2023-08-11T11:53:05.985 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-11T11:53:05.986 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365718 --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/postgres}} --owner scheduled_rishabh@teuthology --name rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi --verbose -- /home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365718/orig.config.yaml 2023-08-11T11:53:06.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T11:53:06.132 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365718 branch: wip-rishabh-2023Aug1-b4 description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/postgres}} email: null first_in_suite: false job_id: '7365718' kernel: client: branch: testing flavor: default kdb: true sha1: a7fb1265323db972dd333f71b9a53e9479f62e37 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-rishabh-2023Aug1-b4 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: 92684807f016ce045ac66e37fdde6f8c47857bcc ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 92684807f016ce045ac66e37fdde6f8c47857bcc kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mountpoint: /tmp/cephfs mntopts: - ms_mode=secure - wsync syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-2023Aug1-b4 sha1: 92684807f016ce045ac66e37fdde6f8c47857bcc owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 sha1: 92684807f016ce045ac66e37fdde6f8c47857bcc sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-2023Aug1-b4 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_92684807f016ce045ac66e37fdde6f8c47857bcc/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 92684807f016ce045ac66e37fdde6f8c47857bcc syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi008.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi045.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi194.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1M - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6M3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 500 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 7fda95956ac10132c9b74016ba832db907df09fa timestamp: 2023-08-10_20:16:46 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2224 2023-08-11T11:53:06.132 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_92684807f016ce045ac66e37fdde6f8c47857bcc/qa; will attempt to use it 2023-08-11T11:53:06.133 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_92684807f016ce045ac66e37fdde6f8c47857bcc/qa/tasks 2023-08-11T11:53:06.133 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-08-11T11:53:06.135 INFO:teuthology.task.internal:Checking packages... 2023-08-11T11:53:06.164 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '92684807f016ce045ac66e37fdde6f8c47857bcc' 2023-08-11T11:53:06.164 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-08-11T11:53:06.165 INFO:teuthology.packaging:ref: None 2023-08-11T11:53:06.165 INFO:teuthology.packaging:tag: None 2023-08-11T11:53:06.165 INFO:teuthology.packaging:branch: wip-rishabh-2023Aug1-b4 2023-08-11T11:53:06.166 INFO:teuthology.packaging:sha1: 92684807f016ce045ac66e37fdde6f8c47857bcc 2023-08-11T11:53:06.166 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-rishabh-2023Aug1-b4 2023-08-11T11:53:06.302 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5437.g92684807 2023-08-11T11:53:06.303 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-08-11T11:53:06.309 INFO:teuthology.task.internal:no buildpackages task found 2023-08-11T11:53:06.309 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-08-11T11:53:06.339 INFO:teuthology.task.internal:Saving configuration 2023-08-11T11:53:06.361 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-08-11T11:53:06.366 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-11T11:53:06.390 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365718', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-11 11:48:13.013822', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-11T11:53:06.414 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365718', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-11 11:48:13.017444', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-11T11:53:06.435 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365718', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-11 11:48:13.015521', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-11T11:53:06.435 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-08-11T11:53:06.441 INFO:teuthology.task.internal:roles: ubuntu@smithi008.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-08-11T11:53:06.441 INFO:teuthology.task.internal:roles: ubuntu@smithi045.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-08-11T11:53:06.441 INFO:teuthology.task.internal:roles: ubuntu@smithi194.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-08-11T11:53:06.442 INFO:teuthology.run_tasks:Running task console_log... 2023-08-11T11:53:06.544 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff0ef0a8160>, signals=[15]) 2023-08-11T11:53:06.545 INFO:teuthology.run_tasks:Running task internal.connect... 2023-08-11T11:53:06.553 INFO:teuthology.task.internal:Opening connections... 2023-08-11T11:53:06.554 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi008.front.sepia.ceph.com 2023-08-11T11:53:06.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T11:53:06.626 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi045.front.sepia.ceph.com 2023-08-11T11:53:06.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T11:53:06.694 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi194.front.sepia.ceph.com 2023-08-11T11:53:06.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T11:53:06.763 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-08-11T11:53:06.776 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2023-08-11T11:53:06.798 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2023-08-11T11:53:06.798 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-08-11T11:53:06.858 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="Red Hat Enterprise Linux" 2023-08-11T11:53:06.859 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8.6 (Ootpa)" 2023-08-11T11:53:06.859 INFO:teuthology.orchestra.run.smithi008.stdout:ID="rhel" 2023-08-11T11:53:06.860 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="fedora" 2023-08-11T11:53:06.860 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8.6" 2023-08-11T11:53:06.860 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2023-08-11T11:53:06.860 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-11T11:53:06.860 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-08-11T11:53:06.860 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-11T11:53:06.860 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://www.redhat.com/" 2023-08-11T11:53:06.861 INFO:teuthology.orchestra.run.smithi008.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-11T11:53:06.861 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-11T11:53:06.861 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T11:53:06.861 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-11T11:53:06.861 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-11T11:53:06.861 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-11T11:53:06.861 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-11T11:53:06.862 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-08-11T11:53:06.884 DEBUG:teuthology.orchestra.run.smithi045:> uname -m 2023-08-11T11:53:06.905 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2023-08-11T11:53:06.905 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2023-08-11T11:53:06.965 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="Red Hat Enterprise Linux" 2023-08-11T11:53:06.965 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8.6 (Ootpa)" 2023-08-11T11:53:06.965 INFO:teuthology.orchestra.run.smithi045.stdout:ID="rhel" 2023-08-11T11:53:06.965 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="fedora" 2023-08-11T11:53:06.965 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8.6" 2023-08-11T11:53:06.966 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8" 2023-08-11T11:53:06.966 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-11T11:53:06.966 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2023-08-11T11:53:06.966 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-11T11:53:06.966 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://www.redhat.com/" 2023-08-11T11:53:06.966 INFO:teuthology.orchestra.run.smithi045.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-11T11:53:06.966 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-11T11:53:06.967 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-08-11T11:53:06.967 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-11T11:53:06.967 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-11T11:53:06.967 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-11T11:53:06.967 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-11T11:53:06.967 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2023-08-11T11:53:06.983 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2023-08-11T11:53:07.003 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2023-08-11T11:53:07.003 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2023-08-11T11:53:07.061 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Red Hat Enterprise Linux" 2023-08-11T11:53:07.062 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="8.6 (Ootpa)" 2023-08-11T11:53:07.062 INFO:teuthology.orchestra.run.smithi194.stdout:ID="rhel" 2023-08-11T11:53:07.062 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="fedora" 2023-08-11T11:53:07.062 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="8.6" 2023-08-11T11:53:07.062 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el8" 2023-08-11T11:53:07.062 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-11T11:53:07.063 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2023-08-11T11:53:07.063 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-11T11:53:07.063 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.redhat.com/" 2023-08-11T11:53:07.063 INFO:teuthology.orchestra.run.smithi194.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-11T11:53:07.063 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-11T11:53:07.063 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-08-11T11:53:07.063 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-11T11:53:07.064 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-11T11:53:07.064 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-11T11:53:07.064 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-11T11:53:07.064 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2023-08-11T11:53:07.083 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-08-11T11:53:07.093 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-08-11T11:53:07.098 INFO:teuthology.task.internal:Checking for old test directory... 2023-08-11T11:53:07.098 DEBUG:teuthology.orchestra.run.smithi008:> test '!' -e /home/ubuntu/cephtest 2023-08-11T11:53:07.101 DEBUG:teuthology.orchestra.run.smithi045:> test '!' -e /home/ubuntu/cephtest 2023-08-11T11:53:07.103 DEBUG:teuthology.orchestra.run.smithi194:> test '!' -e /home/ubuntu/cephtest 2023-08-11T11:53:07.120 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-08-11T11:53:07.126 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-08-11T11:53:07.127 DEBUG:teuthology.orchestra.run.smithi008:> test -z $(ls -A /var/lib/ceph) 2023-08-11T11:53:07.160 DEBUG:teuthology.orchestra.run.smithi045:> test -z $(ls -A /var/lib/ceph) 2023-08-11T11:53:07.163 DEBUG:teuthology.orchestra.run.smithi194:> test -z $(ls -A /var/lib/ceph) 2023-08-11T11:53:07.186 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-08-11T11:53:07.256 INFO:teuthology.run_tasks:Running task kernel... 2023-08-11T11:53:07.270 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a7fb1265323db972dd333f71b9a53e9479f62e37'} 2023-08-11T11:53:07.271 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-08-11T11:53:07.271 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-08-11T11:53:07.271 DEBUG:teuthology.orchestra.run.smithi008:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-11T11:53:07.290 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-11T11:53:07.291 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-08-11T11:53:07.537 DEBUG:teuthology.task.kernel:sha1 for client.0 is a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-11T11:53:07.537 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "a7fb1265323db972dd333f71b9a53e9479f62e37"... 2023-08-11T11:53:07.537 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2023-08-11T11:53:07.557 INFO:teuthology.orchestra.run.smithi008.stdout:4.18.0-372.9.1.el8.x86_64 2023-08-11T11:53:07.557 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-11T11:53:07.558 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-08-11T11:53:07.558 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum upgrade -y linux-firmware 2023-08-11T11:53:08.820 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-08-11T11:53:08.820 INFO:teuthology.orchestra.run.smithi008.stdout:Unable to read consumer identity 2023-08-11T11:53:10.248 INFO:teuthology.orchestra.run.smithi008.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2023-08-11T11:53:11.007 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 21 MB/s | 16 MB 00:00 2023-08-11T11:53:14.599 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 602 kB/s | 24 kB 00:00 2023-08-11T11:53:15.346 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-08-11T11:53:15.347 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-08-11T11:53:15.347 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-08-11T11:53:15.469 INFO:teuthology.task.kernel:Downloading kernel a7fb1265323db972dd333f71b9a53e9479f62e37 on client.0... 2023-08-11T11:53:15.470 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-11T11:53:15.613 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/8/flavors/default/x86_64/ 2023-08-11T11:53:15.613 DEBUG:teuthology.orchestra.run.smithi008:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc4_ga7fb1265323d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/8/flavors/default/x86_64/ --input-file=- 2023-08-11T11:53:15.616 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi008.front.sepia.ceph.com to complete... 2023-08-11T11:53:51.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11 11:53:51 URL:https://1.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/8/flavors/default/x86_64/kernel-6.5.0_rc4_ga7fb1265323d-1.x86_64.rpm [380807140/380807140] -> "/tmp/kernel.x86_64.rpm" [1] 2023-08-11T11:53:51.549 INFO:teuthology.orchestra.run.smithi008.stderr:FINISHED --2023-08-11 11:53:51-- 2023-08-11T11:53:51.549 INFO:teuthology.orchestra.run.smithi008.stderr:Total wall clock time: 36s 2023-08-11T11:53:51.549 INFO:teuthology.orchestra.run.smithi008.stderr:Downloaded: 1 files, 363M in 35s (10.3 MB/s) 2023-08-11T11:53:51.574 INFO:teuthology.task.kernel:Installing kernel a7fb1265323db972dd333f71b9a53e9479f62e37 on client.0... 2023-08-11T11:53:51.574 DEBUG:teuthology.orchestra.run.smithi008:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-08-11T11:53:53.820 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying... ######################################## 2023-08-11T11:53:53.884 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing... ######################################## 2023-08-11T11:53:53.970 INFO:teuthology.orchestra.run.smithi008.stdout:Updating / installing... 2023-08-11T11:54:34.453 INFO:teuthology.orchestra.run.smithi008.stdout:kernel-6.5.0_rc4_ga7fb1265323d-1 ######################################## 2023-08-11T11:55:00.204 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi008.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-08-11T11:55:00.204 DEBUG:teuthology.orchestra.run.smithi008:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-08-11T11:55:00.257 INFO:teuthology.orchestra.run.smithi008.stdout:/boot/System.map-6.5.0-rc4-ga7fb1265323d 2023-08-11T11:55:00.257 INFO:teuthology.orchestra.run.smithi008.stdout:/boot/config-6.5.0-rc4-ga7fb1265323d 2023-08-11T11:55:00.258 INFO:teuthology.orchestra.run.smithi008.stdout:/boot/vmlinuz-6.5.0-rc4-ga7fb1265323d 2023-08-11T11:55:00.258 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d 2023-08-11T11:55:00.258 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel 2023-08-11T11:55:00.258 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch 2023-08-11T11:55:00.258 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86 2023-08-11T11:55:00.258 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto 2023-08-11T11:55:00.258 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-08-11T11:55:00.259 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-08-11T11:55:00.259 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-08-11T11:55:00.259 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-08-11T11:55:00.259 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-08-11T11:55:00.259 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-08-11T11:55:00.259 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-08-11T11:55:00.259 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-08-11T11:55:00.260 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-08-11T11:55:00.260 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-08-11T11:55:00.260 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-08-11T11:55:00.260 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-08-11T11:55:00.260 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-08-11T11:55:00.260 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-08-11T11:55:00.260 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-08-11T11:55:00.260 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-08-11T11:55:00.261 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-08-11T11:55:00.261 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-08-11T11:55:00.261 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-08-11T11:55:00.261 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-08-11T11:55:00.261 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel 2023-08-11T11:55:00.261 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu 2023-08-11T11:55:00.261 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu/mce 2023-08-11T11:55:00.262 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-08-11T11:55:00.262 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm 2023-08-11T11:55:00.262 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm-amd.ko 2023-08-11T11:55:00.262 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm-intel.ko 2023-08-11T11:55:00.262 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm.ko 2023-08-11T11:55:00.262 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto 2023-08-11T11:55:00.262 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/ansi_cprng.ko 2023-08-11T11:55:00.263 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/anubis.ko 2023-08-11T11:55:00.263 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/arc4.ko 2023-08-11T11:55:00.263 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx 2023-08-11T11:55:00.263 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_memcpy.ko 2023-08-11T11:55:00.263 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_pq.ko 2023-08-11T11:55:00.263 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-08-11T11:55:00.263 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_tx.ko 2023-08-11T11:55:00.263 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_xor.ko 2023-08-11T11:55:00.264 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/raid6test.ko 2023-08-11T11:55:00.264 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/authenc.ko 2023-08-11T11:55:00.264 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/authencesn.ko 2023-08-11T11:55:00.264 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blake2b_generic.ko 2023-08-11T11:55:00.264 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blowfish_common.ko 2023-08-11T11:55:00.264 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blowfish_generic.ko 2023-08-11T11:55:00.264 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/camellia_generic.ko 2023-08-11T11:55:00.265 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast5_generic.ko 2023-08-11T11:55:00.265 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast6_generic.ko 2023-08-11T11:55:00.265 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast_common.ko 2023-08-11T11:55:00.265 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/ccm.ko 2023-08-11T11:55:00.265 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cmac.ko 2023-08-11T11:55:00.265 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crc32_generic.ko 2023-08-11T11:55:00.265 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crypto_engine.ko 2023-08-11T11:55:00.266 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crypto_user.ko 2023-08-11T11:55:00.266 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cts.ko 2023-08-11T11:55:00.266 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/des_generic.ko 2023-08-11T11:55:00.266 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/dh_generic.ko 2023-08-11T11:55:00.266 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/echainiv.ko 2023-08-11T11:55:00.266 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/essiv.ko 2023-08-11T11:55:00.266 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/fcrypt.ko 2023-08-11T11:55:00.267 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/khazad.ko 2023-08-11T11:55:00.267 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/lz4.ko 2023-08-11T11:55:00.267 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/lz4hc.ko 2023-08-11T11:55:00.267 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/md4.ko 2023-08-11T11:55:00.267 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/michael_mic.ko 2023-08-11T11:55:00.267 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/pcbc.ko 2023-08-11T11:55:00.267 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/pcrypt.ko 2023-08-11T11:55:00.267 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/rmd160.ko 2023-08-11T11:55:00.268 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/seed.ko 2023-08-11T11:55:00.268 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/serpent_generic.ko 2023-08-11T11:55:00.268 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/tcrypt.ko 2023-08-11T11:55:00.268 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/tea.ko 2023-08-11T11:55:00.268 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/twofish_common.ko 2023-08-11T11:55:00.268 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/twofish_generic.ko 2023-08-11T11:55:00.268 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/vmac.ko 2023-08-11T11:55:00.269 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/wp512.ko 2023-08-11T11:55:00.269 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xcbc.ko 2023-08-11T11:55:00.269 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xor.ko 2023-08-11T11:55:00.269 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xxhash_generic.ko 2023-08-11T11:55:00.269 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers 2023-08-11T11:55:00.269 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi 2023-08-11T11:55:00.269 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/acpi_ipmi.ko 2023-08-11T11:55:00.269 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/acpi_pad.ko 2023-08-11T11:55:00.270 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/custom_method.ko 2023-08-11T11:55:00.270 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/ec_sys.ko 2023-08-11T11:55:00.270 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/platform_profile.ko 2023-08-11T11:55:00.270 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/sbs.ko 2023-08-11T11:55:00.270 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/sbshc.ko 2023-08-11T11:55:00.271 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/video.ko 2023-08-11T11:55:00.271 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata 2023-08-11T11:55:00.271 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/acard-ahci.ko 2023-08-11T11:55:00.271 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/ahci_platform.ko 2023-08-11T11:55:00.271 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/ata_generic.ko 2023-08-11T11:55:00.271 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/libahci_platform.ko 2023-08-11T11:55:00.271 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_acpi.ko 2023-08-11T11:55:00.272 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ali.ko 2023-08-11T11:55:00.272 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_amd.ko 2023-08-11T11:55:00.272 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_artop.ko 2023-08-11T11:55:00.272 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_atiixp.ko 2023-08-11T11:55:00.272 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_atp867x.ko 2023-08-11T11:55:00.272 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cmd640.ko 2023-08-11T11:55:00.272 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cmd64x.ko 2023-08-11T11:55:00.273 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cypress.ko 2023-08-11T11:55:00.273 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_efar.ko 2023-08-11T11:55:00.273 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt366.ko 2023-08-11T11:55:00.273 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt37x.ko 2023-08-11T11:55:00.273 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-08-11T11:55:00.273 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt3x3.ko 2023-08-11T11:55:00.273 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_it8213.ko 2023-08-11T11:55:00.273 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_it821x.ko 2023-08-11T11:55:00.274 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_jmicron.ko 2023-08-11T11:55:00.274 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_marvell.ko 2023-08-11T11:55:00.274 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_mpiix.ko 2023-08-11T11:55:00.274 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_netcell.ko 2023-08-11T11:55:00.274 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ninja32.ko 2023-08-11T11:55:00.274 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ns87410.ko 2023-08-11T11:55:00.274 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ns87415.ko 2023-08-11T11:55:00.275 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_oldpiix.ko 2023-08-11T11:55:00.275 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_opti.ko 2023-08-11T11:55:00.275 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_optidma.ko 2023-08-11T11:55:00.275 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pcmcia.ko 2023-08-11T11:55:00.275 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pdc2027x.ko 2023-08-11T11:55:00.275 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-08-11T11:55:00.275 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_piccolo.ko 2023-08-11T11:55:00.276 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_rdc.ko 2023-08-11T11:55:00.276 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sch.ko 2023-08-11T11:55:00.276 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_serverworks.ko 2023-08-11T11:55:00.276 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sil680.ko 2023-08-11T11:55:00.276 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sis.ko 2023-08-11T11:55:00.276 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sl82c105.ko 2023-08-11T11:55:00.276 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_triflex.ko 2023-08-11T11:55:00.277 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_via.ko 2023-08-11T11:55:00.277 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pdc_adma.ko 2023-08-11T11:55:00.277 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_inic162x.ko 2023-08-11T11:55:00.277 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_mv.ko 2023-08-11T11:55:00.277 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_nv.ko 2023-08-11T11:55:00.277 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_promise.ko 2023-08-11T11:55:00.277 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_qstor.ko 2023-08-11T11:55:00.278 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sil.ko 2023-08-11T11:55:00.278 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sil24.ko 2023-08-11T11:55:00.278 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sis.ko 2023-08-11T11:55:00.278 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_svw.ko 2023-08-11T11:55:00.278 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sx4.ko 2023-08-11T11:55:00.278 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_uli.ko 2023-08-11T11:55:00.278 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_via.ko 2023-08-11T11:55:00.278 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_vsc.ko 2023-08-11T11:55:00.279 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/auxdisplay 2023-08-11T11:55:00.279 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/auxdisplay/ks0108.ko 2023-08-11T11:55:00.279 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base 2023-08-11T11:55:00.279 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap 2023-08-11T11:55:00.279 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-08-11T11:55:00.279 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-08-11T11:55:00.279 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/bcma 2023-08-11T11:55:00.280 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/bcma/bcma.ko 2023-08-11T11:55:00.280 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block 2023-08-11T11:55:00.280 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/aoe 2023-08-11T11:55:00.280 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/aoe/aoe.ko 2023-08-11T11:55:00.280 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/brd.ko 2023-08-11T11:55:00.280 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/drbd 2023-08-11T11:55:00.280 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/drbd/drbd.ko 2023-08-11T11:55:00.281 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/floppy.ko 2023-08-11T11:55:00.281 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/loop.ko 2023-08-11T11:55:00.281 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/mtip32xx 2023-08-11T11:55:00.281 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-08-11T11:55:00.281 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/nbd.ko 2023-08-11T11:55:00.281 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/null_blk 2023-08-11T11:55:00.281 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/null_blk/null_blk.ko 2023-08-11T11:55:00.282 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/pktcdvd.ko 2023-08-11T11:55:00.282 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/rbd.ko 2023-08-11T11:55:00.282 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/virtio_blk.ko 2023-08-11T11:55:00.282 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkback 2023-08-11T11:55:00.282 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-08-11T11:55:00.282 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkfront.ko 2023-08-11T11:55:00.282 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/zram 2023-08-11T11:55:00.282 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/zram/zram.ko 2023-08-11T11:55:00.283 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char 2023-08-11T11:55:00.283 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hangcheck-timer.ko 2023-08-11T11:55:00.283 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random 2023-08-11T11:55:00.283 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/amd-rng.ko 2023-08-11T11:55:00.283 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/intel-rng.ko 2023-08-11T11:55:00.283 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-08-11T11:55:00.283 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/via-rng.ko 2023-08-11T11:55:00.284 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-08-11T11:55:00.284 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi 2023-08-11T11:55:00.284 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-08-11T11:55:00.284 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-08-11T11:55:00.284 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-08-11T11:55:00.284 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-08-11T11:55:00.284 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-08-11T11:55:00.285 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-08-11T11:55:00.285 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/lp.ko 2023-08-11T11:55:00.285 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/mwave 2023-08-11T11:55:00.285 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/mwave/mwave.ko 2023-08-11T11:55:00.285 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ppdev.ko 2023-08-11T11:55:00.285 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tlclk.ko 2023-08-11T11:55:00.285 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm 2023-08-11T11:55:00.286 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm.ko 2023-08-11T11:55:00.286 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-08-11T11:55:00.286 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-08-11T11:55:00.286 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-08-11T11:55:00.286 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_tis.ko 2023-08-11T11:55:00.286 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-08-11T11:55:00.287 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/uv_mmtimer.ko 2023-08-11T11:55:00.287 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/virtio_console.ko 2023-08-11T11:55:00.287 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq 2023-08-11T11:55:00.287 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-08-11T11:55:00.287 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-08-11T11:55:00.287 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-08-11T11:55:00.287 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-08-11T11:55:00.287 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/powernow-k8.ko 2023-08-11T11:55:00.288 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-08-11T11:55:00.288 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto 2023-08-11T11:55:00.288 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp 2023-08-11T11:55:00.288 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-08-11T11:55:00.288 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp/ccp.ko 2023-08-11T11:55:00.288 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel 2023-08-11T11:55:00.288 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat 2023-08-11T11:55:00.289 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_common 2023-08-11T11:55:00.289 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-08-11T11:55:00.289 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-08-11T11:55:00.289 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-08-11T11:55:00.289 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/padlock-aes.ko 2023-08-11T11:55:00.289 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/padlock-sha.ko 2023-08-11T11:55:00.289 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/virtio 2023-08-11T11:55:00.289 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-08-11T11:55:00.290 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dca 2023-08-11T11:55:00.290 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dca/dca.ko 2023-08-11T11:55:00.290 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/devfreq 2023-08-11T11:55:00.290 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-08-11T11:55:00.290 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma 2023-08-11T11:55:00.290 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/dw 2023-08-11T11:55:00.290 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/dw/dw_dmac.ko 2023-08-11T11:55:00.291 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/ioat 2023-08-11T11:55:00.291 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/ioat/ioatdma.ko 2023-08-11T11:55:00.291 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac 2023-08-11T11:55:00.291 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/amd64_edac.ko 2023-08-11T11:55:00.291 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/e752x_edac.ko 2023-08-11T11:55:00.291 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/edac_mce_amd.ko 2023-08-11T11:55:00.291 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i3000_edac.ko 2023-08-11T11:55:00.292 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i3200_edac.ko 2023-08-11T11:55:00.292 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i5100_edac.ko 2023-08-11T11:55:00.292 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i5400_edac.ko 2023-08-11T11:55:00.292 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i7300_edac.ko 2023-08-11T11:55:00.292 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i7core_edac.ko 2023-08-11T11:55:00.292 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i82975x_edac.ko 2023-08-11T11:55:00.292 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/ie31200_edac.ko 2023-08-11T11:55:00.292 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/sb_edac.ko 2023-08-11T11:55:00.293 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/x38_edac.ko 2023-08-11T11:55:00.293 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware 2023-08-11T11:55:00.293 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/edd.ko 2023-08-11T11:55:00.293 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/iscsi_ibft.ko 2023-08-11T11:55:00.293 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio 2023-08-11T11:55:00.293 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-ich.ko 2023-08-11T11:55:00.293 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-viperboard.ko 2023-08-11T11:55:00.294 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid 2023-08-11T11:55:00.294 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-appleir.ko 2023-08-11T11:55:00.294 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-aureal.ko 2023-08-11T11:55:00.294 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-axff.ko 2023-08-11T11:55:00.294 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-dr.ko 2023-08-11T11:55:00.294 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-elecom.ko 2023-08-11T11:55:00.294 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-elo.ko 2023-08-11T11:55:00.294 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-emsff.ko 2023-08-11T11:55:00.295 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gaff.ko 2023-08-11T11:55:00.295 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gt683r.ko 2023-08-11T11:55:00.295 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gyration.ko 2023-08-11T11:55:00.295 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-08-11T11:55:00.295 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-08-11T11:55:00.295 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtekff.ko 2023-08-11T11:55:00.295 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-hyperv.ko 2023-08-11T11:55:00.296 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-icade.ko 2023-08-11T11:55:00.296 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-keytouch.ko 2023-08-11T11:55:00.296 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-kye.ko 2023-08-11T11:55:00.296 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-lcpower.ko 2023-08-11T11:55:00.296 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-led.ko 2023-08-11T11:55:00.296 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-lenovo.ko 2023-08-11T11:55:00.296 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-logitech-dj.ko 2023-08-11T11:55:00.296 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-08-11T11:55:00.297 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-multitouch.ko 2023-08-11T11:55:00.297 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-ortek.ko 2023-08-11T11:55:00.297 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-penmount.ko 2023-08-11T11:55:00.297 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-petalynx.ko 2023-08-11T11:55:00.297 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-picolcd.ko 2023-08-11T11:55:00.297 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-pl.ko 2023-08-11T11:55:00.297 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-plantronics.ko 2023-08-11T11:55:00.298 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-primax.ko 2023-08-11T11:55:00.298 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-rmi.ko 2023-08-11T11:55:00.298 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-08-11T11:55:00.298 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-common.ko 2023-08-11T11:55:00.298 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-isku.ko 2023-08-11T11:55:00.298 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-kone.ko 2023-08-11T11:55:00.298 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-08-11T11:55:00.298 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-08-11T11:55:00.299 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-08-11T11:55:00.299 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-lua.ko 2023-08-11T11:55:00.299 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-08-11T11:55:00.299 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-08-11T11:55:00.299 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-savu.ko 2023-08-11T11:55:00.299 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat.ko 2023-08-11T11:55:00.299 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-saitek.ko 2023-08-11T11:55:00.300 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-samsung.ko 2023-08-11T11:55:00.300 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sensor-hub.ko 2023-08-11T11:55:00.300 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sjoy.ko 2023-08-11T11:55:00.300 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sony.ko 2023-08-11T11:55:00.300 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-speedlink.ko 2023-08-11T11:55:00.300 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-steelseries.ko 2023-08-11T11:55:00.300 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sunplus.ko 2023-08-11T11:55:00.300 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-thrustmaster.ko 2023-08-11T11:55:00.301 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-tivo.ko 2023-08-11T11:55:00.301 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-tmff.ko 2023-08-11T11:55:00.301 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-topseed.ko 2023-08-11T11:55:00.301 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-twinhan.ko 2023-08-11T11:55:00.301 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-uclogic.ko 2023-08-11T11:55:00.301 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-waltop.ko 2023-08-11T11:55:00.301 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-wiimote.ko 2023-08-11T11:55:00.301 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-xinmo.ko 2023-08-11T11:55:00.302 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-zpff.ko 2023-08-11T11:55:00.302 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-zydacron.ko 2023-08-11T11:55:00.302 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/uhid.ko 2023-08-11T11:55:00.302 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/wacom.ko 2023-08-11T11:55:00.302 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv 2023-08-11T11:55:00.302 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_balloon.ko 2023-08-11T11:55:00.302 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_utils.ko 2023-08-11T11:55:00.303 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_vmbus.ko 2023-08-11T11:55:00.303 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon 2023-08-11T11:55:00.303 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/abituguru.ko 2023-08-11T11:55:00.303 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/abituguru3.ko 2023-08-11T11:55:00.303 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-08-11T11:55:00.303 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ad7414.ko 2023-08-11T11:55:00.303 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ad7418.ko 2023-08-11T11:55:00.303 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adc128d818.ko 2023-08-11T11:55:00.304 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1025.ko 2023-08-11T11:55:00.304 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1026.ko 2023-08-11T11:55:00.304 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1029.ko 2023-08-11T11:55:00.304 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1031.ko 2023-08-11T11:55:00.304 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm9240.ko 2023-08-11T11:55:00.304 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ads7828.ko 2023-08-11T11:55:00.304 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7410.ko 2023-08-11T11:55:00.305 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7411.ko 2023-08-11T11:55:00.305 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7462.ko 2023-08-11T11:55:00.305 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7470.ko 2023-08-11T11:55:00.305 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7475.ko 2023-08-11T11:55:00.305 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7x10.ko 2023-08-11T11:55:00.305 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/amc6821.ko 2023-08-11T11:55:00.305 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/applesmc.ko 2023-08-11T11:55:00.305 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asb100.ko 2023-08-11T11:55:00.306 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asc7621.ko 2023-08-11T11:55:00.306 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asus_atk0110.ko 2023-08-11T11:55:00.306 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/atxp1.ko 2023-08-11T11:55:00.306 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/coretemp.ko 2023-08-11T11:55:00.306 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-08-11T11:55:00.306 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/dme1737.ko 2023-08-11T11:55:00.307 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ds1621.ko 2023-08-11T11:55:00.307 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ds620.ko 2023-08-11T11:55:00.307 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/emc1403.ko 2023-08-11T11:55:00.307 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/emc6w201.ko 2023-08-11T11:55:00.307 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f71805f.ko 2023-08-11T11:55:00.307 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f71882fg.ko 2023-08-11T11:55:00.307 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f75375s.ko 2023-08-11T11:55:00.307 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/fam15h_power.ko 2023-08-11T11:55:00.308 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/fschmd.ko 2023-08-11T11:55:00.308 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/g760a.ko 2023-08-11T11:55:00.308 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/g762.ko 2023-08-11T11:55:00.308 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/gl518sm.ko 2023-08-11T11:55:00.308 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/gl520sm.ko 2023-08-11T11:55:00.308 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/hwmon-vid.ko 2023-08-11T11:55:00.308 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/i5500_temp.ko 2023-08-11T11:55:00.309 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/i5k_amb.ko 2023-08-11T11:55:00.309 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ibmaem.ko 2023-08-11T11:55:00.309 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ibmpex.ko 2023-08-11T11:55:00.309 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ina209.ko 2023-08-11T11:55:00.309 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ina2xx.ko 2023-08-11T11:55:00.309 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/it87.ko 2023-08-11T11:55:00.309 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/k10temp.ko 2023-08-11T11:55:00.309 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/k8temp.ko 2023-08-11T11:55:00.310 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lineage-pem.ko 2023-08-11T11:55:00.310 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm63.ko 2023-08-11T11:55:00.310 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm73.ko 2023-08-11T11:55:00.310 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm75.ko 2023-08-11T11:55:00.310 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm77.ko 2023-08-11T11:55:00.310 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm78.ko 2023-08-11T11:55:00.310 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm80.ko 2023-08-11T11:55:00.311 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm83.ko 2023-08-11T11:55:00.311 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm85.ko 2023-08-11T11:55:00.311 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm87.ko 2023-08-11T11:55:00.311 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm90.ko 2023-08-11T11:55:00.311 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm92.ko 2023-08-11T11:55:00.311 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm93.ko 2023-08-11T11:55:00.311 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95234.ko 2023-08-11T11:55:00.311 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95241.ko 2023-08-11T11:55:00.312 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95245.ko 2023-08-11T11:55:00.312 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc2945.ko 2023-08-11T11:55:00.312 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4151.ko 2023-08-11T11:55:00.312 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4215.ko 2023-08-11T11:55:00.312 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4222.ko 2023-08-11T11:55:00.312 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4245.ko 2023-08-11T11:55:00.312 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4260.ko 2023-08-11T11:55:00.313 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4261.ko 2023-08-11T11:55:00.313 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max16065.ko 2023-08-11T11:55:00.313 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max1619.ko 2023-08-11T11:55:00.313 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max1668.ko 2023-08-11T11:55:00.313 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max197.ko 2023-08-11T11:55:00.313 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6639.ko 2023-08-11T11:55:00.313 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6650.ko 2023-08-11T11:55:00.313 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6697.ko 2023-08-11T11:55:00.314 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/mcp3021.ko 2023-08-11T11:55:00.314 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6683.ko 2023-08-11T11:55:00.314 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6775-core.ko 2023-08-11T11:55:00.314 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6775.ko 2023-08-11T11:55:00.314 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct7802.ko 2023-08-11T11:55:00.314 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pc87360.ko 2023-08-11T11:55:00.314 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pc87427.ko 2023-08-11T11:55:00.314 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pcf8591.ko 2023-08-11T11:55:00.315 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus 2023-08-11T11:55:00.315 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-08-11T11:55:00.315 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-08-11T11:55:00.315 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-08-11T11:55:00.315 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-08-11T11:55:00.315 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-08-11T11:55:00.315 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-08-11T11:55:00.316 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-08-11T11:55:00.316 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-08-11T11:55:00.316 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-08-11T11:55:00.316 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-08-11T11:55:00.316 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-08-11T11:55:00.316 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-08-11T11:55:00.316 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/powr1220.ko 2023-08-11T11:55:00.317 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch5627.ko 2023-08-11T11:55:00.317 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch5636.ko 2023-08-11T11:55:00.317 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch56xx-common.ko 2023-08-11T11:55:00.317 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sht15.ko 2023-08-11T11:55:00.317 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sht21.ko 2023-08-11T11:55:00.317 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/shtc1.ko 2023-08-11T11:55:00.318 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sis5595.ko 2023-08-11T11:55:00.318 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47b397.ko 2023-08-11T11:55:00.318 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47m1.ko 2023-08-11T11:55:00.318 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47m192.ko 2023-08-11T11:55:00.318 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/thmc50.ko 2023-08-11T11:55:00.318 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp102.ko 2023-08-11T11:55:00.318 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp103.ko 2023-08-11T11:55:00.318 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp401.ko 2023-08-11T11:55:00.319 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp421.ko 2023-08-11T11:55:00.319 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/via-cputemp.ko 2023-08-11T11:55:00.319 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/via686a.ko 2023-08-11T11:55:00.319 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/vt1211.ko 2023-08-11T11:55:00.319 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/vt8231.ko 2023-08-11T11:55:00.319 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83627ehf.ko 2023-08-11T11:55:00.319 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83627hf.ko 2023-08-11T11:55:00.320 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83781d.ko 2023-08-11T11:55:00.320 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83791d.ko 2023-08-11T11:55:00.320 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83792d.ko 2023-08-11T11:55:00.320 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83793.ko 2023-08-11T11:55:00.320 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83795.ko 2023-08-11T11:55:00.320 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83l785ts.ko 2023-08-11T11:55:00.320 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83l786ng.ko 2023-08-11T11:55:00.320 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c 2023-08-11T11:55:00.321 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos 2023-08-11T11:55:00.321 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-08-11T11:55:00.321 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-08-11T11:55:00.321 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses 2023-08-11T11:55:00.321 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-08-11T11:55:00.321 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-08-11T11:55:00.321 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-08-11T11:55:00.321 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-08-11T11:55:00.322 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-08-11T11:55:00.322 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-08-11T11:55:00.322 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-08-11T11:55:00.322 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-08-11T11:55:00.322 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-08-11T11:55:00.322 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-08-11T11:55:00.322 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-08-11T11:55:00.323 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-08-11T11:55:00.323 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-08-11T11:55:00.323 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-08-11T11:55:00.323 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-08-11T11:55:00.323 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-08-11T11:55:00.323 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-08-11T11:55:00.323 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-08-11T11:55:00.324 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-08-11T11:55:00.324 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-08-11T11:55:00.324 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-via.ko 2023-08-11T11:55:00.324 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-08-11T11:55:00.324 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-08-11T11:55:00.324 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-dev.ko 2023-08-11T11:55:00.324 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-mux.ko 2023-08-11T11:55:00.324 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-08-11T11:55:00.325 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-smbus.ko 2023-08-11T11:55:00.325 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-stub.ko 2023-08-11T11:55:00.325 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband 2023-08-11T11:55:00.325 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core 2023-08-11T11:55:00.325 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_cm.ko 2023-08-11T11:55:00.325 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_core.ko 2023-08-11T11:55:00.325 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_umad.ko 2023-08-11T11:55:00.326 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-08-11T11:55:00.326 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/iw_cm.ko 2023-08-11T11:55:00.326 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-08-11T11:55:00.326 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-08-11T11:55:00.326 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw 2023-08-11T11:55:00.326 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/cxgb4 2023-08-11T11:55:00.326 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-08-11T11:55:00.327 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx4 2023-08-11T11:55:00.327 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-08-11T11:55:00.327 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx5 2023-08-11T11:55:00.327 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-08-11T11:55:00.327 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mthca 2023-08-11T11:55:00.327 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-08-11T11:55:00.327 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp 2023-08-11T11:55:00.328 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/ipoib 2023-08-11T11:55:00.328 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-08-11T11:55:00.328 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/iser 2023-08-11T11:55:00.328 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-08-11T11:55:00.328 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/isert 2023-08-11T11:55:00.328 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-08-11T11:55:00.329 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srp 2023-08-11T11:55:00.329 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-08-11T11:55:00.329 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srpt 2023-08-11T11:55:00.329 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-08-11T11:55:00.329 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input 2023-08-11T11:55:00.329 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport 2023-08-11T11:55:00.329 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-08-11T11:55:00.329 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/fm801-gp.ko 2023-08-11T11:55:00.330 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/gameport.ko 2023-08-11T11:55:00.330 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/lightning.ko 2023-08-11T11:55:00.330 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/ns558.ko 2023-08-11T11:55:00.330 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/joydev.ko 2023-08-11T11:55:00.330 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard 2023-08-11T11:55:00.330 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-08-11T11:55:00.330 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse 2023-08-11T11:55:00.331 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/appletouch.ko 2023-08-11T11:55:00.331 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/bcm5974.ko 2023-08-11T11:55:00.331 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/cyapatp.ko 2023-08-11T11:55:00.331 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/elan_i2c.ko 2023-08-11T11:55:00.331 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/sermouse.ko 2023-08-11T11:55:00.331 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-08-11T11:55:00.331 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-08-11T11:55:00.332 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-08-11T11:55:00.332 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/rmi4 2023-08-11T11:55:00.332 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/rmi4/rmi_core.ko 2023-08-11T11:55:00.332 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio 2023-08-11T11:55:00.332 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/altera_ps2.ko 2023-08-11T11:55:00.332 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/arc_ps2.ko 2023-08-11T11:55:00.332 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-08-11T11:55:00.332 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/serio_raw.ko 2023-08-11T11:55:00.333 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/sparse-keymap.ko 2023-08-11T11:55:00.333 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu 2023-08-11T11:55:00.333 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu/amd 2023-08-11T11:55:00.333 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-08-11T11:55:00.333 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds 2023-08-11T11:55:00.333 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-blinkm.ko 2023-08-11T11:55:00.333 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lm3530.ko 2023-08-11T11:55:00.334 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lp3944.ko 2023-08-11T11:55:00.334 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-ss4200.ko 2023-08-11T11:55:00.334 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger 2023-08-11T11:55:00.334 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-08-11T11:55:00.334 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-08-11T11:55:00.334 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-08-11T11:55:00.334 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-08-11T11:55:00.334 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-08-11T11:55:00.335 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-08-11T11:55:00.335 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-08-11T11:55:00.335 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-08-11T11:55:00.335 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md 2023-08-11T11:55:00.335 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/bcache 2023-08-11T11:55:00.335 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/bcache/bcache.ko 2023-08-11T11:55:00.335 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-bio-prison.ko 2023-08-11T11:55:00.336 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-cache-smq.ko 2023-08-11T11:55:00.336 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-cache.ko 2023-08-11T11:55:00.336 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-crypt.ko 2023-08-11T11:55:00.336 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-delay.ko 2023-08-11T11:55:00.336 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-flakey.ko 2023-08-11T11:55:00.336 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-log-userspace.ko 2023-08-11T11:55:00.336 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-multipath.ko 2023-08-11T11:55:00.336 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-queue-length.ko 2023-08-11T11:55:00.337 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-raid.ko 2023-08-11T11:55:00.337 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-round-robin.ko 2023-08-11T11:55:00.337 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-service-time.ko 2023-08-11T11:55:00.337 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-switch.ko 2023-08-11T11:55:00.337 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-thin-pool.ko 2023-08-11T11:55:00.337 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-verity.ko 2023-08-11T11:55:00.337 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/faulty.ko 2023-08-11T11:55:00.338 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/linear.ko 2023-08-11T11:55:00.338 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/multipath.ko 2023-08-11T11:55:00.338 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/persistent-data 2023-08-11T11:55:00.338 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-08-11T11:55:00.338 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid0.ko 2023-08-11T11:55:00.338 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid1.ko 2023-08-11T11:55:00.338 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid10.ko 2023-08-11T11:55:00.339 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid456.ko 2023-08-11T11:55:00.339 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message 2023-08-11T11:55:00.339 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion 2023-08-11T11:55:00.339 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptbase.ko 2023-08-11T11:55:00.339 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptctl.ko 2023-08-11T11:55:00.339 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptfc.ko 2023-08-11T11:55:00.339 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptlan.ko 2023-08-11T11:55:00.339 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptsas.ko 2023-08-11T11:55:00.340 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptscsih.ko 2023-08-11T11:55:00.340 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptspi.ko 2023-08-11T11:55:00.340 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd 2023-08-11T11:55:00.340 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lpc_ich.ko 2023-08-11T11:55:00.340 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lpc_sch.ko 2023-08-11T11:55:00.340 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/mfd-core.ko 2023-08-11T11:55:00.340 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/sm501.ko 2023-08-11T11:55:00.340 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/viperboard.ko 2023-08-11T11:55:00.341 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/vx855.ko 2023-08-11T11:55:00.341 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/wl1273-core.ko 2023-08-11T11:55:00.341 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc 2023-08-11T11:55:00.341 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/altera-stapl 2023-08-11T11:55:00.341 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-08-11T11:55:00.341 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/apds9802als.ko 2023-08-11T11:55:00.341 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/apds990x.ko 2023-08-11T11:55:00.342 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/bh1770glc.ko 2023-08-11T11:55:00.342 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/cb710 2023-08-11T11:55:00.342 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/cb710/cb710.ko 2023-08-11T11:55:00.342 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom 2023-08-11T11:55:00.342 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/at24.ko 2023-08-11T11:55:00.342 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/eeprom.ko 2023-08-11T11:55:00.342 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-08-11T11:55:00.342 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/max6875.ko 2023-08-11T11:55:00.343 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/enclosure.ko 2023-08-11T11:55:00.343 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/hpilo.ko 2023-08-11T11:55:00.343 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/isl29003.ko 2023-08-11T11:55:00.343 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/isl29020.ko 2023-08-11T11:55:00.343 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d 2023-08-11T11:55:00.343 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-08-11T11:55:00.343 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-08-11T11:55:00.344 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei 2023-08-11T11:55:00.344 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei-me.ko 2023-08-11T11:55:00.344 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei-txe.ko 2023-08-11T11:55:00.344 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei.ko 2023-08-11T11:55:00.344 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-gru 2023-08-11T11:55:00.344 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-gru/gru.ko 2023-08-11T11:55:00.344 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp 2023-08-11T11:55:00.345 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xp.ko 2023-08-11T11:55:00.345 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-08-11T11:55:00.345 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-08-11T11:55:00.345 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tifm_7xx1.ko 2023-08-11T11:55:00.345 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tifm_core.ko 2023-08-11T11:55:00.345 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tsl2550.ko 2023-08-11T11:55:00.345 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_balloon.ko 2023-08-11T11:55:00.346 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_vmci 2023-08-11T11:55:00.346 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-08-11T11:55:00.346 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net 2023-08-11T11:55:00.346 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/bonding 2023-08-11T11:55:00.346 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/bonding/bonding.ko 2023-08-11T11:55:00.346 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa 2023-08-11T11:55:00.346 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/b53 2023-08-11T11:55:00.346 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-08-11T11:55:00.347 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-08-11T11:55:00.347 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6060.ko 2023-08-11T11:55:00.347 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6xxx 2023-08-11T11:55:00.347 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-08-11T11:55:00.347 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dummy.ko 2023-08-11T11:55:00.347 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/eql.ko 2023-08-11T11:55:00.347 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet 2023-08-11T11:55:00.348 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com 2023-08-11T11:55:00.348 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-08-11T11:55:00.348 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-08-11T11:55:00.348 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-08-11T11:55:00.348 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-08-11T11:55:00.348 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390 2023-08-11T11:55:00.348 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/8390.ko 2023-08-11T11:55:00.348 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-08-11T11:55:00.349 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-08-11T11:55:00.349 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-08-11T11:55:00.349 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/adaptec 2023-08-11T11:55:00.349 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-08-11T11:55:00.349 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/agere 2023-08-11T11:55:00.349 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-08-11T11:55:00.349 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/alteon 2023-08-11T11:55:00.350 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-08-11T11:55:00.350 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/altera 2023-08-11T11:55:00.350 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-08-11T11:55:00.350 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd 2023-08-11T11:55:00.350 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-08-11T11:55:00.350 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-08-11T11:55:00.350 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-08-11T11:55:00.350 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros 2023-08-11T11:55:00.351 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/alx 2023-08-11T11:55:00.351 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-08-11T11:55:00.351 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1c 2023-08-11T11:55:00.351 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-08-11T11:55:00.351 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1e 2023-08-11T11:55:00.351 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-08-11T11:55:00.351 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx 2023-08-11T11:55:00.351 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-08-11T11:55:00.352 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-08-11T11:55:00.352 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom 2023-08-11T11:55:00.352 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-08-11T11:55:00.352 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-08-11T11:55:00.352 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-08-11T11:55:00.352 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-08-11T11:55:00.352 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-08-11T11:55:00.353 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/genet 2023-08-11T11:55:00.353 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-08-11T11:55:00.353 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-08-11T11:55:00.353 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade 2023-08-11T11:55:00.353 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade/bna 2023-08-11T11:55:00.353 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-08-11T11:55:00.353 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio 2023-08-11T11:55:00.354 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-08-11T11:55:00.354 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-08-11T11:55:00.354 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-08-11T11:55:00.354 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-08-11T11:55:00.354 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-08-11T11:55:00.354 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-08-11T11:55:00.354 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-08-11T11:55:00.354 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-08-11T11:55:00.355 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-08-11T11:55:00.355 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-08-11T11:55:00.355 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco 2023-08-11T11:55:00.355 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco/enic 2023-08-11T11:55:00.355 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-08-11T11:55:00.355 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec 2023-08-11T11:55:00.355 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip 2023-08-11T11:55:00.355 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-08-11T11:55:00.356 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-08-11T11:55:00.356 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-08-11T11:55:00.356 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-08-11T11:55:00.356 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-08-11T11:55:00.356 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-08-11T11:55:00.356 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink 2023-08-11T11:55:00.356 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-08-11T11:55:00.357 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-08-11T11:55:00.357 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dnet.ko 2023-08-11T11:55:00.357 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex 2023-08-11T11:55:00.357 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex/benet 2023-08-11T11:55:00.357 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-08-11T11:55:00.357 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ethoc.ko 2023-08-11T11:55:00.357 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/fealnx.ko 2023-08-11T11:55:00.358 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel 2023-08-11T11:55:00.358 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e100.ko 2023-08-11T11:55:00.358 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000 2023-08-11T11:55:00.358 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-08-11T11:55:00.358 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000e 2023-08-11T11:55:00.358 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-08-11T11:55:00.358 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/fm10k 2023-08-11T11:55:00.358 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-08-11T11:55:00.359 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/i40e 2023-08-11T11:55:00.359 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-08-11T11:55:00.359 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/iavf 2023-08-11T11:55:00.359 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-08-11T11:55:00.359 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igb 2023-08-11T11:55:00.359 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-08-11T11:55:00.359 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igbvf 2023-08-11T11:55:00.360 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-08-11T11:55:00.360 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbe 2023-08-11T11:55:00.360 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-08-11T11:55:00.360 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-08-11T11:55:00.360 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-08-11T11:55:00.360 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/jme.ko 2023-08-11T11:55:00.360 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell 2023-08-11T11:55:00.361 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-08-11T11:55:00.361 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-08-11T11:55:00.361 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-08-11T11:55:00.361 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox 2023-08-11T11:55:00.361 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-08-11T11:55:00.361 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-08-11T11:55:00.361 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-08-11T11:55:00.361 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-08-11T11:55:00.362 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-08-11T11:55:00.362 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-08-11T11:55:00.362 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel 2023-08-11T11:55:00.362 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-08-11T11:55:00.362 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom 2023-08-11T11:55:00.362 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-08-11T11:55:00.362 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-08-11T11:55:00.362 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi 2023-08-11T11:55:00.363 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-08-11T11:55:00.363 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-08-11T11:55:00.363 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/neterion 2023-08-11T11:55:00.363 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-08-11T11:55:00.363 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/nvidia 2023-08-11T11:55:00.363 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-08-11T11:55:00.363 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines 2023-08-11T11:55:00.364 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-08-11T11:55:00.364 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-08-11T11:55:00.364 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic 2023-08-11T11:55:00.364 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/netxen 2023-08-11T11:55:00.364 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-08-11T11:55:00.364 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-08-11T11:55:00.364 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-08-11T11:55:00.364 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-08-11T11:55:00.365 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rdc 2023-08-11T11:55:00.365 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-08-11T11:55:00.365 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek 2023-08-11T11:55:00.365 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-08-11T11:55:00.365 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-08-11T11:55:00.365 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-08-11T11:55:00.365 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-08-11T11:55:00.366 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rocker 2023-08-11T11:55:00.366 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-08-11T11:55:00.366 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sfc 2023-08-11T11:55:00.366 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-08-11T11:55:00.366 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/silan 2023-08-11T11:55:00.366 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-08-11T11:55:00.366 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis 2023-08-11T11:55:00.367 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-08-11T11:55:00.367 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-08-11T11:55:00.367 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc 2023-08-11T11:55:00.367 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-08-11T11:55:00.367 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-08-11T11:55:00.367 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-08-11T11:55:00.367 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-08-11T11:55:00.367 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro 2023-08-11T11:55:00.368 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-08-11T11:55:00.368 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-08-11T11:55:00.368 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-08-11T11:55:00.368 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun 2023-08-11T11:55:00.368 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-08-11T11:55:00.368 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/niu.ko 2023-08-11T11:55:00.368 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-08-11T11:55:00.369 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-08-11T11:55:00.369 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/tehuti 2023-08-11T11:55:00.369 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-08-11T11:55:00.369 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ti 2023-08-11T11:55:00.369 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-08-11T11:55:00.369 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via 2023-08-11T11:55:00.369 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-08-11T11:55:00.369 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-08-11T11:55:00.370 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet 2023-08-11T11:55:00.370 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-08-11T11:55:00.370 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-08-11T11:55:00.370 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/xircom 2023-08-11T11:55:00.370 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-08-11T11:55:00.370 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/geneve.ko 2023-08-11T11:55:00.370 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/hyperv 2023-08-11T11:55:00.370 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-08-11T11:55:00.371 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ieee802154 2023-08-11T11:55:00.371 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ieee802154/fakelb.ko 2023-08-11T11:55:00.371 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ifb.ko 2023-08-11T11:55:00.371 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ipvlan 2023-08-11T11:55:00.371 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-08-11T11:55:00.371 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/macvlan.ko 2023-08-11T11:55:00.371 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/macvtap.ko 2023-08-11T11:55:00.372 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio 2023-08-11T11:55:00.372 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio.ko 2023-08-11T11:55:00.372 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-08-11T11:55:00.372 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-08-11T11:55:00.372 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-08-11T11:55:00.372 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mii.ko 2023-08-11T11:55:00.372 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/net_failover.ko 2023-08-11T11:55:00.373 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/netconsole.ko 2023-08-11T11:55:00.373 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/nlmon.ko 2023-08-11T11:55:00.373 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs 2023-08-11T11:55:00.373 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-08-11T11:55:00.373 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-08-11T11:55:00.373 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy 2023-08-11T11:55:00.373 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/amd.ko 2023-08-11T11:55:00.373 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-08-11T11:55:00.374 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-08-11T11:55:00.374 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm7xxx.ko 2023-08-11T11:55:00.374 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm87xx.ko 2023-08-11T11:55:00.374 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/broadcom.ko 2023-08-11T11:55:00.374 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/cicada.ko 2023-08-11T11:55:00.374 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/davicom.ko 2023-08-11T11:55:00.374 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/dp83640.ko 2023-08-11T11:55:00.374 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/et1011c.ko 2023-08-11T11:55:00.375 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/icplus.ko 2023-08-11T11:55:00.375 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/lxt.ko 2023-08-11T11:55:00.375 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/marvell.ko 2023-08-11T11:55:00.375 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/micrel.ko 2023-08-11T11:55:00.375 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/national.ko 2023-08-11T11:55:00.375 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/phylink.ko 2023-08-11T11:55:00.375 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/qsemi.ko 2023-08-11T11:55:00.376 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/realtek.ko 2023-08-11T11:55:00.376 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/smsc.ko 2023-08-11T11:55:00.376 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/ste10Xp.ko 2023-08-11T11:55:00.376 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/vitesse.ko 2023-08-11T11:55:00.376 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp 2023-08-11T11:55:00.376 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/bsd_comp.ko 2023-08-11T11:55:00.376 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_async.ko 2023-08-11T11:55:00.377 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-08-11T11:55:00.377 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_generic.ko 2023-08-11T11:55:00.377 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-08-11T11:55:00.377 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-08-11T11:55:00.377 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pppoe.ko 2023-08-11T11:55:00.377 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pppox.ko 2023-08-11T11:55:00.377 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pptp.ko 2023-08-11T11:55:00.377 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip 2023-08-11T11:55:00.378 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip/slhc.ko 2023-08-11T11:55:00.378 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip/slip.ko 2023-08-11T11:55:00.378 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/sungem_phy.ko 2023-08-11T11:55:00.378 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/tap.ko 2023-08-11T11:55:00.378 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team 2023-08-11T11:55:00.378 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team.ko 2023-08-11T11:55:00.378 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-08-11T11:55:00.378 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-08-11T11:55:00.379 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-08-11T11:55:00.379 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_random.ko 2023-08-11T11:55:00.379 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-08-11T11:55:00.379 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/tun.ko 2023-08-11T11:55:00.379 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/veth.ko 2023-08-11T11:55:00.379 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/virtio_net.ko 2023-08-11T11:55:00.379 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vmxnet3 2023-08-11T11:55:00.380 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-08-11T11:55:00.380 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vxlan 2023-08-11T11:55:00.380 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vxlan/vxlan.ko 2023-08-11T11:55:00.380 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netback 2023-08-11T11:55:00.380 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-08-11T11:55:00.380 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netfront.ko 2023-08-11T11:55:00.380 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ntb 2023-08-11T11:55:00.380 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ntb/ntb.ko 2023-08-11T11:55:00.381 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme 2023-08-11T11:55:00.381 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host 2023-08-11T11:55:00.381 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host/nvme-core.ko 2023-08-11T11:55:00.381 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host/nvme.ko 2023-08-11T11:55:00.381 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport 2023-08-11T11:55:00.381 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport.ko 2023-08-11T11:55:00.381 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_cs.ko 2023-08-11T11:55:00.382 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_pc.ko 2023-08-11T11:55:00.382 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_serial.ko 2023-08-11T11:55:00.382 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci 2023-08-11T11:55:00.382 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/hotplug 2023-08-11T11:55:00.382 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-08-11T11:55:00.382 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/pcie 2023-08-11T11:55:00.382 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/pcie/aer_inject.ko 2023-08-11T11:55:00.382 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/xen-pcifront.ko 2023-08-11T11:55:00.383 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia 2023-08-11T11:55:00.383 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/i82092.ko 2023-08-11T11:55:00.383 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/pd6729.ko 2023-08-11T11:55:00.383 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/yenta_socket.ko 2023-08-11T11:55:00.383 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl 2023-08-11T11:55:00.383 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl/intel 2023-08-11T11:55:00.383 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-08-11T11:55:00.383 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform 2023-08-11T11:55:00.384 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86 2023-08-11T11:55:00.384 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/acer-wmi.ko 2023-08-11T11:55:00.384 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/acerhdf.ko 2023-08-11T11:55:00.384 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/apple-gmux.ko 2023-08-11T11:55:00.384 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-laptop.ko 2023-08-11T11:55:00.384 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-08-11T11:55:00.384 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-wmi.ko 2023-08-11T11:55:00.385 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-08-11T11:55:00.385 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-08-11T11:55:00.385 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-08-11T11:55:00.385 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-08-11T11:55:00.385 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-08-11T11:55:00.385 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/hdaps.ko 2023-08-11T11:55:00.385 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel 2023-08-11T11:55:00.385 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-08-11T11:55:00.386 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel_ips.ko 2023-08-11T11:55:00.386 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/msi-wmi.ko 2023-08-11T11:55:00.386 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-08-11T11:55:00.386 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-08-11T11:55:00.386 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-08-11T11:55:00.386 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/samsung-q10.ko 2023-08-11T11:55:00.386 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-08-11T11:55:00.387 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-08-11T11:55:00.387 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-08-11T11:55:00.387 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-08-11T11:55:00.387 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/wmi.ko 2023-08-11T11:55:00.387 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap 2023-08-11T11:55:00.387 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap/intel_rapl_common.ko 2023-08-11T11:55:00.387 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-08-11T11:55:00.387 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps 2023-08-11T11:55:00.388 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients 2023-08-11T11:55:00.388 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps-gpio.ko 2023-08-11T11:55:00.388 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-08-11T11:55:00.388 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps_parport.ko 2023-08-11T11:55:00.388 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/pps_core.ko 2023-08-11T11:55:00.388 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp 2023-08-11T11:55:00.388 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp/ptp.ko 2023-08-11T11:55:00.389 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp/ptp_kvm.ko 2023-08-11T11:55:00.389 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc 2023-08-11T11:55:00.389 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-bq32k.ko 2023-08-11T11:55:00.389 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-bq4802.ko 2023-08-11T11:55:00.389 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1286.ko 2023-08-11T11:55:00.389 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1307.ko 2023-08-11T11:55:00.389 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1374.ko 2023-08-11T11:55:00.389 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1511.ko 2023-08-11T11:55:00.390 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1553.ko 2023-08-11T11:55:00.390 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1672.ko 2023-08-11T11:55:00.390 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1742.ko 2023-08-11T11:55:00.390 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds2404.ko 2023-08-11T11:55:00.390 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds3232.ko 2023-08-11T11:55:00.390 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-em3027.ko 2023-08-11T11:55:00.390 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-fm3130.ko 2023-08-11T11:55:00.391 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-isl12022.ko 2023-08-11T11:55:00.391 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-isl1208.ko 2023-08-11T11:55:00.391 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m41t80.ko 2023-08-11T11:55:00.391 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m48t35.ko 2023-08-11T11:55:00.391 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m48t59.ko 2023-08-11T11:55:00.391 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-max6900.ko 2023-08-11T11:55:00.391 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-msm6242.ko 2023-08-11T11:55:00.391 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-08-11T11:55:00.392 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-08-11T11:55:00.392 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-08-11T11:55:00.392 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-08-11T11:55:00.392 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-08-11T11:55:00.392 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-08-11T11:55:00.392 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-08-11T11:55:00.392 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-08-11T11:55:00.392 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rx8025.ko 2023-08-11T11:55:00.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rx8581.ko 2023-08-11T11:55:00.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-08-11T11:55:00.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-x1205.ko 2023-08-11T11:55:00.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi 2023-08-11T11:55:00.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-9xxx.ko 2023-08-11T11:55:00.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-sas.ko 2023-08-11T11:55:00.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-xxxx.ko 2023-08-11T11:55:00.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/BusLogic.ko 2023-08-11T11:55:00.394 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/a100u2w.ko 2023-08-11T11:55:00.394 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aacraid 2023-08-11T11:55:00.394 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-08-11T11:55:00.394 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/advansys.ko 2023-08-11T11:55:00.394 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx 2023-08-11T11:55:00.394 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-08-11T11:55:00.394 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-08-11T11:55:00.395 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/am53c974.ko 2023-08-11T11:55:00.395 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/arcmsr 2023-08-11T11:55:00.395 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-08-11T11:55:00.395 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/atp870u.ko 2023-08-11T11:55:00.395 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/be2iscsi 2023-08-11T11:55:00.395 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-08-11T11:55:00.395 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bfa 2023-08-11T11:55:00.395 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bfa/bfa.ko 2023-08-11T11:55:00.396 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2fc 2023-08-11T11:55:00.396 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-08-11T11:55:00.396 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2i 2023-08-11T11:55:00.396 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-08-11T11:55:00.396 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ch.ko 2023-08-11T11:55:00.396 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/csiostor 2023-08-11T11:55:00.396 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-08-11T11:55:00.397 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi 2023-08-11T11:55:00.397 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-08-11T11:55:00.397 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-08-11T11:55:00.397 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-08-11T11:55:00.397 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-08-11T11:55:00.397 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-08-11T11:55:00.397 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/dc395x.ko 2023-08-11T11:55:00.398 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler 2023-08-11T11:55:00.398 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-08-11T11:55:00.398 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-08-11T11:55:00.398 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-08-11T11:55:00.398 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-08-11T11:55:00.398 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/dmx3191d.ko 2023-08-11T11:55:00.398 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esas2r 2023-08-11T11:55:00.399 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-08-11T11:55:00.399 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esp_scsi.ko 2023-08-11T11:55:00.399 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe 2023-08-11T11:55:00.399 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-08-11T11:55:00.399 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-08-11T11:55:00.399 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fnic 2023-08-11T11:55:00.399 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fnic/fnic.ko 2023-08-11T11:55:00.400 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hpsa.ko 2023-08-11T11:55:00.400 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hptiop.ko 2023-08-11T11:55:00.400 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hv_storvsc.ko 2023-08-11T11:55:00.400 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/initio.ko 2023-08-11T11:55:00.400 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ipr.ko 2023-08-11T11:55:00.400 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ips.ko 2023-08-11T11:55:00.400 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/isci 2023-08-11T11:55:00.401 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/isci/isci.ko 2023-08-11T11:55:00.401 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-08-11T11:55:00.401 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/iscsi_tcp.ko 2023-08-11T11:55:00.401 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libfc 2023-08-11T11:55:00.401 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libfc/libfc.ko 2023-08-11T11:55:00.401 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libiscsi.ko 2023-08-11T11:55:00.402 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-08-11T11:55:00.402 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libsas 2023-08-11T11:55:00.402 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libsas/libsas.ko 2023-08-11T11:55:00.402 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/lpfc 2023-08-11T11:55:00.402 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-08-11T11:55:00.402 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid 2023-08-11T11:55:00.402 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid.ko 2023-08-11T11:55:00.402 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-08-11T11:55:00.403 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-08-11T11:55:00.403 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-08-11T11:55:00.403 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mpt3sas 2023-08-11T11:55:00.403 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-08-11T11:55:00.403 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvsas 2023-08-11T11:55:00.403 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-08-11T11:55:00.403 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvumi.ko 2023-08-11T11:55:00.403 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pm8001 2023-08-11T11:55:00.404 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-08-11T11:55:00.404 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pmcraid.ko 2023-08-11T11:55:00.404 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla1280.ko 2023-08-11T11:55:00.404 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx 2023-08-11T11:55:00.404 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-08-11T11:55:00.404 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-08-11T11:55:00.404 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla4xxx 2023-08-11T11:55:00.405 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-08-11T11:55:00.405 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/raid_class.ko 2023-08-11T11:55:00.405 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_debug.ko 2023-08-11T11:55:00.405 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-08-11T11:55:00.405 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-08-11T11:55:00.405 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-08-11T11:55:00.405 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-08-11T11:55:00.406 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-08-11T11:55:00.406 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ses.ko 2023-08-11T11:55:00.406 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/st.ko 2023-08-11T11:55:00.406 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/stex.ko 2023-08-11T11:55:00.406 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/sym53c8xx_2 2023-08-11T11:55:00.406 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-08-11T11:55:00.406 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/virtio_scsi.ko 2023-08-11T11:55:00.406 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-08-11T11:55:00.407 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/wd719x.ko 2023-08-11T11:55:00.407 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ssb 2023-08-11T11:55:00.407 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ssb/ssb.ko 2023-08-11T11:55:00.407 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target 2023-08-11T11:55:00.407 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/iscsi 2023-08-11T11:55:00.407 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-08-11T11:55:00.407 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/loopback 2023-08-11T11:55:00.408 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/loopback/tcm_loop.ko 2023-08-11T11:55:00.408 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_file.ko 2023-08-11T11:55:00.408 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_iblock.ko 2023-08-11T11:55:00.408 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_mod.ko 2023-08-11T11:55:00.408 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_pscsi.ko 2023-08-11T11:55:00.408 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_user.ko 2023-08-11T11:55:00.408 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/tcm_fc 2023-08-11T11:55:00.408 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-08-11T11:55:00.409 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal 2023-08-11T11:55:00.409 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel 2023-08-11T11:55:00.409 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal 2023-08-11T11:55:00.409 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-08-11T11:55:00.409 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-08-11T11:55:00.409 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-08-11T11:55:00.409 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-08-11T11:55:00.410 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-08-11T11:55:00.410 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-08-11T11:55:00.410 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-08-11T11:55:00.410 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-08-11T11:55:00.410 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-08-11T11:55:00.410 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-08-11T11:55:00.410 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-08-11T11:55:00.410 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-08-11T11:55:00.411 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-08-11T11:55:00.411 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-08-11T11:55:00.411 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-08-11T11:55:00.411 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty 2023-08-11T11:55:00.411 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/ipwireless 2023-08-11T11:55:00.411 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-08-11T11:55:00.412 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/n_gsm.ko 2023-08-11T11:55:00.412 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/n_hdlc.ko 2023-08-11T11:55:00.412 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/nozomi.ko 2023-08-11T11:55:00.412 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial 2023-08-11T11:55:00.412 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/8250 2023-08-11T11:55:00.412 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-08-11T11:55:00.412 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/arc_uart.ko 2023-08-11T11:55:00.413 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/jsm 2023-08-11T11:55:00.413 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-08-11T11:55:00.413 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/synclink_gt.ko 2023-08-11T11:55:00.413 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs 2023-08-11T11:55:00.413 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/core 2023-08-11T11:55:00.413 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-08-11T11:55:00.414 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/host 2023-08-11T11:55:00.414 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-08-11T11:55:00.414 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio 2023-08-11T11:55:00.414 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio.ko 2023-08-11T11:55:00.414 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_aec.ko 2023-08-11T11:55:00.414 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_cif.ko 2023-08-11T11:55:00.414 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_pci_generic.ko 2023-08-11T11:55:00.415 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_sercos3.ko 2023-08-11T11:55:00.415 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb 2023-08-11T11:55:00.415 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class 2023-08-11T11:55:00.415 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/cdc-acm.ko 2023-08-11T11:55:00.415 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/cdc-wdm.ko 2023-08-11T11:55:00.415 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/usblp.ko 2023-08-11T11:55:00.415 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/usbtmc.ko 2023-08-11T11:55:00.416 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host 2023-08-11T11:55:00.416 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host/sl811-hcd.ko 2023-08-11T11:55:00.416 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image 2023-08-11T11:55:00.416 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image/mdc800.ko 2023-08-11T11:55:00.416 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image/microtek.ko 2023-08-11T11:55:00.416 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc 2023-08-11T11:55:00.416 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/adutux.ko 2023-08-11T11:55:00.416 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/appledisplay.ko 2023-08-11T11:55:00.417 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/emi26.ko 2023-08-11T11:55:00.417 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/emi62.ko 2023-08-11T11:55:00.417 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/ezusb.ko 2023-08-11T11:55:00.417 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/idmouse.ko 2023-08-11T11:55:00.417 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/iowarrior.ko 2023-08-11T11:55:00.417 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/isight_firmware.ko 2023-08-11T11:55:00.418 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/ldusb.ko 2023-08-11T11:55:00.418 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/legousbtower.ko 2023-08-11T11:55:00.418 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/sisusbvga 2023-08-11T11:55:00.418 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-08-11T11:55:00.418 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/trancevibrator.ko 2023-08-11T11:55:00.418 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usb3503.ko 2023-08-11T11:55:00.418 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usblcd.ko 2023-08-11T11:55:00.419 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usbsevseg.ko 2023-08-11T11:55:00.419 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/uss720.ko 2023-08-11T11:55:00.419 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/yurex.ko 2023-08-11T11:55:00.419 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy 2023-08-11T11:55:00.419 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy/phy-generic.ko 2023-08-11T11:55:00.419 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial 2023-08-11T11:55:00.419 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/aircable.ko 2023-08-11T11:55:00.420 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ark3116.ko 2023-08-11T11:55:00.420 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/belkin_sa.ko 2023-08-11T11:55:00.420 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ch341.ko 2023-08-11T11:55:00.420 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cp210x.ko 2023-08-11T11:55:00.420 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cyberjack.ko 2023-08-11T11:55:00.420 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cypress_m8.ko 2023-08-11T11:55:00.420 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-08-11T11:55:00.421 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/empeg.ko 2023-08-11T11:55:00.421 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-08-11T11:55:00.421 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/garmin_gps.ko 2023-08-11T11:55:00.421 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/io_edgeport.ko 2023-08-11T11:55:00.421 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/io_ti.ko 2023-08-11T11:55:00.421 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ipaq.ko 2023-08-11T11:55:00.421 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ipw.ko 2023-08-11T11:55:00.421 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ir-usb.ko 2023-08-11T11:55:00.422 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-08-11T11:55:00.422 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/keyspan.ko 2023-08-11T11:55:00.422 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-08-11T11:55:00.422 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-08-11T11:55:00.422 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/kobil_sct.ko 2023-08-11T11:55:00.422 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mct_u232.ko 2023-08-11T11:55:00.422 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mos7720.ko 2023-08-11T11:55:00.422 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mos7840.ko 2023-08-11T11:55:00.423 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/navman.ko 2023-08-11T11:55:00.423 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/omninet.ko 2023-08-11T11:55:00.423 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/opticon.ko 2023-08-11T11:55:00.423 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/option.ko 2023-08-11T11:55:00.423 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/oti6858.ko 2023-08-11T11:55:00.423 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/pl2303.ko 2023-08-11T11:55:00.423 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/qcaux.ko 2023-08-11T11:55:00.423 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/qcserial.ko 2023-08-11T11:55:00.424 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/quatech2.ko 2023-08-11T11:55:00.424 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/safe_serial.ko 2023-08-11T11:55:00.424 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/sierra.ko 2023-08-11T11:55:00.424 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/spcp8x5.ko 2023-08-11T11:55:00.424 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ssu100.ko 2023-08-11T11:55:00.424 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/symbolserial.ko 2023-08-11T11:55:00.424 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-08-11T11:55:00.425 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-08-11T11:55:00.425 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb_debug.ko 2023-08-11T11:55:00.425 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb_wwan.ko 2023-08-11T11:55:00.425 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/visor.ko 2023-08-11T11:55:00.425 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/whiteheat.ko 2023-08-11T11:55:00.425 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/xsens_mt.ko 2023-08-11T11:55:00.425 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage 2023-08-11T11:55:00.426 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/uas.ko 2023-08-11T11:55:00.426 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-alauda.ko 2023-08-11T11:55:00.426 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-cypress.ko 2023-08-11T11:55:00.426 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-datafab.ko 2023-08-11T11:55:00.426 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-08-11T11:55:00.426 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-freecom.ko 2023-08-11T11:55:00.426 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-isd200.ko 2023-08-11T11:55:00.427 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-08-11T11:55:00.427 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-karma.ko 2023-08-11T11:55:00.427 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-08-11T11:55:00.427 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-realtek.ko 2023-08-11T11:55:00.427 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-08-11T11:55:00.427 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-08-11T11:55:00.427 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-usbat.ko 2023-08-11T11:55:00.427 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/usb-storage.ko 2023-08-11T11:55:00.428 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip 2023-08-11T11:55:00.428 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/usbip-core.ko 2023-08-11T11:55:00.428 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/usbip-host.ko 2023-08-11T11:55:00.428 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-08-11T11:55:00.428 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio 2023-08-11T11:55:00.428 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci 2023-08-11T11:55:00.428 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-08-11T11:55:00.429 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-08-11T11:55:00.429 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/vfio.ko 2023-08-11T11:55:00.429 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-08-11T11:55:00.429 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost 2023-08-11T11:55:00.429 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost.ko 2023-08-11T11:55:00.429 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_iotlb.ko 2023-08-11T11:55:00.429 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_net.ko 2023-08-11T11:55:00.430 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_scsi.ko 2023-08-11T11:55:00.430 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video 2023-08-11T11:55:00.430 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight 2023-08-11T11:55:00.430 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/apple_bl.ko 2023-08-11T11:55:00.430 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/lcd.ko 2023-08-11T11:55:00.430 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/platform_lcd.ko 2023-08-11T11:55:00.431 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio 2023-08-11T11:55:00.431 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio.ko 2023-08-11T11:55:00.431 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_balloon.ko 2023-08-11T11:55:00.431 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_mmio.ko 2023-08-11T11:55:00.431 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci.ko 2023-08-11T11:55:00.431 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-08-11T11:55:00.432 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-08-11T11:55:00.432 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_ring.ko 2023-08-11T11:55:00.432 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1 2023-08-11T11:55:00.432 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters 2023-08-11T11:55:00.432 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/ds2482.ko 2023-08-11T11:55:00.432 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/ds2490.ko 2023-08-11T11:55:00.432 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves 2023-08-11T11:55:00.433 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-08-11T11:55:00.433 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-08-11T11:55:00.433 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-08-11T11:55:00.433 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-08-11T11:55:00.433 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-08-11T11:55:00.433 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-08-11T11:55:00.433 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-08-11T11:55:00.434 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-08-11T11:55:00.434 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-08-11T11:55:00.434 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_smem.ko 2023-08-11T11:55:00.434 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_therm.ko 2023-08-11T11:55:00.434 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/wire.ko 2023-08-11T11:55:00.434 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog 2023-08-11T11:55:00.434 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-08-11T11:55:00.435 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-08-11T11:55:00.435 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-08-11T11:55:00.435 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/hpwdt.ko 2023-08-11T11:55:00.435 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/i6300esb.ko 2023-08-11T11:55:00.435 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-08-11T11:55:00.435 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-08-11T11:55:00.435 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ib700wdt.ko 2023-08-11T11:55:00.436 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ibmasr.ko 2023-08-11T11:55:00.436 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-08-11T11:55:00.436 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-08-11T11:55:00.436 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/it87_wdt.ko 2023-08-11T11:55:00.436 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/machzwd.ko 2023-08-11T11:55:00.436 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/nv_tco.ko 2023-08-11T11:55:00.436 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/pcwd_pci.ko 2023-08-11T11:55:00.436 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/pcwd_usb.ko 2023-08-11T11:55:00.437 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-08-11T11:55:00.437 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-08-11T11:55:00.437 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/softdog.ko 2023-08-11T11:55:00.437 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sp5100_tco.ko 2023-08-11T11:55:00.437 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/via_wdt.ko 2023-08-11T11:55:00.437 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-08-11T11:55:00.437 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-08-11T11:55:00.438 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-08-11T11:55:00.438 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/wdt_pci.ko 2023-08-11T11:55:00.438 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/xen_wdt.ko 2023-08-11T11:55:00.438 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen 2023-08-11T11:55:00.438 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-acpi-processor.ko 2023-08-11T11:55:00.438 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-evtchn.ko 2023-08-11T11:55:00.438 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-gntalloc.ko 2023-08-11T11:55:00.438 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-gntdev.ko 2023-08-11T11:55:00.439 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-pciback 2023-08-11T11:55:00.439 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-08-11T11:55:00.439 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-privcmd.ko 2023-08-11T11:55:00.439 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xenfs 2023-08-11T11:55:00.439 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xenfs/xenfs.ko 2023-08-11T11:55:00.439 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs 2023-08-11T11:55:00.439 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/9p 2023-08-11T11:55:00.439 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/9p/9p.ko 2023-08-11T11:55:00.440 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/affs 2023-08-11T11:55:00.440 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/affs/affs.ko 2023-08-11T11:55:00.440 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/befs 2023-08-11T11:55:00.440 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/befs/befs.ko 2023-08-11T11:55:00.440 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/binfmt_misc.ko 2023-08-11T11:55:00.440 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/btrfs 2023-08-11T11:55:00.440 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/btrfs/btrfs.ko 2023-08-11T11:55:00.441 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cachefiles 2023-08-11T11:55:00.441 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cachefiles/cachefiles.ko 2023-08-11T11:55:00.441 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ceph 2023-08-11T11:55:00.441 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ceph/ceph.ko 2023-08-11T11:55:00.441 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/coda 2023-08-11T11:55:00.441 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/coda/coda.ko 2023-08-11T11:55:00.441 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cramfs 2023-08-11T11:55:00.441 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cramfs/cramfs.ko 2023-08-11T11:55:00.442 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/dlm 2023-08-11T11:55:00.442 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/dlm/dlm.ko 2023-08-11T11:55:00.442 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ecryptfs 2023-08-11T11:55:00.442 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ecryptfs/ecryptfs.ko 2023-08-11T11:55:00.442 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/f2fs 2023-08-11T11:55:00.442 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/f2fs/f2fs.ko 2023-08-11T11:55:00.442 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat 2023-08-11T11:55:00.442 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/fat.ko 2023-08-11T11:55:00.443 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/msdos.ko 2023-08-11T11:55:00.443 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/vfat.ko 2023-08-11T11:55:00.443 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fscache 2023-08-11T11:55:00.443 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fscache/fscache.ko 2023-08-11T11:55:00.443 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse 2023-08-11T11:55:00.443 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse/cuse.ko 2023-08-11T11:55:00.443 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse/fuse.ko 2023-08-11T11:55:00.443 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/gfs2 2023-08-11T11:55:00.444 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/gfs2/gfs2.ko 2023-08-11T11:55:00.444 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfs 2023-08-11T11:55:00.444 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfs/hfs.ko 2023-08-11T11:55:00.444 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfsplus 2023-08-11T11:55:00.444 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfsplus/hfsplus.ko 2023-08-11T11:55:00.444 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/isofs 2023-08-11T11:55:00.444 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/isofs/isofs.ko 2023-08-11T11:55:00.445 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/jfs 2023-08-11T11:55:00.445 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/jfs/jfs.ko 2023-08-11T11:55:00.445 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/lockd 2023-08-11T11:55:00.445 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/lockd/lockd.ko 2023-08-11T11:55:00.445 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/minix 2023-08-11T11:55:00.445 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/minix/minix.ko 2023-08-11T11:55:00.445 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/netfs 2023-08-11T11:55:00.445 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/netfs/netfs.ko 2023-08-11T11:55:00.446 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs 2023-08-11T11:55:00.446 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/blocklayout 2023-08-11T11:55:00.446 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-08-11T11:55:00.446 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/filelayout 2023-08-11T11:55:00.446 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-08-11T11:55:00.446 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/flexfilelayout 2023-08-11T11:55:00.446 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-08-11T11:55:00.447 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfs.ko 2023-08-11T11:55:00.447 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfsv3.ko 2023-08-11T11:55:00.447 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfsv4.ko 2023-08-11T11:55:00.447 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common 2023-08-11T11:55:00.447 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common/grace.ko 2023-08-11T11:55:00.447 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common/nfs_acl.ko 2023-08-11T11:55:00.447 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfsd 2023-08-11T11:55:00.447 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfsd/nfsd.ko 2023-08-11T11:55:00.448 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nilfs2 2023-08-11T11:55:00.448 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nilfs2/nilfs2.ko 2023-08-11T11:55:00.448 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls 2023-08-11T11:55:00.448 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-celtic.ko 2023-08-11T11:55:00.448 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-centeuro.ko 2023-08-11T11:55:00.448 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-croatian.ko 2023-08-11T11:55:00.448 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-cyrillic.ko 2023-08-11T11:55:00.449 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-gaelic.ko 2023-08-11T11:55:00.449 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-greek.ko 2023-08-11T11:55:00.449 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-iceland.ko 2023-08-11T11:55:00.449 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-inuit.ko 2023-08-11T11:55:00.449 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-roman.ko 2023-08-11T11:55:00.449 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-romanian.ko 2023-08-11T11:55:00.449 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-turkish.ko 2023-08-11T11:55:00.449 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1250.ko 2023-08-11T11:55:00.450 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1251.ko 2023-08-11T11:55:00.450 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1255.ko 2023-08-11T11:55:00.450 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp737.ko 2023-08-11T11:55:00.450 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp775.ko 2023-08-11T11:55:00.450 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp850.ko 2023-08-11T11:55:00.450 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp852.ko 2023-08-11T11:55:00.450 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp855.ko 2023-08-11T11:55:00.451 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp857.ko 2023-08-11T11:55:00.451 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp860.ko 2023-08-11T11:55:00.451 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp861.ko 2023-08-11T11:55:00.451 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp862.ko 2023-08-11T11:55:00.451 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp863.ko 2023-08-11T11:55:00.451 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp864.ko 2023-08-11T11:55:00.451 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp865.ko 2023-08-11T11:55:00.451 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp866.ko 2023-08-11T11:55:00.452 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp869.ko 2023-08-11T11:55:00.452 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp874.ko 2023-08-11T11:55:00.452 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp932.ko 2023-08-11T11:55:00.452 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp936.ko 2023-08-11T11:55:00.452 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp949.ko 2023-08-11T11:55:00.452 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp950.ko 2023-08-11T11:55:00.452 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_euc-jp.ko 2023-08-11T11:55:00.453 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-1.ko 2023-08-11T11:55:00.453 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-13.ko 2023-08-11T11:55:00.453 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-14.ko 2023-08-11T11:55:00.453 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-15.ko 2023-08-11T11:55:00.453 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-2.ko 2023-08-11T11:55:00.453 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-3.ko 2023-08-11T11:55:00.453 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-4.ko 2023-08-11T11:55:00.453 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-5.ko 2023-08-11T11:55:00.454 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-6.ko 2023-08-11T11:55:00.454 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-7.ko 2023-08-11T11:55:00.454 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-9.ko 2023-08-11T11:55:00.454 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-r.ko 2023-08-11T11:55:00.454 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-ru.ko 2023-08-11T11:55:00.454 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-u.ko 2023-08-11T11:55:00.454 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_utf8.ko 2023-08-11T11:55:00.454 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2 2023-08-11T11:55:00.455 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/cluster 2023-08-11T11:55:00.455 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-08-11T11:55:00.455 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlm 2023-08-11T11:55:00.455 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-08-11T11:55:00.455 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlmfs 2023-08-11T11:55:00.455 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-08-11T11:55:00.455 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2.ko 2023-08-11T11:55:00.455 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-08-11T11:55:00.456 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-08-11T11:55:00.456 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-08-11T11:55:00.456 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/overlayfs 2023-08-11T11:55:00.456 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/overlayfs/overlay.ko 2023-08-11T11:55:00.456 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/pstore 2023-08-11T11:55:00.456 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/pstore/ramoops.ko 2023-08-11T11:55:00.456 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/reiserfs 2023-08-11T11:55:00.457 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/reiserfs/reiserfs.ko 2023-08-11T11:55:00.457 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/romfs 2023-08-11T11:55:00.457 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/romfs/romfs.ko 2023-08-11T11:55:00.457 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb 2023-08-11T11:55:00.457 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/client 2023-08-11T11:55:00.457 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/client/cifs.ko 2023-08-11T11:55:00.457 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common 2023-08-11T11:55:00.457 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common/cifs_arc4.ko 2023-08-11T11:55:00.458 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common/cifs_md4.ko 2023-08-11T11:55:00.458 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/squashfs 2023-08-11T11:55:00.458 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/squashfs/squashfs.ko 2023-08-11T11:55:00.458 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/sysv 2023-08-11T11:55:00.458 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/sysv/sysv.ko 2023-08-11T11:55:00.458 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/udf 2023-08-11T11:55:00.458 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/udf/udf.ko 2023-08-11T11:55:00.458 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ufs 2023-08-11T11:55:00.459 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ufs/ufs.ko 2023-08-11T11:55:00.459 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/xfs 2023-08-11T11:55:00.459 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/xfs/xfs.ko 2023-08-11T11:55:00.459 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel 2023-08-11T11:55:00.459 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/rcu 2023-08-11T11:55:00.459 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/rcu/rcutorture.ko 2023-08-11T11:55:00.459 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/torture.ko 2023-08-11T11:55:00.460 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/trace 2023-08-11T11:55:00.460 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-08-11T11:55:00.460 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib 2023-08-11T11:55:00.460 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/asn1_encoder.ko 2023-08-11T11:55:00.460 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crc-itu-t.ko 2023-08-11T11:55:00.460 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crc8.ko 2023-08-11T11:55:00.460 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto 2023-08-11T11:55:00.461 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto/libarc4.ko 2023-08-11T11:55:00.461 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto/libdes.ko 2023-08-11T11:55:00.461 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/libcrc32c.ko 2023-08-11T11:55:00.461 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lru_cache.ko 2023-08-11T11:55:00.461 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4 2023-08-11T11:55:00.461 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4/lz4_compress.ko 2023-08-11T11:55:00.461 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4/lz4hc_compress.ko 2023-08-11T11:55:00.462 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/math 2023-08-11T11:55:00.462 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/math/cordic.ko 2023-08-11T11:55:00.462 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/raid6 2023-08-11T11:55:00.462 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/raid6/raid6_pq.ko 2023-08-11T11:55:00.462 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/reed_solomon 2023-08-11T11:55:00.462 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/reed_solomon/reed_solomon.ko 2023-08-11T11:55:00.462 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_bm.ko 2023-08-11T11:55:00.462 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_fsm.ko 2023-08-11T11:55:00.463 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_kmp.ko 2023-08-11T11:55:00.463 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/zstd 2023-08-11T11:55:00.463 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/zstd/zstd_compress.ko 2023-08-11T11:55:00.463 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/mm 2023-08-11T11:55:00.463 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/mm/hwpoison-inject.ko 2023-08-11T11:55:00.463 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net 2023-08-11T11:55:00.463 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan 2023-08-11T11:55:00.464 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/6lowpan.ko 2023-08-11T11:55:00.464 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_dest.ko 2023-08-11T11:55:00.464 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_fragment.ko 2023-08-11T11:55:00.464 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_hop.ko 2023-08-11T11:55:00.464 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_ipv6.ko 2023-08-11T11:55:00.464 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_mobility.ko 2023-08-11T11:55:00.464 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_routing.ko 2023-08-11T11:55:00.464 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_udp.ko 2023-08-11T11:55:00.465 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802 2023-08-11T11:55:00.465 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/garp.ko 2023-08-11T11:55:00.465 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/mrp.ko 2023-08-11T11:55:00.465 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/p8022.ko 2023-08-11T11:55:00.465 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/psnap.ko 2023-08-11T11:55:00.465 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/stp.ko 2023-08-11T11:55:00.465 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/8021q 2023-08-11T11:55:00.466 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/8021q/8021q.ko 2023-08-11T11:55:00.466 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p 2023-08-11T11:55:00.466 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet.ko 2023-08-11T11:55:00.466 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_fd.ko 2023-08-11T11:55:00.466 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_rdma.ko 2023-08-11T11:55:00.466 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_virtio.ko 2023-08-11T11:55:00.466 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/batman-adv 2023-08-11T11:55:00.466 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/batman-adv/batman-adv.ko 2023-08-11T11:55:00.467 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge 2023-08-11T11:55:00.467 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/br_netfilter.ko 2023-08-11T11:55:00.467 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/bridge.ko 2023-08-11T11:55:00.467 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter 2023-08-11T11:55:00.467 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-08-11T11:55:00.467 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_among.ko 2023-08-11T11:55:00.467 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-08-11T11:55:00.468 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-08-11T11:55:00.468 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-08-11T11:55:00.468 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-08-11T11:55:00.468 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-08-11T11:55:00.468 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-08-11T11:55:00.468 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_log.ko 2023-08-11T11:55:00.468 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-08-11T11:55:00.468 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-08-11T11:55:00.469 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-08-11T11:55:00.469 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-08-11T11:55:00.469 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-08-11T11:55:00.469 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-08-11T11:55:00.469 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-08-11T11:55:00.469 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-08-11T11:55:00.469 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-08-11T11:55:00.470 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-08-11T11:55:00.470 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-08-11T11:55:00.470 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtables.ko 2023-08-11T11:55:00.470 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-08-11T11:55:00.470 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-08-11T11:55:00.470 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-08-11T11:55:00.470 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ceph 2023-08-11T11:55:00.470 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ceph/libceph.ko 2023-08-11T11:55:00.471 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core 2023-08-11T11:55:00.471 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core/failover.ko 2023-08-11T11:55:00.471 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core/pktgen.ko 2023-08-11T11:55:00.471 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp 2023-08-11T11:55:00.471 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp.ko 2023-08-11T11:55:00.471 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_diag.ko 2023-08-11T11:55:00.471 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_ipv4.ko 2023-08-11T11:55:00.471 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_ipv6.ko 2023-08-11T11:55:00.472 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dns_resolver 2023-08-11T11:55:00.472 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dns_resolver/dns_resolver.ko 2023-08-11T11:55:00.472 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa 2023-08-11T11:55:00.472 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/dsa_core.ko 2023-08-11T11:55:00.472 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_brcm.ko 2023-08-11T11:55:00.472 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_dsa.ko 2023-08-11T11:55:00.472 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_none.ko 2023-08-11T11:55:00.473 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_trailer.ko 2023-08-11T11:55:00.473 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154 2023-08-11T11:55:00.473 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/6lowpan 2023-08-11T11:55:00.473 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-08-11T11:55:00.473 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/ieee802154.ko 2023-08-11T11:55:00.473 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/ieee802154_socket.ko 2023-08-11T11:55:00.473 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4 2023-08-11T11:55:00.473 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ah4.ko 2023-08-11T11:55:00.474 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/esp4.ko 2023-08-11T11:55:00.474 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/fou.ko 2023-08-11T11:55:00.474 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/gre.ko 2023-08-11T11:55:00.474 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/inet_diag.ko 2023-08-11T11:55:00.474 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_gre.ko 2023-08-11T11:55:00.474 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_tunnel.ko 2023-08-11T11:55:00.474 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_vti.ko 2023-08-11T11:55:00.474 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ipcomp.ko 2023-08-11T11:55:00.475 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ipip.ko 2023-08-11T11:55:00.475 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter 2023-08-11T11:55:00.475 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-08-11T11:55:00.475 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-08-11T11:55:00.475 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-08-11T11:55:00.475 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-08-11T11:55:00.475 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-08-11T11:55:00.476 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-08-11T11:55:00.476 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-08-11T11:55:00.476 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-08-11T11:55:00.476 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-08-11T11:55:00.476 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-08-11T11:55:00.476 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-08-11T11:55:00.476 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-08-11T11:55:00.476 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-08-11T11:55:00.477 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-08-11T11:55:00.477 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-08-11T11:55:00.477 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-08-11T11:55:00.477 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-08-11T11:55:00.477 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-08-11T11:55:00.477 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-08-11T11:55:00.477 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-08-11T11:55:00.478 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-08-11T11:55:00.478 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_bic.ko 2023-08-11T11:55:00.478 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_dctcp.ko 2023-08-11T11:55:00.478 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_diag.ko 2023-08-11T11:55:00.478 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_highspeed.ko 2023-08-11T11:55:00.478 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_htcp.ko 2023-08-11T11:55:00.478 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_hybla.ko 2023-08-11T11:55:00.478 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_illinois.ko 2023-08-11T11:55:00.479 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_lp.ko 2023-08-11T11:55:00.479 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_scalable.ko 2023-08-11T11:55:00.479 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_vegas.ko 2023-08-11T11:55:00.479 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_veno.ko 2023-08-11T11:55:00.479 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_westwood.ko 2023-08-11T11:55:00.479 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_yeah.ko 2023-08-11T11:55:00.479 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tunnel4.ko 2023-08-11T11:55:00.479 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/udp_diag.ko 2023-08-11T11:55:00.480 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/udp_tunnel.ko 2023-08-11T11:55:00.480 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-08-11T11:55:00.480 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6 2023-08-11T11:55:00.480 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ah6.ko 2023-08-11T11:55:00.480 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/esp6.ko 2023-08-11T11:55:00.480 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/fou6.ko 2023-08-11T11:55:00.480 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_tunnel.ko 2023-08-11T11:55:00.481 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-08-11T11:55:00.481 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_vti.ko 2023-08-11T11:55:00.481 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ipcomp6.ko 2023-08-11T11:55:00.481 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter 2023-08-11T11:55:00.481 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-08-11T11:55:00.481 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-08-11T11:55:00.481 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-08-11T11:55:00.482 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-08-11T11:55:00.482 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-08-11T11:55:00.482 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-08-11T11:55:00.482 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-08-11T11:55:00.482 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-08-11T11:55:00.482 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-08-11T11:55:00.482 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-08-11T11:55:00.482 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-08-11T11:55:00.483 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-08-11T11:55:00.483 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-08-11T11:55:00.483 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-08-11T11:55:00.483 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-08-11T11:55:00.483 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-08-11T11:55:00.483 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-08-11T11:55:00.483 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-08-11T11:55:00.483 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-08-11T11:55:00.484 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-08-11T11:55:00.484 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-08-11T11:55:00.484 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-08-11T11:55:00.484 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-08-11T11:55:00.484 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-08-11T11:55:00.484 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/sit.ko 2023-08-11T11:55:00.484 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/tunnel6.ko 2023-08-11T11:55:00.485 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-08-11T11:55:00.485 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/key 2023-08-11T11:55:00.485 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/key/af_key.ko 2023-08-11T11:55:00.485 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp 2023-08-11T11:55:00.485 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_core.ko 2023-08-11T11:55:00.485 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_debugfs.ko 2023-08-11T11:55:00.485 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_eth.ko 2023-08-11T11:55:00.485 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ip.ko 2023-08-11T11:55:00.486 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ip6.ko 2023-08-11T11:55:00.486 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_netlink.ko 2023-08-11T11:55:00.486 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ppp.ko 2023-08-11T11:55:00.486 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/llc 2023-08-11T11:55:00.486 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/llc/llc.ko 2023-08-11T11:55:00.486 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mac802154 2023-08-11T11:55:00.486 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mac802154/mac802154.ko 2023-08-11T11:55:00.487 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mpls 2023-08-11T11:55:00.487 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mpls/mpls_gso.ko 2023-08-11T11:55:00.487 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter 2023-08-11T11:55:00.487 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset 2023-08-11T11:55:00.487 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set.ko 2023-08-11T11:55:00.487 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-08-11T11:55:00.487 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-08-11T11:55:00.487 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-08-11T11:55:00.488 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-08-11T11:55:00.488 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-08-11T11:55:00.488 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-08-11T11:55:00.488 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-08-11T11:55:00.488 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-08-11T11:55:00.488 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-08-11T11:55:00.488 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-08-11T11:55:00.489 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-08-11T11:55:00.489 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-08-11T11:55:00.489 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-08-11T11:55:00.489 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-08-11T11:55:00.489 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-08-11T11:55:00.489 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs 2023-08-11T11:55:00.489 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-08-11T11:55:00.489 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-08-11T11:55:00.490 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-08-11T11:55:00.490 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-08-11T11:55:00.490 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-08-11T11:55:00.490 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-08-11T11:55:00.490 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-08-11T11:55:00.490 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-08-11T11:55:00.490 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-08-11T11:55:00.491 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-08-11T11:55:00.491 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-08-11T11:55:00.491 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-08-11T11:55:00.491 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-08-11T11:55:00.491 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-08-11T11:55:00.491 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conncount.ko 2023-08-11T11:55:00.491 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack.ko 2023-08-11T11:55:00.491 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-08-11T11:55:00.492 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-08-11T11:55:00.492 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-08-11T11:55:00.492 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-08-11T11:55:00.492 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-08-11T11:55:00.492 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-08-11T11:55:00.492 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-08-11T11:55:00.492 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-08-11T11:55:00.493 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-08-11T11:55:00.493 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-08-11T11:55:00.493 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-08-11T11:55:00.493 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-08-11T11:55:00.493 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_dup_netdev.ko 2023-08-11T11:55:00.493 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_flow_table.ko 2023-08-11T11:55:00.493 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-08-11T11:55:00.493 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_log_syslog.ko 2023-08-11T11:55:00.494 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat.ko 2023-08-11T11:55:00.494 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_amanda.ko 2023-08-11T11:55:00.494 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_ftp.ko 2023-08-11T11:55:00.494 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_irc.ko 2023-08-11T11:55:00.494 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_sip.ko 2023-08-11T11:55:00.494 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_tftp.ko 2023-08-11T11:55:00.495 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_synproxy_core.ko 2023-08-11T11:55:00.495 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_tables.ko 2023-08-11T11:55:00.495 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink.ko 2023-08-11T11:55:00.495 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_acct.ko 2023-08-11T11:55:00.495 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_log.ko 2023-08-11T11:55:00.495 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_osf.ko 2023-08-11T11:55:00.495 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_queue.ko 2023-08-11T11:55:00.496 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_chain_nat.ko 2023-08-11T11:55:00.496 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_compat.ko 2023-08-11T11:55:00.496 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_ct.ko 2023-08-11T11:55:00.496 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_dup_netdev.ko 2023-08-11T11:55:00.496 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_fib.ko 2023-08-11T11:55:00.496 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-08-11T11:55:00.496 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_hash.ko 2023-08-11T11:55:00.497 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_limit.ko 2023-08-11T11:55:00.497 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_log.ko 2023-08-11T11:55:00.497 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_masq.ko 2023-08-11T11:55:00.497 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_nat.ko 2023-08-11T11:55:00.497 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_numgen.ko 2023-08-11T11:55:00.497 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_queue.ko 2023-08-11T11:55:00.497 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_quota.ko 2023-08-11T11:55:00.497 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_redir.ko 2023-08-11T11:55:00.498 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_reject.ko 2023-08-11T11:55:00.498 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_reject_inet.ko 2023-08-11T11:55:00.498 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_socket.ko 2023-08-11T11:55:00.498 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_tunnel.ko 2023-08-11T11:55:00.498 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_AUDIT.ko 2023-08-11T11:55:00.498 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-08-11T11:55:00.498 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-08-11T11:55:00.499 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-08-11T11:55:00.499 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CT.ko 2023-08-11T11:55:00.499 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_DSCP.ko 2023-08-11T11:55:00.499 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_HL.ko 2023-08-11T11:55:00.499 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_HMARK.ko 2023-08-11T11:55:00.499 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-08-11T11:55:00.499 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_LED.ko 2023-08-11T11:55:00.499 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_LOG.ko 2023-08-11T11:55:00.500 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-08-11T11:55:00.500 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NETMAP.ko 2023-08-11T11:55:00.500 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NFLOG.ko 2023-08-11T11:55:00.500 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-08-11T11:55:00.500 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_RATEEST.ko 2023-08-11T11:55:00.500 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_REDIRECT.ko 2023-08-11T11:55:00.500 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_SECMARK.ko 2023-08-11T11:55:00.500 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TCPMSS.ko 2023-08-11T11:55:00.501 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-08-11T11:55:00.501 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TEE.ko 2023-08-11T11:55:00.501 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TPROXY.ko 2023-08-11T11:55:00.501 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TRACE.ko 2023-08-11T11:55:00.501 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_addrtype.ko 2023-08-11T11:55:00.501 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_bpf.ko 2023-08-11T11:55:00.501 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cgroup.ko 2023-08-11T11:55:00.501 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cluster.ko 2023-08-11T11:55:00.502 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_comment.ko 2023-08-11T11:55:00.502 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connbytes.ko 2023-08-11T11:55:00.502 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connlabel.ko 2023-08-11T11:55:00.502 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connlimit.ko 2023-08-11T11:55:00.502 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connmark.ko 2023-08-11T11:55:00.502 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_conntrack.ko 2023-08-11T11:55:00.502 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cpu.ko 2023-08-11T11:55:00.502 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_dccp.ko 2023-08-11T11:55:00.503 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_devgroup.ko 2023-08-11T11:55:00.503 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_dscp.ko 2023-08-11T11:55:00.503 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ecn.ko 2023-08-11T11:55:00.503 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_esp.ko 2023-08-11T11:55:00.503 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_hashlimit.ko 2023-08-11T11:55:00.503 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_helper.ko 2023-08-11T11:55:00.503 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_hl.ko 2023-08-11T11:55:00.504 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ipcomp.ko 2023-08-11T11:55:00.504 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_iprange.ko 2023-08-11T11:55:00.504 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ipvs.ko 2023-08-11T11:55:00.504 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_l2tp.ko 2023-08-11T11:55:00.504 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_length.ko 2023-08-11T11:55:00.504 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_limit.ko 2023-08-11T11:55:00.505 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_mac.ko 2023-08-11T11:55:00.505 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_mark.ko 2023-08-11T11:55:00.505 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_multiport.ko 2023-08-11T11:55:00.505 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_nat.ko 2023-08-11T11:55:00.505 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_nfacct.ko 2023-08-11T11:55:00.505 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_osf.ko 2023-08-11T11:55:00.505 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_owner.ko 2023-08-11T11:55:00.506 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_physdev.ko 2023-08-11T11:55:00.506 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_pkttype.ko 2023-08-11T11:55:00.506 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_policy.ko 2023-08-11T11:55:00.506 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_quota.ko 2023-08-11T11:55:00.506 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_rateest.ko 2023-08-11T11:55:00.506 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_realm.ko 2023-08-11T11:55:00.506 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_recent.ko 2023-08-11T11:55:00.507 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_sctp.ko 2023-08-11T11:55:00.507 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_set.ko 2023-08-11T11:55:00.507 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_socket.ko 2023-08-11T11:55:00.507 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_state.ko 2023-08-11T11:55:00.507 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_statistic.ko 2023-08-11T11:55:00.507 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_string.ko 2023-08-11T11:55:00.507 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_tcpmss.ko 2023-08-11T11:55:00.507 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_time.ko 2023-08-11T11:55:00.508 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_u32.ko 2023-08-11T11:55:00.508 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netlink 2023-08-11T11:55:00.508 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netlink/netlink_diag.ko 2023-08-11T11:55:00.508 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/nsh 2023-08-11T11:55:00.508 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/nsh/nsh.ko 2023-08-11T11:55:00.508 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch 2023-08-11T11:55:00.508 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/openvswitch.ko 2023-08-11T11:55:00.509 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-geneve.ko 2023-08-11T11:55:00.509 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-gre.ko 2023-08-11T11:55:00.509 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-vxlan.ko 2023-08-11T11:55:00.509 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/packet 2023-08-11T11:55:00.509 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/packet/af_packet_diag.ko 2023-08-11T11:55:00.509 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds 2023-08-11T11:55:00.509 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds.ko 2023-08-11T11:55:00.509 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds_rdma.ko 2023-08-11T11:55:00.510 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds_tcp.ko 2023-08-11T11:55:00.510 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched 2023-08-11T11:55:00.510 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_csum.ko 2023-08-11T11:55:00.510 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_gact.ko 2023-08-11T11:55:00.510 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_ipt.ko 2023-08-11T11:55:00.510 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_mirred.ko 2023-08-11T11:55:00.510 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_nat.ko 2023-08-11T11:55:00.510 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_pedit.ko 2023-08-11T11:55:00.511 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_police.ko 2023-08-11T11:55:00.511 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_simple.ko 2023-08-11T11:55:00.511 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_skbedit.ko 2023-08-11T11:55:00.511 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_vlan.ko 2023-08-11T11:55:00.511 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_basic.ko 2023-08-11T11:55:00.511 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_bpf.ko 2023-08-11T11:55:00.511 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_flow.ko 2023-08-11T11:55:00.511 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_fw.ko 2023-08-11T11:55:00.512 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_route.ko 2023-08-11T11:55:00.512 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_u32.ko 2023-08-11T11:55:00.512 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_cmp.ko 2023-08-11T11:55:00.512 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_ipset.ko 2023-08-11T11:55:00.512 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_meta.ko 2023-08-11T11:55:00.512 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_nbyte.ko 2023-08-11T11:55:00.512 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_text.ko 2023-08-11T11:55:00.513 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_u32.ko 2023-08-11T11:55:00.513 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_choke.ko 2023-08-11T11:55:00.513 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_codel.ko 2023-08-11T11:55:00.513 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_drr.ko 2023-08-11T11:55:00.513 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_fq.ko 2023-08-11T11:55:00.513 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_gred.ko 2023-08-11T11:55:00.513 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_hfsc.ko 2023-08-11T11:55:00.513 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_hhf.ko 2023-08-11T11:55:00.514 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_htb.ko 2023-08-11T11:55:00.514 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_ingress.ko 2023-08-11T11:55:00.514 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_mqprio.ko 2023-08-11T11:55:00.514 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_mqprio_lib.ko 2023-08-11T11:55:00.514 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_multiq.ko 2023-08-11T11:55:00.514 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_netem.ko 2023-08-11T11:55:00.514 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_pie.ko 2023-08-11T11:55:00.515 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_plug.ko 2023-08-11T11:55:00.515 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_prio.ko 2023-08-11T11:55:00.515 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_qfq.ko 2023-08-11T11:55:00.515 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_red.ko 2023-08-11T11:55:00.515 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_sfb.ko 2023-08-11T11:55:00.515 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_sfq.ko 2023-08-11T11:55:00.515 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_tbf.ko 2023-08-11T11:55:00.515 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_teql.ko 2023-08-11T11:55:00.516 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp 2023-08-11T11:55:00.516 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp/sctp.ko 2023-08-11T11:55:00.516 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp/sctp_diag.ko 2023-08-11T11:55:00.516 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc 2023-08-11T11:55:00.516 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss 2023-08-11T11:55:00.516 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-08-11T11:55:00.516 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-08-11T11:55:00.517 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/sunrpc.ko 2023-08-11T11:55:00.517 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/xprtrdma 2023-08-11T11:55:00.517 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-08-11T11:55:00.517 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc 2023-08-11T11:55:00.517 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc/diag.ko 2023-08-11T11:55:00.517 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc/tipc.ko 2023-08-11T11:55:00.517 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/unix 2023-08-11T11:55:00.517 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/unix/unix_diag.ko 2023-08-11T11:55:00.518 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock 2023-08-11T11:55:00.518 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-08-11T11:55:00.518 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-08-11T11:55:00.518 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock.ko 2023-08-11T11:55:00.518 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock_diag.ko 2023-08-11T11:55:00.518 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-08-11T11:55:00.518 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/xfrm 2023-08-11T11:55:00.519 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-08-11T11:55:00.519 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security 2023-08-11T11:55:00.519 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys 2023-08-11T11:55:00.519 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/encrypted-keys 2023-08-11T11:55:00.519 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-08-11T11:55:00.519 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/trusted-keys 2023-08-11T11:55:00.519 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/trusted-keys/trusted.ko 2023-08-11T11:55:00.519 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt 2023-08-11T11:55:00.520 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt/lib 2023-08-11T11:55:00.520 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt/lib/irqbypass.ko 2023-08-11T11:55:00.520 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.alias 2023-08-11T11:55:00.520 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.alias.bin 2023-08-11T11:55:00.520 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin 2023-08-11T11:55:00.520 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.bin 2023-08-11T11:55:00.520 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.modinfo 2023-08-11T11:55:00.521 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.dep 2023-08-11T11:55:00.521 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.dep.bin 2023-08-11T11:55:00.521 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.devname 2023-08-11T11:55:00.521 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.order 2023-08-11T11:55:00.521 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.softdep 2023-08-11T11:55:00.521 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.symbols 2023-08-11T11:55:00.521 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.symbols.bin 2023-08-11T11:55:00.522 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc4-ga7fb1265323d 2023-08-11T11:55:00.522 DEBUG:teuthology.orchestra.run.smithi008:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-08-11T11:55:00.550 INFO:teuthology.orchestra.run.smithi008.stdout:postinstall scriptlet (using /bin/sh): 2023-08-11T11:55:00.551 INFO:teuthology.orchestra.run.smithi008.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d -a -r /boot/System.map-6.5.0-rc4-ga7fb1265323d ]; then 2023-08-11T11:55:00.551 INFO:teuthology.orchestra.run.smithi008.stdout:cp /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-11T11:55:00.551 INFO:teuthology.orchestra.run.smithi008.stdout:cp /boot/System.map-6.5.0-rc4-ga7fb1265323d /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-11T11:55:00.551 INFO:teuthology.orchestra.run.smithi008.stdout:rm -f /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d /boot/System.map-6.5.0-rc4-ga7fb1265323d 2023-08-11T11:55:00.551 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/installkernel 6.5.0-rc4-ga7fb1265323d /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-11T11:55:00.551 INFO:teuthology.orchestra.run.smithi008.stdout:rm -f /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-11T11:55:00.551 INFO:teuthology.orchestra.run.smithi008.stdout:fi 2023-08-11T11:55:00.552 INFO:teuthology.orchestra.run.smithi008.stdout:preuninstall scriptlet (using /bin/sh): 2023-08-11T11:55:00.552 INFO:teuthology.orchestra.run.smithi008.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-08-11T11:55:00.552 INFO:teuthology.orchestra.run.smithi008.stdout:new-kernel-pkg --remove 6.5.0-rc4-ga7fb1265323d --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc4-ga7fb1265323d.img 2023-08-11T11:55:00.552 INFO:teuthology.orchestra.run.smithi008.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-08-11T11:55:00.552 INFO:teuthology.orchestra.run.smithi008.stdout:kernel-install remove 6.5.0-rc4-ga7fb1265323d 2023-08-11T11:55:00.552 INFO:teuthology.orchestra.run.smithi008.stdout:fi 2023-08-11T11:55:00.552 INFO:teuthology.orchestra.run.smithi008.stdout:postuninstall scriptlet (using /bin/sh): 2023-08-11T11:55:00.553 INFO:teuthology.orchestra.run.smithi008.stdout:if [ -x /sbin/update-bootloader ]; then 2023-08-11T11:55:00.553 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/update-bootloader --remove 6.5.0-rc4-ga7fb1265323d 2023-08-11T11:55:00.553 INFO:teuthology.orchestra.run.smithi008.stdout:fi 2023-08-11T11:55:00.554 DEBUG:teuthology.orchestra.run.smithi008:> sudo rpm -qi grub2-tools 2023-08-11T11:55:00.633 INFO:teuthology.orchestra.run.smithi008.stdout:Name : grub2-tools 2023-08-11T11:55:00.634 INFO:teuthology.orchestra.run.smithi008.stdout:Epoch : 1 2023-08-11T11:55:00.634 INFO:teuthology.orchestra.run.smithi008.stdout:Version : 2.02 2023-08-11T11:55:00.634 INFO:teuthology.orchestra.run.smithi008.stdout:Release : 123.el8 2023-08-11T11:55:00.634 INFO:teuthology.orchestra.run.smithi008.stdout:Architecture: x86_64 2023-08-11T11:55:00.634 INFO:teuthology.orchestra.run.smithi008.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-08-11T11:55:00.635 INFO:teuthology.orchestra.run.smithi008.stdout:Group : System Environment/Base 2023-08-11T11:55:00.635 INFO:teuthology.orchestra.run.smithi008.stdout:Size : 9265450 2023-08-11T11:55:00.635 INFO:teuthology.orchestra.run.smithi008.stdout:License : GPLv3+ 2023-08-11T11:55:00.635 INFO:teuthology.orchestra.run.smithi008.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-08-11T11:55:00.635 INFO:teuthology.orchestra.run.smithi008.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-08-11T11:55:00.635 INFO:teuthology.orchestra.run.smithi008.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-08-11T11:55:00.635 INFO:teuthology.orchestra.run.smithi008.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-08-11T11:55:00.636 INFO:teuthology.orchestra.run.smithi008.stdout:Relocations : (not relocatable) 2023-08-11T11:55:00.636 INFO:teuthology.orchestra.run.smithi008.stdout:Packager : Red Hat, Inc. 2023-08-11T11:55:00.636 INFO:teuthology.orchestra.run.smithi008.stdout:Vendor : Red Hat, Inc. 2023-08-11T11:55:00.636 INFO:teuthology.orchestra.run.smithi008.stdout:URL : http://www.gnu.org/software/grub/ 2023-08-11T11:55:00.636 INFO:teuthology.orchestra.run.smithi008.stdout:Summary : Support tools for GRUB. 2023-08-11T11:55:00.636 INFO:teuthology.orchestra.run.smithi008.stdout:Description : 2023-08-11T11:55:00.636 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T11:55:00.637 INFO:teuthology.orchestra.run.smithi008.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-08-11T11:55:00.637 INFO:teuthology.orchestra.run.smithi008.stdout:customizable bootloader with modular architecture. It supports a rich 2023-08-11T11:55:00.637 INFO:teuthology.orchestra.run.smithi008.stdout:variety of kernel formats, file systems, computer architectures and 2023-08-11T11:55:00.637 INFO:teuthology.orchestra.run.smithi008.stdout:hardware devices. 2023-08-11T11:55:00.637 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T11:55:00.637 INFO:teuthology.orchestra.run.smithi008.stdout:This subpackage provides tools for support of all platforms. 2023-08-11T11:55:00.638 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-08-11T11:55:00.638 INFO:teuthology.task.kernel:Updating grub on smithi008 to boot 6.5.0-rc4-ga7fb1265323d 2023-08-11T11:55:00.639 DEBUG:teuthology.orchestra.run.smithi008:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-08-11T11:55:03.346 INFO:teuthology.orchestra.run.smithi008.stderr:Generating grub configuration file ... 2023-08-11T11:55:05.482 INFO:teuthology.orchestra.run.smithi008.stderr:done 2023-08-11T11:55:05.484 DEBUG:teuthology.orchestra.run.smithi008:> mktemp 2023-08-11T11:55:05.507 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/tmp.601bGlqaa3 2023-08-11T11:55:05.507 DEBUG:teuthology.orchestra.run.smithi008:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.601bGlqaa3 2023-08-11T11:55:05.579 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0666 /tmp/tmp.601bGlqaa3 2023-08-11T11:55:05.726 DEBUG:teuthology.orchestra.remote:smithi008:/tmp/tmp.601bGlqaa3 is 6KB 2023-08-11T11:55:05.774 DEBUG:teuthology.orchestra.run.smithi008:> rm -fr /tmp/tmp.601bGlqaa3 2023-08-11T11:55:05.791 DEBUG:teuthology.orchestra.run.smithi008:> sudo /bin/ls /boot/loader/entries || true 2023-08-11T11:55:05.866 INFO:teuthology.orchestra.run.smithi008.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-08-11T11:55:05.866 INFO:teuthology.orchestra.run.smithi008.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-08-11T11:55:05.866 INFO:teuthology.orchestra.run.smithi008.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc4-ga7fb1265323d.conf 2023-08-11T11:55:05.867 DEBUG:teuthology.orchestra.run.smithi008:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc4-ga7fb1265323d 2023-08-11T11:55:06.010 DEBUG:teuthology.orchestra.run.smithi008:> sudo shutdown -r now 2023-08-11T11:55:36.013 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-08-11T11:55:36.014 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-08-11T11:55:36.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T11:55:54.352 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-08-11T11:56:03.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-08-11T11:56:03.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T11:56:06.416 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-08-11T11:56:18.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-08-11T11:56:18.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T11:56:50.251 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-08-11T11:56:50.626 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-08-11T11:56:50.627 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc4-ga7fb1265323d"... 2023-08-11T11:56:50.627 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2023-08-11T11:56:50.671 INFO:teuthology.orchestra.run.smithi008.stdout:6.5.0-rc4-ga7fb1265323d 2023-08-11T11:56:50.671 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc4-ga7fb1265323d vs 6.5.0-rc4-ga7fb1265323d 2023-08-11T11:56:50.671 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-11T11:56:50.672 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-08-11T11:56:51.673 DEBUG:teuthology.parallel:result is None 2023-08-11T11:56:51.673 INFO:teuthology.run_tasks:Running task internal.base... 2023-08-11T11:56:51.680 INFO:teuthology.task.internal:Creating test directory... 2023-08-11T11:56:51.681 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-11T11:56:51.686 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-11T11:56:51.688 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-11T11:56:51.725 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-08-11T11:56:51.753 INFO:teuthology.run_tasks:Running task internal.archive... 2023-08-11T11:56:51.760 INFO:teuthology.task.internal:Creating archive directory... 2023-08-11T11:56:51.761 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-11T11:56:51.766 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-11T11:56:51.769 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-11T11:56:51.825 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-08-11T11:56:51.832 INFO:teuthology.task.internal:Enabling coredump saving... 2023-08-11T11:56:51.833 DEBUG:teuthology.orchestra.run.smithi045:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-11T11:56:51.853 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-11T11:56:51.853 DEBUG:teuthology.orchestra.run.smithi194:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-11T11:56:51.872 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-11T11:56:51.873 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-11T11:56:51.877 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-11T11:56:51.896 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-11T11:56:51.932 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-11T11:56:51.952 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-11T11:56:51.953 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-11T11:56:51.970 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-11T11:56:52.025 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-11T11:56:52.069 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-11T11:56:52.073 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-08-11T11:56:52.080 INFO:teuthology.task.internal:Configuring sudo... 2023-08-11T11:56:52.080 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-11T11:56:52.085 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-11T11:56:52.087 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-11T11:56:52.153 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-08-11T11:56:52.161 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-08-11T11:56:52.162 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-11T11:56:52.166 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-11T11:56:52.168 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-11T11:56:52.205 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-11T11:56:52.311 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-11T11:56:52.388 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-11T11:56:52.457 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-11T11:56:52.526 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-11T11:56:52.527 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-11T11:56:52.596 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-11T11:56:52.641 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-11T11:56:52.701 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-11T11:56:52.785 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-11T11:56:52.834 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-08-11T11:56:52.835 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-11T11:56:52.905 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-11T11:56:52.949 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-11T11:56:53.013 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-11T11:56:53.052 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-11T11:56:53.103 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-08-11T11:56:53.103 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-11T11:56:53.172 DEBUG:teuthology.orchestra.run.smithi008:> sudo service rsyslog restart 2023-08-11T11:56:53.177 DEBUG:teuthology.orchestra.run.smithi045:> sudo service rsyslog restart 2023-08-11T11:56:53.180 DEBUG:teuthology.orchestra.run.smithi194:> sudo service rsyslog restart 2023-08-11T11:56:53.245 INFO:teuthology.orchestra.run.smithi045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-11T11:56:53.273 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-11T11:56:53.291 INFO:teuthology.orchestra.run.smithi008.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-11T11:56:53.743 INFO:teuthology.run_tasks:Running task internal.timer... 2023-08-11T11:56:53.757 INFO:teuthology.task.internal:Starting timer... 2023-08-11T11:56:53.757 INFO:teuthology.run_tasks:Running task pcp... 2023-08-11T11:56:53.814 INFO:teuthology.run_tasks:Running task selinux... 2023-08-11T11:56:53.823 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-08-11T11:56:53.824 DEBUG:teuthology.orchestra.run.smithi008:> sudo service auditd rotate 2023-08-11T11:56:53.933 INFO:teuthology.orchestra.run.smithi008.stdout:Rotating logs: 2023-08-11T11:56:53.936 DEBUG:teuthology.orchestra.run.smithi045:> sudo service auditd rotate 2023-08-11T11:56:54.004 INFO:teuthology.orchestra.run.smithi045.stdout:Rotating logs: 2023-08-11T11:56:54.005 DEBUG:teuthology.orchestra.run.smithi194:> sudo service auditd rotate 2023-08-11T11:56:54.064 INFO:teuthology.orchestra.run.smithi194.stdout:Rotating logs: 2023-08-11T11:56:54.066 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-08-11T11:56:54.066 DEBUG:teuthology.orchestra.run.smithi008:> /usr/sbin/getenforce 2023-08-11T11:56:54.122 INFO:teuthology.orchestra.run.smithi008.stdout:Permissive 2023-08-11T11:56:54.123 DEBUG:teuthology.orchestra.run.smithi045:> /usr/sbin/getenforce 2023-08-11T11:56:54.144 INFO:teuthology.orchestra.run.smithi045.stdout:Permissive 2023-08-11T11:56:54.145 DEBUG:teuthology.orchestra.run.smithi194:> /usr/sbin/getenforce 2023-08-11T11:56:54.170 INFO:teuthology.orchestra.run.smithi194.stdout:Permissive 2023-08-11T11:56:54.170 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi008.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi045.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi194.front.sepia.ceph.com': 'permissive'} 2023-08-11T11:56:54.171 DEBUG:teuthology.orchestra.run.smithi008:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-11T11:56:54.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-11T11:56:54.241 DEBUG:teuthology.orchestra.run.smithi045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-11T11:56:54.270 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-11T11:56:54.270 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-11T11:56:54.297 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-11T11:56:54.298 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-08-11T11:56:54.299 DEBUG:teuthology.orchestra.run.smithi008:> sudo /usr/sbin/setenforce permissive 2023-08-11T11:56:54.367 DEBUG:teuthology.orchestra.run.smithi045:> sudo /usr/sbin/setenforce permissive 2023-08-11T11:56:54.395 DEBUG:teuthology.orchestra.run.smithi194:> sudo /usr/sbin/setenforce permissive 2023-08-11T11:56:54.422 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-08-11T11:56:54.433 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-08-11T11:56:54.434 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-08-11T11:56:54.457 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-08-11T11:56:54.459 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi008.front.sepia.ceph.com,smithi045.front.sepia.ceph.com,smithi194.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-08-11T12:10:09.916 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi008.front.sepia.ceph.com'), Remote(name='ubuntu@smithi045.front.sepia.ceph.com'), Remote(name='ubuntu@smithi194.front.sepia.ceph.com')] 2023-08-11T12:10:09.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-08-11T12:10:09.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T12:10:10.009 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-08-11T12:10:10.117 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-08-11T12:10:10.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-08-11T12:10:10.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T12:10:10.189 DEBUG:teuthology.orchestra.run.smithi045:> true 2023-08-11T12:10:10.260 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-08-11T12:10:10.261 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-08-11T12:10:10.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T12:10:10.330 DEBUG:teuthology.orchestra.run.smithi194:> true 2023-08-11T12:10:10.399 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-08-11T12:10:10.400 INFO:teuthology.run_tasks:Running task clock... 2023-08-11T12:10:10.413 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-08-11T12:10:10.413 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-11T12:10:10.414 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-11T12:10:10.420 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-11T12:10:10.420 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-11T12:10:10.422 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-11T12:10:10.423 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-11T12:10:10.458 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-11T12:10:10.474 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-11T12:10:10.475 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-11T12:10:10.491 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-11T12:10:10.492 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-11T12:10:10.527 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-11T12:10:10.549 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: ntpd: command not found 2023-08-11T12:10:10.556 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: ntpd: command not found 2023-08-11T12:10:10.563 INFO:teuthology.orchestra.run.smithi045.stdout:506 Cannot talk to daemon 2023-08-11T12:10:10.569 INFO:teuthology.orchestra.run.smithi194.stdout:506 Cannot talk to daemon 2023-08-11T12:10:10.579 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-11T12:10:10.584 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-11T12:10:10.594 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-11T12:10:10.598 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-11T12:10:10.620 INFO:teuthology.orchestra.run.smithi008.stderr:sudo: ntpd: command not found 2023-08-11T12:10:10.650 INFO:teuthology.orchestra.run.smithi008.stdout:506 Cannot talk to daemon 2023-08-11T12:10:10.666 INFO:teuthology.orchestra.run.smithi194.stderr:bash: ntpq: command not found 2023-08-11T12:10:10.670 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-11T12:10:10.670 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2023-08-11T12:10:10.670 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-11T12:10:10.671 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-11T12:10:10.671 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-11T12:10:10.671 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-11T12:10:10.672 INFO:teuthology.orchestra.run.smithi045.stderr:bash: ntpq: command not found 2023-08-11T12:10:10.676 INFO:teuthology.orchestra.run.smithi045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-11T12:10:10.676 INFO:teuthology.orchestra.run.smithi045.stdout:=============================================================================== 2023-08-11T12:10:10.676 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-11T12:10:10.676 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-11T12:10:10.676 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-11T12:10:10.677 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-11T12:10:10.686 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-11T12:10:10.721 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-11T12:10:10.812 INFO:teuthology.orchestra.run.smithi008.stderr:bash: ntpq: command not found 2023-08-11T12:10:10.820 INFO:teuthology.orchestra.run.smithi008.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-11T12:10:10.822 INFO:teuthology.orchestra.run.smithi008.stdout:=============================================================================== 2023-08-11T12:10:10.822 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-11T12:10:10.822 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-11T12:10:10.822 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-11T12:10:10.823 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-11T12:10:10.825 INFO:teuthology.run_tasks:Running task pexec... 2023-08-11T12:10:10.842 INFO:teuthology.task.pexec:Executing custom commands... 2023-08-11T12:10:10.843 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi008.front.sepia.ceph.com 2023-08-11T12:10:10.844 DEBUG:teuthology.orchestra.run.smithi008:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-08-11T12:10:10.845 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi045.front.sepia.ceph.com 2023-08-11T12:10:10.845 DEBUG:teuthology.orchestra.run.smithi045:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-08-11T12:10:10.846 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi194.front.sepia.ceph.com 2023-08-11T12:10:10.846 DEBUG:teuthology.orchestra.run.smithi194:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-08-11T12:10:11.220 INFO:teuthology.orchestra.run.smithi194.stdout:Updating Subscription Management repositories. 2023-08-11T12:10:11.242 INFO:teuthology.orchestra.run.smithi045.stdout:Updating Subscription Management repositories. 2023-08-11T12:10:11.364 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-08-11T12:10:12.761 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:05:09 ago on Fri 11 Aug 2023 12:05:03 PM UTC. 2023-08-11T12:10:13.110 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:18 ago on Fri 11 Aug 2023 12:07:54 PM UTC. 2023-08-11T12:10:13.146 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:04:57 ago on Fri 11 Aug 2023 12:05:15 PM UTC. 2023-08-11T12:10:14.632 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2023-08-11T12:10:14.633 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2023-08-11T12:10:14.633 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2023-08-11T12:10:14.633 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2023-08-11T12:10:14.634 INFO:teuthology.orchestra.run.smithi194.stdout:Resetting modules: 2023-08-11T12:10:14.634 INFO:teuthology.orchestra.run.smithi194.stdout: container-tools 2023-08-11T12:10:14.634 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-08-11T12:10:14.634 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2023-08-11T12:10:14.634 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2023-08-11T12:10:14.634 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-08-11T12:10:15.148 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2023-08-11T12:10:15.149 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2023-08-11T12:10:15.149 INFO:teuthology.orchestra.run.smithi045.stdout: Package Architecture Version Repository Size 2023-08-11T12:10:15.149 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2023-08-11T12:10:15.149 INFO:teuthology.orchestra.run.smithi045.stdout:Resetting modules: 2023-08-11T12:10:15.149 INFO:teuthology.orchestra.run.smithi045.stdout: container-tools 2023-08-11T12:10:15.150 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-08-11T12:10:15.150 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2023-08-11T12:10:15.150 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2023-08-11T12:10:15.150 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-08-11T12:10:15.167 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-08-11T12:10:15.169 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-08-11T12:10:15.169 INFO:teuthology.orchestra.run.smithi008.stdout: Package Architecture Version Repository Size 2023-08-11T12:10:15.169 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-08-11T12:10:15.169 INFO:teuthology.orchestra.run.smithi008.stdout:Resetting modules: 2023-08-11T12:10:15.169 INFO:teuthology.orchestra.run.smithi008.stdout: container-tools 2023-08-11T12:10:15.170 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:10:15.170 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-08-11T12:10:15.170 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-08-11T12:10:15.170 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:10:15.579 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:05:12 ago on Fri 11 Aug 2023 12:05:03 PM UTC. 2023-08-11T12:10:16.152 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:05:00 ago on Fri 11 Aug 2023 12:05:15 PM UTC. 2023-08-11T12:10:16.452 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:21 ago on Fri 11 Aug 2023 12:07:54 PM UTC. 2023-08-11T12:10:27.203 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2023-08-11T12:10:27.675 INFO:teuthology.orchestra.run.smithi194.stdout:Updating Subscription Management repositories. 2023-08-11T12:10:28.340 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-08-11T12:10:28.512 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2023-08-11T12:10:28.960 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-08-11T12:10:28.995 INFO:teuthology.orchestra.run.smithi045.stdout:Updating Subscription Management repositories. 2023-08-11T12:10:29.306 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:05:25 ago on Fri 11 Aug 2023 12:05:03 PM UTC. 2023-08-11T12:10:30.876 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:36 ago on Fri 11 Aug 2023 12:07:54 PM UTC. 2023-08-11T12:10:30.877 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:05:15 ago on Fri 11 Aug 2023 12:05:15 PM UTC. 2023-08-11T12:10:31.018 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2023-08-11T12:10:31.111 INFO:teuthology.orchestra.run.smithi194.stdout:============================================================================================================ 2023-08-11T12:10:31.111 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2023-08-11T12:10:31.111 INFO:teuthology.orchestra.run.smithi194.stdout:============================================================================================================ 2023-08-11T12:10:31.111 INFO:teuthology.orchestra.run.smithi194.stdout:Installing group/module packages: 2023-08-11T12:10:31.111 INFO:teuthology.orchestra.run.smithi194.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-08-11T12:10:31.111 INFO:teuthology.orchestra.run.smithi194.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-08-11T12:10:31.112 INFO:teuthology.orchestra.run.smithi194.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-08-11T12:10:31.112 INFO:teuthology.orchestra.run.smithi194.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-08-11T12:10:31.112 INFO:teuthology.orchestra.run.smithi194.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-08-11T12:10:31.112 INFO:teuthology.orchestra.run.smithi194.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-08-11T12:10:31.112 INFO:teuthology.orchestra.run.smithi194.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-08-11T12:10:31.112 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2023-08-11T12:10:31.112 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-08-11T12:10:31.113 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-08-11T12:10:31.113 INFO:teuthology.orchestra.run.smithi194.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-08-11T12:10:31.113 INFO:teuthology.orchestra.run.smithi194.stdout:Installing module profiles: 2023-08-11T12:10:31.113 INFO:teuthology.orchestra.run.smithi194.stdout: container-tools/common 2023-08-11T12:10:31.113 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-08-11T12:10:31.113 INFO:teuthology.orchestra.run.smithi194.stdout:Enabling module streams: 2023-08-11T12:10:31.113 INFO:teuthology.orchestra.run.smithi194.stdout: container-tools rhel8 2023-08-11T12:10:31.113 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-08-11T12:10:31.114 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2023-08-11T12:10:31.114 INFO:teuthology.orchestra.run.smithi194.stdout:============================================================================================================ 2023-08-11T12:10:31.114 INFO:teuthology.orchestra.run.smithi194.stdout:Install 10 Packages 2023-08-11T12:10:31.114 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-08-11T12:10:31.115 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 18 M 2023-08-11T12:10:31.115 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 65 M 2023-08-11T12:10:31.115 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2023-08-11T12:10:31.259 INFO:teuthology.orchestra.run.smithi194.stdout:(1/10): python3-pytoml-0.1.14-5.git7dea353.el8. 172 kB/s | 25 kB 00:00 2023-08-11T12:10:31.282 INFO:teuthology.orchestra.run.smithi194.stdout:(2/10): yajl-2.1.0-10.el8.x86_64.rpm 241 kB/s | 41 kB 00:00 2023-08-11T12:10:31.350 INFO:teuthology.orchestra.run.smithi194.stdout:(3/10): python3-pyxdg-0.25-16.el8.noarch.rpm 397 kB/s | 94 kB 00:00 2023-08-11T12:10:31.400 INFO:teuthology.orchestra.run.smithi194.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 347 kB/s | 49 kB 00:00 2023-08-11T12:10:31.442 INFO:teuthology.orchestra.run.smithi194.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 3.2 MB/s | 524 kB 00:00 2023-08-11T12:10:31.609 INFO:teuthology.orchestra.run.smithi194.stdout:(6/10): buildah-1.26.2-1.module+el8.6.0+16771+2 31 MB/s | 8.0 MB 00:00 2023-08-11T12:10:31.625 INFO:teuthology.orchestra.run.smithi194.stdout:(7/10): python3-podman-4.0.1-1.module+el8.6.0+1 663 kB/s | 149 kB 00:00 2023-08-11T12:10:31.651 INFO:teuthology.orchestra.run.smithi194.stdout:(8/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 1.0 MB/s | 213 kB 00:00 2023-08-11T12:10:31.876 INFO:teuthology.orchestra.run.smithi194.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 26 MB/s | 7.0 MB 00:00 2023-08-11T12:10:31.951 INFO:teuthology.orchestra.run.smithi194.stdout:(10/10): toolbox-0.0.99.3-0.6.module+el8.6.0+16 6.7 MB/s | 2.2 MB 00:00 2023-08-11T12:10:31.952 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2023-08-11T12:10:31.952 INFO:teuthology.orchestra.run.smithi194.stdout:Total 22 MB/s | 18 MB 00:00 2023-08-11T12:10:32.152 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2023-08-11T12:10:32.172 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2023-08-11T12:10:32.172 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2023-08-11T12:10:32.354 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2023-08-11T12:10:32.358 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2023-08-11T12:10:32.846 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2023-08-11T12:10:32.859 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2023-08-11T12:10:32.949 INFO:teuthology.orchestra.run.smithi045.stdout:============================================================================================================ 2023-08-11T12:10:32.950 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2023-08-11T12:10:32.950 INFO:teuthology.orchestra.run.smithi045.stdout:============================================================================================================ 2023-08-11T12:10:32.950 INFO:teuthology.orchestra.run.smithi045.stdout:Installing group/module packages: 2023-08-11T12:10:32.950 INFO:teuthology.orchestra.run.smithi045.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-08-11T12:10:32.950 INFO:teuthology.orchestra.run.smithi045.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-08-11T12:10:32.950 INFO:teuthology.orchestra.run.smithi045.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-08-11T12:10:32.950 INFO:teuthology.orchestra.run.smithi045.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-08-11T12:10:32.951 INFO:teuthology.orchestra.run.smithi045.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-08-11T12:10:32.951 INFO:teuthology.orchestra.run.smithi045.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-08-11T12:10:32.951 INFO:teuthology.orchestra.run.smithi045.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-08-11T12:10:32.951 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2023-08-11T12:10:32.952 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-08-11T12:10:32.953 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-08-11T12:10:32.953 INFO:teuthology.orchestra.run.smithi045.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-08-11T12:10:32.953 INFO:teuthology.orchestra.run.smithi045.stdout:Installing module profiles: 2023-08-11T12:10:32.953 INFO:teuthology.orchestra.run.smithi045.stdout: container-tools/common 2023-08-11T12:10:32.953 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-08-11T12:10:32.953 INFO:teuthology.orchestra.run.smithi045.stdout:Enabling module streams: 2023-08-11T12:10:32.954 INFO:teuthology.orchestra.run.smithi045.stdout: container-tools rhel8 2023-08-11T12:10:32.954 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-08-11T12:10:32.954 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2023-08-11T12:10:32.954 INFO:teuthology.orchestra.run.smithi045.stdout:============================================================================================================ 2023-08-11T12:10:32.955 INFO:teuthology.orchestra.run.smithi045.stdout:Install 10 Packages 2023-08-11T12:10:32.955 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-08-11T12:10:32.955 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 18 M 2023-08-11T12:10:32.955 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 65 M 2023-08-11T12:10:32.955 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2023-08-11T12:10:33.005 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-08-11T12:10:33.077 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-08-11T12:10:33.112 INFO:teuthology.orchestra.run.smithi008.stdout:============================================================================================================ 2023-08-11T12:10:33.112 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-08-11T12:10:33.113 INFO:teuthology.orchestra.run.smithi008.stdout:============================================================================================================ 2023-08-11T12:10:33.113 INFO:teuthology.orchestra.run.smithi008.stdout:Installing group/module packages: 2023-08-11T12:10:33.113 INFO:teuthology.orchestra.run.smithi008.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-08-11T12:10:33.113 INFO:teuthology.orchestra.run.smithi008.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-08-11T12:10:33.113 INFO:teuthology.orchestra.run.smithi008.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-08-11T12:10:33.113 INFO:teuthology.orchestra.run.smithi008.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-08-11T12:10:33.114 INFO:teuthology.orchestra.run.smithi008.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-08-11T12:10:33.114 INFO:teuthology.orchestra.run.smithi008.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-08-11T12:10:33.114 INFO:teuthology.orchestra.run.smithi008.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-08-11T12:10:33.114 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-08-11T12:10:33.114 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-08-11T12:10:33.114 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-08-11T12:10:33.114 INFO:teuthology.orchestra.run.smithi008.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-08-11T12:10:33.115 INFO:teuthology.orchestra.run.smithi008.stdout:Installing module profiles: 2023-08-11T12:10:33.115 INFO:teuthology.orchestra.run.smithi008.stdout: container-tools/common 2023-08-11T12:10:33.115 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:10:33.115 INFO:teuthology.orchestra.run.smithi008.stdout:Enabling module streams: 2023-08-11T12:10:33.115 INFO:teuthology.orchestra.run.smithi008.stdout: container-tools rhel8 2023-08-11T12:10:33.115 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:10:33.115 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-08-11T12:10:33.116 INFO:teuthology.orchestra.run.smithi008.stdout:============================================================================================================ 2023-08-11T12:10:33.116 INFO:teuthology.orchestra.run.smithi008.stdout:Install 10 Packages 2023-08-11T12:10:33.116 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:10:33.116 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 18 M 2023-08-11T12:10:33.117 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 65 M 2023-08-11T12:10:33.117 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-08-11T12:10:33.208 INFO:teuthology.orchestra.run.smithi008.stdout:(1/10): python3-pytoml-0.1.14-5.git7dea353.el8. 267 kB/s | 25 kB 00:00 2023-08-11T12:10:33.234 INFO:teuthology.orchestra.run.smithi008.stdout:(2/10): yajl-2.1.0-10.el8.x86_64.rpm 345 kB/s | 41 kB 00:00 2023-08-11T12:10:33.274 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-08-11T12:10:33.276 INFO:teuthology.orchestra.run.smithi008.stdout:(3/10): python3-pyxdg-0.25-16.el8.noarch.rpm 585 kB/s | 94 kB 00:00 2023-08-11T12:10:33.326 INFO:teuthology.orchestra.run.smithi008.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 421 kB/s | 49 kB 00:00 2023-08-11T12:10:33.402 INFO:teuthology.orchestra.run.smithi008.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 3.1 MB/s | 524 kB 00:00 2023-08-11T12:10:33.406 INFO:teuthology.orchestra.run.smithi045.stdout:(1/10): yajl-2.1.0-10.el8.x86_64.rpm 90 kB/s | 41 kB 00:00 2023-08-11T12:10:33.431 INFO:teuthology.orchestra.run.smithi045.stdout:(2/10): python3-pyxdg-0.25-16.el8.noarch.rpm 196 kB/s | 94 kB 00:00 2023-08-11T12:10:33.459 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-08-11T12:10:33.460 INFO:teuthology.orchestra.run.smithi008.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 1.1 MB/s | 149 kB 00:00 2023-08-11T12:10:33.464 INFO:teuthology.orchestra.run.smithi045.stdout:(3/10): python3-pytoml-0.1.14-5.git7dea353.el8. 48 kB/s | 25 kB 00:00 2023-08-11T12:10:33.531 INFO:teuthology.orchestra.run.smithi045.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 394 kB/s | 49 kB 00:00 2023-08-11T12:10:33.554 INFO:teuthology.orchestra.run.smithi008.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 1.4 MB/s | 213 kB 00:00 2023-08-11T12:10:33.592 INFO:teuthology.orchestra.run.smithi045.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 3.2 MB/s | 524 kB 00:00 2023-08-11T12:10:33.638 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-08-11T12:10:33.665 INFO:teuthology.orchestra.run.smithi045.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 1.1 MB/s | 149 kB 00:00 2023-08-11T12:10:33.703 INFO:teuthology.orchestra.run.smithi008.stdout:(8/10): buildah-1.26.2-1.module+el8.6.0+16771+2 19 MB/s | 8.0 MB 00:00 2023-08-11T12:10:33.778 INFO:teuthology.orchestra.run.smithi045.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 1.1 MB/s | 213 kB 00:00 2023-08-11T12:10:33.853 INFO:teuthology.orchestra.run.smithi008.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 18 MB/s | 7.0 MB 00:00 2023-08-11T12:10:33.916 INFO:teuthology.orchestra.run.smithi045.stdout:(8/10): buildah-1.26.2-1.module+el8.6.0+16771+2 18 MB/s | 8.0 MB 00:00 2023-08-11T12:10:33.923 INFO:teuthology.orchestra.run.smithi008.stdout:(10/10): toolbox-0.0.99.3-0.6.module+el8.6.0+16 5.9 MB/s | 2.2 MB 00:00 2023-08-11T12:10:33.923 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-08-11T12:10:33.924 INFO:teuthology.orchestra.run.smithi008.stdout:Total 23 MB/s | 18 MB 00:00 2023-08-11T12:10:33.977 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-08-11T12:10:34.008 INFO:teuthology.orchestra.run.smithi045.stdout:(9/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 9.4 MB/s | 2.2 MB 00:00 2023-08-11T12:10:34.092 INFO:teuthology.orchestra.run.smithi045.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 16 MB/s | 7.0 MB 00:00 2023-08-11T12:10:34.093 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2023-08-11T12:10:34.093 INFO:teuthology.orchestra.run.smithi045.stdout:Total 16 MB/s | 18 MB 00:01 2023-08-11T12:10:34.268 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-08-11T12:10:34.292 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-08-11T12:10:34.292 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-08-11T12:10:34.301 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2023-08-11T12:10:34.323 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2023-08-11T12:10:34.323 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2023-08-11T12:10:34.517 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2023-08-11T12:10:34.521 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2023-08-11T12:10:34.756 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-08-11T12:10:34.813 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-08-11T12:10:34.818 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-08-11T12:10:35.086 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2023-08-11T12:10:35.291 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-08-11T12:10:35.377 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-08-11T12:10:35.444 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-08-11T12:10:35.571 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-08-11T12:10:35.625 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-08-11T12:10:35.651 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-08-11T12:10:35.755 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-08-11T12:10:35.842 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-08-11T12:10:35.871 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-08-11T12:10:36.018 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-08-11T12:10:36.023 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-08-11T12:10:36.227 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-08-11T12:10:36.234 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-08-11T12:10:36.241 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-08-11T12:10:36.508 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-08-11T12:10:36.509 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-08-11T12:10:36.509 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-08-11T12:10:36.509 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-08-11T12:10:36.509 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-08-11T12:10:36.509 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-08-11T12:10:36.509 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-08-11T12:10:36.510 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-08-11T12:10:36.510 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-08-11T12:10:36.510 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-08-11T12:10:36.645 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-08-11T12:10:37.039 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-08-11T12:10:37.483 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-08-11T12:10:37.605 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-08-11T12:10:37.605 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:05:34 ago on Fri 11 Aug 2023 12:05:03 PM UTC. 2023-08-11T12:10:38.003 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-08-11T12:10:38.258 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-08-11T12:10:38.442 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-08-11T12:10:38.486 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-08-11T12:10:38.652 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-08-11T12:10:38.778 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-08-11T12:10:38.916 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-08-11T12:10:38.916 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-08-11T12:10:38.917 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-08-11T12:10:38.917 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-08-11T12:10:38.917 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-08-11T12:10:38.917 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-08-11T12:10:38.917 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-08-11T12:10:38.917 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-08-11T12:10:38.918 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-08-11T12:10:38.918 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-08-11T12:10:39.010 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-08-11T12:10:39.216 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-08-11T12:10:39.656 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-08-11T12:10:39.656 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-08-11T12:10:39.656 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-08-11T12:10:39.656 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-08-11T12:10:39.657 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-08-11T12:10:39.657 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-08-11T12:10:39.657 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-08-11T12:10:39.657 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-08-11T12:10:39.657 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-08-11T12:10:39.657 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-08-11T12:10:40.142 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-08-11T12:10:40.143 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:05:24 ago on Fri 11 Aug 2023 12:05:15 PM UTC. 2023-08-11T12:10:41.106 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-08-11T12:10:41.106 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:46 ago on Fri 11 Aug 2023 12:07:54 PM UTC. 2023-08-11T12:10:47.068 INFO:teuthology.orchestra.run.smithi194.stdout:Installed products updated. 2023-08-11T12:10:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-08-11T12:10:47.279 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2023-08-11T12:10:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-08-11T12:10:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-08-11T12:10:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-08-11T12:10:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-08-11T12:10:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-08-11T12:10:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-08-11T12:10:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-08-11T12:10:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-08-11T12:10:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-08-11T12:10:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: yajl-2.1.0-10.el8.x86_64 2023-08-11T12:10:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-08-11T12:10:47.281 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2023-08-11T12:10:47.651 DEBUG:teuthology.parallel:result is None 2023-08-11T12:10:49.928 INFO:teuthology.orchestra.run.smithi045.stdout:Installed products updated. 2023-08-11T12:10:50.178 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-08-11T12:10:50.179 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2023-08-11T12:10:50.179 INFO:teuthology.orchestra.run.smithi045.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-08-11T12:10:50.179 INFO:teuthology.orchestra.run.smithi045.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-08-11T12:10:50.179 INFO:teuthology.orchestra.run.smithi045.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-08-11T12:10:50.179 INFO:teuthology.orchestra.run.smithi045.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-08-11T12:10:50.179 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-08-11T12:10:50.180 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-08-11T12:10:50.180 INFO:teuthology.orchestra.run.smithi045.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-08-11T12:10:50.180 INFO:teuthology.orchestra.run.smithi045.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-08-11T12:10:50.180 INFO:teuthology.orchestra.run.smithi045.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-08-11T12:10:50.180 INFO:teuthology.orchestra.run.smithi045.stdout: yajl-2.1.0-10.el8.x86_64 2023-08-11T12:10:50.180 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-08-11T12:10:50.181 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2023-08-11T12:10:50.346 DEBUG:teuthology.parallel:result is None 2023-08-11T12:10:50.975 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-08-11T12:10:51.196 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:10:51.197 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-08-11T12:10:51.197 INFO:teuthology.orchestra.run.smithi008.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-08-11T12:10:51.197 INFO:teuthology.orchestra.run.smithi008.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-08-11T12:10:51.197 INFO:teuthology.orchestra.run.smithi008.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-08-11T12:10:51.197 INFO:teuthology.orchestra.run.smithi008.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-08-11T12:10:51.197 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-08-11T12:10:51.197 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-08-11T12:10:51.198 INFO:teuthology.orchestra.run.smithi008.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-08-11T12:10:51.198 INFO:teuthology.orchestra.run.smithi008.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-08-11T12:10:51.198 INFO:teuthology.orchestra.run.smithi008.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-08-11T12:10:51.198 INFO:teuthology.orchestra.run.smithi008.stdout: yajl-2.1.0-10.el8.x86_64 2023-08-11T12:10:51.198 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:10:51.198 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-08-11T12:10:51.407 DEBUG:teuthology.parallel:result is None 2023-08-11T12:10:51.408 INFO:teuthology.run_tasks:Running task install... 2023-08-11T12:10:51.415 DEBUG:teuthology.task.install:project ceph 2023-08-11T12:10:51.416 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '92684807f016ce045ac66e37fdde6f8c47857bcc'}} 2023-08-11T12:10:51.416 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '92684807f016ce045ac66e37fdde6f8c47857bcc'} 2023-08-11T12:10:51.417 INFO:teuthology.task.install:Using flavor: default 2023-08-11T12:10:51.424 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-08-11T12:10:51.425 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-08-11T12:10:51.426 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '92684807f016ce045ac66e37fdde6f8c47857bcc', 'tag': None, 'wait_for_package': False} 2023-08-11T12:10:51.427 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=92684807f016ce045ac66e37fdde6f8c47857bcc 2023-08-11T12:10:51.429 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '92684807f016ce045ac66e37fdde6f8c47857bcc', 'tag': None, 'wait_for_package': False} 2023-08-11T12:10:51.430 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=92684807f016ce045ac66e37fdde6f8c47857bcc 2023-08-11T12:10:51.431 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '92684807f016ce045ac66e37fdde6f8c47857bcc', 'tag': None, 'wait_for_package': False} 2023-08-11T12:10:51.431 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=92684807f016ce045ac66e37fdde6f8c47857bcc 2023-08-11T12:10:51.580 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-b4/92684807f016ce045ac66e37fdde6f8c47857bcc/centos/8/flavors/default/ 2023-08-11T12:10:51.581 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5437.g92684807 2023-08-11T12:10:51.585 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-b4/92684807f016ce045ac66e37fdde6f8c47857bcc/centos/8/flavors/default/ 2023-08-11T12:10:51.585 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5437.g92684807 2023-08-11T12:10:51.643 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-b4/92684807f016ce045ac66e37fdde6f8c47857bcc/centos/8/flavors/default/ 2023-08-11T12:10:51.643 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5437.g92684807 2023-08-11T12:10:51.685 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-b4/92684807f016ce045ac66e37fdde6f8c47857bcc/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-b4/92684807f016ce045ac66e37fdde6f8c47857bcc/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-b4/92684807f016ce045ac66e37fdde6f8c47857bcc/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-11T12:10:51.686 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-08-11T12:10:51.686 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-11T12:10:51.690 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-b4/92684807f016ce045ac66e37fdde6f8c47857bcc/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-b4/92684807f016ce045ac66e37fdde6f8c47857bcc/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-b4/92684807f016ce045ac66e37fdde6f8c47857bcc/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-11T12:10:51.691 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-11T12:10:51.692 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-11T12:10:51.715 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-11T12:10:51.715 DEBUG:teuthology.orchestra.run.smithi045:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/92684807f016ce045ac66e37fdde6f8c47857bcc/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-11T12:10:51.746 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-b4/92684807f016ce045ac66e37fdde6f8c47857bcc/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-b4/92684807f016ce045ac66e37fdde6f8c47857bcc/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-b4/92684807f016ce045ac66e37fdde6f8c47857bcc/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-11T12:10:51.747 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-08-11T12:10:51.748 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-11T12:10:51.762 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-11T12:10:51.762 DEBUG:teuthology.orchestra.run.smithi008:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/92684807f016ce045ac66e37fdde6f8c47857bcc/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-11T12:10:51.776 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-11T12:10:51.777 DEBUG:teuthology.orchestra.run.smithi194:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/92684807f016ce045ac66e37fdde6f8c47857bcc/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-11T12:10:51.785 DEBUG:teuthology.orchestra.run.smithi045:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-11T12:10:51.844 DEBUG:teuthology.orchestra.run.smithi194:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-11T12:10:51.863 DEBUG:teuthology.orchestra.run.smithi045:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-11T12:10:51.873 DEBUG:teuthology.orchestra.run.smithi008:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-11T12:10:51.921 DEBUG:teuthology.orchestra.run.smithi194:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-11T12:10:51.930 INFO:teuthology.orchestra.run.smithi045.stdout:check_obsoletes = 1 2023-08-11T12:10:51.931 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum clean all 2023-08-11T12:10:51.970 DEBUG:teuthology.orchestra.run.smithi008:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-11T12:10:51.987 INFO:teuthology.orchestra.run.smithi194.stdout:check_obsoletes = 1 2023-08-11T12:10:51.988 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum clean all 2023-08-11T12:10:52.045 INFO:teuthology.orchestra.run.smithi008.stdout:check_obsoletes = 1 2023-08-11T12:10:52.046 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum clean all 2023-08-11T12:10:52.353 INFO:teuthology.orchestra.run.smithi045.stdout:Updating Subscription Management repositories. 2023-08-11T12:10:52.358 INFO:teuthology.orchestra.run.smithi194.stdout:Updating Subscription Management repositories. 2023-08-11T12:10:52.534 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-08-11T12:10:53.502 INFO:teuthology.orchestra.run.smithi194.stdout:44 files removed 2023-08-11T12:10:54.166 INFO:teuthology.orchestra.run.smithi045.stdout:44 files removed 2023-08-11T12:10:54.166 INFO:teuthology.orchestra.run.smithi008.stdout:44 files removed 2023-08-11T12:10:54.166 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-11T12:10:54.167 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-11T12:10:54.167 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-11T12:10:54.511 INFO:teuthology.orchestra.run.smithi194.stdout:Updating Subscription Management repositories. 2023-08-11T12:10:54.533 INFO:teuthology.orchestra.run.smithi045.stdout:Updating Subscription Management repositories. 2023-08-11T12:10:54.647 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-08-11T12:10:56.381 INFO:teuthology.orchestra.run.smithi194.stdout:ceph packages for x86_64 133 kB/s | 81 kB 00:00 2023-08-11T12:10:56.516 INFO:teuthology.orchestra.run.smithi045.stdout:ceph packages for x86_64 146 kB/s | 81 kB 00:00 2023-08-11T12:10:56.549 INFO:teuthology.orchestra.run.smithi008.stdout:ceph packages for x86_64 124 kB/s | 81 kB 00:00 2023-08-11T12:10:56.790 INFO:teuthology.orchestra.run.smithi194.stdout:ceph noarch packages 25 kB/s | 9.4 kB 00:00 2023-08-11T12:10:57.108 INFO:teuthology.orchestra.run.smithi045.stdout:ceph noarch packages 17 kB/s | 9.4 kB 00:00 2023-08-11T12:10:57.268 INFO:teuthology.orchestra.run.smithi008.stdout:ceph noarch packages 14 kB/s | 9.4 kB 00:00 2023-08-11T12:10:57.391 INFO:teuthology.orchestra.run.smithi194.stdout:ceph source packages 2.6 kB/s | 1.5 kB 00:00 2023-08-11T12:10:57.567 INFO:teuthology.orchestra.run.smithi194.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-08-11T12:10:57.708 INFO:teuthology.orchestra.run.smithi045.stdout:ceph source packages 2.6 kB/s | 1.5 kB 00:00 2023-08-11T12:10:57.734 INFO:teuthology.orchestra.run.smithi008.stdout:ceph source packages 3.4 kB/s | 1.5 kB 00:00 2023-08-11T12:10:57.851 INFO:teuthology.orchestra.run.smithi045.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2023-08-11T12:10:57.885 INFO:teuthology.orchestra.run.smithi008.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-08-11T12:10:58.850 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-08-11T12:10:59.279 INFO:teuthology.orchestra.run.smithi045.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-08-11T12:10:59.722 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 8.6 MB/s | 16 MB 00:01 2023-08-11T12:11:02.309 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 439 kB/s | 24 kB 00:00 2023-08-11T12:11:02.943 INFO:teuthology.orchestra.run.smithi045.stdout:lab-extras 448 kB/s | 24 kB 00:00 2023-08-11T12:11:03.678 INFO:teuthology.orchestra.run.smithi194.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 37 MB/s | 47 MB 00:01 2023-08-11T12:11:04.028 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 386 kB/s | 24 kB 00:00 2023-08-11T12:11:04.312 INFO:teuthology.orchestra.run.smithi045.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 37 MB/s | 47 MB 00:01 2023-08-11T12:11:06.172 INFO:teuthology.orchestra.run.smithi008.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 26 MB/s | 53 MB 00:02 2023-08-11T12:11:11.788 INFO:teuthology.orchestra.run.smithi194.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 48 MB/s | 53 MB 00:01 2023-08-11T12:11:12.913 INFO:teuthology.orchestra.run.smithi045.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 46 MB/s | 53 MB 00:01 2023-08-11T12:11:15.782 INFO:teuthology.orchestra.run.smithi008.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 32 MB/s | 47 MB 00:01 2023-08-11T12:11:22.868 INFO:teuthology.orchestra.run.smithi194.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-11T12:11:22.869 INFO:teuthology.orchestra.run.smithi194.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-11T12:11:22.884 INFO:teuthology.orchestra.run.smithi194.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-08-11T12:11:22.885 INFO:teuthology.orchestra.run.smithi194.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-08-11T12:11:22.886 INFO:teuthology.orchestra.run.smithi194.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-08-11T12:11:22.887 INFO:teuthology.orchestra.run.smithi194.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-11T12:11:22.889 INFO:teuthology.orchestra.run.smithi194.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-11T12:11:22.892 INFO:teuthology.orchestra.run.smithi194.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-11T12:11:22.893 INFO:teuthology.orchestra.run.smithi194.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-11T12:11:23.024 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2023-08-11T12:11:23.037 INFO:teuthology.orchestra.run.smithi194.stdout:=========================================================================================================================== 2023-08-11T12:11:23.037 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2023-08-11T12:11:23.037 INFO:teuthology.orchestra.run.smithi194.stdout:=========================================================================================================================== 2023-08-11T12:11:23.037 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2023-08-11T12:11:23.038 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-08-11T12:11:23.038 INFO:teuthology.orchestra.run.smithi194.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-11T12:11:23.038 INFO:teuthology.orchestra.run.smithi194.stdout: ceph x86_64 2:18.0.0-5437.g92684807.el8 ceph 6.4 k 2023-08-11T12:11:23.038 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base x86_64 2:18.0.0-5437.g92684807.el8 ceph 5.4 M 2023-08-11T12:11:23.038 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse x86_64 2:18.0.0-5437.g92684807.el8 ceph 860 k 2023-08-11T12:11:23.038 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5437.g92684807.el8 ceph 167 k 2023-08-11T12:11:23.039 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr x86_64 2:18.0.0-5437.g92684807.el8 ceph 1.6 M 2023-08-11T12:11:23.039 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 131 k 2023-08-11T12:11:23.039 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 1.7 M 2023-08-11T12:11:23.039 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 7.4 M 2023-08-11T12:11:23.039 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 47 k 2023-08-11T12:11:23.039 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw x86_64 2:18.0.0-5437.g92684807.el8 ceph 14 M 2023-08-11T12:11:23.039 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test x86_64 2:18.0.0-5437.g92684807.el8 ceph 48 M 2023-08-11T12:11:23.040 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-volume noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 261 k 2023-08-11T12:11:23.040 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 170 k 2023-08-11T12:11:23.040 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-mirror x86_64 2:18.0.0-5437.g92684807.el8 ceph 261 k 2023-08-11T12:11:23.040 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-top noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 18 k 2023-08-11T12:11:23.040 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-08-11T12:11:23.040 INFO:teuthology.orchestra.run.smithi194.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-11T12:11:23.041 INFO:teuthology.orchestra.run.smithi194.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-11T12:11:23.041 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel x86_64 2:18.0.0-5437.g92684807.el8 ceph 31 k 2023-08-11T12:11:23.041 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2 x86_64 2:18.0.0-5437.g92684807.el8 ceph 783 k 2023-08-11T12:11:23.041 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel x86_64 2:18.0.0-5437.g92684807.el8 ceph 139 k 2023-08-11T12:11:23.041 INFO:teuthology.orchestra.run.smithi194.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-11T12:11:23.041 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-08-11T12:11:23.041 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-11T12:11:23.042 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-08-11T12:11:23.042 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-08-11T12:11:23.042 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-08-11T12:11:23.042 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs x86_64 2:18.0.0-5437.g92684807.el8 ceph 197 k 2023-08-11T12:11:23.042 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados x86_64 2:18.0.0-5437.g92684807.el8 ceph 370 k 2023-08-11T12:11:23.042 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd x86_64 2:18.0.0-5437.g92684807.el8 ceph 364 k 2023-08-11T12:11:23.042 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw x86_64 2:18.0.0-5437.g92684807.el8 ceph 107 k 2023-08-11T12:11:23.043 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse x86_64 2:18.0.0-5437.g92684807.el8 ceph 94 k 2023-08-11T12:11:23.043 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror x86_64 2:18.0.0-5437.g92684807.el8 ceph 3.5 M 2023-08-11T12:11:23.043 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd x86_64 2:18.0.0-5437.g92684807.el8 ceph 179 k 2023-08-11T12:11:23.043 INFO:teuthology.orchestra.run.smithi194.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-08-11T12:11:23.043 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrading: 2023-08-11T12:11:23.043 INFO:teuthology.orchestra.run.smithi194.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-08-11T12:11:23.044 INFO:teuthology.orchestra.run.smithi194.stdout: librados2 x86_64 2:18.0.0-5437.g92684807.el8 ceph 3.7 M 2023-08-11T12:11:23.044 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1 x86_64 2:18.0.0-5437.g92684807.el8 ceph 3.6 M 2023-08-11T12:11:23.044 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2023-08-11T12:11:23.044 INFO:teuthology.orchestra.run.smithi194.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-11T12:11:23.044 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common x86_64 2:18.0.0-5437.g92684807.el8 ceph 22 M 2023-08-11T12:11:23.044 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 23 k 2023-08-11T12:11:23.044 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds x86_64 2:18.0.0-5437.g92684807.el8 ceph 2.3 M 2023-08-11T12:11:23.045 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 241 k 2023-08-11T12:11:23.045 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon x86_64 2:18.0.0-5437.g92684807.el8 ceph 4.6 M 2023-08-11T12:11:23.045 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd x86_64 2:18.0.0-5437.g92684807.el8 ceph 18 M 2023-08-11T12:11:23.045 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 15 k 2023-08-11T12:11:23.045 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux x86_64 2:18.0.0-5437.g92684807.el8 ceph 24 k 2023-08-11T12:11:23.045 INFO:teuthology.orchestra.run.smithi194.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-11T12:11:23.045 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-11T12:11:23.046 INFO:teuthology.orchestra.run.smithi194.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-08-11T12:11:23.046 INFO:teuthology.orchestra.run.smithi194.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-11T12:11:23.046 INFO:teuthology.orchestra.run.smithi194.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-08-11T12:11:23.046 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite x86_64 2:18.0.0-5437.g92684807.el8 ceph 139 k 2023-08-11T12:11:23.046 INFO:teuthology.orchestra.run.smithi194.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-08-11T12:11:23.046 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-08-11T12:11:23.046 INFO:teuthology.orchestra.run.smithi194.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-11T12:11:23.047 INFO:teuthology.orchestra.run.smithi194.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-08-11T12:11:23.047 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-08-11T12:11:23.047 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-11T12:11:23.047 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1 x86_64 2:18.0.0-5437.g92684807.el8 ceph 473 k 2023-08-11T12:11:23.047 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-08-11T12:11:23.047 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2 x86_64 2:18.0.0-5437.g92684807.el8 ceph 6.8 M 2023-08-11T12:11:23.047 INFO:teuthology.orchestra.run.smithi194.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-11T12:11:23.048 INFO:teuthology.orchestra.run.smithi194.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-08-11T12:11:23.048 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-11T12:11:23.048 INFO:teuthology.orchestra.run.smithi194.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-11T12:11:23.048 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-11T12:11:23.048 INFO:teuthology.orchestra.run.smithi194.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-11T12:11:23.048 INFO:teuthology.orchestra.run.smithi194.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-11T12:11:23.049 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-08-11T12:11:23.049 INFO:teuthology.orchestra.run.smithi194.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-11T12:11:23.049 INFO:teuthology.orchestra.run.smithi194.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-11T12:11:23.049 INFO:teuthology.orchestra.run.smithi194.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-11T12:11:23.049 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-11T12:11:23.049 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-11T12:11:23.049 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-11T12:11:23.050 INFO:teuthology.orchestra.run.smithi194.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-11T12:11:23.050 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-11T12:11:23.050 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse x86_64 2:18.0.0-5437.g92684807.el8 ceph 45 k 2023-08-11T12:11:23.050 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common x86_64 2:18.0.0-5437.g92684807.el8 ceph 125 k 2023-08-11T12:11:23.050 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-11T12:11:23.050 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-08-11T12:11:23.050 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-11T12:11:23.051 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-11T12:11:23.051 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-11T12:11:23.051 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-11T12:11:23.051 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-11T12:11:23.051 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-11T12:11:23.051 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-11T12:11:23.051 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-11T12:11:23.052 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-11T12:11:23.052 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-11T12:11:23.052 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-11T12:11:23.052 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-11T12:11:23.052 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-11T12:11:23.052 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-11T12:11:23.053 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-11T12:11:23.053 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-11T12:11:23.053 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-11T12:11:23.053 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-11T12:11:23.053 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-11T12:11:23.053 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-11T12:11:23.053 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-11T12:11:23.054 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-11T12:11:23.054 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-08-11T12:11:23.054 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-11T12:11:23.054 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-11T12:11:23.054 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-08-11T12:11:23.054 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-11T12:11:23.054 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-11T12:11:23.055 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-11T12:11:23.055 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-11T12:11:23.055 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-11T12:11:23.055 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-08-11T12:11:23.055 INFO:teuthology.orchestra.run.smithi194.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-11T12:11:23.055 INFO:teuthology.orchestra.run.smithi194.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-11T12:11:23.055 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-11T12:11:23.056 INFO:teuthology.orchestra.run.smithi194.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-11T12:11:23.056 INFO:teuthology.orchestra.run.smithi194.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-11T12:11:23.056 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-11T12:11:23.056 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-11T12:11:23.056 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-11T12:11:23.056 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-11T12:11:23.057 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-11T12:11:23.057 INFO:teuthology.orchestra.run.smithi194.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-08-11T12:11:23.057 INFO:teuthology.orchestra.run.smithi194.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-11T12:11:23.057 INFO:teuthology.orchestra.run.smithi194.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-08-11T12:11:23.057 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-11T12:11:23.057 INFO:teuthology.orchestra.run.smithi194.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-11T12:11:23.057 INFO:teuthology.orchestra.run.smithi194.stdout:Enabling module streams: 2023-08-11T12:11:23.058 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql 10 2023-08-11T12:11:23.058 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-08-11T12:11:23.058 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2023-08-11T12:11:23.058 INFO:teuthology.orchestra.run.smithi194.stdout:=========================================================================================================================== 2023-08-11T12:11:23.058 INFO:teuthology.orchestra.run.smithi194.stdout:Install 128 Packages 2023-08-11T12:11:23.058 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrade 3 Packages 2023-08-11T12:11:23.058 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-08-11T12:11:23.059 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 206 M 2023-08-11T12:11:23.059 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2023-08-11T12:11:23.246 INFO:teuthology.orchestra.run.smithi194.stdout:(1/131): ceph-18.0.0-5437.g92684807.el8.x86_64. 47 kB/s | 6.4 kB 00:00 2023-08-11T12:11:23.421 INFO:teuthology.orchestra.run.smithi194.stdout:(2/131): ceph-fuse-18.0.0-5437.g92684807.el8.x8 4.8 MB/s | 860 kB 00:00 2023-08-11T12:11:23.471 INFO:teuthology.orchestra.run.smithi194.stdout:(3/131): ceph-immutable-object-cache-18.0.0-543 3.3 MB/s | 167 kB 00:00 2023-08-11T12:11:23.682 INFO:teuthology.orchestra.run.smithi194.stdout:(4/131): ceph-mds-18.0.0-5437.g92684807.el8.x86 11 MB/s | 2.3 MB 00:00 2023-08-11T12:11:23.838 INFO:teuthology.orchestra.run.smithi194.stdout:(5/131): ceph-mgr-18.0.0-5437.g92684807.el8.x86 9.9 MB/s | 1.6 MB 00:00 2023-08-11T12:11:23.914 INFO:teuthology.orchestra.run.smithi194.stdout:(6/131): ceph-base-18.0.0-5437.g92684807.el8.x8 6.7 MB/s | 5.4 MB 00:00 2023-08-11T12:11:24.222 INFO:teuthology.orchestra.run.smithi194.stdout:(7/131): ceph-mon-18.0.0-5437.g92684807.el8.x86 12 MB/s | 4.6 MB 00:00 2023-08-11T12:11:24.638 INFO:teuthology.orchestra.run.smithi045.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-11T12:11:24.639 INFO:teuthology.orchestra.run.smithi045.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-11T12:11:24.654 INFO:teuthology.orchestra.run.smithi045.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-08-11T12:11:24.655 INFO:teuthology.orchestra.run.smithi045.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-08-11T12:11:24.657 INFO:teuthology.orchestra.run.smithi045.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-08-11T12:11:24.658 INFO:teuthology.orchestra.run.smithi045.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-11T12:11:24.660 INFO:teuthology.orchestra.run.smithi045.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-11T12:11:24.663 INFO:teuthology.orchestra.run.smithi045.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-11T12:11:24.664 INFO:teuthology.orchestra.run.smithi045.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-11T12:11:24.807 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2023-08-11T12:11:24.820 INFO:teuthology.orchestra.run.smithi045.stdout:=========================================================================================================================== 2023-08-11T12:11:24.821 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2023-08-11T12:11:24.821 INFO:teuthology.orchestra.run.smithi045.stdout:=========================================================================================================================== 2023-08-11T12:11:24.821 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2023-08-11T12:11:24.821 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-08-11T12:11:24.821 INFO:teuthology.orchestra.run.smithi045.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-11T12:11:24.822 INFO:teuthology.orchestra.run.smithi045.stdout: ceph x86_64 2:18.0.0-5437.g92684807.el8 ceph 6.4 k 2023-08-11T12:11:24.822 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base x86_64 2:18.0.0-5437.g92684807.el8 ceph 5.4 M 2023-08-11T12:11:24.822 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-fuse x86_64 2:18.0.0-5437.g92684807.el8 ceph 860 k 2023-08-11T12:11:24.822 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5437.g92684807.el8 ceph 167 k 2023-08-11T12:11:24.822 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr x86_64 2:18.0.0-5437.g92684807.el8 ceph 1.6 M 2023-08-11T12:11:24.822 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 131 k 2023-08-11T12:11:24.822 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 1.7 M 2023-08-11T12:11:24.822 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 7.4 M 2023-08-11T12:11:24.823 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-rook noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 47 k 2023-08-11T12:11:24.823 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-radosgw x86_64 2:18.0.0-5437.g92684807.el8 ceph 14 M 2023-08-11T12:11:24.823 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-test x86_64 2:18.0.0-5437.g92684807.el8 ceph 48 M 2023-08-11T12:11:24.823 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-volume noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 261 k 2023-08-11T12:11:24.823 INFO:teuthology.orchestra.run.smithi045.stdout: cephadm noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 170 k 2023-08-11T12:11:24.823 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-mirror x86_64 2:18.0.0-5437.g92684807.el8 ceph 261 k 2023-08-11T12:11:24.823 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-top noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 18 k 2023-08-11T12:11:24.824 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-08-11T12:11:24.824 INFO:teuthology.orchestra.run.smithi045.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-11T12:11:24.824 INFO:teuthology.orchestra.run.smithi045.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-11T12:11:24.824 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs-devel x86_64 2:18.0.0-5437.g92684807.el8 ceph 31 k 2023-08-11T12:11:24.824 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs2 x86_64 2:18.0.0-5437.g92684807.el8 ceph 783 k 2023-08-11T12:11:24.824 INFO:teuthology.orchestra.run.smithi045.stdout: librados-devel x86_64 2:18.0.0-5437.g92684807.el8 ceph 139 k 2023-08-11T12:11:24.824 INFO:teuthology.orchestra.run.smithi045.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-11T12:11:24.825 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-08-11T12:11:24.825 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-11T12:11:24.825 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-08-11T12:11:24.825 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-08-11T12:11:24.825 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-08-11T12:11:24.825 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cephfs x86_64 2:18.0.0-5437.g92684807.el8 ceph 197 k 2023-08-11T12:11:24.825 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados x86_64 2:18.0.0-5437.g92684807.el8 ceph 370 k 2023-08-11T12:11:24.826 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rbd x86_64 2:18.0.0-5437.g92684807.el8 ceph 364 k 2023-08-11T12:11:24.826 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rgw x86_64 2:18.0.0-5437.g92684807.el8 ceph 107 k 2023-08-11T12:11:24.826 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-fuse x86_64 2:18.0.0-5437.g92684807.el8 ceph 94 k 2023-08-11T12:11:24.826 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-mirror x86_64 2:18.0.0-5437.g92684807.el8 ceph 3.5 M 2023-08-11T12:11:24.826 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-nbd x86_64 2:18.0.0-5437.g92684807.el8 ceph 179 k 2023-08-11T12:11:24.826 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-08-11T12:11:24.826 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrading: 2023-08-11T12:11:24.826 INFO:teuthology.orchestra.run.smithi045.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-08-11T12:11:24.827 INFO:teuthology.orchestra.run.smithi045.stdout: librados2 x86_64 2:18.0.0-5437.g92684807.el8 ceph 3.7 M 2023-08-11T12:11:24.827 INFO:teuthology.orchestra.run.smithi045.stdout: librbd1 x86_64 2:18.0.0-5437.g92684807.el8 ceph 3.6 M 2023-08-11T12:11:24.827 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2023-08-11T12:11:24.827 INFO:teuthology.orchestra.run.smithi045.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-11T12:11:24.827 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-common x86_64 2:18.0.0-5437.g92684807.el8 ceph 22 M 2023-08-11T12:11:24.827 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 23 k 2023-08-11T12:11:24.827 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mds x86_64 2:18.0.0-5437.g92684807.el8 ceph 2.3 M 2023-08-11T12:11:24.828 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 241 k 2023-08-11T12:11:24.828 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mon x86_64 2:18.0.0-5437.g92684807.el8 ceph 4.6 M 2023-08-11T12:11:24.828 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-osd x86_64 2:18.0.0-5437.g92684807.el8 ceph 18 M 2023-08-11T12:11:24.828 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 15 k 2023-08-11T12:11:24.828 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-selinux x86_64 2:18.0.0-5437.g92684807.el8 ceph 24 k 2023-08-11T12:11:24.828 INFO:teuthology.orchestra.run.smithi045.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-11T12:11:24.828 INFO:teuthology.orchestra.run.smithi045.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-11T12:11:24.829 INFO:teuthology.orchestra.run.smithi045.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-08-11T12:11:24.829 INFO:teuthology.orchestra.run.smithi045.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-11T12:11:24.829 INFO:teuthology.orchestra.run.smithi045.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-08-11T12:11:24.829 INFO:teuthology.orchestra.run.smithi045.stdout: libcephsqlite x86_64 2:18.0.0-5437.g92684807.el8 ceph 139 k 2023-08-11T12:11:24.829 INFO:teuthology.orchestra.run.smithi045.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-08-11T12:11:24.829 INFO:teuthology.orchestra.run.smithi045.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-08-11T12:11:24.829 INFO:teuthology.orchestra.run.smithi045.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-11T12:11:24.830 INFO:teuthology.orchestra.run.smithi045.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-08-11T12:11:24.830 INFO:teuthology.orchestra.run.smithi045.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-08-11T12:11:24.830 INFO:teuthology.orchestra.run.smithi045.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-11T12:11:24.830 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1 x86_64 2:18.0.0-5437.g92684807.el8 ceph 473 k 2023-08-11T12:11:24.830 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-08-11T12:11:24.830 INFO:teuthology.orchestra.run.smithi045.stdout: librgw2 x86_64 2:18.0.0-5437.g92684807.el8 ceph 6.8 M 2023-08-11T12:11:24.830 INFO:teuthology.orchestra.run.smithi045.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-11T12:11:24.830 INFO:teuthology.orchestra.run.smithi045.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-08-11T12:11:24.831 INFO:teuthology.orchestra.run.smithi045.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-11T12:11:24.831 INFO:teuthology.orchestra.run.smithi045.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-11T12:11:24.831 INFO:teuthology.orchestra.run.smithi045.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-11T12:11:24.831 INFO:teuthology.orchestra.run.smithi045.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-11T12:11:24.831 INFO:teuthology.orchestra.run.smithi045.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-11T12:11:24.832 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-08-11T12:11:24.832 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-11T12:11:24.832 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-11T12:11:24.832 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-11T12:11:24.832 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-11T12:11:24.832 INFO:teuthology.orchestra.run.smithi045.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-11T12:11:24.832 INFO:teuthology.orchestra.run.smithi045.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-11T12:11:24.833 INFO:teuthology.orchestra.run.smithi045.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-11T12:11:24.833 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-11T12:11:24.833 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse x86_64 2:18.0.0-5437.g92684807.el8 ceph 45 k 2023-08-11T12:11:24.833 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-common x86_64 2:18.0.0-5437.g92684807.el8 ceph 125 k 2023-08-11T12:11:24.833 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-11T12:11:24.833 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-08-11T12:11:24.833 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-11T12:11:24.833 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-11T12:11:24.834 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-11T12:11:24.834 INFO:teuthology.orchestra.run.smithi045.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-11T12:11:24.834 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-11T12:11:24.834 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-11T12:11:24.835 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-11T12:11:24.835 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-11T12:11:24.835 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-11T12:11:24.836 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-11T12:11:24.836 INFO:teuthology.orchestra.run.smithi045.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-11T12:11:24.836 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-11T12:11:24.836 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-11T12:11:24.836 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-11T12:11:24.836 INFO:teuthology.orchestra.run.smithi045.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-11T12:11:24.837 INFO:teuthology.orchestra.run.smithi045.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-11T12:11:24.837 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-11T12:11:24.837 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-11T12:11:24.837 INFO:teuthology.orchestra.run.smithi045.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-11T12:11:24.837 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-11T12:11:24.837 INFO:teuthology.orchestra.run.smithi045.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-11T12:11:24.837 INFO:teuthology.orchestra.run.smithi045.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-11T12:11:24.837 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-08-11T12:11:24.838 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-11T12:11:24.838 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-11T12:11:24.838 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-08-11T12:11:24.838 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-11T12:11:24.838 INFO:teuthology.orchestra.run.smithi045.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-11T12:11:24.838 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-11T12:11:24.838 INFO:teuthology.orchestra.run.smithi045.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-11T12:11:24.838 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-11T12:11:24.839 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-08-11T12:11:24.839 INFO:teuthology.orchestra.run.smithi045.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-11T12:11:24.839 INFO:teuthology.orchestra.run.smithi045.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-11T12:11:24.839 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-11T12:11:24.839 INFO:teuthology.orchestra.run.smithi045.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-11T12:11:24.839 INFO:teuthology.orchestra.run.smithi045.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-11T12:11:24.839 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-11T12:11:24.840 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-11T12:11:24.840 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-11T12:11:24.840 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-11T12:11:24.840 INFO:teuthology.orchestra.run.smithi045.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-11T12:11:24.840 INFO:teuthology.orchestra.run.smithi045.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-08-11T12:11:24.840 INFO:teuthology.orchestra.run.smithi045.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-11T12:11:24.841 INFO:teuthology.orchestra.run.smithi045.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-08-11T12:11:24.841 INFO:teuthology.orchestra.run.smithi045.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-11T12:11:24.841 INFO:teuthology.orchestra.run.smithi045.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-11T12:11:24.841 INFO:teuthology.orchestra.run.smithi045.stdout:Enabling module streams: 2023-08-11T12:11:24.841 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql 10 2023-08-11T12:11:24.841 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-08-11T12:11:24.841 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2023-08-11T12:11:24.842 INFO:teuthology.orchestra.run.smithi045.stdout:=========================================================================================================================== 2023-08-11T12:11:24.842 INFO:teuthology.orchestra.run.smithi045.stdout:Install 128 Packages 2023-08-11T12:11:24.842 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrade 3 Packages 2023-08-11T12:11:24.842 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-08-11T12:11:24.843 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 206 M 2023-08-11T12:11:24.843 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2023-08-11T12:11:25.155 INFO:teuthology.orchestra.run.smithi045.stdout:(1/131): ceph-18.0.0-5437.g92684807.el8.x86_64. 35 kB/s | 6.4 kB 00:00 2023-08-11T12:11:25.297 INFO:teuthology.orchestra.run.smithi194.stdout:(8/131): ceph-osd-18.0.0-5437.g92684807.el8.x86 13 MB/s | 18 MB 00:01 2023-08-11T12:11:25.339 INFO:teuthology.orchestra.run.smithi045.stdout:(2/131): ceph-fuse-18.0.0-5437.g92684807.el8.x8 4.6 MB/s | 860 kB 00:00 2023-08-11T12:11:25.373 INFO:teuthology.orchestra.run.smithi194.stdout:(9/131): ceph-selinux-18.0.0-5437.g92684807.el8 325 kB/s | 24 kB 00:00 2023-08-11T12:11:25.422 INFO:teuthology.orchestra.run.smithi045.stdout:(3/131): ceph-immutable-object-cache-18.0.0-543 2.0 MB/s | 167 kB 00:00 2023-08-11T12:11:25.739 INFO:teuthology.orchestra.run.smithi045.stdout:(4/131): ceph-mds-18.0.0-5437.g92684807.el8.x86 7.2 MB/s | 2.3 MB 00:00 2023-08-11T12:11:25.981 INFO:teuthology.orchestra.run.smithi045.stdout:(5/131): ceph-mgr-18.0.0-5437.g92684807.el8.x86 6.5 MB/s | 1.6 MB 00:00 2023-08-11T12:11:25.998 INFO:teuthology.orchestra.run.smithi194.stdout:(10/131): ceph-radosgw-18.0.0-5437.g92684807.el 7.6 MB/s | 14 MB 00:01 2023-08-11T12:11:26.798 INFO:teuthology.orchestra.run.smithi045.stdout:(6/131): ceph-mon-18.0.0-5437.g92684807.el8.x86 5.7 MB/s | 4.6 MB 00:00 2023-08-11T12:11:26.806 INFO:teuthology.orchestra.run.smithi194.stdout:(11/131): cephfs-mirror-18.0.0-5437.g92684807.e 323 kB/s | 261 kB 00:00 2023-08-11T12:11:26.882 INFO:teuthology.orchestra.run.smithi194.stdout:(12/131): libcephfs-devel-18.0.0-5437.g92684807 415 kB/s | 31 kB 00:00 2023-08-11T12:11:27.140 INFO:teuthology.orchestra.run.smithi194.stdout:(13/131): libcephfs2-18.0.0-5437.g92684807.el8. 3.0 MB/s | 783 kB 00:00 2023-08-11T12:11:27.223 INFO:teuthology.orchestra.run.smithi194.stdout:(14/131): libcephsqlite-18.0.0-5437.g92684807.e 1.6 MB/s | 139 kB 00:00 2023-08-11T12:11:27.307 INFO:teuthology.orchestra.run.smithi194.stdout:(15/131): librados-devel-18.0.0-5437.g92684807. 1.6 MB/s | 139 kB 00:00 2023-08-11T12:11:27.499 INFO:teuthology.orchestra.run.smithi194.stdout:(16/131): libradosstriper1-18.0.0-5437.g9268480 2.4 MB/s | 473 kB 00:00 2023-08-11T12:11:27.840 INFO:teuthology.orchestra.run.smithi045.stdout:(7/131): ceph-base-18.0.0-5437.g92684807.el8.x8 1.9 MB/s | 5.4 MB 00:02 2023-08-11T12:11:28.284 INFO:teuthology.orchestra.run.smithi008.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-11T12:11:28.285 INFO:teuthology.orchestra.run.smithi008.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-11T12:11:28.301 INFO:teuthology.orchestra.run.smithi008.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-08-11T12:11:28.302 INFO:teuthology.orchestra.run.smithi008.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-08-11T12:11:28.303 INFO:teuthology.orchestra.run.smithi008.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-08-11T12:11:28.305 INFO:teuthology.orchestra.run.smithi008.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-11T12:11:28.307 INFO:teuthology.orchestra.run.smithi008.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-11T12:11:28.311 INFO:teuthology.orchestra.run.smithi008.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-11T12:11:28.312 INFO:teuthology.orchestra.run.smithi008.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-11T12:11:28.464 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-08-11T12:11:28.478 INFO:teuthology.orchestra.run.smithi008.stdout:=========================================================================================================================== 2023-08-11T12:11:28.479 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-08-11T12:11:28.479 INFO:teuthology.orchestra.run.smithi008.stdout:=========================================================================================================================== 2023-08-11T12:11:28.479 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-08-11T12:11:28.479 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-08-11T12:11:28.479 INFO:teuthology.orchestra.run.smithi008.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-11T12:11:28.479 INFO:teuthology.orchestra.run.smithi008.stdout: ceph x86_64 2:18.0.0-5437.g92684807.el8 ceph 6.4 k 2023-08-11T12:11:28.479 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base x86_64 2:18.0.0-5437.g92684807.el8 ceph 5.4 M 2023-08-11T12:11:28.480 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse x86_64 2:18.0.0-5437.g92684807.el8 ceph 860 k 2023-08-11T12:11:28.480 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5437.g92684807.el8 ceph 167 k 2023-08-11T12:11:28.480 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr x86_64 2:18.0.0-5437.g92684807.el8 ceph 1.6 M 2023-08-11T12:11:28.480 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 131 k 2023-08-11T12:11:28.480 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 1.7 M 2023-08-11T12:11:28.480 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 7.4 M 2023-08-11T12:11:28.481 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 47 k 2023-08-11T12:11:28.481 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw x86_64 2:18.0.0-5437.g92684807.el8 ceph 14 M 2023-08-11T12:11:28.481 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test x86_64 2:18.0.0-5437.g92684807.el8 ceph 48 M 2023-08-11T12:11:28.481 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-volume noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 261 k 2023-08-11T12:11:28.481 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 170 k 2023-08-11T12:11:28.482 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-mirror x86_64 2:18.0.0-5437.g92684807.el8 ceph 261 k 2023-08-11T12:11:28.482 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-top noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 18 k 2023-08-11T12:11:28.482 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-08-11T12:11:28.482 INFO:teuthology.orchestra.run.smithi008.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-11T12:11:28.482 INFO:teuthology.orchestra.run.smithi008.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-11T12:11:28.482 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel x86_64 2:18.0.0-5437.g92684807.el8 ceph 31 k 2023-08-11T12:11:28.482 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2 x86_64 2:18.0.0-5437.g92684807.el8 ceph 783 k 2023-08-11T12:11:28.483 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel x86_64 2:18.0.0-5437.g92684807.el8 ceph 139 k 2023-08-11T12:11:28.483 INFO:teuthology.orchestra.run.smithi008.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-11T12:11:28.483 INFO:teuthology.orchestra.run.smithi008.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-08-11T12:11:28.483 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-11T12:11:28.483 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-08-11T12:11:28.483 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-08-11T12:11:28.483 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-08-11T12:11:28.484 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs x86_64 2:18.0.0-5437.g92684807.el8 ceph 197 k 2023-08-11T12:11:28.484 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados x86_64 2:18.0.0-5437.g92684807.el8 ceph 370 k 2023-08-11T12:11:28.484 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd x86_64 2:18.0.0-5437.g92684807.el8 ceph 364 k 2023-08-11T12:11:28.484 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw x86_64 2:18.0.0-5437.g92684807.el8 ceph 107 k 2023-08-11T12:11:28.484 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse x86_64 2:18.0.0-5437.g92684807.el8 ceph 94 k 2023-08-11T12:11:28.484 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror x86_64 2:18.0.0-5437.g92684807.el8 ceph 3.5 M 2023-08-11T12:11:28.485 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd x86_64 2:18.0.0-5437.g92684807.el8 ceph 179 k 2023-08-11T12:11:28.485 INFO:teuthology.orchestra.run.smithi008.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-08-11T12:11:28.485 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrading: 2023-08-11T12:11:28.485 INFO:teuthology.orchestra.run.smithi008.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-08-11T12:11:28.485 INFO:teuthology.orchestra.run.smithi008.stdout: librados2 x86_64 2:18.0.0-5437.g92684807.el8 ceph 3.7 M 2023-08-11T12:11:28.485 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1 x86_64 2:18.0.0-5437.g92684807.el8 ceph 3.6 M 2023-08-11T12:11:28.486 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-08-11T12:11:28.486 INFO:teuthology.orchestra.run.smithi008.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-11T12:11:28.486 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common x86_64 2:18.0.0-5437.g92684807.el8 ceph 22 M 2023-08-11T12:11:28.486 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 23 k 2023-08-11T12:11:28.486 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds x86_64 2:18.0.0-5437.g92684807.el8 ceph 2.3 M 2023-08-11T12:11:28.486 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 241 k 2023-08-11T12:11:28.486 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon x86_64 2:18.0.0-5437.g92684807.el8 ceph 4.6 M 2023-08-11T12:11:28.487 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd x86_64 2:18.0.0-5437.g92684807.el8 ceph 18 M 2023-08-11T12:11:28.487 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5437.g92684807.el8 ceph-noarch 15 k 2023-08-11T12:11:28.487 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux x86_64 2:18.0.0-5437.g92684807.el8 ceph 24 k 2023-08-11T12:11:28.487 INFO:teuthology.orchestra.run.smithi008.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-11T12:11:28.487 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-11T12:11:28.488 INFO:teuthology.orchestra.run.smithi008.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-08-11T12:11:28.489 INFO:teuthology.orchestra.run.smithi008.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-11T12:11:28.490 INFO:teuthology.orchestra.run.smithi008.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-08-11T12:11:28.490 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite x86_64 2:18.0.0-5437.g92684807.el8 ceph 139 k 2023-08-11T12:11:28.490 INFO:teuthology.orchestra.run.smithi008.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-08-11T12:11:28.490 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-08-11T12:11:28.490 INFO:teuthology.orchestra.run.smithi008.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-11T12:11:28.490 INFO:teuthology.orchestra.run.smithi008.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-08-11T12:11:28.490 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-08-11T12:11:28.491 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-11T12:11:28.491 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1 x86_64 2:18.0.0-5437.g92684807.el8 ceph 473 k 2023-08-11T12:11:28.491 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-08-11T12:11:28.491 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2 x86_64 2:18.0.0-5437.g92684807.el8 ceph 6.8 M 2023-08-11T12:11:28.491 INFO:teuthology.orchestra.run.smithi008.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-11T12:11:28.491 INFO:teuthology.orchestra.run.smithi008.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-08-11T12:11:28.491 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-11T12:11:28.492 INFO:teuthology.orchestra.run.smithi008.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-11T12:11:28.492 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-11T12:11:28.492 INFO:teuthology.orchestra.run.smithi008.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-11T12:11:28.492 INFO:teuthology.orchestra.run.smithi008.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-11T12:11:28.492 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-08-11T12:11:28.492 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-11T12:11:28.492 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-11T12:11:28.493 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-11T12:11:28.493 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-11T12:11:28.493 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-11T12:11:28.493 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-11T12:11:28.493 INFO:teuthology.orchestra.run.smithi008.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-11T12:11:28.493 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-11T12:11:28.494 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse x86_64 2:18.0.0-5437.g92684807.el8 ceph 45 k 2023-08-11T12:11:28.494 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common x86_64 2:18.0.0-5437.g92684807.el8 ceph 125 k 2023-08-11T12:11:28.495 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-11T12:11:28.495 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-08-11T12:11:28.495 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-11T12:11:28.495 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-11T12:11:28.495 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-11T12:11:28.496 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-11T12:11:28.496 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-11T12:11:28.496 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-11T12:11:28.496 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-11T12:11:28.496 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-11T12:11:28.497 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-11T12:11:28.497 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-11T12:11:28.498 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-11T12:11:28.498 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-11T12:11:28.498 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-11T12:11:28.498 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-11T12:11:28.498 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-11T12:11:28.498 INFO:teuthology.orchestra.run.smithi008.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-11T12:11:28.499 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-11T12:11:28.499 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-11T12:11:28.499 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-11T12:11:28.499 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-11T12:11:28.500 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-11T12:11:28.500 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-11T12:11:28.500 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-08-11T12:11:28.500 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-11T12:11:28.500 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-11T12:11:28.501 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-08-11T12:11:28.501 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-11T12:11:28.501 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-11T12:11:28.501 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-11T12:11:28.501 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-11T12:11:28.501 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-11T12:11:28.501 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-08-11T12:11:28.502 INFO:teuthology.orchestra.run.smithi008.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-11T12:11:28.502 INFO:teuthology.orchestra.run.smithi008.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-11T12:11:28.502 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-11T12:11:28.502 INFO:teuthology.orchestra.run.smithi008.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-11T12:11:28.502 INFO:teuthology.orchestra.run.smithi008.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-11T12:11:28.502 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-11T12:11:28.503 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-11T12:11:28.503 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-11T12:11:28.503 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-11T12:11:28.503 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-11T12:11:28.503 INFO:teuthology.orchestra.run.smithi008.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-08-11T12:11:28.503 INFO:teuthology.orchestra.run.smithi008.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-11T12:11:28.503 INFO:teuthology.orchestra.run.smithi008.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-08-11T12:11:28.504 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-11T12:11:28.504 INFO:teuthology.orchestra.run.smithi008.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-11T12:11:28.504 INFO:teuthology.orchestra.run.smithi008.stdout:Enabling module streams: 2023-08-11T12:11:28.504 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql 10 2023-08-11T12:11:28.504 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:11:28.504 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-08-11T12:11:28.504 INFO:teuthology.orchestra.run.smithi008.stdout:=========================================================================================================================== 2023-08-11T12:11:28.505 INFO:teuthology.orchestra.run.smithi008.stdout:Install 128 Packages 2023-08-11T12:11:28.505 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrade 3 Packages 2023-08-11T12:11:28.505 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:11:28.506 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 206 M 2023-08-11T12:11:28.506 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-08-11T12:11:28.940 INFO:teuthology.orchestra.run.smithi008.stdout:(1/131): ceph-18.0.0-5437.g92684807.el8.x86_64. 22 kB/s | 6.4 kB 00:00 2023-08-11T12:11:29.067 INFO:teuthology.orchestra.run.smithi045.stdout:(8/131): ceph-osd-18.0.0-5437.g92684807.el8.x86 7.8 MB/s | 18 MB 00:02 2023-08-11T12:11:29.157 INFO:teuthology.orchestra.run.smithi045.stdout:(9/131): ceph-selinux-18.0.0-5437.g92684807.el8 271 kB/s | 24 kB 00:00 2023-08-11T12:11:29.275 INFO:teuthology.orchestra.run.smithi194.stdout:(17/131): librgw2-18.0.0-5437.g92684807.el8.x86 3.8 MB/s | 6.8 MB 00:01 2023-08-11T12:11:29.375 INFO:teuthology.orchestra.run.smithi194.stdout:(18/131): python3-ceph-argparse-18.0.0-5437.g92 449 kB/s | 45 kB 00:00 2023-08-11T12:11:29.475 INFO:teuthology.orchestra.run.smithi194.stdout:(19/131): python3-ceph-common-18.0.0-5437.g9268 1.2 MB/s | 125 kB 00:00 2023-08-11T12:11:29.557 INFO:teuthology.orchestra.run.smithi008.stdout:(2/131): ceph-fuse-18.0.0-5437.g92684807.el8.x8 1.4 MB/s | 860 kB 00:00 2023-08-11T12:11:29.683 INFO:teuthology.orchestra.run.smithi008.stdout:(3/131): ceph-immutable-object-cache-18.0.0-543 1.3 MB/s | 167 kB 00:00 2023-08-11T12:11:29.692 INFO:teuthology.orchestra.run.smithi194.stdout:(20/131): ceph-common-18.0.0-5437.g92684807.el8 3.4 MB/s | 22 MB 00:06 2023-08-11T12:11:29.709 INFO:teuthology.orchestra.run.smithi194.stdout:(21/131): python3-cephfs-18.0.0-5437.g92684807. 843 kB/s | 197 kB 00:00 2023-08-11T12:11:29.867 INFO:teuthology.orchestra.run.smithi194.stdout:(22/131): python3-rbd-18.0.0-5437.g92684807.el8 2.2 MB/s | 364 kB 00:00 2023-08-11T12:11:29.892 INFO:teuthology.orchestra.run.smithi194.stdout:(23/131): python3-rados-18.0.0-5437.g92684807.e 1.8 MB/s | 370 kB 00:00 2023-08-11T12:11:29.943 INFO:teuthology.orchestra.run.smithi194.stdout:(24/131): python3-rgw-18.0.0-5437.g92684807.el8 1.4 MB/s | 107 kB 00:00 2023-08-11T12:11:29.985 INFO:teuthology.orchestra.run.smithi194.stdout:(25/131): rbd-fuse-18.0.0-5437.g92684807.el8.x8 1.0 MB/s | 94 kB 00:00 2023-08-11T12:11:30.102 INFO:teuthology.orchestra.run.smithi194.stdout:(26/131): rbd-nbd-18.0.0-5437.g92684807.el8.x86 1.5 MB/s | 179 kB 00:00 2023-08-11T12:11:30.203 INFO:teuthology.orchestra.run.smithi194.stdout:(27/131): ceph-grafana-dashboards-18.0.0-5437.g 230 kB/s | 23 kB 00:00 2023-08-11T12:11:30.311 INFO:teuthology.orchestra.run.smithi194.stdout:(28/131): ceph-mgr-cephadm-18.0.0-5437.g9268480 1.2 MB/s | 131 kB 00:00 2023-08-11T12:11:30.969 INFO:teuthology.orchestra.run.smithi194.stdout:(29/131): rbd-mirror-18.0.0-5437.g92684807.el8. 3.4 MB/s | 3.5 MB 00:01 2023-08-11T12:11:31.012 INFO:teuthology.orchestra.run.smithi194.stdout:(30/131): ceph-mgr-dashboard-18.0.0-5437.g92684 2.5 MB/s | 1.7 MB 00:00 2023-08-11T12:11:31.107 INFO:teuthology.orchestra.run.smithi008.stdout:(4/131): ceph-mds-18.0.0-5437.g92684807.el8.x86 1.6 MB/s | 2.3 MB 00:01 2023-08-11T12:11:31.137 INFO:teuthology.orchestra.run.smithi194.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5437.g92 1.9 MB/s | 241 kB 00:00 2023-08-11T12:11:31.149 INFO:teuthology.orchestra.run.smithi045.stdout:(10/131): ceph-common-18.0.0-5437.g92684807.el8 3.6 MB/s | 22 MB 00:06 2023-08-11T12:11:31.228 INFO:teuthology.orchestra.run.smithi194.stdout:(32/131): ceph-mgr-rook-18.0.0-5437.g92684807.e 519 kB/s | 47 kB 00:00 2023-08-11T12:11:31.300 INFO:teuthology.orchestra.run.smithi008.stdout:(5/131): ceph-base-18.0.0-5437.g92684807.el8.x8 2.0 MB/s | 5.4 MB 00:02 2023-08-11T12:11:31.312 INFO:teuthology.orchestra.run.smithi194.stdout:(33/131): ceph-prometheus-alerts-18.0.0-5437.g9 174 kB/s | 15 kB 00:00 2023-08-11T12:11:31.333 INFO:teuthology.orchestra.run.smithi045.stdout:(11/131): cephfs-mirror-18.0.0-5437.g92684807.e 1.4 MB/s | 261 kB 00:00 2023-08-11T12:11:31.413 INFO:teuthology.orchestra.run.smithi194.stdout:(34/131): ceph-volume-18.0.0-5437.g92684807.el8 2.5 MB/s | 261 kB 00:00 2023-08-11T12:11:31.441 INFO:teuthology.orchestra.run.smithi045.stdout:(12/131): libcephfs-devel-18.0.0-5437.g92684807 287 kB/s | 31 kB 00:00 2023-08-11T12:11:31.513 INFO:teuthology.orchestra.run.smithi194.stdout:(35/131): cephadm-18.0.0-5437.g92684807.el8.noa 1.7 MB/s | 170 kB 00:00 2023-08-11T12:11:31.605 INFO:teuthology.orchestra.run.smithi194.stdout:(36/131): cephfs-top-18.0.0-5437.g92684807.el8. 196 kB/s | 18 kB 00:00 2023-08-11T12:11:31.733 INFO:teuthology.orchestra.run.smithi045.stdout:(13/131): libcephfs2-18.0.0-5437.g92684807.el8. 2.6 MB/s | 783 kB 00:00 2023-08-11T12:11:31.859 INFO:teuthology.orchestra.run.smithi045.stdout:(14/131): libcephsqlite-18.0.0-5437.g92684807.e 1.1 MB/s | 139 kB 00:00 2023-08-11T12:11:31.864 INFO:teuthology.orchestra.run.smithi194.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.2 MB/s | 306 kB 00:00 2023-08-11T12:11:31.938 INFO:teuthology.orchestra.run.smithi194.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 785 kB/s | 59 kB 00:00 2023-08-11T12:11:31.967 INFO:teuthology.orchestra.run.smithi045.stdout:(15/131): librados-devel-18.0.0-5437.g92684807. 1.3 MB/s | 139 kB 00:00 2023-08-11T12:11:31.978 INFO:teuthology.orchestra.run.smithi008.stdout:(6/131): ceph-mgr-18.0.0-5437.g92684807.el8.x86 1.8 MB/s | 1.6 MB 00:00 2023-08-11T12:11:32.022 INFO:teuthology.orchestra.run.smithi194.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 901 kB/s | 75 kB 00:00 2023-08-11T12:11:32.164 INFO:teuthology.orchestra.run.smithi194.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 3.3 MB/s | 476 kB 00:00 2023-08-11T12:11:32.192 INFO:teuthology.orchestra.run.smithi045.stdout:(16/131): libradosstriper1-18.0.0-5437.g9268480 2.1 MB/s | 473 kB 00:00 2023-08-11T12:11:32.256 INFO:teuthology.orchestra.run.smithi194.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 476 kB/s | 44 kB 00:00 2023-08-11T12:11:32.356 INFO:teuthology.orchestra.run.smithi194.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.8 MB/s | 185 kB 00:00 2023-08-11T12:11:32.457 INFO:teuthology.orchestra.run.smithi194.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 330 kB/s | 33 kB 00:00 2023-08-11T12:11:32.557 INFO:teuthology.orchestra.run.smithi194.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 163 kB/s | 16 kB 00:00 2023-08-11T12:11:32.641 INFO:teuthology.orchestra.run.smithi194.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.0 MB/s | 173 kB 00:00 2023-08-11T12:11:32.724 INFO:teuthology.orchestra.run.smithi194.stdout:(46/131): ceph-mgr-diskprediction-local-18.0.0- 4.2 MB/s | 7.4 MB 00:01 2023-08-11T12:11:32.766 INFO:teuthology.orchestra.run.smithi194.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.0 MB/s | 384 kB 00:00 2023-08-11T12:11:32.842 INFO:teuthology.orchestra.run.smithi194.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 148 kB/s | 11 kB 00:00 2023-08-11T12:11:32.918 INFO:teuthology.orchestra.run.smithi194.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 235 kB/s | 18 kB 00:00 2023-08-11T12:11:32.970 INFO:teuthology.orchestra.run.smithi194.stdout:(50/131): python3-google-auth-1.1.1-10.el8.noar 331 kB/s | 81 kB 00:00 2023-08-11T12:11:33.042 INFO:teuthology.orchestra.run.smithi194.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 679 kB/s | 49 kB 00:00 2023-08-11T12:11:33.109 INFO:teuthology.orchestra.run.smithi194.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 884 kB/s | 59 kB 00:00 2023-08-11T12:11:33.110 INFO:teuthology.orchestra.run.smithi008.stdout:(7/131): ceph-mon-18.0.0-5437.g92684807.el8.x86 2.6 MB/s | 4.6 MB 00:01 2023-08-11T12:11:33.184 INFO:teuthology.orchestra.run.smithi194.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 4.4 MB/s | 1.2 MB 00:00 2023-08-11T12:11:33.210 INFO:teuthology.orchestra.run.smithi194.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 601 kB/s | 60 kB 00:00 2023-08-11T12:11:33.635 INFO:teuthology.orchestra.run.smithi194.stdout:(55/131): ceph-test-18.0.0-5437.g92684807.el8.x 5.8 MB/s | 48 MB 00:08 2023-08-11T12:11:33.650 INFO:teuthology.orchestra.run.smithi045.stdout:(17/131): ceph-radosgw-18.0.0-5437.g92684807.el 2.3 MB/s | 14 MB 00:05 2023-08-11T12:11:33.660 INFO:teuthology.orchestra.run.smithi194.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 35 kB/s | 16 kB 00:00 2023-08-11T12:11:33.686 INFO:teuthology.orchestra.run.smithi194.stdout:(57/131): python3-pecan-1.3.2-9.el8.noarch.rpm 565 kB/s | 283 kB 00:00 2023-08-11T12:11:33.711 INFO:teuthology.orchestra.run.smithi194.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 446 kB/s | 34 kB 00:00 2023-08-11T12:11:33.734 INFO:teuthology.orchestra.run.smithi045.stdout:(18/131): python3-ceph-argparse-18.0.0-5437.g92 539 kB/s | 45 kB 00:00 2023-08-11T12:11:33.745 INFO:teuthology.orchestra.run.smithi194.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 1.1 MB/s | 64 kB 00:00 2023-08-11T12:11:33.771 INFO:teuthology.orchestra.run.smithi194.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 320 kB/s | 19 kB 00:00 2023-08-11T12:11:33.804 INFO:teuthology.orchestra.run.smithi194.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 408 kB/s | 24 kB 00:00 2023-08-11T12:11:33.826 INFO:teuthology.orchestra.run.smithi045.stdout:(19/131): python3-ceph-common-18.0.0-5437.g9268 1.3 MB/s | 125 kB 00:00 2023-08-11T12:11:33.829 INFO:teuthology.orchestra.run.smithi194.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 499 kB/s | 29 kB 00:00 2023-08-11T12:11:33.862 INFO:teuthology.orchestra.run.smithi194.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 470 kB/s | 27 kB 00:00 2023-08-11T12:11:33.888 INFO:teuthology.orchestra.run.smithi194.stdout:(64/131): python3-routes-2.4.1-12.el8.noarch.rp 866 kB/s | 196 kB 00:00 2023-08-11T12:11:33.954 INFO:teuthology.orchestra.run.smithi194.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 920 kB/s | 61 kB 00:00 2023-08-11T12:11:33.968 INFO:teuthology.orchestra.run.smithi045.stdout:(20/131): python3-cephfs-18.0.0-5437.g92684807. 1.4 MB/s | 197 kB 00:00 2023-08-11T12:11:33.980 INFO:teuthology.orchestra.run.smithi194.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.1 MB/s | 251 kB 00:00 2023-08-11T12:11:34.008 INFO:teuthology.orchestra.run.smithi194.stdout:(67/131): python3-waitress-1.4.3-1.el8.noarch.r 1.4 MB/s | 255 kB 00:00 2023-08-11T12:11:34.030 INFO:teuthology.orchestra.run.smithi194.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-08-11T12:11:34.047 INFO:teuthology.orchestra.run.smithi194.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 342 kB/s | 23 kB 00:00 2023-08-11T12:11:34.072 INFO:teuthology.orchestra.run.smithi194.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.6 MB/s | 70 kB 00:00 2023-08-11T12:11:34.168 INFO:teuthology.orchestra.run.smithi045.stdout:(21/131): python3-rados-18.0.0-5437.g92684807.e 1.8 MB/s | 370 kB 00:00 2023-08-11T12:11:34.231 INFO:teuthology.orchestra.run.smithi194.stdout:(71/131): thrift-0.13.0-2.el8.x86_64.rpm 7.7 MB/s | 1.7 MB 00:00 2023-08-11T12:11:34.257 INFO:teuthology.orchestra.run.smithi194.stdout:(72/131): python3-pyasn1-modules-0.3.7-6.el8.no 618 kB/s | 110 kB 00:00 2023-08-11T12:11:34.310 INFO:teuthology.orchestra.run.smithi045.stdout:(22/131): librgw2-18.0.0-5437.g92684807.el8.x86 3.2 MB/s | 6.8 MB 00:02 2023-08-11T12:11:34.385 INFO:teuthology.orchestra.run.smithi045.stdout:(23/131): python3-rbd-18.0.0-5437.g92684807.el8 1.6 MB/s | 364 kB 00:00 2023-08-11T12:11:34.411 INFO:teuthology.orchestra.run.smithi045.stdout:(24/131): python3-rgw-18.0.0-5437.g92684807.el8 1.0 MB/s | 107 kB 00:00 2023-08-11T12:11:34.469 INFO:teuthology.orchestra.run.smithi045.stdout:(25/131): rbd-fuse-18.0.0-5437.g92684807.el8.x8 1.1 MB/s | 94 kB 00:00 2023-08-11T12:11:34.474 INFO:teuthology.orchestra.run.smithi194.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 224 kB/s | 54 kB 00:00 2023-08-11T12:11:34.502 INFO:teuthology.orchestra.run.smithi194.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.1 MB/s | 259 kB 00:00 2023-08-11T12:11:34.600 INFO:teuthology.orchestra.run.smithi194.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 2.5 MB/s | 323 kB 00:00 2023-08-11T12:11:34.622 INFO:teuthology.orchestra.run.smithi045.stdout:(26/131): rbd-nbd-18.0.0-5437.g92684807.el8.x86 1.1 MB/s | 179 kB 00:00 2023-08-11T12:11:34.642 INFO:teuthology.orchestra.run.smithi194.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 274 kB/s | 39 kB 00:00 2023-08-11T12:11:34.713 INFO:teuthology.orchestra.run.smithi045.stdout:(27/131): ceph-grafana-dashboards-18.0.0-5437.g 260 kB/s | 23 kB 00:00 2023-08-11T12:11:34.775 INFO:teuthology.orchestra.run.smithi194.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 3.9 MB/s | 538 kB 00:00 2023-08-11T12:11:34.796 INFO:teuthology.orchestra.run.smithi045.stdout:(28/131): ceph-mgr-cephadm-18.0.0-5437.g9268480 1.5 MB/s | 131 kB 00:00 2023-08-11T12:11:34.814 INFO:teuthology.orchestra.run.smithi194.stdout:(78/131): bison-3.0.4-10.el8.x86_64.rpm 3.2 MB/s | 688 kB 00:00 2023-08-11T12:11:34.892 INFO:teuthology.orchestra.run.smithi194.stdout:(79/131): oniguruma-6.8.2-2.el8.x86_64.rpm 2.2 MB/s | 187 kB 00:00 2023-08-11T12:11:34.968 INFO:teuthology.orchestra.run.smithi194.stdout:(80/131): python3-mako-1.0.6-13.el8.noarch.rpm 817 kB/s | 157 kB 00:00 2023-08-11T12:11:35.018 INFO:teuthology.orchestra.run.smithi194.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 5.6 MB/s | 713 kB 00:00 2023-08-11T12:11:35.102 INFO:teuthology.orchestra.run.smithi194.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 320 kB/s | 27 kB 00:00 2023-08-11T12:11:35.172 INFO:teuthology.orchestra.run.smithi194.stdout:(83/131): python3-babel-2.5.1-7.el8.noarch.rpm 24 MB/s | 4.8 MB 00:00 2023-08-11T12:11:35.227 INFO:teuthology.orchestra.run.smithi194.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 2.5 MB/s | 320 kB 00:00 2023-08-11T12:11:35.252 INFO:teuthology.orchestra.run.smithi194.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 525 kB/s | 44 kB 00:00 2023-08-11T12:11:35.304 INFO:teuthology.orchestra.run.smithi045.stdout:(29/131): rbd-mirror-18.0.0-5437.g92684807.el8. 4.0 MB/s | 3.5 MB 00:00 2023-08-11T12:11:35.402 INFO:teuthology.orchestra.run.smithi194.stdout:(86/131): python3-scipy-1.0.0-21.module+el8.5.0 10 MB/s | 14 MB 00:01 2023-08-11T12:11:35.497 INFO:teuthology.orchestra.run.smithi194.stdout:(87/131): python3-numpy-1.14.3-10.el8.x86_64.rp 14 MB/s | 3.7 MB 00:00 2023-08-11T12:11:35.528 INFO:teuthology.orchestra.run.smithi194.stdout:(88/131): python3-werkzeug-0.12.2-4.el8.noarch. 1.6 MB/s | 457 kB 00:00 2023-08-11T12:11:35.570 INFO:teuthology.orchestra.run.smithi194.stdout:(89/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.3 MB/s | 225 kB 00:00 2023-08-11T12:11:35.603 INFO:teuthology.orchestra.run.smithi194.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.6 MB/s | 126 kB 00:00 2023-08-11T12:11:35.629 INFO:teuthology.orchestra.run.smithi194.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 341 kB/s | 20 kB 00:00 2023-08-11T12:11:35.655 INFO:teuthology.orchestra.run.smithi194.stdout:(92/131): uuid-1.6.2-43.el8.x86_64.rpm 402 kB/s | 64 kB 00:00 2023-08-11T12:11:35.729 INFO:teuthology.orchestra.run.smithi194.stdout:(93/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 825 kB/s | 103 kB 00:00 2023-08-11T12:11:35.771 INFO:teuthology.orchestra.run.smithi194.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 4.9 MB/s | 709 kB 00:00 2023-08-11T12:11:35.779 INFO:teuthology.orchestra.run.smithi045.stdout:(30/131): ceph-test-18.0.0-5437.g92684807.el8.x 7.3 MB/s | 48 MB 00:06 2023-08-11T12:11:35.812 INFO:teuthology.orchestra.run.smithi045.stdout:(31/131): ceph-mgr-dashboard-18.0.0-5437.g92684 1.7 MB/s | 1.7 MB 00:01 2023-08-11T12:11:35.846 INFO:teuthology.orchestra.run.smithi045.stdout:(32/131): ceph-mgr-modules-core-18.0.0-5437.g92 3.5 MB/s | 241 kB 00:00 2023-08-11T12:11:35.879 INFO:teuthology.orchestra.run.smithi045.stdout:(33/131): ceph-mgr-rook-18.0.0-5437.g92684807.e 709 kB/s | 47 kB 00:00 2023-08-11T12:11:35.886 INFO:teuthology.orchestra.run.smithi008.stdout:(8/131): ceph-common-18.0.0-5437.g92684807.el8. 3.1 MB/s | 22 MB 00:07 2023-08-11T12:11:35.905 INFO:teuthology.orchestra.run.smithi045.stdout:(34/131): ceph-prometheus-alerts-18.0.0-5437.g9 249 kB/s | 15 kB 00:00 2023-08-11T12:11:35.913 INFO:teuthology.orchestra.run.smithi194.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 19 MB/s | 4.9 MB 00:00 2023-08-11T12:11:35.930 INFO:teuthology.orchestra.run.smithi045.stdout:(35/131): ceph-volume-18.0.0-5437.g92684807.el8 5.1 MB/s | 261 kB 00:00 2023-08-11T12:11:35.938 INFO:teuthology.orchestra.run.smithi194.stdout:(96/131): libpq-13.5-1.el8.x86_64.rpm 947 kB/s | 198 kB 00:00 2023-08-11T12:11:35.955 INFO:teuthology.orchestra.run.smithi008.stdout:(9/131): ceph-selinux-18.0.0-5437.g92684807.el8 367 kB/s | 24 kB 00:00 2023-08-11T12:11:35.981 INFO:teuthology.orchestra.run.smithi045.stdout:(36/131): cephfs-top-18.0.0-5437.g92684807.el8. 358 kB/s | 18 kB 00:00 2023-08-11T12:11:36.006 INFO:teuthology.orchestra.run.smithi045.stdout:(37/131): cephadm-18.0.0-5437.g92684807.el8.noa 1.7 MB/s | 170 kB 00:00 2023-08-11T12:11:36.022 INFO:teuthology.orchestra.run.smithi194.stdout:(97/131): jq-1.6-3.el8.x86_64.rpm 1.8 MB/s | 202 kB 00:00 2023-08-11T12:11:36.064 INFO:teuthology.orchestra.run.smithi194.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.8 MB/s | 354 kB 00:00 2023-08-11T12:11:36.161 INFO:teuthology.orchestra.run.smithi008.stdout:(10/131): ceph-radosgw-18.0.0-5437.g92684807.el 4.4 MB/s | 14 MB 00:03 2023-08-11T12:11:36.190 INFO:teuthology.orchestra.run.smithi194.stdout:(99/131): postgresql-server-10.21-2.module+el8. 30 MB/s | 5.1 MB 00:00 2023-08-11T12:11:36.232 INFO:teuthology.orchestra.run.smithi194.stdout:(100/131): postgresql-contrib-10.21-2.module+el 4.7 MB/s | 808 kB 00:00 2023-08-11T12:11:36.245 INFO:teuthology.orchestra.run.smithi008.stdout:(11/131): cephfs-mirror-18.0.0-5437.g92684807.e 3.1 MB/s | 261 kB 00:00 2023-08-11T12:11:36.296 INFO:teuthology.orchestra.run.smithi008.stdout:(12/131): libcephfs-devel-18.0.0-5437.g92684807 623 kB/s | 31 kB 00:00 2023-08-11T12:11:36.306 INFO:teuthology.orchestra.run.smithi045.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 196 kB/s | 59 kB 00:00 2023-08-11T12:11:36.314 INFO:teuthology.orchestra.run.smithi194.stdout:(101/131): openblas-0.3.15-3.el8.x86_64.rpm 8.7 MB/s | 4.7 MB 00:00 2023-08-11T12:11:36.365 INFO:teuthology.orchestra.run.smithi194.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 8.6 MB/s | 1.5 MB 00:00 2023-08-11T12:11:36.390 INFO:teuthology.orchestra.run.smithi194.stdout:(103/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 295 kB/s | 47 kB 00:00 2023-08-11T12:11:36.415 INFO:teuthology.orchestra.run.smithi194.stdout:(104/131): libselinux-devel-2.9-5.el8.x86_64.rp 1.9 MB/s | 200 kB 00:00 2023-08-11T12:11:36.431 INFO:teuthology.orchestra.run.smithi045.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 680 kB/s | 306 kB 00:00 2023-08-11T12:11:36.446 INFO:teuthology.orchestra.run.smithi008.stdout:(13/131): libcephfs2-18.0.0-5437.g92684807.el8. 5.1 MB/s | 783 kB 00:00 2023-08-11T12:11:36.457 INFO:teuthology.orchestra.run.smithi045.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 500 kB/s | 75 kB 00:00 2023-08-11T12:11:36.496 INFO:teuthology.orchestra.run.smithi008.stdout:(14/131): libcephsqlite-18.0.0-5437.g92684807.e 2.7 MB/s | 139 kB 00:00 2023-08-11T12:11:36.524 INFO:teuthology.orchestra.run.smithi194.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.6 MB/s | 220 kB 00:00 2023-08-11T12:11:36.540 INFO:teuthology.orchestra.run.smithi045.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 526 kB/s | 44 kB 00:00 2023-08-11T12:11:36.546 INFO:teuthology.orchestra.run.smithi008.stdout:(15/131): librados-devel-18.0.0-5437.g92684807. 2.7 MB/s | 139 kB 00:00 2023-08-11T12:11:36.549 INFO:teuthology.orchestra.run.smithi194.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 360 kB/s | 48 kB 00:00 2023-08-11T12:11:36.633 INFO:teuthology.orchestra.run.smithi194.stdout:(107/131): python3-jwt-1.6.1-2.el8.noarch.rpm 159 kB/s | 43 kB 00:00 2023-08-11T12:11:36.647 INFO:teuthology.orchestra.run.smithi008.stdout:(16/131): libradosstriper1-18.0.0-5437.g9268480 4.6 MB/s | 473 kB 00:00 2023-08-11T12:11:36.674 INFO:teuthology.orchestra.run.smithi045.stdout:(42/131): ceph-mgr-diskprediction-local-18.0.0- 5.4 MB/s | 7.4 MB 00:01 2023-08-11T12:11:36.683 INFO:teuthology.orchestra.run.smithi194.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 319 kB/s | 43 kB 00:00 2023-08-11T12:11:36.701 INFO:teuthology.orchestra.run.smithi045.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.1 MB/s | 185 kB 00:00 2023-08-11T12:11:36.724 INFO:teuthology.orchestra.run.smithi045.stdout:(44/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.7 MB/s | 476 kB 00:00 2023-08-11T12:11:36.742 INFO:teuthology.orchestra.run.smithi194.stdout:(109/131): libsepol-devel-2.9-3.el8.x86_64.rpm 400 kB/s | 87 kB 00:00 2023-08-11T12:11:36.774 INFO:teuthology.orchestra.run.smithi045.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 217 kB/s | 16 kB 00:00 2023-08-11T12:11:36.817 INFO:teuthology.orchestra.run.smithi194.stdout:(110/131): python3-pycparser-2.14-14.el8.noarch 593 kB/s | 109 kB 00:00 2023-08-11T12:11:36.842 INFO:teuthology.orchestra.run.smithi194.stdout:(111/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.4 MB/s | 229 kB 00:00 2023-08-11T12:11:36.866 INFO:teuthology.orchestra.run.smithi045.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.2 MB/s | 173 kB 00:00 2023-08-11T12:11:36.876 INFO:teuthology.orchestra.run.smithi194.stdout:(112/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 4.1 MB/s | 560 kB 00:00 2023-08-11T12:11:36.903 INFO:teuthology.orchestra.run.smithi008.stdout:(17/131): ceph-osd-18.0.0-5437.g92684807.el8.x8 3.6 MB/s | 18 MB 00:04 2023-08-11T12:11:36.917 INFO:teuthology.orchestra.run.smithi045.stdout:(47/131): python3-cachetools-3.1.1-4.el8.noarch 136 kB/s | 33 kB 00:00 2023-08-11T12:11:36.934 INFO:teuthology.orchestra.run.smithi194.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.6 MB/s | 155 kB 00:00 2023-08-11T12:11:36.943 INFO:teuthology.orchestra.run.smithi045.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.1 MB/s | 81 kB 00:00 2023-08-11T12:11:36.964 INFO:teuthology.orchestra.run.smithi008.stdout:(18/131): python3-ceph-argparse-18.0.0-5437.g92 737 kB/s | 45 kB 00:00 2023-08-11T12:11:36.967 INFO:teuthology.orchestra.run.smithi045.stdout:(49/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.0 MB/s | 384 kB 00:00 2023-08-11T12:11:36.968 INFO:teuthology.orchestra.run.smithi194.stdout:(114/131): python3-cryptography-3.2.1-5.el8.x86 5.9 MB/s | 559 kB 00:00 2023-08-11T12:11:36.986 INFO:teuthology.orchestra.run.smithi194.stdout:(115/131): libaio-devel-0.3.112-1.el8.x86_64.rp 111 kB/s | 19 kB 00:00 2023-08-11T12:11:36.993 INFO:teuthology.orchestra.run.smithi045.stdout:(50/131): python3-jaraco-6.2-6.el8.noarch.rpm 147 kB/s | 11 kB 00:00 2023-08-11T12:11:37.002 INFO:teuthology.orchestra.run.smithi194.stdout:(116/131): libverto-devel-0.3.0-5.el8.x86_64.rp 266 kB/s | 18 kB 00:00 2023-08-11T12:11:37.040 INFO:teuthology.orchestra.run.smithi008.stdout:(19/131): python3-ceph-common-18.0.0-5437.g9268 1.6 MB/s | 125 kB 00:00 2023-08-11T12:11:37.041 INFO:teuthology.orchestra.run.smithi045.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 178 kB/s | 18 kB 00:00 2023-08-11T12:11:37.103 INFO:teuthology.orchestra.run.smithi194.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.4 MB/s | 605 kB 00:00 2023-08-11T12:11:37.115 INFO:teuthology.orchestra.run.smithi008.stdout:(20/131): python3-cephfs-18.0.0-5437.g92684807. 2.6 MB/s | 197 kB 00:00 2023-08-11T12:11:37.118 INFO:teuthology.orchestra.run.smithi045.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 390 kB/s | 49 kB 00:00 2023-08-11T12:11:37.128 INFO:teuthology.orchestra.run.smithi194.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.6 MB/s | 238 kB 00:00 2023-08-11T12:11:37.143 INFO:teuthology.orchestra.run.smithi045.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 575 kB/s | 59 kB 00:00 2023-08-11T12:11:37.193 INFO:teuthology.orchestra.run.smithi045.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 803 kB/s | 60 kB 00:00 2023-08-11T12:11:37.198 INFO:teuthology.orchestra.run.smithi008.stdout:(21/131): python3-rados-18.0.0-5437.g92684807.e 4.4 MB/s | 370 kB 00:00 2023-08-11T12:11:37.211 INFO:teuthology.orchestra.run.smithi194.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 667 kB/s | 72 kB 00:00 2023-08-11T12:11:37.237 INFO:teuthology.orchestra.run.smithi194.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 761 kB/s | 83 kB 00:00 2023-08-11T12:11:37.269 INFO:teuthology.orchestra.run.smithi045.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 208 kB/s | 16 kB 00:00 2023-08-11T12:11:37.282 INFO:teuthology.orchestra.run.smithi008.stdout:(22/131): python3-rbd-18.0.0-5437.g92684807.el8 4.3 MB/s | 364 kB 00:00 2023-08-11T12:11:37.287 INFO:teuthology.orchestra.run.smithi194.stdout:(121/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 8.2 MB/s | 2.3 MB 00:00 2023-08-11T12:11:37.312 INFO:teuthology.orchestra.run.smithi194.stdout:(122/131): elfutils-libelf-devel-0.186-1.el8.x8 596 kB/s | 60 kB 00:00 2023-08-11T12:11:37.319 INFO:teuthology.orchestra.run.smithi045.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.6 MB/s | 283 kB 00:00 2023-08-11T12:11:37.337 INFO:teuthology.orchestra.run.smithi194.stdout:(123/131): libuuid-devel-2.32.1-35.el8.x86_64.r 978 kB/s | 98 kB 00:00 2023-08-11T12:11:37.340 INFO:teuthology.orchestra.run.smithi008.stdout:(23/131): python3-rgw-18.0.0-5437.g92684807.el8 1.8 MB/s | 107 kB 00:00 2023-08-11T12:11:37.344 INFO:teuthology.orchestra.run.smithi045.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 447 kB/s | 34 kB 00:00 2023-08-11T12:11:37.416 INFO:teuthology.orchestra.run.smithi008.stdout:(24/131): rbd-fuse-18.0.0-5437.g92684807.el8.x8 1.2 MB/s | 94 kB 00:00 2023-08-11T12:11:37.419 INFO:teuthology.orchestra.run.smithi045.stdout:(58/131): python3-rsa-4.9-2.el8.noarch.rpm 860 kB/s | 64 kB 00:00 2023-08-11T12:11:37.445 INFO:teuthology.orchestra.run.smithi045.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.5 MB/s | 196 kB 00:00 2023-08-11T12:11:37.479 INFO:teuthology.orchestra.run.smithi194.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 231 kB/s | 39 kB 00:00 2023-08-11T12:11:37.504 INFO:teuthology.orchestra.run.smithi045.stdout:(60/131): python3-kubernetes-11.0.0-6.el8.noarc 2.2 MB/s | 1.2 MB 00:00 2023-08-11T12:11:37.521 INFO:teuthology.orchestra.run.smithi194.stdout:(125/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 246 kB/s | 58 kB 00:00 2023-08-11T12:11:37.529 INFO:teuthology.orchestra.run.smithi045.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 172 kB/s | 19 kB 00:00 2023-08-11T12:11:37.545 INFO:teuthology.orchestra.run.smithi045.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 238 kB/s | 24 kB 00:00 2023-08-11T12:11:37.555 INFO:teuthology.orchestra.run.smithi194.stdout:(126/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 2.9 MB/s | 644 kB 00:00 2023-08-11T12:11:37.571 INFO:teuthology.orchestra.run.smithi045.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 429 kB/s | 29 kB 00:00 2023-08-11T12:11:37.613 INFO:teuthology.orchestra.run.smithi045.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 412 kB/s | 27 kB 00:00 2023-08-11T12:11:37.622 INFO:teuthology.orchestra.run.smithi194.stdout:(127/131): NetworkManager-initscripts-updown-1. 1.3 MB/s | 138 kB 00:00 2023-08-11T12:11:37.647 INFO:teuthology.orchestra.run.smithi194.stdout:(128/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.0 MB/s | 171 kB 00:00 2023-08-11T12:11:37.674 INFO:teuthology.orchestra.run.smithi008.stdout:(25/131): librgw2-18.0.0-5437.g92684807.el8.x86 6.6 MB/s | 6.8 MB 00:01 2023-08-11T12:11:37.688 INFO:teuthology.orchestra.run.smithi045.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 1.8 MB/s | 255 kB 00:00 2023-08-11T12:11:37.713 INFO:teuthology.orchestra.run.smithi045.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 612 kB/s | 61 kB 00:00 2023-08-11T12:11:37.733 INFO:teuthology.orchestra.run.smithi008.stdout:(26/131): rbd-nbd-18.0.0-5437.g92684807.el8.x86 3.0 MB/s | 179 kB 00:00 2023-08-11T12:11:37.738 INFO:teuthology.orchestra.run.smithi045.stdout:(67/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.5 MB/s | 251 kB 00:00 2023-08-11T12:11:37.764 INFO:teuthology.orchestra.run.smithi045.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-08-11T12:11:37.772 INFO:teuthology.orchestra.run.smithi194.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 6.2 MB/s | 798 kB 00:00 2023-08-11T12:11:37.781 INFO:teuthology.orchestra.run.smithi045.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 340 kB/s | 23 kB 00:00 2023-08-11T12:11:37.783 INFO:teuthology.orchestra.run.smithi008.stdout:(27/131): ceph-grafana-dashboards-18.0.0-5437.g 463 kB/s | 23 kB 00:00 2023-08-11T12:11:37.806 INFO:teuthology.orchestra.run.smithi045.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.6 MB/s | 70 kB 00:00 2023-08-11T12:11:37.885 INFO:teuthology.orchestra.run.smithi008.stdout:(28/131): ceph-mgr-cephadm-18.0.0-5437.g9268480 1.3 MB/s | 131 kB 00:00 2023-08-11T12:11:37.990 INFO:teuthology.orchestra.run.smithi045.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 631 kB/s | 110 kB 00:00 2023-08-11T12:11:38.067 INFO:teuthology.orchestra.run.smithi008.stdout:(29/131): rbd-mirror-18.0.0-5437.g92684807.el8. 5.4 MB/s | 3.5 MB 00:00 2023-08-11T12:11:38.114 INFO:teuthology.orchestra.run.smithi194.stdout:(130/131): librados2-18.0.0-5437.g92684807.el8. 6.6 MB/s | 3.7 MB 00:00 2023-08-11T12:11:38.259 INFO:teuthology.orchestra.run.smithi008.stdout:(30/131): ceph-mgr-dashboard-18.0.0-5437.g92684 4.7 MB/s | 1.7 MB 00:00 2023-08-11T12:11:38.273 INFO:teuthology.orchestra.run.smithi194.stdout:(131/131): librbd1-18.0.0-5437.g92684807.el8.x8 5.6 MB/s | 3.6 MB 00:00 2023-08-11T12:11:38.276 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2023-08-11T12:11:38.276 INFO:teuthology.orchestra.run.smithi194.stdout:Total 14 MB/s | 206 MB 00:15 2023-08-11T12:11:38.298 INFO:teuthology.orchestra.run.smithi045.stdout:(72/131): python3-scipy-1.0.0-21.module+el8.5.0 26 MB/s | 14 MB 00:00 2023-08-11T12:11:38.309 INFO:teuthology.orchestra.run.smithi008.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5437.g92 4.7 MB/s | 241 kB 00:00 2023-08-11T12:11:38.323 INFO:teuthology.orchestra.run.smithi045.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 162 kB/s | 54 kB 00:00 2023-08-11T12:11:38.386 INFO:teuthology.orchestra.run.smithi008.stdout:(32/131): ceph-mgr-rook-18.0.0-5437.g92684807.e 632 kB/s | 47 kB 00:00 2023-08-11T12:11:38.427 INFO:teuthology.orchestra.run.smithi008.stdout:(33/131): ceph-prometheus-alerts-18.0.0-5437.g9 350 kB/s | 15 kB 00:00 2023-08-11T12:11:38.440 INFO:teuthology.orchestra.run.smithi045.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.8 MB/s | 259 kB 00:00 2023-08-11T12:11:38.466 INFO:teuthology.orchestra.run.smithi045.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 2.2 MB/s | 323 kB 00:00 2023-08-11T12:11:38.502 INFO:teuthology.orchestra.run.smithi008.stdout:(34/131): ceph-volume-18.0.0-5437.g92684807.el8 3.4 MB/s | 261 kB 00:00 2023-08-11T12:11:38.535 INFO:teuthology.orchestra.run.smithi045.stdout:(76/131): thrift-0.13.0-2.el8.x86_64.rpm 2.2 MB/s | 1.7 MB 00:00 2023-08-11T12:11:38.560 INFO:teuthology.orchestra.run.smithi045.stdout:(77/131): python3-markupsafe-0.23-19.el8.x86_64 331 kB/s | 39 kB 00:00 2023-08-11T12:11:38.562 INFO:teuthology.orchestra.run.smithi008.stdout:(35/131): cephadm-18.0.0-5437.g92684807.el8.noa 2.9 MB/s | 170 kB 00:00 2023-08-11T12:11:38.600 INFO:teuthology.orchestra.run.smithi045.stdout:(78/131): bison-3.0.4-10.el8.x86_64.rpm 5.0 MB/s | 688 kB 00:00 2023-08-11T12:11:38.612 INFO:teuthology.orchestra.run.smithi008.stdout:(36/131): cephfs-top-18.0.0-5437.g92684807.el8. 362 kB/s | 18 kB 00:00 2023-08-11T12:11:38.661 INFO:teuthology.orchestra.run.smithi045.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.7 MB/s | 157 kB 00:00 2023-08-11T12:11:38.701 INFO:teuthology.orchestra.run.smithi045.stdout:(80/131): python3-jinja2-2.10.1-3.el8.noarch.rp 3.1 MB/s | 538 kB 00:00 2023-08-11T12:11:38.778 INFO:teuthology.orchestra.run.smithi045.stdout:(81/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2023-08-11T12:11:38.817 INFO:teuthology.orchestra.run.smithi045.stdout:(82/131): automake-1.16.1-7.el8.noarch.rpm 4.4 MB/s | 713 kB 00:00 2023-08-11T12:11:38.943 INFO:teuthology.orchestra.run.smithi045.stdout:(83/131): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2023-08-11T12:11:38.969 INFO:teuthology.orchestra.run.smithi045.stdout:(84/131): python3-jsonpatch-1.21-2.el8.noarch.r 138 kB/s | 27 kB 00:00 2023-08-11T12:11:38.993 INFO:teuthology.orchestra.run.smithi045.stdout:(85/131): flex-2.6.1-9.el8.x86_64.rpm 1.8 MB/s | 320 kB 00:00 2023-08-11T12:11:39.037 INFO:teuthology.orchestra.run.smithi008.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 7.7 MB/s | 7.4 MB 00:00 2023-08-11T12:11:39.069 INFO:teuthology.orchestra.run.smithi045.stdout:(86/131): python3-prettytable-0.7.2-14.el8.noar 351 kB/s | 44 kB 00:00 2023-08-11T12:11:39.130 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2023-08-11T12:11:39.169 INFO:teuthology.orchestra.run.smithi045.stdout:(87/131): python3-numpy-1.14.3-10.el8.x86_64.rp 19 MB/s | 3.7 MB 00:00 2023-08-11T12:11:39.186 INFO:teuthology.orchestra.run.smithi045.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.9 MB/s | 225 kB 00:00 2023-08-11T12:11:39.219 INFO:teuthology.orchestra.run.smithi045.stdout:(89/131): python3-werkzeug-0.12.2-4.el8.noarch. 2.0 MB/s | 457 kB 00:00 2023-08-11T12:11:39.250 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2023-08-11T12:11:39.250 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2023-08-11T12:11:39.270 INFO:teuthology.orchestra.run.smithi045.stdout:(90/131): uuid-1.6.2-43.el8.x86_64.rpm 639 kB/s | 64 kB 00:00 2023-08-11T12:11:39.338 INFO:teuthology.orchestra.run.smithi045.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 168 kB/s | 20 kB 00:00 2023-08-11T12:11:39.371 INFO:teuthology.orchestra.run.smithi045.stdout:(92/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 686 kB/s | 126 kB 00:00 2023-08-11T12:11:39.372 INFO:teuthology.orchestra.run.smithi008.stdout:(38/131): gperftools-libs-2.7-9.el8.x86_64.rpm 403 kB/s | 306 kB 00:00 2023-08-11T12:11:39.445 INFO:teuthology.orchestra.run.smithi045.stdout:(93/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 619 kB/s | 103 kB 00:00 2023-08-11T12:11:39.471 INFO:teuthology.orchestra.run.smithi045.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 5.2 MB/s | 709 kB 00:00 2023-08-11T12:11:39.532 INFO:teuthology.orchestra.run.smithi045.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 2.1 MB/s | 198 kB 00:00 2023-08-11T12:11:39.596 INFO:teuthology.orchestra.run.smithi045.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 3.0 MB/s | 202 kB 00:00 2023-08-11T12:11:39.674 INFO:teuthology.orchestra.run.smithi045.stdout:(97/131): openblas-threads-0.3.15-3.el8.x86_64. 16 MB/s | 4.9 MB 00:00 2023-08-11T12:11:39.730 INFO:teuthology.orchestra.run.smithi045.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.6 MB/s | 354 kB 00:00 2023-08-11T12:11:39.839 INFO:teuthology.orchestra.run.smithi045.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 13 MB/s | 4.7 MB 00:00 2023-08-11T12:11:39.914 INFO:teuthology.orchestra.run.smithi045.stdout:(100/131): postgresql-contrib-10.21-2.module+el 4.3 MB/s | 808 kB 00:00 2023-08-11T12:11:39.989 INFO:teuthology.orchestra.run.smithi045.stdout:(101/131): postgresql-server-10.21-2.module+el8 16 MB/s | 5.1 MB 00:00 2023-08-11T12:11:40.040 INFO:teuthology.orchestra.run.smithi045.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 7.5 MB/s | 1.5 MB 00:00 2023-08-11T12:11:40.057 INFO:teuthology.orchestra.run.smithi045.stdout:(103/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 329 kB/s | 47 kB 00:00 2023-08-11T12:11:40.062 INFO:teuthology.orchestra.run.smithi008.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 57 kB/s | 59 kB 00:01 2023-08-11T12:11:40.082 INFO:teuthology.orchestra.run.smithi045.stdout:(104/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.1 MB/s | 200 kB 00:00 2023-08-11T12:11:40.132 INFO:teuthology.orchestra.run.smithi045.stdout:(105/131): python3-jwt-1.6.1-2.el8.noarch.rpm 463 kB/s | 43 kB 00:00 2023-08-11T12:11:40.182 INFO:teuthology.orchestra.run.smithi045.stdout:(106/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.7 MB/s | 220 kB 00:00 2023-08-11T12:11:40.216 INFO:teuthology.orchestra.run.smithi045.stdout:(107/131): keyutils-libs-devel-1.5.10-9.el8.x86 359 kB/s | 48 kB 00:00 2023-08-11T12:11:40.286 INFO:teuthology.orchestra.run.smithi045.stdout:(108/131): libsepol-devel-2.9-3.el8.x86_64.rpm 566 kB/s | 87 kB 00:00 2023-08-11T12:11:40.321 INFO:teuthology.orchestra.run.smithi008.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 79 kB/s | 75 kB 00:00 2023-08-11T12:11:40.325 INFO:teuthology.orchestra.run.smithi045.stdout:(109/131): python3-requests-oauthlib-1.0.0-1.el 300 kB/s | 43 kB 00:00 2023-08-11T12:11:40.350 INFO:teuthology.orchestra.run.smithi045.stdout:(110/131): python3-pycparser-2.14-14.el8.noarch 815 kB/s | 109 kB 00:00 2023-08-11T12:11:40.371 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2023-08-11T12:11:40.375 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2023-08-11T12:11:40.392 INFO:teuthology.orchestra.run.smithi045.stdout:(111/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.1 MB/s | 229 kB 00:00 2023-08-11T12:11:40.454 INFO:teuthology.orchestra.run.smithi008.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 328 kB/s | 44 kB 00:00 2023-08-11T12:11:40.459 INFO:teuthology.orchestra.run.smithi045.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 172 kB/s | 19 kB 00:00 2023-08-11T12:11:40.493 INFO:teuthology.orchestra.run.smithi045.stdout:(113/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.3 MB/s | 560 kB 00:00 2023-08-11T12:11:40.518 INFO:teuthology.orchestra.run.smithi045.stdout:(114/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.2 MB/s | 155 kB 00:00 2023-08-11T12:11:40.576 INFO:teuthology.orchestra.run.smithi045.stdout:(115/131): python3-cryptography-3.2.1-5.el8.x86 4.7 MB/s | 559 kB 00:00 2023-08-11T12:11:40.635 INFO:teuthology.orchestra.run.smithi045.stdout:(116/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-08-11T12:11:40.660 INFO:teuthology.orchestra.run.smithi045.stdout:(117/131): libverto-devel-0.3.0-5.el8.x86_64.rp 107 kB/s | 18 kB 00:00 2023-08-11T12:11:40.663 INFO:teuthology.orchestra.run.smithi008.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 889 kB/s | 185 kB 00:00 2023-08-11T12:11:40.689 INFO:teuthology.orchestra.run.smithi008.stdout:(43/131): python3-asyncssh-2.7.0-2.el8.noarch.r 760 kB/s | 476 kB 00:00 2023-08-11T12:11:41.020 INFO:teuthology.orchestra.run.smithi045.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 1.2 MB/s | 605 kB 00:00 2023-08-11T12:11:41.086 INFO:teuthology.orchestra.run.smithi045.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 170 kB/s | 72 kB 00:00 2023-08-11T12:11:41.178 INFO:teuthology.orchestra.run.smithi045.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 522 kB/s | 83 kB 00:00 2023-08-11T12:11:41.228 INFO:teuthology.orchestra.run.smithi045.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 422 kB/s | 60 kB 00:00 2023-08-11T12:11:41.231 INFO:teuthology.orchestra.run.smithi008.stdout:(44/131): ceph-test-18.0.0-5437.g92684807.el8.x 9.1 MB/s | 48 MB 00:05 2023-08-11T12:11:41.273 INFO:teuthology.orchestra.run.smithi008.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 28 kB/s | 16 kB 00:00 2023-08-11T12:11:41.298 INFO:teuthology.orchestra.run.smithi008.stdout:(46/131): python3-cachetools-3.1.1-4.el8.noarch 52 kB/s | 33 kB 00:00 2023-08-11T12:11:41.353 INFO:teuthology.orchestra.run.smithi045.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 560 kB/s | 98 kB 00:00 2023-08-11T12:11:41.379 INFO:teuthology.orchestra.run.smithi045.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 384 kB/s | 58 kB 00:00 2023-08-11T12:11:41.438 INFO:teuthology.orchestra.run.smithi045.stdout:(124/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 2.9 MB/s | 2.3 MB 00:00 2023-08-11T12:11:41.448 INFO:teuthology.orchestra.run.smithi008.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 542 kB/s | 81 kB 00:00 2023-08-11T12:11:41.462 INFO:teuthology.orchestra.run.smithi045.stdout:(125/131): libcom_err-devel-1.45.6-4.el8.x86_64 355 kB/s | 39 kB 00:00 2023-08-11T12:11:41.482 INFO:teuthology.orchestra.run.smithi008.stdout:(48/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.8 MB/s | 384 kB 00:00 2023-08-11T12:11:41.538 INFO:teuthology.orchestra.run.smithi045.stdout:(126/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 4.0 MB/s | 644 kB 00:00 2023-08-11T12:11:41.571 INFO:teuthology.orchestra.run.smithi045.stdout:(127/131): NetworkManager-initscripts-updown-1. 1.2 MB/s | 138 kB 00:00 2023-08-11T12:11:41.597 INFO:teuthology.orchestra.run.smithi045.stdout:(128/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.1 MB/s | 171 kB 00:00 2023-08-11T12:11:41.649 INFO:teuthology.orchestra.run.smithi008.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 55 kB/s | 11 kB 00:00 2023-08-11T12:11:41.676 INFO:teuthology.orchestra.run.smithi008.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 92 kB/s | 18 kB 00:00 2023-08-11T12:11:41.797 INFO:teuthology.orchestra.run.smithi045.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 3.9 MB/s | 798 kB 00:00 2023-08-11T12:11:41.799 INFO:teuthology.orchestra.run.smithi008.stdout:(51/131): python3-cheroot-8.5.2-1.el8.noarch.rp 304 kB/s | 173 kB 00:00 2023-08-11T12:11:41.858 INFO:teuthology.orchestra.run.smithi008.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 265 kB/s | 49 kB 00:00 2023-08-11T12:11:41.921 INFO:teuthology.orchestra.run.smithi008.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 503 kB/s | 59 kB 00:00 2023-08-11T12:11:41.922 INFO:teuthology.orchestra.run.smithi045.stdout:(130/131): librados2-18.0.0-5437.g92684807.el8. 9.6 MB/s | 3.7 MB 00:00 2023-08-11T12:11:42.000 INFO:teuthology.orchestra.run.smithi008.stdout:(54/131): python3-kubernetes-11.0.0-6.el8.noarc 3.3 MB/s | 1.2 MB 00:00 2023-08-11T12:11:42.126 INFO:teuthology.orchestra.run.smithi008.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 125 kB/s | 16 kB 00:00 2023-08-11T12:11:42.151 INFO:teuthology.orchestra.run.smithi008.stdout:(56/131): python3-natsort-7.1.1-2.el8.noarch.rp 206 kB/s | 60 kB 00:00 2023-08-11T12:11:42.176 INFO:teuthology.orchestra.run.smithi008.stdout:(57/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.1 MB/s | 283 kB 00:00 2023-08-11T12:11:42.260 INFO:teuthology.orchestra.run.smithi008.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 251 kB/s | 34 kB 00:00 2023-08-11T12:11:42.285 INFO:teuthology.orchestra.run.smithi008.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.4 MB/s | 196 kB 00:00 2023-08-11T12:11:42.311 INFO:teuthology.orchestra.run.smithi008.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 480 kB/s | 64 kB 00:00 2023-08-11T12:11:42.361 INFO:teuthology.orchestra.run.smithi008.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 187 kB/s | 19 kB 00:00 2023-08-11T12:11:42.411 INFO:teuthology.orchestra.run.smithi008.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 191 kB/s | 24 kB 00:00 2023-08-11T12:11:42.453 INFO:teuthology.orchestra.run.smithi008.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 205 kB/s | 29 kB 00:00 2023-08-11T12:11:42.464 INFO:teuthology.orchestra.run.smithi045.stdout:(131/131): librbd1-18.0.0-5437.g92684807.el8.x8 4.1 MB/s | 3.6 MB 00:00 2023-08-11T12:11:42.470 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2023-08-11T12:11:42.470 INFO:teuthology.orchestra.run.smithi045.stdout:Total 12 MB/s | 206 MB 00:17 2023-08-11T12:11:42.478 INFO:teuthology.orchestra.run.smithi008.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 235 kB/s | 27 kB 00:00 2023-08-11T12:11:42.587 INFO:teuthology.orchestra.run.smithi008.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.8 MB/s | 251 kB 00:00 2023-08-11T12:11:42.621 INFO:teuthology.orchestra.run.smithi008.stdout:(66/131): python3-waitress-1.4.3-1.el8.noarch.r 1.2 MB/s | 255 kB 00:00 2023-08-11T12:11:42.652 INFO:teuthology.orchestra.run.smithi008.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 366 kB/s | 61 kB 00:00 2023-08-11T12:11:42.719 INFO:teuthology.orchestra.run.smithi008.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 651 kB/s | 85 kB 00:00 2023-08-11T12:11:42.747 INFO:teuthology.orchestra.run.smithi008.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 183 kB/s | 23 kB 00:00 2023-08-11T12:11:42.772 INFO:teuthology.orchestra.run.smithi008.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.3 MB/s | 70 kB 00:00 2023-08-11T12:11:42.864 INFO:teuthology.orchestra.run.smithi008.stdout:(71/131): thrift-0.13.0-2.el8.x86_64.rpm 8.0 MB/s | 1.7 MB 00:00 2023-08-11T12:11:42.922 INFO:teuthology.orchestra.run.smithi008.stdout:(72/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 267 kB/s | 47 kB 00:00 2023-08-11T12:11:43.023 INFO:teuthology.orchestra.run.smithi008.stdout:(73/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.2 MB/s | 220 kB 00:00 2023-08-11T12:11:43.056 INFO:teuthology.orchestra.run.smithi008.stdout:(74/131): libselinux-devel-2.9-5.el8.x86_64.rpm 726 kB/s | 200 kB 00:00 2023-08-11T12:11:43.090 INFO:teuthology.orchestra.run.smithi008.stdout:(75/131): python3-jwt-1.6.1-2.el8.noarch.rpm 189 kB/s | 43 kB 00:00 2023-08-11T12:11:43.132 INFO:teuthology.orchestra.run.smithi008.stdout:(76/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 442 kB/s | 48 kB 00:00 2023-08-11T12:11:43.157 INFO:teuthology.orchestra.run.smithi008.stdout:(77/131): libsepol-devel-2.9-3.el8.x86_64.rpm 864 kB/s | 87 kB 00:00 2023-08-11T12:11:43.174 INFO:teuthology.orchestra.run.smithi008.stdout:(78/131): python3-requests-oauthlib-1.0.0-1.el8 509 kB/s | 43 kB 00:00 2023-08-11T12:11:43.233 INFO:teuthology.orchestra.run.smithi008.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 1.1 MB/s | 109 kB 00:00 2023-08-11T12:11:43.266 INFO:teuthology.orchestra.run.smithi008.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.1 MB/s | 229 kB 00:00 2023-08-11T12:11:43.308 INFO:teuthology.orchestra.run.smithi008.stdout:(81/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 4.1 MB/s | 560 kB 00:00 2023-08-11T12:11:43.351 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2023-08-11T12:11:43.400 INFO:teuthology.orchestra.run.smithi008.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 1.1 MB/s | 155 kB 00:00 2023-08-11T12:11:43.434 INFO:teuthology.orchestra.run.smithi008.stdout:(83/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 93 kB/s | 19 kB 00:00 2023-08-11T12:11:43.468 INFO:teuthology.orchestra.run.smithi008.stdout:(84/131): python3-cryptography-3.2.1-5.el8.x86_ 3.4 MB/s | 559 kB 00:00 2023-08-11T12:11:43.483 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2023-08-11T12:11:43.484 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2023-08-11T12:11:43.527 INFO:teuthology.orchestra.run.smithi008.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 6.4 MB/s | 605 kB 00:00 2023-08-11T12:11:43.551 INFO:teuthology.orchestra.run.smithi008.stdout:(86/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 119 kB/s | 18 kB 00:00 2023-08-11T12:11:43.610 INFO:teuthology.orchestra.run.smithi008.stdout:(87/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.6 MB/s | 238 kB 00:00 2023-08-11T12:11:43.744 INFO:teuthology.orchestra.run.smithi008.stdout:(88/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 11 MB/s | 2.3 MB 00:00 2023-08-11T12:11:43.769 INFO:teuthology.orchestra.run.smithi008.stdout:(89/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 333 kB/s | 72 kB 00:00 2023-08-11T12:11:43.802 INFO:teuthology.orchestra.run.smithi008.stdout:(90/131): fuse-2.9.7-15.el8.x86_64.rpm 431 kB/s | 83 kB 00:00 2023-08-11T12:11:43.853 INFO:teuthology.orchestra.run.smithi008.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.1 MB/s | 98 kB 00:00 2023-08-11T12:11:43.895 INFO:teuthology.orchestra.run.smithi008.stdout:(92/131): elfutils-libelf-devel-0.186-1.el8.x86 397 kB/s | 60 kB 00:00 2023-08-11T12:11:43.937 INFO:teuthology.orchestra.run.smithi008.stdout:(93/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 430 kB/s | 58 kB 00:00 2023-08-11T12:11:43.971 INFO:teuthology.orchestra.run.smithi008.stdout:(94/131): libcom_err-devel-1.45.6-4.el8.x86_64. 329 kB/s | 39 kB 00:00 2023-08-11T12:11:44.021 INFO:teuthology.orchestra.run.smithi008.stdout:(95/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 5.0 MB/s | 644 kB 00:00 2023-08-11T12:11:44.046 INFO:teuthology.orchestra.run.smithi008.stdout:(96/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 1.5 MB/s | 171 kB 00:00 2023-08-11T12:11:44.080 INFO:teuthology.orchestra.run.smithi008.stdout:(97/131): NetworkManager-initscripts-updown-1.3 1.2 MB/s | 138 kB 00:00 2023-08-11T12:11:44.205 INFO:teuthology.orchestra.run.smithi008.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 695 kB/s | 110 kB 00:00 2023-08-11T12:11:44.289 INFO:teuthology.orchestra.run.smithi008.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 260 kB/s | 54 kB 00:00 2023-08-11T12:11:44.356 INFO:teuthology.orchestra.run.smithi008.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.7 MB/s | 259 kB 00:00 2023-08-11T12:11:44.423 INFO:teuthology.orchestra.run.smithi008.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 2.4 MB/s | 323 kB 00:00 2023-08-11T12:11:44.581 INFO:teuthology.orchestra.run.smithi008.stdout:(102/131): python3-scipy-1.0.0-21.module+el8.5. 24 MB/s | 14 MB 00:00 2023-08-11T12:11:44.606 INFO:teuthology.orchestra.run.smithi008.stdout:(103/131): python3-markupsafe-0.23-19.el8.x86_6 155 kB/s | 39 kB 00:00 2023-08-11T12:11:44.673 INFO:teuthology.orchestra.run.smithi008.stdout:(104/131): bison-3.0.4-10.el8.x86_64.rpm 2.7 MB/s | 688 kB 00:00 2023-08-11T12:11:44.674 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2023-08-11T12:11:44.679 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2023-08-11T12:11:44.707 INFO:teuthology.orchestra.run.smithi008.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.5 MB/s | 157 kB 00:00 2023-08-11T12:11:44.749 INFO:teuthology.orchestra.run.smithi008.stdout:(106/131): python3-jinja2-2.10.1-3.el8.noarch.r 3.1 MB/s | 538 kB 00:00 2023-08-11T12:11:44.774 INFO:teuthology.orchestra.run.smithi008.stdout:(107/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.8 MB/s | 187 kB 00:00 2023-08-11T12:11:44.816 INFO:teuthology.orchestra.run.smithi008.stdout:(108/131): automake-1.16.1-7.el8.noarch.rpm 6.4 MB/s | 713 kB 00:00 2023-08-11T12:11:44.875 INFO:teuthology.orchestra.run.smithi008.stdout:(109/131): python3-jsonpatch-1.21-2.el8.noarch. 264 kB/s | 27 kB 00:00 2023-08-11T12:11:44.908 INFO:teuthology.orchestra.run.smithi008.stdout:(110/131): flex-2.6.1-9.el8.x86_64.rpm 3.4 MB/s | 320 kB 00:00 2023-08-11T12:11:45.000 INFO:teuthology.orchestra.run.smithi008.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 19 MB/s | 4.8 MB 00:00 2023-08-11T12:11:45.017 INFO:teuthology.orchestra.run.smithi008.stdout:(112/131): python3-prettytable-0.7.2-14.el8.noa 309 kB/s | 44 kB 00:00 2023-08-11T12:11:45.159 INFO:teuthology.orchestra.run.smithi008.stdout:(113/131): python3-numpy-1.14.3-10.el8.x86_64.r 15 MB/s | 3.7 MB 00:00 2023-08-11T12:11:45.166 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2023-08-11T12:11:45.193 INFO:teuthology.orchestra.run.smithi008.stdout:(114/131): python3-numpy-f2py-1.14.3-10.el8.x86 1.3 MB/s | 225 kB 00:00 2023-08-11T12:11:45.226 INFO:teuthology.orchestra.run.smithi008.stdout:(115/131): python3-werkzeug-0.12.2-4.el8.noarch 2.0 MB/s | 457 kB 00:00 2023-08-11T12:11:45.310 INFO:teuthology.orchestra.run.smithi008.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.1 MB/s | 126 kB 00:00 2023-08-11T12:11:45.336 INFO:teuthology.orchestra.run.smithi008.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 184 kB/s | 20 kB 00:00 2023-08-11T12:11:45.355 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-08-11T12:11:45.361 INFO:teuthology.orchestra.run.smithi008.stdout:(118/131): uuid-1.6.2-43.el8.x86_64.rpm 318 kB/s | 64 kB 00:00 2023-08-11T12:11:45.428 INFO:teuthology.orchestra.run.smithi008.stdout:(119/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 885 kB/s | 103 kB 00:00 2023-08-11T12:11:45.469 INFO:teuthology.orchestra.run.smithi008.stdout:(120/131): libtool-2.4.6-25.el8.x86_64.rpm 5.2 MB/s | 709 kB 00:00 2023-08-11T12:11:45.520 INFO:teuthology.orchestra.run.smithi008.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 2.1 MB/s | 198 kB 00:00 2023-08-11T12:11:45.583 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-08-11T12:11:45.612 INFO:teuthology.orchestra.run.smithi008.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 2.2 MB/s | 202 kB 00:00 2023-08-11T12:11:45.856 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-08-11T12:11:45.896 INFO:teuthology.orchestra.run.smithi008.stdout:(123/131): openblas-threads-0.3.15-3.el8.x86_64 9.1 MB/s | 4.9 MB 00:00 2023-08-11T12:11:45.930 INFO:teuthology.orchestra.run.smithi008.stdout:(124/131): librdkafka-0.11.4-3.el8.x86_64.rpm 1.1 MB/s | 354 kB 00:00 2023-08-11T12:11:46.013 INFO:teuthology.orchestra.run.smithi008.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 8.7 MB/s | 4.7 MB 00:00 2023-08-11T12:11:46.033 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-08-11T12:11:46.064 INFO:teuthology.orchestra.run.smithi008.stdout:(126/131): postgresql-contrib-10.21-2.module+el 5.9 MB/s | 808 kB 00:00 2023-08-11T12:11:46.146 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-08-11T12:11:46.155 INFO:teuthology.orchestra.run.smithi008.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 11 MB/s | 1.5 MB 00:00 2023-08-11T12:11:46.272 INFO:teuthology.orchestra.run.smithi008.stdout:(128/131): postgresql-server-10.21-2.module+el8 13 MB/s | 5.1 MB 00:00 2023-08-11T12:11:46.416 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-08-11T12:11:46.459 INFO:teuthology.orchestra.run.smithi008.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 4.3 MB/s | 798 kB 00:00 2023-08-11T12:11:46.611 INFO:teuthology.orchestra.run.smithi008.stdout:(130/131): librados2-18.0.0-5437.g92684807.el8. 6.7 MB/s | 3.7 MB 00:00 2023-08-11T12:11:46.715 INFO:teuthology.orchestra.run.smithi008.stdout:(131/131): librbd1-18.0.0-5437.g92684807.el8.x8 6.5 MB/s | 3.6 MB 00:00 2023-08-11T12:11:46.719 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-08-11T12:11:46.719 INFO:teuthology.orchestra.run.smithi008.stdout:Total 11 MB/s | 206 MB 00:18 2023-08-11T12:11:46.816 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-08-11T12:11:47.016 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librados2-2:18.0.0-5437.g92684807.el8.x86_64 6/134 2023-08-11T12:11:47.416 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:18.0.0-5437.g92684807.el8.x86_64 6/134 2023-08-11T12:11:47.633 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librbd1-2:18.0.0-5437.g92684807.el8.x86_64 7/134 2023-08-11T12:11:47.748 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:18.0.0-5437.g92684807.el8.x86_64 7/134 2023-08-11T12:11:47.941 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs2-2:18.0.0-5437.g92684807.el8.x86_64 8/134 2023-08-11T12:11:48.036 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephfs2-2:18.0.0-5437.g92684807.el8.x86_64 8/134 2023-08-11T12:11:48.209 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rados-2:18.0.0-5437.g92684807.el8.x86_64 9/134 2023-08-11T12:11:48.405 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-08-11T12:11:48.443 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-08-11T12:11:48.551 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-08-11T12:11:48.552 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-08-11T12:11:48.652 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-08-11T12:11:49.021 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-08-11T12:11:49.244 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-08-11T12:11:49.399 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephsqlite-2:18.0.0-5437.g92684807.el8.x86_64 14/134 2023-08-11T12:11:49.499 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5437.g92684807.el8.x86_64 14/134 2023-08-11T12:11:49.649 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libradosstriper1-2:18.0.0-5437.g92684807.el8.x86 15/134 2023-08-11T12:11:49.723 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5437.g92684807.el8.x86 15/134 2023-08-11T12:11:49.865 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-08-11T12:11:49.875 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2023-08-11T12:11:50.000 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-08-11T12:11:50.075 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-08-11T12:11:50.157 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-08-11T12:11:50.163 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-08-11T12:11:50.168 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-08-11T12:11:50.225 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-08-11T12:11:50.427 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-08-11T12:11:50.618 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-08-11T12:11:50.741 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-08-11T12:11:50.772 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-08-11T12:11:51.010 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-08-11T12:11:51.015 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-08-11T12:11:51.416 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-08-11T12:11:51.621 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-08-11T12:11:51.815 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-08-11T12:11:51.851 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : librados2-2:18.0.0-5437.g92684807.el8.x86_64 6/134 2023-08-11T12:11:52.305 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librados2-2:18.0.0-5437.g92684807.el8.x86_64 6/134 2023-08-11T12:11:52.518 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : librbd1-2:18.0.0-5437.g92684807.el8.x86_64 7/134 2023-08-11T12:11:52.520 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-08-11T12:11:52.636 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librbd1-2:18.0.0-5437.g92684807.el8.x86_64 7/134 2023-08-11T12:11:52.798 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-08-11T12:11:52.876 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephfs2-2:18.0.0-5437.g92684807.el8.x86_64 8/134 2023-08-11T12:11:52.972 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libcephfs2-2:18.0.0-5437.g92684807.el8.x86_64 8/134 2023-08-11T12:11:53.024 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-08-11T12:11:53.145 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rados-2:18.0.0-5437.g92684807.el8.x86_64 9/134 2023-08-11T12:11:53.251 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-08-11T12:11:53.418 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-08-11T12:11:53.437 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-08-11T12:11:53.628 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-08-11T12:11:53.630 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-08-11T12:11:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-08-11T12:11:54.021 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-common-2:18.0.0-5437.g92684807.el8. 26/134 2023-08-11T12:11:54.073 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-08-11T12:11:54.184 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-argparse-2:18.0.0-5437.g92684807.el 27/134 2023-08-11T12:11:54.363 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-08-11T12:11:54.526 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephsqlite-2:18.0.0-5437.g92684807.el8.x86_64 14/134 2023-08-11T12:11:54.619 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5437.g92684807.el8.x86_64 14/134 2023-08-11T12:11:54.801 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libradosstriper1-2:18.0.0-5437.g92684807.el8.x86 15/134 2023-08-11T12:11:54.872 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5437.g92684807.el8.x86 15/134 2023-08-11T12:11:55.017 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-08-11T12:11:55.087 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cephfs-2:18.0.0-5437.g92684807.el8.x86_6 28/134 2023-08-11T12:11:55.159 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-08-11T12:11:55.284 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-08-11T12:11:55.326 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-08-11T12:11:55.404 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-08-11T12:11:55.483 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-08-11T12:11:55.660 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-08-11T12:11:55.687 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-08-11T12:11:55.862 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-08-11T12:11:55.916 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-08-11T12:11:55.977 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-08-11T12:11:56.124 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-08-11T12:11:56.194 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-08-11T12:11:56.300 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-08-11T12:11:56.551 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-08-11T12:11:56.817 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-08-11T12:11:57.059 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-08-11T12:11:57.064 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-08-11T12:11:57.275 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : librados2-2:18.0.0-5437.g92684807.el8.x86_64 5/134 2023-08-11T12:11:57.807 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-2:18.0.0-5437.g92684807.el8.x86_64 5/134 2023-08-11T12:11:57.876 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-08-11T12:11:57.935 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-08-11T12:11:58.000 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : librbd1-2:18.0.0-5437.g92684807.el8.x86_64 6/134 2023-08-11T12:11:58.162 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-2:18.0.0-5437.g92684807.el8.x86_64 6/134 2023-08-11T12:11:58.199 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-08-11T12:11:58.240 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-08-11T12:11:58.400 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephfs2-2:18.0.0-5437.g92684807.el8.x86_64 7/134 2023-08-11T12:11:58.418 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-08-11T12:11:58.442 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-08-11T12:11:58.532 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephfs2-2:18.0.0-5437.g92684807.el8.x86_64 7/134 2023-08-11T12:11:58.622 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-08-11T12:11:58.624 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-08-11T12:11:58.698 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rados-2:18.0.0-5437.g92684807.el8.x86_64 8/134 2023-08-11T12:11:58.803 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rbd-2:18.0.0-5437.g92684807.el8.x86_64 36/134 2023-08-11T12:11:58.868 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-08-11T12:11:58.923 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-08-11T12:11:59.009 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librados-devel-2:18.0.0-5437.g92684807.el8.x86_6 37/134 2023-08-11T12:11:59.097 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-08-11T12:11:59.164 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-08-11T12:11:59.171 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-08-11T12:11:59.316 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-08-11T12:11:59.367 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-08-11T12:11:59.406 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-08-11T12:11:59.475 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ceph-common-2:18.0.0-5437.g92684807.el8. 26/134 2023-08-11T12:11:59.549 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-08-11T12:11:59.587 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ceph-argparse-2:18.0.0-5437.g92684807.el 27/134 2023-08-11T12:11:59.691 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-08-11T12:11:59.866 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-08-11T12:11:59.934 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-08-11T12:12:00.088 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-08-11T12:12:00.099 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-08-11T12:12:00.241 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephsqlite-2:18.0.0-5437.g92684807.el8.x86_64 14/134 2023-08-11T12:12:00.380 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5437.g92684807.el8.x86_64 14/134 2023-08-11T12:12:00.447 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-08-11T12:12:00.541 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libradosstriper1-2:18.0.0-5437.g92684807.el8.x86 15/134 2023-08-11T12:12:00.569 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cephfs-2:18.0.0-5437.g92684807.el8.x86_6 28/134 2023-08-11T12:12:00.725 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-08-11T12:12:00.737 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5437.g92684807.el8.x86 15/134 2023-08-11T12:12:00.908 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-08-11T12:12:00.949 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-08-11T12:12:00.983 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-08-11T12:12:01.177 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-08-11T12:12:01.177 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-08-11T12:12:01.190 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-08-11T12:12:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-08-11T12:12:01.427 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-08-11T12:12:01.444 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-08-11T12:12:01.549 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-08-11T12:12:01.691 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-08-11T12:12:01.722 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-08-11T12:12:01.755 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-08-11T12:12:01.874 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-08-11T12:12:01.996 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-08-11T12:12:02.181 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-08-11T12:12:02.384 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-08-11T12:12:02.558 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-08-11T12:12:02.616 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-08-11T12:12:02.733 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-08-11T12:12:02.824 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-08-11T12:12:03.061 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-08-11T12:12:03.326 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-08-11T12:12:03.538 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-08-11T12:12:03.577 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-08-11T12:12:03.585 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-08-11T12:12:03.758 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-08-11T12:12:03.861 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-08-11T12:12:03.903 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-08-11T12:12:04.028 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-08-11T12:12:04.147 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-08-11T12:12:04.172 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-08-11T12:12:04.337 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-08-11T12:12:04.363 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-08-11T12:12:04.429 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-08-11T12:12:04.555 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rbd-2:18.0.0-5437.g92684807.el8.x86_64 36/134 2023-08-11T12:12:04.673 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-08-11T12:12:04.686 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-08-11T12:12:04.745 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librados-devel-2:18.0.0-5437.g92684807.el8.x86_6 37/134 2023-08-11T12:12:04.908 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-08-11T12:12:04.940 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-08-11T12:12:04.949 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-08-11T12:12:05.047 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-08-11T12:12:05.115 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-08-11T12:12:05.116 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-08-11T12:12:05.149 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-08-11T12:12:05.343 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-08-11T12:12:05.358 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-08-11T12:12:05.425 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-08-11T12:12:05.480 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-08-11T12:12:05.522 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-08-11T12:12:05.648 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ceph-common-2:18.0.0-5437.g92684807.el8. 26/134 2023-08-11T12:12:05.712 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-08-11T12:12:05.719 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-08-11T12:12:05.788 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ceph-argparse-2:18.0.0-5437.g92684807.el 27/134 2023-08-11T12:12:05.907 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-08-11T12:12:05.944 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-08-11T12:12:06.049 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cephfs-2:18.0.0-5437.g92684807.el8.x86_6 28/134 2023-08-11T12:12:06.139 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-08-11T12:12:06.336 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-08-11T12:12:06.483 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-08-11T12:12:06.497 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-08-11T12:12:06.515 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-08-11T12:12:06.656 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-08-11T12:12:06.787 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-08-11T12:12:06.837 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-08-11T12:12:06.985 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-08-11T12:12:07.024 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-08-11T12:12:07.181 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-08-11T12:12:07.215 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-08-11T12:12:07.340 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-08-11T12:12:07.464 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-08-11T12:12:07.477 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-08-11T12:12:07.735 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-08-11T12:12:07.758 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-08-11T12:12:07.950 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-08-11T12:12:08.091 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-08-11T12:12:08.151 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-08-11T12:12:08.296 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-08-11T12:12:08.385 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-08-11T12:12:08.508 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-08-11T12:12:08.645 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-08-11T12:12:08.707 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-08-11T12:12:08.779 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-08-11T12:12:08.812 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-08-11T12:12:08.871 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-08-11T12:12:09.022 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-08-11T12:12:09.184 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-08-11T12:12:09.515 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-08-11T12:12:09.875 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-08-11T12:12:10.045 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-08-11T12:12:10.088 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-08-11T12:12:10.106 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-08-11T12:12:10.290 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-08-11T12:12:10.382 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-08-11T12:12:10.402 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-08-11T12:12:10.453 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-08-11T12:12:10.640 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-08-11T12:12:10.654 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-08-11T12:12:10.706 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-08-11T12:12:10.713 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-08-11T12:12:10.952 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-08-11T12:12:10.969 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-08-11T12:12:10.981 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-08-11T12:12:11.170 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-08-11T12:12:11.182 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-08-11T12:12:11.252 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-08-11T12:12:11.315 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-08-11T12:12:11.381 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-08-11T12:12:11.382 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-08-11T12:12:11.461 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-08-11T12:12:11.608 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rbd-2:18.0.0-5437.g92684807.el8.x86_64 36/134 2023-08-11T12:12:11.616 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-08-11T12:12:11.798 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librados-devel-2:18.0.0-5437.g92684807.el8.x86_6 37/134 2023-08-11T12:12:11.801 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-08-11T12:12:11.983 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-08-11T12:12:11.991 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-08-11T12:12:12.136 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-08-11T12:12:12.181 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-08-11T12:12:12.313 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-08-11T12:12:12.314 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-08-11T12:12:12.437 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-08-11T12:12:12.470 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-08-11T12:12:12.520 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librgw2-2:18.0.0-5437.g92684807.el8.x86_64 92/134 2023-08-11T12:12:12.576 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librgw2-2:18.0.0-5437.g92684807.el8.x86_64 92/134 2023-08-11T12:12:12.687 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-08-11T12:12:12.709 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-08-11T12:12:12.737 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rgw-2:18.0.0-5437.g92684807.el8.x86_64 93/134 2023-08-11T12:12:12.862 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-08-11T12:12:13.028 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-08-11T12:12:13.047 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-08-11T12:12:13.206 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-08-11T12:12:13.212 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-08-11T12:12:13.308 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-08-11T12:12:13.422 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-08-11T12:12:13.581 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-08-11T12:12:13.587 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-08-11T12:12:13.754 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-08-11T12:12:13.793 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-08-11T12:12:13.931 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-08-11T12:12:13.968 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-08-11T12:12:14.166 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-08-11T12:12:14.167 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-08-11T12:12:14.385 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-08-11T12:12:14.386 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-08-11T12:12:14.531 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-08-11T12:12:14.571 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-08-11T12:12:14.784 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-08-11T12:12:14.837 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-08-11T12:12:15.015 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-08-11T12:12:15.052 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-08-11T12:12:15.208 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-08-11T12:12:15.428 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-08-11T12:12:15.484 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-08-11T12:12:15.774 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-08-11T12:12:16.040 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-08-11T12:12:16.321 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-08-11T12:12:16.354 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:18.0.0-5437.g92684807.el8.x86_64 94/134 2023-08-11T12:12:16.587 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-08-11T12:12:16.588 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-common-2:18.0.0-5437.g92684807.el8.x86_64 94/134 2023-08-11T12:12:16.606 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-08-11T12:12:16.870 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-08-11T12:12:16.942 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-08-11T12:12:17.133 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-08-11T12:12:17.158 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-08-11T12:12:17.212 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:18.0.0-5437.g92684807.el8.x86_64 94/134 2023-08-11T12:12:17.411 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-08-11T12:12:17.438 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-08-11T12:12:17.492 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-base-2:18.0.0-5437.g92684807.el8.x86_64 95/134 2023-08-11T12:12:17.563 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-base-2:18.0.0-5437.g92684807.el8.x86_64 95/134 2023-08-11T12:12:17.645 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-08-11T12:12:17.702 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-selinux-2:18.0.0-5437.g92684807.el8.x86_64 96/134 2023-08-11T12:12:17.715 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-08-11T12:12:17.899 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-08-11T12:12:17.968 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-08-11T12:12:18.064 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-08-11T12:12:18.495 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-08-11T12:12:18.799 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-08-11T12:12:18.823 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-08-11T12:12:19.014 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librgw2-2:18.0.0-5437.g92684807.el8.x86_64 92/134 2023-08-11T12:12:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-08-11T12:12:19.098 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librgw2-2:18.0.0-5437.g92684807.el8.x86_64 92/134 2023-08-11T12:12:19.306 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rgw-2:18.0.0-5437.g92684807.el8.x86_64 93/134 2023-08-11T12:12:19.359 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-08-11T12:12:19.534 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-08-11T12:12:19.732 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-08-11T12:12:20.040 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-08-11T12:12:20.306 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-08-11T12:12:20.461 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-08-11T12:12:20.620 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-08-11T12:12:20.858 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-08-11T12:12:21.083 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-08-11T12:12:21.340 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-08-11T12:12:21.534 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-08-11T12:12:21.739 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-08-11T12:12:22.004 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-08-11T12:12:22.289 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-08-11T12:12:22.505 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-08-11T12:12:22.857 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-08-11T12:12:23.084 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-08-11T12:12:23.237 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-common-2:18.0.0-5437.g92684807.el8.x86_64 94/134 2023-08-11T12:12:23.301 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-08-11T12:12:23.556 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-08-11T12:12:23.997 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-common-2:18.0.0-5437.g92684807.el8.x86_64 94/134 2023-08-11T12:12:24.633 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-common-2:18.0.0-5437.g92684807.el8.x86_64 94/134 2023-08-11T12:12:24.965 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-base-2:18.0.0-5437.g92684807.el8.x86_64 95/134 2023-08-11T12:12:25.038 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-08-11T12:12:25.060 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-base-2:18.0.0-5437.g92684807.el8.x86_64 95/134 2023-08-11T12:12:25.205 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-selinux-2:18.0.0-5437.g92684807.el8.x86_64 96/134 2023-08-11T12:12:25.370 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-08-11T12:12:25.646 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-08-11T12:12:26.044 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-08-11T12:12:26.378 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-08-11T12:12:26.578 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-08-11T12:12:27.529 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-08-11T12:12:27.721 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librgw2-2:18.0.0-5437.g92684807.el8.x86_64 92/134 2023-08-11T12:12:27.817 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librgw2-2:18.0.0-5437.g92684807.el8.x86_64 92/134 2023-08-11T12:12:28.005 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rgw-2:18.0.0-5437.g92684807.el8.x86_64 93/134 2023-08-11T12:12:33.193 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:18.0.0-5437.g92684807.el8.x86_64 94/134 2023-08-11T12:12:33.429 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-common-2:18.0.0-5437.g92684807.el8.x86_64 94/134 2023-08-11T12:12:34.172 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:18.0.0-5437.g92684807.el8.x86_64 94/134 2023-08-11T12:12:34.456 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-base-2:18.0.0-5437.g92684807.el8.x86_64 95/134 2023-08-11T12:12:34.601 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-base-2:18.0.0-5437.g92684807.el8.x86_64 95/134 2023-08-11T12:12:34.754 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-selinux-2:18.0.0-5437.g92684807.el8.x86_64 96/134 2023-08-11T12:12:36.276 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5437.g92684807.el8.x86_64 96/134 2023-08-11T12:12:36.277 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /sys 2023-08-11T12:12:36.277 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /proc 2023-08-11T12:12:36.277 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /dev 2023-08-11T12:12:36.277 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /run 2023-08-11T12:12:36.277 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /mnt 2023-08-11T12:12:36.278 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /var/tmp 2023-08-11T12:12:36.278 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /home 2023-08-11T12:12:36.278 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /tmp 2023-08-11T12:12:36.278 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /dev 2023-08-11T12:12:36.278 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-08-11T12:12:36.599 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-volume-2:18.0.0-5437.g92684807.el8.noarch 97/134 2023-08-11T12:12:38.177 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-volume-2:18.0.0-5437.g92684807.el8.noarch 97/134 2023-08-11T12:12:38.346 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-osd-2:18.0.0-5437.g92684807.el8.x86_64 98/134 2023-08-11T12:12:38.565 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-osd-2:18.0.0-5437.g92684807.el8.x86_64 98/134 2023-08-11T12:12:38.743 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mds-2:18.0.0-5437.g92684807.el8.x86_64 99/134 2023-08-11T12:12:39.194 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mds-2:18.0.0-5437.g92684807.el8.x86_64 99/134 2023-08-11T12:12:39.341 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mon-2:18.0.0-5437.g92684807.el8.x86_64 100/134 2023-08-11T12:12:39.358 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mon-2:18.0.0-5437.g92684807.el8.x86_64 100/134 2023-08-11T12:12:40.990 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephadm-2:18.0.0-5437.g92684807.el8.noarch 101/134 2023-08-11T12:12:41.207 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephadm-2:18.0.0-5437.g92684807.el8.noarch 101/134 2023-08-11T12:12:41.338 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5437.g92684807.e 102/134 2023-08-11T12:12:41.539 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5437.g92684807. 103/134 2023-08-11T12:12:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5437.g92684807.el8.noa 104/134 2023-08-11T12:12:41.926 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5437.g92684807.el8.noa 104/134 2023-08-11T12:12:42.229 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5437.g92684807.el8.n 105/134 2023-08-11T12:12:43.188 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5437.g92684807.el8.n 105/134 2023-08-11T12:12:43.356 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5437.g926 106/134 2023-08-11T12:12:43.446 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5437.g926 106/134 2023-08-11T12:12:43.783 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5437.g92684807.el 107/134 2023-08-11T12:12:44.025 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-2:18.0.0-5437.g92684807.el8.x86_64 108/134 2023-08-11T12:12:44.061 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5437.g92684807.el8.x86_64 108/134 2023-08-11T12:12:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-rook-2:18.0.0-5437.g92684807.el8.noarch 109/134 2023-08-11T12:12:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5437.g92684807.el8.noarch 109/134 2023-08-11T12:12:44.621 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5437.g92684807.el8.x86_64 96/134 2023-08-11T12:12:44.622 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /sys 2023-08-11T12:12:44.622 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /proc 2023-08-11T12:12:44.622 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /dev 2023-08-11T12:12:44.622 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /run 2023-08-11T12:12:44.623 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /mnt 2023-08-11T12:12:44.623 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /var/tmp 2023-08-11T12:12:44.623 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /home 2023-08-11T12:12:44.623 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /tmp 2023-08-11T12:12:44.624 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /dev 2023-08-11T12:12:44.624 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-08-11T12:12:45.010 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-volume-2:18.0.0-5437.g92684807.el8.noarch 97/134 2023-08-11T12:12:45.540 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-2:18.0.0-5437.g92684807.el8.x86_64 110/134 2023-08-11T12:12:45.737 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-radosgw-2:18.0.0-5437.g92684807.el8.x86_64 111/134 2023-08-11T12:12:45.771 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5437.g92684807.el8.x86_64 111/134 2023-08-11T12:12:45.968 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5437.g92684 112/134 2023-08-11T12:12:46.012 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5437.g92684 112/134 2023-08-11T12:12:46.164 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephfs-mirror-2:18.0.0-5437.g92684807.el8.x86_64 113/134 2023-08-11T12:12:46.518 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5437.g92684807.el8.x86_64 113/134 2023-08-11T12:12:46.690 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-mirror-2:18.0.0-5437.g92684807.el8.x86_64 114/134 2023-08-11T12:12:46.696 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-volume-2:18.0.0-5437.g92684807.el8.noarch 97/134 2023-08-11T12:12:46.920 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-osd-2:18.0.0-5437.g92684807.el8.x86_64 98/134 2023-08-11T12:12:47.153 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-osd-2:18.0.0-5437.g92684807.el8.x86_64 98/134 2023-08-11T12:12:47.360 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mds-2:18.0.0-5437.g92684807.el8.x86_64 99/134 2023-08-11T12:12:47.844 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mds-2:18.0.0-5437.g92684807.el8.x86_64 99/134 2023-08-11T12:12:48.002 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mon-2:18.0.0-5437.g92684807.el8.x86_64 100/134 2023-08-11T12:12:48.021 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mon-2:18.0.0-5437.g92684807.el8.x86_64 100/134 2023-08-11T12:12:49.816 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: cephadm-2:18.0.0-5437.g92684807.el8.noarch 101/134 2023-08-11T12:12:49.997 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephadm-2:18.0.0-5437.g92684807.el8.noarch 101/134 2023-08-11T12:12:50.132 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5437.g92684807.e 102/134 2023-08-11T12:12:50.320 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5437.g92684807. 103/134 2023-08-11T12:12:50.500 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5437.g92684807.el8.noa 104/134 2023-08-11T12:12:50.728 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5437.g92684807.el8.noa 104/134 2023-08-11T12:12:51.032 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5437.g92684807.el8.n 105/134 2023-08-11T12:12:51.246 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5437.g92684807.el8.x86_64 114/134 2023-08-11T12:12:51.518 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-test-2:18.0.0-5437.g92684807.el8.x86_64 115/134 2023-08-11T12:12:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-08-11T12:12:51.895 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-08-11T12:12:52.055 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5437.g92684807.el8.n 105/134 2023-08-11T12:12:52.227 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5437.g926 106/134 2023-08-11T12:12:52.324 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5437.g926 106/134 2023-08-11T12:12:52.699 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5437.g92684807.el 107/134 2023-08-11T12:12:52.763 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-08-11T12:12:52.948 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-2:18.0.0-5437.g92684807.el8.x86_64 108/134 2023-08-11T12:12:52.986 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5437.g92684807.el8.x86_64 108/134 2023-08-11T12:12:53.071 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-08-11T12:12:53.134 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-rook-2:18.0.0-5437.g92684807.el8.noarch 109/134 2023-08-11T12:12:53.146 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5437.g92684807.el8.noarch 109/134 2023-08-11T12:12:53.249 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-fuse-2:18.0.0-5437.g92684807.el8.x86_64 119/134 2023-08-11T12:12:53.442 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-08-11T12:12:53.651 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs-devel-2:18.0.0-5437.g92684807.el8.x86_ 121/134 2023-08-11T12:12:53.806 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-11T12:12:54.525 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-2:18.0.0-5437.g92684807.el8.x86_64 110/134 2023-08-11T12:12:54.749 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-radosgw-2:18.0.0-5437.g92684807.el8.x86_64 111/134 2023-08-11T12:12:54.786 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5437.g92684807.el8.x86_64 111/134 2023-08-11T12:12:54.942 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5437.g92684 112/134 2023-08-11T12:12:54.994 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5437.g92684 112/134 2023-08-11T12:12:55.176 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephfs-mirror-2:18.0.0-5437.g92684807.el8.x86_64 113/134 2023-08-11T12:12:55.551 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5437.g92684807.el8.x86_64 113/134 2023-08-11T12:12:55.734 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-mirror-2:18.0.0-5437.g92684807.el8.x86_64 114/134 2023-08-11T12:12:55.925 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-11T12:12:55.987 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5437.g92684807.el8.x86_64 96/134 2023-08-11T12:12:55.987 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /sys 2023-08-11T12:12:55.987 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /proc 2023-08-11T12:12:55.987 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /dev 2023-08-11T12:12:55.988 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /run 2023-08-11T12:12:55.988 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /mnt 2023-08-11T12:12:55.988 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /var/tmp 2023-08-11T12:12:55.988 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /home 2023-08-11T12:12:55.989 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /tmp 2023-08-11T12:12:55.989 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /dev 2023-08-11T12:12:55.989 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:12:56.179 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-11T12:12:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-11T12:12:56.355 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephfs-top-2:18.0.0-5437.g92684807.el8.noarch 124/134 2023-08-11T12:12:56.426 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-volume-2:18.0.0-5437.g92684807.el8.noarch 97/134 2023-08-11T12:12:56.663 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-fuse-2:18.0.0-5437.g92684807.el8.x86_64 125/134 2023-08-11T12:12:56.977 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-nbd-2:18.0.0-5437.g92684807.el8.x86_64 126/134 2023-08-11T12:12:57.289 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-08-11T12:12:57.463 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-11T12:12:57.474 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-11T12:12:57.665 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-08-11T12:12:57.862 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-08-11T12:12:57.951 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-08-11T12:12:58.146 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-08-11T12:12:58.159 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-08-11T12:12:58.159 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-11T12:12:58.308 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-volume-2:18.0.0-5437.g92684807.el8.noarch 97/134 2023-08-11T12:12:58.357 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-11T12:12:58.357 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-11T12:12:58.486 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-osd-2:18.0.0-5437.g92684807.el8.x86_64 98/134 2023-08-11T12:12:58.626 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-11T12:12:58.773 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-osd-2:18.0.0-5437.g92684807.el8.x86_64 98/134 2023-08-11T12:12:58.837 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-11T12:12:58.943 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mds-2:18.0.0-5437.g92684807.el8.x86_64 99/134 2023-08-11T12:12:59.355 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-08-11T12:12:59.355 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-2:18.0.0-5437.g92684807.el8.x86_64 1/134 2023-08-11T12:12:59.355 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-base-2:18.0.0-5437.g92684807.el8.x86_64 2/134 2023-08-11T12:12:59.356 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-common-2:18.0.0-5437.g92684807.el8.x86_64 3/134 2023-08-11T12:12:59.356 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-fuse-2:18.0.0-5437.g92684807.el8.x86_64 4/134 2023-08-11T12:12:59.356 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5437.g92684 5/134 2023-08-11T12:12:59.357 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mds-2:18.0.0-5437.g92684807.el8.x86_64 6/134 2023-08-11T12:12:59.357 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-2:18.0.0-5437.g92684807.el8.x86_64 7/134 2023-08-11T12:12:59.357 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mon-2:18.0.0-5437.g92684807.el8.x86_64 8/134 2023-08-11T12:12:59.357 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-osd-2:18.0.0-5437.g92684807.el8.x86_64 9/134 2023-08-11T12:12:59.358 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-radosgw-2:18.0.0-5437.g92684807.el8.x86_64 10/134 2023-08-11T12:12:59.358 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-selinux-2:18.0.0-5437.g92684807.el8.x86_64 11/134 2023-08-11T12:12:59.358 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-test-2:18.0.0-5437.g92684807.el8.x86_64 12/134 2023-08-11T12:12:59.358 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephfs-mirror-2:18.0.0-5437.g92684807.el8.x86_64 13/134 2023-08-11T12:12:59.359 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs-devel-2:18.0.0-5437.g92684807.el8.x86_ 14/134 2023-08-11T12:12:59.359 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs2-2:18.0.0-5437.g92684807.el8.x86_64 15/134 2023-08-11T12:12:59.359 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephsqlite-2:18.0.0-5437.g92684807.el8.x86_64 16/134 2023-08-11T12:12:59.360 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados-devel-2:18.0.0-5437.g92684807.el8.x86_6 17/134 2023-08-11T12:12:59.360 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libradosstriper1-2:18.0.0-5437.g92684807.el8.x86 18/134 2023-08-11T12:12:59.360 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librgw2-2:18.0.0-5437.g92684807.el8.x86_64 19/134 2023-08-11T12:12:59.361 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5437.g92684807.el 20/134 2023-08-11T12:12:59.361 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-common-2:18.0.0-5437.g92684807.el8. 21/134 2023-08-11T12:12:59.361 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cephfs-2:18.0.0-5437.g92684807.el8.x86_6 22/134 2023-08-11T12:12:59.361 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rados-2:18.0.0-5437.g92684807.el8.x86_64 23/134 2023-08-11T12:12:59.361 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rbd-2:18.0.0-5437.g92684807.el8.x86_64 24/134 2023-08-11T12:12:59.362 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rgw-2:18.0.0-5437.g92684807.el8.x86_64 25/134 2023-08-11T12:12:59.362 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-fuse-2:18.0.0-5437.g92684807.el8.x86_64 26/134 2023-08-11T12:12:59.362 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-mirror-2:18.0.0-5437.g92684807.el8.x86_64 27/134 2023-08-11T12:12:59.362 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-nbd-2:18.0.0-5437.g92684807.el8.x86_64 28/134 2023-08-11T12:12:59.362 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5437.g92684807. 29/134 2023-08-11T12:12:59.370 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5437.g92684807.el8.noa 30/134 2023-08-11T12:12:59.370 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5437.g92684807.el8.n 31/134 2023-08-11T12:12:59.370 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5437.g926 32/134 2023-08-11T12:12:59.370 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5437.g92684807.el 33/134 2023-08-11T12:12:59.371 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5437.g92684807.el8.noarch 34/134 2023-08-11T12:12:59.371 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5437.g92684807.e 35/134 2023-08-11T12:12:59.371 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-volume-2:18.0.0-5437.g92684807.el8.noarch 36/134 2023-08-11T12:12:59.371 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephadm-2:18.0.0-5437.g92684807.el8.noarch 37/134 2023-08-11T12:12:59.371 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephfs-top-2:18.0.0-5437.g92684807.el8.noarch 38/134 2023-08-11T12:12:59.372 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-08-11T12:12:59.372 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-08-11T12:12:59.372 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-08-11T12:12:59.372 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-08-11T12:12:59.372 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-08-11T12:12:59.372 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-08-11T12:12:59.372 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-08-11T12:12:59.373 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-08-11T12:12:59.373 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-08-11T12:12:59.373 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-08-11T12:12:59.373 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-08-11T12:12:59.373 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-08-11T12:12:59.373 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-08-11T12:12:59.373 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-08-11T12:12:59.374 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-08-11T12:12:59.374 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-08-11T12:12:59.374 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-08-11T12:12:59.374 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-08-11T12:12:59.374 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-08-11T12:12:59.374 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-08-11T12:12:59.374 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-08-11T12:12:59.374 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-08-11T12:12:59.375 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-08-11T12:12:59.375 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-08-11T12:12:59.375 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-08-11T12:12:59.375 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-08-11T12:12:59.375 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-08-11T12:12:59.375 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-08-11T12:12:59.375 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-08-11T12:12:59.376 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-08-11T12:12:59.376 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-08-11T12:12:59.376 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-08-11T12:12:59.376 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-08-11T12:12:59.376 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-08-11T12:12:59.377 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-08-11T12:12:59.377 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-08-11T12:12:59.377 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-08-11T12:12:59.377 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-08-11T12:12:59.377 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-08-11T12:12:59.378 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-08-11T12:12:59.378 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-08-11T12:12:59.378 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-08-11T12:12:59.378 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-08-11T12:12:59.378 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-08-11T12:12:59.378 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-08-11T12:12:59.378 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-08-11T12:12:59.379 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-08-11T12:12:59.379 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-08-11T12:12:59.379 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-08-11T12:12:59.379 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-08-11T12:12:59.379 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-08-11T12:12:59.379 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-08-11T12:12:59.379 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-08-11T12:12:59.379 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-08-11T12:12:59.380 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-08-11T12:12:59.380 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-08-11T12:12:59.380 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-08-11T12:12:59.380 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-08-11T12:12:59.380 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-08-11T12:12:59.380 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-08-11T12:12:59.380 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-08-11T12:12:59.381 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-08-11T12:12:59.381 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-08-11T12:12:59.381 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-08-11T12:12:59.381 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-08-11T12:12:59.381 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-08-11T12:12:59.381 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-08-11T12:12:59.381 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-08-11T12:12:59.382 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-08-11T12:12:59.382 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-08-11T12:12:59.382 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-08-11T12:12:59.382 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-08-11T12:12:59.382 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-08-11T12:12:59.382 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-08-11T12:12:59.383 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-08-11T12:12:59.383 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-08-11T12:12:59.383 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-08-11T12:12:59.383 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-08-11T12:12:59.383 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-08-11T12:12:59.383 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-08-11T12:12:59.384 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-08-11T12:12:59.384 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-08-11T12:12:59.384 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-08-11T12:12:59.384 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-11T12:12:59.384 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-08-11T12:12:59.384 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-08-11T12:12:59.384 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-08-11T12:12:59.385 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-08-11T12:12:59.385 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-08-11T12:12:59.385 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-11T12:12:59.385 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:18.0.0-5437.g92684807.el8.x86_64 129/134 2023-08-11T12:12:59.385 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-08-11T12:12:59.385 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:18.0.0-5437.g92684807.el8.x86_64 131/134 2023-08-11T12:12:59.385 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-11T12:12:59.385 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-08-11T12:12:59.508 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mds-2:18.0.0-5437.g92684807.el8.x86_64 99/134 2023-08-11T12:12:59.742 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mon-2:18.0.0-5437.g92684807.el8.x86_64 100/134 2023-08-11T12:12:59.786 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mon-2:18.0.0-5437.g92684807.el8.x86_64 100/134 2023-08-11T12:13:00.635 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5437.g92684807.el8.x86_64 114/134 2023-08-11T12:13:00.937 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-test-2:18.0.0-5437.g92684807.el8.x86_64 115/134 2023-08-11T12:13:01.124 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-08-11T12:13:01.339 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-08-11T12:13:01.846 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-11T12:13:01.846 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:50 ago on Fri 11 Aug 2023 12:11:11 PM UTC. 2023-08-11T12:13:02.315 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-08-11T12:13:02.659 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cephadm-2:18.0.0-5437.g92684807.el8.noarch 101/134 2023-08-11T12:13:02.678 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-08-11T12:13:02.847 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephadm-2:18.0.0-5437.g92684807.el8.noarch 101/134 2023-08-11T12:13:02.861 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-fuse-2:18.0.0-5437.g92684807.el8.x86_64 119/134 2023-08-11T12:13:02.967 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5437.g92684807.e 102/134 2023-08-11T12:13:03.062 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-08-11T12:13:03.204 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephfs-devel-2:18.0.0-5437.g92684807.el8.x86_ 121/134 2023-08-11T12:13:03.219 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5437.g92684807. 103/134 2023-08-11T12:13:03.350 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-11T12:13:03.391 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5437.g92684807.el8.noa 104/134 2023-08-11T12:13:03.674 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5437.g92684807.el8.noa 104/134 2023-08-11T12:13:03.860 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5437.g92684807.el8.n 105/134 2023-08-11T12:13:05.062 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5437.g92684807.el8.n 105/134 2023-08-11T12:13:05.266 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5437.g926 106/134 2023-08-11T12:13:05.405 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5437.g926 106/134 2023-08-11T12:13:05.730 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-11T12:13:05.822 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5437.g92684807.el 107/134 2023-08-11T12:13:05.999 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-11T12:13:06.017 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-11T12:13:06.067 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-2:18.0.0-5437.g92684807.el8.x86_64 108/134 2023-08-11T12:13:06.134 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5437.g92684807.el8.x86_64 108/134 2023-08-11T12:13:06.174 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephfs-top-2:18.0.0-5437.g92684807.el8.noarch 124/134 2023-08-11T12:13:06.324 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-rook-2:18.0.0-5437.g92684807.el8.noarch 109/134 2023-08-11T12:13:06.356 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5437.g92684807.el8.noarch 109/134 2023-08-11T12:13:06.491 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-fuse-2:18.0.0-5437.g92684807.el8.x86_64 125/134 2023-08-11T12:13:06.805 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-nbd-2:18.0.0-5437.g92684807.el8.x86_64 126/134 2023-08-11T12:13:07.092 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-08-11T12:13:07.248 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-11T12:13:07.258 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-11T12:13:07.442 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-08-11T12:13:07.673 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-08-11T12:13:07.763 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-08-11T12:13:07.865 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-2:18.0.0-5437.g92684807.el8.x86_64 110/134 2023-08-11T12:13:07.940 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-08-11T12:13:07.954 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-08-11T12:13:07.954 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-11T12:13:08.081 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-radosgw-2:18.0.0-5437.g92684807.el8.x86_64 111/134 2023-08-11T12:13:08.145 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5437.g92684807.el8.x86_64 111/134 2023-08-11T12:13:08.219 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-11T12:13:08.219 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-11T12:13:08.283 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5437.g92684 112/134 2023-08-11T12:13:08.366 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5437.g92684 112/134 2023-08-11T12:13:08.422 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-11T12:13:08.566 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephfs-mirror-2:18.0.0-5437.g92684807.el8.x86_64 113/134 2023-08-11T12:13:08.648 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-11T12:13:09.012 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5437.g92684807.el8.x86_64 113/134 2023-08-11T12:13:09.175 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-mirror-2:18.0.0-5437.g92684807.el8.x86_64 114/134 2023-08-11T12:13:09.231 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-08-11T12:13:09.232 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-2:18.0.0-5437.g92684807.el8.x86_64 1/134 2023-08-11T12:13:09.232 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-base-2:18.0.0-5437.g92684807.el8.x86_64 2/134 2023-08-11T12:13:09.232 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-common-2:18.0.0-5437.g92684807.el8.x86_64 3/134 2023-08-11T12:13:09.232 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-fuse-2:18.0.0-5437.g92684807.el8.x86_64 4/134 2023-08-11T12:13:09.232 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5437.g92684 5/134 2023-08-11T12:13:09.233 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mds-2:18.0.0-5437.g92684807.el8.x86_64 6/134 2023-08-11T12:13:09.233 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-2:18.0.0-5437.g92684807.el8.x86_64 7/134 2023-08-11T12:13:09.233 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mon-2:18.0.0-5437.g92684807.el8.x86_64 8/134 2023-08-11T12:13:09.233 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-osd-2:18.0.0-5437.g92684807.el8.x86_64 9/134 2023-08-11T12:13:09.233 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-radosgw-2:18.0.0-5437.g92684807.el8.x86_64 10/134 2023-08-11T12:13:09.233 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-selinux-2:18.0.0-5437.g92684807.el8.x86_64 11/134 2023-08-11T12:13:09.233 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-test-2:18.0.0-5437.g92684807.el8.x86_64 12/134 2023-08-11T12:13:09.234 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephfs-mirror-2:18.0.0-5437.g92684807.el8.x86_64 13/134 2023-08-11T12:13:09.234 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephfs-devel-2:18.0.0-5437.g92684807.el8.x86_ 14/134 2023-08-11T12:13:09.234 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephfs2-2:18.0.0-5437.g92684807.el8.x86_64 15/134 2023-08-11T12:13:09.234 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephsqlite-2:18.0.0-5437.g92684807.el8.x86_64 16/134 2023-08-11T12:13:09.235 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados-devel-2:18.0.0-5437.g92684807.el8.x86_6 17/134 2023-08-11T12:13:09.235 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libradosstriper1-2:18.0.0-5437.g92684807.el8.x86 18/134 2023-08-11T12:13:09.235 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librgw2-2:18.0.0-5437.g92684807.el8.x86_64 19/134 2023-08-11T12:13:09.235 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5437.g92684807.el 20/134 2023-08-11T12:13:09.242 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ceph-common-2:18.0.0-5437.g92684807.el8. 21/134 2023-08-11T12:13:09.243 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cephfs-2:18.0.0-5437.g92684807.el8.x86_6 22/134 2023-08-11T12:13:09.243 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rados-2:18.0.0-5437.g92684807.el8.x86_64 23/134 2023-08-11T12:13:09.243 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rbd-2:18.0.0-5437.g92684807.el8.x86_64 24/134 2023-08-11T12:13:09.243 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rgw-2:18.0.0-5437.g92684807.el8.x86_64 25/134 2023-08-11T12:13:09.243 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-fuse-2:18.0.0-5437.g92684807.el8.x86_64 26/134 2023-08-11T12:13:09.243 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-mirror-2:18.0.0-5437.g92684807.el8.x86_64 27/134 2023-08-11T12:13:09.244 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-nbd-2:18.0.0-5437.g92684807.el8.x86_64 28/134 2023-08-11T12:13:09.244 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5437.g92684807. 29/134 2023-08-11T12:13:09.244 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5437.g92684807.el8.noa 30/134 2023-08-11T12:13:09.244 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5437.g92684807.el8.n 31/134 2023-08-11T12:13:09.244 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5437.g926 32/134 2023-08-11T12:13:09.244 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5437.g92684807.el 33/134 2023-08-11T12:13:09.244 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5437.g92684807.el8.noarch 34/134 2023-08-11T12:13:09.245 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5437.g92684807.e 35/134 2023-08-11T12:13:09.245 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-volume-2:18.0.0-5437.g92684807.el8.noarch 36/134 2023-08-11T12:13:09.245 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephadm-2:18.0.0-5437.g92684807.el8.noarch 37/134 2023-08-11T12:13:09.245 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephfs-top-2:18.0.0-5437.g92684807.el8.noarch 38/134 2023-08-11T12:13:09.245 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-08-11T12:13:09.245 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-08-11T12:13:09.245 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-08-11T12:13:09.245 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-08-11T12:13:09.246 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-08-11T12:13:09.246 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-08-11T12:13:09.246 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-08-11T12:13:09.246 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-08-11T12:13:09.246 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-08-11T12:13:09.246 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-08-11T12:13:09.246 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-08-11T12:13:09.247 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-08-11T12:13:09.247 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-08-11T12:13:09.247 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-08-11T12:13:09.247 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-08-11T12:13:09.247 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-08-11T12:13:09.247 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-08-11T12:13:09.247 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-08-11T12:13:09.248 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-08-11T12:13:09.248 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-08-11T12:13:09.248 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-08-11T12:13:09.248 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-08-11T12:13:09.248 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-08-11T12:13:09.248 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-08-11T12:13:09.248 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-08-11T12:13:09.249 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-08-11T12:13:09.249 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-08-11T12:13:09.249 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-08-11T12:13:09.249 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-08-11T12:13:09.249 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-08-11T12:13:09.249 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-08-11T12:13:09.249 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-08-11T12:13:09.250 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-08-11T12:13:09.250 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-08-11T12:13:09.250 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-08-11T12:13:09.250 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-08-11T12:13:09.250 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-08-11T12:13:09.250 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-08-11T12:13:09.250 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-08-11T12:13:09.250 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-08-11T12:13:09.251 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-08-11T12:13:09.251 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-08-11T12:13:09.251 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-08-11T12:13:09.251 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-08-11T12:13:09.251 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-08-11T12:13:09.251 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-08-11T12:13:09.251 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-08-11T12:13:09.252 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-08-11T12:13:09.252 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-08-11T12:13:09.252 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-08-11T12:13:09.252 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-08-11T12:13:09.252 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-08-11T12:13:09.252 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-08-11T12:13:09.252 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-08-11T12:13:09.253 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-08-11T12:13:09.253 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-08-11T12:13:09.253 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-08-11T12:13:09.253 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-08-11T12:13:09.253 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-08-11T12:13:09.253 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-08-11T12:13:09.253 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-08-11T12:13:09.253 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-08-11T12:13:09.254 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-08-11T12:13:09.254 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-08-11T12:13:09.254 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-08-11T12:13:09.254 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-08-11T12:13:09.254 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-08-11T12:13:09.254 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-08-11T12:13:09.254 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-08-11T12:13:09.255 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-08-11T12:13:09.255 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-08-11T12:13:09.255 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-08-11T12:13:09.255 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-08-11T12:13:09.255 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-08-11T12:13:09.255 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-08-11T12:13:09.255 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-08-11T12:13:09.255 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-08-11T12:13:09.256 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-08-11T12:13:09.256 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-08-11T12:13:09.256 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-08-11T12:13:09.256 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-08-11T12:13:09.256 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-08-11T12:13:09.256 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-08-11T12:13:09.257 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-11T12:13:09.257 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-08-11T12:13:09.257 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-08-11T12:13:09.257 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-08-11T12:13:09.257 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-08-11T12:13:09.257 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-08-11T12:13:09.257 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-11T12:13:09.258 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados2-2:18.0.0-5437.g92684807.el8.x86_64 129/134 2023-08-11T12:13:09.258 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-08-11T12:13:09.258 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librbd1-2:18.0.0-5437.g92684807.el8.x86_64 131/134 2023-08-11T12:13:09.258 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-11T12:13:09.258 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-08-11T12:13:10.200 INFO:teuthology.orchestra.run.smithi194.stdout:Installed products updated. 2023-08-11T12:13:10.415 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-08-11T12:13:10.415 INFO:teuthology.orchestra.run.smithi194.stdout:Upgraded: 2023-08-11T12:13:10.415 INFO:teuthology.orchestra.run.smithi194.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-08-11T12:13:10.416 INFO:teuthology.orchestra.run.smithi194.stdout: librados2-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.416 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.416 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2023-08-11T12:13:10.416 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-08-11T12:13:10.416 INFO:teuthology.orchestra.run.smithi194.stdout: automake-1.16.1-7.el8.noarch 2023-08-11T12:13:10.416 INFO:teuthology.orchestra.run.smithi194.stdout: bison-3.0.4-10.el8.x86_64 2023-08-11T12:13:10.416 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.417 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.417 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.417 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.417 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:10.417 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.417 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.417 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.418 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:10.418 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:10.418 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:10.418 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:10.418 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:10.418 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.418 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.419 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:10.419 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.419 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.419 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.419 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-volume-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:10.419 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:10.419 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-mirror-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.419 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-top-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:10.420 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-08-11T12:13:10.420 INFO:teuthology.orchestra.run.smithi194.stdout: flex-2.6.1-9.el8.x86_64 2023-08-11T12:13:10.420 INFO:teuthology.orchestra.run.smithi194.stdout: fuse-2.9.7-15.el8.x86_64 2023-08-11T12:13:10.420 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-11T12:13:10.421 INFO:teuthology.orchestra.run.smithi194.stdout: jq-1.6-3.el8.x86_64 2023-08-11T12:13:10.421 INFO:teuthology.orchestra.run.smithi194.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-11T12:13:10.421 INFO:teuthology.orchestra.run.smithi194.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-08-11T12:13:10.421 INFO:teuthology.orchestra.run.smithi194.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-11T12:13:10.421 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.421 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.421 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.421 INFO:teuthology.orchestra.run.smithi194.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-08-11T12:13:10.422 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-08-11T12:13:10.422 INFO:teuthology.orchestra.run.smithi194.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-11T12:13:10.422 INFO:teuthology.orchestra.run.smithi194.stdout: libpq-13.5-1.el8.x86_64 2023-08-11T12:13:10.422 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-08-11T12:13:10.422 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-11T12:13:10.422 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.422 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.423 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-11T12:13:10.423 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.423 INFO:teuthology.orchestra.run.smithi194.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-11T12:13:10.423 INFO:teuthology.orchestra.run.smithi194.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-11T12:13:10.423 INFO:teuthology.orchestra.run.smithi194.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-11T12:13:10.423 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-11T12:13:10.423 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-08-11T12:13:10.424 INFO:teuthology.orchestra.run.smithi194.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-11T12:13:10.424 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-11T12:13:10.424 INFO:teuthology.orchestra.run.smithi194.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-11T12:13:10.424 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-0.3.15-3.el8.x86_64 2023-08-11T12:13:10.424 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-08-11T12:13:10.424 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-08-11T12:13:10.425 INFO:teuthology.orchestra.run.smithi194.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-11T12:13:10.425 INFO:teuthology.orchestra.run.smithi194.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-11T12:13:10.425 INFO:teuthology.orchestra.run.smithi194.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-11T12:13:10.425 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-11T12:13:10.425 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-11T12:13:10.425 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-11T12:13:10.425 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-11T12:13:10.425 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-11T12:13:10.426 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-11T12:13:10.426 INFO:teuthology.orchestra.run.smithi194.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-11T12:13:10.426 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-11T12:13:10.426 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.426 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.426 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.426 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-11T12:13:10.427 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-08-11T12:13:10.427 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-11T12:13:10.427 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-11T12:13:10.427 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-08-11T12:13:10.427 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-11T12:13:10.427 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-11T12:13:10.427 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-11T12:13:10.427 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-11T12:13:10.428 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-11T12:13:10.428 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-11T12:13:10.428 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-11T12:13:10.428 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-11T12:13:10.428 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-11T12:13:10.428 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-11T12:13:10.428 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-11T12:13:10.429 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-11T12:13:10.429 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-11T12:13:10.429 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-11T12:13:10.429 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-11T12:13:10.429 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-11T12:13:10.429 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-11T12:13:10.429 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend-2.6-1.el8.noarch 2023-08-11T12:13:10.429 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-11T12:13:10.430 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-11T12:13:10.430 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-11T12:13:10.430 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-11T12:13:10.430 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-11T12:13:10.430 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-11T12:13:10.430 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.430 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.431 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-11T12:13:10.431 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-11T12:13:10.431 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.431 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-11T12:13:10.431 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-11T12:13:10.431 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-08-11T12:13:10.431 INFO:teuthology.orchestra.run.smithi194.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-11T12:13:10.432 INFO:teuthology.orchestra.run.smithi194.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-11T12:13:10.432 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-11T12:13:10.432 INFO:teuthology.orchestra.run.smithi194.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-11T12:13:10.432 INFO:teuthology.orchestra.run.smithi194.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-11T12:13:10.432 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-11T12:13:10.432 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-11T12:13:10.432 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-11T12:13:10.433 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-11T12:13:10.433 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-11T12:13:10.433 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.433 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.433 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:10.433 INFO:teuthology.orchestra.run.smithi194.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-11T12:13:10.433 INFO:teuthology.orchestra.run.smithi194.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-11T12:13:10.434 INFO:teuthology.orchestra.run.smithi194.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-11T12:13:10.434 INFO:teuthology.orchestra.run.smithi194.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-08-11T12:13:10.434 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-11T12:13:10.434 INFO:teuthology.orchestra.run.smithi194.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-08-11T12:13:10.435 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-08-11T12:13:10.435 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2023-08-11T12:13:10.596 DEBUG:teuthology.parallel:result is None 2023-08-11T12:13:11.763 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-11T12:13:11.764 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:59 ago on Fri 11 Aug 2023 12:11:12 PM UTC. 2023-08-11T12:13:14.595 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5437.g92684807.el8.x86_64 114/134 2023-08-11T12:13:15.974 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-test-2:18.0.0-5437.g92684807.el8.x86_64 115/134 2023-08-11T12:13:16.476 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-08-11T12:13:16.663 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-fuse-2:18.0.0-5437.g92684807.el8.x86_64 117/134 2023-08-11T12:13:16.967 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-08-11T12:13:17.281 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-08-11T12:13:17.557 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-08-11T12:13:17.895 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-08-11T12:13:18.096 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephfs-devel-2:18.0.0-5437.g92684807.el8.x86_ 121/134 2023-08-11T12:13:18.316 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-11T12:13:21.526 INFO:teuthology.orchestra.run.smithi045.stdout:Installed products updated. 2023-08-11T12:13:21.761 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-08-11T12:13:21.762 INFO:teuthology.orchestra.run.smithi045.stdout:Upgraded: 2023-08-11T12:13:21.762 INFO:teuthology.orchestra.run.smithi045.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-08-11T12:13:21.763 INFO:teuthology.orchestra.run.smithi045.stdout: librados2-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.763 INFO:teuthology.orchestra.run.smithi045.stdout: librbd1-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.763 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2023-08-11T12:13:21.764 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-08-11T12:13:21.764 INFO:teuthology.orchestra.run.smithi045.stdout: automake-1.16.1-7.el8.noarch 2023-08-11T12:13:21.764 INFO:teuthology.orchestra.run.smithi045.stdout: bison-3.0.4-10.el8.x86_64 2023-08-11T12:13:21.764 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.764 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.764 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-common-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.764 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-fuse-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.765 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-grafana-dashboards-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:21.765 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-immutable-object-cache-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.765 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mds-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.765 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.765 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-cephadm-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:21.765 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:21.765 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:21.766 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:21.766 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-rook-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:21.766 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mon-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.766 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-osd-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.766 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-prometheus-alerts-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:21.766 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-radosgw-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.766 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-selinux-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.767 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-test-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.767 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-volume-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:21.767 INFO:teuthology.orchestra.run.smithi045.stdout: cephadm-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:21.767 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-mirror-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.767 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-top-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:21.767 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-08-11T12:13:21.767 INFO:teuthology.orchestra.run.smithi045.stdout: flex-2.6.1-9.el8.x86_64 2023-08-11T12:13:21.767 INFO:teuthology.orchestra.run.smithi045.stdout: fuse-2.9.7-15.el8.x86_64 2023-08-11T12:13:21.768 INFO:teuthology.orchestra.run.smithi045.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-11T12:13:21.768 INFO:teuthology.orchestra.run.smithi045.stdout: jq-1.6-3.el8.x86_64 2023-08-11T12:13:21.768 INFO:teuthology.orchestra.run.smithi045.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-11T12:13:21.768 INFO:teuthology.orchestra.run.smithi045.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-08-11T12:13:21.768 INFO:teuthology.orchestra.run.smithi045.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-11T12:13:21.768 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs-devel-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.768 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs2-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.769 INFO:teuthology.orchestra.run.smithi045.stdout: libcephsqlite-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.769 INFO:teuthology.orchestra.run.smithi045.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-08-11T12:13:21.769 INFO:teuthology.orchestra.run.smithi045.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-08-11T12:13:21.769 INFO:teuthology.orchestra.run.smithi045.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-11T12:13:21.769 INFO:teuthology.orchestra.run.smithi045.stdout: libpq-13.5-1.el8.x86_64 2023-08-11T12:13:21.769 INFO:teuthology.orchestra.run.smithi045.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-08-11T12:13:21.769 INFO:teuthology.orchestra.run.smithi045.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-11T12:13:21.769 INFO:teuthology.orchestra.run.smithi045.stdout: librados-devel-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.770 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.770 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-11T12:13:21.770 INFO:teuthology.orchestra.run.smithi045.stdout: librgw2-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.770 INFO:teuthology.orchestra.run.smithi045.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-11T12:13:21.770 INFO:teuthology.orchestra.run.smithi045.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-11T12:13:21.770 INFO:teuthology.orchestra.run.smithi045.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-11T12:13:21.770 INFO:teuthology.orchestra.run.smithi045.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-11T12:13:21.771 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-08-11T12:13:21.771 INFO:teuthology.orchestra.run.smithi045.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-11T12:13:21.771 INFO:teuthology.orchestra.run.smithi045.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-11T12:13:21.771 INFO:teuthology.orchestra.run.smithi045.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-11T12:13:21.771 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-0.3.15-3.el8.x86_64 2023-08-11T12:13:21.771 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-08-11T12:13:21.771 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-08-11T12:13:21.772 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-11T12:13:21.772 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-11T12:13:21.772 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-11T12:13:21.772 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-11T12:13:21.772 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-11T12:13:21.772 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-11T12:13:21.772 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-11T12:13:21.773 INFO:teuthology.orchestra.run.smithi045.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-11T12:13:21.773 INFO:teuthology.orchestra.run.smithi045.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-11T12:13:21.773 INFO:teuthology.orchestra.run.smithi045.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-11T12:13:21.773 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-11T12:13:21.773 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.773 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-common-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.773 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cephfs-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.773 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-11T12:13:21.774 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-08-11T12:13:21.774 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-11T12:13:21.774 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-11T12:13:21.774 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-08-11T12:13:21.774 INFO:teuthology.orchestra.run.smithi045.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-11T12:13:21.774 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-11T12:13:21.774 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-11T12:13:21.775 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-11T12:13:21.775 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-11T12:13:21.775 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-11T12:13:21.775 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-11T12:13:21.775 INFO:teuthology.orchestra.run.smithi045.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-11T12:13:21.775 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-11T12:13:21.775 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-11T12:13:21.775 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-11T12:13:21.776 INFO:teuthology.orchestra.run.smithi045.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-11T12:13:21.776 INFO:teuthology.orchestra.run.smithi045.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-11T12:13:21.776 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-11T12:13:21.776 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-11T12:13:21.776 INFO:teuthology.orchestra.run.smithi045.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-11T12:13:21.776 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-11T12:13:21.776 INFO:teuthology.orchestra.run.smithi045.stdout: python3-portend-2.6-1.el8.noarch 2023-08-11T12:13:21.777 INFO:teuthology.orchestra.run.smithi045.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-11T12:13:21.777 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-11T12:13:21.777 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-11T12:13:21.777 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-11T12:13:21.777 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-11T12:13:21.777 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-11T12:13:21.777 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.778 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rbd-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.778 INFO:teuthology.orchestra.run.smithi045.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-11T12:13:21.778 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-11T12:13:21.778 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rgw-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.778 INFO:teuthology.orchestra.run.smithi045.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-11T12:13:21.778 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-11T12:13:21.778 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-08-11T12:13:21.778 INFO:teuthology.orchestra.run.smithi045.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-11T12:13:21.779 INFO:teuthology.orchestra.run.smithi045.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-11T12:13:21.779 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-11T12:13:21.779 INFO:teuthology.orchestra.run.smithi045.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-11T12:13:21.779 INFO:teuthology.orchestra.run.smithi045.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-11T12:13:21.779 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-11T12:13:21.779 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-11T12:13:21.779 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-11T12:13:21.779 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-11T12:13:21.780 INFO:teuthology.orchestra.run.smithi045.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-11T12:13:21.780 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-fuse-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.780 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-mirror-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.780 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-nbd-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:21.781 INFO:teuthology.orchestra.run.smithi045.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-11T12:13:21.781 INFO:teuthology.orchestra.run.smithi045.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-11T12:13:21.781 INFO:teuthology.orchestra.run.smithi045.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-11T12:13:21.781 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-08-11T12:13:21.781 INFO:teuthology.orchestra.run.smithi045.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-11T12:13:21.782 INFO:teuthology.orchestra.run.smithi045.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-08-11T12:13:21.782 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-08-11T12:13:21.782 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2023-08-11T12:13:21.902 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-11T12:13:21.939 DEBUG:teuthology.parallel:result is None 2023-08-11T12:13:22.323 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-11T12:13:22.361 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-11T12:13:22.591 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephfs-top-2:18.0.0-5437.g92684807.el8.noarch 124/134 2023-08-11T12:13:22.808 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-fuse-2:18.0.0-5437.g92684807.el8.x86_64 125/134 2023-08-11T12:13:23.162 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-nbd-2:18.0.0-5437.g92684807.el8.x86_64 126/134 2023-08-11T12:13:23.506 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-08-11T12:13:23.722 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-08-11T12:13:23.844 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-08-11T12:13:24.081 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-08-11T12:13:24.109 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-08-11T12:13:24.306 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-08-11T12:13:24.330 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-08-11T12:13:24.526 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-08-11T12:13:24.526 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-11T12:13:24.754 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-11T12:13:24.754 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-11T12:13:25.030 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-11T12:13:25.223 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-11T12:13:25.491 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-08-11T12:13:25.491 INFO:teuthology.orchestra.run.smithi008.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-08-11T12:13:25.491 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:13:26.137 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-2:18.0.0-5437.g92684807.el8.x86_64 1/134 2023-08-11T12:13:26.138 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-base-2:18.0.0-5437.g92684807.el8.x86_64 2/134 2023-08-11T12:13:26.138 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-common-2:18.0.0-5437.g92684807.el8.x86_64 3/134 2023-08-11T12:13:26.138 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-fuse-2:18.0.0-5437.g92684807.el8.x86_64 4/134 2023-08-11T12:13:26.138 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5437.g92684 5/134 2023-08-11T12:13:26.139 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mds-2:18.0.0-5437.g92684807.el8.x86_64 6/134 2023-08-11T12:13:26.139 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-2:18.0.0-5437.g92684807.el8.x86_64 7/134 2023-08-11T12:13:26.139 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mon-2:18.0.0-5437.g92684807.el8.x86_64 8/134 2023-08-11T12:13:26.139 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-osd-2:18.0.0-5437.g92684807.el8.x86_64 9/134 2023-08-11T12:13:26.139 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-radosgw-2:18.0.0-5437.g92684807.el8.x86_64 10/134 2023-08-11T12:13:26.139 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-selinux-2:18.0.0-5437.g92684807.el8.x86_64 11/134 2023-08-11T12:13:26.139 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-test-2:18.0.0-5437.g92684807.el8.x86_64 12/134 2023-08-11T12:13:26.140 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephfs-mirror-2:18.0.0-5437.g92684807.el8.x86_64 13/134 2023-08-11T12:13:26.140 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs-devel-2:18.0.0-5437.g92684807.el8.x86_ 14/134 2023-08-11T12:13:26.140 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs2-2:18.0.0-5437.g92684807.el8.x86_64 15/134 2023-08-11T12:13:26.140 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephsqlite-2:18.0.0-5437.g92684807.el8.x86_64 16/134 2023-08-11T12:13:26.140 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados-devel-2:18.0.0-5437.g92684807.el8.x86_6 17/134 2023-08-11T12:13:26.140 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libradosstriper1-2:18.0.0-5437.g92684807.el8.x86 18/134 2023-08-11T12:13:26.140 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librgw2-2:18.0.0-5437.g92684807.el8.x86_64 19/134 2023-08-11T12:13:26.149 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5437.g92684807.el 20/134 2023-08-11T12:13:26.149 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-common-2:18.0.0-5437.g92684807.el8. 21/134 2023-08-11T12:13:26.149 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cephfs-2:18.0.0-5437.g92684807.el8.x86_6 22/134 2023-08-11T12:13:26.150 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rados-2:18.0.0-5437.g92684807.el8.x86_64 23/134 2023-08-11T12:13:26.150 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rbd-2:18.0.0-5437.g92684807.el8.x86_64 24/134 2023-08-11T12:13:26.150 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rgw-2:18.0.0-5437.g92684807.el8.x86_64 25/134 2023-08-11T12:13:26.150 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-fuse-2:18.0.0-5437.g92684807.el8.x86_64 26/134 2023-08-11T12:13:26.150 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-mirror-2:18.0.0-5437.g92684807.el8.x86_64 27/134 2023-08-11T12:13:26.150 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-nbd-2:18.0.0-5437.g92684807.el8.x86_64 28/134 2023-08-11T12:13:26.150 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5437.g92684807. 29/134 2023-08-11T12:13:26.150 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5437.g92684807.el8.noa 30/134 2023-08-11T12:13:26.151 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5437.g92684807.el8.n 31/134 2023-08-11T12:13:26.151 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5437.g926 32/134 2023-08-11T12:13:26.151 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5437.g92684807.el 33/134 2023-08-11T12:13:26.151 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5437.g92684807.el8.noarch 34/134 2023-08-11T12:13:26.151 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5437.g92684807.e 35/134 2023-08-11T12:13:26.151 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-volume-2:18.0.0-5437.g92684807.el8.noarch 36/134 2023-08-11T12:13:26.151 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephadm-2:18.0.0-5437.g92684807.el8.noarch 37/134 2023-08-11T12:13:26.152 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephfs-top-2:18.0.0-5437.g92684807.el8.noarch 38/134 2023-08-11T12:13:26.152 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-08-11T12:13:26.152 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-08-11T12:13:26.152 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-08-11T12:13:26.152 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-08-11T12:13:26.152 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-08-11T12:13:26.152 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-08-11T12:13:26.152 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-08-11T12:13:26.153 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-08-11T12:13:26.153 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-08-11T12:13:26.153 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-08-11T12:13:26.153 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-08-11T12:13:26.153 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-08-11T12:13:26.153 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-08-11T12:13:26.153 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-08-11T12:13:26.154 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-08-11T12:13:26.154 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-08-11T12:13:26.154 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-08-11T12:13:26.154 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-08-11T12:13:26.155 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-08-11T12:13:26.155 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-08-11T12:13:26.155 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-08-11T12:13:26.155 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-08-11T12:13:26.155 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-08-11T12:13:26.155 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-08-11T12:13:26.155 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-08-11T12:13:26.156 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-08-11T12:13:26.156 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-08-11T12:13:26.156 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-08-11T12:13:26.156 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-08-11T12:13:26.156 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-08-11T12:13:26.156 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-08-11T12:13:26.156 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-08-11T12:13:26.157 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-08-11T12:13:26.157 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-08-11T12:13:26.157 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-08-11T12:13:26.157 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-08-11T12:13:26.157 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-08-11T12:13:26.157 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-08-11T12:13:26.157 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-08-11T12:13:26.157 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-08-11T12:13:26.158 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-08-11T12:13:26.158 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-08-11T12:13:26.158 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-08-11T12:13:26.158 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-08-11T12:13:26.158 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-08-11T12:13:26.158 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-08-11T12:13:26.158 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-08-11T12:13:26.159 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-08-11T12:13:26.159 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-08-11T12:13:26.159 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-08-11T12:13:26.159 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-08-11T12:13:26.159 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-08-11T12:13:26.159 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-08-11T12:13:26.159 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-08-11T12:13:26.159 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-08-11T12:13:26.160 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-08-11T12:13:26.160 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-08-11T12:13:26.160 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-08-11T12:13:26.160 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-08-11T12:13:26.160 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-08-11T12:13:26.160 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-08-11T12:13:26.161 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-08-11T12:13:26.161 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-08-11T12:13:26.161 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-08-11T12:13:26.161 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-08-11T12:13:26.161 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-08-11T12:13:26.161 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-08-11T12:13:26.161 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-08-11T12:13:26.162 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-08-11T12:13:26.162 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-08-11T12:13:26.162 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-08-11T12:13:26.162 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-08-11T12:13:26.162 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-08-11T12:13:26.162 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-08-11T12:13:26.162 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-08-11T12:13:26.163 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-08-11T12:13:26.164 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-08-11T12:13:26.164 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-08-11T12:13:26.165 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-08-11T12:13:26.165 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-08-11T12:13:26.165 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-08-11T12:13:26.166 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-08-11T12:13:26.166 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-08-11T12:13:26.166 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-08-11T12:13:26.166 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-08-11T12:13:26.167 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-08-11T12:13:26.167 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-08-11T12:13:26.167 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-08-11T12:13:26.167 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-08-11T12:13:26.168 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-08-11T12:13:26.168 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-2:18.0.0-5437.g92684807.el8.x86_64 129/134 2023-08-11T12:13:26.169 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-08-11T12:13:26.169 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-2:18.0.0-5437.g92684807.el8.x86_64 131/134 2023-08-11T12:13:26.169 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-11T12:13:26.170 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-08-11T12:13:28.896 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-11T12:13:28.896 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:14 ago on Fri 11 Aug 2023 12:11:14 PM UTC. 2023-08-11T12:13:36.612 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-08-11T12:13:36.851 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:13:36.851 INFO:teuthology.orchestra.run.smithi008.stdout:Upgraded: 2023-08-11T12:13:36.851 INFO:teuthology.orchestra.run.smithi008.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-08-11T12:13:36.852 INFO:teuthology.orchestra.run.smithi008.stdout: librados2-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.852 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.852 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-08-11T12:13:36.852 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-08-11T12:13:36.852 INFO:teuthology.orchestra.run.smithi008.stdout: automake-1.16.1-7.el8.noarch 2023-08-11T12:13:36.852 INFO:teuthology.orchestra.run.smithi008.stdout: bison-3.0.4-10.el8.x86_64 2023-08-11T12:13:36.852 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.853 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.853 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.853 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.853 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:36.853 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.854 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.854 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.854 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:36.854 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:36.854 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:36.854 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:36.854 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:36.854 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.855 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.855 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:36.855 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.855 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.855 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.855 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-volume-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:36.855 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:36.856 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-mirror-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.856 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-top-2:18.0.0-5437.g92684807.el8.noarch 2023-08-11T12:13:36.856 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-08-11T12:13:36.856 INFO:teuthology.orchestra.run.smithi008.stdout: flex-2.6.1-9.el8.x86_64 2023-08-11T12:13:36.856 INFO:teuthology.orchestra.run.smithi008.stdout: fuse-2.9.7-15.el8.x86_64 2023-08-11T12:13:36.856 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-11T12:13:36.856 INFO:teuthology.orchestra.run.smithi008.stdout: jq-1.6-3.el8.x86_64 2023-08-11T12:13:36.856 INFO:teuthology.orchestra.run.smithi008.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-11T12:13:36.857 INFO:teuthology.orchestra.run.smithi008.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-08-11T12:13:36.857 INFO:teuthology.orchestra.run.smithi008.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-11T12:13:36.857 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.857 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.857 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.858 INFO:teuthology.orchestra.run.smithi008.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-08-11T12:13:36.858 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-08-11T12:13:36.858 INFO:teuthology.orchestra.run.smithi008.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-11T12:13:36.858 INFO:teuthology.orchestra.run.smithi008.stdout: libpq-13.5-1.el8.x86_64 2023-08-11T12:13:36.858 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-08-11T12:13:36.858 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-11T12:13:36.859 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.859 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.859 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-11T12:13:36.859 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.859 INFO:teuthology.orchestra.run.smithi008.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-11T12:13:36.860 INFO:teuthology.orchestra.run.smithi008.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-11T12:13:36.860 INFO:teuthology.orchestra.run.smithi008.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-11T12:13:36.860 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-11T12:13:36.860 INFO:teuthology.orchestra.run.smithi008.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-08-11T12:13:36.861 INFO:teuthology.orchestra.run.smithi008.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-11T12:13:36.861 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-11T12:13:36.861 INFO:teuthology.orchestra.run.smithi008.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-11T12:13:36.861 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-0.3.15-3.el8.x86_64 2023-08-11T12:13:36.861 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-08-11T12:13:36.861 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-08-11T12:13:36.861 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-11T12:13:36.861 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-11T12:13:36.862 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-11T12:13:36.862 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-11T12:13:36.862 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-11T12:13:36.862 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-11T12:13:36.862 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-11T12:13:36.862 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-11T12:13:36.862 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-11T12:13:36.863 INFO:teuthology.orchestra.run.smithi008.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-11T12:13:36.863 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-11T12:13:36.863 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.863 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.863 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.863 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-11T12:13:36.863 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-08-11T12:13:36.863 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-11T12:13:36.864 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-11T12:13:36.864 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-08-11T12:13:36.864 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-11T12:13:36.864 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-11T12:13:36.864 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-11T12:13:36.864 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-11T12:13:36.864 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-11T12:13:36.864 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-11T12:13:36.865 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-11T12:13:36.865 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-11T12:13:36.865 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-11T12:13:36.865 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-11T12:13:36.865 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-11T12:13:36.865 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-11T12:13:36.865 INFO:teuthology.orchestra.run.smithi008.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-11T12:13:36.866 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-11T12:13:36.866 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-11T12:13:36.866 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-11T12:13:36.866 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-11T12:13:36.866 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend-2.6-1.el8.noarch 2023-08-11T12:13:36.866 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-11T12:13:36.866 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-11T12:13:36.866 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-11T12:13:36.867 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-11T12:13:36.867 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-11T12:13:36.867 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-11T12:13:36.867 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.867 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.867 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-11T12:13:36.867 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-11T12:13:36.867 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.868 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-11T12:13:36.868 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-11T12:13:36.868 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-08-11T12:13:36.868 INFO:teuthology.orchestra.run.smithi008.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-11T12:13:36.868 INFO:teuthology.orchestra.run.smithi008.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-11T12:13:36.868 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-11T12:13:36.868 INFO:teuthology.orchestra.run.smithi008.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-11T12:13:36.869 INFO:teuthology.orchestra.run.smithi008.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-11T12:13:36.869 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-11T12:13:36.870 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-11T12:13:36.870 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-11T12:13:36.870 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-11T12:13:36.871 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-11T12:13:36.871 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.871 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.872 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd-2:18.0.0-5437.g92684807.el8.x86_64 2023-08-11T12:13:36.872 INFO:teuthology.orchestra.run.smithi008.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-11T12:13:36.872 INFO:teuthology.orchestra.run.smithi008.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-11T12:13:36.872 INFO:teuthology.orchestra.run.smithi008.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-11T12:13:36.873 INFO:teuthology.orchestra.run.smithi008.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-08-11T12:13:36.873 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-11T12:13:36.874 INFO:teuthology.orchestra.run.smithi008.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-08-11T12:13:36.874 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:13:36.875 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-08-11T12:13:37.168 DEBUG:teuthology.parallel:result is None 2023-08-11T12:13:37.169 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=92684807f016ce045ac66e37fdde6f8c47857bcc 2023-08-11T12:13:37.474 DEBUG:teuthology.orchestra.run.smithi008:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-11T12:13:37.530 INFO:teuthology.orchestra.run.smithi008.stdout:18.0.0-5437.g92684807.el8 2023-08-11T12:13:37.531 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5437.g92684807.el8 2023-08-11T12:13:37.532 INFO:teuthology.task.install:The correct ceph version 18.0.0-5437.g92684807 is installed. 2023-08-11T12:13:37.532 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=92684807f016ce045ac66e37fdde6f8c47857bcc 2023-08-11T12:13:37.689 DEBUG:teuthology.orchestra.run.smithi045:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-11T12:13:37.718 INFO:teuthology.orchestra.run.smithi045.stdout:18.0.0-5437.g92684807.el8 2023-08-11T12:13:37.719 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5437.g92684807.el8 2023-08-11T12:13:37.719 INFO:teuthology.task.install:The correct ceph version 18.0.0-5437.g92684807 is installed. 2023-08-11T12:13:37.720 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=92684807f016ce045ac66e37fdde6f8c47857bcc 2023-08-11T12:13:37.939 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-11T12:13:37.970 INFO:teuthology.orchestra.run.smithi194.stdout:18.0.0-5437.g92684807.el8 2023-08-11T12:13:37.970 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5437.g92684807.el8 2023-08-11T12:13:37.971 INFO:teuthology.task.install:The correct ceph version 18.0.0-5437.g92684807 is installed. 2023-08-11T12:13:37.971 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-08-11T12:13:37.972 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-11T12:13:37.973 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-11T12:13:38.069 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-08-11T12:13:38.069 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-11T12:13:38.120 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-08-11T12:13:38.121 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-11T12:13:38.168 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-08-11T12:13:38.169 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-11T12:13:38.170 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/daemon-helper 2023-08-11T12:13:38.246 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-11T12:13:38.354 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-08-11T12:13:38.355 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/daemon-helper 2023-08-11T12:13:38.388 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-11T12:13:38.460 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-08-11T12:13:38.461 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/daemon-helper 2023-08-11T12:13:38.492 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-11T12:13:38.562 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-08-11T12:13:38.562 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-11T12:13:38.563 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-11T12:13:38.634 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-11T12:13:38.743 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-08-11T12:13:38.744 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-11T12:13:38.778 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-11T12:13:38.853 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-08-11T12:13:38.854 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-11T12:13:38.884 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-11T12:13:38.953 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-08-11T12:13:38.953 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-11T12:13:38.954 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/stdin-killer 2023-08-11T12:13:39.026 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-11T12:13:39.135 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-08-11T12:13:39.135 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/stdin-killer 2023-08-11T12:13:39.168 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-11T12:13:39.241 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-08-11T12:13:39.242 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/stdin-killer 2023-08-11T12:13:39.272 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-11T12:13:39.342 INFO:teuthology.run_tasks:Running task cephadm... 2023-08-11T12:13:39.454 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '92684807f016ce045ac66e37fdde6f8c47857bcc'} 2023-08-11T12:13:39.455 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc 2023-08-11T12:13:39.465 INFO:tasks.cephadm:Cluster fsid is 815f94ae-3840-11ee-9b37-001a4aab830c 2023-08-11T12:13:39.466 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-08-11T12:13:39.466 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.8', 'mon.b': '172.21.15.45', 'mon.c': '172.21.15.194'} 2023-08-11T12:13:39.466 INFO:tasks.cephadm:First mon is mon.a on smithi008 2023-08-11T12:13:39.467 INFO:tasks.cephadm:First mgr is x 2023-08-11T12:13:39.467 INFO:tasks.cephadm:Normalizing hostnames... 2023-08-11T12:13:39.467 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname $(hostname -s) 2023-08-11T12:13:39.540 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname $(hostname -s) 2023-08-11T12:13:39.574 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname $(hostname -s) 2023-08-11T12:13:39.606 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-08-11T12:13:39.606 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=92684807f016ce045ac66e37fdde6f8c47857bcc 2023-08-11T12:13:39.830 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '92684807f016ce045ac66e37fdde6f8c47857bcc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/71982/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-5437-g92684807', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-5437.g92684807'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-b4/92684807f016ce045ac66e37fdde6f8c47857bcc/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-08-10 16:30:02.468413', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-2023Aug1-b4', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-rishabh-2023Aug1-b4/92684807f016ce045ac66e37fdde6f8c47857bcc/centos/8/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2023-08-11T12:13:40.056 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-rishabh-2023Aug1-b4, sha1 92684807f016ce045ac66e37fdde6f8c47857bcc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=92684807f016ce045ac66e37fdde6f8c47857bcc 2023-08-11T12:13:40.057 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-rishabh-2023Aug1-b4/92684807f016ce045ac66e37fdde6f8c47857bcc/centos/8/x86_64/flavors/default/cephadm 2023-08-11T12:13:40.058 DEBUG:teuthology.orchestra.run.smithi008:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-rishabh-2023Aug1-b4/92684807f016ce045ac66e37fdde6f8c47857bcc/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-08-11T12:13:41.248 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-rw-r--. 1 ubuntu ubuntu 698557 Aug 11 12:13 /home/ubuntu/cephtest/cephadm 2023-08-11T12:13:41.248 DEBUG:teuthology.orchestra.run.smithi045:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-rishabh-2023Aug1-b4/92684807f016ce045ac66e37fdde6f8c47857bcc/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-08-11T12:13:41.991 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r--. 1 ubuntu ubuntu 698557 Aug 11 12:13 /home/ubuntu/cephtest/cephadm 2023-08-11T12:13:41.991 DEBUG:teuthology.orchestra.run.smithi194:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-rishabh-2023Aug1-b4/92684807f016ce045ac66e37fdde6f8c47857bcc/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-08-11T12:13:42.408 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-rw-r--. 1 ubuntu ubuntu 698557 Aug 11 12:13 /home/ubuntu/cephtest/cephadm 2023-08-11T12:13:42.408 DEBUG:teuthology.orchestra.run.smithi008:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-08-11T12:13:42.460 DEBUG:teuthology.orchestra.run.smithi045:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-08-11T12:13:42.482 DEBUG:teuthology.orchestra.run.smithi194:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-08-11T12:13:42.525 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc on all hosts... 2023-08-11T12:13:42.526 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc pull 2023-08-11T12:13:42.531 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc pull 2023-08-11T12:13:42.536 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc pull 2023-08-11T12:13:43.752 INFO:teuthology.orchestra.run.smithi194.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc... 2023-08-11T12:13:43.851 INFO:teuthology.orchestra.run.smithi045.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc... 2023-08-11T12:13:45.991 INFO:teuthology.orchestra.run.smithi008.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc... 2023-08-11T12:14:08.628 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2023-08-11T12:14:08.629 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_version": "ceph version 18.0.0-5437-g92684807 (92684807f016ce045ac66e37fdde6f8c47857bcc) reef (dev)", 2023-08-11T12:14:08.629 INFO:teuthology.orchestra.run.smithi194.stdout: "image_id": "a2667c7aa6ee86ee2d3da372adfcb22033620f9a001092468edeacf683f0ad8c", 2023-08-11T12:14:08.629 INFO:teuthology.orchestra.run.smithi194.stdout: "repo_digests": [ 2023-08-11T12:14:08.629 INFO:teuthology.orchestra.run.smithi194.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:75a49d67f8e63bcfe7c72420c0bd76f2f6be8c4f86dd373c0bd2e3def3a2e2f3" 2023-08-11T12:14:08.630 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2023-08-11T12:14:08.630 INFO:teuthology.orchestra.run.smithi194.stdout:} 2023-08-11T12:14:13.340 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-08-11T12:14:13.341 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 18.0.0-5437-g92684807 (92684807f016ce045ac66e37fdde6f8c47857bcc) reef (dev)", 2023-08-11T12:14:13.341 INFO:teuthology.orchestra.run.smithi045.stdout: "image_id": "a2667c7aa6ee86ee2d3da372adfcb22033620f9a001092468edeacf683f0ad8c", 2023-08-11T12:14:13.341 INFO:teuthology.orchestra.run.smithi045.stdout: "repo_digests": [ 2023-08-11T12:14:13.341 INFO:teuthology.orchestra.run.smithi045.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:75a49d67f8e63bcfe7c72420c0bd76f2f6be8c4f86dd373c0bd2e3def3a2e2f3" 2023-08-11T12:14:13.341 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-08-11T12:14:13.342 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-08-11T12:14:17.775 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:14:17.776 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_version": "ceph version 18.0.0-5437-g92684807 (92684807f016ce045ac66e37fdde6f8c47857bcc) reef (dev)", 2023-08-11T12:14:17.776 INFO:teuthology.orchestra.run.smithi008.stdout: "image_id": "a2667c7aa6ee86ee2d3da372adfcb22033620f9a001092468edeacf683f0ad8c", 2023-08-11T12:14:17.776 INFO:teuthology.orchestra.run.smithi008.stdout: "repo_digests": [ 2023-08-11T12:14:17.776 INFO:teuthology.orchestra.run.smithi008.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:75a49d67f8e63bcfe7c72420c0bd76f2f6be8c4f86dd373c0bd2e3def3a2e2f3" 2023-08-11T12:14:17.776 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-11T12:14:17.777 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:14:17.797 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /etc/ceph 2023-08-11T12:14:17.870 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph 2023-08-11T12:14:17.908 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /etc/ceph 2023-08-11T12:14:17.945 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 777 /etc/ceph 2023-08-11T12:14:18.014 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 777 /etc/ceph 2023-08-11T12:14:18.048 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 777 /etc/ceph 2023-08-11T12:14:18.080 INFO:tasks.cephadm:Writing seed config... 2023-08-11T12:14:18.081 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-08-11T12:14:18.081 INFO:tasks.cephadm: override: [client] debug client = 20 2023-08-11T12:14:18.082 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-08-11T12:14:18.082 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-08-11T12:14:18.082 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-08-11T12:14:18.082 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2023-08-11T12:14:18.082 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-08-11T12:14:18.083 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-08-11T12:14:18.083 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-08-11T12:14:18.083 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2023-08-11T12:14:18.083 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2023-08-11T12:14:18.083 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2023-08-11T12:14:18.084 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2023-08-11T12:14:18.084 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-08-11T12:14:18.084 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-08-11T12:14:18.084 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-08-11T12:14:18.085 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-08-11T12:14:18.085 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2023-08-11T12:14:18.085 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-08-11T12:14:18.085 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-08-11T12:14:18.085 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-08-11T12:14:18.085 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-08-11T12:14:18.086 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2023-08-11T12:14:18.086 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-08-11T12:14:18.086 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-08-11T12:14:18.086 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-08-11T12:14:18.086 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-08-11T12:14:18.087 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-08-11T12:14:18.087 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-08-11T12:14:18.087 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-08-11T12:14:18.087 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2023-08-11T12:14:18.087 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-08-11T12:14:18.088 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2023-08-11T12:14:18.088 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2023-08-11T12:14:18.088 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-08-11T12:14:18.088 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-08-11T12:14:18.089 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2023-08-11T12:14:18.089 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-08-11T12:14:18.089 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-08-11T12:14:18.089 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-08-11T12:14:18.089 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-08-11T12:14:18.090 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-08-11T12:14:18.090 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-08-11T12:14:18.090 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-08-11T12:14:18.090 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2023-08-11T12:14:18.091 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-11T12:14:18.091 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-08-11T12:14:18.134 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 815f94ae-3840-11ee-9b37-001a4aab830c ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-08-11T12:14:18.134 DEBUG:teuthology.orchestra.run.smithi008:mon.a> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mon.a.service 2023-08-11T12:14:18.179 DEBUG:teuthology.orchestra.run.smithi008:mgr.x> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mgr.x.service 2023-08-11T12:14:18.224 INFO:tasks.cephadm:Bootstrapping... 2023-08-11T12:14:18.225 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc -v bootstrap --fsid 815f94ae-3840-11ee-9b37-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.8 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-08-11T12:14:18.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:-- Logs begin at Fri 2023-08-11 11:56:28 UTC. -- 2023-08-11T12:14:18.293 INFO:journalctl@ceph.mgr.x.smithi008.stdout:-- Logs begin at Fri 2023-08-11 11:56:28 UTC. -- 2023-08-11T12:14:18.456 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-08-11T12:14:18.456 INFO:teuthology.orchestra.run.smithi008.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc', '-v', 'bootstrap', '--fsid', '815f94ae-3840-11ee-9b37-001a4aab830c', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.8', '--skip-admin-label'] 2023-08-11T12:14:18.631 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stdout 4.1.1 2023-08-11T12:14:18.632 INFO:teuthology.orchestra.run.smithi008.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-08-11T12:14:18.632 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying podman|docker is present... 2023-08-11T12:14:18.803 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stdout 4.1.1 2023-08-11T12:14:18.804 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying lvm2 is present... 2023-08-11T12:14:18.804 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying time synchronization is in place... 2023-08-11T12:14:18.818 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-08-11T12:14:18.818 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-08-11T12:14:18.831 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-08-11T12:14:18.831 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2023-08-11T12:14:18.845 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout enabled 2023-08-11T12:14:18.858 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout active 2023-08-11T12:14:18.858 INFO:teuthology.orchestra.run.smithi008.stdout:Unit chronyd.service is enabled and running 2023-08-11T12:14:18.859 INFO:teuthology.orchestra.run.smithi008.stdout:Repeating the final host check... 2023-08-11T12:14:19.027 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stdout 4.1.1 2023-08-11T12:14:19.028 INFO:teuthology.orchestra.run.smithi008.stdout:podman (/bin/podman) version 4.1.1 is present 2023-08-11T12:14:19.028 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl is present 2023-08-11T12:14:19.028 INFO:teuthology.orchestra.run.smithi008.stdout:lvcreate is present 2023-08-11T12:14:19.041 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-08-11T12:14:19.041 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-08-11T12:14:19.054 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-08-11T12:14:19.054 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2023-08-11T12:14:19.068 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout enabled 2023-08-11T12:14:19.081 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout active 2023-08-11T12:14:19.081 INFO:teuthology.orchestra.run.smithi008.stdout:Unit chronyd.service is enabled and running 2023-08-11T12:14:19.081 INFO:teuthology.orchestra.run.smithi008.stdout:Host looks OK 2023-08-11T12:14:19.081 INFO:teuthology.orchestra.run.smithi008.stdout:Cluster fsid: 815f94ae-3840-11ee-9b37-001a4aab830c 2023-08-11T12:14:19.082 INFO:teuthology.orchestra.run.smithi008.stdout:Acquiring lock 140330501700072 on /run/cephadm/815f94ae-3840-11ee-9b37-001a4aab830c.lock 2023-08-11T12:14:19.082 INFO:teuthology.orchestra.run.smithi008.stdout:Lock 140330501700072 acquired on /run/cephadm/815f94ae-3840-11ee-9b37-001a4aab830c.lock 2023-08-11T12:14:19.082 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying IP 172.21.15.8 port 3300 ... 2023-08-11T12:14:19.082 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying IP 172.21.15.8 port 6789 ... 2023-08-11T12:14:19.083 INFO:teuthology.orchestra.run.smithi008.stdout:Base mon IP(s) is [172.21.15.8:3300, 172.21.15.8:6789], mon addrv is [v2:172.21.15.8:3300,v1:172.21.15.8:6789] 2023-08-11T12:14:19.090 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp metric 100 2023-08-11T12:14:19.090 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.8 metric 100 2023-08-11T12:14:19.097 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-08-11T12:14:19.097 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2023-08-11T12:14:19.097 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1796sec hoplimit 64 pref medium 2023-08-11T12:14:19.103 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-08-11T12:14:19.103 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-08-11T12:14:19.104 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-08-11T12:14:19.104 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2023-08-11T12:14:19.104 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout inet6 fe80::ae1f:6bff:fef8:25fe/64 scope link 2023-08-11T12:14:19.104 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-08-11T12:14:19.105 INFO:teuthology.orchestra.run.smithi008.stdout:Mon IP `172.21.15.8` is in CIDR network `172.21.0.0/20` 2023-08-11T12:14:19.105 INFO:teuthology.orchestra.run.smithi008.stdout:Mon IP `172.21.15.8` is in CIDR network `172.21.0.0/20` 2023-08-11T12:14:19.105 INFO:teuthology.orchestra.run.smithi008.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-08-11T12:14:19.106 INFO:teuthology.orchestra.run.smithi008.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-08-11T12:14:19.106 INFO:teuthology.orchestra.run.smithi008.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc... 2023-08-11T12:14:19.580 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stdout a2667c7aa6ee86ee2d3da372adfcb22033620f9a001092468edeacf683f0ad8c 2023-08-11T12:14:19.580 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc... 2023-08-11T12:14:19.581 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Getting image source signatures 2023-08-11T12:14:19.581 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Copying blob sha256:1466c0ce567d8cab08280e456a5ef839cd0bf60a0cec2e3199abbfddb92a2725 2023-08-11T12:14:19.581 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Copying blob sha256:6022c611d474f2b306ddd1edfc8360123ece5266119096f25fde843d7967e636 2023-08-11T12:14:19.581 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Copying config sha256:a2667c7aa6ee86ee2d3da372adfcb22033620f9a001092468edeacf683f0ad8c 2023-08-11T12:14:19.582 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Writing manifest to image destination 2023-08-11T12:14:19.582 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Storing signatures 2023-08-11T12:14:20.655 INFO:teuthology.orchestra.run.smithi008.stdout:ceph: stdout ceph version 18.0.0-5437-g92684807 (92684807f016ce045ac66e37fdde6f8c47857bcc) reef (dev) 2023-08-11T12:14:20.655 INFO:teuthology.orchestra.run.smithi008.stdout:Ceph version: ceph version 18.0.0-5437-g92684807 (92684807f016ce045ac66e37fdde6f8c47857bcc) reef (dev) 2023-08-11T12:14:20.655 INFO:teuthology.orchestra.run.smithi008.stdout:Extracting ceph user uid/gid from container image... 2023-08-11T12:14:21.529 INFO:teuthology.orchestra.run.smithi008.stdout:stat: stdout 167 167 2023-08-11T12:14:21.529 INFO:teuthology.orchestra.run.smithi008.stdout:Creating initial keys... 2023-08-11T12:14:22.311 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph-authtool: stdout AQAdJtZk0QOzNhAADt0AP44ODlcBOTox6Pkcpw== 2023-08-11T12:14:23.286 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph-authtool: stdout AQAeJtZkvqNTLRAAH6aa7znjqTuakz6dDSBeXw== 2023-08-11T12:14:24.261 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph-authtool: stdout AQAfJtZkRqY/KxAAE+zW4sgsFSiGwR0zRZl/vw== 2023-08-11T12:14:24.262 INFO:teuthology.orchestra.run.smithi008.stdout:Creating initial monmap... 2023-08-11T12:14:25.137 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-08-11T12:14:25.137 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-08-11T12:14:25.137 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 815f94ae-3840-11ee-9b37-001a4aab830c 2023-08-11T12:14:25.138 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-08-11T12:14:25.138 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool for a [v2:172.21.15.8:3300,v1:172.21.15.8:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-08-11T12:14:25.138 INFO:teuthology.orchestra.run.smithi008.stdout:setting min_mon_release = pacific 2023-08-11T12:14:25.138 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: set fsid to 815f94ae-3840-11ee-9b37-001a4aab830c 2023-08-11T12:14:25.138 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-08-11T12:14:25.138 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:14:25.138 INFO:teuthology.orchestra.run.smithi008.stdout:Creating mon... 2023-08-11T12:14:26.017 INFO:teuthology.orchestra.run.smithi008.stdout:create mon.a on 2023-08-11T12:14:26.275 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-08-11T12:14:26.488 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-08-11T12:14:27.000 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-815f94ae-3840-11ee-9b37-001a4aab830c.target → /etc/systemd/system/ceph-815f94ae-3840-11ee-9b37-001a4aab830c.target. 2023-08-11T12:14:27.000 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-815f94ae-3840-11ee-9b37-001a4aab830c.target → /etc/systemd/system/ceph-815f94ae-3840-11ee-9b37-001a4aab830c.target. 2023-08-11T12:14:27.355 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mon.a 2023-08-11T12:14:27.355 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Failed to reset failed state of unit ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mon.a.service: Unit ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mon.a.service not loaded. 2023-08-11T12:14:27.564 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-815f94ae-3840-11ee-9b37-001a4aab830c.target.wants/ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mon.a.service → /etc/systemd/system/ceph-815f94ae-3840-11ee-9b37-001a4aab830c@.service. 2023-08-11T12:14:27.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:27 smithi008 systemd[1]: Starting Ceph mon.a for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:14:28.336 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:28 smithi008 podman[96613]: 2023-08-11T12:14:28.383 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-08-11T12:14:28.383 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout disabled 2023-08-11T12:14:28.400 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-08-11T12:14:28.400 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2023-08-11T12:14:28.400 INFO:teuthology.orchestra.run.smithi008.stdout:firewalld.service is not enabled 2023-08-11T12:14:28.401 INFO:teuthology.orchestra.run.smithi008.stdout:Not possible to enable service . firewalld.service is not available 2023-08-11T12:14:28.401 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mon to start... 2023-08-11T12:14:28.402 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mon... 2023-08-11T12:14:28.694 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:28 smithi008 bash[96613]: da54c4b63c1451dda869e9a2b741f0dbbd73140d4c6cf7cb0f25d206054630af 2023-08-11T12:14:28.694 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:28 smithi008 ceph-mon[96653]: mkfs 815f94ae-3840-11ee-9b37-001a4aab830c 2023-08-11T12:14:28.694 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:28 smithi008 ceph-mon[96653]: mon.a is new leader, mons a in quorum (ranks 0) 2023-08-11T12:14:28.694 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:28 smithi008 systemd[1]: Started Ceph mon.a for 815f94ae-3840-11ee-9b37-001a4aab830c. 2023-08-11T12:14:29.483 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout cluster: 2023-08-11T12:14:29.483 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout id: 815f94ae-3840-11ee-9b37-001a4aab830c 2023-08-11T12:14:29.483 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-08-11T12:14:29.484 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-08-11T12:14:29.484 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout services: 2023-08-11T12:14:29.484 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.722987s) 2023-08-11T12:14:29.484 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-08-11T12:14:29.484 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-08-11T12:14:29.485 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-08-11T12:14:29.485 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout data: 2023-08-11T12:14:29.486 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-08-11T12:14:29.486 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-08-11T12:14:29.486 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-08-11T12:14:29.486 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout pgs: 2023-08-11T12:14:29.486 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-08-11T12:14:29.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.975+0000 7f4d9a275700 1 Processor -- start 2023-08-11T12:14:29.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.976+0000 7f4d9a275700 1 -- start start 2023-08-11T12:14:29.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.976+0000 7f4d9a275700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d9407be30 0x7f4d9407a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:14:29.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.976+0000 7f4d9a275700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9407a860 con 0x7f4d9407be30 2023-08-11T12:14:29.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.977+0000 7f4d93fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d9407be30 0x7f4d9407a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:14:29.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.977+0000 7f4d93fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d9407be30 0x7f4d9407a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35362/0 (socket says 172.21.15.8:35362) 2023-08-11T12:14:29.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.977+0000 7f4d93fff700 1 -- 172.21.15.8:0/2103273045 learned_addr learned my addr 172.21.15.8:0/2103273045 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:14:29.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.977+0000 7f4d93fff700 1 -- 172.21.15.8:0/2103273045 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9407a9a0 con 0x7f4d9407be30 2023-08-11T12:14:29.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.977+0000 7f4d93fff700 1 --2- 172.21.15.8:0/2103273045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d9407be30 0x7f4d9407a290 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4d840098a0 tx=0x7f4d84009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f9b1b30a1c1683e server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:14:29.492 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.978+0000 7f4d92ffd700 1 -- 172.21.15.8:0/2103273045 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4d84004160 con 0x7f4d9407be30 2023-08-11T12:14:29.492 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.978+0000 7f4d92ffd700 1 -- 172.21.15.8:0/2103273045 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d840042c0 con 0x7f4d9407be30 2023-08-11T12:14:29.492 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.978+0000 7f4d92ffd700 1 -- 172.21.15.8:0/2103273045 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4d840045a0 con 0x7f4d9407be30 2023-08-11T12:14:29.492 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.978+0000 7f4d9a275700 1 -- 172.21.15.8:0/2103273045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d9407be30 msgr2=0x7f4d9407a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:14:29.492 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.978+0000 7f4d9a275700 1 --2- 172.21.15.8:0/2103273045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d9407be30 0x7f4d9407a290 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4d840098a0 tx=0x7f4d84009bb0 comp rx=0 tx=0).stop 2023-08-11T12:14:29.493 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.978+0000 7f4d9a275700 1 -- 172.21.15.8:0/2103273045 shutdown_connections 2023-08-11T12:14:29.493 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.978+0000 7f4d9a275700 1 --2- 172.21.15.8:0/2103273045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d9407be30 0x7f4d9407a290 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:14:29.493 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.978+0000 7f4d9a275700 1 -- 172.21.15.8:0/2103273045 >> 172.21.15.8:0/2103273045 conn(0x7f4d94101750 msgr2=0x7f4d94103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:14:29.493 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.978+0000 7f4d9a275700 1 -- 172.21.15.8:0/2103273045 shutdown_connections 2023-08-11T12:14:29.493 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.979+0000 7f4d9a275700 1 -- 172.21.15.8:0/2103273045 wait complete. 2023-08-11T12:14:29.493 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.980+0000 7f4d9a275700 1 Processor -- start 2023-08-11T12:14:29.493 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.980+0000 7f4d9a275700 1 -- start start 2023-08-11T12:14:29.494 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.980+0000 7f4d9a275700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d9407be30 0x7f4d9419b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:14:29.494 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.980+0000 7f4d9a275700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9419bdc0 con 0x7f4d9407be30 2023-08-11T12:14:29.494 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.980+0000 7f4d93fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d9407be30 0x7f4d9419b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:14:29.494 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.980+0000 7f4d93fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d9407be30 0x7f4d9419b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35366/0 (socket says 172.21.15.8:35366) 2023-08-11T12:14:29.494 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.980+0000 7f4d93fff700 1 -- 172.21.15.8:0/1820403574 learned_addr learned my addr 172.21.15.8:0/1820403574 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:14:29.494 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.981+0000 7f4d93fff700 1 -- 172.21.15.8:0/1820403574 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d84009550 con 0x7f4d9407be30 2023-08-11T12:14:29.495 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.981+0000 7f4d93fff700 1 --2- 172.21.15.8:0/1820403574 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d9407be30 0x7f4d9419b880 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4d84004000 tx=0x7f4d84004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:14:29.495 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.981+0000 7f4d917fa700 1 -- 172.21.15.8:0/1820403574 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4d84011630 con 0x7f4d9407be30 2023-08-11T12:14:29.495 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.981+0000 7f4d917fa700 1 -- 172.21.15.8:0/1820403574 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d84011790 con 0x7f4d9407be30 2023-08-11T12:14:29.495 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.981+0000 7f4d9a275700 1 -- 172.21.15.8:0/1820403574 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d9419bfc0 con 0x7f4d9407be30 2023-08-11T12:14:29.495 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.981+0000 7f4d917fa700 1 -- 172.21.15.8:0/1820403574 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4d84011a30 con 0x7f4d9407be30 2023-08-11T12:14:29.496 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.981+0000 7f4d9a275700 1 -- 172.21.15.8:0/1820403574 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d9419c3e0 con 0x7f4d9407be30 2023-08-11T12:14:29.496 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.981+0000 7f4d917fa700 1 -- 172.21.15.8:0/1820403574 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4d84022070 con 0x7f4d9407be30 2023-08-11T12:14:29.496 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.982+0000 7f4d917fa700 1 -- 172.21.15.8:0/1820403574 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f4d8401c450 con 0x7f4d9407be30 2023-08-11T12:14:29.496 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.982+0000 7f4d9a275700 1 -- 172.21.15.8:0/1820403574 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d941956e0 con 0x7f4d9407be30 2023-08-11T12:14:29.496 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:28.985+0000 7f4d917fa700 1 -- 172.21.15.8:0/1820403574 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f4d8401b450 con 0x7f4d9407be30 2023-08-11T12:14:29.496 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.062+0000 7f4d9a275700 1 -- 172.21.15.8:0/1820403574 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f4d9402cc10 con 0x7f4d9407be30 2023-08-11T12:14:29.497 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.062+0000 7f4d917fa700 1 -- 172.21.15.8:0/1820403574 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f4d8401b5f0 con 0x7f4d9407be30 2023-08-11T12:14:29.497 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.063+0000 7f4d9a275700 1 -- 172.21.15.8:0/1820403574 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d9407be30 msgr2=0x7f4d9419b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:14:29.497 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.063+0000 7f4d9a275700 1 --2- 172.21.15.8:0/1820403574 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d9407be30 0x7f4d9419b880 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4d84004000 tx=0x7f4d84004750 comp rx=0 tx=0).stop 2023-08-11T12:14:29.497 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.063+0000 7f4d9a275700 1 -- 172.21.15.8:0/1820403574 shutdown_connections 2023-08-11T12:14:29.497 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.063+0000 7f4d9a275700 1 --2- 172.21.15.8:0/1820403574 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d9407be30 0x7f4d9419b880 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:14:29.497 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.063+0000 7f4d9a275700 1 -- 172.21.15.8:0/1820403574 >> 172.21.15.8:0/1820403574 conn(0x7f4d94101750 msgr2=0x7f4d94103140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:14:29.497 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.063+0000 7f4d9a275700 1 -- 172.21.15.8:0/1820403574 shutdown_connections 2023-08-11T12:14:29.498 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.063+0000 7f4d9a275700 1 -- 172.21.15.8:0/1820403574 wait complete. 2023-08-11T12:14:29.498 INFO:teuthology.orchestra.run.smithi008.stdout:mon is available 2023-08-11T12:14:29.498 INFO:teuthology.orchestra.run.smithi008.stdout:Assimilating anything we can from ceph.conf... 2023-08-11T12:14:29.729 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:29 smithi008 ceph-mon[96653]: mon.a is new leader, mons a in quorum (ranks 0) 2023-08-11T12:14:29.730 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:29 smithi008 ceph-mon[96653]: monmap e1: 1 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0]} removed_ranks: {} 2023-08-11T12:14:29.730 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:29 smithi008 ceph-mon[96653]: fsmap 2023-08-11T12:14:29.730 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:29 smithi008 ceph-mon[96653]: osdmap e1: 0 total, 0 up, 0 in 2023-08-11T12:14:29.731 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:29 smithi008 ceph-mon[96653]: mgrmap e1: no daemons active 2023-08-11T12:14:29.731 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:29 smithi008 ceph-mon[96653]: from='client.? 172.21.15.8:0/1820403574' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-08-11T12:14:30.468 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-08-11T12:14:30.468 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [global] 2023-08-11T12:14:30.469 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout fsid = 815f94ae-3840-11ee-9b37-001a4aab830c 2023-08-11T12:14:30.469 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.8:3300,v1:172.21.15.8:6789] 2023-08-11T12:14:30.469 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-08-11T12:14:30.469 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-08-11T12:14:30.469 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-08-11T12:14:30.470 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-08-11T12:14:30.470 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-08-11T12:14:30.470 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [mgr] 2023-08-11T12:14:30.470 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-08-11T12:14:30.470 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-08-11T12:14:30.471 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [osd] 2023-08-11T12:14:30.471 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-08-11T12:14:30.471 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-08-11T12:14:30.471 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-08-11T12:14:30.471 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-08-11T12:14:30.471 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-08-11T12:14:30.471 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.980+0000 7f56f77c5700 1 Processor -- start 2023-08-11T12:14:30.472 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.980+0000 7f56f77c5700 1 -- start start 2023-08-11T12:14:30.472 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.981+0000 7f56f77c5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56f007be10 0x7f56f007a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:14:30.472 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.981+0000 7f56f77c5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f007a840 con 0x7f56f007be10 2023-08-11T12:14:30.472 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.982+0000 7f56f5561700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56f007be10 0x7f56f007a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:14:30.472 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.982+0000 7f56f5561700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56f007be10 0x7f56f007a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35374/0 (socket says 172.21.15.8:35374) 2023-08-11T12:14:30.472 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.982+0000 7f56f5561700 1 -- 172.21.15.8:0/2548208995 learned_addr learned my addr 172.21.15.8:0/2548208995 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:14:30.473 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.982+0000 7f56f5561700 1 -- 172.21.15.8:0/2548208995 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f007a980 con 0x7f56f007be10 2023-08-11T12:14:30.473 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.982+0000 7f56f5561700 1 --2- 172.21.15.8:0/2548208995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56f007be10 0x7f56f007a270 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0098a0 tx=0x7f56ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644f5ff59d0e0c9a server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:14:30.473 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.983+0000 7f56e7fff700 1 -- 172.21.15.8:0/2548208995 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56ec004160 con 0x7f56f007be10 2023-08-11T12:14:30.473 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.983+0000 7f56e7fff700 1 -- 172.21.15.8:0/2548208995 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ec0042c0 con 0x7f56f007be10 2023-08-11T12:14:30.473 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.983+0000 7f56e7fff700 1 -- 172.21.15.8:0/2548208995 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56ec0045a0 con 0x7f56f007be10 2023-08-11T12:14:30.473 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.983+0000 7f56f77c5700 1 -- 172.21.15.8:0/2548208995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56f007be10 msgr2=0x7f56f007a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:14:30.473 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.983+0000 7f56f77c5700 1 --2- 172.21.15.8:0/2548208995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56f007be10 0x7f56f007a270 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0098a0 tx=0x7f56ec009bb0 comp rx=0 tx=0).stop 2023-08-11T12:14:30.474 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.983+0000 7f56f77c5700 1 -- 172.21.15.8:0/2548208995 shutdown_connections 2023-08-11T12:14:30.474 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.983+0000 7f56f77c5700 1 --2- 172.21.15.8:0/2548208995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56f007be10 0x7f56f007a270 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:14:30.474 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.983+0000 7f56f77c5700 1 -- 172.21.15.8:0/2548208995 >> 172.21.15.8:0/2548208995 conn(0x7f56f0101750 msgr2=0x7f56f0103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:14:30.474 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.983+0000 7f56f77c5700 1 -- 172.21.15.8:0/2548208995 shutdown_connections 2023-08-11T12:14:30.474 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.984+0000 7f56f77c5700 1 -- 172.21.15.8:0/2548208995 wait complete. 2023-08-11T12:14:30.474 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.984+0000 7f56f77c5700 1 Processor -- start 2023-08-11T12:14:30.474 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.985+0000 7f56f77c5700 1 -- start start 2023-08-11T12:14:30.475 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.985+0000 7f56f77c5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56f007be10 0x7f56f019b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:14:30.475 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.985+0000 7f56f77c5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f019bdc0 con 0x7f56f007be10 2023-08-11T12:14:30.475 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.985+0000 7f56f5561700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56f007be10 0x7f56f019b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:14:30.475 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.985+0000 7f56f5561700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56f007be10 0x7f56f019b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35382/0 (socket says 172.21.15.8:35382) 2023-08-11T12:14:30.475 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.985+0000 7f56f5561700 1 -- 172.21.15.8:0/3478908371 learned_addr learned my addr 172.21.15.8:0/3478908371 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:14:30.475 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.986+0000 7f56f5561700 1 -- 172.21.15.8:0/3478908371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ec009550 con 0x7f56f007be10 2023-08-11T12:14:30.475 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.986+0000 7f56f5561700 1 --2- 172.21.15.8:0/3478908371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56f007be10 0x7f56f019b880 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f56f007b2e0 tx=0x7f56ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:14:30.476 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.986+0000 7f56e67fc700 1 -- 172.21.15.8:0/3478908371 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56ec011630 con 0x7f56f007be10 2023-08-11T12:14:30.476 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.986+0000 7f56e67fc700 1 -- 172.21.15.8:0/3478908371 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ec011790 con 0x7f56f007be10 2023-08-11T12:14:30.476 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.986+0000 7f56f77c5700 1 -- 172.21.15.8:0/3478908371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f019bfc0 con 0x7f56f007be10 2023-08-11T12:14:30.476 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.986+0000 7f56e67fc700 1 -- 172.21.15.8:0/3478908371 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56ec011a30 con 0x7f56f007be10 2023-08-11T12:14:30.477 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.986+0000 7f56f77c5700 1 -- 172.21.15.8:0/3478908371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f019c3e0 con 0x7f56f007be10 2023-08-11T12:14:30.477 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.986+0000 7f56e67fc700 1 -- 172.21.15.8:0/3478908371 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f56ec022070 con 0x7f56f007be10 2023-08-11T12:14:30.477 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.987+0000 7f56e67fc700 1 -- 172.21.15.8:0/3478908371 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f56ec01c450 con 0x7f56f007be10 2023-08-11T12:14:30.477 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.987+0000 7f56f77c5700 1 -- 172.21.15.8:0/3478908371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f0195790 con 0x7f56f007be10 2023-08-11T12:14:30.477 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:29.990+0000 7f56e67fc700 1 -- 172.21.15.8:0/3478908371 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f56ec01b450 con 0x7f56f007be10 2023-08-11T12:14:30.477 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.063+0000 7f56f77c5700 1 -- 172.21.15.8:0/3478908371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f56f007af20 con 0x7f56f007be10 2023-08-11T12:14:30.477 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.068+0000 7f56e67fc700 1 -- 172.21.15.8:0/3478908371 <== mon.0 v2:172.21.15.8:3300/0 7 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f56ec01b5f0 con 0x7f56f007be10 2023-08-11T12:14:30.478 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.068+0000 7f56e67fc700 1 -- 172.21.15.8:0/3478908371 <== mon.0 v2:172.21.15.8:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+427 (secure 0 0 0) 0x7f56ec037610 con 0x7f56f007be10 2023-08-11T12:14:30.478 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.069+0000 7f56f77c5700 1 -- 172.21.15.8:0/3478908371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56f007be10 msgr2=0x7f56f019b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:14:30.478 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.069+0000 7f56f77c5700 1 --2- 172.21.15.8:0/3478908371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56f007be10 0x7f56f019b880 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f56f007b2e0 tx=0x7f56ec004750 comp rx=0 tx=0).stop 2023-08-11T12:14:30.478 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.069+0000 7f56f77c5700 1 -- 172.21.15.8:0/3478908371 shutdown_connections 2023-08-11T12:14:30.478 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.069+0000 7f56f77c5700 1 --2- 172.21.15.8:0/3478908371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56f007be10 0x7f56f019b880 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:14:30.478 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.069+0000 7f56f77c5700 1 -- 172.21.15.8:0/3478908371 >> 172.21.15.8:0/3478908371 conn(0x7f56f0101750 msgr2=0x7f56f01030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:14:30.478 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.069+0000 7f56f77c5700 1 -- 172.21.15.8:0/3478908371 shutdown_connections 2023-08-11T12:14:30.479 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.069+0000 7f56f77c5700 1 -- 172.21.15.8:0/3478908371 wait complete. 2023-08-11T12:14:30.479 INFO:teuthology.orchestra.run.smithi008.stdout:Generating new minimal ceph.conf... 2023-08-11T12:14:30.723 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:30 smithi008 ceph-mon[96653]: from='client.? 172.21.15.8:0/3478908371' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-08-11T12:14:30.723 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:30 smithi008 ceph-mon[96653]: from='client.? 172.21.15.8:0/3478908371' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-08-11T12:14:31.550 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.989+0000 7f2f592e1700 1 Processor -- start 2023-08-11T12:14:31.550 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.989+0000 7f2f592e1700 1 -- start start 2023-08-11T12:14:31.550 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.990+0000 7f2f592e1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f5407be10 0x7f2f5407a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:14:31.550 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.990+0000 7f2f592e1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5407a840 con 0x7f2f5407be10 2023-08-11T12:14:31.550 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.990+0000 7f2f52ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f5407be10 0x7f2f5407a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:14:31.551 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.990+0000 7f2f52ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f5407be10 0x7f2f5407a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35396/0 (socket says 172.21.15.8:35396) 2023-08-11T12:14:31.551 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.990+0000 7f2f52ffd700 1 -- 172.21.15.8:0/3020251583 learned_addr learned my addr 172.21.15.8:0/3020251583 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:14:31.551 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.990+0000 7f2f52ffd700 1 -- 172.21.15.8:0/3020251583 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5407a980 con 0x7f2f5407be10 2023-08-11T12:14:31.551 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.991+0000 7f2f52ffd700 1 --2- 172.21.15.8:0/3020251583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f5407be10 0x7f2f5407a270 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2f440098a0 tx=0x7f2f44009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bdaaf98f5126b73 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:14:31.551 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.991+0000 7f2f51ffb700 1 -- 172.21.15.8:0/3020251583 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f44004160 con 0x7f2f5407be10 2023-08-11T12:14:31.551 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.991+0000 7f2f51ffb700 1 -- 172.21.15.8:0/3020251583 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2f440042c0 con 0x7f2f5407be10 2023-08-11T12:14:31.552 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.991+0000 7f2f51ffb700 1 -- 172.21.15.8:0/3020251583 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f44011a00 con 0x7f2f5407be10 2023-08-11T12:14:31.552 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.991+0000 7f2f592e1700 1 -- 172.21.15.8:0/3020251583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f5407be10 msgr2=0x7f2f5407a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:14:31.552 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.991+0000 7f2f592e1700 1 --2- 172.21.15.8:0/3020251583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f5407be10 0x7f2f5407a270 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2f440098a0 tx=0x7f2f44009bb0 comp rx=0 tx=0).stop 2023-08-11T12:14:31.552 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.992+0000 7f2f592e1700 1 -- 172.21.15.8:0/3020251583 shutdown_connections 2023-08-11T12:14:31.552 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.992+0000 7f2f592e1700 1 --2- 172.21.15.8:0/3020251583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f5407be10 0x7f2f5407a270 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:14:31.552 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.992+0000 7f2f592e1700 1 -- 172.21.15.8:0/3020251583 >> 172.21.15.8:0/3020251583 conn(0x7f2f54101750 msgr2=0x7f2f54103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:14:31.552 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.992+0000 7f2f592e1700 1 -- 172.21.15.8:0/3020251583 shutdown_connections 2023-08-11T12:14:31.552 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.992+0000 7f2f592e1700 1 -- 172.21.15.8:0/3020251583 wait complete. 2023-08-11T12:14:31.553 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.993+0000 7f2f592e1700 1 Processor -- start 2023-08-11T12:14:31.553 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.993+0000 7f2f592e1700 1 -- start start 2023-08-11T12:14:31.553 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.993+0000 7f2f592e1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f5407be10 0x7f2f5419c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:14:31.553 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.993+0000 7f2f592e1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5419c580 con 0x7f2f5407be10 2023-08-11T12:14:31.553 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.993+0000 7f2f52ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f5407be10 0x7f2f5419c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:14:31.553 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.993+0000 7f2f52ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f5407be10 0x7f2f5419c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35404/0 (socket says 172.21.15.8:35404) 2023-08-11T12:14:31.553 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.994+0000 7f2f52ffd700 1 -- 172.21.15.8:0/4233900376 learned_addr learned my addr 172.21.15.8:0/4233900376 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:14:31.554 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.994+0000 7f2f52ffd700 1 -- 172.21.15.8:0/4233900376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f44009550 con 0x7f2f5407be10 2023-08-11T12:14:31.554 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.994+0000 7f2f52ffd700 1 --2- 172.21.15.8:0/4233900376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f5407be10 0x7f2f5419c040 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2f44006af0 tx=0x7f2f44011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:14:31.554 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.994+0000 7f2f3bfff700 1 -- 172.21.15.8:0/4233900376 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f44003a40 con 0x7f2f5407be10 2023-08-11T12:14:31.554 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.994+0000 7f2f592e1700 1 -- 172.21.15.8:0/4233900376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f5419c780 con 0x7f2f5407be10 2023-08-11T12:14:31.554 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.994+0000 7f2f3bfff700 1 -- 172.21.15.8:0/4233900376 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2f44003ba0 con 0x7f2f5407be10 2023-08-11T12:14:31.554 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.994+0000 7f2f3bfff700 1 -- 172.21.15.8:0/4233900376 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f4401a6e0 con 0x7f2f5407be10 2023-08-11T12:14:31.554 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.994+0000 7f2f592e1700 1 -- 172.21.15.8:0/4233900376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5419cba0 con 0x7f2f5407be10 2023-08-11T12:14:31.554 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.995+0000 7f2f3bfff700 1 -- 172.21.15.8:0/4233900376 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2f4401ac50 con 0x7f2f5407be10 2023-08-11T12:14:31.555 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.995+0000 7f2f3bfff700 1 -- 172.21.15.8:0/4233900376 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2f44019700 con 0x7f2f5407be10 2023-08-11T12:14:31.555 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.996+0000 7f2f592e1700 1 -- 172.21.15.8:0/4233900376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f54061f50 con 0x7f2f5407be10 2023-08-11T12:14:31.555 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:30.998+0000 7f2f3bfff700 1 -- 172.21.15.8:0/4233900376 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f2f4402de30 con 0x7f2f5407be10 2023-08-11T12:14:31.555 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:31.072+0000 7f2f592e1700 1 -- 172.21.15.8:0/4233900376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f2f5410c7c0 con 0x7f2f5407be10 2023-08-11T12:14:31.555 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:31.072+0000 7f2f3bfff700 1 -- 172.21.15.8:0/4233900376 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+173 (secure 0 0 0) 0x7f2f44024a60 con 0x7f2f5407be10 2023-08-11T12:14:31.555 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:31.073+0000 7f2f592e1700 1 -- 172.21.15.8:0/4233900376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f5407be10 msgr2=0x7f2f5419c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:14:31.555 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:31.073+0000 7f2f592e1700 1 --2- 172.21.15.8:0/4233900376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f5407be10 0x7f2f5419c040 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2f44006af0 tx=0x7f2f44011ad0 comp rx=0 tx=0).stop 2023-08-11T12:14:31.556 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:31.073+0000 7f2f592e1700 1 -- 172.21.15.8:0/4233900376 shutdown_connections 2023-08-11T12:14:31.556 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:31.073+0000 7f2f592e1700 1 --2- 172.21.15.8:0/4233900376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f5407be10 0x7f2f5419c040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:14:31.556 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:31.073+0000 7f2f592e1700 1 -- 172.21.15.8:0/4233900376 >> 172.21.15.8:0/4233900376 conn(0x7f2f54101750 msgr2=0x7f2f54102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:14:31.556 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:31.074+0000 7f2f592e1700 1 -- 172.21.15.8:0/4233900376 shutdown_connections 2023-08-11T12:14:31.556 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:31.074+0000 7f2f592e1700 1 -- 172.21.15.8:0/4233900376 wait complete. 2023-08-11T12:14:31.556 INFO:teuthology.orchestra.run.smithi008.stdout:Restarting the monitor... 2023-08-11T12:14:31.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:31 smithi008 ceph-mon[96653]: from='client.? 172.21.15.8:0/4233900376' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:14:31.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:31 smithi008 systemd[1]: Stopping Ceph mon.a for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:14:33.280 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:33 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mon-a[96629]: 2023-08-11T12:14:33.027+0000 7f0fd1cd7700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:14:33.280 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:33 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mon-a[96629]: 2023-08-11T12:14:33.027+0000 7f0fd1cd7700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-08-11T12:14:33.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:33 smithi008 bash[96989]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mon-a 2023-08-11T12:14:34.289 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:33 smithi008 systemd[1]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mon.a.service: Succeeded. 2023-08-11T12:14:34.289 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:33 smithi008 systemd[1]: Stopped Ceph mon.a for 815f94ae-3840-11ee-9b37-001a4aab830c. 2023-08-11T12:14:34.289 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:33 smithi008 systemd[1]: Starting Ceph mon.a for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:14:34.533 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 podman[97118]: 2023-08-11T12:14:34.533 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: set uid:gid to 167:167 (ceph:ceph) 2023-08-11T12:14:34.542 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: ceph version 18.0.0-5437-g92684807 (92684807f016ce045ac66e37fdde6f8c47857bcc) reef (dev), process ceph-mon, pid 7 2023-08-11T12:14:34.542 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: pidfile_write: ignore empty --pid-file 2023-08-11T12:14:34.580 INFO:teuthology.orchestra.run.smithi008.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2023-08-11T12:14:34.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: load: jerasure load: lrc 2023-08-11T12:14:34.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: RocksDB version: 7.9.2 2023-08-11T12:14:34.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Git sha 0 2023-08-11T12:14:34.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Compile date 2023-08-10 15:31:53 2023-08-11T12:14:34.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: DB SUMMARY 2023-08-11T12:14:34.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: DB Session ID: RHUG9H9QAJCUS20BDQ50 2023-08-11T12:14:34.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: CURRENT file: CURRENT 2023-08-11T12:14:34.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: IDENTITY file: IDENTITY 2023-08-11T12:14:34.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-08-11T12:14:34.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-08-11T12:14:34.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 99311 ; 2023-08-11T12:14:34.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.error_if_exists: 0 2023-08-11T12:14:34.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.create_if_missing: 0 2023-08-11T12:14:34.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.paranoid_checks: 1 2023-08-11T12:14:34.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.flush_verify_memtable_count: 1 2023-08-11T12:14:34.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-08-11T12:14:34.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-08-11T12:14:34.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.env: 0x56385cdaeda0 2023-08-11T12:14:34.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.fs: PosixFileSystem 2023-08-11T12:14:34.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.info_log: 0x56385e5f7460 2023-08-11T12:14:34.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.max_file_opening_threads: 16 2023-08-11T12:14:34.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.statistics: (nil) 2023-08-11T12:14:34.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.use_fsync: 0 2023-08-11T12:14:34.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.max_log_file_size: 0 2023-08-11T12:14:34.808 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-08-11T12:14:34.808 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.log_file_time_to_roll: 0 2023-08-11T12:14:34.808 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.keep_log_file_num: 1000 2023-08-11T12:14:34.808 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.recycle_log_file_num: 0 2023-08-11T12:14:34.808 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.allow_fallocate: 1 2023-08-11T12:14:34.808 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.allow_mmap_reads: 0 2023-08-11T12:14:34.809 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.allow_mmap_writes: 0 2023-08-11T12:14:34.809 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.use_direct_reads: 0 2023-08-11T12:14:34.809 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-08-11T12:14:34.809 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.create_missing_column_families: 0 2023-08-11T12:14:34.809 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.db_log_dir: 2023-08-11T12:14:34.809 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.wal_dir: 2023-08-11T12:14:34.810 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.table_cache_numshardbits: 6 2023-08-11T12:14:34.810 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.WAL_ttl_seconds: 0 2023-08-11T12:14:34.810 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.WAL_size_limit_MB: 0 2023-08-11T12:14:34.810 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-08-11T12:14:34.810 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-08-11T12:14:34.810 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.is_fd_close_on_exec: 1 2023-08-11T12:14:34.810 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.advise_random_on_open: 1 2023-08-11T12:14:34.811 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.db_write_buffer_size: 0 2023-08-11T12:14:34.811 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.write_buffer_manager: 0x56385e5b03c0 2023-08-11T12:14:34.811 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-08-11T12:14:34.811 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-08-11T12:14:34.811 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.use_adaptive_mutex: 0 2023-08-11T12:14:34.812 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.rate_limiter: (nil) 2023-08-11T12:14:34.812 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-08-11T12:14:34.812 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.wal_recovery_mode: 2 2023-08-11T12:14:34.812 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.enable_thread_tracking: 0 2023-08-11T12:14:34.813 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.enable_pipelined_write: 0 2023-08-11T12:14:34.813 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.unordered_write: 0 2023-08-11T12:14:34.813 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-08-11T12:14:34.814 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-08-11T12:14:34.815 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-08-11T12:14:34.815 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-08-11T12:14:34.815 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.row_cache: None 2023-08-11T12:14:34.816 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.wal_filter: None 2023-08-11T12:14:34.816 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-08-11T12:14:34.817 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.allow_ingest_behind: 0 2023-08-11T12:14:34.817 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.two_write_queues: 0 2023-08-11T12:14:34.817 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.manual_wal_flush: 0 2023-08-11T12:14:34.818 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.wal_compression: 0 2023-08-11T12:14:34.819 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.atomic_flush: 0 2023-08-11T12:14:34.819 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-08-11T12:14:34.819 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.persist_stats_to_disk: 0 2023-08-11T12:14:34.819 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.write_dbid_to_manifest: 0 2023-08-11T12:14:34.819 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.log_readahead_size: 0 2023-08-11T12:14:34.820 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-08-11T12:14:34.820 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.best_efforts_recovery: 0 2023-08-11T12:14:34.820 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-08-11T12:14:34.820 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-08-11T12:14:34.820 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.allow_data_in_errors: 0 2023-08-11T12:14:34.820 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.db_host_id: __hostname__ 2023-08-11T12:14:34.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.enforce_single_del_contracts: true 2023-08-11T12:14:34.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.max_background_jobs: 2 2023-08-11T12:14:34.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.max_background_compactions: -1 2023-08-11T12:14:34.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.max_subcompactions: 1 2023-08-11T12:14:34.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-08-11T12:14:34.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-08-11T12:14:34.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.delayed_write_rate : 16777216 2023-08-11T12:14:34.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.max_total_wal_size: 0 2023-08-11T12:14:34.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-08-11T12:14:34.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 bash[97118]: 312f2c098cf7d5a10396ec51b1caa35959782bea8f692dabf714eadb4b111f89 2023-08-11T12:14:34.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.stats_dump_period_sec: 600 2023-08-11T12:14:34.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.stats_persist_period_sec: 600 2023-08-11T12:14:34.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-08-11T12:14:34.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.max_open_files: -1 2023-08-11T12:14:34.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.bytes_per_sync: 0 2023-08-11T12:14:34.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.wal_bytes_per_sync: 0 2023-08-11T12:14:34.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.strict_bytes_per_sync: 0 2023-08-11T12:14:34.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.compaction_readahead_size: 0 2023-08-11T12:14:34.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.max_background_flushes: -1 2023-08-11T12:14:34.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Compression algorithms supported: 2023-08-11T12:14:34.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-08-11T12:14:34.824 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: kZSTD supported: 0 2023-08-11T12:14:34.824 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: kXpressCompression supported: 0 2023-08-11T12:14:34.824 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: kLZ4HCCompression supported: 1 2023-08-11T12:14:34.824 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: kZlibCompression supported: 1 2023-08-11T12:14:34.824 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: kSnappyCompression supported: 1 2023-08-11T12:14:34.824 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: kLZ4Compression supported: 1 2023-08-11T12:14:34.824 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: kBZip2Compression supported: 0 2023-08-11T12:14:34.825 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Fast CRC32 supported: Supported on x86 2023-08-11T12:14:34.825 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: DMutex implementation: pthread_mutex_t 2023-08-11T12:14:34.825 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-08-11T12:14:34.825 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-08-11T12:14:34.825 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-08-11T12:14:34.825 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.merge_operator: 2023-08-11T12:14:34.825 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.compaction_filter: None 2023-08-11T12:14:34.826 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.compaction_filter_factory: None 2023-08-11T12:14:34.826 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.sst_partitioner_factory: None 2023-08-11T12:14:34.826 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.memtable_factory: SkipListFactory 2023-08-11T12:14:34.826 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.table_factory: BlockBasedTable 2023-08-11T12:14:34.826 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56385e5f7560) 2023-08-11T12:14:34.826 INFO:journalctl@ceph.mon.a.smithi008.stdout: cache_index_and_filter_blocks: 1 2023-08-11T12:14:34.826 INFO:journalctl@ceph.mon.a.smithi008.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-08-11T12:14:34.827 INFO:journalctl@ceph.mon.a.smithi008.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-08-11T12:14:34.827 INFO:journalctl@ceph.mon.a.smithi008.stdout: pin_top_level_index_and_filter: 1 2023-08-11T12:14:34.827 INFO:journalctl@ceph.mon.a.smithi008.stdout: index_type: 0 2023-08-11T12:14:34.827 INFO:journalctl@ceph.mon.a.smithi008.stdout: data_block_index_type: 0 2023-08-11T12:14:34.827 INFO:journalctl@ceph.mon.a.smithi008.stdout: index_shortening: 1 2023-08-11T12:14:34.827 INFO:journalctl@ceph.mon.a.smithi008.stdout: data_block_hash_table_util_ratio: 0.750000 2023-08-11T12:14:34.827 INFO:journalctl@ceph.mon.a.smithi008.stdout: checksum: 4 2023-08-11T12:14:34.828 INFO:journalctl@ceph.mon.a.smithi008.stdout: no_block_cache: 0 2023-08-11T12:14:34.828 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_cache: 0x56385e64f1f0 2023-08-11T12:14:34.828 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_cache_name: BinnedLRUCache 2023-08-11T12:14:34.828 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_cache_options: 2023-08-11T12:14:34.828 INFO:journalctl@ceph.mon.a.smithi008.stdout: capacity : 536870912 2023-08-11T12:14:34.828 INFO:journalctl@ceph.mon.a.smithi008.stdout: num_shard_bits : 4 2023-08-11T12:14:34.829 INFO:journalctl@ceph.mon.a.smithi008.stdout: strict_capacity_limit : 0 2023-08-11T12:14:34.829 INFO:journalctl@ceph.mon.a.smithi008.stdout: high_pri_pool_ratio: 0.000 2023-08-11T12:14:34.829 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_cache_compressed: (nil) 2023-08-11T12:14:34.829 INFO:journalctl@ceph.mon.a.smithi008.stdout: persistent_cache: (nil) 2023-08-11T12:14:34.829 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_size: 4096 2023-08-11T12:14:34.829 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_size_deviation: 10 2023-08-11T12:14:34.829 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_restart_interval: 16 2023-08-11T12:14:34.829 INFO:journalctl@ceph.mon.a.smithi008.stdout: index_block_restart_interval: 1 2023-08-11T12:14:34.830 INFO:journalctl@ceph.mon.a.smithi008.stdout: metadata_block_size: 4096 2023-08-11T12:14:34.830 INFO:journalctl@ceph.mon.a.smithi008.stdout: partition_filters: 0 2023-08-11T12:14:34.830 INFO:journalctl@ceph.mon.a.smithi008.stdout: use_delta_encoding: 1 2023-08-11T12:14:34.830 INFO:journalctl@ceph.mon.a.smithi008.stdout: filter_policy: bloomfilter 2023-08-11T12:14:34.831 INFO:journalctl@ceph.mon.a.smithi008.stdout: whole_key_filtering: 1 2023-08-11T12:14:34.831 INFO:journalctl@ceph.mon.a.smithi008.stdout: verify_compression: 0 2023-08-11T12:14:34.831 INFO:journalctl@ceph.mon.a.smithi008.stdout: read_amp_bytes_per_bit: 0 2023-08-11T12:14:34.831 INFO:journalctl@ceph.mon.a.smithi008.stdout: format_version: 5 2023-08-11T12:14:34.831 INFO:journalctl@ceph.mon.a.smithi008.stdout: enable_index_compression: 1 2023-08-11T12:14:34.831 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_align: 0 2023-08-11T12:14:34.832 INFO:journalctl@ceph.mon.a.smithi008.stdout: max_auto_readahead_size: 262144 2023-08-11T12:14:34.832 INFO:journalctl@ceph.mon.a.smithi008.stdout: prepopulate_block_cache: 0 2023-08-11T12:14:34.832 INFO:journalctl@ceph.mon.a.smithi008.stdout: initial_auto_readahead_size: 8192 2023-08-11T12:14:34.832 INFO:journalctl@ceph.mon.a.smithi008.stdout: num_file_reads_for_auto_readahead: 2 2023-08-11T12:14:34.832 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.write_buffer_size: 33554432 2023-08-11T12:14:34.832 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.max_write_buffer_number: 2 2023-08-11T12:14:34.832 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.compression: NoCompression 2023-08-11T12:14:34.833 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.bottommost_compression: Disabled 2023-08-11T12:14:34.833 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.prefix_extractor: nullptr 2023-08-11T12:14:34.833 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-08-11T12:14:34.833 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.num_levels: 7 2023-08-11T12:14:34.833 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-08-11T12:14:34.833 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-08-11T12:14:34.833 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-08-11T12:14:34.834 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-08-11T12:14:34.834 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-08-11T12:14:34.834 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-08-11T12:14:34.834 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-08-11T12:14:34.834 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-08-11T12:14:34.834 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-08-11T12:14:34.834 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-08-11T12:14:34.835 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-08-11T12:14:34.836 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-08-11T12:14:34.836 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.compression_opts.window_bits: -14 2023-08-11T12:14:34.836 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.compression_opts.level: 32767 2023-08-11T12:14:34.836 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.compression_opts.strategy: 0 2023-08-11T12:14:34.836 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-08-11T12:14:34.837 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-08-11T12:14:34.837 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-08-11T12:14:34.837 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-08-11T12:14:34.837 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.compression_opts.enabled: false 2023-08-11T12:14:34.837 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-08-11T12:14:34.837 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-08-11T12:14:34.837 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-08-11T12:14:34.838 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-08-11T12:14:34.838 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.target_file_size_base: 67108864 2023-08-11T12:14:34.838 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.target_file_size_multiplier: 1 2023-08-11T12:14:34.838 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-08-11T12:14:34.838 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-08-11T12:14:34.838 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-08-11T12:14:34.838 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-08-11T12:14:34.839 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-08-11T12:14:34.839 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-08-11T12:14:34.839 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-08-11T12:14:34.839 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-08-11T12:14:34.839 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-08-11T12:14:34.839 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-08-11T12:14:34.839 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-08-11T12:14:34.840 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-08-11T12:14:34.840 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-08-11T12:14:34.840 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.arena_block_size: 1048576 2023-08-11T12:14:34.840 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-08-11T12:14:34.840 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-08-11T12:14:34.840 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.disable_auto_compactions: 0 2023-08-11T12:14:34.840 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-08-11T12:14:34.841 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-08-11T12:14:34.841 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-08-11T12:14:34.841 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-08-11T12:14:34.841 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-08-11T12:14:34.841 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-08-11T12:14:34.841 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-08-11T12:14:34.841 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-08-11T12:14:34.842 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-08-11T12:14:34.842 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-08-11T12:14:34.842 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.table_properties_collectors: 2023-08-11T12:14:34.842 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.inplace_update_support: 0 2023-08-11T12:14:34.842 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.inplace_update_num_locks: 10000 2023-08-11T12:14:34.842 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-08-11T12:14:34.842 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-08-11T12:14:34.843 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.memtable_huge_page_size: 0 2023-08-11T12:14:34.843 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.bloom_locality: 0 2023-08-11T12:14:34.843 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.max_successive_merges: 0 2023-08-11T12:14:34.843 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.optimize_filters_for_hits: 0 2023-08-11T12:14:34.843 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.paranoid_file_checks: 0 2023-08-11T12:14:34.843 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.force_consistency_checks: 1 2023-08-11T12:14:34.843 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.report_bg_io_stats: 0 2023-08-11T12:14:34.844 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.ttl: 2592000 2023-08-11T12:14:34.844 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.periodic_compaction_seconds: 0 2023-08-11T12:14:34.844 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-08-11T12:14:34.844 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-08-11T12:14:34.844 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.enable_blob_files: false 2023-08-11T12:14:34.844 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.min_blob_size: 0 2023-08-11T12:14:34.844 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.blob_file_size: 268435456 2023-08-11T12:14:34.845 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.blob_compression_type: NoCompression 2023-08-11T12:14:34.845 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.enable_blob_garbage_collection: false 2023-08-11T12:14:34.845 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-08-11T12:14:34.845 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-08-11T12:14:34.845 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-08-11T12:14:34.845 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.blob_file_starting_level: 0 2023-08-11T12:14:34.845 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-08-11T12:14:34.846 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-08-11T12:14:34.846 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-08-11T12:14:34.846 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 7ff1e848-3df7-462a-9a83-644847dbfebb 2023-08-11T12:14:34.846 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: EVENT_LOG_v1 {"time_micros": 1691756074540667, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-08-11T12:14:34.846 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-08-11T12:14:34.846 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: EVENT_LOG_v1 {"time_micros": 1691756074542592, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94511, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 316, "table_properties": {"data_size": 92509, "index_size": 284, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13773, "raw_average_key_size": 50, "raw_value_size": 84999, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 275, "num_filter_entries": 275, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1691756074, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "7ff1e848-3df7-462a-9a83-644847dbfebb", "db_session_id": "RHUG9H9QAJCUS20BDQ50", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-08-11T12:14:34.846 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: EVENT_LOG_v1 {"time_micros": 1691756074542739, "job": 1, "event": "recovery_finished"} 2023-08-11T12:14:34.847 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-08-11T12:14:34.847 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-08-11T12:14:34.847 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56385e6ec000 2023-08-11T12:14:34.847 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: DB pointer 0x56385e6d8000 2023-08-11T12:14:34.847 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-08-11T12:14:34.847 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-08-11T12:14:34.847 INFO:journalctl@ceph.mon.a.smithi008.stdout: ** DB Stats ** 2023-08-11T12:14:34.848 INFO:journalctl@ceph.mon.a.smithi008.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-08-11T12:14:34.848 INFO:journalctl@ceph.mon.a.smithi008.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-08-11T12:14:34.848 INFO:journalctl@ceph.mon.a.smithi008.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-08-11T12:14:34.848 INFO:journalctl@ceph.mon.a.smithi008.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-08-11T12:14:34.848 INFO:journalctl@ceph.mon.a.smithi008.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-08-11T12:14:34.848 INFO:journalctl@ceph.mon.a.smithi008.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-08-11T12:14:34.848 INFO:journalctl@ceph.mon.a.smithi008.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-08-11T12:14:34.849 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2023-08-11T12:14:34.849 INFO:journalctl@ceph.mon.a.smithi008.stdout: ** Compaction Stats [default] ** 2023-08-11T12:14:34.849 INFO:journalctl@ceph.mon.a.smithi008.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-08-11T12:14:34.849 INFO:journalctl@ceph.mon.a.smithi008.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-08-11T12:14:34.849 INFO:journalctl@ceph.mon.a.smithi008.stdout: L0 2/0 94.13 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 70.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-08-11T12:14:34.849 INFO:journalctl@ceph.mon.a.smithi008.stdout: Sum 2/0 94.13 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 70.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-08-11T12:14:34.849 INFO:journalctl@ceph.mon.a.smithi008.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 70.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-08-11T12:14:34.850 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2023-08-11T12:14:34.850 INFO:journalctl@ceph.mon.a.smithi008.stdout: ** Compaction Stats [default] ** 2023-08-11T12:14:34.850 INFO:journalctl@ceph.mon.a.smithi008.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-08-11T12:14:34.850 INFO:journalctl@ceph.mon.a.smithi008.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-08-11T12:14:34.850 INFO:journalctl@ceph.mon.a.smithi008.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 70.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-08-11T12:14:34.850 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2023-08-11T12:14:34.850 INFO:journalctl@ceph.mon.a.smithi008.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-08-11T12:14:34.851 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2023-08-11T12:14:34.851 INFO:journalctl@ceph.mon.a.smithi008.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-08-11T12:14:34.851 INFO:journalctl@ceph.mon.a.smithi008.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-08-11T12:14:34.851 INFO:journalctl@ceph.mon.a.smithi008.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-08-11T12:14:34.851 INFO:journalctl@ceph.mon.a.smithi008.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-08-11T12:14:34.851 INFO:journalctl@ceph.mon.a.smithi008.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-08-11T12:14:34.851 INFO:journalctl@ceph.mon.a.smithi008.stdout: AddFile(Keys): cumulative 0, interval 0 2023-08-11T12:14:34.852 INFO:journalctl@ceph.mon.a.smithi008.stdout: Cumulative compaction: 0.00 GB write, 13.47 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-08-11T12:14:34.852 INFO:journalctl@ceph.mon.a.smithi008.stdout: Interval compaction: 0.00 GB write, 13.47 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-08-11T12:14:34.852 INFO:journalctl@ceph.mon.a.smithi008.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-08-11T12:14:34.852 INFO:journalctl@ceph.mon.a.smithi008.stdout: Block cache BinnedLRUCache@0x56385e64f1f0#7 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2023-08-11T12:14:34.852 INFO:journalctl@ceph.mon.a.smithi008.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2023-08-11T12:14:34.852 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2023-08-11T12:14:34.853 INFO:journalctl@ceph.mon.a.smithi008.stdout: ** File Read Latency Histogram By Level [default] ** 2023-08-11T12:14:34.853 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: starting mon.a rank 0 at public addrs [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] at bind addrs [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 815f94ae-3840-11ee-9b37-001a4aab830c 2023-08-11T12:14:34.854 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: mon.a@-1(???) e1 preinit fsid 815f94ae-3840-11ee-9b37-001a4aab830c 2023-08-11T12:14:34.854 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: mon.a@-1(???).mds e1 new map 2023-08-11T12:14:34.854 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: mon.a@-1(???).mds e1 print_map 2023-08-11T12:14:34.854 INFO:journalctl@ceph.mon.a.smithi008.stdout: e1 2023-08-11T12:14:34.854 INFO:journalctl@ceph.mon.a.smithi008.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-08-11T12:14:34.854 INFO:journalctl@ceph.mon.a.smithi008.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-08-11T12:14:34.854 INFO:journalctl@ceph.mon.a.smithi008.stdout: legacy client fscid: -1 2023-08-11T12:14:34.855 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2023-08-11T12:14:34.855 INFO:journalctl@ceph.mon.a.smithi008.stdout: No filesystems configured 2023-08-11T12:14:34.855 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-08-11T12:14:34.855 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-08-11T12:14:34.855 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-08-11T12:14:34.855 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-08-11T12:14:34.855 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-08-11T12:14:34.856 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: expand_channel_meta expand map: {default=false} 2023-08-11T12:14:34.856 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: expand_channel_meta from 'false' to 'false' 2023-08-11T12:14:34.856 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: expand_channel_meta expanded map: {default=false} 2023-08-11T12:14:34.856 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: expand_channel_meta expand map: {default=info} 2023-08-11T12:14:34.856 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: expand_channel_meta from 'info' to 'info' 2023-08-11T12:14:34.856 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: expand_channel_meta expanded map: {default=info} 2023-08-11T12:14:34.856 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: expand_channel_meta expand map: {default=daemon} 2023-08-11T12:14:34.856 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: expand_channel_meta from 'daemon' to 'daemon' 2023-08-11T12:14:34.857 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: expand_channel_meta expanded map: {default=daemon} 2023-08-11T12:14:34.857 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: expand_channel_meta expand map: {default=debug} 2023-08-11T12:14:34.857 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: expand_channel_meta from 'debug' to 'debug' 2023-08-11T12:14:34.857 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: expand_channel_meta expanded map: {default=debug} 2023-08-11T12:14:34.857 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 systemd[1]: Started Ceph mon.a for 815f94ae-3840-11ee-9b37-001a4aab830c. 2023-08-11T12:14:34.857 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: mon.a is new leader, mons a in quorum (ranks 0) 2023-08-11T12:14:34.857 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: monmap e1: 1 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0]} removed_ranks: {} 2023-08-11T12:14:34.858 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: fsmap 2023-08-11T12:14:34.858 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: osdmap e1: 0 total, 0 up, 0 in 2023-08-11T12:14:34.858 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:34 smithi008 ceph-mon[97158]: mgrmap e1: no daemons active 2023-08-11T12:14:35.565 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.096+0000 7fe1f816b700 1 Processor -- start 2023-08-11T12:14:35.565 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.096+0000 7fe1f816b700 1 -- start start 2023-08-11T12:14:35.565 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.097+0000 7fe1f816b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f007bdf0 0x7fe1f007a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:14:35.565 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.097+0000 7fe1f816b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f007a820 con 0x7fe1f007bdf0 2023-08-11T12:14:35.565 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.097+0000 7fe1f5f07700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f007bdf0 0x7fe1f007a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:14:35.566 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.098+0000 7fe1f5f07700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f007bdf0 0x7fe1f007a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35420/0 (socket says 172.21.15.8:35420) 2023-08-11T12:14:35.566 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.098+0000 7fe1f5f07700 1 -- 172.21.15.8:0/4119685563 learned_addr learned my addr 172.21.15.8:0/4119685563 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:14:35.566 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.098+0000 7fe1f5f07700 1 -- 172.21.15.8:0/4119685563 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f007a960 con 0x7fe1f007bdf0 2023-08-11T12:14:35.566 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.098+0000 7fe1f5f07700 1 --2- 172.21.15.8:0/4119685563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f007bdf0 0x7fe1f007a250 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec0098a0 tx=0x7fe1ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62864f153578a59 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:14:35.566 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.098+0000 7fe1f4f05700 1 -- 172.21.15.8:0/4119685563 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1ec004160 con 0x7fe1f007bdf0 2023-08-11T12:14:35.566 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.098+0000 7fe1f4f05700 1 -- 172.21.15.8:0/4119685563 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe1ec0042c0 con 0x7fe1f007bdf0 2023-08-11T12:14:35.567 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.098+0000 7fe1f4f05700 1 -- 172.21.15.8:0/4119685563 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1ec011a00 con 0x7fe1f007bdf0 2023-08-11T12:14:35.567 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.099+0000 7fe1f816b700 1 -- 172.21.15.8:0/4119685563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f007bdf0 msgr2=0x7fe1f007a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:14:35.567 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.099+0000 7fe1f816b700 1 --2- 172.21.15.8:0/4119685563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f007bdf0 0x7fe1f007a250 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec0098a0 tx=0x7fe1ec009bb0 comp rx=0 tx=0).stop 2023-08-11T12:14:35.567 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.099+0000 7fe1f816b700 1 -- 172.21.15.8:0/4119685563 shutdown_connections 2023-08-11T12:14:35.567 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.099+0000 7fe1f816b700 1 --2- 172.21.15.8:0/4119685563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f007bdf0 0x7fe1f007a250 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:14:35.567 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.099+0000 7fe1f816b700 1 -- 172.21.15.8:0/4119685563 >> 172.21.15.8:0/4119685563 conn(0x7fe1f0101750 msgr2=0x7fe1f0103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:14:35.567 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.099+0000 7fe1f816b700 1 -- 172.21.15.8:0/4119685563 shutdown_connections 2023-08-11T12:14:35.568 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.099+0000 7fe1f816b700 1 -- 172.21.15.8:0/4119685563 wait complete. 2023-08-11T12:14:35.568 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.100+0000 7fe1f816b700 1 Processor -- start 2023-08-11T12:14:35.568 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.100+0000 7fe1f816b700 1 -- start start 2023-08-11T12:14:35.568 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.100+0000 7fe1f816b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f007bdf0 0x7fe1f019c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:14:35.568 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.101+0000 7fe1f816b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f019c5c0 con 0x7fe1f007bdf0 2023-08-11T12:14:35.568 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.101+0000 7fe1f5f07700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f007bdf0 0x7fe1f019c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:14:35.568 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.101+0000 7fe1f5f07700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f007bdf0 0x7fe1f019c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35432/0 (socket says 172.21.15.8:35432) 2023-08-11T12:14:35.569 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.101+0000 7fe1f5f07700 1 -- 172.21.15.8:0/4045010086 learned_addr learned my addr 172.21.15.8:0/4045010086 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:14:35.569 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.101+0000 7fe1f5f07700 1 -- 172.21.15.8:0/4045010086 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ec009550 con 0x7fe1f007bdf0 2023-08-11T12:14:35.569 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.101+0000 7fe1f5f07700 1 --2- 172.21.15.8:0/4045010086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f007bdf0 0x7fe1f019c080 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec006af0 tx=0x7fe1ec011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:14:35.569 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.102+0000 7fe1e6ffd700 1 -- 172.21.15.8:0/4045010086 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1ec003a40 con 0x7fe1f007bdf0 2023-08-11T12:14:35.569 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.102+0000 7fe1e6ffd700 1 -- 172.21.15.8:0/4045010086 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe1ec003ba0 con 0x7fe1f007bdf0 2023-08-11T12:14:35.569 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.102+0000 7fe1e6ffd700 1 -- 172.21.15.8:0/4045010086 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1ec01a6e0 con 0x7fe1f007bdf0 2023-08-11T12:14:35.569 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.102+0000 7fe1f816b700 1 -- 172.21.15.8:0/4045010086 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f019c7c0 con 0x7fe1f007bdf0 2023-08-11T12:14:35.570 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.102+0000 7fe1f816b700 1 -- 172.21.15.8:0/4045010086 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f019cbe0 con 0x7fe1f007bdf0 2023-08-11T12:14:35.570 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.102+0000 7fe1e6ffd700 1 -- 172.21.15.8:0/4045010086 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe1ec01ab60 con 0x7fe1f007bdf0 2023-08-11T12:14:35.570 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.102+0000 7fe1e6ffd700 1 -- 172.21.15.8:0/4045010086 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe1ec019700 con 0x7fe1f007bdf0 2023-08-11T12:14:35.570 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.103+0000 7fe1f816b700 1 -- 172.21.15.8:0/4045010086 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f0061f50 con 0x7fe1f007bdf0 2023-08-11T12:14:35.570 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.106+0000 7fe1e6ffd700 1 -- 172.21.15.8:0/4045010086 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fe1ec02dde0 con 0x7fe1f007bdf0 2023-08-11T12:14:35.570 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.179+0000 7fe1f816b700 1 -- 172.21.15.8:0/4045010086 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fe1f010c560 con 0x7fe1f007bdf0 2023-08-11T12:14:35.570 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.181+0000 7fe1e6ffd700 1 -- 172.21.15.8:0/4045010086 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe1ec024a60 con 0x7fe1f007bdf0 2023-08-11T12:14:35.571 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.182+0000 7fe1f816b700 1 -- 172.21.15.8:0/4045010086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f007bdf0 msgr2=0x7fe1f019c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:14:35.571 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.182+0000 7fe1f816b700 1 --2- 172.21.15.8:0/4045010086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f007bdf0 0x7fe1f019c080 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec006af0 tx=0x7fe1ec011ad0 comp rx=0 tx=0).stop 2023-08-11T12:14:35.571 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.182+0000 7fe1f816b700 1 -- 172.21.15.8:0/4045010086 shutdown_connections 2023-08-11T12:14:35.571 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.182+0000 7fe1f816b700 1 --2- 172.21.15.8:0/4045010086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f007bdf0 0x7fe1f019c080 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:14:35.571 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.182+0000 7fe1f816b700 1 -- 172.21.15.8:0/4045010086 >> 172.21.15.8:0/4045010086 conn(0x7fe1f0101750 msgr2=0x7fe1f0102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:14:35.571 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.183+0000 7fe1f816b700 1 -- 172.21.15.8:0/4045010086 shutdown_connections 2023-08-11T12:14:35.571 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:35.183+0000 7fe1f816b700 1 -- 172.21.15.8:0/4045010086 wait complete. 2023-08-11T12:14:35.571 INFO:teuthology.orchestra.run.smithi008.stdout:Wrote config to /etc/ceph/ceph.conf 2023-08-11T12:14:35.586 INFO:teuthology.orchestra.run.smithi008.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-08-11T12:14:35.586 INFO:teuthology.orchestra.run.smithi008.stdout:Creating mgr... 2023-08-11T12:14:35.586 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying port 9283 ... 2023-08-11T12:14:35.586 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying port 8765 ... 2023-08-11T12:14:35.961 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mgr.x 2023-08-11T12:14:35.961 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Failed to reset failed state of unit ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mgr.x.service: Unit ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mgr.x.service not loaded. 2023-08-11T12:14:36.171 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-815f94ae-3840-11ee-9b37-001a4aab830c.target.wants/ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mgr.x.service → /etc/systemd/system/ceph-815f94ae-3840-11ee-9b37-001a4aab830c@.service. 2023-08-11T12:14:36.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:36 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/4045010086' entity='client.admin' 2023-08-11T12:14:36.304 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:36 smithi008 systemd[1]: Starting Ceph mgr.x for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:14:36.970 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:36 smithi008 podman[97387]: 2023-08-11T12:14:36.971 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:36 smithi008 bash[97387]: e940becb014c3bafe1a8f6b15342b514f3b99a65264c986c728147e0d20d6a89 2023-08-11T12:14:36.993 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-08-11T12:14:36.994 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout disabled 2023-08-11T12:14:37.010 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-08-11T12:14:37.010 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2023-08-11T12:14:37.010 INFO:teuthology.orchestra.run.smithi008.stdout:firewalld.service is not enabled 2023-08-11T12:14:37.010 INFO:teuthology.orchestra.run.smithi008.stdout:Not possible to enable service . firewalld.service is not available 2023-08-11T12:14:37.028 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-08-11T12:14:37.028 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout disabled 2023-08-11T12:14:37.044 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-08-11T12:14:37.045 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2023-08-11T12:14:37.045 INFO:teuthology.orchestra.run.smithi008.stdout:firewalld.service is not enabled 2023-08-11T12:14:37.045 INFO:teuthology.orchestra.run.smithi008.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-08-11T12:14:37.045 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mgr to start... 2023-08-11T12:14:37.045 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mgr... 2023-08-11T12:14:37.226 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:36 smithi008 systemd[1]: Started Ceph mgr.x for 815f94ae-3840-11ee-9b37-001a4aab830c. 2023-08-11T12:14:37.226 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:37 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:37.106+0000 7f08075ea200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-11T12:14:37.226 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:37 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:37.224+0000 7f08075ea200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-11T12:14:37.491 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:37 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:37.352+0000 7f08075ea200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-11T12:14:37.491 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:37 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:37.489+0000 7f08075ea200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-11T12:14:37.766 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:37 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:37.732+0000 7f08075ea200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-11T12:14:38.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:37 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/4113425454' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-08-11T12:14:38.509 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:38 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:38.219+0000 7f08075ea200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-11T12:14:38.509 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:38 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:38.387+0000 7f08075ea200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-11T12:14:38.509 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:38 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:38.507+0000 7f08075ea200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-11T12:14:38.803 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:38 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:38.638+0000 7f08075ea200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-11T12:14:39.033 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-08-11T12:14:39.035 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-08-11T12:14:39.035 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsid": "815f94ae-3840-11ee-9b37-001a4aab830c", 2023-08-11T12:14:39.036 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "health": { 2023-08-11T12:14:39.036 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-08-11T12:14:39.036 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-08-11T12:14:39.036 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-08-11T12:14:39.036 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-08-11T12:14:39.036 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-08-11T12:14:39.036 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-08-11T12:14:39.037 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 0 2023-08-11T12:14:39.037 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-08-11T12:14:39.037 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-08-11T12:14:39.037 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "a" 2023-08-11T12:14:39.037 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-08-11T12:14:39.037 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2023-08-11T12:14:39.037 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "monmap": { 2023-08-11T12:14:39.038 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-11T12:14:39.038 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-08-11T12:14:39.038 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-08-11T12:14:39.038 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-08-11T12:14:39.038 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-08-11T12:14:39.038 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-11T12:14:39.038 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-08-11T12:14:39.038 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-08-11T12:14:39.039 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-08-11T12:14:39.044 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-08-11T12:14:39.045 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-08-11T12:14:39.045 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-08-11T12:14:39.045 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-08-11T12:14:39.045 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-08-11T12:14:39.045 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-08-11T12:14:39.045 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-08-11T12:14:39.045 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-08-11T12:14:39.046 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-08-11T12:14:39.046 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-08-11T12:14:39.046 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-08-11T12:14:39.046 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-08-11T12:14:39.046 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-08-11T12:14:39.046 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-08-11T12:14:39.046 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-08-11T12:14:39.046 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-11T12:14:39.047 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-08-11T12:14:39.047 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-08-11T12:14:39.047 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-08-11T12:14:39.047 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-08-11T12:14:39.047 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "available": false, 2023-08-11T12:14:39.047 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-08-11T12:14:39.047 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modules": [ 2023-08-11T12:14:39.047 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "iostat", 2023-08-11T12:14:39.048 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "nfs", 2023-08-11T12:14:39.048 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "restful" 2023-08-11T12:14:39.048 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-08-11T12:14:39.048 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2023-08-11T12:14:39.048 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-08-11T12:14:39.048 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-08-11T12:14:39.048 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-11T12:14:39.049 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modified": "2023-08-11T12:14:28.341625+0000", 2023-08-11T12:14:39.049 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2023-08-11T12:14:39.049 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-08-11T12:14:39.049 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-08-11T12:14:39.049 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-08-11T12:14:39.049 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.652+0000 7f6c73fa2700 1 Processor -- start 2023-08-11T12:14:39.049 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.652+0000 7f6c73fa2700 1 -- start start 2023-08-11T12:14:39.050 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.653+0000 7f6c73fa2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c6c07be10 0x7f6c6c07a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:14:39.050 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.653+0000 7f6c73fa2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c07a840 con 0x7f6c6c07be10 2023-08-11T12:14:39.050 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.653+0000 7f6c71d3e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c6c07be10 0x7f6c6c07a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:14:39.050 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.653+0000 7f6c71d3e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c6c07be10 0x7f6c6c07a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35452/0 (socket says 172.21.15.8:35452) 2023-08-11T12:14:39.050 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.654+0000 7f6c71d3e700 1 -- 172.21.15.8:0/609432896 learned_addr learned my addr 172.21.15.8:0/609432896 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:14:39.050 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.654+0000 7f6c71d3e700 1 -- 172.21.15.8:0/609432896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6c07a980 con 0x7f6c6c07be10 2023-08-11T12:14:39.050 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.654+0000 7f6c71d3e700 1 --2- 172.21.15.8:0/609432896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c6c07be10 0x7f6c6c07a270 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6c680098a0 tx=0x7f6c68009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c4b0aa8545be99 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:14:39.051 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.654+0000 7f6c70d3c700 1 -- 172.21.15.8:0/609432896 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c68004160 con 0x7f6c6c07be10 2023-08-11T12:14:39.051 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.655+0000 7f6c70d3c700 1 -- 172.21.15.8:0/609432896 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6c680042c0 con 0x7f6c6c07be10 2023-08-11T12:14:39.051 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.655+0000 7f6c70d3c700 1 -- 172.21.15.8:0/609432896 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c68011a00 con 0x7f6c6c07be10 2023-08-11T12:14:39.051 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.655+0000 7f6c73fa2700 1 -- 172.21.15.8:0/609432896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c6c07be10 msgr2=0x7f6c6c07a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:14:39.051 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.655+0000 7f6c73fa2700 1 --2- 172.21.15.8:0/609432896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c6c07be10 0x7f6c6c07a270 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6c680098a0 tx=0x7f6c68009bb0 comp rx=0 tx=0).stop 2023-08-11T12:14:39.051 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.656+0000 7f6c73fa2700 1 -- 172.21.15.8:0/609432896 shutdown_connections 2023-08-11T12:14:39.051 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.656+0000 7f6c73fa2700 1 --2- 172.21.15.8:0/609432896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c6c07be10 0x7f6c6c07a270 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:14:39.052 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.656+0000 7f6c73fa2700 1 -- 172.21.15.8:0/609432896 >> 172.21.15.8:0/609432896 conn(0x7f6c6c101750 msgr2=0x7f6c6c103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:14:39.052 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.656+0000 7f6c73fa2700 1 -- 172.21.15.8:0/609432896 shutdown_connections 2023-08-11T12:14:39.052 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.656+0000 7f6c73fa2700 1 -- 172.21.15.8:0/609432896 wait complete. 2023-08-11T12:14:39.052 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.657+0000 7f6c73fa2700 1 Processor -- start 2023-08-11T12:14:39.052 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.657+0000 7f6c73fa2700 1 -- start start 2023-08-11T12:14:39.052 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.657+0000 7f6c73fa2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c6c07be10 0x7f6c6c19c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:14:39.052 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.657+0000 7f6c73fa2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c19c580 con 0x7f6c6c07be10 2023-08-11T12:14:39.053 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.657+0000 7f6c71d3e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c6c07be10 0x7f6c6c19c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:14:39.053 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.658+0000 7f6c71d3e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c6c07be10 0x7f6c6c19c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35456/0 (socket says 172.21.15.8:35456) 2023-08-11T12:14:39.053 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.658+0000 7f6c71d3e700 1 -- 172.21.15.8:0/4113425454 learned_addr learned my addr 172.21.15.8:0/4113425454 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:14:39.053 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.658+0000 7f6c71d3e700 1 -- 172.21.15.8:0/4113425454 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c68009550 con 0x7f6c6c07be10 2023-08-11T12:14:39.053 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.658+0000 7f6c71d3e700 1 --2- 172.21.15.8:0/4113425454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c6c07be10 0x7f6c6c19c040 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6c68006af0 tx=0x7f6c68011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:14:39.054 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.658+0000 7f6c62ffd700 1 -- 172.21.15.8:0/4113425454 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c68003a40 con 0x7f6c6c07be10 2023-08-11T12:14:39.054 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.659+0000 7f6c62ffd700 1 -- 172.21.15.8:0/4113425454 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6c68003ba0 con 0x7f6c6c07be10 2023-08-11T12:14:39.054 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.659+0000 7f6c73fa2700 1 -- 172.21.15.8:0/4113425454 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c6c19c780 con 0x7f6c6c07be10 2023-08-11T12:14:39.054 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.659+0000 7f6c62ffd700 1 -- 172.21.15.8:0/4113425454 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c6801a6e0 con 0x7f6c6c07be10 2023-08-11T12:14:39.054 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.659+0000 7f6c73fa2700 1 -- 172.21.15.8:0/4113425454 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c6c19cba0 con 0x7f6c6c07be10 2023-08-11T12:14:39.054 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.659+0000 7f6c62ffd700 1 -- 172.21.15.8:0/4113425454 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6c6801ab60 con 0x7f6c6c07be10 2023-08-11T12:14:39.054 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.659+0000 7f6c62ffd700 1 -- 172.21.15.8:0/4113425454 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6c68019700 con 0x7f6c6c07be10 2023-08-11T12:14:39.055 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.660+0000 7f6c73fa2700 1 -- 172.21.15.8:0/4113425454 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c6c061f50 con 0x7f6c6c07be10 2023-08-11T12:14:39.055 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.662+0000 7f6c62ffd700 1 -- 172.21.15.8:0/4113425454 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f6c68024a60 con 0x7f6c6c07be10 2023-08-11T12:14:39.055 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.740+0000 7f6c73fa2700 1 -- 172.21.15.8:0/4113425454 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f6c6c10c7c0 con 0x7f6c6c07be10 2023-08-11T12:14:39.055 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.740+0000 7f6c62ffd700 1 -- 172.21.15.8:0/4113425454 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f6c68024c00 con 0x7f6c6c07be10 2023-08-11T12:14:39.055 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.741+0000 7f6c73fa2700 1 -- 172.21.15.8:0/4113425454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c6c07be10 msgr2=0x7f6c6c19c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:14:39.055 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.741+0000 7f6c73fa2700 1 --2- 172.21.15.8:0/4113425454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c6c07be10 0x7f6c6c19c040 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6c68006af0 tx=0x7f6c68011ad0 comp rx=0 tx=0).stop 2023-08-11T12:14:39.055 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.741+0000 7f6c73fa2700 1 -- 172.21.15.8:0/4113425454 shutdown_connections 2023-08-11T12:14:39.056 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.741+0000 7f6c73fa2700 1 --2- 172.21.15.8:0/4113425454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c6c07be10 0x7f6c6c19c040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:14:39.056 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.741+0000 7f6c73fa2700 1 -- 172.21.15.8:0/4113425454 >> 172.21.15.8:0/4113425454 conn(0x7f6c6c101750 msgr2=0x7f6c6c102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:14:39.056 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.742+0000 7f6c73fa2700 1 -- 172.21.15.8:0/4113425454 shutdown_connections 2023-08-11T12:14:39.056 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:37.742+0000 7f6c73fa2700 1 -- 172.21.15.8:0/4113425454 wait complete. 2023-08-11T12:14:39.056 INFO:teuthology.orchestra.run.smithi008.stdout:mgr not available, waiting (1/15)... 2023-08-11T12:14:39.303 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:39 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:39.217+0000 7f08075ea200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-11T12:14:40.553 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:40 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:40.134+0000 7f08075ea200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-11T12:14:40.553 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:40 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:40.246+0000 7f08075ea200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-11T12:14:41.553 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:41 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:41.247+0000 7f08075ea200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-11T12:14:41.553 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:41 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:41.381+0000 7f08075ea200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-11T12:14:42.028 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:41 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/503027939' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-08-11T12:14:42.029 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:41 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:41.621+0000 7f08075ea200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-11T12:14:42.128 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-08-11T12:14:42.128 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-08-11T12:14:42.129 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsid": "815f94ae-3840-11ee-9b37-001a4aab830c", 2023-08-11T12:14:42.129 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "health": { 2023-08-11T12:14:42.129 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-08-11T12:14:42.129 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-08-11T12:14:42.129 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-08-11T12:14:42.129 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-08-11T12:14:42.129 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-08-11T12:14:42.130 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-08-11T12:14:42.130 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 0 2023-08-11T12:14:42.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-08-11T12:14:42.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-08-11T12:14:42.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "a" 2023-08-11T12:14:42.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-08-11T12:14:42.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2023-08-11T12:14:42.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "monmap": { 2023-08-11T12:14:42.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-11T12:14:42.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-08-11T12:14:42.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-08-11T12:14:42.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-08-11T12:14:42.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-08-11T12:14:42.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-11T12:14:42.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-08-11T12:14:42.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-08-11T12:14:42.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-08-11T12:14:42.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-08-11T12:14:42.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-08-11T12:14:42.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-08-11T12:14:42.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-08-11T12:14:42.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-08-11T12:14:42.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-08-11T12:14:42.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-08-11T12:14:42.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-08-11T12:14:42.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-08-11T12:14:42.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-08-11T12:14:42.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-08-11T12:14:42.135 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-08-11T12:14:42.135 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-08-11T12:14:42.135 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-08-11T12:14:42.140 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-08-11T12:14:42.140 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-11T12:14:42.140 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-08-11T12:14:42.140 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-08-11T12:14:42.140 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-08-11T12:14:42.140 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-08-11T12:14:42.141 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "available": false, 2023-08-11T12:14:42.141 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-08-11T12:14:42.141 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modules": [ 2023-08-11T12:14:42.141 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "iostat", 2023-08-11T12:14:42.142 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "nfs", 2023-08-11T12:14:42.142 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "restful" 2023-08-11T12:14:42.142 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-08-11T12:14:42.142 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2023-08-11T12:14:42.142 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-08-11T12:14:42.142 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-08-11T12:14:42.142 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-11T12:14:42.142 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modified": "2023-08-11T12:14:28.341625+0000", 2023-08-11T12:14:42.143 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2023-08-11T12:14:42.143 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-08-11T12:14:42.143 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-08-11T12:14:42.143 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-08-11T12:14:42.143 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.557+0000 7fb4ac111700 1 Processor -- start 2023-08-11T12:14:42.143 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.558+0000 7fb4ac111700 1 -- start start 2023-08-11T12:14:42.143 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.558+0000 7fb4ac111700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4a407be10 0x7fb4a407a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:14:42.144 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.558+0000 7fb4ac111700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a407a840 con 0x7fb4a407be10 2023-08-11T12:14:42.144 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.558+0000 7fb4a9ead700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4a407be10 0x7fb4a407a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:14:42.144 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.558+0000 7fb4a9ead700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4a407be10 0x7fb4a407a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55810/0 (socket says 172.21.15.8:55810) 2023-08-11T12:14:42.144 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.558+0000 7fb4a9ead700 1 -- 172.21.15.8:0/3424830884 learned_addr learned my addr 172.21.15.8:0/3424830884 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:14:42.144 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.559+0000 7fb4a9ead700 1 -- 172.21.15.8:0/3424830884 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a407a980 con 0x7fb4a407be10 2023-08-11T12:14:42.144 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.559+0000 7fb4a9ead700 1 --2- 172.21.15.8:0/3424830884 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4a407be10 0x7fb4a407a270 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb4a00098a0 tx=0x7fb4a0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c2f035c347209c server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:14:42.144 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.559+0000 7fb4a8eab700 1 -- 172.21.15.8:0/3424830884 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4a0004160 con 0x7fb4a407be10 2023-08-11T12:14:42.145 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.559+0000 7fb4a8eab700 1 -- 172.21.15.8:0/3424830884 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb4a00042c0 con 0x7fb4a407be10 2023-08-11T12:14:42.145 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.559+0000 7fb4a8eab700 1 -- 172.21.15.8:0/3424830884 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4a0011a00 con 0x7fb4a407be10 2023-08-11T12:14:42.145 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.560+0000 7fb4ac111700 1 -- 172.21.15.8:0/3424830884 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4a407be10 msgr2=0x7fb4a407a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:14:42.145 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.560+0000 7fb4ac111700 1 --2- 172.21.15.8:0/3424830884 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4a407be10 0x7fb4a407a270 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb4a00098a0 tx=0x7fb4a0009bb0 comp rx=0 tx=0).stop 2023-08-11T12:14:42.145 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.560+0000 7fb4ac111700 1 -- 172.21.15.8:0/3424830884 shutdown_connections 2023-08-11T12:14:42.145 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.560+0000 7fb4ac111700 1 --2- 172.21.15.8:0/3424830884 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4a407be10 0x7fb4a407a270 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:14:42.145 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.560+0000 7fb4ac111700 1 -- 172.21.15.8:0/3424830884 >> 172.21.15.8:0/3424830884 conn(0x7fb4a4101750 msgr2=0x7fb4a4103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:14:42.146 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.560+0000 7fb4ac111700 1 -- 172.21.15.8:0/3424830884 shutdown_connections 2023-08-11T12:14:42.146 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.560+0000 7fb4ac111700 1 -- 172.21.15.8:0/3424830884 wait complete. 2023-08-11T12:14:42.146 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.561+0000 7fb4ac111700 1 Processor -- start 2023-08-11T12:14:42.146 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.561+0000 7fb4ac111700 1 -- start start 2023-08-11T12:14:42.146 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.561+0000 7fb4ac111700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4a407be10 0x7fb4a419c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:14:42.146 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.561+0000 7fb4ac111700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a419c580 con 0x7fb4a407be10 2023-08-11T12:14:42.146 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.562+0000 7fb4a9ead700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4a407be10 0x7fb4a419c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:14:42.146 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.562+0000 7fb4a9ead700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4a407be10 0x7fb4a419c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55818/0 (socket says 172.21.15.8:55818) 2023-08-11T12:14:42.147 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.562+0000 7fb4a9ead700 1 -- 172.21.15.8:0/503027939 learned_addr learned my addr 172.21.15.8:0/503027939 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:14:42.147 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.562+0000 7fb4a9ead700 1 -- 172.21.15.8:0/503027939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a0009550 con 0x7fb4a407be10 2023-08-11T12:14:42.147 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.562+0000 7fb4a9ead700 1 --2- 172.21.15.8:0/503027939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4a407be10 0x7fb4a419c040 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0006af0 tx=0x7fb4a0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:14:42.147 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.563+0000 7fb49affd700 1 -- 172.21.15.8:0/503027939 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4a0003a40 con 0x7fb4a407be10 2023-08-11T12:14:42.147 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.563+0000 7fb49affd700 1 -- 172.21.15.8:0/503027939 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb4a0003ba0 con 0x7fb4a407be10 2023-08-11T12:14:42.147 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.563+0000 7fb4ac111700 1 -- 172.21.15.8:0/503027939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a419c780 con 0x7fb4a407be10 2023-08-11T12:14:42.147 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.563+0000 7fb49affd700 1 -- 172.21.15.8:0/503027939 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4a001a6e0 con 0x7fb4a407be10 2023-08-11T12:14:42.148 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.563+0000 7fb4ac111700 1 -- 172.21.15.8:0/503027939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a419cba0 con 0x7fb4a407be10 2023-08-11T12:14:42.148 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.563+0000 7fb49affd700 1 -- 172.21.15.8:0/503027939 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb4a001ac50 con 0x7fb4a407be10 2023-08-11T12:14:42.148 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.563+0000 7fb49affd700 1 -- 172.21.15.8:0/503027939 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb4a0019700 con 0x7fb4a407be10 2023-08-11T12:14:42.148 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.564+0000 7fb4ac111700 1 -- 172.21.15.8:0/503027939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4a4061f50 con 0x7fb4a407be10 2023-08-11T12:14:42.148 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.567+0000 7fb49affd700 1 -- 172.21.15.8:0/503027939 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fb4a0024a60 con 0x7fb4a407be10 2023-08-11T12:14:42.148 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.643+0000 7fb4ac111700 1 -- 172.21.15.8:0/503027939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fb4a410c7c0 con 0x7fb4a407be10 2023-08-11T12:14:42.148 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.644+0000 7fb49affd700 1 -- 172.21.15.8:0/503027939 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7fb4a0024c00 con 0x7fb4a407be10 2023-08-11T12:14:42.149 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.645+0000 7fb4ac111700 1 -- 172.21.15.8:0/503027939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4a407be10 msgr2=0x7fb4a419c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:14:42.149 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.645+0000 7fb4ac111700 1 --2- 172.21.15.8:0/503027939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4a407be10 0x7fb4a419c040 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0006af0 tx=0x7fb4a0011ad0 comp rx=0 tx=0).stop 2023-08-11T12:14:42.149 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.645+0000 7fb4ac111700 1 -- 172.21.15.8:0/503027939 shutdown_connections 2023-08-11T12:14:42.149 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.645+0000 7fb4ac111700 1 --2- 172.21.15.8:0/503027939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4a407be10 0x7fb4a419c040 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:14:42.149 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.645+0000 7fb4ac111700 1 -- 172.21.15.8:0/503027939 >> 172.21.15.8:0/503027939 conn(0x7fb4a4101750 msgr2=0x7fb4a4102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:14:42.149 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.645+0000 7fb4ac111700 1 -- 172.21.15.8:0/503027939 shutdown_connections 2023-08-11T12:14:42.151 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:41.645+0000 7fb4ac111700 1 -- 172.21.15.8:0/503027939 wait complete. 2023-08-11T12:14:42.152 INFO:teuthology.orchestra.run.smithi008.stdout:mgr not available, waiting (2/15)... 2023-08-11T12:14:42.303 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:42 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:42.026+0000 7f08075ea200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-11T12:14:42.803 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:42 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:42.311+0000 7f08075ea200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-11T12:14:42.803 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:42 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:42.512+0000 7f08075ea200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-11T12:14:43.303 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:42 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:42.868+0000 7f08075ea200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-11T12:14:44.285 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:43 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:43.832+0000 7f08075ea200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-11T12:14:44.285 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:44 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:44.015+0000 7f08075ea200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-11T12:14:44.553 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:44 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:44.283+0000 7f08075ea200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-11T12:14:44.553 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:44 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:44.438+0000 7f08075ea200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-11T12:14:45.053 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:44 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:44.728+0000 7f08075ea200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-11T12:14:46.303 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:45 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:45.834+0000 7f08075ea200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-11T12:14:46.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:45 smithi008 ceph-mon[97158]: Activating manager daemon x 2023-08-11T12:14:46.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:45 smithi008 ceph-mon[97158]: mgrmap e2: x(active, starting, since 0.0037604s) 2023-08-11T12:14:46.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:45 smithi008 ceph-mon[97158]: from='mgr.14100 172.21.15.8:0/1756321993' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-08-11T12:14:46.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:45 smithi008 ceph-mon[97158]: from='mgr.14100 172.21.15.8:0/1756321993' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-08-11T12:14:46.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:45 smithi008 ceph-mon[97158]: from='mgr.14100 172.21.15.8:0/1756321993' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-08-11T12:14:46.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:45 smithi008 ceph-mon[97158]: from='mgr.14100 172.21.15.8:0/1756321993' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-11T12:14:46.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:45 smithi008 ceph-mon[97158]: from='mgr.14100 172.21.15.8:0/1756321993' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-08-11T12:14:46.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:45 smithi008 ceph-mon[97158]: Manager daemon x is now available 2023-08-11T12:14:46.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:45 smithi008 ceph-mon[97158]: from='mgr.14100 172.21.15.8:0/1756321993' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-08-11T12:14:46.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:45 smithi008 ceph-mon[97158]: from='mgr.14100 172.21.15.8:0/1756321993' entity='mgr.x' 2023-08-11T12:14:46.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:45 smithi008 ceph-mon[97158]: from='mgr.14100 172.21.15.8:0/1756321993' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-08-11T12:14:46.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:45 smithi008 ceph-mon[97158]: from='mgr.14100 172.21.15.8:0/1756321993' entity='mgr.x' 2023-08-11T12:14:46.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:45 smithi008 ceph-mon[97158]: from='mgr.14100 172.21.15.8:0/1756321993' entity='mgr.x' 2023-08-11T12:14:48.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:47 smithi008 ceph-mon[97158]: mgrmap e3: x(active, since 1.0098s) 2023-08-11T12:14:49.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:48 smithi008 ceph-mon[97158]: mgrmap e4: x(active, since 2s) 2023-08-11T12:14:51.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:51 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2190491077' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-08-11T12:14:51.635 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-08-11T12:14:51.635 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-08-11T12:14:51.636 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsid": "815f94ae-3840-11ee-9b37-001a4aab830c", 2023-08-11T12:14:51.636 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "health": { 2023-08-11T12:14:51.636 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-08-11T12:14:51.636 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-08-11T12:14:51.636 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-08-11T12:14:51.636 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-08-11T12:14:51.637 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-08-11T12:14:51.637 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-08-11T12:14:51.637 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 0 2023-08-11T12:14:51.637 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-08-11T12:14:51.637 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-08-11T12:14:51.637 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "a" 2023-08-11T12:14:51.637 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-08-11T12:14:51.637 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_age": 16, 2023-08-11T12:14:51.638 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "monmap": { 2023-08-11T12:14:51.638 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-11T12:14:51.638 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-08-11T12:14:51.638 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-08-11T12:14:51.638 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-08-11T12:14:51.638 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-08-11T12:14:51.639 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-11T12:14:51.639 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-08-11T12:14:51.639 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-08-11T12:14:51.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-08-11T12:14:51.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-08-11T12:14:51.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-08-11T12:14:51.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-08-11T12:14:51.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-08-11T12:14:51.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-08-11T12:14:51.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-08-11T12:14:51.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-08-11T12:14:51.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-08-11T12:14:51.647 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-08-11T12:14:51.647 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-08-11T12:14:51.647 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-08-11T12:14:51.647 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-08-11T12:14:51.647 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-08-11T12:14:51.647 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-08-11T12:14:51.647 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-08-11T12:14:51.647 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-11T12:14:51.648 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-08-11T12:14:51.648 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-08-11T12:14:51.648 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-08-11T12:14:51.648 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-08-11T12:14:51.648 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "available": true, 2023-08-11T12:14:51.648 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-08-11T12:14:51.648 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modules": [ 2023-08-11T12:14:51.649 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "iostat", 2023-08-11T12:14:51.649 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "nfs", 2023-08-11T12:14:51.649 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "restful" 2023-08-11T12:14:51.649 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-08-11T12:14:51.649 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2023-08-11T12:14:51.649 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-08-11T12:14:51.649 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-08-11T12:14:51.650 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-11T12:14:51.650 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modified": "2023-08-11T12:14:28.341625+0000", 2023-08-11T12:14:51.650 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2023-08-11T12:14:51.650 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-08-11T12:14:51.650 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-08-11T12:14:51.650 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-08-11T12:14:51.650 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.833+0000 7f01727fd700 1 Processor -- start 2023-08-11T12:14:51.650 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.833+0000 7f01727fd700 1 -- start start 2023-08-11T12:14:51.651 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.833+0000 7f01727fd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f016c07be50 0x7f016c07a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:14:51.651 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.833+0000 7f01727fd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016c07a880 con 0x7f016c07be50 2023-08-11T12:14:51.651 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.833+0000 7f016bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f016c07be50 0x7f016c07a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:14:51.651 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.833+0000 7f016bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f016c07be50 0x7f016c07a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48966/0 (socket says 172.21.15.8:48966) 2023-08-11T12:14:51.651 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.833+0000 7f016bfff700 1 -- 172.21.15.8:0/2768602949 learned_addr learned my addr 172.21.15.8:0/2768602949 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:14:51.651 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.834+0000 7f016bfff700 1 -- 172.21.15.8:0/2768602949 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016c07a9c0 con 0x7f016c07be50 2023-08-11T12:14:51.651 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.834+0000 7f016bfff700 1 --2- 172.21.15.8:0/2768602949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f016c07be50 0x7f016c07a2b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f015c0098a0 tx=0x7f015c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58d09355e7b0fa8f server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:14:51.652 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.834+0000 7f016affd700 1 -- 172.21.15.8:0/2768602949 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f015c004160 con 0x7f016c07be50 2023-08-11T12:14:51.652 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.834+0000 7f016affd700 1 -- 172.21.15.8:0/2768602949 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f015c0042c0 con 0x7f016c07be50 2023-08-11T12:14:51.652 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.834+0000 7f016affd700 1 -- 172.21.15.8:0/2768602949 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f015c011a00 con 0x7f016c07be50 2023-08-11T12:14:51.652 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.835+0000 7f01727fd700 1 -- 172.21.15.8:0/2768602949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f016c07be50 msgr2=0x7f016c07a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:14:51.652 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.835+0000 7f01727fd700 1 --2- 172.21.15.8:0/2768602949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f016c07be50 0x7f016c07a2b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f015c0098a0 tx=0x7f015c009bb0 comp rx=0 tx=0).stop 2023-08-11T12:14:51.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.835+0000 7f01727fd700 1 -- 172.21.15.8:0/2768602949 shutdown_connections 2023-08-11T12:14:51.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.835+0000 7f01727fd700 1 --2- 172.21.15.8:0/2768602949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f016c07be50 0x7f016c07a2b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:14:51.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.835+0000 7f01727fd700 1 -- 172.21.15.8:0/2768602949 >> 172.21.15.8:0/2768602949 conn(0x7f016c101750 msgr2=0x7f016c103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:14:51.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.835+0000 7f01727fd700 1 -- 172.21.15.8:0/2768602949 shutdown_connections 2023-08-11T12:14:51.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.835+0000 7f01727fd700 1 -- 172.21.15.8:0/2768602949 wait complete. 2023-08-11T12:14:51.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.836+0000 7f01727fd700 1 Processor -- start 2023-08-11T12:14:51.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.836+0000 7f01727fd700 1 -- start start 2023-08-11T12:14:51.654 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.837+0000 7f01727fd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f016c07be50 0x7f016c19c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:14:51.654 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.837+0000 7f01727fd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016c19c5d0 con 0x7f016c07be50 2023-08-11T12:14:51.654 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.837+0000 7f016bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f016c07be50 0x7f016c19c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:14:51.654 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.837+0000 7f016bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f016c07be50 0x7f016c19c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48974/0 (socket says 172.21.15.8:48974) 2023-08-11T12:14:51.654 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.837+0000 7f016bfff700 1 -- 172.21.15.8:0/2190491077 learned_addr learned my addr 172.21.15.8:0/2190491077 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:14:51.654 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.837+0000 7f016bfff700 1 -- 172.21.15.8:0/2190491077 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015c009550 con 0x7f016c07be50 2023-08-11T12:14:51.654 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.838+0000 7f016bfff700 1 --2- 172.21.15.8:0/2190491077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f016c07be50 0x7f016c19c090 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f015c006af0 tx=0x7f015c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:14:51.654 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.838+0000 7f01697fa700 1 -- 172.21.15.8:0/2190491077 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f015c003a40 con 0x7f016c07be50 2023-08-11T12:14:51.655 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.838+0000 7f01697fa700 1 -- 172.21.15.8:0/2190491077 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f015c003ba0 con 0x7f016c07be50 2023-08-11T12:14:51.655 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.838+0000 7f01697fa700 1 -- 172.21.15.8:0/2190491077 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f015c01a700 con 0x7f016c07be50 2023-08-11T12:14:51.655 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.838+0000 7f01727fd700 1 -- 172.21.15.8:0/2190491077 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f016c19c7d0 con 0x7f016c07be50 2023-08-11T12:14:51.655 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.838+0000 7f01727fd700 1 -- 172.21.15.8:0/2190491077 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f016c19cbf0 con 0x7f016c07be50 2023-08-11T12:14:51.655 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.839+0000 7f01697fa700 1 -- 172.21.15.8:0/2190491077 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 45124+0+0 (secure 0 0 0) 0x7f015c024ad0 con 0x7f016c07be50 2023-08-11T12:14:51.655 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.839+0000 7f01727fd700 1 -- 172.21.15.8:0/2190491077 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f016c061f50 con 0x7f016c07be50 2023-08-11T12:14:51.655 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.840+0000 7f01697fa700 1 --2- 172.21.15.8:0/2190491077 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7f0154038110 0x7f015403a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:14:51.656 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.840+0000 7f01697fa700 1 -- 172.21.15.8:0/2190491077 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f015c04be70 con 0x7f016c07be50 2023-08-11T12:14:51.656 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.840+0000 7f016b7fe700 1 --2- 172.21.15.8:0/2190491077 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7f0154038110 0x7f015403a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:14:51.656 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.840+0000 7f016b7fe700 1 --2- 172.21.15.8:0/2190491077 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7f0154038110 0x7f015403a5d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0160006fd0 tx=0x7f0160006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:14:51.656 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:50.846+0000 7f01697fa700 1 -- 172.21.15.8:0/2190491077 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f015c024430 con 0x7f016c07be50 2023-08-11T12:14:51.656 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:51.134+0000 7f01727fd700 1 -- 172.21.15.8:0/2190491077 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f016c10c560 con 0x7f016c07be50 2023-08-11T12:14:51.656 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:51.134+0000 7f01697fa700 1 -- 172.21.15.8:0/2190491077 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f015c018350 con 0x7f016c07be50 2023-08-11T12:14:51.656 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:51.137+0000 7f01727fd700 1 -- 172.21.15.8:0/2190491077 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7f0154038110 msgr2=0x7f015403a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:14:51.657 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:51.137+0000 7f01727fd700 1 --2- 172.21.15.8:0/2190491077 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7f0154038110 0x7f015403a5d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0160006fd0 tx=0x7f0160006e40 comp rx=0 tx=0).stop 2023-08-11T12:14:51.657 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:51.137+0000 7f01727fd700 1 -- 172.21.15.8:0/2190491077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f016c07be50 msgr2=0x7f016c19c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:14:51.657 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:51.137+0000 7f01727fd700 1 --2- 172.21.15.8:0/2190491077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f016c07be50 0x7f016c19c090 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f015c006af0 tx=0x7f015c011ad0 comp rx=0 tx=0).stop 2023-08-11T12:14:51.657 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:51.137+0000 7f01727fd700 1 -- 172.21.15.8:0/2190491077 shutdown_connections 2023-08-11T12:14:51.657 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:51.137+0000 7f01727fd700 1 --2- 172.21.15.8:0/2190491077 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7f0154038110 0x7f015403a5d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:14:51.657 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:51.137+0000 7f01727fd700 1 --2- 172.21.15.8:0/2190491077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f016c07be50 0x7f016c19c090 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:14:51.657 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:51.137+0000 7f01727fd700 1 -- 172.21.15.8:0/2190491077 >> 172.21.15.8:0/2190491077 conn(0x7f016c101750 msgr2=0x7f016c102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:14:51.658 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:51.137+0000 7f01727fd700 1 -- 172.21.15.8:0/2190491077 shutdown_connections 2023-08-11T12:14:51.658 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:51.137+0000 7f01727fd700 1 -- 172.21.15.8:0/2190491077 wait complete. 2023-08-11T12:14:51.658 INFO:teuthology.orchestra.run.smithi008.stdout:mgr is available 2023-08-11T12:14:52.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:52 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1175231453' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-08-11T12:14:52.820 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-08-11T12:14:52.821 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [global] 2023-08-11T12:14:52.821 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout fsid = 815f94ae-3840-11ee-9b37-001a4aab830c 2023-08-11T12:14:52.821 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-08-11T12:14:52.821 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-08-11T12:14:52.821 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-08-11T12:14:52.821 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-08-11T12:14:52.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-08-11T12:14:52.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [mgr] 2023-08-11T12:14:52.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-08-11T12:14:52.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-08-11T12:14:52.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [osd] 2023-08-11T12:14:52.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-08-11T12:14:52.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-08-11T12:14:52.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-08-11T12:14:52.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-08-11T12:14:52.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-08-11T12:14:52.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.171+0000 7fd157dd7700 1 Processor -- start 2023-08-11T12:14:52.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.171+0000 7fd157dd7700 1 -- start start 2023-08-11T12:14:52.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.171+0000 7fd157dd7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd15007be30 0x7fd15007a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:14:52.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.171+0000 7fd157dd7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15007a860 con 0x7fd15007be30 2023-08-11T12:14:52.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.171+0000 7fd155b73700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd15007be30 0x7fd15007a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:14:52.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.172+0000 7fd155b73700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd15007be30 0x7fd15007a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48982/0 (socket says 172.21.15.8:48982) 2023-08-11T12:14:52.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.172+0000 7fd155b73700 1 -- 172.21.15.8:0/122235681 learned_addr learned my addr 172.21.15.8:0/122235681 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:14:52.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.172+0000 7fd155b73700 1 -- 172.21.15.8:0/122235681 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15007a9a0 con 0x7fd15007be30 2023-08-11T12:14:52.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.172+0000 7fd155b73700 1 --2- 172.21.15.8:0/122235681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd15007be30 0x7fd15007a290 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd14c0098a0 tx=0x7fd14c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e8cd99e083b344 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:14:52.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.172+0000 7fd154b71700 1 -- 172.21.15.8:0/122235681 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd14c004160 con 0x7fd15007be30 2023-08-11T12:14:52.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.172+0000 7fd154b71700 1 -- 172.21.15.8:0/122235681 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd14c0042c0 con 0x7fd15007be30 2023-08-11T12:14:52.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.172+0000 7fd154b71700 1 -- 172.21.15.8:0/122235681 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd14c011a00 con 0x7fd15007be30 2023-08-11T12:14:52.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.173+0000 7fd157dd7700 1 -- 172.21.15.8:0/122235681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd15007be30 msgr2=0x7fd15007a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:14:52.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.173+0000 7fd157dd7700 1 --2- 172.21.15.8:0/122235681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd15007be30 0x7fd15007a290 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd14c0098a0 tx=0x7fd14c009bb0 comp rx=0 tx=0).stop 2023-08-11T12:14:52.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.173+0000 7fd157dd7700 1 -- 172.21.15.8:0/122235681 shutdown_connections 2023-08-11T12:14:52.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.173+0000 7fd157dd7700 1 --2- 172.21.15.8:0/122235681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd15007be30 0x7fd15007a290 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:14:52.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.173+0000 7fd157dd7700 1 -- 172.21.15.8:0/122235681 >> 172.21.15.8:0/122235681 conn(0x7fd150101750 msgr2=0x7fd150103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:14:52.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.173+0000 7fd157dd7700 1 -- 172.21.15.8:0/122235681 shutdown_connections 2023-08-11T12:14:52.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.173+0000 7fd157dd7700 1 -- 172.21.15.8:0/122235681 wait complete. 2023-08-11T12:14:52.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.174+0000 7fd157dd7700 1 Processor -- start 2023-08-11T12:14:52.826 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.174+0000 7fd157dd7700 1 -- start start 2023-08-11T12:14:52.826 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.175+0000 7fd157dd7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd15007be30 0x7fd15019c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:14:52.826 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.175+0000 7fd157dd7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15019c5f0 con 0x7fd15007be30 2023-08-11T12:14:52.826 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.175+0000 7fd155b73700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd15007be30 0x7fd15019c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:14:52.826 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.175+0000 7fd155b73700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd15007be30 0x7fd15019c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48996/0 (socket says 172.21.15.8:48996) 2023-08-11T12:14:52.826 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.175+0000 7fd155b73700 1 -- 172.21.15.8:0/1175231453 learned_addr learned my addr 172.21.15.8:0/1175231453 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:14:52.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.175+0000 7fd155b73700 1 -- 172.21.15.8:0/1175231453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14c009550 con 0x7fd15007be30 2023-08-11T12:14:52.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.175+0000 7fd155b73700 1 --2- 172.21.15.8:0/1175231453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd15007be30 0x7fd15019c0b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd14c006af0 tx=0x7fd14c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:14:52.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.176+0000 7fd146ffd700 1 -- 172.21.15.8:0/1175231453 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd14c003a40 con 0x7fd15007be30 2023-08-11T12:14:52.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.176+0000 7fd146ffd700 1 -- 172.21.15.8:0/1175231453 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd14c003ba0 con 0x7fd15007be30 2023-08-11T12:14:52.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.176+0000 7fd146ffd700 1 -- 172.21.15.8:0/1175231453 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd14c01a700 con 0x7fd15007be30 2023-08-11T12:14:52.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.176+0000 7fd157dd7700 1 -- 172.21.15.8:0/1175231453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd15019c7f0 con 0x7fd15007be30 2023-08-11T12:14:52.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.176+0000 7fd157dd7700 1 -- 172.21.15.8:0/1175231453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd15019cc10 con 0x7fd15007be30 2023-08-11T12:14:52.828 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.177+0000 7fd146ffd700 1 -- 172.21.15.8:0/1175231453 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 45124+0+0 (secure 0 0 0) 0x7fd14c024ad0 con 0x7fd15007be30 2023-08-11T12:14:52.828 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.177+0000 7fd157dd7700 1 -- 172.21.15.8:0/1175231453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd150061f50 con 0x7fd15007be30 2023-08-11T12:14:52.828 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.177+0000 7fd146ffd700 1 --2- 172.21.15.8:0/1175231453 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7fd13c038110 0x7fd13c03a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:14:52.828 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.178+0000 7fd146ffd700 1 -- 172.21.15.8:0/1175231453 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd14c04bed0 con 0x7fd15007be30 2023-08-11T12:14:52.828 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.178+0000 7fd155372700 1 --2- 172.21.15.8:0/1175231453 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7fd13c038110 0x7fd13c03a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:14:52.828 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.178+0000 7fd155372700 1 --2- 172.21.15.8:0/1175231453 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7fd13c038110 0x7fd13c03a5d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd140006fd0 tx=0x7fd140006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:14:52.828 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.183+0000 7fd146ffd700 1 -- 172.21.15.8:0/1175231453 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fd14c018bd0 con 0x7fd15007be30 2023-08-11T12:14:52.829 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.389+0000 7fd157dd7700 1 -- 172.21.15.8:0/1175231453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fd15010c580 con 0x7fd15007be30 2023-08-11T12:14:52.829 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.390+0000 7fd146ffd700 1 -- 172.21.15.8:0/1175231453 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fd14c0187c0 con 0x7fd15007be30 2023-08-11T12:14:52.829 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.392+0000 7fd157dd7700 1 -- 172.21.15.8:0/1175231453 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7fd13c038110 msgr2=0x7fd13c03a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:14:52.829 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.392+0000 7fd157dd7700 1 --2- 172.21.15.8:0/1175231453 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7fd13c038110 0x7fd13c03a5d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd140006fd0 tx=0x7fd140006e40 comp rx=0 tx=0).stop 2023-08-11T12:14:52.829 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.392+0000 7fd157dd7700 1 -- 172.21.15.8:0/1175231453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd15007be30 msgr2=0x7fd15019c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:14:52.829 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.392+0000 7fd157dd7700 1 --2- 172.21.15.8:0/1175231453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd15007be30 0x7fd15019c0b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd14c006af0 tx=0x7fd14c011ad0 comp rx=0 tx=0).stop 2023-08-11T12:14:52.829 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.392+0000 7fd157dd7700 1 -- 172.21.15.8:0/1175231453 shutdown_connections 2023-08-11T12:14:52.829 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.392+0000 7fd157dd7700 1 --2- 172.21.15.8:0/1175231453 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7fd13c038110 0x7fd13c03a5d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:14:52.830 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.392+0000 7fd157dd7700 1 --2- 172.21.15.8:0/1175231453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd15007be30 0x7fd15019c0b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:14:52.830 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.392+0000 7fd157dd7700 1 -- 172.21.15.8:0/1175231453 >> 172.21.15.8:0/1175231453 conn(0x7fd150101750 msgr2=0x7fd150102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:14:52.830 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.392+0000 7fd157dd7700 1 -- 172.21.15.8:0/1175231453 shutdown_connections 2023-08-11T12:14:52.830 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:52.393+0000 7fd157dd7700 1 -- 172.21.15.8:0/1175231453 wait complete. 2023-08-11T12:14:52.830 INFO:teuthology.orchestra.run.smithi008.stdout:Enabling cephadm module... 2023-08-11T12:14:53.964 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:53 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2560005242' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-08-11T12:14:53.964 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:53 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: ignoring --setuser ceph since I am not root 2023-08-11T12:14:53.965 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:53 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: ignoring --setgroup ceph since I am not root 2023-08-11T12:14:54.208 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.341+0000 7fdee13b8700 1 Processor -- start 2023-08-11T12:14:54.208 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.341+0000 7fdee13b8700 1 -- start start 2023-08-11T12:14:54.208 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.341+0000 7fdee13b8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdedc07be10 0x7fdedc07a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:14:54.208 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.341+0000 7fdee13b8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc07a840 con 0x7fdedc07be10 2023-08-11T12:14:54.208 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.341+0000 7fdedaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdedc07be10 0x7fdedc07a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:14:54.208 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.341+0000 7fdedaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdedc07be10 0x7fdedc07a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48998/0 (socket says 172.21.15.8:48998) 2023-08-11T12:14:54.209 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.341+0000 7fdedaffd700 1 -- 172.21.15.8:0/2344028362 learned_addr learned my addr 172.21.15.8:0/2344028362 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:14:54.209 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.342+0000 7fdedaffd700 1 -- 172.21.15.8:0/2344028362 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdedc07a980 con 0x7fdedc07be10 2023-08-11T12:14:54.209 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.342+0000 7fdedaffd700 1 --2- 172.21.15.8:0/2344028362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdedc07be10 0x7fdedc07a270 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdecc0098a0 tx=0x7fdecc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a346c8306af1575 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:14:54.209 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.342+0000 7fded9ffb700 1 -- 172.21.15.8:0/2344028362 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdecc004160 con 0x7fdedc07be10 2023-08-11T12:14:54.209 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.342+0000 7fded9ffb700 1 -- 172.21.15.8:0/2344028362 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdecc0042c0 con 0x7fdedc07be10 2023-08-11T12:14:54.209 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.342+0000 7fded9ffb700 1 -- 172.21.15.8:0/2344028362 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdecc011a00 con 0x7fdedc07be10 2023-08-11T12:14:54.209 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.343+0000 7fdee13b8700 1 -- 172.21.15.8:0/2344028362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdedc07be10 msgr2=0x7fdedc07a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:14:54.210 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.343+0000 7fdee13b8700 1 --2- 172.21.15.8:0/2344028362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdedc07be10 0x7fdedc07a270 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdecc0098a0 tx=0x7fdecc009bb0 comp rx=0 tx=0).stop 2023-08-11T12:14:54.210 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.343+0000 7fdee13b8700 1 -- 172.21.15.8:0/2344028362 shutdown_connections 2023-08-11T12:14:54.210 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.343+0000 7fdee13b8700 1 --2- 172.21.15.8:0/2344028362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdedc07be10 0x7fdedc07a270 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:14:54.210 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.343+0000 7fdee13b8700 1 -- 172.21.15.8:0/2344028362 >> 172.21.15.8:0/2344028362 conn(0x7fdedc101750 msgr2=0x7fdedc103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:14:54.210 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.343+0000 7fdee13b8700 1 -- 172.21.15.8:0/2344028362 shutdown_connections 2023-08-11T12:14:54.210 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.343+0000 7fdee13b8700 1 -- 172.21.15.8:0/2344028362 wait complete. 2023-08-11T12:14:54.210 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.344+0000 7fdee13b8700 1 Processor -- start 2023-08-11T12:14:54.210 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.344+0000 7fdee13b8700 1 -- start start 2023-08-11T12:14:54.211 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.345+0000 7fdee13b8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdedc07be10 0x7fdedc19c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:14:54.211 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.345+0000 7fdee13b8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc19c5c0 con 0x7fdedc07be10 2023-08-11T12:14:54.211 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.345+0000 7fdedaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdedc07be10 0x7fdedc19c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:14:54.211 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.345+0000 7fdedaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdedc07be10 0x7fdedc19c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49010/0 (socket says 172.21.15.8:49010) 2023-08-11T12:14:54.211 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.345+0000 7fdedaffd700 1 -- 172.21.15.8:0/2560005242 learned_addr learned my addr 172.21.15.8:0/2560005242 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:14:54.211 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.345+0000 7fdedaffd700 1 -- 172.21.15.8:0/2560005242 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc009550 con 0x7fdedc07be10 2023-08-11T12:14:54.211 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.345+0000 7fdedaffd700 1 --2- 172.21.15.8:0/2560005242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdedc07be10 0x7fdedc19c080 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdecc006af0 tx=0x7fdecc011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:14:54.212 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.346+0000 7fdec3fff700 1 -- 172.21.15.8:0/2560005242 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdecc003a40 con 0x7fdedc07be10 2023-08-11T12:14:54.212 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.346+0000 7fdec3fff700 1 -- 172.21.15.8:0/2560005242 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdecc003ba0 con 0x7fdedc07be10 2023-08-11T12:14:54.212 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.346+0000 7fdec3fff700 1 -- 172.21.15.8:0/2560005242 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdecc01a6e0 con 0x7fdedc07be10 2023-08-11T12:14:54.212 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.346+0000 7fdee13b8700 1 -- 172.21.15.8:0/2560005242 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdedc19c7c0 con 0x7fdedc07be10 2023-08-11T12:14:54.212 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.346+0000 7fdee13b8700 1 -- 172.21.15.8:0/2560005242 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdedc19cbe0 con 0x7fdedc07be10 2023-08-11T12:14:54.212 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.347+0000 7fdec3fff700 1 -- 172.21.15.8:0/2560005242 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 45124+0+0 (secure 0 0 0) 0x7fdecc024a60 con 0x7fdedc07be10 2023-08-11T12:14:54.212 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.347+0000 7fdee13b8700 1 -- 172.21.15.8:0/2560005242 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdedc061f50 con 0x7fdedc07be10 2023-08-11T12:14:54.213 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.347+0000 7fdec3fff700 1 --2- 172.21.15.8:0/2560005242 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7fdec4038110 0x7fdec403a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:14:54.213 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.347+0000 7fdec3fff700 1 -- 172.21.15.8:0/2560005242 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdecc04bef0 con 0x7fdedc07be10 2023-08-11T12:14:54.213 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.347+0000 7fdeda7fc700 1 --2- 172.21.15.8:0/2560005242 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7fdec4038110 0x7fdec403a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:14:54.214 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.348+0000 7fdeda7fc700 1 --2- 172.21.15.8:0/2560005242 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7fdec4038110 0x7fdec403a5d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fded0006fd0 tx=0x7fded0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:14:54.214 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.352+0000 7fdec3fff700 1 -- 172.21.15.8:0/2560005242 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fdecc024430 con 0x7fdedc07be10 2023-08-11T12:14:54.214 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.619+0000 7fdee13b8700 1 -- 172.21.15.8:0/2560005242 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fdedc10c5a0 con 0x7fdedc07be10 2023-08-11T12:14:54.214 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.672+0000 7fdec3fff700 1 -- 172.21.15.8:0/2560005242 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 5) v1 ==== 45135+0+0 (secure 0 0 0) 0x7fdecc02d910 con 0x7fdedc07be10 2023-08-11T12:14:54.214 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.674+0000 7fdec3fff700 1 -- 172.21.15.8:0/2560005242 <== mon.0 v2:172.21.15.8:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fdecc00bc90 con 0x7fdedc07be10 2023-08-11T12:14:54.215 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.676+0000 7fdee13b8700 1 -- 172.21.15.8:0/2560005242 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7fdec4038110 msgr2=0x7fdec403a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:14:54.215 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.676+0000 7fdee13b8700 1 --2- 172.21.15.8:0/2560005242 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7fdec4038110 0x7fdec403a5d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fded0006fd0 tx=0x7fded0006e40 comp rx=0 tx=0).stop 2023-08-11T12:14:54.215 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.676+0000 7fdee13b8700 1 -- 172.21.15.8:0/2560005242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdedc07be10 msgr2=0x7fdedc19c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:14:54.215 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.676+0000 7fdee13b8700 1 --2- 172.21.15.8:0/2560005242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdedc07be10 0x7fdedc19c080 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdecc006af0 tx=0x7fdecc011ad0 comp rx=0 tx=0).stop 2023-08-11T12:14:54.215 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.676+0000 7fdee13b8700 1 -- 172.21.15.8:0/2560005242 shutdown_connections 2023-08-11T12:14:54.215 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.676+0000 7fdee13b8700 1 --2- 172.21.15.8:0/2560005242 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7fdec4038110 0x7fdec403a5d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:14:54.215 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.676+0000 7fdee13b8700 1 --2- 172.21.15.8:0/2560005242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdedc07be10 0x7fdedc19c080 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:14:54.216 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.676+0000 7fdee13b8700 1 -- 172.21.15.8:0/2560005242 >> 172.21.15.8:0/2560005242 conn(0x7fdedc101750 msgr2=0x7fdedc102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:14:54.216 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.677+0000 7fdee13b8700 1 -- 172.21.15.8:0/2560005242 shutdown_connections 2023-08-11T12:14:54.216 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:53.677+0000 7fdee13b8700 1 -- 172.21.15.8:0/2560005242 wait complete. 2023-08-11T12:14:54.219 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:53 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:53.962+0000 7fe9668f6200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-11T12:14:54.219 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:54 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:54.070+0000 7fe9668f6200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-11T12:14:54.219 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:54 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:54.188+0000 7fe9668f6200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-11T12:14:54.470 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:54 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:54.328+0000 7fe9668f6200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-11T12:14:54.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:54 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2560005242' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-08-11T12:14:54.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:54 smithi008 ceph-mon[97158]: mgrmap e5: x(active, since 7s) 2023-08-11T12:14:54.803 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:54 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:54.569+0000 7fe9668f6200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-11T12:14:55.303 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:55 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:55.050+0000 7fe9668f6200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-11T12:14:55.303 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:55 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:55.225+0000 7fe9668f6200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-11T12:14:55.484 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-08-11T12:14:55.485 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-08-11T12:14:55.485 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "available": true, 2023-08-11T12:14:55.485 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-08-11T12:14:55.485 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-08-11T12:14:55.485 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-08-11T12:14:55.485 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.741+0000 7fef436aa700 1 Processor -- start 2023-08-11T12:14:55.486 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.741+0000 7fef436aa700 1 -- start start 2023-08-11T12:14:55.486 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.741+0000 7fef436aa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef3c07be10 0x7fef3c07a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:14:55.486 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.741+0000 7fef436aa700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c07a840 con 0x7fef3c07be10 2023-08-11T12:14:55.486 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.742+0000 7fef41446700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef3c07be10 0x7fef3c07a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:14:55.486 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.742+0000 7fef41446700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef3c07be10 0x7fef3c07a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49038/0 (socket says 172.21.15.8:49038) 2023-08-11T12:14:55.486 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.742+0000 7fef41446700 1 -- 172.21.15.8:0/2282454978 learned_addr learned my addr 172.21.15.8:0/2282454978 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:14:55.486 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.742+0000 7fef41446700 1 -- 172.21.15.8:0/2282454978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c07a980 con 0x7fef3c07be10 2023-08-11T12:14:55.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.742+0000 7fef41446700 1 --2- 172.21.15.8:0/2282454978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef3c07be10 0x7fef3c07a270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fef380098a0 tx=0x7fef38009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234d81105d732622 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:14:55.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.743+0000 7fef33fff700 1 -- 172.21.15.8:0/2282454978 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef38004160 con 0x7fef3c07be10 2023-08-11T12:14:55.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.743+0000 7fef33fff700 1 -- 172.21.15.8:0/2282454978 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fef380042c0 con 0x7fef3c07be10 2023-08-11T12:14:55.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.743+0000 7fef33fff700 1 -- 172.21.15.8:0/2282454978 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef38011a00 con 0x7fef3c07be10 2023-08-11T12:14:55.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.743+0000 7fef436aa700 1 -- 172.21.15.8:0/2282454978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef3c07be10 msgr2=0x7fef3c07a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:14:55.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.743+0000 7fef436aa700 1 --2- 172.21.15.8:0/2282454978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef3c07be10 0x7fef3c07a270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fef380098a0 tx=0x7fef38009bb0 comp rx=0 tx=0).stop 2023-08-11T12:14:55.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.743+0000 7fef436aa700 1 -- 172.21.15.8:0/2282454978 shutdown_connections 2023-08-11T12:14:55.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.743+0000 7fef436aa700 1 --2- 172.21.15.8:0/2282454978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef3c07be10 0x7fef3c07a270 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:14:55.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.743+0000 7fef436aa700 1 -- 172.21.15.8:0/2282454978 >> 172.21.15.8:0/2282454978 conn(0x7fef3c101750 msgr2=0x7fef3c103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:14:55.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.744+0000 7fef436aa700 1 -- 172.21.15.8:0/2282454978 shutdown_connections 2023-08-11T12:14:55.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.744+0000 7fef436aa700 1 -- 172.21.15.8:0/2282454978 wait complete. 2023-08-11T12:14:55.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.745+0000 7fef436aa700 1 Processor -- start 2023-08-11T12:14:55.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.745+0000 7fef436aa700 1 -- start start 2023-08-11T12:14:55.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.745+0000 7fef436aa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef3c07be10 0x7fef3c19c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:14:55.489 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.745+0000 7fef436aa700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c19c580 con 0x7fef3c07be10 2023-08-11T12:14:55.489 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.745+0000 7fef41446700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef3c07be10 0x7fef3c19c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:14:55.489 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.745+0000 7fef41446700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef3c07be10 0x7fef3c19c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49048/0 (socket says 172.21.15.8:49048) 2023-08-11T12:14:55.489 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.745+0000 7fef41446700 1 -- 172.21.15.8:0/3775512952 learned_addr learned my addr 172.21.15.8:0/3775512952 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:14:55.489 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.746+0000 7fef41446700 1 -- 172.21.15.8:0/3775512952 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef38009550 con 0x7fef3c07be10 2023-08-11T12:14:55.489 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.746+0000 7fef41446700 1 --2- 172.21.15.8:0/3775512952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef3c07be10 0x7fef3c19c040 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fef38006af0 tx=0x7fef38011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:14:55.489 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.746+0000 7fef327fc700 1 -- 172.21.15.8:0/3775512952 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef38003a40 con 0x7fef3c07be10 2023-08-11T12:14:55.489 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.746+0000 7fef327fc700 1 -- 172.21.15.8:0/3775512952 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fef38003ba0 con 0x7fef3c07be10 2023-08-11T12:14:55.490 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.746+0000 7fef436aa700 1 -- 172.21.15.8:0/3775512952 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef3c19c780 con 0x7fef3c07be10 2023-08-11T12:14:55.490 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.746+0000 7fef327fc700 1 -- 172.21.15.8:0/3775512952 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef3801a6e0 con 0x7fef3c07be10 2023-08-11T12:14:55.490 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.746+0000 7fef436aa700 1 -- 172.21.15.8:0/3775512952 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef3c19cba0 con 0x7fef3c07be10 2023-08-11T12:14:55.490 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.747+0000 7fef327fc700 1 -- 172.21.15.8:0/3775512952 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 45135+0+0 (secure 0 0 0) 0x7fef3801a950 con 0x7fef3c07be10 2023-08-11T12:14:55.490 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.748+0000 7fef436aa700 1 -- 172.21.15.8:0/3775512952 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef3c061f50 con 0x7fef3c07be10 2023-08-11T12:14:55.490 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.748+0000 7fef327fc700 1 --2- 172.21.15.8:0/3775512952 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7fef28038160 0x7fef2803a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:14:55.490 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.748+0000 7fef327fc700 1 -- 172.21.15.8:0/3775512952 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fef3804c1f0 con 0x7fef3c07be10 2023-08-11T12:14:55.491 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.748+0000 7fef40c45700 1 -- 172.21.15.8:0/3775512952 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7fef28038160 msgr2=0x7fef2803a620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2108474030 2023-08-11T12:14:55.491 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.748+0000 7fef40c45700 1 --2- 172.21.15.8:0/3775512952 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7fef28038160 0x7fef2803a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-11T12:14:55.491 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.753+0000 7fef327fc700 1 -- 172.21.15.8:0/3775512952 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fef3801ac00 con 0x7fef3c07be10 2023-08-11T12:14:55.491 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.949+0000 7fef40c45700 1 -- 172.21.15.8:0/3775512952 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7fef28038160 msgr2=0x7fef2803a620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2108474030 2023-08-11T12:14:55.491 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:54.949+0000 7fef40c45700 1 --2- 172.21.15.8:0/3775512952 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7fef28038160 0x7fef2803a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-11T12:14:55.491 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:55.019+0000 7fef436aa700 1 -- 172.21.15.8:0/3775512952 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fef3c19f900 con 0x7fef3c07be10 2023-08-11T12:14:55.491 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:55.019+0000 7fef327fc700 1 -- 172.21.15.8:0/3775512952 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7fef38018350 con 0x7fef3c07be10 2023-08-11T12:14:55.491 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:55.022+0000 7fef436aa700 1 -- 172.21.15.8:0/3775512952 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7fef28038160 msgr2=0x7fef2803a620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-11T12:14:55.492 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:55.022+0000 7fef436aa700 1 --2- 172.21.15.8:0/3775512952 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7fef28038160 0x7fef2803a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:14:55.492 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:55.022+0000 7fef436aa700 1 -- 172.21.15.8:0/3775512952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef3c07be10 msgr2=0x7fef3c19c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:14:55.492 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:55.022+0000 7fef436aa700 1 --2- 172.21.15.8:0/3775512952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef3c07be10 0x7fef3c19c040 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fef38006af0 tx=0x7fef38011ad0 comp rx=0 tx=0).stop 2023-08-11T12:14:55.492 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:55.022+0000 7fef436aa700 1 -- 172.21.15.8:0/3775512952 shutdown_connections 2023-08-11T12:14:55.492 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:55.022+0000 7fef436aa700 1 --2- 172.21.15.8:0/3775512952 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7fef28038160 0x7fef2803a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:14:55.492 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:55.022+0000 7fef436aa700 1 --2- 172.21.15.8:0/3775512952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef3c07be10 0x7fef3c19c040 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:14:55.492 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:55.022+0000 7fef436aa700 1 -- 172.21.15.8:0/3775512952 >> 172.21.15.8:0/3775512952 conn(0x7fef3c101750 msgr2=0x7fef3c102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:14:55.493 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:55.022+0000 7fef436aa700 1 -- 172.21.15.8:0/3775512952 shutdown_connections 2023-08-11T12:14:55.493 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:55.022+0000 7fef436aa700 1 -- 172.21.15.8:0/3775512952 wait complete. 2023-08-11T12:14:55.493 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for the mgr to restart... 2023-08-11T12:14:55.493 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mgr epoch 5... 2023-08-11T12:14:55.677 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:55 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:55.347+0000 7fe9668f6200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-11T12:14:55.677 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:55 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:55.476+0000 7fe9668f6200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-11T12:14:56.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:14:55 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3775512952' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-08-11T12:14:56.553 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:56 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:56.056+0000 7fe9668f6200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-11T12:14:57.303 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:56 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:56.930+0000 7fe9668f6200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-11T12:14:57.303 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:57 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:57.040+0000 7fe9668f6200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-11T12:14:58.303 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:58 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:58.030+0000 7fe9668f6200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-11T12:14:58.303 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:58 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:58.153+0000 7fe9668f6200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-11T12:14:58.758 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:58 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:58.383+0000 7fe9668f6200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-11T12:14:59.041 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:58 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:58.756+0000 7fe9668f6200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-11T12:14:59.303 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:59 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:59.037+0000 7fe9668f6200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-11T12:14:59.303 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:59 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:59.238+0000 7fe9668f6200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-11T12:15:00.053 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:14:59 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:14:59.595+0000 7fe9668f6200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-11T12:15:01.000 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:00 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:00.561+0000 7fe9668f6200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-11T12:15:01.001 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:00 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:00.740+0000 7fe9668f6200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-11T12:15:01.303 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:00 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:00.997+0000 7fe9668f6200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-11T12:15:01.303 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:01 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:01.148+0000 7fe9668f6200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-11T12:15:01.803 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:01 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:01.431+0000 7fe9668f6200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-11T12:15:02.803 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:02 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:02.525+0000 7fe9668f6200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-11T12:15:02.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:02 smithi008 ceph-mon[97158]: Active manager daemon x restarted 2023-08-11T12:15:02.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:02 smithi008 ceph-mon[97158]: Activating manager daemon x 2023-08-11T12:15:02.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:02 smithi008 ceph-mon[97158]: osdmap e2: 0 total, 0 up, 0 in 2023-08-11T12:15:02.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:02 smithi008 ceph-mon[97158]: mgrmap e6: x(active, starting, since 0.00383665s) 2023-08-11T12:15:02.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:02 smithi008 ceph-mon[97158]: from='mgr.14118 172.21.15.8:0/2457302423' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-11T12:15:02.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:02 smithi008 ceph-mon[97158]: from='mgr.14118 172.21.15.8:0/2457302423' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-08-11T12:15:02.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:02 smithi008 ceph-mon[97158]: from='mgr.14118 172.21.15.8:0/2457302423' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-08-11T12:15:02.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:02 smithi008 ceph-mon[97158]: from='mgr.14118 172.21.15.8:0/2457302423' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-08-11T12:15:02.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:02 smithi008 ceph-mon[97158]: from='mgr.14118 172.21.15.8:0/2457302423' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-08-11T12:15:02.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:02 smithi008 ceph-mon[97158]: Manager daemon x is now available 2023-08-11T12:15:02.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:02 smithi008 ceph-mon[97158]: from='mgr.14118 172.21.15.8:0/2457302423' entity='mgr.x' 2023-08-11T12:15:02.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:02 smithi008 ceph-mon[97158]: from='mgr.14118 172.21.15.8:0/2457302423' entity='mgr.x' 2023-08-11T12:15:02.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:02 smithi008 ceph-mon[97158]: from='mgr.14118 172.21.15.8:0/2457302423' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:15:02.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:02 smithi008 ceph-mon[97158]: from='mgr.14118 172.21.15.8:0/2457302423' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:15:03.957 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:03 smithi008 ceph-mon[97158]: Found migration_current of "None". Setting to last migration. 2023-08-11T12:15:03.957 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:03 smithi008 ceph-mon[97158]: from='mgr.14118 172.21.15.8:0/2457302423' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:15:03.957 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:03 smithi008 ceph-mon[97158]: from='mgr.14118 172.21.15.8:0/2457302423' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-08-11T12:15:03.957 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:03 smithi008 ceph-mon[97158]: from='mgr.14118 172.21.15.8:0/2457302423' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-08-11T12:15:03.957 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:03 smithi008 ceph-mon[97158]: mgrmap e7: x(active, since 1.00657s) 2023-08-11T12:15:03.979 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-08-11T12:15:03.981 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-08-11T12:15:03.982 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "initialized": true 2023-08-11T12:15:03.982 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-08-11T12:15:03.982 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:55.998+0000 7f93ad982700 1 Processor -- start 2023-08-11T12:15:03.983 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:55.998+0000 7f93ad982700 1 -- start start 2023-08-11T12:15:03.983 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:55.998+0000 7f93ad982700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a81061b0 0x7f93a81065d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:03.983 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:55.998+0000 7f93ad982700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a8106ba0 con 0x7f93a81061b0 2023-08-11T12:15:03.983 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:55.998+0000 7f93a6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a81061b0 0x7f93a81065d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:03.983 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:55.999+0000 7f93a6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a81061b0 0x7f93a81065d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49054/0 (socket says 172.21.15.8:49054) 2023-08-11T12:15:03.983 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:55.999+0000 7f93a6ffd700 1 -- 172.21.15.8:0/56408576 learned_addr learned my addr 172.21.15.8:0/56408576 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:03.983 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:55.999+0000 7f93a6ffd700 1 -- 172.21.15.8:0/56408576 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a81073b0 con 0x7f93a81061b0 2023-08-11T12:15:03.984 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:55.999+0000 7f93a6ffd700 1 --2- 172.21.15.8:0/56408576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a81061b0 0x7f93a81065d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f93980098a0 tx=0x7f9398009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a1e5fe017f3a6e server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:03.984 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:55.999+0000 7f93a5ffb700 1 -- 172.21.15.8:0/56408576 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9398004160 con 0x7f93a81061b0 2023-08-11T12:15:03.984 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:55.999+0000 7f93a5ffb700 1 -- 172.21.15.8:0/56408576 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f93980042c0 con 0x7f93a81061b0 2023-08-11T12:15:03.984 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:55.999+0000 7f93a5ffb700 1 -- 172.21.15.8:0/56408576 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9398011a00 con 0x7f93a81061b0 2023-08-11T12:15:03.984 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.000+0000 7f93ad982700 1 -- 172.21.15.8:0/56408576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a81061b0 msgr2=0x7f93a81065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:03.984 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.000+0000 7f93ad982700 1 --2- 172.21.15.8:0/56408576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a81061b0 0x7f93a81065d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f93980098a0 tx=0x7f9398009bb0 comp rx=0 tx=0).stop 2023-08-11T12:15:03.984 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.000+0000 7f93ad982700 1 -- 172.21.15.8:0/56408576 shutdown_connections 2023-08-11T12:15:03.985 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.000+0000 7f93ad982700 1 --2- 172.21.15.8:0/56408576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a81061b0 0x7f93a81065d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:03.985 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.000+0000 7f93ad982700 1 -- 172.21.15.8:0/56408576 >> 172.21.15.8:0/56408576 conn(0x7f93a8101750 msgr2=0x7f93a8103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:03.985 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.000+0000 7f93ad982700 1 -- 172.21.15.8:0/56408576 shutdown_connections 2023-08-11T12:15:03.985 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.000+0000 7f93ad982700 1 -- 172.21.15.8:0/56408576 wait complete. 2023-08-11T12:15:03.989 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.001+0000 7f93ad982700 1 Processor -- start 2023-08-11T12:15:03.989 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.002+0000 7f93ad982700 1 -- start start 2023-08-11T12:15:03.989 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.002+0000 7f93ad982700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a81061b0 0x7f93a8199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:03.989 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.002+0000 7f93ad982700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a819a3f0 con 0x7f93a81061b0 2023-08-11T12:15:03.989 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.002+0000 7f93a6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a81061b0 0x7f93a8199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:03.989 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.002+0000 7f93a6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a81061b0 0x7f93a8199eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49056/0 (socket says 172.21.15.8:49056) 2023-08-11T12:15:03.990 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.002+0000 7f93a6ffd700 1 -- 172.21.15.8:0/1475299363 learned_addr learned my addr 172.21.15.8:0/1475299363 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:03.990 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.002+0000 7f93a6ffd700 1 -- 172.21.15.8:0/1475299363 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9398009550 con 0x7f93a81061b0 2023-08-11T12:15:03.990 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.003+0000 7f93a6ffd700 1 --2- 172.21.15.8:0/1475299363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a81061b0 0x7f93a8199eb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9398006af0 tx=0x7f9398011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:03.990 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.003+0000 7f93ac980700 1 -- 172.21.15.8:0/1475299363 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9398003a40 con 0x7f93a81061b0 2023-08-11T12:15:03.990 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.003+0000 7f93ac980700 1 -- 172.21.15.8:0/1475299363 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9398003ba0 con 0x7f93a81061b0 2023-08-11T12:15:03.990 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.003+0000 7f93ac980700 1 -- 172.21.15.8:0/1475299363 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f939801a700 con 0x7f93a81061b0 2023-08-11T12:15:03.990 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.003+0000 7f93ad982700 1 -- 172.21.15.8:0/1475299363 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a819a5f0 con 0x7f93a81061b0 2023-08-11T12:15:03.991 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.003+0000 7f93ad982700 1 -- 172.21.15.8:0/1475299363 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a819aa10 con 0x7f93a81061b0 2023-08-11T12:15:03.991 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.004+0000 7f93ac980700 1 -- 172.21.15.8:0/1475299363 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 45135+0+0 (secure 0 0 0) 0x7f9398024ad0 con 0x7f93a81061b0 2023-08-11T12:15:03.991 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.005+0000 7f93ac980700 1 --2- 172.21.15.8:0/1475299363 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7f9390038160 0x7f939003a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:03.991 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.005+0000 7f93ac980700 1 -- 172.21.15.8:0/1475299363 --> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f939003ad30 con 0x7f9390038160 2023-08-11T12:15:03.991 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.005+0000 7f93ac980700 1 -- 172.21.15.8:0/1475299363 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f939804beb0 con 0x7f93a81061b0 2023-08-11T12:15:03.991 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.005+0000 7f93a67fc700 1 -- 172.21.15.8:0/1475299363 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7f9390038160 msgr2=0x7f939003a620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2108474030 2023-08-11T12:15:03.991 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.005+0000 7f93a67fc700 1 --2- 172.21.15.8:0/1475299363 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7f9390038160 0x7f939003a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-11T12:15:03.991 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.206+0000 7f93a67fc700 1 -- 172.21.15.8:0/1475299363 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7f9390038160 msgr2=0x7f939003a620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2108474030 2023-08-11T12:15:03.992 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.206+0000 7f93a67fc700 1 --2- 172.21.15.8:0/1475299363 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7f9390038160 0x7f939003a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-11T12:15:03.992 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.607+0000 7f93a67fc700 1 -- 172.21.15.8:0/1475299363 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7f9390038160 msgr2=0x7f939003a620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2108474030 2023-08-11T12:15:03.992 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:56.607+0000 7f93a67fc700 1 --2- 172.21.15.8:0/1475299363 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7f9390038160 0x7f939003a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-08-11T12:15:03.992 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:57.408+0000 7f93a67fc700 1 -- 172.21.15.8:0/1475299363 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7f9390038160 msgr2=0x7f939003a620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2108474030 2023-08-11T12:15:03.993 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:57.408+0000 7f93a67fc700 1 --2- 172.21.15.8:0/1475299363 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7f9390038160 0x7f939003a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-08-11T12:15:03.993 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:59.009+0000 7f93a67fc700 1 -- 172.21.15.8:0/1475299363 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7f9390038160 msgr2=0x7f939003a620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2108474030 2023-08-11T12:15:03.993 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:14:59.009+0000 7f93a67fc700 1 --2- 172.21.15.8:0/1475299363 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7f9390038160 0x7f939003a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-08-11T12:15:03.993 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:02.212+0000 7f93a67fc700 1 -- 172.21.15.8:0/1475299363 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7f9390038160 msgr2=0x7f939003a620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2108474030 2023-08-11T12:15:03.994 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:02.212+0000 7f93a67fc700 1 --2- 172.21.15.8:0/1475299363 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7f9390038160 0x7f939003a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-08-11T12:15:03.994 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:02.529+0000 7f93ac980700 1 -- 172.21.15.8:0/1475299363 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mgrmap(e 6) v1 ==== 44902+0+0 (secure 0 0 0) 0x7f939802d910 con 0x7f93a81061b0 2023-08-11T12:15:03.994 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:02.529+0000 7f93ac980700 1 -- 172.21.15.8:0/1475299363 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7f9390038160 msgr2=0x7f939003a620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-11T12:15:03.995 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:02.529+0000 7f93ac980700 1 --2- 172.21.15.8:0/1475299363 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7f9390038160 0x7f939003a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:03.995 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:03.531+0000 7f93ac980700 1 -- 172.21.15.8:0/1475299363 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 7) v1 ==== 45029+0+0 (secure 0 0 0) 0x7f939804d970 con 0x7f93a81061b0 2023-08-11T12:15:03.995 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:03.532+0000 7f93ac980700 1 --2- 172.21.15.8:0/1475299363 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f939003ba80 0x7f939003de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:03.995 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:03.532+0000 7f93ac980700 1 -- 172.21.15.8:0/1475299363 --> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f939003ad30 con 0x7f939003ba80 2023-08-11T12:15:03.995 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:03.532+0000 7f93a67fc700 1 --2- 172.21.15.8:0/1475299363 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f939003ba80 0x7f939003de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:03.995 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:03.534+0000 7f93a67fc700 1 --2- 172.21.15.8:0/1475299363 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f939003ba80 0x7f939003de70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f939c003a10 tx=0x7f939c0092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:03.995 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:03.534+0000 7f93ac980700 1 -- 172.21.15.8:0/1475299363 <== mgr.14118 v2:172.21.15.8:6800/2832004641 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f939003ad30 con 0x7f939003ba80 2023-08-11T12:15:03.995 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:03.541+0000 7f93ad982700 1 -- 172.21.15.8:0/1475299363 --> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f93a819b1f0 con 0x7f939003ba80 2023-08-11T12:15:03.996 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:03.541+0000 7f93ac980700 1 -- 172.21.15.8:0/1475299363 <== mgr.14118 v2:172.21.15.8:6800/2832004641 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f93a819b1f0 con 0x7f939003ba80 2023-08-11T12:15:03.996 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:03.542+0000 7f93ad982700 1 -- 172.21.15.8:0/1475299363 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f939003ba80 msgr2=0x7f939003de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:03.996 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:03.542+0000 7f93ad982700 1 --2- 172.21.15.8:0/1475299363 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f939003ba80 0x7f939003de70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f939c003a10 tx=0x7f939c0092b0 comp rx=0 tx=0).stop 2023-08-11T12:15:03.996 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:03.542+0000 7f93ad982700 1 -- 172.21.15.8:0/1475299363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a81061b0 msgr2=0x7f93a8199eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:03.996 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:03.542+0000 7f93ad982700 1 --2- 172.21.15.8:0/1475299363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a81061b0 0x7f93a8199eb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9398006af0 tx=0x7f9398011ad0 comp rx=0 tx=0).stop 2023-08-11T12:15:03.996 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:03.542+0000 7f93ad982700 1 -- 172.21.15.8:0/1475299363 shutdown_connections 2023-08-11T12:15:03.996 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:03.542+0000 7f93ad982700 1 --2- 172.21.15.8:0/1475299363 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f939003ba80 0x7f939003de70 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:03.997 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:03.542+0000 7f93ad982700 1 --2- 172.21.15.8:0/1475299363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a81061b0 0x7f93a8199eb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:03.997 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:03.542+0000 7f93ad982700 1 --2- 172.21.15.8:0/1475299363 >> [v2:172.21.15.8:6800/2108474030,v1:172.21.15.8:6801/2108474030] conn(0x7f9390038160 0x7f939003a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:03.997 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:03.542+0000 7f93ad982700 1 -- 172.21.15.8:0/1475299363 >> 172.21.15.8:0/1475299363 conn(0x7f93a8101750 msgr2=0x7f93a8102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:03.997 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:03.542+0000 7f93ad982700 1 -- 172.21.15.8:0/1475299363 shutdown_connections 2023-08-11T12:15:03.997 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:03.542+0000 7f93ad982700 1 -- 172.21.15.8:0/1475299363 wait complete. 2023-08-11T12:15:03.997 INFO:teuthology.orchestra.run.smithi008.stdout:mgr epoch 5 is available 2023-08-11T12:15:03.997 INFO:teuthology.orchestra.run.smithi008.stdout:Setting orchestrator backend to cephadm... 2023-08-11T12:15:04.944 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:04 smithi008 ceph-mon[97158]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-08-11T12:15:04.945 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:04 smithi008 ceph-mon[97158]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-08-11T12:15:04.945 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:04 smithi008 ceph-mon[97158]: from='mgr.14118 172.21.15.8:0/2457302423' entity='mgr.x' 2023-08-11T12:15:04.945 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:04 smithi008 ceph-mon[97158]: from='mgr.14118 172.21.15.8:0/2457302423' entity='mgr.x' 2023-08-11T12:15:04.945 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:04 smithi008 ceph-mon[97158]: from='mgr.14118 172.21.15.8:0/2457302423' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:15:05.267 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.537+0000 7f0cac55e700 1 Processor -- start 2023-08-11T12:15:05.267 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.537+0000 7f0cac55e700 1 -- start start 2023-08-11T12:15:05.267 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.537+0000 7f0cac55e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ca407bdf0 0x7f0ca407a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:05.268 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.537+0000 7f0cac55e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca407a820 con 0x7f0ca407bdf0 2023-08-11T12:15:05.268 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.537+0000 7f0caa2fa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ca407bdf0 0x7f0ca407a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:05.268 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.538+0000 7f0caa2fa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ca407bdf0 0x7f0ca407a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59334/0 (socket says 172.21.15.8:59334) 2023-08-11T12:15:05.268 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.538+0000 7f0caa2fa700 1 -- 172.21.15.8:0/1605744746 learned_addr learned my addr 172.21.15.8:0/1605744746 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:05.268 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.538+0000 7f0caa2fa700 1 -- 172.21.15.8:0/1605744746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca407a960 con 0x7f0ca407bdf0 2023-08-11T12:15:05.268 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.538+0000 7f0caa2fa700 1 --2- 172.21.15.8:0/1605744746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ca407bdf0 0x7f0ca407a250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0ca00098a0 tx=0x7f0ca0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f791fc4fc453af35 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:05.268 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.538+0000 7f0ca92f8700 1 -- 172.21.15.8:0/1605744746 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ca0004160 con 0x7f0ca407bdf0 2023-08-11T12:15:05.269 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.538+0000 7f0ca92f8700 1 -- 172.21.15.8:0/1605744746 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0ca00042c0 con 0x7f0ca407bdf0 2023-08-11T12:15:05.269 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.538+0000 7f0ca92f8700 1 -- 172.21.15.8:0/1605744746 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ca0011a00 con 0x7f0ca407bdf0 2023-08-11T12:15:05.269 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.539+0000 7f0cac55e700 1 -- 172.21.15.8:0/1605744746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ca407bdf0 msgr2=0x7f0ca407a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:05.270 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.539+0000 7f0cac55e700 1 --2- 172.21.15.8:0/1605744746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ca407bdf0 0x7f0ca407a250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0ca00098a0 tx=0x7f0ca0009bb0 comp rx=0 tx=0).stop 2023-08-11T12:15:05.270 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.539+0000 7f0cac55e700 1 -- 172.21.15.8:0/1605744746 shutdown_connections 2023-08-11T12:15:05.270 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.539+0000 7f0cac55e700 1 --2- 172.21.15.8:0/1605744746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ca407bdf0 0x7f0ca407a250 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:05.270 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.539+0000 7f0cac55e700 1 -- 172.21.15.8:0/1605744746 >> 172.21.15.8:0/1605744746 conn(0x7f0ca4101750 msgr2=0x7f0ca4103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:05.270 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.539+0000 7f0cac55e700 1 -- 172.21.15.8:0/1605744746 shutdown_connections 2023-08-11T12:15:05.270 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.539+0000 7f0cac55e700 1 -- 172.21.15.8:0/1605744746 wait complete. 2023-08-11T12:15:05.270 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.540+0000 7f0cac55e700 1 Processor -- start 2023-08-11T12:15:05.271 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.540+0000 7f0cac55e700 1 -- start start 2023-08-11T12:15:05.271 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.541+0000 7f0cac55e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ca407bdf0 0x7f0ca4109560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:05.271 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.541+0000 7f0cac55e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca4109aa0 con 0x7f0ca407bdf0 2023-08-11T12:15:05.271 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.541+0000 7f0caa2fa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ca407bdf0 0x7f0ca4109560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:05.271 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.541+0000 7f0caa2fa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ca407bdf0 0x7f0ca4109560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59336/0 (socket says 172.21.15.8:59336) 2023-08-11T12:15:05.271 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.541+0000 7f0caa2fa700 1 -- 172.21.15.8:0/3453708986 learned_addr learned my addr 172.21.15.8:0/3453708986 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:05.271 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.541+0000 7f0caa2fa700 1 -- 172.21.15.8:0/3453708986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca0009550 con 0x7f0ca407bdf0 2023-08-11T12:15:05.272 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.541+0000 7f0caa2fa700 1 --2- 172.21.15.8:0/3453708986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ca407bdf0 0x7f0ca4109560 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0006af0 tx=0x7f0ca0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:05.272 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.542+0000 7f0c9b7fe700 1 -- 172.21.15.8:0/3453708986 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ca0003a40 con 0x7f0ca407bdf0 2023-08-11T12:15:05.272 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.542+0000 7f0c9b7fe700 1 -- 172.21.15.8:0/3453708986 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0ca0003ba0 con 0x7f0ca407bdf0 2023-08-11T12:15:05.272 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.542+0000 7f0cac55e700 1 -- 172.21.15.8:0/3453708986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca4109ca0 con 0x7f0ca407bdf0 2023-08-11T12:15:05.272 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.542+0000 7f0c9b7fe700 1 -- 172.21.15.8:0/3453708986 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ca001a6e0 con 0x7f0ca407bdf0 2023-08-11T12:15:05.272 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.542+0000 7f0cac55e700 1 -- 172.21.15.8:0/3453708986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca4106190 con 0x7f0ca407bdf0 2023-08-11T12:15:05.272 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.543+0000 7f0c9b7fe700 1 -- 172.21.15.8:0/3453708986 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 7) v1 ==== 45029+0+0 (secure 0 0 0) 0x7f0ca0024a60 con 0x7f0ca407bdf0 2023-08-11T12:15:05.273 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.543+0000 7f0cac55e700 1 -- 172.21.15.8:0/3453708986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca4061f50 con 0x7f0ca407bdf0 2023-08-11T12:15:05.273 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.543+0000 7f0c9b7fe700 1 --2- 172.21.15.8:0/3453708986 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f0c90038030 0x7f0c9003a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:05.273 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.543+0000 7f0c9b7fe700 1 -- 172.21.15.8:0/3453708986 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f0ca004bdf0 con 0x7f0ca407bdf0 2023-08-11T12:15:05.273 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.544+0000 7f0ca9af9700 1 --2- 172.21.15.8:0/3453708986 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f0c90038030 0x7f0c9003a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:05.273 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.544+0000 7f0ca9af9700 1 --2- 172.21.15.8:0/3453708986 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f0c90038030 0x7f0c9003a4f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0c94006fd0 tx=0x7f0c94006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:05.273 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.549+0000 7f0c9b7fe700 1 -- 172.21.15.8:0/3453708986 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f0ca0024430 con 0x7f0ca407bdf0 2023-08-11T12:15:05.274 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.603+0000 7f0c9b7fe700 1 -- 172.21.15.8:0/3453708986 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 8) v1 ==== 45135+0+0 (secure 0 0 0) 0x7f0ca002d910 con 0x7f0ca407bdf0 2023-08-11T12:15:05.274 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.775+0000 7f0cac55e700 1 -- 172.21.15.8:0/3453708986 --> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ca4106700 con 0x7f0c90038030 2023-08-11T12:15:05.274 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.782+0000 7f0c9b7fe700 1 -- 172.21.15.8:0/3453708986 <== mgr.14118 v2:172.21.15.8:6800/2832004641 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0ca4106700 con 0x7f0c90038030 2023-08-11T12:15:05.274 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.785+0000 7f0cac55e700 1 -- 172.21.15.8:0/3453708986 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f0c90038030 msgr2=0x7f0c9003a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:05.274 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.785+0000 7f0cac55e700 1 --2- 172.21.15.8:0/3453708986 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f0c90038030 0x7f0c9003a4f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0c94006fd0 tx=0x7f0c94006e40 comp rx=0 tx=0).stop 2023-08-11T12:15:05.274 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.785+0000 7f0cac55e700 1 -- 172.21.15.8:0/3453708986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ca407bdf0 msgr2=0x7f0ca4109560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:05.274 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.785+0000 7f0cac55e700 1 --2- 172.21.15.8:0/3453708986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ca407bdf0 0x7f0ca4109560 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0006af0 tx=0x7f0ca0011ad0 comp rx=0 tx=0).stop 2023-08-11T12:15:05.275 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.785+0000 7f0cac55e700 1 -- 172.21.15.8:0/3453708986 shutdown_connections 2023-08-11T12:15:05.275 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.785+0000 7f0cac55e700 1 --2- 172.21.15.8:0/3453708986 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f0c90038030 0x7f0c9003a4f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:05.275 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.785+0000 7f0cac55e700 1 --2- 172.21.15.8:0/3453708986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ca407bdf0 0x7f0ca4109560 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:05.275 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.785+0000 7f0cac55e700 1 -- 172.21.15.8:0/3453708986 >> 172.21.15.8:0/3453708986 conn(0x7f0ca4101750 msgr2=0x7f0ca4102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:05.275 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.785+0000 7f0cac55e700 1 -- 172.21.15.8:0/3453708986 shutdown_connections 2023-08-11T12:15:05.275 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:04.785+0000 7f0cac55e700 1 -- 172.21.15.8:0/3453708986 wait complete. 2023-08-11T12:15:05.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:05 smithi008 ceph-mon[97158]: [11/Aug/2023:12:15:04] ENGINE Bus STARTING 2023-08-11T12:15:05.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:05 smithi008 ceph-mon[97158]: [11/Aug/2023:12:15:04] ENGINE Serving on http://172.21.15.8:8765 2023-08-11T12:15:05.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:05 smithi008 ceph-mon[97158]: [11/Aug/2023:12:15:04] ENGINE Serving on https://172.21.15.8:7150 2023-08-11T12:15:05.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:05 smithi008 ceph-mon[97158]: [11/Aug/2023:12:15:04] ENGINE Bus STARTED 2023-08-11T12:15:05.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:05 smithi008 ceph-mon[97158]: mgrmap e8: x(active, since 2s) 2023-08-11T12:15:05.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:05 smithi008 ceph-mon[97158]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:15:05.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:05 smithi008 ceph-mon[97158]: from='mgr.14118 172.21.15.8:0/2457302423' entity='mgr.x' 2023-08-11T12:15:05.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:05 smithi008 ceph-mon[97158]: from='mgr.14118 172.21.15.8:0/2457302423' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:15:06.543 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout value unchanged 2023-08-11T12:15:06.543 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.816+0000 7fb2f19f1700 1 Processor -- start 2023-08-11T12:15:06.543 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.817+0000 7fb2f19f1700 1 -- start start 2023-08-11T12:15:06.544 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.817+0000 7fb2f19f1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2ec07be30 0x7fb2ec07a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:06.544 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.817+0000 7fb2f19f1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec07a860 con 0x7fb2ec07be30 2023-08-11T12:15:06.544 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.817+0000 7fb2eaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2ec07be30 0x7fb2ec07a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:06.544 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.817+0000 7fb2eaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2ec07be30 0x7fb2ec07a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59348/0 (socket says 172.21.15.8:59348) 2023-08-11T12:15:06.547 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.817+0000 7fb2eaffd700 1 -- 172.21.15.8:0/2167278461 learned_addr learned my addr 172.21.15.8:0/2167278461 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:06.548 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.818+0000 7fb2eaffd700 1 -- 172.21.15.8:0/2167278461 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec07a9a0 con 0x7fb2ec07be30 2023-08-11T12:15:06.548 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.818+0000 7fb2eaffd700 1 --2- 172.21.15.8:0/2167278461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2ec07be30 0x7fb2ec07a290 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc0098a0 tx=0x7fb2dc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cea638c2cb2bff6 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:06.548 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.818+0000 7fb2e9ffb700 1 -- 172.21.15.8:0/2167278461 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2dc004160 con 0x7fb2ec07be30 2023-08-11T12:15:06.548 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.818+0000 7fb2e9ffb700 1 -- 172.21.15.8:0/2167278461 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb2dc0042c0 con 0x7fb2ec07be30 2023-08-11T12:15:06.548 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.818+0000 7fb2e9ffb700 1 -- 172.21.15.8:0/2167278461 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2dc011a00 con 0x7fb2ec07be30 2023-08-11T12:15:06.549 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.819+0000 7fb2f19f1700 1 -- 172.21.15.8:0/2167278461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2ec07be30 msgr2=0x7fb2ec07a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:06.549 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.819+0000 7fb2f19f1700 1 --2- 172.21.15.8:0/2167278461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2ec07be30 0x7fb2ec07a290 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc0098a0 tx=0x7fb2dc009bb0 comp rx=0 tx=0).stop 2023-08-11T12:15:06.549 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.819+0000 7fb2f19f1700 1 -- 172.21.15.8:0/2167278461 shutdown_connections 2023-08-11T12:15:06.549 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.819+0000 7fb2f19f1700 1 --2- 172.21.15.8:0/2167278461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2ec07be30 0x7fb2ec07a290 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:06.549 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.819+0000 7fb2f19f1700 1 -- 172.21.15.8:0/2167278461 >> 172.21.15.8:0/2167278461 conn(0x7fb2ec101750 msgr2=0x7fb2ec103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:06.549 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.819+0000 7fb2f19f1700 1 -- 172.21.15.8:0/2167278461 shutdown_connections 2023-08-11T12:15:06.549 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.819+0000 7fb2f19f1700 1 -- 172.21.15.8:0/2167278461 wait complete. 2023-08-11T12:15:06.549 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.820+0000 7fb2f19f1700 1 Processor -- start 2023-08-11T12:15:06.550 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.820+0000 7fb2f19f1700 1 -- start start 2023-08-11T12:15:06.550 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.820+0000 7fb2f19f1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2ec07be30 0x7fb2ec19c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:06.550 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.820+0000 7fb2f19f1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec19c5f0 con 0x7fb2ec07be30 2023-08-11T12:15:06.550 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.821+0000 7fb2eaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2ec07be30 0x7fb2ec19c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:06.550 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.821+0000 7fb2eaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2ec07be30 0x7fb2ec19c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59362/0 (socket says 172.21.15.8:59362) 2023-08-11T12:15:06.550 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.821+0000 7fb2eaffd700 1 -- 172.21.15.8:0/545906530 learned_addr learned my addr 172.21.15.8:0/545906530 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:06.550 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.821+0000 7fb2eaffd700 1 -- 172.21.15.8:0/545906530 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2dc009550 con 0x7fb2ec07be30 2023-08-11T12:15:06.551 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.821+0000 7fb2eaffd700 1 --2- 172.21.15.8:0/545906530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2ec07be30 0x7fb2ec19c0b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc009fb0 tx=0x7fb2dc011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:06.551 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.821+0000 7fb2f09ef700 1 -- 172.21.15.8:0/545906530 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2dc003930 con 0x7fb2ec07be30 2023-08-11T12:15:06.551 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.822+0000 7fb2f09ef700 1 -- 172.21.15.8:0/545906530 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb2dc003a90 con 0x7fb2ec07be30 2023-08-11T12:15:06.551 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.822+0000 7fb2f09ef700 1 -- 172.21.15.8:0/545906530 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2dc0195e0 con 0x7fb2ec07be30 2023-08-11T12:15:06.551 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.822+0000 7fb2f19f1700 1 -- 172.21.15.8:0/545906530 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2ec19c7f0 con 0x7fb2ec07be30 2023-08-11T12:15:06.551 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.822+0000 7fb2f19f1700 1 -- 172.21.15.8:0/545906530 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2ec19cc10 con 0x7fb2ec07be30 2023-08-11T12:15:06.551 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.823+0000 7fb2f09ef700 1 -- 172.21.15.8:0/545906530 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45135+0+0 (secure 0 0 0) 0x7fb2dc01a9d0 con 0x7fb2ec07be30 2023-08-11T12:15:06.551 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.823+0000 7fb2f19f1700 1 -- 172.21.15.8:0/545906530 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2ec061f50 con 0x7fb2ec07be30 2023-08-11T12:15:06.552 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.823+0000 7fb2f09ef700 1 --2- 172.21.15.8:0/545906530 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fb2d4038110 0x7fb2d403a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:06.552 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.823+0000 7fb2f09ef700 1 -- 172.21.15.8:0/545906530 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb2dc04c040 con 0x7fb2ec07be30 2023-08-11T12:15:06.552 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.824+0000 7fb2ea7fc700 1 --2- 172.21.15.8:0/545906530 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fb2d4038110 0x7fb2d403a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:06.552 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.824+0000 7fb2ea7fc700 1 --2- 172.21.15.8:0/545906530 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fb2d4038110 0x7fb2d403a5d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0006fd0 tx=0x7fb2e0006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:06.552 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:05.829+0000 7fb2f09ef700 1 -- 172.21.15.8:0/545906530 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fb2dc07ec30 con 0x7fb2ec07be30 2023-08-11T12:15:06.552 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:06.037+0000 7fb2f19f1700 1 -- 172.21.15.8:0/545906530 --> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2ec103a70 con 0x7fb2d4038110 2023-08-11T12:15:06.552 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:06.038+0000 7fb2f09ef700 1 -- 172.21.15.8:0/545906530 <== mgr.14118 v2:172.21.15.8:6800/2832004641 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fb2ec103a70 con 0x7fb2d4038110 2023-08-11T12:15:06.553 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:06.040+0000 7fb2f19f1700 1 -- 172.21.15.8:0/545906530 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fb2d4038110 msgr2=0x7fb2d403a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:06.553 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:06.040+0000 7fb2f19f1700 1 --2- 172.21.15.8:0/545906530 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fb2d4038110 0x7fb2d403a5d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0006fd0 tx=0x7fb2e0006e40 comp rx=0 tx=0).stop 2023-08-11T12:15:06.553 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:06.040+0000 7fb2f19f1700 1 -- 172.21.15.8:0/545906530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2ec07be30 msgr2=0x7fb2ec19c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:06.553 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:06.040+0000 7fb2f19f1700 1 --2- 172.21.15.8:0/545906530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2ec07be30 0x7fb2ec19c0b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc009fb0 tx=0x7fb2dc011ad0 comp rx=0 tx=0).stop 2023-08-11T12:15:06.553 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:06.040+0000 7fb2f19f1700 1 -- 172.21.15.8:0/545906530 shutdown_connections 2023-08-11T12:15:06.553 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:06.040+0000 7fb2f19f1700 1 --2- 172.21.15.8:0/545906530 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fb2d4038110 0x7fb2d403a5d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:06.553 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:06.040+0000 7fb2f19f1700 1 --2- 172.21.15.8:0/545906530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2ec07be30 0x7fb2ec19c0b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:06.553 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:06.040+0000 7fb2f19f1700 1 -- 172.21.15.8:0/545906530 >> 172.21.15.8:0/545906530 conn(0x7fb2ec101750 msgr2=0x7fb2ec102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:06.554 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:06.040+0000 7fb2f19f1700 1 -- 172.21.15.8:0/545906530 shutdown_connections 2023-08-11T12:15:06.554 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:06.040+0000 7fb2f19f1700 1 -- 172.21.15.8:0/545906530 wait complete. 2023-08-11T12:15:06.554 INFO:teuthology.orchestra.run.smithi008.stdout:Generating ssh key... 2023-08-11T12:15:07.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:06 smithi008 ceph-mon[97158]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:15:08.053 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:07 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: Generating public/private rsa key pair. 2023-08-11T12:15:08.053 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:07 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: Your identification has been saved in /tmp/tmpdxedibn2/key. 2023-08-11T12:15:08.053 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:07 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: Your public key has been saved in /tmp/tmpdxedibn2/key.pub. 2023-08-11T12:15:08.054 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:07 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: The key fingerprint is: 2023-08-11T12:15:08.054 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:07 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: SHA256:TyjCYAqI8zYtI0FN10ylgdfmmIfFru4RQVkbbzJ1+uU ceph-815f94ae-3840-11ee-9b37-001a4aab830c 2023-08-11T12:15:08.054 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:07 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: The key's randomart image is: 2023-08-11T12:15:08.054 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:07 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: +---[RSA 3072]----+ 2023-08-11T12:15:08.054 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:07 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: | .o. .=+*+ . . | 2023-08-11T12:15:08.054 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:07 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: |+ ....=o== o | 2023-08-11T12:15:08.054 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:07 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: |* o .oO+ + . | 2023-08-11T12:15:08.054 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:07 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: |.* + +.=+ . o | 2023-08-11T12:15:08.055 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:07 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: |o * + ..S . . E | 2023-08-11T12:15:08.055 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:07 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: | o + . o.o | 2023-08-11T12:15:08.055 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:07 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: | .. . | 2023-08-11T12:15:08.055 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:07 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: | .. | 2023-08-11T12:15:08.055 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:07 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: | .. | 2023-08-11T12:15:08.056 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:07 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: +----[SHA256]-----+ 2023-08-11T12:15:08.227 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.100+0000 7f659abab700 1 Processor -- start 2023-08-11T12:15:08.227 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.101+0000 7f659abab700 1 -- start start 2023-08-11T12:15:08.228 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.101+0000 7f659abab700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f659407be10 0x7f659407a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:08.228 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.101+0000 7f659abab700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659407a840 con 0x7f659407be10 2023-08-11T12:15:08.228 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.101+0000 7f6598947700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f659407be10 0x7f659407a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:08.228 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.101+0000 7f6598947700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f659407be10 0x7f659407a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59376/0 (socket says 172.21.15.8:59376) 2023-08-11T12:15:08.228 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.101+0000 7f6598947700 1 -- 172.21.15.8:0/1662827961 learned_addr learned my addr 172.21.15.8:0/1662827961 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:08.228 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.102+0000 7f6598947700 1 -- 172.21.15.8:0/1662827961 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659407a980 con 0x7f659407be10 2023-08-11T12:15:08.228 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.102+0000 7f6598947700 1 --2- 172.21.15.8:0/1662827961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f659407be10 0x7f659407a270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f65880098a0 tx=0x7f6588009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69bd932c131dc36d server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:08.229 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.102+0000 7f65937fe700 1 -- 172.21.15.8:0/1662827961 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6588004160 con 0x7f659407be10 2023-08-11T12:15:08.229 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.102+0000 7f65937fe700 1 -- 172.21.15.8:0/1662827961 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f65880042c0 con 0x7f659407be10 2023-08-11T12:15:08.229 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.102+0000 7f65937fe700 1 -- 172.21.15.8:0/1662827961 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6588011a00 con 0x7f659407be10 2023-08-11T12:15:08.229 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.103+0000 7f659abab700 1 -- 172.21.15.8:0/1662827961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f659407be10 msgr2=0x7f659407a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:08.229 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.103+0000 7f659abab700 1 --2- 172.21.15.8:0/1662827961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f659407be10 0x7f659407a270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f65880098a0 tx=0x7f6588009bb0 comp rx=0 tx=0).stop 2023-08-11T12:15:08.229 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.103+0000 7f659abab700 1 -- 172.21.15.8:0/1662827961 shutdown_connections 2023-08-11T12:15:08.229 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.103+0000 7f659abab700 1 --2- 172.21.15.8:0/1662827961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f659407be10 0x7f659407a270 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:08.229 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.103+0000 7f659abab700 1 -- 172.21.15.8:0/1662827961 >> 172.21.15.8:0/1662827961 conn(0x7f6594101750 msgr2=0x7f6594103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:08.230 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.103+0000 7f659abab700 1 -- 172.21.15.8:0/1662827961 shutdown_connections 2023-08-11T12:15:08.230 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.103+0000 7f659abab700 1 -- 172.21.15.8:0/1662827961 wait complete. 2023-08-11T12:15:08.230 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.104+0000 7f659abab700 1 Processor -- start 2023-08-11T12:15:08.230 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.104+0000 7f659abab700 1 -- start start 2023-08-11T12:15:08.230 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.104+0000 7f659abab700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f659407be10 0x7f659419c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:08.230 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.104+0000 7f659abab700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659419c580 con 0x7f659407be10 2023-08-11T12:15:08.231 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.105+0000 7f6598947700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f659407be10 0x7f659419c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:08.231 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.105+0000 7f6598947700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f659407be10 0x7f659419c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59386/0 (socket says 172.21.15.8:59386) 2023-08-11T12:15:08.231 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.105+0000 7f6598947700 1 -- 172.21.15.8:0/1391227176 learned_addr learned my addr 172.21.15.8:0/1391227176 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:08.231 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.105+0000 7f6598947700 1 -- 172.21.15.8:0/1391227176 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6588009550 con 0x7f659407be10 2023-08-11T12:15:08.231 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.105+0000 7f6598947700 1 --2- 172.21.15.8:0/1391227176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f659407be10 0x7f659419c040 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6588006af0 tx=0x7f6588011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:08.231 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.105+0000 7f6591ffb700 1 -- 172.21.15.8:0/1391227176 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6588003a40 con 0x7f659407be10 2023-08-11T12:15:08.231 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.105+0000 7f6591ffb700 1 -- 172.21.15.8:0/1391227176 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6588003ba0 con 0x7f659407be10 2023-08-11T12:15:08.231 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.105+0000 7f659abab700 1 -- 172.21.15.8:0/1391227176 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f659419c780 con 0x7f659407be10 2023-08-11T12:15:08.232 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.106+0000 7f6591ffb700 1 -- 172.21.15.8:0/1391227176 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f658801a6e0 con 0x7f659407be10 2023-08-11T12:15:08.232 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.106+0000 7f659abab700 1 -- 172.21.15.8:0/1391227176 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f659419cba0 con 0x7f659407be10 2023-08-11T12:15:08.232 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.107+0000 7f6591ffb700 1 -- 172.21.15.8:0/1391227176 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45135+0+0 (secure 0 0 0) 0x7f6588024a60 con 0x7f659407be10 2023-08-11T12:15:08.232 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.107+0000 7f659abab700 1 -- 172.21.15.8:0/1391227176 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6594061f50 con 0x7f659407be10 2023-08-11T12:15:08.232 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.107+0000 7f6591ffb700 1 --2- 172.21.15.8:0/1391227176 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f6584038110 0x7f658403a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:08.232 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.107+0000 7f6591ffb700 1 -- 172.21.15.8:0/1391227176 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f658804bf70 con 0x7f659407be10 2023-08-11T12:15:08.232 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.108+0000 7f6593fff700 1 --2- 172.21.15.8:0/1391227176 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f6584038110 0x7f658403a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:08.233 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.108+0000 7f6593fff700 1 --2- 172.21.15.8:0/1391227176 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f6584038110 0x7f658403a5d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6580006fd0 tx=0x7f6580006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:08.233 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.112+0000 7f6591ffb700 1 -- 172.21.15.8:0/1391227176 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f658807ec30 con 0x7f659407be10 2023-08-11T12:15:08.233 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.321+0000 7f659abab700 1 -- 172.21.15.8:0/1391227176 --> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f6594103a50 con 0x7f6584038110 2023-08-11T12:15:08.233 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.784+0000 7f6591ffb700 1 -- 172.21.15.8:0/1391227176 <== mgr.14118 v2:172.21.15.8:6800/2832004641 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6594103a50 con 0x7f6584038110 2023-08-11T12:15:08.233 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.786+0000 7f659abab700 1 -- 172.21.15.8:0/1391227176 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f6584038110 msgr2=0x7f658403a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:08.233 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.786+0000 7f659abab700 1 --2- 172.21.15.8:0/1391227176 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f6584038110 0x7f658403a5d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6580006fd0 tx=0x7f6580006e40 comp rx=0 tx=0).stop 2023-08-11T12:15:08.233 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.786+0000 7f659abab700 1 -- 172.21.15.8:0/1391227176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f659407be10 msgr2=0x7f659419c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:08.234 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.786+0000 7f659abab700 1 --2- 172.21.15.8:0/1391227176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f659407be10 0x7f659419c040 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6588006af0 tx=0x7f6588011ad0 comp rx=0 tx=0).stop 2023-08-11T12:15:08.234 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.787+0000 7f659abab700 1 -- 172.21.15.8:0/1391227176 shutdown_connections 2023-08-11T12:15:08.234 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.787+0000 7f659abab700 1 --2- 172.21.15.8:0/1391227176 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f6584038110 0x7f658403a5d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:08.234 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.787+0000 7f659abab700 1 --2- 172.21.15.8:0/1391227176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f659407be10 0x7f659419c040 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:08.234 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.787+0000 7f659abab700 1 -- 172.21.15.8:0/1391227176 >> 172.21.15.8:0/1391227176 conn(0x7f6594101750 msgr2=0x7f6594102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:08.234 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.787+0000 7f659abab700 1 -- 172.21.15.8:0/1391227176 shutdown_connections 2023-08-11T12:15:08.234 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:07.787+0000 7f659abab700 1 -- 172.21.15.8:0/1391227176 wait complete. 2023-08-11T12:15:09.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:08 smithi008 ceph-mon[97158]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:15:09.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:08 smithi008 ceph-mon[97158]: Generating ssh key... 2023-08-11T12:15:09.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:08 smithi008 ceph-mon[97158]: from='mgr.14118 172.21.15.8:0/2457302423' entity='mgr.x' 2023-08-11T12:15:09.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:08 smithi008 ceph-mon[97158]: from='mgr.14118 172.21.15.8:0/2457302423' entity='mgr.x' 2023-08-11T12:15:09.502 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoeVuOufWZ5MnXDfUtoGl2qfpHYu28dEhG0EhUJTSsnJLn5tTXCy0sqyGNmAJsgSoS4L2rI01Qd0PHLhELNLGWqA6TIK4q6ViETwBZ4N0Le2OOvgjZVRI62lDSkwKZiQlzDmDxUYWo865IbPtS1fW4clIRiIwGzfro7ovq4mF1pNekczo9rVKK+zAMmkfnQGjreGzHBj8iJf2z1UF3rJWVW97aMzkPvHLjIMvNPli1rYwg5Lz0+Y+uPukR/ecdwwxBA447/LYWuqyylCV06py9AsuzK+1Rs47D1JyOmh0jKuvDyL+BZx1eMKnjU8DWWqhvq9qXdM/72isYl1CPD/SEuGZsw7coFNRdybk5UGpmhzhaUAA6apqWjKPj5k0SyVLo+dtZhew0fA/+yvQcePiVTgOPL8OpY4slfF2uQy7CpHeye5ftpwrp+xLS73uD7JtB2Taz1yLP7+FUp0nZUYj8yA/zRJkHLmzZbcs3xw28OhybkcwKUNWjJ298aHO1qQ0= ceph-815f94ae-3840-11ee-9b37-001a4aab830c 2023-08-11T12:15:09.503 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.751+0000 7f1f4892c700 1 Processor -- start 2023-08-11T12:15:09.503 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.751+0000 7f1f4892c700 1 -- start start 2023-08-11T12:15:09.503 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.751+0000 7f1f4892c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f4407be30 0x7f1f4407a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:09.503 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.751+0000 7f1f4892c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4407a860 con 0x7f1f4407be30 2023-08-11T12:15:09.503 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.752+0000 7f1f4259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f4407be30 0x7f1f4407a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:09.503 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.752+0000 7f1f4259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f4407be30 0x7f1f4407a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33756/0 (socket says 172.21.15.8:33756) 2023-08-11T12:15:09.504 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.752+0000 7f1f4259c700 1 -- 172.21.15.8:0/3561048904 learned_addr learned my addr 172.21.15.8:0/3561048904 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:09.504 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.752+0000 7f1f4259c700 1 -- 172.21.15.8:0/3561048904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4407a9a0 con 0x7f1f4407be30 2023-08-11T12:15:09.504 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.752+0000 7f1f4259c700 1 --2- 172.21.15.8:0/3561048904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f4407be30 0x7f1f4407a290 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1f340098a0 tx=0x7f1f34009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c14bad1f99837a1 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:09.504 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.753+0000 7f1f4159a700 1 -- 172.21.15.8:0/3561048904 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f34004160 con 0x7f1f4407be30 2023-08-11T12:15:09.504 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.753+0000 7f1f4159a700 1 -- 172.21.15.8:0/3561048904 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1f340042c0 con 0x7f1f4407be30 2023-08-11T12:15:09.504 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.753+0000 7f1f4159a700 1 -- 172.21.15.8:0/3561048904 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f34011a00 con 0x7f1f4407be30 2023-08-11T12:15:09.504 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.753+0000 7f1f4892c700 1 -- 172.21.15.8:0/3561048904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f4407be30 msgr2=0x7f1f4407a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:09.505 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.753+0000 7f1f4892c700 1 --2- 172.21.15.8:0/3561048904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f4407be30 0x7f1f4407a290 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1f340098a0 tx=0x7f1f34009bb0 comp rx=0 tx=0).stop 2023-08-11T12:15:09.505 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.753+0000 7f1f4892c700 1 -- 172.21.15.8:0/3561048904 shutdown_connections 2023-08-11T12:15:09.505 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.753+0000 7f1f4892c700 1 --2- 172.21.15.8:0/3561048904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f4407be30 0x7f1f4407a290 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:09.505 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.753+0000 7f1f4892c700 1 -- 172.21.15.8:0/3561048904 >> 172.21.15.8:0/3561048904 conn(0x7f1f44101750 msgr2=0x7f1f44103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:09.507 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.753+0000 7f1f4892c700 1 -- 172.21.15.8:0/3561048904 shutdown_connections 2023-08-11T12:15:09.508 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.753+0000 7f1f4892c700 1 -- 172.21.15.8:0/3561048904 wait complete. 2023-08-11T12:15:09.508 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.754+0000 7f1f4892c700 1 Processor -- start 2023-08-11T12:15:09.508 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.755+0000 7f1f4892c700 1 -- start start 2023-08-11T12:15:09.508 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.755+0000 7f1f4892c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f4407be30 0x7f1f4419c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:09.508 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.755+0000 7f1f4892c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4419c5f0 con 0x7f1f4407be30 2023-08-11T12:15:09.508 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.755+0000 7f1f4259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f4407be30 0x7f1f4419c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:09.508 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.755+0000 7f1f4259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f4407be30 0x7f1f4419c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33758/0 (socket says 172.21.15.8:33758) 2023-08-11T12:15:09.509 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.755+0000 7f1f4259c700 1 -- 172.21.15.8:0/2512454283 learned_addr learned my addr 172.21.15.8:0/2512454283 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:09.509 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.755+0000 7f1f4259c700 1 -- 172.21.15.8:0/2512454283 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f34009550 con 0x7f1f4407be30 2023-08-11T12:15:09.509 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.756+0000 7f1f4259c700 1 --2- 172.21.15.8:0/2512454283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f4407be30 0x7f1f4419c0b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1f34006af0 tx=0x7f1f34011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:09.509 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.756+0000 7f1f337fe700 1 -- 172.21.15.8:0/2512454283 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f34003a40 con 0x7f1f4407be30 2023-08-11T12:15:09.509 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.756+0000 7f1f337fe700 1 -- 172.21.15.8:0/2512454283 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1f34003ba0 con 0x7f1f4407be30 2023-08-11T12:15:09.509 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.756+0000 7f1f4892c700 1 -- 172.21.15.8:0/2512454283 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f4419c7f0 con 0x7f1f4407be30 2023-08-11T12:15:09.509 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.756+0000 7f1f337fe700 1 -- 172.21.15.8:0/2512454283 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f3401a700 con 0x7f1f4407be30 2023-08-11T12:15:09.510 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.756+0000 7f1f4892c700 1 -- 172.21.15.8:0/2512454283 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4419cc10 con 0x7f1f4407be30 2023-08-11T12:15:09.510 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.757+0000 7f1f337fe700 1 -- 172.21.15.8:0/2512454283 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45135+0+0 (secure 0 0 0) 0x7f1f34024430 con 0x7f1f4407be30 2023-08-11T12:15:09.511 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.757+0000 7f1f4892c700 1 -- 172.21.15.8:0/2512454283 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f44061f50 con 0x7f1f4407be30 2023-08-11T12:15:09.511 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.758+0000 7f1f337fe700 1 --2- 172.21.15.8:0/2512454283 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f1f2c038160 0x7f1f2c03a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:09.511 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.758+0000 7f1f337fe700 1 -- 172.21.15.8:0/2512454283 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f1f3404bfc0 con 0x7f1f4407be30 2023-08-11T12:15:09.511 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.758+0000 7f1f41d9b700 1 --2- 172.21.15.8:0/2512454283 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f1f2c038160 0x7f1f2c03a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:09.511 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.758+0000 7f1f41d9b700 1 --2- 172.21.15.8:0/2512454283 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f1f2c038160 0x7f1f2c03a620 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1f38006fd0 tx=0x7f1f38006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:09.511 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.763+0000 7f1f337fe700 1 -- 172.21.15.8:0/2512454283 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f1f340246e0 con 0x7f1f4407be30 2023-08-11T12:15:09.512 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.976+0000 7f1f4892c700 1 -- 172.21.15.8:0/2512454283 --> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f44103a70 con 0x7f1f2c038160 2023-08-11T12:15:09.512 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.977+0000 7f1f337fe700 1 -- 172.21.15.8:0/2512454283 <== mgr.14118 v2:172.21.15.8:6800/2832004641 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f1f44103a70 con 0x7f1f2c038160 2023-08-11T12:15:09.512 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.980+0000 7f1f4892c700 1 -- 172.21.15.8:0/2512454283 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f1f2c038160 msgr2=0x7f1f2c03a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:09.512 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.980+0000 7f1f4892c700 1 --2- 172.21.15.8:0/2512454283 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f1f2c038160 0x7f1f2c03a620 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1f38006fd0 tx=0x7f1f38006e40 comp rx=0 tx=0).stop 2023-08-11T12:15:09.512 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.980+0000 7f1f4892c700 1 -- 172.21.15.8:0/2512454283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f4407be30 msgr2=0x7f1f4419c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:09.512 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.980+0000 7f1f4892c700 1 --2- 172.21.15.8:0/2512454283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f4407be30 0x7f1f4419c0b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1f34006af0 tx=0x7f1f34011ad0 comp rx=0 tx=0).stop 2023-08-11T12:15:09.512 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.980+0000 7f1f4892c700 1 -- 172.21.15.8:0/2512454283 shutdown_connections 2023-08-11T12:15:09.513 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.980+0000 7f1f4892c700 1 --2- 172.21.15.8:0/2512454283 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f1f2c038160 0x7f1f2c03a620 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:09.513 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.980+0000 7f1f4892c700 1 --2- 172.21.15.8:0/2512454283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f4407be30 0x7f1f4419c0b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:09.513 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.980+0000 7f1f4892c700 1 -- 172.21.15.8:0/2512454283 >> 172.21.15.8:0/2512454283 conn(0x7f1f44101750 msgr2=0x7f1f44102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:09.513 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.980+0000 7f1f4892c700 1 -- 172.21.15.8:0/2512454283 shutdown_connections 2023-08-11T12:15:09.513 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:08.980+0000 7f1f4892c700 1 -- 172.21.15.8:0/2512454283 wait complete. 2023-08-11T12:15:09.513 INFO:teuthology.orchestra.run.smithi008.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-08-11T12:15:09.514 INFO:teuthology.orchestra.run.smithi008.stdout:Adding key to root@localhost authorized_keys... 2023-08-11T12:15:09.514 INFO:teuthology.orchestra.run.smithi008.stdout:Adding host smithi008... 2023-08-11T12:15:10.922 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:10 smithi008 ceph-mon[97158]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:15:11.808 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:11 smithi008 ceph-mon[97158]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi008", "addr": "172.21.15.8", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:15:12.920 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:12 smithi008 ceph-mon[97158]: Deploying cephadm binary to smithi008 2023-08-11T12:15:14.096 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout Added host 'smithi008' with addr '172.21.15.8' 2023-08-11T12:15:14.096 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.021+0000 7fc7a1148700 1 Processor -- start 2023-08-11T12:15:14.096 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.021+0000 7fc7a1148700 1 -- start start 2023-08-11T12:15:14.097 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.022+0000 7fc7a1148700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc79c07bdf0 0x7fc79c07a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:14.097 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.022+0000 7fc7a1148700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c07a820 con 0x7fc79c07bdf0 2023-08-11T12:15:14.097 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.022+0000 7fc79bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc79c07bdf0 0x7fc79c07a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:14.097 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.022+0000 7fc79bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc79c07bdf0 0x7fc79c07a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33760/0 (socket says 172.21.15.8:33760) 2023-08-11T12:15:14.097 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.022+0000 7fc79bfff700 1 -- 172.21.15.8:0/2897657399 learned_addr learned my addr 172.21.15.8:0/2897657399 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:14.097 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.023+0000 7fc79bfff700 1 -- 172.21.15.8:0/2897657399 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79c07a960 con 0x7fc79c07bdf0 2023-08-11T12:15:14.098 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.023+0000 7fc79bfff700 1 --2- 172.21.15.8:0/2897657399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc79c07bdf0 0x7fc79c07a250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0098a0 tx=0x7fc78c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f7a8c93cf956d1 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:14.098 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.023+0000 7fc79affd700 1 -- 172.21.15.8:0/2897657399 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc78c004160 con 0x7fc79c07bdf0 2023-08-11T12:15:14.098 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.023+0000 7fc79affd700 1 -- 172.21.15.8:0/2897657399 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc78c0042c0 con 0x7fc79c07bdf0 2023-08-11T12:15:14.098 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.023+0000 7fc79affd700 1 -- 172.21.15.8:0/2897657399 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc78c011a00 con 0x7fc79c07bdf0 2023-08-11T12:15:14.098 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.024+0000 7fc7a1148700 1 -- 172.21.15.8:0/2897657399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc79c07bdf0 msgr2=0x7fc79c07a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:14.098 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.024+0000 7fc7a1148700 1 --2- 172.21.15.8:0/2897657399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc79c07bdf0 0x7fc79c07a250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0098a0 tx=0x7fc78c009bb0 comp rx=0 tx=0).stop 2023-08-11T12:15:14.099 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.024+0000 7fc7a1148700 1 -- 172.21.15.8:0/2897657399 shutdown_connections 2023-08-11T12:15:14.099 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.024+0000 7fc7a1148700 1 --2- 172.21.15.8:0/2897657399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc79c07bdf0 0x7fc79c07a250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:14.099 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.024+0000 7fc7a1148700 1 -- 172.21.15.8:0/2897657399 >> 172.21.15.8:0/2897657399 conn(0x7fc79c1015a0 msgr2=0x7fc79c1039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:14.099 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.024+0000 7fc7a1148700 1 -- 172.21.15.8:0/2897657399 shutdown_connections 2023-08-11T12:15:14.099 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.024+0000 7fc7a1148700 1 -- 172.21.15.8:0/2897657399 wait complete. 2023-08-11T12:15:14.099 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.025+0000 7fc7a1148700 1 Processor -- start 2023-08-11T12:15:14.099 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.025+0000 7fc7a1148700 1 -- start start 2023-08-11T12:15:14.100 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.025+0000 7fc7a1148700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc79c07bdf0 0x7fc79c19be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:14.100 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.025+0000 7fc7a1148700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c19c3b0 con 0x7fc79c07bdf0 2023-08-11T12:15:14.100 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.026+0000 7fc79bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc79c07bdf0 0x7fc79c19be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:14.100 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.026+0000 7fc79bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc79c07bdf0 0x7fc79c19be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33770/0 (socket says 172.21.15.8:33770) 2023-08-11T12:15:14.100 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.026+0000 7fc79bfff700 1 -- 172.21.15.8:0/2728503406 learned_addr learned my addr 172.21.15.8:0/2728503406 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:14.100 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.026+0000 7fc79bfff700 1 -- 172.21.15.8:0/2728503406 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78c009550 con 0x7fc79c07bdf0 2023-08-11T12:15:14.100 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.026+0000 7fc79bfff700 1 --2- 172.21.15.8:0/2728503406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc79c07bdf0 0x7fc79c19be70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc78c006af0 tx=0x7fc78c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:14.101 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.026+0000 7fc7997fa700 1 -- 172.21.15.8:0/2728503406 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc78c003a40 con 0x7fc79c07bdf0 2023-08-11T12:15:14.101 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.026+0000 7fc7997fa700 1 -- 172.21.15.8:0/2728503406 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc78c003ba0 con 0x7fc79c07bdf0 2023-08-11T12:15:14.101 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.026+0000 7fc7a1148700 1 -- 172.21.15.8:0/2728503406 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc79c19c5b0 con 0x7fc79c07bdf0 2023-08-11T12:15:14.101 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.026+0000 7fc7997fa700 1 -- 172.21.15.8:0/2728503406 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc78c01a6e0 con 0x7fc79c07bdf0 2023-08-11T12:15:14.101 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.027+0000 7fc7a1148700 1 -- 172.21.15.8:0/2728503406 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc79c19c9d0 con 0x7fc79c07bdf0 2023-08-11T12:15:14.101 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.028+0000 7fc7997fa700 1 -- 172.21.15.8:0/2728503406 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45135+0+0 (secure 0 0 0) 0x7fc78c024a60 con 0x7fc79c07bdf0 2023-08-11T12:15:14.101 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.028+0000 7fc7a1148700 1 -- 172.21.15.8:0/2728503406 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc79c061f50 con 0x7fc79c07bdf0 2023-08-11T12:15:14.102 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.028+0000 7fc7997fa700 1 --2- 172.21.15.8:0/2728503406 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fc784038110 0x7fc78403a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:14.102 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.028+0000 7fc7997fa700 1 -- 172.21.15.8:0/2728503406 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc78c04bf70 con 0x7fc79c07bdf0 2023-08-11T12:15:14.102 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.028+0000 7fc79b7fe700 1 --2- 172.21.15.8:0/2728503406 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fc784038110 0x7fc78403a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:14.102 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.029+0000 7fc79b7fe700 1 --2- 172.21.15.8:0/2728503406 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fc784038110 0x7fc78403a5d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc790006fd0 tx=0x7fc790006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:14.102 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.033+0000 7fc7997fa700 1 -- 172.21.15.8:0/2728503406 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fc78c07ec30 con 0x7fc79c07bdf0 2023-08-11T12:15:14.102 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:10.245+0000 7fc7a1148700 1 -- 172.21.15.8:0/2728503406 --> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi008", "addr": "172.21.15.8", "target": ["mon-mgr", ""]}) v1 -- 0x7fc79c103890 con 0x7fc784038110 2023-08-11T12:15:14.103 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:13.547+0000 7fc7997fa700 1 -- 172.21.15.8:0/2728503406 <== mgr.14118 v2:172.21.15.8:6800/2832004641 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fc79c103890 con 0x7fc784038110 2023-08-11T12:15:14.103 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:13.550+0000 7fc7a1148700 1 -- 172.21.15.8:0/2728503406 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fc784038110 msgr2=0x7fc78403a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:14.103 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:13.550+0000 7fc7a1148700 1 --2- 172.21.15.8:0/2728503406 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fc784038110 0x7fc78403a5d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc790006fd0 tx=0x7fc790006e40 comp rx=0 tx=0).stop 2023-08-11T12:15:14.103 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:13.550+0000 7fc7a1148700 1 -- 172.21.15.8:0/2728503406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc79c07bdf0 msgr2=0x7fc79c19be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:14.103 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:13.550+0000 7fc7a1148700 1 --2- 172.21.15.8:0/2728503406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc79c07bdf0 0x7fc79c19be70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc78c006af0 tx=0x7fc78c011ad0 comp rx=0 tx=0).stop 2023-08-11T12:15:14.103 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:13.550+0000 7fc7a1148700 1 -- 172.21.15.8:0/2728503406 shutdown_connections 2023-08-11T12:15:14.103 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:13.550+0000 7fc7a1148700 1 --2- 172.21.15.8:0/2728503406 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fc784038110 0x7fc78403a5d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:14.104 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:13.551+0000 7fc7a1148700 1 --2- 172.21.15.8:0/2728503406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc79c07bdf0 0x7fc79c19be70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:14.104 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:13.551+0000 7fc7a1148700 1 -- 172.21.15.8:0/2728503406 >> 172.21.15.8:0/2728503406 conn(0x7fc79c1015a0 msgr2=0x7fc79c102c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:14.104 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:13.551+0000 7fc7a1148700 1 -- 172.21.15.8:0/2728503406 shutdown_connections 2023-08-11T12:15:14.104 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:13.551+0000 7fc7a1148700 1 -- 172.21.15.8:0/2728503406 wait complete. 2023-08-11T12:15:14.104 INFO:teuthology.orchestra.run.smithi008.stdout:Deploying unmanaged mon service... 2023-08-11T12:15:14.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:14 smithi008 ceph-mon[97158]: from='mgr.14118 172.21.15.8:0/2457302423' entity='mgr.x' 2023-08-11T12:15:14.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:14 smithi008 ceph-mon[97158]: Added host smithi008 2023-08-11T12:15:14.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:14 smithi008 ceph-mon[97158]: from='mgr.14118 172.21.15.8:0/2457302423' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:15:15.677 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-08-11T12:15:15.678 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.671+0000 7fd25d1d9700 1 Processor -- start 2023-08-11T12:15:15.678 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.671+0000 7fd25d1d9700 1 -- start start 2023-08-11T12:15:15.678 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.671+0000 7fd25d1d9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd258104aa0 0x7fd258104ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:15.678 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.671+0000 7fd25d1d9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd258079da0 con 0x7fd258104aa0 2023-08-11T12:15:15.678 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.672+0000 7fd256d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd258104aa0 0x7fd258104ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:15.679 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.672+0000 7fd256d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd258104aa0 0x7fd258104ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33772/0 (socket says 172.21.15.8:33772) 2023-08-11T12:15:15.679 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.672+0000 7fd256d9d700 1 -- 172.21.15.8:0/2482700117 learned_addr learned my addr 172.21.15.8:0/2482700117 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:15.679 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.672+0000 7fd256d9d700 1 -- 172.21.15.8:0/2482700117 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd258079ee0 con 0x7fd258104aa0 2023-08-11T12:15:15.679 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.673+0000 7fd256d9d700 1 --2- 172.21.15.8:0/2482700117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd258104aa0 0x7fd258104ec0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd2480098a0 tx=0x7fd248009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4606feb7d29a961 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:15.679 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.673+0000 7fd255d9b700 1 -- 172.21.15.8:0/2482700117 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd248004160 con 0x7fd258104aa0 2023-08-11T12:15:15.679 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.673+0000 7fd255d9b700 1 -- 172.21.15.8:0/2482700117 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd2480042c0 con 0x7fd258104aa0 2023-08-11T12:15:15.679 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.673+0000 7fd255d9b700 1 -- 172.21.15.8:0/2482700117 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd248011a00 con 0x7fd258104aa0 2023-08-11T12:15:15.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.674+0000 7fd25d1d9700 1 -- 172.21.15.8:0/2482700117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd258104aa0 msgr2=0x7fd258104ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:15.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.674+0000 7fd25d1d9700 1 --2- 172.21.15.8:0/2482700117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd258104aa0 0x7fd258104ec0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd2480098a0 tx=0x7fd248009bb0 comp rx=0 tx=0).stop 2023-08-11T12:15:15.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.674+0000 7fd25d1d9700 1 -- 172.21.15.8:0/2482700117 shutdown_connections 2023-08-11T12:15:15.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.674+0000 7fd25d1d9700 1 --2- 172.21.15.8:0/2482700117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd258104aa0 0x7fd258104ec0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:15.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.674+0000 7fd25d1d9700 1 -- 172.21.15.8:0/2482700117 >> 172.21.15.8:0/2482700117 conn(0x7fd258100620 msgr2=0x7fd258102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:15.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.674+0000 7fd25d1d9700 1 -- 172.21.15.8:0/2482700117 shutdown_connections 2023-08-11T12:15:15.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.674+0000 7fd25d1d9700 1 -- 172.21.15.8:0/2482700117 wait complete. 2023-08-11T12:15:15.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.675+0000 7fd25d1d9700 1 Processor -- start 2023-08-11T12:15:15.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.675+0000 7fd25d1d9700 1 -- start start 2023-08-11T12:15:15.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.675+0000 7fd25d1d9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd258104aa0 0x7fd25819c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:15.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.675+0000 7fd25d1d9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25819c580 con 0x7fd258104aa0 2023-08-11T12:15:15.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.676+0000 7fd256d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd258104aa0 0x7fd25819c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:15.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.676+0000 7fd256d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd258104aa0 0x7fd25819c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33784/0 (socket says 172.21.15.8:33784) 2023-08-11T12:15:15.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.676+0000 7fd256d9d700 1 -- 172.21.15.8:0/1725648868 learned_addr learned my addr 172.21.15.8:0/1725648868 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:15.682 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.676+0000 7fd256d9d700 1 -- 172.21.15.8:0/1725648868 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd248009550 con 0x7fd258104aa0 2023-08-11T12:15:15.684 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.676+0000 7fd256d9d700 1 --2- 172.21.15.8:0/1725648868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd258104aa0 0x7fd25819c040 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd248006af0 tx=0x7fd248011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:15.684 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.677+0000 7fd23ffff700 1 -- 172.21.15.8:0/1725648868 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd248003a40 con 0x7fd258104aa0 2023-08-11T12:15:15.684 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.677+0000 7fd25d1d9700 1 -- 172.21.15.8:0/1725648868 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd25819c780 con 0x7fd258104aa0 2023-08-11T12:15:15.684 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.677+0000 7fd23ffff700 1 -- 172.21.15.8:0/1725648868 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd248003ba0 con 0x7fd258104aa0 2023-08-11T12:15:15.684 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.677+0000 7fd23ffff700 1 -- 172.21.15.8:0/1725648868 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd24801a6e0 con 0x7fd258104aa0 2023-08-11T12:15:15.684 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.677+0000 7fd25d1d9700 1 -- 172.21.15.8:0/1725648868 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd25819cba0 con 0x7fd258104aa0 2023-08-11T12:15:15.685 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.678+0000 7fd23ffff700 1 -- 172.21.15.8:0/1725648868 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45135+0+0 (secure 0 0 0) 0x7fd248024430 con 0x7fd258104aa0 2023-08-11T12:15:15.685 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.678+0000 7fd25d1d9700 1 -- 172.21.15.8:0/1725648868 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd258195940 con 0x7fd258104aa0 2023-08-11T12:15:15.685 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.678+0000 7fd23ffff700 1 --2- 172.21.15.8:0/1725648868 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fd240038160 0x7fd24003a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:15.685 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.678+0000 7fd23ffff700 1 -- 172.21.15.8:0/1725648868 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd24804bfe0 con 0x7fd258104aa0 2023-08-11T12:15:15.685 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.679+0000 7fd25659c700 1 --2- 172.21.15.8:0/1725648868 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fd240038160 0x7fd24003a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:15.685 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.679+0000 7fd25659c700 1 --2- 172.21.15.8:0/1725648868 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fd240038160 0x7fd24003a620 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd24c006fd0 tx=0x7fd24c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:15.686 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.684+0000 7fd23ffff700 1 -- 172.21.15.8:0/1725648868 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fd2480246e0 con 0x7fd258104aa0 2023-08-11T12:15:15.686 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.949+0000 7fd25d1d9700 1 -- 172.21.15.8:0/1725648868 --> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fd25802cd60 con 0x7fd240038160 2023-08-11T12:15:15.686 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.955+0000 7fd23ffff700 1 -- 172.21.15.8:0/1725648868 <== mgr.14118 v2:172.21.15.8:6800/2832004641 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fd25802cd60 con 0x7fd240038160 2023-08-11T12:15:15.686 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.957+0000 7fd25d1d9700 1 -- 172.21.15.8:0/1725648868 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fd240038160 msgr2=0x7fd24003a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:15.686 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.957+0000 7fd25d1d9700 1 --2- 172.21.15.8:0/1725648868 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fd240038160 0x7fd24003a620 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd24c006fd0 tx=0x7fd24c006e40 comp rx=0 tx=0).stop 2023-08-11T12:15:15.687 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.957+0000 7fd25d1d9700 1 -- 172.21.15.8:0/1725648868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd258104aa0 msgr2=0x7fd25819c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:15.687 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.957+0000 7fd25d1d9700 1 --2- 172.21.15.8:0/1725648868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd258104aa0 0x7fd25819c040 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd248006af0 tx=0x7fd248011ad0 comp rx=0 tx=0).stop 2023-08-11T12:15:15.687 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.957+0000 7fd25d1d9700 1 -- 172.21.15.8:0/1725648868 shutdown_connections 2023-08-11T12:15:15.687 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.957+0000 7fd25d1d9700 1 --2- 172.21.15.8:0/1725648868 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fd240038160 0x7fd24003a620 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:15.687 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.957+0000 7fd25d1d9700 1 --2- 172.21.15.8:0/1725648868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd258104aa0 0x7fd25819c040 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:15.687 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.957+0000 7fd25d1d9700 1 -- 172.21.15.8:0/1725648868 >> 172.21.15.8:0/1725648868 conn(0x7fd258100620 msgr2=0x7fd258190660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:15.687 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.958+0000 7fd25d1d9700 1 -- 172.21.15.8:0/1725648868 shutdown_connections 2023-08-11T12:15:15.687 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:14.958+0000 7fd25d1d9700 1 -- 172.21.15.8:0/1725648868 wait complete. 2023-08-11T12:15:15.688 INFO:teuthology.orchestra.run.smithi008.stdout:Deploying unmanaged mgr service... 2023-08-11T12:15:16.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:15 smithi008 ceph-mon[97158]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:15:16.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:15 smithi008 ceph-mon[97158]: Saving service mon spec with placement count:5 2023-08-11T12:15:16.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:15 smithi008 ceph-mon[97158]: from='mgr.14118 172.21.15.8:0/2457302423' entity='mgr.x' 2023-08-11T12:15:17.066 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-08-11T12:15:17.066 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.327+0000 7f02c3273700 1 Processor -- start 2023-08-11T12:15:17.066 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.327+0000 7f02c3273700 1 -- start start 2023-08-11T12:15:17.066 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.327+0000 7f02c3273700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02bc1061b0 0x7f02bc1065d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:17.067 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.327+0000 7f02c3273700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc106ba0 con 0x7f02bc1061b0 2023-08-11T12:15:17.067 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.328+0000 7f02c100f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02bc1061b0 0x7f02bc1065d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:17.067 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.328+0000 7f02c100f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02bc1061b0 0x7f02bc1065d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33792/0 (socket says 172.21.15.8:33792) 2023-08-11T12:15:17.067 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.328+0000 7f02c100f700 1 -- 172.21.15.8:0/2407483497 learned_addr learned my addr 172.21.15.8:0/2407483497 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:17.067 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.328+0000 7f02c100f700 1 -- 172.21.15.8:0/2407483497 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02bc1073b0 con 0x7f02bc1061b0 2023-08-11T12:15:17.067 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.328+0000 7f02c100f700 1 --2- 172.21.15.8:0/2407483497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02bc1061b0 0x7f02bc1065d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f02b80098a0 tx=0x7f02b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a55a521f0448bae server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:17.067 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.329+0000 7f02b3fff700 1 -- 172.21.15.8:0/2407483497 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02b8004160 con 0x7f02bc1061b0 2023-08-11T12:15:17.068 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.329+0000 7f02b3fff700 1 -- 172.21.15.8:0/2407483497 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f02b80042c0 con 0x7f02bc1061b0 2023-08-11T12:15:17.068 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.329+0000 7f02b3fff700 1 -- 172.21.15.8:0/2407483497 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02b8011a00 con 0x7f02bc1061b0 2023-08-11T12:15:17.068 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.329+0000 7f02c3273700 1 -- 172.21.15.8:0/2407483497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02bc1061b0 msgr2=0x7f02bc1065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:17.069 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.329+0000 7f02c3273700 1 --2- 172.21.15.8:0/2407483497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02bc1061b0 0x7f02bc1065d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f02b80098a0 tx=0x7f02b8009bb0 comp rx=0 tx=0).stop 2023-08-11T12:15:17.069 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.329+0000 7f02c3273700 1 -- 172.21.15.8:0/2407483497 shutdown_connections 2023-08-11T12:15:17.069 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.329+0000 7f02c3273700 1 --2- 172.21.15.8:0/2407483497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02bc1061b0 0x7f02bc1065d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:17.069 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.329+0000 7f02c3273700 1 -- 172.21.15.8:0/2407483497 >> 172.21.15.8:0/2407483497 conn(0x7f02bc101750 msgr2=0x7f02bc103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:17.069 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.329+0000 7f02c3273700 1 -- 172.21.15.8:0/2407483497 shutdown_connections 2023-08-11T12:15:17.069 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.329+0000 7f02c3273700 1 -- 172.21.15.8:0/2407483497 wait complete. 2023-08-11T12:15:17.069 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.330+0000 7f02c3273700 1 Processor -- start 2023-08-11T12:15:17.070 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.331+0000 7f02c3273700 1 -- start start 2023-08-11T12:15:17.070 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.331+0000 7f02c3273700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02bc1061b0 0x7f02bc19c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:17.070 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.331+0000 7f02c3273700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc19c5f0 con 0x7f02bc1061b0 2023-08-11T12:15:17.070 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.331+0000 7f02c100f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02bc1061b0 0x7f02bc19c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:17.070 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.331+0000 7f02c100f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02bc1061b0 0x7f02bc19c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33804/0 (socket says 172.21.15.8:33804) 2023-08-11T12:15:17.070 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.331+0000 7f02c100f700 1 -- 172.21.15.8:0/1175274544 learned_addr learned my addr 172.21.15.8:0/1175274544 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:17.070 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.332+0000 7f02c100f700 1 -- 172.21.15.8:0/1175274544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b8009550 con 0x7f02bc1061b0 2023-08-11T12:15:17.070 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.332+0000 7f02c100f700 1 --2- 172.21.15.8:0/1175274544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02bc1061b0 0x7f02bc19c0b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f02b8006af0 tx=0x7f02b8011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:17.071 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.332+0000 7f02b27fc700 1 -- 172.21.15.8:0/1175274544 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02b8003a40 con 0x7f02bc1061b0 2023-08-11T12:15:17.071 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.332+0000 7f02b27fc700 1 -- 172.21.15.8:0/1175274544 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f02b8003ba0 con 0x7f02bc1061b0 2023-08-11T12:15:17.071 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.332+0000 7f02c3273700 1 -- 172.21.15.8:0/1175274544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02bc19c7f0 con 0x7f02bc1061b0 2023-08-11T12:15:17.071 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.332+0000 7f02b27fc700 1 -- 172.21.15.8:0/1175274544 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02b801a700 con 0x7f02bc1061b0 2023-08-11T12:15:17.071 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.332+0000 7f02c3273700 1 -- 172.21.15.8:0/1175274544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02bc19cc10 con 0x7f02bc1061b0 2023-08-11T12:15:17.071 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.333+0000 7f02b27fc700 1 -- 172.21.15.8:0/1175274544 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45135+0+0 (secure 0 0 0) 0x7f02b8024ad0 con 0x7f02bc1061b0 2023-08-11T12:15:17.071 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.333+0000 7f02c3273700 1 -- 172.21.15.8:0/1175274544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02bc061f50 con 0x7f02bc1061b0 2023-08-11T12:15:17.072 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.334+0000 7f02b27fc700 1 --2- 172.21.15.8:0/1175274544 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f02a8038110 0x7f02a803a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:17.072 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.334+0000 7f02b27fc700 1 -- 172.21.15.8:0/1175274544 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f02b804bfe0 con 0x7f02bc1061b0 2023-08-11T12:15:17.072 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.334+0000 7f02c080e700 1 --2- 172.21.15.8:0/1175274544 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f02a8038110 0x7f02a803a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:17.072 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.335+0000 7f02c080e700 1 --2- 172.21.15.8:0/1175274544 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f02a8038110 0x7f02a803a5d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f02ac006fd0 tx=0x7f02ac006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:17.072 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.339+0000 7f02b27fc700 1 -- 172.21.15.8:0/1175274544 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f02b8018b80 con 0x7f02bc1061b0 2023-08-11T12:15:17.072 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.420+0000 7f02b27fc700 1 -- 172.21.15.8:0/1175274544 <== mon.0 v2:172.21.15.8:3300/0 7 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f02b800bed0 con 0x7f02bc1061b0 2023-08-11T12:15:17.072 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.577+0000 7f02c3273700 1 -- 172.21.15.8:0/1175274544 --> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f02bc103a80 con 0x7f02a8038110 2023-08-11T12:15:17.073 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.582+0000 7f02b27fc700 1 -- 172.21.15.8:0/1175274544 <== mgr.14118 v2:172.21.15.8:6800/2832004641 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f02bc103a80 con 0x7f02a8038110 2023-08-11T12:15:17.073 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.584+0000 7f02c3273700 1 -- 172.21.15.8:0/1175274544 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f02a8038110 msgr2=0x7f02a803a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:17.073 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.584+0000 7f02c3273700 1 --2- 172.21.15.8:0/1175274544 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f02a8038110 0x7f02a803a5d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f02ac006fd0 tx=0x7f02ac006e40 comp rx=0 tx=0).stop 2023-08-11T12:15:17.073 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.584+0000 7f02c3273700 1 -- 172.21.15.8:0/1175274544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02bc1061b0 msgr2=0x7f02bc19c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:17.073 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.584+0000 7f02c3273700 1 --2- 172.21.15.8:0/1175274544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02bc1061b0 0x7f02bc19c0b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f02b8006af0 tx=0x7f02b8011ad0 comp rx=0 tx=0).stop 2023-08-11T12:15:17.073 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.584+0000 7f02c3273700 1 -- 172.21.15.8:0/1175274544 shutdown_connections 2023-08-11T12:15:17.073 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.584+0000 7f02c3273700 1 --2- 172.21.15.8:0/1175274544 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f02a8038110 0x7f02a803a5d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:17.074 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.584+0000 7f02c3273700 1 --2- 172.21.15.8:0/1175274544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02bc1061b0 0x7f02bc19c0b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:17.074 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.584+0000 7f02c3273700 1 -- 172.21.15.8:0/1175274544 >> 172.21.15.8:0/1175274544 conn(0x7f02bc101750 msgr2=0x7f02bc102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:17.074 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.585+0000 7f02c3273700 1 -- 172.21.15.8:0/1175274544 shutdown_connections 2023-08-11T12:15:17.074 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:16.585+0000 7f02c3273700 1 -- 172.21.15.8:0/1175274544 wait complete. 2023-08-11T12:15:17.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:17 smithi008 ceph-mon[97158]: from='mgr.14118 172.21.15.8:0/2457302423' entity='mgr.x' 2023-08-11T12:15:17.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:17 smithi008 ceph-mon[97158]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:15:17.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:17 smithi008 ceph-mon[97158]: Saving service mgr spec with placement count:2 2023-08-11T12:15:17.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:17 smithi008 ceph-mon[97158]: from='mgr.14118 172.21.15.8:0/2457302423' entity='mgr.x' 2023-08-11T12:15:17.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:17 smithi008 ceph-mon[97158]: from='mgr.14118 172.21.15.8:0/2457302423' entity='mgr.x' 2023-08-11T12:15:18.549 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.672+0000 7fe2039aa700 1 Processor -- start 2023-08-11T12:15:18.549 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.673+0000 7fe2039aa700 1 -- start start 2023-08-11T12:15:18.549 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.673+0000 7fe2039aa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1fc07be30 0x7fe1fc07a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:18.549 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.673+0000 7fe2039aa700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc07a860 con 0x7fe1fc07be30 2023-08-11T12:15:18.549 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.673+0000 7fe201746700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1fc07be30 0x7fe1fc07a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:18.550 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.674+0000 7fe201746700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1fc07be30 0x7fe1fc07a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33812/0 (socket says 172.21.15.8:33812) 2023-08-11T12:15:18.550 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.674+0000 7fe201746700 1 -- 172.21.15.8:0/4227773844 learned_addr learned my addr 172.21.15.8:0/4227773844 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:18.550 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.674+0000 7fe201746700 1 -- 172.21.15.8:0/4227773844 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1fc07a9a0 con 0x7fe1fc07be30 2023-08-11T12:15:18.550 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.674+0000 7fe201746700 1 --2- 172.21.15.8:0/4227773844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1fc07be30 0x7fe1fc07a290 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe1f80098a0 tx=0x7fe1f8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58d44dfe5148e73 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:18.550 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.674+0000 7fe1f3fff700 1 -- 172.21.15.8:0/4227773844 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1f8004160 con 0x7fe1fc07be30 2023-08-11T12:15:18.550 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.674+0000 7fe1f3fff700 1 -- 172.21.15.8:0/4227773844 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1f80042c0 con 0x7fe1fc07be30 2023-08-11T12:15:18.551 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.674+0000 7fe1f3fff700 1 -- 172.21.15.8:0/4227773844 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1f80119b0 con 0x7fe1fc07be30 2023-08-11T12:15:18.551 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.675+0000 7fe2039aa700 1 -- 172.21.15.8:0/4227773844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1fc07be30 msgr2=0x7fe1fc07a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:18.551 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.675+0000 7fe2039aa700 1 --2- 172.21.15.8:0/4227773844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1fc07be30 0x7fe1fc07a290 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe1f80098a0 tx=0x7fe1f8009bb0 comp rx=0 tx=0).stop 2023-08-11T12:15:18.551 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.675+0000 7fe2039aa700 1 -- 172.21.15.8:0/4227773844 shutdown_connections 2023-08-11T12:15:18.551 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.675+0000 7fe2039aa700 1 --2- 172.21.15.8:0/4227773844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1fc07be30 0x7fe1fc07a290 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:18.551 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.675+0000 7fe2039aa700 1 -- 172.21.15.8:0/4227773844 >> 172.21.15.8:0/4227773844 conn(0x7fe1fc101750 msgr2=0x7fe1fc103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:18.551 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.675+0000 7fe2039aa700 1 -- 172.21.15.8:0/4227773844 shutdown_connections 2023-08-11T12:15:18.552 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.675+0000 7fe2039aa700 1 -- 172.21.15.8:0/4227773844 wait complete. 2023-08-11T12:15:18.552 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.676+0000 7fe2039aa700 1 Processor -- start 2023-08-11T12:15:18.552 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.677+0000 7fe2039aa700 1 -- start start 2023-08-11T12:15:18.553 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.677+0000 7fe2039aa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1fc07be30 0x7fe1fc19c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:18.553 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.677+0000 7fe2039aa700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc19c620 con 0x7fe1fc07be30 2023-08-11T12:15:18.553 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.677+0000 7fe201746700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1fc07be30 0x7fe1fc19c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:18.553 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.677+0000 7fe201746700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1fc07be30 0x7fe1fc19c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33818/0 (socket says 172.21.15.8:33818) 2023-08-11T12:15:18.553 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.677+0000 7fe201746700 1 -- 172.21.15.8:0/492362849 learned_addr learned my addr 172.21.15.8:0/492362849 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:18.554 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.677+0000 7fe201746700 1 -- 172.21.15.8:0/492362849 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f8009550 con 0x7fe1fc07be30 2023-08-11T12:15:18.554 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.678+0000 7fe201746700 1 --2- 172.21.15.8:0/492362849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1fc07be30 0x7fe1fc19c0e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8000c00 tx=0x7fe1f8011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:18.554 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.678+0000 7fe1f27fc700 1 -- 172.21.15.8:0/492362849 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1f80039f0 con 0x7fe1fc07be30 2023-08-11T12:15:18.554 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.678+0000 7fe1f27fc700 1 -- 172.21.15.8:0/492362849 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1f8003b50 con 0x7fe1fc07be30 2023-08-11T12:15:18.554 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.678+0000 7fe1f27fc700 1 -- 172.21.15.8:0/492362849 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1f801a780 con 0x7fe1fc07be30 2023-08-11T12:15:18.555 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.678+0000 7fe2039aa700 1 -- 172.21.15.8:0/492362849 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1fc19c820 con 0x7fe1fc07be30 2023-08-11T12:15:18.555 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.678+0000 7fe2039aa700 1 -- 172.21.15.8:0/492362849 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1fc19cc40 con 0x7fe1fc07be30 2023-08-11T12:15:18.555 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.679+0000 7fe1f27fc700 1 -- 172.21.15.8:0/492362849 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45135+0+0 (secure 0 0 0) 0x7fe1f8024440 con 0x7fe1fc07be30 2023-08-11T12:15:18.555 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.679+0000 7fe2039aa700 1 -- 172.21.15.8:0/492362849 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1fc1961b0 con 0x7fe1fc07be30 2023-08-11T12:15:18.555 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.680+0000 7fe1f27fc700 1 --2- 172.21.15.8:0/492362849 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fe1e8038160 0x7fe1e803a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:18.555 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.680+0000 7fe1f27fc700 1 -- 172.21.15.8:0/492362849 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe1f804c080 con 0x7fe1fc07be30 2023-08-11T12:15:18.555 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.680+0000 7fe200f45700 1 --2- 172.21.15.8:0/492362849 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fe1e8038160 0x7fe1e803a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:18.556 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.681+0000 7fe200f45700 1 --2- 172.21.15.8:0/492362849 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fe1e8038160 0x7fe1e803a620 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec006fd0 tx=0x7fe1ec006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:18.556 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.685+0000 7fe1f27fc700 1 -- 172.21.15.8:0/492362849 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fe1f80246f0 con 0x7fe1fc07be30 2023-08-11T12:15:18.556 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.900+0000 7fe2039aa700 1 -- 172.21.15.8:0/492362849 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fe1fc061f50 con 0x7fe1fc07be30 2023-08-11T12:15:18.556 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.903+0000 7fe1f27fc700 1 -- 172.21.15.8:0/492362849 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fe1f8018350 con 0x7fe1fc07be30 2023-08-11T12:15:18.556 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.906+0000 7fe2039aa700 1 -- 172.21.15.8:0/492362849 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fe1e8038160 msgr2=0x7fe1e803a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:18.556 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.906+0000 7fe2039aa700 1 --2- 172.21.15.8:0/492362849 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fe1e8038160 0x7fe1e803a620 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec006fd0 tx=0x7fe1ec006e40 comp rx=0 tx=0).stop 2023-08-11T12:15:18.556 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.906+0000 7fe2039aa700 1 -- 172.21.15.8:0/492362849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1fc07be30 msgr2=0x7fe1fc19c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:18.557 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.906+0000 7fe2039aa700 1 --2- 172.21.15.8:0/492362849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1fc07be30 0x7fe1fc19c0e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8000c00 tx=0x7fe1f8011a30 comp rx=0 tx=0).stop 2023-08-11T12:15:18.557 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.906+0000 7fe2039aa700 1 -- 172.21.15.8:0/492362849 shutdown_connections 2023-08-11T12:15:18.557 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.906+0000 7fe2039aa700 1 --2- 172.21.15.8:0/492362849 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fe1e8038160 0x7fe1e803a620 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:18.557 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.906+0000 7fe2039aa700 1 --2- 172.21.15.8:0/492362849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1fc07be30 0x7fe1fc19c0e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:18.557 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.906+0000 7fe2039aa700 1 -- 172.21.15.8:0/492362849 >> 172.21.15.8:0/492362849 conn(0x7fe1fc101750 msgr2=0x7fe1fc102ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:18.557 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.906+0000 7fe2039aa700 1 -- 172.21.15.8:0/492362849 shutdown_connections 2023-08-11T12:15:18.557 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:17.907+0000 7fe2039aa700 1 -- 172.21.15.8:0/492362849 wait complete. 2023-08-11T12:15:19.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:18 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/492362849' entity='client.admin' 2023-08-11T12:15:19.931 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.134+0000 7fac08164700 1 Processor -- start 2023-08-11T12:15:19.931 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.134+0000 7fac08164700 1 -- start start 2023-08-11T12:15:19.931 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.134+0000 7fac08164700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac001061b0 0x7fac001065d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:19.932 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.134+0000 7fac08164700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac00106ba0 con 0x7fac001061b0 2023-08-11T12:15:19.932 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.135+0000 7fac05f00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac001061b0 0x7fac001065d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:19.932 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.135+0000 7fac05f00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac001061b0 0x7fac001065d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56392/0 (socket says 172.21.15.8:56392) 2023-08-11T12:15:19.932 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.135+0000 7fac05f00700 1 -- 172.21.15.8:0/1687156148 learned_addr learned my addr 172.21.15.8:0/1687156148 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:19.932 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.135+0000 7fac05f00700 1 -- 172.21.15.8:0/1687156148 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac001073b0 con 0x7fac001061b0 2023-08-11T12:15:19.932 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.136+0000 7fac05f00700 1 --2- 172.21.15.8:0/1687156148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac001061b0 0x7fac001065d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0098a0 tx=0x7fabfc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ff64a0a453fbaa server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:19.933 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.136+0000 7fac04efe700 1 -- 172.21.15.8:0/1687156148 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fabfc004160 con 0x7fac001061b0 2023-08-11T12:15:19.933 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.136+0000 7fac04efe700 1 -- 172.21.15.8:0/1687156148 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fabfc0042c0 con 0x7fac001061b0 2023-08-11T12:15:19.933 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.136+0000 7fac04efe700 1 -- 172.21.15.8:0/1687156148 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fabfc0119b0 con 0x7fac001061b0 2023-08-11T12:15:19.933 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.137+0000 7fac08164700 1 -- 172.21.15.8:0/1687156148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac001061b0 msgr2=0x7fac001065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:19.933 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.137+0000 7fac08164700 1 --2- 172.21.15.8:0/1687156148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac001061b0 0x7fac001065d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0098a0 tx=0x7fabfc009bb0 comp rx=0 tx=0).stop 2023-08-11T12:15:19.933 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.137+0000 7fac08164700 1 -- 172.21.15.8:0/1687156148 shutdown_connections 2023-08-11T12:15:19.933 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.137+0000 7fac08164700 1 --2- 172.21.15.8:0/1687156148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac001061b0 0x7fac001065d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:19.933 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.137+0000 7fac08164700 1 -- 172.21.15.8:0/1687156148 >> 172.21.15.8:0/1687156148 conn(0x7fac00101750 msgr2=0x7fac00103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:19.934 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.137+0000 7fac08164700 1 -- 172.21.15.8:0/1687156148 shutdown_connections 2023-08-11T12:15:19.934 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.137+0000 7fac08164700 1 -- 172.21.15.8:0/1687156148 wait complete. 2023-08-11T12:15:19.934 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.138+0000 7fac08164700 1 Processor -- start 2023-08-11T12:15:19.934 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.139+0000 7fac08164700 1 -- start start 2023-08-11T12:15:19.934 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.139+0000 7fac08164700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac001061b0 0x7fac0019c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:19.934 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.139+0000 7fac08164700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0019c610 con 0x7fac001061b0 2023-08-11T12:15:19.934 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.139+0000 7fac05f00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac001061b0 0x7fac0019c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:19.935 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.139+0000 7fac05f00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac001061b0 0x7fac0019c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56404/0 (socket says 172.21.15.8:56404) 2023-08-11T12:15:19.935 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.139+0000 7fac05f00700 1 -- 172.21.15.8:0/2120387648 learned_addr learned my addr 172.21.15.8:0/2120387648 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:19.935 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.140+0000 7fac05f00700 1 -- 172.21.15.8:0/2120387648 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabfc009550 con 0x7fac001061b0 2023-08-11T12:15:19.935 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.140+0000 7fac05f00700 1 --2- 172.21.15.8:0/2120387648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac001061b0 0x7fac0019c0d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fabfc000c00 tx=0x7fabfc011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:19.935 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.140+0000 7fabf6ffd700 1 -- 172.21.15.8:0/2120387648 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fabfc0039f0 con 0x7fac001061b0 2023-08-11T12:15:19.935 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.140+0000 7fabf6ffd700 1 -- 172.21.15.8:0/2120387648 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fabfc003b50 con 0x7fac001061b0 2023-08-11T12:15:19.935 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.140+0000 7fac08164700 1 -- 172.21.15.8:0/2120387648 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac0019c810 con 0x7fac001061b0 2023-08-11T12:15:19.935 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.140+0000 7fabf6ffd700 1 -- 172.21.15.8:0/2120387648 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fabfc01a780 con 0x7fac001061b0 2023-08-11T12:15:19.936 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.140+0000 7fac08164700 1 -- 172.21.15.8:0/2120387648 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0019cc30 con 0x7fac001061b0 2023-08-11T12:15:19.936 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.142+0000 7fac08164700 1 -- 172.21.15.8:0/2120387648 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac0010a5e0 con 0x7fac001061b0 2023-08-11T12:15:19.936 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.142+0000 7fabf6ffd700 1 -- 172.21.15.8:0/2120387648 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45135+0+0 (secure 0 0 0) 0x7fabfc024440 con 0x7fac001061b0 2023-08-11T12:15:19.936 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.143+0000 7fabf6ffd700 1 --2- 172.21.15.8:0/2120387648 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fabec038160 0x7fabec03a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:19.936 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.143+0000 7fabf6ffd700 1 -- 172.21.15.8:0/2120387648 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fabfc04c0d0 con 0x7fac001061b0 2023-08-11T12:15:19.936 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.143+0000 7fac056ff700 1 --2- 172.21.15.8:0/2120387648 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fabec038160 0x7fabec03a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:19.936 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.144+0000 7fac056ff700 1 --2- 172.21.15.8:0/2120387648 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fabec038160 0x7fabec03a620 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fabf0006fd0 tx=0x7fabf0006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:19.937 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.148+0000 7fabf6ffd700 1 -- 172.21.15.8:0/2120387648 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fabfc07ec30 con 0x7fac001061b0 2023-08-11T12:15:19.937 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.367+0000 7fac08164700 1 -- 172.21.15.8:0/2120387648 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fac0010a820 con 0x7fac001061b0 2023-08-11T12:15:19.937 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.371+0000 7fabf6ffd700 1 -- 172.21.15.8:0/2120387648 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fabfc0246f0 con 0x7fac001061b0 2023-08-11T12:15:19.937 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.373+0000 7fac08164700 1 -- 172.21.15.8:0/2120387648 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fabec038160 msgr2=0x7fabec03a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:19.937 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.373+0000 7fac08164700 1 --2- 172.21.15.8:0/2120387648 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fabec038160 0x7fabec03a620 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fabf0006fd0 tx=0x7fabf0006e40 comp rx=0 tx=0).stop 2023-08-11T12:15:19.938 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.373+0000 7fac08164700 1 -- 172.21.15.8:0/2120387648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac001061b0 msgr2=0x7fac0019c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:19.938 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.373+0000 7fac08164700 1 --2- 172.21.15.8:0/2120387648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac001061b0 0x7fac0019c0d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fabfc000c00 tx=0x7fabfc011a30 comp rx=0 tx=0).stop 2023-08-11T12:15:19.938 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.374+0000 7fac08164700 1 -- 172.21.15.8:0/2120387648 shutdown_connections 2023-08-11T12:15:19.938 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.374+0000 7fac08164700 1 --2- 172.21.15.8:0/2120387648 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fabec038160 0x7fabec03a620 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:19.938 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.374+0000 7fac08164700 1 --2- 172.21.15.8:0/2120387648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac001061b0 0x7fac0019c0d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:19.938 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.374+0000 7fac08164700 1 -- 172.21.15.8:0/2120387648 >> 172.21.15.8:0/2120387648 conn(0x7fac00101750 msgr2=0x7fac00102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:19.938 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.374+0000 7fac08164700 1 -- 172.21.15.8:0/2120387648 shutdown_connections 2023-08-11T12:15:19.939 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:19.374+0000 7fac08164700 1 -- 172.21.15.8:0/2120387648 wait complete. 2023-08-11T12:15:19.939 INFO:teuthology.orchestra.run.smithi008.stdout:Enabling the dashboard module... 2023-08-11T12:15:20.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:20 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2120387648' entity='client.admin' 2023-08-11T12:15:20.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:20 smithi008 ceph-mon[97158]: from='mgr.14118 172.21.15.8:0/2457302423' entity='mgr.x' 2023-08-11T12:15:21.679 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:21 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1143255081' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-08-11T12:15:21.679 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:21 smithi008 ceph-mon[97158]: from='mgr.14118 172.21.15.8:0/2457302423' entity='mgr.x' 2023-08-11T12:15:21.679 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:21 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: ignoring --setuser ceph since I am not root 2023-08-11T12:15:21.680 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:21 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: ignoring --setgroup ceph since I am not root 2023-08-11T12:15:21.911 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.506+0000 7fd6b8875700 1 Processor -- start 2023-08-11T12:15:21.911 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.506+0000 7fd6b8875700 1 -- start start 2023-08-11T12:15:21.911 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.507+0000 7fd6b8875700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6b407bdf0 0x7fd6b407a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:21.911 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.507+0000 7fd6b8875700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b407a820 con 0x7fd6b407bdf0 2023-08-11T12:15:21.912 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.507+0000 7fd6b259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6b407bdf0 0x7fd6b407a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:21.912 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.507+0000 7fd6b259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6b407bdf0 0x7fd6b407a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56406/0 (socket says 172.21.15.8:56406) 2023-08-11T12:15:21.912 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.507+0000 7fd6b259c700 1 -- 172.21.15.8:0/3131535519 learned_addr learned my addr 172.21.15.8:0/3131535519 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:21.912 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.508+0000 7fd6b259c700 1 -- 172.21.15.8:0/3131535519 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b407a960 con 0x7fd6b407bdf0 2023-08-11T12:15:21.912 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.508+0000 7fd6b259c700 1 --2- 172.21.15.8:0/3131535519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6b407bdf0 0x7fd6b407a250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd6a40098a0 tx=0x7fd6a4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=665b77dae4c725e5 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:21.912 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.508+0000 7fd6b159a700 1 -- 172.21.15.8:0/3131535519 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6a4004160 con 0x7fd6b407bdf0 2023-08-11T12:15:21.912 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.508+0000 7fd6b159a700 1 -- 172.21.15.8:0/3131535519 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6a40042c0 con 0x7fd6b407bdf0 2023-08-11T12:15:21.913 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.508+0000 7fd6b159a700 1 -- 172.21.15.8:0/3131535519 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6a40119b0 con 0x7fd6b407bdf0 2023-08-11T12:15:21.913 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.509+0000 7fd6b8875700 1 -- 172.21.15.8:0/3131535519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6b407bdf0 msgr2=0x7fd6b407a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:21.913 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.509+0000 7fd6b8875700 1 --2- 172.21.15.8:0/3131535519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6b407bdf0 0x7fd6b407a250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd6a40098a0 tx=0x7fd6a4009bb0 comp rx=0 tx=0).stop 2023-08-11T12:15:21.913 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.509+0000 7fd6b8875700 1 -- 172.21.15.8:0/3131535519 shutdown_connections 2023-08-11T12:15:21.913 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.509+0000 7fd6b8875700 1 --2- 172.21.15.8:0/3131535519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6b407bdf0 0x7fd6b407a250 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:21.913 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.509+0000 7fd6b8875700 1 -- 172.21.15.8:0/3131535519 >> 172.21.15.8:0/3131535519 conn(0x7fd6b4101750 msgr2=0x7fd6b4103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:21.913 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.509+0000 7fd6b8875700 1 -- 172.21.15.8:0/3131535519 shutdown_connections 2023-08-11T12:15:21.913 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.509+0000 7fd6b8875700 1 -- 172.21.15.8:0/3131535519 wait complete. 2023-08-11T12:15:21.914 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.510+0000 7fd6b8875700 1 Processor -- start 2023-08-11T12:15:21.914 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.511+0000 7fd6b8875700 1 -- start start 2023-08-11T12:15:21.914 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.511+0000 7fd6b8875700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6b407bdf0 0x7fd6b419c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:21.914 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.511+0000 7fd6b8875700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b419c5f0 con 0x7fd6b407bdf0 2023-08-11T12:15:21.914 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.511+0000 7fd6b259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6b407bdf0 0x7fd6b419c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:21.914 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.511+0000 7fd6b259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6b407bdf0 0x7fd6b419c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56418/0 (socket says 172.21.15.8:56418) 2023-08-11T12:15:21.914 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.511+0000 7fd6b259c700 1 -- 172.21.15.8:0/1143255081 learned_addr learned my addr 172.21.15.8:0/1143255081 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:21.915 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.512+0000 7fd6b259c700 1 -- 172.21.15.8:0/1143255081 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a4009550 con 0x7fd6b407bdf0 2023-08-11T12:15:21.915 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.512+0000 7fd6b259c700 1 --2- 172.21.15.8:0/1143255081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6b407bdf0 0x7fd6b419c0b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4011980 tx=0x7fd6a4011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:21.917 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.512+0000 7fd6a37fe700 1 -- 172.21.15.8:0/1143255081 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6a4003a60 con 0x7fd6b407bdf0 2023-08-11T12:15:21.917 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.513+0000 7fd6a37fe700 1 -- 172.21.15.8:0/1143255081 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6a4003bc0 con 0x7fd6b407bdf0 2023-08-11T12:15:21.917 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.513+0000 7fd6b8875700 1 -- 172.21.15.8:0/1143255081 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b419c7f0 con 0x7fd6b407bdf0 2023-08-11T12:15:21.918 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.513+0000 7fd6a37fe700 1 -- 172.21.15.8:0/1143255081 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6a401a670 con 0x7fd6b407bdf0 2023-08-11T12:15:21.918 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.513+0000 7fd6b8875700 1 -- 172.21.15.8:0/1143255081 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b419cc10 con 0x7fd6b407bdf0 2023-08-11T12:15:21.918 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.514+0000 7fd6b8875700 1 -- 172.21.15.8:0/1143255081 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b410c5b0 con 0x7fd6b407bdf0 2023-08-11T12:15:21.918 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.514+0000 7fd6a37fe700 1 -- 172.21.15.8:0/1143255081 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45135+0+0 (secure 0 0 0) 0x7fd6a4024a00 con 0x7fd6b407bdf0 2023-08-11T12:15:21.918 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.515+0000 7fd6a37fe700 1 --2- 172.21.15.8:0/1143255081 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fd69c038110 0x7fd69c03a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:21.918 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.515+0000 7fd6a37fe700 1 -- 172.21.15.8:0/1143255081 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd6a404c0a0 con 0x7fd6b407bdf0 2023-08-11T12:15:21.918 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.515+0000 7fd6b1d9b700 1 --2- 172.21.15.8:0/1143255081 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fd69c038110 0x7fd69c03a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:21.918 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.516+0000 7fd6b1d9b700 1 --2- 172.21.15.8:0/1143255081 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fd69c038110 0x7fd69c03a5d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8006fd0 tx=0x7fd6a8006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:21.919 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.521+0000 7fd6a37fe700 1 -- 172.21.15.8:0/1143255081 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fd6a40189a0 con 0x7fd6b407bdf0 2023-08-11T12:15:21.919 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:20.794+0000 7fd6b8875700 1 -- 172.21.15.8:0/1143255081 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fd6b410c7f0 con 0x7fd6b407bdf0 2023-08-11T12:15:21.919 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:21.374+0000 7fd6a37fe700 1 -- 172.21.15.8:0/1143255081 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 9) v1 ==== 45148+0+0 (secure 0 0 0) 0x7fd6a402d910 con 0x7fd6b407bdf0 2023-08-11T12:15:21.919 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:21.376+0000 7fd6a37fe700 1 -- 172.21.15.8:0/1143255081 <== mon.0 v2:172.21.15.8:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fd6a404eb90 con 0x7fd6b407bdf0 2023-08-11T12:15:21.919 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:21.378+0000 7fd6b8875700 1 -- 172.21.15.8:0/1143255081 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fd69c038110 msgr2=0x7fd69c03a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:21.919 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:21.378+0000 7fd6b8875700 1 --2- 172.21.15.8:0/1143255081 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fd69c038110 0x7fd69c03a5d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8006fd0 tx=0x7fd6a8006e40 comp rx=0 tx=0).stop 2023-08-11T12:15:21.919 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:21.378+0000 7fd6b8875700 1 -- 172.21.15.8:0/1143255081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6b407bdf0 msgr2=0x7fd6b419c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:21.920 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:21.378+0000 7fd6b8875700 1 --2- 172.21.15.8:0/1143255081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6b407bdf0 0x7fd6b419c0b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4011980 tx=0x7fd6a4011a60 comp rx=0 tx=0).stop 2023-08-11T12:15:21.920 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:21.378+0000 7fd6b8875700 1 -- 172.21.15.8:0/1143255081 shutdown_connections 2023-08-11T12:15:21.920 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:21.378+0000 7fd6b8875700 1 --2- 172.21.15.8:0/1143255081 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7fd69c038110 0x7fd69c03a5d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:21.920 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:21.378+0000 7fd6b8875700 1 --2- 172.21.15.8:0/1143255081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6b407bdf0 0x7fd6b419c0b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:21.920 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:21.378+0000 7fd6b8875700 1 -- 172.21.15.8:0/1143255081 >> 172.21.15.8:0/1143255081 conn(0x7fd6b4101750 msgr2=0x7fd6b4102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:21.920 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:21.378+0000 7fd6b8875700 1 -- 172.21.15.8:0/1143255081 shutdown_connections 2023-08-11T12:15:21.921 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:21.379+0000 7fd6b8875700 1 -- 172.21.15.8:0/1143255081 wait complete. 2023-08-11T12:15:22.053 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:21 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:21.676+0000 7f34d0172200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-11T12:15:22.053 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:21 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:21.788+0000 7f34d0172200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-11T12:15:22.053 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:21 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:21.915+0000 7f34d0172200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-11T12:15:22.354 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:22 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:22.058+0000 7f34d0172200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-11T12:15:22.354 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:22 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:22.301+0000 7f34d0172200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-11T12:15:22.641 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:22 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1143255081' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-08-11T12:15:22.641 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:22 smithi008 ceph-mon[97158]: mgrmap e9: x(active, since 18s) 2023-08-11T12:15:22.952 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:22 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:22.835+0000 7f34d0172200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-11T12:15:23.278 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:23 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:23.015+0000 7f34d0172200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-11T12:15:23.278 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:23 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:23.142+0000 7f34d0172200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-11T12:15:23.278 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:23 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:23.275+0000 7f34d0172200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-11T12:15:23.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:23 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/208417800' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-08-11T12:15:23.599 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-08-11T12:15:23.604 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-08-11T12:15:23.604 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "available": true, 2023-08-11T12:15:23.605 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-08-11T12:15:23.605 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-08-11T12:15:23.605 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-08-11T12:15:23.605 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.605+0000 7f73d3a67700 1 Processor -- start 2023-08-11T12:15:23.605 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.605+0000 7f73d3a67700 1 -- start start 2023-08-11T12:15:23.605 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.606+0000 7f73d3a67700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73cc106c10 0x7f73cc109000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:23.605 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.606+0000 7f73d3a67700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc079e40 con 0x7f73cc106c10 2023-08-11T12:15:23.606 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.606+0000 7f73d1803700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73cc106c10 0x7f73cc109000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:23.606 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.606+0000 7f73d1803700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73cc106c10 0x7f73cc109000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56446/0 (socket says 172.21.15.8:56446) 2023-08-11T12:15:23.606 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.606+0000 7f73d1803700 1 -- 172.21.15.8:0/1313132393 learned_addr learned my addr 172.21.15.8:0/1313132393 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:23.606 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.607+0000 7f73d1803700 1 -- 172.21.15.8:0/1313132393 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73cc109540 con 0x7f73cc106c10 2023-08-11T12:15:23.606 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.607+0000 7f73d1803700 1 --2- 172.21.15.8:0/1313132393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73cc106c10 0x7f73cc109000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f73c80098a0 tx=0x7f73c8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ddc629fe82dc920 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:23.606 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.607+0000 7f73d0801700 1 -- 172.21.15.8:0/1313132393 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73c8004160 con 0x7f73cc106c10 2023-08-11T12:15:23.606 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.607+0000 7f73d0801700 1 -- 172.21.15.8:0/1313132393 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f73c80042c0 con 0x7f73cc106c10 2023-08-11T12:15:23.607 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.608+0000 7f73d0801700 1 -- 172.21.15.8:0/1313132393 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73c80119b0 con 0x7f73cc106c10 2023-08-11T12:15:23.607 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.608+0000 7f73d3a67700 1 -- 172.21.15.8:0/1313132393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73cc106c10 msgr2=0x7f73cc109000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:23.607 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.608+0000 7f73d3a67700 1 --2- 172.21.15.8:0/1313132393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73cc106c10 0x7f73cc109000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f73c80098a0 tx=0x7f73c8009bb0 comp rx=0 tx=0).stop 2023-08-11T12:15:23.607 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.609+0000 7f73d3a67700 1 -- 172.21.15.8:0/1313132393 shutdown_connections 2023-08-11T12:15:23.607 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.609+0000 7f73d3a67700 1 --2- 172.21.15.8:0/1313132393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73cc106c10 0x7f73cc109000 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:23.607 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.609+0000 7f73d3a67700 1 -- 172.21.15.8:0/1313132393 >> 172.21.15.8:0/1313132393 conn(0x7f73cc100620 msgr2=0x7f73cc102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:23.607 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.609+0000 7f73d3a67700 1 -- 172.21.15.8:0/1313132393 shutdown_connections 2023-08-11T12:15:23.608 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.609+0000 7f73d3a67700 1 -- 172.21.15.8:0/1313132393 wait complete. 2023-08-11T12:15:23.608 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.610+0000 7f73d3a67700 1 Processor -- start 2023-08-11T12:15:23.608 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.610+0000 7f73d3a67700 1 -- start start 2023-08-11T12:15:23.608 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.610+0000 7f73d3a67700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73cc106c10 0x7f73cc193150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:23.608 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.610+0000 7f73d3a67700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc193690 con 0x7f73cc106c10 2023-08-11T12:15:23.608 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.611+0000 7f73d1803700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73cc106c10 0x7f73cc193150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:23.608 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.611+0000 7f73d1803700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73cc106c10 0x7f73cc193150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56448/0 (socket says 172.21.15.8:56448) 2023-08-11T12:15:23.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.611+0000 7f73d1803700 1 -- 172.21.15.8:0/208417800 learned_addr learned my addr 172.21.15.8:0/208417800 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:23.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.611+0000 7f73d1803700 1 -- 172.21.15.8:0/208417800 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c8009550 con 0x7f73cc106c10 2023-08-11T12:15:23.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.611+0000 7f73d1803700 1 --2- 172.21.15.8:0/208417800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73cc106c10 0x7f73cc193150 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f73c8011980 tx=0x7f73c8011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:23.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.612+0000 7f73c2ffd700 1 -- 172.21.15.8:0/208417800 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73c8003a60 con 0x7f73cc106c10 2023-08-11T12:15:23.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.612+0000 7f73c2ffd700 1 -- 172.21.15.8:0/208417800 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f73c8003bc0 con 0x7f73cc106c10 2023-08-11T12:15:23.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.612+0000 7f73c2ffd700 1 -- 172.21.15.8:0/208417800 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73c801a670 con 0x7f73cc106c10 2023-08-11T12:15:23.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.612+0000 7f73d3a67700 1 -- 172.21.15.8:0/208417800 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73cc193890 con 0x7f73cc106c10 2023-08-11T12:15:23.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.612+0000 7f73d3a67700 1 -- 172.21.15.8:0/208417800 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73cc18fd80 con 0x7f73cc106c10 2023-08-11T12:15:23.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.613+0000 7f73c2ffd700 1 -- 172.21.15.8:0/208417800 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 9) v1 ==== 45148+0+0 (secure 0 0 0) 0x7f73c801a8e0 con 0x7f73cc106c10 2023-08-11T12:15:23.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.613+0000 7f73d3a67700 1 -- 172.21.15.8:0/208417800 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73cc061f50 con 0x7f73cc106c10 2023-08-11T12:15:23.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.614+0000 7f73c2ffd700 1 --2- 172.21.15.8:0/208417800 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f73b80381b0 0x7f73b803a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:23.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.614+0000 7f73c2ffd700 1 -- 172.21.15.8:0/208417800 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f73c804c030 con 0x7f73cc106c10 2023-08-11T12:15:23.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.614+0000 7f73d1002700 1 -- 172.21.15.8:0/208417800 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f73b80381b0 msgr2=0x7f73b803a670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2832004641 2023-08-11T12:15:23.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.614+0000 7f73d1002700 1 --2- 172.21.15.8:0/208417800 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f73b80381b0 0x7f73b803a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-11T12:15:23.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.620+0000 7f73c2ffd700 1 -- 172.21.15.8:0/208417800 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f73c807ec30 con 0x7f73cc106c10 2023-08-11T12:15:23.611 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.815+0000 7f73d1002700 1 -- 172.21.15.8:0/208417800 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f73b80381b0 msgr2=0x7f73b803a670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2832004641 2023-08-11T12:15:23.611 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.815+0000 7f73d1002700 1 --2- 172.21.15.8:0/208417800 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f73b80381b0 0x7f73b803a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-11T12:15:23.611 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.933+0000 7f73d3a67700 1 -- 172.21.15.8:0/208417800 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f73cc10a380 con 0x7f73cc106c10 2023-08-11T12:15:23.611 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.933+0000 7f73c2ffd700 1 -- 172.21.15.8:0/208417800 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7f73c8024a00 con 0x7f73cc106c10 2023-08-11T12:15:23.611 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.935+0000 7f73d3a67700 1 -- 172.21.15.8:0/208417800 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f73b80381b0 msgr2=0x7f73b803a670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-11T12:15:23.611 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.935+0000 7f73d3a67700 1 --2- 172.21.15.8:0/208417800 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f73b80381b0 0x7f73b803a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:23.611 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.935+0000 7f73d3a67700 1 -- 172.21.15.8:0/208417800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73cc106c10 msgr2=0x7f73cc193150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:23.611 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.935+0000 7f73d3a67700 1 --2- 172.21.15.8:0/208417800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73cc106c10 0x7f73cc193150 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f73c8011980 tx=0x7f73c8011a60 comp rx=0 tx=0).stop 2023-08-11T12:15:23.612 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.935+0000 7f73d3a67700 1 -- 172.21.15.8:0/208417800 shutdown_connections 2023-08-11T12:15:23.612 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.935+0000 7f73d3a67700 1 --2- 172.21.15.8:0/208417800 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7f73b80381b0 0x7f73b803a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:23.612 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.935+0000 7f73d3a67700 1 --2- 172.21.15.8:0/208417800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73cc106c10 0x7f73cc193150 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:23.612 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.935+0000 7f73d3a67700 1 -- 172.21.15.8:0/208417800 >> 172.21.15.8:0/208417800 conn(0x7f73cc100620 msgr2=0x7f73cc101400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:23.612 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.936+0000 7f73d3a67700 1 -- 172.21.15.8:0/208417800 shutdown_connections 2023-08-11T12:15:23.612 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:22.936+0000 7f73d3a67700 1 -- 172.21.15.8:0/208417800 wait complete. 2023-08-11T12:15:23.612 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for the mgr to restart... 2023-08-11T12:15:23.613 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mgr epoch 9... 2023-08-11T12:15:24.303 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:23 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:23.859+0000 7f34d0172200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-11T12:15:25.053 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:24 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:24.755+0000 7f34d0172200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-11T12:15:25.053 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:24 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:24.867+0000 7f34d0172200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-11T12:15:26.228 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:25 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:25.863+0000 7f34d0172200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-11T12:15:26.229 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:25 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:25.990+0000 7f34d0172200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-11T12:15:26.229 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:26 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:26.226+0000 7f34d0172200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-11T12:15:26.889 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:26 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:26.603+0000 7f34d0172200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-11T12:15:27.303 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:26 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:26.887+0000 7f34d0172200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-11T12:15:27.303 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:27 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:27.091+0000 7f34d0172200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-11T12:15:27.803 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:27 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:27.451+0000 7f34d0172200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-11T12:15:28.803 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:28 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:28.421+0000 7f34d0172200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-11T12:15:28.803 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:28 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:28.605+0000 7f34d0172200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-11T12:15:29.303 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:28 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:28.864+0000 7f34d0172200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-11T12:15:29.303 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:29 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:29.017+0000 7f34d0172200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-11T12:15:29.803 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:29 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:29.307+0000 7f34d0172200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-11T12:15:30.803 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:15:30 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:15:30.420+0000 7f34d0172200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-11T12:15:30.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:30 smithi008 ceph-mon[97158]: Active manager daemon x restarted 2023-08-11T12:15:30.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:30 smithi008 ceph-mon[97158]: Activating manager daemon x 2023-08-11T12:15:30.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:30 smithi008 ceph-mon[97158]: osdmap e3: 0 total, 0 up, 0 in 2023-08-11T12:15:30.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:30 smithi008 ceph-mon[97158]: mgrmap e10: x(active, starting, since 0.00394514s) 2023-08-11T12:15:30.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:30 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-11T12:15:30.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:30 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-08-11T12:15:30.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:30 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-08-11T12:15:30.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:30 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-08-11T12:15:30.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:30 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-08-11T12:15:30.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:30 smithi008 ceph-mon[97158]: Manager daemon x is now available 2023-08-11T12:15:30.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:30 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:15:30.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:30 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:15:30.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:30 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-08-11T12:15:30.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:30 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-08-11T12:15:31.923 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-08-11T12:15:31.924 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-08-11T12:15:31.924 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "initialized": true 2023-08-11T12:15:31.924 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-08-11T12:15:31.924 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.159+0000 7ff4f73dd700 1 Processor -- start 2023-08-11T12:15:31.925 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.159+0000 7ff4f73dd700 1 -- start start 2023-08-11T12:15:31.925 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.159+0000 7ff4f73dd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4f007bdf0 0x7ff4f007a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:31.925 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.159+0000 7ff4f73dd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f007a820 con 0x7ff4f007bdf0 2023-08-11T12:15:31.925 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.160+0000 7ff4f5179700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4f007bdf0 0x7ff4f007a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:31.925 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.160+0000 7ff4f5179700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4f007bdf0 0x7ff4f007a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56454/0 (socket says 172.21.15.8:56454) 2023-08-11T12:15:31.925 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.160+0000 7ff4f5179700 1 -- 172.21.15.8:0/725596055 learned_addr learned my addr 172.21.15.8:0/725596055 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:31.925 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.160+0000 7ff4f5179700 1 -- 172.21.15.8:0/725596055 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f007a960 con 0x7ff4f007bdf0 2023-08-11T12:15:31.926 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.160+0000 7ff4f5179700 1 --2- 172.21.15.8:0/725596055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4f007bdf0 0x7ff4f007a250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0098a0 tx=0x7ff4ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de09fb594aaba19 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:31.926 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.161+0000 7ff4e7fff700 1 -- 172.21.15.8:0/725596055 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4ec004160 con 0x7ff4f007bdf0 2023-08-11T12:15:31.926 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.161+0000 7ff4e7fff700 1 -- 172.21.15.8:0/725596055 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff4ec0042c0 con 0x7ff4f007bdf0 2023-08-11T12:15:31.926 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.161+0000 7ff4e7fff700 1 -- 172.21.15.8:0/725596055 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4ec0119b0 con 0x7ff4f007bdf0 2023-08-11T12:15:31.926 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.161+0000 7ff4f73dd700 1 -- 172.21.15.8:0/725596055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4f007bdf0 msgr2=0x7ff4f007a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:31.926 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.161+0000 7ff4f73dd700 1 --2- 172.21.15.8:0/725596055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4f007bdf0 0x7ff4f007a250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0098a0 tx=0x7ff4ec009bb0 comp rx=0 tx=0).stop 2023-08-11T12:15:31.926 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.161+0000 7ff4f73dd700 1 -- 172.21.15.8:0/725596055 shutdown_connections 2023-08-11T12:15:31.926 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.161+0000 7ff4f73dd700 1 --2- 172.21.15.8:0/725596055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4f007bdf0 0x7ff4f007a250 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:31.927 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.162+0000 7ff4f73dd700 1 -- 172.21.15.8:0/725596055 >> 172.21.15.8:0/725596055 conn(0x7ff4f0101750 msgr2=0x7ff4f0103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:31.927 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.162+0000 7ff4f73dd700 1 -- 172.21.15.8:0/725596055 shutdown_connections 2023-08-11T12:15:31.927 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.162+0000 7ff4f73dd700 1 -- 172.21.15.8:0/725596055 wait complete. 2023-08-11T12:15:31.927 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.163+0000 7ff4f73dd700 1 Processor -- start 2023-08-11T12:15:31.927 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.163+0000 7ff4f73dd700 1 -- start start 2023-08-11T12:15:31.927 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.163+0000 7ff4f73dd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4f007bdf0 0x7ff4f019c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:31.927 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.163+0000 7ff4f73dd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f019c5d0 con 0x7ff4f007bdf0 2023-08-11T12:15:31.928 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.163+0000 7ff4f5179700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4f007bdf0 0x7ff4f019c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:31.928 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.163+0000 7ff4f5179700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4f007bdf0 0x7ff4f019c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56464/0 (socket says 172.21.15.8:56464) 2023-08-11T12:15:31.928 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.163+0000 7ff4f5179700 1 -- 172.21.15.8:0/2884597833 learned_addr learned my addr 172.21.15.8:0/2884597833 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:31.928 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.164+0000 7ff4f5179700 1 -- 172.21.15.8:0/2884597833 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ec009550 con 0x7ff4f007bdf0 2023-08-11T12:15:31.928 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.164+0000 7ff4f5179700 1 --2- 172.21.15.8:0/2884597833 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4f007bdf0 0x7ff4f019c090 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec011980 tx=0x7ff4ec011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:31.928 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.164+0000 7ff4e67fc700 1 -- 172.21.15.8:0/2884597833 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4ec003a60 con 0x7ff4f007bdf0 2023-08-11T12:15:31.929 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.164+0000 7ff4f73dd700 1 -- 172.21.15.8:0/2884597833 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f019c7d0 con 0x7ff4f007bdf0 2023-08-11T12:15:31.929 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.164+0000 7ff4e67fc700 1 -- 172.21.15.8:0/2884597833 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff4ec003bc0 con 0x7ff4f007bdf0 2023-08-11T12:15:31.929 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.164+0000 7ff4e67fc700 1 -- 172.21.15.8:0/2884597833 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4ec01a670 con 0x7ff4f007bdf0 2023-08-11T12:15:31.929 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.165+0000 7ff4f73dd700 1 -- 172.21.15.8:0/2884597833 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f019cbf0 con 0x7ff4f007bdf0 2023-08-11T12:15:31.929 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.166+0000 7ff4e67fc700 1 -- 172.21.15.8:0/2884597833 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 9) v1 ==== 45148+0+0 (secure 0 0 0) 0x7ff4ec024a00 con 0x7ff4f007bdf0 2023-08-11T12:15:31.929 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.166+0000 7ff4e67fc700 1 --2- 172.21.15.8:0/2884597833 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7ff4dc038160 0x7ff4dc03a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:31.930 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.166+0000 7ff4e67fc700 1 -- 172.21.15.8:0/2884597833 --> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff4dc03ad30 con 0x7ff4dc038160 2023-08-11T12:15:31.930 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.166+0000 7ff4e67fc700 1 -- 172.21.15.8:0/2884597833 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff4ec04c150 con 0x7ff4f007bdf0 2023-08-11T12:15:31.930 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.167+0000 7ff4f4978700 1 -- 172.21.15.8:0/2884597833 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7ff4dc038160 msgr2=0x7ff4dc03a620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2832004641 2023-08-11T12:15:31.930 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.167+0000 7ff4f4978700 1 --2- 172.21.15.8:0/2884597833 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7ff4dc038160 0x7ff4dc03a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-11T12:15:31.930 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.368+0000 7ff4f4978700 1 -- 172.21.15.8:0/2884597833 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7ff4dc038160 msgr2=0x7ff4dc03a620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2832004641 2023-08-11T12:15:31.930 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.368+0000 7ff4f4978700 1 --2- 172.21.15.8:0/2884597833 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7ff4dc038160 0x7ff4dc03a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-11T12:15:31.931 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.769+0000 7ff4f4978700 1 -- 172.21.15.8:0/2884597833 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7ff4dc038160 msgr2=0x7ff4dc03a620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2832004641 2023-08-11T12:15:31.931 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:24.769+0000 7ff4f4978700 1 --2- 172.21.15.8:0/2884597833 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7ff4dc038160 0x7ff4dc03a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-08-11T12:15:31.931 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:25.570+0000 7ff4f4978700 1 -- 172.21.15.8:0/2884597833 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7ff4dc038160 msgr2=0x7ff4dc03a620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2832004641 2023-08-11T12:15:31.931 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:25.570+0000 7ff4f4978700 1 --2- 172.21.15.8:0/2884597833 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7ff4dc038160 0x7ff4dc03a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-08-11T12:15:31.931 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:27.171+0000 7ff4f4978700 1 -- 172.21.15.8:0/2884597833 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7ff4dc038160 msgr2=0x7ff4dc03a620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2832004641 2023-08-11T12:15:31.931 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:27.172+0000 7ff4f4978700 1 --2- 172.21.15.8:0/2884597833 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7ff4dc038160 0x7ff4dc03a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-08-11T12:15:31.931 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:30.375+0000 7ff4f4978700 1 -- 172.21.15.8:0/2884597833 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7ff4dc038160 msgr2=0x7ff4dc03a620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2832004641 2023-08-11T12:15:31.932 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:30.375+0000 7ff4f4978700 1 --2- 172.21.15.8:0/2884597833 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7ff4dc038160 0x7ff4dc03a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-08-11T12:15:31.932 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:30.425+0000 7ff4e67fc700 1 -- 172.21.15.8:0/2884597833 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mgrmap(e 10) v1 ==== 44915+0+0 (secure 0 0 0) 0x7ff4ec02d910 con 0x7ff4f007bdf0 2023-08-11T12:15:31.932 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:30.425+0000 7ff4e67fc700 1 -- 172.21.15.8:0/2884597833 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7ff4dc038160 msgr2=0x7ff4dc03a620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-11T12:15:31.932 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:30.425+0000 7ff4e67fc700 1 --2- 172.21.15.8:0/2884597833 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7ff4dc038160 0x7ff4dc03a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:31.932 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:31.427+0000 7ff4e67fc700 1 -- 172.21.15.8:0/2884597833 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 11) v1 ==== 45042+0+0 (secure 0 0 0) 0x7ff4ec019c10 con 0x7ff4f007bdf0 2023-08-11T12:15:31.932 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:31.428+0000 7ff4e67fc700 1 --2- 172.21.15.8:0/2884597833 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff4dc03bc10 0x7ff4dc03e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:31.932 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:31.428+0000 7ff4e67fc700 1 -- 172.21.15.8:0/2884597833 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff4dc03ad30 con 0x7ff4dc03bc10 2023-08-11T12:15:31.933 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:31.429+0000 7ff4f4978700 1 --2- 172.21.15.8:0/2884597833 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff4dc03bc10 0x7ff4dc03e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:31.933 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:31.430+0000 7ff4f4978700 1 --2- 172.21.15.8:0/2884597833 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff4dc03bc10 0x7ff4dc03e000 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0003a10 tx=0x7ff4e00092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:31.933 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:31.431+0000 7ff4e67fc700 1 -- 172.21.15.8:0/2884597833 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7ff4dc03ad30 con 0x7ff4dc03bc10 2023-08-11T12:15:31.933 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:31.438+0000 7ff4f73dd700 1 -- 172.21.15.8:0/2884597833 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7ff4f019d3d0 con 0x7ff4dc03bc10 2023-08-11T12:15:31.933 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:31.439+0000 7ff4e67fc700 1 -- 172.21.15.8:0/2884597833 <== mgr.14150 v2:172.21.15.8:6800/2041276411 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7ff4f019d3d0 con 0x7ff4dc03bc10 2023-08-11T12:15:31.933 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:31.439+0000 7ff4f73dd700 1 -- 172.21.15.8:0/2884597833 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff4dc03bc10 msgr2=0x7ff4dc03e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:31.933 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:31.439+0000 7ff4f73dd700 1 --2- 172.21.15.8:0/2884597833 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff4dc03bc10 0x7ff4dc03e000 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0003a10 tx=0x7ff4e00092b0 comp rx=0 tx=0).stop 2023-08-11T12:15:31.934 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:31.439+0000 7ff4f73dd700 1 -- 172.21.15.8:0/2884597833 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4f007bdf0 msgr2=0x7ff4f019c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:31.934 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:31.439+0000 7ff4f73dd700 1 --2- 172.21.15.8:0/2884597833 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4f007bdf0 0x7ff4f019c090 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec011980 tx=0x7ff4ec011a60 comp rx=0 tx=0).stop 2023-08-11T12:15:31.934 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:31.439+0000 7ff4f73dd700 1 -- 172.21.15.8:0/2884597833 shutdown_connections 2023-08-11T12:15:31.934 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:31.439+0000 7ff4f73dd700 1 --2- 172.21.15.8:0/2884597833 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff4dc03bc10 0x7ff4dc03e000 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:31.934 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:31.439+0000 7ff4f73dd700 1 --2- 172.21.15.8:0/2884597833 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4f007bdf0 0x7ff4f019c090 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:31.934 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:31.439+0000 7ff4f73dd700 1 --2- 172.21.15.8:0/2884597833 >> [v2:172.21.15.8:6800/2832004641,v1:172.21.15.8:6801/2832004641] conn(0x7ff4dc038160 0x7ff4dc03a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:31.934 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:31.439+0000 7ff4f73dd700 1 -- 172.21.15.8:0/2884597833 >> 172.21.15.8:0/2884597833 conn(0x7ff4f0101750 msgr2=0x7ff4f0102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:31.935 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:31.439+0000 7ff4f73dd700 1 -- 172.21.15.8:0/2884597833 shutdown_connections 2023-08-11T12:15:31.935 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:31.439+0000 7ff4f73dd700 1 -- 172.21.15.8:0/2884597833 wait complete. 2023-08-11T12:15:31.935 INFO:teuthology.orchestra.run.smithi008.stdout:mgr epoch 9 is available 2023-08-11T12:15:31.935 INFO:teuthology.orchestra.run.smithi008.stdout:Generating a dashboard self-signed certificate... 2023-08-11T12:15:32.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:32 smithi008 ceph-mon[97158]: [11/Aug/2023:12:15:31] ENGINE Bus STARTING 2023-08-11T12:15:32.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:32 smithi008 ceph-mon[97158]: [11/Aug/2023:12:15:31] ENGINE Serving on https://172.21.15.8:7150 2023-08-11T12:15:32.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:32 smithi008 ceph-mon[97158]: [11/Aug/2023:12:15:31] ENGINE Serving on http://172.21.15.8:8765 2023-08-11T12:15:32.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:32 smithi008 ceph-mon[97158]: [11/Aug/2023:12:15:31] ENGINE Bus STARTED 2023-08-11T12:15:32.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:32 smithi008 ceph-mon[97158]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-08-11T12:15:32.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:32 smithi008 ceph-mon[97158]: mgrmap e11: x(active, since 1.00869s) 2023-08-11T12:15:32.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:32 smithi008 ceph-mon[97158]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-08-11T12:15:33.301 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-08-11T12:15:33.302 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.546+0000 7f9c1714e700 1 Processor -- start 2023-08-11T12:15:33.302 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.546+0000 7f9c1714e700 1 -- start start 2023-08-11T12:15:33.302 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.546+0000 7f9c1714e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c101061b0 0x7f9c101065d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:33.302 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.546+0000 7f9c1714e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c10106ba0 con 0x7f9c101061b0 2023-08-11T12:15:33.302 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.547+0000 7f9c14eea700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c101061b0 0x7f9c101065d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:33.302 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.547+0000 7f9c14eea700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c101061b0 0x7f9c101065d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58110/0 (socket says 172.21.15.8:58110) 2023-08-11T12:15:33.303 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.547+0000 7f9c14eea700 1 -- 172.21.15.8:0/1736475817 learned_addr learned my addr 172.21.15.8:0/1736475817 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:33.303 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.547+0000 7f9c14eea700 1 -- 172.21.15.8:0/1736475817 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c101073b0 con 0x7f9c101061b0 2023-08-11T12:15:33.303 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.547+0000 7f9c14eea700 1 --2- 172.21.15.8:0/1736475817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c101061b0 0x7f9c101065d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9c040098a0 tx=0x7f9c04009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb3527dad0d1710 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:33.303 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.547+0000 7f9c0f7fe700 1 -- 172.21.15.8:0/1736475817 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c04004160 con 0x7f9c101061b0 2023-08-11T12:15:33.303 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.548+0000 7f9c0f7fe700 1 -- 172.21.15.8:0/1736475817 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c040042c0 con 0x7f9c101061b0 2023-08-11T12:15:33.303 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.548+0000 7f9c0f7fe700 1 -- 172.21.15.8:0/1736475817 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c040119b0 con 0x7f9c101061b0 2023-08-11T12:15:33.303 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.548+0000 7f9c1714e700 1 -- 172.21.15.8:0/1736475817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c101061b0 msgr2=0x7f9c101065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:33.304 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.548+0000 7f9c1714e700 1 --2- 172.21.15.8:0/1736475817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c101061b0 0x7f9c101065d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9c040098a0 tx=0x7f9c04009bb0 comp rx=0 tx=0).stop 2023-08-11T12:15:33.304 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.548+0000 7f9c1714e700 1 -- 172.21.15.8:0/1736475817 shutdown_connections 2023-08-11T12:15:33.305 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.548+0000 7f9c1714e700 1 --2- 172.21.15.8:0/1736475817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c101061b0 0x7f9c101065d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:33.305 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.548+0000 7f9c1714e700 1 -- 172.21.15.8:0/1736475817 >> 172.21.15.8:0/1736475817 conn(0x7f9c10101750 msgr2=0x7f9c10103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:33.305 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.548+0000 7f9c1714e700 1 -- 172.21.15.8:0/1736475817 shutdown_connections 2023-08-11T12:15:33.305 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.548+0000 7f9c1714e700 1 -- 172.21.15.8:0/1736475817 wait complete. 2023-08-11T12:15:33.305 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.549+0000 7f9c1714e700 1 Processor -- start 2023-08-11T12:15:33.305 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.549+0000 7f9c1714e700 1 -- start start 2023-08-11T12:15:33.306 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.550+0000 7f9c1714e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c101061b0 0x7f9c1019c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:33.306 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.550+0000 7f9c1714e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1019c620 con 0x7f9c101061b0 2023-08-11T12:15:33.306 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.550+0000 7f9c14eea700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c101061b0 0x7f9c1019c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:33.306 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.550+0000 7f9c14eea700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c101061b0 0x7f9c1019c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58122/0 (socket says 172.21.15.8:58122) 2023-08-11T12:15:33.306 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.550+0000 7f9c14eea700 1 -- 172.21.15.8:0/1882290932 learned_addr learned my addr 172.21.15.8:0/1882290932 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:33.306 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.550+0000 7f9c14eea700 1 -- 172.21.15.8:0/1882290932 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c04009550 con 0x7f9c101061b0 2023-08-11T12:15:33.306 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.550+0000 7f9c14eea700 1 --2- 172.21.15.8:0/1882290932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c101061b0 0x7f9c1019c0e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9c04000c00 tx=0x7f9c04011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:33.306 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.551+0000 7f9c0dffb700 1 -- 172.21.15.8:0/1882290932 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c040039f0 con 0x7f9c101061b0 2023-08-11T12:15:33.307 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.551+0000 7f9c1714e700 1 -- 172.21.15.8:0/1882290932 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c1019c820 con 0x7f9c101061b0 2023-08-11T12:15:33.307 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.551+0000 7f9c0dffb700 1 -- 172.21.15.8:0/1882290932 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c04003b50 con 0x7f9c101061b0 2023-08-11T12:15:33.307 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.551+0000 7f9c0dffb700 1 -- 172.21.15.8:0/1882290932 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c0401a780 con 0x7f9c101061b0 2023-08-11T12:15:33.307 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.551+0000 7f9c1714e700 1 -- 172.21.15.8:0/1882290932 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c1019cc40 con 0x7f9c101061b0 2023-08-11T12:15:33.307 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.552+0000 7f9c0dffb700 1 -- 172.21.15.8:0/1882290932 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 12) v1 ==== 45148+0+0 (secure 0 0 0) 0x7f9c0401aa40 con 0x7f9c101061b0 2023-08-11T12:15:33.307 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.552+0000 7f9c1714e700 1 -- 172.21.15.8:0/1882290932 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c10061f50 con 0x7f9c101061b0 2023-08-11T12:15:33.307 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.552+0000 7f9c0dffb700 1 --2- 172.21.15.8:0/1882290932 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9c00038160 0x7f9c0003a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:33.308 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.552+0000 7f9c0dffb700 1 -- 172.21.15.8:0/1882290932 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f9c0404c450 con 0x7f9c101061b0 2023-08-11T12:15:33.308 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.553+0000 7f9c0ffff700 1 --2- 172.21.15.8:0/1882290932 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9c00038160 0x7f9c0003a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:33.308 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.553+0000 7f9c0ffff700 1 --2- 172.21.15.8:0/1882290932 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9c00038160 0x7f9c0003a620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc006fd0 tx=0x7f9bfc006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:33.308 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.558+0000 7f9c0dffb700 1 -- 172.21.15.8:0/1882290932 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f9c040189a0 con 0x7f9c101061b0 2023-08-11T12:15:33.308 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.790+0000 7f9c1714e700 1 -- 172.21.15.8:0/1882290932 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c10103a70 con 0x7f9c00038160 2023-08-11T12:15:33.308 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.876+0000 7f9c0dffb700 1 -- 172.21.15.8:0/1882290932 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f9c10103a70 con 0x7f9c00038160 2023-08-11T12:15:33.308 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.879+0000 7f9c1714e700 1 -- 172.21.15.8:0/1882290932 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9c00038160 msgr2=0x7f9c0003a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:33.309 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.879+0000 7f9c1714e700 1 --2- 172.21.15.8:0/1882290932 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9c00038160 0x7f9c0003a620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc006fd0 tx=0x7f9bfc006e40 comp rx=0 tx=0).stop 2023-08-11T12:15:33.309 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.879+0000 7f9c1714e700 1 -- 172.21.15.8:0/1882290932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c101061b0 msgr2=0x7f9c1019c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:33.309 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.879+0000 7f9c1714e700 1 --2- 172.21.15.8:0/1882290932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c101061b0 0x7f9c1019c0e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9c04000c00 tx=0x7f9c04011a30 comp rx=0 tx=0).stop 2023-08-11T12:15:33.309 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.879+0000 7f9c1714e700 1 -- 172.21.15.8:0/1882290932 shutdown_connections 2023-08-11T12:15:33.309 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.879+0000 7f9c1714e700 1 --2- 172.21.15.8:0/1882290932 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9c00038160 0x7f9c0003a620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:33.309 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.879+0000 7f9c1714e700 1 --2- 172.21.15.8:0/1882290932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c101061b0 0x7f9c1019c0e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:33.309 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.879+0000 7f9c1714e700 1 -- 172.21.15.8:0/1882290932 >> 172.21.15.8:0/1882290932 conn(0x7f9c10101750 msgr2=0x7f9c10102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:33.310 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.879+0000 7f9c1714e700 1 -- 172.21.15.8:0/1882290932 shutdown_connections 2023-08-11T12:15:33.310 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:32.879+0000 7f9c1714e700 1 -- 172.21.15.8:0/1882290932 wait complete. 2023-08-11T12:15:33.310 INFO:teuthology.orchestra.run.smithi008.stdout:Creating initial admin user... 2023-08-11T12:15:33.630 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:33 smithi008 ceph-mon[97158]: mgrmap e12: x(active, since 2s) 2023-08-11T12:15:33.630 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:33 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:15:33.630 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:33 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:15:33.630 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:33 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:15:34.613 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:34 smithi008 ceph-mon[97158]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:15:34.613 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:34 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:15:34.614 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:34 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:15:34.884 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$8bo.Jit8Vcg0EZPE4YI8aeXMyD0bc3MI1XZtE8UgoS2zN5uTQKT7G", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1691756134, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-08-11T12:15:34.884 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.840+0000 7f56d4c1f700 1 Processor -- start 2023-08-11T12:15:34.885 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.840+0000 7f56d4c1f700 1 -- start start 2023-08-11T12:15:34.885 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.841+0000 7f56d4c1f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56d007be30 0x7f56d007a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:34.885 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.841+0000 7f56d4c1f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d007a860 con 0x7f56d007be30 2023-08-11T12:15:34.889 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.841+0000 7f56ce59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56d007be30 0x7f56d007a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:34.889 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.841+0000 7f56ce59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56d007be30 0x7f56d007a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58138/0 (socket says 172.21.15.8:58138) 2023-08-11T12:15:34.889 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.841+0000 7f56ce59c700 1 -- 172.21.15.8:0/961489263 learned_addr learned my addr 172.21.15.8:0/961489263 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:34.889 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.841+0000 7f56ce59c700 1 -- 172.21.15.8:0/961489263 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d007a9a0 con 0x7f56d007be30 2023-08-11T12:15:34.890 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.842+0000 7f56ce59c700 1 --2- 172.21.15.8:0/961489263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56d007be30 0x7f56d007a290 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f56c00098a0 tx=0x7f56c0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316b534a34a5a761 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:34.890 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.842+0000 7f56cd59a700 1 -- 172.21.15.8:0/961489263 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56c0004160 con 0x7f56d007be30 2023-08-11T12:15:34.890 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.842+0000 7f56cd59a700 1 -- 172.21.15.8:0/961489263 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f56c00042c0 con 0x7f56d007be30 2023-08-11T12:15:34.890 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.842+0000 7f56cd59a700 1 -- 172.21.15.8:0/961489263 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56c00119b0 con 0x7f56d007be30 2023-08-11T12:15:34.890 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.843+0000 7f56d4c1f700 1 -- 172.21.15.8:0/961489263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56d007be30 msgr2=0x7f56d007a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:34.890 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.843+0000 7f56d4c1f700 1 --2- 172.21.15.8:0/961489263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56d007be30 0x7f56d007a290 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f56c00098a0 tx=0x7f56c0009bb0 comp rx=0 tx=0).stop 2023-08-11T12:15:34.890 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.843+0000 7f56d4c1f700 1 -- 172.21.15.8:0/961489263 shutdown_connections 2023-08-11T12:15:34.890 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.843+0000 7f56d4c1f700 1 --2- 172.21.15.8:0/961489263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56d007be30 0x7f56d007a290 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:34.891 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.843+0000 7f56d4c1f700 1 -- 172.21.15.8:0/961489263 >> 172.21.15.8:0/961489263 conn(0x7f56d0101750 msgr2=0x7f56d0103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:34.891 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.843+0000 7f56d4c1f700 1 -- 172.21.15.8:0/961489263 shutdown_connections 2023-08-11T12:15:34.891 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.843+0000 7f56d4c1f700 1 -- 172.21.15.8:0/961489263 wait complete. 2023-08-11T12:15:34.891 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.844+0000 7f56d4c1f700 1 Processor -- start 2023-08-11T12:15:34.891 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.844+0000 7f56d4c1f700 1 -- start start 2023-08-11T12:15:34.891 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.844+0000 7f56d4c1f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56d007be30 0x7f56d019c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:34.891 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.844+0000 7f56d4c1f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d019c620 con 0x7f56d007be30 2023-08-11T12:15:34.892 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.845+0000 7f56ce59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56d007be30 0x7f56d019c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:34.892 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.845+0000 7f56ce59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56d007be30 0x7f56d019c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58150/0 (socket says 172.21.15.8:58150) 2023-08-11T12:15:34.892 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.845+0000 7f56ce59c700 1 -- 172.21.15.8:0/1289724399 learned_addr learned my addr 172.21.15.8:0/1289724399 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:34.892 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.845+0000 7f56ce59c700 1 -- 172.21.15.8:0/1289724399 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c0009550 con 0x7f56d007be30 2023-08-11T12:15:34.892 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.845+0000 7f56ce59c700 1 --2- 172.21.15.8:0/1289724399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56d007be30 0x7f56d019c0e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f56c0000c00 tx=0x7f56c0011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:34.892 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.845+0000 7f56bf7fe700 1 -- 172.21.15.8:0/1289724399 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56c00039f0 con 0x7f56d007be30 2023-08-11T12:15:34.892 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.846+0000 7f56bf7fe700 1 -- 172.21.15.8:0/1289724399 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f56c0003b50 con 0x7f56d007be30 2023-08-11T12:15:34.893 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.846+0000 7f56d4c1f700 1 -- 172.21.15.8:0/1289724399 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d019c820 con 0x7f56d007be30 2023-08-11T12:15:34.893 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.846+0000 7f56bf7fe700 1 -- 172.21.15.8:0/1289724399 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56c001a780 con 0x7f56d007be30 2023-08-11T12:15:34.893 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.846+0000 7f56d4c1f700 1 -- 172.21.15.8:0/1289724399 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d019cc40 con 0x7f56d007be30 2023-08-11T12:15:34.893 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.847+0000 7f56d4c1f700 1 -- 172.21.15.8:0/1289724399 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d01961b0 con 0x7f56d007be30 2023-08-11T12:15:34.893 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.847+0000 7f56bf7fe700 1 -- 172.21.15.8:0/1289724399 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 12) v1 ==== 45148+0+0 (secure 0 0 0) 0x7f56c0024440 con 0x7f56d007be30 2023-08-11T12:15:34.893 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.848+0000 7f56bf7fe700 1 --2- 172.21.15.8:0/1289724399 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f56b8038160 0x7f56b803a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:34.893 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.848+0000 7f56bf7fe700 1 -- 172.21.15.8:0/1289724399 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f56c004c2a0 con 0x7f56d007be30 2023-08-11T12:15:34.893 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.848+0000 7f56cdd9b700 1 --2- 172.21.15.8:0/1289724399 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f56b8038160 0x7f56b803a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:34.894 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.849+0000 7f56cdd9b700 1 --2- 172.21.15.8:0/1289724399 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f56b8038160 0x7f56b803a620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f56c4006fd0 tx=0x7f56c4006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:34.894 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:33.853+0000 7f56bf7fe700 1 -- 172.21.15.8:0/1289724399 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f56c0018db0 con 0x7f56d007be30 2023-08-11T12:15:34.894 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:34.082+0000 7f56d4c1f700 1 -- 172.21.15.8:0/1289724399 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f56d0061d70 con 0x7f56b8038160 2023-08-11T12:15:34.894 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:34.330+0000 7f56bf7fe700 1 -- 172.21.15.8:0/1289724399 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f56d0061d70 con 0x7f56b8038160 2023-08-11T12:15:34.894 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:34.332+0000 7f56d4c1f700 1 -- 172.21.15.8:0/1289724399 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f56b8038160 msgr2=0x7f56b803a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:34.894 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:34.332+0000 7f56d4c1f700 1 --2- 172.21.15.8:0/1289724399 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f56b8038160 0x7f56b803a620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f56c4006fd0 tx=0x7f56c4006e40 comp rx=0 tx=0).stop 2023-08-11T12:15:34.894 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:34.332+0000 7f56d4c1f700 1 -- 172.21.15.8:0/1289724399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56d007be30 msgr2=0x7f56d019c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:34.895 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:34.332+0000 7f56d4c1f700 1 --2- 172.21.15.8:0/1289724399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56d007be30 0x7f56d019c0e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f56c0000c00 tx=0x7f56c0011a30 comp rx=0 tx=0).stop 2023-08-11T12:15:34.895 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:34.332+0000 7f56d4c1f700 1 -- 172.21.15.8:0/1289724399 shutdown_connections 2023-08-11T12:15:34.895 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:34.332+0000 7f56d4c1f700 1 --2- 172.21.15.8:0/1289724399 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f56b8038160 0x7f56b803a620 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:34.895 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:34.332+0000 7f56d4c1f700 1 --2- 172.21.15.8:0/1289724399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56d007be30 0x7f56d019c0e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:34.895 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:34.332+0000 7f56d4c1f700 1 -- 172.21.15.8:0/1289724399 >> 172.21.15.8:0/1289724399 conn(0x7f56d0101750 msgr2=0x7f56d0102ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:34.895 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:34.333+0000 7f56d4c1f700 1 -- 172.21.15.8:0/1289724399 shutdown_connections 2023-08-11T12:15:34.895 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:34.333+0000 7f56d4c1f700 1 -- 172.21.15.8:0/1289724399 wait complete. 2023-08-11T12:15:34.895 INFO:teuthology.orchestra.run.smithi008.stdout:Fetching dashboard port number... 2023-08-11T12:15:35.704 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:35 smithi008 ceph-mon[97158]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:15:36.366 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 8443 2023-08-11T12:15:36.366 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.434+0000 7f93bb5a0700 1 Processor -- start 2023-08-11T12:15:36.366 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.434+0000 7f93bb5a0700 1 -- start start 2023-08-11T12:15:36.366 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.435+0000 7f93bb5a0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b41061b0 0x7f93b41065d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:36.366 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.435+0000 7f93bb5a0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b4106ba0 con 0x7f93b41061b0 2023-08-11T12:15:36.368 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.435+0000 7f93b933c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b41061b0 0x7f93b41065d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:36.368 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.435+0000 7f93b933c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b41061b0 0x7f93b41065d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58154/0 (socket says 172.21.15.8:58154) 2023-08-11T12:15:36.368 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.435+0000 7f93b933c700 1 -- 172.21.15.8:0/4294872285 learned_addr learned my addr 172.21.15.8:0/4294872285 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:36.368 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.435+0000 7f93b933c700 1 -- 172.21.15.8:0/4294872285 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b41073b0 con 0x7f93b41061b0 2023-08-11T12:15:36.368 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.436+0000 7f93b933c700 1 --2- 172.21.15.8:0/4294872285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b41061b0 0x7f93b41065d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f93b00098a0 tx=0x7f93b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b861b6f94ce9c43 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:36.369 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.437+0000 7f93abfff700 1 -- 172.21.15.8:0/4294872285 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93b0004160 con 0x7f93b41061b0 2023-08-11T12:15:36.369 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.437+0000 7f93abfff700 1 -- 172.21.15.8:0/4294872285 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f93b00042c0 con 0x7f93b41061b0 2023-08-11T12:15:36.369 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.437+0000 7f93abfff700 1 -- 172.21.15.8:0/4294872285 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93b00119b0 con 0x7f93b41061b0 2023-08-11T12:15:36.369 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.438+0000 7f93bb5a0700 1 -- 172.21.15.8:0/4294872285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b41061b0 msgr2=0x7f93b41065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:36.369 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.438+0000 7f93bb5a0700 1 --2- 172.21.15.8:0/4294872285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b41061b0 0x7f93b41065d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f93b00098a0 tx=0x7f93b0009bb0 comp rx=0 tx=0).stop 2023-08-11T12:15:36.369 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.438+0000 7f93bb5a0700 1 -- 172.21.15.8:0/4294872285 shutdown_connections 2023-08-11T12:15:36.370 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.438+0000 7f93bb5a0700 1 --2- 172.21.15.8:0/4294872285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b41061b0 0x7f93b41065d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:36.370 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.438+0000 7f93bb5a0700 1 -- 172.21.15.8:0/4294872285 >> 172.21.15.8:0/4294872285 conn(0x7f93b4101750 msgr2=0x7f93b4103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:36.370 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.439+0000 7f93bb5a0700 1 -- 172.21.15.8:0/4294872285 shutdown_connections 2023-08-11T12:15:36.370 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.439+0000 7f93bb5a0700 1 -- 172.21.15.8:0/4294872285 wait complete. 2023-08-11T12:15:36.370 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.440+0000 7f93bb5a0700 1 Processor -- start 2023-08-11T12:15:36.373 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.440+0000 7f93bb5a0700 1 -- start start 2023-08-11T12:15:36.373 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.441+0000 7f93bb5a0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b41061b0 0x7f93b4199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:36.373 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.441+0000 7f93bb5a0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b419a400 con 0x7f93b41061b0 2023-08-11T12:15:36.374 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.441+0000 7f93b933c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b41061b0 0x7f93b4199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:36.374 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.441+0000 7f93b933c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b41061b0 0x7f93b4199ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58160/0 (socket says 172.21.15.8:58160) 2023-08-11T12:15:36.374 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.441+0000 7f93b933c700 1 -- 172.21.15.8:0/4132475496 learned_addr learned my addr 172.21.15.8:0/4132475496 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:36.374 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.442+0000 7f93b933c700 1 -- 172.21.15.8:0/4132475496 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b0009550 con 0x7f93b41061b0 2023-08-11T12:15:36.374 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.442+0000 7f93b933c700 1 --2- 172.21.15.8:0/4132475496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b41061b0 0x7f93b4199ec0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f93b0000c00 tx=0x7f93b0011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:36.375 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.442+0000 7f93aa7fc700 1 -- 172.21.15.8:0/4132475496 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93b00039f0 con 0x7f93b41061b0 2023-08-11T12:15:36.375 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.442+0000 7f93aa7fc700 1 -- 172.21.15.8:0/4132475496 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f93b0003b50 con 0x7f93b41061b0 2023-08-11T12:15:36.375 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.442+0000 7f93aa7fc700 1 -- 172.21.15.8:0/4132475496 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93b001a780 con 0x7f93b41061b0 2023-08-11T12:15:36.375 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.442+0000 7f93bb5a0700 1 -- 172.21.15.8:0/4132475496 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b419a600 con 0x7f93b41061b0 2023-08-11T12:15:36.375 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.442+0000 7f93bb5a0700 1 -- 172.21.15.8:0/4132475496 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b419aa20 con 0x7f93b41061b0 2023-08-11T12:15:36.375 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.443+0000 7f93bb5a0700 1 -- 172.21.15.8:0/4132475496 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b4061f50 con 0x7f93b41061b0 2023-08-11T12:15:36.376 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.444+0000 7f93aa7fc700 1 -- 172.21.15.8:0/4132475496 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 12) v1 ==== 45148+0+0 (secure 0 0 0) 0x7f93b0024440 con 0x7f93b41061b0 2023-08-11T12:15:36.376 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.444+0000 7f93aa7fc700 1 --2- 172.21.15.8:0/4132475496 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f93a00381b0 0x7f93a003a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:36.376 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.444+0000 7f93aa7fc700 1 -- 172.21.15.8:0/4132475496 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f93b004c0b0 con 0x7f93b41061b0 2023-08-11T12:15:36.376 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.444+0000 7f93b8b3b700 1 --2- 172.21.15.8:0/4132475496 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f93a00381b0 0x7f93a003a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:36.376 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.445+0000 7f93b8b3b700 1 --2- 172.21.15.8:0/4132475496 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f93a00381b0 0x7f93a003a670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f93a4006fd0 tx=0x7f93a4006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:36.376 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.450+0000 7f93aa7fc700 1 -- 172.21.15.8:0/4132475496 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f93b0018d90 con 0x7f93b41061b0 2023-08-11T12:15:36.376 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.668+0000 7f93bb5a0700 1 -- 172.21.15.8:0/4132475496 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f93b419d460 con 0x7f93b41061b0 2023-08-11T12:15:36.377 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.668+0000 7f93aa7fc700 1 -- 172.21.15.8:0/4132475496 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f93b0018350 con 0x7f93b41061b0 2023-08-11T12:15:36.377 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.672+0000 7f93bb5a0700 1 -- 172.21.15.8:0/4132475496 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f93a00381b0 msgr2=0x7f93a003a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:36.377 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.672+0000 7f93bb5a0700 1 --2- 172.21.15.8:0/4132475496 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f93a00381b0 0x7f93a003a670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f93a4006fd0 tx=0x7f93a4006e40 comp rx=0 tx=0).stop 2023-08-11T12:15:36.378 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.672+0000 7f93bb5a0700 1 -- 172.21.15.8:0/4132475496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b41061b0 msgr2=0x7f93b4199ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:36.378 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.672+0000 7f93bb5a0700 1 --2- 172.21.15.8:0/4132475496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b41061b0 0x7f93b4199ec0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f93b0000c00 tx=0x7f93b0011a30 comp rx=0 tx=0).stop 2023-08-11T12:15:36.378 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.672+0000 7f93bb5a0700 1 -- 172.21.15.8:0/4132475496 shutdown_connections 2023-08-11T12:15:36.378 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.672+0000 7f93bb5a0700 1 --2- 172.21.15.8:0/4132475496 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f93a00381b0 0x7f93a003a670 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:36.378 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.672+0000 7f93bb5a0700 1 --2- 172.21.15.8:0/4132475496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b41061b0 0x7f93b4199ec0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:36.379 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.672+0000 7f93bb5a0700 1 -- 172.21.15.8:0/4132475496 >> 172.21.15.8:0/4132475496 conn(0x7f93b4101750 msgr2=0x7f93b4102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:36.379 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.673+0000 7f93bb5a0700 1 -- 172.21.15.8:0/4132475496 shutdown_connections 2023-08-11T12:15:36.379 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:35.673+0000 7f93bb5a0700 1 -- 172.21.15.8:0/4132475496 wait complete. 2023-08-11T12:15:36.388 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-08-11T12:15:36.388 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout disabled 2023-08-11T12:15:36.405 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-08-11T12:15:36.405 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2023-08-11T12:15:36.405 INFO:teuthology.orchestra.run.smithi008.stdout:firewalld.service is not enabled 2023-08-11T12:15:36.406 INFO:teuthology.orchestra.run.smithi008.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-08-11T12:15:36.407 INFO:teuthology.orchestra.run.smithi008.stdout:Ceph Dashboard is now available at: 2023-08-11T12:15:36.408 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:15:36.408 INFO:teuthology.orchestra.run.smithi008.stdout: URL: https://smithi008.front.sepia.ceph.com:8443/ 2023-08-11T12:15:36.408 INFO:teuthology.orchestra.run.smithi008.stdout: User: admin 2023-08-11T12:15:36.408 INFO:teuthology.orchestra.run.smithi008.stdout: Password: d8bxr344kv 2023-08-11T12:15:36.409 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:15:36.410 INFO:teuthology.orchestra.run.smithi008.stdout:Saving cluster configuration to /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config directory 2023-08-11T12:15:36.410 INFO:teuthology.orchestra.run.smithi008.stdout:Enabling autotune for osd_memory_target 2023-08-11T12:15:36.592 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:36 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/4132475496' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-08-11T12:15:37.771 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:37 smithi008 ceph-mon[97158]: mgrmap e13: x(active, since 6s) 2023-08-11T12:15:37.779 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.117+0000 7f89e1372700 1 Processor -- start 2023-08-11T12:15:37.780 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.117+0000 7f89e1372700 1 -- start start 2023-08-11T12:15:37.780 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.118+0000 7f89e1372700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89dc07be50 0x7f89dc07a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:37.780 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.118+0000 7f89e1372700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc07a880 con 0x7f89dc07be50 2023-08-11T12:15:37.780 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.118+0000 7f89daffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89dc07be50 0x7f89dc07a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:37.780 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.118+0000 7f89daffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89dc07be50 0x7f89dc07a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58170/0 (socket says 172.21.15.8:58170) 2023-08-11T12:15:37.781 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.118+0000 7f89daffd700 1 -- 172.21.15.8:0/2665877388 learned_addr learned my addr 172.21.15.8:0/2665877388 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:37.781 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.119+0000 7f89daffd700 1 -- 172.21.15.8:0/2665877388 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc07a9c0 con 0x7f89dc07be50 2023-08-11T12:15:37.781 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.119+0000 7f89daffd700 1 --2- 172.21.15.8:0/2665877388 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89dc07be50 0x7f89dc07a2b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0098a0 tx=0x7f89cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216eb843d24c739a server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:37.781 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.119+0000 7f89d9ffb700 1 -- 172.21.15.8:0/2665877388 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89cc004160 con 0x7f89dc07be50 2023-08-11T12:15:37.781 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.119+0000 7f89d9ffb700 1 -- 172.21.15.8:0/2665877388 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f89cc0042c0 con 0x7f89dc07be50 2023-08-11T12:15:37.781 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.119+0000 7f89d9ffb700 1 -- 172.21.15.8:0/2665877388 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89cc0119b0 con 0x7f89dc07be50 2023-08-11T12:15:37.781 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.120+0000 7f89e1372700 1 -- 172.21.15.8:0/2665877388 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89dc07be50 msgr2=0x7f89dc07a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:37.781 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.120+0000 7f89e1372700 1 --2- 172.21.15.8:0/2665877388 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89dc07be50 0x7f89dc07a2b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0098a0 tx=0x7f89cc009bb0 comp rx=0 tx=0).stop 2023-08-11T12:15:37.785 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.120+0000 7f89e1372700 1 -- 172.21.15.8:0/2665877388 shutdown_connections 2023-08-11T12:15:37.785 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.120+0000 7f89e1372700 1 --2- 172.21.15.8:0/2665877388 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89dc07be50 0x7f89dc07a2b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:37.785 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.120+0000 7f89e1372700 1 -- 172.21.15.8:0/2665877388 >> 172.21.15.8:0/2665877388 conn(0x7f89dc101750 msgr2=0x7f89dc103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:37.785 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.120+0000 7f89e1372700 1 -- 172.21.15.8:0/2665877388 shutdown_connections 2023-08-11T12:15:37.785 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.120+0000 7f89e1372700 1 -- 172.21.15.8:0/2665877388 wait complete. 2023-08-11T12:15:37.786 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.121+0000 7f89e1372700 1 Processor -- start 2023-08-11T12:15:37.786 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.121+0000 7f89e1372700 1 -- start start 2023-08-11T12:15:37.786 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.121+0000 7f89e1372700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89dc07be50 0x7f89dc19c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:37.786 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.121+0000 7f89e1372700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc19c5c0 con 0x7f89dc07be50 2023-08-11T12:15:37.786 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.122+0000 7f89daffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89dc07be50 0x7f89dc19c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:37.786 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.122+0000 7f89daffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89dc07be50 0x7f89dc19c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58184/0 (socket says 172.21.15.8:58184) 2023-08-11T12:15:37.786 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.122+0000 7f89daffd700 1 -- 172.21.15.8:0/2741330657 learned_addr learned my addr 172.21.15.8:0/2741330657 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:37.787 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.122+0000 7f89daffd700 1 -- 172.21.15.8:0/2741330657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc009550 con 0x7f89dc07be50 2023-08-11T12:15:37.787 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.122+0000 7f89daffd700 1 --2- 172.21.15.8:0/2741330657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89dc07be50 0x7f89dc19c080 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f89cc003e60 tx=0x7f89cc011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:37.787 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.122+0000 7f89c3fff700 1 -- 172.21.15.8:0/2741330657 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89cc003970 con 0x7f89dc07be50 2023-08-11T12:15:37.787 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.122+0000 7f89c3fff700 1 -- 172.21.15.8:0/2741330657 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f89cc003ad0 con 0x7f89dc07be50 2023-08-11T12:15:37.787 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.122+0000 7f89c3fff700 1 -- 172.21.15.8:0/2741330657 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89cc0195e0 con 0x7f89dc07be50 2023-08-11T12:15:37.787 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.122+0000 7f89e1372700 1 -- 172.21.15.8:0/2741330657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89dc19c7c0 con 0x7f89dc07be50 2023-08-11T12:15:37.787 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.123+0000 7f89e1372700 1 -- 172.21.15.8:0/2741330657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89dc19cbe0 con 0x7f89dc07be50 2023-08-11T12:15:37.788 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.124+0000 7f89c3fff700 1 -- 172.21.15.8:0/2741330657 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45190+0+0 (secure 0 0 0) 0x7f89cc019850 con 0x7f89dc07be50 2023-08-11T12:15:37.788 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.124+0000 7f89e1372700 1 -- 172.21.15.8:0/2741330657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89dc061f50 con 0x7f89dc07be50 2023-08-11T12:15:37.788 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.124+0000 7f89c3fff700 1 --2- 172.21.15.8:0/2741330657 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89c4038200 0x7f89c403a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:37.788 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.124+0000 7f89c3fff700 1 -- 172.21.15.8:0/2741330657 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f89cc04c320 con 0x7f89dc07be50 2023-08-11T12:15:37.788 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.124+0000 7f89da7fc700 1 --2- 172.21.15.8:0/2741330657 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89c4038200 0x7f89c403a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:37.788 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.125+0000 7f89da7fc700 1 --2- 172.21.15.8:0/2741330657 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89c4038200 0x7f89c403a6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f89d0006fd0 tx=0x7f89d0006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:37.788 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.129+0000 7f89c3fff700 1 -- 172.21.15.8:0/2741330657 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f89cc003c40 con 0x7f89dc07be50 2023-08-11T12:15:37.788 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.340+0000 7f89e1372700 1 -- 172.21.15.8:0/2741330657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f89dc19f620 con 0x7f89dc07be50 2023-08-11T12:15:37.789 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.341+0000 7f89c3fff700 1 -- 172.21.15.8:0/2741330657 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f89cc023b40 con 0x7f89dc07be50 2023-08-11T12:15:37.789 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.343+0000 7f89e1372700 1 -- 172.21.15.8:0/2741330657 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89c4038200 msgr2=0x7f89c403a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:37.789 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.343+0000 7f89e1372700 1 --2- 172.21.15.8:0/2741330657 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89c4038200 0x7f89c403a6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f89d0006fd0 tx=0x7f89d0006e40 comp rx=0 tx=0).stop 2023-08-11T12:15:37.789 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.343+0000 7f89e1372700 1 -- 172.21.15.8:0/2741330657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89dc07be50 msgr2=0x7f89dc19c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:37.789 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.343+0000 7f89e1372700 1 --2- 172.21.15.8:0/2741330657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89dc07be50 0x7f89dc19c080 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f89cc003e60 tx=0x7f89cc011aa0 comp rx=0 tx=0).stop 2023-08-11T12:15:37.789 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.343+0000 7f89e1372700 1 -- 172.21.15.8:0/2741330657 shutdown_connections 2023-08-11T12:15:37.789 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.343+0000 7f89e1372700 1 --2- 172.21.15.8:0/2741330657 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89c4038200 0x7f89c403a6c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:37.790 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.343+0000 7f89e1372700 1 --2- 172.21.15.8:0/2741330657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89dc07be50 0x7f89dc19c080 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:37.790 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.343+0000 7f89e1372700 1 -- 172.21.15.8:0/2741330657 >> 172.21.15.8:0/2741330657 conn(0x7f89dc101750 msgr2=0x7f89dc102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:37.790 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.343+0000 7f89e1372700 1 -- 172.21.15.8:0/2741330657 shutdown_connections 2023-08-11T12:15:37.790 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:37.343+0000 7f89e1372700 1 -- 172.21.15.8:0/2741330657 wait complete. 2023-08-11T12:15:39.059 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.319+0000 7f033c8c4700 1 Processor -- start 2023-08-11T12:15:39.063 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.319+0000 7f033c8c4700 1 -- start start 2023-08-11T12:15:39.063 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.320+0000 7f033c8c4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f033807bdf0 0x7f033807a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:39.063 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.320+0000 7f033c8c4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033807a820 con 0x7f033807bdf0 2023-08-11T12:15:39.063 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.320+0000 7f033659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f033807bdf0 0x7f033807a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:39.064 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.320+0000 7f033659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f033807bdf0 0x7f033807a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44602/0 (socket says 172.21.15.8:44602) 2023-08-11T12:15:39.064 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.320+0000 7f033659c700 1 -- 172.21.15.8:0/2643694000 learned_addr learned my addr 172.21.15.8:0/2643694000 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:39.064 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.321+0000 7f033659c700 1 -- 172.21.15.8:0/2643694000 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033807a960 con 0x7f033807bdf0 2023-08-11T12:15:39.064 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.321+0000 7f033659c700 1 --2- 172.21.15.8:0/2643694000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f033807bdf0 0x7f033807a250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f03280098a0 tx=0x7f0328009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58d924e7cca8c4cc server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:39.064 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.321+0000 7f033559a700 1 -- 172.21.15.8:0/2643694000 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0328004160 con 0x7f033807bdf0 2023-08-11T12:15:39.064 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.321+0000 7f033559a700 1 -- 172.21.15.8:0/2643694000 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f03280042c0 con 0x7f033807bdf0 2023-08-11T12:15:39.064 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.321+0000 7f033559a700 1 -- 172.21.15.8:0/2643694000 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03280119b0 con 0x7f033807bdf0 2023-08-11T12:15:39.065 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.322+0000 7f033c8c4700 1 -- 172.21.15.8:0/2643694000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f033807bdf0 msgr2=0x7f033807a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:39.065 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.322+0000 7f033c8c4700 1 --2- 172.21.15.8:0/2643694000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f033807bdf0 0x7f033807a250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f03280098a0 tx=0x7f0328009bb0 comp rx=0 tx=0).stop 2023-08-11T12:15:39.065 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.322+0000 7f033c8c4700 1 -- 172.21.15.8:0/2643694000 shutdown_connections 2023-08-11T12:15:39.065 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.322+0000 7f033c8c4700 1 --2- 172.21.15.8:0/2643694000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f033807bdf0 0x7f033807a250 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:39.065 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.322+0000 7f033c8c4700 1 -- 172.21.15.8:0/2643694000 >> 172.21.15.8:0/2643694000 conn(0x7f0338101750 msgr2=0x7f0338103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:39.065 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.322+0000 7f033c8c4700 1 -- 172.21.15.8:0/2643694000 shutdown_connections 2023-08-11T12:15:39.065 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.322+0000 7f033c8c4700 1 -- 172.21.15.8:0/2643694000 wait complete. 2023-08-11T12:15:39.066 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.323+0000 7f033c8c4700 1 Processor -- start 2023-08-11T12:15:39.066 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.323+0000 7f033c8c4700 1 -- start start 2023-08-11T12:15:39.066 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.323+0000 7f033c8c4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f033807bdf0 0x7f033819c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:39.066 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.323+0000 7f033c8c4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033819c5f0 con 0x7f033807bdf0 2023-08-11T12:15:39.066 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.323+0000 7f033659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f033807bdf0 0x7f033819c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:39.067 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.324+0000 7f033659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f033807bdf0 0x7f033819c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44612/0 (socket says 172.21.15.8:44612) 2023-08-11T12:15:39.067 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.324+0000 7f033659c700 1 -- 172.21.15.8:0/737483755 learned_addr learned my addr 172.21.15.8:0/737483755 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:39.067 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.324+0000 7f033659c700 1 -- 172.21.15.8:0/737483755 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0328009550 con 0x7f033807bdf0 2023-08-11T12:15:39.067 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.324+0000 7f033659c700 1 --2- 172.21.15.8:0/737483755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f033807bdf0 0x7f033819c0b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0328003e60 tx=0x7f0328011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:39.067 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.324+0000 7f03277fe700 1 -- 172.21.15.8:0/737483755 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0328003970 con 0x7f033807bdf0 2023-08-11T12:15:39.067 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.324+0000 7f033c8c4700 1 -- 172.21.15.8:0/737483755 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f033819c7f0 con 0x7f033807bdf0 2023-08-11T12:15:39.067 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.324+0000 7f03277fe700 1 -- 172.21.15.8:0/737483755 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0328003ad0 con 0x7f033807bdf0 2023-08-11T12:15:39.068 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.324+0000 7f03277fe700 1 -- 172.21.15.8:0/737483755 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03280195e0 con 0x7f033807bdf0 2023-08-11T12:15:39.068 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.325+0000 7f033c8c4700 1 -- 172.21.15.8:0/737483755 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f033819cc10 con 0x7f033807bdf0 2023-08-11T12:15:39.068 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.326+0000 7f033c8c4700 1 -- 172.21.15.8:0/737483755 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0338061f50 con 0x7f033807bdf0 2023-08-11T12:15:39.068 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.326+0000 7f03277fe700 1 -- 172.21.15.8:0/737483755 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45190+0+0 (secure 0 0 0) 0x7f0328019850 con 0x7f033807bdf0 2023-08-11T12:15:39.069 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.326+0000 7f03277fe700 1 --2- 172.21.15.8:0/737483755 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0320038200 0x7f032003a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:39.069 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.326+0000 7f03277fe700 1 -- 172.21.15.8:0/737483755 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f032804c290 con 0x7f033807bdf0 2023-08-11T12:15:39.069 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.327+0000 7f0335d9b700 1 --2- 172.21.15.8:0/737483755 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0320038200 0x7f032003a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:39.069 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.327+0000 7f0335d9b700 1 --2- 172.21.15.8:0/737483755 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0320038200 0x7f032003a6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f032c006fd0 tx=0x7f032c006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:39.069 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.331+0000 7f03277fe700 1 -- 172.21.15.8:0/737483755 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f0328003c40 con 0x7f033807bdf0 2023-08-11T12:15:39.069 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.654+0000 7f033c8c4700 1 -- 172.21.15.8:0/737483755 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f033819f650 con 0x7f033807bdf0 2023-08-11T12:15:39.069 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.657+0000 7f03277fe700 1 -- 172.21.15.8:0/737483755 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f0328018350 con 0x7f033807bdf0 2023-08-11T12:15:39.069 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.659+0000 7f033c8c4700 1 -- 172.21.15.8:0/737483755 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0320038200 msgr2=0x7f032003a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:39.070 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.659+0000 7f033c8c4700 1 --2- 172.21.15.8:0/737483755 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0320038200 0x7f032003a6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f032c006fd0 tx=0x7f032c006e40 comp rx=0 tx=0).stop 2023-08-11T12:15:39.070 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.659+0000 7f033c8c4700 1 -- 172.21.15.8:0/737483755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f033807bdf0 msgr2=0x7f033819c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:39.070 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.659+0000 7f033c8c4700 1 --2- 172.21.15.8:0/737483755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f033807bdf0 0x7f033819c0b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0328003e60 tx=0x7f0328011aa0 comp rx=0 tx=0).stop 2023-08-11T12:15:39.070 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.659+0000 7f033c8c4700 1 -- 172.21.15.8:0/737483755 shutdown_connections 2023-08-11T12:15:39.070 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.659+0000 7f033c8c4700 1 --2- 172.21.15.8:0/737483755 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0320038200 0x7f032003a6c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:39.070 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.659+0000 7f033c8c4700 1 --2- 172.21.15.8:0/737483755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f033807bdf0 0x7f033819c0b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:39.070 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.659+0000 7f033c8c4700 1 -- 172.21.15.8:0/737483755 >> 172.21.15.8:0/737483755 conn(0x7f0338101750 msgr2=0x7f0338102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:39.071 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.659+0000 7f033c8c4700 1 -- 172.21.15.8:0/737483755 shutdown_connections 2023-08-11T12:15:39.071 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-08-11T12:15:38.659+0000 7f033c8c4700 1 -- 172.21.15.8:0/737483755 wait complete. 2023-08-11T12:15:39.071 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-08-11T12:15:39.071 INFO:teuthology.orchestra.run.smithi008.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-08-11T12:15:39.071 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:15:39.071 INFO:teuthology.orchestra.run.smithi008.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-08-11T12:15:39.071 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:15:39.071 INFO:teuthology.orchestra.run.smithi008.stdout:Or, if you are only running a single cluster on this host: 2023-08-11T12:15:39.072 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:15:39.072 INFO:teuthology.orchestra.run.smithi008.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-08-11T12:15:39.072 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:15:39.072 INFO:teuthology.orchestra.run.smithi008.stdout:Please consider enabling telemetry to help improve Ceph: 2023-08-11T12:15:39.072 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:15:39.072 INFO:teuthology.orchestra.run.smithi008.stdout: ceph telemetry on 2023-08-11T12:15:39.072 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:15:39.073 INFO:teuthology.orchestra.run.smithi008.stdout:For more information see: 2023-08-11T12:15:39.073 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:15:39.073 INFO:teuthology.orchestra.run.smithi008.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-08-11T12:15:39.073 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:15:39.073 INFO:teuthology.orchestra.run.smithi008.stdout:Bootstrap complete. 2023-08-11T12:15:39.123 INFO:tasks.cephadm:Fetching config... 2023-08-11T12:15:39.123 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-11T12:15:39.123 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-08-11T12:15:39.170 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-08-11T12:15:39.170 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-11T12:15:39.171 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-08-11T12:15:39.257 INFO:tasks.cephadm:Fetching mon keyring... 2023-08-11T12:15:39.258 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-11T12:15:39.258 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/keyring of=/dev/stdout 2023-08-11T12:15:39.367 INFO:tasks.cephadm:Fetching pub ssh key... 2023-08-11T12:15:39.367 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-11T12:15:39.368 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-08-11T12:15:39.452 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-08-11T12:15:39.453 DEBUG:teuthology.orchestra.run.smithi008:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoeVuOufWZ5MnXDfUtoGl2qfpHYu28dEhG0EhUJTSsnJLn5tTXCy0sqyGNmAJsgSoS4L2rI01Qd0PHLhELNLGWqA6TIK4q6ViETwBZ4N0Le2OOvgjZVRI62lDSkwKZiQlzDmDxUYWo865IbPtS1fW4clIRiIwGzfro7ovq4mF1pNekczo9rVKK+zAMmkfnQGjreGzHBj8iJf2z1UF3rJWVW97aMzkPvHLjIMvNPli1rYwg5Lz0+Y+uPukR/ecdwwxBA447/LYWuqyylCV06py9AsuzK+1Rs47D1JyOmh0jKuvDyL+BZx1eMKnjU8DWWqhvq9qXdM/72isYl1CPD/SEuGZsw7coFNRdybk5UGpmhzhaUAA6apqWjKPj5k0SyVLo+dtZhew0fA/+yvQcePiVTgOPL8OpY4slfF2uQy7CpHeye5ftpwrp+xLS73uD7JtB2Taz1yLP7+FUp0nZUYj8yA/zRJkHLmzZbcs3xw28OhybkcwKUNWjJ298aHO1qQ0= ceph-815f94ae-3840-11ee-9b37-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-08-11T12:15:39.596 INFO:teuthology.orchestra.run.smithi008.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoeVuOufWZ5MnXDfUtoGl2qfpHYu28dEhG0EhUJTSsnJLn5tTXCy0sqyGNmAJsgSoS4L2rI01Qd0PHLhELNLGWqA6TIK4q6ViETwBZ4N0Le2OOvgjZVRI62lDSkwKZiQlzDmDxUYWo865IbPtS1fW4clIRiIwGzfro7ovq4mF1pNekczo9rVKK+zAMmkfnQGjreGzHBj8iJf2z1UF3rJWVW97aMzkPvHLjIMvNPli1rYwg5Lz0+Y+uPukR/ecdwwxBA447/LYWuqyylCV06py9AsuzK+1Rs47D1JyOmh0jKuvDyL+BZx1eMKnjU8DWWqhvq9qXdM/72isYl1CPD/SEuGZsw7coFNRdybk5UGpmhzhaUAA6apqWjKPj5k0SyVLo+dtZhew0fA/+yvQcePiVTgOPL8OpY4slfF2uQy7CpHeye5ftpwrp+xLS73uD7JtB2Taz1yLP7+FUp0nZUYj8yA/zRJkHLmzZbcs3xw28OhybkcwKUNWjJ298aHO1qQ0= ceph-815f94ae-3840-11ee-9b37-001a4aab830c 2023-08-11T12:15:39.626 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoeVuOufWZ5MnXDfUtoGl2qfpHYu28dEhG0EhUJTSsnJLn5tTXCy0sqyGNmAJsgSoS4L2rI01Qd0PHLhELNLGWqA6TIK4q6ViETwBZ4N0Le2OOvgjZVRI62lDSkwKZiQlzDmDxUYWo865IbPtS1fW4clIRiIwGzfro7ovq4mF1pNekczo9rVKK+zAMmkfnQGjreGzHBj8iJf2z1UF3rJWVW97aMzkPvHLjIMvNPli1rYwg5Lz0+Y+uPukR/ecdwwxBA447/LYWuqyylCV06py9AsuzK+1Rs47D1JyOmh0jKuvDyL+BZx1eMKnjU8DWWqhvq9qXdM/72isYl1CPD/SEuGZsw7coFNRdybk5UGpmhzhaUAA6apqWjKPj5k0SyVLo+dtZhew0fA/+yvQcePiVTgOPL8OpY4slfF2uQy7CpHeye5ftpwrp+xLS73uD7JtB2Taz1yLP7+FUp0nZUYj8yA/zRJkHLmzZbcs3xw28OhybkcwKUNWjJ298aHO1qQ0= ceph-815f94ae-3840-11ee-9b37-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-08-11T12:15:39.673 INFO:teuthology.orchestra.run.smithi045.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoeVuOufWZ5MnXDfUtoGl2qfpHYu28dEhG0EhUJTSsnJLn5tTXCy0sqyGNmAJsgSoS4L2rI01Qd0PHLhELNLGWqA6TIK4q6ViETwBZ4N0Le2OOvgjZVRI62lDSkwKZiQlzDmDxUYWo865IbPtS1fW4clIRiIwGzfro7ovq4mF1pNekczo9rVKK+zAMmkfnQGjreGzHBj8iJf2z1UF3rJWVW97aMzkPvHLjIMvNPli1rYwg5Lz0+Y+uPukR/ecdwwxBA447/LYWuqyylCV06py9AsuzK+1Rs47D1JyOmh0jKuvDyL+BZx1eMKnjU8DWWqhvq9qXdM/72isYl1CPD/SEuGZsw7coFNRdybk5UGpmhzhaUAA6apqWjKPj5k0SyVLo+dtZhew0fA/+yvQcePiVTgOPL8OpY4slfF2uQy7CpHeye5ftpwrp+xLS73uD7JtB2Taz1yLP7+FUp0nZUYj8yA/zRJkHLmzZbcs3xw28OhybkcwKUNWjJ298aHO1qQ0= ceph-815f94ae-3840-11ee-9b37-001a4aab830c 2023-08-11T12:15:39.686 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoeVuOufWZ5MnXDfUtoGl2qfpHYu28dEhG0EhUJTSsnJLn5tTXCy0sqyGNmAJsgSoS4L2rI01Qd0PHLhELNLGWqA6TIK4q6ViETwBZ4N0Le2OOvgjZVRI62lDSkwKZiQlzDmDxUYWo865IbPtS1fW4clIRiIwGzfro7ovq4mF1pNekczo9rVKK+zAMmkfnQGjreGzHBj8iJf2z1UF3rJWVW97aMzkPvHLjIMvNPli1rYwg5Lz0+Y+uPukR/ecdwwxBA447/LYWuqyylCV06py9AsuzK+1Rs47D1JyOmh0jKuvDyL+BZx1eMKnjU8DWWqhvq9qXdM/72isYl1CPD/SEuGZsw7coFNRdybk5UGpmhzhaUAA6apqWjKPj5k0SyVLo+dtZhew0fA/+yvQcePiVTgOPL8OpY4slfF2uQy7CpHeye5ftpwrp+xLS73uD7JtB2Taz1yLP7+FUp0nZUYj8yA/zRJkHLmzZbcs3xw28OhybkcwKUNWjJ298aHO1qQ0= ceph-815f94ae-3840-11ee-9b37-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-08-11T12:15:39.732 INFO:teuthology.orchestra.run.smithi194.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoeVuOufWZ5MnXDfUtoGl2qfpHYu28dEhG0EhUJTSsnJLn5tTXCy0sqyGNmAJsgSoS4L2rI01Qd0PHLhELNLGWqA6TIK4q6ViETwBZ4N0Le2OOvgjZVRI62lDSkwKZiQlzDmDxUYWo865IbPtS1fW4clIRiIwGzfro7ovq4mF1pNekczo9rVKK+zAMmkfnQGjreGzHBj8iJf2z1UF3rJWVW97aMzkPvHLjIMvNPli1rYwg5Lz0+Y+uPukR/ecdwwxBA447/LYWuqyylCV06py9AsuzK+1Rs47D1JyOmh0jKuvDyL+BZx1eMKnjU8DWWqhvq9qXdM/72isYl1CPD/SEuGZsw7coFNRdybk5UGpmhzhaUAA6apqWjKPj5k0SyVLo+dtZhew0fA/+yvQcePiVTgOPL8OpY4slfF2uQy7CpHeye5ftpwrp+xLS73uD7JtB2Taz1yLP7+FUp0nZUYj8yA/zRJkHLmzZbcs3xw28OhybkcwKUNWjJ298aHO1qQ0= ceph-815f94ae-3840-11ee-9b37-001a4aab830c 2023-08-11T12:15:39.745 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-08-11T12:15:40.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:39 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/737483755' entity='client.admin' 2023-08-11T12:15:40.812 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:15:42.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:41 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:15:42.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:41 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:15:42.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:41 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi008", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:15:42.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:41 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:15:42.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:41 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:15:42.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:41 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:15:42.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:42.822+0000 7fd8e0a54700 1 -- 172.21.15.8:0/3669911997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8dc100430 msgr2=0x7fd8dc100850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:42.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:42.822+0000 7fd8e0a54700 1 --2- 172.21.15.8:0/3669911997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8dc100430 0x7fd8dc100850 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc009910 tx=0x7fd8cc009c20 comp rx=0 tx=0).stop 2023-08-11T12:15:42.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:42.822+0000 7fd8e0a54700 1 -- 172.21.15.8:0/3669911997 shutdown_connections 2023-08-11T12:15:42.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:42.822+0000 7fd8e0a54700 1 --2- 172.21.15.8:0/3669911997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8dc100430 0x7fd8dc100850 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:42.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:42.822+0000 7fd8e0a54700 1 -- 172.21.15.8:0/3669911997 >> 172.21.15.8:0/3669911997 conn(0x7fd8dc0fb9b0 msgr2=0x7fd8dc0fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:42.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:42.822+0000 7fd8e0a54700 1 -- 172.21.15.8:0/3669911997 shutdown_connections 2023-08-11T12:15:42.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:42.822+0000 7fd8e0a54700 1 -- 172.21.15.8:0/3669911997 wait complete. 2023-08-11T12:15:42.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:42.823+0000 7fd8e0a54700 1 Processor -- start 2023-08-11T12:15:42.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:42.824+0000 7fd8e0a54700 1 -- start start 2023-08-11T12:15:42.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:42.824+0000 7fd8e0a54700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8dc100430 0x7fd8dc195540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:42.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:42.824+0000 7fd8e0a54700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc195a80 con 0x7fd8dc100430 2023-08-11T12:15:42.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:42.824+0000 7fd8da59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8dc100430 0x7fd8dc195540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:42.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:42.824+0000 7fd8da59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8dc100430 0x7fd8dc195540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44638/0 (socket says 172.21.15.8:44638) 2023-08-11T12:15:42.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:42.824+0000 7fd8da59c700 1 -- 172.21.15.8:0/1355847219 learned_addr learned my addr 172.21.15.8:0/1355847219 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:42.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:42.825+0000 7fd8da59c700 1 -- 172.21.15.8:0/1355847219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8cc0095f0 con 0x7fd8dc100430 2023-08-11T12:15:42.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:42.825+0000 7fd8da59c700 1 --2- 172.21.15.8:0/1355847219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8dc100430 0x7fd8dc195540 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc004f40 tx=0x7fd8cc0057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:42.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:42.825+0000 7fd8cb7fe700 1 -- 172.21.15.8:0/1355847219 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8cc01d070 con 0x7fd8dc100430 2023-08-11T12:15:42.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:42.825+0000 7fd8cb7fe700 1 -- 172.21.15.8:0/1355847219 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd8cc00bc10 con 0x7fd8dc100430 2023-08-11T12:15:42.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:42.825+0000 7fd8e0a54700 1 -- 172.21.15.8:0/1355847219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8dc195c80 con 0x7fd8dc100430 2023-08-11T12:15:42.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:42.825+0000 7fd8cb7fe700 1 -- 172.21.15.8:0/1355847219 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8cc003a70 con 0x7fd8dc100430 2023-08-11T12:15:42.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:42.825+0000 7fd8e0a54700 1 -- 172.21.15.8:0/1355847219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8dc196120 con 0x7fd8dc100430 2023-08-11T12:15:42.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:42.826+0000 7fd8cb7fe700 1 -- 172.21.15.8:0/1355847219 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45190+0+0 (secure 0 0 0) 0x7fd8cc003ce0 con 0x7fd8dc100430 2023-08-11T12:15:42.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:42.826+0000 7fd8e0a54700 1 -- 172.21.15.8:0/1355847219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8dc18ef40 con 0x7fd8dc100430 2023-08-11T12:15:42.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:42.827+0000 7fd8cb7fe700 1 --2- 172.21.15.8:0/1355847219 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd8c4038250 0x7fd8c403a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:42.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:42.827+0000 7fd8cb7fe700 1 -- 172.21.15.8:0/1355847219 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd8cc04bdc0 con 0x7fd8dc100430 2023-08-11T12:15:42.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:42.827+0000 7fd8d9d9b700 1 --2- 172.21.15.8:0/1355847219 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd8c4038250 0x7fd8c403a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:42.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:42.828+0000 7fd8d9d9b700 1 --2- 172.21.15.8:0/1355847219 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd8c4038250 0x7fd8c403a710 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0006fd0 tx=0x7fd8d0006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:42.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:42.832+0000 7fd8cb7fe700 1 -- 172.21.15.8:0/1355847219 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fd8cc02aba0 con 0x7fd8dc100430 2023-08-11T12:15:43.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:43.045+0000 7fd8e0a54700 1 -- 172.21.15.8:0/1355847219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fd8dc106180 con 0x7fd8dc100430 2023-08-11T12:15:43.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:43.050+0000 7fd8cb7fe700 1 -- 172.21.15.8:0/1355847219 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fd8dc106180 con 0x7fd8dc100430 2023-08-11T12:15:43.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:43.052+0000 7fd8e0a54700 1 -- 172.21.15.8:0/1355847219 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd8c4038250 msgr2=0x7fd8c403a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:43.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:43.053+0000 7fd8e0a54700 1 --2- 172.21.15.8:0/1355847219 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd8c4038250 0x7fd8c403a710 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0006fd0 tx=0x7fd8d0006e40 comp rx=0 tx=0).stop 2023-08-11T12:15:43.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:43.053+0000 7fd8e0a54700 1 -- 172.21.15.8:0/1355847219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8dc100430 msgr2=0x7fd8dc195540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:43.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:43.053+0000 7fd8e0a54700 1 --2- 172.21.15.8:0/1355847219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8dc100430 0x7fd8dc195540 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc004f40 tx=0x7fd8cc0057c0 comp rx=0 tx=0).stop 2023-08-11T12:15:43.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:43.053+0000 7fd8e0a54700 1 -- 172.21.15.8:0/1355847219 shutdown_connections 2023-08-11T12:15:43.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:43.053+0000 7fd8e0a54700 1 --2- 172.21.15.8:0/1355847219 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd8c4038250 0x7fd8c403a710 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:43.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:43.053+0000 7fd8e0a54700 1 --2- 172.21.15.8:0/1355847219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8dc100430 0x7fd8dc195540 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:43.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:43.053+0000 7fd8e0a54700 1 -- 172.21.15.8:0/1355847219 >> 172.21.15.8:0/1355847219 conn(0x7fd8dc0fb9b0 msgr2=0x7fd8dc0fc790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:43.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:43.053+0000 7fd8e0a54700 1 -- 172.21.15.8:0/1355847219 shutdown_connections 2023-08-11T12:15:43.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:43.053+0000 7fd8e0a54700 1 -- 172.21.15.8:0/1355847219 wait complete. 2023-08-11T12:15:43.513 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-08-11T12:15:43.513 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-08-11T12:15:44.241 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:15:44.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:44 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1355847219' entity='client.admin' 2023-08-11T12:15:44.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:44 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:15:44.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:44 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:15:45.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:45.797+0000 7f449f4a6700 1 -- 172.21.15.8:0/1047009799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4498100430 msgr2=0x7f4498100850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:45.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:45.797+0000 7f449f4a6700 1 --2- 172.21.15.8:0/1047009799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4498100430 0x7f4498100850 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4494009910 tx=0x7f4494009c20 comp rx=0 tx=0).stop 2023-08-11T12:15:45.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:45.797+0000 7f449f4a6700 1 -- 172.21.15.8:0/1047009799 shutdown_connections 2023-08-11T12:15:45.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:45.797+0000 7f449f4a6700 1 --2- 172.21.15.8:0/1047009799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4498100430 0x7f4498100850 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:45.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:45.797+0000 7f449f4a6700 1 -- 172.21.15.8:0/1047009799 >> 172.21.15.8:0/1047009799 conn(0x7f44980fb9b0 msgr2=0x7f44980fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:45.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:45.798+0000 7f449f4a6700 1 -- 172.21.15.8:0/1047009799 shutdown_connections 2023-08-11T12:15:45.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:45.798+0000 7f449f4a6700 1 -- 172.21.15.8:0/1047009799 wait complete. 2023-08-11T12:15:45.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:45.799+0000 7f449f4a6700 1 Processor -- start 2023-08-11T12:15:45.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:45.799+0000 7f449f4a6700 1 -- start start 2023-08-11T12:15:45.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:45.799+0000 7f449f4a6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4498100430 0x7f4498197730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:45.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:45.799+0000 7f449f4a6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4498197c70 con 0x7f4498100430 2023-08-11T12:15:45.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:45.799+0000 7f449d242700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4498100430 0x7f4498197730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:45.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:45.799+0000 7f449d242700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4498100430 0x7f4498197730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44650/0 (socket says 172.21.15.8:44650) 2023-08-11T12:15:45.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:45.799+0000 7f449d242700 1 -- 172.21.15.8:0/2106939258 learned_addr learned my addr 172.21.15.8:0/2106939258 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:45.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:45.800+0000 7f449d242700 1 -- 172.21.15.8:0/2106939258 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44940095f0 con 0x7f4498100430 2023-08-11T12:15:45.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:45.800+0000 7f449d242700 1 --2- 172.21.15.8:0/2106939258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4498100430 0x7f4498197730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4494004f40 tx=0x7f44940057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:45.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:45.800+0000 7f448e7fc700 1 -- 172.21.15.8:0/2106939258 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f449401d070 con 0x7f4498100430 2023-08-11T12:15:45.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:45.800+0000 7f449f4a6700 1 -- 172.21.15.8:0/2106939258 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4498197e70 con 0x7f4498100430 2023-08-11T12:15:45.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:45.800+0000 7f448e7fc700 1 -- 172.21.15.8:0/2106939258 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f449400bc10 con 0x7f4498100430 2023-08-11T12:15:45.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:45.800+0000 7f448e7fc700 1 -- 172.21.15.8:0/2106939258 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4494003a70 con 0x7f4498100430 2023-08-11T12:15:45.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:45.800+0000 7f449f4a6700 1 -- 172.21.15.8:0/2106939258 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4498198310 con 0x7f4498100430 2023-08-11T12:15:45.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:45.801+0000 7f448e7fc700 1 -- 172.21.15.8:0/2106939258 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45190+0+0 (secure 0 0 0) 0x7f4494003ce0 con 0x7f4498100430 2023-08-11T12:15:45.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:45.801+0000 7f449f4a6700 1 -- 172.21.15.8:0/2106939258 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4498191340 con 0x7f4498100430 2023-08-11T12:15:45.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:45.802+0000 7f448e7fc700 1 --2- 172.21.15.8:0/2106939258 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f4484038200 0x7f448403a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:45.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:45.802+0000 7f448e7fc700 1 -- 172.21.15.8:0/2106939258 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f449404bdf0 con 0x7f4498100430 2023-08-11T12:15:45.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:45.802+0000 7f449ca41700 1 --2- 172.21.15.8:0/2106939258 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f4484038200 0x7f448403a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:45.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:45.803+0000 7f449ca41700 1 --2- 172.21.15.8:0/2106939258 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f4484038200 0x7f448403a6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4488006fd0 tx=0x7f4488006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:45.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:45.807+0000 7f448e7fc700 1 -- 172.21.15.8:0/2106939258 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f449402abf0 con 0x7f4498100430 2023-08-11T12:15:46.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:46.020+0000 7f449f4a6700 1 -- 172.21.15.8:0/2106939258 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f449802cd20 con 0x7f4484038200 2023-08-11T12:15:46.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:46.024+0000 7f448e7fc700 1 -- 172.21.15.8:0/2106939258 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f449802cd20 con 0x7f4484038200 2023-08-11T12:15:46.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:46.026+0000 7f449f4a6700 1 -- 172.21.15.8:0/2106939258 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f4484038200 msgr2=0x7f448403a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:46.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:46.026+0000 7f449f4a6700 1 --2- 172.21.15.8:0/2106939258 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f4484038200 0x7f448403a6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4488006fd0 tx=0x7f4488006e40 comp rx=0 tx=0).stop 2023-08-11T12:15:46.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:46.026+0000 7f449f4a6700 1 -- 172.21.15.8:0/2106939258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4498100430 msgr2=0x7f4498197730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:46.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:46.026+0000 7f449f4a6700 1 --2- 172.21.15.8:0/2106939258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4498100430 0x7f4498197730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4494004f40 tx=0x7f44940057c0 comp rx=0 tx=0).stop 2023-08-11T12:15:46.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:46.026+0000 7f449f4a6700 1 -- 172.21.15.8:0/2106939258 shutdown_connections 2023-08-11T12:15:46.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:46.026+0000 7f449f4a6700 1 --2- 172.21.15.8:0/2106939258 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f4484038200 0x7f448403a6c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:46.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:46.026+0000 7f449f4a6700 1 --2- 172.21.15.8:0/2106939258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4498100430 0x7f4498197730 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:46.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:46.026+0000 7f449f4a6700 1 -- 172.21.15.8:0/2106939258 >> 172.21.15.8:0/2106939258 conn(0x7f44980fb9b0 msgr2=0x7f44980fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:46.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:46.026+0000 7f449f4a6700 1 -- 172.21.15.8:0/2106939258 shutdown_connections 2023-08-11T12:15:46.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:46.026+0000 7f449f4a6700 1 -- 172.21.15.8:0/2106939258 wait complete. 2023-08-11T12:15:46.622 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi045 2023-08-11T12:15:46.623 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-08-11T12:15:46.623 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/etc/ceph/ceph.conf 2023-08-11T12:15:46.645 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-08-11T12:15:46.646 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-08-11T12:15:46.706 INFO:tasks.cephadm:Adding host smithi045 to orchestrator... 2023-08-11T12:15:46.707 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph orch host add smithi045 2023-08-11T12:15:47.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:47 smithi008 ceph-mon[97158]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:15:47.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:47 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:15:47.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:47 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:15:47.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:47 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:15:47.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:47 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:15:47.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:47 smithi008 ceph-mon[97158]: Updating smithi008:/etc/ceph/ceph.conf 2023-08-11T12:15:47.450 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:15:48.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:48 smithi008 ceph-mon[97158]: Updating smithi008:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-11T12:15:48.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:48 smithi008 ceph-mon[97158]: Updating smithi008:/etc/ceph/ceph.client.admin.keyring 2023-08-11T12:15:49.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.069+0000 7f1046312700 1 -- 172.21.15.8:0/686347671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1040100610 msgr2=0x7f10401009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:49.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.069+0000 7f1046312700 1 --2- 172.21.15.8:0/686347671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1040100610 0x7f10401009f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1030009910 tx=0x7f1030009c20 comp rx=0 tx=0).stop 2023-08-11T12:15:49.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.069+0000 7f1046312700 1 -- 172.21.15.8:0/686347671 shutdown_connections 2023-08-11T12:15:49.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.069+0000 7f1046312700 1 --2- 172.21.15.8:0/686347671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1040100610 0x7f10401009f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:49.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.069+0000 7f1046312700 1 -- 172.21.15.8:0/686347671 >> 172.21.15.8:0/686347671 conn(0x7f10400fbee0 msgr2=0x7f10400fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:49.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.069+0000 7f1046312700 1 -- 172.21.15.8:0/686347671 shutdown_connections 2023-08-11T12:15:49.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.069+0000 7f1046312700 1 -- 172.21.15.8:0/686347671 wait complete. 2023-08-11T12:15:49.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.070+0000 7f1046312700 1 Processor -- start 2023-08-11T12:15:49.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.071+0000 7f1046312700 1 -- start start 2023-08-11T12:15:49.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.071+0000 7f1046312700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1040100610 0x7f104019b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:49.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.071+0000 7f1046312700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104019bb60 con 0x7f1040100610 2023-08-11T12:15:49.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.071+0000 7f103ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1040100610 0x7f104019b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:49.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.071+0000 7f103ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1040100610 0x7f104019b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50960/0 (socket says 172.21.15.8:50960) 2023-08-11T12:15:49.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.071+0000 7f103ffff700 1 -- 172.21.15.8:0/1181403190 learned_addr learned my addr 172.21.15.8:0/1181403190 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:49.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.071+0000 7f103ffff700 1 -- 172.21.15.8:0/1181403190 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10300095f0 con 0x7f1040100610 2023-08-11T12:15:49.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.072+0000 7f103ffff700 1 --2- 172.21.15.8:0/1181403190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1040100610 0x7f104019b620 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1030006010 tx=0x7f1030004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:49.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.072+0000 7f103d7fa700 1 -- 172.21.15.8:0/1181403190 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f103001d070 con 0x7f1040100610 2023-08-11T12:15:49.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.072+0000 7f1046312700 1 -- 172.21.15.8:0/1181403190 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f104019bd60 con 0x7f1040100610 2023-08-11T12:15:49.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.072+0000 7f103d7fa700 1 -- 172.21.15.8:0/1181403190 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f103000bc10 con 0x7f1040100610 2023-08-11T12:15:49.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.072+0000 7f103d7fa700 1 -- 172.21.15.8:0/1181403190 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1030003910 con 0x7f1040100610 2023-08-11T12:15:49.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.072+0000 7f1046312700 1 -- 172.21.15.8:0/1181403190 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f104019c180 con 0x7f1040100610 2023-08-11T12:15:49.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.073+0000 7f1046312700 1 -- 172.21.15.8:0/1181403190 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1040061f50 con 0x7f1040100610 2023-08-11T12:15:49.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.073+0000 7f103d7fa700 1 -- 172.21.15.8:0/1181403190 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45190+0+0 (secure 0 0 0) 0x7f103000bd80 con 0x7f1040100610 2023-08-11T12:15:49.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.074+0000 7f103d7fa700 1 --2- 172.21.15.8:0/1181403190 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f10280381b0 0x7f102803a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:49.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.074+0000 7f103d7fa700 1 -- 172.21.15.8:0/1181403190 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f103004bd40 con 0x7f1040100610 2023-08-11T12:15:49.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.074+0000 7f103f7fe700 1 --2- 172.21.15.8:0/1181403190 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f10280381b0 0x7f102803a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:49.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.075+0000 7f103f7fe700 1 --2- 172.21.15.8:0/1181403190 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f10280381b0 0x7f102803a670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1034006fd0 tx=0x7f1034006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:49.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.079+0000 7f103d7fa700 1 -- 172.21.15.8:0/1181403190 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f1030029360 con 0x7f1040100610 2023-08-11T12:15:49.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:49.292+0000 7f1046312700 1 -- 172.21.15.8:0/1181403190 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi045", "target": ["mon-mgr", ""]}) v1 -- 0x7f104010a890 con 0x7f10280381b0 2023-08-11T12:15:49.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:49 smithi008 ceph-mon[97158]: Updating smithi008:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-11T12:15:49.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:49 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:15:49.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:49 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:15:49.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:49 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:15:50.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:50 smithi008 ceph-mon[97158]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi045", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:15:51.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:51.705+0000 7f103d7fa700 1 -- 172.21.15.8:0/1181403190 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f104010a890 con 0x7f10280381b0 2023-08-11T12:15:51.707 INFO:teuthology.orchestra.run.smithi008.stdout:Added host 'smithi045' with addr '172.21.15.45' 2023-08-11T12:15:51.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:51.708+0000 7f1046312700 1 -- 172.21.15.8:0/1181403190 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f10280381b0 msgr2=0x7f102803a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:51.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:51.708+0000 7f1046312700 1 --2- 172.21.15.8:0/1181403190 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f10280381b0 0x7f102803a670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1034006fd0 tx=0x7f1034006e40 comp rx=0 tx=0).stop 2023-08-11T12:15:51.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:51.708+0000 7f1046312700 1 -- 172.21.15.8:0/1181403190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1040100610 msgr2=0x7f104019b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:51.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:51.708+0000 7f1046312700 1 --2- 172.21.15.8:0/1181403190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1040100610 0x7f104019b620 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1030006010 tx=0x7f1030004ff0 comp rx=0 tx=0).stop 2023-08-11T12:15:51.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:51.708+0000 7f1046312700 1 -- 172.21.15.8:0/1181403190 shutdown_connections 2023-08-11T12:15:51.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:51.708+0000 7f1046312700 1 --2- 172.21.15.8:0/1181403190 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f10280381b0 0x7f102803a670 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:51.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:51.708+0000 7f1046312700 1 --2- 172.21.15.8:0/1181403190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1040100610 0x7f104019b620 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:51.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:51.708+0000 7f1046312700 1 -- 172.21.15.8:0/1181403190 >> 172.21.15.8:0/1181403190 conn(0x7f10400fbee0 msgr2=0x7f1040106170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:51.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:51.708+0000 7f1046312700 1 -- 172.21.15.8:0/1181403190 shutdown_connections 2023-08-11T12:15:51.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:51.708+0000 7f1046312700 1 -- 172.21.15.8:0/1181403190 wait complete. 2023-08-11T12:15:51.731 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:51 smithi008 ceph-mon[97158]: Deploying cephadm binary to smithi045 2023-08-11T12:15:51.732 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:51 smithi008 ceph-mon[97158]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:15:52.237 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph orch host ls --format=json 2023-08-11T12:15:52.964 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:15:53.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:52 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:15:53.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:52 smithi008 ceph-mon[97158]: Added host smithi045 2023-08-11T12:15:53.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:52 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:15:53.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:52 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:15:53.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:52 smithi008 ceph-mon[97158]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:15:54.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:15:54.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.509+0000 7f29500a4700 1 -- 172.21.15.8:0/571463699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2948072d50 msgr2=0x7f2948073130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:54.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.509+0000 7f29500a4700 1 --2- 172.21.15.8:0/571463699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2948072d50 0x7f2948073130 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2944009910 tx=0x7f2944009c20 comp rx=0 tx=0).stop 2023-08-11T12:15:54.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.509+0000 7f29500a4700 1 -- 172.21.15.8:0/571463699 shutdown_connections 2023-08-11T12:15:54.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.509+0000 7f29500a4700 1 --2- 172.21.15.8:0/571463699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2948072d50 0x7f2948073130 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:54.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.509+0000 7f29500a4700 1 -- 172.21.15.8:0/571463699 >> 172.21.15.8:0/571463699 conn(0x7f29480fbee0 msgr2=0x7f29480fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:54.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.509+0000 7f29500a4700 1 -- 172.21.15.8:0/571463699 shutdown_connections 2023-08-11T12:15:54.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.510+0000 7f29500a4700 1 -- 172.21.15.8:0/571463699 wait complete. 2023-08-11T12:15:54.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.510+0000 7f29500a4700 1 Processor -- start 2023-08-11T12:15:54.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.511+0000 7f29500a4700 1 -- start start 2023-08-11T12:15:54.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.511+0000 7f29500a4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2948072d50 0x7f294819d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:54.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.511+0000 7f29500a4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294819dde0 con 0x7f2948072d50 2023-08-11T12:15:54.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.511+0000 7f294de40700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2948072d50 0x7f294819d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:54.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.511+0000 7f294de40700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2948072d50 0x7f294819d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50984/0 (socket says 172.21.15.8:50984) 2023-08-11T12:15:54.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.511+0000 7f294de40700 1 -- 172.21.15.8:0/1872667074 learned_addr learned my addr 172.21.15.8:0/1872667074 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:54.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.512+0000 7f294de40700 1 -- 172.21.15.8:0/1872667074 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29440095f0 con 0x7f2948072d50 2023-08-11T12:15:54.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.512+0000 7f294de40700 1 --2- 172.21.15.8:0/1872667074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2948072d50 0x7f294819d8a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2944006010 tx=0x7f2944004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:54.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.512+0000 7f293effd700 1 -- 172.21.15.8:0/1872667074 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f294401d070 con 0x7f2948072d50 2023-08-11T12:15:54.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.512+0000 7f293effd700 1 -- 172.21.15.8:0/1872667074 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f29440044a0 con 0x7f2948072d50 2023-08-11T12:15:54.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.512+0000 7f293effd700 1 -- 172.21.15.8:0/1872667074 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2944003a70 con 0x7f2948072d50 2023-08-11T12:15:54.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.512+0000 7f29500a4700 1 -- 172.21.15.8:0/1872667074 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294819dfe0 con 0x7f2948072d50 2023-08-11T12:15:54.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.512+0000 7f29500a4700 1 -- 172.21.15.8:0/1872667074 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294819e400 con 0x7f2948072d50 2023-08-11T12:15:54.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.513+0000 7f293effd700 1 -- 172.21.15.8:0/1872667074 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45190+0+0 (secure 0 0 0) 0x7f2944003c60 con 0x7f2948072d50 2023-08-11T12:15:54.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.513+0000 7f29500a4700 1 -- 172.21.15.8:0/1872667074 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2948061f50 con 0x7f2948072d50 2023-08-11T12:15:54.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.514+0000 7f293effd700 1 --2- 172.21.15.8:0/1872667074 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f2934038200 0x7f293403a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:54.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.514+0000 7f293effd700 1 -- 172.21.15.8:0/1872667074 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f294404bfc0 con 0x7f2948072d50 2023-08-11T12:15:54.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.514+0000 7f294d63f700 1 --2- 172.21.15.8:0/1872667074 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f2934038200 0x7f293403a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:54.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.514+0000 7f294d63f700 1 --2- 172.21.15.8:0/1872667074 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f2934038200 0x7f293403a6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2938006fd0 tx=0x7f2938006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:54.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.519+0000 7f293effd700 1 -- 172.21.15.8:0/1872667074 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f2944029540 con 0x7f2948072d50 2023-08-11T12:15:54.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.731+0000 7f29500a4700 1 -- 172.21.15.8:0/1872667074 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f294810cb80 con 0x7f2934038200 2023-08-11T12:15:54.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.733+0000 7f293effd700 1 -- 172.21.15.8:0/1872667074 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+158 (secure 0 0 0) 0x7f294810cb80 con 0x7f2934038200 2023-08-11T12:15:54.734 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:15:54.735 INFO:teuthology.orchestra.run.smithi008.stdout:[{"addr": "172.21.15.8", "hostname": "smithi008", "labels": [], "status": ""}, {"addr": "172.21.15.45", "hostname": "smithi045", "labels": [], "status": ""}] 2023-08-11T12:15:54.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.735+0000 7f29500a4700 1 -- 172.21.15.8:0/1872667074 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f2934038200 msgr2=0x7f293403a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:54.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.735+0000 7f29500a4700 1 --2- 172.21.15.8:0/1872667074 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f2934038200 0x7f293403a6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2938006fd0 tx=0x7f2938006e40 comp rx=0 tx=0).stop 2023-08-11T12:15:54.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.735+0000 7f29500a4700 1 -- 172.21.15.8:0/1872667074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2948072d50 msgr2=0x7f294819d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:54.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.735+0000 7f29500a4700 1 --2- 172.21.15.8:0/1872667074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2948072d50 0x7f294819d8a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2944006010 tx=0x7f2944004ff0 comp rx=0 tx=0).stop 2023-08-11T12:15:54.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.735+0000 7f29500a4700 1 -- 172.21.15.8:0/1872667074 shutdown_connections 2023-08-11T12:15:54.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.735+0000 7f29500a4700 1 --2- 172.21.15.8:0/1872667074 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f2934038200 0x7f293403a6c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:54.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.735+0000 7f29500a4700 1 --2- 172.21.15.8:0/1872667074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2948072d50 0x7f294819d8a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:54.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.735+0000 7f29500a4700 1 -- 172.21.15.8:0/1872667074 >> 172.21.15.8:0/1872667074 conn(0x7f29480fbee0 msgr2=0x7f2948106ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:54.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.735+0000 7f29500a4700 1 -- 172.21.15.8:0/1872667074 shutdown_connections 2023-08-11T12:15:54.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:54.735+0000 7f29500a4700 1 -- 172.21.15.8:0/1872667074 wait complete. 2023-08-11T12:15:55.241 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi194 2023-08-11T12:15:55.242 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-08-11T12:15:55.242 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/etc/ceph/ceph.conf 2023-08-11T12:15:55.263 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-08-11T12:15:55.263 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-08-11T12:15:55.322 INFO:tasks.cephadm:Adding host smithi194 to orchestrator... 2023-08-11T12:15:55.322 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph orch host add smithi194 2023-08-11T12:15:55.386 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:55 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:15:55.386 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:55 smithi008 ceph-mon[97158]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:15:56.051 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:15:56.399 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:56 smithi008 ceph-mon[97158]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:15:57.391 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:57 smithi008 ceph-mon[97158]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:15:57.392 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:57 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:15:57.392 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:57 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:15:57.392 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:57 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:15:57.392 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:57 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:15:57.392 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:57 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi045", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:15:57.392 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:57 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:15:57.392 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:57 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:15:57.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.589+0000 7f46d8b51700 1 -- 172.21.15.8:0/3636902335 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46d4108670 msgr2=0x7f46d4108a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:15:57.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.589+0000 7f46d8b51700 1 --2- 172.21.15.8:0/3636902335 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46d4108670 0x7f46d4108a50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009910 tx=0x7f46c4009c20 comp rx=0 tx=0).stop 2023-08-11T12:15:57.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.589+0000 7f46d8b51700 1 -- 172.21.15.8:0/3636902335 shutdown_connections 2023-08-11T12:15:57.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.589+0000 7f46d8b51700 1 --2- 172.21.15.8:0/3636902335 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46d4108670 0x7f46d4108a50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:15:57.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.589+0000 7f46d8b51700 1 -- 172.21.15.8:0/3636902335 >> 172.21.15.8:0/3636902335 conn(0x7f46d40fe0d0 msgr2=0x7f46d41004f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:15:57.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.589+0000 7f46d8b51700 1 -- 172.21.15.8:0/3636902335 shutdown_connections 2023-08-11T12:15:57.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.589+0000 7f46d8b51700 1 -- 172.21.15.8:0/3636902335 wait complete. 2023-08-11T12:15:57.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.590+0000 7f46d8b51700 1 Processor -- start 2023-08-11T12:15:57.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.590+0000 7f46d8b51700 1 -- start start 2023-08-11T12:15:57.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.591+0000 7f46d8b51700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46d4108670 0x7f46d419d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:57.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.591+0000 7f46d8b51700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d419dc10 con 0x7f46d4108670 2023-08-11T12:15:57.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.591+0000 7f46d259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46d4108670 0x7f46d419d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:57.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.591+0000 7f46d259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46d4108670 0x7f46d419d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51000/0 (socket says 172.21.15.8:51000) 2023-08-11T12:15:57.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.591+0000 7f46d259c700 1 -- 172.21.15.8:0/494632359 learned_addr learned my addr 172.21.15.8:0/494632359 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:15:57.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.591+0000 7f46d259c700 1 -- 172.21.15.8:0/494632359 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c40095f0 con 0x7f46d4108670 2023-08-11T12:15:57.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.591+0000 7f46d259c700 1 --2- 172.21.15.8:0/494632359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46d4108670 0x7f46d419d6d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f46c4004f40 tx=0x7f46c4005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:57.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.592+0000 7f46c37fe700 1 -- 172.21.15.8:0/494632359 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46c401d070 con 0x7f46d4108670 2023-08-11T12:15:57.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.592+0000 7f46c37fe700 1 -- 172.21.15.8:0/494632359 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46c4004370 con 0x7f46d4108670 2023-08-11T12:15:57.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.592+0000 7f46d8b51700 1 -- 172.21.15.8:0/494632359 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d419de70 con 0x7f46d4108670 2023-08-11T12:15:57.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.592+0000 7f46c37fe700 1 -- 172.21.15.8:0/494632359 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46c40039b0 con 0x7f46d4108670 2023-08-11T12:15:57.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.592+0000 7f46d8b51700 1 -- 172.21.15.8:0/494632359 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d4197770 con 0x7f46d4108670 2023-08-11T12:15:57.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.593+0000 7f46c37fe700 1 -- 172.21.15.8:0/494632359 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45190+0+0 (secure 0 0 0) 0x7f46c4003c70 con 0x7f46d4108670 2023-08-11T12:15:57.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.593+0000 7f46d8b51700 1 -- 172.21.15.8:0/494632359 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46d4061f50 con 0x7f46d4108670 2023-08-11T12:15:57.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.593+0000 7f46c37fe700 1 --2- 172.21.15.8:0/494632359 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f46bc0381b0 0x7f46bc03a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:15:57.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.593+0000 7f46c37fe700 1 -- 172.21.15.8:0/494632359 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f46c404be70 con 0x7f46d4108670 2023-08-11T12:15:57.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.594+0000 7f46d1d9b700 1 --2- 172.21.15.8:0/494632359 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f46bc0381b0 0x7f46bc03a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:15:57.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.594+0000 7f46d1d9b700 1 --2- 172.21.15.8:0/494632359 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f46bc0381b0 0x7f46bc03a670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f46c8006fd0 tx=0x7f46c8006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:15:57.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.599+0000 7f46c37fe700 1 -- 172.21.15.8:0/494632359 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f46c402a980 con 0x7f46d4108670 2023-08-11T12:15:57.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:15:57.839+0000 7f46d8b51700 1 -- 172.21.15.8:0/494632359 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi194", "target": ["mon-mgr", ""]}) v1 -- 0x7f46d410c950 con 0x7f46bc0381b0 2023-08-11T12:15:58.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:58 smithi008 ceph-mon[97158]: Updating smithi045:/etc/ceph/ceph.conf 2023-08-11T12:15:58.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:58 smithi008 ceph-mon[97158]: Updating smithi045:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-11T12:15:58.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:58 smithi008 ceph-mon[97158]: Updating smithi045:/etc/ceph/ceph.client.admin.keyring 2023-08-11T12:15:58.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:58 smithi008 ceph-mon[97158]: Updating smithi045:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-11T12:15:58.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:58 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:15:58.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:58 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:15:58.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:58 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:15:59.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:59 smithi008 ceph-mon[97158]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi194", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:15:59.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:59 smithi008 ceph-mon[97158]: Deploying cephadm binary to smithi194 2023-08-11T12:15:59.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:15:59 smithi008 ceph-mon[97158]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:00.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:00.200+0000 7f46c37fe700 1 -- 172.21.15.8:0/494632359 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f46d410c950 con 0x7f46bc0381b0 2023-08-11T12:16:00.203 INFO:teuthology.orchestra.run.smithi008.stdout:Added host 'smithi194' with addr '172.21.15.194' 2023-08-11T12:16:00.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:00.203+0000 7f46d8b51700 1 -- 172.21.15.8:0/494632359 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f46bc0381b0 msgr2=0x7f46bc03a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:00.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:00.203+0000 7f46d8b51700 1 --2- 172.21.15.8:0/494632359 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f46bc0381b0 0x7f46bc03a670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f46c8006fd0 tx=0x7f46c8006e40 comp rx=0 tx=0).stop 2023-08-11T12:16:00.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:00.203+0000 7f46d8b51700 1 -- 172.21.15.8:0/494632359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46d4108670 msgr2=0x7f46d419d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:00.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:00.203+0000 7f46d8b51700 1 --2- 172.21.15.8:0/494632359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46d4108670 0x7f46d419d6d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f46c4004f40 tx=0x7f46c4005020 comp rx=0 tx=0).stop 2023-08-11T12:16:00.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:00.203+0000 7f46d8b51700 1 -- 172.21.15.8:0/494632359 shutdown_connections 2023-08-11T12:16:00.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:00.203+0000 7f46d8b51700 1 --2- 172.21.15.8:0/494632359 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f46bc0381b0 0x7f46bc03a670 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:00.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:00.203+0000 7f46d8b51700 1 --2- 172.21.15.8:0/494632359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46d4108670 0x7f46d419d6d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:00.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:00.203+0000 7f46d8b51700 1 -- 172.21.15.8:0/494632359 >> 172.21.15.8:0/494632359 conn(0x7f46d40fe0d0 msgr2=0x7f46d40fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:16:00.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:00.204+0000 7f46d8b51700 1 -- 172.21.15.8:0/494632359 shutdown_connections 2023-08-11T12:16:00.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:00.204+0000 7f46d8b51700 1 -- 172.21.15.8:0/494632359 wait complete. 2023-08-11T12:16:00.736 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph orch host ls --format=json 2023-08-11T12:16:01.463 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:16:01.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:01 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:01.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:01 smithi008 ceph-mon[97158]: Added host smithi194 2023-08-11T12:16:01.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:01 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:16:01.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:01 smithi008 ceph-mon[97158]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:01.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:01 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:02.399 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:02 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:02.399 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:02 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:03.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.058+0000 7f5133c37700 1 -- 172.21.15.8:0/4211694121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f512c100610 msgr2=0x7f512c1009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:03.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.058+0000 7f5133c37700 1 --2- 172.21.15.8:0/4211694121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f512c100610 0x7f512c1009f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5128009910 tx=0x7f5128009c20 comp rx=0 tx=0).stop 2023-08-11T12:16:03.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.058+0000 7f5133c37700 1 -- 172.21.15.8:0/4211694121 shutdown_connections 2023-08-11T12:16:03.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.058+0000 7f5133c37700 1 --2- 172.21.15.8:0/4211694121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f512c100610 0x7f512c1009f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:03.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.058+0000 7f5133c37700 1 -- 172.21.15.8:0/4211694121 >> 172.21.15.8:0/4211694121 conn(0x7f512c0fbee0 msgr2=0x7f512c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:16:03.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.058+0000 7f5133c37700 1 -- 172.21.15.8:0/4211694121 shutdown_connections 2023-08-11T12:16:03.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.058+0000 7f5133c37700 1 -- 172.21.15.8:0/4211694121 wait complete. 2023-08-11T12:16:03.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.060+0000 7f5133c37700 1 Processor -- start 2023-08-11T12:16:03.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.060+0000 7f5133c37700 1 -- start start 2023-08-11T12:16:03.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.060+0000 7f5133c37700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f512c100610 0x7f512c19b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:16:03.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.060+0000 7f5133c37700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c19bb60 con 0x7f512c100610 2023-08-11T12:16:03.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.061+0000 7f51319d3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f512c100610 0x7f512c19b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:16:03.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.061+0000 7f51319d3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f512c100610 0x7f512c19b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46498/0 (socket says 172.21.15.8:46498) 2023-08-11T12:16:03.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.061+0000 7f51319d3700 1 -- 172.21.15.8:0/313465104 learned_addr learned my addr 172.21.15.8:0/313465104 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:16:03.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.061+0000 7f51319d3700 1 -- 172.21.15.8:0/313465104 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51280095f0 con 0x7f512c100610 2023-08-11T12:16:03.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.061+0000 7f51319d3700 1 --2- 172.21.15.8:0/313465104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f512c100610 0x7f512c19b620 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5128004f40 tx=0x7f5128005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:16:03.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.061+0000 7f5122ffd700 1 -- 172.21.15.8:0/313465104 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f512801d070 con 0x7f512c100610 2023-08-11T12:16:03.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.061+0000 7f5133c37700 1 -- 172.21.15.8:0/313465104 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512c19bd60 con 0x7f512c100610 2023-08-11T12:16:03.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.061+0000 7f5122ffd700 1 -- 172.21.15.8:0/313465104 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5128004370 con 0x7f512c100610 2023-08-11T12:16:03.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.061+0000 7f5122ffd700 1 -- 172.21.15.8:0/313465104 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51280039b0 con 0x7f512c100610 2023-08-11T12:16:03.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.062+0000 7f5133c37700 1 -- 172.21.15.8:0/313465104 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512c19c180 con 0x7f512c100610 2023-08-11T12:16:03.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.063+0000 7f5122ffd700 1 -- 172.21.15.8:0/313465104 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45190+0+0 (secure 0 0 0) 0x7f5128003c70 con 0x7f512c100610 2023-08-11T12:16:03.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.063+0000 7f5133c37700 1 -- 172.21.15.8:0/313465104 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f512c061f50 con 0x7f512c100610 2023-08-11T12:16:03.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.063+0000 7f5122ffd700 1 --2- 172.21.15.8:0/313465104 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f51180381b0 0x7f511803a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:16:03.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.063+0000 7f5122ffd700 1 -- 172.21.15.8:0/313465104 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f512804be70 con 0x7f512c100610 2023-08-11T12:16:03.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.063+0000 7f51311d2700 1 --2- 172.21.15.8:0/313465104 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f51180381b0 0x7f511803a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:16:03.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.064+0000 7f51311d2700 1 --2- 172.21.15.8:0/313465104 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f51180381b0 0x7f511803a670 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f511c006fd0 tx=0x7f511c006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:16:03.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.068+0000 7f5122ffd700 1 -- 172.21.15.8:0/313465104 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f512802a980 con 0x7f512c100610 2023-08-11T12:16:03.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.284+0000 7f5133c37700 1 -- 172.21.15.8:0/313465104 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f512c0008d0 con 0x7f51180381b0 2023-08-11T12:16:03.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.286+0000 7f5122ffd700 1 -- 172.21.15.8:0/313465104 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+238 (secure 0 0 0) 0x7f512c0008d0 con 0x7f51180381b0 2023-08-11T12:16:03.287 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:16:03.287 INFO:teuthology.orchestra.run.smithi008.stdout:[{"addr": "172.21.15.8", "hostname": "smithi008", "labels": [], "status": ""}, {"addr": "172.21.15.45", "hostname": "smithi045", "labels": [], "status": ""}, {"addr": "172.21.15.194", "hostname": "smithi194", "labels": [], "status": ""}] 2023-08-11T12:16:03.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.288+0000 7f5133c37700 1 -- 172.21.15.8:0/313465104 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f51180381b0 msgr2=0x7f511803a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:03.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.288+0000 7f5133c37700 1 --2- 172.21.15.8:0/313465104 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f51180381b0 0x7f511803a670 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f511c006fd0 tx=0x7f511c006e40 comp rx=0 tx=0).stop 2023-08-11T12:16:03.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.288+0000 7f5133c37700 1 -- 172.21.15.8:0/313465104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f512c100610 msgr2=0x7f512c19b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:03.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.288+0000 7f5133c37700 1 --2- 172.21.15.8:0/313465104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f512c100610 0x7f512c19b620 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5128004f40 tx=0x7f5128005020 comp rx=0 tx=0).stop 2023-08-11T12:16:03.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.288+0000 7f5133c37700 1 -- 172.21.15.8:0/313465104 shutdown_connections 2023-08-11T12:16:03.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.288+0000 7f5133c37700 1 --2- 172.21.15.8:0/313465104 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f51180381b0 0x7f511803a670 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:03.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.288+0000 7f5133c37700 1 --2- 172.21.15.8:0/313465104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f512c100610 0x7f512c19b620 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:03.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.288+0000 7f5133c37700 1 -- 172.21.15.8:0/313465104 >> 172.21.15.8:0/313465104 conn(0x7f512c0fbee0 msgr2=0x7f512c106170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:16:03.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.289+0000 7f5133c37700 1 -- 172.21.15.8:0/313465104 shutdown_connections 2023-08-11T12:16:03.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:03.289+0000 7f5133c37700 1 -- 172.21.15.8:0/313465104 wait complete. 2023-08-11T12:16:03.514 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:03 smithi008 ceph-mon[97158]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:03.844 INFO:tasks.cephadm:Setting crush tunables to default 2023-08-11T12:16:03.844 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph osd crush tunables default 2023-08-11T12:16:04.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:04 smithi008 ceph-mon[97158]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:16:04.574 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:16:05.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:05 smithi008 ceph-mon[97158]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:05.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:05 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:05.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:05 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:05.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:05 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:05.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:05 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:05.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:05 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:16:05.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:05 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:05.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:05 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:16:05.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:05 smithi008 ceph-mon[97158]: Updating smithi194:/etc/ceph/ceph.conf 2023-08-11T12:16:05.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:05 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:05.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:05 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:05.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:05 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:06.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.033+0000 7fc64e4bc700 1 -- 172.21.15.8:0/4151126714 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc648072d50 msgr2=0x7fc648073130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:06.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.033+0000 7fc64e4bc700 1 --2- 172.21.15.8:0/4151126714 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc648072d50 0x7fc648073130 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc638009910 tx=0x7fc638009c20 comp rx=0 tx=0).stop 2023-08-11T12:16:06.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.033+0000 7fc64e4bc700 1 -- 172.21.15.8:0/4151126714 shutdown_connections 2023-08-11T12:16:06.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.033+0000 7fc64e4bc700 1 --2- 172.21.15.8:0/4151126714 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc648072d50 0x7fc648073130 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:06.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.033+0000 7fc64e4bc700 1 -- 172.21.15.8:0/4151126714 >> 172.21.15.8:0/4151126714 conn(0x7fc6480fbee0 msgr2=0x7fc6480fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:16:06.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.034+0000 7fc64e4bc700 1 -- 172.21.15.8:0/4151126714 shutdown_connections 2023-08-11T12:16:06.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.034+0000 7fc64e4bc700 1 -- 172.21.15.8:0/4151126714 wait complete. 2023-08-11T12:16:06.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.035+0000 7fc64e4bc700 1 Processor -- start 2023-08-11T12:16:06.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.035+0000 7fc64e4bc700 1 -- start start 2023-08-11T12:16:06.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.035+0000 7fc64e4bc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc648072d50 0x7fc64819d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:16:06.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.035+0000 7fc64e4bc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64819dde0 con 0x7fc648072d50 2023-08-11T12:16:06.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.035+0000 7fc647fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc648072d50 0x7fc64819d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:16:06.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.035+0000 7fc647fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc648072d50 0x7fc64819d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46510/0 (socket says 172.21.15.8:46510) 2023-08-11T12:16:06.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.035+0000 7fc647fff700 1 -- 172.21.15.8:0/342603041 learned_addr learned my addr 172.21.15.8:0/342603041 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:16:06.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.036+0000 7fc647fff700 1 -- 172.21.15.8:0/342603041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6380095f0 con 0x7fc648072d50 2023-08-11T12:16:06.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.036+0000 7fc647fff700 1 --2- 172.21.15.8:0/342603041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc648072d50 0x7fc64819d8a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc638006010 tx=0x7fc638004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:16:06.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.036+0000 7fc6457fa700 1 -- 172.21.15.8:0/342603041 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc63801d070 con 0x7fc648072d50 2023-08-11T12:16:06.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.036+0000 7fc6457fa700 1 -- 172.21.15.8:0/342603041 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc6380044a0 con 0x7fc648072d50 2023-08-11T12:16:06.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.036+0000 7fc6457fa700 1 -- 172.21.15.8:0/342603041 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc638003a70 con 0x7fc648072d50 2023-08-11T12:16:06.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.036+0000 7fc64e4bc700 1 -- 172.21.15.8:0/342603041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64819dfe0 con 0x7fc648072d50 2023-08-11T12:16:06.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.036+0000 7fc64e4bc700 1 -- 172.21.15.8:0/342603041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc64819e400 con 0x7fc648072d50 2023-08-11T12:16:06.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.037+0000 7fc6457fa700 1 -- 172.21.15.8:0/342603041 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45190+0+0 (secure 0 0 0) 0x7fc638003c60 con 0x7fc648072d50 2023-08-11T12:16:06.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.037+0000 7fc64e4bc700 1 -- 172.21.15.8:0/342603041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc648061f50 con 0x7fc648072d50 2023-08-11T12:16:06.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.038+0000 7fc6457fa700 1 --2- 172.21.15.8:0/342603041 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc630038200 0x7fc63003a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:16:06.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.038+0000 7fc6457fa700 1 -- 172.21.15.8:0/342603041 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc63804bee0 con 0x7fc648072d50 2023-08-11T12:16:06.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.038+0000 7fc6477fe700 1 --2- 172.21.15.8:0/342603041 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc630038200 0x7fc63003a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:16:06.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.039+0000 7fc6477fe700 1 --2- 172.21.15.8:0/342603041 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc630038200 0x7fc63003a6c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc63c006fd0 tx=0x7fc63c006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:16:06.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.043+0000 7fc6457fa700 1 -- 172.21.15.8:0/342603041 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fc638029360 con 0x7fc648072d50 2023-08-11T12:16:06.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.257+0000 7fc64e4bc700 1 -- 172.21.15.8:0/342603041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc648198e30 con 0x7fc648072d50 2023-08-11T12:16:06.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.469+0000 7fc6457fa700 1 -- 172.21.15.8:0/342603041 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc638026020 con 0x7fc648072d50 2023-08-11T12:16:06.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.471+0000 7fc64e4bc700 1 -- 172.21.15.8:0/342603041 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc630038200 msgr2=0x7fc63003a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:06.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.471+0000 7fc64e4bc700 1 --2- 172.21.15.8:0/342603041 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc630038200 0x7fc63003a6c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc63c006fd0 tx=0x7fc63c006e40 comp rx=0 tx=0).stop 2023-08-11T12:16:06.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.471+0000 7fc64e4bc700 1 -- 172.21.15.8:0/342603041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc648072d50 msgr2=0x7fc64819d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:06.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.471+0000 7fc64e4bc700 1 --2- 172.21.15.8:0/342603041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc648072d50 0x7fc64819d8a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc638006010 tx=0x7fc638004ff0 comp rx=0 tx=0).stop 2023-08-11T12:16:06.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.471+0000 7fc64e4bc700 1 -- 172.21.15.8:0/342603041 shutdown_connections 2023-08-11T12:16:06.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.471+0000 7fc64e4bc700 1 --2- 172.21.15.8:0/342603041 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc630038200 0x7fc63003a6c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:06.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.471+0000 7fc64e4bc700 1 --2- 172.21.15.8:0/342603041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc648072d50 0x7fc64819d8a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:06.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.471+0000 7fc64e4bc700 1 -- 172.21.15.8:0/342603041 >> 172.21.15.8:0/342603041 conn(0x7fc6480fbee0 msgr2=0x7fc648106ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:16:06.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.472+0000 7fc64e4bc700 1 -- 172.21.15.8:0/342603041 shutdown_connections 2023-08-11T12:16:06.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:06.472+0000 7fc64e4bc700 1 -- 172.21.15.8:0/342603041 wait complete. 2023-08-11T12:16:06.476 INFO:teuthology.orchestra.run.smithi008.stderr:adjusted tunables profile to default 2023-08-11T12:16:06.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:06 smithi008 ceph-mon[97158]: Updating smithi194:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-11T12:16:06.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:06 smithi008 ceph-mon[97158]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2023-08-11T12:16:06.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:06 smithi008 ceph-mon[97158]: Updating smithi194:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-11T12:16:06.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:06 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/342603041' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-08-11T12:16:07.062 INFO:tasks.cephadm:Adding mon.a on smithi008 2023-08-11T12:16:07.063 INFO:tasks.cephadm:Adding mon.b on smithi045 2023-08-11T12:16:07.063 INFO:tasks.cephadm:Adding mon.c on smithi194 2023-08-11T12:16:07.063 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph orch apply mon '3;smithi008:172.21.15.8=a;smithi045:172.21.15.45=b;smithi194:172.21.15.194=c' 2023-08-11T12:16:07.658 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-11T12:16:07.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:07 smithi008 ceph-mon[97158]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:07.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:07 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/342603041' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-08-11T12:16:07.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:07 smithi008 ceph-mon[97158]: osdmap e4: 0 total, 0 up, 0 in 2023-08-11T12:16:08.825 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:08.824+0000 7fed0d3b8700 1 -- 172.21.15.194:0/4156008900 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed08101550 msgr2=0x7fed08101930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:08.825 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:08.824+0000 7fed0d3b8700 1 --2- 172.21.15.194:0/4156008900 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed08101550 0x7fed08101930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fecfc009910 tx=0x7fecfc009c20 comp rx=0 tx=0).stop 2023-08-11T12:16:08.825 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:08.824+0000 7fed0d3b8700 1 -- 172.21.15.194:0/4156008900 shutdown_connections 2023-08-11T12:16:08.826 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:08.824+0000 7fed0d3b8700 1 --2- 172.21.15.194:0/4156008900 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed08101550 0x7fed08101930 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:08.826 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:08.824+0000 7fed0d3b8700 1 -- 172.21.15.194:0/4156008900 >> 172.21.15.194:0/4156008900 conn(0x7fed080fada0 msgr2=0x7fed080fd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:16:08.826 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:08.824+0000 7fed0d3b8700 1 -- 172.21.15.194:0/4156008900 shutdown_connections 2023-08-11T12:16:08.826 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:08.824+0000 7fed0d3b8700 1 -- 172.21.15.194:0/4156008900 wait complete. 2023-08-11T12:16:08.827 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:08.824+0000 7fed0d3b8700 1 Processor -- start 2023-08-11T12:16:08.827 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:08.824+0000 7fed0d3b8700 1 -- start start 2023-08-11T12:16:08.828 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:08.825+0000 7fed0d3b8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed08101550 0x7fed080ff1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:16:08.828 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:08.825+0000 7fed0d3b8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed08101130 con 0x7fed08101550 2023-08-11T12:16:08.828 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:08.825+0000 7fed06ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed08101550 0x7fed080ff1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:16:08.828 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:08.825+0000 7fed06ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed08101550 0x7fed080ff1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.194:33346/0 (socket says 172.21.15.194:33346) 2023-08-11T12:16:08.828 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:08.825+0000 7fed06ffd700 1 -- 172.21.15.194:0/135264399 learned_addr learned my addr 172.21.15.194:0/135264399 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-08-11T12:16:08.828 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:08.825+0000 7fed06ffd700 1 -- 172.21.15.194:0/135264399 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecfc0095f0 con 0x7fed08101550 2023-08-11T12:16:08.828 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:08.826+0000 7fed06ffd700 1 --2- 172.21.15.194:0/135264399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed08101550 0x7fed080ff1b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fecfc005850 tx=0x7fecfc004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:16:08.829 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:08.826+0000 7feceffff700 1 -- 172.21.15.194:0/135264399 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecfc01d070 con 0x7fed08101550 2023-08-11T12:16:08.829 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:08.826+0000 7fed0d3b8700 1 -- 172.21.15.194:0/135264399 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed080ff6f0 con 0x7fed08101550 2023-08-11T12:16:08.829 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:08.826+0000 7feceffff700 1 -- 172.21.15.194:0/135264399 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fecfc004370 con 0x7fed08101550 2023-08-11T12:16:08.829 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:08.826+0000 7feceffff700 1 -- 172.21.15.194:0/135264399 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecfc003ab0 con 0x7fed08101550 2023-08-11T12:16:08.830 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:08.826+0000 7fed0d3b8700 1 -- 172.21.15.194:0/135264399 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed080ffb70 con 0x7fed08101550 2023-08-11T12:16:08.831 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:08.827+0000 7fed0d3b8700 1 -- 172.21.15.194:0/135264399 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed08107a60 con 0x7fed08101550 2023-08-11T12:16:08.831 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:08.827+0000 7feceffff700 1 -- 172.21.15.194:0/135264399 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45190+0+0 (secure 0 0 0) 0x7fecfc00b6f0 con 0x7fed08101550 2023-08-11T12:16:08.831 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:08.827+0000 7feceffff700 1 --2- 172.21.15.194:0/135264399 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fecf00381b0 0x7fecf003a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:16:08.832 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:08.827+0000 7feceffff700 1 -- 172.21.15.194:0/135264399 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fecfc04bdd0 con 0x7fed08101550 2023-08-11T12:16:08.832 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:08.827+0000 7fed067fc700 1 --2- 172.21.15.194:0/135264399 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fecf00381b0 0x7fecf003a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:16:08.832 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:08.828+0000 7fed067fc700 1 --2- 172.21.15.194:0/135264399 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fecf00381b0 0x7fecf003a670 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fecf8006fd0 tx=0x7fecf8006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:16:08.834 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:08.833+0000 7feceffff700 1 -- 172.21.15.194:0/135264399 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fecfc02a590 con 0x7fed08101550 2023-08-11T12:16:09.030 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:09.029+0000 7fed0d3b8700 1 -- 172.21.15.194:0/135264399 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi008:172.21.15.8=a;smithi045:172.21.15.45=b;smithi194:172.21.15.194=c", "target": ["mon-mgr", ""]}) v1 -- 0x7fed080ffed0 con 0x7fecf00381b0 2023-08-11T12:16:09.037 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:09.036+0000 7feceffff700 1 -- 172.21.15.194:0/135264399 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fed080ffed0 con 0x7fecf00381b0 2023-08-11T12:16:09.038 INFO:teuthology.orchestra.run.smithi194.stdout:Scheduled mon update... 2023-08-11T12:16:09.040 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:09.038+0000 7fed0d3b8700 1 -- 172.21.15.194:0/135264399 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fecf00381b0 msgr2=0x7fecf003a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:09.040 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:09.038+0000 7fed0d3b8700 1 --2- 172.21.15.194:0/135264399 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fecf00381b0 0x7fecf003a670 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fecf8006fd0 tx=0x7fecf8006e40 comp rx=0 tx=0).stop 2023-08-11T12:16:09.040 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:09.038+0000 7fed0d3b8700 1 -- 172.21.15.194:0/135264399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed08101550 msgr2=0x7fed080ff1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:09.040 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:09.038+0000 7fed0d3b8700 1 --2- 172.21.15.194:0/135264399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed08101550 0x7fed080ff1b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fecfc005850 tx=0x7fecfc004ff0 comp rx=0 tx=0).stop 2023-08-11T12:16:09.040 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:09.038+0000 7fed0d3b8700 1 -- 172.21.15.194:0/135264399 shutdown_connections 2023-08-11T12:16:09.041 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:09.038+0000 7fed0d3b8700 1 --2- 172.21.15.194:0/135264399 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fecf00381b0 0x7fecf003a670 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:09.041 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:09.038+0000 7fed0d3b8700 1 --2- 172.21.15.194:0/135264399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed08101550 0x7fed080ff1b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:09.041 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:09.038+0000 7fed0d3b8700 1 -- 172.21.15.194:0/135264399 >> 172.21.15.194:0/135264399 conn(0x7fed080fada0 msgr2=0x7fed08104ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:16:09.041 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:09.038+0000 7fed0d3b8700 1 -- 172.21.15.194:0/135264399 shutdown_connections 2023-08-11T12:16:09.041 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:09.038+0000 7fed0d3b8700 1 -- 172.21.15.194:0/135264399 wait complete. 2023-08-11T12:16:09.423 DEBUG:teuthology.orchestra.run.smithi045:mon.b> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mon.b.service 2023-08-11T12:16:09.426 DEBUG:teuthology.orchestra.run.smithi194:mon.c> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mon.c.service 2023-08-11T12:16:09.428 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-08-11T12:16:09.429 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph mon dump -f json 2023-08-11T12:16:09.459 INFO:journalctl@ceph.mon.c.smithi194.stdout:-- Logs begin at Fri 2023-08-11 11:52:16 UTC. -- 2023-08-11T12:16:09.463 INFO:journalctl@ceph.mon.b.smithi045.stdout:-- Logs begin at Fri 2023-08-11 11:52:16 UTC. -- 2023-08-11T12:16:09.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:09 smithi008 ceph-mon[97158]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:09.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:09 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:09.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:09 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:16:09.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:09 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:09.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:09 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:16:09.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:09 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:09.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:09 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-11T12:16:09.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:09 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:09.990 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-11T12:16:10.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:10 smithi008 ceph-mon[97158]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi008:172.21.15.8=a;smithi045:172.21.15.45=b;smithi194:172.21.15.194=c", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:16:10.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:10 smithi008 ceph-mon[97158]: Saving service mon spec with placement smithi008:172.21.15.8=a;smithi045:172.21.15.45=b;smithi194:172.21.15.194=c;count:3 2023-08-11T12:16:10.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:10 smithi008 ceph-mon[97158]: Deploying daemon mon.c on smithi194 2023-08-11T12:16:11.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:11 smithi008 ceph-mon[97158]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:12.014 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.012+0000 7f0228e73700 1 -- 172.21.15.194:0/3087743038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02240feb10 msgr2=0x7f02240feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:12.015 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.012+0000 7f0228e73700 1 --2- 172.21.15.194:0/3087743038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02240feb10 0x7f02240feef0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0214009910 tx=0x7f0214009c20 comp rx=0 tx=0).stop 2023-08-11T12:16:12.015 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.012+0000 7f0228e73700 1 -- 172.21.15.194:0/3087743038 shutdown_connections 2023-08-11T12:16:12.015 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.012+0000 7f0228e73700 1 --2- 172.21.15.194:0/3087743038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02240feb10 0x7f02240feef0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:12.016 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.012+0000 7f0228e73700 1 -- 172.21.15.194:0/3087743038 >> 172.21.15.194:0/3087743038 conn(0x7f0224075980 msgr2=0x7f0224075d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:16:12.016 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.012+0000 7f0228e73700 1 -- 172.21.15.194:0/3087743038 shutdown_connections 2023-08-11T12:16:12.016 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.012+0000 7f0228e73700 1 -- 172.21.15.194:0/3087743038 wait complete. 2023-08-11T12:16:12.016 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.013+0000 7f0228e73700 1 Processor -- start 2023-08-11T12:16:12.016 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.013+0000 7f0228e73700 1 -- start start 2023-08-11T12:16:12.016 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.013+0000 7f0228e73700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02240feb10 0x7f02240ffa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:16:12.016 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.013+0000 7f0228e73700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0224101970 con 0x7f02240feb10 2023-08-11T12:16:12.018 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.014+0000 7f022259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02240feb10 0x7f02240ffa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:16:12.019 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.014+0000 7f022259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02240feb10 0x7f02240ffa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.194:33352/0 (socket says 172.21.15.194:33352) 2023-08-11T12:16:12.019 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.014+0000 7f022259c700 1 -- 172.21.15.194:0/2134116792 learned_addr learned my addr 172.21.15.194:0/2134116792 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-08-11T12:16:12.019 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.014+0000 7f022259c700 1 -- 172.21.15.194:0/2134116792 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02140095f0 con 0x7f02240feb10 2023-08-11T12:16:12.019 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.014+0000 7f022259c700 1 --2- 172.21.15.194:0/2134116792 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02240feb10 0x7f02240ffa90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0214004f40 tx=0x7f0214005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:16:12.019 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.015+0000 7f02137fe700 1 -- 172.21.15.194:0/2134116792 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f021401d070 con 0x7f02240feb10 2023-08-11T12:16:12.020 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.015+0000 7f0228e73700 1 -- 172.21.15.194:0/2134116792 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02240fffd0 con 0x7f02240feb10 2023-08-11T12:16:12.020 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.015+0000 7f02137fe700 1 -- 172.21.15.194:0/2134116792 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0214004370 con 0x7f02240feb10 2023-08-11T12:16:12.020 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.015+0000 7f02137fe700 1 -- 172.21.15.194:0/2134116792 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02140039b0 con 0x7f02240feb10 2023-08-11T12:16:12.020 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.015+0000 7f0228e73700 1 -- 172.21.15.194:0/2134116792 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0224100390 con 0x7f02240feb10 2023-08-11T12:16:12.020 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.016+0000 7f02137fe700 1 -- 172.21.15.194:0/2134116792 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45190+0+0 (secure 0 0 0) 0x7f0214003c70 con 0x7f02240feb10 2023-08-11T12:16:12.020 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.016+0000 7f0228e73700 1 -- 172.21.15.194:0/2134116792 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0224061f50 con 0x7f02240feb10 2023-08-11T12:16:12.020 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.016+0000 7f02137fe700 1 --2- 172.21.15.194:0/2134116792 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f020c0381b0 0x7f020c03a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:16:12.021 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.016+0000 7f02137fe700 1 -- 172.21.15.194:0/2134116792 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f021404bf50 con 0x7f02240feb10 2023-08-11T12:16:12.021 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.016+0000 7f0221d9b700 1 --2- 172.21.15.194:0/2134116792 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f020c0381b0 0x7f020c03a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:16:12.021 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.017+0000 7f0221d9b700 1 --2- 172.21.15.194:0/2134116792 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f020c0381b0 0x7f020c03a670 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0218006fd0 tx=0x7f0218006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:16:12.023 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.022+0000 7f02137fe700 1 -- 172.21.15.194:0/2134116792 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f021402aba0 con 0x7f02240feb10 2023-08-11T12:16:12.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:11 smithi194 systemd[1]: Starting Ceph mon.c for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:16:12.327 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.324+0000 7f0228e73700 1 -- 172.21.15.194:0/2134116792 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f02240008d0 con 0x7f02240feb10 2023-08-11T12:16:12.327 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.325+0000 7f02137fe700 1 -- 172.21.15.194:0/2134116792 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+732 (secure 0 0 0) 0x7f0214026030 con 0x7f02240feb10 2023-08-11T12:16:12.328 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-08-11T12:16:12.328 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","modified":"2023-08-11T12:14:24.688999Z","created":"2023-08-11T12:14:24.688999Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-08-11T12:16:12.329 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.327+0000 7f0228e73700 1 -- 172.21.15.194:0/2134116792 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f020c0381b0 msgr2=0x7f020c03a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:12.330 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.327+0000 7f0228e73700 1 --2- 172.21.15.194:0/2134116792 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f020c0381b0 0x7f020c03a670 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0218006fd0 tx=0x7f0218006e40 comp rx=0 tx=0).stop 2023-08-11T12:16:12.330 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.327+0000 7f0228e73700 1 -- 172.21.15.194:0/2134116792 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02240feb10 msgr2=0x7f02240ffa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:12.330 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.327+0000 7f0228e73700 1 --2- 172.21.15.194:0/2134116792 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02240feb10 0x7f02240ffa90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0214004f40 tx=0x7f0214005020 comp rx=0 tx=0).stop 2023-08-11T12:16:12.331 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.327+0000 7f0228e73700 1 -- 172.21.15.194:0/2134116792 shutdown_connections 2023-08-11T12:16:12.331 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.327+0000 7f0228e73700 1 --2- 172.21.15.194:0/2134116792 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f020c0381b0 0x7f020c03a670 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:12.331 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.327+0000 7f0228e73700 1 --2- 172.21.15.194:0/2134116792 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02240feb10 0x7f02240ffa90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:12.331 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.327+0000 7f0228e73700 1 -- 172.21.15.194:0/2134116792 >> 172.21.15.194:0/2134116792 conn(0x7f0224075980 msgr2=0x7f0224106160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:16:12.332 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.327+0000 7f0228e73700 1 -- 172.21.15.194:0/2134116792 shutdown_connections 2023-08-11T12:16:12.332 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:12.327+0000 7f0228e73700 1 -- 172.21.15.194:0/2134116792 wait complete. 2023-08-11T12:16:12.332 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2023-08-11T12:16:12.474 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 podman[130850]: 2023-08-11T12:16:12.474 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 bash[130850]: 8218a9e78837571ee3e17f5bf65276f62fb1bc5da965ecf108113c22ae561da9 2023-08-11T12:16:12.474 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 systemd[1]: Started Ceph mon.c for 815f94ae-3840-11ee-9b37-001a4aab830c. 2023-08-11T12:16:12.474 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: set uid:gid to 167:167 (ceph:ceph) 2023-08-11T12:16:12.474 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: ceph version 18.0.0-5437-g92684807 (92684807f016ce045ac66e37fdde6f8c47857bcc) reef (dev), process ceph-mon, pid 7 2023-08-11T12:16:12.474 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: pidfile_write: ignore empty --pid-file 2023-08-11T12:16:12.475 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: load: jerasure load: lrc 2023-08-11T12:16:12.475 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: RocksDB version: 7.9.2 2023-08-11T12:16:12.475 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Git sha 0 2023-08-11T12:16:12.475 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Compile date 2023-08-10 15:31:53 2023-08-11T12:16:12.476 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: DB SUMMARY 2023-08-11T12:16:12.476 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: DB Session ID: 5GQBXR2OF6NYHWCW211D 2023-08-11T12:16:12.476 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: CURRENT file: CURRENT 2023-08-11T12:16:12.476 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: IDENTITY file: IDENTITY 2023-08-11T12:16:12.476 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-08-11T12:16:12.476 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2023-08-11T12:16:12.477 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2023-08-11T12:16:12.477 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.error_if_exists: 0 2023-08-11T12:16:12.477 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.create_if_missing: 0 2023-08-11T12:16:12.477 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.paranoid_checks: 1 2023-08-11T12:16:12.477 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.flush_verify_memtable_count: 1 2023-08-11T12:16:12.477 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-08-11T12:16:12.477 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-08-11T12:16:12.478 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.env: 0x561f164ffda0 2023-08-11T12:16:12.478 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.fs: PosixFileSystem 2023-08-11T12:16:12.478 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.info_log: 0x561f16e75460 2023-08-11T12:16:12.478 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.max_file_opening_threads: 16 2023-08-11T12:16:12.478 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.statistics: (nil) 2023-08-11T12:16:12.478 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.use_fsync: 0 2023-08-11T12:16:12.478 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.max_log_file_size: 0 2023-08-11T12:16:12.478 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-08-11T12:16:12.479 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.log_file_time_to_roll: 0 2023-08-11T12:16:12.479 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.keep_log_file_num: 1000 2023-08-11T12:16:12.479 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.recycle_log_file_num: 0 2023-08-11T12:16:12.479 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.allow_fallocate: 1 2023-08-11T12:16:12.479 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.allow_mmap_reads: 0 2023-08-11T12:16:12.479 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.allow_mmap_writes: 0 2023-08-11T12:16:12.479 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.use_direct_reads: 0 2023-08-11T12:16:12.480 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-08-11T12:16:12.480 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.create_missing_column_families: 0 2023-08-11T12:16:12.480 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.db_log_dir: 2023-08-11T12:16:12.480 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.wal_dir: 2023-08-11T12:16:12.480 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.table_cache_numshardbits: 6 2023-08-11T12:16:12.480 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.WAL_ttl_seconds: 0 2023-08-11T12:16:12.480 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.WAL_size_limit_MB: 0 2023-08-11T12:16:12.480 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-08-11T12:16:12.481 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-08-11T12:16:12.481 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.is_fd_close_on_exec: 1 2023-08-11T12:16:12.481 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.advise_random_on_open: 1 2023-08-11T12:16:12.481 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.db_write_buffer_size: 0 2023-08-11T12:16:12.481 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.write_buffer_manager: 0x561f16e2e3c0 2023-08-11T12:16:12.481 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-08-11T12:16:12.481 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-08-11T12:16:12.482 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.use_adaptive_mutex: 0 2023-08-11T12:16:12.482 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.rate_limiter: (nil) 2023-08-11T12:16:12.482 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-08-11T12:16:12.482 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.wal_recovery_mode: 2 2023-08-11T12:16:12.482 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.enable_thread_tracking: 0 2023-08-11T12:16:12.482 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.enable_pipelined_write: 0 2023-08-11T12:16:12.483 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.unordered_write: 0 2023-08-11T12:16:12.483 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-08-11T12:16:12.483 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-08-11T12:16:12.483 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-08-11T12:16:12.483 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-08-11T12:16:12.483 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.row_cache: None 2023-08-11T12:16:12.483 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.wal_filter: None 2023-08-11T12:16:12.484 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-08-11T12:16:12.484 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.allow_ingest_behind: 0 2023-08-11T12:16:12.484 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.two_write_queues: 0 2023-08-11T12:16:12.484 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.manual_wal_flush: 0 2023-08-11T12:16:12.484 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.wal_compression: 0 2023-08-11T12:16:12.484 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.atomic_flush: 0 2023-08-11T12:16:12.484 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-08-11T12:16:12.485 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.persist_stats_to_disk: 0 2023-08-11T12:16:12.485 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.write_dbid_to_manifest: 0 2023-08-11T12:16:12.485 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.log_readahead_size: 0 2023-08-11T12:16:12.485 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-08-11T12:16:12.485 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.best_efforts_recovery: 0 2023-08-11T12:16:12.485 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-08-11T12:16:12.485 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-08-11T12:16:12.486 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.allow_data_in_errors: 0 2023-08-11T12:16:12.486 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.db_host_id: __hostname__ 2023-08-11T12:16:12.486 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.enforce_single_del_contracts: true 2023-08-11T12:16:12.486 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.max_background_jobs: 2 2023-08-11T12:16:12.486 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.max_background_compactions: -1 2023-08-11T12:16:12.486 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.max_subcompactions: 1 2023-08-11T12:16:12.486 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-08-11T12:16:12.486 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-08-11T12:16:12.487 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.delayed_write_rate : 16777216 2023-08-11T12:16:12.487 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.max_total_wal_size: 0 2023-08-11T12:16:12.487 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-08-11T12:16:12.487 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.stats_dump_period_sec: 600 2023-08-11T12:16:12.487 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.stats_persist_period_sec: 600 2023-08-11T12:16:12.487 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-08-11T12:16:12.487 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.max_open_files: -1 2023-08-11T12:16:12.487 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.bytes_per_sync: 0 2023-08-11T12:16:12.488 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.wal_bytes_per_sync: 0 2023-08-11T12:16:12.488 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.strict_bytes_per_sync: 0 2023-08-11T12:16:12.488 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.compaction_readahead_size: 0 2023-08-11T12:16:12.488 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.max_background_flushes: -1 2023-08-11T12:16:12.488 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Compression algorithms supported: 2023-08-11T12:16:12.488 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-08-11T12:16:12.488 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: kZSTD supported: 0 2023-08-11T12:16:12.489 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: kXpressCompression supported: 0 2023-08-11T12:16:12.489 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: kLZ4HCCompression supported: 1 2023-08-11T12:16:12.489 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: kZlibCompression supported: 1 2023-08-11T12:16:12.489 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: kSnappyCompression supported: 1 2023-08-11T12:16:12.489 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: kLZ4Compression supported: 1 2023-08-11T12:16:12.489 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: kBZip2Compression supported: 0 2023-08-11T12:16:12.489 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Fast CRC32 supported: Supported on x86 2023-08-11T12:16:12.489 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: DMutex implementation: pthread_mutex_t 2023-08-11T12:16:12.490 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2023-08-11T12:16:12.490 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-08-11T12:16:12.490 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-08-11T12:16:12.490 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.merge_operator: 2023-08-11T12:16:12.490 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.compaction_filter: None 2023-08-11T12:16:12.490 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.compaction_filter_factory: None 2023-08-11T12:16:12.490 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.sst_partitioner_factory: None 2023-08-11T12:16:12.491 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.memtable_factory: SkipListFactory 2023-08-11T12:16:12.491 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.table_factory: BlockBasedTable 2023-08-11T12:16:12.492 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561f16e75560) 2023-08-11T12:16:12.492 INFO:journalctl@ceph.mon.c.smithi194.stdout: cache_index_and_filter_blocks: 1 2023-08-11T12:16:12.492 INFO:journalctl@ceph.mon.c.smithi194.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-08-11T12:16:12.492 INFO:journalctl@ceph.mon.c.smithi194.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-08-11T12:16:12.493 INFO:journalctl@ceph.mon.c.smithi194.stdout: pin_top_level_index_and_filter: 1 2023-08-11T12:16:12.493 INFO:journalctl@ceph.mon.c.smithi194.stdout: index_type: 0 2023-08-11T12:16:12.493 INFO:journalctl@ceph.mon.c.smithi194.stdout: data_block_index_type: 0 2023-08-11T12:16:12.493 INFO:journalctl@ceph.mon.c.smithi194.stdout: index_shortening: 1 2023-08-11T12:16:12.493 INFO:journalctl@ceph.mon.c.smithi194.stdout: data_block_hash_table_util_ratio: 0.750000 2023-08-11T12:16:12.493 INFO:journalctl@ceph.mon.c.smithi194.stdout: checksum: 4 2023-08-11T12:16:12.493 INFO:journalctl@ceph.mon.c.smithi194.stdout: no_block_cache: 0 2023-08-11T12:16:12.493 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_cache: 0x561f16ecd1f0 2023-08-11T12:16:12.494 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_cache_name: BinnedLRUCache 2023-08-11T12:16:12.494 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_cache_options: 2023-08-11T12:16:12.494 INFO:journalctl@ceph.mon.c.smithi194.stdout: capacity : 536870912 2023-08-11T12:16:12.494 INFO:journalctl@ceph.mon.c.smithi194.stdout: num_shard_bits : 4 2023-08-11T12:16:12.494 INFO:journalctl@ceph.mon.c.smithi194.stdout: strict_capacity_limit : 0 2023-08-11T12:16:12.494 INFO:journalctl@ceph.mon.c.smithi194.stdout: high_pri_pool_ratio: 0.000 2023-08-11T12:16:12.494 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_cache_compressed: (nil) 2023-08-11T12:16:12.494 INFO:journalctl@ceph.mon.c.smithi194.stdout: persistent_cache: (nil) 2023-08-11T12:16:12.495 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_size: 4096 2023-08-11T12:16:12.495 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_size_deviation: 10 2023-08-11T12:16:12.495 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_restart_interval: 16 2023-08-11T12:16:12.495 INFO:journalctl@ceph.mon.c.smithi194.stdout: index_block_restart_interval: 1 2023-08-11T12:16:12.495 INFO:journalctl@ceph.mon.c.smithi194.stdout: metadata_block_size: 4096 2023-08-11T12:16:12.495 INFO:journalctl@ceph.mon.c.smithi194.stdout: partition_filters: 0 2023-08-11T12:16:12.495 INFO:journalctl@ceph.mon.c.smithi194.stdout: use_delta_encoding: 1 2023-08-11T12:16:12.496 INFO:journalctl@ceph.mon.c.smithi194.stdout: filter_policy: bloomfilter 2023-08-11T12:16:12.496 INFO:journalctl@ceph.mon.c.smithi194.stdout: whole_key_filtering: 1 2023-08-11T12:16:12.496 INFO:journalctl@ceph.mon.c.smithi194.stdout: verify_compression: 0 2023-08-11T12:16:12.496 INFO:journalctl@ceph.mon.c.smithi194.stdout: read_amp_bytes_per_bit: 0 2023-08-11T12:16:12.496 INFO:journalctl@ceph.mon.c.smithi194.stdout: format_version: 5 2023-08-11T12:16:12.496 INFO:journalctl@ceph.mon.c.smithi194.stdout: enable_index_compression: 1 2023-08-11T12:16:12.496 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_align: 0 2023-08-11T12:16:12.497 INFO:journalctl@ceph.mon.c.smithi194.stdout: max_auto_readahead_size: 262144 2023-08-11T12:16:12.497 INFO:journalctl@ceph.mon.c.smithi194.stdout: prepopulate_block_cache: 0 2023-08-11T12:16:12.497 INFO:journalctl@ceph.mon.c.smithi194.stdout: initial_auto_readahead_size: 8192 2023-08-11T12:16:12.497 INFO:journalctl@ceph.mon.c.smithi194.stdout: num_file_reads_for_auto_readahead: 2 2023-08-11T12:16:12.497 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.write_buffer_size: 33554432 2023-08-11T12:16:12.497 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.max_write_buffer_number: 2 2023-08-11T12:16:12.497 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.compression: NoCompression 2023-08-11T12:16:12.497 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.bottommost_compression: Disabled 2023-08-11T12:16:12.498 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.prefix_extractor: nullptr 2023-08-11T12:16:12.498 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-08-11T12:16:12.498 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.num_levels: 7 2023-08-11T12:16:12.498 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-08-11T12:16:12.498 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-08-11T12:16:12.498 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-08-11T12:16:12.498 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-08-11T12:16:12.498 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-08-11T12:16:12.499 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-08-11T12:16:12.499 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-08-11T12:16:12.499 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-08-11T12:16:12.499 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-08-11T12:16:12.499 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-08-11T12:16:12.499 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-08-11T12:16:12.499 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-08-11T12:16:12.499 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.compression_opts.window_bits: -14 2023-08-11T12:16:12.500 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.compression_opts.level: 32767 2023-08-11T12:16:12.500 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.compression_opts.strategy: 0 2023-08-11T12:16:12.500 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-08-11T12:16:12.500 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-08-11T12:16:12.500 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-08-11T12:16:12.500 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-08-11T12:16:12.500 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.compression_opts.enabled: false 2023-08-11T12:16:12.501 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-08-11T12:16:12.501 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-08-11T12:16:12.501 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-08-11T12:16:12.501 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-08-11T12:16:12.501 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.target_file_size_base: 67108864 2023-08-11T12:16:12.501 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.target_file_size_multiplier: 1 2023-08-11T12:16:12.502 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-08-11T12:16:12.502 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-08-11T12:16:12.502 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-08-11T12:16:12.502 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-08-11T12:16:12.502 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-08-11T12:16:12.502 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-08-11T12:16:12.502 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-08-11T12:16:12.502 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-08-11T12:16:12.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-08-11T12:16:12.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-08-11T12:16:12.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-08-11T12:16:12.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-08-11T12:16:12.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-08-11T12:16:12.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.arena_block_size: 1048576 2023-08-11T12:16:12.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-08-11T12:16:12.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-08-11T12:16:12.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.disable_auto_compactions: 0 2023-08-11T12:16:12.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-08-11T12:16:12.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-08-11T12:16:12.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-08-11T12:16:12.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-08-11T12:16:12.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-08-11T12:16:12.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-08-11T12:16:12.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-08-11T12:16:12.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-08-11T12:16:12.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-08-11T12:16:12.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-08-11T12:16:12.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.table_properties_collectors: 2023-08-11T12:16:12.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.inplace_update_support: 0 2023-08-11T12:16:12.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.inplace_update_num_locks: 10000 2023-08-11T12:16:12.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-08-11T12:16:12.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-08-11T12:16:12.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.memtable_huge_page_size: 0 2023-08-11T12:16:12.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.bloom_locality: 0 2023-08-11T12:16:12.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.max_successive_merges: 0 2023-08-11T12:16:12.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.optimize_filters_for_hits: 0 2023-08-11T12:16:12.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.paranoid_file_checks: 0 2023-08-11T12:16:12.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.force_consistency_checks: 1 2023-08-11T12:16:12.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.report_bg_io_stats: 0 2023-08-11T12:16:12.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.ttl: 2592000 2023-08-11T12:16:12.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.periodic_compaction_seconds: 0 2023-08-11T12:16:12.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-08-11T12:16:12.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-08-11T12:16:12.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.enable_blob_files: false 2023-08-11T12:16:12.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.min_blob_size: 0 2023-08-11T12:16:12.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.blob_file_size: 268435456 2023-08-11T12:16:12.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.blob_compression_type: NoCompression 2023-08-11T12:16:12.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.enable_blob_garbage_collection: false 2023-08-11T12:16:12.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-08-11T12:16:12.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-08-11T12:16:12.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-08-11T12:16:12.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.blob_file_starting_level: 0 2023-08-11T12:16:12.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-08-11T12:16:12.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-08-11T12:16:12.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-08-11T12:16:12.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 3b047eb3-6361-4041-ae06-618a6c2d2b88 2023-08-11T12:16:12.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: EVENT_LOG_v1 {"time_micros": 1691756172443483, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-08-11T12:16:12.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-08-11T12:16:12.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: EVENT_LOG_v1 {"time_micros": 1691756172444049, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1691756172, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "3b047eb3-6361-4041-ae06-618a6c2d2b88", "db_session_id": "5GQBXR2OF6NYHWCW211D", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-08-11T12:16:12.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: EVENT_LOG_v1 {"time_micros": 1691756172444141, "job": 1, "event": "recovery_finished"} 2023-08-11T12:16:12.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-08-11T12:16:12.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-08-11T12:16:12.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x561f16f6a000 2023-08-11T12:16:12.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: DB pointer 0x561f16f56000 2023-08-11T12:16:12.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-08-11T12:16:12.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-08-11T12:16:12.511 INFO:journalctl@ceph.mon.c.smithi194.stdout: ** DB Stats ** 2023-08-11T12:16:12.511 INFO:journalctl@ceph.mon.c.smithi194.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-08-11T12:16:12.512 INFO:journalctl@ceph.mon.c.smithi194.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-08-11T12:16:12.512 INFO:journalctl@ceph.mon.c.smithi194.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-08-11T12:16:12.512 INFO:journalctl@ceph.mon.c.smithi194.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-08-11T12:16:12.512 INFO:journalctl@ceph.mon.c.smithi194.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-08-11T12:16:12.512 INFO:journalctl@ceph.mon.c.smithi194.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-08-11T12:16:12.512 INFO:journalctl@ceph.mon.c.smithi194.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-08-11T12:16:12.513 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2023-08-11T12:16:12.513 INFO:journalctl@ceph.mon.c.smithi194.stdout: ** Compaction Stats [default] ** 2023-08-11T12:16:12.513 INFO:journalctl@ceph.mon.c.smithi194.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-08-11T12:16:12.513 INFO:journalctl@ceph.mon.c.smithi194.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-08-11T12:16:12.513 INFO:journalctl@ceph.mon.c.smithi194.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-08-11T12:16:12.513 INFO:journalctl@ceph.mon.c.smithi194.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-08-11T12:16:12.513 INFO:journalctl@ceph.mon.c.smithi194.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-08-11T12:16:12.514 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2023-08-11T12:16:12.514 INFO:journalctl@ceph.mon.c.smithi194.stdout: ** Compaction Stats [default] ** 2023-08-11T12:16:12.514 INFO:journalctl@ceph.mon.c.smithi194.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-08-11T12:16:12.514 INFO:journalctl@ceph.mon.c.smithi194.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-08-11T12:16:12.514 INFO:journalctl@ceph.mon.c.smithi194.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-08-11T12:16:12.514 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2023-08-11T12:16:12.514 INFO:journalctl@ceph.mon.c.smithi194.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-08-11T12:16:12.515 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2023-08-11T12:16:12.515 INFO:journalctl@ceph.mon.c.smithi194.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-08-11T12:16:12.515 INFO:journalctl@ceph.mon.c.smithi194.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-08-11T12:16:12.515 INFO:journalctl@ceph.mon.c.smithi194.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-08-11T12:16:12.515 INFO:journalctl@ceph.mon.c.smithi194.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-08-11T12:16:12.515 INFO:journalctl@ceph.mon.c.smithi194.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-08-11T12:16:12.516 INFO:journalctl@ceph.mon.c.smithi194.stdout: AddFile(Keys): cumulative 0, interval 0 2023-08-11T12:16:12.516 INFO:journalctl@ceph.mon.c.smithi194.stdout: Cumulative compaction: 0.00 GB write, 0.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-08-11T12:16:12.516 INFO:journalctl@ceph.mon.c.smithi194.stdout: Interval compaction: 0.00 GB write, 0.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-08-11T12:16:12.516 INFO:journalctl@ceph.mon.c.smithi194.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-08-11T12:16:12.516 INFO:journalctl@ceph.mon.c.smithi194.stdout: Block cache BinnedLRUCache@0x561f16ecd1f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2023-08-11T12:16:12.516 INFO:journalctl@ceph.mon.c.smithi194.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-08-11T12:16:12.516 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2023-08-11T12:16:12.517 INFO:journalctl@ceph.mon.c.smithi194.stdout: ** File Read Latency Histogram By Level [default] ** 2023-08-11T12:16:12.517 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: mon.c does not exist in monmap, will attempt to join an existing cluster 2023-08-11T12:16:12.517 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: using public_addr v2:172.21.15.194:0/0 -> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2023-08-11T12:16:12.517 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: starting mon.c rank -1 at public addrs [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] at bind addrs [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 815f94ae-3840-11ee-9b37-001a4aab830c 2023-08-11T12:16:12.517 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: mon.c@-1(???) e0 preinit fsid 815f94ae-3840-11ee-9b37-001a4aab830c 2023-08-11T12:16:12.517 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: mon.c@-1(synchronizing).mds e1 new map 2023-08-11T12:16:12.517 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: mon.c@-1(synchronizing).mds e1 print_map 2023-08-11T12:16:12.518 INFO:journalctl@ceph.mon.c.smithi194.stdout: e1 2023-08-11T12:16:12.518 INFO:journalctl@ceph.mon.c.smithi194.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-08-11T12:16:12.518 INFO:journalctl@ceph.mon.c.smithi194.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-08-11T12:16:12.518 INFO:journalctl@ceph.mon.c.smithi194.stdout: legacy client fscid: -1 2023-08-11T12:16:12.518 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2023-08-11T12:16:12.518 INFO:journalctl@ceph.mon.c.smithi194.stdout: No filesystems configured 2023-08-11T12:16:12.518 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-08-11T12:16:12.518 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-08-11T12:16:12.519 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-08-11T12:16:12.519 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-08-11T12:16:12.519 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-08-11T12:16:12.519 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-08-11T12:16:12.519 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-08-11T12:16:12.519 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-08-11T12:16:12.519 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-08-11T12:16:12.519 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-08-11T12:16:12.520 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:12.520 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:12.520 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:16:12.520 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:12.520 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:12.520 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:12.520 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:12.521 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:12.521 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi045", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:16:12.521 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:12.521 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:16:12.521 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: Updating smithi045:/etc/ceph/ceph.conf 2023-08-11T12:16:12.521 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: Updating smithi045:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-11T12:16:12.521 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: Updating smithi045:/etc/ceph/ceph.client.admin.keyring 2023-08-11T12:16:12.522 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: Updating smithi045:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-11T12:16:12.522 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:12.522 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:12.522 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:12.522 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi194", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:16:12.522 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: Deploying cephadm binary to smithi194 2023-08-11T12:16:12.522 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:12.523 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:12.523 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: Added host smithi194 2023-08-11T12:16:12.523 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:16:12.523 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:12.523 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:12.523 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:12.523 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:12.523 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:12.524 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:16:12.524 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:12.524 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:12.524 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:12.524 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:12.524 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:12.525 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:16:12.525 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:12.525 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:16:12.525 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: Updating smithi194:/etc/ceph/ceph.conf 2023-08-11T12:16:12.525 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:12.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:12 smithi008 ceph-mon[97158]: from='client.? 172.21.15.194:0/2134116792' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-08-11T12:16:12.822 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:12.823 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:12.823 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: Updating smithi194:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-11T12:16:12.823 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2023-08-11T12:16:12.823 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: Updating smithi194:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-11T12:16:12.823 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/342603041' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-08-11T12:16:12.823 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:12.824 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/342603041' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-08-11T12:16:12.824 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: osdmap e4: 0 total, 0 up, 0 in 2023-08-11T12:16:12.824 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:12.824 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:12.824 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:16:12.825 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:12.825 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:16:12.825 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:12.825 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-11T12:16:12.825 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:12.825 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi008:172.21.15.8=a;smithi045:172.21.15.45=b;smithi194:172.21.15.194=c", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:16:12.825 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: Saving service mon spec with placement smithi008:172.21.15.8=a;smithi045:172.21.15.45=b;smithi194:172.21.15.194=c;count:3 2023-08-11T12:16:12.826 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: Deploying daemon mon.c on smithi194 2023-08-11T12:16:12.826 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:12.826 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-08-11T12:16:12.826 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: expand_channel_meta expand map: {default=false} 2023-08-11T12:16:12.826 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: expand_channel_meta from 'false' to 'false' 2023-08-11T12:16:12.826 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: expand_channel_meta expanded map: {default=false} 2023-08-11T12:16:12.826 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: expand_channel_meta expand map: {default=info} 2023-08-11T12:16:12.826 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: expand_channel_meta from 'info' to 'info' 2023-08-11T12:16:12.827 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: expand_channel_meta expanded map: {default=info} 2023-08-11T12:16:12.827 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: expand_channel_meta expand map: {default=daemon} 2023-08-11T12:16:12.827 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: expand_channel_meta from 'daemon' to 'daemon' 2023-08-11T12:16:12.827 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: expand_channel_meta expanded map: {default=daemon} 2023-08-11T12:16:12.827 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: expand_channel_meta expand map: {default=debug} 2023-08-11T12:16:12.827 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: expand_channel_meta from 'debug' to 'debug' 2023-08-11T12:16:12.827 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: expand_channel_meta expanded map: {default=debug} 2023-08-11T12:16:12.828 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:12 smithi194 ceph-mon[130905]: mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-08-11T12:16:13.853 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-08-11T12:16:13.854 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph mon dump -f json 2023-08-11T12:16:14.417 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.c/config 2023-08-11T12:16:17.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:17 smithi194 ceph-mon[130905]: from='client.? 172.21.15.194:0/2134116792' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-08-11T12:16:17.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:17 smithi194 ceph-mon[130905]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:17.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:17 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-11T12:16:17.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:17 smithi194 ceph-mon[130905]: mon.a calling monitor election 2023-08-11T12:16:17.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:17 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:16:17.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:17 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:16:17.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:17 smithi194 ceph-mon[130905]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:17.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:17 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:16:17.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:17 smithi194 ceph-mon[130905]: mon.c calling monitor election 2023-08-11T12:16:17.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:17 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:16:17.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:17 smithi194 ceph-mon[130905]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:17.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:17 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:16:17.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:17 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:16:17.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:17 smithi194 ceph-mon[130905]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-08-11T12:16:17.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:17 smithi194 ceph-mon[130905]: monmap e2: 2 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],c=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} 2023-08-11T12:16:17.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:17 smithi194 ceph-mon[130905]: fsmap 2023-08-11T12:16:17.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:17 smithi194 ceph-mon[130905]: osdmap e4: 0 total, 0 up, 0 in 2023-08-11T12:16:17.896 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:17 smithi194 ceph-mon[130905]: mgrmap e13: x(active, since 47s) 2023-08-11T12:16:17.896 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:17 smithi194 ceph-mon[130905]: overall HEALTH_OK 2023-08-11T12:16:17.896 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:17 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:17.896 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:17 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:17.896 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:17 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:17.896 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:17 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-11T12:16:17.896 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:17 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:18.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:17 smithi008 ceph-mon[97158]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:18.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:17 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-11T12:16:18.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:17 smithi008 ceph-mon[97158]: mon.a calling monitor election 2023-08-11T12:16:18.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:17 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:16:18.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:17 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:16:18.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:17 smithi008 ceph-mon[97158]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:18.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:17 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:16:18.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:17 smithi008 ceph-mon[97158]: mon.c calling monitor election 2023-08-11T12:16:18.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:17 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:16:18.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:17 smithi008 ceph-mon[97158]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:18.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:17 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:16:18.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:17 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:16:18.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:17 smithi008 ceph-mon[97158]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-08-11T12:16:18.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:17 smithi008 ceph-mon[97158]: monmap e2: 2 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],c=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} 2023-08-11T12:16:18.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:17 smithi008 ceph-mon[97158]: fsmap 2023-08-11T12:16:18.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:17 smithi008 ceph-mon[97158]: osdmap e4: 0 total, 0 up, 0 in 2023-08-11T12:16:18.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:17 smithi008 ceph-mon[97158]: mgrmap e13: x(active, since 47s) 2023-08-11T12:16:18.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:17 smithi008 ceph-mon[97158]: overall HEALTH_OK 2023-08-11T12:16:18.056 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:17 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:18.056 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:17 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:18.056 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:17 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:18.056 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:17 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-11T12:16:18.056 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:17 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:18.509 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.507+0000 7f196c00c700 1 -- 172.21.15.194:0/1067977512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19500035c0 msgr2=0x7f1950005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:18.509 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.507+0000 7f196c00c700 1 --2- 172.21.15.194:0/1067977512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19500035c0 0x7f1950005a50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1964076310 tx=0x7f195400feb0 comp rx=0 tx=0).stop 2023-08-11T12:16:18.510 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.507+0000 7f196c00c700 1 -- 172.21.15.194:0/1067977512 shutdown_connections 2023-08-11T12:16:18.510 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.507+0000 7f196c00c700 1 --2- 172.21.15.194:0/1067977512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19500035c0 0x7f1950005a50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:18.510 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.507+0000 7f196c00c700 1 -- 172.21.15.194:0/1067977512 >> 172.21.15.194:0/1067977512 conn(0x7f1964074ed0 msgr2=0x7f19640752e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:16:18.510 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.508+0000 7f196c00c700 1 -- 172.21.15.194:0/1067977512 shutdown_connections 2023-08-11T12:16:18.510 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.508+0000 7f196c00c700 1 -- 172.21.15.194:0/1067977512 wait complete. 2023-08-11T12:16:18.512 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.508+0000 7f196c00c700 1 Processor -- start 2023-08-11T12:16:18.512 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.508+0000 7f196c00c700 1 -- start start 2023-08-11T12:16:18.512 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.509+0000 7f196c00c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19500035c0 0x7f1964107bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:16:18.512 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.509+0000 7f196c00c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1964108100 0x7f1964108580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:16:18.512 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.509+0000 7f196c00c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1964109b40 con 0x7f1964108100 2023-08-11T12:16:18.513 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.509+0000 7f196c00c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19641a1bd0 con 0x7f19500035c0 2023-08-11T12:16:18.513 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.509+0000 7f1969da8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19500035c0 0x7f1964107bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:16:18.513 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.509+0000 7f1969da8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19500035c0 0x7f1964107bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:40120/0 (socket says 172.21.15.194:40120) 2023-08-11T12:16:18.513 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.509+0000 7f1969da8700 1 -- 172.21.15.194:0/3785096085 learned_addr learned my addr 172.21.15.194:0/3785096085 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-08-11T12:16:18.513 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.509+0000 7f1969da8700 1 -- 172.21.15.194:0/3785096085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19500035c0 msgr2=0x7f1964107bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-08-11T12:16:18.514 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.509+0000 7f1969da8700 1 -- 172.21.15.194:0/3785096085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19500035c0 msgr2=0x7f1964107bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-08-11T12:16:18.514 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.509+0000 7f1969da8700 1 --2- 172.21.15.194:0/3785096085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19500035c0 0x7f1964107bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-11T12:16:18.514 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.509+0000 7f19695a7700 1 --2- 172.21.15.194:0/3785096085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1964108100 0x7f1964108580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:16:18.514 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.509+0000 7f1969da8700 1 --2- 172.21.15.194:0/3785096085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19500035c0 0x7f1964107bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-11T12:16:18.514 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.509+0000 7f19695a7700 1 -- 172.21.15.194:0/3785096085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19500035c0 msgr2=0x7f1964107bc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-11T12:16:18.514 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.509+0000 7f19695a7700 1 --2- 172.21.15.194:0/3785096085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19500035c0 0x7f1964107bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:18.515 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.509+0000 7f19695a7700 1 -- 172.21.15.194:0/3785096085 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195400f900 con 0x7f1964108100 2023-08-11T12:16:18.515 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.510+0000 7f19695a7700 1 --2- 172.21.15.194:0/3785096085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1964108100 0x7f1964108580 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f196000b4d0 tx=0x7f196000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:16:18.515 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.510+0000 7f195affd700 1 -- 172.21.15.194:0/3785096085 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f1960011630 con 0x7f1964108100 2023-08-11T12:16:18.515 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.510+0000 7f196c00c700 1 -- 172.21.15.194:0/3785096085 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19641a1dd0 con 0x7f1964108100 2023-08-11T12:16:18.515 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.510+0000 7f195affd700 1 -- 172.21.15.194:0/3785096085 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1960011c50 con 0x7f1964108100 2023-08-11T12:16:18.515 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.510+0000 7f195affd700 1 -- 172.21.15.194:0/3785096085 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f1960010d90 con 0x7f1964108100 2023-08-11T12:16:18.515 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.510+0000 7f196c00c700 1 -- 172.21.15.194:0/3785096085 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19641a22a0 con 0x7f1964108100 2023-08-11T12:16:18.517 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.511+0000 7f195affd700 1 -- 172.21.15.194:0/3785096085 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45190+0+0 (secure 0 0 0) 0x7f196001a400 con 0x7f1964108100 2023-08-11T12:16:18.517 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.511+0000 7f195affd700 1 --2- 172.21.15.194:0/3785096085 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f1948037ff0 0x7f194803a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:16:18.517 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.511+0000 7f196c00c700 1 -- 172.21.15.194:0/3785096085 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1964061f50 con 0x7f1964108100 2023-08-11T12:16:18.518 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.511+0000 7f195affd700 1 -- 172.21.15.194:0/3785096085 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f196004a630 con 0x7f1964108100 2023-08-11T12:16:18.518 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.512+0000 7f1969da8700 1 --2- 172.21.15.194:0/3785096085 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f1948037ff0 0x7f194803a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:16:18.518 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.512+0000 7f1969da8700 1 --2- 172.21.15.194:0/3785096085 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f1948037ff0 0x7f194803a4b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1954005b40 tx=0x7f1954005a90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:16:18.518 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.517+0000 7f195affd700 1 -- 172.21.15.194:0/3785096085 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f19600178b0 con 0x7f1964108100 2023-08-11T12:16:18.785 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.784+0000 7f196c00c700 1 -- 172.21.15.194:0/3785096085 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1964107400 con 0x7f1964108100 2023-08-11T12:16:18.786 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.784+0000 7f195affd700 1 -- 172.21.15.194:0/3785096085 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1002 (secure 0 0 0) 0x7f1964107400 con 0x7f1964108100 2023-08-11T12:16:18.787 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-08-11T12:16:18.787 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":2,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","modified":"2023-08-11T12:16:12.479584Z","created":"2023-08-11T12:14:24.688999Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-08-11T12:16:18.788 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.786+0000 7f196c00c700 1 -- 172.21.15.194:0/3785096085 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f1948037ff0 msgr2=0x7f194803a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:18.788 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.786+0000 7f196c00c700 1 --2- 172.21.15.194:0/3785096085 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f1948037ff0 0x7f194803a4b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1954005b40 tx=0x7f1954005a90 comp rx=0 tx=0).stop 2023-08-11T12:16:18.788 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.786+0000 7f196c00c700 1 -- 172.21.15.194:0/3785096085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1964108100 msgr2=0x7f1964108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:18.789 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.787+0000 7f196c00c700 1 --2- 172.21.15.194:0/3785096085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1964108100 0x7f1964108580 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f196000b4d0 tx=0x7f196000b890 comp rx=0 tx=0).stop 2023-08-11T12:16:18.789 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.787+0000 7f196c00c700 1 -- 172.21.15.194:0/3785096085 shutdown_connections 2023-08-11T12:16:18.789 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.787+0000 7f196c00c700 1 --2- 172.21.15.194:0/3785096085 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f1948037ff0 0x7f194803a4b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:18.789 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.787+0000 7f196c00c700 1 --2- 172.21.15.194:0/3785096085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19500035c0 0x7f1964107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:18.789 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.787+0000 7f196c00c700 1 --2- 172.21.15.194:0/3785096085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1964108100 0x7f1964108580 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:18.789 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.787+0000 7f196c00c700 1 -- 172.21.15.194:0/3785096085 >> 172.21.15.194:0/3785096085 conn(0x7f1964074ed0 msgr2=0x7f1964102f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:16:18.790 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.787+0000 7f196c00c700 1 -- 172.21.15.194:0/3785096085 shutdown_connections 2023-08-11T12:16:18.790 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:18.787+0000 7f196c00c700 1 -- 172.21.15.194:0/3785096085 wait complete. 2023-08-11T12:16:18.790 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 2 2023-08-11T12:16:18.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:18 smithi194 ceph-mon[130905]: Deploying daemon mon.b on smithi045 2023-08-11T12:16:18.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:18 smithi194 ceph-mon[130905]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:18.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:18 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:16:19.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:18 smithi008 ceph-mon[97158]: Deploying daemon mon.b on smithi045 2023-08-11T12:16:19.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:18 smithi008 ceph-mon[97158]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:19.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:18 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:16:19.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:19 smithi194 ceph-mon[130905]: from='client.? 172.21.15.194:0/3785096085' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-08-11T12:16:20.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:19 smithi008 ceph-mon[97158]: from='client.? 172.21.15.194:0/3785096085' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-08-11T12:16:20.182 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-08-11T12:16:20.182 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph mon dump -f json 2023-08-11T12:16:20.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 systemd[1]: Starting Ceph mon.b for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:16:20.715 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 podman[130243]: 2023-08-11T12:16:20.716 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 bash[130243]: fc53258bbff5886dd24335075c8a60583fb972f64bb74993383a85ce88c28e94 2023-08-11T12:16:20.716 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: set uid:gid to 167:167 (ceph:ceph) 2023-08-11T12:16:20.716 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: ceph version 18.0.0-5437-g92684807 (92684807f016ce045ac66e37fdde6f8c47857bcc) reef (dev), process ceph-mon, pid 7 2023-08-11T12:16:20.716 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: pidfile_write: ignore empty --pid-file 2023-08-11T12:16:20.716 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: load: jerasure load: lrc 2023-08-11T12:16:20.716 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: RocksDB version: 7.9.2 2023-08-11T12:16:20.716 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Git sha 0 2023-08-11T12:16:20.717 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Compile date 2023-08-10 15:31:53 2023-08-11T12:16:20.717 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: DB SUMMARY 2023-08-11T12:16:20.717 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: DB Session ID: FBJDMA9LNN038UZMP9K2 2023-08-11T12:16:20.717 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: CURRENT file: CURRENT 2023-08-11T12:16:20.717 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: IDENTITY file: IDENTITY 2023-08-11T12:16:20.717 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-08-11T12:16:20.717 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-08-11T12:16:20.718 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-08-11T12:16:20.718 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.error_if_exists: 0 2023-08-11T12:16:20.718 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.create_if_missing: 0 2023-08-11T12:16:20.718 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.paranoid_checks: 1 2023-08-11T12:16:20.718 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.flush_verify_memtable_count: 1 2023-08-11T12:16:20.718 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-08-11T12:16:20.718 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-08-11T12:16:20.719 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.env: 0x5576723d7da0 2023-08-11T12:16:20.719 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.fs: PosixFileSystem 2023-08-11T12:16:20.719 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.info_log: 0x5576746b7460 2023-08-11T12:16:20.719 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.max_file_opening_threads: 16 2023-08-11T12:16:20.719 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.statistics: (nil) 2023-08-11T12:16:20.719 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.use_fsync: 0 2023-08-11T12:16:20.720 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.max_log_file_size: 0 2023-08-11T12:16:20.720 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-08-11T12:16:20.720 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.log_file_time_to_roll: 0 2023-08-11T12:16:20.720 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.keep_log_file_num: 1000 2023-08-11T12:16:20.720 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.recycle_log_file_num: 0 2023-08-11T12:16:20.720 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.allow_fallocate: 1 2023-08-11T12:16:20.720 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.allow_mmap_reads: 0 2023-08-11T12:16:20.720 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.allow_mmap_writes: 0 2023-08-11T12:16:20.721 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.use_direct_reads: 0 2023-08-11T12:16:20.721 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-08-11T12:16:20.721 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.create_missing_column_families: 0 2023-08-11T12:16:20.721 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.db_log_dir: 2023-08-11T12:16:20.721 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.wal_dir: 2023-08-11T12:16:20.721 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.table_cache_numshardbits: 6 2023-08-11T12:16:20.721 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.WAL_ttl_seconds: 0 2023-08-11T12:16:20.722 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.WAL_size_limit_MB: 0 2023-08-11T12:16:20.722 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-08-11T12:16:20.722 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-08-11T12:16:20.722 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.is_fd_close_on_exec: 1 2023-08-11T12:16:20.723 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.advise_random_on_open: 1 2023-08-11T12:16:20.723 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.db_write_buffer_size: 0 2023-08-11T12:16:20.723 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.write_buffer_manager: 0x5576746703c0 2023-08-11T12:16:20.723 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-08-11T12:16:20.724 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-08-11T12:16:20.724 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.use_adaptive_mutex: 0 2023-08-11T12:16:20.724 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.rate_limiter: (nil) 2023-08-11T12:16:20.724 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-08-11T12:16:20.724 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.wal_recovery_mode: 2 2023-08-11T12:16:20.724 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.enable_thread_tracking: 0 2023-08-11T12:16:20.724 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.enable_pipelined_write: 0 2023-08-11T12:16:20.724 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.unordered_write: 0 2023-08-11T12:16:20.725 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-08-11T12:16:20.725 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-08-11T12:16:20.725 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-08-11T12:16:20.725 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-08-11T12:16:20.726 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.row_cache: None 2023-08-11T12:16:20.726 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.wal_filter: None 2023-08-11T12:16:20.726 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-08-11T12:16:20.726 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.allow_ingest_behind: 0 2023-08-11T12:16:20.726 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.two_write_queues: 0 2023-08-11T12:16:20.726 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.manual_wal_flush: 0 2023-08-11T12:16:20.726 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.wal_compression: 0 2023-08-11T12:16:20.727 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.atomic_flush: 0 2023-08-11T12:16:20.727 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-08-11T12:16:20.727 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.persist_stats_to_disk: 0 2023-08-11T12:16:20.727 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.write_dbid_to_manifest: 0 2023-08-11T12:16:20.727 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.log_readahead_size: 0 2023-08-11T12:16:20.727 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-08-11T12:16:20.728 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.best_efforts_recovery: 0 2023-08-11T12:16:20.728 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-08-11T12:16:20.728 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-08-11T12:16:20.728 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.allow_data_in_errors: 0 2023-08-11T12:16:20.728 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.db_host_id: __hostname__ 2023-08-11T12:16:20.728 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.enforce_single_del_contracts: true 2023-08-11T12:16:20.728 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.max_background_jobs: 2 2023-08-11T12:16:20.729 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.max_background_compactions: -1 2023-08-11T12:16:20.729 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.max_subcompactions: 1 2023-08-11T12:16:20.729 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-08-11T12:16:20.729 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-08-11T12:16:20.729 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.delayed_write_rate : 16777216 2023-08-11T12:16:20.729 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.max_total_wal_size: 0 2023-08-11T12:16:20.729 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-08-11T12:16:20.729 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.stats_dump_period_sec: 600 2023-08-11T12:16:20.730 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.stats_persist_period_sec: 600 2023-08-11T12:16:20.730 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-08-11T12:16:20.730 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.max_open_files: -1 2023-08-11T12:16:20.730 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.bytes_per_sync: 0 2023-08-11T12:16:20.730 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.wal_bytes_per_sync: 0 2023-08-11T12:16:20.730 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.strict_bytes_per_sync: 0 2023-08-11T12:16:20.730 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.compaction_readahead_size: 0 2023-08-11T12:16:20.730 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.max_background_flushes: -1 2023-08-11T12:16:20.731 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Compression algorithms supported: 2023-08-11T12:16:20.731 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-08-11T12:16:20.731 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: kZSTD supported: 0 2023-08-11T12:16:20.731 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: kXpressCompression supported: 0 2023-08-11T12:16:20.731 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: kLZ4HCCompression supported: 1 2023-08-11T12:16:20.731 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: kZlibCompression supported: 1 2023-08-11T12:16:20.731 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: kSnappyCompression supported: 1 2023-08-11T12:16:20.731 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: kLZ4Compression supported: 1 2023-08-11T12:16:20.732 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: kBZip2Compression supported: 0 2023-08-11T12:16:20.732 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Fast CRC32 supported: Supported on x86 2023-08-11T12:16:20.732 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: DMutex implementation: pthread_mutex_t 2023-08-11T12:16:20.732 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-08-11T12:16:20.732 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-08-11T12:16:20.732 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-08-11T12:16:20.732 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.merge_operator: 2023-08-11T12:16:20.733 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.compaction_filter: None 2023-08-11T12:16:20.733 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.compaction_filter_factory: None 2023-08-11T12:16:20.733 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.sst_partitioner_factory: None 2023-08-11T12:16:20.733 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.memtable_factory: SkipListFactory 2023-08-11T12:16:20.734 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.table_factory: BlockBasedTable 2023-08-11T12:16:20.734 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5576746b7560) 2023-08-11T12:16:20.734 INFO:journalctl@ceph.mon.b.smithi045.stdout: cache_index_and_filter_blocks: 1 2023-08-11T12:16:20.734 INFO:journalctl@ceph.mon.b.smithi045.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-08-11T12:16:20.734 INFO:journalctl@ceph.mon.b.smithi045.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-08-11T12:16:20.734 INFO:journalctl@ceph.mon.b.smithi045.stdout: pin_top_level_index_and_filter: 1 2023-08-11T12:16:20.734 INFO:journalctl@ceph.mon.b.smithi045.stdout: index_type: 0 2023-08-11T12:16:20.734 INFO:journalctl@ceph.mon.b.smithi045.stdout: data_block_index_type: 0 2023-08-11T12:16:20.735 INFO:journalctl@ceph.mon.b.smithi045.stdout: index_shortening: 1 2023-08-11T12:16:20.735 INFO:journalctl@ceph.mon.b.smithi045.stdout: data_block_hash_table_util_ratio: 0.750000 2023-08-11T12:16:20.735 INFO:journalctl@ceph.mon.b.smithi045.stdout: checksum: 4 2023-08-11T12:16:20.735 INFO:journalctl@ceph.mon.b.smithi045.stdout: no_block_cache: 0 2023-08-11T12:16:20.735 INFO:journalctl@ceph.mon.b.smithi045.stdout: block_cache: 0x55767470f1f0 2023-08-11T12:16:20.735 INFO:journalctl@ceph.mon.b.smithi045.stdout: block_cache_name: BinnedLRUCache 2023-08-11T12:16:20.735 INFO:journalctl@ceph.mon.b.smithi045.stdout: block_cache_options: 2023-08-11T12:16:20.736 INFO:journalctl@ceph.mon.b.smithi045.stdout: capacity : 536870912 2023-08-11T12:16:20.736 INFO:journalctl@ceph.mon.b.smithi045.stdout: num_shard_bits : 4 2023-08-11T12:16:20.736 INFO:journalctl@ceph.mon.b.smithi045.stdout: strict_capacity_limit : 0 2023-08-11T12:16:20.736 INFO:journalctl@ceph.mon.b.smithi045.stdout: high_pri_pool_ratio: 0.000 2023-08-11T12:16:20.736 INFO:journalctl@ceph.mon.b.smithi045.stdout: block_cache_compressed: (nil) 2023-08-11T12:16:20.736 INFO:journalctl@ceph.mon.b.smithi045.stdout: persistent_cache: (nil) 2023-08-11T12:16:20.736 INFO:journalctl@ceph.mon.b.smithi045.stdout: block_size: 4096 2023-08-11T12:16:20.736 INFO:journalctl@ceph.mon.b.smithi045.stdout: block_size_deviation: 10 2023-08-11T12:16:20.737 INFO:journalctl@ceph.mon.b.smithi045.stdout: block_restart_interval: 16 2023-08-11T12:16:20.737 INFO:journalctl@ceph.mon.b.smithi045.stdout: index_block_restart_interval: 1 2023-08-11T12:16:20.737 INFO:journalctl@ceph.mon.b.smithi045.stdout: metadata_block_size: 4096 2023-08-11T12:16:20.737 INFO:journalctl@ceph.mon.b.smithi045.stdout: partition_filters: 0 2023-08-11T12:16:20.737 INFO:journalctl@ceph.mon.b.smithi045.stdout: use_delta_encoding: 1 2023-08-11T12:16:20.737 INFO:journalctl@ceph.mon.b.smithi045.stdout: filter_policy: bloomfilter 2023-08-11T12:16:20.737 INFO:journalctl@ceph.mon.b.smithi045.stdout: whole_key_filtering: 1 2023-08-11T12:16:20.738 INFO:journalctl@ceph.mon.b.smithi045.stdout: verify_compression: 0 2023-08-11T12:16:20.738 INFO:journalctl@ceph.mon.b.smithi045.stdout: read_amp_bytes_per_bit: 0 2023-08-11T12:16:20.738 INFO:journalctl@ceph.mon.b.smithi045.stdout: format_version: 5 2023-08-11T12:16:20.738 INFO:journalctl@ceph.mon.b.smithi045.stdout: enable_index_compression: 1 2023-08-11T12:16:20.738 INFO:journalctl@ceph.mon.b.smithi045.stdout: block_align: 0 2023-08-11T12:16:20.738 INFO:journalctl@ceph.mon.b.smithi045.stdout: max_auto_readahead_size: 262144 2023-08-11T12:16:20.738 INFO:journalctl@ceph.mon.b.smithi045.stdout: prepopulate_block_cache: 0 2023-08-11T12:16:20.739 INFO:journalctl@ceph.mon.b.smithi045.stdout: initial_auto_readahead_size: 8192 2023-08-11T12:16:20.739 INFO:journalctl@ceph.mon.b.smithi045.stdout: num_file_reads_for_auto_readahead: 2 2023-08-11T12:16:20.739 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.write_buffer_size: 33554432 2023-08-11T12:16:20.739 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.max_write_buffer_number: 2 2023-08-11T12:16:20.739 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.compression: NoCompression 2023-08-11T12:16:20.739 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.bottommost_compression: Disabled 2023-08-11T12:16:20.739 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.prefix_extractor: nullptr 2023-08-11T12:16:20.739 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-08-11T12:16:20.740 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.num_levels: 7 2023-08-11T12:16:20.740 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-08-11T12:16:20.740 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-08-11T12:16:20.740 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-08-11T12:16:20.740 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-08-11T12:16:20.740 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-08-11T12:16:20.740 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-08-11T12:16:20.742 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-08-11T12:16:20.742 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-08-11T12:16:20.742 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-08-11T12:16:20.742 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-08-11T12:16:20.742 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-08-11T12:16:20.742 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-08-11T12:16:20.742 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.compression_opts.window_bits: -14 2023-08-11T12:16:20.743 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.compression_opts.level: 32767 2023-08-11T12:16:20.743 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.compression_opts.strategy: 0 2023-08-11T12:16:20.743 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-08-11T12:16:20.743 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-08-11T12:16:20.743 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-08-11T12:16:20.743 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-08-11T12:16:20.743 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.compression_opts.enabled: false 2023-08-11T12:16:20.744 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-08-11T12:16:20.744 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-08-11T12:16:20.744 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-08-11T12:16:20.744 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-08-11T12:16:20.744 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.target_file_size_base: 67108864 2023-08-11T12:16:20.744 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.target_file_size_multiplier: 1 2023-08-11T12:16:20.744 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-08-11T12:16:20.744 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-08-11T12:16:20.745 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-08-11T12:16:20.745 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-08-11T12:16:20.745 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-08-11T12:16:20.745 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-08-11T12:16:20.745 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-08-11T12:16:20.745 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-08-11T12:16:20.745 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-08-11T12:16:20.746 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-08-11T12:16:20.746 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-08-11T12:16:20.746 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-08-11T12:16:20.746 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-08-11T12:16:20.746 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.arena_block_size: 1048576 2023-08-11T12:16:20.746 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-08-11T12:16:20.746 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-08-11T12:16:20.746 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.disable_auto_compactions: 0 2023-08-11T12:16:20.747 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-08-11T12:16:20.747 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-08-11T12:16:20.747 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-08-11T12:16:20.747 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-08-11T12:16:20.747 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-08-11T12:16:20.747 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-08-11T12:16:20.747 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-08-11T12:16:20.748 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-08-11T12:16:20.748 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-08-11T12:16:20.748 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-08-11T12:16:20.748 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.table_properties_collectors: 2023-08-11T12:16:20.748 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.inplace_update_support: 0 2023-08-11T12:16:20.748 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.inplace_update_num_locks: 10000 2023-08-11T12:16:20.748 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-08-11T12:16:20.749 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-08-11T12:16:20.749 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.memtable_huge_page_size: 0 2023-08-11T12:16:20.749 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.bloom_locality: 0 2023-08-11T12:16:20.749 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.max_successive_merges: 0 2023-08-11T12:16:20.749 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.optimize_filters_for_hits: 0 2023-08-11T12:16:20.749 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.paranoid_file_checks: 0 2023-08-11T12:16:20.749 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.force_consistency_checks: 1 2023-08-11T12:16:20.749 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.report_bg_io_stats: 0 2023-08-11T12:16:20.750 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.ttl: 2592000 2023-08-11T12:16:20.750 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.periodic_compaction_seconds: 0 2023-08-11T12:16:20.750 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-08-11T12:16:20.750 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-08-11T12:16:20.750 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.enable_blob_files: false 2023-08-11T12:16:20.750 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.min_blob_size: 0 2023-08-11T12:16:20.750 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.blob_file_size: 268435456 2023-08-11T12:16:20.750 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.blob_compression_type: NoCompression 2023-08-11T12:16:20.751 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.enable_blob_garbage_collection: false 2023-08-11T12:16:20.751 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-08-11T12:16:20.751 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-08-11T12:16:20.751 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-08-11T12:16:20.751 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.blob_file_starting_level: 0 2023-08-11T12:16:20.751 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-08-11T12:16:20.751 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-08-11T12:16:20.752 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-08-11T12:16:20.752 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 858684fb-636c-4b56-a9b2-b60c5bad8f28 2023-08-11T12:16:20.752 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: EVENT_LOG_v1 {"time_micros": 1691756180644883, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-08-11T12:16:20.752 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-08-11T12:16:20.752 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: EVENT_LOG_v1 {"time_micros": 1691756180645302, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1691756180, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "858684fb-636c-4b56-a9b2-b60c5bad8f28", "db_session_id": "FBJDMA9LNN038UZMP9K2", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-08-11T12:16:20.752 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: EVENT_LOG_v1 {"time_micros": 1691756180645371, "job": 1, "event": "recovery_finished"} 2023-08-11T12:16:20.753 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-08-11T12:16:20.753 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-08-11T12:16:20.753 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5576747ac000 2023-08-11T12:16:20.753 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: DB pointer 0x557674798000 2023-08-11T12:16:20.753 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-08-11T12:16:20.753 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-08-11T12:16:20.753 INFO:journalctl@ceph.mon.b.smithi045.stdout: ** DB Stats ** 2023-08-11T12:16:20.754 INFO:journalctl@ceph.mon.b.smithi045.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-08-11T12:16:20.754 INFO:journalctl@ceph.mon.b.smithi045.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-08-11T12:16:20.754 INFO:journalctl@ceph.mon.b.smithi045.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-08-11T12:16:20.754 INFO:journalctl@ceph.mon.b.smithi045.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-08-11T12:16:20.754 INFO:journalctl@ceph.mon.b.smithi045.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-08-11T12:16:20.754 INFO:journalctl@ceph.mon.b.smithi045.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-08-11T12:16:20.754 INFO:journalctl@ceph.mon.b.smithi045.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-08-11T12:16:20.754 INFO:journalctl@ceph.mon.b.smithi045.stdout: 2023-08-11T12:16:20.755 INFO:journalctl@ceph.mon.b.smithi045.stdout: ** Compaction Stats [default] ** 2023-08-11T12:16:20.755 INFO:journalctl@ceph.mon.b.smithi045.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-08-11T12:16:20.755 INFO:journalctl@ceph.mon.b.smithi045.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-08-11T12:16:20.755 INFO:journalctl@ceph.mon.b.smithi045.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-08-11T12:16:20.755 INFO:journalctl@ceph.mon.b.smithi045.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-08-11T12:16:20.755 INFO:journalctl@ceph.mon.b.smithi045.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-08-11T12:16:20.755 INFO:journalctl@ceph.mon.b.smithi045.stdout: 2023-08-11T12:16:20.755 INFO:journalctl@ceph.mon.b.smithi045.stdout: ** Compaction Stats [default] ** 2023-08-11T12:16:20.756 INFO:journalctl@ceph.mon.b.smithi045.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-08-11T12:16:20.756 INFO:journalctl@ceph.mon.b.smithi045.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-08-11T12:16:20.756 INFO:journalctl@ceph.mon.b.smithi045.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-08-11T12:16:20.756 INFO:journalctl@ceph.mon.b.smithi045.stdout: 2023-08-11T12:16:20.756 INFO:journalctl@ceph.mon.b.smithi045.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-08-11T12:16:20.756 INFO:journalctl@ceph.mon.b.smithi045.stdout: 2023-08-11T12:16:20.757 INFO:journalctl@ceph.mon.b.smithi045.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-08-11T12:16:20.757 INFO:journalctl@ceph.mon.b.smithi045.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-08-11T12:16:20.757 INFO:journalctl@ceph.mon.b.smithi045.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-08-11T12:16:20.757 INFO:journalctl@ceph.mon.b.smithi045.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-08-11T12:16:20.757 INFO:journalctl@ceph.mon.b.smithi045.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-08-11T12:16:20.757 INFO:journalctl@ceph.mon.b.smithi045.stdout: AddFile(Keys): cumulative 0, interval 0 2023-08-11T12:16:20.757 INFO:journalctl@ceph.mon.b.smithi045.stdout: Cumulative compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-08-11T12:16:20.757 INFO:journalctl@ceph.mon.b.smithi045.stdout: Interval compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-08-11T12:16:20.758 INFO:journalctl@ceph.mon.b.smithi045.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-08-11T12:16:20.758 INFO:journalctl@ceph.mon.b.smithi045.stdout: Block cache BinnedLRUCache@0x55767470f1f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2023-08-11T12:16:20.758 INFO:journalctl@ceph.mon.b.smithi045.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-08-11T12:16:20.758 INFO:journalctl@ceph.mon.b.smithi045.stdout: 2023-08-11T12:16:20.758 INFO:journalctl@ceph.mon.b.smithi045.stdout: ** File Read Latency Histogram By Level [default] ** 2023-08-11T12:16:20.758 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-08-11T12:16:20.758 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: using public_addr v2:172.21.15.45:0/0 -> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] 2023-08-11T12:16:20.759 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: starting mon.b rank -1 at public addrs [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] at bind addrs [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 815f94ae-3840-11ee-9b37-001a4aab830c 2023-08-11T12:16:20.759 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: mon.b@-1(???) e0 preinit fsid 815f94ae-3840-11ee-9b37-001a4aab830c 2023-08-11T12:16:20.759 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: mon.b@-1(synchronizing).mds e1 new map 2023-08-11T12:16:20.759 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: mon.b@-1(synchronizing).mds e1 print_map 2023-08-11T12:16:20.759 INFO:journalctl@ceph.mon.b.smithi045.stdout: e1 2023-08-11T12:16:20.759 INFO:journalctl@ceph.mon.b.smithi045.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-08-11T12:16:20.759 INFO:journalctl@ceph.mon.b.smithi045.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-08-11T12:16:20.759 INFO:journalctl@ceph.mon.b.smithi045.stdout: legacy client fscid: -1 2023-08-11T12:16:20.760 INFO:journalctl@ceph.mon.b.smithi045.stdout: 2023-08-11T12:16:20.760 INFO:journalctl@ceph.mon.b.smithi045.stdout: No filesystems configured 2023-08-11T12:16:20.760 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-08-11T12:16:20.760 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-08-11T12:16:20.760 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-08-11T12:16:20.760 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-08-11T12:16:20.760 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-08-11T12:16:20.761 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-08-11T12:16:20.761 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-08-11T12:16:20.761 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-08-11T12:16:20.761 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-08-11T12:16:20.761 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-08-11T12:16:20.761 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:20.761 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:20.761 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:16:20.762 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:20.762 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:20.762 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:20.762 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:20.762 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:20.762 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi045", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:16:20.762 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:20.762 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:16:20.763 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: Updating smithi045:/etc/ceph/ceph.conf 2023-08-11T12:16:20.763 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: Updating smithi045:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-11T12:16:20.763 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: Updating smithi045:/etc/ceph/ceph.client.admin.keyring 2023-08-11T12:16:20.763 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: Updating smithi045:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-11T12:16:20.763 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:20.763 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:20.763 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:20.763 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi194", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:16:20.764 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: Deploying cephadm binary to smithi194 2023-08-11T12:16:20.764 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:20.764 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:20.764 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: Added host smithi194 2023-08-11T12:16:20.764 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:16:20.765 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:20.765 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:20.765 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:20.765 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:20.765 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:20.765 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:16:20.765 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:20.765 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:20.766 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:20.766 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:20.766 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:20.766 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:16:20.766 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:20.766 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:16:20.766 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: Updating smithi194:/etc/ceph/ceph.conf 2023-08-11T12:16:20.767 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:20.767 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:20.767 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:20.767 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: Updating smithi194:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-11T12:16:20.767 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2023-08-11T12:16:20.767 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: Updating smithi194:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-11T12:16:20.767 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/342603041' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-08-11T12:16:20.767 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:20.768 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/342603041' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-08-11T12:16:20.768 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: osdmap e4: 0 total, 0 up, 0 in 2023-08-11T12:16:20.768 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:20.768 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:20.768 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:16:20.768 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:20.768 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:16:20.769 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:20.769 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-11T12:16:20.769 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:20.769 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi008:172.21.15.8=a;smithi045:172.21.15.45=b;smithi194:172.21.15.194=c", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:16:20.769 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: Saving service mon spec with placement smithi008:172.21.15.8=a;smithi045:172.21.15.45=b;smithi194:172.21.15.194=c;count:3 2023-08-11T12:16:20.769 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: Deploying daemon mon.c on smithi194 2023-08-11T12:16:20.769 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:20.769 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='client.? 172.21.15.194:0/2134116792' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-08-11T12:16:20.770 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:20.770 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-11T12:16:20.770 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: mon.a calling monitor election 2023-08-11T12:16:20.770 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:16:20.770 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:16:20.770 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:20.770 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:16:20.771 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: mon.c calling monitor election 2023-08-11T12:16:20.771 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:16:20.771 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:20.771 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:16:20.771 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:16:20.771 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-08-11T12:16:20.771 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: monmap e2: 2 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],c=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} 2023-08-11T12:16:20.771 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: fsmap 2023-08-11T12:16:20.772 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: osdmap e4: 0 total, 0 up, 0 in 2023-08-11T12:16:20.772 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: mgrmap e13: x(active, since 47s) 2023-08-11T12:16:20.772 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: overall HEALTH_OK 2023-08-11T12:16:20.772 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:20.772 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:20.772 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:20.772 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-11T12:16:20.772 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:20.773 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: Deploying daemon mon.b on smithi045 2023-08-11T12:16:20.773 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:20.773 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:16:20.773 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: from='client.? 172.21.15.194:0/3785096085' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-08-11T12:16:20.773 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:20.773 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-08-11T12:16:20.774 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2023-08-11T12:16:20.774 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: expand_channel_meta expand map: {default=false} 2023-08-11T12:16:20.774 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: expand_channel_meta from 'false' to 'false' 2023-08-11T12:16:20.774 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: expand_channel_meta expanded map: {default=false} 2023-08-11T12:16:20.774 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: expand_channel_meta expand map: {default=info} 2023-08-11T12:16:20.774 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: expand_channel_meta from 'info' to 'info' 2023-08-11T12:16:20.774 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: expand_channel_meta expanded map: {default=info} 2023-08-11T12:16:20.775 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: expand_channel_meta expand map: {default=daemon} 2023-08-11T12:16:20.775 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: expand_channel_meta from 'daemon' to 'daemon' 2023-08-11T12:16:20.775 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: expand_channel_meta expanded map: {default=daemon} 2023-08-11T12:16:20.775 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: expand_channel_meta expand map: {default=debug} 2023-08-11T12:16:20.775 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: expand_channel_meta from 'debug' to 'debug' 2023-08-11T12:16:20.775 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 ceph-mon[130284]: expand_channel_meta expanded map: {default=debug} 2023-08-11T12:16:20.775 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:20 smithi045 systemd[1]: Started Ceph mon.b for 815f94ae-3840-11ee-9b37-001a4aab830c. 2023-08-11T12:16:20.776 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.c/config 2023-08-11T12:16:20.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:20 smithi194 ceph-mon[130905]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:21.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:20 smithi008 ceph-mon[97158]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:26.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:25 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-11T12:16:26.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:25 smithi008 ceph-mon[97158]: mon.a calling monitor election 2023-08-11T12:16:26.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:25 smithi008 ceph-mon[97158]: mon.c calling monitor election 2023-08-11T12:16:26.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:25 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:16:26.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:25 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:16:26.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:25 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:16:26.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:25 smithi008 ceph-mon[97158]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:26.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:25 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:16:26.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:25 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:16:26.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:25 smithi008 ceph-mon[97158]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:26.056 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:25 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:16:26.056 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:25 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:16:26.056 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:25 smithi008 ceph-mon[97158]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-08-11T12:16:26.056 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:25 smithi008 ceph-mon[97158]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0],c=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} 2023-08-11T12:16:26.057 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:25 smithi008 ceph-mon[97158]: fsmap 2023-08-11T12:16:26.057 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:25 smithi008 ceph-mon[97158]: osdmap e4: 0 total, 0 up, 0 in 2023-08-11T12:16:26.057 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:25 smithi008 ceph-mon[97158]: mgrmap e13: x(active, since 55s) 2023-08-11T12:16:26.057 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:25 smithi008 ceph-mon[97158]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-08-11T12:16:26.058 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:25 smithi008 ceph-mon[97158]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-08-11T12:16:26.058 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:25 smithi008 ceph-mon[97158]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-08-11T12:16:26.058 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:25 smithi008 ceph-mon[97158]: mon.b (rank 2) addr [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] is down (out of quorum) 2023-08-11T12:16:26.058 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:25 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:26.059 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:25 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:26.059 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:25 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:26.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:25 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-11T12:16:26.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:25 smithi194 ceph-mon[130905]: mon.a calling monitor election 2023-08-11T12:16:26.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:25 smithi194 ceph-mon[130905]: mon.c calling monitor election 2023-08-11T12:16:26.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:25 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:16:26.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:25 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:16:26.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:25 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:16:26.146 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:25 smithi194 ceph-mon[130905]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:26.146 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:25 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:16:26.146 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:25 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:16:26.146 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:25 smithi194 ceph-mon[130905]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:26.146 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:25 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:16:26.146 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:25 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:16:26.146 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:25 smithi194 ceph-mon[130905]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-08-11T12:16:26.147 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:25 smithi194 ceph-mon[130905]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0],c=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} 2023-08-11T12:16:26.147 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:25 smithi194 ceph-mon[130905]: fsmap 2023-08-11T12:16:26.147 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:25 smithi194 ceph-mon[130905]: osdmap e4: 0 total, 0 up, 0 in 2023-08-11T12:16:26.147 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:25 smithi194 ceph-mon[130905]: mgrmap e13: x(active, since 55s) 2023-08-11T12:16:26.147 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:25 smithi194 ceph-mon[130905]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-08-11T12:16:26.147 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:25 smithi194 ceph-mon[130905]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-08-11T12:16:26.147 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:25 smithi194 ceph-mon[130905]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-08-11T12:16:26.147 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:25 smithi194 ceph-mon[130905]: mon.b (rank 2) addr [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] is down (out of quorum) 2023-08-11T12:16:26.148 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:25 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:26.148 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:25 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:26.148 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:25 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:26.242 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.239+0000 7fe1ac1fb700 1 -- 172.21.15.194:0/1215949931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1900035c0 msgr2=0x7fe190005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:26.243 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.239+0000 7fe1ac1fb700 1 --2- 172.21.15.194:0/1215949931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1900035c0 0x7fe190005a50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4076310 tx=0x7fe19400fe60 comp rx=0 tx=0).stop 2023-08-11T12:16:26.243 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.239+0000 7fe1ac1fb700 1 -- 172.21.15.194:0/1215949931 shutdown_connections 2023-08-11T12:16:26.243 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.239+0000 7fe1ac1fb700 1 --2- 172.21.15.194:0/1215949931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1900035c0 0x7fe190005a50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:26.243 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.239+0000 7fe1ac1fb700 1 -- 172.21.15.194:0/1215949931 >> 172.21.15.194:0/1215949931 conn(0x7fe1a4074ed0 msgr2=0x7fe1a40752e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:16:26.243 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.239+0000 7fe1ac1fb700 1 -- 172.21.15.194:0/1215949931 shutdown_connections 2023-08-11T12:16:26.243 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.240+0000 7fe1ac1fb700 1 -- 172.21.15.194:0/1215949931 wait complete. 2023-08-11T12:16:26.244 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.240+0000 7fe1ac1fb700 1 Processor -- start 2023-08-11T12:16:26.244 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.240+0000 7fe1ac1fb700 1 -- start start 2023-08-11T12:16:26.246 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.240+0000 7fe1ac1fb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1900035c0 0x7fe1a41947b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:16:26.246 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.240+0000 7fe1ac1fb700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1a4194cf0 0x7fe1a4195170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:16:26.246 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.240+0000 7fe1ac1fb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1a41a1e20 0x7fe1a41a4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:16:26.246 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.240+0000 7fe1ac1fb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a41a4750 con 0x7fe1a41a1e20 2023-08-11T12:16:26.246 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.240+0000 7fe1ac1fb700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a41a48c0 con 0x7fe1900035c0 2023-08-11T12:16:26.247 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.240+0000 7fe1ac1fb700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a41a4a80 con 0x7fe1a4194cf0 2023-08-11T12:16:26.247 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.241+0000 7fe1a9f97700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1900035c0 0x7fe1a41947b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:16:26.247 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.241+0000 7fe1a9f97700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1900035c0 0x7fe1a41947b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.194:40284/0 (socket says 172.21.15.194:40284) 2023-08-11T12:16:26.247 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.241+0000 7fe1a9f97700 1 -- 172.21.15.194:0/1831055141 learned_addr learned my addr 172.21.15.194:0/1831055141 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-08-11T12:16:26.247 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.241+0000 7fe1a9f97700 1 -- 172.21.15.194:0/1831055141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1900035c0 msgr2=0x7fe1a41947b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-08-11T12:16:26.247 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.241+0000 7fe1a9f97700 1 -- 172.21.15.194:0/1831055141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1900035c0 msgr2=0x7fe1a41947b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-08-11T12:16:26.247 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.241+0000 7fe1a9f97700 1 --2- 172.21.15.194:0/1831055141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1900035c0 0x7fe1a41947b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-11T12:16:26.248 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.241+0000 7fe1a9796700 1 --2- 172.21.15.194:0/1831055141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1a4194cf0 0x7fe1a4195170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:16:26.248 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.241+0000 7fe1a9f97700 1 --2- 172.21.15.194:0/1831055141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1900035c0 0x7fe1a41947b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-11T12:16:26.248 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.241+0000 7fe1aa798700 1 --2- 172.21.15.194:0/1831055141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1a41a1e20 0x7fe1a41a4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:16:26.248 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.241+0000 7fe1a9796700 1 -- 172.21.15.194:0/1831055141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1a4194cf0 msgr2=0x7fe1a4195170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-08-11T12:16:26.249 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.241+0000 7fe1a9796700 1 -- 172.21.15.194:0/1831055141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1a4194cf0 msgr2=0x7fe1a4195170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-08-11T12:16:26.249 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.241+0000 7fe1a9796700 1 --2- 172.21.15.194:0/1831055141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1a4194cf0 0x7fe1a4195170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-11T12:16:26.249 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.241+0000 7fe1a9796700 1 --2- 172.21.15.194:0/1831055141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1a4194cf0 0x7fe1a4195170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-11T12:16:26.249 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.241+0000 7fe1aa798700 1 -- 172.21.15.194:0/1831055141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1a4194cf0 msgr2=0x7fe1a4195170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-11T12:16:26.249 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.241+0000 7fe1aa798700 1 --2- 172.21.15.194:0/1831055141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1a4194cf0 0x7fe1a4195170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:26.249 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.241+0000 7fe1aa798700 1 -- 172.21.15.194:0/1831055141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1900035c0 msgr2=0x7fe1a41947b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-11T12:16:26.249 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.241+0000 7fe1aa798700 1 --2- 172.21.15.194:0/1831055141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1900035c0 0x7fe1a41947b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:26.249 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.241+0000 7fe1aa798700 1 -- 172.21.15.194:0/1831055141 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19400f8b0 con 0x7fe1a41a1e20 2023-08-11T12:16:26.250 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.241+0000 7fe1aa798700 1 --2- 172.21.15.194:0/1831055141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1a41a1e20 0x7fe1a41a4210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe19c00bd50 tx=0x7fe19c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:16:26.250 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.242+0000 7fe19affd700 1 -- 172.21.15.194:0/1831055141 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c00cd10 con 0x7fe1a41a1e20 2023-08-11T12:16:26.250 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.242+0000 7fe19affd700 1 -- 172.21.15.194:0/1831055141 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe19c00ce70 con 0x7fe1a41a1e20 2023-08-11T12:16:26.250 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.242+0000 7fe1ac1fb700 1 -- 172.21.15.194:0/1831055141 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a41a4d60 con 0x7fe1a41a1e20 2023-08-11T12:16:26.250 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.242+0000 7fe19affd700 1 -- 172.21.15.194:0/1831055141 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c012840 con 0x7fe1a41a1e20 2023-08-11T12:16:26.250 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.242+0000 7fe1ac1fb700 1 -- 172.21.15.194:0/1831055141 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a41a51b0 con 0x7fe1a41a1e20 2023-08-11T12:16:26.250 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.243+0000 7fe19affd700 1 -- 172.21.15.194:0/1831055141 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45190+0+0 (secure 0 0 0) 0x7fe19c014440 con 0x7fe1a41a1e20 2023-08-11T12:16:26.251 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.243+0000 7fe1ac1fb700 1 -- 172.21.15.194:0/1831055141 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a4061f50 con 0x7fe1a41a1e20 2023-08-11T12:16:26.251 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.243+0000 7fe19affd700 1 --2- 172.21.15.194:0/1831055141 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe188038680 0x7fe18803ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:16:26.251 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.243+0000 7fe19affd700 1 -- 172.21.15.194:0/1831055141 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe19c04a540 con 0x7fe1a41a1e20 2023-08-11T12:16:26.251 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.243+0000 7fe1a9f97700 1 --2- 172.21.15.194:0/1831055141 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe188038680 0x7fe18803ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:16:26.251 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.244+0000 7fe1a9f97700 1 --2- 172.21.15.194:0/1831055141 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe188038680 0x7fe18803ab40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe194005850 tx=0x7fe194014040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:16:26.252 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.248+0000 7fe19affd700 1 -- 172.21.15.194:0/1831055141 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fe19c014b00 con 0x7fe1a41a1e20 2023-08-11T12:16:26.535 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.533+0000 7fe1ac1fb700 1 -- 172.21.15.194:0/1831055141 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe1a41072b0 con 0x7fe1a41a1e20 2023-08-11T12:16:26.536 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.533+0000 7fe19affd700 1 -- 172.21.15.194:0/1831055141 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1266 (secure 0 0 0) 0x7fe19c01b8d0 con 0x7fe1a41a1e20 2023-08-11T12:16:26.536 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-08-11T12:16:26.536 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":3,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","modified":"2023-08-11T12:16:20.667910Z","created":"2023-08-11T12:14:24.688999Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-08-11T12:16:26.538 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.536+0000 7fe1ac1fb700 1 -- 172.21.15.194:0/1831055141 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe188038680 msgr2=0x7fe18803ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:26.538 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.536+0000 7fe1ac1fb700 1 --2- 172.21.15.194:0/1831055141 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe188038680 0x7fe18803ab40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe194005850 tx=0x7fe194014040 comp rx=0 tx=0).stop 2023-08-11T12:16:26.538 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.536+0000 7fe1ac1fb700 1 -- 172.21.15.194:0/1831055141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1a41a1e20 msgr2=0x7fe1a41a4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:26.538 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.536+0000 7fe1ac1fb700 1 --2- 172.21.15.194:0/1831055141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1a41a1e20 0x7fe1a41a4210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe19c00bd50 tx=0x7fe19c00be30 comp rx=0 tx=0).stop 2023-08-11T12:16:26.539 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.536+0000 7fe1ac1fb700 1 -- 172.21.15.194:0/1831055141 shutdown_connections 2023-08-11T12:16:26.539 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.536+0000 7fe1ac1fb700 1 --2- 172.21.15.194:0/1831055141 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe188038680 0x7fe18803ab40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:26.539 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.536+0000 7fe1ac1fb700 1 --2- 172.21.15.194:0/1831055141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1a41a1e20 0x7fe1a41a4210 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:26.539 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.536+0000 7fe1ac1fb700 1 --2- 172.21.15.194:0/1831055141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1900035c0 0x7fe1a41947b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:26.539 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.536+0000 7fe1ac1fb700 1 --2- 172.21.15.194:0/1831055141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1a4194cf0 0x7fe1a4195170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:26.539 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.536+0000 7fe1ac1fb700 1 -- 172.21.15.194:0/1831055141 >> 172.21.15.194:0/1831055141 conn(0x7fe1a4074ed0 msgr2=0x7fe1a4100f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:16:26.539 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.536+0000 7fe1ac1fb700 1 -- 172.21.15.194:0/1831055141 shutdown_connections 2023-08-11T12:16:26.539 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:26.536+0000 7fe1ac1fb700 1 -- 172.21.15.194:0/1831055141 wait complete. 2023-08-11T12:16:26.540 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 3 2023-08-11T12:16:26.831 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:26 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:26.831 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:26 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:16:26.831 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:26 smithi194 ceph-mon[130905]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:26.831 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:26 smithi194 ceph-mon[130905]: from='client.? 172.21.15.194:0/1831055141' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-08-11T12:16:26.831 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:26 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:16:26.916 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-08-11T12:16:26.917 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph config generate-minimal-conf 2023-08-11T12:16:26.989 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:26 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:26.989 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:26 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:16:26.989 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:26 smithi008 ceph-mon[97158]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:26.990 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:26 smithi008 ceph-mon[97158]: from='client.? 172.21.15.194:0/1831055141' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-08-11T12:16:26.990 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:26 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:16:27.662 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:16:28.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-11T12:16:28.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: mon.a calling monitor election 2023-08-11T12:16:28.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: mon.c calling monitor election 2023-08-11T12:16:28.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:16:28.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:16:28.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:16:28.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:28.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:16:28.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:16:28.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:28.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:16:28.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:16:28.148 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-08-11T12:16:28.148 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0],c=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} 2023-08-11T12:16:28.148 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: fsmap 2023-08-11T12:16:28.149 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: osdmap e4: 0 total, 0 up, 0 in 2023-08-11T12:16:28.149 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: mgrmap e13: x(active, since 55s) 2023-08-11T12:16:28.149 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-08-11T12:16:28.149 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-08-11T12:16:28.149 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-08-11T12:16:28.149 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: mon.b (rank 2) addr [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] is down (out of quorum) 2023-08-11T12:16:28.150 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:28.150 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:28.150 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:28.150 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:28.150 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:16:28.150 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:28.150 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: from='client.? 172.21.15.194:0/1831055141' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-08-11T12:16:28.151 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:16:28.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:28 smithi008 ceph-mon[97158]: mon.b calling monitor election 2023-08-11T12:16:28.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:28 smithi008 ceph-mon[97158]: mon.b calling monitor election 2023-08-11T12:16:28.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:28 smithi008 ceph-mon[97158]: mon.c calling monitor election 2023-08-11T12:16:28.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:28 smithi008 ceph-mon[97158]: mon.a calling monitor election 2023-08-11T12:16:28.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:28 smithi008 ceph-mon[97158]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-08-11T12:16:28.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:28 smithi008 ceph-mon[97158]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0],c=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} 2023-08-11T12:16:28.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:28 smithi008 ceph-mon[97158]: fsmap 2023-08-11T12:16:28.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:28 smithi008 ceph-mon[97158]: osdmap e4: 0 total, 0 up, 0 in 2023-08-11T12:16:28.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:28 smithi008 ceph-mon[97158]: mgrmap e13: x(active, since 57s) 2023-08-11T12:16:28.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:28 smithi008 ceph-mon[97158]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-08-11T12:16:28.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:28 smithi008 ceph-mon[97158]: Cluster is now healthy 2023-08-11T12:16:28.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:28 smithi008 ceph-mon[97158]: overall HEALTH_OK 2023-08-11T12:16:28.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:28 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:28.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:28 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:28.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:28 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:28.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:28 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:28.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:28 smithi194 ceph-mon[130905]: mon.b calling monitor election 2023-08-11T12:16:28.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:28 smithi194 ceph-mon[130905]: mon.b calling monitor election 2023-08-11T12:16:28.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:28 smithi194 ceph-mon[130905]: mon.c calling monitor election 2023-08-11T12:16:28.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:28 smithi194 ceph-mon[130905]: mon.a calling monitor election 2023-08-11T12:16:28.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:28 smithi194 ceph-mon[130905]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-08-11T12:16:28.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:28 smithi194 ceph-mon[130905]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0],c=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} 2023-08-11T12:16:28.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:28 smithi194 ceph-mon[130905]: fsmap 2023-08-11T12:16:28.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:28 smithi194 ceph-mon[130905]: osdmap e4: 0 total, 0 up, 0 in 2023-08-11T12:16:28.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:28 smithi194 ceph-mon[130905]: mgrmap e13: x(active, since 57s) 2023-08-11T12:16:28.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:28 smithi194 ceph-mon[130905]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-08-11T12:16:28.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:28 smithi194 ceph-mon[130905]: Cluster is now healthy 2023-08-11T12:16:28.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:28 smithi194 ceph-mon[130905]: overall HEALTH_OK 2023-08-11T12:16:28.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:28 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:28.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:28 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:28.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:28 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:28.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:28 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:28.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:28 smithi045 ceph-mon[130284]: mon.b calling monitor election 2023-08-11T12:16:28.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:28 smithi045 ceph-mon[130284]: mon.b calling monitor election 2023-08-11T12:16:28.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:28 smithi045 ceph-mon[130284]: mon.c calling monitor election 2023-08-11T12:16:28.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:28 smithi045 ceph-mon[130284]: mon.a calling monitor election 2023-08-11T12:16:28.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:28 smithi045 ceph-mon[130284]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-08-11T12:16:28.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:28 smithi045 ceph-mon[130284]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0],c=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} 2023-08-11T12:16:28.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:28 smithi045 ceph-mon[130284]: fsmap 2023-08-11T12:16:28.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:28 smithi045 ceph-mon[130284]: osdmap e4: 0 total, 0 up, 0 in 2023-08-11T12:16:28.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:28 smithi045 ceph-mon[130284]: mgrmap e13: x(active, since 57s) 2023-08-11T12:16:28.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:28 smithi045 ceph-mon[130284]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-08-11T12:16:28.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:28 smithi045 ceph-mon[130284]: Cluster is now healthy 2023-08-11T12:16:28.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:28 smithi045 ceph-mon[130284]: overall HEALTH_OK 2023-08-11T12:16:28.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:28 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:28.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:28 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:28.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:28 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:28.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:28 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:29.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.316+0000 7f8d17427700 1 -- 172.21.15.8:0/386006743 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d10100610 msgr2=0x7f8d101009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:29.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.316+0000 7f8d17427700 1 --2- 172.21.15.8:0/386006743 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d10100610 0x7f8d101009f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c009910 tx=0x7f8d0c009c20 comp rx=0 tx=0).stop 2023-08-11T12:16:29.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.316+0000 7f8d17427700 1 -- 172.21.15.8:0/386006743 shutdown_connections 2023-08-11T12:16:29.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.316+0000 7f8d17427700 1 --2- 172.21.15.8:0/386006743 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d10100610 0x7f8d101009f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:29.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.317+0000 7f8d17427700 1 -- 172.21.15.8:0/386006743 >> 172.21.15.8:0/386006743 conn(0x7f8d100fbee0 msgr2=0x7f8d100fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:16:29.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.317+0000 7f8d17427700 1 -- 172.21.15.8:0/386006743 shutdown_connections 2023-08-11T12:16:29.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.317+0000 7f8d17427700 1 -- 172.21.15.8:0/386006743 wait complete. 2023-08-11T12:16:29.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.318+0000 7f8d17427700 1 Processor -- start 2023-08-11T12:16:29.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.318+0000 7f8d17427700 1 -- start start 2023-08-11T12:16:29.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.318+0000 7f8d17427700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d10100610 0x7f8d1019b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:16:29.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.318+0000 7f8d17427700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d1019bd00 0x7f8d10195840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:16:29.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.318+0000 7f8d17427700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d10195d80 0x7f8d10196230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:16:29.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.318+0000 7f8d17427700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1019c360 con 0x7f8d10195d80 2023-08-11T12:16:29.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.318+0000 7f8d17427700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d101a25e0 con 0x7f8d1019bd00 2023-08-11T12:16:29.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.318+0000 7f8d17427700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d101a2770 con 0x7f8d10100610 2023-08-11T12:16:29.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.319+0000 7f8d159c4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d10195d80 0x7f8d10196230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:16:29.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.319+0000 7f8d149c2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d1019bd00 0x7f8d10195840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:16:29.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.319+0000 7f8d149c2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d1019bd00 0x7f8d10195840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:55644/0 (socket says 172.21.15.8:55644) 2023-08-11T12:16:29.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.319+0000 7f8d149c2700 1 -- 172.21.15.8:0/1365678874 learned_addr learned my addr 172.21.15.8:0/1365678874 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:16:29.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.319+0000 7f8d151c3700 1 --2- 172.21.15.8:0/1365678874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d10100610 0x7f8d1019b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:16:29.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.319+0000 7f8d149c2700 1 -- 172.21.15.8:0/1365678874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d10100610 msgr2=0x7f8d1019b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:29.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.319+0000 7f8d149c2700 1 --2- 172.21.15.8:0/1365678874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d10100610 0x7f8d1019b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:29.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.319+0000 7f8d149c2700 1 -- 172.21.15.8:0/1365678874 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d10195d80 msgr2=0x7f8d10196230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:29.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.319+0000 7f8d149c2700 1 --2- 172.21.15.8:0/1365678874 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d10195d80 0x7f8d10196230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:29.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.319+0000 7f8d149c2700 1 -- 172.21.15.8:0/1365678874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0c0095f0 con 0x7f8d1019bd00 2023-08-11T12:16:29.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.319+0000 7f8d159c4700 1 --2- 172.21.15.8:0/1365678874 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d10195d80 0x7f8d10196230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:16:29.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.320+0000 7f8d149c2700 1 --2- 172.21.15.8:0/1365678874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d1019bd00 0x7f8d10195840 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8d0000b780 tx=0x7f8d0000ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:16:29.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.320+0000 7f8d067fc700 1 -- 172.21.15.8:0/1365678874 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00004230 con 0x7f8d1019bd00 2023-08-11T12:16:29.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.320+0000 7f8d067fc700 1 -- 172.21.15.8:0/1365678874 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d00004390 con 0x7f8d1019bd00 2023-08-11T12:16:29.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.320+0000 7f8d17427700 1 -- 172.21.15.8:0/1365678874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d10072c70 con 0x7f8d1019bd00 2023-08-11T12:16:29.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.320+0000 7f8d067fc700 1 -- 172.21.15.8:0/1365678874 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00011b90 con 0x7f8d1019bd00 2023-08-11T12:16:29.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.320+0000 7f8d17427700 1 -- 172.21.15.8:0/1365678874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d100731c0 con 0x7f8d1019bd00 2023-08-11T12:16:29.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.321+0000 7f8d067fc700 1 -- 172.21.15.8:0/1365678874 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 13) v1 ==== 45190+0+0 (secure 0 0 0) 0x7f8d00011cf0 con 0x7f8d1019bd00 2023-08-11T12:16:29.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.321+0000 7f8d17427700 1 -- 172.21.15.8:0/1365678874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d10061f50 con 0x7f8d1019bd00 2023-08-11T12:16:29.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.322+0000 7f8d067fc700 1 --2- 172.21.15.8:0/1365678874 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8cfc038680 0x7f8cfc03ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:16:29.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.322+0000 7f8d067fc700 1 -- 172.21.15.8:0/1365678874 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8d000498e0 con 0x7f8d1019bd00 2023-08-11T12:16:29.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.322+0000 7f8d151c3700 1 --2- 172.21.15.8:0/1365678874 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8cfc038680 0x7f8cfc03ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:16:29.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.322+0000 7f8d151c3700 1 --2- 172.21.15.8:0/1365678874 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8cfc038680 0x7f8cfc03ab40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c009fd0 tx=0x7f8d0c0058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:16:29.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.328+0000 7f8d067fc700 1 -- 172.21.15.8:0/1365678874 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f8d00018d20 con 0x7f8d1019bd00 2023-08-11T12:16:29.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.550+0000 7f8d17427700 1 -- 172.21.15.8:0/1365678874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f8d10196d50 con 0x7f8d1019bd00 2023-08-11T12:16:29.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.550+0000 7f8d067fc700 1 -- 172.21.15.8:0/1365678874 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+271 (secure 0 0 0) 0x7f8d000182c0 con 0x7f8d1019bd00 2023-08-11T12:16:29.553 INFO:teuthology.orchestra.run.smithi008.stdout:# minimal ceph.conf for 815f94ae-3840-11ee-9b37-001a4aab830c 2023-08-11T12:16:29.553 INFO:teuthology.orchestra.run.smithi008.stdout:[global] 2023-08-11T12:16:29.554 INFO:teuthology.orchestra.run.smithi008.stdout: fsid = 815f94ae-3840-11ee-9b37-001a4aab830c 2023-08-11T12:16:29.554 INFO:teuthology.orchestra.run.smithi008.stdout: mon_host = [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2023-08-11T12:16:29.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.553+0000 7f8d17427700 1 -- 172.21.15.8:0/1365678874 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8cfc038680 msgr2=0x7f8cfc03ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:29.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.553+0000 7f8d17427700 1 --2- 172.21.15.8:0/1365678874 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8cfc038680 0x7f8cfc03ab40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c009fd0 tx=0x7f8d0c0058e0 comp rx=0 tx=0).stop 2023-08-11T12:16:29.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.553+0000 7f8d17427700 1 -- 172.21.15.8:0/1365678874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d1019bd00 msgr2=0x7f8d10195840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:29.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.553+0000 7f8d17427700 1 --2- 172.21.15.8:0/1365678874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d1019bd00 0x7f8d10195840 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8d0000b780 tx=0x7f8d0000ba90 comp rx=0 tx=0).stop 2023-08-11T12:16:29.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.553+0000 7f8d17427700 1 -- 172.21.15.8:0/1365678874 shutdown_connections 2023-08-11T12:16:29.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.553+0000 7f8d17427700 1 --2- 172.21.15.8:0/1365678874 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8cfc038680 0x7f8cfc03ab40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:29.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.553+0000 7f8d17427700 1 --2- 172.21.15.8:0/1365678874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d10100610 0x7f8d1019b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:29.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.553+0000 7f8d17427700 1 --2- 172.21.15.8:0/1365678874 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d10195d80 0x7f8d10196230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:29.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.553+0000 7f8d17427700 1 --2- 172.21.15.8:0/1365678874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d1019bd00 0x7f8d10195840 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:29.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.553+0000 7f8d17427700 1 -- 172.21.15.8:0/1365678874 >> 172.21.15.8:0/1365678874 conn(0x7f8d100fbee0 msgr2=0x7f8d10106170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:16:29.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.553+0000 7f8d17427700 1 -- 172.21.15.8:0/1365678874 shutdown_connections 2023-08-11T12:16:29.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:29.554+0000 7f8d17427700 1 -- 172.21.15.8:0/1365678874 wait complete. 2023-08-11T12:16:29.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:29 smithi008 ceph-mon[97158]: Updating smithi045:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-11T12:16:29.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:29 smithi008 ceph-mon[97158]: Updating smithi194:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-11T12:16:29.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:29 smithi008 ceph-mon[97158]: Updating smithi008:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-11T12:16:29.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:29 smithi008 ceph-mon[97158]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:29.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:29.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:29.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:29.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:16:29.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:29.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:29.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:29.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:29.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-11T12:16:29.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-08-11T12:16:29.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:29.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:29 smithi194 ceph-mon[130905]: Updating smithi045:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-11T12:16:29.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:29 smithi194 ceph-mon[130905]: Updating smithi194:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-11T12:16:29.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:29 smithi194 ceph-mon[130905]: Updating smithi008:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-11T12:16:29.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:29 smithi194 ceph-mon[130905]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:29.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:29.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:29.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:29.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:16:29.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:29.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:29.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:29.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:29.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-11T12:16:29.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-08-11T12:16:29.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:29.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:29 smithi045 ceph-mon[130284]: Updating smithi045:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-11T12:16:29.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:29 smithi045 ceph-mon[130284]: Updating smithi194:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-11T12:16:29.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:29 smithi045 ceph-mon[130284]: Updating smithi008:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-11T12:16:29.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:29 smithi045 ceph-mon[130284]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:29.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:29.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:29.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:29.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:16:29.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:29.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:29.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:29.898 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:29.898 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-11T12:16:29.898 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-08-11T12:16:29.898 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:30.250 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-08-11T12:16:30.251 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-11T12:16:30.251 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/ceph/ceph.conf 2023-08-11T12:16:30.325 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-11T12:16:30.325 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-08-11T12:16:30.435 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-08-11T12:16:30.435 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/ceph/ceph.conf 2023-08-11T12:16:30.472 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-08-11T12:16:30.473 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-08-11T12:16:30.544 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-08-11T12:16:30.545 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.conf 2023-08-11T12:16:30.581 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-08-11T12:16:30.581 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-08-11T12:16:30.652 INFO:tasks.cephadm:Adding mgr.x on smithi008 2023-08-11T12:16:30.653 INFO:tasks.cephadm:Adding mgr.y on smithi045 2023-08-11T12:16:30.653 INFO:tasks.cephadm:Adding mgr.z on smithi194 2023-08-11T12:16:30.653 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph orch apply mgr '3;smithi008=x;smithi045=y;smithi194=z' 2023-08-11T12:16:30.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:30 smithi008 ceph-mon[97158]: Reconfiguring mon.a (unknown last config time)... 2023-08-11T12:16:30.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:30 smithi008 ceph-mon[97158]: Reconfiguring daemon mon.a on smithi008 2023-08-11T12:16:30.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:30 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1365678874' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:30.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:30 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:30.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:30 smithi194 ceph-mon[130905]: Reconfiguring mon.a (unknown last config time)... 2023-08-11T12:16:30.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:30 smithi194 ceph-mon[130905]: Reconfiguring daemon mon.a on smithi008 2023-08-11T12:16:30.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:30 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1365678874' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:30.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:30 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:30.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:30 smithi045 ceph-mon[130284]: Reconfiguring mon.a (unknown last config time)... 2023-08-11T12:16:30.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:30 smithi045 ceph-mon[130284]: Reconfiguring daemon mon.a on smithi008 2023-08-11T12:16:30.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:30 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1365678874' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:30.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:30 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:31.246 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.c/config 2023-08-11T12:16:31.707 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:31 smithi045 ceph-mon[130284]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:31.707 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:31 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:31.708 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:31 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:31.708 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:31 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-11T12:16:31.708 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:31 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-08-11T12:16:31.708 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:31 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:31.718 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:31 smithi194 ceph-mon[130905]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:31.718 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:31 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:31.718 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:31 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:31.719 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:31 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-11T12:16:31.719 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:31 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-08-11T12:16:31.719 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:31 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:31.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:31 smithi008 ceph-mon[97158]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:31.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:31 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:31.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:31 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:31.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:31 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-11T12:16:31.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:31 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-08-11T12:16:31.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:31 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:32.408 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.406+0000 7f00f1652700 1 -- 172.21.15.194:0/3892749364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00ec0ff430 msgr2=0x7f00ec0ff850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:32.409 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.406+0000 7f00f1652700 1 --2- 172.21.15.194:0/3892749364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00ec0ff430 0x7f00ec0ff850 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009910 tx=0x7f00dc009c20 comp rx=0 tx=0).stop 2023-08-11T12:16:32.409 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.406+0000 7f00f1652700 1 -- 172.21.15.194:0/3892749364 shutdown_connections 2023-08-11T12:16:32.409 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.406+0000 7f00f1652700 1 --2- 172.21.15.194:0/3892749364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00ec0ff430 0x7f00ec0ff850 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:32.409 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.406+0000 7f00f1652700 1 -- 172.21.15.194:0/3892749364 >> 172.21.15.194:0/3892749364 conn(0x7f00ec0fa9f0 msgr2=0x7f00ec0fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:16:32.409 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.406+0000 7f00f1652700 1 -- 172.21.15.194:0/3892749364 shutdown_connections 2023-08-11T12:16:32.409 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.406+0000 7f00f1652700 1 -- 172.21.15.194:0/3892749364 wait complete. 2023-08-11T12:16:32.411 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.407+0000 7f00f1652700 1 Processor -- start 2023-08-11T12:16:32.412 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.407+0000 7f00f1652700 1 -- start start 2023-08-11T12:16:32.412 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.407+0000 7f00f1652700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00ec0ff430 0x7f00ec197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:16:32.412 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.407+0000 7f00f1652700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00ec197ec0 0x7f00ec19cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:16:32.412 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.407+0000 7f00f1652700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00ec198340 0x7f00ec19f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:16:32.413 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.407+0000 7f00f1652700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec19fc60 con 0x7f00ec0ff430 2023-08-11T12:16:32.413 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.407+0000 7f00f1652700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec19fdd0 con 0x7f00ec198340 2023-08-11T12:16:32.413 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.407+0000 7f00f1652700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec19ff90 con 0x7f00ec197ec0 2023-08-11T12:16:32.413 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.407+0000 7f00eaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00ec0ff430 0x7f00ec197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:16:32.413 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.408+0000 7f00eaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00ec0ff430 0x7f00ec197980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.194:33418/0 (socket says 172.21.15.194:33418) 2023-08-11T12:16:32.413 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.408+0000 7f00eaffd700 1 -- 172.21.15.194:0/735441883 learned_addr learned my addr 172.21.15.194:0/735441883 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-08-11T12:16:32.414 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.408+0000 7f00eb7fe700 1 --2- 172.21.15.194:0/735441883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00ec198340 0x7f00ec19f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:16:32.414 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.408+0000 7f00ea7fc700 1 --2- 172.21.15.194:0/735441883 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00ec197ec0 0x7f00ec19cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:16:32.414 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.408+0000 7f00eaffd700 1 -- 172.21.15.194:0/735441883 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00ec197ec0 msgr2=0x7f00ec19cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:32.414 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.408+0000 7f00eaffd700 1 --2- 172.21.15.194:0/735441883 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00ec197ec0 0x7f00ec19cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:32.414 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.408+0000 7f00eaffd700 1 -- 172.21.15.194:0/735441883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00ec198340 msgr2=0x7f00ec19f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:32.414 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.408+0000 7f00eaffd700 1 --2- 172.21.15.194:0/735441883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00ec198340 0x7f00ec19f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:32.414 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.408+0000 7f00eaffd700 1 -- 172.21.15.194:0/735441883 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc0095f0 con 0x7f00ec0ff430 2023-08-11T12:16:32.415 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.408+0000 7f00ea7fc700 1 --2- 172.21.15.194:0/735441883 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00ec197ec0 0x7f00ec19cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:16:32.415 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.408+0000 7f00eaffd700 1 --2- 172.21.15.194:0/735441883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00ec0ff430 0x7f00ec197980 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f00dc000c00 tx=0x7f00dc004cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:16:32.415 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.408+0000 7f00d3fff700 1 -- 172.21.15.194:0/735441883 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc01d070 con 0x7f00ec0ff430 2023-08-11T12:16:32.415 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.408+0000 7f00f1652700 1 -- 172.21.15.194:0/735441883 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00ec1a0210 con 0x7f00ec0ff430 2023-08-11T12:16:32.415 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.408+0000 7f00d3fff700 1 -- 172.21.15.194:0/735441883 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f00dc00be20 con 0x7f00ec0ff430 2023-08-11T12:16:32.416 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.408+0000 7f00d3fff700 1 -- 172.21.15.194:0/735441883 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc022de0 con 0x7f00ec0ff430 2023-08-11T12:16:32.416 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.408+0000 7f00f1652700 1 -- 172.21.15.194:0/735441883 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00ec1a0730 con 0x7f00ec0ff430 2023-08-11T12:16:32.417 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.409+0000 7f00f1652700 1 -- 172.21.15.194:0/735441883 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00ec191a50 con 0x7f00ec0ff430 2023-08-11T12:16:32.417 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.409+0000 7f00d3fff700 1 -- 172.21.15.194:0/735441883 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45190+0+0 (secure 0 0 0) 0x7f00dc00f460 con 0x7f00ec0ff430 2023-08-11T12:16:32.417 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.410+0000 7f00d3fff700 1 --2- 172.21.15.194:0/735441883 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f00d4038630 0x7f00d403aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:16:32.417 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.410+0000 7f00d3fff700 1 -- 172.21.15.194:0/735441883 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f00dc04c460 con 0x7f00ec0ff430 2023-08-11T12:16:32.418 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.410+0000 7f00ea7fc700 1 --2- 172.21.15.194:0/735441883 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f00d4038630 0x7f00d403aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:16:32.418 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.411+0000 7f00ea7fc700 1 --2- 172.21.15.194:0/735441883 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f00d4038630 0x7f00d403aaf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f00e0009ec0 tx=0x7f00e0009210 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:16:32.418 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.415+0000 7f00d3fff700 1 -- 172.21.15.194:0/735441883 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f00dc020960 con 0x7f00ec0ff430 2023-08-11T12:16:32.636 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.627+0000 7f00f1652700 1 -- 172.21.15.194:0/735441883 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi008=x;smithi045=y;smithi194=z", "target": ["mon-mgr", ""]}) v1 -- 0x7f00ec02cd60 con 0x7f00d4038630 2023-08-11T12:16:32.637 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.634+0000 7f00d3fff700 1 -- 172.21.15.194:0/735441883 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f00ec02cd60 con 0x7f00d4038630 2023-08-11T12:16:32.637 INFO:teuthology.orchestra.run.smithi194.stdout:Scheduled mgr update... 2023-08-11T12:16:32.639 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.636+0000 7f00f1652700 1 -- 172.21.15.194:0/735441883 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f00d4038630 msgr2=0x7f00d403aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:32.639 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.636+0000 7f00f1652700 1 --2- 172.21.15.194:0/735441883 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f00d4038630 0x7f00d403aaf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f00e0009ec0 tx=0x7f00e0009210 comp rx=0 tx=0).stop 2023-08-11T12:16:32.639 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.637+0000 7f00f1652700 1 -- 172.21.15.194:0/735441883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00ec0ff430 msgr2=0x7f00ec197980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:32.640 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.637+0000 7f00f1652700 1 --2- 172.21.15.194:0/735441883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00ec0ff430 0x7f00ec197980 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f00dc000c00 tx=0x7f00dc004cb0 comp rx=0 tx=0).stop 2023-08-11T12:16:32.640 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.637+0000 7f00f1652700 1 -- 172.21.15.194:0/735441883 shutdown_connections 2023-08-11T12:16:32.640 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.637+0000 7f00f1652700 1 --2- 172.21.15.194:0/735441883 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f00d4038630 0x7f00d403aaf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:32.640 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.637+0000 7f00f1652700 1 --2- 172.21.15.194:0/735441883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00ec198340 0x7f00ec19f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:32.640 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.637+0000 7f00f1652700 1 --2- 172.21.15.194:0/735441883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00ec0ff430 0x7f00ec197980 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:32.640 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.637+0000 7f00f1652700 1 --2- 172.21.15.194:0/735441883 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00ec197ec0 0x7f00ec19cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:32.640 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.637+0000 7f00f1652700 1 -- 172.21.15.194:0/735441883 >> 172.21.15.194:0/735441883 conn(0x7f00ec0fa9f0 msgr2=0x7f00ec18eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:16:32.641 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.637+0000 7f00f1652700 1 -- 172.21.15.194:0/735441883 shutdown_connections 2023-08-11T12:16:32.641 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:16:32.637+0000 7f00f1652700 1 -- 172.21.15.194:0/735441883 wait complete. 2023-08-11T12:16:32.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:32 smithi008 ceph-mon[97158]: Reconfiguring mon.b (monmap changed)... 2023-08-11T12:16:32.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:32 smithi008 ceph-mon[97158]: Reconfiguring daemon mon.b on smithi045 2023-08-11T12:16:32.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:32 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:32.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:32 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:32.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:32 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-11T12:16:32.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:32 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-08-11T12:16:32.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:32 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:32.892 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:32 smithi194 ceph-mon[130905]: Reconfiguring mon.b (monmap changed)... 2023-08-11T12:16:32.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:32 smithi194 ceph-mon[130905]: Reconfiguring daemon mon.b on smithi045 2023-08-11T12:16:32.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:32 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:32.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:32 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:32.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:32 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-11T12:16:32.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:32 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-08-11T12:16:32.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:32 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:32.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:32 smithi045 ceph-mon[130284]: Reconfiguring mon.b (monmap changed)... 2023-08-11T12:16:32.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:32 smithi045 ceph-mon[130284]: Reconfiguring daemon mon.b on smithi045 2023-08-11T12:16:32.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:32 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:32.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:32 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:32.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:32 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-11T12:16:32.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:32 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-08-11T12:16:32.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:32 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:33.206 DEBUG:teuthology.orchestra.run.smithi045:mgr.y> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mgr.y.service 2023-08-11T12:16:33.208 DEBUG:teuthology.orchestra.run.smithi194:mgr.z> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mgr.z.service 2023-08-11T12:16:33.213 INFO:tasks.cephadm:Deploying OSDs... 2023-08-11T12:16:33.213 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-11T12:16:33.215 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/scratch_devs of=/dev/stdout 2023-08-11T12:16:33.241 INFO:journalctl@ceph.mgr.z.smithi194.stdout:-- Logs begin at Fri 2023-08-11 11:52:16 UTC. -- 2023-08-11T12:16:33.244 INFO:journalctl@ceph.mgr.y.smithi045.stdout:-- Logs begin at Fri 2023-08-11 11:52:16 UTC. -- 2023-08-11T12:16:33.263 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-11T12:16:33.264 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_1 2023-08-11T12:16:33.350 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-11T12:16:33.350 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-11T12:16:33.350 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-08-11T12:16:33.350 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-11T12:16:33.350 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-08-11T12:16:33.351 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-08-11 12:15:42.259525582 +0000 2023-08-11T12:16:33.351 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-08-11 12:09:26.034829572 +0000 2023-08-11T12:16:33.351 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-08-11 12:09:26.034829572 +0000 2023-08-11T12:16:33.351 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-08-11 12:09:26.008829827 +0000 2023-08-11T12:16:33.351 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-11T12:16:33.420 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-08-11T12:16:33.421 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-08-11T12:16:33.421 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000191088 s, 2.7 MB/s 2023-08-11T12:16:33.423 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-11T12:16:33.470 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_2 2023-08-11T12:16:33.555 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-11T12:16:33.556 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-11T12:16:33.556 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-08-11T12:16:33.556 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-11T12:16:33.557 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-08-11T12:16:33.557 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-08-11 12:15:42.259525582 +0000 2023-08-11T12:16:33.557 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-08-11 12:09:26.914820944 +0000 2023-08-11T12:16:33.557 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-08-11 12:09:26.914820944 +0000 2023-08-11T12:16:33.557 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-08-11 12:09:26.892821159 +0000 2023-08-11T12:16:33.557 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-11T12:16:33.664 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-08-11T12:16:33.664 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-08-11T12:16:33.664 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000192997 s, 2.7 MB/s 2023-08-11T12:16:33.665 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:33 smithi008 ceph-mon[97158]: Reconfiguring mon.c (monmap changed)... 2023-08-11T12:16:33.665 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:33 smithi008 ceph-mon[97158]: Reconfiguring daemon mon.c on smithi194 2023-08-11T12:16:33.665 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:33 smithi008 ceph-mon[97158]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:33.665 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:33 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:33.665 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:33 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:33.666 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:33 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:33.666 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:33 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:16:33.666 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:33 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:33.666 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:33 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:16:33.666 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:33 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:33.666 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:33 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-08-11T12:16:33.666 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:33 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-08-11T12:16:33.667 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:33 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-08-11T12:16:33.667 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:33 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:33.668 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-11T12:16:33.713 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_3 2023-08-11T12:16:33.783 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:33 smithi194 ceph-mon[130905]: Reconfiguring mon.c (monmap changed)... 2023-08-11T12:16:33.784 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:33 smithi194 ceph-mon[130905]: Reconfiguring daemon mon.c on smithi194 2023-08-11T12:16:33.784 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:33 smithi194 ceph-mon[130905]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:33.784 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:33 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:33.784 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:33 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:33.785 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:33 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:33.785 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:33 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:16:33.785 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:33 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:33.786 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:33 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:16:33.786 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:33 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:33.786 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:33 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-08-11T12:16:33.786 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:33 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-08-11T12:16:33.787 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:33 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-08-11T12:16:33.787 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:33 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:33.797 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-11T12:16:33.798 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-11T12:16:33.798 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-08-11T12:16:33.798 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-11T12:16:33.798 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-08-11T12:16:33.798 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-08-11 12:15:42.259525582 +0000 2023-08-11T12:16:33.799 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-08-11 12:09:27.758812668 +0000 2023-08-11T12:16:33.799 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-08-11 12:09:27.758812668 +0000 2023-08-11T12:16:33.799 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-08-11 12:09:27.736812884 +0000 2023-08-11T12:16:33.799 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-11T12:16:33.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:33 smithi045 ceph-mon[130284]: Reconfiguring mon.c (monmap changed)... 2023-08-11T12:16:33.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:33 smithi045 ceph-mon[130284]: Reconfiguring daemon mon.c on smithi194 2023-08-11T12:16:33.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:33 smithi045 ceph-mon[130284]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:33.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:33 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:33.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:33 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:33.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:33 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:33.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:33 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:16:33.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:33 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:33.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:33 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:16:33.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:33 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:33.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:33 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-08-11T12:16:33.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:33 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-08-11T12:16:33.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:33 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-08-11T12:16:33.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:33 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:33.903 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-08-11T12:16:33.904 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-08-11T12:16:33.904 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000191071 s, 2.7 MB/s 2023-08-11T12:16:33.906 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-11T12:16:33.951 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_4 2023-08-11T12:16:34.036 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-11T12:16:34.036 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-11T12:16:34.036 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 470 Links: 1 2023-08-11T12:16:34.037 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-11T12:16:34.037 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-08-11T12:16:34.037 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-08-11 12:15:42.259525582 +0000 2023-08-11T12:16:34.037 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-08-11 12:09:28.600804413 +0000 2023-08-11T12:16:34.037 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-08-11 12:09:28.600804413 +0000 2023-08-11T12:16:34.037 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-08-11 12:09:28.577804638 +0000 2023-08-11T12:16:34.038 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-11T12:16:34.142 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-08-11T12:16:34.143 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-08-11T12:16:34.143 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000191683 s, 2.7 MB/s 2023-08-11T12:16:34.145 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-11T12:16:34.190 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-08-11T12:16:34.190 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/scratch_devs of=/dev/stdout 2023-08-11T12:16:34.211 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-11T12:16:34.212 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_1 2023-08-11T12:16:34.273 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-11T12:16:34.273 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-11T12:16:34.273 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 6h/6d Inode: 383627 Links: 1 2023-08-11T12:16:34.273 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-11T12:16:34.273 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2023-08-11T12:16:34.274 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-08-11 12:16:20.073749270 +0000 2023-08-11T12:16:34.274 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-08-11 12:06:25.343989678 +0000 2023-08-11T12:16:34.274 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-08-11 12:06:25.343989678 +0000 2023-08-11T12:16:34.274 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2023-08-11T12:16:34.274 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-11T12:16:34.344 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-08-11T12:16:34.344 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-08-11T12:16:34.345 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000130597 s, 3.9 MB/s 2023-08-11T12:16:34.346 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-11T12:16:34.406 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_2 2023-08-11T12:16:34.468 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-11T12:16:34.469 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-11T12:16:34.469 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 6h/6d Inode: 384700 Links: 1 2023-08-11T12:16:34.469 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-11T12:16:34.469 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2023-08-11T12:16:34.469 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-08-11 12:16:20.073749270 +0000 2023-08-11T12:16:34.469 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-08-11 12:06:25.867981644 +0000 2023-08-11T12:16:34.469 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-08-11 12:06:25.867981644 +0000 2023-08-11T12:16:34.470 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2023-08-11T12:16:34.470 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-11T12:16:34.538 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-08-11T12:16:34.539 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-08-11T12:16:34.539 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.00010272 s, 5.0 MB/s 2023-08-11T12:16:34.540 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-11T12:16:34.600 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_3 2023-08-11T12:16:34.644 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:34 smithi045 ceph-mon[130284]: from='client.14208 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi008=x;smithi045=y;smithi194=z", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:16:34.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:34 smithi045 ceph-mon[130284]: Saving service mgr spec with placement smithi008=x;smithi045=y;smithi194=z;count:3 2023-08-11T12:16:34.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:34 smithi045 ceph-mon[130284]: Deploying daemon mgr.z on smithi194 2023-08-11T12:16:34.660 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-11T12:16:34.660 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-11T12:16:34.660 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 6h/6d Inode: 376774 Links: 1 2023-08-11T12:16:34.661 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-11T12:16:34.661 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2023-08-11T12:16:34.661 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-08-11 12:16:20.073749270 +0000 2023-08-11T12:16:34.661 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-08-11 12:06:26.402973441 +0000 2023-08-11T12:16:34.661 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-08-11 12:06:26.402973441 +0000 2023-08-11T12:16:34.661 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2023-08-11T12:16:34.662 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-11T12:16:34.728 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-08-11T12:16:34.728 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-08-11T12:16:34.728 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000120017 s, 4.3 MB/s 2023-08-11T12:16:34.729 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-11T12:16:34.788 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_4 2023-08-11T12:16:34.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:34 smithi008 ceph-mon[97158]: from='client.14208 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi008=x;smithi045=y;smithi194=z", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:16:34.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:34 smithi008 ceph-mon[97158]: Saving service mgr spec with placement smithi008=x;smithi045=y;smithi194=z;count:3 2023-08-11T12:16:34.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:34 smithi008 ceph-mon[97158]: Deploying daemon mgr.z on smithi194 2023-08-11T12:16:34.848 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-11T12:16:34.848 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-11T12:16:34.848 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 6h/6d Inode: 387573 Links: 1 2023-08-11T12:16:34.849 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-11T12:16:34.849 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2023-08-11T12:16:34.849 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-08-11 12:16:20.073749270 +0000 2023-08-11T12:16:34.849 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-08-11 12:06:26.934965284 +0000 2023-08-11T12:16:34.850 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-08-11 12:06:26.934965284 +0000 2023-08-11T12:16:34.850 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2023-08-11T12:16:34.850 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-11T12:16:34.890 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:34 smithi194 ceph-mon[130905]: from='client.14208 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi008=x;smithi045=y;smithi194=z", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:16:34.890 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:34 smithi194 ceph-mon[130905]: Saving service mgr spec with placement smithi008=x;smithi045=y;smithi194=z;count:3 2023-08-11T12:16:34.891 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:34 smithi194 ceph-mon[130905]: Deploying daemon mgr.z on smithi194 2023-08-11T12:16:34.891 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:34 smithi194 systemd[1]: Starting Ceph mgr.z for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:16:34.915 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-08-11T12:16:34.915 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-08-11T12:16:34.915 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000113678 s, 4.5 MB/s 2023-08-11T12:16:34.916 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-11T12:16:34.975 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-08-11T12:16:34.975 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/scratch_devs of=/dev/stdout 2023-08-11T12:16:34.993 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-11T12:16:34.994 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_1 2023-08-11T12:16:35.053 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-11T12:16:35.054 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-11T12:16:35.054 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 6h/6d Inode: 376683 Links: 1 2023-08-11T12:16:35.054 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-11T12:16:35.054 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2023-08-11T12:16:35.054 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2023-08-11 12:16:34.552793109 +0000 2023-08-11T12:16:35.054 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2023-08-11 12:06:02.733075337 +0000 2023-08-11T12:16:35.055 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2023-08-11 12:06:02.733075337 +0000 2023-08-11T12:16:35.055 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2023-08-11T12:16:35.055 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-11T12:16:35.123 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2023-08-11T12:16:35.123 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2023-08-11T12:16:35.124 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.00026669 s, 1.9 MB/s 2023-08-11T12:16:35.125 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-11T12:16:35.141 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:34 smithi194 podman[132752]: 2023-08-11T12:16:35.159 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_2 2023-08-11T12:16:35.216 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-11T12:16:35.216 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-11T12:16:35.217 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 6h/6d Inode: 384656 Links: 1 2023-08-11T12:16:35.217 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-11T12:16:35.217 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2023-08-11T12:16:35.217 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2023-08-11 12:16:34.552793109 +0000 2023-08-11T12:16:35.217 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2023-08-11 12:06:03.277064441 +0000 2023-08-11T12:16:35.217 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2023-08-11 12:06:03.277064441 +0000 2023-08-11T12:16:35.217 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2023-08-11T12:16:35.218 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-11T12:16:35.283 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2023-08-11T12:16:35.284 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2023-08-11T12:16:35.284 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000233559 s, 2.2 MB/s 2023-08-11T12:16:35.286 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-11T12:16:35.344 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_3 2023-08-11T12:16:35.393 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:35 smithi194 bash[132752]: 9fd8ad25fe157be42c313959e49dc135d80a9a1c0cf5551494cfde00bc0a81a5 2023-08-11T12:16:35.393 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:35 smithi194 ceph-mgr[132851]: -- 172.21.15.194:0/904016866 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564b74fff1e0 con 0x564b74fd5000 2023-08-11T12:16:35.393 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:35 smithi194 systemd[1]: Started Ceph mgr.z for 815f94ae-3840-11ee-9b37-001a4aab830c. 2023-08-11T12:16:35.394 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:35 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:16:35.279+0000 7f8641622200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-11T12:16:35.394 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:35 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:16:35.362+0000 7f8641622200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-11T12:16:35.401 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-11T12:16:35.401 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-11T12:16:35.401 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 6h/6d Inode: 389152 Links: 1 2023-08-11T12:16:35.401 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-11T12:16:35.401 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2023-08-11T12:16:35.402 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2023-08-11 12:16:34.552793109 +0000 2023-08-11T12:16:35.402 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2023-08-11 12:06:03.802053926 +0000 2023-08-11T12:16:35.402 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2023-08-11 12:06:03.802053926 +0000 2023-08-11T12:16:35.402 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2023-08-11T12:16:35.402 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-11T12:16:35.467 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2023-08-11T12:16:35.467 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2023-08-11T12:16:35.467 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000213256 s, 2.4 MB/s 2023-08-11T12:16:35.468 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-11T12:16:35.526 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_4 2023-08-11T12:16:35.584 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-11T12:16:35.584 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-11T12:16:35.585 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 6h/6d Inode: 386528 Links: 1 2023-08-11T12:16:35.585 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-11T12:16:35.585 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2023-08-11T12:16:35.585 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2023-08-11 12:16:34.552793109 +0000 2023-08-11T12:16:35.585 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2023-08-11 12:06:04.335043250 +0000 2023-08-11T12:16:35.585 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2023-08-11 12:06:04.335043250 +0000 2023-08-11T12:16:35.585 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2023-08-11T12:16:35.586 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-11T12:16:35.650 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2023-08-11T12:16:35.651 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2023-08-11T12:16:35.651 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000211647 s, 2.4 MB/s 2023-08-11T12:16:35.652 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-11T12:16:35.710 INFO:tasks.cephadm:Deploying osd.0 on smithi008 with /dev/vg_nvme/lv_4... 2023-08-11T12:16:35.710 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-08-11T12:16:35.736 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:35 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:16:35.455+0000 7f8641622200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-11T12:16:35.736 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:35 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:16:35.554+0000 7f8641622200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-11T12:16:35.736 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:35 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:16:35.731+0000 7f8641622200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-11T12:16:35.737 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:35 smithi194 ceph-mon[130905]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:35.737 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:35 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:35.737 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:35 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:35.737 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:35 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:35.738 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:35 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-08-11T12:16:35.738 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:35 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-08-11T12:16:35.738 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:35 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-08-11T12:16:35.738 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:35 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:35.738 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:35 smithi194 ceph-mon[130905]: Deploying daemon mgr.y on smithi045 2023-08-11T12:16:35.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:35 smithi008 ceph-mon[97158]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:35.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:35 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:35.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:35 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:35.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:35 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:35.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:35 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-08-11T12:16:35.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:35 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-08-11T12:16:35.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:35 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-08-11T12:16:35.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:35 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:35.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:35 smithi008 ceph-mon[97158]: Deploying daemon mgr.y on smithi045 2023-08-11T12:16:35.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:35 smithi045 ceph-mon[130284]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:35.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:35 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:35.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:35 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:35.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:35 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:35.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:35 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-08-11T12:16:35.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:35 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-08-11T12:16:35.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:35 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-08-11T12:16:35.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:35 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:35.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:35 smithi045 ceph-mon[130284]: Deploying daemon mgr.y on smithi045 2023-08-11T12:16:36.393 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:36 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:16:36.091+0000 7f8641622200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-11T12:16:36.393 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:36 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:16:36.220+0000 7f8641622200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-11T12:16:36.393 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:36 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:16:36.308+0000 7f8641622200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-11T12:16:36.444 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:16:36.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:36 smithi008 ceph-mon[97158]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:36.811 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:36 smithi045 ceph-mon[130284]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:36.826 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:36 smithi194 ceph-mon[130905]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:36.827 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:36 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:16:36.402+0000 7f8641622200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-11T12:16:37.141 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:36 smithi045 systemd[1]: Starting Ceph mgr.y for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:16:37.142 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:36 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:16:36.824+0000 7f8641622200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-11T12:16:37.395 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:37 smithi045 podman[131730]: 2023-08-11T12:16:37.395 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:37 smithi045 bash[131730]: 3a1ae74e8a5c593efa623e0b0a408828548917a06e3f301b9dd26bf71489473d 2023-08-11T12:16:37.395 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:37 smithi045 ceph-mgr[131769]: -- 172.21.15.45:0/638631657 <== mon.2 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c7dbb2f1e0 con 0x55c7dbb04c00 2023-08-11T12:16:37.730 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:37 smithi045 systemd[1]: Started Ceph mgr.y for 815f94ae-3840-11ee-9b37-001a4aab830c. 2023-08-11T12:16:37.730 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:37 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:16:37.522+0000 7f259e5bd200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-11T12:16:37.730 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:37 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:16:37.618+0000 7f259e5bd200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-11T12:16:37.731 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:37 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:16:37.728+0000 7f259e5bd200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-11T12:16:37.893 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:37 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:16:37.489+0000 7f8641622200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-11T12:16:37.893 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:37 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:16:37.570+0000 7f8641622200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-11T12:16:38.059 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:37 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:16:37.843+0000 7f259e5bd200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-11T12:16:38.395 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:38 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:16:38.057+0000 7f259e5bd200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-11T12:16:38.659 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-08-11T12:16:38.660 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-08-11T12:16:38.660 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10+0 records in 2023-08-11T12:16:38.660 INFO:teuthology.orchestra.run.smithi008.stderr:10+0 records out 2023-08-11T12:16:38.660 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0300155 s, 349 MB/s 2023-08-11T12:16:38.660 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping successful for: 2023-08-11T12:16:38.678 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:38 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:38.678 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:38 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:38.678 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:38 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:38.678 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:38 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:38.679 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:38 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:16:38.679 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:38 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:16:38.404+0000 7f8641622200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-11T12:16:38.679 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:38 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:16:38.497+0000 7f8641622200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-11T12:16:38.679 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:38 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:16:38.675+0000 7f8641622200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-11T12:16:38.722 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:38 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:16:38.563+0000 7f259e5bd200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-11T12:16:38.724 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:38 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:38.724 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:38 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:38.725 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:38 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:38.725 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:38 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:38.725 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:38 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:16:38.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:38 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:38.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:38 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:38.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:38 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:38.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:38 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:38.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:38 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:16:39.125 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi008:vg_nvme/lv_4 2023-08-11T12:16:39.145 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:38 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:16:38.720+0000 7f259e5bd200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-11T12:16:39.145 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:38 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:16:38.833+0000 7f259e5bd200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-11T12:16:39.145 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:38 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:16:38.960+0000 7f259e5bd200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-11T12:16:39.377 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:38 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:16:38.989+0000 7f8641622200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-11T12:16:39.378 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:39 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:16:39.227+0000 7f8641622200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-11T12:16:39.643 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:39 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:16:39.375+0000 7f8641622200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-11T12:16:39.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:39 smithi194 ceph-mon[130905]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:39.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:39 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:39.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:39 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:39.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:39 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:39.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:39 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:39.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:39 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:39.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:39 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:16:39.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:39 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:39.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:39 smithi008 ceph-mon[97158]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:39.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:39 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:39.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:39 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:39.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:39 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:39.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:39 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:39.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:39 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:39.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:39 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:16:39.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:39 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:39.876 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:16:39.894 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:39 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:16:39.479+0000 7f259e5bd200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-11T12:16:39.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:39 smithi045 ceph-mon[130284]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:39.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:39 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:39.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:39 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:39.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:39 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:39.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:39 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:39.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:39 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:39.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:39 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:16:39.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:39 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:40.143 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:39 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:16:39.641+0000 7f8641622200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-11T12:16:40.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:40 smithi194 ceph-mon[130905]: Reconfiguring mgr.x (unknown last config time)... 2023-08-11T12:16:40.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:40 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-08-11T12:16:40.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:40 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-08-11T12:16:40.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:40 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:40.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:40 smithi194 ceph-mon[130905]: Reconfiguring daemon mgr.x on smithi008 2023-08-11T12:16:40.644 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:40 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:16:40.339+0000 7f8641622200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-11T12:16:40.644 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:40 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:16:40.469+0000 7f8641622200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-11T12:16:40.644 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:40 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:16:40.274+0000 7f259e5bd200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-11T12:16:40.644 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:40 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:16:40.373+0000 7f259e5bd200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-11T12:16:40.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:40 smithi045 ceph-mon[130284]: Reconfiguring mgr.x (unknown last config time)... 2023-08-11T12:16:40.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:40 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-08-11T12:16:40.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:40 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-08-11T12:16:40.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:40 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:40.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:40 smithi045 ceph-mon[130284]: Reconfiguring daemon mgr.x on smithi008 2023-08-11T12:16:40.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:40 smithi008 ceph-mon[97158]: Reconfiguring mgr.x (unknown last config time)... 2023-08-11T12:16:40.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:40 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-08-11T12:16:40.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:40 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-08-11T12:16:40.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:40 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:40.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:40 smithi008 ceph-mon[97158]: Reconfiguring daemon mgr.x on smithi008 2023-08-11T12:16:40.992 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:40 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:16:40.662+0000 7f8641622200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-11T12:16:40.992 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:40 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:16:40.774+0000 7f8641622200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-11T12:16:40.993 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:40 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:16:40.990+0000 7f8641622200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-11T12:16:41.644 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:41 smithi045 ceph-mon[130284]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:41.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:41 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:41.646 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:41 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:16:41.345+0000 7f259e5bd200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-11T12:16:41.646 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:41 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:16:41.456+0000 7f259e5bd200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-11T12:16:41.779 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:41 smithi008 ceph-mon[97158]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:41.779 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:41 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:41.852 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:41 smithi194 ceph-mon[130905]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:41.852 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:41 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:42.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.021+0000 7f2846200700 1 -- 172.21.15.8:0/1210621351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2840101bb0 msgr2=0x7f2840102010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:42.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.021+0000 7f2846200700 1 --2- 172.21.15.8:0/1210621351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2840101bb0 0x7f2840102010 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2834009920 tx=0x7f2834009c30 comp rx=0 tx=0).stop 2023-08-11T12:16:42.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.021+0000 7f2846200700 1 -- 172.21.15.8:0/1210621351 shutdown_connections 2023-08-11T12:16:42.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.021+0000 7f2846200700 1 --2- 172.21.15.8:0/1210621351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2840102550 0x7f2840108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:42.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.021+0000 7f2846200700 1 --2- 172.21.15.8:0/1210621351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28401009b0 0x7f2840100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:42.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.021+0000 7f2846200700 1 --2- 172.21.15.8:0/1210621351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2840101bb0 0x7f2840102010 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:42.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.021+0000 7f2846200700 1 -- 172.21.15.8:0/1210621351 >> 172.21.15.8:0/1210621351 conn(0x7f28400fbf10 msgr2=0x7f28400fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:16:42.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.021+0000 7f2846200700 1 -- 172.21.15.8:0/1210621351 shutdown_connections 2023-08-11T12:16:42.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.021+0000 7f2846200700 1 -- 172.21.15.8:0/1210621351 wait complete. 2023-08-11T12:16:42.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.022+0000 7f2846200700 1 Processor -- start 2023-08-11T12:16:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.022+0000 7f2846200700 1 -- start start 2023-08-11T12:16:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.023+0000 7f2846200700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28401009b0 0x7f2840198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:16:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.023+0000 7f2846200700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2840101bb0 0x7f2840198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:16:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.023+0000 7f2846200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2840102550 0x7f284019ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:16:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.023+0000 7f2846200700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28401a0500 con 0x7f28401009b0 2023-08-11T12:16:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.023+0000 7f2846200700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28401a0640 con 0x7f2840101bb0 2023-08-11T12:16:42.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.023+0000 7f2846200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28401a07d0 con 0x7f2840102550 2023-08-11T12:16:42.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.023+0000 7f283f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28401009b0 0x7f2840198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:16:42.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.023+0000 7f283effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2840101bb0 0x7f2840198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:16:42.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.023+0000 7f283f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28401009b0 0x7f2840198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50578/0 (socket says 172.21.15.8:50578) 2023-08-11T12:16:42.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.023+0000 7f283effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2840101bb0 0x7f2840198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:34690/0 (socket says 172.21.15.8:34690) 2023-08-11T12:16:42.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.023+0000 7f283f7fe700 1 -- 172.21.15.8:0/2529936553 learned_addr learned my addr 172.21.15.8:0/2529936553 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:16:42.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.023+0000 7f283ffff700 1 --2- 172.21.15.8:0/2529936553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2840102550 0x7f284019ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:16:42.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.023+0000 7f283effd700 1 -- 172.21.15.8:0/2529936553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2840102550 msgr2=0x7f284019ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:42.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.023+0000 7f283effd700 1 --2- 172.21.15.8:0/2529936553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2840102550 0x7f284019ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:42.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.023+0000 7f283effd700 1 -- 172.21.15.8:0/2529936553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28401009b0 msgr2=0x7f2840198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:16:42.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.023+0000 7f283effd700 1 --2- 172.21.15.8:0/2529936553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28401009b0 0x7f2840198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:16:42.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.023+0000 7f283effd700 1 -- 172.21.15.8:0/2529936553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2834009520 con 0x7f2840101bb0 2023-08-11T12:16:42.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.024+0000 7f283effd700 1 --2- 172.21.15.8:0/2529936553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2840101bb0 0x7f2840198eb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2834000c00 tx=0x7f283400b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:16:42.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.024+0000 7f283cff9700 1 -- 172.21.15.8:0/2529936553 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283401c070 con 0x7f2840101bb0 2023-08-11T12:16:42.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.024+0000 7f283cff9700 1 -- 172.21.15.8:0/2529936553 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f283400f7d0 con 0x7f2840101bb0 2023-08-11T12:16:42.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.024+0000 7f283cff9700 1 -- 172.21.15.8:0/2529936553 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2834003970 con 0x7f2840101bb0 2023-08-11T12:16:42.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.024+0000 7f2846200700 1 -- 172.21.15.8:0/2529936553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28401a0a50 con 0x7f2840101bb0 2023-08-11T12:16:42.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.024+0000 7f2846200700 1 -- 172.21.15.8:0/2529936553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28401a0e10 con 0x7f2840101bb0 2023-08-11T12:16:42.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.025+0000 7f283cff9700 1 -- 172.21.15.8:0/2529936553 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 13) v1 ==== 45190+0+0 (secure 0 0 0) 0x7f2834020030 con 0x7f2840101bb0 2023-08-11T12:16:42.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.025+0000 7f2846200700 1 -- 172.21.15.8:0/2529936553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2840192ff0 con 0x7f2840101bb0 2023-08-11T12:16:42.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.025+0000 7f283cff9700 1 --2- 172.21.15.8:0/2529936553 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f28280383e0 0x7f282803a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:16:42.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.025+0000 7f283cff9700 1 -- 172.21.15.8:0/2529936553 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f283404bac0 con 0x7f2840101bb0 2023-08-11T12:16:42.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.026+0000 7f283f7fe700 1 --2- 172.21.15.8:0/2529936553 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f28280383e0 0x7f282803a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:16:42.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.026+0000 7f283f7fe700 1 --2- 172.21.15.8:0/2529936553 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f28280383e0 0x7f282803a8a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2830009cf0 tx=0x7f2830009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:16:42.032 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:41 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:16:41.679+0000 7f259e5bd200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-11T12:16:42.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.031+0000 7f283cff9700 1 -- 172.21.15.8:0/2529936553 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f2834005690 con 0x7f2840101bb0 2023-08-11T12:16:42.143 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:16:41 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:16:41.849+0000 7f8641622200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-11T12:16:42.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.249+0000 7f2846200700 1 -- 172.21.15.8:0/2529936553 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f284010c200 con 0x7f28280383e0 2023-08-11T12:16:42.285 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:42 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:16:42.029+0000 7f259e5bd200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-11T12:16:42.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:42.528+0000 7f283cff9700 1 -- 172.21.15.8:0/2529936553 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mgrmap(e 14) v1 ==== 89902+0+0 (secure 0 0 0) 0x7f283404dd50 con 0x7f2840101bb0 2023-08-11T12:16:42.644 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:42 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:16:42.283+0000 7f259e5bd200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-11T12:16:42.645 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:42 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:16:42.465+0000 7f259e5bd200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-11T12:16:42.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:42 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:42.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:42 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:42.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:42 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:16:42.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:42 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:42.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:42 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:16:42.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:42 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:42.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:42 smithi045 ceph-mon[130284]: Standby manager daemon z started 2023-08-11T12:16:42.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:42 smithi045 ceph-mon[130284]: from='mgr.? 172.21.15.194:0/885595549' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-08-11T12:16:42.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:42 smithi045 ceph-mon[130284]: from='mgr.? 172.21.15.194:0/885595549' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-11T12:16:42.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:42 smithi045 ceph-mon[130284]: from='mgr.? 172.21.15.194:0/885595549' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-08-11T12:16:42.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:42 smithi045 ceph-mon[130284]: from='mgr.? 172.21.15.194:0/885595549' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-11T12:16:42.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:42 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:16:42.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:42 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:16:42.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:42 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:42.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:42 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:42.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:42 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:42.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:42 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:16:42.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:42 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:42.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:42 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:16:42.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:42 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:42.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:42 smithi008 ceph-mon[97158]: Standby manager daemon z started 2023-08-11T12:16:42.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:42 smithi008 ceph-mon[97158]: from='mgr.? 172.21.15.194:0/885595549' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-08-11T12:16:42.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:42 smithi008 ceph-mon[97158]: from='mgr.? 172.21.15.194:0/885595549' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-11T12:16:42.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:42 smithi008 ceph-mon[97158]: from='mgr.? 172.21.15.194:0/885595549' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-08-11T12:16:42.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:42 smithi008 ceph-mon[97158]: from='mgr.? 172.21.15.194:0/885595549' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-11T12:16:42.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:42 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:16:42.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:42 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:16:42.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:42 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:42.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:42 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:42.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:42 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:42.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:42 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:16:42.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:42 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:42.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:42 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:16:42.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:42 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:42.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:42 smithi194 ceph-mon[130905]: Standby manager daemon z started 2023-08-11T12:16:42.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:42 smithi194 ceph-mon[130905]: from='mgr.? 172.21.15.194:0/885595549' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-08-11T12:16:42.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:42 smithi194 ceph-mon[130905]: from='mgr.? 172.21.15.194:0/885595549' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-11T12:16:42.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:42 smithi194 ceph-mon[130905]: from='mgr.? 172.21.15.194:0/885595549' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-08-11T12:16:42.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:42 smithi194 ceph-mon[130905]: from='mgr.? 172.21.15.194:0/885595549' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-11T12:16:42.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:42 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:16:42.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:42 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:16:42.896 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:42 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:43.145 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:42 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:16:42.796+0000 7f259e5bd200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-11T12:16:43.665 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:43 smithi008 ceph-mon[97158]: from='client.24122 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:16:43.665 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:43 smithi008 ceph-mon[97158]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:43.665 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:43 smithi008 ceph-mon[97158]: mgrmap e14: x(active, since 72s), standbys: z 2023-08-11T12:16:43.666 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:43 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-08-11T12:16:43.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:43 smithi194 ceph-mon[130905]: from='client.24122 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:16:43.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:43 smithi194 ceph-mon[130905]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:43.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:43 smithi194 ceph-mon[130905]: mgrmap e14: x(active, since 72s), standbys: z 2023-08-11T12:16:43.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:43 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-08-11T12:16:43.894 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:43 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:16:43.619+0000 7f259e5bd200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-11T12:16:43.895 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:43 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:16:43.776+0000 7f259e5bd200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-11T12:16:43.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:43 smithi045 ceph-mon[130284]: from='client.24122 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:16:43.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:43 smithi045 ceph-mon[130284]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:43.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:43 smithi045 ceph-mon[130284]: mgrmap e14: x(active, since 72s), standbys: z 2023-08-11T12:16:43.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:43 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-08-11T12:16:44.395 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:44 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:16:44.022+0000 7f259e5bd200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-11T12:16:44.395 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:44 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:16:44.158+0000 7f259e5bd200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-11T12:16:44.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:44 smithi194 ceph-mon[130905]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:44.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:44 smithi045 ceph-mon[130284]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:44.895 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:44 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:16:44.431+0000 7f259e5bd200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-11T12:16:45.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:44 smithi008 ceph-mon[97158]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:45.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:45 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/266197675' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f903e393-7894-42d6-8b11-737ceef1f4c5"}]: dispatch 2023-08-11T12:16:45.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:45 smithi194 ceph-mon[130905]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f903e393-7894-42d6-8b11-737ceef1f4c5"}]: dispatch 2023-08-11T12:16:45.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:45 smithi194 ceph-mon[130905]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f903e393-7894-42d6-8b11-737ceef1f4c5"}]': finished 2023-08-11T12:16:45.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:45 smithi194 ceph-mon[130905]: osdmap e5: 1 total, 0 up, 1 in 2023-08-11T12:16:45.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:45 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-11T12:16:45.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:45 smithi194 ceph-mon[130905]: Standby manager daemon y started 2023-08-11T12:16:45.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:45 smithi194 ceph-mon[130905]: from='mgr.? 172.21.15.45:0/849071508' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-08-11T12:16:45.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:45 smithi194 ceph-mon[130905]: from='mgr.? 172.21.15.45:0/849071508' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-11T12:16:45.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:45 smithi194 ceph-mon[130905]: from='mgr.? 172.21.15.45:0/849071508' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-08-11T12:16:45.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:45 smithi194 ceph-mon[130905]: from='mgr.? 172.21.15.45:0/849071508' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-11T12:16:45.896 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:16:45 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:16:45.474+0000 7f259e5bd200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-11T12:16:45.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:45 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/266197675' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f903e393-7894-42d6-8b11-737ceef1f4c5"}]: dispatch 2023-08-11T12:16:45.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:45 smithi045 ceph-mon[130284]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f903e393-7894-42d6-8b11-737ceef1f4c5"}]: dispatch 2023-08-11T12:16:45.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:45 smithi045 ceph-mon[130284]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f903e393-7894-42d6-8b11-737ceef1f4c5"}]': finished 2023-08-11T12:16:45.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:45 smithi045 ceph-mon[130284]: osdmap e5: 1 total, 0 up, 1 in 2023-08-11T12:16:45.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:45 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-11T12:16:45.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:45 smithi045 ceph-mon[130284]: Standby manager daemon y started 2023-08-11T12:16:45.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:45 smithi045 ceph-mon[130284]: from='mgr.? 172.21.15.45:0/849071508' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-08-11T12:16:45.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:45 smithi045 ceph-mon[130284]: from='mgr.? 172.21.15.45:0/849071508' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-11T12:16:45.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:45 smithi045 ceph-mon[130284]: from='mgr.? 172.21.15.45:0/849071508' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-08-11T12:16:45.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:45 smithi045 ceph-mon[130284]: from='mgr.? 172.21.15.45:0/849071508' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-11T12:16:46.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:45 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/266197675' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f903e393-7894-42d6-8b11-737ceef1f4c5"}]: dispatch 2023-08-11T12:16:46.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:45 smithi008 ceph-mon[97158]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f903e393-7894-42d6-8b11-737ceef1f4c5"}]: dispatch 2023-08-11T12:16:46.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:45 smithi008 ceph-mon[97158]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f903e393-7894-42d6-8b11-737ceef1f4c5"}]': finished 2023-08-11T12:16:46.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:45 smithi008 ceph-mon[97158]: osdmap e5: 1 total, 0 up, 1 in 2023-08-11T12:16:46.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:45 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-11T12:16:46.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:45 smithi008 ceph-mon[97158]: Standby manager daemon y started 2023-08-11T12:16:46.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:45 smithi008 ceph-mon[97158]: from='mgr.? 172.21.15.45:0/849071508' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-08-11T12:16:46.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:45 smithi008 ceph-mon[97158]: from='mgr.? 172.21.15.45:0/849071508' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-11T12:16:46.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:45 smithi008 ceph-mon[97158]: from='mgr.? 172.21.15.45:0/849071508' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-08-11T12:16:46.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:45 smithi008 ceph-mon[97158]: from='mgr.? 172.21.15.45:0/849071508' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-11T12:16:46.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:16:46.320+0000 7f283cff9700 1 -- 172.21.15.8:0/2529936553 <== mon.2 v2:172.21.15.45:3300/0 8 ==== mgrmap(e 15) v1 ==== 134614+0+0 (secure 0 0 0) 0x7f2834003ad0 con 0x7f2840101bb0 2023-08-11T12:16:46.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:46 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2731399150' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:16:46.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:46 smithi194 ceph-mon[130905]: mgrmap e15: x(active, since 75s), standbys: z, y 2023-08-11T12:16:46.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:46 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-08-11T12:16:46.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:46 smithi194 ceph-mon[130905]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:46.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:46 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2731399150' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:16:46.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:46 smithi045 ceph-mon[130284]: mgrmap e15: x(active, since 75s), standbys: z, y 2023-08-11T12:16:46.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:46 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-08-11T12:16:46.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:46 smithi045 ceph-mon[130284]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:47.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:46 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2731399150' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:16:47.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:46 smithi008 ceph-mon[97158]: mgrmap e15: x(active, since 75s), standbys: z, y 2023-08-11T12:16:47.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:46 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-08-11T12:16:47.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:46 smithi008 ceph-mon[97158]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:49.797 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:49 smithi008 ceph-mon[97158]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:49.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:49 smithi194 ceph-mon[130905]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:49.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:49 smithi045 ceph-mon[130284]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:50.882 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:50 smithi008 ceph-mon[97158]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:50.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:50 smithi194 ceph-mon[130905]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:50.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:50 smithi045 ceph-mon[130284]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:53.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:53 smithi008 ceph-mon[97158]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:53.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-08-11T12:16:53.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:53.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:53 smithi194 ceph-mon[130905]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:53.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:53 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-08-11T12:16:53.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:53 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:53.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:53 smithi045 ceph-mon[130284]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:53.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:53 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-08-11T12:16:53.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:53 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:16:54.515 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:54 smithi008 ceph-mon[97158]: Deploying daemon osd.0 on smithi008 2023-08-11T12:16:54.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:54 smithi194 ceph-mon[130905]: Deploying daemon osd.0 on smithi008 2023-08-11T12:16:54.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:54 smithi045 ceph-mon[130284]: Deploying daemon osd.0 on smithi008 2023-08-11T12:16:55.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:55 smithi008 ceph-mon[97158]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:55.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:55 smithi194 ceph-mon[130905]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:55.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:55 smithi045 ceph-mon[130284]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:57.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:57 smithi008 ceph-mon[97158]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:57.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:57 smithi194 ceph-mon[130905]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:57.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:57 smithi045 ceph-mon[130284]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:59.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:59 smithi008 ceph-mon[97158]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:59.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:59 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:59.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:59 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:59.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:16:59 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:16:59.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:59 smithi194 ceph-mon[130905]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:59.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:59 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:59.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:59 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:59.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:16:59 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:16:59.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:59 smithi045 ceph-mon[130284]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:16:59.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:59 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:59.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:59 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:16:59.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:16:59 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:17:00.680 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:00 smithi008 ceph-mon[97158]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:17:00.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:00 smithi194 ceph-mon[130905]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:17:00.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:00 smithi045 ceph-mon[130284]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:17:02.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:02.713+0000 7f283cff9700 1 -- 172.21.15.8:0/2529936553 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f284010c200 con 0x7f28280383e0 2023-08-11T12:17:02.716 INFO:teuthology.orchestra.run.smithi008.stdout:Created osd(s) 0 on host 'smithi008' 2023-08-11T12:17:02.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:02.715+0000 7f2846200700 1 -- 172.21.15.8:0/2529936553 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f28280383e0 msgr2=0x7f282803a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:17:02.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:02.715+0000 7f2846200700 1 --2- 172.21.15.8:0/2529936553 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f28280383e0 0x7f282803a8a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2830009cf0 tx=0x7f2830009310 comp rx=0 tx=0).stop 2023-08-11T12:17:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:02.715+0000 7f2846200700 1 -- 172.21.15.8:0/2529936553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2840101bb0 msgr2=0x7f2840198eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:17:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:02.715+0000 7f2846200700 1 --2- 172.21.15.8:0/2529936553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2840101bb0 0x7f2840198eb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2834000c00 tx=0x7f283400b790 comp rx=0 tx=0).stop 2023-08-11T12:17:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:02.715+0000 7f2846200700 1 -- 172.21.15.8:0/2529936553 shutdown_connections 2023-08-11T12:17:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:02.716+0000 7f2846200700 1 --2- 172.21.15.8:0/2529936553 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f28280383e0 0x7f282803a8a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:17:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:02.716+0000 7f2846200700 1 --2- 172.21.15.8:0/2529936553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2840102550 0x7f284019ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:17:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:02.716+0000 7f2846200700 1 --2- 172.21.15.8:0/2529936553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28401009b0 0x7f2840198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:17:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:02.716+0000 7f2846200700 1 --2- 172.21.15.8:0/2529936553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2840101bb0 0x7f2840198eb0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:17:02.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:02.716+0000 7f2846200700 1 -- 172.21.15.8:0/2529936553 >> 172.21.15.8:0/2529936553 conn(0x7f28400fbf10 msgr2=0x7f2840107600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:17:02.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:02.716+0000 7f2846200700 1 -- 172.21.15.8:0/2529936553 shutdown_connections 2023-08-11T12:17:02.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:02.716+0000 7f2846200700 1 -- 172.21.15.8:0/2529936553 wait complete. 2023-08-11T12:17:03.233 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:02 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:03.233 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:02 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:03.234 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:02 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:03.234 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:02 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:17:03.234 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:02 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:03.234 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:02 smithi008 ceph-mon[97158]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:17:03.234 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:02 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:03.234 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:02 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:03.234 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:02 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:17:03.327 DEBUG:teuthology.orchestra.run.smithi008:osd.0> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.0.service 2023-08-11T12:17:03.331 INFO:tasks.cephadm:Deploying osd.1 on smithi045 with /dev/vg_nvme/lv_4... 2023-08-11T12:17:03.332 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-08-11T12:17:03.365 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:02 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:03.365 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:02 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:03.365 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:02 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:03.366 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:02 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:17:03.366 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:02 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:03.366 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:02 smithi045 ceph-mon[130284]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:17:03.366 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:02 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:03.366 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:02 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:03.366 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:02 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:17:03.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:02 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:03.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:02 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:03.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:02 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:03.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:02 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:17:03.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:02 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:03.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:02 smithi194 ceph-mon[130905]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:17:03.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:02 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:03.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:02 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:03.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:02 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:17:03.406 INFO:journalctl@ceph.osd.0.smithi008.stdout:-- Logs begin at Fri 2023-08-11 11:56:28 UTC. -- 2023-08-11T12:17:03.903 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.b/config 2023-08-11T12:17:04.230 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:03 smithi008 ceph-mon[97158]: from='osd.0 [v2:172.21.15.8:6802/664104961,v1:172.21.15.8:6803/664104961]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-08-11T12:17:04.231 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:03 smithi008 ceph-mon[97158]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-08-11T12:17:04.300 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:03 smithi045 ceph-mon[130284]: from='osd.0 [v2:172.21.15.8:6802/664104961,v1:172.21.15.8:6803/664104961]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-08-11T12:17:04.300 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:03 smithi045 ceph-mon[130284]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-08-11T12:17:04.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:03 smithi194 ceph-mon[130905]: from='osd.0 [v2:172.21.15.8:6802/664104961,v1:172.21.15.8:6803/664104961]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-08-11T12:17:04.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:03 smithi194 ceph-mon[130905]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-08-11T12:17:05.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:05 smithi008 ceph-mon[97158]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-08-11T12:17:05.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:05 smithi008 ceph-mon[97158]: osdmap e6: 1 total, 0 up, 1 in 2023-08-11T12:17:05.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:05 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-11T12:17:05.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:05 smithi008 ceph-mon[97158]: from='osd.0 [v2:172.21.15.8:6802/664104961,v1:172.21.15.8:6803/664104961]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-08-11T12:17:05.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:05 smithi008 ceph-mon[97158]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-08-11T12:17:05.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:05 smithi008 ceph-mon[97158]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:17:05.304 INFO:journalctl@ceph.osd.0.smithi008.stdout:Aug 11 12:17:05 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-0[110043]: 2023-08-11T12:17:05.003+0000 7f7cef65f700 -1 osd.0 0 waiting for initial osdmap 2023-08-11T12:17:05.305 INFO:journalctl@ceph.osd.0.smithi008.stdout:Aug 11 12:17:05 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-0[110043]: 2023-08-11T12:17:05.007+0000 7f7ce744c700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-11T12:17:05.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:05 smithi194 ceph-mon[130905]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-08-11T12:17:05.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:05 smithi194 ceph-mon[130905]: osdmap e6: 1 total, 0 up, 1 in 2023-08-11T12:17:05.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:05 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-11T12:17:05.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:05 smithi194 ceph-mon[130905]: from='osd.0 [v2:172.21.15.8:6802/664104961,v1:172.21.15.8:6803/664104961]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-08-11T12:17:05.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:05 smithi194 ceph-mon[130905]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-08-11T12:17:05.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:05 smithi194 ceph-mon[130905]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:17:05.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:05 smithi045 ceph-mon[130284]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-08-11T12:17:05.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:05 smithi045 ceph-mon[130284]: osdmap e6: 1 total, 0 up, 1 in 2023-08-11T12:17:05.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:05 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-11T12:17:05.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:05 smithi045 ceph-mon[130284]: from='osd.0 [v2:172.21.15.8:6802/664104961,v1:172.21.15.8:6803/664104961]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-08-11T12:17:05.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:05 smithi045 ceph-mon[130284]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-08-11T12:17:05.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:05 smithi045 ceph-mon[130284]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-11T12:17:05.624 INFO:teuthology.orchestra.run.smithi045.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-08-11T12:17:05.624 INFO:teuthology.orchestra.run.smithi045.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-08-11T12:17:05.625 INFO:teuthology.orchestra.run.smithi045.stderr: stderr: 10+0 records in 2023-08-11T12:17:05.625 INFO:teuthology.orchestra.run.smithi045.stderr:10+0 records out 2023-08-11T12:17:05.625 INFO:teuthology.orchestra.run.smithi045.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00816891 s, 1.3 GB/s 2023-08-11T12:17:05.625 INFO:teuthology.orchestra.run.smithi045.stderr:--> Zapping successful for: 2023-08-11T12:17:06.063 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi045:vg_nvme/lv_4 2023-08-11T12:17:06.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:06 smithi008 ceph-mon[97158]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-08-11T12:17:06.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:06 smithi008 ceph-mon[97158]: osdmap e7: 1 total, 0 up, 1 in 2023-08-11T12:17:06.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:06 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-11T12:17:06.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:06 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-11T12:17:06.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:06 smithi194 ceph-mon[130905]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-08-11T12:17:06.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:06 smithi194 ceph-mon[130905]: osdmap e7: 1 total, 0 up, 1 in 2023-08-11T12:17:06.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:06 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-11T12:17:06.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:06 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-11T12:17:06.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:06 smithi045 ceph-mon[130284]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-08-11T12:17:06.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:06 smithi045 ceph-mon[130284]: osdmap e7: 1 total, 0 up, 1 in 2023-08-11T12:17:06.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:06 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-11T12:17:06.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:06 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-11T12:17:06.669 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.b/config 2023-08-11T12:17:07.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:07 smithi045 ceph-mon[130284]: purged_snaps scrub starts 2023-08-11T12:17:07.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:07 smithi045 ceph-mon[130284]: purged_snaps scrub ok 2023-08-11T12:17:07.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:07 smithi045 ceph-mon[130284]: osd.0 [v2:172.21.15.8:6802/664104961,v1:172.21.15.8:6803/664104961] boot 2023-08-11T12:17:07.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:07 smithi045 ceph-mon[130284]: osdmap e8: 1 total, 1 up, 1 in 2023-08-11T12:17:07.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:07 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-11T12:17:07.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:07 smithi045 ceph-mon[130284]: Detected new or changed devices on smithi008 2023-08-11T12:17:07.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:07 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:07.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:07 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:07.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:07 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:17:07.148 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:07 smithi045 ceph-mon[130284]: Adjusting osd_memory_target on smithi008 to 17272M 2023-08-11T12:17:07.148 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:07 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:07.148 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:07 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:07.148 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:07 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:17:07.149 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:07 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:07.149 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:07 smithi045 ceph-mon[130284]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:07.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:07 smithi008 ceph-mon[97158]: purged_snaps scrub starts 2023-08-11T12:17:07.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:07 smithi008 ceph-mon[97158]: purged_snaps scrub ok 2023-08-11T12:17:07.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:07 smithi008 ceph-mon[97158]: osd.0 [v2:172.21.15.8:6802/664104961,v1:172.21.15.8:6803/664104961] boot 2023-08-11T12:17:07.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:07 smithi008 ceph-mon[97158]: osdmap e8: 1 total, 1 up, 1 in 2023-08-11T12:17:07.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:07 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-11T12:17:07.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:07 smithi008 ceph-mon[97158]: Detected new or changed devices on smithi008 2023-08-11T12:17:07.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:07 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:07.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:07 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:07.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:07 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:17:07.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:07 smithi008 ceph-mon[97158]: Adjusting osd_memory_target on smithi008 to 17272M 2023-08-11T12:17:07.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:07 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:07.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:07 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:07.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:07 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:17:07.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:07 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:07.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:07 smithi008 ceph-mon[97158]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:07.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:07 smithi194 ceph-mon[130905]: purged_snaps scrub starts 2023-08-11T12:17:07.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:07 smithi194 ceph-mon[130905]: purged_snaps scrub ok 2023-08-11T12:17:07.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:07 smithi194 ceph-mon[130905]: osd.0 [v2:172.21.15.8:6802/664104961,v1:172.21.15.8:6803/664104961] boot 2023-08-11T12:17:07.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:07 smithi194 ceph-mon[130905]: osdmap e8: 1 total, 1 up, 1 in 2023-08-11T12:17:07.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:07 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-11T12:17:07.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:07 smithi194 ceph-mon[130905]: Detected new or changed devices on smithi008 2023-08-11T12:17:07.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:07 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:07.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:07 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:07.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:07 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:17:07.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:07 smithi194 ceph-mon[130905]: Adjusting osd_memory_target on smithi008 to 17272M 2023-08-11T12:17:07.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:07 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:07.395 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:07 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:07.395 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:07 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:17:07.395 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:07 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:07.395 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:07 smithi194 ceph-mon[130905]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:07.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.946+0000 7fd4a8c8e700 1 -- 172.21.15.45:0/1687944752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4a40ff8b0 msgr2=0x7fd4a40ffcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:17:07.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.946+0000 7fd4a8c8e700 1 --2- 172.21.15.45:0/1687944752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4a40ff8b0 0x7fd4a40ffcd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd4940099c0 tx=0x7fd494009cd0 comp rx=0 tx=0).stop 2023-08-11T12:17:07.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.946+0000 7fd4a8c8e700 1 -- 172.21.15.45:0/1687944752 shutdown_connections 2023-08-11T12:17:07.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.946+0000 7fd4a8c8e700 1 --2- 172.21.15.45:0/1687944752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4a4101450 0x7fd4a4107d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:17:07.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.946+0000 7fd4a8c8e700 1 --2- 172.21.15.45:0/1687944752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4a40ff8b0 0x7fd4a40ffcd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:17:07.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.946+0000 7fd4a8c8e700 1 --2- 172.21.15.45:0/1687944752 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4a4100ab0 0x7fd4a4100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:17:07.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.946+0000 7fd4a8c8e700 1 -- 172.21.15.45:0/1687944752 >> 172.21.15.45:0/1687944752 conn(0x7fd4a40fae30 msgr2=0x7fd4a40fd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:17:07.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.946+0000 7fd4a8c8e700 1 -- 172.21.15.45:0/1687944752 shutdown_connections 2023-08-11T12:17:07.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.946+0000 7fd4a8c8e700 1 -- 172.21.15.45:0/1687944752 wait complete. 2023-08-11T12:17:07.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.947+0000 7fd4a8c8e700 1 Processor -- start 2023-08-11T12:17:07.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.947+0000 7fd4a8c8e700 1 -- start start 2023-08-11T12:17:07.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.947+0000 7fd4a8c8e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4a40ff8b0 0x7fd4a40697f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:17:07.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.947+0000 7fd4a8c8e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4a4100ab0 0x7fd4a419b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:17:07.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.947+0000 7fd4a8c8e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4a4101450 0x7fd4a419db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:17:07.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.947+0000 7fd4a8c8e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a419e2c0 con 0x7fd4a40ff8b0 2023-08-11T12:17:07.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.947+0000 7fd4a8c8e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a419e430 con 0x7fd4a4101450 2023-08-11T12:17:07.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.947+0000 7fd4a8c8e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a419e5f0 con 0x7fd4a4100ab0 2023-08-11T12:17:07.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.947+0000 7fd4a2d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4a4101450 0x7fd4a419db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:17:07.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.947+0000 7fd4a2d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4a4101450 0x7fd4a419db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43636/0 (socket says 172.21.15.45:43636) 2023-08-11T12:17:07.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.947+0000 7fd4a2d9d700 1 -- 172.21.15.45:0/4065483344 learned_addr learned my addr 172.21.15.45:0/4065483344 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-08-11T12:17:07.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.947+0000 7fd4a1d9b700 1 --2- 172.21.15.45:0/4065483344 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4a4100ab0 0x7fd4a419b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:17:07.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.947+0000 7fd4a259c700 1 --2- 172.21.15.45:0/4065483344 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4a40ff8b0 0x7fd4a40697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:17:07.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.947+0000 7fd4a2d9d700 1 -- 172.21.15.45:0/4065483344 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4a4100ab0 msgr2=0x7fd4a419b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:17:07.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.947+0000 7fd4a2d9d700 1 --2- 172.21.15.45:0/4065483344 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4a4100ab0 0x7fd4a419b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:17:07.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.947+0000 7fd4a2d9d700 1 -- 172.21.15.45:0/4065483344 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4a40ff8b0 msgr2=0x7fd4a40697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:17:07.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.947+0000 7fd4a2d9d700 1 --2- 172.21.15.45:0/4065483344 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4a40ff8b0 0x7fd4a40697f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:17:07.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.947+0000 7fd4a2d9d700 1 -- 172.21.15.45:0/4065483344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4940095f0 con 0x7fd4a4101450 2023-08-11T12:17:07.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.947+0000 7fd4a2d9d700 1 --2- 172.21.15.45:0/4065483344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4a4101450 0x7fd4a419db20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd49c00b970 tx=0x7fd49c00bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:17:07.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.948+0000 7fd4937fe700 1 -- 172.21.15.45:0/4065483344 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c00c930 con 0x7fd4a4101450 2023-08-11T12:17:07.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.948+0000 7fd4937fe700 1 -- 172.21.15.45:0/4065483344 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd49c014440 con 0x7fd4a4101450 2023-08-11T12:17:07.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.948+0000 7fd4937fe700 1 -- 172.21.15.45:0/4065483344 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c0075d0 con 0x7fd4a4101450 2023-08-11T12:17:07.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.948+0000 7fd4a8c8e700 1 -- 172.21.15.45:0/4065483344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a419e8d0 con 0x7fd4a4101450 2023-08-11T12:17:07.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.948+0000 7fd4a8c8e700 1 -- 172.21.15.45:0/4065483344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a419ee00 con 0x7fd4a4101450 2023-08-11T12:17:07.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.949+0000 7fd4a8c8e700 1 -- 172.21.15.45:0/4065483344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a410b1b0 con 0x7fd4a4101450 2023-08-11T12:17:07.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.950+0000 7fd4937fe700 1 -- 172.21.15.45:0/4065483344 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 15) v1 ==== 134614+0+0 (secure 0 0 0) 0x7fd49c0145b0 con 0x7fd4a4101450 2023-08-11T12:17:07.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.950+0000 7fd4937fe700 1 --2- 172.21.15.45:0/4065483344 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd48c09ffc0 0x7fd48c0a2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:17:07.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.951+0000 7fd4937fe700 1 -- 172.21.15.45:0/4065483344 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1767+0+0 (secure 0 0 0) 0x7fd49c006e40 con 0x7fd4a4101450 2023-08-11T12:17:07.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.951+0000 7fd4a259c700 1 --2- 172.21.15.45:0/4065483344 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd48c09ffc0 0x7fd48c0a2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:17:07.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.951+0000 7fd4a259c700 1 --2- 172.21.15.45:0/4065483344 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd48c09ffc0 0x7fd48c0a2480 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd49400b580 tx=0x7fd494005c00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:17:07.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:07.955+0000 7fd4937fe700 1 -- 172.21.15.45:0/4065483344 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fd49c094600 con 0x7fd4a4101450 2023-08-11T12:17:08.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:08.162+0000 7fd4a8c8e700 1 -- 172.21.15.45:0/4065483344 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4a4060d60 con 0x7fd48c09ffc0 2023-08-11T12:17:08.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:08 smithi008 ceph-mon[97158]: osdmap e9: 1 total, 1 up, 1 in 2023-08-11T12:17:08.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:08 smithi194 ceph-mon[130905]: osdmap e9: 1 total, 1 up, 1 in 2023-08-11T12:17:08.644 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:08 smithi045 ceph-mon[130284]: osdmap e9: 1 total, 1 up, 1 in 2023-08-11T12:17:09.349 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:09 smithi045 ceph-mon[130284]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:17:09.350 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:09 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:17:09.350 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:09 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:17:09.350 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:09 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:09.350 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:09 smithi045 ceph-mon[130284]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:09.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:09 smithi008 ceph-mon[97158]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:17:09.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:09 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:17:09.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:09 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:17:09.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:09 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:09.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:09 smithi008 ceph-mon[97158]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:09.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:09 smithi194 ceph-mon[130905]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:17:09.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:09 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:17:09.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:09 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:17:09.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:09 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:09.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:09 smithi194 ceph-mon[130905]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:10.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:10 smithi194 ceph-mon[130905]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:10.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:10 smithi045 ceph-mon[130284]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:11.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:10 smithi008 ceph-mon[97158]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:11.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:11 smithi194 ceph-mon[130905]: from='client.? 172.21.15.45:0/126566907' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e988e5c-e78c-46d5-80a5-dff7ac38cbeb"}]: dispatch 2023-08-11T12:17:11.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:11 smithi194 ceph-mon[130905]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e988e5c-e78c-46d5-80a5-dff7ac38cbeb"}]: dispatch 2023-08-11T12:17:11.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:11 smithi194 ceph-mon[130905]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e988e5c-e78c-46d5-80a5-dff7ac38cbeb"}]': finished 2023-08-11T12:17:11.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:11 smithi194 ceph-mon[130905]: osdmap e10: 2 total, 1 up, 2 in 2023-08-11T12:17:11.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:11 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-11T12:17:11.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:11 smithi194 ceph-mon[130905]: from='client.? 172.21.15.45:0/715813120' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:17:11.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:11 smithi045 ceph-mon[130284]: from='client.? 172.21.15.45:0/126566907' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e988e5c-e78c-46d5-80a5-dff7ac38cbeb"}]: dispatch 2023-08-11T12:17:11.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:11 smithi045 ceph-mon[130284]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e988e5c-e78c-46d5-80a5-dff7ac38cbeb"}]: dispatch 2023-08-11T12:17:11.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:11 smithi045 ceph-mon[130284]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e988e5c-e78c-46d5-80a5-dff7ac38cbeb"}]': finished 2023-08-11T12:17:11.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:11 smithi045 ceph-mon[130284]: osdmap e10: 2 total, 1 up, 2 in 2023-08-11T12:17:11.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:11 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-11T12:17:11.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:11 smithi045 ceph-mon[130284]: from='client.? 172.21.15.45:0/715813120' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:17:12.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:11 smithi008 ceph-mon[97158]: from='client.? 172.21.15.45:0/126566907' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e988e5c-e78c-46d5-80a5-dff7ac38cbeb"}]: dispatch 2023-08-11T12:17:12.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:11 smithi008 ceph-mon[97158]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e988e5c-e78c-46d5-80a5-dff7ac38cbeb"}]: dispatch 2023-08-11T12:17:12.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:11 smithi008 ceph-mon[97158]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e988e5c-e78c-46d5-80a5-dff7ac38cbeb"}]': finished 2023-08-11T12:17:12.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:11 smithi008 ceph-mon[97158]: osdmap e10: 2 total, 1 up, 2 in 2023-08-11T12:17:12.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:11 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-11T12:17:12.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:11 smithi008 ceph-mon[97158]: from='client.? 172.21.15.45:0/715813120' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:17:12.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:12 smithi194 ceph-mon[130905]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:12.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:12 smithi045 ceph-mon[130284]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:13.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:12 smithi008 ceph-mon[97158]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:15.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:15 smithi008 ceph-mon[97158]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:15.857 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:15 smithi045 ceph-mon[130284]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:15.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:15 smithi194 ceph-mon[130905]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:17.763 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:17 smithi045 ceph-mon[130284]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:17.763 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:17 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-08-11T12:17:17.763 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:17 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:17.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:17 smithi008 ceph-mon[97158]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:17.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:17 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-08-11T12:17:17.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:17 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:17.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:17 smithi194 ceph-mon[130905]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:17.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:17 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-08-11T12:17:17.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:17 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:18.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:18 smithi008 ceph-mon[97158]: Deploying daemon osd.1 on smithi045 2023-08-11T12:17:18.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:18 smithi194 ceph-mon[130905]: Deploying daemon osd.1 on smithi045 2023-08-11T12:17:18.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:18 smithi045 ceph-mon[130284]: Deploying daemon osd.1 on smithi045 2023-08-11T12:17:19.748 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:19 smithi045 ceph-mon[130284]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:19.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:19 smithi008 ceph-mon[97158]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:19.892 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:19 smithi194 ceph-mon[130905]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:20.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:20 smithi194 ceph-mon[130905]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:20.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:20 smithi045 ceph-mon[130284]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:21.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:20 smithi008 ceph-mon[97158]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:22.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:22 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:22.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:22 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:22.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:22 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:17:22.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:22 smithi045 ceph-mon[130284]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:22.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:22 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:22.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:22 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:22.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:22 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:17:22.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:22 smithi008 ceph-mon[97158]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:22.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:22 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:22.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:22 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:22.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:22 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:17:22.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:22 smithi194 ceph-mon[130905]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:24.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:24.178+0000 7fd4937fe700 1 -- 172.21.15.45:0/4065483344 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd4a4060d60 con 0x7fd48c09ffc0 2023-08-11T12:17:24.181 INFO:teuthology.orchestra.run.smithi045.stdout:Created osd(s) 1 on host 'smithi045' 2023-08-11T12:17:24.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:24.181+0000 7fd4a8c8e700 1 -- 172.21.15.45:0/4065483344 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd48c09ffc0 msgr2=0x7fd48c0a2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:17:24.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:24.181+0000 7fd4a8c8e700 1 --2- 172.21.15.45:0/4065483344 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd48c09ffc0 0x7fd48c0a2480 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd49400b580 tx=0x7fd494005c00 comp rx=0 tx=0).stop 2023-08-11T12:17:24.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:24.181+0000 7fd4a8c8e700 1 -- 172.21.15.45:0/4065483344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4a4101450 msgr2=0x7fd4a419db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:17:24.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:24.181+0000 7fd4a8c8e700 1 --2- 172.21.15.45:0/4065483344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4a4101450 0x7fd4a419db20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd49c00b970 tx=0x7fd49c00bc80 comp rx=0 tx=0).stop 2023-08-11T12:17:24.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:24.181+0000 7fd4a8c8e700 1 -- 172.21.15.45:0/4065483344 shutdown_connections 2023-08-11T12:17:24.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:24.181+0000 7fd4a8c8e700 1 --2- 172.21.15.45:0/4065483344 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd48c09ffc0 0x7fd48c0a2480 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:17:24.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:24.181+0000 7fd4a8c8e700 1 --2- 172.21.15.45:0/4065483344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4a4101450 0x7fd4a419db20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:17:24.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:24.181+0000 7fd4a8c8e700 1 --2- 172.21.15.45:0/4065483344 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4a40ff8b0 0x7fd4a40697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:17:24.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:24.181+0000 7fd4a8c8e700 1 --2- 172.21.15.45:0/4065483344 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4a4100ab0 0x7fd4a419b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:17:24.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:24.181+0000 7fd4a8c8e700 1 -- 172.21.15.45:0/4065483344 >> 172.21.15.45:0/4065483344 conn(0x7fd4a40fae30 msgr2=0x7fd4a40fd100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:17:24.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:24.181+0000 7fd4a8c8e700 1 -- 172.21.15.45:0/4065483344 shutdown_connections 2023-08-11T12:17:24.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:17:24.181+0000 7fd4a8c8e700 1 -- 172.21.15.45:0/4065483344 wait complete. 2023-08-11T12:17:24.655 DEBUG:teuthology.orchestra.run.smithi045:osd.1> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.1.service 2023-08-11T12:17:24.658 INFO:tasks.cephadm:Deploying osd.2 on smithi194 with /dev/vg_nvme/lv_4... 2023-08-11T12:17:24.659 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-08-11T12:17:24.692 INFO:journalctl@ceph.osd.1.smithi045.stdout:-- Logs begin at Fri 2023-08-11 11:52:16 UTC. -- 2023-08-11T12:17:24.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:24 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:24.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:24 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:24.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:24 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:24.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:24 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:17:24.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:24 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:24.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:24 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:24.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:24 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:24.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:24 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:17:24.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:24 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:24.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:24 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:24.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:24 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:24.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:24 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:17:24.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:24 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:24.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:24 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:24.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:24 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:24.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:24 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:17:24.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:24 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:24.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:24 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:24.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:24 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:24.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:24 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:17:24.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:24 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:24.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:24 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:24.898 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:24 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:24.898 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:24 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:17:25.221 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.c/config 2023-08-11T12:17:25.395 INFO:journalctl@ceph.osd.1.smithi045.stdout:Aug 11 12:17:25 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-1[135362]: 2023-08-11T12:17:25.223+0000 7fa31631d640 -1 osd.1 0 log_to_monitors true 2023-08-11T12:17:25.700 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:25 smithi194 ceph-mon[130905]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:25.701 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:25 smithi194 ceph-mon[130905]: from='osd.1 [v2:172.21.15.45:6800/4187350703,v1:172.21.15.45:6801/4187350703]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-08-11T12:17:25.701 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:25 smithi194 ceph-mon[130905]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-08-11T12:17:25.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:25 smithi008 ceph-mon[97158]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:25.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:25 smithi008 ceph-mon[97158]: from='osd.1 [v2:172.21.15.45:6800/4187350703,v1:172.21.15.45:6801/4187350703]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-08-11T12:17:25.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:25 smithi008 ceph-mon[97158]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-08-11T12:17:25.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:25 smithi045 ceph-mon[130284]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:25.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:25 smithi045 ceph-mon[130284]: from='osd.1 [v2:172.21.15.45:6800/4187350703,v1:172.21.15.45:6801/4187350703]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-08-11T12:17:25.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:25 smithi045 ceph-mon[130284]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-08-11T12:17:26.694 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-08-11T12:17:26.695 INFO:teuthology.orchestra.run.smithi194.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-08-11T12:17:26.695 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10+0 records in 2023-08-11T12:17:26.695 INFO:teuthology.orchestra.run.smithi194.stderr:10+0 records out 2023-08-11T12:17:26.695 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111417 s, 941 MB/s 2023-08-11T12:17:26.695 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping successful for: 2023-08-11T12:17:27.064 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi194:vg_nvme/lv_4 2023-08-11T12:17:27.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:27 smithi194 ceph-mon[130905]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-08-11T12:17:27.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:27 smithi194 ceph-mon[130905]: osdmap e11: 2 total, 1 up, 2 in 2023-08-11T12:17:27.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:27 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-11T12:17:27.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:27 smithi194 ceph-mon[130905]: from='osd.1 [v2:172.21.15.45:6800/4187350703,v1:172.21.15.45:6801/4187350703]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2023-08-11T12:17:27.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:27 smithi194 ceph-mon[130905]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2023-08-11T12:17:27.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:27 smithi194 ceph-mon[130905]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:27.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:27 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:27.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:27 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:27.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:27 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:17:27.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:27 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:27.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:27 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:27.395 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:27 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:17:27.395 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:27 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:27.395 INFO:journalctl@ceph.osd.1.smithi045.stdout:Aug 11 12:17:27 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-1[135362]: 2023-08-11T12:17:27.153+0000 7fa30b995700 -1 osd.1 0 waiting for initial osdmap 2023-08-11T12:17:27.396 INFO:journalctl@ceph.osd.1.smithi045.stdout:Aug 11 12:17:27 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-1[135362]: 2023-08-11T12:17:27.156+0000 7fa305f87700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-11T12:17:27.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:27 smithi045 ceph-mon[130284]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-08-11T12:17:27.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:27 smithi045 ceph-mon[130284]: osdmap e11: 2 total, 1 up, 2 in 2023-08-11T12:17:27.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-11T12:17:27.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:27 smithi045 ceph-mon[130284]: from='osd.1 [v2:172.21.15.45:6800/4187350703,v1:172.21.15.45:6801/4187350703]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2023-08-11T12:17:27.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:27 smithi045 ceph-mon[130284]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2023-08-11T12:17:27.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:27 smithi045 ceph-mon[130284]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:27.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:27.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:27.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:17:27.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:27.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:27.398 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:17:27.398 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:27.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:27 smithi008 ceph-mon[97158]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-08-11T12:17:27.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:27 smithi008 ceph-mon[97158]: osdmap e11: 2 total, 1 up, 2 in 2023-08-11T12:17:27.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:27 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-11T12:17:27.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:27 smithi008 ceph-mon[97158]: from='osd.1 [v2:172.21.15.45:6800/4187350703,v1:172.21.15.45:6801/4187350703]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2023-08-11T12:17:27.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:27 smithi008 ceph-mon[97158]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2023-08-11T12:17:27.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:27 smithi008 ceph-mon[97158]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-11T12:17:27.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:27 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:27.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:27 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:27.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:27 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:17:27.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:27 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:27.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:27 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:27.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:27 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:17:27.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:27 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:27.616 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.c/config 2023-08-11T12:17:28.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:28 smithi194 ceph-mon[130905]: Detected new or changed devices on smithi045 2023-08-11T12:17:28.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:28 smithi194 ceph-mon[130905]: Adjusting osd_memory_target on smithi045 to 17173M 2023-08-11T12:17:28.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:28 smithi194 ceph-mon[130905]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2023-08-11T12:17:28.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:28 smithi194 ceph-mon[130905]: osdmap e12: 2 total, 1 up, 2 in 2023-08-11T12:17:28.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:28 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-11T12:17:28.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:28 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-11T12:17:28.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:28 smithi008 ceph-mon[97158]: Detected new or changed devices on smithi045 2023-08-11T12:17:28.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:28 smithi008 ceph-mon[97158]: Adjusting osd_memory_target on smithi045 to 17173M 2023-08-11T12:17:28.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:28 smithi008 ceph-mon[97158]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2023-08-11T12:17:28.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:28 smithi008 ceph-mon[97158]: osdmap e12: 2 total, 1 up, 2 in 2023-08-11T12:17:28.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:28 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-11T12:17:28.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:28 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-11T12:17:28.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:28 smithi045 ceph-mon[130284]: Detected new or changed devices on smithi045 2023-08-11T12:17:28.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:28 smithi045 ceph-mon[130284]: Adjusting osd_memory_target on smithi045 to 17173M 2023-08-11T12:17:28.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:28 smithi045 ceph-mon[130284]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2023-08-11T12:17:28.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:28 smithi045 ceph-mon[130284]: osdmap e12: 2 total, 1 up, 2 in 2023-08-11T12:17:28.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:28 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-11T12:17:28.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:28 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-11T12:17:28.690 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.687+0000 7f89f6569700 1 -- 172.21.15.194:0/1368509479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89f0101450 msgr2=0x7f89f0107d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:17:28.690 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.687+0000 7f89f6569700 1 --2- 172.21.15.194:0/1368509479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89f0101450 0x7f89f0107d00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f89e800b0a0 tx=0x7f89e800b3b0 comp rx=0 tx=0).stop 2023-08-11T12:17:28.691 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.687+0000 7f89f6569700 1 -- 172.21.15.194:0/1368509479 shutdown_connections 2023-08-11T12:17:28.691 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.687+0000 7f89f6569700 1 --2- 172.21.15.194:0/1368509479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89f0101450 0x7f89f0107d00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:17:28.691 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.687+0000 7f89f6569700 1 --2- 172.21.15.194:0/1368509479 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89f00ff8b0 0x7f89f00ffcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:17:28.691 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.687+0000 7f89f6569700 1 --2- 172.21.15.194:0/1368509479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89f0100ab0 0x7f89f0100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:17:28.692 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.687+0000 7f89f6569700 1 -- 172.21.15.194:0/1368509479 >> 172.21.15.194:0/1368509479 conn(0x7f89f00fae30 msgr2=0x7f89f00fd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:17:28.692 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.688+0000 7f89f6569700 1 -- 172.21.15.194:0/1368509479 shutdown_connections 2023-08-11T12:17:28.692 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.688+0000 7f89f6569700 1 -- 172.21.15.194:0/1368509479 wait complete. 2023-08-11T12:17:28.694 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.688+0000 7f89f6569700 1 Processor -- start 2023-08-11T12:17:28.694 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.688+0000 7f89f6569700 1 -- start start 2023-08-11T12:17:28.695 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.689+0000 7f89f6569700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89f00ff8b0 0x7f89f0195620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:17:28.696 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.689+0000 7f89f6569700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89f0100ab0 0x7f89f0195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:17:28.696 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.689+0000 7f89f6569700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89f0101450 0x7f89f019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:17:28.696 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.689+0000 7f89f6569700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f019d1b0 con 0x7f89f0101450 2023-08-11T12:17:28.696 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.689+0000 7f89f6569700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f019d2f0 con 0x7f89f0100ab0 2023-08-11T12:17:28.697 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.689+0000 7f89f6569700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f019d480 con 0x7f89f00ff8b0 2023-08-11T12:17:28.697 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.689+0000 7f89effff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89f00ff8b0 0x7f89f0195620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:17:28.697 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.689+0000 7f89effff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89f00ff8b0 0x7f89f0195620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:40188/0 (socket says 172.21.15.194:40188) 2023-08-11T12:17:28.698 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.689+0000 7f89effff700 1 -- 172.21.15.194:0/1111354577 learned_addr learned my addr 172.21.15.194:0/1111354577 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-08-11T12:17:28.698 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.689+0000 7f89effff700 1 -- 172.21.15.194:0/1111354577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89f0100ab0 msgr2=0x7f89f0195b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:17:28.698 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.689+0000 7f89effff700 1 --2- 172.21.15.194:0/1111354577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89f0100ab0 0x7f89f0195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:17:28.698 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.689+0000 7f89effff700 1 -- 172.21.15.194:0/1111354577 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89f0101450 msgr2=0x7f89f019cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:17:28.699 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.689+0000 7f89effff700 1 --2- 172.21.15.194:0/1111354577 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89f0101450 0x7f89f019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:17:28.699 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.689+0000 7f89effff700 1 -- 172.21.15.194:0/1111354577 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e8009d00 con 0x7f89f00ff8b0 2023-08-11T12:17:28.699 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.689+0000 7f89effff700 1 --2- 172.21.15.194:0/1111354577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89f00ff8b0 0x7f89f0195620 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f89e000d9b0 tx=0x7f89e000dd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:17:28.699 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.689+0000 7f89ed7fa700 1 -- 172.21.15.194:0/1111354577 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e000be80 con 0x7f89f00ff8b0 2023-08-11T12:17:28.700 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.689+0000 7f89f6569700 1 -- 172.21.15.194:0/1111354577 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f019d760 con 0x7f89f00ff8b0 2023-08-11T12:17:28.700 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.689+0000 7f89ed7fa700 1 -- 172.21.15.194:0/1111354577 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f89e00044e0 con 0x7f89f00ff8b0 2023-08-11T12:17:28.700 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.690+0000 7f89ed7fa700 1 -- 172.21.15.194:0/1111354577 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e0003b40 con 0x7f89f00ff8b0 2023-08-11T12:17:28.700 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.690+0000 7f89f6569700 1 -- 172.21.15.194:0/1111354577 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f019dcb0 con 0x7f89f00ff8b0 2023-08-11T12:17:28.701 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.691+0000 7f89f6569700 1 -- 172.21.15.194:0/1111354577 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f0106dc0 con 0x7f89f00ff8b0 2023-08-11T12:17:28.702 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.692+0000 7f89ed7fa700 1 -- 172.21.15.194:0/1111354577 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 15) v1 ==== 134614+0+0 (secure 0 0 0) 0x7f89e0009940 con 0x7f89f00ff8b0 2023-08-11T12:17:28.702 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.693+0000 7f89ed7fa700 1 --2- 172.21.15.194:0/1111354577 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89d809ff40 0x7f89d80a2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:17:28.703 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.693+0000 7f89ed7fa700 1 -- 172.21.15.194:0/1111354577 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2309+0+0 (secure 0 0 0) 0x7f89e00c9a50 con 0x7f89f00ff8b0 2023-08-11T12:17:28.703 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.693+0000 7f89ef7fe700 1 --2- 172.21.15.194:0/1111354577 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89d809ff40 0x7f89d80a2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:17:28.703 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.694+0000 7f89ef7fe700 1 --2- 172.21.15.194:0/1111354577 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89d809ff40 0x7f89d80a2400 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f89e4005fd0 tx=0x7f89e4005d00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:17:28.703 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.697+0000 7f89ed7fa700 1 -- 172.21.15.194:0/1111354577 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f89e0095090 con 0x7f89f00ff8b0 2023-08-11T12:17:28.894 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:28.892+0000 7f89f6569700 1 -- 172.21.15.194:0/1111354577 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f89f002cf50 con 0x7f89d809ff40 2023-08-11T12:17:29.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:29 smithi008 ceph-mon[97158]: purged_snaps scrub starts 2023-08-11T12:17:29.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:29 smithi008 ceph-mon[97158]: purged_snaps scrub ok 2023-08-11T12:17:29.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:29 smithi008 ceph-mon[97158]: osd.1 [v2:172.21.15.45:6800/4187350703,v1:172.21.15.45:6801/4187350703] boot 2023-08-11T12:17:29.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:29 smithi008 ceph-mon[97158]: osdmap e13: 2 total, 2 up, 2 in 2023-08-11T12:17:29.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-11T12:17:29.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:29 smithi008 ceph-mon[97158]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:29.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:17:29.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:17:29.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:29.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:29 smithi194 ceph-mon[130905]: purged_snaps scrub starts 2023-08-11T12:17:29.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:29 smithi194 ceph-mon[130905]: purged_snaps scrub ok 2023-08-11T12:17:29.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:29 smithi194 ceph-mon[130905]: osd.1 [v2:172.21.15.45:6800/4187350703,v1:172.21.15.45:6801/4187350703] boot 2023-08-11T12:17:29.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:29 smithi194 ceph-mon[130905]: osdmap e13: 2 total, 2 up, 2 in 2023-08-11T12:17:29.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-11T12:17:29.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:29 smithi194 ceph-mon[130905]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:29.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:17:29.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:17:29.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:29.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:29 smithi045 ceph-mon[130284]: purged_snaps scrub starts 2023-08-11T12:17:29.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:29 smithi045 ceph-mon[130284]: purged_snaps scrub ok 2023-08-11T12:17:29.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:29 smithi045 ceph-mon[130284]: osd.1 [v2:172.21.15.45:6800/4187350703,v1:172.21.15.45:6801/4187350703] boot 2023-08-11T12:17:29.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:29 smithi045 ceph-mon[130284]: osdmap e13: 2 total, 2 up, 2 in 2023-08-11T12:17:29.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-11T12:17:29.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:29 smithi045 ceph-mon[130284]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:29.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:17:29.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:17:29.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:30.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:30 smithi194 ceph-mon[130905]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:17:30.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:30 smithi194 ceph-mon[130905]: osdmap e14: 2 total, 2 up, 2 in 2023-08-11T12:17:30.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:30 smithi008 ceph-mon[97158]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:17:30.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:30 smithi008 ceph-mon[97158]: osdmap e14: 2 total, 2 up, 2 in 2023-08-11T12:17:30.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:30 smithi045 ceph-mon[130284]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:17:30.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:30 smithi045 ceph-mon[130284]: osdmap e14: 2 total, 2 up, 2 in 2023-08-11T12:17:31.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:31 smithi008 ceph-mon[97158]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:31.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:31 smithi194 ceph-mon[130905]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:31.644 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:31 smithi045 ceph-mon[130284]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:32.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:32 smithi008 ceph-mon[97158]: from='client.? 172.21.15.194:0/2178304063' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1835217c-a93c-4181-b8b8-cc410bab1a89"}]: dispatch 2023-08-11T12:17:32.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:32 smithi008 ceph-mon[97158]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1835217c-a93c-4181-b8b8-cc410bab1a89"}]: dispatch 2023-08-11T12:17:32.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:32 smithi008 ceph-mon[97158]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1835217c-a93c-4181-b8b8-cc410bab1a89"}]': finished 2023-08-11T12:17:32.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:32 smithi008 ceph-mon[97158]: osdmap e15: 3 total, 2 up, 3 in 2023-08-11T12:17:32.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:32 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-11T12:17:32.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:32 smithi008 ceph-mon[97158]: from='client.? 172.21.15.194:0/423277841' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:17:32.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:32 smithi194 ceph-mon[130905]: from='client.? 172.21.15.194:0/2178304063' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1835217c-a93c-4181-b8b8-cc410bab1a89"}]: dispatch 2023-08-11T12:17:32.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:32 smithi194 ceph-mon[130905]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1835217c-a93c-4181-b8b8-cc410bab1a89"}]: dispatch 2023-08-11T12:17:32.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:32 smithi194 ceph-mon[130905]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1835217c-a93c-4181-b8b8-cc410bab1a89"}]': finished 2023-08-11T12:17:32.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:32 smithi194 ceph-mon[130905]: osdmap e15: 3 total, 2 up, 3 in 2023-08-11T12:17:32.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:32 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-11T12:17:32.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:32 smithi194 ceph-mon[130905]: from='client.? 172.21.15.194:0/423277841' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:17:32.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:32 smithi045 ceph-mon[130284]: from='client.? 172.21.15.194:0/2178304063' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1835217c-a93c-4181-b8b8-cc410bab1a89"}]: dispatch 2023-08-11T12:17:32.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:32 smithi045 ceph-mon[130284]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1835217c-a93c-4181-b8b8-cc410bab1a89"}]: dispatch 2023-08-11T12:17:32.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:32 smithi045 ceph-mon[130284]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1835217c-a93c-4181-b8b8-cc410bab1a89"}]': finished 2023-08-11T12:17:32.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:32 smithi045 ceph-mon[130284]: osdmap e15: 3 total, 2 up, 3 in 2023-08-11T12:17:32.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:32 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-11T12:17:32.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:32 smithi045 ceph-mon[130284]: from='client.? 172.21.15.194:0/423277841' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:17:33.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:33 smithi008 ceph-mon[97158]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:33.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:33 smithi194 ceph-mon[130905]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:33.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:33 smithi045 ceph-mon[130284]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:35.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:35 smithi008 ceph-mon[97158]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:35.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:35 smithi194 ceph-mon[130905]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:35.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:35 smithi045 ceph-mon[130284]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:37.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:37 smithi008 ceph-mon[97158]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:37.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:37 smithi194 ceph-mon[130905]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:37.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:37 smithi045 ceph-mon[130284]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:38.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:38 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-08-11T12:17:38.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:38 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:38.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:38 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-08-11T12:17:38.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:38 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:38.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:38 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-08-11T12:17:38.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:38 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:39.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:39 smithi008 ceph-mon[97158]: Deploying daemon osd.2 on smithi194 2023-08-11T12:17:39.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:39 smithi008 ceph-mon[97158]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:39.857 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:39 smithi194 ceph-mon[130905]: Deploying daemon osd.2 on smithi194 2023-08-11T12:17:39.857 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:39 smithi194 ceph-mon[130905]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:39.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:39 smithi045 ceph-mon[130284]: Deploying daemon osd.2 on smithi194 2023-08-11T12:17:39.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:39 smithi045 ceph-mon[130284]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:40.873 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:40 smithi194 ceph-mon[130905]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:40.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:40 smithi045 ceph-mon[130284]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:41.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:40 smithi008 ceph-mon[97158]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:42.831 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:42 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:42.831 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:42 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:42.831 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:42 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:17:42.831 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:42 smithi194 ceph-mon[130905]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:43.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:42 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:43.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:42 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:43.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:42 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:17:43.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:42 smithi008 ceph-mon[97158]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:43.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:42 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:43.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:42 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:43.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:42 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:17:43.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:42 smithi045 ceph-mon[130284]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:44.257 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 2 on host 'smithi194' 2023-08-11T12:17:44.258 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:44.255+0000 7f89ed7fa700 1 -- 172.21.15.194:0/1111354577 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f89f002cf50 con 0x7f89d809ff40 2023-08-11T12:17:44.260 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:44.257+0000 7f89f6569700 1 -- 172.21.15.194:0/1111354577 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89d809ff40 msgr2=0x7f89d80a2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:17:44.260 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:44.257+0000 7f89f6569700 1 --2- 172.21.15.194:0/1111354577 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89d809ff40 0x7f89d80a2400 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f89e4005fd0 tx=0x7f89e4005d00 comp rx=0 tx=0).stop 2023-08-11T12:17:44.260 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:44.258+0000 7f89f6569700 1 -- 172.21.15.194:0/1111354577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89f00ff8b0 msgr2=0x7f89f0195620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:17:44.261 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:44.258+0000 7f89f6569700 1 --2- 172.21.15.194:0/1111354577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89f00ff8b0 0x7f89f0195620 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f89e000d9b0 tx=0x7f89e000dd70 comp rx=0 tx=0).stop 2023-08-11T12:17:44.261 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:44.258+0000 7f89f6569700 1 -- 172.21.15.194:0/1111354577 shutdown_connections 2023-08-11T12:17:44.261 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:44.258+0000 7f89f6569700 1 --2- 172.21.15.194:0/1111354577 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89d809ff40 0x7f89d80a2400 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:17:44.261 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:44.258+0000 7f89f6569700 1 --2- 172.21.15.194:0/1111354577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89f00ff8b0 0x7f89f0195620 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:17:44.261 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:44.258+0000 7f89f6569700 1 --2- 172.21.15.194:0/1111354577 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89f0101450 0x7f89f019cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:17:44.261 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:44.258+0000 7f89f6569700 1 --2- 172.21.15.194:0/1111354577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89f0100ab0 0x7f89f0195b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:17:44.261 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:44.258+0000 7f89f6569700 1 -- 172.21.15.194:0/1111354577 >> 172.21.15.194:0/1111354577 conn(0x7f89f00fae30 msgr2=0x7f89f0103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:17:44.261 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:44.258+0000 7f89f6569700 1 -- 172.21.15.194:0/1111354577 shutdown_connections 2023-08-11T12:17:44.262 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:17:44.258+0000 7f89f6569700 1 -- 172.21.15.194:0/1111354577 wait complete. 2023-08-11T12:17:44.699 DEBUG:teuthology.orchestra.run.smithi194:osd.2> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.2.service 2023-08-11T12:17:44.701 INFO:tasks.cephadm:Deploying osd.3 on smithi008 with /dev/vg_nvme/lv_3... 2023-08-11T12:17:44.702 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-08-11T12:17:44.732 INFO:journalctl@ceph.osd.2.smithi194.stdout:-- Logs begin at Fri 2023-08-11 11:52:16 UTC. -- 2023-08-11T12:17:44.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:44 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:44.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:44 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:44.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:44 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:44.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:44 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:17:44.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:44 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:44.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:44 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:44.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:44 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:44.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:44 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:17:44.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:44 smithi194 ceph-mon[130905]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:44.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:44 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:44.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:44 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:44.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:44 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:44.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:44 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:17:44.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:44 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:44.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:44 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:44.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:44 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:44.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:44 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:17:44.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:44 smithi045 ceph-mon[130284]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:45.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:44 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:45.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:44 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:45.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:44 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:45.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:44 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:17:45.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:44 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:45.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:44 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:45.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:44 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:45.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:44 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:17:45.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:44 smithi008 ceph-mon[97158]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:45.440 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:17:45.893 INFO:journalctl@ceph.osd.2.smithi194.stdout:Aug 11 12:17:45 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-2[136715]: 2023-08-11T12:17:45.635+0000 7ffbda9d2640 -1 osd.2 0 log_to_monitors true 2023-08-11T12:17:46.408 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:46 smithi008 ceph-mon[97158]: from='osd.2 [v2:172.21.15.194:6800/2547818140,v1:172.21.15.194:6801/2547818140]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-08-11T12:17:46.408 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:46 smithi008 ceph-mon[97158]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-08-11T12:17:46.572 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:46 smithi194 ceph-mon[130905]: from='osd.2 [v2:172.21.15.194:6800/2547818140,v1:172.21.15.194:6801/2547818140]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-08-11T12:17:46.573 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:46 smithi194 ceph-mon[130905]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-08-11T12:17:46.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:46 smithi045 ceph-mon[130284]: from='osd.2 [v2:172.21.15.194:6800/2547818140,v1:172.21.15.194:6801/2547818140]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-08-11T12:17:46.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:46 smithi045 ceph-mon[130284]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-08-11T12:17:47.543 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-08-11T12:17:47.543 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-08-11T12:17:47.543 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10+0 records in 2023-08-11T12:17:47.543 INFO:teuthology.orchestra.run.smithi008.stderr:10+0 records out 2023-08-11T12:17:47.543 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0319029 s, 329 MB/s 2023-08-11T12:17:47.544 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping successful for: 2023-08-11T12:17:47.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:47 smithi008 ceph-mon[97158]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-08-11T12:17:47.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:47 smithi008 ceph-mon[97158]: osdmap e16: 3 total, 2 up, 3 in 2023-08-11T12:17:47.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:47 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-11T12:17:47.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:47 smithi008 ceph-mon[97158]: from='osd.2 [v2:172.21.15.194:6800/2547818140,v1:172.21.15.194:6801/2547818140]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2023-08-11T12:17:47.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:47 smithi008 ceph-mon[97158]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2023-08-11T12:17:47.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:47 smithi008 ceph-mon[97158]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:47.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:47 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:47.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:47 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:47.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:47 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:17:47.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:47 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:47.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:47 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:47.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:47 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:17:47.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:47 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:47.643 INFO:journalctl@ceph.osd.2.smithi194.stdout:Aug 11 12:17:47 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-2[136715]: 2023-08-11T12:17:47.241+0000 7ffbd004a700 -1 osd.2 0 waiting for initial osdmap 2023-08-11T12:17:47.643 INFO:journalctl@ceph.osd.2.smithi194.stdout:Aug 11 12:17:47 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-2[136715]: 2023-08-11T12:17:47.245+0000 7ffbca63c700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-11T12:17:47.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:47 smithi194 ceph-mon[130905]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-08-11T12:17:47.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:47 smithi194 ceph-mon[130905]: osdmap e16: 3 total, 2 up, 3 in 2023-08-11T12:17:47.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:47 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-11T12:17:47.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:47 smithi194 ceph-mon[130905]: from='osd.2 [v2:172.21.15.194:6800/2547818140,v1:172.21.15.194:6801/2547818140]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2023-08-11T12:17:47.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:47 smithi194 ceph-mon[130905]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2023-08-11T12:17:47.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:47 smithi194 ceph-mon[130905]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:47.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:47 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:47.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:47 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:47.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:47 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:17:47.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:47 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:47.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:47 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:47.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:47 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:17:47.646 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:47 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:47.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:47 smithi045 ceph-mon[130284]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-08-11T12:17:47.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:47 smithi045 ceph-mon[130284]: osdmap e16: 3 total, 2 up, 3 in 2023-08-11T12:17:47.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:47 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-11T12:17:47.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:47 smithi045 ceph-mon[130284]: from='osd.2 [v2:172.21.15.194:6800/2547818140,v1:172.21.15.194:6801/2547818140]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2023-08-11T12:17:47.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:47 smithi045 ceph-mon[130284]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2023-08-11T12:17:47.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:47 smithi045 ceph-mon[130284]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:47.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:47 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:47.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:47 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:47.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:47 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:17:47.648 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:47 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:47.648 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:47 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:47.648 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:47 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:17:47.648 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:47 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:48.123 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi008:vg_nvme/lv_3 2023-08-11T12:17:48.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:48 smithi008 ceph-mon[97158]: Detected new or changed devices on smithi194 2023-08-11T12:17:48.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:48 smithi008 ceph-mon[97158]: Adjusting osd_memory_target on smithi194 to 17168M 2023-08-11T12:17:48.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:48 smithi008 ceph-mon[97158]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2023-08-11T12:17:48.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:48 smithi008 ceph-mon[97158]: osdmap e17: 3 total, 2 up, 3 in 2023-08-11T12:17:48.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:48 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-11T12:17:48.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:48 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-11T12:17:48.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:48 smithi194 ceph-mon[130905]: Detected new or changed devices on smithi194 2023-08-11T12:17:48.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:48 smithi194 ceph-mon[130905]: Adjusting osd_memory_target on smithi194 to 17168M 2023-08-11T12:17:48.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:48 smithi194 ceph-mon[130905]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2023-08-11T12:17:48.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:48 smithi194 ceph-mon[130905]: osdmap e17: 3 total, 2 up, 3 in 2023-08-11T12:17:48.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:48 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-11T12:17:48.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:48 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-11T12:17:48.644 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:48 smithi045 ceph-mon[130284]: Detected new or changed devices on smithi194 2023-08-11T12:17:48.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:48 smithi045 ceph-mon[130284]: Adjusting osd_memory_target on smithi194 to 17168M 2023-08-11T12:17:48.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:48 smithi045 ceph-mon[130284]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2023-08-11T12:17:48.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:48 smithi045 ceph-mon[130284]: osdmap e17: 3 total, 2 up, 3 in 2023-08-11T12:17:48.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:48 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-11T12:17:48.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:48 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-11T12:17:48.858 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:17:49.507 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:49 smithi008 ceph-mon[97158]: purged_snaps scrub starts 2023-08-11T12:17:49.507 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:49 smithi008 ceph-mon[97158]: purged_snaps scrub ok 2023-08-11T12:17:49.507 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:49 smithi008 ceph-mon[97158]: osd.2 [v2:172.21.15.194:6800/2547818140,v1:172.21.15.194:6801/2547818140] boot 2023-08-11T12:17:49.507 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:49 smithi008 ceph-mon[97158]: osdmap e18: 3 total, 3 up, 3 in 2023-08-11T12:17:49.507 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:49 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-11T12:17:49.507 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:49 smithi008 ceph-mon[97158]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:49.508 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:49 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-08-11T12:17:49.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:49 smithi194 ceph-mon[130905]: purged_snaps scrub starts 2023-08-11T12:17:49.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:49 smithi194 ceph-mon[130905]: purged_snaps scrub ok 2023-08-11T12:17:49.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:49 smithi194 ceph-mon[130905]: osd.2 [v2:172.21.15.194:6800/2547818140,v1:172.21.15.194:6801/2547818140] boot 2023-08-11T12:17:49.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:49 smithi194 ceph-mon[130905]: osdmap e18: 3 total, 3 up, 3 in 2023-08-11T12:17:49.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:49 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-11T12:17:49.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:49 smithi194 ceph-mon[130905]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:49.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:49 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-08-11T12:17:49.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:49 smithi045 ceph-mon[130284]: purged_snaps scrub starts 2023-08-11T12:17:49.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:49 smithi045 ceph-mon[130284]: purged_snaps scrub ok 2023-08-11T12:17:49.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:49 smithi045 ceph-mon[130284]: osd.2 [v2:172.21.15.194:6800/2547818140,v1:172.21.15.194:6801/2547818140] boot 2023-08-11T12:17:49.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:49 smithi045 ceph-mon[130284]: osdmap e18: 3 total, 3 up, 3 in 2023-08-11T12:17:49.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:49 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-11T12:17:49.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:49 smithi045 ceph-mon[130284]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-11T12:17:49.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:49 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-08-11T12:17:50.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:50 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-08-11T12:17:50.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:50 smithi008 ceph-mon[97158]: osdmap e19: 3 total, 3 up, 3 in 2023-08-11T12:17:50.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:50 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-08-11T12:17:50.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.607+0000 7fafe5ac5700 1 -- 172.21.15.8:0/3097334191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fafe01009b0 msgr2=0x7fafe0100dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:17:50.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.607+0000 7fafe5ac5700 1 --2- 172.21.15.8:0/3097334191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fafe01009b0 0x7fafe0100dd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fafd00099c0 tx=0x7fafd0009cd0 comp rx=0 tx=0).stop 2023-08-11T12:17:50.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.607+0000 7fafe5ac5700 1 -- 172.21.15.8:0/3097334191 shutdown_connections 2023-08-11T12:17:50.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.607+0000 7fafe5ac5700 1 --2- 172.21.15.8:0/3097334191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafe0102550 0x7fafe0108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:17:50.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.607+0000 7fafe5ac5700 1 --2- 172.21.15.8:0/3097334191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fafe01009b0 0x7fafe0100dd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:17:50.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.607+0000 7fafe5ac5700 1 --2- 172.21.15.8:0/3097334191 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafe0101bb0 0x7fafe0102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:17:50.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.607+0000 7fafe5ac5700 1 -- 172.21.15.8:0/3097334191 >> 172.21.15.8:0/3097334191 conn(0x7fafe00fbf10 msgr2=0x7fafe00fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:17:50.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.607+0000 7fafe5ac5700 1 -- 172.21.15.8:0/3097334191 shutdown_connections 2023-08-11T12:17:50.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.607+0000 7fafe5ac5700 1 -- 172.21.15.8:0/3097334191 wait complete. 2023-08-11T12:17:50.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.609+0000 7fafe5ac5700 1 Processor -- start 2023-08-11T12:17:50.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.609+0000 7fafe5ac5700 1 -- start start 2023-08-11T12:17:50.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.609+0000 7fafe5ac5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fafe01009b0 0x7fafe0198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:17:50.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.609+0000 7fafe5ac5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafe0101bb0 0x7fafe0198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:17:50.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.610+0000 7fafe5ac5700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafe0102550 0x7fafe019fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:17:50.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.610+0000 7fafe5ac5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe01a03d0 con 0x7fafe01009b0 2023-08-11T12:17:50.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.610+0000 7fafe5ac5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe01a0510 con 0x7fafe0101bb0 2023-08-11T12:17:50.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.610+0000 7fafe5ac5700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe01a06a0 con 0x7fafe0102550 2023-08-11T12:17:50.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.610+0000 7fafdf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fafe01009b0 0x7fafe0198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:17:50.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.610+0000 7fafdf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fafe01009b0 0x7fafe0198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49410/0 (socket says 172.21.15.8:49410) 2023-08-11T12:17:50.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.610+0000 7fafdf7fe700 1 -- 172.21.15.8:0/3871087638 learned_addr learned my addr 172.21.15.8:0/3871087638 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:17:50.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.610+0000 7fafdffff700 1 --2- 172.21.15.8:0/3871087638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafe0102550 0x7fafe019fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:17:50.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.610+0000 7fafdeffd700 1 --2- 172.21.15.8:0/3871087638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafe0101bb0 0x7fafe0198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:17:50.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.610+0000 7fafdf7fe700 1 -- 172.21.15.8:0/3871087638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafe0102550 msgr2=0x7fafe019fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:17:50.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.610+0000 7fafdf7fe700 1 --2- 172.21.15.8:0/3871087638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafe0102550 0x7fafe019fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:17:50.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.610+0000 7fafdf7fe700 1 -- 172.21.15.8:0/3871087638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafe0101bb0 msgr2=0x7fafe0198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:17:50.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.610+0000 7fafdf7fe700 1 --2- 172.21.15.8:0/3871087638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafe0101bb0 0x7fafe0198d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:17:50.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.610+0000 7fafdf7fe700 1 -- 172.21.15.8:0/3871087638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd00095f0 con 0x7fafe01009b0 2023-08-11T12:17:50.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.611+0000 7fafdf7fe700 1 --2- 172.21.15.8:0/3871087638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fafe01009b0 0x7fafe0198840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fafd00098e0 tx=0x7fafd0009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:17:50.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.611+0000 7fafdcff9700 1 -- 172.21.15.8:0/3871087638 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd001d070 con 0x7fafe01009b0 2023-08-11T12:17:50.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.611+0000 7fafdcff9700 1 -- 172.21.15.8:0/3871087638 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fafd0005030 con 0x7fafe01009b0 2023-08-11T12:17:50.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.611+0000 7fafdcff9700 1 -- 172.21.15.8:0/3871087638 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd0004a90 con 0x7fafe01009b0 2023-08-11T12:17:50.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.611+0000 7fafe5ac5700 1 -- 172.21.15.8:0/3871087638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe01a0920 con 0x7fafe01009b0 2023-08-11T12:17:50.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.611+0000 7fafe5ac5700 1 -- 172.21.15.8:0/3871087638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe01a0ce0 con 0x7fafe01009b0 2023-08-11T12:17:50.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.612+0000 7fafe5ac5700 1 -- 172.21.15.8:0/3871087638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe0192fa0 con 0x7fafe01009b0 2023-08-11T12:17:50.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.615+0000 7fafdcff9700 1 -- 172.21.15.8:0/3871087638 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 15) v1 ==== 134614+0+0 (secure 0 0 0) 0x7fafd00051a0 con 0x7fafe01009b0 2023-08-11T12:17:50.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.616+0000 7fafdcff9700 1 --2- 172.21.15.8:0/3871087638 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fafc809ff40 0x7fafc80a2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:17:50.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.616+0000 7fafdcff9700 1 -- 172.21.15.8:0/3871087638 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3237+0+0 (secure 0 0 0) 0x7fafd00caeb0 con 0x7fafe01009b0 2023-08-11T12:17:50.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.616+0000 7fafdeffd700 1 --2- 172.21.15.8:0/3871087638 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fafc809ff40 0x7fafc80a2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:17:50.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.617+0000 7fafdeffd700 1 --2- 172.21.15.8:0/3871087638 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fafc809ff40 0x7fafc80a2400 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fafd4009c60 tx=0x7fafd4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:17:50.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.619+0000 7fafdcff9700 1 -- 172.21.15.8:0/3871087638 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fafd00960e0 con 0x7fafe01009b0 2023-08-11T12:17:50.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:50 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-08-11T12:17:50.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:50 smithi194 ceph-mon[130905]: osdmap e19: 3 total, 3 up, 3 in 2023-08-11T12:17:50.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:50 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-08-11T12:17:50.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:50 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-08-11T12:17:50.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:50 smithi045 ceph-mon[130284]: osdmap e19: 3 total, 3 up, 3 in 2023-08-11T12:17:50.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:50 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-08-11T12:17:50.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:50.838+0000 7fafe5ac5700 1 -- 172.21.15.8:0/3871087638 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fafe002cd70 con 0x7fafc809ff40 2023-08-11T12:17:51.267 INFO:journalctl@ceph.osd.0.smithi008.stdout:Aug 11 12:17:50 smithi008 sudo[112982]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-08-11T12:17:51.267 INFO:journalctl@ceph.osd.0.smithi008.stdout:Aug 11 12:17:50 smithi008 sudo[112982]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-11T12:17:51.267 INFO:journalctl@ceph.osd.0.smithi008.stdout:Aug 11 12:17:50 smithi008 sudo[112982]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-11T12:17:51.268 INFO:journalctl@ceph.osd.0.smithi008.stdout:Aug 11 12:17:50 smithi008 sudo[112982]: pam_unix(sudo:session): session closed for user root 2023-08-11T12:17:51.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:17:51.271+0000 7fafdcff9700 1 -- 172.21.15.8:0/3871087638 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fafd00964b0 con 0x7fafe01009b0 2023-08-11T12:17:51.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:51 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-08-11T12:17:51.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:51 smithi008 ceph-mon[97158]: osdmap e20: 3 total, 3 up, 3 in 2023-08-11T12:17:51.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:51 smithi008 ceph-mon[97158]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-11T12:17:51.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:51 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:17:51.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:51 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:17:51.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:51 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:51.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:51 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-08-11T12:17:51.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:51 smithi194 ceph-mon[130905]: osdmap e20: 3 total, 3 up, 3 in 2023-08-11T12:17:51.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:51 smithi194 ceph-mon[130905]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-11T12:17:51.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:51 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:17:51.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:51 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:17:51.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:51 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:51.644 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:51 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-08-11T12:17:51.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:51 smithi045 ceph-mon[130284]: osdmap e20: 3 total, 3 up, 3 in 2023-08-11T12:17:51.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:51 smithi045 ceph-mon[130284]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-11T12:17:51.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:51 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:17:51.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:51 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:17:51.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:51 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:17:51.929 INFO:journalctl@ceph.osd.0.smithi008.stdout:Aug 11 12:17:51 smithi008 sudo[113039]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-08-11T12:17:51.929 INFO:journalctl@ceph.osd.0.smithi008.stdout:Aug 11 12:17:51 smithi008 sudo[113039]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-11T12:17:51.930 INFO:journalctl@ceph.osd.0.smithi008.stdout:Aug 11 12:17:51 smithi008 sudo[113039]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-11T12:17:51.930 INFO:journalctl@ceph.osd.0.smithi008.stdout:Aug 11 12:17:51 smithi008 sudo[113039]: pam_unix(sudo:session): session closed for user root 2023-08-11T12:17:52.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:52 smithi045 ceph-mon[130284]: from='client.14265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:17:52.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:52 smithi045 ceph-mon[130284]: osdmap e21: 3 total, 3 up, 3 in 2023-08-11T12:17:52.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:52 smithi045 ceph-mon[130284]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-08-11T12:17:52.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:52 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:52.395 INFO:journalctl@ceph.osd.1.smithi045.stdout:Aug 11 12:17:52 smithi045 sudo[137660]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-08-11T12:17:52.396 INFO:journalctl@ceph.osd.1.smithi045.stdout:Aug 11 12:17:52 smithi045 sudo[137660]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-11T12:17:52.396 INFO:journalctl@ceph.osd.1.smithi045.stdout:Aug 11 12:17:52 smithi045 sudo[137660]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-11T12:17:52.396 INFO:journalctl@ceph.osd.1.smithi045.stdout:Aug 11 12:17:52 smithi045 sudo[137660]: pam_unix(sudo:session): session closed for user root 2023-08-11T12:17:52.513 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:52 smithi008 ceph-mon[97158]: from='client.14265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:17:52.514 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:52 smithi008 ceph-mon[97158]: osdmap e21: 3 total, 3 up, 3 in 2023-08-11T12:17:52.514 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:52 smithi008 ceph-mon[97158]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-08-11T12:17:52.514 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:52 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:52.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:52 smithi194 ceph-mon[130905]: from='client.14265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:17:52.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:52 smithi194 ceph-mon[130905]: osdmap e21: 3 total, 3 up, 3 in 2023-08-11T12:17:52.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:52 smithi194 ceph-mon[130905]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-08-11T12:17:52.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:52 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:52.895 INFO:journalctl@ceph.osd.1.smithi045.stdout:Aug 11 12:17:52 smithi045 sudo[137663]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-08-11T12:17:52.895 INFO:journalctl@ceph.osd.1.smithi045.stdout:Aug 11 12:17:52 smithi045 sudo[137663]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-11T12:17:52.895 INFO:journalctl@ceph.osd.1.smithi045.stdout:Aug 11 12:17:52 smithi045 sudo[137663]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-11T12:17:52.895 INFO:journalctl@ceph.osd.1.smithi045.stdout:Aug 11 12:17:52 smithi045 sudo[137663]: pam_unix(sudo:session): session closed for user root 2023-08-11T12:17:53.006 INFO:journalctl@ceph.osd.2.smithi194.stdout:Aug 11 12:17:52 smithi194 sudo[138839]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-08-11T12:17:53.007 INFO:journalctl@ceph.osd.2.smithi194.stdout:Aug 11 12:17:52 smithi194 sudo[138839]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-11T12:17:53.007 INFO:journalctl@ceph.osd.2.smithi194.stdout:Aug 11 12:17:52 smithi194 sudo[138839]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-11T12:17:53.007 INFO:journalctl@ceph.osd.2.smithi194.stdout:Aug 11 12:17:52 smithi194 sudo[138839]: pam_unix(sudo:session): session closed for user root 2023-08-11T12:17:53.393 INFO:journalctl@ceph.osd.2.smithi194.stdout:Aug 11 12:17:53 smithi194 sudo[138842]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-08-11T12:17:53.393 INFO:journalctl@ceph.osd.2.smithi194.stdout:Aug 11 12:17:53 smithi194 sudo[138842]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-11T12:17:53.393 INFO:journalctl@ceph.osd.2.smithi194.stdout:Aug 11 12:17:53 smithi194 sudo[138842]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-11T12:17:53.393 INFO:journalctl@ceph.osd.2.smithi194.stdout:Aug 11 12:17:53 smithi194 sudo[138842]: pam_unix(sudo:session): session closed for user root 2023-08-11T12:17:54.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:53 smithi008 sudo[113174]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-08-11T12:17:54.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:53 smithi008 sudo[113174]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-11T12:17:54.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:53 smithi008 sudo[113174]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-11T12:17:54.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:53 smithi008 sudo[113174]: pam_unix(sudo:session): session closed for user root 2023-08-11T12:17:54.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:54 smithi194 ceph-mon[130905]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-11T12:17:54.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:54 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:54.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:54 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:54.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:54 smithi194 ceph-mon[130905]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-08-11T12:17:54.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:54 smithi194 sudo[138845]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-08-11T12:17:54.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:54 smithi194 sudo[138845]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-11T12:17:54.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:54 smithi194 sudo[138845]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-11T12:17:54.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:54 smithi045 ceph-mon[130284]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-11T12:17:54.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:54 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:54.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:54 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:54.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:54 smithi045 ceph-mon[130284]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-08-11T12:17:54.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:54 smithi008 sudo[113199]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-08-11T12:17:54.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:54 smithi008 sudo[113199]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-11T12:17:54.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:54 smithi008 sudo[113199]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-11T12:17:54.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:54 smithi008 sudo[113199]: pam_unix(sudo:session): session closed for user root 2023-08-11T12:17:54.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:54 smithi008 ceph-mon[97158]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-11T12:17:54.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:54 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:54.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:54 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:17:54.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:54 smithi008 ceph-mon[97158]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-08-11T12:17:54.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:54 smithi194 sudo[138845]: pam_unix(sudo:session): session closed for user root 2023-08-11T12:17:54.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:54 smithi194 sudo[138848]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-08-11T12:17:54.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:54 smithi194 sudo[138848]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-11T12:17:54.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:54 smithi194 sudo[138848]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-11T12:17:54.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:54 smithi194 sudo[138848]: pam_unix(sudo:session): session closed for user root 2023-08-11T12:17:55.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:55 smithi045 sudo[137666]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-08-11T12:17:55.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:55 smithi045 sudo[137666]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-11T12:17:55.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:55 smithi045 sudo[137666]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-11T12:17:55.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:55 smithi045 sudo[137666]: pam_unix(sudo:session): session closed for user root 2023-08-11T12:17:55.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:55 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/697280993' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b55ae61a-731c-4312-a998-661122b84788"}]: dispatch 2023-08-11T12:17:55.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:55 smithi008 ceph-mon[97158]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-08-11T12:17:55.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:55 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-11T12:17:55.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:55 smithi008 ceph-mon[97158]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b55ae61a-731c-4312-a998-661122b84788"}]: dispatch 2023-08-11T12:17:55.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:55 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:17:55.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:55 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:17:55.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:55 smithi008 ceph-mon[97158]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b55ae61a-731c-4312-a998-661122b84788"}]': finished 2023-08-11T12:17:55.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:55 smithi008 ceph-mon[97158]: osdmap e22: 4 total, 3 up, 4 in 2023-08-11T12:17:55.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:55 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-11T12:17:55.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:55 smithi008 ceph-mon[97158]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-08-11T12:17:55.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:55 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-11T12:17:55.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:55 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:17:55.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:55 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:17:55.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:55 smithi008 ceph-mon[97158]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-11T12:17:55.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:55 smithi008 ceph-mon[97158]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-08-11T12:17:55.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:55 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-11T12:17:55.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:55 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:17:55.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:55 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:17:55.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:55 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3596162153' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:17:55.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:55 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/697280993' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b55ae61a-731c-4312-a998-661122b84788"}]: dispatch 2023-08-11T12:17:55.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:55 smithi194 ceph-mon[130905]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-08-11T12:17:55.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:55 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-11T12:17:55.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:55 smithi194 ceph-mon[130905]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b55ae61a-731c-4312-a998-661122b84788"}]: dispatch 2023-08-11T12:17:55.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:55 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:17:55.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:55 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:17:55.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:55 smithi194 ceph-mon[130905]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b55ae61a-731c-4312-a998-661122b84788"}]': finished 2023-08-11T12:17:55.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:55 smithi194 ceph-mon[130905]: osdmap e22: 4 total, 3 up, 4 in 2023-08-11T12:17:55.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:55 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-11T12:17:55.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:55 smithi194 ceph-mon[130905]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-08-11T12:17:55.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:55 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-11T12:17:55.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:55 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:17:55.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:55 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:17:55.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:55 smithi194 ceph-mon[130905]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-11T12:17:55.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:55 smithi194 ceph-mon[130905]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-08-11T12:17:55.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:55 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-11T12:17:55.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:55 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:17:55.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:55 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:17:55.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:55 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3596162153' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:17:55.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:55 smithi045 sudo[137669]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-08-11T12:17:55.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:55 smithi045 sudo[137669]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-11T12:17:55.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:55 smithi045 sudo[137669]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-11T12:17:55.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:55 smithi045 sudo[137669]: pam_unix(sudo:session): session closed for user root 2023-08-11T12:17:55.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:55 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/697280993' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b55ae61a-731c-4312-a998-661122b84788"}]: dispatch 2023-08-11T12:17:55.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:55 smithi045 ceph-mon[130284]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-08-11T12:17:55.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:55 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-11T12:17:55.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:55 smithi045 ceph-mon[130284]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b55ae61a-731c-4312-a998-661122b84788"}]: dispatch 2023-08-11T12:17:55.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:55 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:17:55.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:55 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:17:55.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:55 smithi045 ceph-mon[130284]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b55ae61a-731c-4312-a998-661122b84788"}]': finished 2023-08-11T12:17:55.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:55 smithi045 ceph-mon[130284]: osdmap e22: 4 total, 3 up, 4 in 2023-08-11T12:17:55.898 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:55 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-11T12:17:55.898 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:55 smithi045 ceph-mon[130284]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-08-11T12:17:55.898 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:55 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-11T12:17:55.898 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:55 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:17:55.898 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:55 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:17:55.898 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:55 smithi045 ceph-mon[130284]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-11T12:17:55.898 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:55 smithi045 ceph-mon[130284]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-08-11T12:17:55.898 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:55 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-11T12:17:55.899 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:55 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:17:55.899 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:55 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:17:55.899 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:55 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3596162153' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:17:56.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:56 smithi008 ceph-mon[97158]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-08-11T12:17:56.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:56 smithi008 ceph-mon[97158]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-08-11T12:17:56.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:56 smithi194 ceph-mon[130905]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-08-11T12:17:56.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:56 smithi194 ceph-mon[130905]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-08-11T12:17:56.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:56 smithi045 ceph-mon[130284]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-08-11T12:17:56.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:56 smithi045 ceph-mon[130284]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-08-11T12:17:57.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:57 smithi008 ceph-mon[97158]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-11T12:17:57.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:57 smithi194 ceph-mon[130905]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-11T12:17:57.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:57 smithi045 ceph-mon[130284]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-11T12:17:58.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:17:58 smithi194 ceph-mon[130905]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 61 KiB/s wr, 5 op/s 2023-08-11T12:17:58.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:17:58 smithi045 ceph-mon[130284]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 61 KiB/s wr, 5 op/s 2023-08-11T12:17:59.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:17:58 smithi008 ceph-mon[97158]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 61 KiB/s wr, 5 op/s 2023-08-11T12:18:00.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:00 smithi194 ceph-mon[130905]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 41 KiB/s wr, 3 op/s 2023-08-11T12:18:00.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:00 smithi045 ceph-mon[130284]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 41 KiB/s wr, 3 op/s 2023-08-11T12:18:01.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:00 smithi008 ceph-mon[97158]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 41 KiB/s wr, 3 op/s 2023-08-11T12:18:02.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:01 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-08-11T12:18:02.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:01 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:02.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:01 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-08-11T12:18:02.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:01 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:02.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:01 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-08-11T12:18:02.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:01 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:02.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:02 smithi008 ceph-mon[97158]: Deploying daemon osd.3 on smithi008 2023-08-11T12:18:02.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:02 smithi008 ceph-mon[97158]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 31 KiB/s wr, 3 op/s 2023-08-11T12:18:03.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:02 smithi194 ceph-mon[130905]: Deploying daemon osd.3 on smithi008 2023-08-11T12:18:03.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:02 smithi194 ceph-mon[130905]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 31 KiB/s wr, 3 op/s 2023-08-11T12:18:03.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:02 smithi045 ceph-mon[130284]: Deploying daemon osd.3 on smithi008 2023-08-11T12:18:03.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:02 smithi045 ceph-mon[130284]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 31 KiB/s wr, 3 op/s 2023-08-11T12:18:05.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:05 smithi008 ceph-mon[97158]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 992 B/s rd, 25 KiB/s wr, 2 op/s 2023-08-11T12:18:05.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:05 smithi194 ceph-mon[130905]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 992 B/s rd, 25 KiB/s wr, 2 op/s 2023-08-11T12:18:05.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:05 smithi045 ceph-mon[130284]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 992 B/s rd, 25 KiB/s wr, 2 op/s 2023-08-11T12:18:07.775 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:07 smithi008 ceph-mon[97158]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-08-11T12:18:07.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:07 smithi194 ceph-mon[130905]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-08-11T12:18:07.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:07 smithi045 ceph-mon[130284]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-08-11T12:18:09.265 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:08 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:09.265 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:08 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:09.265 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:08 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:18:09.265 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:08 smithi008 ceph-mon[97158]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-08-11T12:18:09.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:08 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:09.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:08 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:09.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:08 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:18:09.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:08 smithi194 ceph-mon[130905]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-08-11T12:18:09.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:08 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:09.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:08 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:09.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:08 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:18:09.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:08 smithi045 ceph-mon[130284]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-08-11T12:18:10.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:10 smithi008 ceph-mon[97158]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-11T12:18:10.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:10 smithi194 ceph-mon[130905]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-11T12:18:10.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:10 smithi045 ceph-mon[130284]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-11T12:18:11.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:11.654+0000 7fafdcff9700 1 -- 172.21.15.8:0/3871087638 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fafe002cd70 con 0x7fafc809ff40 2023-08-11T12:18:11.658 INFO:teuthology.orchestra.run.smithi008.stdout:Created osd(s) 3 on host 'smithi008' 2023-08-11T12:18:11.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:11.657+0000 7fafe5ac5700 1 -- 172.21.15.8:0/3871087638 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fafc809ff40 msgr2=0x7fafc80a2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:18:11.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:11.657+0000 7fafe5ac5700 1 --2- 172.21.15.8:0/3871087638 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fafc809ff40 0x7fafc80a2400 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fafd4009c60 tx=0x7fafd4009260 comp rx=0 tx=0).stop 2023-08-11T12:18:11.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:11.657+0000 7fafe5ac5700 1 -- 172.21.15.8:0/3871087638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fafe01009b0 msgr2=0x7fafe0198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:18:11.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:11.657+0000 7fafe5ac5700 1 --2- 172.21.15.8:0/3871087638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fafe01009b0 0x7fafe0198840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fafd00098e0 tx=0x7fafd0009580 comp rx=0 tx=0).stop 2023-08-11T12:18:11.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:11.657+0000 7fafe5ac5700 1 -- 172.21.15.8:0/3871087638 shutdown_connections 2023-08-11T12:18:11.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:11.657+0000 7fafe5ac5700 1 --2- 172.21.15.8:0/3871087638 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fafc809ff40 0x7fafc80a2400 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:18:11.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:11.657+0000 7fafe5ac5700 1 --2- 172.21.15.8:0/3871087638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafe0102550 0x7fafe019fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:18:11.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:11.657+0000 7fafe5ac5700 1 --2- 172.21.15.8:0/3871087638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fafe01009b0 0x7fafe0198840 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:18:11.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:11.657+0000 7fafe5ac5700 1 --2- 172.21.15.8:0/3871087638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafe0101bb0 0x7fafe0198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:18:11.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:11.657+0000 7fafe5ac5700 1 -- 172.21.15.8:0/3871087638 >> 172.21.15.8:0/3871087638 conn(0x7fafe00fbf10 msgr2=0x7fafe0107530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:18:11.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:11.658+0000 7fafe5ac5700 1 -- 172.21.15.8:0/3871087638 shutdown_connections 2023-08-11T12:18:11.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:11.658+0000 7fafe5ac5700 1 -- 172.21.15.8:0/3871087638 wait complete. 2023-08-11T12:18:11.967 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:11 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:11.967 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:11 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:11.967 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:11 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:11.968 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:11 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:18:11.968 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:11 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:11.968 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:11 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:11.968 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:11 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:18:11.968 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:11 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:12.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:11 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:12.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:11 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:12.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:11 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:12.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:11 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:18:12.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:11 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:12.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:11 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:12.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:11 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:18:12.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:11 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:12.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:11 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:12.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:11 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:12.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:11 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:12.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:11 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:18:12.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:11 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:12.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:11 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:12.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:11 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:18:12.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:11 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:12.187 DEBUG:teuthology.orchestra.run.smithi008:osd.3> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.3.service 2023-08-11T12:18:12.191 INFO:tasks.cephadm:Deploying osd.4 on smithi045 with /dev/vg_nvme/lv_3... 2023-08-11T12:18:12.192 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-08-11T12:18:12.268 INFO:journalctl@ceph.osd.3.smithi008.stdout:-- Logs begin at Fri 2023-08-11 11:56:28 UTC. -- 2023-08-11T12:18:12.762 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.b/config 2023-08-11T12:18:13.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:12 smithi008 ceph-mon[97158]: from='osd.3 [v2:172.21.15.8:6810/187418883,v1:172.21.15.8:6811/187418883]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-08-11T12:18:13.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:12 smithi008 ceph-mon[97158]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-11T12:18:13.123 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:12 smithi045 ceph-mon[130284]: from='osd.3 [v2:172.21.15.8:6810/187418883,v1:172.21.15.8:6811/187418883]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-08-11T12:18:13.123 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:12 smithi045 ceph-mon[130284]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-11T12:18:13.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:12 smithi194 ceph-mon[130905]: from='osd.3 [v2:172.21.15.8:6810/187418883,v1:172.21.15.8:6811/187418883]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-08-11T12:18:13.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:12 smithi194 ceph-mon[130905]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-11T12:18:14.027 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:13 smithi045 ceph-mon[130284]: from='osd.3 [v2:172.21.15.8:6810/187418883,v1:172.21.15.8:6811/187418883]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-08-11T12:18:14.027 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:13 smithi045 ceph-mon[130284]: osdmap e23: 4 total, 3 up, 4 in 2023-08-11T12:18:14.028 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:13 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-11T12:18:14.028 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:13 smithi045 ceph-mon[130284]: from='osd.3 [v2:172.21.15.8:6810/187418883,v1:172.21.15.8:6811/187418883]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-08-11T12:18:14.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:13 smithi008 ceph-mon[97158]: from='osd.3 [v2:172.21.15.8:6810/187418883,v1:172.21.15.8:6811/187418883]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-08-11T12:18:14.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:13 smithi008 ceph-mon[97158]: osdmap e23: 4 total, 3 up, 4 in 2023-08-11T12:18:14.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:13 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-11T12:18:14.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:13 smithi008 ceph-mon[97158]: from='osd.3 [v2:172.21.15.8:6810/187418883,v1:172.21.15.8:6811/187418883]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-08-11T12:18:14.054 INFO:journalctl@ceph.osd.3.smithi008.stdout:Aug 11 12:18:13 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-3[115429]: 2023-08-11T12:18:13.871+0000 7fb065ca1700 -1 osd.3 0 waiting for initial osdmap 2023-08-11T12:18:14.054 INFO:journalctl@ceph.osd.3.smithi008.stdout:Aug 11 12:18:13 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-3[115429]: 2023-08-11T12:18:13.877+0000 7fb05fa92700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-11T12:18:14.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:13 smithi194 ceph-mon[130905]: from='osd.3 [v2:172.21.15.8:6810/187418883,v1:172.21.15.8:6811/187418883]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-08-11T12:18:14.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:13 smithi194 ceph-mon[130905]: osdmap e23: 4 total, 3 up, 4 in 2023-08-11T12:18:14.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:13 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-11T12:18:14.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:13 smithi194 ceph-mon[130905]: from='osd.3 [v2:172.21.15.8:6810/187418883,v1:172.21.15.8:6811/187418883]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-08-11T12:18:14.465 INFO:teuthology.orchestra.run.smithi045.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-08-11T12:18:14.465 INFO:teuthology.orchestra.run.smithi045.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-08-11T12:18:14.465 INFO:teuthology.orchestra.run.smithi045.stderr: stderr: 10+0 records in 2023-08-11T12:18:14.465 INFO:teuthology.orchestra.run.smithi045.stderr:10+0 records out 2023-08-11T12:18:14.465 INFO:teuthology.orchestra.run.smithi045.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0080371 s, 1.3 GB/s 2023-08-11T12:18:14.466 INFO:teuthology.orchestra.run.smithi045.stderr:--> Zapping successful for: 2023-08-11T12:18:14.913 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi045:vg_nvme/lv_3 2023-08-11T12:18:15.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:14 smithi194 ceph-mon[130905]: from='osd.3 [v2:172.21.15.8:6810/187418883,v1:172.21.15.8:6811/187418883]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-08-11T12:18:15.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:14 smithi194 ceph-mon[130905]: osdmap e24: 4 total, 3 up, 4 in 2023-08-11T12:18:15.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:14 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-11T12:18:15.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:14 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-11T12:18:15.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:14 smithi194 ceph-mon[130905]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-11T12:18:15.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:14 smithi194 ceph-mon[130905]: osd.3 [v2:172.21.15.8:6810/187418883,v1:172.21.15.8:6811/187418883] boot 2023-08-11T12:18:15.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:14 smithi194 ceph-mon[130905]: osdmap e25: 4 total, 4 up, 4 in 2023-08-11T12:18:15.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:14 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-11T12:18:15.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:14 smithi045 ceph-mon[130284]: from='osd.3 [v2:172.21.15.8:6810/187418883,v1:172.21.15.8:6811/187418883]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-08-11T12:18:15.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:14 smithi045 ceph-mon[130284]: osdmap e24: 4 total, 3 up, 4 in 2023-08-11T12:18:15.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:14 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-11T12:18:15.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:14 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-11T12:18:15.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:14 smithi045 ceph-mon[130284]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-11T12:18:15.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:14 smithi045 ceph-mon[130284]: osd.3 [v2:172.21.15.8:6810/187418883,v1:172.21.15.8:6811/187418883] boot 2023-08-11T12:18:15.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:14 smithi045 ceph-mon[130284]: osdmap e25: 4 total, 4 up, 4 in 2023-08-11T12:18:15.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:14 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-11T12:18:15.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:14 smithi008 ceph-mon[97158]: from='osd.3 [v2:172.21.15.8:6810/187418883,v1:172.21.15.8:6811/187418883]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-08-11T12:18:15.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:14 smithi008 ceph-mon[97158]: osdmap e24: 4 total, 3 up, 4 in 2023-08-11T12:18:15.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:14 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-11T12:18:15.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:14 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-11T12:18:15.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:14 smithi008 ceph-mon[97158]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-11T12:18:15.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:14 smithi008 ceph-mon[97158]: osd.3 [v2:172.21.15.8:6810/187418883,v1:172.21.15.8:6811/187418883] boot 2023-08-11T12:18:15.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:14 smithi008 ceph-mon[97158]: osdmap e25: 4 total, 4 up, 4 in 2023-08-11T12:18:15.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:14 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-11T12:18:15.472 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.b/config 2023-08-11T12:18:15.981 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:15 smithi045 ceph-mon[130284]: purged_snaps scrub starts 2023-08-11T12:18:15.982 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:15 smithi045 ceph-mon[130284]: purged_snaps scrub ok 2023-08-11T12:18:15.982 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:15 smithi045 ceph-mon[130284]: Detected new or changed devices on smithi008 2023-08-11T12:18:15.982 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:15 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:15.982 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:15 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:15.982 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:15 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:18:15.982 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:15 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:18:15.982 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:15 smithi045 ceph-mon[130284]: Adjusting osd_memory_target on smithi008 to 8636M 2023-08-11T12:18:15.983 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:15 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:15.983 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:15 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:15.983 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:15 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:18:15.983 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:15 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:15.983 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:15 smithi045 ceph-mon[130284]: osdmap e26: 4 total, 4 up, 4 in 2023-08-11T12:18:16.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:15 smithi194 ceph-mon[130905]: purged_snaps scrub starts 2023-08-11T12:18:16.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:15 smithi194 ceph-mon[130905]: purged_snaps scrub ok 2023-08-11T12:18:16.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:15 smithi194 ceph-mon[130905]: Detected new or changed devices on smithi008 2023-08-11T12:18:16.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:15 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:16.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:15 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:16.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:15 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:18:16.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:15 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:18:16.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:15 smithi194 ceph-mon[130905]: Adjusting osd_memory_target on smithi008 to 8636M 2023-08-11T12:18:16.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:15 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:16.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:15 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:16.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:15 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:18:16.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:15 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:16.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:15 smithi194 ceph-mon[130905]: osdmap e26: 4 total, 4 up, 4 in 2023-08-11T12:18:16.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:15 smithi008 ceph-mon[97158]: purged_snaps scrub starts 2023-08-11T12:18:16.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:15 smithi008 ceph-mon[97158]: purged_snaps scrub ok 2023-08-11T12:18:16.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:15 smithi008 ceph-mon[97158]: Detected new or changed devices on smithi008 2023-08-11T12:18:16.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:15 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:16.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:15 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:16.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:15 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:18:16.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:15 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:18:16.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:15 smithi008 ceph-mon[97158]: Adjusting osd_memory_target on smithi008 to 8636M 2023-08-11T12:18:16.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:15 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:16.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:15 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:16.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:15 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:18:16.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:15 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:16.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:15 smithi008 ceph-mon[97158]: osdmap e26: 4 total, 4 up, 4 in 2023-08-11T12:18:16.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.769+0000 7f200e2d8700 1 -- 172.21.15.45:0/3148294239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2008103df0 msgr2=0x7f20081061e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:18:16.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.769+0000 7f200e2d8700 1 --2- 172.21.15.45:0/3148294239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2008103df0 0x7f20081061e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8009990 tx=0x7f1ff8009ca0 comp rx=0 tx=0).stop 2023-08-11T12:18:16.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.769+0000 7f200e2d8700 1 -- 172.21.15.45:0/3148294239 shutdown_connections 2023-08-11T12:18:16.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.769+0000 7f200e2d8700 1 --2- 172.21.15.45:0/3148294239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2008106720 0x7f2008108b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:18:16.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.769+0000 7f200e2d8700 1 --2- 172.21.15.45:0/3148294239 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20081014c0 0x7f20081038b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:18:16.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.769+0000 7f200e2d8700 1 --2- 172.21.15.45:0/3148294239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2008103df0 0x7f20081061e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:18:16.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.769+0000 7f200e2d8700 1 -- 172.21.15.45:0/3148294239 >> 172.21.15.45:0/3148294239 conn(0x7f20080fae30 msgr2=0x7f20080fd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:18:16.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.769+0000 7f200e2d8700 1 -- 172.21.15.45:0/3148294239 shutdown_connections 2023-08-11T12:18:16.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.769+0000 7f200e2d8700 1 -- 172.21.15.45:0/3148294239 wait complete. 2023-08-11T12:18:16.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.770+0000 7f200e2d8700 1 Processor -- start 2023-08-11T12:18:16.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.770+0000 7f200e2d8700 1 -- start start 2023-08-11T12:18:16.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.770+0000 7f200e2d8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20081014c0 0x7f2008100e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:18:16.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.770+0000 7f200e2d8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2008103df0 0x7f20080ff470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:18:16.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.770+0000 7f200e2d8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2008106720 0x7f20080ff9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:18:16.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.770+0000 7f200e2d8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2008100130 con 0x7f20081014c0 2023-08-11T12:18:16.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.770+0000 7f200e2d8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20081002a0 con 0x7f2008106720 2023-08-11T12:18:16.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.770+0000 7f200e2d8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20081a0810 con 0x7f2008103df0 2023-08-11T12:18:16.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.770+0000 7f200c875700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2008106720 0x7f20080ff9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:18:16.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.770+0000 7f200c875700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2008106720 0x7f20080ff9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43714/0 (socket says 172.21.15.45:43714) 2023-08-11T12:18:16.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.770+0000 7f200c875700 1 -- 172.21.15.45:0/2751289625 learned_addr learned my addr 172.21.15.45:0/2751289625 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-08-11T12:18:16.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.770+0000 7f20077fe700 1 --2- 172.21.15.45:0/2751289625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2008103df0 0x7f20080ff470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:18:16.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.770+0000 7f200c875700 1 -- 172.21.15.45:0/2751289625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2008103df0 msgr2=0x7f20080ff470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:18:16.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.770+0000 7f200c875700 1 --2- 172.21.15.45:0/2751289625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2008103df0 0x7f20080ff470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:18:16.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.770+0000 7f200c875700 1 -- 172.21.15.45:0/2751289625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20081014c0 msgr2=0x7f2008100e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:18:16.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.770+0000 7f200c875700 1 --2- 172.21.15.45:0/2751289625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20081014c0 0x7f2008100e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:18:16.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.770+0000 7f200c875700 1 -- 172.21.15.45:0/2751289625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff80095f0 con 0x7f2008106720 2023-08-11T12:18:16.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.771+0000 7f200c875700 1 --2- 172.21.15.45:0/2751289625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2008106720 0x7f20080ff9b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f200000b9e0 tx=0x7f200000bcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:18:16.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.771+0000 7f20057fa700 1 -- 172.21.15.45:0/2751289625 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200000c930 con 0x7f2008106720 2023-08-11T12:18:16.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.771+0000 7f20057fa700 1 -- 172.21.15.45:0/2751289625 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2000014440 con 0x7f2008106720 2023-08-11T12:18:16.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.771+0000 7f200e2d8700 1 -- 172.21.15.45:0/2751289625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20081a0af0 con 0x7f2008106720 2023-08-11T12:18:16.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.771+0000 7f20057fa700 1 -- 172.21.15.45:0/2751289625 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20000125a0 con 0x7f2008106720 2023-08-11T12:18:16.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.771+0000 7f200e2d8700 1 -- 172.21.15.45:0/2751289625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20081a0ff0 con 0x7f2008106720 2023-08-11T12:18:16.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.772+0000 7f200e2d8700 1 -- 172.21.15.45:0/2751289625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20080fc9b0 con 0x7f2008106720 2023-08-11T12:18:16.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.773+0000 7f20057fa700 1 -- 172.21.15.45:0/2751289625 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f20000145b0 con 0x7f2008106720 2023-08-11T12:18:16.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.773+0000 7f20057fa700 1 --2- 172.21.15.45:0/2751289625 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f1ff40a0050 0x7f1ff40a2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:18:16.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.774+0000 7f20057fa700 1 -- 172.21.15.45:0/2751289625 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 3698+0+0 (secure 0 0 0) 0x7f2000006e40 con 0x7f2008106720 2023-08-11T12:18:16.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.774+0000 7f2007fff700 1 --2- 172.21.15.45:0/2751289625 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f1ff40a0050 0x7f1ff40a2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:18:16.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.774+0000 7f2007fff700 1 --2- 172.21.15.45:0/2751289625 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f1ff40a0050 0x7f1ff40a2510 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00097b0 tx=0x7f1ff0006d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:18:16.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.777+0000 7f20057fa700 1 -- 172.21.15.45:0/2751289625 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f2000094a00 con 0x7f2008106720 2023-08-11T12:18:16.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:16.984+0000 7f200e2d8700 1 -- 172.21.15.45:0/2751289625 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f200802ce70 con 0x7f1ff40a0050 2023-08-11T12:18:17.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:16 smithi194 ceph-mon[130905]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-11T12:18:17.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:16 smithi194 ceph-mon[130905]: osdmap e27: 4 total, 4 up, 4 in 2023-08-11T12:18:17.144 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:16 smithi045 ceph-mon[130284]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-11T12:18:17.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:16 smithi045 ceph-mon[130284]: osdmap e27: 4 total, 4 up, 4 in 2023-08-11T12:18:17.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:16 smithi008 ceph-mon[97158]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-11T12:18:17.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:16 smithi008 ceph-mon[97158]: osdmap e27: 4 total, 4 up, 4 in 2023-08-11T12:18:18.073 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:17 smithi045 ceph-mon[130284]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:18:18.073 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:17 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:18:18.073 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:17 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:18:18.073 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:17 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:18.074 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:17 smithi045 ceph-mon[130284]: osdmap e28: 4 total, 4 up, 4 in 2023-08-11T12:18:18.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:17 smithi194 ceph-mon[130905]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:18:18.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:17 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:18:18.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:17 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:18:18.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:17 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:18.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:17 smithi194 ceph-mon[130905]: osdmap e28: 4 total, 4 up, 4 in 2023-08-11T12:18:18.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:17 smithi008 ceph-mon[97158]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:18:18.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:17 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:18:18.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:17 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:18:18.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:17 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:18.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:17 smithi008 ceph-mon[97158]: osdmap e28: 4 total, 4 up, 4 in 2023-08-11T12:18:19.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:18 smithi194 ceph-mon[130905]: pgmap v102: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-08-11T12:18:19.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:18 smithi194 ceph-mon[130905]: osdmap e29: 4 total, 4 up, 4 in 2023-08-11T12:18:19.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:18 smithi045 ceph-mon[130284]: pgmap v102: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-08-11T12:18:19.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:18 smithi045 ceph-mon[130284]: osdmap e29: 4 total, 4 up, 4 in 2023-08-11T12:18:19.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:18 smithi008 ceph-mon[97158]: pgmap v102: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-08-11T12:18:19.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:18 smithi008 ceph-mon[97158]: osdmap e29: 4 total, 4 up, 4 in 2023-08-11T12:18:20.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:19 smithi194 ceph-mon[130905]: from='client.? 172.21.15.45:0/2013503067' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c28acbb-e807-4559-8aa2-a35ca84b5d43"}]: dispatch 2023-08-11T12:18:20.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:19 smithi194 ceph-mon[130905]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c28acbb-e807-4559-8aa2-a35ca84b5d43"}]: dispatch 2023-08-11T12:18:20.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:19 smithi194 ceph-mon[130905]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c28acbb-e807-4559-8aa2-a35ca84b5d43"}]': finished 2023-08-11T12:18:20.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:19 smithi194 ceph-mon[130905]: osdmap e30: 5 total, 4 up, 5 in 2023-08-11T12:18:20.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:19 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-11T12:18:20.144 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:19 smithi045 ceph-mon[130284]: from='client.? 172.21.15.45:0/2013503067' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c28acbb-e807-4559-8aa2-a35ca84b5d43"}]: dispatch 2023-08-11T12:18:20.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:19 smithi045 ceph-mon[130284]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c28acbb-e807-4559-8aa2-a35ca84b5d43"}]: dispatch 2023-08-11T12:18:20.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:19 smithi045 ceph-mon[130284]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c28acbb-e807-4559-8aa2-a35ca84b5d43"}]': finished 2023-08-11T12:18:20.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:19 smithi045 ceph-mon[130284]: osdmap e30: 5 total, 4 up, 5 in 2023-08-11T12:18:20.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:19 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-11T12:18:20.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:19 smithi008 ceph-mon[97158]: from='client.? 172.21.15.45:0/2013503067' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c28acbb-e807-4559-8aa2-a35ca84b5d43"}]: dispatch 2023-08-11T12:18:20.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:19 smithi008 ceph-mon[97158]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c28acbb-e807-4559-8aa2-a35ca84b5d43"}]: dispatch 2023-08-11T12:18:20.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:19 smithi008 ceph-mon[97158]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c28acbb-e807-4559-8aa2-a35ca84b5d43"}]': finished 2023-08-11T12:18:20.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:19 smithi008 ceph-mon[97158]: osdmap e30: 5 total, 4 up, 5 in 2023-08-11T12:18:20.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:19 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-11T12:18:21.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:20 smithi008 ceph-mon[97158]: from='client.? 172.21.15.45:0/3437732143' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:18:21.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:20 smithi008 ceph-mon[97158]: pgmap v105: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-08-11T12:18:21.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:20 smithi194 ceph-mon[130905]: from='client.? 172.21.15.45:0/3437732143' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:18:21.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:20 smithi194 ceph-mon[130905]: pgmap v105: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-08-11T12:18:21.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:20 smithi045 ceph-mon[130284]: from='client.? 172.21.15.45:0/3437732143' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:18:21.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:20 smithi045 ceph-mon[130284]: pgmap v105: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-08-11T12:18:23.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:23 smithi008 ceph-mon[97158]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2023-08-11T12:18:23.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:23 smithi194 ceph-mon[130905]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2023-08-11T12:18:23.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:23 smithi045 ceph-mon[130284]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2023-08-11T12:18:25.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:25 smithi008 ceph-mon[97158]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2023-08-11T12:18:25.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:25 smithi194 ceph-mon[130905]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2023-08-11T12:18:25.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:25 smithi045 ceph-mon[130284]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2023-08-11T12:18:26.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:26 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-08-11T12:18:26.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:26 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:26.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:26 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-08-11T12:18:26.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:26 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:26.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:26 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-08-11T12:18:26.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:26 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:27.779 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:27 smithi045 ceph-mon[130284]: Deploying daemon osd.4 on smithi045 2023-08-11T12:18:27.780 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:27 smithi045 ceph-mon[130284]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-11T12:18:27.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:27 smithi008 ceph-mon[97158]: Deploying daemon osd.4 on smithi045 2023-08-11T12:18:27.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:27 smithi008 ceph-mon[97158]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-11T12:18:27.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:27 smithi194 ceph-mon[130905]: Deploying daemon osd.4 on smithi045 2023-08-11T12:18:27.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:27 smithi194 ceph-mon[130905]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-11T12:18:29.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:29 smithi045 ceph-mon[130284]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-11T12:18:29.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:29 smithi008 ceph-mon[97158]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-11T12:18:29.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:29 smithi194 ceph-mon[130905]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-11T12:18:30.808 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:30 smithi045 ceph-mon[130284]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-11T12:18:30.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:30 smithi194 ceph-mon[130905]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-11T12:18:31.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:30 smithi008 ceph-mon[97158]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-11T12:18:31.987 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:31 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:31.987 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:31 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:31.987 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:31 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:18:32.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:31 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:32.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:31 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:32.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:31 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:18:32.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:31 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:32.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:31 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:32.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:31 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:18:32.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:32 smithi045 ceph-mon[130284]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-11T12:18:33.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:32 smithi194 ceph-mon[130905]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-11T12:18:33.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:32 smithi008 ceph-mon[97158]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-11T12:18:33.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:33.400+0000 7f20057fa700 1 -- 172.21.15.45:0/2751289625 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f200802ce70 con 0x7f1ff40a0050 2023-08-11T12:18:33.403 INFO:teuthology.orchestra.run.smithi045.stdout:Created osd(s) 4 on host 'smithi045' 2023-08-11T12:18:33.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:33.402+0000 7f200e2d8700 1 -- 172.21.15.45:0/2751289625 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f1ff40a0050 msgr2=0x7f1ff40a2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:18:33.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:33.402+0000 7f200e2d8700 1 --2- 172.21.15.45:0/2751289625 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f1ff40a0050 0x7f1ff40a2510 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00097b0 tx=0x7f1ff0006d20 comp rx=0 tx=0).stop 2023-08-11T12:18:33.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:33.402+0000 7f200e2d8700 1 -- 172.21.15.45:0/2751289625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2008106720 msgr2=0x7f20080ff9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:18:33.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:33.402+0000 7f200e2d8700 1 --2- 172.21.15.45:0/2751289625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2008106720 0x7f20080ff9b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f200000b9e0 tx=0x7f200000bcf0 comp rx=0 tx=0).stop 2023-08-11T12:18:33.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:33.402+0000 7f200e2d8700 1 -- 172.21.15.45:0/2751289625 shutdown_connections 2023-08-11T12:18:33.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:33.402+0000 7f200e2d8700 1 --2- 172.21.15.45:0/2751289625 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f1ff40a0050 0x7f1ff40a2510 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:18:33.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:33.402+0000 7f200e2d8700 1 --2- 172.21.15.45:0/2751289625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2008106720 0x7f20080ff9b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:18:33.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:33.402+0000 7f200e2d8700 1 --2- 172.21.15.45:0/2751289625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20081014c0 0x7f2008100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:18:33.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:33.402+0000 7f200e2d8700 1 --2- 172.21.15.45:0/2751289625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2008103df0 0x7f20080ff470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:18:33.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:33.402+0000 7f200e2d8700 1 -- 172.21.15.45:0/2751289625 >> 172.21.15.45:0/2751289625 conn(0x7f20080fae30 msgr2=0x7f2008102130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:18:33.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:33.402+0000 7f200e2d8700 1 -- 172.21.15.45:0/2751289625 shutdown_connections 2023-08-11T12:18:33.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:18:33.402+0000 7f200e2d8700 1 -- 172.21.15.45:0/2751289625 wait complete. 2023-08-11T12:18:33.769 DEBUG:teuthology.orchestra.run.smithi045:osd.4> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.4.service 2023-08-11T12:18:33.771 INFO:tasks.cephadm:Deploying osd.5 on smithi194 with /dev/vg_nvme/lv_3... 2023-08-11T12:18:33.772 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-08-11T12:18:33.802 INFO:journalctl@ceph.osd.4.smithi045.stdout:-- Logs begin at Fri 2023-08-11 11:52:16 UTC. -- 2023-08-11T12:18:34.334 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.c/config 2023-08-11T12:18:34.491 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:34 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:34.491 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:34 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:34.491 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:34 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:34.492 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:34 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:18:34.492 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:34 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:34.492 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:34 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:34.492 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:34 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:34.492 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:34 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:18:34.529 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:34 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:34.530 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:34 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:34.530 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:34 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:34.530 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:34 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:18:34.530 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:34 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:34.530 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:34 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:34.531 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:34 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:34.531 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:34 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:18:34.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:34 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:34.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:34 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:34.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:34 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:34.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:34 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:18:34.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:34 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:34.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:34 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:34.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:34 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:34.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:34 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:18:35.112 INFO:journalctl@ceph.osd.4.smithi045.stdout:Aug 11 12:18:34 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-4[140874]: 2023-08-11T12:18:34.778+0000 7fe0140e1640 -1 osd.4 0 log_to_monitors true 2023-08-11T12:18:35.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:35 smithi045 ceph-mon[130284]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-11T12:18:35.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:35 smithi045 ceph-mon[130284]: from='osd.4 [v2:172.21.15.45:6808/3099704571,v1:172.21.15.45:6809/3099704571]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-08-11T12:18:35.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:35 smithi045 ceph-mon[130284]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-08-11T12:18:35.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:35 smithi008 ceph-mon[97158]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-11T12:18:35.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:35 smithi008 ceph-mon[97158]: from='osd.4 [v2:172.21.15.45:6808/3099704571,v1:172.21.15.45:6809/3099704571]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-08-11T12:18:35.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:35 smithi008 ceph-mon[97158]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-08-11T12:18:35.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:35 smithi194 ceph-mon[130905]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-11T12:18:35.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:35 smithi194 ceph-mon[130905]: from='osd.4 [v2:172.21.15.45:6808/3099704571,v1:172.21.15.45:6809/3099704571]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-08-11T12:18:35.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:35 smithi194 ceph-mon[130905]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-08-11T12:18:35.688 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-08-11T12:18:35.688 INFO:teuthology.orchestra.run.smithi194.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-08-11T12:18:35.688 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10+0 records in 2023-08-11T12:18:35.688 INFO:teuthology.orchestra.run.smithi194.stderr:10+0 records out 2023-08-11T12:18:35.688 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0109846 s, 955 MB/s 2023-08-11T12:18:35.689 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping successful for: 2023-08-11T12:18:36.076 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi194:vg_nvme/lv_3 2023-08-11T12:18:36.626 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.c/config 2023-08-11T12:18:36.881 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:36 smithi194 ceph-mon[130905]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-08-11T12:18:36.882 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:36 smithi194 ceph-mon[130905]: osdmap e31: 5 total, 4 up, 5 in 2023-08-11T12:18:36.882 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:36 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-11T12:18:36.882 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:36 smithi194 ceph-mon[130905]: from='osd.4 [v2:172.21.15.45:6808/3099704571,v1:172.21.15.45:6809/3099704571]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2023-08-11T12:18:36.882 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:36 smithi194 ceph-mon[130905]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2023-08-11T12:18:36.882 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:36 smithi194 ceph-mon[130905]: Detected new or changed devices on smithi045 2023-08-11T12:18:36.882 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:36 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:36.883 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:36 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:36.883 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:36 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:18:36.883 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:36 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:18:36.883 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:36 smithi194 ceph-mon[130905]: Adjusting osd_memory_target on smithi045 to 8586M 2023-08-11T12:18:36.883 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:36 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:36.883 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:36 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:36.883 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:36 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:18:36.884 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:36 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:36.884 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:36 smithi194 ceph-mon[130905]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-11T12:18:36.895 INFO:journalctl@ceph.osd.4.smithi045.stdout:Aug 11 12:18:36 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-4[140874]: 2023-08-11T12:18:36.615+0000 7fe009759700 -1 osd.4 0 waiting for initial osdmap 2023-08-11T12:18:36.895 INFO:journalctl@ceph.osd.4.smithi045.stdout:Aug 11 12:18:36 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-4[140874]: 2023-08-11T12:18:36.622+0000 7fe001546700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-11T12:18:36.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:36 smithi045 ceph-mon[130284]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-08-11T12:18:36.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:36 smithi045 ceph-mon[130284]: osdmap e31: 5 total, 4 up, 5 in 2023-08-11T12:18:36.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:36 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-11T12:18:36.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:36 smithi045 ceph-mon[130284]: from='osd.4 [v2:172.21.15.45:6808/3099704571,v1:172.21.15.45:6809/3099704571]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2023-08-11T12:18:36.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:36 smithi045 ceph-mon[130284]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2023-08-11T12:18:36.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:36 smithi045 ceph-mon[130284]: Detected new or changed devices on smithi045 2023-08-11T12:18:36.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:36 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:36.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:36 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:36.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:36 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:18:36.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:36 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:18:36.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:36 smithi045 ceph-mon[130284]: Adjusting osd_memory_target on smithi045 to 8586M 2023-08-11T12:18:36.898 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:36 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:36.898 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:36 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:36.898 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:36 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:18:36.898 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:36 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:36.898 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:36 smithi045 ceph-mon[130284]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-11T12:18:37.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:36 smithi008 ceph-mon[97158]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-08-11T12:18:37.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:36 smithi008 ceph-mon[97158]: osdmap e31: 5 total, 4 up, 5 in 2023-08-11T12:18:37.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:36 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-11T12:18:37.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:36 smithi008 ceph-mon[97158]: from='osd.4 [v2:172.21.15.45:6808/3099704571,v1:172.21.15.45:6809/3099704571]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2023-08-11T12:18:37.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:36 smithi008 ceph-mon[97158]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2023-08-11T12:18:37.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:36 smithi008 ceph-mon[97158]: Detected new or changed devices on smithi045 2023-08-11T12:18:37.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:36 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:37.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:36 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:37.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:36 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:18:37.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:36 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:18:37.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:36 smithi008 ceph-mon[97158]: Adjusting osd_memory_target on smithi045 to 8586M 2023-08-11T12:18:37.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:36 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:37.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:36 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:37.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:36 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:18:37.056 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:36 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:37.056 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:36 smithi008 ceph-mon[97158]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-11T12:18:37.792 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.791+0000 7f24eb5f2700 1 -- 172.21.15.194:0/2836107325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24e4101450 msgr2=0x7f24e4107d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:18:37.792 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.791+0000 7f24eb5f2700 1 --2- 172.21.15.194:0/2836107325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24e4101450 0x7f24e4107d00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f24dc00b0a0 tx=0x7f24dc00b3b0 comp rx=0 tx=0).stop 2023-08-11T12:18:37.793 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.791+0000 7f24eb5f2700 1 -- 172.21.15.194:0/2836107325 shutdown_connections 2023-08-11T12:18:37.793 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.791+0000 7f24eb5f2700 1 --2- 172.21.15.194:0/2836107325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24e4101450 0x7f24e4107d00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:18:37.793 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.791+0000 7f24eb5f2700 1 --2- 172.21.15.194:0/2836107325 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24e40ff8b0 0x7f24e40ffcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:18:37.793 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.791+0000 7f24eb5f2700 1 --2- 172.21.15.194:0/2836107325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24e4100ab0 0x7f24e4100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:18:37.793 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.791+0000 7f24eb5f2700 1 -- 172.21.15.194:0/2836107325 >> 172.21.15.194:0/2836107325 conn(0x7f24e40fae30 msgr2=0x7f24e40fd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:18:37.793 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.791+0000 7f24eb5f2700 1 -- 172.21.15.194:0/2836107325 shutdown_connections 2023-08-11T12:18:37.793 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.791+0000 7f24eb5f2700 1 -- 172.21.15.194:0/2836107325 wait complete. 2023-08-11T12:18:37.795 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.791+0000 7f24eb5f2700 1 Processor -- start 2023-08-11T12:18:37.796 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.791+0000 7f24eb5f2700 1 -- start start 2023-08-11T12:18:37.796 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.791+0000 7f24eb5f2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24e40ff8b0 0x7f24e41989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:18:37.796 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.791+0000 7f24eb5f2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24e4100ab0 0x7f24e4198f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:18:37.796 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.792+0000 7f24eb5f2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24e4101450 0x7f24e419ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:18:37.796 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.792+0000 7f24eb5f2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e41a0560 con 0x7f24e40ff8b0 2023-08-11T12:18:37.797 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.792+0000 7f24eb5f2700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e41a06a0 con 0x7f24e4101450 2023-08-11T12:18:37.797 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.792+0000 7f24eb5f2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e41a0830 con 0x7f24e4100ab0 2023-08-11T12:18:37.797 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.792+0000 7f24e8b8d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24e4100ab0 0x7f24e4198f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:18:37.797 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.792+0000 7f24e8b8d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24e4100ab0 0x7f24e4198f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:40272/0 (socket says 172.21.15.194:40272) 2023-08-11T12:18:37.797 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.792+0000 7f24e8b8d700 1 -- 172.21.15.194:0/2332008013 learned_addr learned my addr 172.21.15.194:0/2332008013 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-08-11T12:18:37.797 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.792+0000 7f24e8b8d700 1 -- 172.21.15.194:0/2332008013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24e4101450 msgr2=0x7f24e419ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:18:37.797 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.792+0000 7f24e9b8f700 1 --2- 172.21.15.194:0/2332008013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24e4101450 0x7f24e419ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:18:37.798 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.792+0000 7f24e8b8d700 1 --2- 172.21.15.194:0/2332008013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24e4101450 0x7f24e419ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:18:37.798 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.792+0000 7f24e8b8d700 1 -- 172.21.15.194:0/2332008013 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24e40ff8b0 msgr2=0x7f24e41989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:18:37.798 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.792+0000 7f24e8b8d700 1 --2- 172.21.15.194:0/2332008013 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24e40ff8b0 0x7f24e41989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:18:37.798 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.792+0000 7f24e8b8d700 1 -- 172.21.15.194:0/2332008013 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24dc009d00 con 0x7f24e4100ab0 2023-08-11T12:18:37.798 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.792+0000 7f24e9b8f700 1 --2- 172.21.15.194:0/2332008013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24e4101450 0x7f24e419ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:18:37.798 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.792+0000 7f24e8b8d700 1 --2- 172.21.15.194:0/2332008013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24e4100ab0 0x7f24e4198f10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f24d400d980 tx=0x7f24d400dd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:18:37.798 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.792+0000 7f24da7fc700 1 -- 172.21.15.194:0/2332008013 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d4009b40 con 0x7f24e4100ab0 2023-08-11T12:18:37.798 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.792+0000 7f24da7fc700 1 -- 172.21.15.194:0/2332008013 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f24d400b6e0 con 0x7f24e4100ab0 2023-08-11T12:18:37.799 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.792+0000 7f24eb5f2700 1 -- 172.21.15.194:0/2332008013 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e41a0b10 con 0x7f24e4100ab0 2023-08-11T12:18:37.799 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.792+0000 7f24da7fc700 1 -- 172.21.15.194:0/2332008013 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d400f620 con 0x7f24e4100ab0 2023-08-11T12:18:37.799 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.792+0000 7f24eb5f2700 1 -- 172.21.15.194:0/2332008013 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e41a1060 con 0x7f24e4100ab0 2023-08-11T12:18:37.799 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.793+0000 7f24eb5f2700 1 -- 172.21.15.194:0/2332008013 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e410b150 con 0x7f24e4100ab0 2023-08-11T12:18:37.799 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.794+0000 7f24da7fc700 1 -- 172.21.15.194:0/2332008013 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f24d4010460 con 0x7f24e4100ab0 2023-08-11T12:18:37.800 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.795+0000 7f24da7fc700 1 --2- 172.21.15.194:0/2332008013 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f24d009ffd0 0x7f24d00a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:18:37.800 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.795+0000 7f24da7fc700 1 -- 172.21.15.194:0/2332008013 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4101+0+0 (secure 0 0 0) 0x7f24d40c9ff0 con 0x7f24e4100ab0 2023-08-11T12:18:37.800 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.795+0000 7f24e938e700 1 --2- 172.21.15.194:0/2332008013 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f24d009ffd0 0x7f24d00a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:18:37.800 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.796+0000 7f24e938e700 1 --2- 172.21.15.194:0/2332008013 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f24d009ffd0 0x7f24d00a2490 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f24e4100910 tx=0x7f24e0006d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:18:37.800 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.798+0000 7f24da7fc700 1 -- 172.21.15.194:0/2332008013 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f24d4094df0 con 0x7f24e4100ab0 2023-08-11T12:18:37.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:37 smithi194 ceph-mon[130905]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2023-08-11T12:18:37.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:37 smithi194 ceph-mon[130905]: osdmap e32: 5 total, 4 up, 5 in 2023-08-11T12:18:37.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:37 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-11T12:18:37.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:37 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-11T12:18:37.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:37 smithi045 ceph-mon[130284]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2023-08-11T12:18:37.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:37 smithi045 ceph-mon[130284]: osdmap e32: 5 total, 4 up, 5 in 2023-08-11T12:18:37.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:37 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-11T12:18:37.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:37 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-11T12:18:37.996 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:37.994+0000 7f24eb5f2700 1 -- 172.21.15.194:0/2332008013 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f24e4068b90 con 0x7f24d009ffd0 2023-08-11T12:18:38.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:37 smithi008 ceph-mon[97158]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2023-08-11T12:18:38.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:37 smithi008 ceph-mon[97158]: osdmap e32: 5 total, 4 up, 5 in 2023-08-11T12:18:38.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:37 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-11T12:18:38.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:37 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-11T12:18:38.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:38 smithi194 ceph-mon[130905]: purged_snaps scrub starts 2023-08-11T12:18:38.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:38 smithi194 ceph-mon[130905]: purged_snaps scrub ok 2023-08-11T12:18:38.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:38 smithi194 ceph-mon[130905]: osd.4 [v2:172.21.15.45:6808/3099704571,v1:172.21.15.45:6809/3099704571] boot 2023-08-11T12:18:38.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:38 smithi194 ceph-mon[130905]: osdmap e33: 5 total, 5 up, 5 in 2023-08-11T12:18:38.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:38 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-11T12:18:38.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:38 smithi194 ceph-mon[130905]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:18:38.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:38 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:18:38.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:38 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:18:38.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:38 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:38.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:38 smithi194 ceph-mon[130905]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-11T12:18:38.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:38 smithi045 ceph-mon[130284]: purged_snaps scrub starts 2023-08-11T12:18:38.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:38 smithi045 ceph-mon[130284]: purged_snaps scrub ok 2023-08-11T12:18:38.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:38 smithi045 ceph-mon[130284]: osd.4 [v2:172.21.15.45:6808/3099704571,v1:172.21.15.45:6809/3099704571] boot 2023-08-11T12:18:38.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:38 smithi045 ceph-mon[130284]: osdmap e33: 5 total, 5 up, 5 in 2023-08-11T12:18:38.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:38 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-11T12:18:38.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:38 smithi045 ceph-mon[130284]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:18:38.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:38 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:18:38.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:38 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:18:38.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:38 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:38.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:38 smithi045 ceph-mon[130284]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-11T12:18:39.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:38 smithi008 ceph-mon[97158]: purged_snaps scrub starts 2023-08-11T12:18:39.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:38 smithi008 ceph-mon[97158]: purged_snaps scrub ok 2023-08-11T12:18:39.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:38 smithi008 ceph-mon[97158]: osd.4 [v2:172.21.15.45:6808/3099704571,v1:172.21.15.45:6809/3099704571] boot 2023-08-11T12:18:39.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:38 smithi008 ceph-mon[97158]: osdmap e33: 5 total, 5 up, 5 in 2023-08-11T12:18:39.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:38 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-11T12:18:39.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:38 smithi008 ceph-mon[97158]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:18:39.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:38 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:18:39.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:38 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:18:39.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:38 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:39.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:38 smithi008 ceph-mon[97158]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-11T12:18:39.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:39 smithi194 ceph-mon[130905]: osdmap e34: 5 total, 5 up, 5 in 2023-08-11T12:18:39.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:39 smithi045 ceph-mon[130284]: osdmap e34: 5 total, 5 up, 5 in 2023-08-11T12:18:40.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:39 smithi008 ceph-mon[97158]: osdmap e34: 5 total, 5 up, 5 in 2023-08-11T12:18:40.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:40 smithi194 ceph-mon[130905]: from='client.? 172.21.15.194:0/1230526536' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37032289-8016-4730-9b69-f7985e058ff9"}]: dispatch 2023-08-11T12:18:40.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:40 smithi194 ceph-mon[130905]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37032289-8016-4730-9b69-f7985e058ff9"}]: dispatch 2023-08-11T12:18:40.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:40 smithi194 ceph-mon[130905]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "37032289-8016-4730-9b69-f7985e058ff9"}]': finished 2023-08-11T12:18:40.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:40 smithi194 ceph-mon[130905]: osdmap e35: 6 total, 5 up, 6 in 2023-08-11T12:18:40.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:40 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-11T12:18:40.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:40 smithi194 ceph-mon[130905]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-08-11T12:18:40.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:40 smithi045 ceph-mon[130284]: from='client.? 172.21.15.194:0/1230526536' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37032289-8016-4730-9b69-f7985e058ff9"}]: dispatch 2023-08-11T12:18:40.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:40 smithi045 ceph-mon[130284]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37032289-8016-4730-9b69-f7985e058ff9"}]: dispatch 2023-08-11T12:18:40.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:40 smithi045 ceph-mon[130284]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "37032289-8016-4730-9b69-f7985e058ff9"}]': finished 2023-08-11T12:18:40.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:40 smithi045 ceph-mon[130284]: osdmap e35: 6 total, 5 up, 6 in 2023-08-11T12:18:40.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:40 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-11T12:18:40.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:40 smithi045 ceph-mon[130284]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-08-11T12:18:41.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:40 smithi008 ceph-mon[97158]: from='client.? 172.21.15.194:0/1230526536' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37032289-8016-4730-9b69-f7985e058ff9"}]: dispatch 2023-08-11T12:18:41.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:40 smithi008 ceph-mon[97158]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37032289-8016-4730-9b69-f7985e058ff9"}]: dispatch 2023-08-11T12:18:41.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:40 smithi008 ceph-mon[97158]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "37032289-8016-4730-9b69-f7985e058ff9"}]': finished 2023-08-11T12:18:41.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:40 smithi008 ceph-mon[97158]: osdmap e35: 6 total, 5 up, 6 in 2023-08-11T12:18:41.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:40 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-11T12:18:41.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:40 smithi008 ceph-mon[97158]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-08-11T12:18:41.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:41 smithi194 ceph-mon[130905]: from='client.? 172.21.15.194:0/3809825429' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:18:41.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:41 smithi045 ceph-mon[130284]: from='client.? 172.21.15.194:0/3809825429' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:18:42.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:41 smithi008 ceph-mon[97158]: from='client.? 172.21.15.194:0/3809825429' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:18:42.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:42 smithi194 ceph-mon[130905]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-08-11T12:18:42.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:42 smithi045 ceph-mon[130284]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-08-11T12:18:43.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:42 smithi008 ceph-mon[97158]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-08-11T12:18:45.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:45 smithi008 ceph-mon[97158]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-11T12:18:45.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:45 smithi194 ceph-mon[130905]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-11T12:18:45.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:45 smithi045 ceph-mon[130284]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-11T12:18:47.589 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:47 smithi194 ceph-mon[130905]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-11T12:18:47.589 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:47 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-08-11T12:18:47.589 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:47 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:47.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:47 smithi008 ceph-mon[97158]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-11T12:18:47.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:47 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-08-11T12:18:47.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:47 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:47.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:47 smithi045 ceph-mon[130284]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-11T12:18:47.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:47 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-08-11T12:18:47.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:47 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:48.727 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:48 smithi194 ceph-mon[130905]: Deploying daemon osd.5 on smithi194 2023-08-11T12:18:48.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:48 smithi008 ceph-mon[97158]: Deploying daemon osd.5 on smithi194 2023-08-11T12:18:48.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:48 smithi045 ceph-mon[130284]: Deploying daemon osd.5 on smithi194 2023-08-11T12:18:49.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:49 smithi008 ceph-mon[97158]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-11T12:18:49.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:49 smithi194 ceph-mon[130905]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-11T12:18:49.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:49 smithi045 ceph-mon[130284]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-11T12:18:50.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:50 smithi194 ceph-mon[130905]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-11T12:18:50.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:50 smithi045 ceph-mon[130284]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-11T12:18:51.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:50 smithi008 ceph-mon[97158]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-11T12:18:52.078 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:51 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:52.079 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:51 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:52.079 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:51 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:18:52.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:51 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:52.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:51 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:52.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:51 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:18:52.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:51 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:52.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:51 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:52.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:51 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:18:53.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:52 smithi194 ceph-mon[130905]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-11T12:18:53.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:52 smithi045 ceph-mon[130284]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-11T12:18:53.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:52 smithi008 ceph-mon[97158]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-11T12:18:53.563 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:53.560+0000 7f24da7fc700 1 -- 172.21.15.194:0/2332008013 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f24e4068b90 con 0x7f24d009ffd0 2023-08-11T12:18:53.563 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 5 on host 'smithi194' 2023-08-11T12:18:53.565 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:53.562+0000 7f24eb5f2700 1 -- 172.21.15.194:0/2332008013 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f24d009ffd0 msgr2=0x7f24d00a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:18:53.565 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:53.562+0000 7f24eb5f2700 1 --2- 172.21.15.194:0/2332008013 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f24d009ffd0 0x7f24d00a2490 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f24e4100910 tx=0x7f24e0006d20 comp rx=0 tx=0).stop 2023-08-11T12:18:53.566 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:53.562+0000 7f24eb5f2700 1 -- 172.21.15.194:0/2332008013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24e4100ab0 msgr2=0x7f24e4198f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:18:53.566 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:53.562+0000 7f24eb5f2700 1 --2- 172.21.15.194:0/2332008013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24e4100ab0 0x7f24e4198f10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f24d400d980 tx=0x7f24d400dd40 comp rx=0 tx=0).stop 2023-08-11T12:18:53.566 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:53.563+0000 7f24eb5f2700 1 -- 172.21.15.194:0/2332008013 shutdown_connections 2023-08-11T12:18:53.566 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:53.563+0000 7f24eb5f2700 1 --2- 172.21.15.194:0/2332008013 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f24d009ffd0 0x7f24d00a2490 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:18:53.566 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:53.563+0000 7f24eb5f2700 1 --2- 172.21.15.194:0/2332008013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24e4101450 0x7f24e419ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:18:53.566 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:53.563+0000 7f24eb5f2700 1 --2- 172.21.15.194:0/2332008013 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24e40ff8b0 0x7f24e41989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:18:53.567 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:53.563+0000 7f24eb5f2700 1 --2- 172.21.15.194:0/2332008013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24e4100ab0 0x7f24e4198f10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:18:53.567 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:53.563+0000 7f24eb5f2700 1 -- 172.21.15.194:0/2332008013 >> 172.21.15.194:0/2332008013 conn(0x7f24e40fae30 msgr2=0x7f24e4068480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:18:53.567 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:53.563+0000 7f24eb5f2700 1 -- 172.21.15.194:0/2332008013 shutdown_connections 2023-08-11T12:18:53.567 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:18:53.563+0000 7f24eb5f2700 1 -- 172.21.15.194:0/2332008013 wait complete. 2023-08-11T12:18:54.028 DEBUG:teuthology.orchestra.run.smithi194:osd.5> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.5.service 2023-08-11T12:18:54.030 INFO:tasks.cephadm:Deploying osd.6 on smithi008 with /dev/vg_nvme/lv_2... 2023-08-11T12:18:54.031 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-08-11T12:18:54.076 INFO:journalctl@ceph.osd.5.smithi194.stdout:-- Logs begin at Fri 2023-08-11 11:52:16 UTC. -- 2023-08-11T12:18:54.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:54.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:54.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:54.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:18:54.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:54.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:54.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:54.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:18:54.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:53 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:54.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:53 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:54.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:53 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:54.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:53 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:18:54.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:53 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:54.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:53 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:54.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:53 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:54.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:53 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:18:54.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:53 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:54.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:53 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:54.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:53 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:54.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:53 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:18:54.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:53 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:54.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:53 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:54.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:53 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:54.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:53 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:18:54.792 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:18:55.143 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:18:54 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:18:54.828+0000 7f66660ff640 -1 osd.5 0 log_to_monitors true 2023-08-11T12:18:55.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:54 smithi194 ceph-mon[130905]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-11T12:18:55.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:54 smithi194 ceph-mon[130905]: from='osd.5 [v2:172.21.15.194:6808/263803874,v1:172.21.15.194:6809/263803874]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-08-11T12:18:55.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:54 smithi194 ceph-mon[130905]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-08-11T12:18:55.181 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:54 smithi008 ceph-mon[97158]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-11T12:18:55.182 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:54 smithi008 ceph-mon[97158]: from='osd.5 [v2:172.21.15.194:6808/263803874,v1:172.21.15.194:6809/263803874]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-08-11T12:18:55.182 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:54 smithi008 ceph-mon[97158]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-08-11T12:18:55.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:54 smithi045 ceph-mon[130284]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-11T12:18:55.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:54 smithi045 ceph-mon[130284]: from='osd.5 [v2:172.21.15.194:6808/263803874,v1:172.21.15.194:6809/263803874]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-08-11T12:18:55.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:54 smithi045 ceph-mon[130284]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-08-11T12:18:56.737 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-08-11T12:18:56.737 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-08-11T12:18:56.738 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10+0 records in 2023-08-11T12:18:56.738 INFO:teuthology.orchestra.run.smithi008.stderr:10+0 records out 2023-08-11T12:18:56.738 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0303574 s, 345 MB/s 2023-08-11T12:18:56.738 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping successful for: 2023-08-11T12:18:56.893 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:18:56 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:18:56.628+0000 7f665b777700 -1 osd.5 0 waiting for initial osdmap 2023-08-11T12:18:56.893 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:18:56 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:18:56.636+0000 7f6654d67700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-11T12:18:56.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:56 smithi194 ceph-mon[130905]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-08-11T12:18:56.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:56 smithi194 ceph-mon[130905]: osdmap e36: 6 total, 5 up, 6 in 2023-08-11T12:18:56.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:56 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-11T12:18:56.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:56 smithi194 ceph-mon[130905]: from='osd.5 [v2:172.21.15.194:6808/263803874,v1:172.21.15.194:6809/263803874]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2023-08-11T12:18:56.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:56 smithi194 ceph-mon[130905]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2023-08-11T12:18:56.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:56 smithi194 ceph-mon[130905]: Detected new or changed devices on smithi194 2023-08-11T12:18:56.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:56 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:56.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:56 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:56.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:56 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:18:56.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:56 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:18:56.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:56 smithi194 ceph-mon[130905]: Adjusting osd_memory_target on smithi194 to 8584M 2023-08-11T12:18:56.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:56 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:56.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:56 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:56.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:56 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:18:56.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:56 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:56.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:56 smithi194 ceph-mon[130905]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-11T12:18:56.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:56 smithi045 ceph-mon[130284]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-08-11T12:18:56.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:56 smithi045 ceph-mon[130284]: osdmap e36: 6 total, 5 up, 6 in 2023-08-11T12:18:56.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:56 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-11T12:18:56.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:56 smithi045 ceph-mon[130284]: from='osd.5 [v2:172.21.15.194:6808/263803874,v1:172.21.15.194:6809/263803874]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2023-08-11T12:18:56.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:56 smithi045 ceph-mon[130284]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2023-08-11T12:18:56.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:56 smithi045 ceph-mon[130284]: Detected new or changed devices on smithi194 2023-08-11T12:18:56.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:56 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:56.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:56 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:56.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:56 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:18:56.898 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:56 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:18:56.898 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:56 smithi045 ceph-mon[130284]: Adjusting osd_memory_target on smithi194 to 8584M 2023-08-11T12:18:56.899 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:56 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:56.899 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:56 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:56.899 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:56 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:18:56.900 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:56 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:56.900 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:56 smithi045 ceph-mon[130284]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-11T12:18:56.949 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:56 smithi008 ceph-mon[97158]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-08-11T12:18:56.950 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:56 smithi008 ceph-mon[97158]: osdmap e36: 6 total, 5 up, 6 in 2023-08-11T12:18:56.950 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:56 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-11T12:18:56.950 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:56 smithi008 ceph-mon[97158]: from='osd.5 [v2:172.21.15.194:6808/263803874,v1:172.21.15.194:6809/263803874]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2023-08-11T12:18:56.951 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:56 smithi008 ceph-mon[97158]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2023-08-11T12:18:56.952 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:56 smithi008 ceph-mon[97158]: Detected new or changed devices on smithi194 2023-08-11T12:18:56.953 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:56 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:56.953 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:56 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:56.953 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:56 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:18:56.953 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:56 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:18:56.954 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:56 smithi008 ceph-mon[97158]: Adjusting osd_memory_target on smithi194 to 8584M 2023-08-11T12:18:56.954 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:56 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:56.954 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:56 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:18:56.955 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:56 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:18:56.955 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:56 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:18:56.955 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:56 smithi008 ceph-mon[97158]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-11T12:18:57.271 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi008:vg_nvme/lv_2 2023-08-11T12:18:57.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:57 smithi194 ceph-mon[130905]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2023-08-11T12:18:57.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:57 smithi194 ceph-mon[130905]: osdmap e37: 6 total, 5 up, 6 in 2023-08-11T12:18:57.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:57 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-11T12:18:57.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:57 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-11T12:18:57.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:57 smithi194 ceph-mon[130905]: osd.5 [v2:172.21.15.194:6808/263803874,v1:172.21.15.194:6809/263803874] boot 2023-08-11T12:18:57.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:57 smithi194 ceph-mon[130905]: osdmap e38: 6 total, 6 up, 6 in 2023-08-11T12:18:57.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:57 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-11T12:18:57.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:57 smithi045 ceph-mon[130284]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2023-08-11T12:18:57.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:57 smithi045 ceph-mon[130284]: osdmap e37: 6 total, 5 up, 6 in 2023-08-11T12:18:57.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:57 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-11T12:18:57.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:57 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-11T12:18:57.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:57 smithi045 ceph-mon[130284]: osd.5 [v2:172.21.15.194:6808/263803874,v1:172.21.15.194:6809/263803874] boot 2023-08-11T12:18:57.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:57 smithi045 ceph-mon[130284]: osdmap e38: 6 total, 6 up, 6 in 2023-08-11T12:18:57.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:57 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-11T12:18:58.004 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:18:58.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:57 smithi008 ceph-mon[97158]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2023-08-11T12:18:58.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:57 smithi008 ceph-mon[97158]: osdmap e37: 6 total, 5 up, 6 in 2023-08-11T12:18:58.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:57 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-11T12:18:58.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:57 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-11T12:18:58.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:57 smithi008 ceph-mon[97158]: osd.5 [v2:172.21.15.194:6808/263803874,v1:172.21.15.194:6809/263803874] boot 2023-08-11T12:18:58.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:57 smithi008 ceph-mon[97158]: osdmap e38: 6 total, 6 up, 6 in 2023-08-11T12:18:58.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:57 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-11T12:18:58.779 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:58 smithi008 ceph-mon[97158]: purged_snaps scrub starts 2023-08-11T12:18:58.779 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:58 smithi008 ceph-mon[97158]: purged_snaps scrub ok 2023-08-11T12:18:58.780 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:58 smithi008 ceph-mon[97158]: pgmap v132: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-08-11T12:18:58.780 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:18:58 smithi008 ceph-mon[97158]: osdmap e39: 6 total, 6 up, 6 in 2023-08-11T12:18:58.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:58 smithi194 ceph-mon[130905]: purged_snaps scrub starts 2023-08-11T12:18:58.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:58 smithi194 ceph-mon[130905]: purged_snaps scrub ok 2023-08-11T12:18:58.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:58 smithi194 ceph-mon[130905]: pgmap v132: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-08-11T12:18:58.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:18:58 smithi194 ceph-mon[130905]: osdmap e39: 6 total, 6 up, 6 in 2023-08-11T12:18:58.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:58 smithi045 ceph-mon[130284]: purged_snaps scrub starts 2023-08-11T12:18:58.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:58 smithi045 ceph-mon[130284]: purged_snaps scrub ok 2023-08-11T12:18:58.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:58 smithi045 ceph-mon[130284]: pgmap v132: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-08-11T12:18:58.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:18:58 smithi045 ceph-mon[130284]: osdmap e39: 6 total, 6 up, 6 in 2023-08-11T12:18:59.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.448+0000 7fd8774f2700 1 -- 172.21.15.8:0/1903204572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd870102550 msgr2=0x7fd870108e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:18:59.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.448+0000 7fd8774f2700 1 --2- 172.21.15.8:0/1903204572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd870102550 0x7fd870108e00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd86800b0d0 tx=0x7fd86800b3e0 comp rx=0 tx=0).stop 2023-08-11T12:18:59.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.448+0000 7fd8774f2700 1 -- 172.21.15.8:0/1903204572 shutdown_connections 2023-08-11T12:18:59.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.448+0000 7fd8774f2700 1 --2- 172.21.15.8:0/1903204572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd870102550 0x7fd870108e00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:18:59.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.448+0000 7fd8774f2700 1 --2- 172.21.15.8:0/1903204572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8701009b0 0x7fd870100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:18:59.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.448+0000 7fd8774f2700 1 --2- 172.21.15.8:0/1903204572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd870101bb0 0x7fd870102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:18:59.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.448+0000 7fd8774f2700 1 -- 172.21.15.8:0/1903204572 >> 172.21.15.8:0/1903204572 conn(0x7fd8700fbf10 msgr2=0x7fd8700fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:18:59.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.448+0000 7fd8774f2700 1 -- 172.21.15.8:0/1903204572 shutdown_connections 2023-08-11T12:18:59.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.448+0000 7fd8774f2700 1 -- 172.21.15.8:0/1903204572 wait complete. 2023-08-11T12:18:59.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.449+0000 7fd8774f2700 1 Processor -- start 2023-08-11T12:18:59.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.449+0000 7fd8774f2700 1 -- start start 2023-08-11T12:18:59.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.449+0000 7fd8774f2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8701009b0 0x7fd8701989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:18:59.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.449+0000 7fd8774f2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd870101bb0 0x7fd870198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:18:59.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.449+0000 7fd8774f2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd870102550 0x7fd87019ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:18:59.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.449+0000 7fd8774f2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8701a04f0 con 0x7fd870102550 2023-08-11T12:18:59.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.449+0000 7fd8774f2700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8701a0630 con 0x7fd8701009b0 2023-08-11T12:18:59.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.449+0000 7fd8774f2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8701a07c0 con 0x7fd870101bb0 2023-08-11T12:18:59.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.450+0000 7fd875a8f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd870102550 0x7fd87019ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:18:59.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.450+0000 7fd87528e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8701009b0 0x7fd8701989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:18:59.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.450+0000 7fd875a8f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd870102550 0x7fd87019ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55214/0 (socket says 172.21.15.8:55214) 2023-08-11T12:18:59.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.450+0000 7fd875a8f700 1 -- 172.21.15.8:0/682705826 learned_addr learned my addr 172.21.15.8:0/682705826 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:18:59.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.450+0000 7fd874a8d700 1 --2- 172.21.15.8:0/682705826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd870101bb0 0x7fd870198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:18:59.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.450+0000 7fd875a8f700 1 -- 172.21.15.8:0/682705826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd870101bb0 msgr2=0x7fd870198ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:18:59.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.450+0000 7fd875a8f700 1 --2- 172.21.15.8:0/682705826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd870101bb0 0x7fd870198ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:18:59.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.450+0000 7fd875a8f700 1 -- 172.21.15.8:0/682705826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8701009b0 msgr2=0x7fd8701989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:18:59.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.450+0000 7fd875a8f700 1 --2- 172.21.15.8:0/682705826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8701009b0 0x7fd8701989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:18:59.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.450+0000 7fd875a8f700 1 -- 172.21.15.8:0/682705826 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd868009d00 con 0x7fd870102550 2023-08-11T12:18:59.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.450+0000 7fd875a8f700 1 --2- 172.21.15.8:0/682705826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd870102550 0x7fd87019ff20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd868008ee0 tx=0x7fd868008f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:18:59.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.451+0000 7fd8667fc700 1 -- 172.21.15.8:0/682705826 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86800e040 con 0x7fd870102550 2023-08-11T12:18:59.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.451+0000 7fd8774f2700 1 -- 172.21.15.8:0/682705826 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8701a0a40 con 0x7fd870102550 2023-08-11T12:18:59.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.451+0000 7fd8667fc700 1 -- 172.21.15.8:0/682705826 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd86800bdb0 con 0x7fd870102550 2023-08-11T12:18:59.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.451+0000 7fd8667fc700 1 -- 172.21.15.8:0/682705826 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86801d470 con 0x7fd870102550 2023-08-11T12:18:59.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.451+0000 7fd8774f2700 1 -- 172.21.15.8:0/682705826 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8701a0f00 con 0x7fd870102550 2023-08-11T12:18:59.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.452+0000 7fd8774f2700 1 -- 172.21.15.8:0/682705826 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd870193000 con 0x7fd870102550 2023-08-11T12:18:59.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.454+0000 7fd8667fc700 1 -- 172.21.15.8:0/682705826 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fd8680050b0 con 0x7fd870102550 2023-08-11T12:18:59.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.455+0000 7fd8667fc700 1 --2- 172.21.15.8:0/682705826 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd85c09ffd0 0x7fd85c0a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:18:59.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.456+0000 7fd8667fc700 1 -- 172.21.15.8:0/682705826 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4562+0+0 (secure 0 0 0) 0x7fd8680cb350 con 0x7fd870102550 2023-08-11T12:18:59.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.456+0000 7fd87528e700 1 --2- 172.21.15.8:0/682705826 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd85c09ffd0 0x7fd85c0a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:18:59.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.456+0000 7fd87528e700 1 --2- 172.21.15.8:0/682705826 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd85c09ffd0 0x7fd85c0a2490 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd870101a10 tx=0x7fd86c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:18:59.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.460+0000 7fd8667fc700 1 -- 172.21.15.8:0/682705826 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fd868095f70 con 0x7fd870102550 2023-08-11T12:18:59.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:18:59.682+0000 7fd8774f2700 1 -- 172.21.15.8:0/682705826 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fd87002ce30 con 0x7fd85c09ffd0 2023-08-11T12:19:00.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:00 smithi194 ceph-mon[130905]: osdmap e40: 6 total, 6 up, 6 in 2023-08-11T12:19:00.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:00 smithi194 ceph-mon[130905]: from='client.14313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:19:00.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:00 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:19:00.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:00 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:19:00.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:00 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:00.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:00 smithi194 ceph-mon[130905]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-08-11T12:19:00.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:00 smithi045 ceph-mon[130284]: osdmap e40: 6 total, 6 up, 6 in 2023-08-11T12:19:00.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:00 smithi045 ceph-mon[130284]: from='client.14313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:19:00.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:00 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:19:00.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:00 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:19:00.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:00 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:00.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:00 smithi045 ceph-mon[130284]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-08-11T12:19:00.937 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:00 smithi008 ceph-mon[97158]: osdmap e40: 6 total, 6 up, 6 in 2023-08-11T12:19:00.937 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:00 smithi008 ceph-mon[97158]: from='client.14313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:19:00.937 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:00 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:19:00.938 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:00 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:19:00.938 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:00 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:00.938 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:00 smithi008 ceph-mon[97158]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-08-11T12:19:01.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:01 smithi008 ceph-mon[97158]: osdmap e41: 6 total, 6 up, 6 in 2023-08-11T12:19:01.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:01 smithi194 ceph-mon[130905]: osdmap e41: 6 total, 6 up, 6 in 2023-08-11T12:19:01.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:01 smithi045 ceph-mon[130284]: osdmap e41: 6 total, 6 up, 6 in 2023-08-11T12:19:02.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:02 smithi194 ceph-mon[130905]: osdmap e42: 6 total, 6 up, 6 in 2023-08-11T12:19:02.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:02 smithi194 ceph-mon[130905]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-08-11T12:19:02.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:02 smithi045 ceph-mon[130284]: osdmap e42: 6 total, 6 up, 6 in 2023-08-11T12:19:02.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:02 smithi045 ceph-mon[130284]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-08-11T12:19:03.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:02 smithi008 ceph-mon[97158]: osdmap e42: 6 total, 6 up, 6 in 2023-08-11T12:19:03.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:02 smithi008 ceph-mon[97158]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-08-11T12:19:03.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:03 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3911219104' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32d2dab9-6944-40d1-ada9-4f941821b063"}]: dispatch 2023-08-11T12:19:03.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:03 smithi194 ceph-mon[130905]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32d2dab9-6944-40d1-ada9-4f941821b063"}]: dispatch 2023-08-11T12:19:03.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:03 smithi194 ceph-mon[130905]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32d2dab9-6944-40d1-ada9-4f941821b063"}]': finished 2023-08-11T12:19:03.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:03 smithi194 ceph-mon[130905]: osdmap e43: 7 total, 6 up, 7 in 2023-08-11T12:19:03.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:03 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-11T12:19:03.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:03 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/160299125' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:19:03.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:03 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3911219104' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32d2dab9-6944-40d1-ada9-4f941821b063"}]: dispatch 2023-08-11T12:19:03.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:03 smithi045 ceph-mon[130284]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32d2dab9-6944-40d1-ada9-4f941821b063"}]: dispatch 2023-08-11T12:19:03.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:03 smithi045 ceph-mon[130284]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32d2dab9-6944-40d1-ada9-4f941821b063"}]': finished 2023-08-11T12:19:03.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:03 smithi045 ceph-mon[130284]: osdmap e43: 7 total, 6 up, 7 in 2023-08-11T12:19:03.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:03 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-11T12:19:03.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:03 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/160299125' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:19:04.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:03 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3911219104' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32d2dab9-6944-40d1-ada9-4f941821b063"}]: dispatch 2023-08-11T12:19:04.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:03 smithi008 ceph-mon[97158]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32d2dab9-6944-40d1-ada9-4f941821b063"}]: dispatch 2023-08-11T12:19:04.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:03 smithi008 ceph-mon[97158]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32d2dab9-6944-40d1-ada9-4f941821b063"}]': finished 2023-08-11T12:19:04.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:03 smithi008 ceph-mon[97158]: osdmap e43: 7 total, 6 up, 7 in 2023-08-11T12:19:04.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:03 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-11T12:19:04.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:03 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/160299125' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:19:04.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:04 smithi045 ceph-mon[130284]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 119 KiB/s, 0 objects/s recovering 2023-08-11T12:19:05.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:04 smithi008 ceph-mon[97158]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 119 KiB/s, 0 objects/s recovering 2023-08-11T12:19:05.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:04 smithi194 ceph-mon[130905]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 119 KiB/s, 0 objects/s recovering 2023-08-11T12:19:07.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:07 smithi008 ceph-mon[97158]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-08-11T12:19:07.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:07 smithi194 ceph-mon[130905]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-08-11T12:19:07.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:07 smithi045 ceph-mon[130284]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-08-11T12:19:09.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:09 smithi008 ceph-mon[97158]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2023-08-11T12:19:09.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:09 smithi194 ceph-mon[130905]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2023-08-11T12:19:09.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:09 smithi045 ceph-mon[130284]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2023-08-11T12:19:10.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:10 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-08-11T12:19:10.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:10 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:10.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:10 smithi194 ceph-mon[130905]: Deploying daemon osd.6 on smithi008 2023-08-11T12:19:10.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:10 smithi194 ceph-mon[130905]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2023-08-11T12:19:10.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:10 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-08-11T12:19:10.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:10 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:10.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:10 smithi045 ceph-mon[130284]: Deploying daemon osd.6 on smithi008 2023-08-11T12:19:10.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:10 smithi045 ceph-mon[130284]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2023-08-11T12:19:11.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:10 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-08-11T12:19:11.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:10 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:11.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:10 smithi008 ceph-mon[97158]: Deploying daemon osd.6 on smithi008 2023-08-11T12:19:11.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:10 smithi008 ceph-mon[97158]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2023-08-11T12:19:13.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:13 smithi008 ceph-mon[97158]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-08-11T12:19:13.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:13 smithi194 ceph-mon[130905]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-08-11T12:19:13.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:13 smithi045 ceph-mon[130284]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-08-11T12:19:15.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:15 smithi008 ceph-mon[97158]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2023-08-11T12:19:15.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:15 smithi194 ceph-mon[130905]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2023-08-11T12:19:15.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:15 smithi045 ceph-mon[130284]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2023-08-11T12:19:17.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:17 smithi008 ceph-mon[97158]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-08-11T12:19:17.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:17 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:17.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:17 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:17.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:17 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:19:17.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:17 smithi194 ceph-mon[130905]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-08-11T12:19:17.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:17 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:17.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:17 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:17.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:17 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:19:17.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:17 smithi045 ceph-mon[130284]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-08-11T12:19:17.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:17 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:17.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:17 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:17.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:17 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:19:19.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:19 smithi008 ceph-mon[97158]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-08-11T12:19:19.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:19 smithi194 ceph-mon[130905]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-08-11T12:19:19.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:19 smithi045 ceph-mon[130284]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-08-11T12:19:20.298 INFO:teuthology.orchestra.run.smithi008.stdout:Created osd(s) 6 on host 'smithi008' 2023-08-11T12:19:20.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:19:20.295+0000 7fd8667fc700 1 -- 172.21.15.8:0/682705826 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd87002ce30 con 0x7fd85c09ffd0 2023-08-11T12:19:20.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:19:20.298+0000 7fd8774f2700 1 -- 172.21.15.8:0/682705826 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd85c09ffd0 msgr2=0x7fd85c0a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:19:20.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:19:20.298+0000 7fd8774f2700 1 --2- 172.21.15.8:0/682705826 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd85c09ffd0 0x7fd85c0a2490 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd870101a10 tx=0x7fd86c009260 comp rx=0 tx=0).stop 2023-08-11T12:19:20.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:19:20.298+0000 7fd8774f2700 1 -- 172.21.15.8:0/682705826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd870102550 msgr2=0x7fd87019ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:19:20.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:19:20.298+0000 7fd8774f2700 1 --2- 172.21.15.8:0/682705826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd870102550 0x7fd87019ff20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd868008ee0 tx=0x7fd868008f10 comp rx=0 tx=0).stop 2023-08-11T12:19:20.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:19:20.298+0000 7fd8774f2700 1 -- 172.21.15.8:0/682705826 shutdown_connections 2023-08-11T12:19:20.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:19:20.298+0000 7fd8774f2700 1 --2- 172.21.15.8:0/682705826 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd85c09ffd0 0x7fd85c0a2490 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:19:20.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:19:20.298+0000 7fd8774f2700 1 --2- 172.21.15.8:0/682705826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd870102550 0x7fd87019ff20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:19:20.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:19:20.298+0000 7fd8774f2700 1 --2- 172.21.15.8:0/682705826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8701009b0 0x7fd8701989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:19:20.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:19:20.298+0000 7fd8774f2700 1 --2- 172.21.15.8:0/682705826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd870101bb0 0x7fd870198ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:19:20.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:19:20.298+0000 7fd8774f2700 1 -- 172.21.15.8:0/682705826 >> 172.21.15.8:0/682705826 conn(0x7fd8700fbf10 msgr2=0x7fd870107460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:19:20.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:19:20.299+0000 7fd8774f2700 1 -- 172.21.15.8:0/682705826 shutdown_connections 2023-08-11T12:19:20.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:19:20.299+0000 7fd8774f2700 1 -- 172.21.15.8:0/682705826 wait complete. 2023-08-11T12:19:20.826 DEBUG:teuthology.orchestra.run.smithi008:osd.6> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.6.service 2023-08-11T12:19:20.831 INFO:tasks.cephadm:Deploying osd.7 on smithi045 with /dev/vg_nvme/lv_2... 2023-08-11T12:19:20.831 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-08-11T12:19:20.908 INFO:journalctl@ceph.osd.6.smithi008.stdout:-- Logs begin at Fri 2023-08-11 11:56:28 UTC. -- 2023-08-11T12:19:21.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:21.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:21.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:21.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:19:21.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:21.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:21.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:21.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:20 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:19:21.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:20 smithi045 ceph-mon[130284]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-08-11T12:19:21.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:20 smithi045 ceph-mon[130284]: from='osd.6 [v2:172.21.15.8:6818/1802966829,v1:172.21.15.8:6819/1802966829]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-08-11T12:19:21.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:20 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:21.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:20 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:21.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:20 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:21.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:20 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:19:21.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:20 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:21.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:20 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:21.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:20 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:21.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:20 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:19:21.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:20 smithi008 ceph-mon[97158]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-08-11T12:19:21.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:20 smithi008 ceph-mon[97158]: from='osd.6 [v2:172.21.15.8:6818/1802966829,v1:172.21.15.8:6819/1802966829]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-08-11T12:19:21.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:20 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:21.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:20 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:21.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:20 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:21.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:20 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:19:21.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:20 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:21.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:20 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:21.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:20 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:21.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:20 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:19:21.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:20 smithi194 ceph-mon[130905]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-08-11T12:19:21.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:20 smithi194 ceph-mon[130905]: from='osd.6 [v2:172.21.15.8:6818/1802966829,v1:172.21.15.8:6819/1802966829]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-08-11T12:19:21.414 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.b/config 2023-08-11T12:19:22.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:22 smithi008 ceph-mon[97158]: from='osd.6 [v2:172.21.15.8:6818/1802966829,v1:172.21.15.8:6819/1802966829]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-08-11T12:19:22.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:22 smithi008 ceph-mon[97158]: osdmap e44: 7 total, 6 up, 7 in 2023-08-11T12:19:22.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:22 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-11T12:19:22.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:22 smithi008 ceph-mon[97158]: from='osd.6 [v2:172.21.15.8:6818/1802966829,v1:172.21.15.8:6819/1802966829]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-08-11T12:19:22.554 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:19:22 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:19:22.300+0000 7f20e0d92700 -1 osd.6 0 waiting for initial osdmap 2023-08-11T12:19:22.554 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:19:22 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:19:22.313+0000 7f20dcb87700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-11T12:19:22.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:22 smithi194 ceph-mon[130905]: from='osd.6 [v2:172.21.15.8:6818/1802966829,v1:172.21.15.8:6819/1802966829]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-08-11T12:19:22.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:22 smithi194 ceph-mon[130905]: osdmap e44: 7 total, 6 up, 7 in 2023-08-11T12:19:22.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:22 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-11T12:19:22.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:22 smithi194 ceph-mon[130905]: from='osd.6 [v2:172.21.15.8:6818/1802966829,v1:172.21.15.8:6819/1802966829]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-08-11T12:19:22.644 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:22 smithi045 ceph-mon[130284]: from='osd.6 [v2:172.21.15.8:6818/1802966829,v1:172.21.15.8:6819/1802966829]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-08-11T12:19:22.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:22 smithi045 ceph-mon[130284]: osdmap e44: 7 total, 6 up, 7 in 2023-08-11T12:19:22.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:22 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-11T12:19:22.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:22 smithi045 ceph-mon[130284]: from='osd.6 [v2:172.21.15.8:6818/1802966829,v1:172.21.15.8:6819/1802966829]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-08-11T12:19:22.936 INFO:teuthology.orchestra.run.smithi045.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-08-11T12:19:22.937 INFO:teuthology.orchestra.run.smithi045.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-08-11T12:19:22.937 INFO:teuthology.orchestra.run.smithi045.stderr: stderr: 10+0 records in 2023-08-11T12:19:22.937 INFO:teuthology.orchestra.run.smithi045.stderr:10+0 records out 2023-08-11T12:19:22.937 INFO:teuthology.orchestra.run.smithi045.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00818633 s, 1.3 GB/s 2023-08-11T12:19:22.937 INFO:teuthology.orchestra.run.smithi045.stderr:--> Zapping successful for: 2023-08-11T12:19:23.373 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi045:vg_nvme/lv_2 2023-08-11T12:19:23.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:23 smithi008 ceph-mon[97158]: from='osd.6 [v2:172.21.15.8:6818/1802966829,v1:172.21.15.8:6819/1802966829]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-08-11T12:19:23.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:23 smithi008 ceph-mon[97158]: osdmap e45: 7 total, 6 up, 7 in 2023-08-11T12:19:23.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:23 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-11T12:19:23.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:23 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-11T12:19:23.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:23 smithi008 ceph-mon[97158]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-08-11T12:19:23.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:23 smithi194 ceph-mon[130905]: from='osd.6 [v2:172.21.15.8:6818/1802966829,v1:172.21.15.8:6819/1802966829]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-08-11T12:19:23.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:23 smithi194 ceph-mon[130905]: osdmap e45: 7 total, 6 up, 7 in 2023-08-11T12:19:23.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:23 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-11T12:19:23.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:23 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-11T12:19:23.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:23 smithi194 ceph-mon[130905]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-08-11T12:19:23.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:23 smithi045 ceph-mon[130284]: from='osd.6 [v2:172.21.15.8:6818/1802966829,v1:172.21.15.8:6819/1802966829]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-08-11T12:19:23.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:23 smithi045 ceph-mon[130284]: osdmap e45: 7 total, 6 up, 7 in 2023-08-11T12:19:23.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:23 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-11T12:19:23.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:23 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-11T12:19:23.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:23 smithi045 ceph-mon[130284]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-08-11T12:19:23.932 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.b/config 2023-08-11T12:19:24.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:24 smithi045 ceph-mon[130284]: purged_snaps scrub starts 2023-08-11T12:19:24.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:24 smithi045 ceph-mon[130284]: purged_snaps scrub ok 2023-08-11T12:19:24.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:24 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-11T12:19:24.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:24 smithi045 ceph-mon[130284]: osd.6 [v2:172.21.15.8:6818/1802966829,v1:172.21.15.8:6819/1802966829] boot 2023-08-11T12:19:24.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:24 smithi045 ceph-mon[130284]: osdmap e46: 7 total, 7 up, 7 in 2023-08-11T12:19:24.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:24 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-11T12:19:24.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:24 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:24.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:24 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:24.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:24 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:19:24.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:24 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:19:24.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:24 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:19:24.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:24 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:24.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:24 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:24.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:24 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:19:24.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:24 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:24.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:24 smithi008 ceph-mon[97158]: purged_snaps scrub starts 2023-08-11T12:19:24.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:24 smithi008 ceph-mon[97158]: purged_snaps scrub ok 2023-08-11T12:19:24.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:24 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-11T12:19:24.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:24 smithi008 ceph-mon[97158]: osd.6 [v2:172.21.15.8:6818/1802966829,v1:172.21.15.8:6819/1802966829] boot 2023-08-11T12:19:24.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:24 smithi008 ceph-mon[97158]: osdmap e46: 7 total, 7 up, 7 in 2023-08-11T12:19:24.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:24 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-11T12:19:24.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:24 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:24.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:24 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:24.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:24 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:19:24.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:24 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:19:24.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:24 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:19:24.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:24 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:24.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:24 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:24.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:24 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:19:24.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:24 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:24.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:24 smithi194 ceph-mon[130905]: purged_snaps scrub starts 2023-08-11T12:19:24.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:24 smithi194 ceph-mon[130905]: purged_snaps scrub ok 2023-08-11T12:19:24.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:24 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-11T12:19:24.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:24 smithi194 ceph-mon[130905]: osd.6 [v2:172.21.15.8:6818/1802966829,v1:172.21.15.8:6819/1802966829] boot 2023-08-11T12:19:24.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:24 smithi194 ceph-mon[130905]: osdmap e46: 7 total, 7 up, 7 in 2023-08-11T12:19:24.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:24 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-11T12:19:24.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:24 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:24.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:24 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:24.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:24 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:19:24.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:24 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:19:24.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:24 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:19:24.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:24 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:24.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:24 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:24.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:24 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:19:24.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:24 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:25.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.206+0000 7fc3b06db700 1 -- 172.21.15.45:0/2571076858 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3a8102550 msgr2=0x7fc3a8108e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:19:25.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.206+0000 7fc3b06db700 1 --2- 172.21.15.45:0/2571076858 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3a8102550 0x7fc3a8108e00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc3a000b0d0 tx=0x7fc3a000b3e0 comp rx=0 tx=0).stop 2023-08-11T12:19:25.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.206+0000 7fc3b06db700 1 -- 172.21.15.45:0/2571076858 shutdown_connections 2023-08-11T12:19:25.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.206+0000 7fc3b06db700 1 --2- 172.21.15.45:0/2571076858 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3a8102550 0x7fc3a8108e00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:19:25.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.206+0000 7fc3b06db700 1 --2- 172.21.15.45:0/2571076858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3a81009b0 0x7fc3a8100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:19:25.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.206+0000 7fc3b06db700 1 --2- 172.21.15.45:0/2571076858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3a8101bb0 0x7fc3a8102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:19:25.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.206+0000 7fc3b06db700 1 -- 172.21.15.45:0/2571076858 >> 172.21.15.45:0/2571076858 conn(0x7fc3a80fbf10 msgr2=0x7fc3a80fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:19:25.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.206+0000 7fc3b06db700 1 -- 172.21.15.45:0/2571076858 shutdown_connections 2023-08-11T12:19:25.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.206+0000 7fc3b06db700 1 -- 172.21.15.45:0/2571076858 wait complete. 2023-08-11T12:19:25.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.206+0000 7fc3b06db700 1 Processor -- start 2023-08-11T12:19:25.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.206+0000 7fc3b06db700 1 -- start start 2023-08-11T12:19:25.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.207+0000 7fc3b06db700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3a81009b0 0x7fc3a81967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:19:25.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.207+0000 7fc3b06db700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3a8101bb0 0x7fc3a8196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:19:25.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.207+0000 7fc3b06db700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3a8102550 0x7fc3a819dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:19:25.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.207+0000 7fc3b06db700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a819e360 con 0x7fc3a8101bb0 2023-08-11T12:19:25.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.207+0000 7fc3b06db700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a819e4a0 con 0x7fc3a81009b0 2023-08-11T12:19:25.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.207+0000 7fc3b06db700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a819e630 con 0x7fc3a8102550 2023-08-11T12:19:25.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.207+0000 7fc3ae477700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3a81009b0 0x7fc3a81967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:19:25.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.207+0000 7fc3ae477700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3a81009b0 0x7fc3a81967d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43824/0 (socket says 172.21.15.45:43824) 2023-08-11T12:19:25.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.207+0000 7fc3ae477700 1 -- 172.21.15.45:0/356639157 learned_addr learned my addr 172.21.15.45:0/356639157 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-08-11T12:19:25.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.207+0000 7fc3aec78700 1 --2- 172.21.15.45:0/356639157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3a8102550 0x7fc3a819dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:19:25.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.207+0000 7fc3adc76700 1 --2- 172.21.15.45:0/356639157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3a8101bb0 0x7fc3a8196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:19:25.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.207+0000 7fc3ae477700 1 -- 172.21.15.45:0/356639157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3a8102550 msgr2=0x7fc3a819dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:19:25.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.207+0000 7fc3ae477700 1 --2- 172.21.15.45:0/356639157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3a8102550 0x7fc3a819dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:19:25.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.207+0000 7fc3ae477700 1 -- 172.21.15.45:0/356639157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3a8101bb0 msgr2=0x7fc3a8196d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:19:25.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.207+0000 7fc3ae477700 1 --2- 172.21.15.45:0/356639157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3a8101bb0 0x7fc3a8196d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:19:25.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.207+0000 7fc3ae477700 1 -- 172.21.15.45:0/356639157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a0009d00 con 0x7fc3a81009b0 2023-08-11T12:19:25.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.207+0000 7fc3adc76700 1 --2- 172.21.15.45:0/356639157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3a8101bb0 0x7fc3a8196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:19:25.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.207+0000 7fc3ae477700 1 --2- 172.21.15.45:0/356639157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3a81009b0 0x7fc3a81967d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400b500 tx=0x7fc3a400b8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:19:25.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.207+0000 7fc39f7fe700 1 -- 172.21.15.45:0/356639157 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4011830 con 0x7fc3a81009b0 2023-08-11T12:19:25.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.207+0000 7fc39f7fe700 1 -- 172.21.15.45:0/356639157 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc3a4011e50 con 0x7fc3a81009b0 2023-08-11T12:19:25.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.207+0000 7fc39f7fe700 1 -- 172.21.15.45:0/356639157 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a400f2e0 con 0x7fc3a81009b0 2023-08-11T12:19:25.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.208+0000 7fc3b06db700 1 -- 172.21.15.45:0/356639157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a819e910 con 0x7fc3a81009b0 2023-08-11T12:19:25.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.208+0000 7fc3b06db700 1 -- 172.21.15.45:0/356639157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a819ee40 con 0x7fc3a81009b0 2023-08-11T12:19:25.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.209+0000 7fc3b06db700 1 -- 172.21.15.45:0/356639157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a810c250 con 0x7fc3a81009b0 2023-08-11T12:19:25.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.209+0000 7fc39f7fe700 1 -- 172.21.15.45:0/356639157 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fc3a4010580 con 0x7fc3a81009b0 2023-08-11T12:19:25.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.210+0000 7fc39f7fe700 1 --2- 172.21.15.45:0/356639157 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc39409ffd0 0x7fc3940a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:19:25.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.210+0000 7fc39f7fe700 1 -- 172.21.15.45:0/356639157 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4965+0+0 (secure 0 0 0) 0x7fc3a40c9f70 con 0x7fc3a81009b0 2023-08-11T12:19:25.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.211+0000 7fc3adc76700 1 --2- 172.21.15.45:0/356639157 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc39409ffd0 0x7fc3940a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:19:25.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.211+0000 7fc3adc76700 1 --2- 172.21.15.45:0/356639157 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc39409ffd0 0x7fc3940a2490 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc398005fd0 tx=0x7fc398005ee0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:19:25.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.215+0000 7fc39f7fe700 1 -- 172.21.15.45:0/356639157 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fc3a40fcc30 con 0x7fc3a81009b0 2023-08-11T12:19:25.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:25.421+0000 7fc3b06db700 1 -- 172.21.15.45:0/356639157 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3a8060d60 con 0x7fc39409ffd0 2023-08-11T12:19:25.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:25 smithi194 ceph-mon[130905]: Detected new or changed devices on smithi008 2023-08-11T12:19:25.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:25 smithi194 ceph-mon[130905]: Adjusting osd_memory_target on smithi008 to 5757M 2023-08-11T12:19:25.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:25 smithi194 ceph-mon[130905]: osdmap e47: 7 total, 7 up, 7 in 2023-08-11T12:19:25.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:25 smithi194 ceph-mon[130905]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:25.644 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:25 smithi045 ceph-mon[130284]: Detected new or changed devices on smithi008 2023-08-11T12:19:25.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:25 smithi045 ceph-mon[130284]: Adjusting osd_memory_target on smithi008 to 5757M 2023-08-11T12:19:25.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:25 smithi045 ceph-mon[130284]: osdmap e47: 7 total, 7 up, 7 in 2023-08-11T12:19:25.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:25 smithi045 ceph-mon[130284]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:25.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:25 smithi008 ceph-mon[97158]: Detected new or changed devices on smithi008 2023-08-11T12:19:25.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:25 smithi008 ceph-mon[97158]: Adjusting osd_memory_target on smithi008 to 5757M 2023-08-11T12:19:25.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:25 smithi008 ceph-mon[97158]: osdmap e47: 7 total, 7 up, 7 in 2023-08-11T12:19:25.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:25 smithi008 ceph-mon[97158]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:26.571 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:26 smithi045 ceph-mon[130284]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:19:26.571 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:26 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:19:26.571 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:26 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:19:26.571 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:26 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:26.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:26 smithi194 ceph-mon[130905]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:19:26.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:26 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:19:26.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:26 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:19:26.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:26 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:26.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:26 smithi008 ceph-mon[97158]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:19:26.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:26 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:19:26.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:26 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:19:26.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:26 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:27.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:27 smithi194 ceph-mon[130905]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:27.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:27 smithi045 ceph-mon[130284]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:27.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:27 smithi008 ceph-mon[97158]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:28.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:28 smithi194 ceph-mon[130905]: from='client.? 172.21.15.45:0/2717441919' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "086aff58-1554-49fe-92ff-5166b115aeef"}]: dispatch 2023-08-11T12:19:28.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:28 smithi194 ceph-mon[130905]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "086aff58-1554-49fe-92ff-5166b115aeef"}]: dispatch 2023-08-11T12:19:28.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:28 smithi194 ceph-mon[130905]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "086aff58-1554-49fe-92ff-5166b115aeef"}]': finished 2023-08-11T12:19:28.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:28 smithi194 ceph-mon[130905]: osdmap e48: 8 total, 7 up, 8 in 2023-08-11T12:19:28.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:28 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-11T12:19:28.644 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:28 smithi045 ceph-mon[130284]: from='client.? 172.21.15.45:0/2717441919' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "086aff58-1554-49fe-92ff-5166b115aeef"}]: dispatch 2023-08-11T12:19:28.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:28 smithi045 ceph-mon[130284]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "086aff58-1554-49fe-92ff-5166b115aeef"}]: dispatch 2023-08-11T12:19:28.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:28 smithi045 ceph-mon[130284]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "086aff58-1554-49fe-92ff-5166b115aeef"}]': finished 2023-08-11T12:19:28.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:28 smithi045 ceph-mon[130284]: osdmap e48: 8 total, 7 up, 8 in 2023-08-11T12:19:28.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:28 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-11T12:19:28.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:28 smithi008 ceph-mon[97158]: from='client.? 172.21.15.45:0/2717441919' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "086aff58-1554-49fe-92ff-5166b115aeef"}]: dispatch 2023-08-11T12:19:28.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:28 smithi008 ceph-mon[97158]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "086aff58-1554-49fe-92ff-5166b115aeef"}]: dispatch 2023-08-11T12:19:28.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:28 smithi008 ceph-mon[97158]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "086aff58-1554-49fe-92ff-5166b115aeef"}]': finished 2023-08-11T12:19:28.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:28 smithi008 ceph-mon[97158]: osdmap e48: 8 total, 7 up, 8 in 2023-08-11T12:19:28.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:28 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-11T12:19:29.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:29 smithi194 ceph-mon[130905]: from='client.? 172.21.15.45:0/3141800948' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:19:29.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:29 smithi194 ceph-mon[130905]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:29.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:29 smithi045 ceph-mon[130284]: from='client.? 172.21.15.45:0/3141800948' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:19:29.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:29 smithi045 ceph-mon[130284]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:29.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:29 smithi008 ceph-mon[97158]: from='client.? 172.21.15.45:0/3141800948' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:19:29.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:29 smithi008 ceph-mon[97158]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:30.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:30 smithi194 ceph-mon[130905]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:30.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:30 smithi045 ceph-mon[130284]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:31.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:30 smithi008 ceph-mon[97158]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:33.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:33 smithi008 ceph-mon[97158]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:33.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:33 smithi194 ceph-mon[130905]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:33.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:33 smithi045 ceph-mon[130284]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:34.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:34 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-08-11T12:19:34.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:34 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:34.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:34 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-08-11T12:19:34.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:34 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:34.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:34 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-08-11T12:19:34.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:34 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:35.801 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:35 smithi045 ceph-mon[130284]: Deploying daemon osd.7 on smithi045 2023-08-11T12:19:35.801 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:35 smithi045 ceph-mon[130284]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:35.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:35 smithi008 ceph-mon[97158]: Deploying daemon osd.7 on smithi045 2023-08-11T12:19:35.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:35 smithi008 ceph-mon[97158]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:35.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:35 smithi194 ceph-mon[130905]: Deploying daemon osd.7 on smithi045 2023-08-11T12:19:35.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:35 smithi194 ceph-mon[130905]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:37.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:37 smithi045 ceph-mon[130284]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:37.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:37 smithi008 ceph-mon[97158]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:37.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:37 smithi194 ceph-mon[130905]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:39.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:39 smithi008 ceph-mon[97158]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:39.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:39 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:39.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:39 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:39.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:39 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:19:39.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:39 smithi194 ceph-mon[130905]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:39.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:39 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:39.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:39 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:39.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:39 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:19:39.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:39 smithi045 ceph-mon[130284]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:39.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:39 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:39.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:39 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:39.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:39 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:19:40.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:40 smithi194 ceph-mon[130905]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:40.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:40 smithi045 ceph-mon[130284]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:41.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:40 smithi008 ceph-mon[97158]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:41.486 INFO:teuthology.orchestra.run.smithi045.stdout:Created osd(s) 7 on host 'smithi045' 2023-08-11T12:19:41.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:41.484+0000 7fc39f7fe700 1 -- 172.21.15.45:0/356639157 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc3a8060d60 con 0x7fc39409ffd0 2023-08-11T12:19:41.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:41.486+0000 7fc3b06db700 1 -- 172.21.15.45:0/356639157 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc39409ffd0 msgr2=0x7fc3940a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:19:41.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:41.486+0000 7fc3b06db700 1 --2- 172.21.15.45:0/356639157 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc39409ffd0 0x7fc3940a2490 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc398005fd0 tx=0x7fc398005ee0 comp rx=0 tx=0).stop 2023-08-11T12:19:41.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:41.486+0000 7fc3b06db700 1 -- 172.21.15.45:0/356639157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3a81009b0 msgr2=0x7fc3a81967d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:19:41.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:41.486+0000 7fc3b06db700 1 --2- 172.21.15.45:0/356639157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3a81009b0 0x7fc3a81967d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400b500 tx=0x7fc3a400b8c0 comp rx=0 tx=0).stop 2023-08-11T12:19:41.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:41.486+0000 7fc3b06db700 1 -- 172.21.15.45:0/356639157 shutdown_connections 2023-08-11T12:19:41.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:41.486+0000 7fc3b06db700 1 --2- 172.21.15.45:0/356639157 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc39409ffd0 0x7fc3940a2490 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:19:41.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:41.486+0000 7fc3b06db700 1 --2- 172.21.15.45:0/356639157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3a8102550 0x7fc3a819dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:19:41.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:41.486+0000 7fc3b06db700 1 --2- 172.21.15.45:0/356639157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3a81009b0 0x7fc3a81967d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:19:41.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:41.486+0000 7fc3b06db700 1 --2- 172.21.15.45:0/356639157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3a8101bb0 0x7fc3a8196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:19:41.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:41.486+0000 7fc3b06db700 1 -- 172.21.15.45:0/356639157 >> 172.21.15.45:0/356639157 conn(0x7fc3a80fbf10 msgr2=0x7fc3a80fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:19:41.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:41.486+0000 7fc3b06db700 1 -- 172.21.15.45:0/356639157 shutdown_connections 2023-08-11T12:19:41.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:19:41.487+0000 7fc3b06db700 1 -- 172.21.15.45:0/356639157 wait complete. 2023-08-11T12:19:41.942 DEBUG:teuthology.orchestra.run.smithi045:osd.7> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.7.service 2023-08-11T12:19:41.944 INFO:tasks.cephadm:Deploying osd.8 on smithi194 with /dev/vg_nvme/lv_2... 2023-08-11T12:19:41.945 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-08-11T12:19:41.983 INFO:journalctl@ceph.osd.7.smithi045.stdout:-- Logs begin at Fri 2023-08-11 11:52:16 UTC. -- 2023-08-11T12:19:42.300 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:42 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:42.300 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:42 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:42.300 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:42 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:42.300 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:42 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:19:42.301 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:42 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:42.301 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:42 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:42.301 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:42 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:42.301 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:42 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:19:42.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:42 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:42.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:42 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:42.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:42 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:42.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:42 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:19:42.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:42 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:42.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:42 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:42.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:42 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:42.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:42 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:19:42.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:42 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:42.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:42 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:42.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:42 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:42.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:42 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:19:42.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:42 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:42.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:42 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:42.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:42 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:42.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:42 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:19:42.510 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.c/config 2023-08-11T12:19:43.032 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:19:42 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:19:42.666+0000 7f5fbed91640 -1 osd.7 0 log_to_monitors true 2023-08-11T12:19:43.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:43 smithi008 ceph-mon[97158]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:43.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:43 smithi008 ceph-mon[97158]: from='osd.7 [v2:172.21.15.45:6816/3715737148,v1:172.21.15.45:6817/3715737148]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-08-11T12:19:43.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:43 smithi008 ceph-mon[97158]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-08-11T12:19:43.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:43 smithi194 ceph-mon[130905]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:43.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:43 smithi194 ceph-mon[130905]: from='osd.7 [v2:172.21.15.45:6816/3715737148,v1:172.21.15.45:6817/3715737148]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-08-11T12:19:43.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:43 smithi194 ceph-mon[130905]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-08-11T12:19:43.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:43 smithi045 ceph-mon[130284]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:43.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:43 smithi045 ceph-mon[130284]: from='osd.7 [v2:172.21.15.45:6816/3715737148,v1:172.21.15.45:6817/3715737148]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-08-11T12:19:43.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:43 smithi045 ceph-mon[130284]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-08-11T12:19:43.884 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-08-11T12:19:43.885 INFO:teuthology.orchestra.run.smithi194.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-08-11T12:19:43.885 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10+0 records in 2023-08-11T12:19:43.885 INFO:teuthology.orchestra.run.smithi194.stderr:10+0 records out 2023-08-11T12:19:43.885 INFO:teuthology.orchestra.run.smithi194.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0110961 s, 945 MB/s 2023-08-11T12:19:43.885 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 2023-08-11T12:19:43.886 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping successful for: 2023-08-11T12:19:44.041 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:44 smithi045 ceph-mon[130284]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-08-11T12:19:44.041 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:44 smithi045 ceph-mon[130284]: osdmap e49: 8 total, 7 up, 8 in 2023-08-11T12:19:44.041 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:44 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-11T12:19:44.041 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:44 smithi045 ceph-mon[130284]: from='osd.7 [v2:172.21.15.45:6816/3715737148,v1:172.21.15.45:6817/3715737148]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2023-08-11T12:19:44.041 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:44 smithi045 ceph-mon[130284]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2023-08-11T12:19:44.187 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:44 smithi194 ceph-mon[130905]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-08-11T12:19:44.188 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:44 smithi194 ceph-mon[130905]: osdmap e49: 8 total, 7 up, 8 in 2023-08-11T12:19:44.188 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:44 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-11T12:19:44.188 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:44 smithi194 ceph-mon[130905]: from='osd.7 [v2:172.21.15.45:6816/3715737148,v1:172.21.15.45:6817/3715737148]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2023-08-11T12:19:44.188 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:44 smithi194 ceph-mon[130905]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2023-08-11T12:19:44.263 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi194:vg_nvme/lv_2 2023-08-11T12:19:44.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:44 smithi008 ceph-mon[97158]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-08-11T12:19:44.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:44 smithi008 ceph-mon[97158]: osdmap e49: 8 total, 7 up, 8 in 2023-08-11T12:19:44.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:44 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-11T12:19:44.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:44 smithi008 ceph-mon[97158]: from='osd.7 [v2:172.21.15.45:6816/3715737148,v1:172.21.15.45:6817/3715737148]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2023-08-11T12:19:44.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:44 smithi008 ceph-mon[97158]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2023-08-11T12:19:44.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:19:44 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:19:44.042+0000 7f5fb4409700 -1 osd.7 0 waiting for initial osdmap 2023-08-11T12:19:44.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:19:44 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:19:44.054+0000 7f5fad1f8700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-11T12:19:44.820 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.c/config 2023-08-11T12:19:45.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:45 smithi008 ceph-mon[97158]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2023-08-11T12:19:45.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:45 smithi008 ceph-mon[97158]: osdmap e50: 8 total, 7 up, 8 in 2023-08-11T12:19:45.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:45 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-11T12:19:45.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:45 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-11T12:19:45.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:45 smithi008 ceph-mon[97158]: Detected new or changed devices on smithi045 2023-08-11T12:19:45.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:45 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:45.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:45 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:45.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:45 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:19:45.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:45 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:19:45.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:45 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:19:45.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:45 smithi008 ceph-mon[97158]: Adjusting osd_memory_target on smithi045 to 5724M 2023-08-11T12:19:45.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:45 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:45.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:45 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:45.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:45 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:19:45.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:45 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:45.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:45 smithi008 ceph-mon[97158]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:45.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:45 smithi008 ceph-mon[97158]: osd.7 [v2:172.21.15.45:6816/3715737148,v1:172.21.15.45:6817/3715737148] boot 2023-08-11T12:19:45.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:45 smithi008 ceph-mon[97158]: osdmap e51: 8 total, 8 up, 8 in 2023-08-11T12:19:45.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:45 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-11T12:19:45.319 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:45 smithi194 ceph-mon[130905]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2023-08-11T12:19:45.320 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:45 smithi194 ceph-mon[130905]: osdmap e50: 8 total, 7 up, 8 in 2023-08-11T12:19:45.320 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:45 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-11T12:19:45.320 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:45 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-11T12:19:45.320 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:45 smithi194 ceph-mon[130905]: Detected new or changed devices on smithi045 2023-08-11T12:19:45.321 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:45 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:45.321 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:45 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:45.321 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:45 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:19:45.321 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:45 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:19:45.321 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:45 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:19:45.321 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:45 smithi194 ceph-mon[130905]: Adjusting osd_memory_target on smithi045 to 5724M 2023-08-11T12:19:45.321 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:45 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:45.322 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:45 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:45.322 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:45 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:19:45.322 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:45 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:45.322 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:45 smithi194 ceph-mon[130905]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:45.322 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:45 smithi194 ceph-mon[130905]: osd.7 [v2:172.21.15.45:6816/3715737148,v1:172.21.15.45:6817/3715737148] boot 2023-08-11T12:19:45.322 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:45 smithi194 ceph-mon[130905]: osdmap e51: 8 total, 8 up, 8 in 2023-08-11T12:19:45.322 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:45 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-11T12:19:45.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:45 smithi045 ceph-mon[130284]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2023-08-11T12:19:45.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:45 smithi045 ceph-mon[130284]: osdmap e50: 8 total, 7 up, 8 in 2023-08-11T12:19:45.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:45 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-11T12:19:45.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:45 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-11T12:19:45.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:45 smithi045 ceph-mon[130284]: Detected new or changed devices on smithi045 2023-08-11T12:19:45.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:45 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:45.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:45 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:45.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:45 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:19:45.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:45 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:19:45.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:45 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:19:45.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:45 smithi045 ceph-mon[130284]: Adjusting osd_memory_target on smithi045 to 5724M 2023-08-11T12:19:45.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:45 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:45.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:45 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:45.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:45 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:19:45.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:45 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:45.398 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:45 smithi045 ceph-mon[130284]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-11T12:19:45.398 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:45 smithi045 ceph-mon[130284]: osd.7 [v2:172.21.15.45:6816/3715737148,v1:172.21.15.45:6817/3715737148] boot 2023-08-11T12:19:45.398 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:45 smithi045 ceph-mon[130284]: osdmap e51: 8 total, 8 up, 8 in 2023-08-11T12:19:45.398 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:45 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-11T12:19:45.983 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.978+0000 7efe977d4700 1 -- 172.21.15.194:0/2647171867 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe901009b0 msgr2=0x7efe90100dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:19:45.984 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.978+0000 7efe977d4700 1 --2- 172.21.15.194:0/2647171867 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe901009b0 0x7efe90100dd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efe80009990 tx=0x7efe80009ca0 comp rx=0 tx=0).stop 2023-08-11T12:19:45.984 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.978+0000 7efe977d4700 1 -- 172.21.15.194:0/2647171867 shutdown_connections 2023-08-11T12:19:45.984 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.978+0000 7efe977d4700 1 --2- 172.21.15.194:0/2647171867 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe901009b0 0x7efe90100dd0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:19:45.984 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.978+0000 7efe977d4700 1 --2- 172.21.15.194:0/2647171867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe90102550 0x7efe90108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:19:45.985 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.978+0000 7efe977d4700 1 --2- 172.21.15.194:0/2647171867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe90101bb0 0x7efe90102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:19:45.985 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.978+0000 7efe977d4700 1 -- 172.21.15.194:0/2647171867 >> 172.21.15.194:0/2647171867 conn(0x7efe900fbf10 msgr2=0x7efe900fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:19:45.985 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.978+0000 7efe977d4700 1 -- 172.21.15.194:0/2647171867 shutdown_connections 2023-08-11T12:19:45.985 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.978+0000 7efe977d4700 1 -- 172.21.15.194:0/2647171867 wait complete. 2023-08-11T12:19:45.986 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.979+0000 7efe977d4700 1 Processor -- start 2023-08-11T12:19:45.986 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.979+0000 7efe977d4700 1 -- start start 2023-08-11T12:19:45.986 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.979+0000 7efe977d4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe901009b0 0x7efe900746c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:19:45.986 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.979+0000 7efe977d4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe90101bb0 0x7efe90072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:19:45.986 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.979+0000 7efe977d4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe90102550 0x7efe90073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:19:45.986 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.979+0000 7efe977d4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe900739d0 con 0x7efe901009b0 2023-08-11T12:19:45.987 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.979+0000 7efe977d4700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe90073b40 con 0x7efe90101bb0 2023-08-11T12:19:45.987 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.979+0000 7efe977d4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe901a08a0 con 0x7efe90102550 2023-08-11T12:19:45.987 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.979+0000 7efe95d71700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe90102550 0x7efe90073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:19:45.987 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.979+0000 7efe95d71700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe90102550 0x7efe90073250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:40388/0 (socket says 172.21.15.194:40388) 2023-08-11T12:19:45.987 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.979+0000 7efe95d71700 1 -- 172.21.15.194:0/2439719278 learned_addr learned my addr 172.21.15.194:0/2439719278 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-08-11T12:19:45.987 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.979+0000 7efe95570700 1 --2- 172.21.15.194:0/2439719278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe901009b0 0x7efe900746c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:19:45.987 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.979+0000 7efe94d6f700 1 --2- 172.21.15.194:0/2439719278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe90101bb0 0x7efe90072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:19:45.988 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.979+0000 7efe95d71700 1 -- 172.21.15.194:0/2439719278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe90101bb0 msgr2=0x7efe90072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:19:45.988 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.979+0000 7efe95d71700 1 --2- 172.21.15.194:0/2439719278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe90101bb0 0x7efe90072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:19:45.988 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.979+0000 7efe95d71700 1 -- 172.21.15.194:0/2439719278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe901009b0 msgr2=0x7efe900746c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:19:45.988 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.979+0000 7efe95d71700 1 --2- 172.21.15.194:0/2439719278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe901009b0 0x7efe900746c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:19:45.988 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.979+0000 7efe95d71700 1 -- 172.21.15.194:0/2439719278 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe800095f0 con 0x7efe90102550 2023-08-11T12:19:45.989 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.979+0000 7efe94d6f700 1 --2- 172.21.15.194:0/2439719278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe90101bb0 0x7efe90072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:19:45.989 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.979+0000 7efe95d71700 1 --2- 172.21.15.194:0/2439719278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe90102550 0x7efe90073250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efe8800b970 tx=0x7efe8800bd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:19:45.989 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.980+0000 7efe867fc700 1 -- 172.21.15.194:0/2439719278 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8800c9b0 con 0x7efe90102550 2023-08-11T12:19:45.989 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.980+0000 7efe867fc700 1 -- 172.21.15.194:0/2439719278 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe88014440 con 0x7efe90102550 2023-08-11T12:19:45.989 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.980+0000 7efe977d4700 1 -- 172.21.15.194:0/2439719278 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe901a0b80 con 0x7efe90102550 2023-08-11T12:19:45.989 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.980+0000 7efe867fc700 1 -- 172.21.15.194:0/2439719278 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe880075d0 con 0x7efe90102550 2023-08-11T12:19:45.989 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.980+0000 7efe977d4700 1 -- 172.21.15.194:0/2439719278 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe901a1080 con 0x7efe90102550 2023-08-11T12:19:45.990 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.980+0000 7efe977d4700 1 -- 172.21.15.194:0/2439719278 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe90108060 con 0x7efe90102550 2023-08-11T12:19:45.990 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.981+0000 7efe867fc700 1 -- 172.21.15.194:0/2439719278 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7efe880145b0 con 0x7efe90102550 2023-08-11T12:19:45.991 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.982+0000 7efe867fc700 1 --2- 172.21.15.194:0/2439719278 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7efe7c09ffd0 0x7efe7c0a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:19:45.991 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.982+0000 7efe867fc700 1 -- 172.21.15.194:0/2439719278 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5426+0+0 (secure 0 0 0) 0x7efe88006e40 con 0x7efe90102550 2023-08-11T12:19:45.991 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.982+0000 7efe95570700 1 --2- 172.21.15.194:0/2439719278 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7efe7c09ffd0 0x7efe7c0a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:19:45.991 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.983+0000 7efe95570700 1 --2- 172.21.15.194:0/2439719278 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7efe7c09ffd0 0x7efe7c0a2490 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efe8000b5c0 tx=0x7efe80005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:19:45.992 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:45.986+0000 7efe867fc700 1 -- 172.21.15.194:0/2439719278 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7efe88094670 con 0x7efe90102550 2023-08-11T12:19:46.185 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:19:46.182+0000 7efe977d4700 1 -- 172.21.15.194:0/2439719278 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7efe9002ceb0 con 0x7efe7c09ffd0 2023-08-11T12:19:46.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:46 smithi194 ceph-mon[130905]: purged_snaps scrub starts 2023-08-11T12:19:46.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:46 smithi194 ceph-mon[130905]: purged_snaps scrub ok 2023-08-11T12:19:46.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:46 smithi194 ceph-mon[130905]: osdmap e52: 8 total, 8 up, 8 in 2023-08-11T12:19:46.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:46 smithi194 ceph-mon[130905]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:19:46.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:46 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:19:46.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:46 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:19:46.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:46 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:46.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:46 smithi194 ceph-mon[130905]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:19:46.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:46 smithi045 ceph-mon[130284]: purged_snaps scrub starts 2023-08-11T12:19:46.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:46 smithi045 ceph-mon[130284]: purged_snaps scrub ok 2023-08-11T12:19:46.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:46 smithi045 ceph-mon[130284]: osdmap e52: 8 total, 8 up, 8 in 2023-08-11T12:19:46.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:46 smithi045 ceph-mon[130284]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:19:46.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:46 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:19:46.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:46 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:19:46.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:46 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:46.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:46 smithi045 ceph-mon[130284]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:19:47.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:46 smithi008 ceph-mon[97158]: purged_snaps scrub starts 2023-08-11T12:19:47.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:46 smithi008 ceph-mon[97158]: purged_snaps scrub ok 2023-08-11T12:19:47.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:46 smithi008 ceph-mon[97158]: osdmap e52: 8 total, 8 up, 8 in 2023-08-11T12:19:47.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:46 smithi008 ceph-mon[97158]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:19:47.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:46 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:19:47.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:46 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:19:47.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:46 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:47.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:46 smithi008 ceph-mon[97158]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:19:47.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:47 smithi194 ceph-mon[130905]: osdmap e53: 8 total, 8 up, 8 in 2023-08-11T12:19:47.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:47 smithi045 ceph-mon[130284]: osdmap e53: 8 total, 8 up, 8 in 2023-08-11T12:19:48.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:47 smithi008 ceph-mon[97158]: osdmap e53: 8 total, 8 up, 8 in 2023-08-11T12:19:49.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:48 smithi008 ceph-mon[97158]: osdmap e54: 8 total, 8 up, 8 in 2023-08-11T12:19:49.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:48 smithi008 ceph-mon[97158]: from='client.? 172.21.15.194:0/1964411456' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7fff5e95-2453-4ea6-a5c1-3bba6a1f6400"}]: dispatch 2023-08-11T12:19:49.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:48 smithi008 ceph-mon[97158]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7fff5e95-2453-4ea6-a5c1-3bba6a1f6400"}]: dispatch 2023-08-11T12:19:49.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:48 smithi008 ceph-mon[97158]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7fff5e95-2453-4ea6-a5c1-3bba6a1f6400"}]': finished 2023-08-11T12:19:49.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:48 smithi008 ceph-mon[97158]: osdmap e55: 9 total, 8 up, 9 in 2023-08-11T12:19:49.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:48 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-11T12:19:49.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:48 smithi008 ceph-mon[97158]: pgmap v174: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:19:49.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:48 smithi194 ceph-mon[130905]: osdmap e54: 8 total, 8 up, 8 in 2023-08-11T12:19:49.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:48 smithi194 ceph-mon[130905]: from='client.? 172.21.15.194:0/1964411456' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7fff5e95-2453-4ea6-a5c1-3bba6a1f6400"}]: dispatch 2023-08-11T12:19:49.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:48 smithi194 ceph-mon[130905]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7fff5e95-2453-4ea6-a5c1-3bba6a1f6400"}]: dispatch 2023-08-11T12:19:49.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:48 smithi194 ceph-mon[130905]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7fff5e95-2453-4ea6-a5c1-3bba6a1f6400"}]': finished 2023-08-11T12:19:49.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:48 smithi194 ceph-mon[130905]: osdmap e55: 9 total, 8 up, 9 in 2023-08-11T12:19:49.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:48 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-11T12:19:49.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:48 smithi194 ceph-mon[130905]: pgmap v174: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:19:49.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:48 smithi045 ceph-mon[130284]: osdmap e54: 8 total, 8 up, 8 in 2023-08-11T12:19:49.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:48 smithi045 ceph-mon[130284]: from='client.? 172.21.15.194:0/1964411456' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7fff5e95-2453-4ea6-a5c1-3bba6a1f6400"}]: dispatch 2023-08-11T12:19:49.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:48 smithi045 ceph-mon[130284]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7fff5e95-2453-4ea6-a5c1-3bba6a1f6400"}]: dispatch 2023-08-11T12:19:49.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:48 smithi045 ceph-mon[130284]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7fff5e95-2453-4ea6-a5c1-3bba6a1f6400"}]': finished 2023-08-11T12:19:49.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:48 smithi045 ceph-mon[130284]: osdmap e55: 9 total, 8 up, 9 in 2023-08-11T12:19:49.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:48 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-11T12:19:49.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:48 smithi045 ceph-mon[130284]: pgmap v174: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:19:50.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:49 smithi008 ceph-mon[97158]: from='client.? 172.21.15.194:0/2947011319' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:19:50.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:49 smithi194 ceph-mon[130905]: from='client.? 172.21.15.194:0/2947011319' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:19:50.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:49 smithi045 ceph-mon[130284]: from='client.? 172.21.15.194:0/2947011319' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:19:51.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:50 smithi008 ceph-mon[97158]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:19:51.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:50 smithi194 ceph-mon[130905]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:19:51.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:50 smithi045 ceph-mon[130284]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:19:53.593 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:53 smithi194 ceph-mon[130905]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:19:53.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:53 smithi008 ceph-mon[97158]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:19:53.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:53 smithi045 ceph-mon[130284]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:19:55.767 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:55 smithi194 ceph-mon[130905]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:19:55.767 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:55 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-08-11T12:19:55.768 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:55 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:55.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:55 smithi008 ceph-mon[97158]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:19:55.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:55 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-08-11T12:19:55.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:55 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:55.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:55 smithi045 ceph-mon[130284]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:19:55.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:55 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-08-11T12:19:55.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:55 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:19:56.627 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:56 smithi194 ceph-mon[130905]: Deploying daemon osd.8 on smithi194 2023-08-11T12:19:56.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:56 smithi008 ceph-mon[97158]: Deploying daemon osd.8 on smithi194 2023-08-11T12:19:56.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:56 smithi045 ceph-mon[130284]: Deploying daemon osd.8 on smithi194 2023-08-11T12:19:57.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:57 smithi008 ceph-mon[97158]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:19:57.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:57 smithi194 ceph-mon[130905]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:19:57.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:57 smithi045 ceph-mon[130284]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:19:59.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:59 smithi008 ceph-mon[97158]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:19:59.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:59 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:59.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:59 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:59.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:19:59 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:19:59.848 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:59 smithi194 ceph-mon[130905]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:19:59.848 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:59 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:59.849 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:59 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:59.849 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:19:59 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:19:59.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:59 smithi045 ceph-mon[130284]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:19:59.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:59 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:59.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:59 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:19:59.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:19:59 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:20:00.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:00 smithi194 ceph-mon[130905]: overall HEALTH_OK 2023-08-11T12:20:00.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:00 smithi194 ceph-mon[130905]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:20:00.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:00 smithi045 ceph-mon[130284]: overall HEALTH_OK 2023-08-11T12:20:00.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:00 smithi045 ceph-mon[130284]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:20:01.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:00 smithi008 ceph-mon[97158]: overall HEALTH_OK 2023-08-11T12:20:01.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:00 smithi008 ceph-mon[97158]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:20:01.496 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 8 on host 'smithi194' 2023-08-11T12:20:01.497 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:01.494+0000 7efe867fc700 1 -- 172.21.15.194:0/2439719278 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7efe9002ceb0 con 0x7efe7c09ffd0 2023-08-11T12:20:01.501 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:01.496+0000 7efe977d4700 1 -- 172.21.15.194:0/2439719278 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7efe7c09ffd0 msgr2=0x7efe7c0a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:20:01.501 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:01.496+0000 7efe977d4700 1 --2- 172.21.15.194:0/2439719278 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7efe7c09ffd0 0x7efe7c0a2490 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efe8000b5c0 tx=0x7efe80005fb0 comp rx=0 tx=0).stop 2023-08-11T12:20:01.501 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:01.496+0000 7efe977d4700 1 -- 172.21.15.194:0/2439719278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe90102550 msgr2=0x7efe90073250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:20:01.501 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:01.496+0000 7efe977d4700 1 --2- 172.21.15.194:0/2439719278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe90102550 0x7efe90073250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efe8800b970 tx=0x7efe8800bd30 comp rx=0 tx=0).stop 2023-08-11T12:20:01.501 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:01.496+0000 7efe977d4700 1 -- 172.21.15.194:0/2439719278 shutdown_connections 2023-08-11T12:20:01.501 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:01.496+0000 7efe977d4700 1 --2- 172.21.15.194:0/2439719278 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7efe7c09ffd0 0x7efe7c0a2490 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:20:01.502 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:01.496+0000 7efe977d4700 1 --2- 172.21.15.194:0/2439719278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe90102550 0x7efe90073250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:20:01.502 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:01.496+0000 7efe977d4700 1 --2- 172.21.15.194:0/2439719278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe901009b0 0x7efe900746c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:20:01.502 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:01.496+0000 7efe977d4700 1 --2- 172.21.15.194:0/2439719278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe90101bb0 0x7efe90072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:20:01.502 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:01.496+0000 7efe977d4700 1 -- 172.21.15.194:0/2439719278 >> 172.21.15.194:0/2439719278 conn(0x7efe900fbf10 msgr2=0x7efe901051a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:20:01.502 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:01.496+0000 7efe977d4700 1 -- 172.21.15.194:0/2439719278 shutdown_connections 2023-08-11T12:20:01.502 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:01.496+0000 7efe977d4700 1 -- 172.21.15.194:0/2439719278 wait complete. 2023-08-11T12:20:01.898 DEBUG:teuthology.orchestra.run.smithi194:osd.8> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.8.service 2023-08-11T12:20:01.900 INFO:tasks.cephadm:Deploying osd.9 on smithi008 with /dev/vg_nvme/lv_1... 2023-08-11T12:20:01.901 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-08-11T12:20:01.932 INFO:journalctl@ceph.osd.8.smithi194.stdout:-- Logs begin at Fri 2023-08-11 11:52:16 UTC. -- 2023-08-11T12:20:02.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:02 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:02.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:02 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:02.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:02 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:02.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:02 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:20:02.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:02 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:02.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:02 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:02.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:02 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:02.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:02 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:20:02.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:02 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:02.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:02 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:02.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:02 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:02.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:02 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:20:02.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:02 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:02.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:02 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:02.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:02 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:02.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:02 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:20:02.647 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:20:02.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:02 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:02.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:02 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:02.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:02 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:02.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:02 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:20:02.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:02 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:02.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:02 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:02.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:02 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:02.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:02 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:20:03.355 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:20:03 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:20:03.035+0000 7f01692a5640 -1 osd.8 0 log_to_monitors true 2023-08-11T12:20:03.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:03 smithi008 ceph-mon[97158]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:20:03.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:03 smithi008 ceph-mon[97158]: from='osd.8 [v2:172.21.15.194:6816/57497127,v1:172.21.15.194:6817/57497127]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-08-11T12:20:03.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:03 smithi008 ceph-mon[97158]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-08-11T12:20:03.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:03 smithi194 ceph-mon[130905]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:20:03.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:03 smithi194 ceph-mon[130905]: from='osd.8 [v2:172.21.15.194:6816/57497127,v1:172.21.15.194:6817/57497127]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-08-11T12:20:03.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:03 smithi194 ceph-mon[130905]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-08-11T12:20:03.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:03 smithi045 ceph-mon[130284]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:20:03.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:03 smithi045 ceph-mon[130284]: from='osd.8 [v2:172.21.15.194:6816/57497127,v1:172.21.15.194:6817/57497127]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-08-11T12:20:03.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:03 smithi045 ceph-mon[130284]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-08-11T12:20:04.643 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:20:04 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:20:04.359+0000 7f015e91d700 -1 osd.8 0 waiting for initial osdmap 2023-08-11T12:20:04.643 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:20:04 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:20:04.368+0000 7f015870e700 -1 osd.8 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-11T12:20:04.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:04 smithi194 ceph-mon[130905]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-08-11T12:20:04.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:04 smithi194 ceph-mon[130905]: osdmap e56: 9 total, 8 up, 9 in 2023-08-11T12:20:04.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:04 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-11T12:20:04.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:04 smithi194 ceph-mon[130905]: from='osd.8 [v2:172.21.15.194:6816/57497127,v1:172.21.15.194:6817/57497127]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2023-08-11T12:20:04.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:04 smithi194 ceph-mon[130905]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2023-08-11T12:20:04.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:04 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:04.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:04 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:04.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:04 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:04.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:04 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:04.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:04 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:04.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:04 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:04.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:04 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:04.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:04 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:20:04.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:04 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:04.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:04 smithi045 ceph-mon[130284]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-08-11T12:20:04.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:04 smithi045 ceph-mon[130284]: osdmap e56: 9 total, 8 up, 9 in 2023-08-11T12:20:04.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:04 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-11T12:20:04.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:04 smithi045 ceph-mon[130284]: from='osd.8 [v2:172.21.15.194:6816/57497127,v1:172.21.15.194:6817/57497127]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2023-08-11T12:20:04.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:04 smithi045 ceph-mon[130284]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2023-08-11T12:20:04.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:04 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:04.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:04 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:04.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:04 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:04.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:04 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:04.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:04 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:04.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:04 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:04.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:04 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:04.648 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:04 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:20:04.648 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:04 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:04.775 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-08-11T12:20:04.775 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-08-11T12:20:04.775 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10+0 records in 2023-08-11T12:20:04.776 INFO:teuthology.orchestra.run.smithi008.stderr:10+0 records out 2023-08-11T12:20:04.776 INFO:teuthology.orchestra.run.smithi008.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0403536 s, 260 MB/s 2023-08-11T12:20:04.776 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 2023-08-11T12:20:04.777 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping successful for: 2023-08-11T12:20:04.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:04 smithi008 ceph-mon[97158]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-08-11T12:20:04.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:04 smithi008 ceph-mon[97158]: osdmap e56: 9 total, 8 up, 9 in 2023-08-11T12:20:04.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:04 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-11T12:20:04.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:04 smithi008 ceph-mon[97158]: from='osd.8 [v2:172.21.15.194:6816/57497127,v1:172.21.15.194:6817/57497127]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2023-08-11T12:20:04.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:04 smithi008 ceph-mon[97158]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2023-08-11T12:20:04.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:04 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:04.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:04 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:04.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:04 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:04.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:04 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:04.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:04 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:04.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:04 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:04.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:04 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:04.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:04 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:20:04.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:04 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:05.326 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi008:vg_nvme/lv_1 2023-08-11T12:20:05.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:05 smithi008 ceph-mon[97158]: Detected new or changed devices on smithi194 2023-08-11T12:20:05.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:05 smithi008 ceph-mon[97158]: Adjusting osd_memory_target on smithi194 to 5722M 2023-08-11T12:20:05.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:05 smithi008 ceph-mon[97158]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2023-08-11T12:20:05.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:05 smithi008 ceph-mon[97158]: osdmap e57: 9 total, 8 up, 9 in 2023-08-11T12:20:05.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:05 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-11T12:20:05.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:05 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-11T12:20:05.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:05 smithi008 ceph-mon[97158]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:20:05.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:05 smithi008 ceph-mon[97158]: osd.8 [v2:172.21.15.194:6816/57497127,v1:172.21.15.194:6817/57497127] boot 2023-08-11T12:20:05.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:05 smithi008 ceph-mon[97158]: osdmap e58: 9 total, 9 up, 9 in 2023-08-11T12:20:05.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:05 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-11T12:20:05.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:05 smithi194 ceph-mon[130905]: Detected new or changed devices on smithi194 2023-08-11T12:20:05.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:05 smithi194 ceph-mon[130905]: Adjusting osd_memory_target on smithi194 to 5722M 2023-08-11T12:20:05.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:05 smithi194 ceph-mon[130905]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2023-08-11T12:20:05.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:05 smithi194 ceph-mon[130905]: osdmap e57: 9 total, 8 up, 9 in 2023-08-11T12:20:05.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:05 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-11T12:20:05.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:05 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-11T12:20:05.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:05 smithi194 ceph-mon[130905]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:20:05.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:05 smithi194 ceph-mon[130905]: osd.8 [v2:172.21.15.194:6816/57497127,v1:172.21.15.194:6817/57497127] boot 2023-08-11T12:20:05.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:05 smithi194 ceph-mon[130905]: osdmap e58: 9 total, 9 up, 9 in 2023-08-11T12:20:05.646 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:05 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-11T12:20:05.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:05 smithi045 ceph-mon[130284]: Detected new or changed devices on smithi194 2023-08-11T12:20:05.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:05 smithi045 ceph-mon[130284]: Adjusting osd_memory_target on smithi194 to 5722M 2023-08-11T12:20:05.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:05 smithi045 ceph-mon[130284]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2023-08-11T12:20:05.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:05 smithi045 ceph-mon[130284]: osdmap e57: 9 total, 8 up, 9 in 2023-08-11T12:20:05.648 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:05 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-11T12:20:05.648 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:05 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-11T12:20:05.648 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:05 smithi045 ceph-mon[130284]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-11T12:20:05.649 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:05 smithi045 ceph-mon[130284]: osd.8 [v2:172.21.15.194:6816/57497127,v1:172.21.15.194:6817/57497127] boot 2023-08-11T12:20:05.649 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:05 smithi045 ceph-mon[130284]: osdmap e58: 9 total, 9 up, 9 in 2023-08-11T12:20:05.649 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:05 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-11T12:20:06.063 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:20:06.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:06 smithi194 ceph-mon[130905]: purged_snaps scrub starts 2023-08-11T12:20:06.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:06 smithi194 ceph-mon[130905]: purged_snaps scrub ok 2023-08-11T12:20:06.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:06 smithi194 ceph-mon[130905]: osdmap e59: 9 total, 9 up, 9 in 2023-08-11T12:20:06.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:06 smithi194 ceph-mon[130905]: pgmap v187: 1 pgs: 1 remapped+peering; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-08-11T12:20:06.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:06 smithi045 ceph-mon[130284]: purged_snaps scrub starts 2023-08-11T12:20:06.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:06 smithi045 ceph-mon[130284]: purged_snaps scrub ok 2023-08-11T12:20:06.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:06 smithi045 ceph-mon[130284]: osdmap e59: 9 total, 9 up, 9 in 2023-08-11T12:20:06.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:06 smithi045 ceph-mon[130284]: pgmap v187: 1 pgs: 1 remapped+peering; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-08-11T12:20:06.902 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:06 smithi008 ceph-mon[97158]: purged_snaps scrub starts 2023-08-11T12:20:06.902 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:06 smithi008 ceph-mon[97158]: purged_snaps scrub ok 2023-08-11T12:20:06.902 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:06 smithi008 ceph-mon[97158]: osdmap e59: 9 total, 9 up, 9 in 2023-08-11T12:20:06.903 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:06 smithi008 ceph-mon[97158]: pgmap v187: 1 pgs: 1 remapped+peering; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-08-11T12:20:07.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.588+0000 7f9f00045700 1 -- 172.21.15.8:0/548199208 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef81009b0 msgr2=0x7f9ef8100dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:20:07.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.588+0000 7f9f00045700 1 --2- 172.21.15.8:0/548199208 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef81009b0 0x7f9ef8100dd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9ef40099c0 tx=0x7f9ef4009cd0 comp rx=0 tx=0).stop 2023-08-11T12:20:07.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.588+0000 7f9f00045700 1 -- 172.21.15.8:0/548199208 shutdown_connections 2023-08-11T12:20:07.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.588+0000 7f9f00045700 1 --2- 172.21.15.8:0/548199208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ef8102550 0x7f9ef8108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:20:07.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.588+0000 7f9f00045700 1 --2- 172.21.15.8:0/548199208 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef81009b0 0x7f9ef8100dd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:20:07.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.588+0000 7f9f00045700 1 --2- 172.21.15.8:0/548199208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ef8101bb0 0x7f9ef8102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:20:07.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.588+0000 7f9f00045700 1 -- 172.21.15.8:0/548199208 >> 172.21.15.8:0/548199208 conn(0x7f9ef80fbf10 msgr2=0x7f9ef80fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:20:07.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.588+0000 7f9f00045700 1 -- 172.21.15.8:0/548199208 shutdown_connections 2023-08-11T12:20:07.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.588+0000 7f9f00045700 1 -- 172.21.15.8:0/548199208 wait complete. 2023-08-11T12:20:07.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.589+0000 7f9f00045700 1 Processor -- start 2023-08-11T12:20:07.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.590+0000 7f9f00045700 1 -- start start 2023-08-11T12:20:07.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.590+0000 7f9f00045700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef81009b0 0x7f9ef80746c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:20:07.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.590+0000 7f9f00045700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ef8101bb0 0x7f9ef8072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:20:07.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.590+0000 7f9f00045700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ef8102550 0x7f9ef8073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:20:07.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.590+0000 7f9f00045700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef80739d0 con 0x7f9ef81009b0 2023-08-11T12:20:07.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.590+0000 7f9f00045700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef8073b40 con 0x7f9ef8101bb0 2023-08-11T12:20:07.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.590+0000 7f9f00045700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef81a0710 con 0x7f9ef8102550 2023-08-11T12:20:07.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.591+0000 7f9efdde1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef81009b0 0x7f9ef80746c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:20:07.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.591+0000 7f9efdde1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef81009b0 0x7f9ef80746c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39120/0 (socket says 172.21.15.8:39120) 2023-08-11T12:20:07.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.591+0000 7f9efdde1700 1 -- 172.21.15.8:0/3008830137 learned_addr learned my addr 172.21.15.8:0/3008830137 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:20:07.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.591+0000 7f9efe5e2700 1 --2- 172.21.15.8:0/3008830137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ef8102550 0x7f9ef8073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:20:07.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.591+0000 7f9efd5e0700 1 --2- 172.21.15.8:0/3008830137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ef8101bb0 0x7f9ef8072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:20:07.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.591+0000 7f9efdde1700 1 -- 172.21.15.8:0/3008830137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ef8102550 msgr2=0x7f9ef8073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:20:07.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.591+0000 7f9efdde1700 1 --2- 172.21.15.8:0/3008830137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ef8102550 0x7f9ef8073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:20:07.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.591+0000 7f9efdde1700 1 -- 172.21.15.8:0/3008830137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ef8101bb0 msgr2=0x7f9ef8072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:20:07.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.591+0000 7f9efdde1700 1 --2- 172.21.15.8:0/3008830137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ef8101bb0 0x7f9ef8072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:20:07.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.591+0000 7f9efdde1700 1 -- 172.21.15.8:0/3008830137 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef40095f0 con 0x7f9ef81009b0 2023-08-11T12:20:07.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.591+0000 7f9efdde1700 1 --2- 172.21.15.8:0/3008830137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef81009b0 0x7f9ef80746c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4009990 tx=0x7f9ef400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:20:07.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.592+0000 7f9eeeffd700 1 -- 172.21.15.8:0/3008830137 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef401d070 con 0x7f9ef81009b0 2023-08-11T12:20:07.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.592+0000 7f9eeeffd700 1 -- 172.21.15.8:0/3008830137 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ef4005030 con 0x7f9ef81009b0 2023-08-11T12:20:07.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.592+0000 7f9eeeffd700 1 -- 172.21.15.8:0/3008830137 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef4004b30 con 0x7f9ef81009b0 2023-08-11T12:20:07.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.592+0000 7f9f00045700 1 -- 172.21.15.8:0/3008830137 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef81a0990 con 0x7f9ef81009b0 2023-08-11T12:20:07.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.592+0000 7f9f00045700 1 -- 172.21.15.8:0/3008830137 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef81a0d50 con 0x7f9ef81009b0 2023-08-11T12:20:07.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.593+0000 7f9f00045700 1 -- 172.21.15.8:0/3008830137 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef8107fd0 con 0x7f9ef81009b0 2023-08-11T12:20:07.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.595+0000 7f9eeeffd700 1 -- 172.21.15.8:0/3008830137 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f9ef4004cd0 con 0x7f9ef81009b0 2023-08-11T12:20:07.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.596+0000 7f9eeeffd700 1 --2- 172.21.15.8:0/3008830137 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9ee409ffd0 0x7f9ee40a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:20:07.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.596+0000 7f9eeeffd700 1 -- 172.21.15.8:0/3008830137 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5858+0+0 (secure 0 0 0) 0x7f9ef40cb6f0 con 0x7f9ef81009b0 2023-08-11T12:20:07.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.596+0000 7f9efd5e0700 1 --2- 172.21.15.8:0/3008830137 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9ee409ffd0 0x7f9ee40a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:20:07.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.597+0000 7f9efd5e0700 1 --2- 172.21.15.8:0/3008830137 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9ee409ffd0 0x7f9ee40a2490 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8009c60 tx=0x7f9ee8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:20:07.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.600+0000 7f9eeeffd700 1 -- 172.21.15.8:0/3008830137 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f9ef4095e00 con 0x7f9ef81009b0 2023-08-11T12:20:07.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:07.820+0000 7f9f00045700 1 -- 172.21.15.8:0/3008830137 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ef802ce50 con 0x7f9ee409ffd0 2023-08-11T12:20:08.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:07 smithi008 ceph-mon[97158]: osdmap e60: 9 total, 9 up, 9 in 2023-08-11T12:20:08.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:07 smithi194 ceph-mon[130905]: osdmap e60: 9 total, 9 up, 9 in 2023-08-11T12:20:08.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:07 smithi045 ceph-mon[130284]: osdmap e60: 9 total, 9 up, 9 in 2023-08-11T12:20:08.918 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:08 smithi008 ceph-mon[97158]: osdmap e61: 9 total, 9 up, 9 in 2023-08-11T12:20:08.919 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:08 smithi008 ceph-mon[97158]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:20:08.919 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:08 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:20:08.920 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:08 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:20:08.920 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:08 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:08.920 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:08 smithi008 ceph-mon[97158]: pgmap v190: 1 pgs: 1 remapped+peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-11T12:20:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:08 smithi194 ceph-mon[130905]: osdmap e61: 9 total, 9 up, 9 in 2023-08-11T12:20:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:08 smithi194 ceph-mon[130905]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:20:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:08 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:20:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:08 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:20:09.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:08 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:09.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:08 smithi194 ceph-mon[130905]: pgmap v190: 1 pgs: 1 remapped+peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-11T12:20:09.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:08 smithi045 ceph-mon[130284]: osdmap e61: 9 total, 9 up, 9 in 2023-08-11T12:20:09.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:08 smithi045 ceph-mon[130284]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:20:09.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:08 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:20:09.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:08 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:20:09.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:08 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:09.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:08 smithi045 ceph-mon[130284]: pgmap v190: 1 pgs: 1 remapped+peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-11T12:20:10.005 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:09 smithi008 ceph-mon[97158]: osdmap e62: 9 total, 9 up, 9 in 2023-08-11T12:20:10.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:09 smithi194 ceph-mon[130905]: osdmap e62: 9 total, 9 up, 9 in 2023-08-11T12:20:10.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:09 smithi045 ceph-mon[130284]: osdmap e62: 9 total, 9 up, 9 in 2023-08-11T12:20:11.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:10 smithi008 ceph-mon[97158]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 119 KiB/s, 0 objects/s recovering 2023-08-11T12:20:11.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:10 smithi194 ceph-mon[130905]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 119 KiB/s, 0 objects/s recovering 2023-08-11T12:20:11.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:10 smithi045 ceph-mon[130284]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 119 KiB/s, 0 objects/s recovering 2023-08-11T12:20:12.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:11 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2928836894' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31ab0121-4c92-42ec-9f19-e672062e8814"}]: dispatch 2023-08-11T12:20:12.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:11 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2928836894' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31ab0121-4c92-42ec-9f19-e672062e8814"}]': finished 2023-08-11T12:20:12.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:11 smithi008 ceph-mon[97158]: osdmap e63: 10 total, 9 up, 10 in 2023-08-11T12:20:12.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:11 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-11T12:20:12.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:11 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2928836894' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31ab0121-4c92-42ec-9f19-e672062e8814"}]: dispatch 2023-08-11T12:20:12.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:11 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2928836894' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31ab0121-4c92-42ec-9f19-e672062e8814"}]': finished 2023-08-11T12:20:12.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:11 smithi194 ceph-mon[130905]: osdmap e63: 10 total, 9 up, 10 in 2023-08-11T12:20:12.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:11 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-11T12:20:12.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:11 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2928836894' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31ab0121-4c92-42ec-9f19-e672062e8814"}]: dispatch 2023-08-11T12:20:12.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:11 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2928836894' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31ab0121-4c92-42ec-9f19-e672062e8814"}]': finished 2023-08-11T12:20:12.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:11 smithi045 ceph-mon[130284]: osdmap e63: 10 total, 9 up, 10 in 2023-08-11T12:20:12.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:11 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-11T12:20:13.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:12 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/4267229092' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:20:13.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:12 smithi008 ceph-mon[97158]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2023-08-11T12:20:13.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:12 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/4267229092' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:20:13.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:12 smithi194 ceph-mon[130905]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2023-08-11T12:20:13.144 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:12 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/4267229092' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:20:13.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:12 smithi045 ceph-mon[130284]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2023-08-11T12:20:15.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:15 smithi008 ceph-mon[97158]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2023-08-11T12:20:15.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:15 smithi194 ceph-mon[130905]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2023-08-11T12:20:15.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:15 smithi045 ceph-mon[130284]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2023-08-11T12:20:17.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:17 smithi008 ceph-mon[97158]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-08-11T12:20:17.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:17 smithi194 ceph-mon[130905]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-08-11T12:20:17.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:17 smithi045 ceph-mon[130284]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-08-11T12:20:19.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:19 smithi008 ceph-mon[97158]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2023-08-11T12:20:19.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:19 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-08-11T12:20:19.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:19 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:19.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:19 smithi194 ceph-mon[130905]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2023-08-11T12:20:19.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:19 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-08-11T12:20:19.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:19 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:19.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:19 smithi045 ceph-mon[130284]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2023-08-11T12:20:19.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:19 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-08-11T12:20:19.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:19 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:20.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:20 smithi008 ceph-mon[97158]: Deploying daemon osd.9 on smithi008 2023-08-11T12:20:20.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:20 smithi194 ceph-mon[130905]: Deploying daemon osd.9 on smithi008 2023-08-11T12:20:20.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:20 smithi045 ceph-mon[130284]: Deploying daemon osd.9 on smithi008 2023-08-11T12:20:21.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:21 smithi008 ceph-mon[97158]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-11T12:20:21.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:21 smithi194 ceph-mon[130905]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-11T12:20:21.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:21 smithi045 ceph-mon[130284]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-11T12:20:23.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:23 smithi008 ceph-mon[97158]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-11T12:20:23.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:23 smithi194 ceph-mon[130905]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-11T12:20:23.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:23 smithi045 ceph-mon[130284]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-11T12:20:25.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:25 smithi008 ceph-mon[97158]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-11T12:20:25.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:25 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:25.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:25 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:25.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:25 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:20:25.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:25 smithi194 ceph-mon[130905]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-11T12:20:25.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:25 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:25.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:25 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:25.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:25 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:20:25.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:25 smithi045 ceph-mon[130284]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-11T12:20:25.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:25 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:25.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:25 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:25.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:25 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:20:27.721 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:27 smithi008 ceph-mon[97158]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-11T12:20:27.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:27 smithi194 ceph-mon[130905]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-11T12:20:27.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:27 smithi045 ceph-mon[130284]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-11T12:20:28.993 INFO:teuthology.orchestra.run.smithi008.stdout:Created osd(s) 9 on host 'smithi008' 2023-08-11T12:20:28.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:28.990+0000 7f9eeeffd700 1 -- 172.21.15.8:0/3008830137 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9ef802ce50 con 0x7f9ee409ffd0 2023-08-11T12:20:28.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:28.992+0000 7f9f00045700 1 -- 172.21.15.8:0/3008830137 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9ee409ffd0 msgr2=0x7f9ee40a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:20:28.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:28.992+0000 7f9f00045700 1 --2- 172.21.15.8:0/3008830137 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9ee409ffd0 0x7f9ee40a2490 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8009c60 tx=0x7f9ee8009260 comp rx=0 tx=0).stop 2023-08-11T12:20:28.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:28.992+0000 7f9f00045700 1 -- 172.21.15.8:0/3008830137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef81009b0 msgr2=0x7f9ef80746c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:20:28.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:28.992+0000 7f9f00045700 1 --2- 172.21.15.8:0/3008830137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef81009b0 0x7f9ef80746c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4009990 tx=0x7f9ef400f690 comp rx=0 tx=0).stop 2023-08-11T12:20:28.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:28.993+0000 7f9f00045700 1 -- 172.21.15.8:0/3008830137 shutdown_connections 2023-08-11T12:20:28.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:28.993+0000 7f9f00045700 1 --2- 172.21.15.8:0/3008830137 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9ee409ffd0 0x7f9ee40a2490 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:20:28.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:28.993+0000 7f9f00045700 1 --2- 172.21.15.8:0/3008830137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ef8102550 0x7f9ef8073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:20:28.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:28.993+0000 7f9f00045700 1 --2- 172.21.15.8:0/3008830137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef81009b0 0x7f9ef80746c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:20:28.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:28.993+0000 7f9f00045700 1 --2- 172.21.15.8:0/3008830137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ef8101bb0 0x7f9ef8072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:20:28.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:28.993+0000 7f9f00045700 1 -- 172.21.15.8:0/3008830137 >> 172.21.15.8:0/3008830137 conn(0x7f9ef80fbf10 msgr2=0x7f9ef8105110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:20:28.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:28.993+0000 7f9f00045700 1 -- 172.21.15.8:0/3008830137 shutdown_connections 2023-08-11T12:20:28.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:20:28.993+0000 7f9f00045700 1 -- 172.21.15.8:0/3008830137 wait complete. 2023-08-11T12:20:29.482 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:29.482 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:29.482 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:29.483 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:20:29.483 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:29.483 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:29 smithi008 ceph-mon[97158]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-11T12:20:29.483 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:29.483 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:29.483 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:20:29.485 DEBUG:teuthology.orchestra.run.smithi008:osd.9> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.9.service 2023-08-11T12:20:29.489 INFO:tasks.cephadm:Deploying osd.10 on smithi045 with /dev/vg_nvme/lv_1... 2023-08-11T12:20:29.489 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-08-11T12:20:29.569 INFO:journalctl@ceph.osd.9.smithi008.stdout:-- Logs begin at Fri 2023-08-11 11:56:28 UTC. -- 2023-08-11T12:20:29.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:29.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:29.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:29.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:20:29.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:29.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:29 smithi194 ceph-mon[130905]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-11T12:20:29.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:29.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:29.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:20:29.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:29.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:29.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:29.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:20:29.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:29.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:29 smithi045 ceph-mon[130284]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-11T12:20:29.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:29.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:29.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:20:30.063 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.b/config 2023-08-11T12:20:30.520 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:30 smithi008 ceph-mon[97158]: from='osd.9 [v2:172.21.15.8:6826/434661930,v1:172.21.15.8:6827/434661930]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-08-11T12:20:30.594 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:30 smithi045 ceph-mon[130284]: from='osd.9 [v2:172.21.15.8:6826/434661930,v1:172.21.15.8:6827/434661930]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-08-11T12:20:30.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:30 smithi194 ceph-mon[130905]: from='osd.9 [v2:172.21.15.8:6826/434661930,v1:172.21.15.8:6827/434661930]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-08-11T12:20:31.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:31 smithi008 ceph-mon[97158]: from='osd.9 [v2:172.21.15.8:6826/434661930,v1:172.21.15.8:6827/434661930]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-08-11T12:20:31.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:31 smithi008 ceph-mon[97158]: osdmap e64: 10 total, 9 up, 10 in 2023-08-11T12:20:31.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:31 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-11T12:20:31.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:31 smithi008 ceph-mon[97158]: from='osd.9 [v2:172.21.15.8:6826/434661930,v1:172.21.15.8:6827/434661930]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-08-11T12:20:31.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:31 smithi008 ceph-mon[97158]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-11T12:20:31.555 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:20:31 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:20:31.328+0000 7f59838c0700 -1 osd.9 0 waiting for initial osdmap 2023-08-11T12:20:31.555 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:20:31 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:20:31.344+0000 7f597eeb4700 -1 osd.9 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-11T12:20:31.565 INFO:teuthology.orchestra.run.smithi045.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-08-11T12:20:31.566 INFO:teuthology.orchestra.run.smithi045.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-08-11T12:20:31.566 INFO:teuthology.orchestra.run.smithi045.stderr: stderr: 10+0 records in 2023-08-11T12:20:31.566 INFO:teuthology.orchestra.run.smithi045.stderr:10+0 records out 2023-08-11T12:20:31.567 INFO:teuthology.orchestra.run.smithi045.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00805108 s, 1.3 GB/s 2023-08-11T12:20:31.567 INFO:teuthology.orchestra.run.smithi045.stderr:--> Zapping successful for: 2023-08-11T12:20:31.597 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:31 smithi045 ceph-mon[130284]: from='osd.9 [v2:172.21.15.8:6826/434661930,v1:172.21.15.8:6827/434661930]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-08-11T12:20:31.597 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:31 smithi045 ceph-mon[130284]: osdmap e64: 10 total, 9 up, 10 in 2023-08-11T12:20:31.597 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:31 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-11T12:20:31.598 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:31 smithi045 ceph-mon[130284]: from='osd.9 [v2:172.21.15.8:6826/434661930,v1:172.21.15.8:6827/434661930]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-08-11T12:20:31.598 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:31 smithi045 ceph-mon[130284]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-11T12:20:31.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:31 smithi194 ceph-mon[130905]: from='osd.9 [v2:172.21.15.8:6826/434661930,v1:172.21.15.8:6827/434661930]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-08-11T12:20:31.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:31 smithi194 ceph-mon[130905]: osdmap e64: 10 total, 9 up, 10 in 2023-08-11T12:20:31.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:31 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-11T12:20:31.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:31 smithi194 ceph-mon[130905]: from='osd.9 [v2:172.21.15.8:6826/434661930,v1:172.21.15.8:6827/434661930]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-08-11T12:20:31.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:31 smithi194 ceph-mon[130905]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-11T12:20:32.113 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi045:vg_nvme/lv_1 2023-08-11T12:20:32.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:32 smithi045 ceph-mon[130284]: from='osd.9 [v2:172.21.15.8:6826/434661930,v1:172.21.15.8:6827/434661930]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-08-11T12:20:32.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:32 smithi045 ceph-mon[130284]: osdmap e65: 10 total, 9 up, 10 in 2023-08-11T12:20:32.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:32 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-11T12:20:32.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:32 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-11T12:20:32.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:32 smithi008 ceph-mon[97158]: from='osd.9 [v2:172.21.15.8:6826/434661930,v1:172.21.15.8:6827/434661930]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-08-11T12:20:32.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:32 smithi008 ceph-mon[97158]: osdmap e65: 10 total, 9 up, 10 in 2023-08-11T12:20:32.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:32 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-11T12:20:32.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:32 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-11T12:20:32.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:32 smithi194 ceph-mon[130905]: from='osd.9 [v2:172.21.15.8:6826/434661930,v1:172.21.15.8:6827/434661930]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-08-11T12:20:32.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:32 smithi194 ceph-mon[130905]: osdmap e65: 10 total, 9 up, 10 in 2023-08-11T12:20:32.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:32 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-11T12:20:32.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:32 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-11T12:20:32.677 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.b/config 2023-08-11T12:20:33.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:33 smithi194 ceph-mon[130905]: purged_snaps scrub starts 2023-08-11T12:20:33.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:33 smithi194 ceph-mon[130905]: purged_snaps scrub ok 2023-08-11T12:20:33.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:33 smithi194 ceph-mon[130905]: osd.9 [v2:172.21.15.8:6826/434661930,v1:172.21.15.8:6827/434661930] boot 2023-08-11T12:20:33.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:33 smithi194 ceph-mon[130905]: osdmap e66: 10 total, 10 up, 10 in 2023-08-11T12:20:33.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:33 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-11T12:20:33.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:33 smithi194 ceph-mon[130905]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:33.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:33 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:33.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:33 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:33.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:33 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:33.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:33 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:33.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:33 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:33.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:33 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:33.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:33 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:33.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:33 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:33.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:33 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:20:33.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:33 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:33.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:33 smithi045 ceph-mon[130284]: purged_snaps scrub starts 2023-08-11T12:20:33.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:33 smithi045 ceph-mon[130284]: purged_snaps scrub ok 2023-08-11T12:20:33.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:33 smithi045 ceph-mon[130284]: osd.9 [v2:172.21.15.8:6826/434661930,v1:172.21.15.8:6827/434661930] boot 2023-08-11T12:20:33.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:33 smithi045 ceph-mon[130284]: osdmap e66: 10 total, 10 up, 10 in 2023-08-11T12:20:33.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:33 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-11T12:20:33.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:33 smithi045 ceph-mon[130284]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:33.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:33 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:33.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:33 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:33.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:33 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:33.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:33 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:33.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:33 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:33.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:33 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:33.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:33 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:33.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:33 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:33.648 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:33 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:20:33.648 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:33 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:33.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:33 smithi008 ceph-mon[97158]: purged_snaps scrub starts 2023-08-11T12:20:33.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:33 smithi008 ceph-mon[97158]: purged_snaps scrub ok 2023-08-11T12:20:33.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:33 smithi008 ceph-mon[97158]: osd.9 [v2:172.21.15.8:6826/434661930,v1:172.21.15.8:6827/434661930] boot 2023-08-11T12:20:33.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:33 smithi008 ceph-mon[97158]: osdmap e66: 10 total, 10 up, 10 in 2023-08-11T12:20:33.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:33 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-11T12:20:33.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:33 smithi008 ceph-mon[97158]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:33.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:33 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:33.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:33 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:33.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:33 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:33.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:33 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:33.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:33 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:33.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:33 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:33.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:33 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:33.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:33 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:33.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:33 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:20:33.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:33 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:33.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.892+0000 7f60fee29700 1 -- 172.21.15.45:0/3914226805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60f80ff8c0 msgr2=0x7f60f80ffce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:20:33.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.892+0000 7f60fee29700 1 --2- 172.21.15.45:0/3914226805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60f80ff8c0 0x7f60f80ffce0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f60ec0099c0 tx=0x7f60ec009cd0 comp rx=0 tx=0).stop 2023-08-11T12:20:33.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.892+0000 7f60fee29700 1 -- 172.21.15.45:0/3914226805 shutdown_connections 2023-08-11T12:20:33.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.892+0000 7f60fee29700 1 --2- 172.21.15.45:0/3914226805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60f8101460 0x7f60f8107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:20:33.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.892+0000 7f60fee29700 1 --2- 172.21.15.45:0/3914226805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60f80ff8c0 0x7f60f80ffce0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:20:33.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.892+0000 7f60fee29700 1 --2- 172.21.15.45:0/3914226805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60f8100ac0 0x7f60f8100f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:20:33.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.892+0000 7f60fee29700 1 -- 172.21.15.45:0/3914226805 >> 172.21.15.45:0/3914226805 conn(0x7f60f80fae60 msgr2=0x7f60f80fd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:20:33.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.892+0000 7f60fee29700 1 -- 172.21.15.45:0/3914226805 shutdown_connections 2023-08-11T12:20:33.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.892+0000 7f60fee29700 1 -- 172.21.15.45:0/3914226805 wait complete. 2023-08-11T12:20:33.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.892+0000 7f60fee29700 1 Processor -- start 2023-08-11T12:20:33.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.892+0000 7f60fee29700 1 -- start start 2023-08-11T12:20:33.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.892+0000 7f60fee29700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60f80ff8c0 0x7f60f810d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:20:33.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.892+0000 7f60fee29700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60f8100ac0 0x7f60f810bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:20:33.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.892+0000 7f60fee29700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60f8101460 0x7f60f810c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:20:33.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.892+0000 7f60fee29700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f810c880 con 0x7f60f80ff8c0 2023-08-11T12:20:33.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.893+0000 7f60fee29700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f810c9f0 con 0x7f60f8101460 2023-08-11T12:20:33.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.893+0000 7f60fee29700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f81a0660 con 0x7f60f8100ac0 2023-08-11T12:20:33.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.893+0000 7f60fd3c6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60f8101460 0x7f60f810c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:20:33.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.893+0000 7f60fd3c6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60f8101460 0x7f60f810c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43980/0 (socket says 172.21.15.45:43980) 2023-08-11T12:20:33.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.893+0000 7f60fd3c6700 1 -- 172.21.15.45:0/1867547411 learned_addr learned my addr 172.21.15.45:0/1867547411 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-08-11T12:20:33.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.893+0000 7f60fcbc5700 1 --2- 172.21.15.45:0/1867547411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60f80ff8c0 0x7f60f810d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:20:33.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.893+0000 7f60f7fff700 1 --2- 172.21.15.45:0/1867547411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60f8100ac0 0x7f60f810bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:20:33.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.893+0000 7f60fd3c6700 1 -- 172.21.15.45:0/1867547411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60f8100ac0 msgr2=0x7f60f810bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:20:33.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.893+0000 7f60fd3c6700 1 --2- 172.21.15.45:0/1867547411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60f8100ac0 0x7f60f810bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:20:33.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.893+0000 7f60fd3c6700 1 -- 172.21.15.45:0/1867547411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60f80ff8c0 msgr2=0x7f60f810d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:20:33.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.893+0000 7f60fd3c6700 1 --2- 172.21.15.45:0/1867547411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60f80ff8c0 0x7f60f810d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:20:33.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.893+0000 7f60fd3c6700 1 -- 172.21.15.45:0/1867547411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ec0095f0 con 0x7f60f8101460 2023-08-11T12:20:33.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.893+0000 7f60fcbc5700 1 --2- 172.21.15.45:0/1867547411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60f80ff8c0 0x7f60f810d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:20:33.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.893+0000 7f60fd3c6700 1 --2- 172.21.15.45:0/1867547411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60f8101460 0x7f60f810c100 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f60f0007d70 tx=0x7f60f000a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:20:33.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.893+0000 7f60f5ffb700 1 -- 172.21.15.45:0/1867547411 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f000ad40 con 0x7f60f8101460 2023-08-11T12:20:33.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.893+0000 7f60f5ffb700 1 -- 172.21.15.45:0/1867547411 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f60f00128e0 con 0x7f60f8101460 2023-08-11T12:20:33.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.893+0000 7f60fee29700 1 -- 172.21.15.45:0/1867547411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f81a0940 con 0x7f60f8101460 2023-08-11T12:20:33.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.893+0000 7f60f5ffb700 1 -- 172.21.15.45:0/1867547411 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f0011780 con 0x7f60f8101460 2023-08-11T12:20:33.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.894+0000 7f60fee29700 1 -- 172.21.15.45:0/1867547411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f81a0e40 con 0x7f60f8101460 2023-08-11T12:20:33.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.894+0000 7f60fee29700 1 -- 172.21.15.45:0/1867547411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f810b0c0 con 0x7f60f8101460 2023-08-11T12:20:33.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.895+0000 7f60f5ffb700 1 -- 172.21.15.45:0/1867547411 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f60f0012a50 con 0x7f60f8101460 2023-08-11T12:20:33.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.896+0000 7f60f5ffb700 1 --2- 172.21.15.45:0/1867547411 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f60e809ffd0 0x7f60e80a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:20:33.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.896+0000 7f60f5ffb700 1 -- 172.21.15.45:0/1867547411 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f60f00cad30 con 0x7f60f8101460 2023-08-11T12:20:33.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.896+0000 7f60fcbc5700 1 --2- 172.21.15.45:0/1867547411 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f60e809ffd0 0x7f60e80a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:20:33.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.897+0000 7f60fcbc5700 1 --2- 172.21.15.45:0/1867547411 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f60e809ffd0 0x7f60e80a2490 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f60ec00b580 tx=0x7f60ec005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:20:33.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:33.900+0000 7f60f5ffb700 1 -- 172.21.15.45:0/1867547411 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f60f00952c0 con 0x7f60f8101460 2023-08-11T12:20:34.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:34.109+0000 7f60fee29700 1 -- 172.21.15.45:0/1867547411 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f60f80fbde0 con 0x7f60e809ffd0 2023-08-11T12:20:34.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:34 smithi194 ceph-mon[130905]: Detected new or changed devices on smithi008 2023-08-11T12:20:34.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:34 smithi194 ceph-mon[130905]: Adjusting osd_memory_target on smithi008 to 4318M 2023-08-11T12:20:34.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:34 smithi194 ceph-mon[130905]: osdmap e67: 10 total, 10 up, 10 in 2023-08-11T12:20:34.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:34 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:20:34.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:34 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:20:34.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:34 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:34.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:34 smithi045 ceph-mon[130284]: Detected new or changed devices on smithi008 2023-08-11T12:20:34.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:34 smithi045 ceph-mon[130284]: Adjusting osd_memory_target on smithi008 to 4318M 2023-08-11T12:20:34.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:34 smithi045 ceph-mon[130284]: osdmap e67: 10 total, 10 up, 10 in 2023-08-11T12:20:34.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:34 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:20:34.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:34 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:20:34.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:34 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:34.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:34 smithi008 ceph-mon[97158]: Detected new or changed devices on smithi008 2023-08-11T12:20:34.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:34 smithi008 ceph-mon[97158]: Adjusting osd_memory_target on smithi008 to 4318M 2023-08-11T12:20:34.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:34 smithi008 ceph-mon[97158]: osdmap e67: 10 total, 10 up, 10 in 2023-08-11T12:20:34.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:34 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:20:34.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:34 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:20:34.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:34 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:35.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:35 smithi194 ceph-mon[130905]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:20:35.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:35 smithi194 ceph-mon[130905]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:35.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:35 smithi045 ceph-mon[130284]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:20:35.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:35 smithi045 ceph-mon[130284]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:35.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:35 smithi008 ceph-mon[97158]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:20:35.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:35 smithi008 ceph-mon[97158]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:36.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:36 smithi008 ceph-mon[97158]: from='client.? 172.21.15.45:0/3532158342' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62c632e4-94f6-4630-9d94-8d28fccacf45"}]: dispatch 2023-08-11T12:20:36.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:36 smithi008 ceph-mon[97158]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62c632e4-94f6-4630-9d94-8d28fccacf45"}]: dispatch 2023-08-11T12:20:36.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:36 smithi008 ceph-mon[97158]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62c632e4-94f6-4630-9d94-8d28fccacf45"}]': finished 2023-08-11T12:20:36.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:36 smithi008 ceph-mon[97158]: osdmap e68: 11 total, 10 up, 11 in 2023-08-11T12:20:36.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:36 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-11T12:20:36.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:36 smithi194 ceph-mon[130905]: from='client.? 172.21.15.45:0/3532158342' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62c632e4-94f6-4630-9d94-8d28fccacf45"}]: dispatch 2023-08-11T12:20:36.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:36 smithi194 ceph-mon[130905]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62c632e4-94f6-4630-9d94-8d28fccacf45"}]: dispatch 2023-08-11T12:20:36.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:36 smithi194 ceph-mon[130905]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62c632e4-94f6-4630-9d94-8d28fccacf45"}]': finished 2023-08-11T12:20:36.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:36 smithi194 ceph-mon[130905]: osdmap e68: 11 total, 10 up, 11 in 2023-08-11T12:20:36.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:36 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-11T12:20:36.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:36 smithi045 ceph-mon[130284]: from='client.? 172.21.15.45:0/3532158342' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62c632e4-94f6-4630-9d94-8d28fccacf45"}]: dispatch 2023-08-11T12:20:36.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:36 smithi045 ceph-mon[130284]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62c632e4-94f6-4630-9d94-8d28fccacf45"}]: dispatch 2023-08-11T12:20:36.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:36 smithi045 ceph-mon[130284]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62c632e4-94f6-4630-9d94-8d28fccacf45"}]': finished 2023-08-11T12:20:36.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:36 smithi045 ceph-mon[130284]: osdmap e68: 11 total, 10 up, 11 in 2023-08-11T12:20:36.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:36 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-11T12:20:37.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:37 smithi008 ceph-mon[97158]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:37.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:37 smithi008 ceph-mon[97158]: from='client.? 172.21.15.45:0/873019080' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:20:37.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:37 smithi194 ceph-mon[130905]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:37.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:37 smithi194 ceph-mon[130905]: from='client.? 172.21.15.45:0/873019080' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:20:37.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:37 smithi045 ceph-mon[130284]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:37.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:37 smithi045 ceph-mon[130284]: from='client.? 172.21.15.45:0/873019080' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:20:39.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:39 smithi008 ceph-mon[97158]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:39.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:39 smithi194 ceph-mon[130905]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:39.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:39 smithi045 ceph-mon[130284]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:40.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:40 smithi045 ceph-mon[130284]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:41.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:40 smithi008 ceph-mon[97158]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:41.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:40 smithi194 ceph-mon[130905]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:43.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:43 smithi008 ceph-mon[97158]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:43.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:43 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-08-11T12:20:43.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:43 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:43.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:43 smithi194 ceph-mon[130905]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:43.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:43 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-08-11T12:20:43.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:43 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:43.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:43 smithi045 ceph-mon[130284]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:43.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:43 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-08-11T12:20:43.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:43 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:44.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:44 smithi008 ceph-mon[97158]: Deploying daemon osd.10 on smithi045 2023-08-11T12:20:44.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:44 smithi194 ceph-mon[130905]: Deploying daemon osd.10 on smithi045 2023-08-11T12:20:44.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:44 smithi045 ceph-mon[130284]: Deploying daemon osd.10 on smithi045 2023-08-11T12:20:45.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:45 smithi045 ceph-mon[130284]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:45.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:45 smithi008 ceph-mon[97158]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:45.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:45 smithi194 ceph-mon[130905]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:47.721 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:47 smithi045 ceph-mon[130284]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:47.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:47 smithi008 ceph-mon[97158]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:47.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:47 smithi194 ceph-mon[130905]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:48.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:48 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:48.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:48 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:48.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:48 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:20:48.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:48 smithi045 ceph-mon[130284]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:49.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:48 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:49.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:48 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:49.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:48 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:20:49.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:48 smithi008 ceph-mon[97158]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:49.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:48 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:49.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:48 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:49.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:48 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:20:49.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:48 smithi194 ceph-mon[130905]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:50.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:50.524+0000 7f60f5ffb700 1 -- 172.21.15.45:0/1867547411 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f60f80fbde0 con 0x7f60e809ffd0 2023-08-11T12:20:50.527 INFO:teuthology.orchestra.run.smithi045.stdout:Created osd(s) 10 on host 'smithi045' 2023-08-11T12:20:50.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:50.527+0000 7f60fee29700 1 -- 172.21.15.45:0/1867547411 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f60e809ffd0 msgr2=0x7f60e80a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:20:50.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:50.527+0000 7f60fee29700 1 --2- 172.21.15.45:0/1867547411 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f60e809ffd0 0x7f60e80a2490 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f60ec00b580 tx=0x7f60ec005fb0 comp rx=0 tx=0).stop 2023-08-11T12:20:50.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:50.527+0000 7f60fee29700 1 -- 172.21.15.45:0/1867547411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60f8101460 msgr2=0x7f60f810c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:20:50.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:50.527+0000 7f60fee29700 1 --2- 172.21.15.45:0/1867547411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60f8101460 0x7f60f810c100 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f60f0007d70 tx=0x7f60f000a340 comp rx=0 tx=0).stop 2023-08-11T12:20:50.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:50.527+0000 7f60fee29700 1 -- 172.21.15.45:0/1867547411 shutdown_connections 2023-08-11T12:20:50.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:50.527+0000 7f60fee29700 1 --2- 172.21.15.45:0/1867547411 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f60e809ffd0 0x7f60e80a2490 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:20:50.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:50.527+0000 7f60fee29700 1 --2- 172.21.15.45:0/1867547411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60f8101460 0x7f60f810c100 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:20:50.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:50.527+0000 7f60fee29700 1 --2- 172.21.15.45:0/1867547411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60f80ff8c0 0x7f60f810d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:20:50.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:50.527+0000 7f60fee29700 1 --2- 172.21.15.45:0/1867547411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60f8100ac0 0x7f60f810bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:20:50.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:50.527+0000 7f60fee29700 1 -- 172.21.15.45:0/1867547411 >> 172.21.15.45:0/1867547411 conn(0x7f60f80fae60 msgr2=0x7f60f80fb6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:20:50.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:50.527+0000 7f60fee29700 1 -- 172.21.15.45:0/1867547411 shutdown_connections 2023-08-11T12:20:50.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-08-11T12:20:50.527+0000 7f60fee29700 1 -- 172.21.15.45:0/1867547411 wait complete. 2023-08-11T12:20:50.973 DEBUG:teuthology.orchestra.run.smithi045:osd.10> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.10.service 2023-08-11T12:20:50.976 INFO:tasks.cephadm:Deploying osd.11 on smithi194 with /dev/vg_nvme/lv_1... 2023-08-11T12:20:50.976 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-08-11T12:20:51.009 INFO:journalctl@ceph.osd.10.smithi045.stdout:-- Logs begin at Fri 2023-08-11 11:52:16 UTC. -- 2023-08-11T12:20:51.541 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.c/config 2023-08-11T12:20:51.739 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:51 smithi194 ceph-mon[130905]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:51.739 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:51 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:51.739 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:51 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:51.740 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:51 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:51.740 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:51 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:51.783 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:51 smithi045 ceph-mon[130284]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:51.784 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:51 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:51.784 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:51 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:51.784 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:51 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:51.784 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:51 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:51.786 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:20:51 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:20:51.780+0000 7f2ff6cab640 -1 osd.10 0 log_to_monitors true 2023-08-11T12:20:51.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:51 smithi008 ceph-mon[97158]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:51.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:51 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:51.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:51 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:51.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:51 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:51.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:51 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:52.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:52 smithi045 ceph-mon[130284]: from='osd.10 [v2:172.21.15.45:6824/3281212184,v1:172.21.15.45:6825/3281212184]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-08-11T12:20:52.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:52 smithi045 ceph-mon[130284]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-08-11T12:20:52.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:52 smithi008 ceph-mon[97158]: from='osd.10 [v2:172.21.15.45:6824/3281212184,v1:172.21.15.45:6825/3281212184]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-08-11T12:20:52.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:52 smithi008 ceph-mon[97158]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-08-11T12:20:52.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:52 smithi194 ceph-mon[130905]: from='osd.10 [v2:172.21.15.45:6824/3281212184,v1:172.21.15.45:6825/3281212184]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-08-11T12:20:52.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:52 smithi194 ceph-mon[130905]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-08-11T12:20:52.912 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-08-11T12:20:52.912 INFO:teuthology.orchestra.run.smithi194.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-08-11T12:20:52.912 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10+0 records in 2023-08-11T12:20:52.912 INFO:teuthology.orchestra.run.smithi194.stderr:10+0 records out 2023-08-11T12:20:52.913 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114502 s, 916 MB/s 2023-08-11T12:20:52.913 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping successful for: 2023-08-11T12:20:53.283 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi194:vg_nvme/lv_1 2023-08-11T12:20:53.645 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:20:53 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:20:53.506+0000 7f2fec323700 -1 osd.10 0 waiting for initial osdmap 2023-08-11T12:20:53.645 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:20:53 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:20:53.521+0000 7f2fe6114700 -1 osd.10 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-11T12:20:53.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:53 smithi045 ceph-mon[130284]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:53.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:53 smithi045 ceph-mon[130284]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-08-11T12:20:53.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:53 smithi045 ceph-mon[130284]: osdmap e69: 11 total, 10 up, 11 in 2023-08-11T12:20:53.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:53 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-11T12:20:53.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:53 smithi045 ceph-mon[130284]: from='osd.10 [v2:172.21.15.45:6824/3281212184,v1:172.21.15.45:6825/3281212184]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2023-08-11T12:20:53.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:53 smithi045 ceph-mon[130284]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2023-08-11T12:20:53.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:53 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:53.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:53 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:53.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:53 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:53.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:53 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:53.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:53 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:53.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:53 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:53.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:53 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:53.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:53 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:53.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:53 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:20:53.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:53 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:53.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:53 smithi008 ceph-mon[97158]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:53.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:53 smithi008 ceph-mon[97158]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-08-11T12:20:53.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:53 smithi008 ceph-mon[97158]: osdmap e69: 11 total, 10 up, 11 in 2023-08-11T12:20:53.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-11T12:20:53.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:53 smithi008 ceph-mon[97158]: from='osd.10 [v2:172.21.15.45:6824/3281212184,v1:172.21.15.45:6825/3281212184]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2023-08-11T12:20:53.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:53 smithi008 ceph-mon[97158]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2023-08-11T12:20:53.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:53.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:53.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:53.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:53.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:53.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:53.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:53.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:53.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:20:53.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:53.835 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.c/config 2023-08-11T12:20:53.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:53 smithi194 ceph-mon[130905]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:53.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:53 smithi194 ceph-mon[130905]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-08-11T12:20:53.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:53 smithi194 ceph-mon[130905]: osdmap e69: 11 total, 10 up, 11 in 2023-08-11T12:20:53.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:53 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-11T12:20:53.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:53 smithi194 ceph-mon[130905]: from='osd.10 [v2:172.21.15.45:6824/3281212184,v1:172.21.15.45:6825/3281212184]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2023-08-11T12:20:53.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:53 smithi194 ceph-mon[130905]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2023-08-11T12:20:53.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:53 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:53.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:53 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:53.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:53 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:53.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:53 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:53.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:53 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:53.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:53 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:20:53.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:53 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:53.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:53 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:53.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:53 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:20:53.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:53 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:54.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:54 smithi194 ceph-mon[130905]: Detected new or changed devices on smithi045 2023-08-11T12:20:54.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:54 smithi194 ceph-mon[130905]: Adjusting osd_memory_target on smithi045 to 4293M 2023-08-11T12:20:54.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:54 smithi194 ceph-mon[130905]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2023-08-11T12:20:54.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:54 smithi194 ceph-mon[130905]: osdmap e70: 11 total, 10 up, 11 in 2023-08-11T12:20:54.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:54 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-11T12:20:54.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:54 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-11T12:20:54.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:54 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:20:54.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:54 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:54.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:54 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:20:54.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:54 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:54.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:54 smithi008 ceph-mon[97158]: Detected new or changed devices on smithi045 2023-08-11T12:20:54.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:54 smithi008 ceph-mon[97158]: Adjusting osd_memory_target on smithi045 to 4293M 2023-08-11T12:20:54.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:54 smithi008 ceph-mon[97158]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2023-08-11T12:20:54.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:54 smithi008 ceph-mon[97158]: osdmap e70: 11 total, 10 up, 11 in 2023-08-11T12:20:54.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:54 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-11T12:20:54.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:54 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-11T12:20:54.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:54 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:20:54.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:54 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:54.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:54 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:20:54.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:54 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:54.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:54 smithi045 ceph-mon[130284]: Detected new or changed devices on smithi045 2023-08-11T12:20:54.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:54 smithi045 ceph-mon[130284]: Adjusting osd_memory_target on smithi045 to 4293M 2023-08-11T12:20:54.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:54 smithi045 ceph-mon[130284]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2023-08-11T12:20:54.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:54 smithi045 ceph-mon[130284]: osdmap e70: 11 total, 10 up, 11 in 2023-08-11T12:20:54.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:54 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-11T12:20:54.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:54 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-11T12:20:54.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:54 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:20:54.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:54 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:54.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:54 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:20:54.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:54 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:20:54.940 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.937+0000 7f199d123700 1 -- 172.21.15.194:0/3674108653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1998101bb0 msgr2=0x7f1998102010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:20:54.940 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.937+0000 7f199d123700 1 --2- 172.21.15.194:0/3674108653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1998101bb0 0x7f1998102010 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f198c009990 tx=0x7f198c009ca0 comp rx=0 tx=0).stop 2023-08-11T12:20:54.940 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.937+0000 7f199d123700 1 -- 172.21.15.194:0/3674108653 shutdown_connections 2023-08-11T12:20:54.940 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.937+0000 7f199d123700 1 --2- 172.21.15.194:0/3674108653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1998102550 0x7f1998108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:20:54.941 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.937+0000 7f199d123700 1 --2- 172.21.15.194:0/3674108653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19981009b0 0x7f1998100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:20:54.941 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.937+0000 7f199d123700 1 --2- 172.21.15.194:0/3674108653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1998101bb0 0x7f1998102010 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:20:54.941 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.937+0000 7f199d123700 1 -- 172.21.15.194:0/3674108653 >> 172.21.15.194:0/3674108653 conn(0x7f19980fbf10 msgr2=0x7f19980fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:20:54.941 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.937+0000 7f199d123700 1 -- 172.21.15.194:0/3674108653 shutdown_connections 2023-08-11T12:20:54.941 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.937+0000 7f199d123700 1 -- 172.21.15.194:0/3674108653 wait complete. 2023-08-11T12:20:54.941 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.937+0000 7f199d123700 1 Processor -- start 2023-08-11T12:20:54.943 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.938+0000 7f199d123700 1 -- start start 2023-08-11T12:20:54.943 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.938+0000 7f199d123700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19981009b0 0x7f1998196740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:20:54.943 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.938+0000 7f199d123700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1998101bb0 0x7f1998196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:20:54.943 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.938+0000 7f199d123700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1998102550 0x7f199819dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:20:54.943 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.938+0000 7f199d123700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199819e2d0 con 0x7f19981009b0 2023-08-11T12:20:54.944 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.938+0000 7f199d123700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199819e410 con 0x7f1998102550 2023-08-11T12:20:54.944 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.938+0000 7f199d123700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199819e5a0 con 0x7f1998101bb0 2023-08-11T12:20:54.944 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.938+0000 7f199659c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1998101bb0 0x7f1998196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:20:54.944 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.938+0000 7f199659c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1998101bb0 0x7f1998196c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:40538/0 (socket says 172.21.15.194:40538) 2023-08-11T12:20:54.944 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.938+0000 7f199659c700 1 -- 172.21.15.194:0/2189247267 learned_addr learned my addr 172.21.15.194:0/2189247267 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-08-11T12:20:54.944 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.938+0000 7f199659c700 1 -- 172.21.15.194:0/2189247267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1998102550 msgr2=0x7f199819dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:20:54.945 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.938+0000 7f199759e700 1 --2- 172.21.15.194:0/2189247267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1998102550 0x7f199819dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:20:54.945 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.938+0000 7f1996d9d700 1 --2- 172.21.15.194:0/2189247267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19981009b0 0x7f1998196740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:20:54.945 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.938+0000 7f199659c700 1 --2- 172.21.15.194:0/2189247267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1998102550 0x7f199819dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:20:54.945 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.938+0000 7f199659c700 1 -- 172.21.15.194:0/2189247267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19981009b0 msgr2=0x7f1998196740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:20:54.945 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.938+0000 7f199659c700 1 --2- 172.21.15.194:0/2189247267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19981009b0 0x7f1998196740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:20:54.945 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.938+0000 7f199659c700 1 -- 172.21.15.194:0/2189247267 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c0095f0 con 0x7f1998101bb0 2023-08-11T12:20:54.946 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.938+0000 7f1996d9d700 1 --2- 172.21.15.194:0/2189247267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19981009b0 0x7f1998196740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:20:54.946 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.939+0000 7f199659c700 1 --2- 172.21.15.194:0/2189247267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1998101bb0 0x7f1998196c80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f198c00f700 tx=0x7f198c00f7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:20:54.946 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.939+0000 7f197ffff700 1 -- 172.21.15.194:0/2189247267 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c01d070 con 0x7f1998101bb0 2023-08-11T12:20:54.946 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.939+0000 7f199d123700 1 -- 172.21.15.194:0/2189247267 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199819e820 con 0x7f1998101bb0 2023-08-11T12:20:54.946 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.939+0000 7f197ffff700 1 -- 172.21.15.194:0/2189247267 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f198c003e20 con 0x7f1998101bb0 2023-08-11T12:20:54.946 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.939+0000 7f197ffff700 1 -- 172.21.15.194:0/2189247267 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c0173f0 con 0x7f1998101bb0 2023-08-11T12:20:54.946 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.939+0000 7f199d123700 1 -- 172.21.15.194:0/2189247267 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199819ed10 con 0x7f1998101bb0 2023-08-11T12:20:54.947 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.940+0000 7f199d123700 1 -- 172.21.15.194:0/2189247267 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199810c2c0 con 0x7f1998101bb0 2023-08-11T12:20:54.947 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.941+0000 7f197ffff700 1 -- 172.21.15.194:0/2189247267 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f198c003960 con 0x7f1998101bb0 2023-08-11T12:20:54.948 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.942+0000 7f197ffff700 1 --2- 172.21.15.194:0/2189247267 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f198009ff50 0x7f19800a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:20:54.948 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.942+0000 7f197ffff700 1 -- 172.21.15.194:0/2189247267 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6723+0+0 (secure 0 0 0) 0x7f198c0cc260 con 0x7f1998101bb0 2023-08-11T12:20:54.948 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.942+0000 7f1996d9d700 1 --2- 172.21.15.194:0/2189247267 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f198009ff50 0x7f19800a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:20:54.948 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.943+0000 7f1996d9d700 1 --2- 172.21.15.194:0/2189247267 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f198009ff50 0x7f19800a2410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1998101a10 tx=0x7f1988008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:20:54.948 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:54.945+0000 7f197ffff700 1 -- 172.21.15.194:0/2189247267 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f198c096610 con 0x7f1998101bb0 2023-08-11T12:20:55.144 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:20:55.141+0000 7f199d123700 1 -- 172.21.15.194:0/2189247267 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f199819ef30 con 0x7f198009ff50 2023-08-11T12:20:55.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:55 smithi008 ceph-mon[97158]: purged_snaps scrub starts 2023-08-11T12:20:55.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:55 smithi008 ceph-mon[97158]: purged_snaps scrub ok 2023-08-11T12:20:55.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:55 smithi008 ceph-mon[97158]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:55.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:55 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-11T12:20:55.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:55 smithi008 ceph-mon[97158]: osd.10 [v2:172.21.15.45:6824/3281212184,v1:172.21.15.45:6825/3281212184] boot 2023-08-11T12:20:55.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:55 smithi008 ceph-mon[97158]: osdmap e71: 11 total, 11 up, 11 in 2023-08-11T12:20:55.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:55 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-11T12:20:55.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:55 smithi008 ceph-mon[97158]: osdmap e72: 11 total, 11 up, 11 in 2023-08-11T12:20:55.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:55 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:20:55.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:55 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:20:55.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:55 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:55.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:55 smithi194 ceph-mon[130905]: purged_snaps scrub starts 2023-08-11T12:20:55.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:55 smithi194 ceph-mon[130905]: purged_snaps scrub ok 2023-08-11T12:20:55.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:55 smithi194 ceph-mon[130905]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:55.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:55 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-11T12:20:55.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:55 smithi194 ceph-mon[130905]: osd.10 [v2:172.21.15.45:6824/3281212184,v1:172.21.15.45:6825/3281212184] boot 2023-08-11T12:20:55.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:55 smithi194 ceph-mon[130905]: osdmap e71: 11 total, 11 up, 11 in 2023-08-11T12:20:55.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:55 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-11T12:20:55.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:55 smithi194 ceph-mon[130905]: osdmap e72: 11 total, 11 up, 11 in 2023-08-11T12:20:55.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:55 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:20:55.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:55 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:20:55.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:55 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:55.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:55 smithi045 ceph-mon[130284]: purged_snaps scrub starts 2023-08-11T12:20:55.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:55 smithi045 ceph-mon[130284]: purged_snaps scrub ok 2023-08-11T12:20:55.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:55 smithi045 ceph-mon[130284]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-11T12:20:55.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:55 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-11T12:20:55.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:55 smithi045 ceph-mon[130284]: osd.10 [v2:172.21.15.45:6824/3281212184,v1:172.21.15.45:6825/3281212184] boot 2023-08-11T12:20:55.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:55 smithi045 ceph-mon[130284]: osdmap e71: 11 total, 11 up, 11 in 2023-08-11T12:20:55.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:55 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-11T12:20:55.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:55 smithi045 ceph-mon[130284]: osdmap e72: 11 total, 11 up, 11 in 2023-08-11T12:20:55.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:55 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-11T12:20:55.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:55 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-11T12:20:55.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:55 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:20:56.791 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:56 smithi194 ceph-mon[130905]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:20:56.792 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:56 smithi194 ceph-mon[130905]: osdmap e73: 11 total, 11 up, 11 in 2023-08-11T12:20:56.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:56 smithi008 ceph-mon[97158]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:20:56.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:56 smithi008 ceph-mon[97158]: osdmap e73: 11 total, 11 up, 11 in 2023-08-11T12:20:56.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:56 smithi045 ceph-mon[130284]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:20:56.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:56 smithi045 ceph-mon[130284]: osdmap e73: 11 total, 11 up, 11 in 2023-08-11T12:20:57.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:57 smithi008 ceph-mon[97158]: pgmap v226: 1 pgs: 1 remapped+peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-08-11T12:20:57.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:57 smithi008 ceph-mon[97158]: osdmap e74: 11 total, 11 up, 11 in 2023-08-11T12:20:57.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:57 smithi008 ceph-mon[97158]: from='client.? 172.21.15.194:0/1635155422' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ca4a80d-cd75-4230-b46d-aef6fdc03e6f"}]: dispatch 2023-08-11T12:20:57.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:57 smithi008 ceph-mon[97158]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ca4a80d-cd75-4230-b46d-aef6fdc03e6f"}]: dispatch 2023-08-11T12:20:57.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:57 smithi008 ceph-mon[97158]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ca4a80d-cd75-4230-b46d-aef6fdc03e6f"}]': finished 2023-08-11T12:20:57.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:57 smithi008 ceph-mon[97158]: osdmap e75: 12 total, 11 up, 12 in 2023-08-11T12:20:57.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:57 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-11T12:20:57.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:57 smithi194 ceph-mon[130905]: pgmap v226: 1 pgs: 1 remapped+peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-08-11T12:20:57.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:57 smithi194 ceph-mon[130905]: osdmap e74: 11 total, 11 up, 11 in 2023-08-11T12:20:57.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:57 smithi194 ceph-mon[130905]: from='client.? 172.21.15.194:0/1635155422' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ca4a80d-cd75-4230-b46d-aef6fdc03e6f"}]: dispatch 2023-08-11T12:20:57.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:57 smithi194 ceph-mon[130905]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ca4a80d-cd75-4230-b46d-aef6fdc03e6f"}]: dispatch 2023-08-11T12:20:57.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:57 smithi194 ceph-mon[130905]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ca4a80d-cd75-4230-b46d-aef6fdc03e6f"}]': finished 2023-08-11T12:20:57.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:57 smithi194 ceph-mon[130905]: osdmap e75: 12 total, 11 up, 12 in 2023-08-11T12:20:57.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:57 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-11T12:20:57.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:57 smithi045 ceph-mon[130284]: pgmap v226: 1 pgs: 1 remapped+peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-08-11T12:20:57.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:57 smithi045 ceph-mon[130284]: osdmap e74: 11 total, 11 up, 11 in 2023-08-11T12:20:57.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:57 smithi045 ceph-mon[130284]: from='client.? 172.21.15.194:0/1635155422' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ca4a80d-cd75-4230-b46d-aef6fdc03e6f"}]: dispatch 2023-08-11T12:20:57.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:57 smithi045 ceph-mon[130284]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ca4a80d-cd75-4230-b46d-aef6fdc03e6f"}]: dispatch 2023-08-11T12:20:57.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:57 smithi045 ceph-mon[130284]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ca4a80d-cd75-4230-b46d-aef6fdc03e6f"}]': finished 2023-08-11T12:20:57.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:57 smithi045 ceph-mon[130284]: osdmap e75: 12 total, 11 up, 12 in 2023-08-11T12:20:57.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:57 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-11T12:20:58.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:58 smithi008 ceph-mon[97158]: from='client.? 172.21.15.194:0/2398286031' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:20:58.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:58 smithi194 ceph-mon[130905]: from='client.? 172.21.15.194:0/2398286031' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:20:58.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:58 smithi045 ceph-mon[130284]: from='client.? 172.21.15.194:0/2398286031' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-11T12:20:59.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:20:59 smithi008 ceph-mon[97158]: pgmap v229: 1 pgs: 1 remapped+peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-08-11T12:20:59.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:20:59 smithi194 ceph-mon[130905]: pgmap v229: 1 pgs: 1 remapped+peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-08-11T12:20:59.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:20:59 smithi045 ceph-mon[130284]: pgmap v229: 1 pgs: 1 remapped+peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-08-11T12:21:01.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:00 smithi008 ceph-mon[97158]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 99 KiB/s, 0 objects/s recovering 2023-08-11T12:21:01.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:00 smithi194 ceph-mon[130905]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 99 KiB/s, 0 objects/s recovering 2023-08-11T12:21:01.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:00 smithi045 ceph-mon[130284]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 99 KiB/s, 0 objects/s recovering 2023-08-11T12:21:03.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:03 smithi008 ceph-mon[97158]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2023-08-11T12:21:03.880 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:03 smithi194 ceph-mon[130905]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2023-08-11T12:21:03.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:03 smithi045 ceph-mon[130284]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2023-08-11T12:21:04.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:04 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-08-11T12:21:04.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:04 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:04.865 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:04 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-08-11T12:21:04.866 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:04 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:04.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:04 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-08-11T12:21:04.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:04 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:05.742 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:05 smithi194 ceph-mon[130905]: Deploying daemon osd.11 on smithi194 2023-08-11T12:21:05.743 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:05 smithi194 ceph-mon[130905]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-08-11T12:21:05.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:05 smithi008 ceph-mon[97158]: Deploying daemon osd.11 on smithi194 2023-08-11T12:21:05.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:05 smithi008 ceph-mon[97158]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-08-11T12:21:05.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:05 smithi045 ceph-mon[130284]: Deploying daemon osd.11 on smithi194 2023-08-11T12:21:05.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:05 smithi045 ceph-mon[130284]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-08-11T12:21:07.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:07 smithi194 ceph-mon[130905]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2023-08-11T12:21:07.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:07 smithi045 ceph-mon[130284]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2023-08-11T12:21:08.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:07 smithi008 ceph-mon[97158]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2023-08-11T12:21:09.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:09 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:09.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:09 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:09.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:09 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:21:09.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:09 smithi194 ceph-mon[130905]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2023-08-11T12:21:09.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:09 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:09.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:09 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:09.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:09 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:21:09.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:09 smithi008 ceph-mon[97158]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2023-08-11T12:21:09.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:09 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:09.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:09 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:09.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:09 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:21:09.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:09 smithi045 ceph-mon[130284]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2023-08-11T12:21:10.873 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:10 smithi194 ceph-mon[130905]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-08-11T12:21:10.956 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:10.954+0000 7f197ffff700 1 -- 172.21.15.194:0/2189247267 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f199819ef30 con 0x7f198009ff50 2023-08-11T12:21:10.956 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 11 on host 'smithi194' 2023-08-11T12:21:10.958 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:10.957+0000 7f199d123700 1 -- 172.21.15.194:0/2189247267 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f198009ff50 msgr2=0x7f19800a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:10.958 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:10.957+0000 7f199d123700 1 --2- 172.21.15.194:0/2189247267 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f198009ff50 0x7f19800a2410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1998101a10 tx=0x7f1988008040 comp rx=0 tx=0).stop 2023-08-11T12:21:10.959 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:10.957+0000 7f199d123700 1 -- 172.21.15.194:0/2189247267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1998101bb0 msgr2=0x7f1998196c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:10.959 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:10.957+0000 7f199d123700 1 --2- 172.21.15.194:0/2189247267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1998101bb0 0x7f1998196c80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f198c00f700 tx=0x7f198c00f7e0 comp rx=0 tx=0).stop 2023-08-11T12:21:10.959 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:10.957+0000 7f199d123700 1 -- 172.21.15.194:0/2189247267 shutdown_connections 2023-08-11T12:21:10.959 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:10.957+0000 7f199d123700 1 --2- 172.21.15.194:0/2189247267 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f198009ff50 0x7f19800a2410 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:10.959 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:10.957+0000 7f199d123700 1 --2- 172.21.15.194:0/2189247267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1998102550 0x7f199819dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:10.959 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:10.957+0000 7f199d123700 1 --2- 172.21.15.194:0/2189247267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19981009b0 0x7f1998196740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:10.959 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:10.957+0000 7f199d123700 1 --2- 172.21.15.194:0/2189247267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1998101bb0 0x7f1998196c80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:10.960 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:10.957+0000 7f199d123700 1 -- 172.21.15.194:0/2189247267 >> 172.21.15.194:0/2189247267 conn(0x7f19980fbf10 msgr2=0x7f19980fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:10.960 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:10.957+0000 7f199d123700 1 -- 172.21.15.194:0/2189247267 shutdown_connections 2023-08-11T12:21:10.960 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:10.957+0000 7f199d123700 1 -- 172.21.15.194:0/2189247267 wait complete. 2023-08-11T12:21:11.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:10 smithi008 ceph-mon[97158]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-08-11T12:21:11.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:10 smithi045 ceph-mon[130284]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-08-11T12:21:11.328 DEBUG:teuthology.orchestra.run.smithi194:osd.11> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.11.service 2023-08-11T12:21:11.330 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-08-11T12:21:11.331 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph osd stat -f json 2023-08-11T12:21:11.362 INFO:journalctl@ceph.osd.11.smithi194.stdout:-- Logs begin at Fri 2023-08-11 11:52:16 UTC. -- 2023-08-11T12:21:12.071 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:11 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:12.071 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:11 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:12.071 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:11 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:12.071 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:11 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:12.073 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:21:12.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:11 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:12.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:11 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:12.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:11 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:12.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:11 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:12.393 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:21:12 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:21:12.243+0000 7ff0e884d640 -1 osd.11 0 log_to_monitors true 2023-08-11T12:21:12.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:11 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:12.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:11 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:12.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:11 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:12.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:11 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:13.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:12 smithi008 ceph-mon[97158]: from='osd.11 [v2:172.21.15.194:6824/1637875895,v1:172.21.15.194:6825/1637875895]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-08-11T12:21:13.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:12 smithi008 ceph-mon[97158]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-08-11T12:21:13.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:12 smithi008 ceph-mon[97158]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-11T12:21:13.285 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:12 smithi194 ceph-mon[130905]: from='osd.11 [v2:172.21.15.194:6824/1637875895,v1:172.21.15.194:6825/1637875895]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-08-11T12:21:13.285 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:12 smithi194 ceph-mon[130905]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-08-11T12:21:13.285 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:12 smithi194 ceph-mon[130905]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-11T12:21:13.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:12 smithi045 ceph-mon[130284]: from='osd.11 [v2:172.21.15.194:6824/1637875895,v1:172.21.15.194:6825/1637875895]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-08-11T12:21:13.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:12 smithi045 ceph-mon[130284]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-08-11T12:21:13.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:12 smithi045 ceph-mon[130284]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-11T12:21:13.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.674+0000 7f6eebd75700 1 -- 172.21.15.8:0/188988325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ee41009b0 msgr2=0x7f6ee4100dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:13.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.674+0000 7f6eebd75700 1 --2- 172.21.15.8:0/188988325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ee41009b0 0x7f6ee4100dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6ee00098f0 tx=0x7f6ee0009c00 comp rx=0 tx=0).stop 2023-08-11T12:21:13.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.674+0000 7f6eebd75700 1 -- 172.21.15.8:0/188988325 shutdown_connections 2023-08-11T12:21:13.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.674+0000 7f6eebd75700 1 --2- 172.21.15.8:0/188988325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ee41009b0 0x7f6ee4100dd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:13.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.674+0000 7f6eebd75700 1 --2- 172.21.15.8:0/188988325 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ee4102550 0x7f6ee4108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:13.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.674+0000 7f6eebd75700 1 --2- 172.21.15.8:0/188988325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ee4101bb0 0x7f6ee4102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:13.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.674+0000 7f6eebd75700 1 -- 172.21.15.8:0/188988325 >> 172.21.15.8:0/188988325 conn(0x7f6ee40fbf10 msgr2=0x7f6ee40fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:13.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.675+0000 7f6eebd75700 1 -- 172.21.15.8:0/188988325 shutdown_connections 2023-08-11T12:21:13.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.675+0000 7f6eebd75700 1 -- 172.21.15.8:0/188988325 wait complete. 2023-08-11T12:21:13.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.676+0000 7f6eebd75700 1 Processor -- start 2023-08-11T12:21:13.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.676+0000 7f6eebd75700 1 -- start start 2023-08-11T12:21:13.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.676+0000 7f6eebd75700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ee41009b0 0x7f6ee41988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:13.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.676+0000 7f6eebd75700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ee4101bb0 0x7f6ee4198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:13.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.676+0000 7f6eebd75700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ee4102550 0x7f6ee419fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:13.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.676+0000 7f6eebd75700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee41a0470 con 0x7f6ee41009b0 2023-08-11T12:21:13.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.676+0000 7f6eebd75700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee41a05b0 con 0x7f6ee4101bb0 2023-08-11T12:21:13.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.676+0000 7f6eebd75700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee41a0740 con 0x7f6ee4102550 2023-08-11T12:21:13.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.677+0000 7f6ee9b11700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ee41009b0 0x7f6ee41988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:13.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.677+0000 7f6ee9b11700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ee41009b0 0x7f6ee41988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59012/0 (socket says 172.21.15.8:59012) 2023-08-11T12:21:13.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.677+0000 7f6ee9b11700 1 -- 172.21.15.8:0/2909114219 learned_addr learned my addr 172.21.15.8:0/2909114219 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:21:13.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.677+0000 7f6ee9310700 1 --2- 172.21.15.8:0/2909114219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ee4101bb0 0x7f6ee4198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:13.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.677+0000 7f6eea312700 1 --2- 172.21.15.8:0/2909114219 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ee4102550 0x7f6ee419fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:13.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.677+0000 7f6eea312700 1 -- 172.21.15.8:0/2909114219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ee4101bb0 msgr2=0x7f6ee4198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:13.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.677+0000 7f6eea312700 1 --2- 172.21.15.8:0/2909114219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ee4101bb0 0x7f6ee4198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:13.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.677+0000 7f6eea312700 1 -- 172.21.15.8:0/2909114219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ee41009b0 msgr2=0x7f6ee41988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:13.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.677+0000 7f6eea312700 1 --2- 172.21.15.8:0/2909114219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ee41009b0 0x7f6ee41988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:13.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.677+0000 7f6eea312700 1 -- 172.21.15.8:0/2909114219 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee0009520 con 0x7f6ee4102550 2023-08-11T12:21:13.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.677+0000 7f6ee9b11700 1 --2- 172.21.15.8:0/2909114219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ee41009b0 0x7f6ee41988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:21:13.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.678+0000 7f6eea312700 1 --2- 172.21.15.8:0/2909114219 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ee4102550 0x7f6ee419fea0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6edc009f60 tx=0x7f6edc009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:13.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.678+0000 7f6edaffd700 1 -- 172.21.15.8:0/2909114219 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc018070 con 0x7f6ee4102550 2023-08-11T12:21:13.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.678+0000 7f6edaffd700 1 -- 172.21.15.8:0/2909114219 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6edc00f040 con 0x7f6ee4102550 2023-08-11T12:21:13.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.678+0000 7f6edaffd700 1 -- 172.21.15.8:0/2909114219 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc00cbf0 con 0x7f6ee4102550 2023-08-11T12:21:13.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.678+0000 7f6eebd75700 1 -- 172.21.15.8:0/2909114219 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee41a09c0 con 0x7f6ee4102550 2023-08-11T12:21:13.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.678+0000 7f6eebd75700 1 -- 172.21.15.8:0/2909114219 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee41a0e70 con 0x7f6ee4102550 2023-08-11T12:21:13.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.680+0000 7f6eebd75700 1 -- 172.21.15.8:0/2909114219 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee4192fc0 con 0x7f6ee4102550 2023-08-11T12:21:13.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.681+0000 7f6edaffd700 1 -- 172.21.15.8:0/2909114219 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f6edc003a00 con 0x7f6ee4102550 2023-08-11T12:21:13.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.682+0000 7f6edaffd700 1 --2- 172.21.15.8:0/2909114219 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6ed00a00a0 0x7f6ed00a2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:13.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.683+0000 7f6edaffd700 1 -- 172.21.15.8:0/2909114219 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6831+0+0 (secure 0 0 0) 0x7f6edc0ca620 con 0x7f6ee4102550 2023-08-11T12:21:13.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.683+0000 7f6ee9b11700 1 --2- 172.21.15.8:0/2909114219 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6ed00a00a0 0x7f6ed00a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:13.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.683+0000 7f6ee9b11700 1 --2- 172.21.15.8:0/2909114219 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6ed00a00a0 0x7f6ed00a2560 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000c010 tx=0x7f6ee0019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:13.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.686+0000 7f6edaffd700 1 -- 172.21.15.8:0/2909114219 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f6edc094970 con 0x7f6ee4102550 2023-08-11T12:21:13.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.899+0000 7f6eebd75700 1 -- 172.21.15.8:0/2909114219 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f6ee402ccf0 con 0x7f6ee4102550 2023-08-11T12:21:13.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.900+0000 7f6edaffd700 1 -- 172.21.15.8:0/2909114219 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) v1 ==== 74+0+133 (secure 0 0 0) 0x7f6edc097f90 con 0x7f6ee4102550 2023-08-11T12:21:13.902 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:21:13.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.902+0000 7f6eebd75700 1 -- 172.21.15.8:0/2909114219 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6ed00a00a0 msgr2=0x7f6ed00a2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:13.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.902+0000 7f6eebd75700 1 --2- 172.21.15.8:0/2909114219 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6ed00a00a0 0x7f6ed00a2560 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000c010 tx=0x7f6ee0019040 comp rx=0 tx=0).stop 2023-08-11T12:21:13.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.902+0000 7f6eebd75700 1 -- 172.21.15.8:0/2909114219 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ee4102550 msgr2=0x7f6ee419fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:13.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.902+0000 7f6eebd75700 1 --2- 172.21.15.8:0/2909114219 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ee4102550 0x7f6ee419fea0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6edc009f60 tx=0x7f6edc009f90 comp rx=0 tx=0).stop 2023-08-11T12:21:13.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.902+0000 7f6eebd75700 1 -- 172.21.15.8:0/2909114219 shutdown_connections 2023-08-11T12:21:13.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.902+0000 7f6eebd75700 1 --2- 172.21.15.8:0/2909114219 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6ed00a00a0 0x7f6ed00a2560 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:13.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.902+0000 7f6eebd75700 1 --2- 172.21.15.8:0/2909114219 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ee4102550 0x7f6ee419fea0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:13.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.902+0000 7f6eebd75700 1 --2- 172.21.15.8:0/2909114219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ee41009b0 0x7f6ee41988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:13.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.902+0000 7f6eebd75700 1 --2- 172.21.15.8:0/2909114219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ee4101bb0 0x7f6ee4198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:13.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.902+0000 7f6eebd75700 1 -- 172.21.15.8:0/2909114219 >> 172.21.15.8:0/2909114219 conn(0x7f6ee40fbf10 msgr2=0x7f6ee4107590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:13.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.902+0000 7f6eebd75700 1 -- 172.21.15.8:0/2909114219 shutdown_connections 2023-08-11T12:21:13.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:13.902+0000 7f6eebd75700 1 -- 172.21.15.8:0/2909114219 wait complete. 2023-08-11T12:21:14.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:13 smithi008 ceph-mon[97158]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-08-11T12:21:14.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:13 smithi008 ceph-mon[97158]: osdmap e76: 12 total, 11 up, 12 in 2023-08-11T12:21:14.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:13 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-11T12:21:14.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:13 smithi008 ceph-mon[97158]: from='osd.11 [v2:172.21.15.194:6824/1637875895,v1:172.21.15.194:6825/1637875895]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2023-08-11T12:21:14.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:13 smithi008 ceph-mon[97158]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2023-08-11T12:21:14.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:13 smithi008 ceph-mon[97158]: Detected new or changed devices on smithi194 2023-08-11T12:21:14.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:13 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:14.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:13 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:14.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:13 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:21:14.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:13 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:21:14.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:13 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:21:14.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:13 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:21:14.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:13 smithi008 ceph-mon[97158]: Adjusting osd_memory_target on smithi194 to 4292M 2023-08-11T12:21:14.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:13 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:14.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:13 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:14.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:13 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:21:14.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:13 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:14.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:13 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:21:14.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:13 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:14.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:13 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:21:14.307 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:13 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:14.307 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:13 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2909114219' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-08-11T12:21:14.393 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:21:13 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:21:13.917+0000 7ff0ddec5700 -1 osd.11 0 waiting for initial osdmap 2023-08-11T12:21:14.393 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:21:13 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:21:13.936+0000 7ff0d74b5700 -1 osd.11 77 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-11T12:21:14.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:13 smithi194 ceph-mon[130905]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-08-11T12:21:14.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:13 smithi194 ceph-mon[130905]: osdmap e76: 12 total, 11 up, 12 in 2023-08-11T12:21:14.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:13 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-11T12:21:14.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:13 smithi194 ceph-mon[130905]: from='osd.11 [v2:172.21.15.194:6824/1637875895,v1:172.21.15.194:6825/1637875895]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2023-08-11T12:21:14.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:13 smithi194 ceph-mon[130905]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2023-08-11T12:21:14.395 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:13 smithi194 ceph-mon[130905]: Detected new or changed devices on smithi194 2023-08-11T12:21:14.395 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:13 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:14.395 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:13 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:14.395 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:13 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:21:14.395 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:13 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:21:14.395 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:13 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:21:14.395 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:13 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:21:14.395 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:13 smithi194 ceph-mon[130905]: Adjusting osd_memory_target on smithi194 to 4292M 2023-08-11T12:21:14.396 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:13 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:14.396 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:13 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:14.396 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:13 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:21:14.396 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:13 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:14.396 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:13 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:21:14.396 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:13 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:14.396 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:13 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:21:14.397 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:13 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:14.397 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:13 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2909114219' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-08-11T12:21:14.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:13 smithi045 ceph-mon[130284]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-08-11T12:21:14.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:13 smithi045 ceph-mon[130284]: osdmap e76: 12 total, 11 up, 12 in 2023-08-11T12:21:14.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:13 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-11T12:21:14.398 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:13 smithi045 ceph-mon[130284]: from='osd.11 [v2:172.21.15.194:6824/1637875895,v1:172.21.15.194:6825/1637875895]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2023-08-11T12:21:14.398 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:13 smithi045 ceph-mon[130284]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2023-08-11T12:21:14.398 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:13 smithi045 ceph-mon[130284]: Detected new or changed devices on smithi194 2023-08-11T12:21:14.398 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:13 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:14.398 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:13 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:14.398 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:13 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:21:14.398 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:13 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:21:14.399 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:13 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:21:14.399 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:13 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:21:14.399 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:13 smithi045 ceph-mon[130284]: Adjusting osd_memory_target on smithi194 to 4292M 2023-08-11T12:21:14.399 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:13 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:14.399 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:13 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:14.399 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:13 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:21:14.399 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:13 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:14.399 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:13 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:21:14.400 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:13 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:14.400 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:13 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:21:14.400 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:13 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:14.400 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:13 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2909114219' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-08-11T12:21:14.453 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":76,"num_osds":12,"num_up_osds":11,"osd_up_since":1691756454,"num_in_osds":12,"osd_in_since":1691756457,"num_remapped_pgs":0} 2023-08-11T12:21:15.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:14 smithi008 ceph-mon[97158]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2023-08-11T12:21:15.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:14 smithi008 ceph-mon[97158]: osdmap e77: 12 total, 11 up, 12 in 2023-08-11T12:21:15.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:14 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-11T12:21:15.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:14 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-11T12:21:15.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:14 smithi008 ceph-mon[97158]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-11T12:21:15.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:14 smithi194 ceph-mon[130905]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2023-08-11T12:21:15.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:14 smithi194 ceph-mon[130905]: osdmap e77: 12 total, 11 up, 12 in 2023-08-11T12:21:15.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:14 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-11T12:21:15.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:14 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-11T12:21:15.395 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:14 smithi194 ceph-mon[130905]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-11T12:21:15.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:14 smithi045 ceph-mon[130284]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2023-08-11T12:21:15.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:14 smithi045 ceph-mon[130284]: osdmap e77: 12 total, 11 up, 12 in 2023-08-11T12:21:15.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:14 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-11T12:21:15.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:14 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-11T12:21:15.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:14 smithi045 ceph-mon[130284]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-11T12:21:15.454 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph osd stat -f json 2023-08-11T12:21:16.196 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:21:16.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:15 smithi008 ceph-mon[97158]: purged_snaps scrub starts 2023-08-11T12:21:16.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:15 smithi008 ceph-mon[97158]: purged_snaps scrub ok 2023-08-11T12:21:16.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:15 smithi008 ceph-mon[97158]: osd.11 [v2:172.21.15.194:6824/1637875895,v1:172.21.15.194:6825/1637875895] boot 2023-08-11T12:21:16.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:15 smithi008 ceph-mon[97158]: osdmap e78: 12 total, 12 up, 12 in 2023-08-11T12:21:16.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:15 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-11T12:21:16.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:15 smithi194 ceph-mon[130905]: purged_snaps scrub starts 2023-08-11T12:21:16.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:15 smithi194 ceph-mon[130905]: purged_snaps scrub ok 2023-08-11T12:21:16.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:15 smithi194 ceph-mon[130905]: osd.11 [v2:172.21.15.194:6824/1637875895,v1:172.21.15.194:6825/1637875895] boot 2023-08-11T12:21:16.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:15 smithi194 ceph-mon[130905]: osdmap e78: 12 total, 12 up, 12 in 2023-08-11T12:21:16.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:15 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-11T12:21:16.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:15 smithi045 ceph-mon[130284]: purged_snaps scrub starts 2023-08-11T12:21:16.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:15 smithi045 ceph-mon[130284]: purged_snaps scrub ok 2023-08-11T12:21:16.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:15 smithi045 ceph-mon[130284]: osd.11 [v2:172.21.15.194:6824/1637875895,v1:172.21.15.194:6825/1637875895] boot 2023-08-11T12:21:16.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:15 smithi045 ceph-mon[130284]: osdmap e78: 12 total, 12 up, 12 in 2023-08-11T12:21:16.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:15 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-11T12:21:17.044 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:16 smithi008 ceph-mon[97158]: osdmap e79: 12 total, 12 up, 12 in 2023-08-11T12:21:17.045 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:16 smithi008 ceph-mon[97158]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:17.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:16 smithi194 ceph-mon[130905]: osdmap e79: 12 total, 12 up, 12 in 2023-08-11T12:21:17.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:16 smithi194 ceph-mon[130905]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:17.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:16 smithi045 ceph-mon[130284]: osdmap e79: 12 total, 12 up, 12 in 2023-08-11T12:21:17.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:16 smithi045 ceph-mon[130284]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:17.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.751+0000 7fe92972f700 1 -- 172.21.15.8:0/2420018062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9241009b0 msgr2=0x7fe924100dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:17.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.751+0000 7fe92972f700 1 --2- 172.21.15.8:0/2420018062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9241009b0 0x7fe924100dd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe9140099c0 tx=0x7fe914009cd0 comp rx=0 tx=0).stop 2023-08-11T12:21:17.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.751+0000 7fe92972f700 1 -- 172.21.15.8:0/2420018062 shutdown_connections 2023-08-11T12:21:17.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.751+0000 7fe92972f700 1 --2- 172.21.15.8:0/2420018062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe924102550 0x7fe924108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:17.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.751+0000 7fe92972f700 1 --2- 172.21.15.8:0/2420018062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9241009b0 0x7fe924100dd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:17.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.751+0000 7fe92972f700 1 --2- 172.21.15.8:0/2420018062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe924101bb0 0x7fe924102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:17.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.751+0000 7fe92972f700 1 -- 172.21.15.8:0/2420018062 >> 172.21.15.8:0/2420018062 conn(0x7fe9240fbf10 msgr2=0x7fe9240fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:17.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.751+0000 7fe92972f700 1 -- 172.21.15.8:0/2420018062 shutdown_connections 2023-08-11T12:21:17.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.751+0000 7fe92972f700 1 -- 172.21.15.8:0/2420018062 wait complete. 2023-08-11T12:21:17.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.752+0000 7fe92972f700 1 Processor -- start 2023-08-11T12:21:17.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.752+0000 7fe92972f700 1 -- start start 2023-08-11T12:21:17.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.753+0000 7fe92972f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9241009b0 0x7fe9241988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:17.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.753+0000 7fe92972f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe924101bb0 0x7fe924198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:17.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.753+0000 7fe92972f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe924102550 0x7fe92419fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:17.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.753+0000 7fe92972f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9241a0470 con 0x7fe924101bb0 2023-08-11T12:21:17.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.753+0000 7fe92972f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9241a05b0 con 0x7fe924102550 2023-08-11T12:21:17.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.753+0000 7fe92972f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9241a0740 con 0x7fe9241009b0 2023-08-11T12:21:17.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.753+0000 7fe922ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9241009b0 0x7fe9241988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:17.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.753+0000 7fe922ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9241009b0 0x7fe9241988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:34238/0 (socket says 172.21.15.8:34238) 2023-08-11T12:21:17.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.753+0000 7fe922ffd700 1 -- 172.21.15.8:0/404787642 learned_addr learned my addr 172.21.15.8:0/404787642 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:21:17.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.753+0000 7fe9227fc700 1 --2- 172.21.15.8:0/404787642 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe924101bb0 0x7fe924198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:17.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.753+0000 7fe9237fe700 1 --2- 172.21.15.8:0/404787642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe924102550 0x7fe92419fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:17.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.754+0000 7fe9227fc700 1 -- 172.21.15.8:0/404787642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9241009b0 msgr2=0x7fe9241988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:17.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.754+0000 7fe9227fc700 1 --2- 172.21.15.8:0/404787642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9241009b0 0x7fe9241988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:17.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.754+0000 7fe9227fc700 1 -- 172.21.15.8:0/404787642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe924102550 msgr2=0x7fe92419fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:17.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.754+0000 7fe9227fc700 1 --2- 172.21.15.8:0/404787642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe924102550 0x7fe92419fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:17.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.754+0000 7fe9227fc700 1 -- 172.21.15.8:0/404787642 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9140095f0 con 0x7fe924101bb0 2023-08-11T12:21:17.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.754+0000 7fe9227fc700 1 --2- 172.21.15.8:0/404787642 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe924101bb0 0x7fe924198e20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe91800ea20 tx=0x7fe91800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:17.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.754+0000 7fe90bfff700 1 -- 172.21.15.8:0/404787642 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91800cbd0 con 0x7fe924101bb0 2023-08-11T12:21:17.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.754+0000 7fe92972f700 1 -- 172.21.15.8:0/404787642 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9241a0a20 con 0x7fe924101bb0 2023-08-11T12:21:17.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.754+0000 7fe90bfff700 1 -- 172.21.15.8:0/404787642 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe91800ee60 con 0x7fe924101bb0 2023-08-11T12:21:17.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.754+0000 7fe90bfff700 1 -- 172.21.15.8:0/404787642 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe918018680 con 0x7fe924101bb0 2023-08-11T12:21:17.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.754+0000 7fe92972f700 1 -- 172.21.15.8:0/404787642 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9241a0f70 con 0x7fe924101bb0 2023-08-11T12:21:17.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.755+0000 7fe92972f700 1 -- 172.21.15.8:0/404787642 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe92410c200 con 0x7fe924101bb0 2023-08-11T12:21:17.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.757+0000 7fe90bfff700 1 -- 172.21.15.8:0/404787642 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fe918010430 con 0x7fe924101bb0 2023-08-11T12:21:17.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.759+0000 7fe90bfff700 1 --2- 172.21.15.8:0/404787642 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe90c09ffd0 0x7fe90c0a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:17.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.759+0000 7fe90bfff700 1 -- 172.21.15.8:0/404787642 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe918014070 con 0x7fe924101bb0 2023-08-11T12:21:17.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.759+0000 7fe922ffd700 1 --2- 172.21.15.8:0/404787642 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe90c09ffd0 0x7fe90c0a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:17.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.760+0000 7fe922ffd700 1 --2- 172.21.15.8:0/404787642 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe90c09ffd0 0x7fe90c0a2490 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe914000c00 tx=0x7fe914005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:17.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.763+0000 7fe90bfff700 1 -- 172.21.15.8:0/404787642 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fe918051c30 con 0x7fe924101bb0 2023-08-11T12:21:17.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.975+0000 7fe92972f700 1 -- 172.21.15.8:0/404787642 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fe92410c3c0 con 0x7fe924101bb0 2023-08-11T12:21:17.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.976+0000 7fe90bfff700 1 -- 172.21.15.8:0/404787642 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v79) v1 ==== 74+0+133 (secure 0 0 0) 0x7fe918095040 con 0x7fe924101bb0 2023-08-11T12:21:17.978 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:21:17.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.978+0000 7fe92972f700 1 -- 172.21.15.8:0/404787642 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe90c09ffd0 msgr2=0x7fe90c0a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:17.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.978+0000 7fe92972f700 1 --2- 172.21.15.8:0/404787642 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe90c09ffd0 0x7fe90c0a2490 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe914000c00 tx=0x7fe914005fb0 comp rx=0 tx=0).stop 2023-08-11T12:21:17.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.978+0000 7fe92972f700 1 -- 172.21.15.8:0/404787642 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe924101bb0 msgr2=0x7fe924198e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:17.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.978+0000 7fe92972f700 1 --2- 172.21.15.8:0/404787642 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe924101bb0 0x7fe924198e20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe91800ea20 tx=0x7fe91800ed30 comp rx=0 tx=0).stop 2023-08-11T12:21:17.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.978+0000 7fe92972f700 1 -- 172.21.15.8:0/404787642 shutdown_connections 2023-08-11T12:21:17.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.978+0000 7fe92972f700 1 --2- 172.21.15.8:0/404787642 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe90c09ffd0 0x7fe90c0a2490 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:17.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.978+0000 7fe92972f700 1 --2- 172.21.15.8:0/404787642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9241009b0 0x7fe9241988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:17.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.978+0000 7fe92972f700 1 --2- 172.21.15.8:0/404787642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe924102550 0x7fe92419fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:17.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.978+0000 7fe92972f700 1 --2- 172.21.15.8:0/404787642 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe924101bb0 0x7fe924198e20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:17.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.978+0000 7fe92972f700 1 -- 172.21.15.8:0/404787642 >> 172.21.15.8:0/404787642 conn(0x7fe9240fbf10 msgr2=0x7fe9240fe240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:17.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.978+0000 7fe92972f700 1 -- 172.21.15.8:0/404787642 shutdown_connections 2023-08-11T12:21:17.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:17.978+0000 7fe92972f700 1 -- 172.21.15.8:0/404787642 wait complete. 2023-08-11T12:21:18.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:18 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/404787642' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-08-11T12:21:18.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:18 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/404787642' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-08-11T12:21:18.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:18 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/404787642' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-08-11T12:21:18.476 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":79,"num_osds":12,"num_up_osds":12,"osd_up_since":1691756474,"num_in_osds":12,"osd_in_since":1691756457,"num_remapped_pgs":0} 2023-08-11T12:21:18.476 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph osd dump --format=json 2023-08-11T12:21:19.209 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:21:19.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:19 smithi008 ceph-mon[97158]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:19.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:19 smithi194 ceph-mon[130905]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:19.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:19 smithi045 ceph-mon[130284]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:20.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.834+0000 7f636c895700 1 -- 172.21.15.8:0/2430045087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6368100940 msgr2=0x7f6368100dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:20.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.834+0000 7f636c895700 1 --2- 172.21.15.8:0/2430045087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6368100940 0x7f6368100dc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f635c0098f0 tx=0x7f635c009c00 comp rx=0 tx=0).stop 2023-08-11T12:21:20.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.834+0000 7f636c895700 1 -- 172.21.15.8:0/2430045087 shutdown_connections 2023-08-11T12:21:20.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.834+0000 7f636c895700 1 --2- 172.21.15.8:0/2430045087 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6368106940 0x7f6368106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:20.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.834+0000 7f636c895700 1 --2- 172.21.15.8:0/2430045087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6368101300 0x7f636810d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:20.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.834+0000 7f636c895700 1 --2- 172.21.15.8:0/2430045087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6368100940 0x7f6368100dc0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:20.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.834+0000 7f636c895700 1 -- 172.21.15.8:0/2430045087 >> 172.21.15.8:0/2430045087 conn(0x7f63680fc410 msgr2=0x7f63680fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:20.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.834+0000 7f636c895700 1 -- 172.21.15.8:0/2430045087 shutdown_connections 2023-08-11T12:21:20.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.834+0000 7f636c895700 1 -- 172.21.15.8:0/2430045087 wait complete. 2023-08-11T12:21:20.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.835+0000 7f636c895700 1 Processor -- start 2023-08-11T12:21:20.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.835+0000 7f636c895700 1 -- start start 2023-08-11T12:21:20.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.836+0000 7f636c895700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6368100940 0x7f6368198cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:20.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.836+0000 7f636c895700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6368101300 0x7f6368199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:20.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.836+0000 7f636c895700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6368106940 0x7f636819c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:20.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.836+0000 7f636c895700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636819cbd0 con 0x7f6368106940 2023-08-11T12:21:20.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.836+0000 7f636c895700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636819cd40 con 0x7f6368100940 2023-08-11T12:21:20.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.836+0000 7f636c895700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636819cf00 con 0x7f6368101300 2023-08-11T12:21:20.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.836+0000 7f636659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6368100940 0x7f6368198cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:20.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.836+0000 7f6366d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6368106940 0x7f636819c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:20.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.836+0000 7f636659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6368100940 0x7f6368198cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:49676/0 (socket says 172.21.15.8:49676) 2023-08-11T12:21:20.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.836+0000 7f636659c700 1 -- 172.21.15.8:0/3006223506 learned_addr learned my addr 172.21.15.8:0/3006223506 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:21:20.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.836+0000 7f6365d9b700 1 --2- 172.21.15.8:0/3006223506 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6368101300 0x7f6368199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:20.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.837+0000 7f636659c700 1 -- 172.21.15.8:0/3006223506 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6368101300 msgr2=0x7f6368199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:20.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.837+0000 7f636659c700 1 --2- 172.21.15.8:0/3006223506 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6368101300 0x7f6368199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:20.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.837+0000 7f636659c700 1 -- 172.21.15.8:0/3006223506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6368106940 msgr2=0x7f636819c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:20.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.837+0000 7f636659c700 1 --2- 172.21.15.8:0/3006223506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6368106940 0x7f636819c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:20.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.837+0000 7f636659c700 1 -- 172.21.15.8:0/3006223506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6360009d00 con 0x7f6368100940 2023-08-11T12:21:20.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.837+0000 7f6365d9b700 1 --2- 172.21.15.8:0/3006223506 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6368101300 0x7f6368199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:21:20.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.837+0000 7f6366d9d700 1 --2- 172.21.15.8:0/3006223506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6368106940 0x7f636819c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:21:20.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.837+0000 7f636659c700 1 --2- 172.21.15.8:0/3006223506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6368100940 0x7f6368198cd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f635800e9a0 tx=0x7f635800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:20.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.837+0000 7f63577fe700 1 -- 172.21.15.8:0/3006223506 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6358009790 con 0x7f6368100940 2023-08-11T12:21:20.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.837+0000 7f63577fe700 1 -- 172.21.15.8:0/3006223506 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f635800cbd0 con 0x7f6368100940 2023-08-11T12:21:20.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.837+0000 7f636c895700 1 -- 172.21.15.8:0/3006223506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f635c009520 con 0x7f6368100940 2023-08-11T12:21:20.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.837+0000 7f63577fe700 1 -- 172.21.15.8:0/3006223506 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6358018680 con 0x7f6368100940 2023-08-11T12:21:20.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.837+0000 7f636c895700 1 -- 172.21.15.8:0/3006223506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63681a5960 con 0x7f6368100940 2023-08-11T12:21:20.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.838+0000 7f636c895700 1 -- 172.21.15.8:0/3006223506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f636804e620 con 0x7f6368100940 2023-08-11T12:21:20.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.840+0000 7f63577fe700 1 -- 172.21.15.8:0/3006223506 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f635800cd40 con 0x7f6368100940 2023-08-11T12:21:20.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.842+0000 7f63577fe700 1 --2- 172.21.15.8:0/3006223506 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f635009ffd0 0x7f63500a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:20.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.842+0000 7f63577fe700 1 -- 172.21.15.8:0/3006223506 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f6358014070 con 0x7f6368100940 2023-08-11T12:21:20.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.842+0000 7f6365d9b700 1 --2- 172.21.15.8:0/3006223506 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f635009ffd0 0x7f63500a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:20.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.842+0000 7f6365d9b700 1 --2- 172.21.15.8:0/3006223506 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f635009ffd0 0x7f63500a2490 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f636819a350 tx=0x7f635c019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:20.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:20.844+0000 7f63577fe700 1 -- 172.21.15.8:0/3006223506 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f63580951f0 con 0x7f6368100940 2023-08-11T12:21:21.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:20 smithi008 ceph-mon[97158]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:21.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:21.056+0000 7f636c895700 1 -- 172.21.15.8:0/3006223506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6368110ac0 con 0x7f6368100940 2023-08-11T12:21:21.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:21.057+0000 7f63577fe700 1 -- 172.21.15.8:0/3006223506 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18282 (secure 0 0 0) 0x7f6358098810 con 0x7f6368100940 2023-08-11T12:21:21.060 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:21:21.060 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":79,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","created":"2023-08-11T12:14:28.341113+0000","modified":"2023-08-11T12:21:15.922685+0000","last_up_change":"2023-08-11T12:21:14.913735+0000","last_in_change":"2023-08-11T12:20:57.476558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-11T12:17:49.040758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f903e393-7894-42d6-8b11-737ceef1f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6803","nonce":664104961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6805","nonce":664104961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6809","nonce":664104961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6807","nonce":664104961}]},"public_addr":"172.21.15.8:6803/664104961","cluster_addr":"172.21.15.8:6805/664104961","heartbeat_back_addr":"172.21.15.8:6809/664104961","heartbeat_front_addr":"172.21.15.8:6807/664104961","state":["exists","up"]},{"osd":1,"uuid":"1e988e5c-e78c-46d5-80a5-dff7ac38cbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6801","nonce":4187350703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6803","nonce":4187350703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6807","nonce":4187350703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6805","nonce":4187350703}]},"public_addr":"172.21.15.45:6801/4187350703","cluster_addr":"172.21.15.45:6803/4187350703","heartbeat_back_addr":"172.21.15.45:6807/4187350703","heartbeat_front_addr":"172.21.15.45:6805/4187350703","state":["exists","up"]},{"osd":2,"uuid":"1835217c-a93c-4181-b8b8-cc410bab1a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6801","nonce":2547818140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6803","nonce":2547818140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6807","nonce":2547818140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6805","nonce":2547818140}]},"public_addr":"172.21.15.194:6801/2547818140","cluster_addr":"172.21.15.194:6803/2547818140","heartbeat_back_addr":"172.21.15.194:6807/2547818140","heartbeat_front_addr":"172.21.15.194:6805/2547818140","state":["exists","up"]},{"osd":3,"uuid":"b55ae61a-731c-4312-a998-661122b84788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6811","nonce":187418883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6813","nonce":187418883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6817","nonce":187418883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6815","nonce":187418883}]},"public_addr":"172.21.15.8:6811/187418883","cluster_addr":"172.21.15.8:6813/187418883","heartbeat_back_addr":"172.21.15.8:6817/187418883","heartbeat_front_addr":"172.21.15.8:6815/187418883","state":["exists","up"]},{"osd":4,"uuid":"2c28acbb-e807-4559-8aa2-a35ca84b5d43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6809","nonce":3099704571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6811","nonce":3099704571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6815","nonce":3099704571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6813","nonce":3099704571}]},"public_addr":"172.21.15.45:6809/3099704571","cluster_addr":"172.21.15.45:6811/3099704571","heartbeat_back_addr":"172.21.15.45:6815/3099704571","heartbeat_front_addr":"172.21.15.45:6813/3099704571","state":["exists","up"]},{"osd":5,"uuid":"37032289-8016-4730-9b69-f7985e058ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6809","nonce":263803874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6811","nonce":263803874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6815","nonce":263803874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6813","nonce":263803874}]},"public_addr":"172.21.15.194:6809/263803874","cluster_addr":"172.21.15.194:6811/263803874","heartbeat_back_addr":"172.21.15.194:6815/263803874","heartbeat_front_addr":"172.21.15.194:6813/263803874","state":["exists","up"]},{"osd":6,"uuid":"32d2dab9-6944-40d1-ada9-4f941821b063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6819","nonce":1802966829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6821","nonce":1802966829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6825","nonce":1802966829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6823","nonce":1802966829}]},"public_addr":"172.21.15.8:6819/1802966829","cluster_addr":"172.21.15.8:6821/1802966829","heartbeat_back_addr":"172.21.15.8:6825/1802966829","heartbeat_front_addr":"172.21.15.8:6823/1802966829","state":["exists","up"]},{"osd":7,"uuid":"086aff58-1554-49fe-92ff-5166b115aeef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6817","nonce":3715737148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6819","nonce":3715737148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6823","nonce":3715737148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6821","nonce":3715737148}]},"public_addr":"172.21.15.45:6817/3715737148","cluster_addr":"172.21.15.45:6819/3715737148","heartbeat_back_addr":"172.21.15.45:6823/3715737148","heartbeat_front_addr":"172.21.15.45:6821/3715737148","state":["exists","up"]},{"osd":8,"uuid":"7fff5e95-2453-4ea6-a5c1-3bba6a1f6400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6817","nonce":57497127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6819","nonce":57497127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6823","nonce":57497127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6821","nonce":57497127}]},"public_addr":"172.21.15.194:6817/57497127","cluster_addr":"172.21.15.194:6819/57497127","heartbeat_back_addr":"172.21.15.194:6823/57497127","heartbeat_front_addr":"172.21.15.194:6821/57497127","state":["exists","up"]},{"osd":9,"uuid":"31ab0121-4c92-42ec-9f19-e672062e8814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6827","nonce":434661930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6829","nonce":434661930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6833","nonce":434661930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6831","nonce":434661930}]},"public_addr":"172.21.15.8:6827/434661930","cluster_addr":"172.21.15.8:6829/434661930","heartbeat_back_addr":"172.21.15.8:6833/434661930","heartbeat_front_addr":"172.21.15.8:6831/434661930","state":["exists","up"]},{"osd":10,"uuid":"62c632e4-94f6-4630-9d94-8d28fccacf45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6825","nonce":3281212184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6827","nonce":3281212184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6831","nonce":3281212184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6829","nonce":3281212184}]},"public_addr":"172.21.15.45:6825/3281212184","cluster_addr":"172.21.15.45:6827/3281212184","heartbeat_back_addr":"172.21.15.45:6831/3281212184","heartbeat_front_addr":"172.21.15.45:6829/3281212184","state":["exists","up"]},{"osd":11,"uuid":"8ca4a80d-cd75-4230-b46d-aef6fdc03e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6825","nonce":1637875895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6827","nonce":1637875895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6831","nonce":1637875895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6829","nonce":1637875895}]},"public_addr":"172.21.15.194:6825/1637875895","cluster_addr":"172.21.15.194:6827/1637875895","heartbeat_back_addr":"172.21.15.194:6831/1637875895","heartbeat_front_addr":"172.21.15.194:6829/1637875895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:04.255616+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:26.243863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:46.630365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:12.926291+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:35.747049+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:55.793767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:21.685725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:43.703215+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:04.043674+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:30.320026+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:52.751974+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:21:13.230024+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/2000592056":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2102228072":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2374527928":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2928221278":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2744750874":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/3681755887":"2023-08-12T12:15:02.528403+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-11T12:21:21.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:21.060+0000 7f636c895700 1 -- 172.21.15.8:0/3006223506 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f635009ffd0 msgr2=0x7f63500a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:21.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:21.060+0000 7f636c895700 1 --2- 172.21.15.8:0/3006223506 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f635009ffd0 0x7f63500a2490 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f636819a350 tx=0x7f635c019040 comp rx=0 tx=0).stop 2023-08-11T12:21:21.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:21.060+0000 7f636c895700 1 -- 172.21.15.8:0/3006223506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6368100940 msgr2=0x7f6368198cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:21.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:21.060+0000 7f636c895700 1 --2- 172.21.15.8:0/3006223506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6368100940 0x7f6368198cd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f635800e9a0 tx=0x7f635800ecb0 comp rx=0 tx=0).stop 2023-08-11T12:21:21.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:21.060+0000 7f636c895700 1 -- 172.21.15.8:0/3006223506 shutdown_connections 2023-08-11T12:21:21.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:21.060+0000 7f636c895700 1 --2- 172.21.15.8:0/3006223506 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f635009ffd0 0x7f63500a2490 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:21.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:21.060+0000 7f636c895700 1 --2- 172.21.15.8:0/3006223506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6368106940 0x7f636819c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:21.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:21.060+0000 7f636c895700 1 --2- 172.21.15.8:0/3006223506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6368100940 0x7f6368198cd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:21.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:21.060+0000 7f636c895700 1 --2- 172.21.15.8:0/3006223506 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6368101300 0x7f6368199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:21.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:21.060+0000 7f636c895700 1 -- 172.21.15.8:0/3006223506 >> 172.21.15.8:0/3006223506 conn(0x7f63680fc410 msgr2=0x7f63680fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:21.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:21.060+0000 7f636c895700 1 -- 172.21.15.8:0/3006223506 shutdown_connections 2023-08-11T12:21:21.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:21.060+0000 7f636c895700 1 -- 172.21.15.8:0/3006223506 wait complete. 2023-08-11T12:21:21.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:20 smithi194 ceph-mon[130905]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:21.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:20 smithi045 ceph-mon[130284]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:21.591 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-11T12:17:49.040758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-11T12:21:21.592 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph osd pool get .mgr pg_num 2023-08-11T12:21:22.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:21 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3006223506' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:21:22.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:21 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3006223506' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:21:22.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:21 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3006223506' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:21:22.325 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:21:22.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:22 smithi008 ceph-mon[97158]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:23.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:22 smithi194 ceph-mon[130905]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:23.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:22 smithi045 ceph-mon[130284]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:23.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.853+0000 7fac88dcc700 1 -- 172.21.15.8:0/3029328951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac84106940 msgr2=0x7fac84106d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:23.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.853+0000 7fac88dcc700 1 --2- 172.21.15.8:0/3029328951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac84106940 0x7fac84106d20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fac74009990 tx=0x7fac74009ca0 comp rx=0 tx=0).stop 2023-08-11T12:21:23.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.853+0000 7fac88dcc700 1 -- 172.21.15.8:0/3029328951 shutdown_connections 2023-08-11T12:21:23.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.853+0000 7fac88dcc700 1 --2- 172.21.15.8:0/3029328951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac84101300 0x7fac8410d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:23.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.853+0000 7fac88dcc700 1 --2- 172.21.15.8:0/3029328951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac84106940 0x7fac84106d20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:23.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.853+0000 7fac88dcc700 1 --2- 172.21.15.8:0/3029328951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac84100940 0x7fac84100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:23.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.853+0000 7fac88dcc700 1 -- 172.21.15.8:0/3029328951 >> 172.21.15.8:0/3029328951 conn(0x7fac840fc410 msgr2=0x7fac840fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:23.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.853+0000 7fac88dcc700 1 -- 172.21.15.8:0/3029328951 shutdown_connections 2023-08-11T12:21:23.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.853+0000 7fac88dcc700 1 -- 172.21.15.8:0/3029328951 wait complete. 2023-08-11T12:21:23.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.854+0000 7fac88dcc700 1 Processor -- start 2023-08-11T12:21:23.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.854+0000 7fac88dcc700 1 -- start start 2023-08-11T12:21:23.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.854+0000 7fac88dcc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac84100940 0x7fac8419c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:23.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.854+0000 7fac88dcc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac84101300 0x7fac8419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:23.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.854+0000 7fac88dcc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac84106940 0x7fac841968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:23.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.854+0000 7fac88dcc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac84196f20 con 0x7fac84106940 2023-08-11T12:21:23.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.854+0000 7fac88dcc700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac84197090 con 0x7fac84101300 2023-08-11T12:21:23.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.854+0000 7fac88dcc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac84197250 con 0x7fac84100940 2023-08-11T12:21:23.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.855+0000 7fac7a59c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac84100940 0x7fac8419c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:23.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.855+0000 7fac82d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac84106940 0x7fac841968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:23.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.855+0000 7fac82d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac84106940 0x7fac841968c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59196/0 (socket says 172.21.15.8:59196) 2023-08-11T12:21:23.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.855+0000 7fac82d9d700 1 -- 172.21.15.8:0/1548372629 learned_addr learned my addr 172.21.15.8:0/1548372629 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:21:23.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.855+0000 7fac7a59c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac84100940 0x7fac8419c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:35214/0 (socket says 172.21.15.8:35214) 2023-08-11T12:21:23.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.855+0000 7fac8259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac84101300 0x7fac8419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:23.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.855+0000 7fac82d9d700 1 -- 172.21.15.8:0/1548372629 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac84100940 msgr2=0x7fac8419c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:23.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.855+0000 7fac82d9d700 1 --2- 172.21.15.8:0/1548372629 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac84100940 0x7fac8419c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:23.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.855+0000 7fac82d9d700 1 -- 172.21.15.8:0/1548372629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac84101300 msgr2=0x7fac8419cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:23.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.855+0000 7fac82d9d700 1 --2- 172.21.15.8:0/1548372629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac84101300 0x7fac8419cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:23.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.855+0000 7fac82d9d700 1 -- 172.21.15.8:0/1548372629 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac740095f0 con 0x7fac84106940 2023-08-11T12:21:23.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.855+0000 7fac82d9d700 1 --2- 172.21.15.8:0/1548372629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac84106940 0x7fac841968c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fac7c00ef30 tx=0x7fac7c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:23.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.856+0000 7fac7bfff700 1 -- 172.21.15.8:0/1548372629 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c018070 con 0x7fac84106940 2023-08-11T12:21:23.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.856+0000 7fac7bfff700 1 -- 172.21.15.8:0/1548372629 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac7c00f040 con 0x7fac84106940 2023-08-11T12:21:23.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.856+0000 7fac7bfff700 1 -- 172.21.15.8:0/1548372629 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c00cd00 con 0x7fac84106940 2023-08-11T12:21:23.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.856+0000 7fac88dcc700 1 -- 172.21.15.8:0/1548372629 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac841974d0 con 0x7fac84106940 2023-08-11T12:21:23.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.856+0000 7fac88dcc700 1 -- 172.21.15.8:0/1548372629 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac841a37c0 con 0x7fac84106940 2023-08-11T12:21:23.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.857+0000 7fac88dcc700 1 -- 172.21.15.8:0/1548372629 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac8404e620 con 0x7fac84106940 2023-08-11T12:21:23.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.859+0000 7fac7bfff700 1 -- 172.21.15.8:0/1548372629 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fac7c003a00 con 0x7fac84106940 2023-08-11T12:21:23.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.860+0000 7fac7bfff700 1 --2- 172.21.15.8:0/1548372629 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fac7009ffd0 0x7fac700a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:23.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.861+0000 7fac7bfff700 1 -- 172.21.15.8:0/1548372629 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fac7c0cb210 con 0x7fac84106940 2023-08-11T12:21:23.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.861+0000 7fac7a59c700 1 --2- 172.21.15.8:0/1548372629 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fac7009ffd0 0x7fac700a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:23.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.861+0000 7fac7a59c700 1 --2- 172.21.15.8:0/1548372629 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fac7009ffd0 0x7fac700a2490 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fac7400b2e0 tx=0x7fac74005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:23.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:23.863+0000 7fac7bfff700 1 -- 172.21.15.8:0/1548372629 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fac7c095430 con 0x7fac84106940 2023-08-11T12:21:24.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:24.069+0000 7fac88dcc700 1 -- 172.21.15.8:0/1548372629 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac840008d0 con 0x7fac84106940 2023-08-11T12:21:24.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:24.069+0000 7fac7bfff700 1 -- 172.21.15.8:0/1548372629 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac7c098a50 con 0x7fac84106940 2023-08-11T12:21:24.073 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-08-11T12:21:24.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:24.071+0000 7fac88dcc700 1 -- 172.21.15.8:0/1548372629 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fac7009ffd0 msgr2=0x7fac700a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:24.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:24.071+0000 7fac88dcc700 1 --2- 172.21.15.8:0/1548372629 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fac7009ffd0 0x7fac700a2490 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fac7400b2e0 tx=0x7fac74005fd0 comp rx=0 tx=0).stop 2023-08-11T12:21:24.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:24.071+0000 7fac88dcc700 1 -- 172.21.15.8:0/1548372629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac84106940 msgr2=0x7fac841968c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:24.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:24.071+0000 7fac88dcc700 1 --2- 172.21.15.8:0/1548372629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac84106940 0x7fac841968c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fac7c00ef30 tx=0x7fac7c00c3a0 comp rx=0 tx=0).stop 2023-08-11T12:21:24.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:24.072+0000 7fac88dcc700 1 -- 172.21.15.8:0/1548372629 shutdown_connections 2023-08-11T12:21:24.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:24.072+0000 7fac88dcc700 1 --2- 172.21.15.8:0/1548372629 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fac7009ffd0 0x7fac700a2490 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:24.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:24.072+0000 7fac88dcc700 1 --2- 172.21.15.8:0/1548372629 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac84100940 0x7fac8419c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:24.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:24.072+0000 7fac88dcc700 1 --2- 172.21.15.8:0/1548372629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac84106940 0x7fac841968c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:24.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:24.072+0000 7fac88dcc700 1 --2- 172.21.15.8:0/1548372629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac84101300 0x7fac8419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:24.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:24.072+0000 7fac88dcc700 1 -- 172.21.15.8:0/1548372629 >> 172.21.15.8:0/1548372629 conn(0x7fac840fc410 msgr2=0x7fac840fcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:24.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:24.072+0000 7fac88dcc700 1 -- 172.21.15.8:0/1548372629 shutdown_connections 2023-08-11T12:21:24.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:24.072+0000 7fac88dcc700 1 -- 172.21.15.8:0/1548372629 wait complete. 2023-08-11T12:21:24.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:24 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1548372629' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:21:24.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:24 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1548372629' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:21:24.551 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:24 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1548372629' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:21:24.605 INFO:tasks.cephadm:Adding mds.a on smithi008 2023-08-11T12:21:24.606 INFO:tasks.cephadm:Adding mds.d on smithi008 2023-08-11T12:21:24.606 INFO:tasks.cephadm:Adding mds.g on smithi008 2023-08-11T12:21:24.606 INFO:tasks.cephadm:Adding mds.j on smithi008 2023-08-11T12:21:24.607 INFO:tasks.cephadm:Adding mds.b on smithi045 2023-08-11T12:21:24.607 INFO:tasks.cephadm:Adding mds.e on smithi045 2023-08-11T12:21:24.607 INFO:tasks.cephadm:Adding mds.h on smithi045 2023-08-11T12:21:24.608 INFO:tasks.cephadm:Adding mds.k on smithi045 2023-08-11T12:21:24.608 INFO:tasks.cephadm:Adding mds.c on smithi194 2023-08-11T12:21:24.608 INFO:tasks.cephadm:Adding mds.f on smithi194 2023-08-11T12:21:24.609 INFO:tasks.cephadm:Adding mds.i on smithi194 2023-08-11T12:21:24.609 INFO:tasks.cephadm:Adding mds.l on smithi194 2023-08-11T12:21:24.610 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph orch apply mds all '12;smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi045=b;smithi045=e;smithi045=h;smithi045=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l' 2023-08-11T12:21:25.182 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.c/config 2023-08-11T12:21:25.391 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:25 smithi194 ceph-mon[130905]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:25.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:25 smithi045 ceph-mon[130284]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:25.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:25 smithi008 ceph-mon[97158]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:26.242 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.237+0000 7f8b9127a700 1 -- 172.21.15.194:0/897598868 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b8c100c30 msgr2=0x7f8b8c1074e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:26.242 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.237+0000 7f8b9127a700 1 --2- 172.21.15.194:0/897598868 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b8c100c30 0x7f8b8c1074e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8b8400b0a0 tx=0x7f8b8400b3b0 comp rx=0 tx=0).stop 2023-08-11T12:21:26.242 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.237+0000 7f8b9127a700 1 -- 172.21.15.194:0/897598868 shutdown_connections 2023-08-11T12:21:26.242 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.237+0000 7f8b9127a700 1 --2- 172.21.15.194:0/897598868 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b8c100c30 0x7f8b8c1074e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:26.243 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.237+0000 7f8b9127a700 1 --2- 172.21.15.194:0/897598868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b8c0ff090 0x7f8b8c0ff4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:26.243 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.237+0000 7f8b9127a700 1 --2- 172.21.15.194:0/897598868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b8c100290 0x7f8b8c1006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:26.243 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.237+0000 7f8b9127a700 1 -- 172.21.15.194:0/897598868 >> 172.21.15.194:0/897598868 conn(0x7f8b8c0fa630 msgr2=0x7f8b8c0fca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:26.243 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.237+0000 7f8b9127a700 1 -- 172.21.15.194:0/897598868 shutdown_connections 2023-08-11T12:21:26.243 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.237+0000 7f8b9127a700 1 -- 172.21.15.194:0/897598868 wait complete. 2023-08-11T12:21:26.243 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.238+0000 7f8b9127a700 1 Processor -- start 2023-08-11T12:21:26.244 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.238+0000 7f8b9127a700 1 -- start start 2023-08-11T12:21:26.244 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.238+0000 7f8b9127a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b8c0ff090 0x7f8b8c108990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:26.244 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.238+0000 7f8b9127a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b8c100290 0x7f8b8c19b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:26.244 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.238+0000 7f8b9127a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b8c100c30 0x7f8b8c19da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:26.244 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.238+0000 7f8b9127a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c19e1d0 con 0x7f8b8c0ff090 2023-08-11T12:21:26.244 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.238+0000 7f8b9127a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c19e340 con 0x7f8b8c100290 2023-08-11T12:21:26.245 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.238+0000 7f8b9127a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c19e500 con 0x7f8b8c100c30 2023-08-11T12:21:26.245 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.238+0000 7f8b8b7fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b8c100c30 0x7f8b8c19da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:26.245 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.238+0000 7f8b8b7fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b8c100c30 0x7f8b8c19da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:40666/0 (socket says 172.21.15.194:40666) 2023-08-11T12:21:26.245 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.238+0000 7f8b8b7fe700 1 -- 172.21.15.194:0/3270525837 learned_addr learned my addr 172.21.15.194:0/3270525837 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-08-11T12:21:26.246 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.238+0000 7f8b8a7fc700 1 --2- 172.21.15.194:0/3270525837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b8c100290 0x7f8b8c19b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:26.246 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.239+0000 7f8b8affd700 1 --2- 172.21.15.194:0/3270525837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b8c0ff090 0x7f8b8c108990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:26.246 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.239+0000 7f8b8b7fe700 1 -- 172.21.15.194:0/3270525837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b8c100290 msgr2=0x7f8b8c19b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:26.246 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.239+0000 7f8b8b7fe700 1 --2- 172.21.15.194:0/3270525837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b8c100290 0x7f8b8c19b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:26.246 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.239+0000 7f8b8b7fe700 1 -- 172.21.15.194:0/3270525837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b8c0ff090 msgr2=0x7f8b8c108990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:26.246 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.239+0000 7f8b8b7fe700 1 --2- 172.21.15.194:0/3270525837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b8c0ff090 0x7f8b8c108990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:26.246 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.239+0000 7f8b8b7fe700 1 -- 172.21.15.194:0/3270525837 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b84009d00 con 0x7f8b8c100c30 2023-08-11T12:21:26.247 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.239+0000 7f8b8b7fe700 1 --2- 172.21.15.194:0/3270525837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b8c100c30 0x7f8b8c19da30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8b840062a0 tx=0x7f8b84004d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:26.247 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.239+0000 7f8b83fff700 1 -- 172.21.15.194:0/3270525837 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8400e040 con 0x7f8b8c100c30 2023-08-11T12:21:26.247 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.239+0000 7f8b83fff700 1 -- 172.21.15.194:0/3270525837 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b84009440 con 0x7f8b8c100c30 2023-08-11T12:21:26.247 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.239+0000 7f8b9127a700 1 -- 172.21.15.194:0/3270525837 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b8c19e780 con 0x7f8b8c100c30 2023-08-11T12:21:26.247 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.239+0000 7f8b83fff700 1 -- 172.21.15.194:0/3270525837 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b84004020 con 0x7f8b8c100c30 2023-08-11T12:21:26.248 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.239+0000 7f8b9127a700 1 -- 172.21.15.194:0/3270525837 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b8c19eba0 con 0x7f8b8c100c30 2023-08-11T12:21:26.248 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.240+0000 7f8b9127a700 1 -- 172.21.15.194:0/3270525837 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b8c106510 con 0x7f8b8c100c30 2023-08-11T12:21:26.248 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.241+0000 7f8b83fff700 1 -- 172.21.15.194:0/3270525837 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f8b8401d690 con 0x7f8b8c100c30 2023-08-11T12:21:26.249 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.241+0000 7f8b83fff700 1 --2- 172.21.15.194:0/3270525837 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8b7809ffd0 0x7f8b780a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:26.249 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.242+0000 7f8b83fff700 1 -- 172.21.15.194:0/3270525837 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8b840cccb0 con 0x7f8b8c100c30 2023-08-11T12:21:26.249 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.242+0000 7f8b8affd700 1 --2- 172.21.15.194:0/3270525837 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8b7809ffd0 0x7f8b780a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:26.249 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.242+0000 7f8b8affd700 1 --2- 172.21.15.194:0/3270525837 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8b7809ffd0 0x7f8b780a2490 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8b74005fd0 tx=0x7f8b74005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:26.249 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.245+0000 7f8b83fff700 1 -- 172.21.15.194:0/3270525837 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f8b84096ed0 con 0x7f8b8c100c30 2023-08-11T12:21:26.445 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.443+0000 7f8b9127a700 1 -- 172.21.15.194:0/3270525837 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi045=b;smithi045=e;smithi045=h;smithi045=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b8c02cde0 con 0x7f8b7809ffd0 2023-08-11T12:21:26.454 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.451+0000 7f8b83fff700 1 -- 172.21.15.194:0/3270525837 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f8b8c02cde0 con 0x7f8b7809ffd0 2023-08-11T12:21:26.454 INFO:teuthology.orchestra.run.smithi194.stdout:Scheduled mds.all update... 2023-08-11T12:21:26.456 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.454+0000 7f8b9127a700 1 -- 172.21.15.194:0/3270525837 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8b7809ffd0 msgr2=0x7f8b780a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:26.457 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.454+0000 7f8b9127a700 1 --2- 172.21.15.194:0/3270525837 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8b7809ffd0 0x7f8b780a2490 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8b74005fd0 tx=0x7f8b74005e50 comp rx=0 tx=0).stop 2023-08-11T12:21:26.457 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.454+0000 7f8b9127a700 1 -- 172.21.15.194:0/3270525837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b8c100c30 msgr2=0x7f8b8c19da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:26.457 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.454+0000 7f8b9127a700 1 --2- 172.21.15.194:0/3270525837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b8c100c30 0x7f8b8c19da30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8b840062a0 tx=0x7f8b84004d00 comp rx=0 tx=0).stop 2023-08-11T12:21:26.457 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.454+0000 7f8b9127a700 1 -- 172.21.15.194:0/3270525837 shutdown_connections 2023-08-11T12:21:26.457 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.454+0000 7f8b9127a700 1 --2- 172.21.15.194:0/3270525837 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8b7809ffd0 0x7f8b780a2490 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:26.457 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.454+0000 7f8b9127a700 1 --2- 172.21.15.194:0/3270525837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b8c100c30 0x7f8b8c19da30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:26.458 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.454+0000 7f8b9127a700 1 --2- 172.21.15.194:0/3270525837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b8c0ff090 0x7f8b8c108990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:26.458 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.454+0000 7f8b9127a700 1 --2- 172.21.15.194:0/3270525837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b8c100290 0x7f8b8c19b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:26.458 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.454+0000 7f8b9127a700 1 -- 172.21.15.194:0/3270525837 >> 172.21.15.194:0/3270525837 conn(0x7f8b8c0fa630 msgr2=0x7f8b8c103650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:26.458 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.454+0000 7f8b9127a700 1 -- 172.21.15.194:0/3270525837 shutdown_connections 2023-08-11T12:21:26.458 INFO:teuthology.orchestra.run.smithi194.stderr:2023-08-11T12:21:26.454+0000 7f8b9127a700 1 -- 172.21.15.194:0/3270525837 wait complete. 2023-08-11T12:21:26.734 DEBUG:teuthology.orchestra.run.smithi008:mds.a> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.a.service 2023-08-11T12:21:26.739 DEBUG:teuthology.orchestra.run.smithi008:mds.d> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.d.service 2023-08-11T12:21:26.784 DEBUG:teuthology.orchestra.run.smithi008:mds.g> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.g.service 2023-08-11T12:21:26.820 INFO:journalctl@ceph.mds.a.smithi008.stdout:-- Logs begin at Fri 2023-08-11 11:56:28 UTC. -- 2023-08-11T12:21:26.824 DEBUG:teuthology.orchestra.run.smithi008:mds.j> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.j.service 2023-08-11T12:21:26.862 INFO:journalctl@ceph.mds.d.smithi008.stdout:-- Logs begin at Fri 2023-08-11 11:56:28 UTC. -- 2023-08-11T12:21:26.865 DEBUG:teuthology.orchestra.run.smithi045:mds.b> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.b.service 2023-08-11T12:21:26.867 DEBUG:teuthology.orchestra.run.smithi045:mds.e> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.e.service 2023-08-11T12:21:26.898 INFO:journalctl@ceph.mds.b.smithi045.stdout:-- Logs begin at Fri 2023-08-11 11:52:16 UTC. -- 2023-08-11T12:21:26.899 DEBUG:teuthology.orchestra.run.smithi045:mds.h> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.h.service 2023-08-11T12:21:26.901 INFO:journalctl@ceph.mds.g.smithi008.stdout:-- Logs begin at Fri 2023-08-11 11:56:28 UTC. -- 2023-08-11T12:21:26.928 INFO:journalctl@ceph.mds.e.smithi045.stdout:-- Logs begin at Fri 2023-08-11 11:52:16 UTC. -- 2023-08-11T12:21:26.929 DEBUG:teuthology.orchestra.run.smithi045:mds.k> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.k.service 2023-08-11T12:21:26.937 INFO:journalctl@ceph.mds.j.smithi008.stdout:-- Logs begin at Fri 2023-08-11 11:56:28 UTC. -- 2023-08-11T12:21:26.955 INFO:journalctl@ceph.mds.h.smithi045.stdout:-- Logs begin at Fri 2023-08-11 11:52:16 UTC. -- 2023-08-11T12:21:26.956 DEBUG:teuthology.orchestra.run.smithi194:mds.c> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.c.service 2023-08-11T12:21:26.959 DEBUG:teuthology.orchestra.run.smithi194:mds.f> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.f.service 2023-08-11T12:21:26.982 INFO:journalctl@ceph.mds.k.smithi045.stdout:-- Logs begin at Fri 2023-08-11 11:52:16 UTC. -- 2023-08-11T12:21:26.988 INFO:journalctl@ceph.mds.c.smithi194.stdout:-- Logs begin at Fri 2023-08-11 11:52:16 UTC. -- 2023-08-11T12:21:26.989 DEBUG:teuthology.orchestra.run.smithi194:mds.i> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.i.service 2023-08-11T12:21:27.015 INFO:journalctl@ceph.mds.f.smithi194.stdout:-- Logs begin at Fri 2023-08-11 11:52:16 UTC. -- 2023-08-11T12:21:27.015 DEBUG:teuthology.orchestra.run.smithi194:mds.l> sudo journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.l.service 2023-08-11T12:21:27.041 INFO:journalctl@ceph.mds.i.smithi194.stdout:-- Logs begin at Fri 2023-08-11 11:52:16 UTC. -- 2023-08-11T12:21:27.042 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-08-11T12:21:27.042 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-11T12:21:27.067 INFO:journalctl@ceph.mds.l.smithi194.stdout:-- Logs begin at Fri 2023-08-11 11:52:16 UTC. -- 2023-08-11T12:21:27.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.264+0000 7f49095ff700 1 -- 172.21.15.8:0/1850373229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4904102570 msgr2=0x7f4904108e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:27.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.264+0000 7f49095ff700 1 --2- 172.21.15.8:0/1850373229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4904102570 0x7f4904108e20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f48fc009fc0 tx=0x7f48fc00b330 comp rx=0 tx=0).stop 2023-08-11T12:21:27.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.264+0000 7f49095ff700 1 -- 172.21.15.8:0/1850373229 shutdown_connections 2023-08-11T12:21:27.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.264+0000 7f49095ff700 1 --2- 172.21.15.8:0/1850373229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4904102570 0x7f4904108e20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:27.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.264+0000 7f49095ff700 1 --2- 172.21.15.8:0/1850373229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49041009e0 0x7f4904100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:27.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.264+0000 7f49095ff700 1 --2- 172.21.15.8:0/1850373229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4904101bd0 0x7f4904102030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:27.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.264+0000 7f49095ff700 1 -- 172.21.15.8:0/1850373229 >> 172.21.15.8:0/1850373229 conn(0x7f49040fbf50 msgr2=0x7f49040fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:27.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.264+0000 7f49095ff700 1 -- 172.21.15.8:0/1850373229 shutdown_connections 2023-08-11T12:21:27.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.264+0000 7f49095ff700 1 -- 172.21.15.8:0/1850373229 wait complete. 2023-08-11T12:21:27.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.265+0000 7f49095ff700 1 Processor -- start 2023-08-11T12:21:27.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.265+0000 7f49095ff700 1 -- start start 2023-08-11T12:21:27.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.266+0000 7f49095ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49041009e0 0x7f4904198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:27.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.266+0000 7f49095ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4904101bd0 0x7f4904198f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:27.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.266+0000 7f49095ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4904102570 0x7f490419ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:27.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.266+0000 7f49095ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49041a0590 con 0x7f4904102570 2023-08-11T12:21:27.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.266+0000 7f49095ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49041a06d0 con 0x7f4904101bd0 2023-08-11T12:21:27.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.266+0000 7f49095ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49041a0860 con 0x7f49041009e0 2023-08-11T12:21:27.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.266+0000 7f48fbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4904101bd0 0x7f4904198f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:27.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.266+0000 7f4902ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49041009e0 0x7f4904198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:27.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.266+0000 7f4902ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49041009e0 0x7f4904198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:35234/0 (socket says 172.21.15.8:35234) 2023-08-11T12:21:27.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.266+0000 7f4902ffd700 1 -- 172.21.15.8:0/2842314396 learned_addr learned my addr 172.21.15.8:0/2842314396 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:21:27.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.266+0000 7f49037fe700 1 --2- 172.21.15.8:0/2842314396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4904102570 0x7f490419ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:27.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.266+0000 7f4902ffd700 1 -- 172.21.15.8:0/2842314396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4904101bd0 msgr2=0x7f4904198f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:27.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.266+0000 7f4902ffd700 1 --2- 172.21.15.8:0/2842314396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4904101bd0 0x7f4904198f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:27.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.266+0000 7f4902ffd700 1 -- 172.21.15.8:0/2842314396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4904102570 msgr2=0x7f490419ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:27.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.266+0000 7f4902ffd700 1 --2- 172.21.15.8:0/2842314396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4904102570 0x7f490419ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:27.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.266+0000 7f4902ffd700 1 -- 172.21.15.8:0/2842314396 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc009c40 con 0x7f49041009e0 2023-08-11T12:21:27.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.266+0000 7f48fbfff700 1 --2- 172.21.15.8:0/2842314396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4904101bd0 0x7f4904198f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:21:27.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.267+0000 7f4902ffd700 1 --2- 172.21.15.8:0/2842314396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49041009e0 0x7f4904198a10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f48f400e9f0 tx=0x7f48f400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:27.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.267+0000 7f4900ff9700 1 -- 172.21.15.8:0/2842314396 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f4004220 con 0x7f49041009e0 2023-08-11T12:21:27.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.267+0000 7f4900ff9700 1 -- 172.21.15.8:0/2842314396 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f48f4004380 con 0x7f49041009e0 2023-08-11T12:21:27.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.267+0000 7f49095ff700 1 -- 172.21.15.8:0/2842314396 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49041a0b40 con 0x7f49041009e0 2023-08-11T12:21:27.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.267+0000 7f4900ff9700 1 -- 172.21.15.8:0/2842314396 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f4003be0 con 0x7f49041009e0 2023-08-11T12:21:27.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.267+0000 7f49095ff700 1 -- 172.21.15.8:0/2842314396 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49041a10a0 con 0x7f49041009e0 2023-08-11T12:21:27.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.268+0000 7f49095ff700 1 -- 172.21.15.8:0/2842314396 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f490410c250 con 0x7f49041009e0 2023-08-11T12:21:27.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.270+0000 7f4900ff9700 1 -- 172.21.15.8:0/2842314396 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f48f4003d40 con 0x7f49041009e0 2023-08-11T12:21:27.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.271+0000 7f4900ff9700 1 --2- 172.21.15.8:0/2842314396 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f48f009ffd0 0x7f48f00a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:27.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.272+0000 7f4900ff9700 1 -- 172.21.15.8:0/2842314396 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f48f4014070 con 0x7f49041009e0 2023-08-11T12:21:27.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.272+0000 7f48fbfff700 1 --2- 172.21.15.8:0/2842314396 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f48f009ffd0 0x7f48f00a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:27.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.272+0000 7f48fbfff700 1 --2- 172.21.15.8:0/2842314396 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f48f009ffd0 0x7f48f00a2490 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f48ec011490 tx=0x7f48ec009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:27.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.273+0000 7f4900ff9700 1 -- 172.21.15.8:0/2842314396 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f48f4095100 con 0x7f49041009e0 2023-08-11T12:21:27.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.486+0000 7f49095ff700 1 -- 172.21.15.8:0/2842314396 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f490410c490 con 0x7f49041009e0 2023-08-11T12:21:27.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.488+0000 7f4900ff9700 1 -- 172.21.15.8:0/2842314396 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18282 (secure 0 0 0) 0x7f48f4098720 con 0x7f49041009e0 2023-08-11T12:21:27.491 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:21:27.491 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":79,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","created":"2023-08-11T12:14:28.341113+0000","modified":"2023-08-11T12:21:15.922685+0000","last_up_change":"2023-08-11T12:21:14.913735+0000","last_in_change":"2023-08-11T12:20:57.476558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-11T12:17:49.040758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f903e393-7894-42d6-8b11-737ceef1f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6803","nonce":664104961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6805","nonce":664104961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6809","nonce":664104961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6807","nonce":664104961}]},"public_addr":"172.21.15.8:6803/664104961","cluster_addr":"172.21.15.8:6805/664104961","heartbeat_back_addr":"172.21.15.8:6809/664104961","heartbeat_front_addr":"172.21.15.8:6807/664104961","state":["exists","up"]},{"osd":1,"uuid":"1e988e5c-e78c-46d5-80a5-dff7ac38cbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6801","nonce":4187350703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6803","nonce":4187350703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6807","nonce":4187350703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6805","nonce":4187350703}]},"public_addr":"172.21.15.45:6801/4187350703","cluster_addr":"172.21.15.45:6803/4187350703","heartbeat_back_addr":"172.21.15.45:6807/4187350703","heartbeat_front_addr":"172.21.15.45:6805/4187350703","state":["exists","up"]},{"osd":2,"uuid":"1835217c-a93c-4181-b8b8-cc410bab1a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6801","nonce":2547818140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6803","nonce":2547818140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6807","nonce":2547818140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6805","nonce":2547818140}]},"public_addr":"172.21.15.194:6801/2547818140","cluster_addr":"172.21.15.194:6803/2547818140","heartbeat_back_addr":"172.21.15.194:6807/2547818140","heartbeat_front_addr":"172.21.15.194:6805/2547818140","state":["exists","up"]},{"osd":3,"uuid":"b55ae61a-731c-4312-a998-661122b84788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6811","nonce":187418883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6813","nonce":187418883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6817","nonce":187418883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6815","nonce":187418883}]},"public_addr":"172.21.15.8:6811/187418883","cluster_addr":"172.21.15.8:6813/187418883","heartbeat_back_addr":"172.21.15.8:6817/187418883","heartbeat_front_addr":"172.21.15.8:6815/187418883","state":["exists","up"]},{"osd":4,"uuid":"2c28acbb-e807-4559-8aa2-a35ca84b5d43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6809","nonce":3099704571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6811","nonce":3099704571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6815","nonce":3099704571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6813","nonce":3099704571}]},"public_addr":"172.21.15.45:6809/3099704571","cluster_addr":"172.21.15.45:6811/3099704571","heartbeat_back_addr":"172.21.15.45:6815/3099704571","heartbeat_front_addr":"172.21.15.45:6813/3099704571","state":["exists","up"]},{"osd":5,"uuid":"37032289-8016-4730-9b69-f7985e058ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6809","nonce":263803874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6811","nonce":263803874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6815","nonce":263803874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6813","nonce":263803874}]},"public_addr":"172.21.15.194:6809/263803874","cluster_addr":"172.21.15.194:6811/263803874","heartbeat_back_addr":"172.21.15.194:6815/263803874","heartbeat_front_addr":"172.21.15.194:6813/263803874","state":["exists","up"]},{"osd":6,"uuid":"32d2dab9-6944-40d1-ada9-4f941821b063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6819","nonce":1802966829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6821","nonce":1802966829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6825","nonce":1802966829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6823","nonce":1802966829}]},"public_addr":"172.21.15.8:6819/1802966829","cluster_addr":"172.21.15.8:6821/1802966829","heartbeat_back_addr":"172.21.15.8:6825/1802966829","heartbeat_front_addr":"172.21.15.8:6823/1802966829","state":["exists","up"]},{"osd":7,"uuid":"086aff58-1554-49fe-92ff-5166b115aeef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6817","nonce":3715737148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6819","nonce":3715737148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6823","nonce":3715737148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6821","nonce":3715737148}]},"public_addr":"172.21.15.45:6817/3715737148","cluster_addr":"172.21.15.45:6819/3715737148","heartbeat_back_addr":"172.21.15.45:6823/3715737148","heartbeat_front_addr":"172.21.15.45:6821/3715737148","state":["exists","up"]},{"osd":8,"uuid":"7fff5e95-2453-4ea6-a5c1-3bba6a1f6400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6817","nonce":57497127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6819","nonce":57497127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6823","nonce":57497127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6821","nonce":57497127}]},"public_addr":"172.21.15.194:6817/57497127","cluster_addr":"172.21.15.194:6819/57497127","heartbeat_back_addr":"172.21.15.194:6823/57497127","heartbeat_front_addr":"172.21.15.194:6821/57497127","state":["exists","up"]},{"osd":9,"uuid":"31ab0121-4c92-42ec-9f19-e672062e8814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6827","nonce":434661930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6829","nonce":434661930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6833","nonce":434661930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6831","nonce":434661930}]},"public_addr":"172.21.15.8:6827/434661930","cluster_addr":"172.21.15.8:6829/434661930","heartbeat_back_addr":"172.21.15.8:6833/434661930","heartbeat_front_addr":"172.21.15.8:6831/434661930","state":["exists","up"]},{"osd":10,"uuid":"62c632e4-94f6-4630-9d94-8d28fccacf45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6825","nonce":3281212184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6827","nonce":3281212184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6831","nonce":3281212184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6829","nonce":3281212184}]},"public_addr":"172.21.15.45:6825/3281212184","cluster_addr":"172.21.15.45:6827/3281212184","heartbeat_back_addr":"172.21.15.45:6831/3281212184","heartbeat_front_addr":"172.21.15.45:6829/3281212184","state":["exists","up"]},{"osd":11,"uuid":"8ca4a80d-cd75-4230-b46d-aef6fdc03e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6825","nonce":1637875895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6827","nonce":1637875895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6831","nonce":1637875895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6829","nonce":1637875895}]},"public_addr":"172.21.15.194:6825/1637875895","cluster_addr":"172.21.15.194:6827/1637875895","heartbeat_back_addr":"172.21.15.194:6831/1637875895","heartbeat_front_addr":"172.21.15.194:6829/1637875895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:04.255616+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:26.243863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:46.630365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:12.926291+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:35.747049+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:55.793767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:21.685725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:43.703215+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:04.043674+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:30.320026+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:52.751974+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:21:13.230024+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/2000592056":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2102228072":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2374527928":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2928221278":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2744750874":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/3681755887":"2023-08-12T12:15:02.528403+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-11T12:21:27.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.490+0000 7f49095ff700 1 -- 172.21.15.8:0/2842314396 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f48f009ffd0 msgr2=0x7f48f00a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:27.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.490+0000 7f49095ff700 1 --2- 172.21.15.8:0/2842314396 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f48f009ffd0 0x7f48f00a2490 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f48ec011490 tx=0x7f48ec009260 comp rx=0 tx=0).stop 2023-08-11T12:21:27.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.490+0000 7f49095ff700 1 -- 172.21.15.8:0/2842314396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49041009e0 msgr2=0x7f4904198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:27.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.490+0000 7f49095ff700 1 --2- 172.21.15.8:0/2842314396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49041009e0 0x7f4904198a10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f48f400e9f0 tx=0x7f48f400ed00 comp rx=0 tx=0).stop 2023-08-11T12:21:27.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.490+0000 7f49095ff700 1 -- 172.21.15.8:0/2842314396 shutdown_connections 2023-08-11T12:21:27.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.490+0000 7f49095ff700 1 --2- 172.21.15.8:0/2842314396 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f48f009ffd0 0x7f48f00a2490 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:27.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.490+0000 7f49095ff700 1 --2- 172.21.15.8:0/2842314396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49041009e0 0x7f4904198a10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:27.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.490+0000 7f49095ff700 1 --2- 172.21.15.8:0/2842314396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4904102570 0x7f490419ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:27.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.490+0000 7f49095ff700 1 --2- 172.21.15.8:0/2842314396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4904101bd0 0x7f4904198f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:27.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.490+0000 7f49095ff700 1 -- 172.21.15.8:0/2842314396 >> 172.21.15.8:0/2842314396 conn(0x7f49040fbf50 msgr2=0x7f49040fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:27.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.490+0000 7f49095ff700 1 -- 172.21.15.8:0/2842314396 shutdown_connections 2023-08-11T12:21:27.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.490+0000 7f49095ff700 1 -- 172.21.15.8:0/2842314396 wait complete. 2023-08-11T12:21:27.513 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-11T12:17:49.040758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-11T12:21:27.513 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-11T12:21:27.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.718+0000 7f072efff700 1 -- 172.21.15.8:0/2925926828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0728100a00 msgr2=0x7f0728100e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:27.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.718+0000 7f072efff700 1 --2- 172.21.15.8:0/2925926828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0728100a00 0x7f0728100e20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f071c0099c0 tx=0x7f071c009cd0 comp rx=0 tx=0).stop 2023-08-11T12:21:27.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.718+0000 7f072efff700 1 -- 172.21.15.8:0/2925926828 shutdown_connections 2023-08-11T12:21:27.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.718+0000 7f072efff700 1 --2- 172.21.15.8:0/2925926828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0728102590 0x7f0728108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:27.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.718+0000 7f072efff700 1 --2- 172.21.15.8:0/2925926828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0728100a00 0x7f0728100e20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:27.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.718+0000 7f072efff700 1 --2- 172.21.15.8:0/2925926828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0728101bf0 0x7f0728102050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:27.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.718+0000 7f072efff700 1 -- 172.21.15.8:0/2925926828 >> 172.21.15.8:0/2925926828 conn(0x7f07280fbf70 msgr2=0x7f07280fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:27.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.719+0000 7f072efff700 1 -- 172.21.15.8:0/2925926828 shutdown_connections 2023-08-11T12:21:27.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.719+0000 7f072efff700 1 -- 172.21.15.8:0/2925926828 wait complete. 2023-08-11T12:21:27.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.720+0000 7f072efff700 1 Processor -- start 2023-08-11T12:21:27.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.720+0000 7f072efff700 1 -- start start 2023-08-11T12:21:27.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.720+0000 7f072efff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0728100a00 0x7f0728198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:27.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.720+0000 7f072efff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0728101bf0 0x7f0728198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:27.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.720+0000 7f072efff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0728102590 0x7f072819feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:27.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.720+0000 7f072efff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07281a0480 con 0x7f0728102590 2023-08-11T12:21:27.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.720+0000 7f072efff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07281a05c0 con 0x7f0728101bf0 2023-08-11T12:21:27.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.720+0000 7f072efff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07281a0750 con 0x7f0728100a00 2023-08-11T12:21:27.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.720+0000 7f072cd9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0728100a00 0x7f0728198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:27.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.720+0000 7f072d59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0728102590 0x7f072819feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:27.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.720+0000 7f072cd9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0728100a00 0x7f0728198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:35264/0 (socket says 172.21.15.8:35264) 2023-08-11T12:21:27.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.720+0000 7f072cd9b700 1 -- 172.21.15.8:0/72967948 learned_addr learned my addr 172.21.15.8:0/72967948 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:21:27.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.720+0000 7f0727fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0728101bf0 0x7f0728198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:27.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.721+0000 7f072cd9b700 1 -- 172.21.15.8:0/72967948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0728101bf0 msgr2=0x7f0728198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:27.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.721+0000 7f072cd9b700 1 --2- 172.21.15.8:0/72967948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0728101bf0 0x7f0728198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:27.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.721+0000 7f072cd9b700 1 -- 172.21.15.8:0/72967948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0728102590 msgr2=0x7f072819feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:27.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.721+0000 7f072cd9b700 1 --2- 172.21.15.8:0/72967948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0728102590 0x7f072819feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:27.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.721+0000 7f072cd9b700 1 -- 172.21.15.8:0/72967948 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071c0095f0 con 0x7f0728100a00 2023-08-11T12:21:27.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.721+0000 7f072d59c700 1 --2- 172.21.15.8:0/72967948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0728102590 0x7f072819feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:21:27.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.721+0000 7f072cd9b700 1 --2- 172.21.15.8:0/72967948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0728100a00 0x7f0728198900 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f071c009990 tx=0x7f071c00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:27.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.721+0000 7f0725ffb700 1 -- 172.21.15.8:0/72967948 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c01d070 con 0x7f0728100a00 2023-08-11T12:21:27.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.721+0000 7f072efff700 1 -- 172.21.15.8:0/72967948 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07281a09d0 con 0x7f0728100a00 2023-08-11T12:21:27.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.721+0000 7f0725ffb700 1 -- 172.21.15.8:0/72967948 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f071c005030 con 0x7f0728100a00 2023-08-11T12:21:27.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.721+0000 7f0725ffb700 1 -- 172.21.15.8:0/72967948 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c004b30 con 0x7f0728100a00 2023-08-11T12:21:27.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.721+0000 7f072efff700 1 -- 172.21.15.8:0/72967948 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07281a0e50 con 0x7f0728100a00 2023-08-11T12:21:27.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.723+0000 7f072efff700 1 -- 172.21.15.8:0/72967948 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0728193050 con 0x7f0728100a00 2023-08-11T12:21:27.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.724+0000 7f0725ffb700 1 -- 172.21.15.8:0/72967948 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f071c004cd0 con 0x7f0728100a00 2023-08-11T12:21:27.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.726+0000 7f0725ffb700 1 --2- 172.21.15.8:0/72967948 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f071809ff50 0x7f07180a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:27.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.726+0000 7f0725ffb700 1 -- 172.21.15.8:0/72967948 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f071c0cbc70 con 0x7f0728100a00 2023-08-11T12:21:27.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.726+0000 7f0727fff700 1 --2- 172.21.15.8:0/72967948 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f071809ff50 0x7f07180a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:27.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.726+0000 7f0727fff700 1 --2- 172.21.15.8:0/72967948 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f071809ff50 0x7f07180a2410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0714007c60 tx=0x7f07140073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:27.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.728+0000 7f0725ffb700 1 -- 172.21.15.8:0/72967948 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f071c095e90 con 0x7f0728100a00 2023-08-11T12:21:27.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:27 smithi008 ceph-mon[97158]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi045=b;smithi045=e;smithi045=h;smithi045=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:21:27.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:27 smithi008 ceph-mon[97158]: Saving service mds.all spec with placement smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi045=b;smithi045=e;smithi045=h;smithi045=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l;count:12 2023-08-11T12:21:27.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:27 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:27.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:27 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:21:27.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:27 smithi008 ceph-mon[97158]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:27.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:27 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:27.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:27 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:21:27.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:27 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:27.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:27 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:27.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:27 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:27.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:27 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:27.822 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:27 smithi194 ceph-mon[130905]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi045=b;smithi045=e;smithi045=h;smithi045=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:21:27.822 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:27 smithi194 ceph-mon[130905]: Saving service mds.all spec with placement smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi045=b;smithi045=e;smithi045=h;smithi045=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l;count:12 2023-08-11T12:21:27.822 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:27 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:27.822 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:27 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:21:27.823 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:27 smithi194 ceph-mon[130905]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:27.823 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:27 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:27.823 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:27 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:21:27.823 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:27 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:27.823 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:27 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:27.823 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:27 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:27.823 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:27 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:27.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:27 smithi045 ceph-mon[130284]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi045=b;smithi045=e;smithi045=h;smithi045=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:21:27.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:27 smithi045 ceph-mon[130284]: Saving service mds.all spec with placement smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi045=b;smithi045=e;smithi045=h;smithi045=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l;count:12 2023-08-11T12:21:27.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:27.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:21:27.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:27 smithi045 ceph-mon[130284]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:27.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:27.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:21:27.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:27.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:27.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:27.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:27 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:27.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.941+0000 7f072efff700 1 -- 172.21.15.8:0/72967948 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f072810c3f0 con 0x7f0728100a00 2023-08-11T12:21:27.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.942+0000 7f0725ffb700 1 -- 172.21.15.8:0/72967948 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f071c0994b0 con 0x7f0728100a00 2023-08-11T12:21:27.945 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-08-11T12:21:27.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.944+0000 7f072efff700 1 -- 172.21.15.8:0/72967948 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f071809ff50 msgr2=0x7f07180a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:27.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.944+0000 7f072efff700 1 --2- 172.21.15.8:0/72967948 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f071809ff50 0x7f07180a2410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0714007c60 tx=0x7f07140073d0 comp rx=0 tx=0).stop 2023-08-11T12:21:27.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.944+0000 7f072efff700 1 -- 172.21.15.8:0/72967948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0728100a00 msgr2=0x7f0728198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:27.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.944+0000 7f072efff700 1 --2- 172.21.15.8:0/72967948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0728100a00 0x7f0728198900 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f071c009990 tx=0x7f071c00f690 comp rx=0 tx=0).stop 2023-08-11T12:21:27.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.944+0000 7f072efff700 1 -- 172.21.15.8:0/72967948 shutdown_connections 2023-08-11T12:21:27.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.944+0000 7f072efff700 1 --2- 172.21.15.8:0/72967948 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f071809ff50 0x7f07180a2410 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:27.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.944+0000 7f072efff700 1 --2- 172.21.15.8:0/72967948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0728100a00 0x7f0728198900 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:27.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.944+0000 7f072efff700 1 --2- 172.21.15.8:0/72967948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0728102590 0x7f072819feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:27.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.944+0000 7f072efff700 1 --2- 172.21.15.8:0/72967948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0728101bf0 0x7f0728198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:27.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.944+0000 7f072efff700 1 -- 172.21.15.8:0/72967948 >> 172.21.15.8:0/72967948 conn(0x7f07280fbf70 msgr2=0x7f0728107500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:27.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.944+0000 7f072efff700 1 -- 172.21.15.8:0/72967948 shutdown_connections 2023-08-11T12:21:27.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:27.944+0000 7f072efff700 1 -- 172.21.15.8:0/72967948 wait complete. 2023-08-11T12:21:27.966 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-11T12:21:28.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.168+0000 7f448ffff700 1 -- 172.21.15.8:0/2812947955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4488073380 msgr2=0x7f4488073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:28.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.168+0000 7f448ffff700 1 --2- 172.21.15.8:0/2812947955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4488073380 0x7f4488073800 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f44780098f0 tx=0x7f4478009c00 comp rx=0 tx=0).stop 2023-08-11T12:21:28.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.168+0000 7f448ffff700 1 -- 172.21.15.8:0/2812947955 shutdown_connections 2023-08-11T12:21:28.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.168+0000 7f448ffff700 1 --2- 172.21.15.8:0/2812947955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4488074960 0x7f4488072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:28.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.168+0000 7f448ffff700 1 --2- 172.21.15.8:0/2812947955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44881088a0 0x7f448810ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:28.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.168+0000 7f448ffff700 1 --2- 172.21.15.8:0/2812947955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4488073380 0x7f4488073800 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:28.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.168+0000 7f448ffff700 1 -- 172.21.15.8:0/2812947955 >> 172.21.15.8:0/2812947955 conn(0x7f44880fbf50 msgr2=0x7f44880fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:28.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.168+0000 7f448ffff700 1 -- 172.21.15.8:0/2812947955 shutdown_connections 2023-08-11T12:21:28.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.168+0000 7f448ffff700 1 -- 172.21.15.8:0/2812947955 wait complete. 2023-08-11T12:21:28.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.169+0000 7f448ffff700 1 Processor -- start 2023-08-11T12:21:28.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.170+0000 7f448ffff700 1 -- start start 2023-08-11T12:21:28.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.170+0000 7f448ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4488073380 0x7f4488198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.170+0000 7f448ffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4488074960 0x7f4488198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.170+0000 7f448ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44881088a0 0x7f448819ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.170+0000 7f448ffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44881a04d0 con 0x7f4488073380 2023-08-11T12:21:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.170+0000 7f448ffff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44881a0610 con 0x7f44881088a0 2023-08-11T12:21:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.170+0000 7f448ffff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44881a07a0 con 0x7f4488074960 2023-08-11T12:21:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.170+0000 7f448dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4488073380 0x7f4488198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.170+0000 7f448dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4488073380 0x7f4488198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55032/0 (socket says 172.21.15.8:55032) 2023-08-11T12:21:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.170+0000 7f448dd9b700 1 -- 172.21.15.8:0/3363813178 learned_addr learned my addr 172.21.15.8:0/3363813178 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:21:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.170+0000 7f448d59a700 1 --2- 172.21.15.8:0/3363813178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4488074960 0x7f4488198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.170+0000 7f448e59c700 1 --2- 172.21.15.8:0/3363813178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44881088a0 0x7f448819ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.171+0000 7f448dd9b700 1 -- 172.21.15.8:0/3363813178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4488074960 msgr2=0x7f4488198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.171+0000 7f448dd9b700 1 --2- 172.21.15.8:0/3363813178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4488074960 0x7f4488198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.171+0000 7f448dd9b700 1 -- 172.21.15.8:0/3363813178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44881088a0 msgr2=0x7f448819ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.171+0000 7f448dd9b700 1 --2- 172.21.15.8:0/3363813178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44881088a0 0x7f448819ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.171+0000 7f448dd9b700 1 -- 172.21.15.8:0/3363813178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4478009520 con 0x7f4488073380 2023-08-11T12:21:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.171+0000 7f448dd9b700 1 --2- 172.21.15.8:0/3363813178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4488073380 0x7f4488198950 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f448400e9c0 tx=0x7f448400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.171+0000 7f447effd700 1 -- 172.21.15.8:0/3363813178 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4484004a30 con 0x7f4488073380 2023-08-11T12:21:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.171+0000 7f448ffff700 1 -- 172.21.15.8:0/3363813178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44881a0a80 con 0x7f4488073380 2023-08-11T12:21:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.171+0000 7f447effd700 1 -- 172.21.15.8:0/3363813178 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f448400cc80 con 0x7f4488073380 2023-08-11T12:21:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.171+0000 7f447effd700 1 -- 172.21.15.8:0/3363813178 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44840054e0 con 0x7f4488073380 2023-08-11T12:21:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.171+0000 7f448ffff700 1 -- 172.21.15.8:0/3363813178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44881a0fe0 con 0x7f4488073380 2023-08-11T12:21:28.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.172+0000 7f448ffff700 1 -- 172.21.15.8:0/3363813178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4488106f50 con 0x7f4488073380 2023-08-11T12:21:28.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.174+0000 7f447effd700 1 -- 172.21.15.8:0/3363813178 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f4484004b90 con 0x7f4488073380 2023-08-11T12:21:28.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.175+0000 7f447effd700 1 --2- 172.21.15.8:0/3363813178 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f447409ff50 0x7f44740a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:28.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.176+0000 7f447effd700 1 -- 172.21.15.8:0/3363813178 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f4484014070 con 0x7f4488073380 2023-08-11T12:21:28.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.176+0000 7f448d59a700 1 --2- 172.21.15.8:0/3363813178 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f447409ff50 0x7f44740a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:28.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.176+0000 7f448d59a700 1 --2- 172.21.15.8:0/3363813178 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f447409ff50 0x7f44740a2410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4478009fd0 tx=0x7f4478019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:28.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.179+0000 7f447effd700 1 -- 172.21.15.8:0/3363813178 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f4484095090 con 0x7f4488073380 2023-08-11T12:21:28.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.435+0000 7f448ffff700 1 -- 172.21.15.8:0/3363813178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f448810e420 con 0x7f4488073380 2023-08-11T12:21:28.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.435+0000 7f447effd700 1 -- 172.21.15.8:0/3363813178 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f44840986b0 con 0x7f4488073380 2023-08-11T12:21:28.439 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:21:28.439 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-08-11T12:21:28.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.438+0000 7f448ffff700 1 -- 172.21.15.8:0/3363813178 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f447409ff50 msgr2=0x7f44740a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:28.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.438+0000 7f448ffff700 1 --2- 172.21.15.8:0/3363813178 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f447409ff50 0x7f44740a2410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4478009fd0 tx=0x7f4478019040 comp rx=0 tx=0).stop 2023-08-11T12:21:28.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.438+0000 7f448ffff700 1 -- 172.21.15.8:0/3363813178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4488073380 msgr2=0x7f4488198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:28.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.438+0000 7f448ffff700 1 --2- 172.21.15.8:0/3363813178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4488073380 0x7f4488198950 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f448400e9c0 tx=0x7f448400ecd0 comp rx=0 tx=0).stop 2023-08-11T12:21:28.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.438+0000 7f448ffff700 1 -- 172.21.15.8:0/3363813178 shutdown_connections 2023-08-11T12:21:28.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.438+0000 7f448ffff700 1 --2- 172.21.15.8:0/3363813178 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f447409ff50 0x7f44740a2410 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:28.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.438+0000 7f448ffff700 1 --2- 172.21.15.8:0/3363813178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44881088a0 0x7f448819ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:28.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.438+0000 7f448ffff700 1 --2- 172.21.15.8:0/3363813178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4488073380 0x7f4488198950 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:28.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.438+0000 7f448ffff700 1 --2- 172.21.15.8:0/3363813178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4488074960 0x7f4488198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:28.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.438+0000 7f448ffff700 1 -- 172.21.15.8:0/3363813178 >> 172.21.15.8:0/3363813178 conn(0x7f44880fbf50 msgr2=0x7f44880fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:28.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.438+0000 7f448ffff700 1 -- 172.21.15.8:0/3363813178 shutdown_connections 2023-08-11T12:21:28.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:28.438+0000 7f448ffff700 1 -- 172.21.15.8:0/3363813178 wait complete. 2023-08-11T12:21:28.443 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 1 2023-08-11T12:21:28.675 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:28 smithi194 ceph-mon[130905]: Deploying daemon mds.l on smithi194 2023-08-11T12:21:28.676 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:28 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2842314396' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:21:28.676 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:28 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/72967948' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:21:28.676 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:28 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3363813178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:28.677 INFO:journalctl@ceph.mds.l.smithi194.stdout:Aug 11 12:21:28 smithi194 systemd[1]: Starting Ceph mds.l for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:21:28.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:28 smithi008 ceph-mon[97158]: Deploying daemon mds.l on smithi194 2023-08-11T12:21:28.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:28 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2842314396' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:21:28.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:28 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/72967948' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:21:28.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:28 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3363813178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:28.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:28 smithi045 ceph-mon[130284]: Deploying daemon mds.l on smithi194 2023-08-11T12:21:28.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:28 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2842314396' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:21:28.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:28 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/72967948' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:21:28.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:28 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3363813178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:29.000 INFO:journalctl@ceph.mds.l.smithi194.stdout:Aug 11 12:21:28 smithi194 podman[155779]: 2023-08-11T12:21:29.000 INFO:journalctl@ceph.mds.l.smithi194.stdout:Aug 11 12:21:28 smithi194 bash[155779]: 83a8d819d5c82c020514c22a38aac4946ed1b241ec8c32a40ceb67e6cbd11053 2023-08-11T12:21:29.001 INFO:journalctl@ceph.mds.l.smithi194.stdout:Aug 11 12:21:28 smithi194 ceph-mds[155820]: -- 172.21.15.194:0/4272519796 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a8b8d7f1e0 con 0x55a8b8d54800 2023-08-11T12:21:29.001 INFO:journalctl@ceph.mds.l.smithi194.stdout:Aug 11 12:21:28 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-l[155795]: starting mds.l at 2023-08-11T12:21:29.393 INFO:journalctl@ceph.mds.l.smithi194.stdout:Aug 11 12:21:29 smithi194 systemd[1]: Started Ceph mds.l for 815f94ae-3840-11ee-9b37-001a4aab830c. 2023-08-11T12:21:29.735 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:29 smithi045 ceph-mon[130284]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:29.735 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:29 smithi045 ceph-mon[130284]: mds.? [v2:172.21.15.194:6832/2043443402,v1:172.21.15.194:6833/2043443402] up:boot 2023-08-11T12:21:29.736 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:29 smithi045 ceph-mon[130284]: fsmap 1 up:standby 2023-08-11T12:21:29.736 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-08-11T12:21:29.736 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:29.737 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:29.737 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:29.737 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:29.737 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:29.737 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:29 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:29.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:29 smithi008 ceph-mon[97158]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:29.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:29 smithi008 ceph-mon[97158]: mds.? [v2:172.21.15.194:6832/2043443402,v1:172.21.15.194:6833/2043443402] up:boot 2023-08-11T12:21:29.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:29 smithi008 ceph-mon[97158]: fsmap 1 up:standby 2023-08-11T12:21:29.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-08-11T12:21:29.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:29.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:29.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:29.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:29.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:29.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:29 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:29.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:29 smithi194 ceph-mon[130905]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:29.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:29 smithi194 ceph-mon[130905]: mds.? [v2:172.21.15.194:6832/2043443402,v1:172.21.15.194:6833/2043443402] up:boot 2023-08-11T12:21:29.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:29 smithi194 ceph-mon[130905]: fsmap 1 up:standby 2023-08-11T12:21:29.896 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-08-11T12:21:29.896 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:29.896 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:29.897 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:29.897 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:29.897 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:29.897 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:29 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:30.460 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-11T12:21:30.659 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:30 smithi045 ceph-mon[130284]: Deploying daemon mds.k on smithi045 2023-08-11T12:21:30.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.673+0000 7f13ec3ff700 1 -- 172.21.15.8:0/2963694132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13e4101bd0 msgr2=0x7f13e4102030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:30.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.673+0000 7f13ec3ff700 1 --2- 172.21.15.8:0/2963694132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13e4101bd0 0x7f13e4102030 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f13d40099c0 tx=0x7f13d4009cd0 comp rx=0 tx=0).stop 2023-08-11T12:21:30.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.673+0000 7f13ec3ff700 1 -- 172.21.15.8:0/2963694132 shutdown_connections 2023-08-11T12:21:30.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.673+0000 7f13ec3ff700 1 --2- 172.21.15.8:0/2963694132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13e41009e0 0x7f13e4100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:30.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.673+0000 7f13ec3ff700 1 --2- 172.21.15.8:0/2963694132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13e4102570 0x7f13e4108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:30.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.673+0000 7f13ec3ff700 1 --2- 172.21.15.8:0/2963694132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13e4101bd0 0x7f13e4102030 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:30.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.673+0000 7f13ec3ff700 1 -- 172.21.15.8:0/2963694132 >> 172.21.15.8:0/2963694132 conn(0x7f13e40fbf50 msgr2=0x7f13e40fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:30.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.673+0000 7f13ec3ff700 1 -- 172.21.15.8:0/2963694132 shutdown_connections 2023-08-11T12:21:30.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.673+0000 7f13ec3ff700 1 -- 172.21.15.8:0/2963694132 wait complete. 2023-08-11T12:21:30.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.674+0000 7f13ec3ff700 1 Processor -- start 2023-08-11T12:21:30.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.675+0000 7f13ec3ff700 1 -- start start 2023-08-11T12:21:30.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.675+0000 7f13ec3ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13e41009e0 0x7f13e41988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:30.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.675+0000 7f13ec3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13e4101bd0 0x7f13e4198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:30.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.675+0000 7f13ec3ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13e4102570 0x7f13e419fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:30.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.675+0000 7f13ec3ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e41a0450 con 0x7f13e4102570 2023-08-11T12:21:30.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.675+0000 7f13ec3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e41a0590 con 0x7f13e4101bd0 2023-08-11T12:21:30.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.675+0000 7f13ec3ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e41a0720 con 0x7f13e41009e0 2023-08-11T12:21:30.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.675+0000 7f13ea99c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13e4102570 0x7f13e419fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:30.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.675+0000 7f13e999a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13e4101bd0 0x7f13e4198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:30.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.675+0000 7f13e999a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13e4101bd0 0x7f13e4198e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:38556/0 (socket says 172.21.15.8:38556) 2023-08-11T12:21:30.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.675+0000 7f13ea99c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13e4102570 0x7f13e419fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55046/0 (socket says 172.21.15.8:55046) 2023-08-11T12:21:30.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.675+0000 7f13e999a700 1 -- 172.21.15.8:0/398853838 learned_addr learned my addr 172.21.15.8:0/398853838 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:21:30.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.675+0000 7f13ea19b700 1 --2- 172.21.15.8:0/398853838 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13e41009e0 0x7f13e41988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:30.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.676+0000 7f13ea99c700 1 -- 172.21.15.8:0/398853838 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13e41009e0 msgr2=0x7f13e41988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:30.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.676+0000 7f13ea99c700 1 --2- 172.21.15.8:0/398853838 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13e41009e0 0x7f13e41988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:30.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.676+0000 7f13ea99c700 1 -- 172.21.15.8:0/398853838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13e4101bd0 msgr2=0x7f13e4198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:30.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.676+0000 7f13ea99c700 1 --2- 172.21.15.8:0/398853838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13e4101bd0 0x7f13e4198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:30.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.676+0000 7f13ea99c700 1 -- 172.21.15.8:0/398853838 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e0009520 con 0x7f13e4102570 2023-08-11T12:21:30.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.676+0000 7f13e999a700 1 --2- 172.21.15.8:0/398853838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13e4101bd0 0x7f13e4198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:21:30.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.676+0000 7f13ea99c700 1 --2- 172.21.15.8:0/398853838 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13e4102570 0x7f13e419fe80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00efc0 tx=0x7f13dc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:30.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.676+0000 7f13db7fe700 1 -- 172.21.15.8:0/398853838 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc018070 con 0x7f13e4102570 2023-08-11T12:21:30.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.676+0000 7f13db7fe700 1 -- 172.21.15.8:0/398853838 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f13dc00f040 con 0x7f13e4102570 2023-08-11T12:21:30.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.676+0000 7f13ec3ff700 1 -- 172.21.15.8:0/398853838 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d40095f0 con 0x7f13e4102570 2023-08-11T12:21:30.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.676+0000 7f13db7fe700 1 -- 172.21.15.8:0/398853838 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc00cd40 con 0x7f13e4102570 2023-08-11T12:21:30.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.676+0000 7f13ec3ff700 1 -- 172.21.15.8:0/398853838 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e41a0d20 con 0x7f13e4102570 2023-08-11T12:21:30.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.677+0000 7f13ec3ff700 1 -- 172.21.15.8:0/398853838 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13e410c240 con 0x7f13e4102570 2023-08-11T12:21:30.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.679+0000 7f13db7fe700 1 -- 172.21.15.8:0/398853838 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f13dc003a00 con 0x7f13e4102570 2023-08-11T12:21:30.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.680+0000 7f13db7fe700 1 --2- 172.21.15.8:0/398853838 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f13d009ffd0 0x7f13d00a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:30.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.681+0000 7f13db7fe700 1 -- 172.21.15.8:0/398853838 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f13dc0ca960 con 0x7f13e4102570 2023-08-11T12:21:30.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.681+0000 7f13ea19b700 1 --2- 172.21.15.8:0/398853838 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f13d009ffd0 0x7f13d00a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:30.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.681+0000 7f13ea19b700 1 --2- 172.21.15.8:0/398853838 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f13d009ffd0 0x7f13d00a2490 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f13e4101a30 tx=0x7f13e0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:30.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.685+0000 7f13db7fe700 1 -- 172.21.15.8:0/398853838 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f13dc094b80 con 0x7f13e4102570 2023-08-11T12:21:30.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:30 smithi008 ceph-mon[97158]: Deploying daemon mds.k on smithi045 2023-08-11T12:21:30.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:30 smithi194 ceph-mon[130905]: Deploying daemon mds.k on smithi045 2023-08-11T12:21:30.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.943+0000 7f13ec3ff700 1 -- 172.21.15.8:0/398853838 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f13e41a0f40 con 0x7f13e4102570 2023-08-11T12:21:30.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.944+0000 7f13db7fe700 1 -- 172.21.15.8:0/398853838 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1328 (secure 0 0 0) 0x7f13dc01b320 con 0x7f13e4102570 2023-08-11T12:21:30.947 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:21:30.947 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2043443402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2043443402},{"type":"v1","addr":"172.21.15.194:6833","nonce":2043443402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-08-11T12:21:30.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.947+0000 7f13ec3ff700 1 -- 172.21.15.8:0/398853838 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f13d009ffd0 msgr2=0x7f13d00a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:30.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.947+0000 7f13ec3ff700 1 --2- 172.21.15.8:0/398853838 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f13d009ffd0 0x7f13d00a2490 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f13e4101a30 tx=0x7f13e0009260 comp rx=0 tx=0).stop 2023-08-11T12:21:30.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.947+0000 7f13ec3ff700 1 -- 172.21.15.8:0/398853838 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13e4102570 msgr2=0x7f13e419fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:30.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.947+0000 7f13ec3ff700 1 --2- 172.21.15.8:0/398853838 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13e4102570 0x7f13e419fe80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00efc0 tx=0x7f13dc00c3a0 comp rx=0 tx=0).stop 2023-08-11T12:21:30.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.947+0000 7f13ec3ff700 1 -- 172.21.15.8:0/398853838 shutdown_connections 2023-08-11T12:21:30.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.947+0000 7f13ec3ff700 1 --2- 172.21.15.8:0/398853838 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f13d009ffd0 0x7f13d00a2490 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:30.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.947+0000 7f13ec3ff700 1 --2- 172.21.15.8:0/398853838 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13e41009e0 0x7f13e41988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:30.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.947+0000 7f13ec3ff700 1 --2- 172.21.15.8:0/398853838 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13e4102570 0x7f13e419fe80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:30.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.947+0000 7f13ec3ff700 1 --2- 172.21.15.8:0/398853838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13e4101bd0 0x7f13e4198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:30.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.947+0000 7f13ec3ff700 1 -- 172.21.15.8:0/398853838 >> 172.21.15.8:0/398853838 conn(0x7f13e40fbf50 msgr2=0x7f13e40fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:30.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.947+0000 7f13ec3ff700 1 -- 172.21.15.8:0/398853838 shutdown_connections 2023-08-11T12:21:30.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:30.947+0000 7f13ec3ff700 1 -- 172.21.15.8:0/398853838 wait complete. 2023-08-11T12:21:30.952 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 2 2023-08-11T12:21:30.958 INFO:journalctl@ceph.mds.k.smithi045.stdout:Aug 11 12:21:30 smithi045 systemd[1]: Starting Ceph mds.k for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:21:31.251 INFO:journalctl@ceph.mds.k.smithi045.stdout:Aug 11 12:21:30 smithi045 podman[154594]: 2023-08-11T12:21:31.251 INFO:journalctl@ceph.mds.k.smithi045.stdout:Aug 11 12:21:31 smithi045 bash[154594]: a245f51d41c66937de5f31e1d0cc23e9be3ee5f752ee2b667ff7c0934bd100d1 2023-08-11T12:21:31.252 INFO:journalctl@ceph.mds.k.smithi045.stdout:Aug 11 12:21:31 smithi045 ceph-mds[154634]: -- 172.21.15.45:0/1333256454 <== mon.2 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a0f33331e0 con 0x55a0f3308800 2023-08-11T12:21:31.252 INFO:journalctl@ceph.mds.k.smithi045.stdout:Aug 11 12:21:31 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-k[154610]: starting mds.k at 2023-08-11T12:21:31.645 INFO:journalctl@ceph.mds.k.smithi045.stdout:Aug 11 12:21:31 smithi045 systemd[1]: Started Ceph mds.k for 815f94ae-3840-11ee-9b37-001a4aab830c. 2023-08-11T12:21:31.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:31 smithi045 ceph-mon[130284]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:31.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:31 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/398853838' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:31.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:31 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:31.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:31 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:31.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:31 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:31.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:31 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:31.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:31 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:31.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:31 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:31.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:31 smithi008 ceph-mon[97158]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:31.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:31 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/398853838' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:31.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:31 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:31.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:31 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:31.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:31 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:31.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:31 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:31.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:31 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:31.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:31 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:31.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:31 smithi194 ceph-mon[130905]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:31.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:31 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/398853838' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:31.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:31 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:31.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:31 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:31.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:31 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:31.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:31 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:31.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:31 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:31.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:31 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:32.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:32 smithi008 ceph-mon[97158]: Deploying daemon mds.j on smithi008 2023-08-11T12:21:32.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:32 smithi008 ceph-mon[97158]: mds.? [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] up:boot 2023-08-11T12:21:32.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:32 smithi008 ceph-mon[97158]: fsmap 2 up:standby 2023-08-11T12:21:32.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:32 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-08-11T12:21:32.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:32 smithi194 ceph-mon[130905]: Deploying daemon mds.j on smithi008 2023-08-11T12:21:32.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:32 smithi194 ceph-mon[130905]: mds.? [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] up:boot 2023-08-11T12:21:32.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:32 smithi194 ceph-mon[130905]: fsmap 2 up:standby 2023-08-11T12:21:32.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:32 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-08-11T12:21:32.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:32 smithi045 ceph-mon[130284]: Deploying daemon mds.j on smithi008 2023-08-11T12:21:32.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:32 smithi045 ceph-mon[130284]: mds.? [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] up:boot 2023-08-11T12:21:32.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:32 smithi045 ceph-mon[130284]: fsmap 2 up:standby 2023-08-11T12:21:32.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:32 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-08-11T12:21:32.970 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-11T12:21:33.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.199+0000 7fabaf1ff700 1 -- 172.21.15.8:0/2204621380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faba810cfb0 msgr2=0x7faba810f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:33.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.199+0000 7fabaf1ff700 1 --2- 172.21.15.8:0/2204621380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faba810cfb0 0x7faba810f3a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7faba000b0a0 tx=0x7faba000b3b0 comp rx=0 tx=0).stop 2023-08-11T12:21:33.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.199+0000 7fabaf1ff700 1 -- 172.21.15.8:0/2204621380 shutdown_connections 2023-08-11T12:21:33.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.199+0000 7fabaf1ff700 1 --2- 172.21.15.8:0/2204621380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faba810cfb0 0x7faba810f3a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:33.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.199+0000 7fabaf1ff700 1 --2- 172.21.15.8:0/2204621380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faba8074960 0x7faba8072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:33.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.199+0000 7fabaf1ff700 1 --2- 172.21.15.8:0/2204621380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faba8073380 0x7faba8073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:33.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.199+0000 7fabaf1ff700 1 -- 172.21.15.8:0/2204621380 >> 172.21.15.8:0/2204621380 conn(0x7faba80fbf50 msgr2=0x7faba80fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:33.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.199+0000 7fabaf1ff700 1 -- 172.21.15.8:0/2204621380 shutdown_connections 2023-08-11T12:21:33.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.199+0000 7fabaf1ff700 1 -- 172.21.15.8:0/2204621380 wait complete. 2023-08-11T12:21:33.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.200+0000 7fabaf1ff700 1 Processor -- start 2023-08-11T12:21:33.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.201+0000 7fabaf1ff700 1 -- start start 2023-08-11T12:21:33.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.201+0000 7fabaf1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faba8073380 0x7faba819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:33.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.201+0000 7fabaf1ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faba8074960 0x7faba819d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:33.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.201+0000 7fabaf1ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faba810cfb0 0x7faba81a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:33.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.201+0000 7fabaf1ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba81a4940 con 0x7faba8074960 2023-08-11T12:21:33.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.201+0000 7fabaf1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba81a4a80 con 0x7faba8073380 2023-08-11T12:21:33.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.201+0000 7fabaf1ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba81a4c10 con 0x7faba810cfb0 2023-08-11T12:21:33.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.202+0000 7faba7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faba8074960 0x7faba819d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:33.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.202+0000 7fabacf9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faba8073380 0x7faba819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:33.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.202+0000 7fabacf9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faba8073380 0x7faba819cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:38568/0 (socket says 172.21.15.8:38568) 2023-08-11T12:21:33.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.202+0000 7fabacf9b700 1 -- 172.21.15.8:0/4050460860 learned_addr learned my addr 172.21.15.8:0/4050460860 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:21:33.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.202+0000 7fabad79c700 1 --2- 172.21.15.8:0/4050460860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faba810cfb0 0x7faba81a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:33.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.202+0000 7faba7fff700 1 -- 172.21.15.8:0/4050460860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faba810cfb0 msgr2=0x7faba81a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:33.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.202+0000 7faba7fff700 1 --2- 172.21.15.8:0/4050460860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faba810cfb0 0x7faba81a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:33.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.202+0000 7faba7fff700 1 -- 172.21.15.8:0/4050460860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faba8073380 msgr2=0x7faba819cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:33.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.202+0000 7faba7fff700 1 --2- 172.21.15.8:0/4050460860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faba8073380 0x7faba819cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:33.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.202+0000 7faba7fff700 1 -- 172.21.15.8:0/4050460860 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba0009d00 con 0x7faba8074960 2023-08-11T12:21:33.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.202+0000 7fabacf9b700 1 --2- 172.21.15.8:0/4050460860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faba8073380 0x7faba819cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:21:33.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.202+0000 7faba7fff700 1 --2- 172.21.15.8:0/4050460860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faba8074960 0x7faba819d300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fab9400e9c0 tx=0x7fab9400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:33.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.203+0000 7faba5ffb700 1 -- 172.21.15.8:0/4050460860 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab94004220 con 0x7faba8074960 2023-08-11T12:21:33.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.203+0000 7faba5ffb700 1 -- 172.21.15.8:0/4050460860 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fab94004380 con 0x7faba8074960 2023-08-11T12:21:33.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.203+0000 7fabaf1ff700 1 -- 172.21.15.8:0/4050460860 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba81a4ef0 con 0x7faba8074960 2023-08-11T12:21:33.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.203+0000 7faba5ffb700 1 -- 172.21.15.8:0/4050460860 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab94003be0 con 0x7faba8074960 2023-08-11T12:21:33.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.203+0000 7fabaf1ff700 1 -- 172.21.15.8:0/4050460860 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba81a5370 con 0x7faba8074960 2023-08-11T12:21:33.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.204+0000 7fabaf1ff700 1 -- 172.21.15.8:0/4050460860 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba8102b00 con 0x7faba8074960 2023-08-11T12:21:33.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.206+0000 7faba5ffb700 1 -- 172.21.15.8:0/4050460860 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fab94003d40 con 0x7faba8074960 2023-08-11T12:21:33.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.207+0000 7faba5ffb700 1 --2- 172.21.15.8:0/4050460860 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fab9809ff50 0x7fab980a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:33.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.208+0000 7faba5ffb700 1 -- 172.21.15.8:0/4050460860 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fab94014070 con 0x7faba8074960 2023-08-11T12:21:33.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.208+0000 7fabacf9b700 1 --2- 172.21.15.8:0/4050460860 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fab9809ff50 0x7fab980a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:33.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.208+0000 7fabacf9b700 1 --2- 172.21.15.8:0/4050460860 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fab9809ff50 0x7fab980a2410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fab9c011550 tx=0x7fab9c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:33.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.211+0000 7faba5ffb700 1 -- 172.21.15.8:0/4050460860 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fab94095200 con 0x7faba8074960 2023-08-11T12:21:33.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.503+0000 7fabaf1ff700 1 -- 172.21.15.8:0/4050460860 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faba81127d0 con 0x7faba8074960 2023-08-11T12:21:33.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.504+0000 7faba5ffb700 1 -- 172.21.15.8:0/4050460860 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2119 (secure 0 0 0) 0x7fab94098820 con 0x7faba8074960 2023-08-11T12:21:33.507 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:21:33.507 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2043443402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2043443402},{"type":"v1","addr":"172.21.15.194:6833","nonce":2043443402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1208864615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1208864615},{"type":"v1","addr":"172.21.15.45:6833","nonce":1208864615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-08-11T12:21:33.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.506+0000 7fabaf1ff700 1 -- 172.21.15.8:0/4050460860 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fab9809ff50 msgr2=0x7fab980a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:33.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.506+0000 7fabaf1ff700 1 --2- 172.21.15.8:0/4050460860 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fab9809ff50 0x7fab980a2410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fab9c011550 tx=0x7fab9c009260 comp rx=0 tx=0).stop 2023-08-11T12:21:33.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.506+0000 7fabaf1ff700 1 -- 172.21.15.8:0/4050460860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faba8074960 msgr2=0x7faba819d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:33.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.506+0000 7fabaf1ff700 1 --2- 172.21.15.8:0/4050460860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faba8074960 0x7faba819d300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fab9400e9c0 tx=0x7fab9400ecd0 comp rx=0 tx=0).stop 2023-08-11T12:21:33.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.506+0000 7fabaf1ff700 1 -- 172.21.15.8:0/4050460860 shutdown_connections 2023-08-11T12:21:33.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.506+0000 7fabaf1ff700 1 --2- 172.21.15.8:0/4050460860 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fab9809ff50 0x7fab980a2410 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:33.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.506+0000 7fabaf1ff700 1 --2- 172.21.15.8:0/4050460860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faba810cfb0 0x7faba81a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:33.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.506+0000 7fabaf1ff700 1 --2- 172.21.15.8:0/4050460860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faba8073380 0x7faba819cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:33.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.506+0000 7fabaf1ff700 1 --2- 172.21.15.8:0/4050460860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faba8074960 0x7faba819d300 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:33.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.506+0000 7fabaf1ff700 1 -- 172.21.15.8:0/4050460860 >> 172.21.15.8:0/4050460860 conn(0x7faba80fbf50 msgr2=0x7faba80fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:33.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.506+0000 7fabaf1ff700 1 -- 172.21.15.8:0/4050460860 shutdown_connections 2023-08-11T12:21:33.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:33.507+0000 7fabaf1ff700 1 -- 172.21.15.8:0/4050460860 wait complete. 2023-08-11T12:21:33.511 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 3 2023-08-11T12:21:33.638 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:33 smithi008 ceph-mon[97158]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:33.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:33 smithi194 ceph-mon[130905]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:33.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:33 smithi045 ceph-mon[130284]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:34.053 INFO:journalctl@ceph.mds.j.smithi008.stdout:Aug 11 12:21:33 smithi008 systemd[1]: Starting Ceph mds.j for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:21:34.369 INFO:journalctl@ceph.mds.j.smithi008.stdout:Aug 11 12:21:34 smithi008 podman[130284]: 2023-08-11T12:21:34.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:34 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/4050460860' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:34.803 INFO:journalctl@ceph.mds.j.smithi008.stdout:Aug 11 12:21:34 smithi008 ceph-mds[130324]: -- 172.21.15.8:0/1127454888 <== mon.0 v2:172.21.15.8:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559f3b5391e0 con 0x559f3b50ec00 2023-08-11T12:21:34.804 INFO:journalctl@ceph.mds.j.smithi008.stdout:Aug 11 12:21:34 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-j[130300]: starting mds.j at 2023-08-11T12:21:34.804 INFO:journalctl@ceph.mds.j.smithi008.stdout:Aug 11 12:21:34 smithi008 bash[130284]: c15de7f911dad1a1337380b5d7ced7913b603a13244b6879541652ec28ec7e30 2023-08-11T12:21:34.804 INFO:journalctl@ceph.mds.j.smithi008.stdout:Aug 11 12:21:34 smithi008 systemd[1]: Started Ceph mds.j for 815f94ae-3840-11ee-9b37-001a4aab830c. 2023-08-11T12:21:34.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:34 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/4050460860' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:34.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:34 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/4050460860' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:35.530 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-11T12:21:35.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.755+0000 7fe8193ff700 1 -- 172.21.15.8:0/2768060725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8140ffc00 msgr2=0x7fe814100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:35.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.755+0000 7fe8193ff700 1 --2- 172.21.15.8:0/2768060725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8140ffc00 0x7fe814100080 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe8080099c0 tx=0x7fe808009cd0 comp rx=0 tx=0).stop 2023-08-11T12:21:35.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.755+0000 7fe8193ff700 1 -- 172.21.15.8:0/2768060725 shutdown_connections 2023-08-11T12:21:35.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.755+0000 7fe8193ff700 1 --2- 172.21.15.8:0/2768060725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8140ff2a0 0x7fe8140ff6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:35.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.755+0000 7fe8193ff700 1 --2- 172.21.15.8:0/2768060725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8141005c0 0x7fe814100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:35.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.755+0000 7fe8193ff700 1 --2- 172.21.15.8:0/2768060725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8140ffc00 0x7fe814100080 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:35.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.755+0000 7fe8193ff700 1 -- 172.21.15.8:0/2768060725 >> 172.21.15.8:0/2768060725 conn(0x7fe8140fae60 msgr2=0x7fe8140fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:35.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.755+0000 7fe8193ff700 1 -- 172.21.15.8:0/2768060725 shutdown_connections 2023-08-11T12:21:35.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.755+0000 7fe8193ff700 1 -- 172.21.15.8:0/2768060725 wait complete. 2023-08-11T12:21:35.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.757+0000 7fe8193ff700 1 Processor -- start 2023-08-11T12:21:35.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.757+0000 7fe8193ff700 1 -- start start 2023-08-11T12:21:35.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.758+0000 7fe8193ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8140ff2a0 0x7fe8141988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:35.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.758+0000 7fe8193ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8140ffc00 0x7fe814198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:35.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.758+0000 7fe8193ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8141005c0 0x7fe81419fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:35.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.758+0000 7fe8193ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8141a0430 con 0x7fe8140ffc00 2023-08-11T12:21:35.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.758+0000 7fe8193ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8141a0570 con 0x7fe8141005c0 2023-08-11T12:21:35.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.758+0000 7fe8193ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8141a0700 con 0x7fe8140ff2a0 2023-08-11T12:21:35.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.758+0000 7fe8127fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8140ffc00 0x7fe814198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:35.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.758+0000 7fe812ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8140ff2a0 0x7fe8141988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:35.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.758+0000 7fe812ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8140ff2a0 0x7fe8141988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:41412/0 (socket says 172.21.15.8:41412) 2023-08-11T12:21:35.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.758+0000 7fe812ffd700 1 -- 172.21.15.8:0/1508019509 learned_addr learned my addr 172.21.15.8:0/1508019509 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:21:35.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.758+0000 7fe8127fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8140ffc00 0x7fe814198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55102/0 (socket says 172.21.15.8:55102) 2023-08-11T12:21:35.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.758+0000 7fe8137fe700 1 --2- 172.21.15.8:0/1508019509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8141005c0 0x7fe81419fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:35.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.758+0000 7fe812ffd700 1 -- 172.21.15.8:0/1508019509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8141005c0 msgr2=0x7fe81419fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:35.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.758+0000 7fe812ffd700 1 --2- 172.21.15.8:0/1508019509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8141005c0 0x7fe81419fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:35.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.758+0000 7fe812ffd700 1 -- 172.21.15.8:0/1508019509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8140ffc00 msgr2=0x7fe814198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:35.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.758+0000 7fe812ffd700 1 --2- 172.21.15.8:0/1508019509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8140ffc00 0x7fe814198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:35.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.758+0000 7fe812ffd700 1 -- 172.21.15.8:0/1508019509 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8080095f0 con 0x7fe8140ff2a0 2023-08-11T12:21:35.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.758+0000 7fe8137fe700 1 --2- 172.21.15.8:0/1508019509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8141005c0 0x7fe81419fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:21:35.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.758+0000 7fe8127fc700 1 --2- 172.21.15.8:0/1508019509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8140ffc00 0x7fe814198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:21:35.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.759+0000 7fe812ffd700 1 --2- 172.21.15.8:0/1508019509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8140ff2a0 0x7fe8141988b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe80400e9a0 tx=0x7fe80400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:35.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.759+0000 7fe7fbfff700 1 -- 172.21.15.8:0/1508019509 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe804009790 con 0x7fe8140ff2a0 2023-08-11T12:21:35.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.759+0000 7fe7fbfff700 1 -- 172.21.15.8:0/1508019509 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe80400cbd0 con 0x7fe8140ff2a0 2023-08-11T12:21:35.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.759+0000 7fe8193ff700 1 -- 172.21.15.8:0/1508019509 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8141a09e0 con 0x7fe8140ff2a0 2023-08-11T12:21:35.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.759+0000 7fe7fbfff700 1 -- 172.21.15.8:0/1508019509 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe804018680 con 0x7fe8140ff2a0 2023-08-11T12:21:35.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.759+0000 7fe8193ff700 1 -- 172.21.15.8:0/1508019509 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8141a0ef0 con 0x7fe8140ff2a0 2023-08-11T12:21:35.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.760+0000 7fe8193ff700 1 -- 172.21.15.8:0/1508019509 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe81410a080 con 0x7fe8140ff2a0 2023-08-11T12:21:35.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.762+0000 7fe7fbfff700 1 -- 172.21.15.8:0/1508019509 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fe80400cd40 con 0x7fe8140ff2a0 2023-08-11T12:21:35.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.763+0000 7fe7fbfff700 1 --2- 172.21.15.8:0/1508019509 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe7fc09ff50 0x7fe7fc0a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:35.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.764+0000 7fe7fbfff700 1 -- 172.21.15.8:0/1508019509 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe804014070 con 0x7fe8140ff2a0 2023-08-11T12:21:35.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.764+0000 7fe8127fc700 1 --2- 172.21.15.8:0/1508019509 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe7fc09ff50 0x7fe7fc0a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:35.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.764+0000 7fe8127fc700 1 --2- 172.21.15.8:0/1508019509 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe7fc09ff50 0x7fe7fc0a2410 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe80800b580 tx=0x7fe80801a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:35.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:35.766+0000 7fe7fbfff700 1 -- 172.21.15.8:0/1508019509 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fe804095310 con 0x7fe8140ff2a0 2023-08-11T12:21:35.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:35 smithi008 ceph-mon[97158]: mds.? [v2:172.21.15.8:6834/2854286216,v1:172.21.15.8:6835/2854286216] up:boot 2023-08-11T12:21:35.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:35 smithi008 ceph-mon[97158]: fsmap 3 up:standby 2023-08-11T12:21:35.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:35 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-08-11T12:21:35.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:35 smithi008 ceph-mon[97158]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:35.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:35 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:35.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:35 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:35.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:35 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:35.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:35 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:35.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:35 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:35.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:35 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:35.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:35 smithi194 ceph-mon[130905]: mds.? [v2:172.21.15.8:6834/2854286216,v1:172.21.15.8:6835/2854286216] up:boot 2023-08-11T12:21:35.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:35 smithi194 ceph-mon[130905]: fsmap 3 up:standby 2023-08-11T12:21:35.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:35 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-08-11T12:21:35.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:35 smithi194 ceph-mon[130905]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:35.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:35 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:35.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:35 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:35.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:35 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:35.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:35 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:35.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:35 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:35.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:35 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:35.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:35 smithi045 ceph-mon[130284]: mds.? [v2:172.21.15.8:6834/2854286216,v1:172.21.15.8:6835/2854286216] up:boot 2023-08-11T12:21:35.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:35 smithi045 ceph-mon[130284]: fsmap 3 up:standby 2023-08-11T12:21:35.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:35 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-08-11T12:21:35.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:35 smithi045 ceph-mon[130284]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:35.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:35 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:35.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:35 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:35.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:35 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:35.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:35 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:35.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:35 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:35.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:35 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:36.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:36.033+0000 7fe8193ff700 1 -- 172.21.15.8:0/1508019509 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe81410e410 con 0x7fe8140ff2a0 2023-08-11T12:21:36.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:36.034+0000 7fe7fbfff700 1 -- 172.21.15.8:0/1508019509 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2907 (secure 0 0 0) 0x7fe804098930 con 0x7fe8140ff2a0 2023-08-11T12:21:36.081 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:21:36.081 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14469,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2854286216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2854286216},{"type":"v1","addr":"172.21.15.8:6835","nonce":2854286216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2043443402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2043443402},{"type":"v1","addr":"172.21.15.194:6833","nonce":2043443402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1208864615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1208864615},{"type":"v1","addr":"172.21.15.45:6833","nonce":1208864615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-08-11T12:21:36.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:36.037+0000 7fe8193ff700 1 -- 172.21.15.8:0/1508019509 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe7fc09ff50 msgr2=0x7fe7fc0a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:36.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:36.037+0000 7fe8193ff700 1 --2- 172.21.15.8:0/1508019509 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe7fc09ff50 0x7fe7fc0a2410 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe80800b580 tx=0x7fe80801a040 comp rx=0 tx=0).stop 2023-08-11T12:21:36.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:36.037+0000 7fe8193ff700 1 -- 172.21.15.8:0/1508019509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8140ff2a0 msgr2=0x7fe8141988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:36.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:36.037+0000 7fe8193ff700 1 --2- 172.21.15.8:0/1508019509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8140ff2a0 0x7fe8141988b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe80400e9a0 tx=0x7fe80400ecb0 comp rx=0 tx=0).stop 2023-08-11T12:21:36.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:36.037+0000 7fe8193ff700 1 -- 172.21.15.8:0/1508019509 shutdown_connections 2023-08-11T12:21:36.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:36.037+0000 7fe8193ff700 1 --2- 172.21.15.8:0/1508019509 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe7fc09ff50 0x7fe7fc0a2410 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:36.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:36.037+0000 7fe8193ff700 1 --2- 172.21.15.8:0/1508019509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8140ff2a0 0x7fe8141988b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:36.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:36.037+0000 7fe8193ff700 1 --2- 172.21.15.8:0/1508019509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8141005c0 0x7fe81419fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:36.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:36.037+0000 7fe8193ff700 1 --2- 172.21.15.8:0/1508019509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8140ffc00 0x7fe814198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:36.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:36.037+0000 7fe8193ff700 1 -- 172.21.15.8:0/1508019509 >> 172.21.15.8:0/1508019509 conn(0x7fe8140fae60 msgr2=0x7fe8140fcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:36.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:36.037+0000 7fe8193ff700 1 -- 172.21.15.8:0/1508019509 shutdown_connections 2023-08-11T12:21:36.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:36.037+0000 7fe8193ff700 1 -- 172.21.15.8:0/1508019509 wait complete. 2023-08-11T12:21:36.084 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 4 2023-08-11T12:21:36.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:36 smithi008 ceph-mon[97158]: Deploying daemon mds.d on smithi008 2023-08-11T12:21:36.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:36 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1508019509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:36.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:36 smithi194 ceph-mon[130905]: Deploying daemon mds.d on smithi008 2023-08-11T12:21:36.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:36 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1508019509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:36.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:36 smithi045 ceph-mon[130284]: Deploying daemon mds.d on smithi008 2023-08-11T12:21:36.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:36 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1508019509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:37.303 INFO:journalctl@ceph.mds.d.smithi008.stdout:Aug 11 12:21:36 smithi008 systemd[1]: Starting Ceph mds.d for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:21:37.568 INFO:journalctl@ceph.mds.d.smithi008.stdout:Aug 11 12:21:37 smithi008 podman[130671]: 2023-08-11T12:21:37.568 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:37 smithi008 ceph-mon[97158]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:37.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:37 smithi194 ceph-mon[130905]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:37.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:37 smithi045 ceph-mon[130284]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:38.053 INFO:journalctl@ceph.mds.d.smithi008.stdout:Aug 11 12:21:37 smithi008 bash[130671]: 4432a53902eb839580c0a2dcc07be8bd5b8b99b830539a84832b6496334e6b14 2023-08-11T12:21:38.053 INFO:journalctl@ceph.mds.d.smithi008.stdout:Aug 11 12:21:37 smithi008 ceph-mds[130719]: -- 172.21.15.8:0/1247826993 <== mon.2 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559f5d6191e0 con 0x559f5d5ee800 2023-08-11T12:21:38.054 INFO:journalctl@ceph.mds.d.smithi008.stdout:Aug 11 12:21:37 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-d[130692]: starting mds.d at 2023-08-11T12:21:38.054 INFO:journalctl@ceph.mds.d.smithi008.stdout:Aug 11 12:21:37 smithi008 systemd[1]: Started Ceph mds.d for 815f94ae-3840-11ee-9b37-001a4aab830c. 2023-08-11T12:21:38.085 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-11T12:21:38.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.297+0000 7f38ee7ff700 1 -- 172.21.15.8:0/2696566872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38e8074960 msgr2=0x7f38e8072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:38.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.297+0000 7f38ee7ff700 1 --2- 172.21.15.8:0/2696566872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38e8074960 0x7f38e8072db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f38d80098f0 tx=0x7f38d8009c00 comp rx=0 tx=0).stop 2023-08-11T12:21:38.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.297+0000 7f38ee7ff700 1 -- 172.21.15.8:0/2696566872 shutdown_connections 2023-08-11T12:21:38.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.297+0000 7f38ee7ff700 1 --2- 172.21.15.8:0/2696566872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38e81088b0 0x7f38e810ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:38.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.297+0000 7f38ee7ff700 1 --2- 172.21.15.8:0/2696566872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38e8074960 0x7f38e8072db0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:38.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.297+0000 7f38ee7ff700 1 --2- 172.21.15.8:0/2696566872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38e8073380 0x7f38e8073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:38.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.297+0000 7f38ee7ff700 1 -- 172.21.15.8:0/2696566872 >> 172.21.15.8:0/2696566872 conn(0x7f38e80fbf80 msgr2=0x7f38e80fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:38.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.297+0000 7f38ee7ff700 1 -- 172.21.15.8:0/2696566872 shutdown_connections 2023-08-11T12:21:38.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.297+0000 7f38ee7ff700 1 -- 172.21.15.8:0/2696566872 wait complete. 2023-08-11T12:21:38.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.298+0000 7f38ee7ff700 1 Processor -- start 2023-08-11T12:21:38.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.298+0000 7f38ee7ff700 1 -- start start 2023-08-11T12:21:38.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.299+0000 7f38ee7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38e8073380 0x7f38e8103d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:38.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.299+0000 7f38ee7ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38e8074960 0x7f38e8104250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:38.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.299+0000 7f38ee7ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38e81088b0 0x7f38e81008a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:38.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.299+0000 7f38ee7ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e8101040 con 0x7f38e8074960 2023-08-11T12:21:38.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.299+0000 7f38ee7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e81011b0 con 0x7f38e8073380 2023-08-11T12:21:38.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.299+0000 7f38ee7ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e8101370 con 0x7f38e81088b0 2023-08-11T12:21:38.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.299+0000 7f38e77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38e8074960 0x7f38e8104250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:38.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.299+0000 7f38e7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38e8073380 0x7f38e8103d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:38.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.299+0000 7f38e7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38e8073380 0x7f38e8103d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:59284/0 (socket says 172.21.15.8:59284) 2023-08-11T12:21:38.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.299+0000 7f38e77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38e8074960 0x7f38e8104250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47232/0 (socket says 172.21.15.8:47232) 2023-08-11T12:21:38.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.299+0000 7f38e7fff700 1 -- 172.21.15.8:0/1297898307 learned_addr learned my addr 172.21.15.8:0/1297898307 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:21:38.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.299+0000 7f38ecd9c700 1 --2- 172.21.15.8:0/1297898307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38e81088b0 0x7f38e81008a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:38.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.299+0000 7f38e77fe700 1 -- 172.21.15.8:0/1297898307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38e81088b0 msgr2=0x7f38e81008a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:38.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.299+0000 7f38e77fe700 1 --2- 172.21.15.8:0/1297898307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38e81088b0 0x7f38e81008a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:38.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.299+0000 7f38e77fe700 1 -- 172.21.15.8:0/1297898307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38e8073380 msgr2=0x7f38e8103d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:38.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.299+0000 7f38e77fe700 1 --2- 172.21.15.8:0/1297898307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38e8073380 0x7f38e8103d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:38.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.299+0000 7f38e77fe700 1 -- 172.21.15.8:0/1297898307 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e0009d00 con 0x7f38e8074960 2023-08-11T12:21:38.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.299+0000 7f38ecd9c700 1 --2- 172.21.15.8:0/1297898307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38e81088b0 0x7f38e81008a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:21:38.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.300+0000 7f38e77fe700 1 --2- 172.21.15.8:0/1297898307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38e8074960 0x7f38e8104250 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f38dc00e9c0 tx=0x7f38dc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:38.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.300+0000 7f38e57fa700 1 -- 172.21.15.8:0/1297898307 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38dc00cbd0 con 0x7f38e8074960 2023-08-11T12:21:38.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.300+0000 7f38e57fa700 1 -- 172.21.15.8:0/1297898307 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f38dc00eeb0 con 0x7f38e8074960 2023-08-11T12:21:38.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.300+0000 7f38e57fa700 1 -- 172.21.15.8:0/1297898307 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38dc003c70 con 0x7f38e8074960 2023-08-11T12:21:38.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.300+0000 7f38ee7ff700 1 -- 172.21.15.8:0/1297898307 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d8009520 con 0x7f38e8074960 2023-08-11T12:21:38.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.300+0000 7f38ee7ff700 1 -- 172.21.15.8:0/1297898307 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38e81a51b0 con 0x7f38e8074960 2023-08-11T12:21:38.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.301+0000 7f38ee7ff700 1 -- 172.21.15.8:0/1297898307 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38e8106f60 con 0x7f38e8074960 2023-08-11T12:21:38.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.303+0000 7f38e57fa700 1 -- 172.21.15.8:0/1297898307 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f38dc003dd0 con 0x7f38e8074960 2023-08-11T12:21:38.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.305+0000 7f38e57fa700 1 --2- 172.21.15.8:0/1297898307 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f38d009ffd0 0x7f38d00a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:38.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.305+0000 7f38e57fa700 1 -- 172.21.15.8:0/1297898307 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f38dc014070 con 0x7f38e8074960 2023-08-11T12:21:38.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.305+0000 7f38e7fff700 1 --2- 172.21.15.8:0/1297898307 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f38d009ffd0 0x7f38d00a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:38.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.306+0000 7f38e7fff700 1 --2- 172.21.15.8:0/1297898307 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f38d009ffd0 0x7f38d00a2490 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f38d800c010 tx=0x7f38d8019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:38.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.309+0000 7f38e57fa700 1 -- 172.21.15.8:0/1297898307 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f38dc0951d0 con 0x7f38e8074960 2023-08-11T12:21:38.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.566+0000 7f38ee7ff700 1 -- 172.21.15.8:0/1297898307 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38e810e430 con 0x7f38e8074960 2023-08-11T12:21:38.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.567+0000 7f38e57fa700 1 -- 172.21.15.8:0/1297898307 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3692 (secure 0 0 0) 0x7f38dc0987f0 con 0x7f38e8074960 2023-08-11T12:21:38.570 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:21:38.570 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14469,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2854286216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2854286216},{"type":"v1","addr":"172.21.15.8:6835","nonce":2854286216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/805368621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":805368621},{"type":"v1","addr":"172.21.15.8:6837","nonce":805368621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2043443402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2043443402},{"type":"v1","addr":"172.21.15.194:6833","nonce":2043443402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1208864615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1208864615},{"type":"v1","addr":"172.21.15.45:6833","nonce":1208864615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-08-11T12:21:38.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.569+0000 7f38ee7ff700 1 -- 172.21.15.8:0/1297898307 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f38d009ffd0 msgr2=0x7f38d00a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:38.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.569+0000 7f38ee7ff700 1 --2- 172.21.15.8:0/1297898307 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f38d009ffd0 0x7f38d00a2490 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f38d800c010 tx=0x7f38d8019040 comp rx=0 tx=0).stop 2023-08-11T12:21:38.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.569+0000 7f38ee7ff700 1 -- 172.21.15.8:0/1297898307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38e8074960 msgr2=0x7f38e8104250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:38.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.569+0000 7f38ee7ff700 1 --2- 172.21.15.8:0/1297898307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38e8074960 0x7f38e8104250 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f38dc00e9c0 tx=0x7f38dc00ecd0 comp rx=0 tx=0).stop 2023-08-11T12:21:38.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.569+0000 7f38ee7ff700 1 -- 172.21.15.8:0/1297898307 shutdown_connections 2023-08-11T12:21:38.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.569+0000 7f38ee7ff700 1 --2- 172.21.15.8:0/1297898307 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f38d009ffd0 0x7f38d00a2490 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:38.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.569+0000 7f38ee7ff700 1 --2- 172.21.15.8:0/1297898307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38e81088b0 0x7f38e81008a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:38.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.569+0000 7f38ee7ff700 1 --2- 172.21.15.8:0/1297898307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38e8073380 0x7f38e8103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:38.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.569+0000 7f38ee7ff700 1 --2- 172.21.15.8:0/1297898307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38e8074960 0x7f38e8104250 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:38.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.569+0000 7f38ee7ff700 1 -- 172.21.15.8:0/1297898307 >> 172.21.15.8:0/1297898307 conn(0x7f38e80fbf80 msgr2=0x7f38e80fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:38.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.569+0000 7f38ee7ff700 1 -- 172.21.15.8:0/1297898307 shutdown_connections 2023-08-11T12:21:38.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:38.569+0000 7f38ee7ff700 1 -- 172.21.15.8:0/1297898307 wait complete. 2023-08-11T12:21:38.575 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 5 2023-08-11T12:21:38.801 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:38 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:38.802 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:38 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:38.802 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:38 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:38.802 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:38 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:38.802 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:38 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:38.802 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:38 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:38.802 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:38 smithi045 ceph-mon[130284]: Deploying daemon mds.e on smithi045 2023-08-11T12:21:38.803 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:38 smithi045 ceph-mon[130284]: mds.? [v2:172.21.15.8:6836/805368621,v1:172.21.15.8:6837/805368621] up:boot 2023-08-11T12:21:38.803 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:38 smithi045 ceph-mon[130284]: fsmap 4 up:standby 2023-08-11T12:21:38.803 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:38 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-08-11T12:21:38.803 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:38 smithi045 ceph-mon[130284]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:38.803 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:38 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1297898307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:39.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:38 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:39.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:38 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:39.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:38 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:39.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:38 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:39.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:38 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:39.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:38 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:39.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:38 smithi008 ceph-mon[97158]: Deploying daemon mds.e on smithi045 2023-08-11T12:21:39.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:38 smithi008 ceph-mon[97158]: mds.? [v2:172.21.15.8:6836/805368621,v1:172.21.15.8:6837/805368621] up:boot 2023-08-11T12:21:39.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:38 smithi008 ceph-mon[97158]: fsmap 4 up:standby 2023-08-11T12:21:39.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:38 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-08-11T12:21:39.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:38 smithi008 ceph-mon[97158]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:39.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:38 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1297898307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:39.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:38 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:39.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:38 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:39.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:38 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:39.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:38 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:39.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:38 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:39.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:38 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:39.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:38 smithi194 ceph-mon[130905]: Deploying daemon mds.e on smithi045 2023-08-11T12:21:39.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:38 smithi194 ceph-mon[130905]: mds.? [v2:172.21.15.8:6836/805368621,v1:172.21.15.8:6837/805368621] up:boot 2023-08-11T12:21:39.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:38 smithi194 ceph-mon[130905]: fsmap 4 up:standby 2023-08-11T12:21:39.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:38 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-08-11T12:21:39.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:38 smithi194 ceph-mon[130905]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:39.146 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:38 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1297898307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:39.741 INFO:journalctl@ceph.mds.e.smithi045.stdout:Aug 11 12:21:39 smithi045 systemd[1]: Starting Ceph mds.e for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:21:40.016 INFO:journalctl@ceph.mds.e.smithi045.stdout:Aug 11 12:21:39 smithi045 podman[154935]: 2023-08-11T12:21:40.016 INFO:journalctl@ceph.mds.e.smithi045.stdout:Aug 11 12:21:39 smithi045 ceph-mds[154975]: -- 172.21.15.45:0/3453217896 <== mon.2 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55752e3711e0 con 0x55752e346c00 2023-08-11T12:21:40.017 INFO:journalctl@ceph.mds.e.smithi045.stdout:Aug 11 12:21:39 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-e[154951]: starting mds.e at 2023-08-11T12:21:40.395 INFO:journalctl@ceph.mds.e.smithi045.stdout:Aug 11 12:21:40 smithi045 bash[154935]: 648230d0bb9f393a4742653b4081adf661113226444b3ef0ba70d84c8ab87199 2023-08-11T12:21:40.395 INFO:journalctl@ceph.mds.e.smithi045.stdout:Aug 11 12:21:40 smithi045 systemd[1]: Started Ceph mds.e for 815f94ae-3840-11ee-9b37-001a4aab830c. 2023-08-11T12:21:40.593 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-11T12:21:40.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.806+0000 7f286b3ff700 1 -- 172.21.15.8:0/7449024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2864102570 msgr2=0x7f2864108e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:40.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.806+0000 7f286b3ff700 1 --2- 172.21.15.8:0/7449024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2864102570 0x7f2864108e20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f285c00b0d0 tx=0x7f285c00b3e0 comp rx=0 tx=0).stop 2023-08-11T12:21:40.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.806+0000 7f286b3ff700 1 -- 172.21.15.8:0/7449024 shutdown_connections 2023-08-11T12:21:40.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.806+0000 7f286b3ff700 1 --2- 172.21.15.8:0/7449024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2864102570 0x7f2864108e20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:40.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.806+0000 7f286b3ff700 1 --2- 172.21.15.8:0/7449024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28641009e0 0x7f2864100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:40.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.806+0000 7f286b3ff700 1 --2- 172.21.15.8:0/7449024 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2864101bd0 0x7f2864102030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:40.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.806+0000 7f286b3ff700 1 -- 172.21.15.8:0/7449024 >> 172.21.15.8:0/7449024 conn(0x7f28640fbf50 msgr2=0x7f28640fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:40.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.806+0000 7f286b3ff700 1 -- 172.21.15.8:0/7449024 shutdown_connections 2023-08-11T12:21:40.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.806+0000 7f286b3ff700 1 -- 172.21.15.8:0/7449024 wait complete. 2023-08-11T12:21:40.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.807+0000 7f286b3ff700 1 Processor -- start 2023-08-11T12:21:40.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.808+0000 7f286b3ff700 1 -- start start 2023-08-11T12:21:40.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.808+0000 7f286b3ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28641009e0 0x7f28640746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:40.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.808+0000 7f286b3ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2864101bd0 0x7f2864072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:40.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.808+0000 7f286b3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2864102570 0x7f2864073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:40.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.808+0000 7f286b3ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28640739f0 con 0x7f28641009e0 2023-08-11T12:21:40.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.808+0000 7f286b3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2864073b60 con 0x7f2864102570 2023-08-11T12:21:40.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.808+0000 7f286b3ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28641a0820 con 0x7f2864101bd0 2023-08-11T12:21:40.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.808+0000 7f286919b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28641009e0 0x7f28640746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:40.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.808+0000 7f286899a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2864101bd0 0x7f2864072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:40.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.808+0000 7f286919b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28641009e0 0x7f28640746d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47248/0 (socket says 172.21.15.8:47248) 2023-08-11T12:21:40.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.808+0000 7f286919b700 1 -- 172.21.15.8:0/3534600465 learned_addr learned my addr 172.21.15.8:0/3534600465 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:21:40.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.808+0000 7f286999c700 1 --2- 172.21.15.8:0/3534600465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2864102570 0x7f2864073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:40.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.808+0000 7f286899a700 1 -- 172.21.15.8:0/3534600465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2864102570 msgr2=0x7f2864073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:40.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.808+0000 7f286899a700 1 --2- 172.21.15.8:0/3534600465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2864102570 0x7f2864073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:40.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.808+0000 7f286899a700 1 -- 172.21.15.8:0/3534600465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28641009e0 msgr2=0x7f28640746d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:40.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.808+0000 7f286899a700 1 --2- 172.21.15.8:0/3534600465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28641009e0 0x7f28640746d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:40.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.808+0000 7f286899a700 1 -- 172.21.15.8:0/3534600465 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2860009520 con 0x7f2864101bd0 2023-08-11T12:21:40.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.809+0000 7f286899a700 1 --2- 172.21.15.8:0/3534600465 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2864101bd0 0x7f2864072d10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f285400e9f0 tx=0x7f285400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:40.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.809+0000 7f285a7fc700 1 -- 172.21.15.8:0/3534600465 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285400c9c0 con 0x7f2864101bd0 2023-08-11T12:21:40.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.809+0000 7f285a7fc700 1 -- 172.21.15.8:0/3534600465 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2854010430 con 0x7f2864101bd0 2023-08-11T12:21:40.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.809+0000 7f286b3ff700 1 -- 172.21.15.8:0/3534600465 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f285c009d00 con 0x7f2864101bd0 2023-08-11T12:21:40.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.809+0000 7f285a7fc700 1 -- 172.21.15.8:0/3534600465 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854018680 con 0x7f2864101bd0 2023-08-11T12:21:40.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.809+0000 7f286b3ff700 1 -- 172.21.15.8:0/3534600465 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28641a0e80 con 0x7f2864101bd0 2023-08-11T12:21:40.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.810+0000 7f286b3ff700 1 -- 172.21.15.8:0/3534600465 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f286410c250 con 0x7f2864101bd0 2023-08-11T12:21:40.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.812+0000 7f285a7fc700 1 -- 172.21.15.8:0/3534600465 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f2854010860 con 0x7f2864101bd0 2023-08-11T12:21:40.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.813+0000 7f285a7fc700 1 --2- 172.21.15.8:0/3534600465 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f285009ff50 0x7f28500a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:40.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.814+0000 7f285a7fc700 1 -- 172.21.15.8:0/3534600465 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2854014070 con 0x7f2864101bd0 2023-08-11T12:21:40.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.814+0000 7f286919b700 1 --2- 172.21.15.8:0/3534600465 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f285009ff50 0x7f28500a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:40.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.814+0000 7f286919b700 1 --2- 172.21.15.8:0/3534600465 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f285009ff50 0x7f28500a2410 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2860005950 tx=0x7f2860009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:40.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:40.815+0000 7f285a7fc700 1 -- 172.21.15.8:0/3534600465 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f2854095060 con 0x7f2864101bd0 2023-08-11T12:21:41.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:41.072+0000 7f286b3ff700 1 -- 172.21.15.8:0/3534600465 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2864107830 con 0x7f2864101bd0 2023-08-11T12:21:41.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:41.073+0000 7f285a7fc700 1 -- 172.21.15.8:0/3534600465 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4483 (secure 0 0 0) 0x7f2854098680 con 0x7f2864101bd0 2023-08-11T12:21:41.076 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:21:41.076 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14469,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2854286216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2854286216},{"type":"v1","addr":"172.21.15.8:6835","nonce":2854286216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/805368621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":805368621},{"type":"v1","addr":"172.21.15.8:6837","nonce":805368621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2043443402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2043443402},{"type":"v1","addr":"172.21.15.194:6833","nonce":2043443402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1208864615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1208864615},{"type":"v1","addr":"172.21.15.45:6833","nonce":1208864615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1776075470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1776075470},{"type":"v1","addr":"172.21.15.45:6835","nonce":1776075470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2023-08-11T12:21:41.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:41.075+0000 7f286b3ff700 1 -- 172.21.15.8:0/3534600465 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f285009ff50 msgr2=0x7f28500a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:41.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:41.075+0000 7f286b3ff700 1 --2- 172.21.15.8:0/3534600465 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f285009ff50 0x7f28500a2410 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2860005950 tx=0x7f2860009260 comp rx=0 tx=0).stop 2023-08-11T12:21:41.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:41.075+0000 7f286b3ff700 1 -- 172.21.15.8:0/3534600465 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2864101bd0 msgr2=0x7f2864072d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:41.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:41.075+0000 7f286b3ff700 1 --2- 172.21.15.8:0/3534600465 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2864101bd0 0x7f2864072d10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f285400e9f0 tx=0x7f285400ed00 comp rx=0 tx=0).stop 2023-08-11T12:21:41.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:41.076+0000 7f286b3ff700 1 -- 172.21.15.8:0/3534600465 shutdown_connections 2023-08-11T12:21:41.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:41.076+0000 7f286b3ff700 1 --2- 172.21.15.8:0/3534600465 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f285009ff50 0x7f28500a2410 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:41.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:41.076+0000 7f286b3ff700 1 --2- 172.21.15.8:0/3534600465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2864102570 0x7f2864073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:41.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:41.076+0000 7f286b3ff700 1 --2- 172.21.15.8:0/3534600465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28641009e0 0x7f28640746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:41.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:41.076+0000 7f286b3ff700 1 --2- 172.21.15.8:0/3534600465 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2864101bd0 0x7f2864072d10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:41.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:41.076+0000 7f286b3ff700 1 -- 172.21.15.8:0/3534600465 >> 172.21.15.8:0/3534600465 conn(0x7f28640fbf50 msgr2=0x7f28640fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:41.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:41.076+0000 7f286b3ff700 1 -- 172.21.15.8:0/3534600465 shutdown_connections 2023-08-11T12:21:41.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:41.076+0000 7f286b3ff700 1 -- 172.21.15.8:0/3534600465 wait complete. 2023-08-11T12:21:41.080 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 6 2023-08-11T12:21:41.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:41 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:41.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:41 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:41.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:41 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:41.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:41 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:41.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:41 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:41.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:41 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:41.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:41 smithi194 ceph-mon[130905]: Deploying daemon mds.f on smithi194 2023-08-11T12:21:41.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:41 smithi194 ceph-mon[130905]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:41.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:41 smithi194 ceph-mon[130905]: mds.? [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] up:boot 2023-08-11T12:21:41.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:41 smithi194 ceph-mon[130905]: fsmap 5 up:standby 2023-08-11T12:21:41.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:41 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-08-11T12:21:41.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:41 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3534600465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:41.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:41 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:41.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:41 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:41.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:41 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:41.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:41 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:41.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:41 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:41.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:41 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:41.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:41 smithi045 ceph-mon[130284]: Deploying daemon mds.f on smithi194 2023-08-11T12:21:41.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:41 smithi045 ceph-mon[130284]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:41.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:41 smithi045 ceph-mon[130284]: mds.? [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] up:boot 2023-08-11T12:21:41.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:41 smithi045 ceph-mon[130284]: fsmap 5 up:standby 2023-08-11T12:21:41.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:41 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-08-11T12:21:41.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:41 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3534600465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:41.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:41 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:41.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:41 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:41.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:41 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:41.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:41 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:41.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:41 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:41.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:41 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:41.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:41 smithi008 ceph-mon[97158]: Deploying daemon mds.f on smithi194 2023-08-11T12:21:41.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:41 smithi008 ceph-mon[97158]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:41.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:41 smithi008 ceph-mon[97158]: mds.? [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] up:boot 2023-08-11T12:21:41.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:41 smithi008 ceph-mon[97158]: fsmap 5 up:standby 2023-08-11T12:21:41.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:41 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-08-11T12:21:41.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:41 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3534600465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:41.644 INFO:journalctl@ceph.mds.f.smithi194.stdout:Aug 11 12:21:41 smithi194 systemd[1]: Starting Ceph mds.f for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:21:42.031 INFO:journalctl@ceph.mds.f.smithi194.stdout:Aug 11 12:21:41 smithi194 podman[156118]: 2023-08-11T12:21:42.032 INFO:journalctl@ceph.mds.f.smithi194.stdout:Aug 11 12:21:42 smithi194 ceph-mds[156158]: -- 172.21.15.194:0/1195392451 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564a63c631e0 con 0x564a63c39000 2023-08-11T12:21:42.032 INFO:journalctl@ceph.mds.f.smithi194.stdout:Aug 11 12:21:42 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-f[156134]: starting mds.f at 2023-08-11T12:21:42.393 INFO:journalctl@ceph.mds.f.smithi194.stdout:Aug 11 12:21:42 smithi194 bash[156118]: 8b284be8960907820fd8de30c13f87814d69e8a6bdf429468e49924ffd7a2b28 2023-08-11T12:21:42.393 INFO:journalctl@ceph.mds.f.smithi194.stdout:Aug 11 12:21:42 smithi194 systemd[1]: Started Ceph mds.f for 815f94ae-3840-11ee-9b37-001a4aab830c. 2023-08-11T12:21:43.100 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-11T12:21:43.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.313+0000 7fd7721ff700 1 -- 172.21.15.8:0/2058000863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd76c101bd0 msgr2=0x7fd76c102030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:43.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.313+0000 7fd7721ff700 1 --2- 172.21.15.8:0/2058000863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd76c101bd0 0x7fd76c102030 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd7600099c0 tx=0x7fd760009cd0 comp rx=0 tx=0).stop 2023-08-11T12:21:43.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.313+0000 7fd7721ff700 1 -- 172.21.15.8:0/2058000863 shutdown_connections 2023-08-11T12:21:43.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.313+0000 7fd7721ff700 1 --2- 172.21.15.8:0/2058000863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd76c1009e0 0x7fd76c100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:43.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.313+0000 7fd7721ff700 1 --2- 172.21.15.8:0/2058000863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd76c102570 0x7fd76c108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:43.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.313+0000 7fd7721ff700 1 --2- 172.21.15.8:0/2058000863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd76c101bd0 0x7fd76c102030 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:43.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.313+0000 7fd7721ff700 1 -- 172.21.15.8:0/2058000863 >> 172.21.15.8:0/2058000863 conn(0x7fd76c0fbf50 msgr2=0x7fd76c0fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:43.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.313+0000 7fd7721ff700 1 -- 172.21.15.8:0/2058000863 shutdown_connections 2023-08-11T12:21:43.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.313+0000 7fd7721ff700 1 -- 172.21.15.8:0/2058000863 wait complete. 2023-08-11T12:21:43.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.314+0000 7fd7721ff700 1 Processor -- start 2023-08-11T12:21:43.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.314+0000 7fd7721ff700 1 -- start start 2023-08-11T12:21:43.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.314+0000 7fd7721ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd76c1009e0 0x7fd76c0746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:43.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.314+0000 7fd7721ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd76c101bd0 0x7fd76c072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:43.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.314+0000 7fd7721ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd76c102570 0x7fd76c073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:43.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.314+0000 7fd7721ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c0739f0 con 0x7fd76c102570 2023-08-11T12:21:43.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.314+0000 7fd7721ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c073b60 con 0x7fd76c1009e0 2023-08-11T12:21:43.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.314+0000 7fd7721ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c1a0710 con 0x7fd76c101bd0 2023-08-11T12:21:43.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.314+0000 7fd76bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd76c102570 0x7fd76c073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:43.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.315+0000 7fd76bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd76c102570 0x7fd76c073250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47270/0 (socket says 172.21.15.8:47270) 2023-08-11T12:21:43.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.315+0000 7fd76bfff700 1 -- 172.21.15.8:0/1928344696 learned_addr learned my addr 172.21.15.8:0/1928344696 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:21:43.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.315+0000 7fd76affd700 1 --2- 172.21.15.8:0/1928344696 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd76c101bd0 0x7fd76c072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:43.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.315+0000 7fd76b7fe700 1 --2- 172.21.15.8:0/1928344696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd76c1009e0 0x7fd76c0746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:43.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.315+0000 7fd76bfff700 1 -- 172.21.15.8:0/1928344696 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd76c101bd0 msgr2=0x7fd76c072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:43.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.315+0000 7fd76bfff700 1 --2- 172.21.15.8:0/1928344696 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd76c101bd0 0x7fd76c072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:43.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.315+0000 7fd76bfff700 1 -- 172.21.15.8:0/1928344696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd76c1009e0 msgr2=0x7fd76c0746d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:43.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.315+0000 7fd76bfff700 1 --2- 172.21.15.8:0/1928344696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd76c1009e0 0x7fd76c0746d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:43.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.315+0000 7fd76bfff700 1 -- 172.21.15.8:0/1928344696 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7600095f0 con 0x7fd76c102570 2023-08-11T12:21:43.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.315+0000 7fd76bfff700 1 --2- 172.21.15.8:0/1928344696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd76c102570 0x7fd76c073250 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd764007ee0 tx=0x7fd76400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:43.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.315+0000 7fd768ff9700 1 -- 172.21.15.8:0/1928344696 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd764017070 con 0x7fd76c102570 2023-08-11T12:21:43.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.315+0000 7fd7721ff700 1 -- 172.21.15.8:0/1928344696 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd76c1a09f0 con 0x7fd76c102570 2023-08-11T12:21:43.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.315+0000 7fd768ff9700 1 -- 172.21.15.8:0/1928344696 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd76400f040 con 0x7fd76c102570 2023-08-11T12:21:43.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.315+0000 7fd768ff9700 1 -- 172.21.15.8:0/1928344696 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd764005580 con 0x7fd76c102570 2023-08-11T12:21:43.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.316+0000 7fd7721ff700 1 -- 172.21.15.8:0/1928344696 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76c1a0eb0 con 0x7fd76c102570 2023-08-11T12:21:43.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.316+0000 7fd7721ff700 1 -- 172.21.15.8:0/1928344696 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd76c10c1f0 con 0x7fd76c102570 2023-08-11T12:21:43.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.318+0000 7fd768ff9700 1 -- 172.21.15.8:0/1928344696 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fd76400db20 con 0x7fd76c102570 2023-08-11T12:21:43.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.320+0000 7fd768ff9700 1 --2- 172.21.15.8:0/1928344696 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd75409ff50 0x7fd7540a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:43.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.320+0000 7fd768ff9700 1 -- 172.21.15.8:0/1928344696 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd7640ca5b0 con 0x7fd76c102570 2023-08-11T12:21:43.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.320+0000 7fd76b7fe700 1 --2- 172.21.15.8:0/1928344696 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd75409ff50 0x7fd7540a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:43.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.321+0000 7fd76b7fe700 1 --2- 172.21.15.8:0/1928344696 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd75409ff50 0x7fd7540a2410 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd76c101a30 tx=0x7fd75c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:43.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.324+0000 7fd768ff9700 1 -- 172.21.15.8:0/1928344696 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fd764094740 con 0x7fd76c102570 2023-08-11T12:21:43.341 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:43 smithi194 ceph-mon[130905]: mds.? [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] up:boot 2023-08-11T12:21:43.341 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:43 smithi194 ceph-mon[130905]: fsmap 6 up:standby 2023-08-11T12:21:43.341 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:43 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-08-11T12:21:43.342 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:43 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:43.342 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:43 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:43.342 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:43 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:43.342 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:43 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:43.342 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:43 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:43.342 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:43 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:43.343 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:43 smithi194 ceph-mon[130905]: Deploying daemon mds.c on smithi194 2023-08-11T12:21:43.343 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:43 smithi194 ceph-mon[130905]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:43.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:43 smithi045 ceph-mon[130284]: mds.? [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] up:boot 2023-08-11T12:21:43.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:43 smithi045 ceph-mon[130284]: fsmap 6 up:standby 2023-08-11T12:21:43.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:43 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-08-11T12:21:43.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:43 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:43.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:43 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:43.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:43 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:43.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:43 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:43.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:43 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:43.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:43 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:43.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:43 smithi045 ceph-mon[130284]: Deploying daemon mds.c on smithi194 2023-08-11T12:21:43.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:43 smithi045 ceph-mon[130284]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:43.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:43 smithi008 ceph-mon[97158]: mds.? [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] up:boot 2023-08-11T12:21:43.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:43 smithi008 ceph-mon[97158]: fsmap 6 up:standby 2023-08-11T12:21:43.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:43 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-08-11T12:21:43.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:43 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:43.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:43 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:43.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:43 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:43.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:43 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:43.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:43 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:43.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:43 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:43.556 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:43 smithi008 ceph-mon[97158]: Deploying daemon mds.c on smithi194 2023-08-11T12:21:43.556 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:43 smithi008 ceph-mon[97158]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:43.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.584+0000 7fd7721ff700 1 -- 172.21.15.8:0/1928344696 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd76c10c400 con 0x7fd76c102570 2023-08-11T12:21:43.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.584+0000 7fd768ff9700 1 -- 172.21.15.8:0/1928344696 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5277 (secure 0 0 0) 0x7fd764097d60 con 0x7fd76c102570 2023-08-11T12:21:43.588 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:21:43.588 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14469,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2854286216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2854286216},{"type":"v1","addr":"172.21.15.8:6835","nonce":2854286216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/805368621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":805368621},{"type":"v1","addr":"172.21.15.8:6837","nonce":805368621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2043443402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2043443402},{"type":"v1","addr":"172.21.15.194:6833","nonce":2043443402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1208864615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1208864615},{"type":"v1","addr":"172.21.15.45:6833","nonce":1208864615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1776075470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1776075470},{"type":"v1","addr":"172.21.15.45:6835","nonce":1776075470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24517,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2457430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2457430285},{"type":"v1","addr":"172.21.15.194:6835","nonce":2457430285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[]} 2023-08-11T12:21:43.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.587+0000 7fd7721ff700 1 -- 172.21.15.8:0/1928344696 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd75409ff50 msgr2=0x7fd7540a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:43.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.587+0000 7fd7721ff700 1 --2- 172.21.15.8:0/1928344696 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd75409ff50 0x7fd7540a2410 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd76c101a30 tx=0x7fd75c009260 comp rx=0 tx=0).stop 2023-08-11T12:21:43.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.587+0000 7fd7721ff700 1 -- 172.21.15.8:0/1928344696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd76c102570 msgr2=0x7fd76c073250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:43.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.587+0000 7fd7721ff700 1 --2- 172.21.15.8:0/1928344696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd76c102570 0x7fd76c073250 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd764007ee0 tx=0x7fd76400d3b0 comp rx=0 tx=0).stop 2023-08-11T12:21:43.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.587+0000 7fd7721ff700 1 -- 172.21.15.8:0/1928344696 shutdown_connections 2023-08-11T12:21:43.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.587+0000 7fd7721ff700 1 --2- 172.21.15.8:0/1928344696 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd75409ff50 0x7fd7540a2410 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:43.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.587+0000 7fd7721ff700 1 --2- 172.21.15.8:0/1928344696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd76c102570 0x7fd76c073250 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:43.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.587+0000 7fd7721ff700 1 --2- 172.21.15.8:0/1928344696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd76c1009e0 0x7fd76c0746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:43.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.587+0000 7fd7721ff700 1 --2- 172.21.15.8:0/1928344696 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd76c101bd0 0x7fd76c072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:43.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.587+0000 7fd7721ff700 1 -- 172.21.15.8:0/1928344696 >> 172.21.15.8:0/1928344696 conn(0x7fd76c0fbf50 msgr2=0x7fd76c0fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:43.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.587+0000 7fd7721ff700 1 -- 172.21.15.8:0/1928344696 shutdown_connections 2023-08-11T12:21:43.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:43.587+0000 7fd7721ff700 1 -- 172.21.15.8:0/1928344696 wait complete. 2023-08-11T12:21:43.592 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 7 2023-08-11T12:21:43.643 INFO:journalctl@ceph.mds.c.smithi194.stdout:Aug 11 12:21:43 smithi194 systemd[1]: Starting Ceph mds.c for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:21:44.143 INFO:journalctl@ceph.mds.c.smithi194.stdout:Aug 11 12:21:43 smithi194 podman[156459]: 2023-08-11T12:21:44.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:44 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1928344696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:44.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:44 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1928344696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:44.643 INFO:journalctl@ceph.mds.c.smithi194.stdout:Aug 11 12:21:44 smithi194 ceph-mds[156499]: -- 172.21.15.194:0/3496588383 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e4d3ccd1e0 con 0x55e4d3ca2c00 2023-08-11T12:21:44.643 INFO:journalctl@ceph.mds.c.smithi194.stdout:Aug 11 12:21:44 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-c[156475]: starting mds.c at 2023-08-11T12:21:44.644 INFO:journalctl@ceph.mds.c.smithi194.stdout:Aug 11 12:21:44 smithi194 bash[156459]: 4b773b9892adfb100d97e9943cd909671eb2dc39052db27364d8c980a92b0d25 2023-08-11T12:21:44.644 INFO:journalctl@ceph.mds.c.smithi194.stdout:Aug 11 12:21:44 smithi194 systemd[1]: Started Ceph mds.c for 815f94ae-3840-11ee-9b37-001a4aab830c. 2023-08-11T12:21:44.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:44 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1928344696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:45.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:45 smithi045 ceph-mon[130284]: mds.? [v2:172.21.15.194:6836/3072808560,v1:172.21.15.194:6837/3072808560] up:boot 2023-08-11T12:21:45.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:45 smithi045 ceph-mon[130284]: fsmap 7 up:standby 2023-08-11T12:21:45.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:45 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-08-11T12:21:45.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:45 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:45.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:45 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:45.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:45 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:45.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:45 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:45.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:45 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:45.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:45 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:45.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:45 smithi045 ceph-mon[130284]: Deploying daemon mds.h on smithi045 2023-08-11T12:21:45.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:45 smithi045 ceph-mon[130284]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:45.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:45 smithi008 ceph-mon[97158]: mds.? [v2:172.21.15.194:6836/3072808560,v1:172.21.15.194:6837/3072808560] up:boot 2023-08-11T12:21:45.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:45 smithi008 ceph-mon[97158]: fsmap 7 up:standby 2023-08-11T12:21:45.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:45 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-08-11T12:21:45.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:45 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:45.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:45 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:45.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:45 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:45.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:45 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:45.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:45 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:45.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:45 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:45.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:45 smithi008 ceph-mon[97158]: Deploying daemon mds.h on smithi045 2023-08-11T12:21:45.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:45 smithi008 ceph-mon[97158]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:45.610 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-11T12:21:45.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:45 smithi194 ceph-mon[130905]: mds.? [v2:172.21.15.194:6836/3072808560,v1:172.21.15.194:6837/3072808560] up:boot 2023-08-11T12:21:45.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:45 smithi194 ceph-mon[130905]: fsmap 7 up:standby 2023-08-11T12:21:45.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:45 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-08-11T12:21:45.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:45 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:45.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:45 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:45.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:45 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:45.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:45 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:45.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:45 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:45.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:45 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:45.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:45 smithi194 ceph-mon[130905]: Deploying daemon mds.h on smithi045 2023-08-11T12:21:45.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:45 smithi194 ceph-mon[130905]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:45.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.822+0000 7f0dce1ff700 1 -- 172.21.15.8:0/4020368520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dc81009e0 msgr2=0x7f0dc8100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:45.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.822+0000 7f0dce1ff700 1 --2- 172.21.15.8:0/4020368520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dc81009e0 0x7f0dc8100e00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0db80099c0 tx=0x7f0db8009cd0 comp rx=0 tx=0).stop 2023-08-11T12:21:45.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.822+0000 7f0dce1ff700 1 -- 172.21.15.8:0/4020368520 shutdown_connections 2023-08-11T12:21:45.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.822+0000 7f0dce1ff700 1 --2- 172.21.15.8:0/4020368520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0dc8102570 0x7f0dc8108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:45.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.822+0000 7f0dce1ff700 1 --2- 172.21.15.8:0/4020368520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dc81009e0 0x7f0dc8100e00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:45.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.822+0000 7f0dce1ff700 1 --2- 172.21.15.8:0/4020368520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dc8101bd0 0x7f0dc8102030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:45.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.822+0000 7f0dce1ff700 1 -- 172.21.15.8:0/4020368520 >> 172.21.15.8:0/4020368520 conn(0x7f0dc80fbf50 msgr2=0x7f0dc80fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:45.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.822+0000 7f0dce1ff700 1 -- 172.21.15.8:0/4020368520 shutdown_connections 2023-08-11T12:21:45.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.822+0000 7f0dce1ff700 1 -- 172.21.15.8:0/4020368520 wait complete. 2023-08-11T12:21:45.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.823+0000 7f0dce1ff700 1 Processor -- start 2023-08-11T12:21:45.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.823+0000 7f0dce1ff700 1 -- start start 2023-08-11T12:21:45.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.824+0000 7f0dce1ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0dc81009e0 0x7f0dc8198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:45.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.824+0000 7f0dce1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dc8101bd0 0x7f0dc8198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:45.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.824+0000 7f0dce1ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dc8102570 0x7f0dc819fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:45.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.824+0000 7f0dce1ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc81a04b0 con 0x7f0dc81009e0 2023-08-11T12:21:45.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.824+0000 7f0dce1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc81a05f0 con 0x7f0dc8101bd0 2023-08-11T12:21:45.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.824+0000 7f0dce1ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc81a0780 con 0x7f0dc8102570 2023-08-11T12:21:45.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.824+0000 7f0dc77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0dc81009e0 0x7f0dc8198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:45.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.824+0000 7f0dc6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dc8101bd0 0x7f0dc8198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:45.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.824+0000 7f0dc6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dc8101bd0 0x7f0dc8198e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:59320/0 (socket says 172.21.15.8:59320) 2023-08-11T12:21:45.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.824+0000 7f0dc6ffd700 1 -- 172.21.15.8:0/3357137695 learned_addr learned my addr 172.21.15.8:0/3357137695 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:21:45.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.824+0000 7f0dc7fff700 1 --2- 172.21.15.8:0/3357137695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dc8102570 0x7f0dc819fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:45.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.824+0000 7f0dc77fe700 1 -- 172.21.15.8:0/3357137695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dc8102570 msgr2=0x7f0dc819fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:45.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.824+0000 7f0dc77fe700 1 --2- 172.21.15.8:0/3357137695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dc8102570 0x7f0dc819fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:45.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.824+0000 7f0dc77fe700 1 -- 172.21.15.8:0/3357137695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dc8101bd0 msgr2=0x7f0dc8198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:45.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.824+0000 7f0dc77fe700 1 --2- 172.21.15.8:0/3357137695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dc8101bd0 0x7f0dc8198e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:45.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.824+0000 7f0dc77fe700 1 -- 172.21.15.8:0/3357137695 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc0009c40 con 0x7f0dc81009e0 2023-08-11T12:21:45.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.824+0000 7f0dc6ffd700 1 --2- 172.21.15.8:0/3357137695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dc8101bd0 0x7f0dc8198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:21:45.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.825+0000 7f0dc77fe700 1 --2- 172.21.15.8:0/3357137695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0dc81009e0 0x7f0dc8198930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0db80098e0 tx=0x7f0db800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:45.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.825+0000 7f0dc4ff9700 1 -- 172.21.15.8:0/3357137695 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db801d070 con 0x7f0dc81009e0 2023-08-11T12:21:45.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.825+0000 7f0dce1ff700 1 -- 172.21.15.8:0/3357137695 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db80095f0 con 0x7f0dc81009e0 2023-08-11T12:21:45.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.825+0000 7f0dc4ff9700 1 -- 172.21.15.8:0/3357137695 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0db8005510 con 0x7f0dc81009e0 2023-08-11T12:21:45.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.825+0000 7f0dc4ff9700 1 -- 172.21.15.8:0/3357137695 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db8004a90 con 0x7f0dc81009e0 2023-08-11T12:21:45.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.825+0000 7f0dce1ff700 1 -- 172.21.15.8:0/3357137695 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc81a0cf0 con 0x7f0dc81009e0 2023-08-11T12:21:45.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.826+0000 7f0dce1ff700 1 -- 172.21.15.8:0/3357137695 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc810c240 con 0x7f0dc81009e0 2023-08-11T12:21:45.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.828+0000 7f0dc4ff9700 1 -- 172.21.15.8:0/3357137695 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f0db800fb80 con 0x7f0dc81009e0 2023-08-11T12:21:45.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.831+0000 7f0dc4ff9700 1 --2- 172.21.15.8:0/3357137695 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0db009ff50 0x7f0db00a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:45.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.831+0000 7f0dc4ff9700 1 -- 172.21.15.8:0/3357137695 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f0db80cbd10 con 0x7f0dc81009e0 2023-08-11T12:21:45.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.831+0000 7f0dc6ffd700 1 --2- 172.21.15.8:0/3357137695 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0db009ff50 0x7f0db00a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:45.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.832+0000 7f0dc6ffd700 1 --2- 172.21.15.8:0/3357137695 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0db009ff50 0x7f0db00a2410 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc011550 tx=0x7f0dbc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:45.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:45.833+0000 7f0dc4ff9700 1 -- 172.21.15.8:0/3357137695 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f0db8095f30 con 0x7f0dc81009e0 2023-08-11T12:21:45.988 INFO:journalctl@ceph.mds.h.smithi045.stdout:Aug 11 12:21:45 smithi045 systemd[1]: Starting Ceph mds.h for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:21:46.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:46.092+0000 7f0dce1ff700 1 -- 172.21.15.8:0/3357137695 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0dc810c400 con 0x7f0dc81009e0 2023-08-11T12:21:46.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:46.092+0000 7f0dc4ff9700 1 -- 172.21.15.8:0/3357137695 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6071 (secure 0 0 0) 0x7f0db8099550 con 0x7f0dc81009e0 2023-08-11T12:21:46.095 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:21:46.095 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14469,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2854286216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2854286216},{"type":"v1","addr":"172.21.15.8:6835","nonce":2854286216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/805368621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":805368621},{"type":"v1","addr":"172.21.15.8:6837","nonce":805368621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2043443402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2043443402},{"type":"v1","addr":"172.21.15.194:6833","nonce":2043443402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1208864615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1208864615},{"type":"v1","addr":"172.21.15.45:6833","nonce":1208864615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1776075470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1776075470},{"type":"v1","addr":"172.21.15.45:6835","nonce":1776075470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24517,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2457430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2457430285},{"type":"v1","addr":"172.21.15.194:6835","nonce":2457430285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24529,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/3072808560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":3072808560},{"type":"v1","addr":"172.21.15.194:6837","nonce":3072808560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2023-08-11T12:21:46.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:46.094+0000 7f0dce1ff700 1 -- 172.21.15.8:0/3357137695 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0db009ff50 msgr2=0x7f0db00a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:46.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:46.094+0000 7f0dce1ff700 1 --2- 172.21.15.8:0/3357137695 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0db009ff50 0x7f0db00a2410 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc011550 tx=0x7f0dbc009260 comp rx=0 tx=0).stop 2023-08-11T12:21:46.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:46.094+0000 7f0dce1ff700 1 -- 172.21.15.8:0/3357137695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0dc81009e0 msgr2=0x7f0dc8198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:46.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:46.094+0000 7f0dce1ff700 1 --2- 172.21.15.8:0/3357137695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0dc81009e0 0x7f0dc8198930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0db80098e0 tx=0x7f0db800f690 comp rx=0 tx=0).stop 2023-08-11T12:21:46.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:46.095+0000 7f0dce1ff700 1 -- 172.21.15.8:0/3357137695 shutdown_connections 2023-08-11T12:21:46.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:46.095+0000 7f0dce1ff700 1 --2- 172.21.15.8:0/3357137695 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0db009ff50 0x7f0db00a2410 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:46.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:46.095+0000 7f0dce1ff700 1 --2- 172.21.15.8:0/3357137695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dc8102570 0x7f0dc819fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:46.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:46.095+0000 7f0dce1ff700 1 --2- 172.21.15.8:0/3357137695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0dc81009e0 0x7f0dc8198930 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:46.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:46.095+0000 7f0dce1ff700 1 --2- 172.21.15.8:0/3357137695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dc8101bd0 0x7f0dc8198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:46.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:46.095+0000 7f0dce1ff700 1 -- 172.21.15.8:0/3357137695 >> 172.21.15.8:0/3357137695 conn(0x7f0dc80fbf50 msgr2=0x7f0dc80fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:46.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:46.095+0000 7f0dce1ff700 1 -- 172.21.15.8:0/3357137695 shutdown_connections 2023-08-11T12:21:46.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:46.095+0000 7f0dce1ff700 1 -- 172.21.15.8:0/3357137695 wait complete. 2023-08-11T12:21:46.100 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2023-08-11T12:21:46.507 INFO:journalctl@ceph.mds.h.smithi045.stdout:Aug 11 12:21:46 smithi045 podman[155272]: 2023-08-11T12:21:46.508 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:46 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3357137695' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:46.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:46 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3357137695' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:46.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:46 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3357137695' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:46.895 INFO:journalctl@ceph.mds.h.smithi045.stdout:Aug 11 12:21:46 smithi045 bash[155272]: 2225f98b5238d6d4452c416ecc867c2d00fd7e85056fb595cef958b036e93e3d 2023-08-11T12:21:46.895 INFO:journalctl@ceph.mds.h.smithi045.stdout:Aug 11 12:21:46 smithi045 ceph-mds[155313]: -- 172.21.15.45:0/2131087325 <== mon.2 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d462faf1e0 con 0x55d462f84800 2023-08-11T12:21:46.895 INFO:journalctl@ceph.mds.h.smithi045.stdout:Aug 11 12:21:46 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-h[155288]: starting mds.h at 2023-08-11T12:21:46.895 INFO:journalctl@ceph.mds.h.smithi045.stdout:Aug 11 12:21:46 smithi045 systemd[1]: Started Ceph mds.h for 815f94ae-3840-11ee-9b37-001a4aab830c. 2023-08-11T12:21:47.573 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:47 smithi194 ceph-mon[130905]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:47.574 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:47 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:47.574 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:47 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:47.574 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:47 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:47.574 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:47 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:47.574 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:47 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:47.574 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:47 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:47.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:47 smithi045 ceph-mon[130284]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:47.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:47 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:47.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:47 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:47.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:47 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:47.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:47 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:47.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:47 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:47.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:47 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:47.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:47 smithi008 ceph-mon[97158]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:47.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:47 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:47.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:47 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:47.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:47 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:47.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:47 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:47.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:47 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:47.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:47 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:48.117 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-11T12:21:48.148 INFO:journalctl@ceph.mds.i.smithi194.stdout:Aug 11 12:21:48 smithi194 systemd[1]: Starting Ceph mds.i for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:21:48.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.330+0000 7f96587ff700 1 -- 172.21.15.8:0/3061960831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96501009e0 msgr2=0x7f9650100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:48.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.330+0000 7f96587ff700 1 --2- 172.21.15.8:0/3061960831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96501009e0 0x7f9650100e00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f964c009990 tx=0x7f964c009ca0 comp rx=0 tx=0).stop 2023-08-11T12:21:48.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.330+0000 7f96587ff700 1 -- 172.21.15.8:0/3061960831 shutdown_connections 2023-08-11T12:21:48.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.330+0000 7f96587ff700 1 --2- 172.21.15.8:0/3061960831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96501009e0 0x7f9650100e00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:48.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.330+0000 7f96587ff700 1 --2- 172.21.15.8:0/3061960831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9650102570 0x7f9650108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:48.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.330+0000 7f96587ff700 1 --2- 172.21.15.8:0/3061960831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9650101bd0 0x7f9650102030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:48.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.330+0000 7f96587ff700 1 -- 172.21.15.8:0/3061960831 >> 172.21.15.8:0/3061960831 conn(0x7f96500fbf50 msgr2=0x7f96500fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:48.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.330+0000 7f96587ff700 1 -- 172.21.15.8:0/3061960831 shutdown_connections 2023-08-11T12:21:48.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.330+0000 7f96587ff700 1 -- 172.21.15.8:0/3061960831 wait complete. 2023-08-11T12:21:48.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.331+0000 7f96587ff700 1 Processor -- start 2023-08-11T12:21:48.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.331+0000 7f96587ff700 1 -- start start 2023-08-11T12:21:48.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.332+0000 7f96587ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96501009e0 0x7f9650198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:48.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.332+0000 7f96587ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9650101bd0 0x7f9650198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:48.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.332+0000 7f96587ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9650102570 0x7f965019fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:48.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.332+0000 7f96587ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96501a0490 con 0x7f96501009e0 2023-08-11T12:21:48.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.332+0000 7f96587ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96501a05d0 con 0x7f9650101bd0 2023-08-11T12:21:48.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.332+0000 7f96587ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96501a0760 con 0x7f9650102570 2023-08-11T12:21:48.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.332+0000 7f965659b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96501009e0 0x7f9650198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:48.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.332+0000 7f965659b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96501009e0 0x7f9650198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59766/0 (socket says 172.21.15.8:59766) 2023-08-11T12:21:48.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.332+0000 7f965659b700 1 -- 172.21.15.8:0/3603160113 learned_addr learned my addr 172.21.15.8:0/3603160113 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:21:48.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.332+0000 7f9656d9c700 1 --2- 172.21.15.8:0/3603160113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9650102570 0x7f965019fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:48.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.332+0000 7f9655d9a700 1 --2- 172.21.15.8:0/3603160113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9650101bd0 0x7f9650198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:48.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.332+0000 7f965659b700 1 -- 172.21.15.8:0/3603160113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9650102570 msgr2=0x7f965019fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:48.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.332+0000 7f965659b700 1 --2- 172.21.15.8:0/3603160113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9650102570 0x7f965019fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:48.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.332+0000 7f965659b700 1 -- 172.21.15.8:0/3603160113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9650101bd0 msgr2=0x7f9650198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:48.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.332+0000 7f965659b700 1 --2- 172.21.15.8:0/3603160113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9650101bd0 0x7f9650198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:48.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.332+0000 7f965659b700 1 -- 172.21.15.8:0/3603160113 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f964c0095f0 con 0x7f96501009e0 2023-08-11T12:21:48.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.333+0000 7f965659b700 1 --2- 172.21.15.8:0/3603160113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96501009e0 0x7f9650198910 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f964c00b680 tx=0x7f964c005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:48.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.333+0000 7f96477fe700 1 -- 172.21.15.8:0/3603160113 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c01d070 con 0x7f96501009e0 2023-08-11T12:21:48.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.333+0000 7f96477fe700 1 -- 172.21.15.8:0/3603160113 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f964c021410 con 0x7f96501009e0 2023-08-11T12:21:48.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.333+0000 7f96477fe700 1 -- 172.21.15.8:0/3603160113 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c017650 con 0x7f96501009e0 2023-08-11T12:21:48.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.333+0000 7f96587ff700 1 -- 172.21.15.8:0/3603160113 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96501a09e0 con 0x7f96501009e0 2023-08-11T12:21:48.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.333+0000 7f96587ff700 1 -- 172.21.15.8:0/3603160113 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96501a0db0 con 0x7f96501009e0 2023-08-11T12:21:48.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.334+0000 7f96587ff700 1 -- 172.21.15.8:0/3603160113 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9650193030 con 0x7f96501009e0 2023-08-11T12:21:48.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.336+0000 7f96477fe700 1 -- 172.21.15.8:0/3603160113 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f964c021580 con 0x7f96501009e0 2023-08-11T12:21:48.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.338+0000 7f96477fe700 1 --2- 172.21.15.8:0/3603160113 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f963c09ff50 0x7f963c0a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:48.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.338+0000 7f96477fe700 1 -- 172.21.15.8:0/3603160113 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f964c0cc2e0 con 0x7f96501009e0 2023-08-11T12:21:48.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.338+0000 7f9655d9a700 1 --2- 172.21.15.8:0/3603160113 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f963c09ff50 0x7f963c0a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:48.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.338+0000 7f9655d9a700 1 --2- 172.21.15.8:0/3603160113 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f963c09ff50 0x7f963c0a2410 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9640009c60 tx=0x7f9640009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:48.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.341+0000 7f96477fe700 1 -- 172.21.15.8:0/3603160113 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f964c096500 con 0x7f96501009e0 2023-08-11T12:21:48.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:48 smithi008 ceph-mon[97158]: Deploying daemon mds.i on smithi194 2023-08-11T12:21:48.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:48 smithi008 ceph-mon[97158]: mds.? [v2:172.21.15.45:6836/641549061,v1:172.21.15.45:6837/641549061] up:boot 2023-08-11T12:21:48.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:48 smithi008 ceph-mon[97158]: fsmap 8 up:standby 2023-08-11T12:21:48.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:48 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-08-11T12:21:48.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.597+0000 7f96587ff700 1 -- 172.21.15.8:0/3603160113 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f965010c240 con 0x7f96501009e0 2023-08-11T12:21:48.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.598+0000 7f96477fe700 1 -- 172.21.15.8:0/3603160113 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6859 (secure 0 0 0) 0x7f964c099b20 con 0x7f96501009e0 2023-08-11T12:21:48.601 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:21:48.601 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14469,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2854286216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2854286216},{"type":"v1","addr":"172.21.15.8:6835","nonce":2854286216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/805368621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":805368621},{"type":"v1","addr":"172.21.15.8:6837","nonce":805368621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2043443402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2043443402},{"type":"v1","addr":"172.21.15.194:6833","nonce":2043443402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1208864615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1208864615},{"type":"v1","addr":"172.21.15.45:6833","nonce":1208864615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1776075470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1776075470},{"type":"v1","addr":"172.21.15.45:6835","nonce":1776075470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24517,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2457430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2457430285},{"type":"v1","addr":"172.21.15.194:6835","nonce":2457430285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24529,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/3072808560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":3072808560},{"type":"v1","addr":"172.21.15.194:6837","nonce":3072808560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/641549061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":641549061},{"type":"v1","addr":"172.21.15.45:6837","nonce":641549061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[]} 2023-08-11T12:21:48.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.600+0000 7f96587ff700 1 -- 172.21.15.8:0/3603160113 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f963c09ff50 msgr2=0x7f963c0a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:48.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.600+0000 7f96587ff700 1 --2- 172.21.15.8:0/3603160113 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f963c09ff50 0x7f963c0a2410 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9640009c60 tx=0x7f9640009260 comp rx=0 tx=0).stop 2023-08-11T12:21:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.600+0000 7f96587ff700 1 -- 172.21.15.8:0/3603160113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96501009e0 msgr2=0x7f9650198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.600+0000 7f96587ff700 1 --2- 172.21.15.8:0/3603160113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96501009e0 0x7f9650198910 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f964c00b680 tx=0x7f964c005740 comp rx=0 tx=0).stop 2023-08-11T12:21:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.600+0000 7f96587ff700 1 -- 172.21.15.8:0/3603160113 shutdown_connections 2023-08-11T12:21:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.600+0000 7f96587ff700 1 --2- 172.21.15.8:0/3603160113 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f963c09ff50 0x7f963c0a2410 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.600+0000 7f96587ff700 1 --2- 172.21.15.8:0/3603160113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9650102570 0x7f965019fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.600+0000 7f96587ff700 1 --2- 172.21.15.8:0/3603160113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96501009e0 0x7f9650198910 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.600+0000 7f96587ff700 1 --2- 172.21.15.8:0/3603160113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9650101bd0 0x7f9650198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:48.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.600+0000 7f96587ff700 1 -- 172.21.15.8:0/3603160113 >> 172.21.15.8:0/3603160113 conn(0x7f96500fbf50 msgr2=0x7f9650107500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:48.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.600+0000 7f96587ff700 1 -- 172.21.15.8:0/3603160113 shutdown_connections 2023-08-11T12:21:48.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:48.601+0000 7f96587ff700 1 -- 172.21.15.8:0/3603160113 wait complete. 2023-08-11T12:21:48.605 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 9 2023-08-11T12:21:48.643 INFO:journalctl@ceph.mds.i.smithi194.stdout:Aug 11 12:21:48 smithi194 podman[156800]: 2023-08-11T12:21:48.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:48 smithi194 ceph-mon[130905]: Deploying daemon mds.i on smithi194 2023-08-11T12:21:48.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:48 smithi194 ceph-mon[130905]: mds.? [v2:172.21.15.45:6836/641549061,v1:172.21.15.45:6837/641549061] up:boot 2023-08-11T12:21:48.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:48 smithi194 ceph-mon[130905]: fsmap 8 up:standby 2023-08-11T12:21:48.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:48 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-08-11T12:21:48.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:48 smithi045 ceph-mon[130284]: Deploying daemon mds.i on smithi194 2023-08-11T12:21:48.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:48 smithi045 ceph-mon[130284]: mds.? [v2:172.21.15.45:6836/641549061,v1:172.21.15.45:6837/641549061] up:boot 2023-08-11T12:21:48.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:48 smithi045 ceph-mon[130284]: fsmap 8 up:standby 2023-08-11T12:21:48.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:48 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-08-11T12:21:49.143 INFO:journalctl@ceph.mds.i.smithi194.stdout:Aug 11 12:21:48 smithi194 ceph-mds[156840]: -- 172.21.15.194:0/2534213748 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f0f8e811e0 con 0x55f0f8e56800 2023-08-11T12:21:49.143 INFO:journalctl@ceph.mds.i.smithi194.stdout:Aug 11 12:21:48 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-i[156816]: starting mds.i at 2023-08-11T12:21:49.144 INFO:journalctl@ceph.mds.i.smithi194.stdout:Aug 11 12:21:48 smithi194 bash[156800]: 5b6f49ff61e5c234be5e49cebdc3ae9c4aa248966c29a9ffc557d2e28d957397 2023-08-11T12:21:49.144 INFO:journalctl@ceph.mds.i.smithi194.stdout:Aug 11 12:21:48 smithi194 systemd[1]: Started Ceph mds.i for 815f94ae-3840-11ee-9b37-001a4aab830c. 2023-08-11T12:21:49.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:49 smithi194 ceph-mon[130905]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:49.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:49 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3603160113' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:49.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:49 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:49.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:49 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:49.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:49 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:49.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:49 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:49.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:49 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:49.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:49 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:49.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:49 smithi045 ceph-mon[130284]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:49.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:49 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3603160113' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:49.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:49 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:49.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:49 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:49.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:49 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:49.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:49 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:49.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:49 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:49.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:49 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:49.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:49 smithi008 ceph-mon[97158]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:49.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:49 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3603160113' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:49.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:49 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:49.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:49 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:49.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:49 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:49.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:49 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:49.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:49 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:49.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:49 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:50.485 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:50 smithi008 ceph-mon[97158]: Deploying daemon mds.g on smithi008 2023-08-11T12:21:50.485 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:50 smithi008 ceph-mon[97158]: mds.? [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] up:boot 2023-08-11T12:21:50.486 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:50 smithi008 ceph-mon[97158]: fsmap 9 up:standby 2023-08-11T12:21:50.486 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:50 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-08-11T12:21:50.623 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-11T12:21:50.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:50 smithi194 ceph-mon[130905]: Deploying daemon mds.g on smithi008 2023-08-11T12:21:50.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:50 smithi194 ceph-mon[130905]: mds.? [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] up:boot 2023-08-11T12:21:50.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:50 smithi194 ceph-mon[130905]: fsmap 9 up:standby 2023-08-11T12:21:50.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:50 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-08-11T12:21:50.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:50 smithi045 ceph-mon[130284]: Deploying daemon mds.g on smithi008 2023-08-11T12:21:50.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:50 smithi045 ceph-mon[130284]: mds.? [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] up:boot 2023-08-11T12:21:50.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:50 smithi045 ceph-mon[130284]: fsmap 9 up:standby 2023-08-11T12:21:50.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:50 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-08-11T12:21:51.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.046+0000 7fe80e5ff700 1 -- 172.21.15.8:0/199282742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe808102590 msgr2=0x7fe808108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:51.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.046+0000 7fe80e5ff700 1 --2- 172.21.15.8:0/199282742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe808102590 0x7fe808108e40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe800009fc0 tx=0x7fe80000b330 comp rx=0 tx=0).stop 2023-08-11T12:21:51.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.046+0000 7fe80e5ff700 1 -- 172.21.15.8:0/199282742 shutdown_connections 2023-08-11T12:21:51.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.046+0000 7fe80e5ff700 1 --2- 172.21.15.8:0/199282742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe808102590 0x7fe808108e40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:51.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.046+0000 7fe80e5ff700 1 --2- 172.21.15.8:0/199282742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe808100a00 0x7fe808100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:51.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.046+0000 7fe80e5ff700 1 --2- 172.21.15.8:0/199282742 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe808101bf0 0x7fe808102050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:51.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.046+0000 7fe80e5ff700 1 -- 172.21.15.8:0/199282742 >> 172.21.15.8:0/199282742 conn(0x7fe8080fbf70 msgr2=0x7fe8080fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:51.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.046+0000 7fe80e5ff700 1 -- 172.21.15.8:0/199282742 shutdown_connections 2023-08-11T12:21:51.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.046+0000 7fe80e5ff700 1 -- 172.21.15.8:0/199282742 wait complete. 2023-08-11T12:21:51.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.047+0000 7fe80e5ff700 1 Processor -- start 2023-08-11T12:21:51.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.048+0000 7fe80e5ff700 1 -- start start 2023-08-11T12:21:51.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.048+0000 7fe80e5ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe808100a00 0x7fe8081967e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:51.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.048+0000 7fe80e5ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe808101bf0 0x7fe808196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:51.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.048+0000 7fe80e5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe808102590 0x7fe80819dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:51.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.048+0000 7fe80e5ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80819e360 con 0x7fe808100a00 2023-08-11T12:21:51.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.048+0000 7fe80e5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80819e4a0 con 0x7fe808102590 2023-08-11T12:21:51.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.048+0000 7fe80e5ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80819e630 con 0x7fe808101bf0 2023-08-11T12:21:51.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.049+0000 7fe807fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe808100a00 0x7fe8081967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:51.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.049+0000 7fe807fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe808100a00 0x7fe8081967e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59788/0 (socket says 172.21.15.8:59788) 2023-08-11T12:21:51.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.049+0000 7fe807fff700 1 -- 172.21.15.8:0/2073629628 learned_addr learned my addr 172.21.15.8:0/2073629628 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:21:51.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.049+0000 7fe8077fe700 1 --2- 172.21.15.8:0/2073629628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe808101bf0 0x7fe808196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:51.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.049+0000 7fe80cb9c700 1 --2- 172.21.15.8:0/2073629628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe808102590 0x7fe80819dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:51.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.049+0000 7fe807fff700 1 -- 172.21.15.8:0/2073629628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe808101bf0 msgr2=0x7fe808196d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:51.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.049+0000 7fe807fff700 1 --2- 172.21.15.8:0/2073629628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe808101bf0 0x7fe808196d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:51.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.049+0000 7fe807fff700 1 -- 172.21.15.8:0/2073629628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe808102590 msgr2=0x7fe80819dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:51.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.049+0000 7fe807fff700 1 --2- 172.21.15.8:0/2073629628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe808102590 0x7fe80819dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:51.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.049+0000 7fe807fff700 1 -- 172.21.15.8:0/2073629628 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f80095f0 con 0x7fe808100a00 2023-08-11T12:21:51.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.049+0000 7fe807fff700 1 --2- 172.21.15.8:0/2073629628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe808100a00 0x7fe8081967e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe7f800ebf0 tx=0x7fe7f800ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:51.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.049+0000 7fe8057fa700 1 -- 172.21.15.8:0/2073629628 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8009a10 con 0x7fe808100a00 2023-08-11T12:21:51.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.049+0000 7fe80e5ff700 1 -- 172.21.15.8:0/2073629628 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe800009c40 con 0x7fe808100a00 2023-08-11T12:21:51.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.049+0000 7fe8057fa700 1 -- 172.21.15.8:0/2073629628 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7f800cd40 con 0x7fe808100a00 2023-08-11T12:21:51.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.049+0000 7fe8057fa700 1 -- 172.21.15.8:0/2073629628 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8018820 con 0x7fe808100a00 2023-08-11T12:21:51.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.050+0000 7fe80e5ff700 1 -- 172.21.15.8:0/2073629628 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80819ece0 con 0x7fe808100a00 2023-08-11T12:21:51.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.051+0000 7fe80e5ff700 1 -- 172.21.15.8:0/2073629628 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe808107f20 con 0x7fe808100a00 2023-08-11T12:21:51.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.053+0000 7fe8057fa700 1 -- 172.21.15.8:0/2073629628 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fe7f8018980 con 0x7fe808100a00 2023-08-11T12:21:51.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.054+0000 7fe8057fa700 1 --2- 172.21.15.8:0/2073629628 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe7f009ff50 0x7fe7f00a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:51.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.054+0000 7fe8057fa700 1 -- 172.21.15.8:0/2073629628 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe7f8014070 con 0x7fe808100a00 2023-08-11T12:21:51.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.055+0000 7fe8077fe700 1 --2- 172.21.15.8:0/2073629628 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe7f009ff50 0x7fe7f00a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:51.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.055+0000 7fe8077fe700 1 --2- 172.21.15.8:0/2073629628 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe7f009ff50 0x7fe7f00a2410 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc009c60 tx=0x7fe7fc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:51.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.057+0000 7fe8057fa700 1 -- 172.21.15.8:0/2073629628 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fe7f8096080 con 0x7fe808100a00 2023-08-11T12:21:51.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.334+0000 7fe80e5ff700 1 -- 172.21.15.8:0/2073629628 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe80810c4f0 con 0x7fe808100a00 2023-08-11T12:21:51.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.335+0000 7fe8057fa700 1 -- 172.21.15.8:0/2073629628 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7655 (secure 0 0 0) 0x7fe7f80996a0 con 0x7fe808100a00 2023-08-11T12:21:51.339 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:21:51.339 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14469,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2854286216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2854286216},{"type":"v1","addr":"172.21.15.8:6835","nonce":2854286216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/805368621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":805368621},{"type":"v1","addr":"172.21.15.8:6837","nonce":805368621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2043443402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2043443402},{"type":"v1","addr":"172.21.15.194:6833","nonce":2043443402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1208864615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1208864615},{"type":"v1","addr":"172.21.15.45:6833","nonce":1208864615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1776075470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1776075470},{"type":"v1","addr":"172.21.15.45:6835","nonce":1776075470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24517,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2457430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2457430285},{"type":"v1","addr":"172.21.15.194:6835","nonce":2457430285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24529,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/3072808560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":3072808560},{"type":"v1","addr":"172.21.15.194:6837","nonce":3072808560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/641549061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":641549061},{"type":"v1","addr":"172.21.15.45:6837","nonce":641549061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24550,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6839/2174476491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":2174476491},{"type":"v1","addr":"172.21.15.194:6839","nonce":2174476491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-08-11T12:21:51.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.337+0000 7fe80e5ff700 1 -- 172.21.15.8:0/2073629628 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe7f009ff50 msgr2=0x7fe7f00a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:51.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.337+0000 7fe80e5ff700 1 --2- 172.21.15.8:0/2073629628 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe7f009ff50 0x7fe7f00a2410 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc009c60 tx=0x7fe7fc009260 comp rx=0 tx=0).stop 2023-08-11T12:21:51.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.338+0000 7fe80e5ff700 1 -- 172.21.15.8:0/2073629628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe808100a00 msgr2=0x7fe8081967e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:51.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.338+0000 7fe80e5ff700 1 --2- 172.21.15.8:0/2073629628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe808100a00 0x7fe8081967e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe7f800ebf0 tx=0x7fe7f800ef00 comp rx=0 tx=0).stop 2023-08-11T12:21:51.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.338+0000 7fe80e5ff700 1 -- 172.21.15.8:0/2073629628 shutdown_connections 2023-08-11T12:21:51.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.338+0000 7fe80e5ff700 1 --2- 172.21.15.8:0/2073629628 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe7f009ff50 0x7fe7f00a2410 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:51.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.338+0000 7fe80e5ff700 1 --2- 172.21.15.8:0/2073629628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe808102590 0x7fe80819dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:51.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.338+0000 7fe80e5ff700 1 --2- 172.21.15.8:0/2073629628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe808100a00 0x7fe8081967e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:51.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.338+0000 7fe80e5ff700 1 --2- 172.21.15.8:0/2073629628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe808101bf0 0x7fe808196d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:51.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.338+0000 7fe80e5ff700 1 -- 172.21.15.8:0/2073629628 >> 172.21.15.8:0/2073629628 conn(0x7fe8080fbf70 msgr2=0x7fe808105060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:51.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.338+0000 7fe80e5ff700 1 -- 172.21.15.8:0/2073629628 shutdown_connections 2023-08-11T12:21:51.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:51.338+0000 7fe80e5ff700 1 -- 172.21.15.8:0/2073629628 wait complete. 2023-08-11T12:21:51.343 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 10 2023-08-11T12:21:51.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:51 smithi008 ceph-mon[97158]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:51.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:51 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2073629628' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:51.554 INFO:journalctl@ceph.mds.g.smithi008.stdout:Aug 11 12:21:51 smithi008 systemd[1]: Starting Ceph mds.g for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:21:51.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:51 smithi194 ceph-mon[130905]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:51.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:51 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2073629628' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:51.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:51 smithi045 ceph-mon[130284]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:51.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:51 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2073629628' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:52.040 INFO:journalctl@ceph.mds.g.smithi008.stdout:Aug 11 12:21:51 smithi008 podman[131295]: 2023-08-11T12:21:52.303 INFO:journalctl@ceph.mds.g.smithi008.stdout:Aug 11 12:21:52 smithi008 bash[131295]: 514684eaa3df2f1d0173a6864c084de009d5b7e5a7562dfc1845c0f1452ba77d 2023-08-11T12:21:52.304 INFO:journalctl@ceph.mds.g.smithi008.stdout:Aug 11 12:21:52 smithi008 ceph-mds[131335]: -- 172.21.15.8:0/2142157312 <== mon.0 v2:172.21.15.8:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56204fd531e0 con 0x56204fd28c00 2023-08-11T12:21:52.304 INFO:journalctl@ceph.mds.g.smithi008.stdout:Aug 11 12:21:52 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-g[131311]: starting mds.g at 2023-08-11T12:21:52.304 INFO:journalctl@ceph.mds.g.smithi008.stdout:Aug 11 12:21:52 smithi008 systemd[1]: Started Ceph mds.g for 815f94ae-3840-11ee-9b37-001a4aab830c. 2023-08-11T12:21:53.362 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-11T12:21:53.502 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:53.502 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:53.503 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:53.503 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:53.503 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:53.503 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:53.503 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:53 smithi008 ceph-mon[97158]: Deploying daemon mds.a on smithi008 2023-08-11T12:21:53.503 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:53 smithi008 ceph-mon[97158]: mds.? [v2:172.21.15.8:6838/2990530720,v1:172.21.15.8:6839/2990530720] up:boot 2023-08-11T12:21:53.503 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:53 smithi008 ceph-mon[97158]: fsmap 10 up:standby 2023-08-11T12:21:53.504 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:53 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-08-11T12:21:53.504 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:53 smithi008 ceph-mon[97158]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:53.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.577+0000 7f5adb9ff700 1 -- 172.21.15.8:0/1826296907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ad4101bd0 msgr2=0x7f5ad4102030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:53.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.577+0000 7f5adb9ff700 1 --2- 172.21.15.8:0/1826296907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ad4101bd0 0x7f5ad4102030 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5ac40099c0 tx=0x7f5ac4009cd0 comp rx=0 tx=0).stop 2023-08-11T12:21:53.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.577+0000 7f5adb9ff700 1 -- 172.21.15.8:0/1826296907 shutdown_connections 2023-08-11T12:21:53.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.577+0000 7f5adb9ff700 1 --2- 172.21.15.8:0/1826296907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ad41009e0 0x7f5ad4100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:53.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.577+0000 7f5adb9ff700 1 --2- 172.21.15.8:0/1826296907 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ad4102570 0x7f5ad4108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:53.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.577+0000 7f5adb9ff700 1 --2- 172.21.15.8:0/1826296907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ad4101bd0 0x7f5ad4102030 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:53.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.577+0000 7f5adb9ff700 1 -- 172.21.15.8:0/1826296907 >> 172.21.15.8:0/1826296907 conn(0x7f5ad40fbf50 msgr2=0x7f5ad40fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:53.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.577+0000 7f5adb9ff700 1 -- 172.21.15.8:0/1826296907 shutdown_connections 2023-08-11T12:21:53.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.577+0000 7f5adb9ff700 1 -- 172.21.15.8:0/1826296907 wait complete. 2023-08-11T12:21:53.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.578+0000 7f5adb9ff700 1 Processor -- start 2023-08-11T12:21:53.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.579+0000 7f5adb9ff700 1 -- start start 2023-08-11T12:21:53.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.579+0000 7f5adb9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ad41009e0 0x7f5ad4198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:53.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.579+0000 7f5adb9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ad4101bd0 0x7f5ad4198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:53.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.579+0000 7f5adb9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ad4102570 0x7f5ad419feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:53.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.579+0000 7f5adb9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad41a0480 con 0x7f5ad41009e0 2023-08-11T12:21:53.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.579+0000 7f5adb9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad41a05c0 con 0x7f5ad4102570 2023-08-11T12:21:53.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.579+0000 7f5adb9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad41a0750 con 0x7f5ad4101bd0 2023-08-11T12:21:53.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.579+0000 7f5ad979b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ad41009e0 0x7f5ad4198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:53.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.579+0000 7f5ad979b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ad41009e0 0x7f5ad4198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59832/0 (socket says 172.21.15.8:59832) 2023-08-11T12:21:53.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.579+0000 7f5ad979b700 1 -- 172.21.15.8:0/1129295272 learned_addr learned my addr 172.21.15.8:0/1129295272 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:21:53.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.579+0000 7f5ad9f9c700 1 --2- 172.21.15.8:0/1129295272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ad4102570 0x7f5ad419feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:53.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.579+0000 7f5ad8f9a700 1 --2- 172.21.15.8:0/1129295272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ad4101bd0 0x7f5ad4198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:53.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.580+0000 7f5ad979b700 1 -- 172.21.15.8:0/1129295272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ad4101bd0 msgr2=0x7f5ad4198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:53.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.580+0000 7f5ad979b700 1 --2- 172.21.15.8:0/1129295272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ad4101bd0 0x7f5ad4198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:53.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.580+0000 7f5ad979b700 1 -- 172.21.15.8:0/1129295272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ad4102570 msgr2=0x7f5ad419feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:53.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.580+0000 7f5ad979b700 1 --2- 172.21.15.8:0/1129295272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ad4102570 0x7f5ad419feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:53.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.580+0000 7f5ad979b700 1 -- 172.21.15.8:0/1129295272 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac40095f0 con 0x7f5ad41009e0 2023-08-11T12:21:53.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.580+0000 7f5ad8f9a700 1 --2- 172.21.15.8:0/1129295272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ad4101bd0 0x7f5ad4198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:21:53.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.580+0000 7f5ad979b700 1 --2- 172.21.15.8:0/1129295272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ad41009e0 0x7f5ad4198900 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000e970 tx=0x7f5ad000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:53.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.580+0000 7f5aca7fc700 1 -- 172.21.15.8:0/1129295272 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0009790 con 0x7f5ad41009e0 2023-08-11T12:21:53.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.580+0000 7f5aca7fc700 1 -- 172.21.15.8:0/1129295272 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ad000eec0 con 0x7f5ad41009e0 2023-08-11T12:21:53.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.580+0000 7f5adb9ff700 1 -- 172.21.15.8:0/1129295272 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad41a0a30 con 0x7f5ad41009e0 2023-08-11T12:21:53.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.580+0000 7f5aca7fc700 1 -- 172.21.15.8:0/1129295272 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0003cf0 con 0x7f5ad41009e0 2023-08-11T12:21:53.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.580+0000 7f5adb9ff700 1 -- 172.21.15.8:0/1129295272 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad41a0f40 con 0x7f5ad41009e0 2023-08-11T12:21:53.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.581+0000 7f5adb9ff700 1 -- 172.21.15.8:0/1129295272 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad410c240 con 0x7f5ad41009e0 2023-08-11T12:21:53.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.583+0000 7f5aca7fc700 1 -- 172.21.15.8:0/1129295272 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f5ad000ccd0 con 0x7f5ad41009e0 2023-08-11T12:21:53.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.585+0000 7f5aca7fc700 1 --2- 172.21.15.8:0/1129295272 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5ac009ff50 0x7f5ac00a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:53.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.585+0000 7f5aca7fc700 1 -- 172.21.15.8:0/1129295272 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5ad0014070 con 0x7f5ad41009e0 2023-08-11T12:21:53.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.585+0000 7f5ad8f9a700 1 --2- 172.21.15.8:0/1129295272 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5ac009ff50 0x7f5ac00a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:53.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.586+0000 7f5ad8f9a700 1 --2- 172.21.15.8:0/1129295272 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5ac009ff50 0x7f5ac00a2410 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400b580 tx=0x7f5ac401a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:53.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.589+0000 7f5aca7fc700 1 -- 172.21.15.8:0/1129295272 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f5ad0095210 con 0x7f5ad41009e0 2023-08-11T12:21:53.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:53 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:53.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:53 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:53.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:53 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:53.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:53 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:53.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:53 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:53.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:53 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:53.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:53 smithi194 ceph-mon[130905]: Deploying daemon mds.a on smithi008 2023-08-11T12:21:53.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:53 smithi194 ceph-mon[130905]: mds.? [v2:172.21.15.8:6838/2990530720,v1:172.21.15.8:6839/2990530720] up:boot 2023-08-11T12:21:53.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:53 smithi194 ceph-mon[130905]: fsmap 10 up:standby 2023-08-11T12:21:53.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:53 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-08-11T12:21:53.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:53 smithi194 ceph-mon[130905]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:53.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:53 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:53.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:53 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:53.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:53 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:53.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:53 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:53.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:53 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:53.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:53 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:53.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:53 smithi045 ceph-mon[130284]: Deploying daemon mds.a on smithi008 2023-08-11T12:21:53.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:53 smithi045 ceph-mon[130284]: mds.? [v2:172.21.15.8:6838/2990530720,v1:172.21.15.8:6839/2990530720] up:boot 2023-08-11T12:21:53.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:53 smithi045 ceph-mon[130284]: fsmap 10 up:standby 2023-08-11T12:21:53.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:53 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-08-11T12:21:53.647 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:53 smithi045 ceph-mon[130284]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:53.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.866+0000 7f5adb9ff700 1 -- 172.21.15.8:0/1129295272 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ad410c450 con 0x7f5ad41009e0 2023-08-11T12:21:53.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.866+0000 7f5aca7fc700 1 -- 172.21.15.8:0/1129295272 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8444 (secure 0 0 0) 0x7f5ad0098830 con 0x7f5ad41009e0 2023-08-11T12:21:53.870 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:21:53.870 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14469,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2854286216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2854286216},{"type":"v1","addr":"172.21.15.8:6835","nonce":2854286216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/805368621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":805368621},{"type":"v1","addr":"172.21.15.8:6837","nonce":805368621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14526,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/2990530720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":2990530720},{"type":"v1","addr":"172.21.15.8:6839","nonce":2990530720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2043443402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2043443402},{"type":"v1","addr":"172.21.15.194:6833","nonce":2043443402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1208864615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1208864615},{"type":"v1","addr":"172.21.15.45:6833","nonce":1208864615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1776075470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1776075470},{"type":"v1","addr":"172.21.15.45:6835","nonce":1776075470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24517,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2457430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2457430285},{"type":"v1","addr":"172.21.15.194:6835","nonce":2457430285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24529,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/3072808560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":3072808560},{"type":"v1","addr":"172.21.15.194:6837","nonce":3072808560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/641549061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":641549061},{"type":"v1","addr":"172.21.15.45:6837","nonce":641549061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24550,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6839/2174476491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":2174476491},{"type":"v1","addr":"172.21.15.194:6839","nonce":2174476491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-08-11T12:21:53.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.869+0000 7f5adb9ff700 1 -- 172.21.15.8:0/1129295272 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5ac009ff50 msgr2=0x7f5ac00a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:53.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.869+0000 7f5adb9ff700 1 --2- 172.21.15.8:0/1129295272 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5ac009ff50 0x7f5ac00a2410 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400b580 tx=0x7f5ac401a040 comp rx=0 tx=0).stop 2023-08-11T12:21:53.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.869+0000 7f5adb9ff700 1 -- 172.21.15.8:0/1129295272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ad41009e0 msgr2=0x7f5ad4198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:53.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.869+0000 7f5adb9ff700 1 --2- 172.21.15.8:0/1129295272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ad41009e0 0x7f5ad4198900 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000e970 tx=0x7f5ad000ec80 comp rx=0 tx=0).stop 2023-08-11T12:21:53.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.869+0000 7f5adb9ff700 1 -- 172.21.15.8:0/1129295272 shutdown_connections 2023-08-11T12:21:53.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.869+0000 7f5adb9ff700 1 --2- 172.21.15.8:0/1129295272 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5ac009ff50 0x7f5ac00a2410 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:53.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.869+0000 7f5adb9ff700 1 --2- 172.21.15.8:0/1129295272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ad4102570 0x7f5ad419feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:53.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.869+0000 7f5adb9ff700 1 --2- 172.21.15.8:0/1129295272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ad41009e0 0x7f5ad4198900 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:53.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.869+0000 7f5adb9ff700 1 --2- 172.21.15.8:0/1129295272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ad4101bd0 0x7f5ad4198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:53.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.869+0000 7f5adb9ff700 1 -- 172.21.15.8:0/1129295272 >> 172.21.15.8:0/1129295272 conn(0x7f5ad40fbf50 msgr2=0x7f5ad40fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:53.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.869+0000 7f5adb9ff700 1 -- 172.21.15.8:0/1129295272 shutdown_connections 2023-08-11T12:21:53.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:53.869+0000 7f5adb9ff700 1 -- 172.21.15.8:0/1129295272 wait complete. 2023-08-11T12:21:53.873 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 11 2023-08-11T12:21:54.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:54 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1129295272' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:54.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:54 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1129295272' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:54.804 INFO:journalctl@ceph.mds.a.smithi008.stdout:Aug 11 12:21:54 smithi008 systemd[1]: Starting Ceph mds.a for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:21:54.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:54 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1129295272' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:55.240 INFO:journalctl@ceph.mds.a.smithi008.stdout:Aug 11 12:21:54 smithi008 podman[131684]: 2023-08-11T12:21:55.240 INFO:journalctl@ceph.mds.a.smithi008.stdout:Aug 11 12:21:55 smithi008 ceph-mds[131724]: -- 172.21.15.8:0/1996027988 <== mon.0 v2:172.21.15.8:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55878526f1e0 con 0x558785244c00 2023-08-11T12:21:55.240 INFO:journalctl@ceph.mds.a.smithi008.stdout:Aug 11 12:21:55 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-a[131700]: starting mds.a at 2023-08-11T12:21:55.553 INFO:journalctl@ceph.mds.a.smithi008.stdout:Aug 11 12:21:55 smithi008 bash[131684]: fef274065715241683a03b9774d5321173e22d5c2c53382d519934fce77f9396 2023-08-11T12:21:55.554 INFO:journalctl@ceph.mds.a.smithi008.stdout:Aug 11 12:21:55 smithi008 systemd[1]: Started Ceph mds.a for 815f94ae-3840-11ee-9b37-001a4aab830c. 2023-08-11T12:21:55.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:55 smithi008 ceph-mon[97158]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:55.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:55 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:55.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:55 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:55.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:55 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:55.556 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:55 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:55.556 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:55 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:55.556 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:55 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:55.893 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-11T12:21:55.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:55 smithi194 ceph-mon[130905]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:55.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:55 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:55.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:55 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:55.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:55 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:55.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:55 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:55.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:55 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:55.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:55 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:55.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:55 smithi045 ceph-mon[130284]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:55.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:55 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:55.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:55 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:55.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:55 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:55.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:55 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-11T12:21:55.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:55 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-11T12:21:55.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:55 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:21:56.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.104+0000 7fcbe77ff700 1 -- 172.21.15.8:0/4225138591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbe01009e0 msgr2=0x7fcbe0100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:56.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.104+0000 7fcbe77ff700 1 --2- 172.21.15.8:0/4225138591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbe01009e0 0x7fcbe0100e00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc0099c0 tx=0x7fcbdc009cd0 comp rx=0 tx=0).stop 2023-08-11T12:21:56.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.104+0000 7fcbe77ff700 1 -- 172.21.15.8:0/4225138591 shutdown_connections 2023-08-11T12:21:56.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.104+0000 7fcbe77ff700 1 --2- 172.21.15.8:0/4225138591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbe0102570 0x7fcbe0108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:56.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.104+0000 7fcbe77ff700 1 --2- 172.21.15.8:0/4225138591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbe01009e0 0x7fcbe0100e00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:56.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.104+0000 7fcbe77ff700 1 --2- 172.21.15.8:0/4225138591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbe0101bd0 0x7fcbe0102030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:56.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.104+0000 7fcbe77ff700 1 -- 172.21.15.8:0/4225138591 >> 172.21.15.8:0/4225138591 conn(0x7fcbe00fbf50 msgr2=0x7fcbe00fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:56.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.105+0000 7fcbe77ff700 1 -- 172.21.15.8:0/4225138591 shutdown_connections 2023-08-11T12:21:56.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.105+0000 7fcbe77ff700 1 -- 172.21.15.8:0/4225138591 wait complete. 2023-08-11T12:21:56.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.106+0000 7fcbe77ff700 1 Processor -- start 2023-08-11T12:21:56.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.106+0000 7fcbe77ff700 1 -- start start 2023-08-11T12:21:56.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.106+0000 7fcbe77ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbe01009e0 0x7fcbe00746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:56.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.106+0000 7fcbe77ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbe0101bd0 0x7fcbe0072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:56.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.106+0000 7fcbe77ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbe0102570 0x7fcbe0073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:56.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.106+0000 7fcbe77ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe00739f0 con 0x7fcbe01009e0 2023-08-11T12:21:56.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.106+0000 7fcbe77ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe0073b60 con 0x7fcbe0101bd0 2023-08-11T12:21:56.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.106+0000 7fcbe77ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe01a0760 con 0x7fcbe0102570 2023-08-11T12:21:56.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.107+0000 7fcbe559b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbe01009e0 0x7fcbe00746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:56.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.107+0000 7fcbe4d9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbe0101bd0 0x7fcbe0072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:56.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.107+0000 7fcbe559b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbe01009e0 0x7fcbe00746d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59856/0 (socket says 172.21.15.8:59856) 2023-08-11T12:21:56.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.107+0000 7fcbe4d9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbe0101bd0 0x7fcbe0072d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:39098/0 (socket says 172.21.15.8:39098) 2023-08-11T12:21:56.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.107+0000 7fcbe559b700 1 -- 172.21.15.8:0/2040486435 learned_addr learned my addr 172.21.15.8:0/2040486435 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:21:56.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.107+0000 7fcbe5d9c700 1 --2- 172.21.15.8:0/2040486435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbe0102570 0x7fcbe0073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:56.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.107+0000 7fcbe559b700 1 -- 172.21.15.8:0/2040486435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbe0102570 msgr2=0x7fcbe0073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:56.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.107+0000 7fcbe559b700 1 --2- 172.21.15.8:0/2040486435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbe0102570 0x7fcbe0073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:56.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.107+0000 7fcbe559b700 1 -- 172.21.15.8:0/2040486435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbe0101bd0 msgr2=0x7fcbe0072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:56.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.107+0000 7fcbe559b700 1 --2- 172.21.15.8:0/2040486435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbe0101bd0 0x7fcbe0072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:56.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.107+0000 7fcbe559b700 1 -- 172.21.15.8:0/2040486435 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc0095f0 con 0x7fcbe01009e0 2023-08-11T12:21:56.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.107+0000 7fcbe4d9a700 1 --2- 172.21.15.8:0/2040486435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbe0101bd0 0x7fcbe0072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:21:56.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.107+0000 7fcbe559b700 1 --2- 172.21.15.8:0/2040486435 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbe01009e0 0x7fcbe00746d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc0098e0 tx=0x7fcbdc00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:56.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.107+0000 7fcbd67fc700 1 -- 172.21.15.8:0/2040486435 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc01d070 con 0x7fcbe01009e0 2023-08-11T12:21:56.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.108+0000 7fcbe77ff700 1 -- 172.21.15.8:0/2040486435 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe01a09e0 con 0x7fcbe01009e0 2023-08-11T12:21:56.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.108+0000 7fcbd67fc700 1 -- 172.21.15.8:0/2040486435 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcbdc005050 con 0x7fcbe01009e0 2023-08-11T12:21:56.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.108+0000 7fcbd67fc700 1 -- 172.21.15.8:0/2040486435 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc004b40 con 0x7fcbe01009e0 2023-08-11T12:21:56.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.108+0000 7fcbe77ff700 1 -- 172.21.15.8:0/2040486435 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe01a0e60 con 0x7fcbe01009e0 2023-08-11T12:21:56.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.109+0000 7fcbe77ff700 1 -- 172.21.15.8:0/2040486435 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe010c240 con 0x7fcbe01009e0 2023-08-11T12:21:56.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.110+0000 7fcbd67fc700 1 -- 172.21.15.8:0/2040486435 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fcbdc004ce0 con 0x7fcbe01009e0 2023-08-11T12:21:56.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.112+0000 7fcbd67fc700 1 --2- 172.21.15.8:0/2040486435 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fcbcc09ffd0 0x7fcbcc0a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:56.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.112+0000 7fcbd67fc700 1 -- 172.21.15.8:0/2040486435 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fcbdc0cbbe0 con 0x7fcbe01009e0 2023-08-11T12:21:56.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.112+0000 7fcbe4d9a700 1 --2- 172.21.15.8:0/2040486435 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fcbcc09ffd0 0x7fcbcc0a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:56.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.113+0000 7fcbe4d9a700 1 --2- 172.21.15.8:0/2040486435 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fcbcc09ffd0 0x7fcbcc0a2490 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0011490 tx=0x7fcbd0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:56.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.116+0000 7fcbd67fc700 1 -- 172.21.15.8:0/2040486435 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fcbdc095e00 con 0x7fcbe01009e0 2023-08-11T12:21:56.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.372+0000 7fcbe77ff700 1 -- 172.21.15.8:0/2040486435 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcbe0107930 con 0x7fcbe01009e0 2023-08-11T12:21:56.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.373+0000 7fcbd67fc700 1 -- 172.21.15.8:0/2040486435 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+9233 (secure 0 0 0) 0x7fcbdc099420 con 0x7fcbe01009e0 2023-08-11T12:21:56.376 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:21:56.376 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14469,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2854286216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2854286216},{"type":"v1","addr":"172.21.15.8:6835","nonce":2854286216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/805368621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":805368621},{"type":"v1","addr":"172.21.15.8:6837","nonce":805368621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14526,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/2990530720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":2990530720},{"type":"v1","addr":"172.21.15.8:6839","nonce":2990530720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14538,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/3589272762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":3589272762},{"type":"v1","addr":"172.21.15.8:6841","nonce":3589272762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2043443402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2043443402},{"type":"v1","addr":"172.21.15.194:6833","nonce":2043443402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1208864615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1208864615},{"type":"v1","addr":"172.21.15.45:6833","nonce":1208864615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1776075470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1776075470},{"type":"v1","addr":"172.21.15.45:6835","nonce":1776075470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24517,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2457430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2457430285},{"type":"v1","addr":"172.21.15.194:6835","nonce":2457430285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24529,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/3072808560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":3072808560},{"type":"v1","addr":"172.21.15.194:6837","nonce":3072808560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/641549061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":641549061},{"type":"v1","addr":"172.21.15.45:6837","nonce":641549061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24550,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6839/2174476491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":2174476491},{"type":"v1","addr":"172.21.15.194:6839","nonce":2174476491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-08-11T12:21:56.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.375+0000 7fcbe77ff700 1 -- 172.21.15.8:0/2040486435 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fcbcc09ffd0 msgr2=0x7fcbcc0a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:56.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.375+0000 7fcbe77ff700 1 --2- 172.21.15.8:0/2040486435 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fcbcc09ffd0 0x7fcbcc0a2490 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0011490 tx=0x7fcbd0009260 comp rx=0 tx=0).stop 2023-08-11T12:21:56.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.375+0000 7fcbe77ff700 1 -- 172.21.15.8:0/2040486435 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbe01009e0 msgr2=0x7fcbe00746d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:56.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.375+0000 7fcbe77ff700 1 --2- 172.21.15.8:0/2040486435 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbe01009e0 0x7fcbe00746d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc0098e0 tx=0x7fcbdc00f690 comp rx=0 tx=0).stop 2023-08-11T12:21:56.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.375+0000 7fcbe77ff700 1 -- 172.21.15.8:0/2040486435 shutdown_connections 2023-08-11T12:21:56.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.375+0000 7fcbe77ff700 1 --2- 172.21.15.8:0/2040486435 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fcbcc09ffd0 0x7fcbcc0a2490 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:56.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.375+0000 7fcbe77ff700 1 --2- 172.21.15.8:0/2040486435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbe0102570 0x7fcbe0073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:56.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.375+0000 7fcbe77ff700 1 --2- 172.21.15.8:0/2040486435 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbe01009e0 0x7fcbe00746d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:56.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.375+0000 7fcbe77ff700 1 --2- 172.21.15.8:0/2040486435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbe0101bd0 0x7fcbe0072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:56.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.375+0000 7fcbe77ff700 1 -- 172.21.15.8:0/2040486435 >> 172.21.15.8:0/2040486435 conn(0x7fcbe00fbf50 msgr2=0x7fcbe00fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:56.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.375+0000 7fcbe77ff700 1 -- 172.21.15.8:0/2040486435 shutdown_connections 2023-08-11T12:21:56.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:56.375+0000 7fcbe77ff700 1 -- 172.21.15.8:0/2040486435 wait complete. 2023-08-11T12:21:56.380 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 12 2023-08-11T12:21:56.633 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:56 smithi045 ceph-mon[130284]: Deploying daemon mds.b on smithi045 2023-08-11T12:21:56.633 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:56 smithi045 ceph-mon[130284]: mds.? [v2:172.21.15.8:6840/3589272762,v1:172.21.15.8:6841/3589272762] up:boot 2023-08-11T12:21:56.633 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:56 smithi045 ceph-mon[130284]: fsmap 11 up:standby 2023-08-11T12:21:56.633 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:56 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-08-11T12:21:56.633 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:56 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2040486435' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:56.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:56 smithi008 ceph-mon[97158]: Deploying daemon mds.b on smithi045 2023-08-11T12:21:56.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:56 smithi008 ceph-mon[97158]: mds.? [v2:172.21.15.8:6840/3589272762,v1:172.21.15.8:6841/3589272762] up:boot 2023-08-11T12:21:56.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:56 smithi008 ceph-mon[97158]: fsmap 11 up:standby 2023-08-11T12:21:56.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:56 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-08-11T12:21:56.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:56 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2040486435' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:56.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:56 smithi194 ceph-mon[130905]: Deploying daemon mds.b on smithi045 2023-08-11T12:21:56.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:56 smithi194 ceph-mon[130905]: mds.? [v2:172.21.15.8:6840/3589272762,v1:172.21.15.8:6841/3589272762] up:boot 2023-08-11T12:21:56.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:56 smithi194 ceph-mon[130905]: fsmap 11 up:standby 2023-08-11T12:21:56.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:56 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-08-11T12:21:56.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:56 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2040486435' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:21:57.321 INFO:journalctl@ceph.mds.b.smithi045.stdout:Aug 11 12:21:57 smithi045 systemd[1]: Starting Ceph mds.b for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:21:57.638 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:57 smithi045 ceph-mon[130284]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:57.639 INFO:journalctl@ceph.mds.b.smithi045.stdout:Aug 11 12:21:57 smithi045 podman[155616]: 2023-08-11T12:21:57.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:57 smithi008 ceph-mon[97158]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:57.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:57 smithi194 ceph-mon[130905]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:57.895 INFO:journalctl@ceph.mds.b.smithi045.stdout:Aug 11 12:21:57 smithi045 bash[155616]: 8334d9e74303853cc09e2b880176dcd558ba2b23ec848f7d73be553f0a1f880e 2023-08-11T12:21:57.895 INFO:journalctl@ceph.mds.b.smithi045.stdout:Aug 11 12:21:57 smithi045 ceph-mds[155656]: -- 172.21.15.45:0/106921474 <== mon.2 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5563a655f1e0 con 0x5563a6534c00 2023-08-11T12:21:57.895 INFO:journalctl@ceph.mds.b.smithi045.stdout:Aug 11 12:21:57 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-b[155632]: starting mds.b at 2023-08-11T12:21:57.896 INFO:journalctl@ceph.mds.b.smithi045.stdout:Aug 11 12:21:57 smithi045 systemd[1]: Started Ceph mds.b for 815f94ae-3840-11ee-9b37-001a4aab830c. 2023-08-11T12:21:58.398 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-11T12:21:58.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.609+0000 7f372c9ff700 1 -- 172.21.15.8:0/2554683390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3728073380 msgr2=0x7f3728073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:58.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.609+0000 7f372c9ff700 1 --2- 172.21.15.8:0/2554683390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3728073380 0x7f3728073800 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f371c0098f0 tx=0x7f371c009c00 comp rx=0 tx=0).stop 2023-08-11T12:21:58.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.609+0000 7f372c9ff700 1 -- 172.21.15.8:0/2554683390 shutdown_connections 2023-08-11T12:21:58.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.609+0000 7f372c9ff700 1 --2- 172.21.15.8:0/2554683390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f372810cfb0 0x7f372810f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:58.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.609+0000 7f372c9ff700 1 --2- 172.21.15.8:0/2554683390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3728074960 0x7f3728072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:58.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.609+0000 7f372c9ff700 1 --2- 172.21.15.8:0/2554683390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3728073380 0x7f3728073800 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:58.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.609+0000 7f372c9ff700 1 -- 172.21.15.8:0/2554683390 >> 172.21.15.8:0/2554683390 conn(0x7f37280fbf50 msgr2=0x7f37280fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:58.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.609+0000 7f372c9ff700 1 -- 172.21.15.8:0/2554683390 shutdown_connections 2023-08-11T12:21:58.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.609+0000 7f372c9ff700 1 -- 172.21.15.8:0/2554683390 wait complete. 2023-08-11T12:21:58.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.611+0000 7f372c9ff700 1 Processor -- start 2023-08-11T12:21:58.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.611+0000 7f372c9ff700 1 -- start start 2023-08-11T12:21:58.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.611+0000 7f372c9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3728073380 0x7f372819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:58.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.612+0000 7f372c9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3728074960 0x7f372819d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:58.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.612+0000 7f372c9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f372810cfb0 0x7f37281a4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:58.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.612+0000 7f372c9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37281a48e0 con 0x7f372810cfb0 2023-08-11T12:21:58.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.612+0000 7f372c9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37281a4a20 con 0x7f3728073380 2023-08-11T12:21:58.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.612+0000 7f372c9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37281a4bb0 con 0x7f3728074960 2023-08-11T12:21:58.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.612+0000 7f3725d9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3728074960 0x7f372819d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:58.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.612+0000 7f3725d9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3728074960 0x7f372819d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:55356/0 (socket says 172.21.15.8:55356) 2023-08-11T12:21:58.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.612+0000 7f3725d9b700 1 -- 172.21.15.8:0/3068271421 learned_addr learned my addr 172.21.15.8:0/3068271421 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:21:58.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.612+0000 7f3726d9d700 1 --2- 172.21.15.8:0/3068271421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f372810cfb0 0x7f37281a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:58.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.612+0000 7f372659c700 1 --2- 172.21.15.8:0/3068271421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3728073380 0x7f372819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:58.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.612+0000 7f3725d9b700 1 -- 172.21.15.8:0/3068271421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3728073380 msgr2=0x7f372819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:58.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.612+0000 7f3725d9b700 1 --2- 172.21.15.8:0/3068271421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3728073380 0x7f372819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:58.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.612+0000 7f3725d9b700 1 -- 172.21.15.8:0/3068271421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f372810cfb0 msgr2=0x7f37281a4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:58.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.612+0000 7f3725d9b700 1 --2- 172.21.15.8:0/3068271421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f372810cfb0 0x7f37281a4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:58.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.612+0000 7f3725d9b700 1 -- 172.21.15.8:0/3068271421 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371c009520 con 0x7f3728074960 2023-08-11T12:21:58.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.612+0000 7f3726d9d700 1 --2- 172.21.15.8:0/3068271421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f372810cfb0 0x7f37281a4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:21:58.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.613+0000 7f3725d9b700 1 --2- 172.21.15.8:0/3068271421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3728074960 0x7f372819d2a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f371c009fd0 tx=0x7f371c00b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:58.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.613+0000 7f37177fe700 1 -- 172.21.15.8:0/3068271421 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c01c070 con 0x7f3728074960 2023-08-11T12:21:58.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.613+0000 7f37177fe700 1 -- 172.21.15.8:0/3068271421 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f371c00f7d0 con 0x7f3728074960 2023-08-11T12:21:58.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.613+0000 7f372c9ff700 1 -- 172.21.15.8:0/3068271421 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37281a4e30 con 0x7f3728074960 2023-08-11T12:21:58.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.613+0000 7f37177fe700 1 -- 172.21.15.8:0/3068271421 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c003a40 con 0x7f3728074960 2023-08-11T12:21:58.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.613+0000 7f372c9ff700 1 -- 172.21.15.8:0/3068271421 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37281a51a0 con 0x7f3728074960 2023-08-11T12:21:58.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.614+0000 7f372c9ff700 1 -- 172.21.15.8:0/3068271421 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3728102b00 con 0x7f3728074960 2023-08-11T12:21:58.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.616+0000 7f37177fe700 1 -- 172.21.15.8:0/3068271421 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f371c020030 con 0x7f3728074960 2023-08-11T12:21:58.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.617+0000 7f37177fe700 1 --2- 172.21.15.8:0/3068271421 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f371009ff50 0x7f37100a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:58.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.617+0000 7f37177fe700 1 -- 172.21.15.8:0/3068271421 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f371c0cbda0 con 0x7f3728074960 2023-08-11T12:21:58.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.617+0000 7f372659c700 1 --2- 172.21.15.8:0/3068271421 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f371009ff50 0x7f37100a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:58.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.618+0000 7f372659c700 1 --2- 172.21.15.8:0/3068271421 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f371009ff50 0x7f37100a2410 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3718009c60 tx=0x7f3718009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:58.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.621+0000 7f37177fe700 1 -- 172.21.15.8:0/3068271421 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f371c095fc0 con 0x7f3728074960 2023-08-11T12:21:58.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.883+0000 7f372c9ff700 1 -- 172.21.15.8:0/3068271421 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f372802cdc0 con 0x7f3728074960 2023-08-11T12:21:58.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.884+0000 7f37177fe700 1 -- 172.21.15.8:0/3068271421 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+10022 (secure 0 0 0) 0x7f371c0995e0 con 0x7f3728074960 2023-08-11T12:21:58.888 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:21:58.888 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14469,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2854286216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2854286216},{"type":"v1","addr":"172.21.15.8:6835","nonce":2854286216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/805368621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":805368621},{"type":"v1","addr":"172.21.15.8:6837","nonce":805368621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14526,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/2990530720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":2990530720},{"type":"v1","addr":"172.21.15.8:6839","nonce":2990530720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14538,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/3589272762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":3589272762},{"type":"v1","addr":"172.21.15.8:6841","nonce":3589272762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2043443402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2043443402},{"type":"v1","addr":"172.21.15.194:6833","nonce":2043443402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1208864615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1208864615},{"type":"v1","addr":"172.21.15.45:6833","nonce":1208864615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1776075470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1776075470},{"type":"v1","addr":"172.21.15.45:6835","nonce":1776075470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24517,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2457430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2457430285},{"type":"v1","addr":"172.21.15.194:6835","nonce":2457430285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24529,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/3072808560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":3072808560},{"type":"v1","addr":"172.21.15.194:6837","nonce":3072808560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/641549061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":641549061},{"type":"v1","addr":"172.21.15.45:6837","nonce":641549061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24550,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6839/2174476491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":2174476491},{"type":"v1","addr":"172.21.15.194:6839","nonce":2174476491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24575,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/119684732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":119684732},{"type":"v1","addr":"172.21.15.45:6839","nonce":119684732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[]} 2023-08-11T12:21:58.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.887+0000 7f372c9ff700 1 -- 172.21.15.8:0/3068271421 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f371009ff50 msgr2=0x7f37100a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:58.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.887+0000 7f372c9ff700 1 --2- 172.21.15.8:0/3068271421 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f371009ff50 0x7f37100a2410 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3718009c60 tx=0x7f3718009260 comp rx=0 tx=0).stop 2023-08-11T12:21:58.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.887+0000 7f372c9ff700 1 -- 172.21.15.8:0/3068271421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3728074960 msgr2=0x7f372819d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:58.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.887+0000 7f372c9ff700 1 --2- 172.21.15.8:0/3068271421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3728074960 0x7f372819d2a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f371c009fd0 tx=0x7f371c00b790 comp rx=0 tx=0).stop 2023-08-11T12:21:58.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.887+0000 7f372c9ff700 1 -- 172.21.15.8:0/3068271421 shutdown_connections 2023-08-11T12:21:58.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.887+0000 7f372c9ff700 1 --2- 172.21.15.8:0/3068271421 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f371009ff50 0x7f37100a2410 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:58.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.887+0000 7f372c9ff700 1 --2- 172.21.15.8:0/3068271421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f372810cfb0 0x7f37281a4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:58.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.887+0000 7f372c9ff700 1 --2- 172.21.15.8:0/3068271421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3728073380 0x7f372819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:58.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.887+0000 7f372c9ff700 1 --2- 172.21.15.8:0/3068271421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3728074960 0x7f372819d2a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:58.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.887+0000 7f372c9ff700 1 -- 172.21.15.8:0/3068271421 >> 172.21.15.8:0/3068271421 conn(0x7f37280fbf50 msgr2=0x7f37280fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:58.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.887+0000 7f372c9ff700 1 -- 172.21.15.8:0/3068271421 shutdown_connections 2023-08-11T12:21:58.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:58.887+0000 7f372c9ff700 1 -- 172.21.15.8:0/3068271421 wait complete. 2023-08-11T12:21:58.891 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 13 2023-08-11T12:21:58.910 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-11T12:21:59.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:58 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:59.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:58 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:59.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:58 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:59.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:58 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:59.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:58 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:59.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:58 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:21:59.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:58 smithi008 ceph-mon[97158]: mds.? [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] up:boot 2023-08-11T12:21:59.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:58 smithi008 ceph-mon[97158]: fsmap 12 up:standby 2023-08-11T12:21:59.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:58 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-08-11T12:21:59.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:58 smithi008 ceph-mon[97158]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:59.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.120+0000 7f1284dff700 1 -- 172.21.15.8:0/1572154466 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1280103c70 msgr2=0x7f1280106060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:59.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.120+0000 7f1284dff700 1 --2- 172.21.15.8:0/1572154466 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1280103c70 0x7f1280106060 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1268009990 tx=0x7f1268009ca0 comp rx=0 tx=0).stop 2023-08-11T12:21:59.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.120+0000 7f1284dff700 1 -- 172.21.15.8:0/1572154466 shutdown_connections 2023-08-11T12:21:59.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.120+0000 7f1284dff700 1 --2- 172.21.15.8:0/1572154466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12801065a0 0x7f1280108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:59.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.120+0000 7f1284dff700 1 --2- 172.21.15.8:0/1572154466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1280101340 0x7f1280103730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:59.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.121+0000 7f1284dff700 1 --2- 172.21.15.8:0/1572154466 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1280103c70 0x7f1280106060 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:59.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.121+0000 7f1284dff700 1 -- 172.21.15.8:0/1572154466 >> 172.21.15.8:0/1572154466 conn(0x7f12800fad30 msgr2=0x7f12800fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:59.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.121+0000 7f1284dff700 1 -- 172.21.15.8:0/1572154466 shutdown_connections 2023-08-11T12:21:59.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.121+0000 7f1284dff700 1 -- 172.21.15.8:0/1572154466 wait complete. 2023-08-11T12:21:59.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.122+0000 7f1284dff700 1 Processor -- start 2023-08-11T12:21:59.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.122+0000 7f1284dff700 1 -- start start 2023-08-11T12:21:59.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.122+0000 7f1284dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1280101340 0x7f12801987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:59.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.122+0000 7f1284dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1280103c70 0x7f1280198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:59.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.122+0000 7f1284dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12801065a0 0x7f128019fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:59.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.122+0000 7f1284dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12801a0330 con 0x7f12801065a0 2023-08-11T12:21:59.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.122+0000 7f1284dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12801a0470 con 0x7f1280103c70 2023-08-11T12:21:59.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.122+0000 7f1284dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12801a0600 con 0x7f1280101340 2023-08-11T12:21:59.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.122+0000 7f127e59c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1280101340 0x7f12801987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:59.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.122+0000 7f1277fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1280103c70 0x7f1280198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:59.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.122+0000 7f127ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12801065a0 0x7f128019fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:59.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.122+0000 7f127e59c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1280101340 0x7f12801987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:55382/0 (socket says 172.21.15.8:55382) 2023-08-11T12:21:59.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.122+0000 7f1277fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1280103c70 0x7f1280198cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:55152/0 (socket says 172.21.15.8:55152) 2023-08-11T12:21:59.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.122+0000 7f127e59c700 1 -- 172.21.15.8:0/1096573586 learned_addr learned my addr 172.21.15.8:0/1096573586 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:21:59.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.123+0000 7f127e59c700 1 -- 172.21.15.8:0/1096573586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1280103c70 msgr2=0x7f1280198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:59.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.123+0000 7f127e59c700 1 --2- 172.21.15.8:0/1096573586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1280103c70 0x7f1280198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:59.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.123+0000 7f127e59c700 1 -- 172.21.15.8:0/1096573586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12801065a0 msgr2=0x7f128019fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:59.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.123+0000 7f127e59c700 1 --2- 172.21.15.8:0/1096573586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12801065a0 0x7f128019fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:59.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.123+0000 7f127e59c700 1 -- 172.21.15.8:0/1096573586 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1278009c40 con 0x7f1280101340 2023-08-11T12:21:59.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.123+0000 7f127e59c700 1 --2- 172.21.15.8:0/1096573586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1280101340 0x7f12801987b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f127000e9a0 tx=0x7f127000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:59.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.123+0000 7f12777fe700 1 -- 172.21.15.8:0/1096573586 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1270009790 con 0x7f1280101340 2023-08-11T12:21:59.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.123+0000 7f1284dff700 1 -- 172.21.15.8:0/1096573586 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12680095f0 con 0x7f1280101340 2023-08-11T12:21:59.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.123+0000 7f12777fe700 1 -- 172.21.15.8:0/1096573586 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f127000ce80 con 0x7f1280101340 2023-08-11T12:21:59.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.123+0000 7f12777fe700 1 -- 172.21.15.8:0/1096573586 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1270018680 con 0x7f1280101340 2023-08-11T12:21:59.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.123+0000 7f1284dff700 1 -- 172.21.15.8:0/1096573586 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12801a0cb0 con 0x7f1280101340 2023-08-11T12:21:59.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.125+0000 7f1284dff700 1 -- 172.21.15.8:0/1096573586 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1280108170 con 0x7f1280101340 2023-08-11T12:21:59.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.128+0000 7f12777fe700 1 -- 172.21.15.8:0/1096573586 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f1270010430 con 0x7f1280101340 2023-08-11T12:21:59.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.129+0000 7f12777fe700 1 --2- 172.21.15.8:0/1096573586 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f126c09ff50 0x7f126c0a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:59.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.130+0000 7f12777fe700 1 -- 172.21.15.8:0/1096573586 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1270014070 con 0x7f1280101340 2023-08-11T12:21:59.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.130+0000 7f1277fff700 1 --2- 172.21.15.8:0/1096573586 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f126c09ff50 0x7f126c0a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:59.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.130+0000 7f1277fff700 1 --2- 172.21.15.8:0/1096573586 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f126c09ff50 0x7f126c0a2410 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f126800b2e0 tx=0x7f1268005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:59.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.134+0000 7f12777fe700 1 -- 172.21.15.8:0/1096573586 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f1270095300 con 0x7f1280101340 2023-08-11T12:21:59.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:58 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:59.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:58 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:59.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:58 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:59.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:58 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:59.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:58 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:59.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:58 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:21:59.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:58 smithi194 ceph-mon[130905]: mds.? [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] up:boot 2023-08-11T12:21:59.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:58 smithi194 ceph-mon[130905]: fsmap 12 up:standby 2023-08-11T12:21:59.146 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:58 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-08-11T12:21:59.146 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:58 smithi194 ceph-mon[130905]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:59.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:58 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:59.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:58 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:59.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:58 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:59.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:58 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:59.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:58 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:21:59.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:58 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:21:59.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:58 smithi045 ceph-mon[130284]: mds.? [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] up:boot 2023-08-11T12:21:59.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:58 smithi045 ceph-mon[130284]: fsmap 12 up:standby 2023-08-11T12:21:59.148 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:58 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-08-11T12:21:59.148 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:58 smithi045 ceph-mon[130284]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:21:59.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.367+0000 7f1284dff700 1 -- 172.21.15.8:0/1096573586 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f128010c100 con 0x7f1280101340 2023-08-11T12:21:59.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.368+0000 7f12777fe700 1 -- 172.21.15.8:0/1096573586 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18282 (secure 0 0 0) 0x7f1270098920 con 0x7f1280101340 2023-08-11T12:21:59.372 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:21:59.372 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":79,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","created":"2023-08-11T12:14:28.341113+0000","modified":"2023-08-11T12:21:15.922685+0000","last_up_change":"2023-08-11T12:21:14.913735+0000","last_in_change":"2023-08-11T12:20:57.476558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-11T12:17:49.040758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f903e393-7894-42d6-8b11-737ceef1f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6803","nonce":664104961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6805","nonce":664104961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6809","nonce":664104961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6807","nonce":664104961}]},"public_addr":"172.21.15.8:6803/664104961","cluster_addr":"172.21.15.8:6805/664104961","heartbeat_back_addr":"172.21.15.8:6809/664104961","heartbeat_front_addr":"172.21.15.8:6807/664104961","state":["exists","up"]},{"osd":1,"uuid":"1e988e5c-e78c-46d5-80a5-dff7ac38cbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6801","nonce":4187350703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6803","nonce":4187350703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6807","nonce":4187350703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6805","nonce":4187350703}]},"public_addr":"172.21.15.45:6801/4187350703","cluster_addr":"172.21.15.45:6803/4187350703","heartbeat_back_addr":"172.21.15.45:6807/4187350703","heartbeat_front_addr":"172.21.15.45:6805/4187350703","state":["exists","up"]},{"osd":2,"uuid":"1835217c-a93c-4181-b8b8-cc410bab1a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6801","nonce":2547818140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6803","nonce":2547818140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6807","nonce":2547818140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6805","nonce":2547818140}]},"public_addr":"172.21.15.194:6801/2547818140","cluster_addr":"172.21.15.194:6803/2547818140","heartbeat_back_addr":"172.21.15.194:6807/2547818140","heartbeat_front_addr":"172.21.15.194:6805/2547818140","state":["exists","up"]},{"osd":3,"uuid":"b55ae61a-731c-4312-a998-661122b84788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6811","nonce":187418883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6813","nonce":187418883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6817","nonce":187418883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6815","nonce":187418883}]},"public_addr":"172.21.15.8:6811/187418883","cluster_addr":"172.21.15.8:6813/187418883","heartbeat_back_addr":"172.21.15.8:6817/187418883","heartbeat_front_addr":"172.21.15.8:6815/187418883","state":["exists","up"]},{"osd":4,"uuid":"2c28acbb-e807-4559-8aa2-a35ca84b5d43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6809","nonce":3099704571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6811","nonce":3099704571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6815","nonce":3099704571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6813","nonce":3099704571}]},"public_addr":"172.21.15.45:6809/3099704571","cluster_addr":"172.21.15.45:6811/3099704571","heartbeat_back_addr":"172.21.15.45:6815/3099704571","heartbeat_front_addr":"172.21.15.45:6813/3099704571","state":["exists","up"]},{"osd":5,"uuid":"37032289-8016-4730-9b69-f7985e058ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6809","nonce":263803874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6811","nonce":263803874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6815","nonce":263803874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6813","nonce":263803874}]},"public_addr":"172.21.15.194:6809/263803874","cluster_addr":"172.21.15.194:6811/263803874","heartbeat_back_addr":"172.21.15.194:6815/263803874","heartbeat_front_addr":"172.21.15.194:6813/263803874","state":["exists","up"]},{"osd":6,"uuid":"32d2dab9-6944-40d1-ada9-4f941821b063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6819","nonce":1802966829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6821","nonce":1802966829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6825","nonce":1802966829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6823","nonce":1802966829}]},"public_addr":"172.21.15.8:6819/1802966829","cluster_addr":"172.21.15.8:6821/1802966829","heartbeat_back_addr":"172.21.15.8:6825/1802966829","heartbeat_front_addr":"172.21.15.8:6823/1802966829","state":["exists","up"]},{"osd":7,"uuid":"086aff58-1554-49fe-92ff-5166b115aeef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6817","nonce":3715737148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6819","nonce":3715737148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6823","nonce":3715737148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6821","nonce":3715737148}]},"public_addr":"172.21.15.45:6817/3715737148","cluster_addr":"172.21.15.45:6819/3715737148","heartbeat_back_addr":"172.21.15.45:6823/3715737148","heartbeat_front_addr":"172.21.15.45:6821/3715737148","state":["exists","up"]},{"osd":8,"uuid":"7fff5e95-2453-4ea6-a5c1-3bba6a1f6400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6817","nonce":57497127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6819","nonce":57497127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6823","nonce":57497127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6821","nonce":57497127}]},"public_addr":"172.21.15.194:6817/57497127","cluster_addr":"172.21.15.194:6819/57497127","heartbeat_back_addr":"172.21.15.194:6823/57497127","heartbeat_front_addr":"172.21.15.194:6821/57497127","state":["exists","up"]},{"osd":9,"uuid":"31ab0121-4c92-42ec-9f19-e672062e8814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6827","nonce":434661930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6829","nonce":434661930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6833","nonce":434661930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6831","nonce":434661930}]},"public_addr":"172.21.15.8:6827/434661930","cluster_addr":"172.21.15.8:6829/434661930","heartbeat_back_addr":"172.21.15.8:6833/434661930","heartbeat_front_addr":"172.21.15.8:6831/434661930","state":["exists","up"]},{"osd":10,"uuid":"62c632e4-94f6-4630-9d94-8d28fccacf45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6825","nonce":3281212184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6827","nonce":3281212184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6831","nonce":3281212184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6829","nonce":3281212184}]},"public_addr":"172.21.15.45:6825/3281212184","cluster_addr":"172.21.15.45:6827/3281212184","heartbeat_back_addr":"172.21.15.45:6831/3281212184","heartbeat_front_addr":"172.21.15.45:6829/3281212184","state":["exists","up"]},{"osd":11,"uuid":"8ca4a80d-cd75-4230-b46d-aef6fdc03e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6825","nonce":1637875895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6827","nonce":1637875895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6831","nonce":1637875895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6829","nonce":1637875895}]},"public_addr":"172.21.15.194:6825/1637875895","cluster_addr":"172.21.15.194:6827/1637875895","heartbeat_back_addr":"172.21.15.194:6831/1637875895","heartbeat_front_addr":"172.21.15.194:6829/1637875895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:04.255616+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:26.243863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:46.630365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:12.926291+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:35.747049+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:55.793767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:21.685725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:43.703215+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:04.043674+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:30.320026+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:52.751974+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:21:13.230024+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/2000592056":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2102228072":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2374527928":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2928221278":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2744750874":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/3681755887":"2023-08-12T12:15:02.528403+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-11T12:21:59.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.372+0000 7f1284dff700 1 -- 172.21.15.8:0/1096573586 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f126c09ff50 msgr2=0x7f126c0a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:59.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.372+0000 7f1284dff700 1 --2- 172.21.15.8:0/1096573586 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f126c09ff50 0x7f126c0a2410 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f126800b2e0 tx=0x7f1268005fb0 comp rx=0 tx=0).stop 2023-08-11T12:21:59.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.372+0000 7f1284dff700 1 -- 172.21.15.8:0/1096573586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1280101340 msgr2=0x7f12801987b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:59.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.372+0000 7f1284dff700 1 --2- 172.21.15.8:0/1096573586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1280101340 0x7f12801987b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f127000e9a0 tx=0x7f127000ecb0 comp rx=0 tx=0).stop 2023-08-11T12:21:59.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.372+0000 7f1284dff700 1 -- 172.21.15.8:0/1096573586 shutdown_connections 2023-08-11T12:21:59.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.372+0000 7f1284dff700 1 --2- 172.21.15.8:0/1096573586 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f126c09ff50 0x7f126c0a2410 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:59.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.372+0000 7f1284dff700 1 --2- 172.21.15.8:0/1096573586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1280101340 0x7f12801987b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:59.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.372+0000 7f1284dff700 1 --2- 172.21.15.8:0/1096573586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12801065a0 0x7f128019fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:59.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.372+0000 7f1284dff700 1 --2- 172.21.15.8:0/1096573586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1280103c70 0x7f1280198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:59.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.372+0000 7f1284dff700 1 -- 172.21.15.8:0/1096573586 >> 172.21.15.8:0/1096573586 conn(0x7f12800fad30 msgr2=0x7f12800ff9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:59.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.372+0000 7f1284dff700 1 -- 172.21.15.8:0/1096573586 shutdown_connections 2023-08-11T12:21:59.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.372+0000 7f1284dff700 1 -- 172.21.15.8:0/1096573586 wait complete. 2023-08-11T12:21:59.394 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-11T12:17:49.040758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-11T12:21:59.395 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-11T12:21:59.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.626+0000 7f223c3ff700 1 -- 172.21.15.8:0/1855577199 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2234074960 msgr2=0x7f2234072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:59.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.626+0000 7f223c3ff700 1 --2- 172.21.15.8:0/1855577199 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2234074960 0x7f2234072db0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2230009990 tx=0x7f2230009ca0 comp rx=0 tx=0).stop 2023-08-11T12:21:59.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.626+0000 7f223c3ff700 1 -- 172.21.15.8:0/1855577199 shutdown_connections 2023-08-11T12:21:59.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.627+0000 7f223c3ff700 1 --2- 172.21.15.8:0/1855577199 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2234074960 0x7f2234072db0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:59.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.627+0000 7f223c3ff700 1 --2- 172.21.15.8:0/1855577199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f223410cfd0 0x7f223410f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:59.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.627+0000 7f223c3ff700 1 --2- 172.21.15.8:0/1855577199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2234073380 0x7f2234073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:59.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.627+0000 7f223c3ff700 1 -- 172.21.15.8:0/1855577199 >> 172.21.15.8:0/1855577199 conn(0x7f22340fbf70 msgr2=0x7f22340fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:59.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.627+0000 7f223c3ff700 1 -- 172.21.15.8:0/1855577199 shutdown_connections 2023-08-11T12:21:59.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.627+0000 7f223c3ff700 1 -- 172.21.15.8:0/1855577199 wait complete. 2023-08-11T12:21:59.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.628+0000 7f223c3ff700 1 Processor -- start 2023-08-11T12:21:59.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.628+0000 7f223c3ff700 1 -- start start 2023-08-11T12:21:59.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.629+0000 7f223c3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2234073380 0x7f223419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:59.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.629+0000 7f223c3ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2234074960 0x7f223419d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:59.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.629+0000 7f223c3ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f223410cfd0 0x7f22341a42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:59.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.629+0000 7f223c3ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22341a4870 con 0x7f223410cfd0 2023-08-11T12:21:59.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.629+0000 7f223c3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22341a49e0 con 0x7f2234073380 2023-08-11T12:21:59.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.629+0000 7f223c3ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22341a4ba0 con 0x7f2234074960 2023-08-11T12:21:59.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.629+0000 7f223a99c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f223410cfd0 0x7f22341a42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:59.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.629+0000 7f223999a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2234074960 0x7f223419d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:59.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.629+0000 7f223a19b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2234073380 0x7f223419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:59.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.629+0000 7f223999a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2234074960 0x7f223419d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:55410/0 (socket says 172.21.15.8:55410) 2023-08-11T12:21:59.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.629+0000 7f223999a700 1 -- 172.21.15.8:0/1711419153 learned_addr learned my addr 172.21.15.8:0/1711419153 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:21:59.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.630+0000 7f223999a700 1 -- 172.21.15.8:0/1711419153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2234073380 msgr2=0x7f223419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:59.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.630+0000 7f223999a700 1 --2- 172.21.15.8:0/1711419153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2234073380 0x7f223419cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:59.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.630+0000 7f223999a700 1 -- 172.21.15.8:0/1711419153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f223410cfd0 msgr2=0x7f22341a42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:59.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.630+0000 7f223999a700 1 --2- 172.21.15.8:0/1711419153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f223410cfd0 0x7f22341a42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:59.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.630+0000 7f223999a700 1 -- 172.21.15.8:0/1711419153 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22300095f0 con 0x7f2234074960 2023-08-11T12:21:59.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.630+0000 7f223999a700 1 --2- 172.21.15.8:0/1711419153 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2234074960 0x7f223419d270 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f222400e970 tx=0x7f222400ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:59.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.630+0000 7f222b7fe700 1 -- 172.21.15.8:0/1711419153 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2224009790 con 0x7f2234074960 2023-08-11T12:21:59.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.630+0000 7f222b7fe700 1 -- 172.21.15.8:0/1711419153 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f222400c7e0 con 0x7f2234074960 2023-08-11T12:21:59.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.630+0000 7f222b7fe700 1 -- 172.21.15.8:0/1711419153 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2224003c70 con 0x7f2234074960 2023-08-11T12:21:59.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.630+0000 7f223c3ff700 1 -- 172.21.15.8:0/1711419153 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22341a4e80 con 0x7f2234074960 2023-08-11T12:21:59.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.630+0000 7f223c3ff700 1 -- 172.21.15.8:0/1711419153 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22341a52a0 con 0x7f2234074960 2023-08-11T12:21:59.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.631+0000 7f223c3ff700 1 -- 172.21.15.8:0/1711419153 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2234102b20 con 0x7f2234074960 2023-08-11T12:21:59.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.633+0000 7f222b7fe700 1 -- 172.21.15.8:0/1711419153 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f222400cc50 con 0x7f2234074960 2023-08-11T12:21:59.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.635+0000 7f222b7fe700 1 --2- 172.21.15.8:0/1711419153 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f222009ffd0 0x7f22200a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:21:59.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.635+0000 7f222b7fe700 1 -- 172.21.15.8:0/1711419153 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2224014070 con 0x7f2234074960 2023-08-11T12:21:59.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.635+0000 7f223a19b700 1 --2- 172.21.15.8:0/1711419153 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f222009ffd0 0x7f22200a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:21:59.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.635+0000 7f223a19b700 1 --2- 172.21.15.8:0/1711419153 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f222009ffd0 0x7f22200a2490 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f223000b2e0 tx=0x7f2230005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:21:59.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.638+0000 7f222b7fe700 1 -- 172.21.15.8:0/1711419153 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f2224095110 con 0x7f2234074960 2023-08-11T12:21:59.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.871+0000 7f223c3ff700 1 -- 172.21.15.8:0/1711419153 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f223402cdc0 con 0x7f2234074960 2023-08-11T12:21:59.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.871+0000 7f222b7fe700 1 -- 172.21.15.8:0/1711419153 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2224003dd0 con 0x7f2234074960 2023-08-11T12:21:59.874 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-08-11T12:21:59.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.874+0000 7f223c3ff700 1 -- 172.21.15.8:0/1711419153 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f222009ffd0 msgr2=0x7f22200a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:59.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.874+0000 7f223c3ff700 1 --2- 172.21.15.8:0/1711419153 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f222009ffd0 0x7f22200a2490 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f223000b2e0 tx=0x7f2230005fb0 comp rx=0 tx=0).stop 2023-08-11T12:21:59.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.874+0000 7f223c3ff700 1 -- 172.21.15.8:0/1711419153 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2234074960 msgr2=0x7f223419d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:21:59.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.874+0000 7f223c3ff700 1 --2- 172.21.15.8:0/1711419153 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2234074960 0x7f223419d270 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f222400e970 tx=0x7f222400ec80 comp rx=0 tx=0).stop 2023-08-11T12:21:59.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.874+0000 7f223c3ff700 1 -- 172.21.15.8:0/1711419153 shutdown_connections 2023-08-11T12:21:59.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.874+0000 7f223c3ff700 1 --2- 172.21.15.8:0/1711419153 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f222009ffd0 0x7f22200a2490 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:59.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.874+0000 7f223c3ff700 1 --2- 172.21.15.8:0/1711419153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f223410cfd0 0x7f22341a42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:59.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.874+0000 7f223c3ff700 1 --2- 172.21.15.8:0/1711419153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2234073380 0x7f223419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:59.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.874+0000 7f223c3ff700 1 --2- 172.21.15.8:0/1711419153 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2234074960 0x7f223419d270 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:21:59.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.874+0000 7f223c3ff700 1 -- 172.21.15.8:0/1711419153 >> 172.21.15.8:0/1711419153 conn(0x7f22340fbf70 msgr2=0x7f22340fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:21:59.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.874+0000 7f223c3ff700 1 -- 172.21.15.8:0/1711419153 shutdown_connections 2023-08-11T12:21:59.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:21:59.874+0000 7f223c3ff700 1 -- 172.21.15.8:0/1711419153 wait complete. 2023-08-11T12:21:59.899 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-11T12:22:00.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:59 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3068271421' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:22:00.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:21:59 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1096573586' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:00.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.111+0000 7f6391dff700 1 -- 172.21.15.8:0/1541232945 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f638c1009f0 msgr2=0x7f638c100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:00.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.111+0000 7f6391dff700 1 --2- 172.21.15.8:0/1541232945 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f638c1009f0 0x7f638c100e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f637c0098f0 tx=0x7f637c009c00 comp rx=0 tx=0).stop 2023-08-11T12:22:00.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.111+0000 7f6391dff700 1 -- 172.21.15.8:0/1541232945 shutdown_connections 2023-08-11T12:22:00.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.111+0000 7f6391dff700 1 --2- 172.21.15.8:0/1541232945 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f638c1009f0 0x7f638c100e10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:00.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.111+0000 7f6391dff700 1 --2- 172.21.15.8:0/1541232945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f638c102580 0x7f638c108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:00.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.111+0000 7f6391dff700 1 --2- 172.21.15.8:0/1541232945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f638c101be0 0x7f638c102040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:00.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.111+0000 7f6391dff700 1 -- 172.21.15.8:0/1541232945 >> 172.21.15.8:0/1541232945 conn(0x7f638c0fbf80 msgr2=0x7f638c0fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:00.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.111+0000 7f6391dff700 1 -- 172.21.15.8:0/1541232945 shutdown_connections 2023-08-11T12:22:00.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.111+0000 7f6391dff700 1 -- 172.21.15.8:0/1541232945 wait complete. 2023-08-11T12:22:00.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.112+0000 7f6391dff700 1 Processor -- start 2023-08-11T12:22:00.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.112+0000 7f6391dff700 1 -- start start 2023-08-11T12:22:00.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.113+0000 7f6391dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f638c1009f0 0x7f638c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:00.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.113+0000 7f6391dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f638c101be0 0x7f638c198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:00.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.113+0000 7f6391dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f638c102580 0x7f638c19ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:00.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.113+0000 7f6391dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c1a04f0 con 0x7f638c102580 2023-08-11T12:22:00.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.113+0000 7f6391dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c1a0630 con 0x7f638c1009f0 2023-08-11T12:22:00.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.113+0000 7f6391dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c1a07c0 con 0x7f638c101be0 2023-08-11T12:22:00.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.113+0000 7f638bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f638c102580 0x7f638c19ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:00.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.113+0000 7f638b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f638c1009f0 0x7f638c198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:00.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.113+0000 7f638bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f638c102580 0x7f638c19ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42988/0 (socket says 172.21.15.8:42988) 2023-08-11T12:22:00.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.113+0000 7f638bfff700 1 -- 172.21.15.8:0/1984706626 learned_addr learned my addr 172.21.15.8:0/1984706626 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:00.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.113+0000 7f638affd700 1 --2- 172.21.15.8:0/1984706626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f638c101be0 0x7f638c198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:00.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.114+0000 7f638b7fe700 1 -- 172.21.15.8:0/1984706626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f638c101be0 msgr2=0x7f638c198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:00.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.114+0000 7f638b7fe700 1 --2- 172.21.15.8:0/1984706626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f638c101be0 0x7f638c198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:00.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.114+0000 7f638b7fe700 1 -- 172.21.15.8:0/1984706626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f638c102580 msgr2=0x7f638c19ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:00.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.114+0000 7f638b7fe700 1 --2- 172.21.15.8:0/1984706626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f638c102580 0x7f638c19ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:00.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.114+0000 7f638b7fe700 1 -- 172.21.15.8:0/1984706626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637c009520 con 0x7f638c1009f0 2023-08-11T12:22:00.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.114+0000 7f638bfff700 1 --2- 172.21.15.8:0/1984706626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f638c102580 0x7f638c19ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:22:00.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.114+0000 7f638b7fe700 1 --2- 172.21.15.8:0/1984706626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f638c1009f0 0x7f638c198970 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f637c000c00 tx=0x7f637c00b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:00.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.114+0000 7f6388ff9700 1 -- 172.21.15.8:0/1984706626 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c01c070 con 0x7f638c1009f0 2023-08-11T12:22:00.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.114+0000 7f6391dff700 1 -- 172.21.15.8:0/1984706626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f638c1a0a40 con 0x7f638c1009f0 2023-08-11T12:22:00.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.114+0000 7f6388ff9700 1 -- 172.21.15.8:0/1984706626 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f637c00f860 con 0x7f638c1009f0 2023-08-11T12:22:00.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.114+0000 7f6388ff9700 1 -- 172.21.15.8:0/1984706626 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c0039b0 con 0x7f638c1009f0 2023-08-11T12:22:00.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.114+0000 7f6391dff700 1 -- 172.21.15.8:0/1984706626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f638c1a0ec0 con 0x7f638c1009f0 2023-08-11T12:22:00.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.115+0000 7f6391dff700 1 -- 172.21.15.8:0/1984706626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f638c193040 con 0x7f638c1009f0 2023-08-11T12:22:00.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.117+0000 7f6388ff9700 1 -- 172.21.15.8:0/1984706626 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f637c020030 con 0x7f638c1009f0 2023-08-11T12:22:00.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.119+0000 7f6388ff9700 1 --2- 172.21.15.8:0/1984706626 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f637409ff50 0x7f63740a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:00.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.119+0000 7f6388ff9700 1 -- 172.21.15.8:0/1984706626 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f637c0cc170 con 0x7f638c1009f0 2023-08-11T12:22:00.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.119+0000 7f638affd700 1 --2- 172.21.15.8:0/1984706626 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f637409ff50 0x7f63740a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:00.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.120+0000 7f638affd700 1 --2- 172.21.15.8:0/1984706626 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f637409ff50 0x7f63740a2410 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6380005fd0 tx=0x7f6380009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:00.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.121+0000 7f6388ff9700 1 -- 172.21.15.8:0/1984706626 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f637c096390 con 0x7f638c1009f0 2023-08-11T12:22:00.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:59 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3068271421' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:22:00.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:21:59 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1096573586' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:00.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:59 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3068271421' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:22:00.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:21:59 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1096573586' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.346+0000 7f6391dff700 1 -- 172.21.15.8:0/1984706626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f638c10c250 con 0x7f638c1009f0 2023-08-11T12:22:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.347+0000 7f6388ff9700 1 -- 172.21.15.8:0/1984706626 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) v1 ==== 84+0+65 (secure 0 0 0) 0x7f637c0999b0 con 0x7f638c1009f0 2023-08-11T12:22:00.350 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:22:00.350 INFO:teuthology.orchestra.run.smithi008.stdout:[ 2023-08-11T12:22:00.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:22:00.350 INFO:teuthology.orchestra.run.smithi008.stdout: "poolnum": 1, 2023-08-11T12:22:00.350 INFO:teuthology.orchestra.run.smithi008.stdout: "poolname": ".mgr" 2023-08-11T12:22:00.351 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:22:00.351 INFO:teuthology.orchestra.run.smithi008.stdout:] 2023-08-11T12:22:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.350+0000 7f6391dff700 1 -- 172.21.15.8:0/1984706626 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f637409ff50 msgr2=0x7f63740a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.350+0000 7f6391dff700 1 --2- 172.21.15.8:0/1984706626 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f637409ff50 0x7f63740a2410 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6380005fd0 tx=0x7f6380009310 comp rx=0 tx=0).stop 2023-08-11T12:22:00.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.351+0000 7f6391dff700 1 -- 172.21.15.8:0/1984706626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f638c1009f0 msgr2=0x7f638c198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:00.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.351+0000 7f6391dff700 1 --2- 172.21.15.8:0/1984706626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f638c1009f0 0x7f638c198970 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f637c000c00 tx=0x7f637c00b790 comp rx=0 tx=0).stop 2023-08-11T12:22:00.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.351+0000 7f6391dff700 1 -- 172.21.15.8:0/1984706626 shutdown_connections 2023-08-11T12:22:00.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.351+0000 7f6391dff700 1 --2- 172.21.15.8:0/1984706626 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f637409ff50 0x7f63740a2410 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.351+0000 7f6391dff700 1 --2- 172.21.15.8:0/1984706626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f638c102580 0x7f638c19ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.351+0000 7f6391dff700 1 --2- 172.21.15.8:0/1984706626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f638c1009f0 0x7f638c198970 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.351+0000 7f6391dff700 1 --2- 172.21.15.8:0/1984706626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f638c101be0 0x7f638c198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.351+0000 7f6391dff700 1 -- 172.21.15.8:0/1984706626 >> 172.21.15.8:0/1984706626 conn(0x7f638c0fbf80 msgr2=0x7f638c107510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.351+0000 7f6391dff700 1 -- 172.21.15.8:0/1984706626 shutdown_connections 2023-08-11T12:22:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.352+0000 7f6391dff700 1 -- 172.21.15.8:0/1984706626 wait complete. 2023-08-11T12:22:00.378 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-11T12:22:00.379 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-11T12:22:00.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.597+0000 7fecee3ff700 1 -- 172.21.15.8:0/3318916699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fece8074960 msgr2=0x7fece8072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:00.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.597+0000 7fecee3ff700 1 --2- 172.21.15.8:0/3318916699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fece8074960 0x7fece8072db0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fecd8009990 tx=0x7fecd8009ca0 comp rx=0 tx=0).stop 2023-08-11T12:22:00.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.597+0000 7fecee3ff700 1 -- 172.21.15.8:0/3318916699 shutdown_connections 2023-08-11T12:22:00.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.597+0000 7fecee3ff700 1 --2- 172.21.15.8:0/3318916699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fece8074960 0x7fece8072db0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:00.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.597+0000 7fecee3ff700 1 --2- 172.21.15.8:0/3318916699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece81088d0 0x7fece810ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:00.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.597+0000 7fecee3ff700 1 --2- 172.21.15.8:0/3318916699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fece8073380 0x7fece8073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:00.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.597+0000 7fecee3ff700 1 -- 172.21.15.8:0/3318916699 >> 172.21.15.8:0/3318916699 conn(0x7fece80fbf80 msgr2=0x7fece80fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:00.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.597+0000 7fecee3ff700 1 -- 172.21.15.8:0/3318916699 shutdown_connections 2023-08-11T12:22:00.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.597+0000 7fecee3ff700 1 -- 172.21.15.8:0/3318916699 wait complete. 2023-08-11T12:22:00.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.598+0000 7fecee3ff700 1 Processor -- start 2023-08-11T12:22:00.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.599+0000 7fecee3ff700 1 -- start start 2023-08-11T12:22:00.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.599+0000 7fecee3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece8073380 0x7fece81988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:00.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.599+0000 7fecee3ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fece8074960 0x7fece8198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:00.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.599+0000 7fecee3ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fece81088d0 0x7fece819fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:00.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.599+0000 7fecee3ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece81a0420 con 0x7fece8074960 2023-08-11T12:22:00.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.599+0000 7fecee3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece81a0560 con 0x7fece8073380 2023-08-11T12:22:00.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.599+0000 7fecee3ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece81a06f0 con 0x7fece81088d0 2023-08-11T12:22:00.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.599+0000 7fece7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece8073380 0x7fece81988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:00.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.599+0000 7fece7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece8073380 0x7fece81988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:55210/0 (socket says 172.21.15.8:55210) 2023-08-11T12:22:00.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.599+0000 7fece7fff700 1 -- 172.21.15.8:0/3048471465 learned_addr learned my addr 172.21.15.8:0/3048471465 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:00.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.599+0000 7fece77fe700 1 --2- 172.21.15.8:0/3048471465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fece8074960 0x7fece8198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:00.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.599+0000 7fecec99c700 1 --2- 172.21.15.8:0/3048471465 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fece81088d0 0x7fece819fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:00.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.600+0000 7fece7fff700 1 -- 172.21.15.8:0/3048471465 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fece81088d0 msgr2=0x7fece819fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:00.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.600+0000 7fece7fff700 1 --2- 172.21.15.8:0/3048471465 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fece81088d0 0x7fece819fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:00.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.600+0000 7fece7fff700 1 -- 172.21.15.8:0/3048471465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fece8074960 msgr2=0x7fece8198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:00.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.600+0000 7fece7fff700 1 --2- 172.21.15.8:0/3048471465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fece8074960 0x7fece8198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:00.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.600+0000 7fece7fff700 1 -- 172.21.15.8:0/3048471465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd80095f0 con 0x7fece8073380 2023-08-11T12:22:00.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.600+0000 7fece77fe700 1 --2- 172.21.15.8:0/3048471465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fece8074960 0x7fece8198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:22:00.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.600+0000 7fece7fff700 1 --2- 172.21.15.8:0/3048471465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece8073380 0x7fece81988a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fecd8000c00 tx=0x7fecd80057a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:00.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.600+0000 7fece57fa700 1 -- 172.21.15.8:0/3048471465 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd801d070 con 0x7fece8073380 2023-08-11T12:22:00.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.600+0000 7fecee3ff700 1 -- 172.21.15.8:0/3048471465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece81a0970 con 0x7fece8073380 2023-08-11T12:22:00.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.600+0000 7fece57fa700 1 -- 172.21.15.8:0/3048471465 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fecd800fb90 con 0x7fece8073380 2023-08-11T12:22:00.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.600+0000 7fece57fa700 1 -- 172.21.15.8:0/3048471465 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd80173f0 con 0x7fece8073380 2023-08-11T12:22:00.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.601+0000 7fecee3ff700 1 -- 172.21.15.8:0/3048471465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece81a0e70 con 0x7fece8073380 2023-08-11T12:22:00.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.602+0000 7fecee3ff700 1 -- 172.21.15.8:0/3048471465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece8106f80 con 0x7fece8073380 2023-08-11T12:22:00.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.604+0000 7fece57fa700 1 -- 172.21.15.8:0/3048471465 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fecd8021410 con 0x7fece8073380 2023-08-11T12:22:00.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.605+0000 7fece57fa700 1 --2- 172.21.15.8:0/3048471465 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fecd009ff50 0x7fecd00a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:00.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.605+0000 7fece57fa700 1 -- 172.21.15.8:0/3048471465 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fecd80cc330 con 0x7fece8073380 2023-08-11T12:22:00.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.605+0000 7fece77fe700 1 --2- 172.21.15.8:0/3048471465 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fecd009ff50 0x7fecd00a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:00.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.606+0000 7fece77fe700 1 --2- 172.21.15.8:0/3048471465 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fecd009ff50 0x7fecd00a2410 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fece8074680 tx=0x7fecdc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:00.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.608+0000 7fece57fa700 1 -- 172.21.15.8:0/3048471465 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fecd8096670 con 0x7fece8073380 2023-08-11T12:22:00.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:00.843+0000 7fecee3ff700 1 -- 172.21.15.8:0/3048471465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fece810e400 con 0x7fece8073380 2023-08-11T12:22:01.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:00 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1711419153' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:22:01.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:00 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1984706626' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-08-11T12:22:01.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:00 smithi008 ceph-mon[97158]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:22:01.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:00 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:01.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:00 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1711419153' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:22:01.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:00 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1984706626' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-08-11T12:22:01.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:00 smithi194 ceph-mon[130905]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:22:01.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:00 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:01.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:00 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1711419153' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:22:01.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:00 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1984706626' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-08-11T12:22:01.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:00 smithi045 ceph-mon[130284]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:22:01.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:00 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:01.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:01.814+0000 7fece57fa700 1 -- 172.21.15.8:0/3048471465 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v80) v1 ==== 138+0+0 (secure 0 0 0) 0x7fecd8099c90 con 0x7fece8073380 2023-08-11T12:22:01.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:01.819+0000 7fecee3ff700 1 -- 172.21.15.8:0/3048471465 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fecd009ff50 msgr2=0x7fecd00a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:01.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:01.819+0000 7fecee3ff700 1 --2- 172.21.15.8:0/3048471465 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fecd009ff50 0x7fecd00a2410 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fece8074680 tx=0x7fecdc009260 comp rx=0 tx=0).stop 2023-08-11T12:22:01.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:01.819+0000 7fecee3ff700 1 -- 172.21.15.8:0/3048471465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece8073380 msgr2=0x7fece81988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:01.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:01.819+0000 7fecee3ff700 1 --2- 172.21.15.8:0/3048471465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece8073380 0x7fece81988a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fecd8000c00 tx=0x7fecd80057a0 comp rx=0 tx=0).stop 2023-08-11T12:22:01.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:01.820+0000 7fecee3ff700 1 -- 172.21.15.8:0/3048471465 shutdown_connections 2023-08-11T12:22:01.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:01.820+0000 7fecee3ff700 1 --2- 172.21.15.8:0/3048471465 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fecd009ff50 0x7fecd00a2410 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:01.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:01.820+0000 7fecee3ff700 1 --2- 172.21.15.8:0/3048471465 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fece81088d0 0x7fece819fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:01.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:01.820+0000 7fecee3ff700 1 --2- 172.21.15.8:0/3048471465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece8073380 0x7fece81988a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:01.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:01.820+0000 7fecee3ff700 1 --2- 172.21.15.8:0/3048471465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fece8074960 0x7fece8198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:01.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:01.820+0000 7fecee3ff700 1 -- 172.21.15.8:0/3048471465 >> 172.21.15.8:0/3048471465 conn(0x7fece80fbf80 msgr2=0x7fece80fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:01.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:01.820+0000 7fecee3ff700 1 -- 172.21.15.8:0/3048471465 shutdown_connections 2023-08-11T12:22:01.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:01.820+0000 7fecee3ff700 1 -- 172.21.15.8:0/3048471465 wait complete. 2023-08-11T12:22:01.825 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_metadata' created 2023-08-11T12:22:01.844 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-08-11T12:22:02.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:01 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:02.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:01 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:02.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:01 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:02.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:01 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:02.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:01 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3048471465' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-08-11T12:22:02.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:01 smithi008 ceph-mon[97158]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-08-11T12:22:02.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.056+0000 7fe5bfbff700 1 -- 172.21.15.8:0/2792745514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b8100a10 msgr2=0x7fe5b8100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:02.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.056+0000 7fe5bfbff700 1 --2- 172.21.15.8:0/2792745514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b8100a10 0x7fe5b8100e30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe5b40099c0 tx=0x7fe5b4009cd0 comp rx=0 tx=0).stop 2023-08-11T12:22:02.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.056+0000 7fe5bfbff700 1 -- 172.21.15.8:0/2792745514 shutdown_connections 2023-08-11T12:22:02.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.056+0000 7fe5bfbff700 1 --2- 172.21.15.8:0/2792745514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5b81025a0 0x7fe5b8108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:02.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.056+0000 7fe5bfbff700 1 --2- 172.21.15.8:0/2792745514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b8100a10 0x7fe5b8100e30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:02.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.056+0000 7fe5bfbff700 1 --2- 172.21.15.8:0/2792745514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5b8101c00 0x7fe5b8102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:02.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.056+0000 7fe5bfbff700 1 -- 172.21.15.8:0/2792745514 >> 172.21.15.8:0/2792745514 conn(0x7fe5b80fbf80 msgr2=0x7fe5b80fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:02.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.057+0000 7fe5bfbff700 1 -- 172.21.15.8:0/2792745514 shutdown_connections 2023-08-11T12:22:02.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.057+0000 7fe5bfbff700 1 -- 172.21.15.8:0/2792745514 wait complete. 2023-08-11T12:22:02.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.058+0000 7fe5bfbff700 1 Processor -- start 2023-08-11T12:22:02.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.058+0000 7fe5bfbff700 1 -- start start 2023-08-11T12:22:02.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.058+0000 7fe5bfbff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5b8100a10 0x7fe5b8196710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:02.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.058+0000 7fe5bfbff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5b8101c00 0x7fe5b8196c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:02.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.058+0000 7fe5bfbff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b81025a0 0x7fe5b819dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:02.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.058+0000 7fe5bfbff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b819e290 con 0x7fe5b81025a0 2023-08-11T12:22:02.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.058+0000 7fe5bfbff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b819e3d0 con 0x7fe5b8100a10 2023-08-11T12:22:02.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.058+0000 7fe5bfbff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b819e560 con 0x7fe5b8101c00 2023-08-11T12:22:02.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.058+0000 7fe5bd99b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5b8100a10 0x7fe5b8196710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:02.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.058+0000 7fe5be19c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b81025a0 0x7fe5b819dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:02.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.058+0000 7fe5bd99b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5b8100a10 0x7fe5b8196710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:55230/0 (socket says 172.21.15.8:55230) 2023-08-11T12:22:02.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.058+0000 7fe5bd99b700 1 -- 172.21.15.8:0/2627390593 learned_addr learned my addr 172.21.15.8:0/2627390593 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:02.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.058+0000 7fe5bd19a700 1 --2- 172.21.15.8:0/2627390593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5b8101c00 0x7fe5b8196c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:02.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.059+0000 7fe5bd99b700 1 -- 172.21.15.8:0/2627390593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5b8101c00 msgr2=0x7fe5b8196c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:02.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.059+0000 7fe5bd99b700 1 --2- 172.21.15.8:0/2627390593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5b8101c00 0x7fe5b8196c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:02.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.059+0000 7fe5bd99b700 1 -- 172.21.15.8:0/2627390593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b81025a0 msgr2=0x7fe5b819dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:02.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.059+0000 7fe5bd99b700 1 --2- 172.21.15.8:0/2627390593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b81025a0 0x7fe5b819dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:02.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.059+0000 7fe5bd99b700 1 -- 172.21.15.8:0/2627390593 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b40095f0 con 0x7fe5b8100a10 2023-08-11T12:22:02.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.059+0000 7fe5be19c700 1 --2- 172.21.15.8:0/2627390593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b81025a0 0x7fe5b819dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:22:02.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.059+0000 7fe5bd99b700 1 --2- 172.21.15.8:0/2627390593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5b8100a10 0x7fe5b8196710 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4009f50 tx=0x7fe5b4005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:02.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.059+0000 7fe5aeffd700 1 -- 172.21.15.8:0/2627390593 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b401d070 con 0x7fe5b8100a10 2023-08-11T12:22:02.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.059+0000 7fe5bfbff700 1 -- 172.21.15.8:0/2627390593 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b819e7e0 con 0x7fe5b8100a10 2023-08-11T12:22:02.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.059+0000 7fe5aeffd700 1 -- 172.21.15.8:0/2627390593 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe5b4003f90 con 0x7fe5b8100a10 2023-08-11T12:22:02.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.059+0000 7fe5aeffd700 1 -- 172.21.15.8:0/2627390593 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4022d00 con 0x7fe5b8100a10 2023-08-11T12:22:02.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.060+0000 7fe5bfbff700 1 -- 172.21.15.8:0/2627390593 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b819ec60 con 0x7fe5b8100a10 2023-08-11T12:22:02.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.060+0000 7fe5bfbff700 1 -- 172.21.15.8:0/2627390593 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b810c270 con 0x7fe5b8100a10 2023-08-11T12:22:02.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.063+0000 7fe5aeffd700 1 -- 172.21.15.8:0/2627390593 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fe5b4022470 con 0x7fe5b8100a10 2023-08-11T12:22:02.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.064+0000 7fe5aeffd700 1 --2- 172.21.15.8:0/2627390593 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe5a409ff50 0x7fe5a40a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:02.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.064+0000 7fe5aeffd700 1 -- 172.21.15.8:0/2627390593 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7497+0+0 (secure 0 0 0) 0x7fe5b40cc8b0 con 0x7fe5b8100a10 2023-08-11T12:22:02.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.064+0000 7fe5bd19a700 1 --2- 172.21.15.8:0/2627390593 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe5a409ff50 0x7fe5a40a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:02.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.065+0000 7fe5bd19a700 1 --2- 172.21.15.8:0/2627390593 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe5a409ff50 0x7fe5a40a2410 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8007c60 tx=0x7fe5a80073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:02.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.066+0000 7fe5aeffd700 1 -- 172.21.15.8:0/2627390593 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fe5b4096960 con 0x7fe5b8100a10 2023-08-11T12:22:02.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:01 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:02.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:01 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:02.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:01 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:02.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:01 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:02.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:01 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3048471465' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-08-11T12:22:02.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:01 smithi194 ceph-mon[130905]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-08-11T12:22:02.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:01 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:02.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:01 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:02.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:01 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:02.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:01 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:02.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:01 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3048471465' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-08-11T12:22:02.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:01 smithi045 ceph-mon[130284]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-08-11T12:22:02.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.290+0000 7fe5bfbff700 1 -- 172.21.15.8:0/2627390593 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fe5b81078f0 con 0x7fe5b8100a10 2023-08-11T12:22:02.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.827+0000 7fe5aeffd700 1 -- 172.21.15.8:0/2627390593 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v81) v1 ==== 171+0+0 (secure 0 0 0) 0x7fe5b4022e60 con 0x7fe5b8100a10 2023-08-11T12:22:02.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.833+0000 7fe5bfbff700 1 -- 172.21.15.8:0/2627390593 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe5a409ff50 msgr2=0x7fe5a40a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:02.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.833+0000 7fe5bfbff700 1 --2- 172.21.15.8:0/2627390593 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe5a409ff50 0x7fe5a40a2410 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8007c60 tx=0x7fe5a80073d0 comp rx=0 tx=0).stop 2023-08-11T12:22:02.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.833+0000 7fe5bfbff700 1 -- 172.21.15.8:0/2627390593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5b8100a10 msgr2=0x7fe5b8196710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:02.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.833+0000 7fe5bfbff700 1 --2- 172.21.15.8:0/2627390593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5b8100a10 0x7fe5b8196710 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4009f50 tx=0x7fe5b4005740 comp rx=0 tx=0).stop 2023-08-11T12:22:02.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.837+0000 7fe5bfbff700 1 -- 172.21.15.8:0/2627390593 shutdown_connections 2023-08-11T12:22:02.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.837+0000 7fe5bfbff700 1 --2- 172.21.15.8:0/2627390593 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe5a409ff50 0x7fe5a40a2410 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:02.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.837+0000 7fe5bfbff700 1 --2- 172.21.15.8:0/2627390593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b81025a0 0x7fe5b819dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:02.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.837+0000 7fe5bfbff700 1 --2- 172.21.15.8:0/2627390593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5b8100a10 0x7fe5b8196710 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:02.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.837+0000 7fe5bfbff700 1 --2- 172.21.15.8:0/2627390593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5b8101c00 0x7fe5b8196c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:02.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.837+0000 7fe5bfbff700 1 -- 172.21.15.8:0/2627390593 >> 172.21.15.8:0/2627390593 conn(0x7fe5b80fbf80 msgr2=0x7fe5b80fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:02.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.839+0000 7fe5bfbff700 1 -- 172.21.15.8:0/2627390593 shutdown_connections 2023-08-11T12:22:02.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:02.843+0000 7fe5bfbff700 1 -- 172.21.15.8:0/2627390593 wait complete. 2023-08-11T12:22:02.850 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data' created 2023-08-11T12:22:02.869 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-11T12:22:03.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.082+0000 7f11527ff700 1 -- 172.21.15.8:0/2384709504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f114c102590 msgr2=0x7f114c108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:03.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.082+0000 7f11527ff700 1 --2- 172.21.15.8:0/2384709504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f114c102590 0x7f114c108e40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1144009fc0 tx=0x7f114400b330 comp rx=0 tx=0).stop 2023-08-11T12:22:03.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.082+0000 7f11527ff700 1 -- 172.21.15.8:0/2384709504 shutdown_connections 2023-08-11T12:22:03.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.082+0000 7f11527ff700 1 --2- 172.21.15.8:0/2384709504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f114c100a00 0x7f114c100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:03.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.082+0000 7f11527ff700 1 --2- 172.21.15.8:0/2384709504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f114c102590 0x7f114c108e40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:03.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.082+0000 7f11527ff700 1 --2- 172.21.15.8:0/2384709504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f114c101bf0 0x7f114c102050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:03.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.082+0000 7f11527ff700 1 -- 172.21.15.8:0/2384709504 >> 172.21.15.8:0/2384709504 conn(0x7f114c0fbf70 msgr2=0x7f114c0fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:03.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.083+0000 7f11527ff700 1 -- 172.21.15.8:0/2384709504 shutdown_connections 2023-08-11T12:22:03.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.083+0000 7f11527ff700 1 -- 172.21.15.8:0/2384709504 wait complete. 2023-08-11T12:22:03.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.083+0000 7f11527ff700 1 Processor -- start 2023-08-11T12:22:03.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.084+0000 7f11527ff700 1 -- start start 2023-08-11T12:22:03.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.084+0000 7f11527ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f114c100a00 0x7f114c198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:03.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.084+0000 7f11527ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f114c101bf0 0x7f114c198f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:03.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.084+0000 7f11527ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f114c102590 0x7f114c19ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:03.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.084+0000 7f11527ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114c1a0580 con 0x7f114c102590 2023-08-11T12:22:03.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.084+0000 7f11527ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114c1a06c0 con 0x7f114c100a00 2023-08-11T12:22:03.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.084+0000 7f11527ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114c1a0850 con 0x7f114c101bf0 2023-08-11T12:22:03.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.084+0000 7f114bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f114c100a00 0x7f114c198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:03.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.084+0000 7f114bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f114c100a00 0x7f114c198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:55250/0 (socket says 172.21.15.8:55250) 2023-08-11T12:22:03.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.084+0000 7f114bfff700 1 -- 172.21.15.8:0/3961381301 learned_addr learned my addr 172.21.15.8:0/3961381301 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:03.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.084+0000 7f1150d9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f114c102590 0x7f114c19ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:03.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.084+0000 7f114b7fe700 1 --2- 172.21.15.8:0/3961381301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f114c101bf0 0x7f114c198f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:03.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.085+0000 7f114bfff700 1 -- 172.21.15.8:0/3961381301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f114c101bf0 msgr2=0x7f114c198f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:03.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.085+0000 7f114bfff700 1 --2- 172.21.15.8:0/3961381301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f114c101bf0 0x7f114c198f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:03.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.085+0000 7f114bfff700 1 -- 172.21.15.8:0/3961381301 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f114c102590 msgr2=0x7f114c19ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:03.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.085+0000 7f114bfff700 1 --2- 172.21.15.8:0/3961381301 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f114c102590 0x7f114c19ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:03.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.085+0000 7f114bfff700 1 -- 172.21.15.8:0/3961381301 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1144009c40 con 0x7f114c100a00 2023-08-11T12:22:03.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.085+0000 7f1150d9c700 1 --2- 172.21.15.8:0/3961381301 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f114c102590 0x7f114c19ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:22:03.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.085+0000 7f114b7fe700 1 --2- 172.21.15.8:0/3961381301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f114c101bf0 0x7f114c198f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:22:03.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.085+0000 7f114bfff700 1 --2- 172.21.15.8:0/3961381301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f114c100a00 0x7f114c198a00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f113c00c5d0 tx=0x7f113c00c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:03.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.085+0000 7f11497fa700 1 -- 172.21.15.8:0/3961381301 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c009e90 con 0x7f114c100a00 2023-08-11T12:22:03.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.085+0000 7f11497fa700 1 -- 172.21.15.8:0/3961381301 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f113c0044e0 con 0x7f114c100a00 2023-08-11T12:22:03.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.085+0000 7f11497fa700 1 -- 172.21.15.8:0/3961381301 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c01e690 con 0x7f114c100a00 2023-08-11T12:22:03.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.085+0000 7f11527ff700 1 -- 172.21.15.8:0/3961381301 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f114c102e70 con 0x7f114c100a00 2023-08-11T12:22:03.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.085+0000 7f11527ff700 1 -- 172.21.15.8:0/3961381301 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f114c103330 con 0x7f114c100a00 2023-08-11T12:22:03.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.086+0000 7f11527ff700 1 -- 172.21.15.8:0/3961381301 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f114c10c270 con 0x7f114c100a00 2023-08-11T12:22:03.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.088+0000 7f11497fa700 1 -- 172.21.15.8:0/3961381301 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f113c003ee0 con 0x7f114c100a00 2023-08-11T12:22:03.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.090+0000 7f11497fa700 1 --2- 172.21.15.8:0/3961381301 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f113409ff50 0x7f11340a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:03.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.090+0000 7f11497fa700 1 -- 172.21.15.8:0/3961381301 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f113c0d34b0 con 0x7f114c100a00 2023-08-11T12:22:03.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.090+0000 7f114b7fe700 1 --2- 172.21.15.8:0/3961381301 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f113409ff50 0x7f11340a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:03.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.090+0000 7f114b7fe700 1 --2- 172.21.15.8:0/3961381301 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f113409ff50 0x7f11340a2410 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1140005fd0 tx=0x7f1140009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:03.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.092+0000 7f11497fa700 1 -- 172.21.15.8:0/3961381301 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f113c09d3e0 con 0x7f114c100a00 2023-08-11T12:22:03.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:02 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:03.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:02 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:03.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:02 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:22:03.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:02 smithi194 ceph-mon[130905]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-08-11T12:22:03.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:02 smithi194 ceph-mon[130905]: osdmap e80: 12 total, 12 up, 12 in 2023-08-11T12:22:03.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:02 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:22:03.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:02 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:03.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:02 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:22:03.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:02 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2627390593' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-08-11T12:22:03.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:02 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:03.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:02 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:03.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:02 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:22:03.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:02 smithi045 ceph-mon[130284]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-08-11T12:22:03.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:02 smithi045 ceph-mon[130284]: osdmap e80: 12 total, 12 up, 12 in 2023-08-11T12:22:03.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:02 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:22:03.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:02 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:03.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:02 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:22:03.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:02 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2627390593' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-08-11T12:22:03.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:02 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:03.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:02 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:03.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:02 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:22:03.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:02 smithi008 ceph-mon[97158]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-08-11T12:22:03.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:02 smithi008 ceph-mon[97158]: osdmap e80: 12 total, 12 up, 12 in 2023-08-11T12:22:03.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:02 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:22:03.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:02 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:03.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:02 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:22:03.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:02 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2627390593' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-08-11T12:22:03.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.395+0000 7f11527ff700 1 -- 172.21.15.8:0/3961381301 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f114c103610 con 0x7f114c100a00 2023-08-11T12:22:03.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.854+0000 7f11497fa700 1 -- 172.21.15.8:0/3961381301 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f113c0a0a00 con 0x7f114c100a00 2023-08-11T12:22:03.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.858+0000 7f11527ff700 1 -- 172.21.15.8:0/3961381301 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f113409ff50 msgr2=0x7f11340a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:03.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.858+0000 7f11527ff700 1 --2- 172.21.15.8:0/3961381301 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f113409ff50 0x7f11340a2410 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1140005fd0 tx=0x7f1140009310 comp rx=0 tx=0).stop 2023-08-11T12:22:03.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.858+0000 7f11527ff700 1 -- 172.21.15.8:0/3961381301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f114c100a00 msgr2=0x7f114c198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:03.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.858+0000 7f11527ff700 1 --2- 172.21.15.8:0/3961381301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f114c100a00 0x7f114c198a00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f113c00c5d0 tx=0x7f113c00c8e0 comp rx=0 tx=0).stop 2023-08-11T12:22:03.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.859+0000 7f11527ff700 1 -- 172.21.15.8:0/3961381301 shutdown_connections 2023-08-11T12:22:03.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.859+0000 7f11527ff700 1 --2- 172.21.15.8:0/3961381301 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f113409ff50 0x7f11340a2410 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:03.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.859+0000 7f11527ff700 1 --2- 172.21.15.8:0/3961381301 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f114c102590 0x7f114c19ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:03.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.859+0000 7f11527ff700 1 --2- 172.21.15.8:0/3961381301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f114c100a00 0x7f114c198a00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:03.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.859+0000 7f11527ff700 1 --2- 172.21.15.8:0/3961381301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f114c101bf0 0x7f114c198f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:03.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.859+0000 7f11527ff700 1 -- 172.21.15.8:0/3961381301 >> 172.21.15.8:0/3961381301 conn(0x7f114c0fbf70 msgr2=0x7f114c107490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:03.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.859+0000 7f11527ff700 1 -- 172.21.15.8:0/3961381301 shutdown_connections 2023-08-11T12:22:03.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:03.860+0000 7f11527ff700 1 -- 172.21.15.8:0/3961381301 wait complete. 2023-08-11T12:22:03.865 INFO:teuthology.orchestra.run.smithi008.stderr:new fs with metadata pool 2 and data pool 3 2023-08-11T12:22:03.882 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-08-11T12:22:03.883 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-08-11T12:22:04.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.112+0000 7f3d1c5ff700 1 -- 172.21.15.8:0/759578564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d14100a00 msgr2=0x7f3d14100e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:04.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.112+0000 7f3d1c5ff700 1 --2- 172.21.15.8:0/759578564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d14100a00 0x7f3d14100e20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3d100099c0 tx=0x7f3d10009cd0 comp rx=0 tx=0).stop 2023-08-11T12:22:04.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.112+0000 7f3d1c5ff700 1 -- 172.21.15.8:0/759578564 shutdown_connections 2023-08-11T12:22:04.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.112+0000 7f3d1c5ff700 1 --2- 172.21.15.8:0/759578564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d14102590 0x7f3d14108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:04.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.112+0000 7f3d1c5ff700 1 --2- 172.21.15.8:0/759578564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d14100a00 0x7f3d14100e20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:04.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.112+0000 7f3d1c5ff700 1 --2- 172.21.15.8:0/759578564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d14101bf0 0x7f3d14102050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:04.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.112+0000 7f3d1c5ff700 1 -- 172.21.15.8:0/759578564 >> 172.21.15.8:0/759578564 conn(0x7f3d140fbf70 msgr2=0x7f3d140fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:04.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.112+0000 7f3d1c5ff700 1 -- 172.21.15.8:0/759578564 shutdown_connections 2023-08-11T12:22:04.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.112+0000 7f3d1c5ff700 1 -- 172.21.15.8:0/759578564 wait complete. 2023-08-11T12:22:04.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.113+0000 7f3d1c5ff700 1 Processor -- start 2023-08-11T12:22:04.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.113+0000 7f3d1c5ff700 1 -- start start 2023-08-11T12:22:04.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.113+0000 7f3d1c5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d14100a00 0x7f3d14198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:04.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.113+0000 7f3d1c5ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d14101bf0 0x7f3d14198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:04.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.113+0000 7f3d1c5ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d14102590 0x7f3d1419fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:04.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.114+0000 7f3d1c5ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d141a04a0 con 0x7f3d14102590 2023-08-11T12:22:04.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.114+0000 7f3d1c5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d141a05e0 con 0x7f3d14100a00 2023-08-11T12:22:04.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.114+0000 7f3d1c5ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d141a0770 con 0x7f3d14101bf0 2023-08-11T12:22:04.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.114+0000 7f3d19b9a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d14101bf0 0x7f3d14198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:04.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.114+0000 7f3d1a39b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d14100a00 0x7f3d14198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:04.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.114+0000 7f3d19b9a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d14101bf0 0x7f3d14198e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:55506/0 (socket says 172.21.15.8:55506) 2023-08-11T12:22:04.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.114+0000 7f3d19b9a700 1 -- 172.21.15.8:0/2158620847 learned_addr learned my addr 172.21.15.8:0/2158620847 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:04.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.114+0000 7f3d1ab9c700 1 --2- 172.21.15.8:0/2158620847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d14102590 0x7f3d1419fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:04.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.114+0000 7f3d19b9a700 1 -- 172.21.15.8:0/2158620847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d14100a00 msgr2=0x7f3d14198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:04.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.114+0000 7f3d19b9a700 1 --2- 172.21.15.8:0/2158620847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d14100a00 0x7f3d14198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:04.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.114+0000 7f3d19b9a700 1 -- 172.21.15.8:0/2158620847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d14102590 msgr2=0x7f3d1419fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:04.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.114+0000 7f3d19b9a700 1 --2- 172.21.15.8:0/2158620847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d14102590 0x7f3d1419fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:04.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.114+0000 7f3d19b9a700 1 -- 172.21.15.8:0/2158620847 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d100095f0 con 0x7f3d14101bf0 2023-08-11T12:22:04.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.114+0000 7f3d1ab9c700 1 --2- 172.21.15.8:0/2158620847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d14102590 0x7f3d1419fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:22:04.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.114+0000 7f3d1a39b700 1 --2- 172.21.15.8:0/2158620847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d14100a00 0x7f3d14198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:22:04.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.114+0000 7f3d19b9a700 1 --2- 172.21.15.8:0/2158620847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d14101bf0 0x7f3d14198e60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400e9a0 tx=0x7f3d0400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:04.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.115+0000 7f3d0b7fe700 1 -- 172.21.15.8:0/2158620847 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d04009790 con 0x7f3d14101bf0 2023-08-11T12:22:04.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.115+0000 7f3d0b7fe700 1 -- 172.21.15.8:0/2158620847 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3d0400cbd0 con 0x7f3d14101bf0 2023-08-11T12:22:04.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.115+0000 7f3d0b7fe700 1 -- 172.21.15.8:0/2158620847 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d04018680 con 0x7f3d14101bf0 2023-08-11T12:22:04.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.115+0000 7f3d1c5ff700 1 -- 172.21.15.8:0/2158620847 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d141a0a50 con 0x7f3d14101bf0 2023-08-11T12:22:04.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.115+0000 7f3d1c5ff700 1 -- 172.21.15.8:0/2158620847 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d141a0f10 con 0x7f3d14101bf0 2023-08-11T12:22:04.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.116+0000 7f3d1c5ff700 1 -- 172.21.15.8:0/2158620847 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d1410c260 con 0x7f3d14101bf0 2023-08-11T12:22:04.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.118+0000 7f3d0b7fe700 1 -- 172.21.15.8:0/2158620847 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f3d0400cd40 con 0x7f3d14101bf0 2023-08-11T12:22:04.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.119+0000 7f3d0b7fe700 1 --2- 172.21.15.8:0/2158620847 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3d0009ffd0 0x7f3d000a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:04.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.119+0000 7f3d0b7fe700 1 -- 172.21.15.8:0/2158620847 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3d04014070 con 0x7f3d14101bf0 2023-08-11T12:22:04.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.119+0000 7f3d1a39b700 1 --2- 172.21.15.8:0/2158620847 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3d0009ffd0 0x7f3d000a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:04.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.120+0000 7f3d1a39b700 1 --2- 172.21.15.8:0/2158620847 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3d0009ffd0 0x7f3d000a2490 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009990 tx=0x7f3d1001a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:04.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.121+0000 7f3d0b7fe700 1 -- 172.21.15.8:0/2158620847 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f3d04095230 con 0x7f3d14101bf0 2023-08-11T12:22:04.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:03 smithi194 ceph-mon[130905]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-08-11T12:22:04.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:03 smithi194 ceph-mon[130905]: pgmap v266: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:22:04.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:03 smithi194 ceph-mon[130905]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2023-08-11T12:22:04.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:03 smithi194 ceph-mon[130905]: osdmap e81: 12 total, 12 up, 12 in 2023-08-11T12:22:04.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:03 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3961381301' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-08-11T12:22:04.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:03 smithi194 ceph-mon[130905]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-08-11T12:22:04.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:03 smithi194 ceph-mon[130905]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-08-11T12:22:04.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:03 smithi045 ceph-mon[130284]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-08-11T12:22:04.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:03 smithi045 ceph-mon[130284]: pgmap v266: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:22:04.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:03 smithi045 ceph-mon[130284]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2023-08-11T12:22:04.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:03 smithi045 ceph-mon[130284]: osdmap e81: 12 total, 12 up, 12 in 2023-08-11T12:22:04.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:03 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3961381301' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-08-11T12:22:04.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:03 smithi045 ceph-mon[130284]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-08-11T12:22:04.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:03 smithi045 ceph-mon[130284]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-08-11T12:22:04.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:03 smithi008 ceph-mon[97158]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-08-11T12:22:04.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:03 smithi008 ceph-mon[97158]: pgmap v266: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:22:04.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:03 smithi008 ceph-mon[97158]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2023-08-11T12:22:04.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:03 smithi008 ceph-mon[97158]: osdmap e81: 12 total, 12 up, 12 in 2023-08-11T12:22:04.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:03 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3961381301' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-08-11T12:22:04.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:03 smithi008 ceph-mon[97158]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-08-11T12:22:04.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:03 smithi008 ceph-mon[97158]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-08-11T12:22:04.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.351+0000 7f3d1c5ff700 1 -- 172.21.15.8:0/2158620847 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f3d1410c440 con 0x7f3d14101bf0 2023-08-11T12:22:04.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.824+0000 7f3d0b7fe700 1 -- 172.21.15.8:0/2158620847 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v83) v1 ==== 157+0+0 (secure 0 0 0) 0x7f3d04098850 con 0x7f3d14101bf0 2023-08-11T12:22:04.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.828+0000 7f3d1c5ff700 1 -- 172.21.15.8:0/2158620847 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3d0009ffd0 msgr2=0x7f3d000a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:04.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.828+0000 7f3d1c5ff700 1 --2- 172.21.15.8:0/2158620847 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3d0009ffd0 0x7f3d000a2490 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009990 tx=0x7f3d1001a040 comp rx=0 tx=0).stop 2023-08-11T12:22:04.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.828+0000 7f3d1c5ff700 1 -- 172.21.15.8:0/2158620847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d14101bf0 msgr2=0x7f3d14198e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:04.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.828+0000 7f3d1c5ff700 1 --2- 172.21.15.8:0/2158620847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d14101bf0 0x7f3d14198e60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400e9a0 tx=0x7f3d0400ecb0 comp rx=0 tx=0).stop 2023-08-11T12:22:04.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.828+0000 7f3d1c5ff700 1 -- 172.21.15.8:0/2158620847 shutdown_connections 2023-08-11T12:22:04.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.828+0000 7f3d1c5ff700 1 --2- 172.21.15.8:0/2158620847 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3d0009ffd0 0x7f3d000a2490 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:04.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.828+0000 7f3d1c5ff700 1 --2- 172.21.15.8:0/2158620847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d14102590 0x7f3d1419fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:04.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.828+0000 7f3d1c5ff700 1 --2- 172.21.15.8:0/2158620847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d14100a00 0x7f3d14198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:04.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.828+0000 7f3d1c5ff700 1 --2- 172.21.15.8:0/2158620847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d14101bf0 0x7f3d14198e60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:04.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.828+0000 7f3d1c5ff700 1 -- 172.21.15.8:0/2158620847 >> 172.21.15.8:0/2158620847 conn(0x7f3d140fbf70 msgr2=0x7f3d140fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:04.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.828+0000 7f3d1c5ff700 1 -- 172.21.15.8:0/2158620847 shutdown_connections 2023-08-11T12:22:04.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:04.829+0000 7f3d1c5ff700 1 -- 172.21.15.8:0/2158620847 wait complete. 2023-08-11T12:22:04.853 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-08-11T12:22:05.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.080+0000 7f2290bff700 1 -- 172.21.15.8:0/355223455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f228c100950 msgr2=0x7f228c100d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:05.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.080+0000 7f2290bff700 1 --2- 172.21.15.8:0/355223455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f228c100950 0x7f228c100d70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f227c0099c0 tx=0x7f227c009cd0 comp rx=0 tx=0).stop 2023-08-11T12:22:05.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.080+0000 7f2290bff700 1 -- 172.21.15.8:0/355223455 shutdown_connections 2023-08-11T12:22:05.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.080+0000 7f2290bff700 1 --2- 172.21.15.8:0/355223455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f228c1024e0 0x7f228c108d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:05.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.080+0000 7f2290bff700 1 --2- 172.21.15.8:0/355223455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f228c100950 0x7f228c100d70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:05.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.080+0000 7f2290bff700 1 --2- 172.21.15.8:0/355223455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f228c101b40 0x7f228c101fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:05.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.080+0000 7f2290bff700 1 -- 172.21.15.8:0/355223455 >> 172.21.15.8:0/355223455 conn(0x7f228c0fbee0 msgr2=0x7f228c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:05.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.080+0000 7f2290bff700 1 -- 172.21.15.8:0/355223455 shutdown_connections 2023-08-11T12:22:05.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.080+0000 7f2290bff700 1 -- 172.21.15.8:0/355223455 wait complete. 2023-08-11T12:22:05.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.081+0000 7f2290bff700 1 Processor -- start 2023-08-11T12:22:05.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.081+0000 7f2290bff700 1 -- start start 2023-08-11T12:22:05.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.082+0000 7f2290bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f228c100950 0x7f228c198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:05.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.082+0000 7f2290bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f228c101b40 0x7f228c198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:05.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.082+0000 7f2290bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f228c1024e0 0x7f228c19fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:05.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.082+0000 7f2290bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228c1a03b0 con 0x7f228c100950 2023-08-11T12:22:05.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.082+0000 7f2290bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228c1a04f0 con 0x7f228c1024e0 2023-08-11T12:22:05.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.082+0000 7f2290bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228c1a0680 con 0x7f228c101b40 2023-08-11T12:22:05.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.082+0000 7f228a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f228c100950 0x7f228c198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:05.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.082+0000 7f228ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f228c1024e0 0x7f228c19fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:05.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.082+0000 7f228a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f228c100950 0x7f228c198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43074/0 (socket says 172.21.15.8:43074) 2023-08-11T12:22:05.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.082+0000 7f228a59c700 1 -- 172.21.15.8:0/3029890191 learned_addr learned my addr 172.21.15.8:0/3029890191 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:05.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.082+0000 7f2289d9b700 1 --2- 172.21.15.8:0/3029890191 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f228c101b40 0x7f228c198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:05.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.082+0000 7f228ad9d700 1 -- 172.21.15.8:0/3029890191 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f228c101b40 msgr2=0x7f228c198d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:05.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.083+0000 7f228ad9d700 1 --2- 172.21.15.8:0/3029890191 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f228c101b40 0x7f228c198d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:05.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.083+0000 7f228ad9d700 1 -- 172.21.15.8:0/3029890191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f228c100950 msgr2=0x7f228c198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:05.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.083+0000 7f228ad9d700 1 --2- 172.21.15.8:0/3029890191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f228c100950 0x7f228c198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:05.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.083+0000 7f228ad9d700 1 -- 172.21.15.8:0/3029890191 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227c0095f0 con 0x7f228c1024e0 2023-08-11T12:22:05.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.083+0000 7f228a59c700 1 --2- 172.21.15.8:0/3029890191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f228c100950 0x7f228c198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:22:05.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.083+0000 7f228ad9d700 1 --2- 172.21.15.8:0/3029890191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f228c1024e0 0x7f228c19fde0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f228400efc0 tx=0x7f228400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:05.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.083+0000 7f227b7fe700 1 -- 172.21.15.8:0/3029890191 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2284018070 con 0x7f228c1024e0 2023-08-11T12:22:05.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.083+0000 7f227b7fe700 1 -- 172.21.15.8:0/3029890191 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f228400f040 con 0x7f228c1024e0 2023-08-11T12:22:05.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.083+0000 7f2290bff700 1 -- 172.21.15.8:0/3029890191 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f228c1a0900 con 0x7f228c1024e0 2023-08-11T12:22:05.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.083+0000 7f227b7fe700 1 -- 172.21.15.8:0/3029890191 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228400cd40 con 0x7f228c1024e0 2023-08-11T12:22:05.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.083+0000 7f2290bff700 1 -- 172.21.15.8:0/3029890191 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f228c1a0e10 con 0x7f228c1024e0 2023-08-11T12:22:05.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.085+0000 7f2290bff700 1 -- 172.21.15.8:0/3029890191 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f228c192fa0 con 0x7f228c1024e0 2023-08-11T12:22:05.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.088+0000 7f227b7fe700 1 -- 172.21.15.8:0/3029890191 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f2284003a00 con 0x7f228c1024e0 2023-08-11T12:22:05.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.089+0000 7f227b7fe700 1 --2- 172.21.15.8:0/3029890191 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f227409ffd0 0x7f22740a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:05.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.089+0000 7f227b7fe700 1 -- 172.21.15.8:0/3029890191 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8205+0+0 (secure 0 0 0) 0x7f22840cad40 con 0x7f228c1024e0 2023-08-11T12:22:05.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.089+0000 7f228a59c700 1 --2- 172.21.15.8:0/3029890191 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f227409ffd0 0x7f22740a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:05.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.090+0000 7f228a59c700 1 --2- 172.21.15.8:0/3029890191 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f227409ffd0 0x7f22740a2490 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f227c000c00 tx=0x7f227c005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:05.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.093+0000 7f227b7fe700 1 -- 172.21.15.8:0/3029890191 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f2284094b80 con 0x7f228c1024e0 2023-08-11T12:22:05.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:04 smithi194 ceph-mon[130905]: osdmap e82: 12 total, 12 up, 12 in 2023-08-11T12:22:05.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:04 smithi194 ceph-mon[130905]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-08-11T12:22:05.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:04 smithi194 ceph-mon[130905]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-08-11T12:22:05.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:04 smithi194 ceph-mon[130905]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-08-11T12:22:05.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:04 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2158620847' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-08-11T12:22:05.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:04 smithi194 ceph-mon[130905]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-08-11T12:22:05.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:04 smithi194 ceph-mon[130905]: pgmap v269: 97 pgs: 16 creating+peering, 21 active+clean, 60 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 0 op/s 2023-08-11T12:22:05.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:04 smithi194 ceph-mon[130905]: mds.? [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] up:active 2023-08-11T12:22:05.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:04 smithi194 ceph-mon[130905]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-11T12:22:05.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:04 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:05.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:04 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:05.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:04 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:05.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:04 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:05.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:04 smithi045 ceph-mon[130284]: osdmap e82: 12 total, 12 up, 12 in 2023-08-11T12:22:05.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:04 smithi045 ceph-mon[130284]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-08-11T12:22:05.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:04 smithi045 ceph-mon[130284]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-08-11T12:22:05.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:04 smithi045 ceph-mon[130284]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-08-11T12:22:05.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:04 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2158620847' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-08-11T12:22:05.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:04 smithi045 ceph-mon[130284]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-08-11T12:22:05.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:04 smithi045 ceph-mon[130284]: pgmap v269: 97 pgs: 16 creating+peering, 21 active+clean, 60 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 0 op/s 2023-08-11T12:22:05.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:04 smithi045 ceph-mon[130284]: mds.? [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] up:active 2023-08-11T12:22:05.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:04 smithi045 ceph-mon[130284]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-11T12:22:05.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:04 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:05.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:04 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:05.148 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:04 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:05.148 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:04 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:05.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:04 smithi008 ceph-mon[97158]: osdmap e82: 12 total, 12 up, 12 in 2023-08-11T12:22:05.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:04 smithi008 ceph-mon[97158]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-08-11T12:22:05.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:04 smithi008 ceph-mon[97158]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-08-11T12:22:05.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:04 smithi008 ceph-mon[97158]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-08-11T12:22:05.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:04 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2158620847' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-08-11T12:22:05.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:04 smithi008 ceph-mon[97158]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-08-11T12:22:05.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:04 smithi008 ceph-mon[97158]: pgmap v269: 97 pgs: 16 creating+peering, 21 active+clean, 60 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 0 op/s 2023-08-11T12:22:05.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:04 smithi008 ceph-mon[97158]: mds.? [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] up:active 2023-08-11T12:22:05.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:04 smithi008 ceph-mon[97158]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-11T12:22:05.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:04 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:05.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:04 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:05.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:04 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:05.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:04 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:05.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:05.326+0000 7f2290bff700 1 -- 172.21.15.8:0/3029890191 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f228c02cdc0 con 0x7f228c1024e0 2023-08-11T12:22:06.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:05 smithi194 ceph-mon[130905]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2023-08-11T12:22:06.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:05 smithi194 ceph-mon[130905]: osdmap e83: 12 total, 12 up, 12 in 2023-08-11T12:22:06.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:05 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3029890191' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-08-11T12:22:06.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:05 smithi194 ceph-mon[130905]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-08-11T12:22:06.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:05 smithi045 ceph-mon[130284]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2023-08-11T12:22:06.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:05 smithi045 ceph-mon[130284]: osdmap e83: 12 total, 12 up, 12 in 2023-08-11T12:22:06.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:05 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3029890191' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-08-11T12:22:06.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:05 smithi045 ceph-mon[130284]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-08-11T12:22:06.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:05 smithi008 ceph-mon[97158]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2023-08-11T12:22:06.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:05 smithi008 ceph-mon[97158]: osdmap e83: 12 total, 12 up, 12 in 2023-08-11T12:22:06.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:05 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3029890191' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-08-11T12:22:06.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:05 smithi008 ceph-mon[97158]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-08-11T12:22:06.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:06.861+0000 7f227b7fe700 1 -- 172.21.15.8:0/3029890191 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v85) v1 ==== 228+0+0 (secure 0 0 0) 0x7f228401b320 con 0x7f228c1024e0 2023-08-11T12:22:06.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:06.868+0000 7f2290bff700 1 -- 172.21.15.8:0/3029890191 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f227409ffd0 msgr2=0x7f22740a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:06.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:06.868+0000 7f2290bff700 1 --2- 172.21.15.8:0/3029890191 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f227409ffd0 0x7f22740a2490 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f227c000c00 tx=0x7f227c005fb0 comp rx=0 tx=0).stop 2023-08-11T12:22:06.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:06.868+0000 7f2290bff700 1 -- 172.21.15.8:0/3029890191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f228c1024e0 msgr2=0x7f228c19fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:06.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:06.868+0000 7f2290bff700 1 --2- 172.21.15.8:0/3029890191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f228c1024e0 0x7f228c19fde0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f228400efc0 tx=0x7f228400c3a0 comp rx=0 tx=0).stop 2023-08-11T12:22:06.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:06.869+0000 7f2290bff700 1 -- 172.21.15.8:0/3029890191 shutdown_connections 2023-08-11T12:22:06.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:06.869+0000 7f2290bff700 1 --2- 172.21.15.8:0/3029890191 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f227409ffd0 0x7f22740a2490 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:06.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:06.869+0000 7f2290bff700 1 --2- 172.21.15.8:0/3029890191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f228c1024e0 0x7f228c19fde0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:06.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:06.869+0000 7f2290bff700 1 --2- 172.21.15.8:0/3029890191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f228c100950 0x7f228c198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:06.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:06.869+0000 7f2290bff700 1 --2- 172.21.15.8:0/3029890191 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f228c101b40 0x7f228c198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:06.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:06.869+0000 7f2290bff700 1 -- 172.21.15.8:0/3029890191 >> 172.21.15.8:0/3029890191 conn(0x7f228c0fbee0 msgr2=0x7f228c107440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:06.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:06.870+0000 7f2290bff700 1 -- 172.21.15.8:0/3029890191 shutdown_connections 2023-08-11T12:22:06.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:06.871+0000 7f2290bff700 1 -- 172.21.15.8:0/3029890191 wait complete. 2023-08-11T12:22:06.874 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data_ec' created 2023-08-11T12:22:06.893 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-08-11T12:22:07.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.099+0000 7ff97f9ff700 1 -- 172.21.15.8:0/1633493254 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff978101bf0 msgr2=0x7ff978102050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:07.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.099+0000 7ff97f9ff700 1 --2- 172.21.15.8:0/1633493254 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff978101bf0 0x7ff978102050 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff9680099c0 tx=0x7ff968009cd0 comp rx=0 tx=0).stop 2023-08-11T12:22:07.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.100+0000 7ff97f9ff700 1 -- 172.21.15.8:0/1633493254 shutdown_connections 2023-08-11T12:22:07.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.100+0000 7ff97f9ff700 1 --2- 172.21.15.8:0/1633493254 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff978102590 0x7ff978108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:07.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.100+0000 7ff97f9ff700 1 --2- 172.21.15.8:0/1633493254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff978100a00 0x7ff978100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:07.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.100+0000 7ff97f9ff700 1 --2- 172.21.15.8:0/1633493254 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff978101bf0 0x7ff978102050 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:07.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.100+0000 7ff97f9ff700 1 -- 172.21.15.8:0/1633493254 >> 172.21.15.8:0/1633493254 conn(0x7ff9780fbf70 msgr2=0x7ff9780fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:07.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.100+0000 7ff97f9ff700 1 -- 172.21.15.8:0/1633493254 shutdown_connections 2023-08-11T12:22:07.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.100+0000 7ff97f9ff700 1 -- 172.21.15.8:0/1633493254 wait complete. 2023-08-11T12:22:07.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.101+0000 7ff97f9ff700 1 Processor -- start 2023-08-11T12:22:07.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.101+0000 7ff97f9ff700 1 -- start start 2023-08-11T12:22:07.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.101+0000 7ff97f9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff978100a00 0x7ff978198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:07.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.101+0000 7ff97f9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff978101bf0 0x7ff978198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:07.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.101+0000 7ff97f9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff978102590 0x7ff97819fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:07.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.101+0000 7ff97f9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9781a0490 con 0x7ff978101bf0 2023-08-11T12:22:07.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.101+0000 7ff97f9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9781a05d0 con 0x7ff978102590 2023-08-11T12:22:07.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.101+0000 7ff97f9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9781a0760 con 0x7ff978100a00 2023-08-11T12:22:07.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.101+0000 7ff97cf9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff978101bf0 0x7ff978198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:07.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.101+0000 7ff97cf9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff978101bf0 0x7ff978198e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43086/0 (socket says 172.21.15.8:43086) 2023-08-11T12:22:07.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.101+0000 7ff97cf9a700 1 -- 172.21.15.8:0/2583092107 learned_addr learned my addr 172.21.15.8:0/2583092107 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:07.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.101+0000 7ff97df9c700 1 --2- 172.21.15.8:0/2583092107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff978102590 0x7ff97819fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:07.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.101+0000 7ff97d79b700 1 --2- 172.21.15.8:0/2583092107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff978100a00 0x7ff978198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:07.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.102+0000 7ff97df9c700 1 -- 172.21.15.8:0/2583092107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff978100a00 msgr2=0x7ff978198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:07.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.102+0000 7ff97df9c700 1 --2- 172.21.15.8:0/2583092107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff978100a00 0x7ff978198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:07.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.102+0000 7ff97df9c700 1 -- 172.21.15.8:0/2583092107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff978101bf0 msgr2=0x7ff978198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:07.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.102+0000 7ff97df9c700 1 --2- 172.21.15.8:0/2583092107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff978101bf0 0x7ff978198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:07.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.102+0000 7ff97df9c700 1 -- 172.21.15.8:0/2583092107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9680095f0 con 0x7ff978102590 2023-08-11T12:22:07.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.102+0000 7ff97d79b700 1 --2- 172.21.15.8:0/2583092107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff978100a00 0x7ff978198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:22:07.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.102+0000 7ff97cf9a700 1 --2- 172.21.15.8:0/2583092107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff978101bf0 0x7ff978198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:22:07.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.102+0000 7ff97df9c700 1 --2- 172.21.15.8:0/2583092107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff978102590 0x7ff97819fec0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff97000efc0 tx=0x7ff97000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:07.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.102+0000 7ff96e7fc700 1 -- 172.21.15.8:0/2583092107 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff970018070 con 0x7ff978102590 2023-08-11T12:22:07.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.102+0000 7ff97f9ff700 1 -- 172.21.15.8:0/2583092107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9781a09e0 con 0x7ff978102590 2023-08-11T12:22:07.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.102+0000 7ff96e7fc700 1 -- 172.21.15.8:0/2583092107 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff97000f040 con 0x7ff978102590 2023-08-11T12:22:07.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.102+0000 7ff96e7fc700 1 -- 172.21.15.8:0/2583092107 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97000cd40 con 0x7ff978102590 2023-08-11T12:22:07.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.103+0000 7ff97f9ff700 1 -- 172.21.15.8:0/2583092107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9781a0ef0 con 0x7ff978102590 2023-08-11T12:22:07.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.103+0000 7ff97f9ff700 1 -- 172.21.15.8:0/2583092107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97810c260 con 0x7ff978102590 2023-08-11T12:22:07.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.106+0000 7ff96e7fc700 1 -- 172.21.15.8:0/2583092107 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7ff970003a00 con 0x7ff978102590 2023-08-11T12:22:07.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.107+0000 7ff96e7fc700 1 --2- 172.21.15.8:0/2583092107 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff96409ffd0 0x7ff9640a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:07.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.107+0000 7ff96e7fc700 1 -- 172.21.15.8:0/2583092107 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8698+0+0 (secure 0 0 0) 0x7ff9700cb910 con 0x7ff978102590 2023-08-11T12:22:07.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.107+0000 7ff97d79b700 1 --2- 172.21.15.8:0/2583092107 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff96409ffd0 0x7ff9640a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:07.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.108+0000 7ff97d79b700 1 --2- 172.21.15.8:0/2583092107 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff96409ffd0 0x7ff9640a2490 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff978101a50 tx=0x7ff974009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:07.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.109+0000 7ff96e7fc700 1 -- 172.21.15.8:0/2583092107 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7ff970095500 con 0x7ff978102590 2023-08-11T12:22:07.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:06 smithi194 ceph-mon[130905]: osdmap e84: 12 total, 12 up, 12 in 2023-08-11T12:22:07.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:06 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:07.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:06 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:07.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:06 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:22:07.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:06 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:22:07.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:06 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:07.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:06 smithi194 ceph-mon[130905]: pgmap v272: 97 pgs: 16 creating+peering, 74 active+clean, 7 unknown; 578 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 7 op/s 2023-08-11T12:22:07.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:06 smithi045 ceph-mon[130284]: osdmap e84: 12 total, 12 up, 12 in 2023-08-11T12:22:07.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:06 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:07.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:06 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:07.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:06 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:22:07.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:06 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:22:07.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:06 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:07.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:06 smithi045 ceph-mon[130284]: pgmap v272: 97 pgs: 16 creating+peering, 74 active+clean, 7 unknown; 578 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 7 op/s 2023-08-11T12:22:07.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:06 smithi008 ceph-mon[97158]: osdmap e84: 12 total, 12 up, 12 in 2023-08-11T12:22:07.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:06 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:07.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:06 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:07.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:06 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:22:07.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:06 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:22:07.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:06 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:22:07.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:06 smithi008 ceph-mon[97158]: pgmap v272: 97 pgs: 16 creating+peering, 74 active+clean, 7 unknown; 578 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 7 op/s 2023-08-11T12:22:07.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.320+0000 7ff97f9ff700 1 -- 172.21.15.8:0/2583092107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7ff9781a10e0 con 0x7ff978102590 2023-08-11T12:22:07.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.865+0000 7ff96e7fc700 1 -- 172.21.15.8:0/2583092107 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v86) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff970098b20 con 0x7ff978102590 2023-08-11T12:22:07.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.876+0000 7ff97f9ff700 1 -- 172.21.15.8:0/2583092107 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff96409ffd0 msgr2=0x7ff9640a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:07.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.876+0000 7ff97f9ff700 1 --2- 172.21.15.8:0/2583092107 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff96409ffd0 0x7ff9640a2490 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff978101a50 tx=0x7ff974009260 comp rx=0 tx=0).stop 2023-08-11T12:22:07.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.876+0000 7ff97f9ff700 1 -- 172.21.15.8:0/2583092107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff978102590 msgr2=0x7ff97819fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:07.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.876+0000 7ff97f9ff700 1 --2- 172.21.15.8:0/2583092107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff978102590 0x7ff97819fec0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff97000efc0 tx=0x7ff97000c3a0 comp rx=0 tx=0).stop 2023-08-11T12:22:07.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.888+0000 7ff97f9ff700 1 -- 172.21.15.8:0/2583092107 shutdown_connections 2023-08-11T12:22:07.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.888+0000 7ff97f9ff700 1 --2- 172.21.15.8:0/2583092107 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff96409ffd0 0x7ff9640a2490 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:07.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.888+0000 7ff97f9ff700 1 --2- 172.21.15.8:0/2583092107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff978100a00 0x7ff978198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:07.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.888+0000 7ff97f9ff700 1 --2- 172.21.15.8:0/2583092107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff978102590 0x7ff97819fec0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:07.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.888+0000 7ff97f9ff700 1 --2- 172.21.15.8:0/2583092107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff978101bf0 0x7ff978198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:07.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.888+0000 7ff97f9ff700 1 -- 172.21.15.8:0/2583092107 >> 172.21.15.8:0/2583092107 conn(0x7ff9780fbf70 msgr2=0x7ff9780fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:07.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.890+0000 7ff97f9ff700 1 -- 172.21.15.8:0/2583092107 shutdown_connections 2023-08-11T12:22:07.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:07.891+0000 7ff97f9ff700 1 -- 172.21.15.8:0/2583092107 wait complete. 2023-08-11T12:22:07.896 INFO:teuthology.orchestra.run.smithi008.stderr:set pool 4 allow_ec_overwrites to true 2023-08-11T12:22:07.916 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-08-11T12:22:08.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.124+0000 7f71853ff700 1 -- 172.21.15.8:0/2115289606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7180102590 msgr2=0x7f7180108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:08.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.124+0000 7f71853ff700 1 --2- 172.21.15.8:0/2115289606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7180102590 0x7f7180108e40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7178009fc0 tx=0x7f717800b330 comp rx=0 tx=0).stop 2023-08-11T12:22:08.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.124+0000 7f71853ff700 1 -- 172.21.15.8:0/2115289606 shutdown_connections 2023-08-11T12:22:08.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.124+0000 7f71853ff700 1 --2- 172.21.15.8:0/2115289606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7180100a00 0x7f7180100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:08.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.124+0000 7f71853ff700 1 --2- 172.21.15.8:0/2115289606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7180102590 0x7f7180108e40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:08.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.124+0000 7f71853ff700 1 --2- 172.21.15.8:0/2115289606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7180101bf0 0x7f7180102050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:08.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.124+0000 7f71853ff700 1 -- 172.21.15.8:0/2115289606 >> 172.21.15.8:0/2115289606 conn(0x7f71800fbf70 msgr2=0x7f71800fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:08.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.124+0000 7f71853ff700 1 -- 172.21.15.8:0/2115289606 shutdown_connections 2023-08-11T12:22:08.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.124+0000 7f71853ff700 1 -- 172.21.15.8:0/2115289606 wait complete. 2023-08-11T12:22:08.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.125+0000 7f71853ff700 1 Processor -- start 2023-08-11T12:22:08.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.125+0000 7f71853ff700 1 -- start start 2023-08-11T12:22:08.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.125+0000 7f71853ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7180100a00 0x7f71800746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:08.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.125+0000 7f71853ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7180101bf0 0x7f7180072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:08.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.125+0000 7f71853ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7180102590 0x7f7180073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:08.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.125+0000 7f71853ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71800739f0 con 0x7f7180100a00 2023-08-11T12:22:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.125+0000 7f71853ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7180073b60 con 0x7f7180101bf0 2023-08-11T12:22:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.125+0000 7f71853ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71801a0850 con 0x7f7180102590 2023-08-11T12:22:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.126+0000 7f717effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7180100a00 0x7f71800746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.126+0000 7f717effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7180100a00 0x7f71800746d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58904/0 (socket says 172.21.15.8:58904) 2023-08-11T12:22:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.126+0000 7f717effd700 1 -- 172.21.15.8:0/3696638997 learned_addr learned my addr 172.21.15.8:0/3696638997 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.126+0000 7f717f7fe700 1 --2- 172.21.15.8:0/3696638997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7180102590 0x7f7180073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.126+0000 7f7177fff700 1 --2- 172.21.15.8:0/3696638997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7180101bf0 0x7f7180072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.126+0000 7f717effd700 1 -- 172.21.15.8:0/3696638997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7180102590 msgr2=0x7f7180073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.126+0000 7f717effd700 1 --2- 172.21.15.8:0/3696638997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7180102590 0x7f7180073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.126+0000 7f717effd700 1 -- 172.21.15.8:0/3696638997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7180101bf0 msgr2=0x7f7180072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.126+0000 7f717effd700 1 --2- 172.21.15.8:0/3696638997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7180101bf0 0x7f7180072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.126+0000 7f717effd700 1 -- 172.21.15.8:0/3696638997 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7178009c40 con 0x7f7180100a00 2023-08-11T12:22:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.126+0000 7f717effd700 1 --2- 172.21.15.8:0/3696638997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7180100a00 0x7f71800746d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f717000e9f0 tx=0x7f717000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.127+0000 7f717cff9700 1 -- 172.21.15.8:0/3696638997 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7170004220 con 0x7f7180100a00 2023-08-11T12:22:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.127+0000 7f717cff9700 1 -- 172.21.15.8:0/3696638997 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7170004380 con 0x7f7180100a00 2023-08-11T12:22:08.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.127+0000 7f71853ff700 1 -- 172.21.15.8:0/3696638997 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71801a0b30 con 0x7f7180100a00 2023-08-11T12:22:08.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.127+0000 7f717cff9700 1 -- 172.21.15.8:0/3696638997 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7170003be0 con 0x7f7180100a00 2023-08-11T12:22:08.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.127+0000 7f71853ff700 1 -- 172.21.15.8:0/3696638997 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71801a1090 con 0x7f7180100a00 2023-08-11T12:22:08.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.128+0000 7f71853ff700 1 -- 172.21.15.8:0/3696638997 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f718010c270 con 0x7f7180100a00 2023-08-11T12:22:08.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.132+0000 7f717cff9700 1 -- 172.21.15.8:0/3696638997 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f7170003d40 con 0x7f7180100a00 2023-08-11T12:22:08.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.133+0000 7f717cff9700 1 --2- 172.21.15.8:0/3696638997 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f716c09ffd0 0x7f716c0a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:08.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.133+0000 7f717cff9700 1 -- 172.21.15.8:0/3696638997 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8698+0+0 (secure 0 0 0) 0x7f7170014070 con 0x7f7180100a00 2023-08-11T12:22:08.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.133+0000 7f7177fff700 1 --2- 172.21.15.8:0/3696638997 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f716c09ffd0 0x7f716c0a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:08.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.134+0000 7f7177fff700 1 --2- 172.21.15.8:0/3696638997 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f716c09ffd0 0x7f716c0a2490 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7168009c60 tx=0x7f7168009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.136+0000 7f717cff9700 1 -- 172.21.15.8:0/3696638997 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f71700950c0 con 0x7f7180100a00 2023-08-11T12:22:08.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:07 smithi194 ceph-mon[130905]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-08-11T12:22:08.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:07 smithi194 ceph-mon[130905]: osdmap e85: 12 total, 12 up, 12 in 2023-08-11T12:22:08.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:07 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2583092107' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-08-11T12:22:08.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:07 smithi194 ceph-mon[130905]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-08-11T12:22:08.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:07 smithi045 ceph-mon[130284]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-08-11T12:22:08.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:07 smithi045 ceph-mon[130284]: osdmap e85: 12 total, 12 up, 12 in 2023-08-11T12:22:08.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:07 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2583092107' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-08-11T12:22:08.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:07 smithi045 ceph-mon[130284]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-08-11T12:22:08.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:07 smithi008 ceph-mon[97158]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-08-11T12:22:08.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:07 smithi008 ceph-mon[97158]: osdmap e85: 12 total, 12 up, 12 in 2023-08-11T12:22:08.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:07 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2583092107' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-08-11T12:22:08.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:07 smithi008 ceph-mon[97158]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-08-11T12:22:08.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.395+0000 7f71853ff700 1 -- 172.21.15.8:0/3696638997 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f7180107860 con 0x7f7180100a00 2023-08-11T12:22:08.884 INFO:journalctl@ceph.mds.b.smithi045.stdout:Aug 11 12:22:08 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-b[155632]: 2023-08-11T12:22:08.413+0000 7fc35a79a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-11T12:22:08.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.884+0000 7f717cff9700 1 -- 172.21.15.8:0/3696638997 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v16) v1 ==== 137+0+0 (secure 0 0 0) 0x7f71700986e0 con 0x7f7180100a00 2023-08-11T12:22:08.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.887+0000 7f71853ff700 1 -- 172.21.15.8:0/3696638997 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f716c09ffd0 msgr2=0x7f716c0a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:08.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.887+0000 7f71853ff700 1 --2- 172.21.15.8:0/3696638997 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f716c09ffd0 0x7f716c0a2490 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7168009c60 tx=0x7f7168009260 comp rx=0 tx=0).stop 2023-08-11T12:22:08.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.887+0000 7f71853ff700 1 -- 172.21.15.8:0/3696638997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7180100a00 msgr2=0x7f71800746d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:08.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.887+0000 7f71853ff700 1 --2- 172.21.15.8:0/3696638997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7180100a00 0x7f71800746d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f717000e9f0 tx=0x7f717000ed00 comp rx=0 tx=0).stop 2023-08-11T12:22:08.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.887+0000 7f71853ff700 1 -- 172.21.15.8:0/3696638997 shutdown_connections 2023-08-11T12:22:08.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.887+0000 7f71853ff700 1 --2- 172.21.15.8:0/3696638997 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f716c09ffd0 0x7f716c0a2490 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:08.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.887+0000 7f71853ff700 1 --2- 172.21.15.8:0/3696638997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7180102590 0x7f7180073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:08.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.887+0000 7f71853ff700 1 --2- 172.21.15.8:0/3696638997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7180100a00 0x7f71800746d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:08.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.887+0000 7f71853ff700 1 --2- 172.21.15.8:0/3696638997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7180101bf0 0x7f7180072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:08.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.887+0000 7f71853ff700 1 -- 172.21.15.8:0/3696638997 >> 172.21.15.8:0/3696638997 conn(0x7f71800fbf70 msgr2=0x7f71800fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:08.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.887+0000 7f71853ff700 1 -- 172.21.15.8:0/3696638997 shutdown_connections 2023-08-11T12:22:08.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:08.887+0000 7f71853ff700 1 -- 172.21.15.8:0/3696638997 wait complete. 2023-08-11T12:22:08.892 INFO:teuthology.orchestra.run.smithi008.stderr:added data pool 4 to fsmap 2023-08-11T12:22:08.911 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-11T12:22:09.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.121+0000 7f2a5619d700 1 -- 172.21.15.8:0/1047221820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a50100830 msgr2=0x7f2a50100c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:09.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.121+0000 7f2a5619d700 1 --2- 172.21.15.8:0/1047221820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a50100830 0x7f2a50100c90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009990 tx=0x7f2a40009ca0 comp rx=0 tx=0).stop 2023-08-11T12:22:09.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.121+0000 7f2a5619d700 1 -- 172.21.15.8:0/1047221820 shutdown_connections 2023-08-11T12:22:09.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.121+0000 7f2a5619d700 1 --2- 172.21.15.8:0/1047221820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a501011d0 0x7f2a50107a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:09.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.121+0000 7f2a5619d700 1 --2- 172.21.15.8:0/1047221820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a500ff640 0x7f2a500ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:09.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.121+0000 7f2a5619d700 1 --2- 172.21.15.8:0/1047221820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a50100830 0x7f2a50100c90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:09.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.121+0000 7f2a5619d700 1 -- 172.21.15.8:0/1047221820 >> 172.21.15.8:0/1047221820 conn(0x7f2a500fabd0 msgr2=0x7f2a500fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:09.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.121+0000 7f2a5619d700 1 -- 172.21.15.8:0/1047221820 shutdown_connections 2023-08-11T12:22:09.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.121+0000 7f2a5619d700 1 -- 172.21.15.8:0/1047221820 wait complete. 2023-08-11T12:22:09.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.122+0000 7f2a5619d700 1 Processor -- start 2023-08-11T12:22:09.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.122+0000 7f2a5619d700 1 -- start start 2023-08-11T12:22:09.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.122+0000 7f2a5619d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a500ff640 0x7f2a501035d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:09.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.122+0000 7f2a5619d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a50100830 0x7f2a50101c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:09.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.122+0000 7f2a5619d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a501011d0 0x7f2a50102150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:09.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.122+0000 7f2a5619d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a501028f0 con 0x7f2a501011d0 2023-08-11T12:22:09.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.122+0000 7f2a5619d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a50102a60 con 0x7f2a50100830 2023-08-11T12:22:09.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.122+0000 7f2a5619d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a501a04d0 con 0x7f2a500ff640 2023-08-11T12:22:09.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.123+0000 7f2a5599c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a501011d0 0x7f2a50102150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:09.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.123+0000 7f2a5519b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a500ff640 0x7f2a501035d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:09.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.123+0000 7f2a5499a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a50100830 0x7f2a50101c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:09.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.123+0000 7f2a5599c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a501011d0 0x7f2a50102150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58922/0 (socket says 172.21.15.8:58922) 2023-08-11T12:22:09.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.123+0000 7f2a5599c700 1 -- 172.21.15.8:0/2527882811 learned_addr learned my addr 172.21.15.8:0/2527882811 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:09.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.123+0000 7f2a5599c700 1 -- 172.21.15.8:0/2527882811 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a500ff640 msgr2=0x7f2a501035d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:09.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.123+0000 7f2a5599c700 1 --2- 172.21.15.8:0/2527882811 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a500ff640 0x7f2a501035d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:09.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.123+0000 7f2a5599c700 1 -- 172.21.15.8:0/2527882811 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a50100830 msgr2=0x7f2a50101c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:09.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.123+0000 7f2a5599c700 1 --2- 172.21.15.8:0/2527882811 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a50100830 0x7f2a50101c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:09.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.123+0000 7f2a5599c700 1 -- 172.21.15.8:0/2527882811 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a48009c40 con 0x7f2a501011d0 2023-08-11T12:22:09.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.123+0000 7f2a5519b700 1 --2- 172.21.15.8:0/2527882811 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a500ff640 0x7f2a501035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:22:09.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.123+0000 7f2a5599c700 1 --2- 172.21.15.8:0/2527882811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a501011d0 0x7f2a50102150 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800c370 tx=0x7f2a4800c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:09.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.124+0000 7f2a467fc700 1 -- 172.21.15.8:0/2527882811 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48017070 con 0x7f2a501011d0 2023-08-11T12:22:09.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.124+0000 7f2a5619d700 1 -- 172.21.15.8:0/2527882811 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a400095f0 con 0x7f2a501011d0 2023-08-11T12:22:09.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.124+0000 7f2a467fc700 1 -- 172.21.15.8:0/2527882811 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a4800f040 con 0x7f2a501011d0 2023-08-11T12:22:09.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.124+0000 7f2a467fc700 1 -- 172.21.15.8:0/2527882811 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4800e050 con 0x7f2a501011d0 2023-08-11T12:22:09.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.124+0000 7f2a5619d700 1 -- 172.21.15.8:0/2527882811 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a501a0ad0 con 0x7f2a501011d0 2023-08-11T12:22:09.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.125+0000 7f2a5619d700 1 -- 172.21.15.8:0/2527882811 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a5010aea0 con 0x7f2a501011d0 2023-08-11T12:22:09.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.127+0000 7f2a467fc700 1 -- 172.21.15.8:0/2527882811 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f2a4800cb60 con 0x7f2a501011d0 2023-08-11T12:22:09.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.129+0000 7f2a467fc700 1 --2- 172.21.15.8:0/2527882811 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f2a3c09ff50 0x7f2a3c0a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:09.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.129+0000 7f2a467fc700 1 -- 172.21.15.8:0/2527882811 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f2a480cadd0 con 0x7f2a501011d0 2023-08-11T12:22:09.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.129+0000 7f2a5519b700 1 --2- 172.21.15.8:0/2527882811 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f2a3c09ff50 0x7f2a3c0a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:09.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.129+0000 7f2a5519b700 1 --2- 172.21.15.8:0/2527882811 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f2a3c09ff50 0x7f2a3c0a2410 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2a50100690 tx=0x7f2a4c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:09.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.132+0000 7f2a467fc700 1 -- 172.21.15.8:0/2527882811 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f2a48094910 con 0x7f2a501011d0 2023-08-11T12:22:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:08 smithi194 ceph-mon[130905]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2023-08-11T12:22:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:08 smithi194 ceph-mon[130905]: osdmap e86: 12 total, 12 up, 12 in 2023-08-11T12:22:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:08 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3696638997' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2023-08-11T12:22:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:08 smithi194 ceph-mon[130905]: pgmap v275: 129 pgs: 10 creating+peering, 96 active+clean, 23 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 8 op/s 2023-08-11T12:22:09.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:08 smithi045 ceph-mon[130284]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2023-08-11T12:22:09.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:08 smithi045 ceph-mon[130284]: osdmap e86: 12 total, 12 up, 12 in 2023-08-11T12:22:09.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:08 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3696638997' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2023-08-11T12:22:09.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:08 smithi045 ceph-mon[130284]: pgmap v275: 129 pgs: 10 creating+peering, 96 active+clean, 23 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 8 op/s 2023-08-11T12:22:09.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:08 smithi008 ceph-mon[97158]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2023-08-11T12:22:09.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:08 smithi008 ceph-mon[97158]: osdmap e86: 12 total, 12 up, 12 in 2023-08-11T12:22:09.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:08 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3696638997' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2023-08-11T12:22:09.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:08 smithi008 ceph-mon[97158]: pgmap v275: 129 pgs: 10 creating+peering, 96 active+clean, 23 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 8 op/s 2023-08-11T12:22:09.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.395+0000 7f2a5619d700 1 -- 172.21.15.8:0/2527882811 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a501a0cf0 con 0x7f2a501011d0 2023-08-11T12:22:09.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.396+0000 7f2a467fc700 1 -- 172.21.15.8:0/2527882811 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+11240 (secure 0 0 0) 0x7f2a48097f30 con 0x7f2a501011d0 2023-08-11T12:22:09.399 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:22:09.399 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14469,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2854286216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2854286216},{"type":"v1","addr":"172.21.15.8:6835","nonce":2854286216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/805368621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":805368621},{"type":"v1","addr":"172.21.15.8:6837","nonce":805368621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14526,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/2990530720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":2990530720},{"type":"v1","addr":"172.21.15.8:6839","nonce":2990530720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14538,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/3589272762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":3589272762},{"type":"v1","addr":"172.21.15.8:6841","nonce":3589272762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2043443402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2043443402},{"type":"v1","addr":"172.21.15.194:6833","nonce":2043443402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1208864615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1208864615},{"type":"v1","addr":"172.21.15.45:6833","nonce":1208864615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1776075470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1776075470},{"type":"v1","addr":"172.21.15.45:6835","nonce":1776075470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24517,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2457430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2457430285},{"type":"v1","addr":"172.21.15.194:6835","nonce":2457430285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24529,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/3072808560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":3072808560},{"type":"v1","addr":"172.21.15.194:6837","nonce":3072808560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/641549061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":641549061},{"type":"v1","addr":"172.21.15.45:6837","nonce":641549061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24550,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6839/2174476491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":2174476491},{"type":"v1","addr":"172.21.15.194:6839","nonce":2174476491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-11T12:22:03.398475+0000","modified":"2023-08-11T12:22:08.875325+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24575},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6839/119684732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":119684732},{"type":"v1","addr":"172.21.15.45:6839","nonce":119684732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-08-11T12:22:09.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.398+0000 7f2a5619d700 1 -- 172.21.15.8:0/2527882811 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f2a3c09ff50 msgr2=0x7f2a3c0a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:09.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.398+0000 7f2a5619d700 1 --2- 172.21.15.8:0/2527882811 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f2a3c09ff50 0x7f2a3c0a2410 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2a50100690 tx=0x7f2a4c009260 comp rx=0 tx=0).stop 2023-08-11T12:22:09.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.398+0000 7f2a5619d700 1 -- 172.21.15.8:0/2527882811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a501011d0 msgr2=0x7f2a50102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:09.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.398+0000 7f2a5619d700 1 --2- 172.21.15.8:0/2527882811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a501011d0 0x7f2a50102150 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800c370 tx=0x7f2a4800c680 comp rx=0 tx=0).stop 2023-08-11T12:22:09.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.398+0000 7f2a5619d700 1 -- 172.21.15.8:0/2527882811 shutdown_connections 2023-08-11T12:22:09.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.398+0000 7f2a5619d700 1 --2- 172.21.15.8:0/2527882811 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f2a3c09ff50 0x7f2a3c0a2410 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:09.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.398+0000 7f2a5619d700 1 --2- 172.21.15.8:0/2527882811 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a500ff640 0x7f2a501035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:09.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.398+0000 7f2a5619d700 1 --2- 172.21.15.8:0/2527882811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a501011d0 0x7f2a50102150 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:09.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.398+0000 7f2a5619d700 1 --2- 172.21.15.8:0/2527882811 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a50100830 0x7f2a50101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:09.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.398+0000 7f2a5619d700 1 -- 172.21.15.8:0/2527882811 >> 172.21.15.8:0/2527882811 conn(0x7f2a500fabd0 msgr2=0x7f2a50067c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:09.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.398+0000 7f2a5619d700 1 -- 172.21.15.8:0/2527882811 shutdown_connections 2023-08-11T12:22:09.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.398+0000 7f2a5619d700 1 -- 172.21.15.8:0/2527882811 wait complete. 2023-08-11T12:22:09.403 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 16 2023-08-11T12:22:09.420 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-11T12:22:09.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.620+0000 7f22aedff700 1 -- 172.21.15.8:0/442679831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22a81009e0 msgr2=0x7f22a8100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:09.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.620+0000 7f22aedff700 1 --2- 172.21.15.8:0/442679831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22a81009e0 0x7f22a8100e00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f229c0099c0 tx=0x7f229c009cd0 comp rx=0 tx=0).stop 2023-08-11T12:22:09.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.620+0000 7f22aedff700 1 -- 172.21.15.8:0/442679831 shutdown_connections 2023-08-11T12:22:09.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.620+0000 7f22aedff700 1 --2- 172.21.15.8:0/442679831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22a8102570 0x7f22a8108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:09.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.621+0000 7f22aedff700 1 --2- 172.21.15.8:0/442679831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22a81009e0 0x7f22a8100e00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:09.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.621+0000 7f22aedff700 1 --2- 172.21.15.8:0/442679831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22a8101bd0 0x7f22a8102030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:09.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.621+0000 7f22aedff700 1 -- 172.21.15.8:0/442679831 >> 172.21.15.8:0/442679831 conn(0x7f22a80fbf50 msgr2=0x7f22a80fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:09.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.621+0000 7f22aedff700 1 -- 172.21.15.8:0/442679831 shutdown_connections 2023-08-11T12:22:09.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.621+0000 7f22aedff700 1 -- 172.21.15.8:0/442679831 wait complete. 2023-08-11T12:22:09.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.622+0000 7f22aedff700 1 Processor -- start 2023-08-11T12:22:09.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.622+0000 7f22aedff700 1 -- start start 2023-08-11T12:22:09.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.622+0000 7f22aedff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22a81009e0 0x7f22a80746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:09.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.622+0000 7f22aedff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22a8101bd0 0x7f22a8072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:09.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.622+0000 7f22aedff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22a8102570 0x7f22a8073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:09.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.622+0000 7f22aedff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a80739f0 con 0x7f22a8101bd0 2023-08-11T12:22:09.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.622+0000 7f22aedff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a8073b60 con 0x7f22a81009e0 2023-08-11T12:22:09.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.622+0000 7f22aedff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a81a0780 con 0x7f22a8102570 2023-08-11T12:22:09.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.622+0000 7f22a7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22a8101bd0 0x7f22a8072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:09.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.622+0000 7f22a7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22a8101bd0 0x7f22a8072d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58940/0 (socket says 172.21.15.8:58940) 2023-08-11T12:22:09.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.622+0000 7f22a7fff700 1 -- 172.21.15.8:0/1189644204 learned_addr learned my addr 172.21.15.8:0/1189644204 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:09.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.622+0000 7f22acb9b700 1 --2- 172.21.15.8:0/1189644204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22a81009e0 0x7f22a80746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:09.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.622+0000 7f22ad39c700 1 --2- 172.21.15.8:0/1189644204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22a8102570 0x7f22a8073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:09.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.623+0000 7f22a7fff700 1 -- 172.21.15.8:0/1189644204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22a8102570 msgr2=0x7f22a8073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:09.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.623+0000 7f22a7fff700 1 --2- 172.21.15.8:0/1189644204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22a8102570 0x7f22a8073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:09.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.623+0000 7f22a7fff700 1 -- 172.21.15.8:0/1189644204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22a81009e0 msgr2=0x7f22a80746d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:09.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.623+0000 7f22a7fff700 1 --2- 172.21.15.8:0/1189644204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22a81009e0 0x7f22a80746d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:09.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.623+0000 7f22a7fff700 1 -- 172.21.15.8:0/1189644204 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229c0095f0 con 0x7f22a8101bd0 2023-08-11T12:22:09.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.623+0000 7f22a7fff700 1 --2- 172.21.15.8:0/1189644204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22a8101bd0 0x7f22a8072d10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f229400e9a0 tx=0x7f229400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:09.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.623+0000 7f22a5ffb700 1 -- 172.21.15.8:0/1189644204 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294009790 con 0x7f22a8101bd0 2023-08-11T12:22:09.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.623+0000 7f22a5ffb700 1 -- 172.21.15.8:0/1189644204 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f229400cbd0 con 0x7f22a8101bd0 2023-08-11T12:22:09.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.623+0000 7f22aedff700 1 -- 172.21.15.8:0/1189644204 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a81a0a60 con 0x7f22a8101bd0 2023-08-11T12:22:09.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.623+0000 7f22a5ffb700 1 -- 172.21.15.8:0/1189644204 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294018680 con 0x7f22a8101bd0 2023-08-11T12:22:09.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.623+0000 7f22aedff700 1 -- 172.21.15.8:0/1189644204 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a81a0f70 con 0x7f22a8101bd0 2023-08-11T12:22:09.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.624+0000 7f22aedff700 1 -- 172.21.15.8:0/1189644204 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a810c240 con 0x7f22a8101bd0 2023-08-11T12:22:09.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.626+0000 7f22a5ffb700 1 -- 172.21.15.8:0/1189644204 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f229400cd40 con 0x7f22a8101bd0 2023-08-11T12:22:09.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.629+0000 7f22a5ffb700 1 --2- 172.21.15.8:0/1189644204 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f229809ff50 0x7f22980a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:09.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.629+0000 7f22a5ffb700 1 -- 172.21.15.8:0/1189644204 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f2294014070 con 0x7f22a8101bd0 2023-08-11T12:22:09.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.629+0000 7f22acb9b700 1 --2- 172.21.15.8:0/1189644204 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f229809ff50 0x7f22980a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:09.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.629+0000 7f22acb9b700 1 --2- 172.21.15.8:0/1189644204 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f229809ff50 0x7f22980a2410 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f229c009990 tx=0x7f229c005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:09.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.631+0000 7f22a5ffb700 1 -- 172.21.15.8:0/1189644204 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f2294051c30 con 0x7f22a8101bd0 2023-08-11T12:22:09.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.844+0000 7f22aedff700 1 -- 172.21.15.8:0/1189644204 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22a810c450 con 0x7f22a8101bd0 2023-08-11T12:22:09.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.846+0000 7f22a5ffb700 1 -- 172.21.15.8:0/1189644204 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+23820 (secure 0 0 0) 0x7f2294095270 con 0x7f22a8101bd0 2023-08-11T12:22:09.849 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:22:09.849 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":87,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","created":"2023-08-11T12:14:28.341113+0000","modified":"2023-08-11T12:22:08.397736+0000","last_up_change":"2023-08-11T12:21:14.913735+0000","last_in_change":"2023-08-11T12:20:57.476558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-11T12:17:49.040758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-11T12:22:01.383296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-11T12:22:02.816329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-11T12:22:06.369375+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f903e393-7894-42d6-8b11-737ceef1f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6803","nonce":664104961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6805","nonce":664104961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6809","nonce":664104961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6807","nonce":664104961}]},"public_addr":"172.21.15.8:6803/664104961","cluster_addr":"172.21.15.8:6805/664104961","heartbeat_back_addr":"172.21.15.8:6809/664104961","heartbeat_front_addr":"172.21.15.8:6807/664104961","state":["exists","up"]},{"osd":1,"uuid":"1e988e5c-e78c-46d5-80a5-dff7ac38cbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6801","nonce":4187350703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6803","nonce":4187350703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6807","nonce":4187350703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6805","nonce":4187350703}]},"public_addr":"172.21.15.45:6801/4187350703","cluster_addr":"172.21.15.45:6803/4187350703","heartbeat_back_addr":"172.21.15.45:6807/4187350703","heartbeat_front_addr":"172.21.15.45:6805/4187350703","state":["exists","up"]},{"osd":2,"uuid":"1835217c-a93c-4181-b8b8-cc410bab1a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6801","nonce":2547818140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6803","nonce":2547818140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6807","nonce":2547818140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6805","nonce":2547818140}]},"public_addr":"172.21.15.194:6801/2547818140","cluster_addr":"172.21.15.194:6803/2547818140","heartbeat_back_addr":"172.21.15.194:6807/2547818140","heartbeat_front_addr":"172.21.15.194:6805/2547818140","state":["exists","up"]},{"osd":3,"uuid":"b55ae61a-731c-4312-a998-661122b84788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6811","nonce":187418883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6813","nonce":187418883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6817","nonce":187418883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6815","nonce":187418883}]},"public_addr":"172.21.15.8:6811/187418883","cluster_addr":"172.21.15.8:6813/187418883","heartbeat_back_addr":"172.21.15.8:6817/187418883","heartbeat_front_addr":"172.21.15.8:6815/187418883","state":["exists","up"]},{"osd":4,"uuid":"2c28acbb-e807-4559-8aa2-a35ca84b5d43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6809","nonce":3099704571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6811","nonce":3099704571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6815","nonce":3099704571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6813","nonce":3099704571}]},"public_addr":"172.21.15.45:6809/3099704571","cluster_addr":"172.21.15.45:6811/3099704571","heartbeat_back_addr":"172.21.15.45:6815/3099704571","heartbeat_front_addr":"172.21.15.45:6813/3099704571","state":["exists","up"]},{"osd":5,"uuid":"37032289-8016-4730-9b69-f7985e058ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6809","nonce":263803874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6811","nonce":263803874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6815","nonce":263803874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6813","nonce":263803874}]},"public_addr":"172.21.15.194:6809/263803874","cluster_addr":"172.21.15.194:6811/263803874","heartbeat_back_addr":"172.21.15.194:6815/263803874","heartbeat_front_addr":"172.21.15.194:6813/263803874","state":["exists","up"]},{"osd":6,"uuid":"32d2dab9-6944-40d1-ada9-4f941821b063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6819","nonce":1802966829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6821","nonce":1802966829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6825","nonce":1802966829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6823","nonce":1802966829}]},"public_addr":"172.21.15.8:6819/1802966829","cluster_addr":"172.21.15.8:6821/1802966829","heartbeat_back_addr":"172.21.15.8:6825/1802966829","heartbeat_front_addr":"172.21.15.8:6823/1802966829","state":["exists","up"]},{"osd":7,"uuid":"086aff58-1554-49fe-92ff-5166b115aeef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6817","nonce":3715737148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6819","nonce":3715737148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6823","nonce":3715737148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6821","nonce":3715737148}]},"public_addr":"172.21.15.45:6817/3715737148","cluster_addr":"172.21.15.45:6819/3715737148","heartbeat_back_addr":"172.21.15.45:6823/3715737148","heartbeat_front_addr":"172.21.15.45:6821/3715737148","state":["exists","up"]},{"osd":8,"uuid":"7fff5e95-2453-4ea6-a5c1-3bba6a1f6400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6817","nonce":57497127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6819","nonce":57497127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6823","nonce":57497127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6821","nonce":57497127}]},"public_addr":"172.21.15.194:6817/57497127","cluster_addr":"172.21.15.194:6819/57497127","heartbeat_back_addr":"172.21.15.194:6823/57497127","heartbeat_front_addr":"172.21.15.194:6821/57497127","state":["exists","up"]},{"osd":9,"uuid":"31ab0121-4c92-42ec-9f19-e672062e8814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6827","nonce":434661930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6829","nonce":434661930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6833","nonce":434661930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6831","nonce":434661930}]},"public_addr":"172.21.15.8:6827/434661930","cluster_addr":"172.21.15.8:6829/434661930","heartbeat_back_addr":"172.21.15.8:6833/434661930","heartbeat_front_addr":"172.21.15.8:6831/434661930","state":["exists","up"]},{"osd":10,"uuid":"62c632e4-94f6-4630-9d94-8d28fccacf45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6825","nonce":3281212184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6827","nonce":3281212184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6831","nonce":3281212184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6829","nonce":3281212184}]},"public_addr":"172.21.15.45:6825/3281212184","cluster_addr":"172.21.15.45:6827/3281212184","heartbeat_back_addr":"172.21.15.45:6831/3281212184","heartbeat_front_addr":"172.21.15.45:6829/3281212184","state":["exists","up"]},{"osd":11,"uuid":"8ca4a80d-cd75-4230-b46d-aef6fdc03e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6825","nonce":1637875895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6827","nonce":1637875895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6831","nonce":1637875895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6829","nonce":1637875895}]},"public_addr":"172.21.15.194:6825/1637875895","cluster_addr":"172.21.15.194:6827/1637875895","heartbeat_back_addr":"172.21.15.194:6831/1637875895","heartbeat_front_addr":"172.21.15.194:6829/1637875895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:04.255616+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:26.243863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:46.630365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:12.926291+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:35.747049+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:55.793767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:21.685725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:43.703215+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:04.043674+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:30.320026+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:52.751974+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:21:13.230024+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/2000592056":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2102228072":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2374527928":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2928221278":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2744750874":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/3681755887":"2023-08-12T12:15:02.528403+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-11T12:22:09.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.848+0000 7f22aedff700 1 -- 172.21.15.8:0/1189644204 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f229809ff50 msgr2=0x7f22980a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:09.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.848+0000 7f22aedff700 1 --2- 172.21.15.8:0/1189644204 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f229809ff50 0x7f22980a2410 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f229c009990 tx=0x7f229c005fb0 comp rx=0 tx=0).stop 2023-08-11T12:22:09.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.848+0000 7f22aedff700 1 -- 172.21.15.8:0/1189644204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22a8101bd0 msgr2=0x7f22a8072d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:09.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.848+0000 7f22aedff700 1 --2- 172.21.15.8:0/1189644204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22a8101bd0 0x7f22a8072d10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f229400e9a0 tx=0x7f229400ecb0 comp rx=0 tx=0).stop 2023-08-11T12:22:09.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.848+0000 7f22aedff700 1 -- 172.21.15.8:0/1189644204 shutdown_connections 2023-08-11T12:22:09.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.848+0000 7f22aedff700 1 --2- 172.21.15.8:0/1189644204 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f229809ff50 0x7f22980a2410 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:09.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.848+0000 7f22aedff700 1 --2- 172.21.15.8:0/1189644204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22a8102570 0x7f22a8073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:09.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.848+0000 7f22aedff700 1 --2- 172.21.15.8:0/1189644204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22a81009e0 0x7f22a80746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:09.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.848+0000 7f22aedff700 1 --2- 172.21.15.8:0/1189644204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22a8101bd0 0x7f22a8072d10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:09.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.848+0000 7f22aedff700 1 -- 172.21.15.8:0/1189644204 >> 172.21.15.8:0/1189644204 conn(0x7f22a80fbf50 msgr2=0x7f22a80fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:09.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.848+0000 7f22aedff700 1 -- 172.21.15.8:0/1189644204 shutdown_connections 2023-08-11T12:22:09.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:09.848+0000 7f22aedff700 1 -- 172.21.15.8:0/1189644204 wait complete. 2023-08-11T12:22:09.871 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-11T12:22:10.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.072+0000 7fa11e5ff700 1 -- 172.21.15.8:0/1218476271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa118102580 msgr2=0x7fa118108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:10.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.072+0000 7fa11e5ff700 1 --2- 172.21.15.8:0/1218476271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa118102580 0x7fa118108e30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa11000b0d0 tx=0x7fa11000b3e0 comp rx=0 tx=0).stop 2023-08-11T12:22:10.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.072+0000 7fa11e5ff700 1 -- 172.21.15.8:0/1218476271 shutdown_connections 2023-08-11T12:22:10.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.072+0000 7fa11e5ff700 1 --2- 172.21.15.8:0/1218476271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1181009f0 0x7fa118100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:10.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.072+0000 7fa11e5ff700 1 --2- 172.21.15.8:0/1218476271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa118102580 0x7fa118108e30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:10.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.072+0000 7fa11e5ff700 1 --2- 172.21.15.8:0/1218476271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa118101be0 0x7fa118102040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:10.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.072+0000 7fa11e5ff700 1 -- 172.21.15.8:0/1218476271 >> 172.21.15.8:0/1218476271 conn(0x7fa1180fbf80 msgr2=0x7fa1180fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:10.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.072+0000 7fa11e5ff700 1 -- 172.21.15.8:0/1218476271 shutdown_connections 2023-08-11T12:22:10.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.072+0000 7fa11e5ff700 1 -- 172.21.15.8:0/1218476271 wait complete. 2023-08-11T12:22:10.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.073+0000 7fa11e5ff700 1 Processor -- start 2023-08-11T12:22:10.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.075+0000 7fa11e5ff700 1 -- start start 2023-08-11T12:22:10.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.075+0000 7fa11e5ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1181009f0 0x7fa1181967e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:10.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.075+0000 7fa11e5ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa118101be0 0x7fa118196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:10.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.075+0000 7fa11e5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa118102580 0x7fa11819dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:10.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.075+0000 7fa11e5ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11819e360 con 0x7fa118101be0 2023-08-11T12:22:10.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.075+0000 7fa11e5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11819e4a0 con 0x7fa118102580 2023-08-11T12:22:10.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.075+0000 7fa11e5ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11819e630 con 0x7fa1181009f0 2023-08-11T12:22:10.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.075+0000 7fa1177fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa118101be0 0x7fa118196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:10.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.075+0000 7fa1177fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa118101be0 0x7fa118196d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58960/0 (socket says 172.21.15.8:58960) 2023-08-11T12:22:10.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.075+0000 7fa1177fe700 1 -- 172.21.15.8:0/148480580 learned_addr learned my addr 172.21.15.8:0/148480580 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:10.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.075+0000 7fa117fff700 1 --2- 172.21.15.8:0/148480580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1181009f0 0x7fa1181967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:10.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.075+0000 7fa11cb9c700 1 --2- 172.21.15.8:0/148480580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa118102580 0x7fa11819dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:10.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.075+0000 7fa1177fe700 1 -- 172.21.15.8:0/148480580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1181009f0 msgr2=0x7fa1181967e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:10.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.075+0000 7fa1177fe700 1 --2- 172.21.15.8:0/148480580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1181009f0 0x7fa1181967e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:10.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.075+0000 7fa1177fe700 1 -- 172.21.15.8:0/148480580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa118102580 msgr2=0x7fa11819dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:10.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.075+0000 7fa1177fe700 1 --2- 172.21.15.8:0/148480580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa118102580 0x7fa11819dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:10.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.075+0000 7fa1177fe700 1 -- 172.21.15.8:0/148480580 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa110009d00 con 0x7fa118101be0 2023-08-11T12:22:10.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.075+0000 7fa1177fe700 1 --2- 172.21.15.8:0/148480580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa118101be0 0x7fa118196d20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa10c00d950 tx=0x7fa10c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:10.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.075+0000 7fa1157fa700 1 -- 172.21.15.8:0/148480580 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c009940 con 0x7fa118101be0 2023-08-11T12:22:10.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.076+0000 7fa11e5ff700 1 -- 172.21.15.8:0/148480580 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa11819e910 con 0x7fa118101be0 2023-08-11T12:22:10.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.076+0000 7fa1157fa700 1 -- 172.21.15.8:0/148480580 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa10c010460 con 0x7fa118101be0 2023-08-11T12:22:10.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.076+0000 7fa1157fa700 1 -- 172.21.15.8:0/148480580 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c00f620 con 0x7fa118101be0 2023-08-11T12:22:10.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.076+0000 7fa11e5ff700 1 -- 172.21.15.8:0/148480580 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa11819ee20 con 0x7fa118101be0 2023-08-11T12:22:10.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.077+0000 7fa11e5ff700 1 -- 172.21.15.8:0/148480580 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa11810c260 con 0x7fa118101be0 2023-08-11T12:22:10.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.079+0000 7fa1157fa700 1 -- 172.21.15.8:0/148480580 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fa10c0108d0 con 0x7fa118101be0 2023-08-11T12:22:10.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.080+0000 7fa1157fa700 1 --2- 172.21.15.8:0/148480580 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa10009ff50 0x7fa1000a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:10.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.080+0000 7fa1157fa700 1 -- 172.21.15.8:0/148480580 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fa10c0cb270 con 0x7fa118101be0 2023-08-11T12:22:10.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.080+0000 7fa117fff700 1 --2- 172.21.15.8:0/148480580 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa10009ff50 0x7fa1000a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:10.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.081+0000 7fa117fff700 1 --2- 172.21.15.8:0/148480580 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa10009ff50 0x7fa1000a2410 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa118101a40 tx=0x7fa108007400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:10.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.085+0000 7fa1157fa700 1 -- 172.21.15.8:0/148480580 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fa10c094db0 con 0x7fa118101be0 2023-08-11T12:22:10.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:09 smithi194 ceph-mon[130905]: osdmap e87: 12 total, 12 up, 12 in 2023-08-11T12:22:10.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:09 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3696638997' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2023-08-11T12:22:10.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:09 smithi194 ceph-mon[130905]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-11T12:22:10.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:09 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2527882811' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:22:10.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:09 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1189644204' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:10.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:09 smithi045 ceph-mon[130284]: osdmap e87: 12 total, 12 up, 12 in 2023-08-11T12:22:10.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:09 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3696638997' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2023-08-11T12:22:10.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:09 smithi045 ceph-mon[130284]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-11T12:22:10.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:09 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2527882811' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:22:10.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:09 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1189644204' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:10.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.293+0000 7fa11e5ff700 1 -- 172.21.15.8:0/148480580 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa11810c480 con 0x7fa118101be0 2023-08-11T12:22:10.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.295+0000 7fa1157fa700 1 -- 172.21.15.8:0/148480580 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+23820 (secure 0 0 0) 0x7fa10c0983d0 con 0x7fa118101be0 2023-08-11T12:22:10.298 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:22:10.298 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":87,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","created":"2023-08-11T12:14:28.341113+0000","modified":"2023-08-11T12:22:08.397736+0000","last_up_change":"2023-08-11T12:21:14.913735+0000","last_in_change":"2023-08-11T12:20:57.476558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-11T12:17:49.040758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-11T12:22:01.383296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-11T12:22:02.816329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-11T12:22:06.369375+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f903e393-7894-42d6-8b11-737ceef1f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6803","nonce":664104961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6805","nonce":664104961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6809","nonce":664104961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6807","nonce":664104961}]},"public_addr":"172.21.15.8:6803/664104961","cluster_addr":"172.21.15.8:6805/664104961","heartbeat_back_addr":"172.21.15.8:6809/664104961","heartbeat_front_addr":"172.21.15.8:6807/664104961","state":["exists","up"]},{"osd":1,"uuid":"1e988e5c-e78c-46d5-80a5-dff7ac38cbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6801","nonce":4187350703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6803","nonce":4187350703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6807","nonce":4187350703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6805","nonce":4187350703}]},"public_addr":"172.21.15.45:6801/4187350703","cluster_addr":"172.21.15.45:6803/4187350703","heartbeat_back_addr":"172.21.15.45:6807/4187350703","heartbeat_front_addr":"172.21.15.45:6805/4187350703","state":["exists","up"]},{"osd":2,"uuid":"1835217c-a93c-4181-b8b8-cc410bab1a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6801","nonce":2547818140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6803","nonce":2547818140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6807","nonce":2547818140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6805","nonce":2547818140}]},"public_addr":"172.21.15.194:6801/2547818140","cluster_addr":"172.21.15.194:6803/2547818140","heartbeat_back_addr":"172.21.15.194:6807/2547818140","heartbeat_front_addr":"172.21.15.194:6805/2547818140","state":["exists","up"]},{"osd":3,"uuid":"b55ae61a-731c-4312-a998-661122b84788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6811","nonce":187418883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6813","nonce":187418883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6817","nonce":187418883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6815","nonce":187418883}]},"public_addr":"172.21.15.8:6811/187418883","cluster_addr":"172.21.15.8:6813/187418883","heartbeat_back_addr":"172.21.15.8:6817/187418883","heartbeat_front_addr":"172.21.15.8:6815/187418883","state":["exists","up"]},{"osd":4,"uuid":"2c28acbb-e807-4559-8aa2-a35ca84b5d43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6809","nonce":3099704571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6811","nonce":3099704571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6815","nonce":3099704571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6813","nonce":3099704571}]},"public_addr":"172.21.15.45:6809/3099704571","cluster_addr":"172.21.15.45:6811/3099704571","heartbeat_back_addr":"172.21.15.45:6815/3099704571","heartbeat_front_addr":"172.21.15.45:6813/3099704571","state":["exists","up"]},{"osd":5,"uuid":"37032289-8016-4730-9b69-f7985e058ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6809","nonce":263803874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6811","nonce":263803874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6815","nonce":263803874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6813","nonce":263803874}]},"public_addr":"172.21.15.194:6809/263803874","cluster_addr":"172.21.15.194:6811/263803874","heartbeat_back_addr":"172.21.15.194:6815/263803874","heartbeat_front_addr":"172.21.15.194:6813/263803874","state":["exists","up"]},{"osd":6,"uuid":"32d2dab9-6944-40d1-ada9-4f941821b063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6819","nonce":1802966829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6821","nonce":1802966829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6825","nonce":1802966829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6823","nonce":1802966829}]},"public_addr":"172.21.15.8:6819/1802966829","cluster_addr":"172.21.15.8:6821/1802966829","heartbeat_back_addr":"172.21.15.8:6825/1802966829","heartbeat_front_addr":"172.21.15.8:6823/1802966829","state":["exists","up"]},{"osd":7,"uuid":"086aff58-1554-49fe-92ff-5166b115aeef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6817","nonce":3715737148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6819","nonce":3715737148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6823","nonce":3715737148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6821","nonce":3715737148}]},"public_addr":"172.21.15.45:6817/3715737148","cluster_addr":"172.21.15.45:6819/3715737148","heartbeat_back_addr":"172.21.15.45:6823/3715737148","heartbeat_front_addr":"172.21.15.45:6821/3715737148","state":["exists","up"]},{"osd":8,"uuid":"7fff5e95-2453-4ea6-a5c1-3bba6a1f6400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6817","nonce":57497127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6819","nonce":57497127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6823","nonce":57497127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6821","nonce":57497127}]},"public_addr":"172.21.15.194:6817/57497127","cluster_addr":"172.21.15.194:6819/57497127","heartbeat_back_addr":"172.21.15.194:6823/57497127","heartbeat_front_addr":"172.21.15.194:6821/57497127","state":["exists","up"]},{"osd":9,"uuid":"31ab0121-4c92-42ec-9f19-e672062e8814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6827","nonce":434661930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6829","nonce":434661930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6833","nonce":434661930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6831","nonce":434661930}]},"public_addr":"172.21.15.8:6827/434661930","cluster_addr":"172.21.15.8:6829/434661930","heartbeat_back_addr":"172.21.15.8:6833/434661930","heartbeat_front_addr":"172.21.15.8:6831/434661930","state":["exists","up"]},{"osd":10,"uuid":"62c632e4-94f6-4630-9d94-8d28fccacf45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6825","nonce":3281212184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6827","nonce":3281212184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6831","nonce":3281212184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6829","nonce":3281212184}]},"public_addr":"172.21.15.45:6825/3281212184","cluster_addr":"172.21.15.45:6827/3281212184","heartbeat_back_addr":"172.21.15.45:6831/3281212184","heartbeat_front_addr":"172.21.15.45:6829/3281212184","state":["exists","up"]},{"osd":11,"uuid":"8ca4a80d-cd75-4230-b46d-aef6fdc03e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6825","nonce":1637875895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6827","nonce":1637875895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6831","nonce":1637875895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6829","nonce":1637875895}]},"public_addr":"172.21.15.194:6825/1637875895","cluster_addr":"172.21.15.194:6827/1637875895","heartbeat_back_addr":"172.21.15.194:6831/1637875895","heartbeat_front_addr":"172.21.15.194:6829/1637875895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:04.255616+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:26.243863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:46.630365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:12.926291+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:35.747049+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:55.793767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:21.685725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:43.703215+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:04.043674+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:30.320026+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:52.751974+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:21:13.230024+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/2000592056":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2102228072":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2374527928":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2928221278":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2744750874":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/3681755887":"2023-08-12T12:15:02.528403+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-11T12:22:10.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.298+0000 7fa11e5ff700 1 -- 172.21.15.8:0/148480580 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa10009ff50 msgr2=0x7fa1000a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:10.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.298+0000 7fa11e5ff700 1 --2- 172.21.15.8:0/148480580 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa10009ff50 0x7fa1000a2410 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa118101a40 tx=0x7fa108007400 comp rx=0 tx=0).stop 2023-08-11T12:22:10.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.298+0000 7fa11e5ff700 1 -- 172.21.15.8:0/148480580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa118101be0 msgr2=0x7fa118196d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:10.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.298+0000 7fa11e5ff700 1 --2- 172.21.15.8:0/148480580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa118101be0 0x7fa118196d20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa10c00d950 tx=0x7fa10c00dc60 comp rx=0 tx=0).stop 2023-08-11T12:22:10.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.298+0000 7fa11e5ff700 1 -- 172.21.15.8:0/148480580 shutdown_connections 2023-08-11T12:22:10.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.298+0000 7fa11e5ff700 1 --2- 172.21.15.8:0/148480580 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa10009ff50 0x7fa1000a2410 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:10.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.298+0000 7fa11e5ff700 1 --2- 172.21.15.8:0/148480580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1181009f0 0x7fa1181967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:10.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.298+0000 7fa11e5ff700 1 --2- 172.21.15.8:0/148480580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa118102580 0x7fa11819dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:10.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.298+0000 7fa11e5ff700 1 --2- 172.21.15.8:0/148480580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa118101be0 0x7fa118196d20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:10.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.298+0000 7fa11e5ff700 1 -- 172.21.15.8:0/148480580 >> 172.21.15.8:0/148480580 conn(0x7fa1180fbf80 msgr2=0x7fa1180fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:10.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.298+0000 7fa11e5ff700 1 -- 172.21.15.8:0/148480580 shutdown_connections 2023-08-11T12:22:10.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.298+0000 7fa11e5ff700 1 -- 172.21.15.8:0/148480580 wait complete. 2023-08-11T12:22:10.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:09 smithi008 ceph-mon[97158]: osdmap e87: 12 total, 12 up, 12 in 2023-08-11T12:22:10.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:09 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3696638997' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2023-08-11T12:22:10.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:09 smithi008 ceph-mon[97158]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-11T12:22:10.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:09 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2527882811' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:22:10.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:09 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1189644204' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:10.340 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-11T12:22:10.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.544+0000 7fbc615ff700 1 -- 172.21.15.8:0/2702747500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc5c102570 msgr2=0x7fbc5c108e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:10.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.544+0000 7fbc615ff700 1 --2- 172.21.15.8:0/2702747500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc5c102570 0x7fbc5c108e20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400b0d0 tx=0x7fbc5400b3e0 comp rx=0 tx=0).stop 2023-08-11T12:22:10.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.544+0000 7fbc615ff700 1 -- 172.21.15.8:0/2702747500 shutdown_connections 2023-08-11T12:22:10.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.544+0000 7fbc615ff700 1 --2- 172.21.15.8:0/2702747500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc5c1009e0 0x7fbc5c100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:10.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.544+0000 7fbc615ff700 1 --2- 172.21.15.8:0/2702747500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc5c102570 0x7fbc5c108e20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:10.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.544+0000 7fbc615ff700 1 --2- 172.21.15.8:0/2702747500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc5c101bd0 0x7fbc5c102030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:10.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.544+0000 7fbc615ff700 1 -- 172.21.15.8:0/2702747500 >> 172.21.15.8:0/2702747500 conn(0x7fbc5c0fbf50 msgr2=0x7fbc5c0fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:10.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.544+0000 7fbc615ff700 1 -- 172.21.15.8:0/2702747500 shutdown_connections 2023-08-11T12:22:10.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.544+0000 7fbc615ff700 1 -- 172.21.15.8:0/2702747500 wait complete. 2023-08-11T12:22:10.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.545+0000 7fbc615ff700 1 Processor -- start 2023-08-11T12:22:10.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.545+0000 7fbc615ff700 1 -- start start 2023-08-11T12:22:10.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.546+0000 7fbc615ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc5c1009e0 0x7fbc5c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:10.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.546+0000 7fbc615ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc5c101bd0 0x7fbc5c198f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:10.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.546+0000 7fbc615ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc5c102570 0x7fbc5c19ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:10.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.546+0000 7fbc615ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c1a0550 con 0x7fbc5c101bd0 2023-08-11T12:22:10.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.546+0000 7fbc615ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c1a0690 con 0x7fbc5c1009e0 2023-08-11T12:22:10.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.546+0000 7fbc615ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c1a0820 con 0x7fbc5c102570 2023-08-11T12:22:10.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.546+0000 7fbc5a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc5c101bd0 0x7fbc5c198f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:10.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.546+0000 7fbc5a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc5c101bd0 0x7fbc5c198f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58986/0 (socket says 172.21.15.8:58986) 2023-08-11T12:22:10.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.546+0000 7fbc5a7fc700 1 -- 172.21.15.8:0/1083358247 learned_addr learned my addr 172.21.15.8:0/1083358247 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:10.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.546+0000 7fbc5affd700 1 --2- 172.21.15.8:0/1083358247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc5c1009e0 0x7fbc5c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:10.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.546+0000 7fbc5b7fe700 1 --2- 172.21.15.8:0/1083358247 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc5c102570 0x7fbc5c19ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:10.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.546+0000 7fbc5a7fc700 1 -- 172.21.15.8:0/1083358247 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc5c102570 msgr2=0x7fbc5c19ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:10.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.546+0000 7fbc5a7fc700 1 --2- 172.21.15.8:0/1083358247 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc5c102570 0x7fbc5c19ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:10.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.546+0000 7fbc5a7fc700 1 -- 172.21.15.8:0/1083358247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc5c1009e0 msgr2=0x7fbc5c1989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:10.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.546+0000 7fbc5a7fc700 1 --2- 172.21.15.8:0/1083358247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc5c1009e0 0x7fbc5c1989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:10.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.546+0000 7fbc5a7fc700 1 -- 172.21.15.8:0/1083358247 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc50009520 con 0x7fbc5c101bd0 2023-08-11T12:22:10.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.546+0000 7fbc5b7fe700 1 --2- 172.21.15.8:0/1083358247 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc5c102570 0x7fbc5c19ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:22:10.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.546+0000 7fbc5a7fc700 1 --2- 172.21.15.8:0/1083358247 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc5c101bd0 0x7fbc5c198f10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbc5000eb30 tx=0x7fbc5000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:10.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.547+0000 7fbc43fff700 1 -- 172.21.15.8:0/1083358247 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc50009880 con 0x7fbc5c101bd0 2023-08-11T12:22:10.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.547+0000 7fbc43fff700 1 -- 172.21.15.8:0/1083358247 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbc500044e0 con 0x7fbc5c101bd0 2023-08-11T12:22:10.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.547+0000 7fbc615ff700 1 -- 172.21.15.8:0/1083358247 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc54009d00 con 0x7fbc5c101bd0 2023-08-11T12:22:10.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.547+0000 7fbc43fff700 1 -- 172.21.15.8:0/1083358247 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc50010430 con 0x7fbc5c101bd0 2023-08-11T12:22:10.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.547+0000 7fbc615ff700 1 -- 172.21.15.8:0/1083358247 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc5c1a0e80 con 0x7fbc5c101bd0 2023-08-11T12:22:10.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.548+0000 7fbc615ff700 1 -- 172.21.15.8:0/1083358247 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc5c10c250 con 0x7fbc5c101bd0 2023-08-11T12:22:10.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.550+0000 7fbc43fff700 1 -- 172.21.15.8:0/1083358247 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fbc50003ee0 con 0x7fbc5c101bd0 2023-08-11T12:22:10.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.551+0000 7fbc43fff700 1 --2- 172.21.15.8:0/1083358247 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fbc4409ff50 0x7fbc440a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:10.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.551+0000 7fbc43fff700 1 -- 172.21.15.8:0/1083358247 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fbc50014070 con 0x7fbc5c101bd0 2023-08-11T12:22:10.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.551+0000 7fbc5affd700 1 --2- 172.21.15.8:0/1083358247 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fbc4409ff50 0x7fbc440a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:10.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.552+0000 7fbc5affd700 1 --2- 172.21.15.8:0/1083358247 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fbc4409ff50 0x7fbc440a2410 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c101a30 tx=0x7fbc4c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:10.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.553+0000 7fbc43fff700 1 -- 172.21.15.8:0/1083358247 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fbc50095620 con 0x7fbc5c101bd0 2023-08-11T12:22:10.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.810+0000 7fbc615ff700 1 -- 172.21.15.8:0/1083358247 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc5c1a1130 con 0x7fbc5c101bd0 2023-08-11T12:22:10.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.810+0000 7fbc43fff700 1 -- 172.21.15.8:0/1083358247 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+11240 (secure 0 0 0) 0x7fbc50004190 con 0x7fbc5c101bd0 2023-08-11T12:22:10.813 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:22:10.813 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14469,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2854286216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2854286216},{"type":"v1","addr":"172.21.15.8:6835","nonce":2854286216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/805368621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":805368621},{"type":"v1","addr":"172.21.15.8:6837","nonce":805368621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14526,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/2990530720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":2990530720},{"type":"v1","addr":"172.21.15.8:6839","nonce":2990530720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14538,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/3589272762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":3589272762},{"type":"v1","addr":"172.21.15.8:6841","nonce":3589272762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2043443402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2043443402},{"type":"v1","addr":"172.21.15.194:6833","nonce":2043443402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1208864615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1208864615},{"type":"v1","addr":"172.21.15.45:6833","nonce":1208864615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1776075470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1776075470},{"type":"v1","addr":"172.21.15.45:6835","nonce":1776075470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24517,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2457430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2457430285},{"type":"v1","addr":"172.21.15.194:6835","nonce":2457430285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24529,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/3072808560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":3072808560},{"type":"v1","addr":"172.21.15.194:6837","nonce":3072808560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/641549061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":641549061},{"type":"v1","addr":"172.21.15.45:6837","nonce":641549061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24550,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6839/2174476491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":2174476491},{"type":"v1","addr":"172.21.15.194:6839","nonce":2174476491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-11T12:22:03.398475+0000","modified":"2023-08-11T12:22:08.875325+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24575},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6839/119684732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":119684732},{"type":"v1","addr":"172.21.15.45:6839","nonce":119684732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-08-11T12:22:10.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.813+0000 7fbc615ff700 1 -- 172.21.15.8:0/1083358247 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fbc4409ff50 msgr2=0x7fbc440a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:10.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.813+0000 7fbc615ff700 1 --2- 172.21.15.8:0/1083358247 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fbc4409ff50 0x7fbc440a2410 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c101a30 tx=0x7fbc4c009260 comp rx=0 tx=0).stop 2023-08-11T12:22:10.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.813+0000 7fbc615ff700 1 -- 172.21.15.8:0/1083358247 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc5c101bd0 msgr2=0x7fbc5c198f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:10.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.813+0000 7fbc615ff700 1 --2- 172.21.15.8:0/1083358247 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc5c101bd0 0x7fbc5c198f10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbc5000eb30 tx=0x7fbc5000eef0 comp rx=0 tx=0).stop 2023-08-11T12:22:10.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.813+0000 7fbc615ff700 1 -- 172.21.15.8:0/1083358247 shutdown_connections 2023-08-11T12:22:10.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.813+0000 7fbc615ff700 1 --2- 172.21.15.8:0/1083358247 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fbc4409ff50 0x7fbc440a2410 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:10.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.813+0000 7fbc615ff700 1 --2- 172.21.15.8:0/1083358247 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc5c102570 0x7fbc5c19ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:10.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.813+0000 7fbc615ff700 1 --2- 172.21.15.8:0/1083358247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc5c1009e0 0x7fbc5c1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:10.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.813+0000 7fbc615ff700 1 --2- 172.21.15.8:0/1083358247 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc5c101bd0 0x7fbc5c198f10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:10.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.813+0000 7fbc615ff700 1 -- 172.21.15.8:0/1083358247 >> 172.21.15.8:0/1083358247 conn(0x7fbc5c0fbf50 msgr2=0x7fbc5c107400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:10.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.814+0000 7fbc615ff700 1 -- 172.21.15.8:0/1083358247 shutdown_connections 2023-08-11T12:22:10.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:10.814+0000 7fbc615ff700 1 -- 172.21.15.8:0/1083358247 wait complete. 2023-08-11T12:22:10.819 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 16 2023-08-11T12:22:10.835 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-11T12:22:11.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.040+0000 7f35e41ff700 1 -- 172.21.15.8:0/2137207172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35dc1066b0 msgr2=0x7f35dc108b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:11.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.040+0000 7f35e41ff700 1 --2- 172.21.15.8:0/2137207172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35dc1066b0 0x7f35dc108b20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f35d400b0a0 tx=0x7f35d400b3b0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.040+0000 7f35e41ff700 1 -- 172.21.15.8:0/2137207172 shutdown_connections 2023-08-11T12:22:11.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.040+0000 7f35e41ff700 1 --2- 172.21.15.8:0/2137207172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35dc1066b0 0x7f35dc108b20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.040+0000 7f35e41ff700 1 --2- 172.21.15.8:0/2137207172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35dc101450 0x7f35dc103840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.040+0000 7f35e41ff700 1 --2- 172.21.15.8:0/2137207172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35dc103d80 0x7f35dc106170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.040+0000 7f35e41ff700 1 -- 172.21.15.8:0/2137207172 >> 172.21.15.8:0/2137207172 conn(0x7f35dc0fae60 msgr2=0x7f35dc0fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:11.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.040+0000 7f35e41ff700 1 -- 172.21.15.8:0/2137207172 shutdown_connections 2023-08-11T12:22:11.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.040+0000 7f35e41ff700 1 -- 172.21.15.8:0/2137207172 wait complete. 2023-08-11T12:22:11.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.041+0000 7f35e41ff700 1 Processor -- start 2023-08-11T12:22:11.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.042+0000 7f35e41ff700 1 -- start start 2023-08-11T12:22:11.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.042+0000 7f35e41ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35dc101450 0x7f35dc1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:11.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.042+0000 7f35e41ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35dc103d80 0x7f35dc198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:11.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.042+0000 7f35e41ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35dc1066b0 0x7f35dc19ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:11.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.042+0000 7f35e41ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc1a0520 con 0x7f35dc103d80 2023-08-11T12:22:11.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.042+0000 7f35e41ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc1a0660 con 0x7f35dc101450 2023-08-11T12:22:11.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.042+0000 7f35e41ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc1a07f0 con 0x7f35dc1066b0 2023-08-11T12:22:11.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.042+0000 7f35e179a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35dc103d80 0x7f35dc198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:11.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.042+0000 7f35e179a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35dc103d80 0x7f35dc198ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59002/0 (socket says 172.21.15.8:59002) 2023-08-11T12:22:11.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.042+0000 7f35e179a700 1 -- 172.21.15.8:0/2712194245 learned_addr learned my addr 172.21.15.8:0/2712194245 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:11.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.042+0000 7f35e1f9b700 1 --2- 172.21.15.8:0/2712194245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35dc101450 0x7f35dc1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:11.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.042+0000 7f35e279c700 1 --2- 172.21.15.8:0/2712194245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35dc1066b0 0x7f35dc19ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:11.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.043+0000 7f35e179a700 1 -- 172.21.15.8:0/2712194245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35dc1066b0 msgr2=0x7f35dc19ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:11.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.043+0000 7f35e179a700 1 --2- 172.21.15.8:0/2712194245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35dc1066b0 0x7f35dc19ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.043+0000 7f35e179a700 1 -- 172.21.15.8:0/2712194245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35dc101450 msgr2=0x7f35dc1989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:11.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.043+0000 7f35e179a700 1 --2- 172.21.15.8:0/2712194245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35dc101450 0x7f35dc1989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.043+0000 7f35e179a700 1 -- 172.21.15.8:0/2712194245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d4009d00 con 0x7f35dc103d80 2023-08-11T12:22:11.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.043+0000 7f35e1f9b700 1 --2- 172.21.15.8:0/2712194245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35dc101450 0x7f35dc1989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:22:11.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.043+0000 7f35e179a700 1 --2- 172.21.15.8:0/2712194245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35dc103d80 0x7f35dc198ee0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f35cc00e9a0 tx=0x7f35cc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:11.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.043+0000 7f35d2ffd700 1 -- 172.21.15.8:0/2712194245 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc009790 con 0x7f35dc103d80 2023-08-11T12:22:11.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.043+0000 7f35d2ffd700 1 -- 172.21.15.8:0/2712194245 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f35cc010430 con 0x7f35dc103d80 2023-08-11T12:22:11.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.043+0000 7f35d2ffd700 1 -- 172.21.15.8:0/2712194245 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc018680 con 0x7f35dc103d80 2023-08-11T12:22:11.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.043+0000 7f35e41ff700 1 -- 172.21.15.8:0/2712194245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35dc1a0ad0 con 0x7f35dc103d80 2023-08-11T12:22:11.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.043+0000 7f35e41ff700 1 -- 172.21.15.8:0/2712194245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35dc1a0fe0 con 0x7f35dc103d80 2023-08-11T12:22:11.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.044+0000 7f35e41ff700 1 -- 172.21.15.8:0/2712194245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35dc108230 con 0x7f35dc103d80 2023-08-11T12:22:11.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.046+0000 7f35d2ffd700 1 -- 172.21.15.8:0/2712194245 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f35cc0105a0 con 0x7f35dc103d80 2023-08-11T12:22:11.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.048+0000 7f35d2ffd700 1 --2- 172.21.15.8:0/2712194245 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f35c809ffd0 0x7f35c80a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:11.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.048+0000 7f35d2ffd700 1 -- 172.21.15.8:0/2712194245 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f35cc014070 con 0x7f35dc103d80 2023-08-11T12:22:11.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.048+0000 7f35e1f9b700 1 --2- 172.21.15.8:0/2712194245 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f35c809ffd0 0x7f35c80a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:11.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.048+0000 7f35e1f9b700 1 --2- 172.21.15.8:0/2712194245 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f35c809ffd0 0x7f35c80a2490 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f35d8011490 tx=0x7f35d8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:11.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.051+0000 7f35d2ffd700 1 -- 172.21.15.8:0/2712194245 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f35cc051c30 con 0x7f35dc103d80 2023-08-11T12:22:11.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:10 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/148480580' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:11.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:10 smithi194 ceph-mon[130905]: pgmap v277: 129 pgs: 8 creating+peering, 116 active+clean, 5 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 660 B/s wr, 2 op/s 2023-08-11T12:22:11.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:10 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1083358247' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:22:11.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:10 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/148480580' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:11.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:10 smithi045 ceph-mon[130284]: pgmap v277: 129 pgs: 8 creating+peering, 116 active+clean, 5 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 660 B/s wr, 2 op/s 2023-08-11T12:22:11.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:10 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1083358247' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:22:11.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.262+0000 7f35e41ff700 1 -- 172.21.15.8:0/2712194245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35dc10c200 con 0x7f35dc103d80 2023-08-11T12:22:11.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.264+0000 7f35d2ffd700 1 -- 172.21.15.8:0/2712194245 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+23820 (secure 0 0 0) 0x7f35cc095100 con 0x7f35dc103d80 2023-08-11T12:22:11.266 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:22:11.266 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":87,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","created":"2023-08-11T12:14:28.341113+0000","modified":"2023-08-11T12:22:08.397736+0000","last_up_change":"2023-08-11T12:21:14.913735+0000","last_in_change":"2023-08-11T12:20:57.476558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-11T12:17:49.040758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-11T12:22:01.383296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-11T12:22:02.816329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-11T12:22:06.369375+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f903e393-7894-42d6-8b11-737ceef1f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6803","nonce":664104961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6805","nonce":664104961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6809","nonce":664104961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6807","nonce":664104961}]},"public_addr":"172.21.15.8:6803/664104961","cluster_addr":"172.21.15.8:6805/664104961","heartbeat_back_addr":"172.21.15.8:6809/664104961","heartbeat_front_addr":"172.21.15.8:6807/664104961","state":["exists","up"]},{"osd":1,"uuid":"1e988e5c-e78c-46d5-80a5-dff7ac38cbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6801","nonce":4187350703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6803","nonce":4187350703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6807","nonce":4187350703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6805","nonce":4187350703}]},"public_addr":"172.21.15.45:6801/4187350703","cluster_addr":"172.21.15.45:6803/4187350703","heartbeat_back_addr":"172.21.15.45:6807/4187350703","heartbeat_front_addr":"172.21.15.45:6805/4187350703","state":["exists","up"]},{"osd":2,"uuid":"1835217c-a93c-4181-b8b8-cc410bab1a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6801","nonce":2547818140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6803","nonce":2547818140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6807","nonce":2547818140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6805","nonce":2547818140}]},"public_addr":"172.21.15.194:6801/2547818140","cluster_addr":"172.21.15.194:6803/2547818140","heartbeat_back_addr":"172.21.15.194:6807/2547818140","heartbeat_front_addr":"172.21.15.194:6805/2547818140","state":["exists","up"]},{"osd":3,"uuid":"b55ae61a-731c-4312-a998-661122b84788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6811","nonce":187418883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6813","nonce":187418883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6817","nonce":187418883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6815","nonce":187418883}]},"public_addr":"172.21.15.8:6811/187418883","cluster_addr":"172.21.15.8:6813/187418883","heartbeat_back_addr":"172.21.15.8:6817/187418883","heartbeat_front_addr":"172.21.15.8:6815/187418883","state":["exists","up"]},{"osd":4,"uuid":"2c28acbb-e807-4559-8aa2-a35ca84b5d43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6809","nonce":3099704571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6811","nonce":3099704571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6815","nonce":3099704571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6813","nonce":3099704571}]},"public_addr":"172.21.15.45:6809/3099704571","cluster_addr":"172.21.15.45:6811/3099704571","heartbeat_back_addr":"172.21.15.45:6815/3099704571","heartbeat_front_addr":"172.21.15.45:6813/3099704571","state":["exists","up"]},{"osd":5,"uuid":"37032289-8016-4730-9b69-f7985e058ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6809","nonce":263803874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6811","nonce":263803874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6815","nonce":263803874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6813","nonce":263803874}]},"public_addr":"172.21.15.194:6809/263803874","cluster_addr":"172.21.15.194:6811/263803874","heartbeat_back_addr":"172.21.15.194:6815/263803874","heartbeat_front_addr":"172.21.15.194:6813/263803874","state":["exists","up"]},{"osd":6,"uuid":"32d2dab9-6944-40d1-ada9-4f941821b063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6819","nonce":1802966829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6821","nonce":1802966829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6825","nonce":1802966829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6823","nonce":1802966829}]},"public_addr":"172.21.15.8:6819/1802966829","cluster_addr":"172.21.15.8:6821/1802966829","heartbeat_back_addr":"172.21.15.8:6825/1802966829","heartbeat_front_addr":"172.21.15.8:6823/1802966829","state":["exists","up"]},{"osd":7,"uuid":"086aff58-1554-49fe-92ff-5166b115aeef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6817","nonce":3715737148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6819","nonce":3715737148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6823","nonce":3715737148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6821","nonce":3715737148}]},"public_addr":"172.21.15.45:6817/3715737148","cluster_addr":"172.21.15.45:6819/3715737148","heartbeat_back_addr":"172.21.15.45:6823/3715737148","heartbeat_front_addr":"172.21.15.45:6821/3715737148","state":["exists","up"]},{"osd":8,"uuid":"7fff5e95-2453-4ea6-a5c1-3bba6a1f6400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6817","nonce":57497127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6819","nonce":57497127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6823","nonce":57497127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6821","nonce":57497127}]},"public_addr":"172.21.15.194:6817/57497127","cluster_addr":"172.21.15.194:6819/57497127","heartbeat_back_addr":"172.21.15.194:6823/57497127","heartbeat_front_addr":"172.21.15.194:6821/57497127","state":["exists","up"]},{"osd":9,"uuid":"31ab0121-4c92-42ec-9f19-e672062e8814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6827","nonce":434661930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6829","nonce":434661930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6833","nonce":434661930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6831","nonce":434661930}]},"public_addr":"172.21.15.8:6827/434661930","cluster_addr":"172.21.15.8:6829/434661930","heartbeat_back_addr":"172.21.15.8:6833/434661930","heartbeat_front_addr":"172.21.15.8:6831/434661930","state":["exists","up"]},{"osd":10,"uuid":"62c632e4-94f6-4630-9d94-8d28fccacf45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6825","nonce":3281212184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6827","nonce":3281212184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6831","nonce":3281212184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6829","nonce":3281212184}]},"public_addr":"172.21.15.45:6825/3281212184","cluster_addr":"172.21.15.45:6827/3281212184","heartbeat_back_addr":"172.21.15.45:6831/3281212184","heartbeat_front_addr":"172.21.15.45:6829/3281212184","state":["exists","up"]},{"osd":11,"uuid":"8ca4a80d-cd75-4230-b46d-aef6fdc03e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6825","nonce":1637875895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6827","nonce":1637875895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6831","nonce":1637875895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6829","nonce":1637875895}]},"public_addr":"172.21.15.194:6825/1637875895","cluster_addr":"172.21.15.194:6827/1637875895","heartbeat_back_addr":"172.21.15.194:6831/1637875895","heartbeat_front_addr":"172.21.15.194:6829/1637875895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:04.255616+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:26.243863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:46.630365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:12.926291+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:35.747049+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:55.793767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:21.685725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:43.703215+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:04.043674+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:30.320026+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:52.751974+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:21:13.230024+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/2000592056":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2102228072":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2374527928":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2928221278":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2744750874":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/3681755887":"2023-08-12T12:15:02.528403+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-11T12:22:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.266+0000 7f35e41ff700 1 -- 172.21.15.8:0/2712194245 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f35c809ffd0 msgr2=0x7f35c80a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.266+0000 7f35e41ff700 1 --2- 172.21.15.8:0/2712194245 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f35c809ffd0 0x7f35c80a2490 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f35d8011490 tx=0x7f35d8009260 comp rx=0 tx=0).stop 2023-08-11T12:22:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.266+0000 7f35e41ff700 1 -- 172.21.15.8:0/2712194245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35dc103d80 msgr2=0x7f35dc198ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.266+0000 7f35e41ff700 1 --2- 172.21.15.8:0/2712194245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35dc103d80 0x7f35dc198ee0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f35cc00e9a0 tx=0x7f35cc00ecb0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.266+0000 7f35e41ff700 1 -- 172.21.15.8:0/2712194245 shutdown_connections 2023-08-11T12:22:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.266+0000 7f35e41ff700 1 --2- 172.21.15.8:0/2712194245 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f35c809ffd0 0x7f35c80a2490 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.266+0000 7f35e41ff700 1 --2- 172.21.15.8:0/2712194245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35dc1066b0 0x7f35dc19ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.266+0000 7f35e41ff700 1 --2- 172.21.15.8:0/2712194245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35dc101450 0x7f35dc1989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.266+0000 7f35e41ff700 1 --2- 172.21.15.8:0/2712194245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35dc103d80 0x7f35dc198ee0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.266+0000 7f35e41ff700 1 -- 172.21.15.8:0/2712194245 >> 172.21.15.8:0/2712194245 conn(0x7f35dc0fae60 msgr2=0x7f35dc0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.266+0000 7f35e41ff700 1 -- 172.21.15.8:0/2712194245 shutdown_connections 2023-08-11T12:22:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.266+0000 7f35e41ff700 1 -- 172.21.15.8:0/2712194245 wait complete. 2023-08-11T12:22:11.285 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:10 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/148480580' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:11.285 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:10 smithi008 ceph-mon[97158]: pgmap v277: 129 pgs: 8 creating+peering, 116 active+clean, 5 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 660 B/s wr, 2 op/s 2023-08-11T12:22:11.286 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:10 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1083358247' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:22:11.287 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-11T12:22:03.398475+0000', 'modified': '2023-08-11T12:22:08.875325+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24575}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24575': {'gid': 24575, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6839/119684732', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6838', 'nonce': 119684732}, {'type': 'v1', 'addr': '172.21.15.45:6839', 'nonce': 119684732}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-08-11T12:22:11.288 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-11T12:22:11.288 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-08-11T12:22:11.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.491+0000 7f70de3ff700 1 -- 172.21.15.8:0/3518841138 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70d81025a0 msgr2=0x7f70d8108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:11.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.491+0000 7f70de3ff700 1 --2- 172.21.15.8:0/3518841138 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70d81025a0 0x7f70d8108e50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f70d000b0d0 tx=0x7f70d000b3e0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.491+0000 7f70de3ff700 1 -- 172.21.15.8:0/3518841138 shutdown_connections 2023-08-11T12:22:11.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.491+0000 7f70de3ff700 1 --2- 172.21.15.8:0/3518841138 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70d81025a0 0x7f70d8108e50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.491+0000 7f70de3ff700 1 --2- 172.21.15.8:0/3518841138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70d8100a10 0x7f70d8100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.491+0000 7f70de3ff700 1 --2- 172.21.15.8:0/3518841138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70d8101c00 0x7f70d8102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.491+0000 7f70de3ff700 1 -- 172.21.15.8:0/3518841138 >> 172.21.15.8:0/3518841138 conn(0x7f70d80fbf80 msgr2=0x7f70d80fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:11.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.492+0000 7f70de3ff700 1 -- 172.21.15.8:0/3518841138 shutdown_connections 2023-08-11T12:22:11.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.492+0000 7f70de3ff700 1 -- 172.21.15.8:0/3518841138 wait complete. 2023-08-11T12:22:11.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.493+0000 7f70de3ff700 1 Processor -- start 2023-08-11T12:22:11.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.493+0000 7f70de3ff700 1 -- start start 2023-08-11T12:22:11.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.493+0000 7f70de3ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70d8100a10 0x7f70d81989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:11.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.493+0000 7f70de3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70d8101c00 0x7f70d8198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:11.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.493+0000 7f70de3ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70d81025a0 0x7f70d819ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:11.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.493+0000 7f70de3ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d81a0570 con 0x7f70d8100a10 2023-08-11T12:22:11.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.493+0000 7f70de3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d81a06b0 con 0x7f70d8101c00 2023-08-11T12:22:11.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.493+0000 7f70de3ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d81a0840 con 0x7f70d81025a0 2023-08-11T12:22:11.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.493+0000 7f70d7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70d8100a10 0x7f70d81989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:11.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.493+0000 7f70d7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70d8100a10 0x7f70d81989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59020/0 (socket says 172.21.15.8:59020) 2023-08-11T12:22:11.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.493+0000 7f70d7fff700 1 -- 172.21.15.8:0/543641654 learned_addr learned my addr 172.21.15.8:0/543641654 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:11.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.493+0000 7f70d77fe700 1 --2- 172.21.15.8:0/543641654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70d8101c00 0x7f70d8198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:11.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.494+0000 7f70dc99c700 1 --2- 172.21.15.8:0/543641654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70d81025a0 0x7f70d819ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:11.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.494+0000 7f70d7fff700 1 -- 172.21.15.8:0/543641654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70d81025a0 msgr2=0x7f70d819ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:11.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.494+0000 7f70d7fff700 1 --2- 172.21.15.8:0/543641654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70d81025a0 0x7f70d819ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.494+0000 7f70d7fff700 1 -- 172.21.15.8:0/543641654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70d8101c00 msgr2=0x7f70d8198f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:11.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.494+0000 7f70d7fff700 1 --2- 172.21.15.8:0/543641654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70d8101c00 0x7f70d8198f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.494+0000 7f70d7fff700 1 -- 172.21.15.8:0/543641654 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70cc009520 con 0x7f70d8100a10 2023-08-11T12:22:11.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.494+0000 7f70d7fff700 1 --2- 172.21.15.8:0/543641654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70d8100a10 0x7f70d81989f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f70c800e970 tx=0x7f70c800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:11.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.494+0000 7f70d57fa700 1 -- 172.21.15.8:0/543641654 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c8009790 con 0x7f70d8100a10 2023-08-11T12:22:11.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.494+0000 7f70d57fa700 1 -- 172.21.15.8:0/543641654 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f70c800c7e0 con 0x7f70d8100a10 2023-08-11T12:22:11.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.494+0000 7f70de3ff700 1 -- 172.21.15.8:0/543641654 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d0009d00 con 0x7f70d8100a10 2023-08-11T12:22:11.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.494+0000 7f70d57fa700 1 -- 172.21.15.8:0/543641654 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c8003c70 con 0x7f70d8100a10 2023-08-11T12:22:11.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.495+0000 7f70de3ff700 1 -- 172.21.15.8:0/543641654 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d81a0ea0 con 0x7f70d8100a10 2023-08-11T12:22:11.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.498+0000 7f70d57fa700 1 -- 172.21.15.8:0/543641654 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f70c800cc50 con 0x7f70d8100a10 2023-08-11T12:22:11.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.499+0000 7f70f1d2ab80 1 Processor -- start 2023-08-11T12:22:11.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.500+0000 7f70f1d2ab80 1 -- start start 2023-08-11T12:22:11.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.500+0000 7f70f1d2ab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df8d06ca80 0x55df8d06cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:11.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.500+0000 7f70f1d2ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df8d06d3e0 0x55df8d06d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:11.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.500+0000 7f70f1d2ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df8d06dda0 0x55df8d06e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:11.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.500+0000 7f70f1d2ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df8cfc55e0 con 0x55df8d06d3e0 2023-08-11T12:22:11.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.500+0000 7f70f1d2ab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df8cfc2f00 con 0x55df8d06ca80 2023-08-11T12:22:11.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.500+0000 7f70f1d2ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df8cfbe7f0 con 0x55df8d06dda0 2023-08-11T12:22:11.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.500+0000 7f70d57fa700 1 --2- 172.21.15.8:0/543641654 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f70c009ff50 0x7f70c00a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:11.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.500+0000 7f70d7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df8d06d3e0 0x55df8d06d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:11.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.500+0000 7f70d7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df8d06d3e0 0x55df8d06d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59022/0 (socket says 172.21.15.8:59022) 2023-08-11T12:22:11.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.500+0000 7f70d7fff700 1 -- 172.21.15.8:0/2101147475 learned_addr learned my addr 172.21.15.8:0/2101147475 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:11.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.500+0000 7f70dc99c700 1 --2- 172.21.15.8:0/2101147475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df8d06ca80 0x55df8d06cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:11.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.501+0000 7f70d57fa700 1 -- 172.21.15.8:0/543641654 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f70c8014070 con 0x7f70d8100a10 2023-08-11T12:22:11.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.501+0000 7f70d77fe700 1 --2- 172.21.15.8:0/2101147475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df8d06dda0 0x55df8d06e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:11.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.501+0000 7f70dc99c700 1 --2- 172.21.15.8:0/543641654 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f70c009ff50 0x7f70c00a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:11.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.501+0000 7f70d7fff700 1 -- 172.21.15.8:0/2101147475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df8d06dda0 msgr2=0x55df8d06e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:22:11.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.501+0000 7f70d7fff700 1 --2- 172.21.15.8:0/2101147475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df8d06dda0 0x55df8d06e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.501+0000 7f70d7fff700 1 -- 172.21.15.8:0/2101147475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df8d06ca80 msgr2=0x55df8d06cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:22:11.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.501+0000 7f70d7fff700 1 --2- 172.21.15.8:0/2101147475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df8d06ca80 0x55df8d06cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.501+0000 7f70d7fff700 1 -- 172.21.15.8:0/2101147475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df8ce3e5e0 con 0x55df8d06d3e0 2023-08-11T12:22:11.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.501+0000 7f70d7fff700 1 --2- 172.21.15.8:0/2101147475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df8d06d3e0 0x55df8d06d860 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f70c80c8ee0 tx=0x7f70c806aef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d31b97d429064 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:11.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.501+0000 7f70dc99c700 1 --2- 172.21.15.8:0/543641654 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f70c009ff50 0x7f70c00a2410 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f70d00060b0 tx=0x7f70d000b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:11.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.501+0000 7f70be7fc700 1 -- 172.21.15.8:0/2101147475 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c8003dd0 con 0x55df8d06d3e0 2023-08-11T12:22:11.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.501+0000 7f70be7fc700 1 -- 172.21.15.8:0/2101147475 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f70c8064e20 con 0x55df8d06d3e0 2023-08-11T12:22:11.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.501+0000 7f70be7fc700 1 -- 172.21.15.8:0/2101147475 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c800c950 con 0x55df8d06d3e0 2023-08-11T12:22:11.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.502+0000 7f70f1d2ab80 1 -- 172.21.15.8:0/2101147475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df8d06d3e0 msgr2=0x55df8d06d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:11.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.502+0000 7f70f1d2ab80 1 --2- 172.21.15.8:0/2101147475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df8d06d3e0 0x55df8d06d860 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f70c80c8ee0 tx=0x7f70c806aef0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.502+0000 7f70f1d2ab80 1 -- 172.21.15.8:0/2101147475 shutdown_connections 2023-08-11T12:22:11.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.502+0000 7f70f1d2ab80 1 --2- 172.21.15.8:0/2101147475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df8d06dda0 0x55df8d06e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.502+0000 7f70f1d2ab80 1 --2- 172.21.15.8:0/2101147475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df8d06ca80 0x55df8d06cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.502+0000 7f70f1d2ab80 1 --2- 172.21.15.8:0/2101147475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df8d06d3e0 0x55df8d06d860 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.502+0000 7f70f1d2ab80 1 -- 172.21.15.8:0/2101147475 >> 172.21.15.8:0/2101147475 conn(0x55df8cf99900 msgr2=0x55df8d0673d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:11.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.502+0000 7f70f1d2ab80 1 -- 172.21.15.8:0/2101147475 shutdown_connections 2023-08-11T12:22:11.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.502+0000 7f70f1d2ab80 1 -- 172.21.15.8:0/2101147475 wait complete. 2023-08-11T12:22:11.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.503+0000 7f70f1d2ab80 1 -- start start 2023-08-11T12:22:11.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.503+0000 7f70f1d2ab80 1 Processor -- start 2023-08-11T12:22:11.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.503+0000 7f70f1d2ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df8d06ca80 0x55df8d0760d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:11.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.503+0000 7f70f1d2ab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df8d06d3e0 0x55df8d076610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:11.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.503+0000 7f70f1d2ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df8d06dda0 0x55df8d07d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:11.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.503+0000 7f70f1d2ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df8cf5ca70 con 0x55df8d06dda0 2023-08-11T12:22:11.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.503+0000 7f70f1d2ab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df8cf5c770 con 0x55df8d06d3e0 2023-08-11T12:22:11.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.503+0000 7f70f1d2ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df8ce408d0 con 0x55df8d06ca80 2023-08-11T12:22:11.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.504+0000 7f70f1d2ab80 10 client.0 _ll_register_callbacks cb 0x55df8cf5fa60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:22:11.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.504+0000 7f70dc99c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df8d06dda0 0x55df8d07d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:11.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.504+0000 7f70dc99c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df8d06dda0 0x55df8d07d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59038/0 (socket says 172.21.15.8:59038) 2023-08-11T12:22:11.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.504+0000 7f70dc99c700 1 -- 172.21.15.8:0/2728597673 learned_addr learned my addr 172.21.15.8:0/2728597673 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:11.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.504+0000 7f70d7fff700 1 --2- 172.21.15.8:0/2728597673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df8d06ca80 0x55df8d0760d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:11.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.504+0000 7f70d77fe700 1 --2- 172.21.15.8:0/2728597673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df8d06d3e0 0x55df8d076610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:11.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.504+0000 7f70dc99c700 1 -- 172.21.15.8:0/2728597673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df8d06ca80 msgr2=0x55df8d0760d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:22:11.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.504+0000 7f70dc99c700 1 --2- 172.21.15.8:0/2728597673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df8d06ca80 0x55df8d0760d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.504+0000 7f70dc99c700 1 -- 172.21.15.8:0/2728597673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df8d06d3e0 msgr2=0x55df8d076610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:22:11.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.504+0000 7f70dc99c700 1 --2- 172.21.15.8:0/2728597673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df8d06d3e0 0x55df8d076610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.504+0000 7f70dc99c700 1 -- 172.21.15.8:0/2728597673 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d81a0ea0 con 0x55df8d06dda0 2023-08-11T12:22:11.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.504+0000 7f70dc99c700 1 --2- 172.21.15.8:0/2728597673 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df8d06dda0 0x55df8d07d650 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f70d0015000 tx=0x7f70d00099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ff81b6073cfd5e server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:11.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.504+0000 7f70b77fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:22:11.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.505+0000 7f70b77fe700 1 -- 172.21.15.8:0/2728597673 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d000e040 con 0x55df8d06dda0 2023-08-11T12:22:11.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.505+0000 7f70f1d2ab80 1 -- 172.21.15.8:0/2728597673 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55df8d05fa40 con 0x55df8d06dda0 2023-08-11T12:22:11.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.505+0000 7f70b77fe700 1 -- 172.21.15.8:0/2728597673 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f70d0005050 con 0x55df8d06dda0 2023-08-11T12:22:11.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.505+0000 7f70b77fe700 1 -- 172.21.15.8:0/2728597673 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70d0006160 con 0x55df8d06dda0 2023-08-11T12:22:11.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.505+0000 7f70f1d2ab80 10 client.14655 fetch_fsmap learned FSMap version 16 2023-08-11T12:22:11.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.505+0000 7f70f1d2ab80 1 -- 172.21.15.8:0/2728597673 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=4+}) v3 -- 0x55df8cdead90 con 0x55df8d06dda0 2023-08-11T12:22:11.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.505+0000 7f70b77fe700 1 -- 172.21.15.8:0/2728597673 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55df8d05fa40 con 0x55df8d06dda0 2023-08-11T12:22:11.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.505+0000 7f70b77fe700 1 -- 172.21.15.8:0/2728597673 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 16) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f70d001e8a0 con 0x55df8d06dda0 2023-08-11T12:22:11.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.505+0000 7f70f1d2ab80 10 client.14655 fetch_fsmap finished waiting for FSMap version 16 2023-08-11T12:22:11.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.506+0000 7f70f1d2ab80 10 client.14655 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-11T12:22:11.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.506+0000 7f70f1d2ab80 20 client.14655 populate_metadata read hostname 'smithi008' 2023-08-11T12:22:11.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.506+0000 7f70f1d2ab80 1 --2- 172.21.15.8:0/2728597673 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55df8d081cf0 0x55df8d080750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:11.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.506+0000 7f70f1d2ab80 4 client.14655 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:22:11.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.506+0000 7f70f1d2ab80 1 -- 172.21.15.8:0/2728597673 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55df8d03b490 con 0x55df8d081cf0 2023-08-11T12:22:11.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.506+0000 7f70d7fff700 1 --2- 172.21.15.8:0/2728597673 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55df8d081cf0 0x55df8d080750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:11.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.507+0000 7f70b77fe700 10 client.14655 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:22:11.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.507+0000 7f70d7fff700 1 --2- 172.21.15.8:0/2728597673 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55df8d081cf0 0x55df8d080750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd924323a4a6aaa5 server_cookie=2262f13092063017 in_seq=0 out_seq=0 2023-08-11T12:22:11.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.507+0000 7f70b77fe700 1 -- 172.21.15.8:0/2728597673 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55df8d03b490 con 0x55df8d081cf0 2023-08-11T12:22:11.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.507+0000 7f70b77fe700 10 client.14655 handle_command_reply: tid=0 2023-08-11T12:22:11.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.507+0000 7f70f1d2ab80 1 client.14655 shutdown 2023-08-11T12:22:11.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.508+0000 7f70f1d2ab80 1 -- 172.21.15.8:0/2728597673 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df8d06dda0 msgr2=0x55df8d07d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:11.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.508+0000 7f70f1d2ab80 1 --2- 172.21.15.8:0/2728597673 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df8d06dda0 0x55df8d07d650 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f70d0015000 tx=0x7f70d00099e0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.508+0000 7f70f1d2ab80 1 -- 172.21.15.8:0/2728597673 shutdown_connections 2023-08-11T12:22:11.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.508+0000 7f70f1d2ab80 1 --2- 172.21.15.8:0/2728597673 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55df8d081cf0 0x55df8d080750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.508+0000 7f70f1d2ab80 1 --2- 172.21.15.8:0/2728597673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df8d06ca80 0x55df8d0760d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.508+0000 7f70f1d2ab80 1 --2- 172.21.15.8:0/2728597673 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df8d06dda0 0x55df8d07d650 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.508+0000 7f70f1d2ab80 1 --2- 172.21.15.8:0/2728597673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df8d06d3e0 0x55df8d076610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.508+0000 7f70b77fe700 0 client.14655 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:22:11.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.508+0000 7f70f1d2ab80 1 -- 172.21.15.8:0/2728597673 >> 172.21.15.8:0/2728597673 conn(0x55df8cf99900 msgr2=0x55df8d061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:11.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.508+0000 7f70f1d2ab80 1 -- 172.21.15.8:0/2728597673 shutdown_connections 2023-08-11T12:22:11.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.508+0000 7f70f1d2ab80 1 -- 172.21.15.8:0/2728597673 wait complete. 2023-08-11T12:22:11.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.508+0000 7f70f1d2ab80 20 client.14655 trim_cache size 0 max 16384 2023-08-11T12:22:11.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.526+0000 7f70f1d2ab80 1 Processor -- start 2023-08-11T12:22:11.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.526+0000 7f70f1d2ab80 1 -- start start 2023-08-11T12:22:11.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.527+0000 7f70f1d2ab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df8d06ca80 0x55df8d0672f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:11.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.527+0000 7f70f1d2ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df8d06d3e0 0x55df8d07d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:11.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.527+0000 7f70f1d2ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df8d06dda0 0x55df8d070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:11.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.527+0000 7f70f1d2ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df8ce4cde0 con 0x55df8d06dda0 2023-08-11T12:22:11.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.527+0000 7f70f1d2ab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df8cf58d50 con 0x55df8d06ca80 2023-08-11T12:22:11.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.527+0000 7f70f1d2ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df8cf7b480 con 0x55df8d06d3e0 2023-08-11T12:22:11.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.527+0000 7f70dc99c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df8d06dda0 0x55df8d070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:11.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.527+0000 7f70dc99c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df8d06dda0 0x55df8d070ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59046/0 (socket says 172.21.15.8:59046) 2023-08-11T12:22:11.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.527+0000 7f70dc99c700 1 -- 172.21.15.8:0/2773968402 learned_addr learned my addr 172.21.15.8:0/2773968402 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:11.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.527+0000 7f70d77fe700 1 --2- 172.21.15.8:0/2773968402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df8d06d3e0 0x55df8d07d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:11.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.527+0000 7f70d7fff700 1 --2- 172.21.15.8:0/2773968402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df8d06ca80 0x55df8d0672f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:11.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.527+0000 7f70dc99c700 1 -- 172.21.15.8:0/2773968402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df8d06d3e0 msgr2=0x55df8d07d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:22:11.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.527+0000 7f70dc99c700 1 --2- 172.21.15.8:0/2773968402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df8d06d3e0 0x55df8d07d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.527+0000 7f70dc99c700 1 -- 172.21.15.8:0/2773968402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df8d06ca80 msgr2=0x55df8d0672f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:22:11.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.527+0000 7f70dc99c700 1 --2- 172.21.15.8:0/2773968402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df8d06ca80 0x55df8d0672f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.527+0000 7f70dc99c700 1 -- 172.21.15.8:0/2773968402 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df8cdd3c10 con 0x55df8d06dda0 2023-08-11T12:22:11.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.527+0000 7f70d7fff700 1 --2- 172.21.15.8:0/2773968402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df8d06ca80 0x55df8d0672f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:22:11.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.528+0000 7f70dc99c700 1 --2- 172.21.15.8:0/2773968402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df8d06dda0 0x55df8d070ca0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f70d0009550 tx=0x7f70d00061e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c86ba5a9089775 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:11.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.528+0000 7f70beffd700 1 -- 172.21.15.8:0/2773968402 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d0003d10 con 0x55df8d06dda0 2023-08-11T12:22:11.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.528+0000 7f70beffd700 1 -- 172.21.15.8:0/2773968402 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f70d0025030 con 0x55df8d06dda0 2023-08-11T12:22:11.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.528+0000 7f70beffd700 1 -- 172.21.15.8:0/2773968402 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d0005670 con 0x55df8d06dda0 2023-08-11T12:22:11.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.528+0000 7f70f1d2ab80 1 -- 172.21.15.8:0/2773968402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df8d06dda0 msgr2=0x55df8d070ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:11.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.528+0000 7f70f1d2ab80 1 --2- 172.21.15.8:0/2773968402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df8d06dda0 0x55df8d070ca0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f70d0009550 tx=0x7f70d00061e0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.528+0000 7f70f1d2ab80 1 -- 172.21.15.8:0/2773968402 shutdown_connections 2023-08-11T12:22:11.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.528+0000 7f70f1d2ab80 1 --2- 172.21.15.8:0/2773968402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df8d06dda0 0x55df8d070ca0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.528+0000 7f70f1d2ab80 1 --2- 172.21.15.8:0/2773968402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df8d06ca80 0x55df8d0672f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.528+0000 7f70f1d2ab80 1 --2- 172.21.15.8:0/2773968402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df8d06d3e0 0x55df8d07d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.528+0000 7f70f1d2ab80 1 -- 172.21.15.8:0/2773968402 >> 172.21.15.8:0/2773968402 conn(0x55df8cf99900 msgr2=0x55df8d074e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:11.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.529+0000 7f70f1d2ab80 1 -- 172.21.15.8:0/2773968402 shutdown_connections 2023-08-11T12:22:11.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.529+0000 7f70f1d2ab80 1 -- 172.21.15.8:0/2773968402 wait complete. 2023-08-11T12:22:11.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.529+0000 7f70f1d2ab80 1 -- start start 2023-08-11T12:22:11.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.529+0000 7f70f1d2ab80 1 Processor -- start 2023-08-11T12:22:11.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.530+0000 7f70f1d2ab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df8d06ca80 0x55df8d073220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:11.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.530+0000 7f70f1d2ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df8d06d3e0 0x55df8d07d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:11.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.530+0000 7f70f1d2ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df8d06dda0 0x55df8d071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:11.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.530+0000 7f70f1d2ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df8d073a50 con 0x55df8d06d3e0 2023-08-11T12:22:11.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.530+0000 7f70f1d2ab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df8d072130 con 0x55df8d06ca80 2023-08-11T12:22:11.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.530+0000 7f70f1d2ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df8d0722c0 con 0x55df8d06dda0 2023-08-11T12:22:11.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.530+0000 7f70f1d2ab80 10 client.0 _ll_register_callbacks cb 0x7f70d00078a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:22:11.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.530+0000 7f70d77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df8d06d3e0 0x55df8d07d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:11.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.530+0000 7f70d77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df8d06d3e0 0x55df8d07d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59062/0 (socket says 172.21.15.8:59062) 2023-08-11T12:22:11.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.530+0000 7f70d77fe700 1 -- 172.21.15.8:0/230229309 learned_addr learned my addr 172.21.15.8:0/230229309 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:11.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.530+0000 7f70d7fff700 1 --2- 172.21.15.8:0/230229309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df8d06ca80 0x55df8d073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:11.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.530+0000 7f70dc99c700 1 --2- 172.21.15.8:0/230229309 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df8d06dda0 0x55df8d071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:11.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.530+0000 7f70d7fff700 1 -- 172.21.15.8:0/230229309 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df8d06dda0 msgr2=0x55df8d071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:22:11.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.530+0000 7f70d7fff700 1 --2- 172.21.15.8:0/230229309 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df8d06dda0 0x55df8d071bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.530+0000 7f70d7fff700 1 -- 172.21.15.8:0/230229309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df8d06d3e0 msgr2=0x55df8d07d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:22:11.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.530+0000 7f70d7fff700 1 --2- 172.21.15.8:0/230229309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df8d06d3e0 0x55df8d07d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.530+0000 7f70d7fff700 1 -- 172.21.15.8:0/230229309 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df8cdead90 con 0x55df8d06ca80 2023-08-11T12:22:11.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.530+0000 7f70d77fe700 1 --2- 172.21.15.8:0/230229309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df8d06d3e0 0x55df8d07d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:22:11.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.531+0000 7f70d7fff700 1 --2- 172.21.15.8:0/230229309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df8d06ca80 0x55df8d073220 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f70c80958a0 tx=0x7f70c80952a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecbe993e77870c8b server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:11.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.531+0000 7f70b77fe700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:22:11.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.531+0000 7f70b77fe700 1 -- 172.21.15.8:0/230229309 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c809ccd0 con 0x55df8d06ca80 2023-08-11T12:22:11.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.531+0000 7f70f1d2ab80 1 -- 172.21.15.8:0/230229309 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f70c8064e20 con 0x55df8d06ca80 2023-08-11T12:22:11.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.531+0000 7f70b77fe700 1 -- 172.21.15.8:0/230229309 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f70c8099e40 con 0x55df8d06ca80 2023-08-11T12:22:11.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.531+0000 7f70b77fe700 1 -- 172.21.15.8:0/230229309 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70c8098970 con 0x55df8d06ca80 2023-08-11T12:22:11.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.531+0000 7f70f1d2ab80 10 client.24689 fetch_fsmap learned FSMap version 16 2023-08-11T12:22:11.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.531+0000 7f70f1d2ab80 1 -- 172.21.15.8:0/230229309 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=4+}) v3 -- 0x55df8ce11200 con 0x55df8d06ca80 2023-08-11T12:22:11.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.532+0000 7f70b77fe700 1 -- 172.21.15.8:0/230229309 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f70c8064e20 con 0x55df8d06ca80 2023-08-11T12:22:11.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.532+0000 7f70b77fe700 1 -- 172.21.15.8:0/230229309 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 16) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f70c8098320 con 0x55df8d06ca80 2023-08-11T12:22:11.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.532+0000 7f70f1d2ab80 10 client.24689 fetch_fsmap finished waiting for FSMap version 16 2023-08-11T12:22:11.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.532+0000 7f70f1d2ab80 10 client.24689 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-11T12:22:11.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.532+0000 7f70f1d2ab80 20 client.24689 populate_metadata read hostname 'smithi008' 2023-08-11T12:22:11.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.532+0000 7f70f1d2ab80 1 --2- 172.21.15.8:0/230229309 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55df8d0d9ad0 0x55df8d0d5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:11.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.532+0000 7f70f1d2ab80 4 client.24689 mds_command: new command op to 24575 tid=0[{"prefix": "status"}] 2023-08-11T12:22:11.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.532+0000 7f70f1d2ab80 1 -- 172.21.15.8:0/230229309 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55df8cfb77d0 con 0x55df8d0d9ad0 2023-08-11T12:22:11.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.532+0000 7f70d77fe700 1 --2- 172.21.15.8:0/230229309 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55df8d0d9ad0 0x55df8d0d5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:11.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.533+0000 7f70d77fe700 1 --2- 172.21.15.8:0/230229309 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55df8d0d9ad0 0x55df8d0d5f70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4191c4308bbce01 server_cookie=3449c1bd5b76b236 in_seq=0 out_seq=0 2023-08-11T12:22:11.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.533+0000 7f70b77fe700 10 client.24689 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:22:11.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.533+0000 7f70b77fe700 1 -- 172.21.15.8:0/230229309 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55df8cfb77d0 con 0x55df8d0d9ad0 2023-08-11T12:22:11.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.533+0000 7f70b77fe700 10 client.24689 handle_command_reply: tid=0 2023-08-11T12:22:11.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.533+0000 7f70f1d2ab80 1 client.24689 shutdown 2023-08-11T12:22:11.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.533+0000 7f70f1d2ab80 1 -- 172.21.15.8:0/230229309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df8d06ca80 msgr2=0x55df8d073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:11.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.533+0000 7f70f1d2ab80 1 --2- 172.21.15.8:0/230229309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df8d06ca80 0x55df8d073220 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f70c80958a0 tx=0x7f70c80952a0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.533+0000 7f70f1d2ab80 1 -- 172.21.15.8:0/230229309 shutdown_connections 2023-08-11T12:22:11.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.533+0000 7f70f1d2ab80 1 --2- 172.21.15.8:0/230229309 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55df8d0d9ad0 0x55df8d0d5f70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.533+0000 7f70f1d2ab80 1 --2- 172.21.15.8:0/230229309 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df8d06dda0 0x55df8d071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.533+0000 7f70b77fe700 0 client.24689 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:22:11.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.533+0000 7f70f1d2ab80 1 --2- 172.21.15.8:0/230229309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df8d06ca80 0x55df8d073220 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.533+0000 7f70f1d2ab80 1 --2- 172.21.15.8:0/230229309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df8d06d3e0 0x55df8d07d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.533+0000 7f70f1d2ab80 1 -- 172.21.15.8:0/230229309 >> 172.21.15.8:0/230229309 conn(0x55df8cf99900 msgr2=0x55df8d074120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:11.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.533+0000 7f70f1d2ab80 1 -- 172.21.15.8:0/230229309 shutdown_connections 2023-08-11T12:22:11.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.533+0000 7f70f1d2ab80 1 -- 172.21.15.8:0/230229309 wait complete. 2023-08-11T12:22:11.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.534+0000 7f70f1d2ab80 20 client.24689 trim_cache size 0 max 16384 2023-08-11T12:22:11.544 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:22:11.544 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "815f94ae-3840-11ee-9b37-001a4aab830c", 2023-08-11T12:22:11.544 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2023-08-11T12:22:11.544 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24575, 2023-08-11T12:22:11.545 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-08-11T12:22:11.545 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-08-11T12:22:11.545 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-08-11T12:22:11.545 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 7.6811682890000004, 2023-08-11T12:22:11.545 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 16, 2023-08-11T12:22:11.545 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 87, 2023-08-11T12:22:11.545 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 87, 2023-08-11T12:22:11.545 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 13.892555344 2023-08-11T12:22:11.546 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:22:11.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.534+0000 7f70de3ff700 1 -- 172.21.15.8:0/543641654 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f70c009ff50 msgr2=0x7f70c00a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:11.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.534+0000 7f70de3ff700 1 --2- 172.21.15.8:0/543641654 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f70c009ff50 0x7f70c00a2410 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f70d00060b0 tx=0x7f70d000b040 comp rx=0 tx=0).stop 2023-08-11T12:22:11.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.534+0000 7f70de3ff700 1 -- 172.21.15.8:0/543641654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70d8100a10 msgr2=0x7f70d81989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:11.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.534+0000 7f70de3ff700 1 --2- 172.21.15.8:0/543641654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70d8100a10 0x7f70d81989f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f70c800e970 tx=0x7f70c800ec80 comp rx=0 tx=0).stop 2023-08-11T12:22:11.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.534+0000 7f70de3ff700 1 -- 172.21.15.8:0/543641654 shutdown_connections 2023-08-11T12:22:11.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.534+0000 7f70de3ff700 1 --2- 172.21.15.8:0/543641654 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f70c009ff50 0x7f70c00a2410 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.534+0000 7f70de3ff700 1 --2- 172.21.15.8:0/543641654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70d81025a0 0x7f70d819ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.534+0000 7f70de3ff700 1 --2- 172.21.15.8:0/543641654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70d8100a10 0x7f70d81989f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.534+0000 7f70de3ff700 1 --2- 172.21.15.8:0/543641654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70d8101c00 0x7f70d8198f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:11.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.534+0000 7f70de3ff700 1 -- 172.21.15.8:0/543641654 >> 172.21.15.8:0/543641654 conn(0x7f70d80fbf80 msgr2=0x7f70d8107430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:11.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.534+0000 7f70de3ff700 1 -- 172.21.15.8:0/543641654 shutdown_connections 2023-08-11T12:22:11.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:11.534+0000 7f70de3ff700 1 -- 172.21.15.8:0/543641654 wait complete. 2023-08-11T12:22:11.555 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-11T12:22:11.555 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-08-11T12:22:11.556 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph fs ls 2023-08-11T12:22:12.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:11 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2712194245' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:12.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:11 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2712194245' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:12.283 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:22:12.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:11 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2712194245' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:13.255 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:12 smithi008 ceph-mon[97158]: pgmap v278: 129 pgs: 4 creating+peering, 125 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 2 op/s 2023-08-11T12:22:13.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:12 smithi194 ceph-mon[130905]: pgmap v278: 129 pgs: 4 creating+peering, 125 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 2 op/s 2023-08-11T12:22:13.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:12 smithi045 ceph-mon[130284]: pgmap v278: 129 pgs: 4 creating+peering, 125 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 2 op/s 2023-08-11T12:22:13.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.936+0000 7f12ffb70700 1 -- 172.21.15.8:0/3083648750 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12f8101300 msgr2=0x7f12f810d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:13.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.936+0000 7f12ffb70700 1 --2- 172.21.15.8:0/3083648750 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12f8101300 0x7f12f810d810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f12f000b0a0 tx=0x7f12f000b3b0 comp rx=0 tx=0).stop 2023-08-11T12:22:13.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.936+0000 7f12ffb70700 1 -- 172.21.15.8:0/3083648750 shutdown_connections 2023-08-11T12:22:13.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.936+0000 7f12ffb70700 1 --2- 172.21.15.8:0/3083648750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12f8106940 0x7f12f8106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:13.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.936+0000 7f12ffb70700 1 --2- 172.21.15.8:0/3083648750 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12f8101300 0x7f12f810d810 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:13.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.936+0000 7f12ffb70700 1 --2- 172.21.15.8:0/3083648750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12f8100940 0x7f12f8100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:13.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.936+0000 7f12ffb70700 1 -- 172.21.15.8:0/3083648750 >> 172.21.15.8:0/3083648750 conn(0x7f12f80fc410 msgr2=0x7f12f80fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:13.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.936+0000 7f12ffb70700 1 -- 172.21.15.8:0/3083648750 shutdown_connections 2023-08-11T12:22:13.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.936+0000 7f12ffb70700 1 -- 172.21.15.8:0/3083648750 wait complete. 2023-08-11T12:22:13.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.937+0000 7f12ffb70700 1 Processor -- start 2023-08-11T12:22:13.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.937+0000 7f12ffb70700 1 -- start start 2023-08-11T12:22:13.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.938+0000 7f12ffb70700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12f8100940 0x7f12f8198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:13.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.938+0000 7f12ffb70700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12f8101300 0x7f12f81992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:13.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.938+0000 7f12ffb70700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12f8106940 0x7f12f819d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:13.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.938+0000 7f12ffb70700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f819dd60 con 0x7f12f8101300 2023-08-11T12:22:13.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.938+0000 7f12ffb70700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f819ded0 con 0x7f12f8106940 2023-08-11T12:22:13.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.938+0000 7f12ffb70700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f819e090 con 0x7f12f8100940 2023-08-11T12:22:13.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.938+0000 7f12fd10b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12f8101300 0x7f12f81992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:13.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.938+0000 7f12fd10b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12f8101300 0x7f12f81992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59076/0 (socket says 172.21.15.8:59076) 2023-08-11T12:22:13.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.938+0000 7f12fd10b700 1 -- 172.21.15.8:0/3702279518 learned_addr learned my addr 172.21.15.8:0/3702279518 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:13.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.938+0000 7f12fd90c700 1 --2- 172.21.15.8:0/3702279518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12f8100940 0x7f12f8198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:13.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.938+0000 7f12fe10d700 1 --2- 172.21.15.8:0/3702279518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12f8106940 0x7f12f819d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:13.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.938+0000 7f12fd10b700 1 -- 172.21.15.8:0/3702279518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12f8100940 msgr2=0x7f12f8198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:13.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.938+0000 7f12fd10b700 1 --2- 172.21.15.8:0/3702279518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12f8100940 0x7f12f8198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:13.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.938+0000 7f12fd10b700 1 -- 172.21.15.8:0/3702279518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12f8106940 msgr2=0x7f12f819d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:13.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.938+0000 7f12fd10b700 1 --2- 172.21.15.8:0/3702279518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12f8106940 0x7f12f819d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:13.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.938+0000 7f12fd10b700 1 -- 172.21.15.8:0/3702279518 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f0009d00 con 0x7f12f8101300 2023-08-11T12:22:13.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.939+0000 7f12fd10b700 1 --2- 172.21.15.8:0/3702279518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12f8101300 0x7f12f81992e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f12e800d980 tx=0x7f12e800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:13.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.939+0000 7f12eeffd700 1 -- 172.21.15.8:0/3702279518 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8004220 con 0x7f12f8101300 2023-08-11T12:22:13.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.939+0000 7f12eeffd700 1 -- 172.21.15.8:0/3702279518 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f12e8007640 con 0x7f12f8101300 2023-08-11T12:22:13.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.939+0000 7f12eeffd700 1 -- 172.21.15.8:0/3702279518 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8005690 con 0x7f12f8101300 2023-08-11T12:22:13.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.939+0000 7f12ffb70700 1 -- 172.21.15.8:0/3702279518 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f819e370 con 0x7f12f8101300 2023-08-11T12:22:13.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.939+0000 7f12ffb70700 1 -- 172.21.15.8:0/3702279518 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f81a5bd0 con 0x7f12f8101300 2023-08-11T12:22:13.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.940+0000 7f12ffb70700 1 -- 172.21.15.8:0/3702279518 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f804e620 con 0x7f12f8101300 2023-08-11T12:22:13.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.942+0000 7f12eeffd700 1 -- 172.21.15.8:0/3702279518 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f12e8004750 con 0x7f12f8101300 2023-08-11T12:22:13.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.943+0000 7f12eeffd700 1 --2- 172.21.15.8:0/3702279518 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f12e409ffd0 0x7f12e40a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:13.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.944+0000 7f12eeffd700 1 -- 172.21.15.8:0/3702279518 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f12e80cb200 con 0x7f12f8101300 2023-08-11T12:22:13.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.944+0000 7f12fd90c700 1 --2- 172.21.15.8:0/3702279518 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f12e409ffd0 0x7f12e40a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:13.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.944+0000 7f12fd90c700 1 --2- 172.21.15.8:0/3702279518 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f12e409ffd0 0x7f12e40a2490 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f12f4009be0 tx=0x7f12f4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:13.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:13.947+0000 7f12eeffd700 1 -- 172.21.15.8:0/3702279518 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f12e8094d40 con 0x7f12f8101300 2023-08-11T12:22:14.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:14.204+0000 7f12ffb70700 1 -- 172.21.15.8:0/3702279518 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f12f819a100 con 0x7f12f8101300 2023-08-11T12:22:14.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:14.204+0000 7f12eeffd700 1 -- 172.21.15.8:0/3702279518 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+88 (secure 0 0 0) 0x7f12e8016070 con 0x7f12f8101300 2023-08-11T12:22:14.207 INFO:teuthology.orchestra.run.smithi008.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-11T12:22:14.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:14.206+0000 7f12ffb70700 1 -- 172.21.15.8:0/3702279518 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f12e409ffd0 msgr2=0x7f12e40a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:14.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:14.206+0000 7f12ffb70700 1 --2- 172.21.15.8:0/3702279518 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f12e409ffd0 0x7f12e40a2490 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f12f4009be0 tx=0x7f12f4009260 comp rx=0 tx=0).stop 2023-08-11T12:22:14.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:14.206+0000 7f12ffb70700 1 -- 172.21.15.8:0/3702279518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12f8101300 msgr2=0x7f12f81992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:14.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:14.206+0000 7f12ffb70700 1 --2- 172.21.15.8:0/3702279518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12f8101300 0x7f12f81992e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f12e800d980 tx=0x7f12e800dc90 comp rx=0 tx=0).stop 2023-08-11T12:22:14.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:14.206+0000 7f12ffb70700 1 -- 172.21.15.8:0/3702279518 shutdown_connections 2023-08-11T12:22:14.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:14.206+0000 7f12ffb70700 1 --2- 172.21.15.8:0/3702279518 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f12e409ffd0 0x7f12e40a2490 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:14.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:14.206+0000 7f12ffb70700 1 --2- 172.21.15.8:0/3702279518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12f8100940 0x7f12f8198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:14.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:14.206+0000 7f12ffb70700 1 --2- 172.21.15.8:0/3702279518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12f8106940 0x7f12f819d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:14.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:14.206+0000 7f12ffb70700 1 --2- 172.21.15.8:0/3702279518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12f8101300 0x7f12f81992e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:14.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:14.206+0000 7f12ffb70700 1 -- 172.21.15.8:0/3702279518 >> 172.21.15.8:0/3702279518 conn(0x7f12f80fc410 msgr2=0x7f12f810bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:14.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:14.207+0000 7f12ffb70700 1 -- 172.21.15.8:0/3702279518 shutdown_connections 2023-08-11T12:22:14.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:14.207+0000 7f12ffb70700 1 -- 172.21.15.8:0/3702279518 wait complete. 2023-08-11T12:22:14.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:14 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3702279518' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-08-11T12:22:14.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:14 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3702279518' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-08-11T12:22:14.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:14 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3702279518' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-08-11T12:22:14.666 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-11T12:22:14.666 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-11T12:22:14.666 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi008.front.sepia.ceph.com 2023-08-11T12:22:14.667 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-08-11T12:22:14.667 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-08-11T12:22:14.667 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-11T12:22:14.668 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-11T12:22:14.668 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-11T12:22:14.668 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-08-11T12:22:14.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:22:14.669 DEBUG:teuthology.orchestra.run.smithi008:> ip addr 2023-08-11T12:22:14.715 INFO:teuthology.orchestra.run.smithi008.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-11T12:22:14.715 INFO:teuthology.orchestra.run.smithi008.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-11T12:22:14.716 INFO:teuthology.orchestra.run.smithi008.stdout: inet 127.0.0.1/8 scope host lo 2023-08-11T12:22:14.716 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-08-11T12:22:14.716 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 ::1/128 scope host 2023-08-11T12:22:14.716 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-08-11T12:22:14.716 INFO:teuthology.orchestra.run.smithi008.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-11T12:22:14.716 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2e brd ff:ff:ff:ff:ff:ff 2023-08-11T12:22:14.716 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f0 2023-08-11T12:22:14.717 INFO:teuthology.orchestra.run.smithi008.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-11T12:22:14.717 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2f brd ff:ff:ff:ff:ff:ff 2023-08-11T12:22:14.717 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f1 2023-08-11T12:22:14.717 INFO:teuthology.orchestra.run.smithi008.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-11T12:22:14.717 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:fe brd ff:ff:ff:ff:ff:ff 2023-08-11T12:22:14.717 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f0 2023-08-11T12:22:14.717 INFO:teuthology.orchestra.run.smithi008.stdout: inet 172.21.15.8/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-11T12:22:14.717 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft 41671sec preferred_lft 41671sec 2023-08-11T12:22:14.718 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::ae1f:6bff:fef8:25fe/64 scope link 2023-08-11T12:22:14.718 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-08-11T12:22:14.718 INFO:teuthology.orchestra.run.smithi008.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-11T12:22:14.718 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:ff brd ff:ff:ff:ff:ff:ff 2023-08-11T12:22:14.718 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f1 2023-08-11T12:22:14.719 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-11T12:22:14.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:22:14.720 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-08-11T12:22:14.720 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-08-11T12:22:14.721 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add name ceph-brx type bridge 2023-08-11T12:22:14.721 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip addr flush dev ceph-brx 2023-08-11T12:22:14.721 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set ceph-brx up 2023-08-11T12:22:14.721 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-11T12:22:14.722 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-08-11T12:22:15.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:22:15.221 DEBUG:teuthology.orchestra.run.smithi008:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-11T12:22:15.294 INFO:teuthology.orchestra.run.smithi008.stdout:1 2023-08-11T12:22:15.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:22:15.297 DEBUG:teuthology.orchestra.run.smithi008:> route 2023-08-11T12:22:15.357 INFO:teuthology.orchestra.run.smithi008.stdout:Kernel IP routing table 2023-08-11T12:22:15.358 INFO:teuthology.orchestra.run.smithi008.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-11T12:22:15.358 INFO:teuthology.orchestra.run.smithi008.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-11T12:22:15.358 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-11T12:22:15.359 INFO:teuthology.orchestra.run.smithi008.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-11T12:22:15.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:22:15.361 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-08-11T12:22:15.362 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-08-11T12:22:15.363 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-11T12:22:15.363 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-11T12:22:15.363 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-11T12:22:15.364 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-08-11T12:22:15.468 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:15 smithi008 ceph-mon[97158]: pgmap v279: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 401 B/s wr, 1 op/s 2023-08-11T12:22:15.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:15 smithi194 ceph-mon[130905]: pgmap v279: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 401 B/s wr, 1 op/s 2023-08-11T12:22:15.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:15 smithi045 ceph-mon[130284]: pgmap v279: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 401 B/s wr, 1 op/s 2023-08-11T12:22:16.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:22:16.131 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-08-11T12:22:16.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:22:16.176 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list-id 2023-08-11T12:22:16.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:22:16.260 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-08-11T12:22:16.261 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-08-11T12:22:16.261 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-08-11T12:22:16.261 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-08-11T12:22:16.262 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-08-11T12:22:16.446 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-08-11T12:22:16.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:22:16.447 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-08-11T12:22:16.447 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-08-11T12:22:16.448 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-08-11T12:22:16.448 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-11T12:22:16.448 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-08-11T12:22:16.448 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-08-11T12:22:16.449 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-08-11T12:22:16.449 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-08-11T12:22:16.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:22:16.752 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-08-11T12:22:16.753 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-08-11T12:22:16.753 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set brx.0 up 2023-08-11T12:22:16.753 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set dev brx.0 master ceph-brx 2023-08-11T12:22:16.753 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-08-11T12:22:16.930 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-08-11T12:22:16.931 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-11T12:22:16.931 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-08-11T12:22:16.975 INFO:teuthology.orchestra.run.smithi008.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-08-11T12:22:16.975 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-11T12:22:16.975 DEBUG:teuthology.orchestra.run.smithi008:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-08-11T12:22:17.057 DEBUG:teuthology.orchestra.run.smithi008:> sudo modprobe fuse 2023-08-11T12:22:17.180 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-11T12:22:17.181 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-11T12:22:17.250 INFO:teuthology.orchestra.run.smithi008.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-11T12:22:17.252 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-11T12:22:17.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:22:17.253 DEBUG:teuthology.orchestra.run.smithi008:> ls /sys/fs/fuse/connections 2023-08-11T12:22:17.297 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-11T12:22:17.298 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-08-11T12:22:17.342 DEBUG:teuthology.orchestra.run.smithi008:> sudo modprobe fuse 2023-08-11T12:22:17.415 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-11T12:22:17.416 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-11T12:22:17.488 INFO:teuthology.orchestra.run.smithi008.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-11T12:22:17.491 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-11T12:22:17.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:22:17.492 DEBUG:teuthology.orchestra.run.smithi008:> ls /sys/fs/fuse/connections 2023-08-11T12:22:17.568 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi008.stderr:2023-08-11T12:22:17.566+0000 7f1786f7b5c0 -1 init, newargv = 0x559f17a36030 newargc=15 2023-08-11T12:22:17.569 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi008.stderr:ceph-fuse[134195]: starting ceph client 2023-08-11T12:22:17.579 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi008.stderr:ceph-fuse[134195]: starting fuse 2023-08-11T12:22:17.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:17 smithi008 ceph-mon[97158]: pgmap v280: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-08-11T12:22:17.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:17 smithi194 ceph-mon[130905]: pgmap v280: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-08-11T12:22:17.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:17 smithi045 ceph-mon[130284]: pgmap v280: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-08-11T12:22:18.637 DEBUG:teuthology.orchestra.run.smithi008:> sudo modprobe fuse 2023-08-11T12:22:18.716 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-11T12:22:18.717 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-11T12:22:18.788 INFO:teuthology.orchestra.run.smithi008.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-11T12:22:18.791 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-11T12:22:18.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:22:18.792 DEBUG:teuthology.orchestra.run.smithi008:> ls /sys/fs/fuse/connections 2023-08-11T12:22:18.836 INFO:teuthology.orchestra.run.smithi008.stdout:121 2023-08-11T12:22:18.836 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [121] 2023-08-11T12:22:18.837 DEBUG:teuthology.orchestra.run.smithi008:> sudo stdin-killer -- python3 -c ' 2023-08-11T12:22:18.837 DEBUG:teuthology.orchestra.run.smithi008:> import glob 2023-08-11T12:22:18.837 DEBUG:teuthology.orchestra.run.smithi008:> import re 2023-08-11T12:22:18.838 DEBUG:teuthology.orchestra.run.smithi008:> import os 2023-08-11T12:22:18.838 DEBUG:teuthology.orchestra.run.smithi008:> import subprocess 2023-08-11T12:22:18.838 DEBUG:teuthology.orchestra.run.smithi008:> 2023-08-11T12:22:18.838 DEBUG:teuthology.orchestra.run.smithi008:> def _find_admin_socket(client_name): 2023-08-11T12:22:18.839 DEBUG:teuthology.orchestra.run.smithi008:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-08-11T12:22:18.839 DEBUG:teuthology.orchestra.run.smithi008:> files = glob.glob(asok_path) 2023-08-11T12:22:18.839 DEBUG:teuthology.orchestra.run.smithi008:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-08-11T12:22:18.839 DEBUG:teuthology.orchestra.run.smithi008:> 2023-08-11T12:22:18.840 DEBUG:teuthology.orchestra.run.smithi008:> # Given a non-glob path, it better be there 2023-08-11T12:22:18.840 DEBUG:teuthology.orchestra.run.smithi008:> if "*" not in asok_path: 2023-08-11T12:22:18.840 DEBUG:teuthology.orchestra.run.smithi008:> assert(len(files) == 1) 2023-08-11T12:22:18.841 DEBUG:teuthology.orchestra.run.smithi008:> return files[0] 2023-08-11T12:22:18.841 DEBUG:teuthology.orchestra.run.smithi008:> 2023-08-11T12:22:18.841 DEBUG:teuthology.orchestra.run.smithi008:> for f in files: 2023-08-11T12:22:18.841 DEBUG:teuthology.orchestra.run.smithi008:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-11T12:22:18.842 DEBUG:teuthology.orchestra.run.smithi008:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-11T12:22:18.842 DEBUG:teuthology.orchestra.run.smithi008:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-11T12:22:18.842 DEBUG:teuthology.orchestra.run.smithi008:> contents = proc_f.read() 2023-08-11T12:22:18.842 DEBUG:teuthology.orchestra.run.smithi008:> if mountpoint in contents: 2023-08-11T12:22:18.843 DEBUG:teuthology.orchestra.run.smithi008:> return f 2023-08-11T12:22:18.843 DEBUG:teuthology.orchestra.run.smithi008:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-11T12:22:18.843 DEBUG:teuthology.orchestra.run.smithi008:> 2023-08-11T12:22:18.844 DEBUG:teuthology.orchestra.run.smithi008:> print(_find_admin_socket("client.admin")) 2023-08-11T12:22:18.844 DEBUG:teuthology.orchestra.run.smithi008:> ' 2023-08-11T12:22:19.022 INFO:teuthology.orchestra.run.smithi008.stdout:/var/run/ceph/ceph-client.admin.134195.asok 2023-08-11T12:22:19.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-11T12:22:19.036 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.134195.asok 2023-08-11T12:22:19.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:22:19.037 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.134195.asok status 2023-08-11T12:22:19.267 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:22:19.267 INFO:teuthology.orchestra.run.smithi008.stdout: "metadata": { 2023-08-11T12:22:19.268 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_sha1": "92684807f016ce045ac66e37fdde6f8c47857bcc", 2023-08-11T12:22:19.268 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_version": "ceph version 18.0.0-5437-g92684807 (92684807f016ce045ac66e37fdde6f8c47857bcc) reef (dev)", 2023-08-11T12:22:19.268 INFO:teuthology.orchestra.run.smithi008.stdout: "entity_id": "admin", 2023-08-11T12:22:19.268 INFO:teuthology.orchestra.run.smithi008.stdout: "hostname": "smithi008", 2023-08-11T12:22:19.268 INFO:teuthology.orchestra.run.smithi008.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-08-11T12:22:19.268 INFO:teuthology.orchestra.run.smithi008.stdout: "pid": "134195", 2023-08-11T12:22:19.268 INFO:teuthology.orchestra.run.smithi008.stdout: "root": "/" 2023-08-11T12:22:19.269 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:22:19.269 INFO:teuthology.orchestra.run.smithi008.stdout: "dentry_count": 0, 2023-08-11T12:22:19.269 INFO:teuthology.orchestra.run.smithi008.stdout: "dentry_pinned_count": 0, 2023-08-11T12:22:19.269 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24712, 2023-08-11T12:22:19.269 INFO:teuthology.orchestra.run.smithi008.stdout: "inst": { 2023-08-11T12:22:19.269 INFO:teuthology.orchestra.run.smithi008.stdout: "name": { 2023-08-11T12:22:19.269 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "client", 2023-08-11T12:22:19.270 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 24712 2023-08-11T12:22:19.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:22:19.270 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": { 2023-08-11T12:22:19.270 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2023-08-11T12:22:19.270 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:0", 2023-08-11T12:22:19.270 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 2994730445 2023-08-11T12:22:19.270 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:22:19.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:22:19.271 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": { 2023-08-11T12:22:19.271 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2023-08-11T12:22:19.271 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:0", 2023-08-11T12:22:19.271 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 2994730445 2023-08-11T12:22:19.271 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:22:19.271 INFO:teuthology.orchestra.run.smithi008.stdout: "inst_str": "client.24712 172.21.15.8:0/2994730445", 2023-08-11T12:22:19.271 INFO:teuthology.orchestra.run.smithi008.stdout: "addr_str": "172.21.15.8:0/2994730445", 2023-08-11T12:22:19.271 INFO:teuthology.orchestra.run.smithi008.stdout: "inode_count": 1, 2023-08-11T12:22:19.272 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_epoch": 16, 2023-08-11T12:22:19.272 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_epoch": 87, 2023-08-11T12:22:19.272 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_epoch_barrier": 0, 2023-08-11T12:22:19.272 INFO:teuthology.orchestra.run.smithi008.stdout: "blocklisted": false, 2023-08-11T12:22:19.272 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs" 2023-08-11T12:22:19.272 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:22:19.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:22:19.282 DEBUG:teuthology.orchestra.run.smithi008:> stat --file-system '--printf=%T 2023-08-11T12:22:19.282 DEBUG:teuthology.orchestra.run.smithi008:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-08-11T12:22:19.327 INFO:teuthology.orchestra.run.smithi008.stdout:fuseblk 2023-08-11T12:22:19.327 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-08-11T12:22:19.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:22:19.328 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-08-11T12:22:19.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:22:19.439 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-08-11T12:22:19.570 INFO:teuthology.orchestra.run.smithi008.stdout:# file: . 2023-08-11T12:22:19.570 INFO:teuthology.orchestra.run.smithi008.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-08-11T12:22:19.571 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:22:19.571 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-11T12:22:19.572 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-11T12:22:19.615 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-11T12:22:19.717 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:19 smithi008 ceph-mon[97158]: pgmap v281: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-08-11T12:22:19.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.862+0000 7fec015ff700 1 -- 172.21.15.8:0/996236174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febfc074960 msgr2=0x7febfc072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:19.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.862+0000 7fec015ff700 1 --2- 172.21.15.8:0/996236174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febfc074960 0x7febfc072db0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7febec009990 tx=0x7febec009ca0 comp rx=0 tx=0).stop 2023-08-11T12:22:19.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.862+0000 7fec015ff700 1 -- 172.21.15.8:0/996236174 shutdown_connections 2023-08-11T12:22:19.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.862+0000 7fec015ff700 1 --2- 172.21.15.8:0/996236174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febfc1088b0 0x7febfc10ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:19.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.862+0000 7fec015ff700 1 --2- 172.21.15.8:0/996236174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febfc074960 0x7febfc072db0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:19.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.862+0000 7fec015ff700 1 --2- 172.21.15.8:0/996236174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febfc073380 0x7febfc073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:19.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.862+0000 7fec015ff700 1 -- 172.21.15.8:0/996236174 >> 172.21.15.8:0/996236174 conn(0x7febfc0fbf80 msgr2=0x7febfc0fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:19.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.862+0000 7fec015ff700 1 -- 172.21.15.8:0/996236174 shutdown_connections 2023-08-11T12:22:19.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.862+0000 7fec015ff700 1 -- 172.21.15.8:0/996236174 wait complete. 2023-08-11T12:22:19.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.863+0000 7fec015ff700 1 Processor -- start 2023-08-11T12:22:19.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.863+0000 7fec015ff700 1 -- start start 2023-08-11T12:22:19.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.863+0000 7fec015ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febfc073380 0x7febfc198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:19.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.863+0000 7fec015ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febfc074960 0x7febfc198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:19.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.863+0000 7fec015ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febfc1088b0 0x7febfc19feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:19.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.863+0000 7fec015ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc1a0480 con 0x7febfc073380 2023-08-11T12:22:19.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.863+0000 7fec015ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc1a05c0 con 0x7febfc074960 2023-08-11T12:22:19.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.863+0000 7fec015ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc1a0750 con 0x7febfc1088b0 2023-08-11T12:22:19.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.864+0000 7febfaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febfc073380 0x7febfc198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:19.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.864+0000 7febfaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febfc073380 0x7febfc198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36082/0 (socket says 172.21.15.8:36082) 2023-08-11T12:22:19.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.864+0000 7febfaffd700 1 -- 172.21.15.8:0/986963247 learned_addr learned my addr 172.21.15.8:0/986963247 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:19.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.864+0000 7febfb7fe700 1 --2- 172.21.15.8:0/986963247 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febfc1088b0 0x7febfc19feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:19.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.864+0000 7febfa7fc700 1 --2- 172.21.15.8:0/986963247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febfc074960 0x7febfc198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:19.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.864+0000 7febfaffd700 1 -- 172.21.15.8:0/986963247 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febfc1088b0 msgr2=0x7febfc19feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:19.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.864+0000 7febfaffd700 1 --2- 172.21.15.8:0/986963247 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febfc1088b0 0x7febfc19feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:19.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.864+0000 7febfaffd700 1 -- 172.21.15.8:0/986963247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febfc074960 msgr2=0x7febfc198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:19.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.864+0000 7febfaffd700 1 --2- 172.21.15.8:0/986963247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febfc074960 0x7febfc198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:19.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.864+0000 7febfaffd700 1 -- 172.21.15.8:0/986963247 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec0095f0 con 0x7febfc073380 2023-08-11T12:22:19.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.864+0000 7febfaffd700 1 --2- 172.21.15.8:0/986963247 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febfc073380 0x7febfc198900 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7febec0059d0 tx=0x7febec0047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:19.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.865+0000 7febe3fff700 1 -- 172.21.15.8:0/986963247 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec01d070 con 0x7febfc073380 2023-08-11T12:22:19.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.865+0000 7fec015ff700 1 -- 172.21.15.8:0/986963247 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febfc1a09d0 con 0x7febfc073380 2023-08-11T12:22:19.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.865+0000 7febe3fff700 1 -- 172.21.15.8:0/986963247 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7febec00fb90 con 0x7febfc073380 2023-08-11T12:22:19.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.865+0000 7febe3fff700 1 -- 172.21.15.8:0/986963247 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec017650 con 0x7febfc073380 2023-08-11T12:22:19.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.865+0000 7fec015ff700 1 -- 172.21.15.8:0/986963247 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febfc1a0df0 con 0x7febfc073380 2023-08-11T12:22:19.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.866+0000 7fec015ff700 1 -- 172.21.15.8:0/986963247 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febfc106f60 con 0x7febfc073380 2023-08-11T12:22:19.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.868+0000 7febe3fff700 1 -- 172.21.15.8:0/986963247 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7febec00fd00 con 0x7febfc073380 2023-08-11T12:22:19.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.869+0000 7febe3fff700 1 --2- 172.21.15.8:0/986963247 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7febe409ff50 0x7febe40a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:19.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.869+0000 7febe3fff700 1 -- 172.21.15.8:0/986963247 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8730+0+0 (secure 0 0 0) 0x7febec0cd280 con 0x7febfc073380 2023-08-11T12:22:19.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.870+0000 7febfa7fc700 1 --2- 172.21.15.8:0/986963247 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7febe409ff50 0x7febe40a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:19.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.870+0000 7febfa7fc700 1 --2- 172.21.15.8:0/986963247 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7febe409ff50 0x7febe40a2410 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7febfc074680 tx=0x7febf0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:19.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:19.871+0000 7febe3fff700 1 -- 172.21.15.8:0/986963247 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7febec096e50 con 0x7febfc073380 2023-08-11T12:22:19.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:19 smithi194 ceph-mon[130905]: pgmap v281: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-08-11T12:22:19.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:19 smithi045 ceph-mon[130284]: pgmap v281: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-08-11T12:22:20.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.088+0000 7fec015ff700 1 -- 172.21.15.8:0/986963247 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febfc10e3e0 con 0x7febfc073380 2023-08-11T12:22:20.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.089+0000 7febe3fff700 1 -- 172.21.15.8:0/986963247 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+23820 (secure 0 0 0) 0x7febec09a470 con 0x7febfc073380 2023-08-11T12:22:20.091 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:22:20.092 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":87,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","created":"2023-08-11T12:14:28.341113+0000","modified":"2023-08-11T12:22:08.397736+0000","last_up_change":"2023-08-11T12:21:14.913735+0000","last_in_change":"2023-08-11T12:20:57.476558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-11T12:17:49.040758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-11T12:22:01.383296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-11T12:22:02.816329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-11T12:22:06.369375+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f903e393-7894-42d6-8b11-737ceef1f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6803","nonce":664104961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6805","nonce":664104961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6809","nonce":664104961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6807","nonce":664104961}]},"public_addr":"172.21.15.8:6803/664104961","cluster_addr":"172.21.15.8:6805/664104961","heartbeat_back_addr":"172.21.15.8:6809/664104961","heartbeat_front_addr":"172.21.15.8:6807/664104961","state":["exists","up"]},{"osd":1,"uuid":"1e988e5c-e78c-46d5-80a5-dff7ac38cbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6801","nonce":4187350703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6803","nonce":4187350703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6807","nonce":4187350703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6805","nonce":4187350703}]},"public_addr":"172.21.15.45:6801/4187350703","cluster_addr":"172.21.15.45:6803/4187350703","heartbeat_back_addr":"172.21.15.45:6807/4187350703","heartbeat_front_addr":"172.21.15.45:6805/4187350703","state":["exists","up"]},{"osd":2,"uuid":"1835217c-a93c-4181-b8b8-cc410bab1a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6801","nonce":2547818140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6803","nonce":2547818140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6807","nonce":2547818140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6805","nonce":2547818140}]},"public_addr":"172.21.15.194:6801/2547818140","cluster_addr":"172.21.15.194:6803/2547818140","heartbeat_back_addr":"172.21.15.194:6807/2547818140","heartbeat_front_addr":"172.21.15.194:6805/2547818140","state":["exists","up"]},{"osd":3,"uuid":"b55ae61a-731c-4312-a998-661122b84788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6811","nonce":187418883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6813","nonce":187418883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6817","nonce":187418883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6815","nonce":187418883}]},"public_addr":"172.21.15.8:6811/187418883","cluster_addr":"172.21.15.8:6813/187418883","heartbeat_back_addr":"172.21.15.8:6817/187418883","heartbeat_front_addr":"172.21.15.8:6815/187418883","state":["exists","up"]},{"osd":4,"uuid":"2c28acbb-e807-4559-8aa2-a35ca84b5d43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6809","nonce":3099704571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6811","nonce":3099704571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6815","nonce":3099704571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6813","nonce":3099704571}]},"public_addr":"172.21.15.45:6809/3099704571","cluster_addr":"172.21.15.45:6811/3099704571","heartbeat_back_addr":"172.21.15.45:6815/3099704571","heartbeat_front_addr":"172.21.15.45:6813/3099704571","state":["exists","up"]},{"osd":5,"uuid":"37032289-8016-4730-9b69-f7985e058ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6809","nonce":263803874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6811","nonce":263803874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6815","nonce":263803874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6813","nonce":263803874}]},"public_addr":"172.21.15.194:6809/263803874","cluster_addr":"172.21.15.194:6811/263803874","heartbeat_back_addr":"172.21.15.194:6815/263803874","heartbeat_front_addr":"172.21.15.194:6813/263803874","state":["exists","up"]},{"osd":6,"uuid":"32d2dab9-6944-40d1-ada9-4f941821b063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6819","nonce":1802966829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6821","nonce":1802966829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6825","nonce":1802966829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6823","nonce":1802966829}]},"public_addr":"172.21.15.8:6819/1802966829","cluster_addr":"172.21.15.8:6821/1802966829","heartbeat_back_addr":"172.21.15.8:6825/1802966829","heartbeat_front_addr":"172.21.15.8:6823/1802966829","state":["exists","up"]},{"osd":7,"uuid":"086aff58-1554-49fe-92ff-5166b115aeef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6817","nonce":3715737148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6819","nonce":3715737148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6823","nonce":3715737148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6821","nonce":3715737148}]},"public_addr":"172.21.15.45:6817/3715737148","cluster_addr":"172.21.15.45:6819/3715737148","heartbeat_back_addr":"172.21.15.45:6823/3715737148","heartbeat_front_addr":"172.21.15.45:6821/3715737148","state":["exists","up"]},{"osd":8,"uuid":"7fff5e95-2453-4ea6-a5c1-3bba6a1f6400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6817","nonce":57497127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6819","nonce":57497127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6823","nonce":57497127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6821","nonce":57497127}]},"public_addr":"172.21.15.194:6817/57497127","cluster_addr":"172.21.15.194:6819/57497127","heartbeat_back_addr":"172.21.15.194:6823/57497127","heartbeat_front_addr":"172.21.15.194:6821/57497127","state":["exists","up"]},{"osd":9,"uuid":"31ab0121-4c92-42ec-9f19-e672062e8814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6827","nonce":434661930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6829","nonce":434661930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6833","nonce":434661930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6831","nonce":434661930}]},"public_addr":"172.21.15.8:6827/434661930","cluster_addr":"172.21.15.8:6829/434661930","heartbeat_back_addr":"172.21.15.8:6833/434661930","heartbeat_front_addr":"172.21.15.8:6831/434661930","state":["exists","up"]},{"osd":10,"uuid":"62c632e4-94f6-4630-9d94-8d28fccacf45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6825","nonce":3281212184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6827","nonce":3281212184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6831","nonce":3281212184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6829","nonce":3281212184}]},"public_addr":"172.21.15.45:6825/3281212184","cluster_addr":"172.21.15.45:6827/3281212184","heartbeat_back_addr":"172.21.15.45:6831/3281212184","heartbeat_front_addr":"172.21.15.45:6829/3281212184","state":["exists","up"]},{"osd":11,"uuid":"8ca4a80d-cd75-4230-b46d-aef6fdc03e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6825","nonce":1637875895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6827","nonce":1637875895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6831","nonce":1637875895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6829","nonce":1637875895}]},"public_addr":"172.21.15.194:6825/1637875895","cluster_addr":"172.21.15.194:6827/1637875895","heartbeat_back_addr":"172.21.15.194:6831/1637875895","heartbeat_front_addr":"172.21.15.194:6829/1637875895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:04.255616+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:26.243863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:46.630365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:12.926291+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:35.747049+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:55.793767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:21.685725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:43.703215+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:04.043674+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:30.320026+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:52.751974+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:21:13.230024+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/2000592056":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2102228072":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2374527928":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2928221278":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2744750874":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/3681755887":"2023-08-12T12:15:02.528403+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-11T12:22:20.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.092+0000 7fec015ff700 1 -- 172.21.15.8:0/986963247 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7febe409ff50 msgr2=0x7febe40a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:20.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.092+0000 7fec015ff700 1 --2- 172.21.15.8:0/986963247 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7febe409ff50 0x7febe40a2410 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7febfc074680 tx=0x7febf0009260 comp rx=0 tx=0).stop 2023-08-11T12:22:20.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.092+0000 7fec015ff700 1 -- 172.21.15.8:0/986963247 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febfc073380 msgr2=0x7febfc198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:20.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.092+0000 7fec015ff700 1 --2- 172.21.15.8:0/986963247 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febfc073380 0x7febfc198900 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7febec0059d0 tx=0x7febec0047a0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.092+0000 7fec015ff700 1 -- 172.21.15.8:0/986963247 shutdown_connections 2023-08-11T12:22:20.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.092+0000 7fec015ff700 1 --2- 172.21.15.8:0/986963247 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7febe409ff50 0x7febe40a2410 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.092+0000 7fec015ff700 1 --2- 172.21.15.8:0/986963247 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febfc1088b0 0x7febfc19feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.092+0000 7fec015ff700 1 --2- 172.21.15.8:0/986963247 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febfc073380 0x7febfc198900 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.092+0000 7fec015ff700 1 --2- 172.21.15.8:0/986963247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febfc074960 0x7febfc198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.092+0000 7fec015ff700 1 -- 172.21.15.8:0/986963247 >> 172.21.15.8:0/986963247 conn(0x7febfc0fbf80 msgr2=0x7febfc0fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:20.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.092+0000 7fec015ff700 1 -- 172.21.15.8:0/986963247 shutdown_connections 2023-08-11T12:22:20.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.092+0000 7fec015ff700 1 -- 172.21.15.8:0/986963247 wait complete. 2023-08-11T12:22:20.112 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-11T12:17:49.040758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-11T12:22:01.383296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-11T12:22:02.816329+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-11T12:22:06.369375+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-11T12:22:20.113 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-11T12:22:20.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.319+0000 7f128f9ff700 1 -- 172.21.15.8:0/926838227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1288100a00 msgr2=0x7f1288100e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:20.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.319+0000 7f128f9ff700 1 --2- 172.21.15.8:0/926838227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1288100a00 0x7f1288100e20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f12840099c0 tx=0x7f1284009cd0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.319+0000 7f128f9ff700 1 -- 172.21.15.8:0/926838227 shutdown_connections 2023-08-11T12:22:20.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.319+0000 7f128f9ff700 1 --2- 172.21.15.8:0/926838227 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1288102590 0x7f1288108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.319+0000 7f128f9ff700 1 --2- 172.21.15.8:0/926838227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1288100a00 0x7f1288100e20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.319+0000 7f128f9ff700 1 --2- 172.21.15.8:0/926838227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1288101bf0 0x7f1288102050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.319+0000 7f128f9ff700 1 -- 172.21.15.8:0/926838227 >> 172.21.15.8:0/926838227 conn(0x7f12880fbf70 msgr2=0x7f12880fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:20.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.319+0000 7f128f9ff700 1 -- 172.21.15.8:0/926838227 shutdown_connections 2023-08-11T12:22:20.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.319+0000 7f128f9ff700 1 -- 172.21.15.8:0/926838227 wait complete. 2023-08-11T12:22:20.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.320+0000 7f128f9ff700 1 Processor -- start 2023-08-11T12:22:20.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.320+0000 7f128f9ff700 1 -- start start 2023-08-11T12:22:20.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.320+0000 7f128f9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1288100a00 0x7f1288198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:20.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.320+0000 7f128f9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1288101bf0 0x7f1288198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:20.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.321+0000 7f128f9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1288102590 0x7f128819fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:20.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.321+0000 7f128f9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12881a04a0 con 0x7f1288100a00 2023-08-11T12:22:20.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.321+0000 7f128f9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12881a05e0 con 0x7f1288101bf0 2023-08-11T12:22:20.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.321+0000 7f128f9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12881a0770 con 0x7f1288102590 2023-08-11T12:22:20.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.321+0000 7f128cf9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1288101bf0 0x7f1288198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:20.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.321+0000 7f128d79b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1288100a00 0x7f1288198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:20.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.321+0000 7f128cf9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1288101bf0 0x7f1288198e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:60782/0 (socket says 172.21.15.8:60782) 2023-08-11T12:22:20.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.321+0000 7f128cf9a700 1 -- 172.21.15.8:0/3438929667 learned_addr learned my addr 172.21.15.8:0/3438929667 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:20.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.321+0000 7f128df9c700 1 --2- 172.21.15.8:0/3438929667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1288102590 0x7f128819fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:20.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.321+0000 7f128cf9a700 1 -- 172.21.15.8:0/3438929667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1288102590 msgr2=0x7f128819fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:20.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.321+0000 7f128cf9a700 1 --2- 172.21.15.8:0/3438929667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1288102590 0x7f128819fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.321+0000 7f128cf9a700 1 -- 172.21.15.8:0/3438929667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1288100a00 msgr2=0x7f1288198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:20.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.321+0000 7f128cf9a700 1 --2- 172.21.15.8:0/3438929667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1288100a00 0x7f1288198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.321+0000 7f128cf9a700 1 -- 172.21.15.8:0/3438929667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12840095f0 con 0x7f1288101bf0 2023-08-11T12:22:20.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.321+0000 7f128d79b700 1 --2- 172.21.15.8:0/3438929667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1288100a00 0x7f1288198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:22:20.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.321+0000 7f128cf9a700 1 --2- 172.21.15.8:0/3438929667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1288101bf0 0x7f1288198e60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f127800e9a0 tx=0x7f127800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:20.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.322+0000 7f127e7fc700 1 -- 172.21.15.8:0/3438929667 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1278009790 con 0x7f1288101bf0 2023-08-11T12:22:20.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.322+0000 7f127e7fc700 1 -- 172.21.15.8:0/3438929667 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1278010430 con 0x7f1288101bf0 2023-08-11T12:22:20.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.322+0000 7f128f9ff700 1 -- 172.21.15.8:0/3438929667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12881a0a50 con 0x7f1288101bf0 2023-08-11T12:22:20.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.322+0000 7f127e7fc700 1 -- 172.21.15.8:0/3438929667 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1278018680 con 0x7f1288101bf0 2023-08-11T12:22:20.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.322+0000 7f128f9ff700 1 -- 172.21.15.8:0/3438929667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12881a0f60 con 0x7f1288101bf0 2023-08-11T12:22:20.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.323+0000 7f128f9ff700 1 -- 172.21.15.8:0/3438929667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f128810c260 con 0x7f1288101bf0 2023-08-11T12:22:20.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.325+0000 7f127e7fc700 1 -- 172.21.15.8:0/3438929667 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f12780105a0 con 0x7f1288101bf0 2023-08-11T12:22:20.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.326+0000 7f127e7fc700 1 --2- 172.21.15.8:0/3438929667 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f127409ff50 0x7f12740a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:20.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.327+0000 7f127e7fc700 1 -- 172.21.15.8:0/3438929667 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f1278014070 con 0x7f1288101bf0 2023-08-11T12:22:20.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.327+0000 7f128d79b700 1 --2- 172.21.15.8:0/3438929667 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f127409ff50 0x7f12740a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:20.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.327+0000 7f128d79b700 1 --2- 172.21.15.8:0/3438929667 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f127409ff50 0x7f12740a2410 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1284009990 tx=0x7f1284005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:20.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.329+0000 7f127e7fc700 1 -- 172.21.15.8:0/3438929667 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f1278095380 con 0x7f1288101bf0 2023-08-11T12:22:20.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.539+0000 7f128f9ff700 1 -- 172.21.15.8:0/3438929667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f12881a10f0 con 0x7f1288101bf0 2023-08-11T12:22:20.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.539+0000 7f127e7fc700 1 -- 172.21.15.8:0/3438929667 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f12780260a0 con 0x7f1288101bf0 2023-08-11T12:22:20.541 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-08-11T12:22:20.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.542+0000 7f128f9ff700 1 -- 172.21.15.8:0/3438929667 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f127409ff50 msgr2=0x7f12740a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:20.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.542+0000 7f128f9ff700 1 --2- 172.21.15.8:0/3438929667 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f127409ff50 0x7f12740a2410 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1284009990 tx=0x7f1284005fb0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.542+0000 7f128f9ff700 1 -- 172.21.15.8:0/3438929667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1288101bf0 msgr2=0x7f1288198e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:20.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.542+0000 7f128f9ff700 1 --2- 172.21.15.8:0/3438929667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1288101bf0 0x7f1288198e60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f127800e9a0 tx=0x7f127800ecb0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.542+0000 7f128f9ff700 1 -- 172.21.15.8:0/3438929667 shutdown_connections 2023-08-11T12:22:20.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.542+0000 7f128f9ff700 1 --2- 172.21.15.8:0/3438929667 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f127409ff50 0x7f12740a2410 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.542+0000 7f128f9ff700 1 --2- 172.21.15.8:0/3438929667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1288102590 0x7f128819fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.542+0000 7f128f9ff700 1 --2- 172.21.15.8:0/3438929667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1288100a00 0x7f1288198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.542+0000 7f128f9ff700 1 --2- 172.21.15.8:0/3438929667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1288101bf0 0x7f1288198e60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.542+0000 7f128f9ff700 1 -- 172.21.15.8:0/3438929667 >> 172.21.15.8:0/3438929667 conn(0x7f12880fbf70 msgr2=0x7f12880fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:20.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.542+0000 7f128f9ff700 1 -- 172.21.15.8:0/3438929667 shutdown_connections 2023-08-11T12:22:20.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.542+0000 7f128f9ff700 1 -- 172.21.15.8:0/3438929667 wait complete. 2023-08-11T12:22:20.562 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-11T12:22:20.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.770+0000 7f3b319ff700 1 -- 172.21.15.8:0/3604679629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b2c100a10 msgr2=0x7f3b2c100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:20.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.770+0000 7f3b319ff700 1 --2- 172.21.15.8:0/3604679629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b2c100a10 0x7f3b2c100e30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c0099c0 tx=0x7f3b1c009cd0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.771+0000 7f3b319ff700 1 -- 172.21.15.8:0/3604679629 shutdown_connections 2023-08-11T12:22:20.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.771+0000 7f3b319ff700 1 --2- 172.21.15.8:0/3604679629 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2c1025a0 0x7f3b2c108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.771+0000 7f3b319ff700 1 --2- 172.21.15.8:0/3604679629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b2c100a10 0x7f3b2c100e30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.771+0000 7f3b319ff700 1 --2- 172.21.15.8:0/3604679629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b2c101c00 0x7f3b2c102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.771+0000 7f3b319ff700 1 -- 172.21.15.8:0/3604679629 >> 172.21.15.8:0/3604679629 conn(0x7f3b2c0fbf80 msgr2=0x7f3b2c0fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:20.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.771+0000 7f3b319ff700 1 -- 172.21.15.8:0/3604679629 shutdown_connections 2023-08-11T12:22:20.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.771+0000 7f3b319ff700 1 -- 172.21.15.8:0/3604679629 wait complete. 2023-08-11T12:22:20.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.772+0000 7f3b319ff700 1 Processor -- start 2023-08-11T12:22:20.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.772+0000 7f3b319ff700 1 -- start start 2023-08-11T12:22:20.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.772+0000 7f3b319ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2c100a10 0x7f3b2c196790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:20.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.772+0000 7f3b319ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b2c101c00 0x7f3b2c196cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:20.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.772+0000 7f3b319ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b2c1025a0 0x7f3b2c19dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:20.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.772+0000 7f3b319ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c19e310 con 0x7f3b2c101c00 2023-08-11T12:22:20.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.772+0000 7f3b319ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c19e450 con 0x7f3b2c1025a0 2023-08-11T12:22:20.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.772+0000 7f3b319ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c19e5e0 con 0x7f3b2c100a10 2023-08-11T12:22:20.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.772+0000 7f3b2a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b2c101c00 0x7f3b2c196cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:20.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.772+0000 7f3b2b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b2c1025a0 0x7f3b2c19dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:20.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.772+0000 7f3b2a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b2c101c00 0x7f3b2c196cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36128/0 (socket says 172.21.15.8:36128) 2023-08-11T12:22:20.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.772+0000 7f3b2a7fc700 1 -- 172.21.15.8:0/2606190189 learned_addr learned my addr 172.21.15.8:0/2606190189 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:20.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.773+0000 7f3b2affd700 1 --2- 172.21.15.8:0/2606190189 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2c100a10 0x7f3b2c196790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:20.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.773+0000 7f3b2a7fc700 1 -- 172.21.15.8:0/2606190189 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2c100a10 msgr2=0x7f3b2c196790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:20.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.773+0000 7f3b2a7fc700 1 --2- 172.21.15.8:0/2606190189 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2c100a10 0x7f3b2c196790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.773+0000 7f3b2a7fc700 1 -- 172.21.15.8:0/2606190189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b2c1025a0 msgr2=0x7f3b2c19dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:20.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.773+0000 7f3b2a7fc700 1 --2- 172.21.15.8:0/2606190189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b2c1025a0 0x7f3b2c19dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.773+0000 7f3b2a7fc700 1 -- 172.21.15.8:0/2606190189 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1c0095f0 con 0x7f3b2c101c00 2023-08-11T12:22:20.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.773+0000 7f3b2a7fc700 1 --2- 172.21.15.8:0/2606190189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b2c101c00 0x7f3b2c196cd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3b1400e9a0 tx=0x7f3b1400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:20.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.773+0000 7f3b309fd700 1 -- 172.21.15.8:0/2606190189 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b14009790 con 0x7f3b2c101c00 2023-08-11T12:22:20.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.773+0000 7f3b319ff700 1 -- 172.21.15.8:0/2606190189 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b2c19e8c0 con 0x7f3b2c101c00 2023-08-11T12:22:20.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.773+0000 7f3b309fd700 1 -- 172.21.15.8:0/2606190189 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b14010430 con 0x7f3b2c101c00 2023-08-11T12:22:20.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.773+0000 7f3b309fd700 1 -- 172.21.15.8:0/2606190189 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b14018680 con 0x7f3b2c101c00 2023-08-11T12:22:20.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.774+0000 7f3b319ff700 1 -- 172.21.15.8:0/2606190189 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2c19ee20 con 0x7f3b2c101c00 2023-08-11T12:22:20.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.775+0000 7f3b319ff700 1 -- 172.21.15.8:0/2606190189 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b2c107ff0 con 0x7f3b2c101c00 2023-08-11T12:22:20.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.777+0000 7f3b309fd700 1 -- 172.21.15.8:0/2606190189 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f3b140105a0 con 0x7f3b2c101c00 2023-08-11T12:22:20.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.779+0000 7f3b309fd700 1 --2- 172.21.15.8:0/2606190189 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3b1809ff50 0x7f3b180a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:20.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.779+0000 7f3b309fd700 1 -- 172.21.15.8:0/2606190189 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f3b14014070 con 0x7f3b2c101c00 2023-08-11T12:22:20.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.779+0000 7f3b2affd700 1 --2- 172.21.15.8:0/2606190189 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3b1809ff50 0x7f3b180a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:20.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.779+0000 7f3b2affd700 1 --2- 172.21.15.8:0/2606190189 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3b1809ff50 0x7f3b180a2410 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c009990 tx=0x7f3b1c005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:20.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.782+0000 7f3b309fd700 1 -- 172.21.15.8:0/2606190189 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f3b14051c30 con 0x7f3b2c101c00 2023-08-11T12:22:20.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.992+0000 7f3b319ff700 1 -- 172.21.15.8:0/2606190189 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3b2c02cc70 con 0x7f3b2c101c00 2023-08-11T12:22:20.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.993+0000 7f3b309fd700 1 -- 172.21.15.8:0/2606190189 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3b14095180 con 0x7f3b2c101c00 2023-08-11T12:22:20.995 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-08-11T12:22:20.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.995+0000 7f3b319ff700 1 -- 172.21.15.8:0/2606190189 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3b1809ff50 msgr2=0x7f3b180a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:20.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.995+0000 7f3b319ff700 1 --2- 172.21.15.8:0/2606190189 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3b1809ff50 0x7f3b180a2410 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c009990 tx=0x7f3b1c005fb0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.995+0000 7f3b319ff700 1 -- 172.21.15.8:0/2606190189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b2c101c00 msgr2=0x7f3b2c196cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:20.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.995+0000 7f3b319ff700 1 --2- 172.21.15.8:0/2606190189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b2c101c00 0x7f3b2c196cd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3b1400e9a0 tx=0x7f3b1400ecb0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.995+0000 7f3b319ff700 1 -- 172.21.15.8:0/2606190189 shutdown_connections 2023-08-11T12:22:20.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.995+0000 7f3b319ff700 1 --2- 172.21.15.8:0/2606190189 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3b1809ff50 0x7f3b180a2410 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.995+0000 7f3b319ff700 1 --2- 172.21.15.8:0/2606190189 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2c100a10 0x7f3b2c196790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.995+0000 7f3b319ff700 1 --2- 172.21.15.8:0/2606190189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b2c1025a0 0x7f3b2c19dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.995+0000 7f3b319ff700 1 --2- 172.21.15.8:0/2606190189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b2c101c00 0x7f3b2c196cd0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:20.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.995+0000 7f3b319ff700 1 -- 172.21.15.8:0/2606190189 >> 172.21.15.8:0/2606190189 conn(0x7f3b2c0fbf80 msgr2=0x7f3b2c105130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:21.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.996+0000 7f3b319ff700 1 -- 172.21.15.8:0/2606190189 shutdown_connections 2023-08-11T12:22:21.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:20.996+0000 7f3b319ff700 1 -- 172.21.15.8:0/2606190189 wait complete. 2023-08-11T12:22:21.013 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:20 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/986963247' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:21.013 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:20 smithi008 ceph-mon[97158]: pgmap v282: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-08-11T12:22:21.013 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:20 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3438929667' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:22:21.015 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-11T12:22:21.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:20 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/986963247' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:21.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:20 smithi194 ceph-mon[130905]: pgmap v282: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-08-11T12:22:21.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:20 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3438929667' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:22:21.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:20 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/986963247' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:21.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:20 smithi045 ceph-mon[130284]: pgmap v282: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-08-11T12:22:21.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:20 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3438929667' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:22:21.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.222+0000 7fae213ff700 1 -- 172.21.15.8:0/1025673089 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae1c1025a0 msgr2=0x7fae1c108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:21.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.222+0000 7fae213ff700 1 --2- 172.21.15.8:0/1025673089 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae1c1025a0 0x7fae1c108e50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fae1400b0d0 tx=0x7fae1400b3e0 comp rx=0 tx=0).stop 2023-08-11T12:22:21.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.222+0000 7fae213ff700 1 -- 172.21.15.8:0/1025673089 shutdown_connections 2023-08-11T12:22:21.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.222+0000 7fae213ff700 1 --2- 172.21.15.8:0/1025673089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae1c100a10 0x7fae1c100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:21.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.222+0000 7fae213ff700 1 --2- 172.21.15.8:0/1025673089 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae1c1025a0 0x7fae1c108e50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:21.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.222+0000 7fae213ff700 1 --2- 172.21.15.8:0/1025673089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae1c101c00 0x7fae1c102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:21.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.222+0000 7fae213ff700 1 -- 172.21.15.8:0/1025673089 >> 172.21.15.8:0/1025673089 conn(0x7fae1c0fbf80 msgr2=0x7fae1c0fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:21.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.222+0000 7fae213ff700 1 -- 172.21.15.8:0/1025673089 shutdown_connections 2023-08-11T12:22:21.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.222+0000 7fae213ff700 1 -- 172.21.15.8:0/1025673089 wait complete. 2023-08-11T12:22:21.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.223+0000 7fae213ff700 1 Processor -- start 2023-08-11T12:22:21.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.223+0000 7fae213ff700 1 -- start start 2023-08-11T12:22:21.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.223+0000 7fae213ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae1c100a10 0x7fae1c0746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:21.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.223+0000 7fae213ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae1c101c00 0x7fae1c072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:21.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.223+0000 7fae213ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae1c1025a0 0x7fae1c073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:21.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.223+0000 7fae213ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c0739f0 con 0x7fae1c100a10 2023-08-11T12:22:21.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.223+0000 7fae213ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c073b60 con 0x7fae1c101c00 2023-08-11T12:22:21.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.223+0000 7fae213ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c1a0820 con 0x7fae1c1025a0 2023-08-11T12:22:21.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.224+0000 7fae1affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae1c100a10 0x7fae1c0746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:21.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.224+0000 7fae1affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae1c100a10 0x7fae1c0746d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36138/0 (socket says 172.21.15.8:36138) 2023-08-11T12:22:21.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.224+0000 7fae1affd700 1 -- 172.21.15.8:0/1318134115 learned_addr learned my addr 172.21.15.8:0/1318134115 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:21.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.224+0000 7fae13fff700 1 --2- 172.21.15.8:0/1318134115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae1c101c00 0x7fae1c072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:21.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.224+0000 7fae1b7fe700 1 --2- 172.21.15.8:0/1318134115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae1c1025a0 0x7fae1c073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:21.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.224+0000 7fae1affd700 1 -- 172.21.15.8:0/1318134115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae1c1025a0 msgr2=0x7fae1c073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:21.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.224+0000 7fae1affd700 1 --2- 172.21.15.8:0/1318134115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae1c1025a0 0x7fae1c073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:21.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.224+0000 7fae1affd700 1 -- 172.21.15.8:0/1318134115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae1c101c00 msgr2=0x7fae1c072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:21.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.224+0000 7fae1affd700 1 --2- 172.21.15.8:0/1318134115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae1c101c00 0x7fae1c072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:21.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.224+0000 7fae1affd700 1 -- 172.21.15.8:0/1318134115 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae14009d00 con 0x7fae1c100a10 2023-08-11T12:22:21.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.225+0000 7fae1affd700 1 --2- 172.21.15.8:0/1318134115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae1c100a10 0x7fae1c0746d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fae0c00e970 tx=0x7fae0c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:21.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.225+0000 7fae18ff9700 1 -- 172.21.15.8:0/1318134115 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c009790 con 0x7fae1c100a10 2023-08-11T12:22:21.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.225+0000 7fae18ff9700 1 -- 172.21.15.8:0/1318134115 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae0c00c7e0 con 0x7fae1c100a10 2023-08-11T12:22:21.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.225+0000 7fae213ff700 1 -- 172.21.15.8:0/1318134115 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae1c1a0b00 con 0x7fae1c100a10 2023-08-11T12:22:21.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.225+0000 7fae18ff9700 1 -- 172.21.15.8:0/1318134115 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c003c70 con 0x7fae1c100a10 2023-08-11T12:22:21.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.225+0000 7fae213ff700 1 -- 172.21.15.8:0/1318134115 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae1c1a1010 con 0x7fae1c100a10 2023-08-11T12:22:21.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.226+0000 7fae213ff700 1 -- 172.21.15.8:0/1318134115 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae1c107f10 con 0x7fae1c100a10 2023-08-11T12:22:21.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.228+0000 7fae18ff9700 1 -- 172.21.15.8:0/1318134115 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fae0c00cc50 con 0x7fae1c100a10 2023-08-11T12:22:21.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.229+0000 7fae18ff9700 1 --2- 172.21.15.8:0/1318134115 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fae0809ff50 0x7fae080a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:21.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.230+0000 7fae18ff9700 1 -- 172.21.15.8:0/1318134115 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fae0c014070 con 0x7fae1c100a10 2023-08-11T12:22:21.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.230+0000 7fae13fff700 1 --2- 172.21.15.8:0/1318134115 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fae0809ff50 0x7fae080a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:21.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.230+0000 7fae13fff700 1 --2- 172.21.15.8:0/1318134115 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fae0809ff50 0x7fae080a2410 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fae04009c60 tx=0x7fae04009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:21.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.231+0000 7fae18ff9700 1 -- 172.21.15.8:0/1318134115 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fae0c095310 con 0x7fae1c100a10 2023-08-11T12:22:21.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.443+0000 7fae213ff700 1 -- 172.21.15.8:0/1318134115 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fae1c10c430 con 0x7fae1c100a10 2023-08-11T12:22:21.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.443+0000 7fae18ff9700 1 -- 172.21.15.8:0/1318134115 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7fae0c098930 con 0x7fae1c100a10 2023-08-11T12:22:21.445 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-08-11T12:22:21.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.445+0000 7fae213ff700 1 -- 172.21.15.8:0/1318134115 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fae0809ff50 msgr2=0x7fae080a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:21.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.445+0000 7fae213ff700 1 --2- 172.21.15.8:0/1318134115 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fae0809ff50 0x7fae080a2410 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fae04009c60 tx=0x7fae04009260 comp rx=0 tx=0).stop 2023-08-11T12:22:21.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.445+0000 7fae213ff700 1 -- 172.21.15.8:0/1318134115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae1c100a10 msgr2=0x7fae1c0746d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:21.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.445+0000 7fae213ff700 1 --2- 172.21.15.8:0/1318134115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae1c100a10 0x7fae1c0746d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fae0c00e970 tx=0x7fae0c00ec80 comp rx=0 tx=0).stop 2023-08-11T12:22:21.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.446+0000 7fae213ff700 1 -- 172.21.15.8:0/1318134115 shutdown_connections 2023-08-11T12:22:21.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.446+0000 7fae213ff700 1 --2- 172.21.15.8:0/1318134115 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fae0809ff50 0x7fae080a2410 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:21.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.446+0000 7fae213ff700 1 --2- 172.21.15.8:0/1318134115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae1c1025a0 0x7fae1c073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:21.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.446+0000 7fae213ff700 1 --2- 172.21.15.8:0/1318134115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae1c100a10 0x7fae1c0746d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:21.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.446+0000 7fae213ff700 1 --2- 172.21.15.8:0/1318134115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae1c101c00 0x7fae1c072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:21.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.446+0000 7fae213ff700 1 -- 172.21.15.8:0/1318134115 >> 172.21.15.8:0/1318134115 conn(0x7fae1c0fbf80 msgr2=0x7fae1c105050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:21.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.446+0000 7fae213ff700 1 -- 172.21.15.8:0/1318134115 shutdown_connections 2023-08-11T12:22:21.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.446+0000 7fae213ff700 1 -- 172.21.15.8:0/1318134115 wait complete. 2023-08-11T12:22:21.465 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-11T12:22:21.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.670+0000 7f8a5a9ff700 1 -- 172.21.15.8:0/2949019917 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a54073380 msgr2=0x7f8a54073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:21.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.670+0000 7f8a5a9ff700 1 --2- 172.21.15.8:0/2949019917 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a54073380 0x7f8a54073800 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8a48009990 tx=0x7f8a48009ca0 comp rx=0 tx=0).stop 2023-08-11T12:22:21.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.671+0000 7f8a5a9ff700 1 -- 172.21.15.8:0/2949019917 shutdown_connections 2023-08-11T12:22:21.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.671+0000 7f8a5a9ff700 1 --2- 172.21.15.8:0/2949019917 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a541088c0 0x7f8a5410ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:21.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.671+0000 7f8a5a9ff700 1 --2- 172.21.15.8:0/2949019917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a54074960 0x7f8a54072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:21.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.671+0000 7f8a5a9ff700 1 --2- 172.21.15.8:0/2949019917 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a54073380 0x7f8a54073800 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:21.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.671+0000 7f8a5a9ff700 1 -- 172.21.15.8:0/2949019917 >> 172.21.15.8:0/2949019917 conn(0x7f8a540fbf70 msgr2=0x7f8a540fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:21.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.671+0000 7f8a5a9ff700 1 -- 172.21.15.8:0/2949019917 shutdown_connections 2023-08-11T12:22:21.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.671+0000 7f8a5a9ff700 1 -- 172.21.15.8:0/2949019917 wait complete. 2023-08-11T12:22:21.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.672+0000 7f8a5a9ff700 1 Processor -- start 2023-08-11T12:22:21.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.672+0000 7f8a5a9ff700 1 -- start start 2023-08-11T12:22:21.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.672+0000 7f8a5a9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a54073380 0x7f8a541988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:21.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.672+0000 7f8a5a9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a54074960 0x7f8a54198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:21.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.672+0000 7f8a5a9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a541088c0 0x7f8a5419fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:21.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.672+0000 7f8a5a9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a541a0470 con 0x7f8a54073380 2023-08-11T12:22:21.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.672+0000 7f8a5a9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a541a05b0 con 0x7f8a54074960 2023-08-11T12:22:21.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.672+0000 7f8a5a9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a541a0740 con 0x7f8a541088c0 2023-08-11T12:22:21.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.673+0000 7f8a53fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a54073380 0x7f8a541988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:21.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.673+0000 7f8a537fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a54074960 0x7f8a54198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:21.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.673+0000 7f8a58f9c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a541088c0 0x7f8a5419fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:21.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.673+0000 7f8a537fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a54074960 0x7f8a54198e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:60832/0 (socket says 172.21.15.8:60832) 2023-08-11T12:22:21.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.673+0000 7f8a537fe700 1 -- 172.21.15.8:0/1120844435 learned_addr learned my addr 172.21.15.8:0/1120844435 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:21.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.673+0000 7f8a537fe700 1 -- 172.21.15.8:0/1120844435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a541088c0 msgr2=0x7f8a5419fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:21.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.673+0000 7f8a537fe700 1 --2- 172.21.15.8:0/1120844435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a541088c0 0x7f8a5419fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:21.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.673+0000 7f8a537fe700 1 -- 172.21.15.8:0/1120844435 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a54073380 msgr2=0x7f8a541988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:21.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.673+0000 7f8a537fe700 1 --2- 172.21.15.8:0/1120844435 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a54073380 0x7f8a541988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:21.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.673+0000 7f8a537fe700 1 -- 172.21.15.8:0/1120844435 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a44009520 con 0x7f8a54074960 2023-08-11T12:22:21.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.673+0000 7f8a537fe700 1 --2- 172.21.15.8:0/1120844435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a54074960 0x7f8a54198e30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8a48004710 tx=0x7f8a48009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:21.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.675+0000 7f8a517fa700 1 -- 172.21.15.8:0/1120844435 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4801d070 con 0x7f8a54074960 2023-08-11T12:22:21.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.675+0000 7f8a517fa700 1 -- 172.21.15.8:0/1120844435 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a48021410 con 0x7f8a54074960 2023-08-11T12:22:21.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.675+0000 7f8a517fa700 1 -- 172.21.15.8:0/1120844435 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a48017650 con 0x7f8a54074960 2023-08-11T12:22:21.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.675+0000 7f8a5a9ff700 1 -- 172.21.15.8:0/1120844435 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a480095f0 con 0x7f8a54074960 2023-08-11T12:22:21.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.675+0000 7f8a5a9ff700 1 -- 172.21.15.8:0/1120844435 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a541a0c50 con 0x7f8a54074960 2023-08-11T12:22:21.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.676+0000 7f8a5a9ff700 1 -- 172.21.15.8:0/1120844435 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a54106f70 con 0x7f8a54074960 2023-08-11T12:22:21.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.678+0000 7f8a517fa700 1 -- 172.21.15.8:0/1120844435 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f8a48021580 con 0x7f8a54074960 2023-08-11T12:22:21.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.679+0000 7f8a517fa700 1 --2- 172.21.15.8:0/1120844435 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8a3c09ffd0 0x7f8a3c0a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:21.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.679+0000 7f8a517fa700 1 -- 172.21.15.8:0/1120844435 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8a480cc7f0 con 0x7f8a54074960 2023-08-11T12:22:21.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.679+0000 7f8a53fff700 1 --2- 172.21.15.8:0/1120844435 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8a3c09ffd0 0x7f8a3c0a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:21.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.680+0000 7f8a53fff700 1 --2- 172.21.15.8:0/1120844435 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8a3c09ffd0 0x7f8a3c0a2490 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009df0 tx=0x7f8a44009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:21.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.684+0000 7f8a517fa700 1 -- 172.21.15.8:0/1120844435 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f8a480963c0 con 0x7f8a54074960 2023-08-11T12:22:21.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:21 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2606190189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:22:21.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:21 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1318134115' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:22:21.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.894+0000 7f8a5a9ff700 1 -- 172.21.15.8:0/1120844435 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8a5402ccc0 con 0x7f8a54074960 2023-08-11T12:22:21.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.895+0000 7f8a517fa700 1 -- 172.21.15.8:0/1120844435 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v87) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8a480999e0 con 0x7f8a54074960 2023-08-11T12:22:21.897 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-08-11T12:22:21.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.897+0000 7f8a5a9ff700 1 -- 172.21.15.8:0/1120844435 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8a3c09ffd0 msgr2=0x7f8a3c0a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.897+0000 7f8a5a9ff700 1 --2- 172.21.15.8:0/1120844435 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8a3c09ffd0 0x7f8a3c0a2490 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009df0 tx=0x7f8a44009260 comp rx=0 tx=0).stop 2023-08-11T12:22:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.897+0000 7f8a5a9ff700 1 -- 172.21.15.8:0/1120844435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a54074960 msgr2=0x7f8a54198e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.897+0000 7f8a5a9ff700 1 --2- 172.21.15.8:0/1120844435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a54074960 0x7f8a54198e30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8a48004710 tx=0x7f8a48009580 comp rx=0 tx=0).stop 2023-08-11T12:22:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.897+0000 7f8a5a9ff700 1 -- 172.21.15.8:0/1120844435 shutdown_connections 2023-08-11T12:22:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.897+0000 7f8a5a9ff700 1 --2- 172.21.15.8:0/1120844435 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8a3c09ffd0 0x7f8a3c0a2490 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.898+0000 7f8a5a9ff700 1 --2- 172.21.15.8:0/1120844435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a541088c0 0x7f8a5419fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.898+0000 7f8a5a9ff700 1 --2- 172.21.15.8:0/1120844435 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a54073380 0x7f8a541988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:21.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.898+0000 7f8a5a9ff700 1 --2- 172.21.15.8:0/1120844435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a54074960 0x7f8a54198e30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:21.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.898+0000 7f8a5a9ff700 1 -- 172.21.15.8:0/1120844435 >> 172.21.15.8:0/1120844435 conn(0x7f8a540fbf70 msgr2=0x7f8a540fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:21.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.898+0000 7f8a5a9ff700 1 -- 172.21.15.8:0/1120844435 shutdown_connections 2023-08-11T12:22:21.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:21.898+0000 7f8a5a9ff700 1 -- 172.21.15.8:0/1120844435 wait complete. 2023-08-11T12:22:21.918 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-11T12:22:22.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.122+0000 7f9a32dff700 1 -- 172.21.15.8:0/1587428448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a2c100a10 msgr2=0x7f9a2c100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:22.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.122+0000 7f9a32dff700 1 --2- 172.21.15.8:0/1587428448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a2c100a10 0x7f9a2c100e30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9a20009990 tx=0x7f9a20009ca0 comp rx=0 tx=0).stop 2023-08-11T12:22:22.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.122+0000 7f9a32dff700 1 -- 172.21.15.8:0/1587428448 shutdown_connections 2023-08-11T12:22:22.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.122+0000 7f9a32dff700 1 --2- 172.21.15.8:0/1587428448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a2c100a10 0x7f9a2c100e30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:22.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.122+0000 7f9a32dff700 1 --2- 172.21.15.8:0/1587428448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a2c1025a0 0x7f9a2c108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:22.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.122+0000 7f9a32dff700 1 --2- 172.21.15.8:0/1587428448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a2c101c00 0x7f9a2c102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:22.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.122+0000 7f9a32dff700 1 -- 172.21.15.8:0/1587428448 >> 172.21.15.8:0/1587428448 conn(0x7f9a2c0fbf80 msgr2=0x7f9a2c0fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:22.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.122+0000 7f9a32dff700 1 -- 172.21.15.8:0/1587428448 shutdown_connections 2023-08-11T12:22:22.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.122+0000 7f9a32dff700 1 -- 172.21.15.8:0/1587428448 wait complete. 2023-08-11T12:22:22.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.123+0000 7f9a32dff700 1 Processor -- start 2023-08-11T12:22:22.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.123+0000 7f9a32dff700 1 -- start start 2023-08-11T12:22:22.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.124+0000 7f9a32dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a2c100a10 0x7f9a2c106790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:22.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.124+0000 7f9a32dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a2c101c00 0x7f9a2c106cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:22.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.124+0000 7f9a32dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a2c1025a0 0x7f9a2c103320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:22.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.124+0000 7f9a32dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c103ac0 con 0x7f9a2c101c00 2023-08-11T12:22:22.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.124+0000 7f9a32dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c103c30 con 0x7f9a2c1025a0 2023-08-11T12:22:22.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.124+0000 7f9a32dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c103df0 con 0x7f9a2c100a10 2023-08-11T12:22:22.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.124+0000 7f9a2bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a2c101c00 0x7f9a2c106cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:22.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.124+0000 7f9a2bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a2c101c00 0x7f9a2c106cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36196/0 (socket says 172.21.15.8:36196) 2023-08-11T12:22:22.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.124+0000 7f9a2bfff700 1 -- 172.21.15.8:0/1079700981 learned_addr learned my addr 172.21.15.8:0/1079700981 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:22.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.124+0000 7f9a30b9b700 1 --2- 172.21.15.8:0/1079700981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a2c100a10 0x7f9a2c106790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:22.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.124+0000 7f9a3139c700 1 --2- 172.21.15.8:0/1079700981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a2c1025a0 0x7f9a2c103320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:22.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.124+0000 7f9a2bfff700 1 -- 172.21.15.8:0/1079700981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a2c100a10 msgr2=0x7f9a2c106790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:22.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.124+0000 7f9a2bfff700 1 --2- 172.21.15.8:0/1079700981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a2c100a10 0x7f9a2c106790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:22.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.124+0000 7f9a2bfff700 1 -- 172.21.15.8:0/1079700981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a2c1025a0 msgr2=0x7f9a2c103320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:22.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.124+0000 7f9a2bfff700 1 --2- 172.21.15.8:0/1079700981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a2c1025a0 0x7f9a2c103320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:22.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.124+0000 7f9a2bfff700 1 -- 172.21.15.8:0/1079700981 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a18009520 con 0x7f9a2c101c00 2023-08-11T12:22:22.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.124+0000 7f9a30b9b700 1 --2- 172.21.15.8:0/1079700981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a2c100a10 0x7f9a2c106790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:22:22.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.125+0000 7f9a2bfff700 1 --2- 172.21.15.8:0/1079700981 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a2c101c00 0x7f9a2c106cd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9a1800eb30 tx=0x7f9a1800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:22.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.125+0000 7f9a29ffb700 1 -- 172.21.15.8:0/1079700981 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a18009880 con 0x7f9a2c101c00 2023-08-11T12:22:22.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.125+0000 7f9a29ffb700 1 -- 172.21.15.8:0/1079700981 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9a180044e0 con 0x7f9a2c101c00 2023-08-11T12:22:22.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.125+0000 7f9a32dff700 1 -- 172.21.15.8:0/1079700981 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a200095f0 con 0x7f9a2c101c00 2023-08-11T12:22:22.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.125+0000 7f9a29ffb700 1 -- 172.21.15.8:0/1079700981 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a18003d80 con 0x7f9a2c101c00 2023-08-11T12:22:22.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.125+0000 7f9a32dff700 1 -- 172.21.15.8:0/1079700981 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a2c1a51b0 con 0x7f9a2c101c00 2023-08-11T12:22:22.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.126+0000 7f9a32dff700 1 -- 172.21.15.8:0/1079700981 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a2c193010 con 0x7f9a2c101c00 2023-08-11T12:22:22.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.128+0000 7f9a29ffb700 1 -- 172.21.15.8:0/1079700981 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f9a18003f20 con 0x7f9a2c101c00 2023-08-11T12:22:22.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.130+0000 7f9a29ffb700 1 --2- 172.21.15.8:0/1079700981 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9a1c09ffd0 0x7f9a1c0a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:22.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.130+0000 7f9a29ffb700 1 -- 172.21.15.8:0/1079700981 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f9a18014070 con 0x7f9a2c101c00 2023-08-11T12:22:22.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.130+0000 7f9a30b9b700 1 --2- 172.21.15.8:0/1079700981 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9a1c09ffd0 0x7f9a1c0a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:22.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.131+0000 7f9a30b9b700 1 --2- 172.21.15.8:0/1079700981 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9a1c09ffd0 0x7f9a1c0a2490 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000b2e0 tx=0x7f9a20005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:22.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.133+0000 7f9a29ffb700 1 -- 172.21.15.8:0/1079700981 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f9a180954a0 con 0x7f9a2c101c00 2023-08-11T12:22:22.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:21 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2606190189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:22:22.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:21 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1318134115' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:22:22.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:21 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2606190189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:22:22.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:21 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1318134115' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:22:22.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.360+0000 7f9a32dff700 1 -- 172.21.15.8:0/1079700981 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9a2c10c220 con 0x7f9a2c101c00 2023-08-11T12:22:22.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.361+0000 7f9a29ffb700 1 -- 172.21.15.8:0/1079700981 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v87) v1 ==== 81+0+582 (secure 0 0 0) 0x7f9a180041d0 con 0x7f9a2c101c00 2023-08-11T12:22:22.363 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2000592056 2023-08-12T12:15:30.423754+0000 2023-08-11T12:22:22.363 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2102228072 2023-08-12T12:15:30.423754+0000 2023-08-11T12:22:22.363 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6801/2832004641 2023-08-12T12:15:30.423754+0000 2023-08-11T12:22:22.364 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6800/2832004641 2023-08-12T12:15:30.423754+0000 2023-08-11T12:22:22.364 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6800/2108474030 2023-08-12T12:15:02.528403+0000 2023-08-11T12:22:22.364 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2374527928 2023-08-12T12:15:02.528403+0000 2023-08-11T12:22:22.364 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2928221278 2023-08-12T12:15:02.528403+0000 2023-08-11T12:22:22.364 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2744750874 2023-08-12T12:15:30.423754+0000 2023-08-11T12:22:22.364 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6801/2108474030 2023-08-12T12:15:02.528403+0000 2023-08-11T12:22:22.364 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/3681755887 2023-08-12T12:15:02.528403+0000 2023-08-11T12:22:22.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.363+0000 7f9a32dff700 1 -- 172.21.15.8:0/1079700981 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9a1c09ffd0 msgr2=0x7f9a1c0a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:22.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.363+0000 7f9a32dff700 1 --2- 172.21.15.8:0/1079700981 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9a1c09ffd0 0x7f9a1c0a2490 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000b2e0 tx=0x7f9a20005fb0 comp rx=0 tx=0).stop 2023-08-11T12:22:22.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.363+0000 7f9a32dff700 1 -- 172.21.15.8:0/1079700981 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a2c101c00 msgr2=0x7f9a2c106cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:22.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.363+0000 7f9a32dff700 1 --2- 172.21.15.8:0/1079700981 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a2c101c00 0x7f9a2c106cd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9a1800eb30 tx=0x7f9a1800ee40 comp rx=0 tx=0).stop 2023-08-11T12:22:22.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.363+0000 7f9a32dff700 1 -- 172.21.15.8:0/1079700981 shutdown_connections 2023-08-11T12:22:22.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.363+0000 7f9a32dff700 1 --2- 172.21.15.8:0/1079700981 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9a1c09ffd0 0x7f9a1c0a2490 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:22.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.363+0000 7f9a32dff700 1 --2- 172.21.15.8:0/1079700981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a2c100a10 0x7f9a2c106790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:22.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.363+0000 7f9a32dff700 1 --2- 172.21.15.8:0/1079700981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a2c1025a0 0x7f9a2c103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:22.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.363+0000 7f9a32dff700 1 --2- 172.21.15.8:0/1079700981 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a2c101c00 0x7f9a2c106cd0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:22.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.363+0000 7f9a32dff700 1 -- 172.21.15.8:0/1079700981 >> 172.21.15.8:0/1079700981 conn(0x7f9a2c0fbf80 msgr2=0x7f9a2c1074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:22.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.363+0000 7f9a32dff700 1 -- 172.21.15.8:0/1079700981 shutdown_connections 2023-08-11T12:22:22.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.364+0000 7f9a32dff700 1 -- 172.21.15.8:0/1079700981 wait complete. 2023-08-11T12:22:22.367 INFO:teuthology.orchestra.run.smithi008.stderr:listed 10 entries 2023-08-11T12:22:22.383 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-11T12:22:22.384 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-11T12:22:22.428 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-11T12:22:22.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.670+0000 7f4c947ff700 1 -- 172.21.15.8:0/2369025326 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c8c1088a0 msgr2=0x7f4c8c10ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:22.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.670+0000 7f4c947ff700 1 --2- 172.21.15.8:0/2369025326 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c8c1088a0 0x7f4c8c10ad30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4c8400b0a0 tx=0x7f4c8400b3b0 comp rx=0 tx=0).stop 2023-08-11T12:22:22.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.671+0000 7f4c947ff700 1 -- 172.21.15.8:0/2369025326 shutdown_connections 2023-08-11T12:22:22.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.671+0000 7f4c947ff700 1 --2- 172.21.15.8:0/2369025326 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c8c1088a0 0x7f4c8c10ad30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:22.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.671+0000 7f4c947ff700 1 --2- 172.21.15.8:0/2369025326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c8c074960 0x7f4c8c072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:22.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.671+0000 7f4c947ff700 1 --2- 172.21.15.8:0/2369025326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c8c073380 0x7f4c8c073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:22.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.671+0000 7f4c947ff700 1 -- 172.21.15.8:0/2369025326 >> 172.21.15.8:0/2369025326 conn(0x7f4c8c0fbf50 msgr2=0x7f4c8c0fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:22.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.671+0000 7f4c947ff700 1 -- 172.21.15.8:0/2369025326 shutdown_connections 2023-08-11T12:22:22.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.671+0000 7f4c947ff700 1 -- 172.21.15.8:0/2369025326 wait complete. 2023-08-11T12:22:22.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.672+0000 7f4c947ff700 1 Processor -- start 2023-08-11T12:22:22.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.672+0000 7f4c947ff700 1 -- start start 2023-08-11T12:22:22.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.673+0000 7f4c947ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c8c073380 0x7f4c8c198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:22.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.673+0000 7f4c947ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c8c074960 0x7f4c8c198f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:22.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.673+0000 7f4c947ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c8c1088a0 0x7f4c8c1a0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:22.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.673+0000 7f4c947ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c1a05d0 con 0x7f4c8c074960 2023-08-11T12:22:22.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.673+0000 7f4c947ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c1a0710 con 0x7f4c8c073380 2023-08-11T12:22:22.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.673+0000 7f4c947ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c1a08a0 con 0x7f4c8c1088a0 2023-08-11T12:22:22.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.673+0000 7f4c9259b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c8c073380 0x7f4c8c198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:22.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.673+0000 7f4c9259b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c8c073380 0x7f4c8c198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:60870/0 (socket says 172.21.15.8:60870) 2023-08-11T12:22:22.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.673+0000 7f4c9259b700 1 -- 172.21.15.8:0/872616654 learned_addr learned my addr 172.21.15.8:0/872616654 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:22.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.673+0000 7f4c92d9c700 1 --2- 172.21.15.8:0/872616654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c8c1088a0 0x7f4c8c1a0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:22.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.673+0000 7f4c91d9a700 1 --2- 172.21.15.8:0/872616654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c8c074960 0x7f4c8c198f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:22.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.673+0000 7f4c9259b700 1 -- 172.21.15.8:0/872616654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c8c1088a0 msgr2=0x7f4c8c1a0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:22.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.673+0000 7f4c9259b700 1 --2- 172.21.15.8:0/872616654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c8c1088a0 0x7f4c8c1a0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:22.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.673+0000 7f4c9259b700 1 -- 172.21.15.8:0/872616654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c8c074960 msgr2=0x7f4c8c198f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:22.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.673+0000 7f4c9259b700 1 --2- 172.21.15.8:0/872616654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c8c074960 0x7f4c8c198f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:22.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.673+0000 7f4c9259b700 1 -- 172.21.15.8:0/872616654 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7c009520 con 0x7f4c8c073380 2023-08-11T12:22:22.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.674+0000 7f4c9259b700 1 --2- 172.21.15.8:0/872616654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c8c073380 0x7f4c8c198a50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800eb30 tx=0x7f4c8800ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:22.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.675+0000 7f4c837fe700 1 -- 172.21.15.8:0/872616654 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c88009880 con 0x7f4c8c073380 2023-08-11T12:22:22.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.675+0000 7f4c837fe700 1 -- 172.21.15.8:0/872616654 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c880044e0 con 0x7f4c8c073380 2023-08-11T12:22:22.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.675+0000 7f4c837fe700 1 -- 172.21.15.8:0/872616654 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c88003d80 con 0x7f4c8c073380 2023-08-11T12:22:22.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.675+0000 7f4c947ff700 1 -- 172.21.15.8:0/872616654 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c88009520 con 0x7f4c8c073380 2023-08-11T12:22:22.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.676+0000 7f4c947ff700 1 -- 172.21.15.8:0/872616654 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c84009d00 con 0x7f4c8c073380 2023-08-11T12:22:22.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.677+0000 7f4c947ff700 1 -- 172.21.15.8:0/872616654 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c8c106f50 con 0x7f4c8c073380 2023-08-11T12:22:22.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.679+0000 7f4c837fe700 1 -- 172.21.15.8:0/872616654 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f4c88003f20 con 0x7f4c8c073380 2023-08-11T12:22:22.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.680+0000 7f4c837fe700 1 --2- 172.21.15.8:0/872616654 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f4c7809ff50 0x7f4c780a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:22.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.680+0000 7f4c837fe700 1 -- 172.21.15.8:0/872616654 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f4c88014070 con 0x7f4c8c073380 2023-08-11T12:22:22.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.680+0000 7f4c91d9a700 1 --2- 172.21.15.8:0/872616654 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f4c7809ff50 0x7f4c780a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:22.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.681+0000 7f4c91d9a700 1 --2- 172.21.15.8:0/872616654 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f4c7809ff50 0x7f4c780a2410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c074680 tx=0x7f4c7c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:22.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.684+0000 7f4c837fe700 1 -- 172.21.15.8:0/872616654 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f4c88095490 con 0x7f4c8c073380 2023-08-11T12:22:22.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.896+0000 7f4c947ff700 1 -- 172.21.15.8:0/872616654 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c8c02cd00 con 0x7f4c8c073380 2023-08-11T12:22:22.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.898+0000 7f4c837fe700 1 -- 172.21.15.8:0/872616654 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+23820 (secure 0 0 0) 0x7f4c88098ab0 con 0x7f4c8c073380 2023-08-11T12:22:22.900 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:22:22.900 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":87,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","created":"2023-08-11T12:14:28.341113+0000","modified":"2023-08-11T12:22:08.397736+0000","last_up_change":"2023-08-11T12:21:14.913735+0000","last_in_change":"2023-08-11T12:20:57.476558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-11T12:17:49.040758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-11T12:22:01.383296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-11T12:22:02.816329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-11T12:22:06.369375+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f903e393-7894-42d6-8b11-737ceef1f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6803","nonce":664104961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6805","nonce":664104961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6809","nonce":664104961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6807","nonce":664104961}]},"public_addr":"172.21.15.8:6803/664104961","cluster_addr":"172.21.15.8:6805/664104961","heartbeat_back_addr":"172.21.15.8:6809/664104961","heartbeat_front_addr":"172.21.15.8:6807/664104961","state":["exists","up"]},{"osd":1,"uuid":"1e988e5c-e78c-46d5-80a5-dff7ac38cbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6801","nonce":4187350703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6803","nonce":4187350703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6807","nonce":4187350703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6805","nonce":4187350703}]},"public_addr":"172.21.15.45:6801/4187350703","cluster_addr":"172.21.15.45:6803/4187350703","heartbeat_back_addr":"172.21.15.45:6807/4187350703","heartbeat_front_addr":"172.21.15.45:6805/4187350703","state":["exists","up"]},{"osd":2,"uuid":"1835217c-a93c-4181-b8b8-cc410bab1a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6801","nonce":2547818140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6803","nonce":2547818140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6807","nonce":2547818140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6805","nonce":2547818140}]},"public_addr":"172.21.15.194:6801/2547818140","cluster_addr":"172.21.15.194:6803/2547818140","heartbeat_back_addr":"172.21.15.194:6807/2547818140","heartbeat_front_addr":"172.21.15.194:6805/2547818140","state":["exists","up"]},{"osd":3,"uuid":"b55ae61a-731c-4312-a998-661122b84788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6811","nonce":187418883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6813","nonce":187418883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6817","nonce":187418883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6815","nonce":187418883}]},"public_addr":"172.21.15.8:6811/187418883","cluster_addr":"172.21.15.8:6813/187418883","heartbeat_back_addr":"172.21.15.8:6817/187418883","heartbeat_front_addr":"172.21.15.8:6815/187418883","state":["exists","up"]},{"osd":4,"uuid":"2c28acbb-e807-4559-8aa2-a35ca84b5d43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6809","nonce":3099704571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6811","nonce":3099704571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6815","nonce":3099704571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6813","nonce":3099704571}]},"public_addr":"172.21.15.45:6809/3099704571","cluster_addr":"172.21.15.45:6811/3099704571","heartbeat_back_addr":"172.21.15.45:6815/3099704571","heartbeat_front_addr":"172.21.15.45:6813/3099704571","state":["exists","up"]},{"osd":5,"uuid":"37032289-8016-4730-9b69-f7985e058ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6809","nonce":263803874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6811","nonce":263803874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6815","nonce":263803874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6813","nonce":263803874}]},"public_addr":"172.21.15.194:6809/263803874","cluster_addr":"172.21.15.194:6811/263803874","heartbeat_back_addr":"172.21.15.194:6815/263803874","heartbeat_front_addr":"172.21.15.194:6813/263803874","state":["exists","up"]},{"osd":6,"uuid":"32d2dab9-6944-40d1-ada9-4f941821b063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6819","nonce":1802966829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6821","nonce":1802966829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6825","nonce":1802966829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6823","nonce":1802966829}]},"public_addr":"172.21.15.8:6819/1802966829","cluster_addr":"172.21.15.8:6821/1802966829","heartbeat_back_addr":"172.21.15.8:6825/1802966829","heartbeat_front_addr":"172.21.15.8:6823/1802966829","state":["exists","up"]},{"osd":7,"uuid":"086aff58-1554-49fe-92ff-5166b115aeef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6817","nonce":3715737148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6819","nonce":3715737148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6823","nonce":3715737148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6821","nonce":3715737148}]},"public_addr":"172.21.15.45:6817/3715737148","cluster_addr":"172.21.15.45:6819/3715737148","heartbeat_back_addr":"172.21.15.45:6823/3715737148","heartbeat_front_addr":"172.21.15.45:6821/3715737148","state":["exists","up"]},{"osd":8,"uuid":"7fff5e95-2453-4ea6-a5c1-3bba6a1f6400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6817","nonce":57497127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6819","nonce":57497127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6823","nonce":57497127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6821","nonce":57497127}]},"public_addr":"172.21.15.194:6817/57497127","cluster_addr":"172.21.15.194:6819/57497127","heartbeat_back_addr":"172.21.15.194:6823/57497127","heartbeat_front_addr":"172.21.15.194:6821/57497127","state":["exists","up"]},{"osd":9,"uuid":"31ab0121-4c92-42ec-9f19-e672062e8814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6827","nonce":434661930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6829","nonce":434661930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6833","nonce":434661930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6831","nonce":434661930}]},"public_addr":"172.21.15.8:6827/434661930","cluster_addr":"172.21.15.8:6829/434661930","heartbeat_back_addr":"172.21.15.8:6833/434661930","heartbeat_front_addr":"172.21.15.8:6831/434661930","state":["exists","up"]},{"osd":10,"uuid":"62c632e4-94f6-4630-9d94-8d28fccacf45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6825","nonce":3281212184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6827","nonce":3281212184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6831","nonce":3281212184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6829","nonce":3281212184}]},"public_addr":"172.21.15.45:6825/3281212184","cluster_addr":"172.21.15.45:6827/3281212184","heartbeat_back_addr":"172.21.15.45:6831/3281212184","heartbeat_front_addr":"172.21.15.45:6829/3281212184","state":["exists","up"]},{"osd":11,"uuid":"8ca4a80d-cd75-4230-b46d-aef6fdc03e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6825","nonce":1637875895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6827","nonce":1637875895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6831","nonce":1637875895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6829","nonce":1637875895}]},"public_addr":"172.21.15.194:6825/1637875895","cluster_addr":"172.21.15.194:6827/1637875895","heartbeat_back_addr":"172.21.15.194:6831/1637875895","heartbeat_front_addr":"172.21.15.194:6829/1637875895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:04.255616+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:26.243863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:46.630365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:12.926291+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:35.747049+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:55.793767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:21.685725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:43.703215+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:04.043674+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:30.320026+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:52.751974+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:21:13.230024+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/2000592056":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2102228072":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2374527928":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2928221278":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2744750874":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/3681755887":"2023-08-12T12:15:02.528403+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-11T12:22:22.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.900+0000 7f4c947ff700 1 -- 172.21.15.8:0/872616654 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f4c7809ff50 msgr2=0x7f4c780a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:22.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.900+0000 7f4c947ff700 1 --2- 172.21.15.8:0/872616654 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f4c7809ff50 0x7f4c780a2410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c074680 tx=0x7f4c7c009260 comp rx=0 tx=0).stop 2023-08-11T12:22:22.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.900+0000 7f4c947ff700 1 -- 172.21.15.8:0/872616654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c8c073380 msgr2=0x7f4c8c198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:22.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.900+0000 7f4c947ff700 1 --2- 172.21.15.8:0/872616654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c8c073380 0x7f4c8c198a50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800eb30 tx=0x7f4c8800ee40 comp rx=0 tx=0).stop 2023-08-11T12:22:22.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.900+0000 7f4c947ff700 1 -- 172.21.15.8:0/872616654 shutdown_connections 2023-08-11T12:22:22.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.900+0000 7f4c947ff700 1 --2- 172.21.15.8:0/872616654 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f4c7809ff50 0x7f4c780a2410 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:22.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.900+0000 7f4c947ff700 1 --2- 172.21.15.8:0/872616654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c8c1088a0 0x7f4c8c1a0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:22.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.900+0000 7f4c947ff700 1 --2- 172.21.15.8:0/872616654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c8c073380 0x7f4c8c198a50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:22.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.900+0000 7f4c947ff700 1 --2- 172.21.15.8:0/872616654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c8c074960 0x7f4c8c198f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:22.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.900+0000 7f4c947ff700 1 -- 172.21.15.8:0/872616654 >> 172.21.15.8:0/872616654 conn(0x7f4c8c0fbf50 msgr2=0x7f4c8c0fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:22.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.900+0000 7f4c947ff700 1 -- 172.21.15.8:0/872616654 shutdown_connections 2023-08-11T12:22:22.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:22.900+0000 7f4c947ff700 1 -- 172.21.15.8:0/872616654 wait complete. 2023-08-11T12:22:22.920 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-11T12:17:49.040758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-11T12:22:01.383296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-11T12:22:02.816329+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-11T12:22:06.369375+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-11T12:22:22.921 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-11T12:22:22.982 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:22 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1120844435' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:22:22.983 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:22 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1079700981' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-08-11T12:22:22.983 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:22 smithi008 ceph-mon[97158]: pgmap v283: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-08-11T12:22:23.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.128+0000 7f69de5ff700 1 -- 172.21.15.8:0/3959756284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69d8074960 msgr2=0x7f69d8072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:23.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.128+0000 7f69de5ff700 1 --2- 172.21.15.8:0/3959756284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69d8074960 0x7f69d8072db0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f69c80098f0 tx=0x7f69c8009c00 comp rx=0 tx=0).stop 2023-08-11T12:22:23.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.128+0000 7f69de5ff700 1 -- 172.21.15.8:0/3959756284 shutdown_connections 2023-08-11T12:22:23.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.128+0000 7f69de5ff700 1 --2- 172.21.15.8:0/3959756284 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69d81088c0 0x7f69d810ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:23.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.128+0000 7f69de5ff700 1 --2- 172.21.15.8:0/3959756284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69d8074960 0x7f69d8072db0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:23.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.128+0000 7f69de5ff700 1 --2- 172.21.15.8:0/3959756284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69d8073380 0x7f69d8073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:23.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.128+0000 7f69de5ff700 1 -- 172.21.15.8:0/3959756284 >> 172.21.15.8:0/3959756284 conn(0x7f69d80fbf70 msgr2=0x7f69d80fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:23.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.128+0000 7f69de5ff700 1 -- 172.21.15.8:0/3959756284 shutdown_connections 2023-08-11T12:22:23.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.128+0000 7f69de5ff700 1 -- 172.21.15.8:0/3959756284 wait complete. 2023-08-11T12:22:23.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.129+0000 7f69de5ff700 1 Processor -- start 2023-08-11T12:22:23.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.129+0000 7f69de5ff700 1 -- start start 2023-08-11T12:22:23.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.130+0000 7f69de5ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69d8073380 0x7f69d8198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:23.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.130+0000 7f69de5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69d8074960 0x7f69d8198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:23.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.130+0000 7f69de5ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69d81088c0 0x7f69d819ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:23.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.130+0000 7f69de5ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d81a04f0 con 0x7f69d8073380 2023-08-11T12:22:23.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.130+0000 7f69de5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d81a0630 con 0x7f69d8074960 2023-08-11T12:22:23.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.130+0000 7f69de5ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d81a07c0 con 0x7f69d81088c0 2023-08-11T12:22:23.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.130+0000 7f69d7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69d8073380 0x7f69d8198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:23.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.130+0000 7f69d7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69d8073380 0x7f69d8198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36236/0 (socket says 172.21.15.8:36236) 2023-08-11T12:22:23.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.130+0000 7f69d7fff700 1 -- 172.21.15.8:0/1590823511 learned_addr learned my addr 172.21.15.8:0/1590823511 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:23.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.130+0000 7f69d77fe700 1 --2- 172.21.15.8:0/1590823511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69d8074960 0x7f69d8198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:23.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.130+0000 7f69dcb9c700 1 --2- 172.21.15.8:0/1590823511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69d81088c0 0x7f69d819ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:23.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.130+0000 7f69d7fff700 1 -- 172.21.15.8:0/1590823511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69d81088c0 msgr2=0x7f69d819ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:23.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.130+0000 7f69d7fff700 1 --2- 172.21.15.8:0/1590823511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69d81088c0 0x7f69d819ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:23.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.130+0000 7f69d7fff700 1 -- 172.21.15.8:0/1590823511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69d8074960 msgr2=0x7f69d8198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:23.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.130+0000 7f69d7fff700 1 --2- 172.21.15.8:0/1590823511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69d8074960 0x7f69d8198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:23.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.130+0000 7f69d7fff700 1 -- 172.21.15.8:0/1590823511 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d0009d00 con 0x7f69d8073380 2023-08-11T12:22:23.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.130+0000 7f69dcb9c700 1 --2- 172.21.15.8:0/1590823511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69d81088c0 0x7f69d819ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:22:23.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.130+0000 7f69d7fff700 1 --2- 172.21.15.8:0/1590823511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69d8073380 0x7f69d8198970 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f69c8009fd0 tx=0x7f69c800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:23.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.131+0000 7f69d57fa700 1 -- 172.21.15.8:0/1590823511 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c801c070 con 0x7f69d8073380 2023-08-11T12:22:23.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.131+0000 7f69d57fa700 1 -- 172.21.15.8:0/1590823511 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f69c800f7d0 con 0x7f69d8073380 2023-08-11T12:22:23.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.131+0000 7f69de5ff700 1 -- 172.21.15.8:0/1590823511 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69c8009520 con 0x7f69d8073380 2023-08-11T12:22:23.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.131+0000 7f69d57fa700 1 -- 172.21.15.8:0/1590823511 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c8004b90 con 0x7f69d8073380 2023-08-11T12:22:23.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.131+0000 7f69de5ff700 1 -- 172.21.15.8:0/1590823511 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d81a0cd0 con 0x7f69d8073380 2023-08-11T12:22:23.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.132+0000 7f69de5ff700 1 -- 172.21.15.8:0/1590823511 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d8106f70 con 0x7f69d8073380 2023-08-11T12:22:23.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.134+0000 7f69d57fa700 1 -- 172.21.15.8:0/1590823511 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f69c8020070 con 0x7f69d8073380 2023-08-11T12:22:23.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.136+0000 7f69d57fa700 1 --2- 172.21.15.8:0/1590823511 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f69c009ff50 0x7f69c00a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:23.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.137+0000 7f69d57fa700 1 -- 172.21.15.8:0/1590823511 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f69c80cc160 con 0x7f69d8073380 2023-08-11T12:22:23.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.137+0000 7f69d77fe700 1 --2- 172.21.15.8:0/1590823511 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f69c009ff50 0x7f69c00a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:23.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.137+0000 7f69d77fe700 1 --2- 172.21.15.8:0/1590823511 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f69c009ff50 0x7f69c00a2410 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f69d8074680 tx=0x7f69cc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:23.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.140+0000 7f69d57fa700 1 -- 172.21.15.8:0/1590823511 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f69c805cc30 con 0x7f69d8073380 2023-08-11T12:22:23.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:22 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1120844435' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:22:23.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:22 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1079700981' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-08-11T12:22:23.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:22 smithi194 ceph-mon[130905]: pgmap v283: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-08-11T12:22:23.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:22 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1120844435' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:22:23.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:22 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1079700981' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-08-11T12:22:23.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:22 smithi045 ceph-mon[130284]: pgmap v283: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-08-11T12:22:23.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.349+0000 7f69de5ff700 1 -- 172.21.15.8:0/1590823511 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f69d802cc90 con 0x7f69d8073380 2023-08-11T12:22:23.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.350+0000 7f69d57fa700 1 -- 172.21.15.8:0/1590823511 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f69c8095d30 con 0x7f69d8073380 2023-08-11T12:22:23.352 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-08-11T12:22:23.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.352+0000 7f69de5ff700 1 -- 172.21.15.8:0/1590823511 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f69c009ff50 msgr2=0x7f69c00a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:23.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.352+0000 7f69de5ff700 1 --2- 172.21.15.8:0/1590823511 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f69c009ff50 0x7f69c00a2410 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f69d8074680 tx=0x7f69cc009260 comp rx=0 tx=0).stop 2023-08-11T12:22:23.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.352+0000 7f69de5ff700 1 -- 172.21.15.8:0/1590823511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69d8073380 msgr2=0x7f69d8198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:23.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.352+0000 7f69de5ff700 1 --2- 172.21.15.8:0/1590823511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69d8073380 0x7f69d8198970 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f69c8009fd0 tx=0x7f69c800b790 comp rx=0 tx=0).stop 2023-08-11T12:22:23.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.352+0000 7f69de5ff700 1 -- 172.21.15.8:0/1590823511 shutdown_connections 2023-08-11T12:22:23.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.352+0000 7f69de5ff700 1 --2- 172.21.15.8:0/1590823511 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f69c009ff50 0x7f69c00a2410 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:23.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.352+0000 7f69de5ff700 1 --2- 172.21.15.8:0/1590823511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69d81088c0 0x7f69d819ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:23.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.352+0000 7f69de5ff700 1 --2- 172.21.15.8:0/1590823511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69d8073380 0x7f69d8198970 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:23.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.352+0000 7f69de5ff700 1 --2- 172.21.15.8:0/1590823511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69d8074960 0x7f69d8198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:23.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.352+0000 7f69de5ff700 1 -- 172.21.15.8:0/1590823511 >> 172.21.15.8:0/1590823511 conn(0x7f69d80fbf70 msgr2=0x7f69d80fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:23.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.352+0000 7f69de5ff700 1 -- 172.21.15.8:0/1590823511 shutdown_connections 2023-08-11T12:22:23.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.352+0000 7f69de5ff700 1 -- 172.21.15.8:0/1590823511 wait complete. 2023-08-11T12:22:23.372 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-11T12:22:23.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.579+0000 7f98579ff700 1 -- 172.21.15.8:0/2298245946 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9850102590 msgr2=0x7f9850108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:23.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.579+0000 7f98579ff700 1 --2- 172.21.15.8:0/2298245946 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9850102590 0x7f9850108e40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f984800b0d0 tx=0x7f984800b3e0 comp rx=0 tx=0).stop 2023-08-11T12:22:23.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.579+0000 7f98579ff700 1 -- 172.21.15.8:0/2298245946 shutdown_connections 2023-08-11T12:22:23.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.579+0000 7f98579ff700 1 --2- 172.21.15.8:0/2298245946 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9850102590 0x7f9850108e40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:23.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.579+0000 7f98579ff700 1 --2- 172.21.15.8:0/2298245946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9850100a00 0x7f9850100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:23.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.579+0000 7f98579ff700 1 --2- 172.21.15.8:0/2298245946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9850101bf0 0x7f9850102050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:23.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.579+0000 7f98579ff700 1 -- 172.21.15.8:0/2298245946 >> 172.21.15.8:0/2298245946 conn(0x7f98500fbf70 msgr2=0x7f98500fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:23.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.579+0000 7f98579ff700 1 -- 172.21.15.8:0/2298245946 shutdown_connections 2023-08-11T12:22:23.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.579+0000 7f98579ff700 1 -- 172.21.15.8:0/2298245946 wait complete. 2023-08-11T12:22:23.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.580+0000 7f98579ff700 1 Processor -- start 2023-08-11T12:22:23.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.580+0000 7f98579ff700 1 -- start start 2023-08-11T12:22:23.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.580+0000 7f98579ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9850100a00 0x7f98500746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:23.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.581+0000 7f98579ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9850101bf0 0x7f9850072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:23.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.581+0000 7f98579ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9850102590 0x7f9850073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:23.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.581+0000 7f98579ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98500739f0 con 0x7f9850101bf0 2023-08-11T12:22:23.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.581+0000 7f98579ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9850073b60 con 0x7f9850100a00 2023-08-11T12:22:23.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.581+0000 7f98579ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98501a0880 con 0x7f9850102590 2023-08-11T12:22:23.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.581+0000 7f9854f9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9850101bf0 0x7f9850072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:23.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.581+0000 7f9854f9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9850101bf0 0x7f9850072d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36248/0 (socket says 172.21.15.8:36248) 2023-08-11T12:22:23.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.581+0000 7f985579b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9850100a00 0x7f98500746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:23.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.581+0000 7f9854f9a700 1 -- 172.21.15.8:0/3615713564 learned_addr learned my addr 172.21.15.8:0/3615713564 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:23.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.581+0000 7f9855f9c700 1 --2- 172.21.15.8:0/3615713564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9850102590 0x7f9850073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:23.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.581+0000 7f9854f9a700 1 -- 172.21.15.8:0/3615713564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9850102590 msgr2=0x7f9850073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:23.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.581+0000 7f9854f9a700 1 --2- 172.21.15.8:0/3615713564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9850102590 0x7f9850073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:23.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.581+0000 7f9854f9a700 1 -- 172.21.15.8:0/3615713564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9850100a00 msgr2=0x7f98500746d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:23.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.581+0000 7f9854f9a700 1 --2- 172.21.15.8:0/3615713564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9850100a00 0x7f98500746d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:23.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.581+0000 7f9854f9a700 1 -- 172.21.15.8:0/3615713564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9848009d00 con 0x7f9850101bf0 2023-08-11T12:22:23.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.582+0000 7f9854f9a700 1 --2- 172.21.15.8:0/3615713564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9850101bf0 0x7f9850072d10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f984000e9a0 tx=0x7f984000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:23.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.582+0000 7f98467fc700 1 -- 172.21.15.8:0/3615713564 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9840009790 con 0x7f9850101bf0 2023-08-11T12:22:23.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.582+0000 7f98579ff700 1 -- 172.21.15.8:0/3615713564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98501a0b60 con 0x7f9850101bf0 2023-08-11T12:22:23.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.582+0000 7f98467fc700 1 -- 172.21.15.8:0/3615713564 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9840010430 con 0x7f9850101bf0 2023-08-11T12:22:23.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.582+0000 7f98467fc700 1 -- 172.21.15.8:0/3615713564 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9840018680 con 0x7f9850101bf0 2023-08-11T12:22:23.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.582+0000 7f98579ff700 1 -- 172.21.15.8:0/3615713564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98501a10c0 con 0x7f9850101bf0 2023-08-11T12:22:23.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.583+0000 7f98579ff700 1 -- 172.21.15.8:0/3615713564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9850107ef0 con 0x7f9850101bf0 2023-08-11T12:22:23.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.585+0000 7f98467fc700 1 -- 172.21.15.8:0/3615713564 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f98400105a0 con 0x7f9850101bf0 2023-08-11T12:22:23.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.586+0000 7f98467fc700 1 --2- 172.21.15.8:0/3615713564 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f983c09ff50 0x7f983c0a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:23.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.586+0000 7f98467fc700 1 -- 172.21.15.8:0/3615713564 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f9840014070 con 0x7f9850101bf0 2023-08-11T12:22:23.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.587+0000 7f985579b700 1 --2- 172.21.15.8:0/3615713564 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f983c09ff50 0x7f983c0a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:23.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.587+0000 7f985579b700 1 --2- 172.21.15.8:0/3615713564 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f983c09ff50 0x7f983c0a2410 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9850101a50 tx=0x7f984c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:23.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.590+0000 7f98467fc700 1 -- 172.21.15.8:0/3615713564 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f9840051c30 con 0x7f9850101bf0 2023-08-11T12:22:23.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.802+0000 7f98579ff700 1 -- 172.21.15.8:0/3615713564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f985002cd00 con 0x7f9850101bf0 2023-08-11T12:22:23.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.803+0000 7f98467fc700 1 -- 172.21.15.8:0/3615713564 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7f98400950c0 con 0x7f9850101bf0 2023-08-11T12:22:23.805 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-08-11T12:22:23.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.805+0000 7f98579ff700 1 -- 172.21.15.8:0/3615713564 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f983c09ff50 msgr2=0x7f983c0a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:23.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.805+0000 7f98579ff700 1 --2- 172.21.15.8:0/3615713564 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f983c09ff50 0x7f983c0a2410 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9850101a50 tx=0x7f984c009260 comp rx=0 tx=0).stop 2023-08-11T12:22:23.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.805+0000 7f98579ff700 1 -- 172.21.15.8:0/3615713564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9850101bf0 msgr2=0x7f9850072d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:23.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.805+0000 7f98579ff700 1 --2- 172.21.15.8:0/3615713564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9850101bf0 0x7f9850072d10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f984000e9a0 tx=0x7f984000ecb0 comp rx=0 tx=0).stop 2023-08-11T12:22:23.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.805+0000 7f98579ff700 1 -- 172.21.15.8:0/3615713564 shutdown_connections 2023-08-11T12:22:23.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.805+0000 7f98579ff700 1 --2- 172.21.15.8:0/3615713564 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f983c09ff50 0x7f983c0a2410 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:23.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.805+0000 7f98579ff700 1 --2- 172.21.15.8:0/3615713564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9850102590 0x7f9850073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:23.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.805+0000 7f98579ff700 1 --2- 172.21.15.8:0/3615713564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9850100a00 0x7f98500746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:23.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.805+0000 7f98579ff700 1 --2- 172.21.15.8:0/3615713564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9850101bf0 0x7f9850072d10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:23.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.805+0000 7f98579ff700 1 -- 172.21.15.8:0/3615713564 >> 172.21.15.8:0/3615713564 conn(0x7f98500fbf70 msgr2=0x7f9850105030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:23.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.806+0000 7f98579ff700 1 -- 172.21.15.8:0/3615713564 shutdown_connections 2023-08-11T12:22:23.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:23.806+0000 7f98579ff700 1 -- 172.21.15.8:0/3615713564 wait complete. 2023-08-11T12:22:23.825 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-11T12:22:24.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.035+0000 7f65e95ff700 1 -- 172.21.15.8:0/2351313682 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65e4101c00 msgr2=0x7f65e4102060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:24.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.035+0000 7f65e95ff700 1 --2- 172.21.15.8:0/2351313682 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65e4101c00 0x7f65e4102060 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0099c0 tx=0x7f65cc009cd0 comp rx=0 tx=0).stop 2023-08-11T12:22:24.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.035+0000 7f65e95ff700 1 -- 172.21.15.8:0/2351313682 shutdown_connections 2023-08-11T12:22:24.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.035+0000 7f65e95ff700 1 --2- 172.21.15.8:0/2351313682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65e4100a10 0x7f65e4100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:24.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.035+0000 7f65e95ff700 1 --2- 172.21.15.8:0/2351313682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65e41025a0 0x7f65e4108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:24.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.035+0000 7f65e95ff700 1 --2- 172.21.15.8:0/2351313682 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65e4101c00 0x7f65e4102060 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:24.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.035+0000 7f65e95ff700 1 -- 172.21.15.8:0/2351313682 >> 172.21.15.8:0/2351313682 conn(0x7f65e40fbf80 msgr2=0x7f65e40fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:24.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.035+0000 7f65e95ff700 1 -- 172.21.15.8:0/2351313682 shutdown_connections 2023-08-11T12:22:24.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.035+0000 7f65e95ff700 1 -- 172.21.15.8:0/2351313682 wait complete. 2023-08-11T12:22:24.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.036+0000 7f65e95ff700 1 Processor -- start 2023-08-11T12:22:24.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.036+0000 7f65e95ff700 1 -- start start 2023-08-11T12:22:24.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.036+0000 7f65e95ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65e4100a10 0x7f65e41988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:24.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.036+0000 7f65e95ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65e4101c00 0x7f65e4198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:24.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.037+0000 7f65e95ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65e41025a0 0x7f65e419fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:24.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.037+0000 7f65e95ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e41a0440 con 0x7f65e4101c00 2023-08-11T12:22:24.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.037+0000 7f65e95ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e41a0580 con 0x7f65e41025a0 2023-08-11T12:22:24.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.037+0000 7f65e95ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e41a0710 con 0x7f65e4100a10 2023-08-11T12:22:24.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.037+0000 7f65dbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65e4101c00 0x7f65e4198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:24.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.037+0000 7f65dbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65e4101c00 0x7f65e4198e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36258/0 (socket says 172.21.15.8:36258) 2023-08-11T12:22:24.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.037+0000 7f65dbfff700 1 -- 172.21.15.8:0/4251937416 learned_addr learned my addr 172.21.15.8:0/4251937416 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:24.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.037+0000 7f65e2ffd700 1 --2- 172.21.15.8:0/4251937416 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65e4100a10 0x7f65e41988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:24.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.037+0000 7f65e37fe700 1 --2- 172.21.15.8:0/4251937416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65e41025a0 0x7f65e419fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:24.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.037+0000 7f65dbfff700 1 -- 172.21.15.8:0/4251937416 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65e4100a10 msgr2=0x7f65e41988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:24.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.037+0000 7f65dbfff700 1 --2- 172.21.15.8:0/4251937416 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65e4100a10 0x7f65e41988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:24.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.037+0000 7f65dbfff700 1 -- 172.21.15.8:0/4251937416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65e41025a0 msgr2=0x7f65e419fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:24.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.037+0000 7f65dbfff700 1 --2- 172.21.15.8:0/4251937416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65e41025a0 0x7f65e419fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:24.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.037+0000 7f65dbfff700 1 -- 172.21.15.8:0/4251937416 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65cc0095f0 con 0x7f65e4101c00 2023-08-11T12:22:24.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.037+0000 7f65e37fe700 1 --2- 172.21.15.8:0/4251937416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65e41025a0 0x7f65e419fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:22:24.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.037+0000 7f65dbfff700 1 --2- 172.21.15.8:0/4251937416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65e4101c00 0x7f65e4198e00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f65cc009990 tx=0x7f65cc00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:24.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.038+0000 7f65e0ff9700 1 -- 172.21.15.8:0/4251937416 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65cc01d070 con 0x7f65e4101c00 2023-08-11T12:22:24.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.038+0000 7f65e0ff9700 1 -- 172.21.15.8:0/4251937416 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f65cc0054f0 con 0x7f65e4101c00 2023-08-11T12:22:24.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.038+0000 7f65e0ff9700 1 -- 172.21.15.8:0/4251937416 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65cc004b00 con 0x7f65e4101c00 2023-08-11T12:22:24.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.038+0000 7f65e95ff700 1 -- 172.21.15.8:0/4251937416 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e41a0990 con 0x7f65e4101c00 2023-08-11T12:22:24.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.038+0000 7f65e95ff700 1 -- 172.21.15.8:0/4251937416 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e41a0d60 con 0x7f65e4101c00 2023-08-11T12:22:24.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.039+0000 7f65e95ff700 1 -- 172.21.15.8:0/4251937416 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e410c270 con 0x7f65e4101c00 2023-08-11T12:22:24.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.041+0000 7f65e0ff9700 1 -- 172.21.15.8:0/4251937416 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f65cc00fb80 con 0x7f65e4101c00 2023-08-11T12:22:24.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.043+0000 7f65e0ff9700 1 --2- 172.21.15.8:0/4251937416 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f65d009ffd0 0x7f65d00a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:24.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.043+0000 7f65e0ff9700 1 -- 172.21.15.8:0/4251937416 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f65cc0cc220 con 0x7f65e4101c00 2023-08-11T12:22:24.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.043+0000 7f65e2ffd700 1 --2- 172.21.15.8:0/4251937416 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f65d009ffd0 0x7f65d00a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:24.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.044+0000 7f65e2ffd700 1 --2- 172.21.15.8:0/4251937416 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f65d009ffd0 0x7f65d00a2490 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f65e4101a60 tx=0x7f65d4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:24.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.047+0000 7f65e0ff9700 1 -- 172.21.15.8:0/4251937416 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f65cc095f10 con 0x7f65e4101c00 2023-08-11T12:22:24.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:23 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/872616654' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:24.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:23 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1590823511' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:22:24.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:23 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/872616654' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:24.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:23 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1590823511' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:22:24.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:23 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/872616654' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:24.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:23 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1590823511' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:22:24.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.259+0000 7f65e95ff700 1 -- 172.21.15.8:0/4251937416 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f65e41a1040 con 0x7f65e4101c00 2023-08-11T12:22:24.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.259+0000 7f65e0ff9700 1 -- 172.21.15.8:0/4251937416 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7f65cc099530 con 0x7f65e4101c00 2023-08-11T12:22:24.262 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-08-11T12:22:24.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.262+0000 7f65e95ff700 1 -- 172.21.15.8:0/4251937416 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f65d009ffd0 msgr2=0x7f65d00a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:24.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.262+0000 7f65e95ff700 1 --2- 172.21.15.8:0/4251937416 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f65d009ffd0 0x7f65d00a2490 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f65e4101a60 tx=0x7f65d4009260 comp rx=0 tx=0).stop 2023-08-11T12:22:24.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.262+0000 7f65e95ff700 1 -- 172.21.15.8:0/4251937416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65e4101c00 msgr2=0x7f65e4198e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:24.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.262+0000 7f65e95ff700 1 --2- 172.21.15.8:0/4251937416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65e4101c00 0x7f65e4198e00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f65cc009990 tx=0x7f65cc00f690 comp rx=0 tx=0).stop 2023-08-11T12:22:24.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.262+0000 7f65e95ff700 1 -- 172.21.15.8:0/4251937416 shutdown_connections 2023-08-11T12:22:24.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.262+0000 7f65e95ff700 1 --2- 172.21.15.8:0/4251937416 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f65d009ffd0 0x7f65d00a2490 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:24.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.262+0000 7f65e95ff700 1 --2- 172.21.15.8:0/4251937416 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65e4100a10 0x7f65e41988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:24.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.262+0000 7f65e95ff700 1 --2- 172.21.15.8:0/4251937416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65e41025a0 0x7f65e419fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:24.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.262+0000 7f65e95ff700 1 --2- 172.21.15.8:0/4251937416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65e4101c00 0x7f65e4198e00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:24.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.262+0000 7f65e95ff700 1 -- 172.21.15.8:0/4251937416 >> 172.21.15.8:0/4251937416 conn(0x7f65e40fbf80 msgr2=0x7f65e40fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:24.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.262+0000 7f65e95ff700 1 -- 172.21.15.8:0/4251937416 shutdown_connections 2023-08-11T12:22:24.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.262+0000 7f65e95ff700 1 -- 172.21.15.8:0/4251937416 wait complete. 2023-08-11T12:22:24.282 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-11T12:22:24.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.488+0000 7f8ebd7ff700 1 -- 172.21.15.8:0/3287708158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8eb8073380 msgr2=0x7f8eb8073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:24.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.488+0000 7f8ebd7ff700 1 --2- 172.21.15.8:0/3287708158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8eb8073380 0x7f8eb8073800 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8eac009990 tx=0x7f8eac009ca0 comp rx=0 tx=0).stop 2023-08-11T12:22:24.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.488+0000 7f8ebd7ff700 1 -- 172.21.15.8:0/3287708158 shutdown_connections 2023-08-11T12:22:24.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.488+0000 7f8ebd7ff700 1 --2- 172.21.15.8:0/3287708158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8eb8074960 0x7f8eb8072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:24.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.488+0000 7f8ebd7ff700 1 --2- 172.21.15.8:0/3287708158 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8eb810cfd0 0x7f8eb810f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:24.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.488+0000 7f8ebd7ff700 1 --2- 172.21.15.8:0/3287708158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8eb8073380 0x7f8eb8073800 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:24.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.488+0000 7f8ebd7ff700 1 -- 172.21.15.8:0/3287708158 >> 172.21.15.8:0/3287708158 conn(0x7f8eb80fbf70 msgr2=0x7f8eb80fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:24.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.488+0000 7f8ebd7ff700 1 -- 172.21.15.8:0/3287708158 shutdown_connections 2023-08-11T12:22:24.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.488+0000 7f8ebd7ff700 1 -- 172.21.15.8:0/3287708158 wait complete. 2023-08-11T12:22:24.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.489+0000 7f8ebd7ff700 1 Processor -- start 2023-08-11T12:22:24.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.489+0000 7f8ebd7ff700 1 -- start start 2023-08-11T12:22:24.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.489+0000 7f8ebd7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8eb8073380 0x7f8eb819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:24.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.489+0000 7f8ebd7ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8eb8074960 0x7f8eb819d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:24.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.489+0000 7f8ebd7ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8eb810cfd0 0x7f8eb81a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:24.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.489+0000 7f8ebd7ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb81a4900 con 0x7f8eb8074960 2023-08-11T12:22:24.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.489+0000 7f8ebd7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb81a4a70 con 0x7f8eb8073380 2023-08-11T12:22:24.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.489+0000 7f8ebd7ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb81a4c30 con 0x7f8eb810cfd0 2023-08-11T12:22:24.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.490+0000 7f8eb67fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8eb8074960 0x7f8eb819d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:24.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.490+0000 7f8eb67fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8eb8074960 0x7f8eb819d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36266/0 (socket says 172.21.15.8:36266) 2023-08-11T12:22:24.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.490+0000 7f8eb67fc700 1 -- 172.21.15.8:0/3216111382 learned_addr learned my addr 172.21.15.8:0/3216111382 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:24.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.490+0000 7f8eb6ffd700 1 --2- 172.21.15.8:0/3216111382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8eb8073380 0x7f8eb819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:24.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.490+0000 7f8eb77fe700 1 --2- 172.21.15.8:0/3216111382 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8eb810cfd0 0x7f8eb81a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:24.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.490+0000 7f8eb67fc700 1 -- 172.21.15.8:0/3216111382 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8eb810cfd0 msgr2=0x7f8eb81a4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:24.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.490+0000 7f8eb67fc700 1 --2- 172.21.15.8:0/3216111382 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8eb810cfd0 0x7f8eb81a4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:24.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.490+0000 7f8eb67fc700 1 -- 172.21.15.8:0/3216111382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8eb8073380 msgr2=0x7f8eb819cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:24.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.490+0000 7f8eb67fc700 1 --2- 172.21.15.8:0/3216111382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8eb8073380 0x7f8eb819cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:24.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.490+0000 7f8eb67fc700 1 -- 172.21.15.8:0/3216111382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eac0095f0 con 0x7f8eb8074960 2023-08-11T12:22:24.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.490+0000 7f8eb67fc700 1 --2- 172.21.15.8:0/3216111382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8eb8074960 0x7f8eb819d300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8eac004710 tx=0x7f8eac009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:24.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.491+0000 7f8e9ffff700 1 -- 172.21.15.8:0/3216111382 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac01d070 con 0x7f8eb8074960 2023-08-11T12:22:24.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.491+0000 7f8e9ffff700 1 -- 172.21.15.8:0/3216111382 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8eac021410 con 0x7f8eb8074960 2023-08-11T12:22:24.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.491+0000 7f8ebd7ff700 1 -- 172.21.15.8:0/3216111382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb81a4eb0 con 0x7f8eb8074960 2023-08-11T12:22:24.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.491+0000 7f8e9ffff700 1 -- 172.21.15.8:0/3216111382 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac017650 con 0x7f8eb8074960 2023-08-11T12:22:24.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.491+0000 7f8ebd7ff700 1 -- 172.21.15.8:0/3216111382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb81a5270 con 0x7f8eb8074960 2023-08-11T12:22:24.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.492+0000 7f8ebd7ff700 1 -- 172.21.15.8:0/3216111382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb8102b20 con 0x7f8eb8074960 2023-08-11T12:22:24.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.494+0000 7f8e9ffff700 1 -- 172.21.15.8:0/3216111382 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f8eac021580 con 0x7f8eb8074960 2023-08-11T12:22:24.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.496+0000 7f8e9ffff700 1 --2- 172.21.15.8:0/3216111382 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8ea009ffd0 0x7f8ea00a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:24.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.496+0000 7f8e9ffff700 1 -- 172.21.15.8:0/3216111382 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8eac0cc7f0 con 0x7f8eb8074960 2023-08-11T12:22:24.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.496+0000 7f8eb6ffd700 1 --2- 172.21.15.8:0/3216111382 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8ea009ffd0 0x7f8ea00a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:24.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.497+0000 7f8eb6ffd700 1 --2- 172.21.15.8:0/3216111382 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8ea009ffd0 0x7f8ea00a2490 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8eb819e290 tx=0x7f8ea8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:24.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.500+0000 7f8e9ffff700 1 -- 172.21.15.8:0/3216111382 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f8eac0963c0 con 0x7f8eb8074960 2023-08-11T12:22:24.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.710+0000 7f8ebd7ff700 1 -- 172.21.15.8:0/3216111382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8eb802cc40 con 0x7f8eb8074960 2023-08-11T12:22:24.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.710+0000 7f8e9ffff700 1 -- 172.21.15.8:0/3216111382 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v87) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8eac0999e0 con 0x7f8eb8074960 2023-08-11T12:22:24.713 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-08-11T12:22:24.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.713+0000 7f8ebd7ff700 1 -- 172.21.15.8:0/3216111382 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8ea009ffd0 msgr2=0x7f8ea00a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:24.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.713+0000 7f8ebd7ff700 1 --2- 172.21.15.8:0/3216111382 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8ea009ffd0 0x7f8ea00a2490 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8eb819e290 tx=0x7f8ea8009260 comp rx=0 tx=0).stop 2023-08-11T12:22:24.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.713+0000 7f8ebd7ff700 1 -- 172.21.15.8:0/3216111382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8eb8074960 msgr2=0x7f8eb819d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:24.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.713+0000 7f8ebd7ff700 1 --2- 172.21.15.8:0/3216111382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8eb8074960 0x7f8eb819d300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8eac004710 tx=0x7f8eac009580 comp rx=0 tx=0).stop 2023-08-11T12:22:24.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.713+0000 7f8ebd7ff700 1 -- 172.21.15.8:0/3216111382 shutdown_connections 2023-08-11T12:22:24.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.713+0000 7f8ebd7ff700 1 --2- 172.21.15.8:0/3216111382 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8ea009ffd0 0x7f8ea00a2490 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:24.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.713+0000 7f8ebd7ff700 1 --2- 172.21.15.8:0/3216111382 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8eb810cfd0 0x7f8eb81a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:24.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.713+0000 7f8ebd7ff700 1 --2- 172.21.15.8:0/3216111382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8eb8073380 0x7f8eb819cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:24.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.713+0000 7f8ebd7ff700 1 --2- 172.21.15.8:0/3216111382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8eb8074960 0x7f8eb819d300 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:24.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.713+0000 7f8ebd7ff700 1 -- 172.21.15.8:0/3216111382 >> 172.21.15.8:0/3216111382 conn(0x7f8eb80fbf70 msgr2=0x7f8eb80fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:24.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.713+0000 7f8ebd7ff700 1 -- 172.21.15.8:0/3216111382 shutdown_connections 2023-08-11T12:22:24.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.713+0000 7f8ebd7ff700 1 -- 172.21.15.8:0/3216111382 wait complete. 2023-08-11T12:22:24.733 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-11T12:22:24.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.936+0000 7f0e7ebff700 1 -- 172.21.15.8:0/2508618733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e78074960 msgr2=0x7f0e78072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:24.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.936+0000 7f0e7ebff700 1 --2- 172.21.15.8:0/2508618733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e78074960 0x7f0e78072db0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c009990 tx=0x7f0e6c009ca0 comp rx=0 tx=0).stop 2023-08-11T12:22:24.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.936+0000 7f0e7ebff700 1 -- 172.21.15.8:0/2508618733 shutdown_connections 2023-08-11T12:22:24.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.936+0000 7f0e7ebff700 1 --2- 172.21.15.8:0/2508618733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e781088c0 0x7f0e7810ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:24.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.936+0000 7f0e7ebff700 1 --2- 172.21.15.8:0/2508618733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e78074960 0x7f0e78072db0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:24.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.936+0000 7f0e7ebff700 1 --2- 172.21.15.8:0/2508618733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e78073380 0x7f0e78073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:24.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.936+0000 7f0e7ebff700 1 -- 172.21.15.8:0/2508618733 >> 172.21.15.8:0/2508618733 conn(0x7f0e780fbf70 msgr2=0x7f0e780fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:24.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.937+0000 7f0e7ebff700 1 -- 172.21.15.8:0/2508618733 shutdown_connections 2023-08-11T12:22:24.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.937+0000 7f0e7ebff700 1 -- 172.21.15.8:0/2508618733 wait complete. 2023-08-11T12:22:24.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.938+0000 7f0e7ebff700 1 Processor -- start 2023-08-11T12:22:24.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.938+0000 7f0e7ebff700 1 -- start start 2023-08-11T12:22:24.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.938+0000 7f0e7ebff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e78073380 0x7f0e781988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:24.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.938+0000 7f0e7ebff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e78074960 0x7f0e78198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:24.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.938+0000 7f0e7ebff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e781088c0 0x7f0e7819fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:24.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.938+0000 7f0e7ebff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e781a0460 con 0x7f0e78074960 2023-08-11T12:22:24.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.938+0000 7f0e7ebff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e781a05a0 con 0x7f0e781088c0 2023-08-11T12:22:24.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.938+0000 7f0e7ebff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e781a0730 con 0x7f0e78073380 2023-08-11T12:22:24.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.938+0000 7f0e77fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e78074960 0x7f0e78198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:24.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.938+0000 7f0e77fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e78074960 0x7f0e78198e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36280/0 (socket says 172.21.15.8:36280) 2023-08-11T12:22:24.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.938+0000 7f0e77fff700 1 -- 172.21.15.8:0/3080536353 learned_addr learned my addr 172.21.15.8:0/3080536353 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:24.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.939+0000 7f0e7c99b700 1 --2- 172.21.15.8:0/3080536353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e78073380 0x7f0e781988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:24.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.939+0000 7f0e7d19c700 1 --2- 172.21.15.8:0/3080536353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e781088c0 0x7f0e7819fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:24.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.939+0000 7f0e77fff700 1 -- 172.21.15.8:0/3080536353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e78073380 msgr2=0x7f0e781988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:24.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.939+0000 7f0e77fff700 1 --2- 172.21.15.8:0/3080536353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e78073380 0x7f0e781988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:24.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.939+0000 7f0e77fff700 1 -- 172.21.15.8:0/3080536353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e781088c0 msgr2=0x7f0e7819fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:24.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.939+0000 7f0e77fff700 1 --2- 172.21.15.8:0/3080536353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e781088c0 0x7f0e7819fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:24.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.939+0000 7f0e77fff700 1 -- 172.21.15.8:0/3080536353 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6c0095f0 con 0x7f0e78074960 2023-08-11T12:22:24.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.939+0000 7f0e77fff700 1 --2- 172.21.15.8:0/3080536353 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e78074960 0x7f0e78198e20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400d980 tx=0x7f0e6400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:24.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.939+0000 7f0e75ffb700 1 -- 172.21.15.8:0/3080536353 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e64004020 con 0x7f0e78074960 2023-08-11T12:22:24.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.939+0000 7f0e7ebff700 1 -- 172.21.15.8:0/3080536353 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e781a0a10 con 0x7f0e78074960 2023-08-11T12:22:24.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.939+0000 7f0e75ffb700 1 -- 172.21.15.8:0/3080536353 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e64009730 con 0x7f0e78074960 2023-08-11T12:22:24.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.939+0000 7f0e75ffb700 1 -- 172.21.15.8:0/3080536353 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e64003a30 con 0x7f0e78074960 2023-08-11T12:22:24.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.940+0000 7f0e7ebff700 1 -- 172.21.15.8:0/3080536353 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e781a0f70 con 0x7f0e78074960 2023-08-11T12:22:24.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.941+0000 7f0e7ebff700 1 -- 172.21.15.8:0/3080536353 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e78106f70 con 0x7f0e78074960 2023-08-11T12:22:24.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.943+0000 7f0e75ffb700 1 -- 172.21.15.8:0/3080536353 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f0e640098a0 con 0x7f0e78074960 2023-08-11T12:22:24.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.944+0000 7f0e75ffb700 1 --2- 172.21.15.8:0/3080536353 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0e6809ffd0 0x7f0e680a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:24.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.944+0000 7f0e75ffb700 1 -- 172.21.15.8:0/3080536353 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f0e640caac0 con 0x7f0e78074960 2023-08-11T12:22:24.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.944+0000 7f0e7c99b700 1 --2- 172.21.15.8:0/3080536353 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0e6809ffd0 0x7f0e680a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:24.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.945+0000 7f0e7c99b700 1 --2- 172.21.15.8:0/3080536353 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0e6809ffd0 0x7f0e680a2490 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c00b5c0 tx=0x7f0e6c005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:24.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:24.948+0000 7f0e75ffb700 1 -- 172.21.15.8:0/3080536353 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f0e64094660 con 0x7f0e78074960 2023-08-11T12:22:25.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:24 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3615713564' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:22:25.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:24 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/4251937416' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:22:25.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:24 smithi008 ceph-mon[97158]: pgmap v284: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-08-11T12:22:25.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:24 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3615713564' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:22:25.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:24 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/4251937416' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:22:25.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:24 smithi194 ceph-mon[130905]: pgmap v284: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-08-11T12:22:25.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:24 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3615713564' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:22:25.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:24 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/4251937416' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:22:25.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:24 smithi045 ceph-mon[130284]: pgmap v284: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-08-11T12:22:25.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.175+0000 7f0e7ebff700 1 -- 172.21.15.8:0/3080536353 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0e7810e440 con 0x7f0e78074960 2023-08-11T12:22:25.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.175+0000 7f0e75ffb700 1 -- 172.21.15.8:0/3080536353 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v87) v1 ==== 81+0+582 (secure 0 0 0) 0x7f0e64017260 con 0x7f0e78074960 2023-08-11T12:22:25.178 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2000592056 2023-08-12T12:15:30.423754+0000 2023-08-11T12:22:25.178 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2102228072 2023-08-12T12:15:30.423754+0000 2023-08-11T12:22:25.179 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6801/2832004641 2023-08-12T12:15:30.423754+0000 2023-08-11T12:22:25.179 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6800/2832004641 2023-08-12T12:15:30.423754+0000 2023-08-11T12:22:25.179 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6800/2108474030 2023-08-12T12:15:02.528403+0000 2023-08-11T12:22:25.179 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2374527928 2023-08-12T12:15:02.528403+0000 2023-08-11T12:22:25.180 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2928221278 2023-08-12T12:15:02.528403+0000 2023-08-11T12:22:25.180 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2744750874 2023-08-12T12:15:30.423754+0000 2023-08-11T12:22:25.180 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6801/2108474030 2023-08-12T12:15:02.528403+0000 2023-08-11T12:22:25.180 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/3681755887 2023-08-12T12:15:02.528403+0000 2023-08-11T12:22:25.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.178+0000 7f0e7ebff700 1 -- 172.21.15.8:0/3080536353 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0e6809ffd0 msgr2=0x7f0e680a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:25.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.178+0000 7f0e7ebff700 1 --2- 172.21.15.8:0/3080536353 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0e6809ffd0 0x7f0e680a2490 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c00b5c0 tx=0x7f0e6c005fd0 comp rx=0 tx=0).stop 2023-08-11T12:22:25.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.178+0000 7f0e7ebff700 1 -- 172.21.15.8:0/3080536353 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e78074960 msgr2=0x7f0e78198e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:25.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.178+0000 7f0e7ebff700 1 --2- 172.21.15.8:0/3080536353 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e78074960 0x7f0e78198e20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400d980 tx=0x7f0e6400dc90 comp rx=0 tx=0).stop 2023-08-11T12:22:25.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.178+0000 7f0e7ebff700 1 -- 172.21.15.8:0/3080536353 shutdown_connections 2023-08-11T12:22:25.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.178+0000 7f0e7ebff700 1 --2- 172.21.15.8:0/3080536353 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0e6809ffd0 0x7f0e680a2490 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:25.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.178+0000 7f0e7ebff700 1 --2- 172.21.15.8:0/3080536353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e78073380 0x7f0e781988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:25.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.178+0000 7f0e7ebff700 1 --2- 172.21.15.8:0/3080536353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e781088c0 0x7f0e7819fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:25.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.178+0000 7f0e7ebff700 1 --2- 172.21.15.8:0/3080536353 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e78074960 0x7f0e78198e20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:25.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.178+0000 7f0e7ebff700 1 -- 172.21.15.8:0/3080536353 >> 172.21.15.8:0/3080536353 conn(0x7f0e780fbf70 msgr2=0x7f0e780fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:25.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.178+0000 7f0e7ebff700 1 -- 172.21.15.8:0/3080536353 shutdown_connections 2023-08-11T12:22:25.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.178+0000 7f0e7ebff700 1 -- 172.21.15.8:0/3080536353 wait complete. 2023-08-11T12:22:25.185 INFO:teuthology.orchestra.run.smithi008.stderr:listed 10 entries 2023-08-11T12:22:25.197 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi008.front.sepia.ceph.com... 2023-08-11T12:22:25.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:22:25.198 DEBUG:teuthology.orchestra.run.smithi008:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-08-11T12:22:25.266 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi008.stderr:ceph-fuse[134195]: fuse finished with error 0 and tester_r 0 2023-08-11T12:22:25.270 INFO:teuthology.orchestra.run:waiting for 300 2023-08-11T12:22:25.349 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi008.front.sepia.ceph.com 2023-08-11T12:22:25.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:22:25.350 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-08-11T12:22:25.401 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-11T12:22:25.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.605+0000 7f8a165ff700 1 -- 172.21.15.8:0/2047419974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a101009e0 msgr2=0x7f8a10100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:25.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.605+0000 7f8a165ff700 1 --2- 172.21.15.8:0/2047419974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a101009e0 0x7f8a10100e00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8a000099c0 tx=0x7f8a00009cd0 comp rx=0 tx=0).stop 2023-08-11T12:22:25.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.605+0000 7f8a165ff700 1 -- 172.21.15.8:0/2047419974 shutdown_connections 2023-08-11T12:22:25.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.605+0000 7f8a165ff700 1 --2- 172.21.15.8:0/2047419974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a10102570 0x7f8a10108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:25.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.605+0000 7f8a165ff700 1 --2- 172.21.15.8:0/2047419974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a101009e0 0x7f8a10100e00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:25.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.605+0000 7f8a165ff700 1 --2- 172.21.15.8:0/2047419974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a10101bd0 0x7f8a10102030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:25.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.605+0000 7f8a165ff700 1 -- 172.21.15.8:0/2047419974 >> 172.21.15.8:0/2047419974 conn(0x7f8a100fbf50 msgr2=0x7f8a100fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:25.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.605+0000 7f8a165ff700 1 -- 172.21.15.8:0/2047419974 shutdown_connections 2023-08-11T12:22:25.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.605+0000 7f8a165ff700 1 -- 172.21.15.8:0/2047419974 wait complete. 2023-08-11T12:22:25.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.606+0000 7f8a165ff700 1 Processor -- start 2023-08-11T12:22:25.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.607+0000 7f8a165ff700 1 -- start start 2023-08-11T12:22:25.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.607+0000 7f8a165ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a101009e0 0x7f8a10196730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:25.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.607+0000 7f8a165ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a10101bd0 0x7f8a10196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:25.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.607+0000 7f8a165ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a10102570 0x7f8a1019dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:25.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.607+0000 7f8a165ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1019e2b0 con 0x7f8a10101bd0 2023-08-11T12:22:25.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.607+0000 7f8a165ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1019e3f0 con 0x7f8a101009e0 2023-08-11T12:22:25.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.607+0000 7f8a165ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1019e580 con 0x7f8a10102570 2023-08-11T12:22:25.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.607+0000 7f8a0f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a10101bd0 0x7f8a10196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:25.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.607+0000 7f8a0f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a10101bd0 0x7f8a10196c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36308/0 (socket says 172.21.15.8:36308) 2023-08-11T12:22:25.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.607+0000 7f8a0ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a101009e0 0x7f8a10196730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:25.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.607+0000 7f8a0f7fe700 1 -- 172.21.15.8:0/3412747998 learned_addr learned my addr 172.21.15.8:0/3412747998 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:25.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.608+0000 7f8a14b9c700 1 --2- 172.21.15.8:0/3412747998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a10102570 0x7f8a1019dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:25.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.608+0000 7f8a0f7fe700 1 -- 172.21.15.8:0/3412747998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a10102570 msgr2=0x7f8a1019dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:25.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.608+0000 7f8a0f7fe700 1 --2- 172.21.15.8:0/3412747998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a10102570 0x7f8a1019dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:25.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.608+0000 7f8a0f7fe700 1 -- 172.21.15.8:0/3412747998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a101009e0 msgr2=0x7f8a10196730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:25.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.608+0000 7f8a0f7fe700 1 --2- 172.21.15.8:0/3412747998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a101009e0 0x7f8a10196730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:25.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.608+0000 7f8a0f7fe700 1 -- 172.21.15.8:0/3412747998 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a000095f0 con 0x7f8a10101bd0 2023-08-11T12:22:25.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.608+0000 7f8a0ffff700 1 --2- 172.21.15.8:0/3412747998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a101009e0 0x7f8a10196730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:22:25.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.608+0000 7f8a0f7fe700 1 --2- 172.21.15.8:0/3412747998 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a10101bd0 0x7f8a10196c70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8a0400e9a0 tx=0x7f8a0400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:25.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.608+0000 7f8a0d7fa700 1 -- 172.21.15.8:0/3412747998 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a04009790 con 0x7f8a10101bd0 2023-08-11T12:22:25.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.608+0000 7f8a165ff700 1 -- 172.21.15.8:0/3412747998 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a1019e860 con 0x7f8a10101bd0 2023-08-11T12:22:25.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.608+0000 7f8a0d7fa700 1 -- 172.21.15.8:0/3412747998 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a04010430 con 0x7f8a10101bd0 2023-08-11T12:22:25.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.608+0000 7f8a0d7fa700 1 -- 172.21.15.8:0/3412747998 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a04018680 con 0x7f8a10101bd0 2023-08-11T12:22:25.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.609+0000 7f8a165ff700 1 -- 172.21.15.8:0/3412747998 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a1019edc0 con 0x7f8a10101bd0 2023-08-11T12:22:25.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.610+0000 7f8a165ff700 1 -- 172.21.15.8:0/3412747998 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a10107990 con 0x7f8a10101bd0 2023-08-11T12:22:25.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.612+0000 7f8a0d7fa700 1 -- 172.21.15.8:0/3412747998 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f8a040105a0 con 0x7f8a10101bd0 2023-08-11T12:22:25.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.613+0000 7f8a0d7fa700 1 --2- 172.21.15.8:0/3412747998 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89f809ff50 0x7f89f80a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:25.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.613+0000 7f8a0d7fa700 1 -- 172.21.15.8:0/3412747998 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8a04014070 con 0x7f8a10101bd0 2023-08-11T12:22:25.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.613+0000 7f8a0ffff700 1 --2- 172.21.15.8:0/3412747998 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89f809ff50 0x7f89f80a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:25.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.614+0000 7f8a0ffff700 1 --2- 172.21.15.8:0/3412747998 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89f809ff50 0x7f89f80a2410 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8a00009990 tx=0x7f8a00005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:25.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.617+0000 7f8a0d7fa700 1 -- 172.21.15.8:0/3412747998 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f8a04051c30 con 0x7f8a10101bd0 2023-08-11T12:22:25.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:25 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3216111382' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:22:25.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:25 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3080536353' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-08-11T12:22:25.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.835+0000 7f8a165ff700 1 -- 172.21.15.8:0/3412747998 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a1010c240 con 0x7f8a10101bd0 2023-08-11T12:22:25.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.836+0000 7f8a0d7fa700 1 -- 172.21.15.8:0/3412747998 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+23820 (secure 0 0 0) 0x7f8a04095180 con 0x7f8a10101bd0 2023-08-11T12:22:25.839 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:22:25.839 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":87,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","created":"2023-08-11T12:14:28.341113+0000","modified":"2023-08-11T12:22:08.397736+0000","last_up_change":"2023-08-11T12:21:14.913735+0000","last_in_change":"2023-08-11T12:20:57.476558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-11T12:17:49.040758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-11T12:22:01.383296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-11T12:22:02.816329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-11T12:22:06.369375+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f903e393-7894-42d6-8b11-737ceef1f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6803","nonce":664104961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6805","nonce":664104961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6809","nonce":664104961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6807","nonce":664104961}]},"public_addr":"172.21.15.8:6803/664104961","cluster_addr":"172.21.15.8:6805/664104961","heartbeat_back_addr":"172.21.15.8:6809/664104961","heartbeat_front_addr":"172.21.15.8:6807/664104961","state":["exists","up"]},{"osd":1,"uuid":"1e988e5c-e78c-46d5-80a5-dff7ac38cbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6801","nonce":4187350703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6803","nonce":4187350703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6807","nonce":4187350703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6805","nonce":4187350703}]},"public_addr":"172.21.15.45:6801/4187350703","cluster_addr":"172.21.15.45:6803/4187350703","heartbeat_back_addr":"172.21.15.45:6807/4187350703","heartbeat_front_addr":"172.21.15.45:6805/4187350703","state":["exists","up"]},{"osd":2,"uuid":"1835217c-a93c-4181-b8b8-cc410bab1a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6801","nonce":2547818140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6803","nonce":2547818140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6807","nonce":2547818140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6805","nonce":2547818140}]},"public_addr":"172.21.15.194:6801/2547818140","cluster_addr":"172.21.15.194:6803/2547818140","heartbeat_back_addr":"172.21.15.194:6807/2547818140","heartbeat_front_addr":"172.21.15.194:6805/2547818140","state":["exists","up"]},{"osd":3,"uuid":"b55ae61a-731c-4312-a998-661122b84788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6811","nonce":187418883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6813","nonce":187418883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6817","nonce":187418883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6815","nonce":187418883}]},"public_addr":"172.21.15.8:6811/187418883","cluster_addr":"172.21.15.8:6813/187418883","heartbeat_back_addr":"172.21.15.8:6817/187418883","heartbeat_front_addr":"172.21.15.8:6815/187418883","state":["exists","up"]},{"osd":4,"uuid":"2c28acbb-e807-4559-8aa2-a35ca84b5d43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6809","nonce":3099704571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6811","nonce":3099704571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6815","nonce":3099704571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6813","nonce":3099704571}]},"public_addr":"172.21.15.45:6809/3099704571","cluster_addr":"172.21.15.45:6811/3099704571","heartbeat_back_addr":"172.21.15.45:6815/3099704571","heartbeat_front_addr":"172.21.15.45:6813/3099704571","state":["exists","up"]},{"osd":5,"uuid":"37032289-8016-4730-9b69-f7985e058ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6809","nonce":263803874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6811","nonce":263803874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6815","nonce":263803874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6813","nonce":263803874}]},"public_addr":"172.21.15.194:6809/263803874","cluster_addr":"172.21.15.194:6811/263803874","heartbeat_back_addr":"172.21.15.194:6815/263803874","heartbeat_front_addr":"172.21.15.194:6813/263803874","state":["exists","up"]},{"osd":6,"uuid":"32d2dab9-6944-40d1-ada9-4f941821b063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6819","nonce":1802966829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6821","nonce":1802966829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6825","nonce":1802966829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6823","nonce":1802966829}]},"public_addr":"172.21.15.8:6819/1802966829","cluster_addr":"172.21.15.8:6821/1802966829","heartbeat_back_addr":"172.21.15.8:6825/1802966829","heartbeat_front_addr":"172.21.15.8:6823/1802966829","state":["exists","up"]},{"osd":7,"uuid":"086aff58-1554-49fe-92ff-5166b115aeef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6817","nonce":3715737148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6819","nonce":3715737148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6823","nonce":3715737148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6821","nonce":3715737148}]},"public_addr":"172.21.15.45:6817/3715737148","cluster_addr":"172.21.15.45:6819/3715737148","heartbeat_back_addr":"172.21.15.45:6823/3715737148","heartbeat_front_addr":"172.21.15.45:6821/3715737148","state":["exists","up"]},{"osd":8,"uuid":"7fff5e95-2453-4ea6-a5c1-3bba6a1f6400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6817","nonce":57497127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6819","nonce":57497127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6823","nonce":57497127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6821","nonce":57497127}]},"public_addr":"172.21.15.194:6817/57497127","cluster_addr":"172.21.15.194:6819/57497127","heartbeat_back_addr":"172.21.15.194:6823/57497127","heartbeat_front_addr":"172.21.15.194:6821/57497127","state":["exists","up"]},{"osd":9,"uuid":"31ab0121-4c92-42ec-9f19-e672062e8814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6827","nonce":434661930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6829","nonce":434661930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6833","nonce":434661930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6831","nonce":434661930}]},"public_addr":"172.21.15.8:6827/434661930","cluster_addr":"172.21.15.8:6829/434661930","heartbeat_back_addr":"172.21.15.8:6833/434661930","heartbeat_front_addr":"172.21.15.8:6831/434661930","state":["exists","up"]},{"osd":10,"uuid":"62c632e4-94f6-4630-9d94-8d28fccacf45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6825","nonce":3281212184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6827","nonce":3281212184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6831","nonce":3281212184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6829","nonce":3281212184}]},"public_addr":"172.21.15.45:6825/3281212184","cluster_addr":"172.21.15.45:6827/3281212184","heartbeat_back_addr":"172.21.15.45:6831/3281212184","heartbeat_front_addr":"172.21.15.45:6829/3281212184","state":["exists","up"]},{"osd":11,"uuid":"8ca4a80d-cd75-4230-b46d-aef6fdc03e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6825","nonce":1637875895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6827","nonce":1637875895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6831","nonce":1637875895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6829","nonce":1637875895}]},"public_addr":"172.21.15.194:6825/1637875895","cluster_addr":"172.21.15.194:6827/1637875895","heartbeat_back_addr":"172.21.15.194:6831/1637875895","heartbeat_front_addr":"172.21.15.194:6829/1637875895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:04.255616+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:26.243863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:46.630365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:12.926291+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:35.747049+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:55.793767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:21.685725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:43.703215+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:04.043674+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:30.320026+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:52.751974+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:21:13.230024+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/2000592056":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2102228072":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2374527928":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2928221278":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2744750874":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/3681755887":"2023-08-12T12:15:02.528403+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-11T12:22:25.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.838+0000 7f8a165ff700 1 -- 172.21.15.8:0/3412747998 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89f809ff50 msgr2=0x7f89f80a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:25.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.838+0000 7f8a165ff700 1 --2- 172.21.15.8:0/3412747998 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89f809ff50 0x7f89f80a2410 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8a00009990 tx=0x7f8a00005fb0 comp rx=0 tx=0).stop 2023-08-11T12:22:25.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.839+0000 7f8a165ff700 1 -- 172.21.15.8:0/3412747998 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a10101bd0 msgr2=0x7f8a10196c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:25.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.839+0000 7f8a165ff700 1 --2- 172.21.15.8:0/3412747998 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a10101bd0 0x7f8a10196c70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8a0400e9a0 tx=0x7f8a0400ecb0 comp rx=0 tx=0).stop 2023-08-11T12:22:25.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.839+0000 7f8a165ff700 1 -- 172.21.15.8:0/3412747998 shutdown_connections 2023-08-11T12:22:25.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.839+0000 7f8a165ff700 1 --2- 172.21.15.8:0/3412747998 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89f809ff50 0x7f89f80a2410 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:25.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.839+0000 7f8a165ff700 1 --2- 172.21.15.8:0/3412747998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a10102570 0x7f8a1019dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:25.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.839+0000 7f8a165ff700 1 --2- 172.21.15.8:0/3412747998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a101009e0 0x7f8a10196730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:25.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.839+0000 7f8a165ff700 1 --2- 172.21.15.8:0/3412747998 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a10101bd0 0x7f8a10196c70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:25.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.839+0000 7f8a165ff700 1 -- 172.21.15.8:0/3412747998 >> 172.21.15.8:0/3412747998 conn(0x7f8a100fbf50 msgr2=0x7f8a100fe240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:25.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.839+0000 7f8a165ff700 1 -- 172.21.15.8:0/3412747998 shutdown_connections 2023-08-11T12:22:25.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:25.839+0000 7f8a165ff700 1 -- 172.21.15.8:0/3412747998 wait complete. 2023-08-11T12:22:25.859 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-11T12:22:26.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.061+0000 7fd5535ff700 1 -- 172.21.15.8:0/3867835373 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd54c073380 msgr2=0x7fd54c073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:26.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.061+0000 7fd5535ff700 1 --2- 172.21.15.8:0/3867835373 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd54c073380 0x7fd54c073800 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd53c0098f0 tx=0x7fd53c009c00 comp rx=0 tx=0).stop 2023-08-11T12:22:26.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.061+0000 7fd5535ff700 1 -- 172.21.15.8:0/3867835373 shutdown_connections 2023-08-11T12:22:26.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.061+0000 7fd5535ff700 1 --2- 172.21.15.8:0/3867835373 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd54c074960 0x7fd54c072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:26.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.061+0000 7fd5535ff700 1 --2- 172.21.15.8:0/3867835373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd54c1088b0 0x7fd54c10ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:26.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.061+0000 7fd5535ff700 1 --2- 172.21.15.8:0/3867835373 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd54c073380 0x7fd54c073800 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:26.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.061+0000 7fd5535ff700 1 -- 172.21.15.8:0/3867835373 >> 172.21.15.8:0/3867835373 conn(0x7fd54c0fbf80 msgr2=0x7fd54c0fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:26.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.062+0000 7fd5535ff700 1 -- 172.21.15.8:0/3867835373 shutdown_connections 2023-08-11T12:22:26.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.062+0000 7fd5535ff700 1 -- 172.21.15.8:0/3867835373 wait complete. 2023-08-11T12:22:26.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.062+0000 7fd5535ff700 1 Processor -- start 2023-08-11T12:22:26.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.063+0000 7fd5535ff700 1 -- start start 2023-08-11T12:22:26.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.063+0000 7fd5535ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd54c073380 0x7fd54c198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:26.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.063+0000 7fd5535ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd54c074960 0x7fd54c198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:26.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.063+0000 7fd5535ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd54c1088b0 0x7fd54c19ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:26.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.063+0000 7fd5535ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c1a04d0 con 0x7fd54c1088b0 2023-08-11T12:22:26.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.063+0000 7fd5535ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c1a0610 con 0x7fd54c074960 2023-08-11T12:22:26.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.063+0000 7fd5535ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c1a07a0 con 0x7fd54c073380 2023-08-11T12:22:26.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.063+0000 7fd551b9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd54c1088b0 0x7fd54c19ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:26.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.063+0000 7fd551b9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd54c1088b0 0x7fd54c19ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36322/0 (socket says 172.21.15.8:36322) 2023-08-11T12:22:26.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.063+0000 7fd551b9c700 1 -- 172.21.15.8:0/2460474355 learned_addr learned my addr 172.21.15.8:0/2460474355 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:26.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.063+0000 7fd550b9a700 1 --2- 172.21.15.8:0/2460474355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd54c074960 0x7fd54c198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:26.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.063+0000 7fd55139b700 1 --2- 172.21.15.8:0/2460474355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd54c073380 0x7fd54c198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:26.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.064+0000 7fd551b9c700 1 -- 172.21.15.8:0/2460474355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd54c073380 msgr2=0x7fd54c198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:26.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.064+0000 7fd551b9c700 1 --2- 172.21.15.8:0/2460474355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd54c073380 0x7fd54c198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:26.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.064+0000 7fd551b9c700 1 -- 172.21.15.8:0/2460474355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd54c074960 msgr2=0x7fd54c198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:26.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.064+0000 7fd551b9c700 1 --2- 172.21.15.8:0/2460474355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd54c074960 0x7fd54c198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:26.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.064+0000 7fd551b9c700 1 -- 172.21.15.8:0/2460474355 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c009520 con 0x7fd54c1088b0 2023-08-11T12:22:26.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.064+0000 7fd550b9a700 1 --2- 172.21.15.8:0/2460474355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd54c074960 0x7fd54c198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:22:26.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.064+0000 7fd551b9c700 1 --2- 172.21.15.8:0/2460474355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd54c1088b0 0x7fd54c19ff00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd54400c110 tx=0x7fd54400c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:26.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.064+0000 7fd5427fc700 1 -- 172.21.15.8:0/2460474355 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd544017070 con 0x7fd54c1088b0 2023-08-11T12:22:26.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.064+0000 7fd5427fc700 1 -- 172.21.15.8:0/2460474355 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd54400e050 con 0x7fd54c1088b0 2023-08-11T12:22:26.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.064+0000 7fd5535ff700 1 -- 172.21.15.8:0/2460474355 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd54c1a0a20 con 0x7fd54c1088b0 2023-08-11T12:22:26.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.064+0000 7fd5427fc700 1 -- 172.21.15.8:0/2460474355 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5440078f0 con 0x7fd54c1088b0 2023-08-11T12:22:26.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.064+0000 7fd5535ff700 1 -- 172.21.15.8:0/2460474355 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd54c1a0f30 con 0x7fd54c1088b0 2023-08-11T12:22:26.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.065+0000 7fd5535ff700 1 -- 172.21.15.8:0/2460474355 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd54c106f60 con 0x7fd54c1088b0 2023-08-11T12:22:26.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.067+0000 7fd5427fc700 1 -- 172.21.15.8:0/2460474355 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fd544007a50 con 0x7fd54c1088b0 2023-08-11T12:22:26.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.069+0000 7fd5427fc700 1 --2- 172.21.15.8:0/2460474355 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd53809ffd0 0x7fd5380a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:26.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.069+0000 7fd5427fc700 1 -- 172.21.15.8:0/2460474355 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fd5440cae50 con 0x7fd54c1088b0 2023-08-11T12:22:26.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.069+0000 7fd55139b700 1 --2- 172.21.15.8:0/2460474355 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd53809ffd0 0x7fd5380a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:26.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.070+0000 7fd55139b700 1 --2- 172.21.15.8:0/2460474355 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd53809ffd0 0x7fd5380a2490 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd548009c60 tx=0x7fd548009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:26.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.073+0000 7fd5427fc700 1 -- 172.21.15.8:0/2460474355 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fd544094990 con 0x7fd54c1088b0 2023-08-11T12:22:26.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:25 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3216111382' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:22:26.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:25 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3080536353' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-08-11T12:22:26.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:25 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3216111382' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:22:26.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:25 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3080536353' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-08-11T12:22:26.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.284+0000 7fd5535ff700 1 -- 172.21.15.8:0/2460474355 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd54c10e650 con 0x7fd54c1088b0 2023-08-11T12:22:26.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.285+0000 7fd5427fc700 1 -- 172.21.15.8:0/2460474355 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+23820 (secure 0 0 0) 0x7fd544097fb0 con 0x7fd54c1088b0 2023-08-11T12:22:26.288 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:22:26.288 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":87,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","created":"2023-08-11T12:14:28.341113+0000","modified":"2023-08-11T12:22:08.397736+0000","last_up_change":"2023-08-11T12:21:14.913735+0000","last_in_change":"2023-08-11T12:20:57.476558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-11T12:17:49.040758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-11T12:22:01.383296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-11T12:22:02.816329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-11T12:22:06.369375+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f903e393-7894-42d6-8b11-737ceef1f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6803","nonce":664104961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6805","nonce":664104961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6809","nonce":664104961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6807","nonce":664104961}]},"public_addr":"172.21.15.8:6803/664104961","cluster_addr":"172.21.15.8:6805/664104961","heartbeat_back_addr":"172.21.15.8:6809/664104961","heartbeat_front_addr":"172.21.15.8:6807/664104961","state":["exists","up"]},{"osd":1,"uuid":"1e988e5c-e78c-46d5-80a5-dff7ac38cbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6801","nonce":4187350703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6803","nonce":4187350703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6807","nonce":4187350703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6805","nonce":4187350703}]},"public_addr":"172.21.15.45:6801/4187350703","cluster_addr":"172.21.15.45:6803/4187350703","heartbeat_back_addr":"172.21.15.45:6807/4187350703","heartbeat_front_addr":"172.21.15.45:6805/4187350703","state":["exists","up"]},{"osd":2,"uuid":"1835217c-a93c-4181-b8b8-cc410bab1a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6801","nonce":2547818140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6803","nonce":2547818140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6807","nonce":2547818140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6805","nonce":2547818140}]},"public_addr":"172.21.15.194:6801/2547818140","cluster_addr":"172.21.15.194:6803/2547818140","heartbeat_back_addr":"172.21.15.194:6807/2547818140","heartbeat_front_addr":"172.21.15.194:6805/2547818140","state":["exists","up"]},{"osd":3,"uuid":"b55ae61a-731c-4312-a998-661122b84788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6811","nonce":187418883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6813","nonce":187418883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6817","nonce":187418883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6815","nonce":187418883}]},"public_addr":"172.21.15.8:6811/187418883","cluster_addr":"172.21.15.8:6813/187418883","heartbeat_back_addr":"172.21.15.8:6817/187418883","heartbeat_front_addr":"172.21.15.8:6815/187418883","state":["exists","up"]},{"osd":4,"uuid":"2c28acbb-e807-4559-8aa2-a35ca84b5d43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6809","nonce":3099704571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6811","nonce":3099704571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6815","nonce":3099704571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6813","nonce":3099704571}]},"public_addr":"172.21.15.45:6809/3099704571","cluster_addr":"172.21.15.45:6811/3099704571","heartbeat_back_addr":"172.21.15.45:6815/3099704571","heartbeat_front_addr":"172.21.15.45:6813/3099704571","state":["exists","up"]},{"osd":5,"uuid":"37032289-8016-4730-9b69-f7985e058ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6809","nonce":263803874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6811","nonce":263803874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6815","nonce":263803874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6813","nonce":263803874}]},"public_addr":"172.21.15.194:6809/263803874","cluster_addr":"172.21.15.194:6811/263803874","heartbeat_back_addr":"172.21.15.194:6815/263803874","heartbeat_front_addr":"172.21.15.194:6813/263803874","state":["exists","up"]},{"osd":6,"uuid":"32d2dab9-6944-40d1-ada9-4f941821b063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6819","nonce":1802966829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6821","nonce":1802966829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6825","nonce":1802966829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6823","nonce":1802966829}]},"public_addr":"172.21.15.8:6819/1802966829","cluster_addr":"172.21.15.8:6821/1802966829","heartbeat_back_addr":"172.21.15.8:6825/1802966829","heartbeat_front_addr":"172.21.15.8:6823/1802966829","state":["exists","up"]},{"osd":7,"uuid":"086aff58-1554-49fe-92ff-5166b115aeef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6817","nonce":3715737148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6819","nonce":3715737148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6823","nonce":3715737148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6821","nonce":3715737148}]},"public_addr":"172.21.15.45:6817/3715737148","cluster_addr":"172.21.15.45:6819/3715737148","heartbeat_back_addr":"172.21.15.45:6823/3715737148","heartbeat_front_addr":"172.21.15.45:6821/3715737148","state":["exists","up"]},{"osd":8,"uuid":"7fff5e95-2453-4ea6-a5c1-3bba6a1f6400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6817","nonce":57497127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6819","nonce":57497127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6823","nonce":57497127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6821","nonce":57497127}]},"public_addr":"172.21.15.194:6817/57497127","cluster_addr":"172.21.15.194:6819/57497127","heartbeat_back_addr":"172.21.15.194:6823/57497127","heartbeat_front_addr":"172.21.15.194:6821/57497127","state":["exists","up"]},{"osd":9,"uuid":"31ab0121-4c92-42ec-9f19-e672062e8814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6827","nonce":434661930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6829","nonce":434661930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6833","nonce":434661930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6831","nonce":434661930}]},"public_addr":"172.21.15.8:6827/434661930","cluster_addr":"172.21.15.8:6829/434661930","heartbeat_back_addr":"172.21.15.8:6833/434661930","heartbeat_front_addr":"172.21.15.8:6831/434661930","state":["exists","up"]},{"osd":10,"uuid":"62c632e4-94f6-4630-9d94-8d28fccacf45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6825","nonce":3281212184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6827","nonce":3281212184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6831","nonce":3281212184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6829","nonce":3281212184}]},"public_addr":"172.21.15.45:6825/3281212184","cluster_addr":"172.21.15.45:6827/3281212184","heartbeat_back_addr":"172.21.15.45:6831/3281212184","heartbeat_front_addr":"172.21.15.45:6829/3281212184","state":["exists","up"]},{"osd":11,"uuid":"8ca4a80d-cd75-4230-b46d-aef6fdc03e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6825","nonce":1637875895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6827","nonce":1637875895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6831","nonce":1637875895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6829","nonce":1637875895}]},"public_addr":"172.21.15.194:6825/1637875895","cluster_addr":"172.21.15.194:6827/1637875895","heartbeat_back_addr":"172.21.15.194:6831/1637875895","heartbeat_front_addr":"172.21.15.194:6829/1637875895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:04.255616+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:26.243863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:46.630365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:12.926291+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:35.747049+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:55.793767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:21.685725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:43.703215+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:04.043674+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:30.320026+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:52.751974+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:21:13.230024+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/2000592056":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2102228072":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2374527928":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2928221278":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2744750874":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/3681755887":"2023-08-12T12:15:02.528403+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-11T12:22:26.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.287+0000 7fd5535ff700 1 -- 172.21.15.8:0/2460474355 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd53809ffd0 msgr2=0x7fd5380a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:26.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.287+0000 7fd5535ff700 1 --2- 172.21.15.8:0/2460474355 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd53809ffd0 0x7fd5380a2490 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd548009c60 tx=0x7fd548009260 comp rx=0 tx=0).stop 2023-08-11T12:22:26.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.287+0000 7fd5535ff700 1 -- 172.21.15.8:0/2460474355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd54c1088b0 msgr2=0x7fd54c19ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:26.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.287+0000 7fd5535ff700 1 --2- 172.21.15.8:0/2460474355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd54c1088b0 0x7fd54c19ff00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd54400c110 tx=0x7fd54400c420 comp rx=0 tx=0).stop 2023-08-11T12:22:26.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.288+0000 7fd5535ff700 1 -- 172.21.15.8:0/2460474355 shutdown_connections 2023-08-11T12:22:26.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.288+0000 7fd5535ff700 1 --2- 172.21.15.8:0/2460474355 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd53809ffd0 0x7fd5380a2490 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:26.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.288+0000 7fd5535ff700 1 --2- 172.21.15.8:0/2460474355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd54c073380 0x7fd54c198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:26.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.288+0000 7fd5535ff700 1 --2- 172.21.15.8:0/2460474355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd54c1088b0 0x7fd54c19ff00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:26.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.288+0000 7fd5535ff700 1 --2- 172.21.15.8:0/2460474355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd54c074960 0x7fd54c198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:26.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.288+0000 7fd5535ff700 1 -- 172.21.15.8:0/2460474355 >> 172.21.15.8:0/2460474355 conn(0x7fd54c0fbf80 msgr2=0x7fd54c0fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:26.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.288+0000 7fd5535ff700 1 -- 172.21.15.8:0/2460474355 shutdown_connections 2023-08-11T12:22:26.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.288+0000 7fd5535ff700 1 -- 172.21.15.8:0/2460474355 wait complete. 2023-08-11T12:22:26.309 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-11T12:22:26.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.515+0000 7fd20f3ff700 1 -- 172.21.15.8:0/2925536418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd208100a10 msgr2=0x7fd208100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:26.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.515+0000 7fd20f3ff700 1 --2- 172.21.15.8:0/2925536418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd208100a10 0x7fd208100e30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd2040099c0 tx=0x7fd204009cd0 comp rx=0 tx=0).stop 2023-08-11T12:22:26.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.515+0000 7fd20f3ff700 1 -- 172.21.15.8:0/2925536418 shutdown_connections 2023-08-11T12:22:26.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.515+0000 7fd20f3ff700 1 --2- 172.21.15.8:0/2925536418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2081025a0 0x7fd208108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:26.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.515+0000 7fd20f3ff700 1 --2- 172.21.15.8:0/2925536418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd208100a10 0x7fd208100e30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:26.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.515+0000 7fd20f3ff700 1 --2- 172.21.15.8:0/2925536418 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd208101c00 0x7fd208102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:26.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.515+0000 7fd20f3ff700 1 -- 172.21.15.8:0/2925536418 >> 172.21.15.8:0/2925536418 conn(0x7fd2080fbf80 msgr2=0x7fd2080fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:26.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.515+0000 7fd20f3ff700 1 -- 172.21.15.8:0/2925536418 shutdown_connections 2023-08-11T12:22:26.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.515+0000 7fd20f3ff700 1 -- 172.21.15.8:0/2925536418 wait complete. 2023-08-11T12:22:26.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.516+0000 7fd20f3ff700 1 Processor -- start 2023-08-11T12:22:26.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.516+0000 7fd20f3ff700 1 -- start start 2023-08-11T12:22:26.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.516+0000 7fd20f3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd208100a10 0x7fd2081988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:26.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.516+0000 7fd20f3ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd208101c00 0x7fd208198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:26.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.517+0000 7fd20f3ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2081025a0 0x7fd20819fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:26.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.517+0000 7fd20f3ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2081a0420 con 0x7fd2081025a0 2023-08-11T12:22:26.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.517+0000 7fd20f3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2081a0560 con 0x7fd208100a10 2023-08-11T12:22:26.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.517+0000 7fd20f3ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2081a06f0 con 0x7fd208101c00 2023-08-11T12:22:26.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.517+0000 7fd20d99c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2081025a0 0x7fd20819fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:26.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.517+0000 7fd20d19b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd208100a10 0x7fd2081988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:26.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.517+0000 7fd20d19b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd208100a10 0x7fd2081988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:32808/0 (socket says 172.21.15.8:32808) 2023-08-11T12:22:26.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.517+0000 7fd20d19b700 1 -- 172.21.15.8:0/916881352 learned_addr learned my addr 172.21.15.8:0/916881352 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:26.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.517+0000 7fd20c99a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd208101c00 0x7fd208198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:26.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.517+0000 7fd20d99c700 1 -- 172.21.15.8:0/916881352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd208101c00 msgr2=0x7fd208198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:26.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.517+0000 7fd20d99c700 1 --2- 172.21.15.8:0/916881352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd208101c00 0x7fd208198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:26.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.517+0000 7fd20d99c700 1 -- 172.21.15.8:0/916881352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd208100a10 msgr2=0x7fd2081988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:26.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.517+0000 7fd20d99c700 1 --2- 172.21.15.8:0/916881352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd208100a10 0x7fd2081988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:26.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.517+0000 7fd20d99c700 1 -- 172.21.15.8:0/916881352 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2040095f0 con 0x7fd2081025a0 2023-08-11T12:22:26.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.517+0000 7fd20d19b700 1 --2- 172.21.15.8:0/916881352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd208100a10 0x7fd2081988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:22:26.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.518+0000 7fd20d99c700 1 --2- 172.21.15.8:0/916881352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2081025a0 0x7fd20819fe50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd20000efc0 tx=0x7fd20000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:26.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.518+0000 7fd1fe7fc700 1 -- 172.21.15.8:0/916881352 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd200018070 con 0x7fd2081025a0 2023-08-11T12:22:26.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.518+0000 7fd20f3ff700 1 -- 172.21.15.8:0/916881352 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2081a0970 con 0x7fd2081025a0 2023-08-11T12:22:26.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.518+0000 7fd1fe7fc700 1 -- 172.21.15.8:0/916881352 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd20000f040 con 0x7fd2081025a0 2023-08-11T12:22:26.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.518+0000 7fd1fe7fc700 1 -- 172.21.15.8:0/916881352 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20000cd40 con 0x7fd2081025a0 2023-08-11T12:22:26.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.518+0000 7fd20f3ff700 1 -- 172.21.15.8:0/916881352 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2081a0e30 con 0x7fd2081025a0 2023-08-11T12:22:26.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.519+0000 7fd20f3ff700 1 -- 172.21.15.8:0/916881352 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd208193010 con 0x7fd2081025a0 2023-08-11T12:22:26.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.521+0000 7fd1fe7fc700 1 -- 172.21.15.8:0/916881352 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fd200003a00 con 0x7fd2081025a0 2023-08-11T12:22:26.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.522+0000 7fd1fe7fc700 1 --2- 172.21.15.8:0/916881352 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd1f409ff50 0x7fd1f40a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:26.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.523+0000 7fd1fe7fc700 1 -- 172.21.15.8:0/916881352 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fd2000caff0 con 0x7fd2081025a0 2023-08-11T12:22:26.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.523+0000 7fd20d19b700 1 --2- 172.21.15.8:0/916881352 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd1f409ff50 0x7fd1f40a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:26.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.523+0000 7fd20d19b700 1 --2- 172.21.15.8:0/916881352 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd1f409ff50 0x7fd1f40a2410 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd204004800 tx=0x7fd20401a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:26.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.526+0000 7fd1fe7fc700 1 -- 172.21.15.8:0/916881352 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fd200094c20 con 0x7fd2081025a0 2023-08-11T12:22:26.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:26.784+0000 7fd20f3ff700 1 -- 172.21.15.8:0/916881352 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd20810c220 con 0x7fd2081025a0 2023-08-11T12:22:27.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:26 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3412747998' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:27.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:26 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2460474355' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:27.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:26 smithi008 ceph-mon[97158]: pgmap v285: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-08-11T12:22:27.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:26 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3412747998' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:27.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:26 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2460474355' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:27.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:26 smithi194 ceph-mon[130905]: pgmap v285: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-08-11T12:22:27.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:26 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3412747998' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:27.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:26 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2460474355' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:27.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:26 smithi045 ceph-mon[130284]: pgmap v285: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-08-11T12:22:27.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.702+0000 7fd1fe7fc700 1 -- 172.21.15.8:0/916881352 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd200098240 con 0x7fd2081025a0 2023-08-11T12:22:27.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.705+0000 7fd20f3ff700 1 -- 172.21.15.8:0/916881352 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd1f409ff50 msgr2=0x7fd1f40a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:27.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.705+0000 7fd20f3ff700 1 --2- 172.21.15.8:0/916881352 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd1f409ff50 0x7fd1f40a2410 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd204004800 tx=0x7fd20401a040 comp rx=0 tx=0).stop 2023-08-11T12:22:27.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.705+0000 7fd20f3ff700 1 -- 172.21.15.8:0/916881352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2081025a0 msgr2=0x7fd20819fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:27.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.705+0000 7fd20f3ff700 1 --2- 172.21.15.8:0/916881352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2081025a0 0x7fd20819fe50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd20000efc0 tx=0x7fd20000c3a0 comp rx=0 tx=0).stop 2023-08-11T12:22:27.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.705+0000 7fd20f3ff700 1 -- 172.21.15.8:0/916881352 shutdown_connections 2023-08-11T12:22:27.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.705+0000 7fd20f3ff700 1 --2- 172.21.15.8:0/916881352 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd1f409ff50 0x7fd1f40a2410 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:27.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.705+0000 7fd20f3ff700 1 --2- 172.21.15.8:0/916881352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2081025a0 0x7fd20819fe50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:27.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.705+0000 7fd20f3ff700 1 --2- 172.21.15.8:0/916881352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd208100a10 0x7fd2081988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:27.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.705+0000 7fd20f3ff700 1 --2- 172.21.15.8:0/916881352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd208101c00 0x7fd208198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:27.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.705+0000 7fd20f3ff700 1 -- 172.21.15.8:0/916881352 >> 172.21.15.8:0/916881352 conn(0x7fd2080fbf80 msgr2=0x7fd2081074e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:27.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.705+0000 7fd20f3ff700 1 -- 172.21.15.8:0/916881352 shutdown_connections 2023-08-11T12:22:27.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.705+0000 7fd20f3ff700 1 -- 172.21.15.8:0/916881352 wait complete. 2023-08-11T12:22:27.728 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True} 2023-08-11T12:22:27.729 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2023-08-11T12:22:27.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.943+0000 7feb8d1ff700 1 -- 172.21.15.8:0/220636570 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb88100a00 msgr2=0x7feb88100e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:27.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.943+0000 7feb8d1ff700 1 --2- 172.21.15.8:0/220636570 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb88100a00 0x7feb88100e20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7feb780099c0 tx=0x7feb78009cd0 comp rx=0 tx=0).stop 2023-08-11T12:22:27.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.943+0000 7feb8d1ff700 1 -- 172.21.15.8:0/220636570 shutdown_connections 2023-08-11T12:22:27.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.943+0000 7feb8d1ff700 1 --2- 172.21.15.8:0/220636570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb88102590 0x7feb88108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:27.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.943+0000 7feb8d1ff700 1 --2- 172.21.15.8:0/220636570 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb88100a00 0x7feb88100e20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:27.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.943+0000 7feb8d1ff700 1 --2- 172.21.15.8:0/220636570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb88101bf0 0x7feb88102050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:27.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.943+0000 7feb8d1ff700 1 -- 172.21.15.8:0/220636570 >> 172.21.15.8:0/220636570 conn(0x7feb880fbf70 msgr2=0x7feb880fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:27.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.943+0000 7feb8d1ff700 1 -- 172.21.15.8:0/220636570 shutdown_connections 2023-08-11T12:22:27.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.943+0000 7feb8d1ff700 1 -- 172.21.15.8:0/220636570 wait complete. 2023-08-11T12:22:27.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.944+0000 7feb8d1ff700 1 Processor -- start 2023-08-11T12:22:27.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.944+0000 7feb8d1ff700 1 -- start start 2023-08-11T12:22:27.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.945+0000 7feb8d1ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb88100a00 0x7feb88198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:27.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.945+0000 7feb8d1ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb88101bf0 0x7feb88198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:27.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.945+0000 7feb8d1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb88102590 0x7feb8819fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:27.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.945+0000 7feb8d1ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb881a04a0 con 0x7feb88101bf0 2023-08-11T12:22:27.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.945+0000 7feb8d1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb881a05e0 con 0x7feb88102590 2023-08-11T12:22:27.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.945+0000 7feb8d1ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb881a0770 con 0x7feb88100a00 2023-08-11T12:22:27.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.945+0000 7feb8659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb88101bf0 0x7feb88198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:27.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.945+0000 7feb8659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb88101bf0 0x7feb88198e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50698/0 (socket says 172.21.15.8:50698) 2023-08-11T12:22:27.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.945+0000 7feb8659c700 1 -- 172.21.15.8:0/3736595378 learned_addr learned my addr 172.21.15.8:0/3736595378 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:27.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.945+0000 7feb8759e700 1 --2- 172.21.15.8:0/3736595378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb88102590 0x7feb8819fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:27.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.945+0000 7feb86d9d700 1 --2- 172.21.15.8:0/3736595378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb88100a00 0x7feb88198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:27.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.945+0000 7feb8659c700 1 -- 172.21.15.8:0/3736595378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb88100a00 msgr2=0x7feb88198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:27.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.945+0000 7feb8659c700 1 --2- 172.21.15.8:0/3736595378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb88100a00 0x7feb88198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:27.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.945+0000 7feb8659c700 1 -- 172.21.15.8:0/3736595378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb88102590 msgr2=0x7feb8819fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:27.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.945+0000 7feb8659c700 1 --2- 172.21.15.8:0/3736595378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb88102590 0x7feb8819fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:27.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.945+0000 7feb8659c700 1 -- 172.21.15.8:0/3736595378 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb780095f0 con 0x7feb88101bf0 2023-08-11T12:22:27.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.946+0000 7feb8659c700 1 --2- 172.21.15.8:0/3736595378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb88101bf0 0x7feb88198e60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7feb7c00e9a0 tx=0x7feb7c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:27.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.946+0000 7feb6ffff700 1 -- 172.21.15.8:0/3736595378 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c009790 con 0x7feb88101bf0 2023-08-11T12:22:27.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.946+0000 7feb6ffff700 1 -- 172.21.15.8:0/3736595378 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feb7c010430 con 0x7feb88101bf0 2023-08-11T12:22:27.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.946+0000 7feb8d1ff700 1 -- 172.21.15.8:0/3736595378 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb881a0a50 con 0x7feb88101bf0 2023-08-11T12:22:27.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.946+0000 7feb6ffff700 1 -- 172.21.15.8:0/3736595378 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c018680 con 0x7feb88101bf0 2023-08-11T12:22:27.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.946+0000 7feb8d1ff700 1 -- 172.21.15.8:0/3736595378 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb881a0fb0 con 0x7feb88101bf0 2023-08-11T12:22:27.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.947+0000 7feb8d1ff700 1 -- 172.21.15.8:0/3736595378 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8810c260 con 0x7feb88101bf0 2023-08-11T12:22:27.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.949+0000 7feb6ffff700 1 -- 172.21.15.8:0/3736595378 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7feb7c0105a0 con 0x7feb88101bf0 2023-08-11T12:22:27.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.950+0000 7feb6ffff700 1 --2- 172.21.15.8:0/3736595378 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7feb7009ffd0 0x7feb700a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:27.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.951+0000 7feb6ffff700 1 -- 172.21.15.8:0/3736595378 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8730+0+0 (secure 0 0 0) 0x7feb7c014070 con 0x7feb88101bf0 2023-08-11T12:22:27.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.951+0000 7feb86d9d700 1 --2- 172.21.15.8:0/3736595378 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7feb7009ffd0 0x7feb700a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:27.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.951+0000 7feb86d9d700 1 --2- 172.21.15.8:0/3736595378 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7feb7009ffd0 0x7feb700a2490 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feb78009990 tx=0x7feb78005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:27.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:27.955+0000 7feb6ffff700 1 -- 172.21.15.8:0/3736595378 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7feb7c051c30 con 0x7feb88101bf0 2023-08-11T12:22:28.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:27 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/916881352' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-08-11T12:22:28.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:27 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/916881352' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-08-11T12:22:28.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:27 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/916881352' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-08-11T12:22:28.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.214+0000 7feb8d1ff700 1 -- 172.21.15.8:0/3736595378 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7feb881a11a0 con 0x7feb88101bf0 2023-08-11T12:22:28.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.708+0000 7feb6ffff700 1 -- 172.21.15.8:0/3736595378 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7feb7c095100 con 0x7feb88101bf0 2023-08-11T12:22:28.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.711+0000 7feb8d1ff700 1 -- 172.21.15.8:0/3736595378 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7feb7009ffd0 msgr2=0x7feb700a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:28.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.711+0000 7feb8d1ff700 1 --2- 172.21.15.8:0/3736595378 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7feb7009ffd0 0x7feb700a2490 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feb78009990 tx=0x7feb78005fb0 comp rx=0 tx=0).stop 2023-08-11T12:22:28.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.711+0000 7feb8d1ff700 1 -- 172.21.15.8:0/3736595378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb88101bf0 msgr2=0x7feb88198e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:28.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.711+0000 7feb8d1ff700 1 --2- 172.21.15.8:0/3736595378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb88101bf0 0x7feb88198e60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7feb7c00e9a0 tx=0x7feb7c00ecb0 comp rx=0 tx=0).stop 2023-08-11T12:22:28.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.711+0000 7feb8d1ff700 1 -- 172.21.15.8:0/3736595378 shutdown_connections 2023-08-11T12:22:28.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.711+0000 7feb8d1ff700 1 --2- 172.21.15.8:0/3736595378 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7feb7009ffd0 0x7feb700a2490 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:28.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.711+0000 7feb8d1ff700 1 --2- 172.21.15.8:0/3736595378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb88100a00 0x7feb88198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:28.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.711+0000 7feb8d1ff700 1 --2- 172.21.15.8:0/3736595378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb88102590 0x7feb8819fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:28.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.711+0000 7feb8d1ff700 1 --2- 172.21.15.8:0/3736595378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb88101bf0 0x7feb88198e60 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:28.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.711+0000 7feb8d1ff700 1 -- 172.21.15.8:0/3736595378 >> 172.21.15.8:0/3736595378 conn(0x7feb880fbf70 msgr2=0x7feb880fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:28.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.712+0000 7feb8d1ff700 1 -- 172.21.15.8:0/3736595378 shutdown_connections 2023-08-11T12:22:28.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.712+0000 7feb8d1ff700 1 -- 172.21.15.8:0/3736595378 wait complete. 2023-08-11T12:22:28.737 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-08-11T12:22:28.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.943+0000 7ff3e75ff700 1 -- 172.21.15.8:0/1058227624 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3e0102590 msgr2=0x7ff3e0108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:28.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.943+0000 7ff3e75ff700 1 --2- 172.21.15.8:0/1058227624 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3e0102590 0x7ff3e0108e40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800b0d0 tx=0x7ff3d800b3e0 comp rx=0 tx=0).stop 2023-08-11T12:22:28.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.943+0000 7ff3e75ff700 1 -- 172.21.15.8:0/1058227624 shutdown_connections 2023-08-11T12:22:28.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.943+0000 7ff3e75ff700 1 --2- 172.21.15.8:0/1058227624 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3e0102590 0x7ff3e0108e40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:28.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.943+0000 7ff3e75ff700 1 --2- 172.21.15.8:0/1058227624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3e0100a00 0x7ff3e0100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:28.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.943+0000 7ff3e75ff700 1 --2- 172.21.15.8:0/1058227624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3e0101bf0 0x7ff3e0102050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:28.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.943+0000 7ff3e75ff700 1 -- 172.21.15.8:0/1058227624 >> 172.21.15.8:0/1058227624 conn(0x7ff3e00fbf70 msgr2=0x7ff3e00fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:28.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.943+0000 7ff3e75ff700 1 -- 172.21.15.8:0/1058227624 shutdown_connections 2023-08-11T12:22:28.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.943+0000 7ff3e75ff700 1 -- 172.21.15.8:0/1058227624 wait complete. 2023-08-11T12:22:28.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.944+0000 7ff3e75ff700 1 Processor -- start 2023-08-11T12:22:28.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.944+0000 7ff3e75ff700 1 -- start start 2023-08-11T12:22:28.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.944+0000 7ff3e75ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3e0100a00 0x7ff3e01989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:28.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.944+0000 7ff3e75ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3e0101bf0 0x7ff3e0198f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:28.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.944+0000 7ff3e75ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3e0102590 0x7ff3e019ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:28.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.945+0000 7ff3e75ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e01a0550 con 0x7ff3e0100a00 2023-08-11T12:22:28.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.945+0000 7ff3e75ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e01a0690 con 0x7ff3e0102590 2023-08-11T12:22:28.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.945+0000 7ff3e75ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e01a0820 con 0x7ff3e0101bf0 2023-08-11T12:22:28.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.945+0000 7ff3e539b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3e0100a00 0x7ff3e01989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:28.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.945+0000 7ff3e539b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3e0100a00 0x7ff3e01989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50730/0 (socket says 172.21.15.8:50730) 2023-08-11T12:22:28.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.945+0000 7ff3e539b700 1 -- 172.21.15.8:0/594839727 learned_addr learned my addr 172.21.15.8:0/594839727 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:28.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.945+0000 7ff3e4b9a700 1 --2- 172.21.15.8:0/594839727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3e0101bf0 0x7ff3e0198f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:28.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.945+0000 7ff3e5b9c700 1 --2- 172.21.15.8:0/594839727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3e0102590 0x7ff3e019ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:28.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.945+0000 7ff3e539b700 1 -- 172.21.15.8:0/594839727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3e0101bf0 msgr2=0x7ff3e0198f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:28.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.945+0000 7ff3e539b700 1 --2- 172.21.15.8:0/594839727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3e0101bf0 0x7ff3e0198f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:28.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.945+0000 7ff3e539b700 1 -- 172.21.15.8:0/594839727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3e0102590 msgr2=0x7ff3e019ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:28.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.945+0000 7ff3e539b700 1 --2- 172.21.15.8:0/594839727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3e0102590 0x7ff3e019ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:28.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.945+0000 7ff3e539b700 1 -- 172.21.15.8:0/594839727 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d8009d00 con 0x7ff3e0100a00 2023-08-11T12:22:28.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.945+0000 7ff3e539b700 1 --2- 172.21.15.8:0/594839727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3e0100a00 0x7ff3e01989d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00d980 tx=0x7ff3dc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:28.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.946+0000 7ff3d67fc700 1 -- 172.21.15.8:0/594839727 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc00b950 con 0x7ff3e0100a00 2023-08-11T12:22:28.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.946+0000 7ff3d67fc700 1 -- 172.21.15.8:0/594839727 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff3dc007620 con 0x7ff3e0100a00 2023-08-11T12:22:28.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.946+0000 7ff3e75ff700 1 -- 172.21.15.8:0/594839727 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3e01a0b00 con 0x7ff3e0100a00 2023-08-11T12:22:28.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.946+0000 7ff3d67fc700 1 -- 172.21.15.8:0/594839727 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc00f3c0 con 0x7ff3e0100a00 2023-08-11T12:22:28.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.946+0000 7ff3e75ff700 1 -- 172.21.15.8:0/594839727 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e01a1060 con 0x7ff3e0100a00 2023-08-11T12:22:28.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.947+0000 7ff3e75ff700 1 -- 172.21.15.8:0/594839727 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3e010c270 con 0x7ff3e0100a00 2023-08-11T12:22:28.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.949+0000 7ff3d67fc700 1 -- 172.21.15.8:0/594839727 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7ff3dc010640 con 0x7ff3e0100a00 2023-08-11T12:22:28.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.950+0000 7ff3d67fc700 1 --2- 172.21.15.8:0/594839727 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff3cc09ffd0 0x7ff3cc0a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:28.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.950+0000 7ff3d67fc700 1 -- 172.21.15.8:0/594839727 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8730+0+0 (secure 0 0 0) 0x7ff3dc0cb2c0 con 0x7ff3e0100a00 2023-08-11T12:22:28.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.950+0000 7ff3e4b9a700 1 --2- 172.21.15.8:0/594839727 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff3cc09ffd0 0x7ff3cc0a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:28.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.951+0000 7ff3e4b9a700 1 --2- 172.21.15.8:0/594839727 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff3cc09ffd0 0x7ff3cc0a2490 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0009be0 tx=0x7ff3d0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:28.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:28.954+0000 7ff3d67fc700 1 -- 172.21.15.8:0/594839727 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7ff3dc094e00 con 0x7ff3e0100a00 2023-08-11T12:22:29.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:28 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/916881352' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-08-11T12:22:29.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:28 smithi008 ceph-mon[97158]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-11T12:22:29.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:28 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3736595378' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-08-11T12:22:29.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:28 smithi008 ceph-mon[97158]: pgmap v286: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-08-11T12:22:29.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:28 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/916881352' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-08-11T12:22:29.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:28 smithi194 ceph-mon[130905]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-11T12:22:29.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:28 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3736595378' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-08-11T12:22:29.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:28 smithi194 ceph-mon[130905]: pgmap v286: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-08-11T12:22:29.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:28 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/916881352' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-08-11T12:22:29.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:28 smithi045 ceph-mon[130284]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-11T12:22:29.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:28 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3736595378' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-08-11T12:22:29.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:28 smithi045 ceph-mon[130284]: pgmap v286: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-08-11T12:22:29.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.210+0000 7ff3e75ff700 1 -- 172.21.15.8:0/594839727 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7ff3e010c4b0 con 0x7ff3e0100a00 2023-08-11T12:22:29.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.670+0000 7ff3d67fc700 1 -- 172.21.15.8:0/594839727 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7ff3dc098420 con 0x7ff3e0100a00 2023-08-11T12:22:29.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.673+0000 7ff3e75ff700 1 -- 172.21.15.8:0/594839727 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff3cc09ffd0 msgr2=0x7ff3cc0a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:29.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.673+0000 7ff3e75ff700 1 --2- 172.21.15.8:0/594839727 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff3cc09ffd0 0x7ff3cc0a2490 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0009be0 tx=0x7ff3d0009260 comp rx=0 tx=0).stop 2023-08-11T12:22:29.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.673+0000 7ff3e75ff700 1 -- 172.21.15.8:0/594839727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3e0100a00 msgr2=0x7ff3e01989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:29.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.673+0000 7ff3e75ff700 1 --2- 172.21.15.8:0/594839727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3e0100a00 0x7ff3e01989d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00d980 tx=0x7ff3dc00dc90 comp rx=0 tx=0).stop 2023-08-11T12:22:29.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.673+0000 7ff3e75ff700 1 -- 172.21.15.8:0/594839727 shutdown_connections 2023-08-11T12:22:29.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.673+0000 7ff3e75ff700 1 --2- 172.21.15.8:0/594839727 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff3cc09ffd0 0x7ff3cc0a2490 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:29.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.673+0000 7ff3e75ff700 1 --2- 172.21.15.8:0/594839727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3e0102590 0x7ff3e019ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:29.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.673+0000 7ff3e75ff700 1 --2- 172.21.15.8:0/594839727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3e0100a00 0x7ff3e01989d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:29.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.673+0000 7ff3e75ff700 1 --2- 172.21.15.8:0/594839727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3e0101bf0 0x7ff3e0198f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:29.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.673+0000 7ff3e75ff700 1 -- 172.21.15.8:0/594839727 >> 172.21.15.8:0/594839727 conn(0x7ff3e00fbf70 msgr2=0x7ff3e0107450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:29.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.674+0000 7ff3e75ff700 1 -- 172.21.15.8:0/594839727 shutdown_connections 2023-08-11T12:22:29.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.674+0000 7ff3e75ff700 1 -- 172.21.15.8:0/594839727 wait complete. 2023-08-11T12:22:29.701 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-08-11T12:22:29.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.908+0000 7fe93d1ff700 1 -- 172.21.15.8:0/1782027257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe938102590 msgr2=0x7fe938108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:29.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.908+0000 7fe93d1ff700 1 --2- 172.21.15.8:0/1782027257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe938102590 0x7fe938108e40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe93000b0d0 tx=0x7fe93000b3e0 comp rx=0 tx=0).stop 2023-08-11T12:22:29.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.909+0000 7fe93d1ff700 1 -- 172.21.15.8:0/1782027257 shutdown_connections 2023-08-11T12:22:29.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.909+0000 7fe93d1ff700 1 --2- 172.21.15.8:0/1782027257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe938102590 0x7fe938108e40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:29.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.909+0000 7fe93d1ff700 1 --2- 172.21.15.8:0/1782027257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe938100a00 0x7fe938100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:29.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.909+0000 7fe93d1ff700 1 --2- 172.21.15.8:0/1782027257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe938101bf0 0x7fe938102050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:29.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.909+0000 7fe93d1ff700 1 -- 172.21.15.8:0/1782027257 >> 172.21.15.8:0/1782027257 conn(0x7fe9380fbf70 msgr2=0x7fe9380fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:29.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.909+0000 7fe93d1ff700 1 -- 172.21.15.8:0/1782027257 shutdown_connections 2023-08-11T12:22:29.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.909+0000 7fe93d1ff700 1 -- 172.21.15.8:0/1782027257 wait complete. 2023-08-11T12:22:29.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.910+0000 7fe93d1ff700 1 Processor -- start 2023-08-11T12:22:29.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.910+0000 7fe93d1ff700 1 -- start start 2023-08-11T12:22:29.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.910+0000 7fe93d1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe938100a00 0x7fe9381989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:29.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.910+0000 7fe93d1ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe938101bf0 0x7fe938198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:29.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.910+0000 7fe93d1ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe938102590 0x7fe93819ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:29.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.910+0000 7fe93d1ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9381a0570 con 0x7fe938102590 2023-08-11T12:22:29.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.910+0000 7fe93d1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9381a06b0 con 0x7fe938100a00 2023-08-11T12:22:29.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.910+0000 7fe93d1ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9381a0840 con 0x7fe938101bf0 2023-08-11T12:22:29.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.910+0000 7fe93759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe938102590 0x7fe93819ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:29.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.911+0000 7fe936d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe938100a00 0x7fe9381989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:29.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.911+0000 7fe93759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe938102590 0x7fe93819ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50760/0 (socket says 172.21.15.8:50760) 2023-08-11T12:22:29.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.911+0000 7fe93759e700 1 -- 172.21.15.8:0/803497623 learned_addr learned my addr 172.21.15.8:0/803497623 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:29.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.911+0000 7fe93659c700 1 --2- 172.21.15.8:0/803497623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe938101bf0 0x7fe938198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:29.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.911+0000 7fe93759e700 1 -- 172.21.15.8:0/803497623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe938101bf0 msgr2=0x7fe938198f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:29.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.911+0000 7fe93759e700 1 --2- 172.21.15.8:0/803497623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe938101bf0 0x7fe938198f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:29.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.911+0000 7fe93759e700 1 -- 172.21.15.8:0/803497623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe938100a00 msgr2=0x7fe9381989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:29.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.911+0000 7fe93759e700 1 --2- 172.21.15.8:0/803497623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe938100a00 0x7fe9381989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:29.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.911+0000 7fe93759e700 1 -- 172.21.15.8:0/803497623 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe930009d00 con 0x7fe938102590 2023-08-11T12:22:29.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.911+0000 7fe93759e700 1 --2- 172.21.15.8:0/803497623 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe938102590 0x7fe93819ffa0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe930008eb0 tx=0x7fe930008ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:29.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.911+0000 7fe91ffff700 1 -- 172.21.15.8:0/803497623 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93000e040 con 0x7fe938102590 2023-08-11T12:22:29.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.911+0000 7fe93d1ff700 1 -- 172.21.15.8:0/803497623 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9381a0ac0 con 0x7fe938102590 2023-08-11T12:22:29.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.911+0000 7fe91ffff700 1 -- 172.21.15.8:0/803497623 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe93000bdb0 con 0x7fe938102590 2023-08-11T12:22:29.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.911+0000 7fe91ffff700 1 -- 172.21.15.8:0/803497623 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93001d470 con 0x7fe938102590 2023-08-11T12:22:29.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.912+0000 7fe93d1ff700 1 -- 172.21.15.8:0/803497623 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9381a0f40 con 0x7fe938102590 2023-08-11T12:22:29.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.913+0000 7fe93d1ff700 1 -- 172.21.15.8:0/803497623 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe93810c270 con 0x7fe938102590 2023-08-11T12:22:29.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.914+0000 7fe91ffff700 1 -- 172.21.15.8:0/803497623 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fe930005020 con 0x7fe938102590 2023-08-11T12:22:29.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.916+0000 7fe91ffff700 1 --2- 172.21.15.8:0/803497623 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe92009ff50 0x7fe9200a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:29.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.916+0000 7fe91ffff700 1 -- 172.21.15.8:0/803497623 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fe9300cc400 con 0x7fe938102590 2023-08-11T12:22:29.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.916+0000 7fe936d9d700 1 --2- 172.21.15.8:0/803497623 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe92009ff50 0x7fe9200a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:29.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.917+0000 7fe936d9d700 1 --2- 172.21.15.8:0/803497623 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe92009ff50 0x7fe9200a2410 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe938101a50 tx=0x7fe928009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:29.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:29.920+0000 7fe91ffff700 1 -- 172.21.15.8:0/803497623 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fe930095fd0 con 0x7fe938102590 2023-08-11T12:22:30.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:29 smithi008 ceph-mon[97158]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-08-11T12:22:30.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:29 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3736595378' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-08-11T12:22:30.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:29 smithi008 ceph-mon[97158]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-08-11T12:22:30.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:29 smithi008 ceph-mon[97158]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-11T12:22:30.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:29 smithi008 ceph-mon[97158]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-08-11T12:22:30.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:29 smithi008 ceph-mon[97158]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-08-11T12:22:30.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:29 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/594839727' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-08-11T12:22:30.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:29 smithi008 ceph-mon[97158]: mds.? [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] up:active 2023-08-11T12:22:30.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:29 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/594839727' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-08-11T12:22:30.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:29 smithi008 ceph-mon[97158]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-08-11T12:22:30.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:29 smithi008 ceph-mon[97158]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 2 up:standby-replay 8 up:standby 2023-08-11T12:22:30.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:29 smithi008 ceph-mon[97158]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:creating} 2 up:standby-replay 7 up:standby 2023-08-11T12:22:30.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:29 smithi008 ceph-mon[97158]: daemon mds.f is now active in filesystem cephfs as rank 2 2023-08-11T12:22:30.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:29 smithi194 ceph-mon[130905]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-08-11T12:22:30.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:29 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3736595378' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-08-11T12:22:30.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:29 smithi194 ceph-mon[130905]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-08-11T12:22:30.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:29 smithi194 ceph-mon[130905]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-11T12:22:30.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:29 smithi194 ceph-mon[130905]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-08-11T12:22:30.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:29 smithi194 ceph-mon[130905]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-08-11T12:22:30.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:29 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/594839727' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-08-11T12:22:30.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:29 smithi194 ceph-mon[130905]: mds.? [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] up:active 2023-08-11T12:22:30.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:29 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/594839727' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-08-11T12:22:30.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:29 smithi194 ceph-mon[130905]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-08-11T12:22:30.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:29 smithi194 ceph-mon[130905]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 2 up:standby-replay 8 up:standby 2023-08-11T12:22:30.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:29 smithi194 ceph-mon[130905]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:creating} 2 up:standby-replay 7 up:standby 2023-08-11T12:22:30.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:29 smithi194 ceph-mon[130905]: daemon mds.f is now active in filesystem cephfs as rank 2 2023-08-11T12:22:30.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:29 smithi045 ceph-mon[130284]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-08-11T12:22:30.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:29 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3736595378' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-08-11T12:22:30.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:29 smithi045 ceph-mon[130284]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-08-11T12:22:30.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:29 smithi045 ceph-mon[130284]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-11T12:22:30.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:29 smithi045 ceph-mon[130284]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-08-11T12:22:30.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:29 smithi045 ceph-mon[130284]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-08-11T12:22:30.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:29 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/594839727' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-08-11T12:22:30.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:29 smithi045 ceph-mon[130284]: mds.? [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] up:active 2023-08-11T12:22:30.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:29 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/594839727' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-08-11T12:22:30.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:29 smithi045 ceph-mon[130284]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-08-11T12:22:30.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:29 smithi045 ceph-mon[130284]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 2 up:standby-replay 8 up:standby 2023-08-11T12:22:30.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:29 smithi045 ceph-mon[130284]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:creating} 2 up:standby-replay 7 up:standby 2023-08-11T12:22:30.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:29 smithi045 ceph-mon[130284]: daemon mds.f is now active in filesystem cephfs as rank 2 2023-08-11T12:22:30.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.183+0000 7fe93d1ff700 1 -- 172.21.15.8:0/803497623 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fe9381a10d0 con 0x7fe938102590 2023-08-11T12:22:30.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.677+0000 7fe91ffff700 1 -- 172.21.15.8:0/803497623 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v22) v1 ==== 115+0+0 (secure 0 0 0) 0x7fe9300995f0 con 0x7fe938102590 2023-08-11T12:22:30.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.680+0000 7fe93d1ff700 1 -- 172.21.15.8:0/803497623 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe92009ff50 msgr2=0x7fe9200a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:30.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.680+0000 7fe93d1ff700 1 --2- 172.21.15.8:0/803497623 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe92009ff50 0x7fe9200a2410 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe938101a50 tx=0x7fe928009260 comp rx=0 tx=0).stop 2023-08-11T12:22:30.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.680+0000 7fe93d1ff700 1 -- 172.21.15.8:0/803497623 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe938102590 msgr2=0x7fe93819ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:30.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.680+0000 7fe93d1ff700 1 --2- 172.21.15.8:0/803497623 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe938102590 0x7fe93819ffa0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe930008eb0 tx=0x7fe930008ee0 comp rx=0 tx=0).stop 2023-08-11T12:22:30.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.680+0000 7fe93d1ff700 1 -- 172.21.15.8:0/803497623 shutdown_connections 2023-08-11T12:22:30.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.680+0000 7fe93d1ff700 1 --2- 172.21.15.8:0/803497623 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe92009ff50 0x7fe9200a2410 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:30.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.680+0000 7fe93d1ff700 1 --2- 172.21.15.8:0/803497623 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe938102590 0x7fe93819ffa0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:30.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.680+0000 7fe93d1ff700 1 --2- 172.21.15.8:0/803497623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe938100a00 0x7fe9381989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:30.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.680+0000 7fe93d1ff700 1 --2- 172.21.15.8:0/803497623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe938101bf0 0x7fe938198f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:30.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.680+0000 7fe93d1ff700 1 -- 172.21.15.8:0/803497623 >> 172.21.15.8:0/803497623 conn(0x7fe9380fbf70 msgr2=0x7fe938107450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:30.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.680+0000 7fe93d1ff700 1 -- 172.21.15.8:0/803497623 shutdown_connections 2023-08-11T12:22:30.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.680+0000 7fe93d1ff700 1 -- 172.21.15.8:0/803497623 wait complete. 2023-08-11T12:22:30.705 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-11T12:22:30.705 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-11T12:22:30.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.916+0000 7f2b227ff700 1 -- 172.21.15.8:0/2457303882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c1009e0 msgr2=0x7f2b1c100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:30.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.916+0000 7f2b227ff700 1 --2- 172.21.15.8:0/2457303882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c1009e0 0x7f2b1c100e00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c0099c0 tx=0x7f2b0c009cd0 comp rx=0 tx=0).stop 2023-08-11T12:22:30.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.916+0000 7f2b227ff700 1 -- 172.21.15.8:0/2457303882 shutdown_connections 2023-08-11T12:22:30.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.916+0000 7f2b227ff700 1 --2- 172.21.15.8:0/2457303882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b1c102570 0x7f2b1c108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:30.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.916+0000 7f2b227ff700 1 --2- 172.21.15.8:0/2457303882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c1009e0 0x7f2b1c100e00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:30.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.916+0000 7f2b227ff700 1 --2- 172.21.15.8:0/2457303882 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b1c101bd0 0x7f2b1c102030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:30.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.916+0000 7f2b227ff700 1 -- 172.21.15.8:0/2457303882 >> 172.21.15.8:0/2457303882 conn(0x7f2b1c0fbf50 msgr2=0x7f2b1c0fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:30.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.917+0000 7f2b227ff700 1 -- 172.21.15.8:0/2457303882 shutdown_connections 2023-08-11T12:22:30.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.917+0000 7f2b227ff700 1 -- 172.21.15.8:0/2457303882 wait complete. 2023-08-11T12:22:30.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.918+0000 7f2b227ff700 1 Processor -- start 2023-08-11T12:22:30.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.918+0000 7f2b227ff700 1 -- start start 2023-08-11T12:22:30.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.918+0000 7f2b227ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c1009e0 0x7f2b1c1966f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:30.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.918+0000 7f2b227ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b1c101bd0 0x7f2b1c196c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:30.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.918+0000 7f2b227ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b1c102570 0x7f2b1c19dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:30.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.918+0000 7f2b227ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c19e270 con 0x7f2b1c1009e0 2023-08-11T12:22:30.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.918+0000 7f2b227ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c19e3b0 con 0x7f2b1c102570 2023-08-11T12:22:30.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.918+0000 7f2b227ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c19e540 con 0x7f2b1c101bd0 2023-08-11T12:22:30.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.918+0000 7f2b1bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c1009e0 0x7f2b1c1966f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:30.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.918+0000 7f2b1bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c1009e0 0x7f2b1c1966f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50778/0 (socket says 172.21.15.8:50778) 2023-08-11T12:22:30.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.918+0000 7f2b1bfff700 1 -- 172.21.15.8:0/2514839218 learned_addr learned my addr 172.21.15.8:0/2514839218 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:30.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.918+0000 7f2b20d9c700 1 --2- 172.21.15.8:0/2514839218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b1c102570 0x7f2b1c19dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:30.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.919+0000 7f2b1b7fe700 1 --2- 172.21.15.8:0/2514839218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b1c101bd0 0x7f2b1c196c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:30.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.919+0000 7f2b1bfff700 1 -- 172.21.15.8:0/2514839218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b1c101bd0 msgr2=0x7f2b1c196c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:30.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.919+0000 7f2b1bfff700 1 --2- 172.21.15.8:0/2514839218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b1c101bd0 0x7f2b1c196c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:30.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.919+0000 7f2b1bfff700 1 -- 172.21.15.8:0/2514839218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b1c102570 msgr2=0x7f2b1c19dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:30.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.919+0000 7f2b1bfff700 1 --2- 172.21.15.8:0/2514839218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b1c102570 0x7f2b1c19dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:30.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.919+0000 7f2b1bfff700 1 -- 172.21.15.8:0/2514839218 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0c0095f0 con 0x7f2b1c1009e0 2023-08-11T12:22:30.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.919+0000 7f2b20d9c700 1 --2- 172.21.15.8:0/2514839218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b1c102570 0x7f2b1c19dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:22:30.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.919+0000 7f2b1bfff700 1 --2- 172.21.15.8:0/2514839218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c1009e0 0x7f2b1c1966f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c009fd0 tx=0x7f2b0c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:30.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.919+0000 7f2b197fa700 1 -- 172.21.15.8:0/2514839218 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c01d070 con 0x7f2b1c1009e0 2023-08-11T12:22:30.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.919+0000 7f2b197fa700 1 -- 172.21.15.8:0/2514839218 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b0c005050 con 0x7f2b1c1009e0 2023-08-11T12:22:30.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.919+0000 7f2b197fa700 1 -- 172.21.15.8:0/2514839218 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c004a70 con 0x7f2b1c1009e0 2023-08-11T12:22:30.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.919+0000 7f2b227ff700 1 -- 172.21.15.8:0/2514839218 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b1c19e7c0 con 0x7f2b1c1009e0 2023-08-11T12:22:30.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.920+0000 7f2b227ff700 1 -- 172.21.15.8:0/2514839218 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b1c19eb90 con 0x7f2b1c1009e0 2023-08-11T12:22:30.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.921+0000 7f2b227ff700 1 -- 172.21.15.8:0/2514839218 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b1c107f70 con 0x7f2b1c1009e0 2023-08-11T12:22:30.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.923+0000 7f2b197fa700 1 -- 172.21.15.8:0/2514839218 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f2b0c005450 con 0x7f2b1c1009e0 2023-08-11T12:22:30.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.924+0000 7f2b197fa700 1 --2- 172.21.15.8:0/2514839218 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f2b0409ffd0 0x7f2b040a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:30.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.924+0000 7f2b197fa700 1 -- 172.21.15.8:0/2514839218 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f2b0c0cc2f0 con 0x7f2b1c1009e0 2023-08-11T12:22:30.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.924+0000 7f2b1b7fe700 1 --2- 172.21.15.8:0/2514839218 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f2b0409ffd0 0x7f2b040a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:30.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.925+0000 7f2b1b7fe700 1 --2- 172.21.15.8:0/2514839218 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f2b0409ffd0 0x7f2b040a2490 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2b10009c60 tx=0x7f2b10009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:30.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:30.928+0000 7f2b197fa700 1 -- 172.21.15.8:0/2514839218 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f2b0c095da0 con 0x7f2b1c1009e0 2023-08-11T12:22:31.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:30 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/803497623' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-08-11T12:22:31.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:30 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2023-08-11T12:22:31.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:30 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2023-08-11T12:22:31.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:30 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2023-08-11T12:22:31.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:30 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2023-08-11T12:22:31.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:30 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2023-08-11T12:22:31.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:30 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2023-08-11T12:22:31.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:30 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.11", "id": [5, 8]}]: dispatch 2023-08-11T12:22:31.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:30 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]: dispatch 2023-08-11T12:22:31.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:30 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2023-08-11T12:22:31.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:30 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]: dispatch 2023-08-11T12:22:31.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:30 smithi008 ceph-mon[97158]: pgmap v287: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s rd, 1.2 KiB/s wr, 2 op/s 2023-08-11T12:22:31.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:30 smithi008 ceph-mon[97158]: mds.? [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] up:active 2023-08-11T12:22:31.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:30 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/803497623' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-08-11T12:22:31.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:30 smithi008 ceph-mon[97158]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-08-11T12:22:31.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:30 smithi008 ceph-mon[97158]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2023-08-11T12:22:31.056 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:30 smithi008 ceph-mon[97158]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:creating} 2 up:standby-replay 6 up:standby 2023-08-11T12:22:31.056 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:30 smithi008 ceph-mon[97158]: daemon mds.e is now active in filesystem cephfs as rank 3 2023-08-11T12:22:31.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:30 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/803497623' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-08-11T12:22:31.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:30 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2023-08-11T12:22:31.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:30 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2023-08-11T12:22:31.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:30 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2023-08-11T12:22:31.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:30 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2023-08-11T12:22:31.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:30 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2023-08-11T12:22:31.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:30 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2023-08-11T12:22:31.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:30 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.11", "id": [5, 8]}]: dispatch 2023-08-11T12:22:31.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:30 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]: dispatch 2023-08-11T12:22:31.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:30 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2023-08-11T12:22:31.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:30 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]: dispatch 2023-08-11T12:22:31.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:30 smithi194 ceph-mon[130905]: pgmap v287: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s rd, 1.2 KiB/s wr, 2 op/s 2023-08-11T12:22:31.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:30 smithi194 ceph-mon[130905]: mds.? [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] up:active 2023-08-11T12:22:31.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:30 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/803497623' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-08-11T12:22:31.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:30 smithi194 ceph-mon[130905]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-08-11T12:22:31.146 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:30 smithi194 ceph-mon[130905]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2023-08-11T12:22:31.146 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:30 smithi194 ceph-mon[130905]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:creating} 2 up:standby-replay 6 up:standby 2023-08-11T12:22:31.146 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:30 smithi194 ceph-mon[130905]: daemon mds.e is now active in filesystem cephfs as rank 3 2023-08-11T12:22:31.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:30 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/803497623' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-08-11T12:22:31.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:30 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2023-08-11T12:22:31.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:30 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2023-08-11T12:22:31.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:30 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2023-08-11T12:22:31.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:30 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2023-08-11T12:22:31.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:30 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2023-08-11T12:22:31.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:30 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2023-08-11T12:22:31.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:30 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.11", "id": [5, 8]}]: dispatch 2023-08-11T12:22:31.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:30 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]: dispatch 2023-08-11T12:22:31.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:30 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2023-08-11T12:22:31.148 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:30 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]: dispatch 2023-08-11T12:22:31.148 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:30 smithi045 ceph-mon[130284]: pgmap v287: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s rd, 1.2 KiB/s wr, 2 op/s 2023-08-11T12:22:31.148 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:30 smithi045 ceph-mon[130284]: mds.? [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] up:active 2023-08-11T12:22:31.148 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:30 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/803497623' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-08-11T12:22:31.148 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:30 smithi045 ceph-mon[130284]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-08-11T12:22:31.148 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:30 smithi045 ceph-mon[130284]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2023-08-11T12:22:31.149 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:30 smithi045 ceph-mon[130284]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:creating} 2 up:standby-replay 6 up:standby 2023-08-11T12:22:31.149 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:30 smithi045 ceph-mon[130284]: daemon mds.e is now active in filesystem cephfs as rank 3 2023-08-11T12:22:31.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.187+0000 7f2b227ff700 1 -- 172.21.15.8:0/2514839218 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b1c10c240 con 0x7f2b1c1009e0 2023-08-11T12:22:31.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.188+0000 7f2b197fa700 1 -- 172.21.15.8:0/2514839218 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11312 (secure 0 0 0) 0x7f2b0c0993c0 con 0x7f2b1c1009e0 2023-08-11T12:22:31.190 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:22:31.190 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14469,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2854286216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2854286216},{"type":"v1","addr":"172.21.15.8:6835","nonce":2854286216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/805368621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":805368621},{"type":"v1","addr":"172.21.15.8:6837","nonce":805368621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14526,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/2990530720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":2990530720},{"type":"v1","addr":"172.21.15.8:6839","nonce":2990530720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14538,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/3589272762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":3589272762},{"type":"v1","addr":"172.21.15.8:6841","nonce":3589272762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2043443402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2043443402},{"type":"v1","addr":"172.21.15.194:6833","nonce":2043443402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1208864615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1208864615},{"type":"v1","addr":"172.21.15.45:6833","nonce":1208864615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-11T12:22:03.398475+0000","modified":"2023-08-11T12:22:30.677457+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3],"up":{"mds_0":24575,"mds_1":24550,"mds_2":24517,"mds_3":24500},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24500":{"gid":24500,"name":"e","rank":3,"incarnation":23,"state":"up:creating","state_seq":1,"addr":"172.21.15.45:6835/1776075470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1776075470},{"type":"v1","addr":"172.21.15.45:6835","nonce":1776075470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24517":{"gid":24517,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.194:6835/2457430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2457430285},{"type":"v1","addr":"172.21.15.194:6835","nonce":2457430285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24529":{"gid":24529,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/3072808560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":3072808560},{"type":"v1","addr":"172.21.15.194:6837","nonce":3072808560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/641549061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":641549061},{"type":"v1","addr":"172.21.15.45:6837","nonce":641549061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.194:6839/2174476491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":2174476491},{"type":"v1","addr":"172.21.15.194:6839","nonce":2174476491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6839/119684732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":119684732},{"type":"v1","addr":"172.21.15.45:6839","nonce":119684732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-11T12:22:31.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.190+0000 7f2b227ff700 1 -- 172.21.15.8:0/2514839218 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f2b0409ffd0 msgr2=0x7f2b040a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:31.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.190+0000 7f2b227ff700 1 --2- 172.21.15.8:0/2514839218 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f2b0409ffd0 0x7f2b040a2490 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2b10009c60 tx=0x7f2b10009260 comp rx=0 tx=0).stop 2023-08-11T12:22:31.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.190+0000 7f2b227ff700 1 -- 172.21.15.8:0/2514839218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c1009e0 msgr2=0x7f2b1c1966f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:31.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.190+0000 7f2b227ff700 1 --2- 172.21.15.8:0/2514839218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c1009e0 0x7f2b1c1966f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c009fd0 tx=0x7f2b0c00f690 comp rx=0 tx=0).stop 2023-08-11T12:22:31.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.190+0000 7f2b227ff700 1 -- 172.21.15.8:0/2514839218 shutdown_connections 2023-08-11T12:22:31.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.190+0000 7f2b227ff700 1 --2- 172.21.15.8:0/2514839218 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f2b0409ffd0 0x7f2b040a2490 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:31.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.190+0000 7f2b227ff700 1 --2- 172.21.15.8:0/2514839218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b1c102570 0x7f2b1c19dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:31.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.190+0000 7f2b227ff700 1 --2- 172.21.15.8:0/2514839218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c1009e0 0x7f2b1c1966f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:31.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.190+0000 7f2b227ff700 1 --2- 172.21.15.8:0/2514839218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b1c101bd0 0x7f2b1c196c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:31.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.190+0000 7f2b227ff700 1 -- 172.21.15.8:0/2514839218 >> 172.21.15.8:0/2514839218 conn(0x7f2b1c0fbf50 msgr2=0x7f2b1c1050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:31.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.190+0000 7f2b227ff700 1 -- 172.21.15.8:0/2514839218 shutdown_connections 2023-08-11T12:22:31.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.191+0000 7f2b227ff700 1 -- 172.21.15.8:0/2514839218 wait complete. 2023-08-11T12:22:31.194 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 23 2023-08-11T12:22:31.211 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-11T12:22:31.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.413+0000 7f448e9ff700 1 -- 172.21.15.8:0/3144202810 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44881088a0 msgr2=0x7f448810ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:31.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.413+0000 7f448e9ff700 1 --2- 172.21.15.8:0/3144202810 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44881088a0 0x7f448810ad30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f448000b0a0 tx=0x7f448000b3b0 comp rx=0 tx=0).stop 2023-08-11T12:22:31.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.413+0000 7f448e9ff700 1 -- 172.21.15.8:0/3144202810 shutdown_connections 2023-08-11T12:22:31.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.413+0000 7f448e9ff700 1 --2- 172.21.15.8:0/3144202810 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44881088a0 0x7f448810ad30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:31.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.413+0000 7f448e9ff700 1 --2- 172.21.15.8:0/3144202810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4488074960 0x7f4488072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:31.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.413+0000 7f448e9ff700 1 --2- 172.21.15.8:0/3144202810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4488073380 0x7f4488073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:31.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.413+0000 7f448e9ff700 1 -- 172.21.15.8:0/3144202810 >> 172.21.15.8:0/3144202810 conn(0x7f44880fbf50 msgr2=0x7f44880fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:31.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.413+0000 7f448e9ff700 1 -- 172.21.15.8:0/3144202810 shutdown_connections 2023-08-11T12:22:31.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.413+0000 7f448e9ff700 1 -- 172.21.15.8:0/3144202810 wait complete. 2023-08-11T12:22:31.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.414+0000 7f448e9ff700 1 Processor -- start 2023-08-11T12:22:31.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.414+0000 7f448e9ff700 1 -- start start 2023-08-11T12:22:31.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.414+0000 7f448e9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4488073380 0x7f4488198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:31.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.415+0000 7f448e9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4488074960 0x7f4488198fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:31.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.415+0000 7f448e9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44881088a0 0x7f44881a0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:31.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.415+0000 7f448e9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44881a0620 con 0x7f4488073380 2023-08-11T12:22:31.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.415+0000 7f448e9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44881a0760 con 0x7f4488074960 2023-08-11T12:22:31.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.415+0000 7f448e9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44881a08f0 con 0x7f44881088a0 2023-08-11T12:22:31.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.415+0000 7f4487fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4488073380 0x7f4488198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:31.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.415+0000 7f4487fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4488073380 0x7f4488198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50806/0 (socket says 172.21.15.8:50806) 2023-08-11T12:22:31.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.415+0000 7f4487fff700 1 -- 172.21.15.8:0/3834049020 learned_addr learned my addr 172.21.15.8:0/3834049020 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:31.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.415+0000 7f448cf9c700 1 --2- 172.21.15.8:0/3834049020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44881088a0 0x7f44881a0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:31.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.415+0000 7f44877fe700 1 --2- 172.21.15.8:0/3834049020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4488074960 0x7f4488198fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:31.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.415+0000 7f4487fff700 1 -- 172.21.15.8:0/3834049020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44881088a0 msgr2=0x7f44881a0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:31.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.415+0000 7f4487fff700 1 --2- 172.21.15.8:0/3834049020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44881088a0 0x7f44881a0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:31.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.415+0000 7f4487fff700 1 -- 172.21.15.8:0/3834049020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4488074960 msgr2=0x7f4488198fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:31.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.415+0000 7f4487fff700 1 --2- 172.21.15.8:0/3834049020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4488074960 0x7f4488198fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:31.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.415+0000 7f4487fff700 1 -- 172.21.15.8:0/3834049020 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4478009520 con 0x7f4488073380 2023-08-11T12:22:31.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.415+0000 7f448cf9c700 1 --2- 172.21.15.8:0/3834049020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44881088a0 0x7f44881a0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:22:31.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.416+0000 7f4487fff700 1 --2- 172.21.15.8:0/3834049020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4488073380 0x7f4488198aa0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f447800eb30 tx=0x7f447800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:31.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.416+0000 7f44857fa700 1 -- 172.21.15.8:0/3834049020 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4478009880 con 0x7f4488073380 2023-08-11T12:22:31.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.416+0000 7f448e9ff700 1 -- 172.21.15.8:0/3834049020 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4480009d00 con 0x7f4488073380 2023-08-11T12:22:31.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.416+0000 7f44857fa700 1 -- 172.21.15.8:0/3834049020 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f44780044e0 con 0x7f4488073380 2023-08-11T12:22:31.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.416+0000 7f44857fa700 1 -- 172.21.15.8:0/3834049020 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4478003e90 con 0x7f4488073380 2023-08-11T12:22:31.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.416+0000 7f448e9ff700 1 -- 172.21.15.8:0/3834049020 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44881a0fa0 con 0x7f4488073380 2023-08-11T12:22:31.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.417+0000 7f448e9ff700 1 -- 172.21.15.8:0/3834049020 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4488106f50 con 0x7f4488073380 2023-08-11T12:22:31.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.419+0000 7f44857fa700 1 -- 172.21.15.8:0/3834049020 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f4478004000 con 0x7f4488073380 2023-08-11T12:22:31.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.420+0000 7f44857fa700 1 --2- 172.21.15.8:0/3834049020 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f447009ff50 0x7f44700a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:31.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.420+0000 7f44857fa700 1 -- 172.21.15.8:0/3834049020 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f4478014070 con 0x7f4488073380 2023-08-11T12:22:31.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.421+0000 7f44877fe700 1 --2- 172.21.15.8:0/3834049020 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f447009ff50 0x7f44700a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:31.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.421+0000 7f44877fe700 1 --2- 172.21.15.8:0/3834049020 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f447009ff50 0x7f44700a2410 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4488074680 tx=0x7f447c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:31.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.424+0000 7f44857fa700 1 -- 172.21.15.8:0/3834049020 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f44780953a0 con 0x7f4488073380 2023-08-11T12:22:31.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.638+0000 7f448e9ff700 1 -- 172.21.15.8:0/3834049020 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44881a0bd0 con 0x7f4488073380 2023-08-11T12:22:31.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.640+0000 7f44857fa700 1 -- 172.21.15.8:0/3834049020 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+24348 (secure 0 0 0) 0x7f44881a0bd0 con 0x7f4488073380 2023-08-11T12:22:31.642 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:22:31.642 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":88,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","created":"2023-08-11T12:14:28.341113+0000","modified":"2023-08-11T12:22:30.708045+0000","last_up_change":"2023-08-11T12:21:14.913735+0000","last_in_change":"2023-08-11T12:20:57.476558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-11T12:17:49.040758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-11T12:22:01.383296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-11T12:22:02.816329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-11T12:22:06.369375+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f903e393-7894-42d6-8b11-737ceef1f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6803","nonce":664104961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6805","nonce":664104961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6809","nonce":664104961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6807","nonce":664104961}]},"public_addr":"172.21.15.8:6803/664104961","cluster_addr":"172.21.15.8:6805/664104961","heartbeat_back_addr":"172.21.15.8:6809/664104961","heartbeat_front_addr":"172.21.15.8:6807/664104961","state":["exists","up"]},{"osd":1,"uuid":"1e988e5c-e78c-46d5-80a5-dff7ac38cbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6801","nonce":4187350703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6803","nonce":4187350703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6807","nonce":4187350703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6805","nonce":4187350703}]},"public_addr":"172.21.15.45:6801/4187350703","cluster_addr":"172.21.15.45:6803/4187350703","heartbeat_back_addr":"172.21.15.45:6807/4187350703","heartbeat_front_addr":"172.21.15.45:6805/4187350703","state":["exists","up"]},{"osd":2,"uuid":"1835217c-a93c-4181-b8b8-cc410bab1a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6801","nonce":2547818140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6803","nonce":2547818140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6807","nonce":2547818140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6805","nonce":2547818140}]},"public_addr":"172.21.15.194:6801/2547818140","cluster_addr":"172.21.15.194:6803/2547818140","heartbeat_back_addr":"172.21.15.194:6807/2547818140","heartbeat_front_addr":"172.21.15.194:6805/2547818140","state":["exists","up"]},{"osd":3,"uuid":"b55ae61a-731c-4312-a998-661122b84788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6811","nonce":187418883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6813","nonce":187418883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6817","nonce":187418883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6815","nonce":187418883}]},"public_addr":"172.21.15.8:6811/187418883","cluster_addr":"172.21.15.8:6813/187418883","heartbeat_back_addr":"172.21.15.8:6817/187418883","heartbeat_front_addr":"172.21.15.8:6815/187418883","state":["exists","up"]},{"osd":4,"uuid":"2c28acbb-e807-4559-8aa2-a35ca84b5d43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6809","nonce":3099704571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6811","nonce":3099704571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6815","nonce":3099704571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6813","nonce":3099704571}]},"public_addr":"172.21.15.45:6809/3099704571","cluster_addr":"172.21.15.45:6811/3099704571","heartbeat_back_addr":"172.21.15.45:6815/3099704571","heartbeat_front_addr":"172.21.15.45:6813/3099704571","state":["exists","up"]},{"osd":5,"uuid":"37032289-8016-4730-9b69-f7985e058ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6809","nonce":263803874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6811","nonce":263803874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6815","nonce":263803874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6813","nonce":263803874}]},"public_addr":"172.21.15.194:6809/263803874","cluster_addr":"172.21.15.194:6811/263803874","heartbeat_back_addr":"172.21.15.194:6815/263803874","heartbeat_front_addr":"172.21.15.194:6813/263803874","state":["exists","up"]},{"osd":6,"uuid":"32d2dab9-6944-40d1-ada9-4f941821b063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6819","nonce":1802966829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6821","nonce":1802966829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6825","nonce":1802966829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6823","nonce":1802966829}]},"public_addr":"172.21.15.8:6819/1802966829","cluster_addr":"172.21.15.8:6821/1802966829","heartbeat_back_addr":"172.21.15.8:6825/1802966829","heartbeat_front_addr":"172.21.15.8:6823/1802966829","state":["exists","up"]},{"osd":7,"uuid":"086aff58-1554-49fe-92ff-5166b115aeef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6817","nonce":3715737148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6819","nonce":3715737148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6823","nonce":3715737148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6821","nonce":3715737148}]},"public_addr":"172.21.15.45:6817/3715737148","cluster_addr":"172.21.15.45:6819/3715737148","heartbeat_back_addr":"172.21.15.45:6823/3715737148","heartbeat_front_addr":"172.21.15.45:6821/3715737148","state":["exists","up"]},{"osd":8,"uuid":"7fff5e95-2453-4ea6-a5c1-3bba6a1f6400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6817","nonce":57497127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6819","nonce":57497127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6823","nonce":57497127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6821","nonce":57497127}]},"public_addr":"172.21.15.194:6817/57497127","cluster_addr":"172.21.15.194:6819/57497127","heartbeat_back_addr":"172.21.15.194:6823/57497127","heartbeat_front_addr":"172.21.15.194:6821/57497127","state":["exists","up"]},{"osd":9,"uuid":"31ab0121-4c92-42ec-9f19-e672062e8814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6827","nonce":434661930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6829","nonce":434661930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6833","nonce":434661930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6831","nonce":434661930}]},"public_addr":"172.21.15.8:6827/434661930","cluster_addr":"172.21.15.8:6829/434661930","heartbeat_back_addr":"172.21.15.8:6833/434661930","heartbeat_front_addr":"172.21.15.8:6831/434661930","state":["exists","up"]},{"osd":10,"uuid":"62c632e4-94f6-4630-9d94-8d28fccacf45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6825","nonce":3281212184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6827","nonce":3281212184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6831","nonce":3281212184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6829","nonce":3281212184}]},"public_addr":"172.21.15.45:6825/3281212184","cluster_addr":"172.21.15.45:6827/3281212184","heartbeat_back_addr":"172.21.15.45:6831/3281212184","heartbeat_front_addr":"172.21.15.45:6829/3281212184","state":["exists","up"]},{"osd":11,"uuid":"8ca4a80d-cd75-4230-b46d-aef6fdc03e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6825","nonce":1637875895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6827","nonce":1637875895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6831","nonce":1637875895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6829","nonce":1637875895}]},"public_addr":"172.21.15.194:6825/1637875895","cluster_addr":"172.21.15.194:6827/1637875895","heartbeat_back_addr":"172.21.15.194:6831/1637875895","heartbeat_front_addr":"172.21.15.194:6829/1637875895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:04.255616+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:26.243863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:46.630365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:12.926291+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:35.747049+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:55.793767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:21.685725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:43.703215+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:04.043674+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:30.320026+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:52.751974+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:21:13.230024+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/2000592056":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2102228072":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2374527928":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2928221278":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2744750874":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/3681755887":"2023-08-12T12:15:02.528403+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-11T12:22:31.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.642+0000 7f448e9ff700 1 -- 172.21.15.8:0/3834049020 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f447009ff50 msgr2=0x7f44700a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:31.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.642+0000 7f448e9ff700 1 --2- 172.21.15.8:0/3834049020 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f447009ff50 0x7f44700a2410 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4488074680 tx=0x7f447c009260 comp rx=0 tx=0).stop 2023-08-11T12:22:31.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.642+0000 7f448e9ff700 1 -- 172.21.15.8:0/3834049020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4488073380 msgr2=0x7f4488198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:31.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.642+0000 7f448e9ff700 1 --2- 172.21.15.8:0/3834049020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4488073380 0x7f4488198aa0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f447800eb30 tx=0x7f447800ee40 comp rx=0 tx=0).stop 2023-08-11T12:22:31.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.642+0000 7f448e9ff700 1 -- 172.21.15.8:0/3834049020 shutdown_connections 2023-08-11T12:22:31.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.642+0000 7f448e9ff700 1 --2- 172.21.15.8:0/3834049020 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f447009ff50 0x7f44700a2410 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:31.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.642+0000 7f448e9ff700 1 --2- 172.21.15.8:0/3834049020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44881088a0 0x7f44881a0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:31.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.642+0000 7f448e9ff700 1 --2- 172.21.15.8:0/3834049020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4488073380 0x7f4488198aa0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:31.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.642+0000 7f448e9ff700 1 --2- 172.21.15.8:0/3834049020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4488074960 0x7f4488198fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:31.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.642+0000 7f448e9ff700 1 -- 172.21.15.8:0/3834049020 >> 172.21.15.8:0/3834049020 conn(0x7f44880fbf50 msgr2=0x7f44880fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:31.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.642+0000 7f448e9ff700 1 -- 172.21.15.8:0/3834049020 shutdown_connections 2023-08-11T12:22:31.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.642+0000 7f448e9ff700 1 -- 172.21.15.8:0/3834049020 wait complete. 2023-08-11T12:22:31.663 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-11T12:22:31.664 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-11T12:22:31.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.880+0000 7faf845ff700 1 -- 172.21.15.8:0/3866609925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf7c101bd0 msgr2=0x7faf7c102030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:31.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.880+0000 7faf845ff700 1 --2- 172.21.15.8:0/3866609925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf7c101bd0 0x7faf7c102030 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7faf6c0099c0 tx=0x7faf6c009cd0 comp rx=0 tx=0).stop 2023-08-11T12:22:31.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.880+0000 7faf845ff700 1 -- 172.21.15.8:0/3866609925 shutdown_connections 2023-08-11T12:22:31.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.880+0000 7faf845ff700 1 --2- 172.21.15.8:0/3866609925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf7c1009e0 0x7faf7c100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:31.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.880+0000 7faf845ff700 1 --2- 172.21.15.8:0/3866609925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf7c102570 0x7faf7c108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:31.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.880+0000 7faf845ff700 1 --2- 172.21.15.8:0/3866609925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf7c101bd0 0x7faf7c102030 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:31.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.880+0000 7faf845ff700 1 -- 172.21.15.8:0/3866609925 >> 172.21.15.8:0/3866609925 conn(0x7faf7c0fbf50 msgr2=0x7faf7c0fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:31.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.881+0000 7faf845ff700 1 -- 172.21.15.8:0/3866609925 shutdown_connections 2023-08-11T12:22:31.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.881+0000 7faf845ff700 1 -- 172.21.15.8:0/3866609925 wait complete. 2023-08-11T12:22:31.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.882+0000 7faf845ff700 1 Processor -- start 2023-08-11T12:22:31.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.882+0000 7faf845ff700 1 -- start start 2023-08-11T12:22:31.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.882+0000 7faf845ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf7c1009e0 0x7faf7c1988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:31.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.882+0000 7faf845ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf7c101bd0 0x7faf7c198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:31.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.882+0000 7faf845ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf7c102570 0x7faf7c19fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:31.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.882+0000 7faf845ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c1a0460 con 0x7faf7c102570 2023-08-11T12:22:31.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.882+0000 7faf845ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c1a05a0 con 0x7faf7c101bd0 2023-08-11T12:22:31.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.882+0000 7faf845ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c1a0730 con 0x7faf7c1009e0 2023-08-11T12:22:31.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.882+0000 7faf8239b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf7c1009e0 0x7faf7c1988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:31.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.882+0000 7faf81b9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf7c101bd0 0x7faf7c198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:31.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.882+0000 7faf8239b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf7c1009e0 0x7faf7c1988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:44848/0 (socket says 172.21.15.8:44848) 2023-08-11T12:22:31.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.882+0000 7faf8239b700 1 -- 172.21.15.8:0/2394174548 learned_addr learned my addr 172.21.15.8:0/2394174548 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:31.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.883+0000 7faf82b9c700 1 --2- 172.21.15.8:0/2394174548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf7c102570 0x7faf7c19fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:31.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.883+0000 7faf8239b700 1 -- 172.21.15.8:0/2394174548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf7c101bd0 msgr2=0x7faf7c198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:31.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.883+0000 7faf8239b700 1 --2- 172.21.15.8:0/2394174548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf7c101bd0 0x7faf7c198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:31.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.883+0000 7faf8239b700 1 -- 172.21.15.8:0/2394174548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf7c102570 msgr2=0x7faf7c19fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:31.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.883+0000 7faf8239b700 1 --2- 172.21.15.8:0/2394174548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf7c102570 0x7faf7c19fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:31.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.883+0000 7faf8239b700 1 -- 172.21.15.8:0/2394174548 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6c0095f0 con 0x7faf7c1009e0 2023-08-11T12:22:31.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.883+0000 7faf81b9a700 1 --2- 172.21.15.8:0/2394174548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf7c101bd0 0x7faf7c198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:22:31.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.883+0000 7faf8239b700 1 --2- 172.21.15.8:0/2394174548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf7c1009e0 0x7faf7c1988e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faf7800d980 tx=0x7faf7800dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:31.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.883+0000 7faf737fe700 1 -- 172.21.15.8:0/2394174548 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf78004020 con 0x7faf7c1009e0 2023-08-11T12:22:31.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.884+0000 7faf845ff700 1 -- 172.21.15.8:0/2394174548 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf7c1a0a10 con 0x7faf7c1009e0 2023-08-11T12:22:31.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.884+0000 7faf737fe700 1 -- 172.21.15.8:0/2394174548 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf7800f690 con 0x7faf7c1009e0 2023-08-11T12:22:31.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.884+0000 7faf737fe700 1 -- 172.21.15.8:0/2394174548 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf78003a60 con 0x7faf7c1009e0 2023-08-11T12:22:31.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.884+0000 7faf845ff700 1 -- 172.21.15.8:0/2394174548 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7c1a0f70 con 0x7faf7c1009e0 2023-08-11T12:22:31.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.885+0000 7faf845ff700 1 -- 172.21.15.8:0/2394174548 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7c0732d0 con 0x7faf7c1009e0 2023-08-11T12:22:31.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.887+0000 7faf737fe700 1 -- 172.21.15.8:0/2394174548 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7faf7800fb00 con 0x7faf7c1009e0 2023-08-11T12:22:31.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.889+0000 7faf737fe700 1 --2- 172.21.15.8:0/2394174548 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7faf6809ff50 0x7faf680a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:31.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.889+0000 7faf737fe700 1 -- 172.21.15.8:0/2394174548 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7faf780cb480 con 0x7faf7c1009e0 2023-08-11T12:22:31.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.889+0000 7faf81b9a700 1 --2- 172.21.15.8:0/2394174548 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7faf6809ff50 0x7faf680a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:31.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.890+0000 7faf81b9a700 1 --2- 172.21.15.8:0/2394174548 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7faf6809ff50 0x7faf680a2410 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00b580 tx=0x7faf6c005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:31.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:31.891+0000 7faf737fe700 1 -- 172.21.15.8:0/2394174548 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7faf78094ea0 con 0x7faf7c1009e0 2023-08-11T12:22:32.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:31 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2023-08-11T12:22:32.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:31 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2023-08-11T12:22:32.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:31 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2023-08-11T12:22:32.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:31 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2023-08-11T12:22:32.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:31 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2023-08-11T12:22:32.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:31 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2023-08-11T12:22:32.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:31 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.11", "id": [5, 8]}]': finished 2023-08-11T12:22:32.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:31 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2023-08-11T12:22:32.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:31 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2023-08-11T12:22:32.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:31 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]': finished 2023-08-11T12:22:32.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:31 smithi008 ceph-mon[97158]: osdmap e88: 12 total, 12 up, 12 in 2023-08-11T12:22:32.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:31 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2514839218' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:22:32.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:31 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3834049020' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:32.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:31 smithi008 ceph-mon[97158]: mds.? [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] up:active 2023-08-11T12:22:32.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:31 smithi008 ceph-mon[97158]: daemon mds.k assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-08-11T12:22:32.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:31 smithi008 ceph-mon[97158]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-08-11T12:22:32.056 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:31 smithi008 ceph-mon[97158]: Cluster is now healthy 2023-08-11T12:22:32.056 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:31 smithi008 ceph-mon[97158]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:active} 2 up:standby-replay 6 up:standby 2023-08-11T12:22:32.056 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:31 smithi008 ceph-mon[97158]: fsmap cephfs:5 2 up:standby-replay 1 up:creating 5 up:standby 4 up:active 2023-08-11T12:22:32.056 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:31 smithi008 ceph-mon[97158]: daemon mds.k is now active in filesystem cephfs as rank 4 2023-08-11T12:22:32.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.097+0000 7faf845ff700 1 -- 172.21.15.8:0/2394174548 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faf7c1a11c0 con 0x7faf6809ff50 2023-08-11T12:22:32.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.113+0000 7faf737fe700 1 -- 172.21.15.8:0/2394174548 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+422497 (secure 0 0 0) 0x7faf7c1a11c0 con 0x7faf6809ff50 2023-08-11T12:22:32.122 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:22:32.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.118+0000 7faf845ff700 1 -- 172.21.15.8:0/2394174548 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7faf6809ff50 msgr2=0x7faf680a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:32.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.118+0000 7faf845ff700 1 --2- 172.21.15.8:0/2394174548 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7faf6809ff50 0x7faf680a2410 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00b580 tx=0x7faf6c005fb0 comp rx=0 tx=0).stop 2023-08-11T12:22:32.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.118+0000 7faf845ff700 1 -- 172.21.15.8:0/2394174548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf7c1009e0 msgr2=0x7faf7c1988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:32.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.118+0000 7faf845ff700 1 --2- 172.21.15.8:0/2394174548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf7c1009e0 0x7faf7c1988e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faf7800d980 tx=0x7faf7800dc90 comp rx=0 tx=0).stop 2023-08-11T12:22:32.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.119+0000 7faf845ff700 1 -- 172.21.15.8:0/2394174548 shutdown_connections 2023-08-11T12:22:32.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.119+0000 7faf845ff700 1 --2- 172.21.15.8:0/2394174548 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7faf6809ff50 0x7faf680a2410 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:32.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.119+0000 7faf845ff700 1 --2- 172.21.15.8:0/2394174548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf7c1009e0 0x7faf7c1988e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:32.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.119+0000 7faf845ff700 1 --2- 172.21.15.8:0/2394174548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf7c102570 0x7faf7c19fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:32.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.119+0000 7faf845ff700 1 --2- 172.21.15.8:0/2394174548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf7c101bd0 0x7faf7c198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:32.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.119+0000 7faf845ff700 1 -- 172.21.15.8:0/2394174548 >> 172.21.15.8:0/2394174548 conn(0x7faf7c0fbf50 msgr2=0x7faf7c0fc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:32.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.119+0000 7faf845ff700 1 -- 172.21.15.8:0/2394174548 shutdown_connections 2023-08-11T12:22:32.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.119+0000 7faf845ff700 1 -- 172.21.15.8:0/2394174548 wait complete. 2023-08-11T12:22:32.127 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-08-11T12:22:32.140 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":289,"stamp":"2023-08-11T12:22:31.715374+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595322,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":143,"num_read_kb":128,"num_write":267,"num_write_kb":2968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335492,"kb_used_data":11284,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124606332,"statfs":{"total":1151940427776,"available":1151596883968,"internally_reserved":0,"allocated":11554816,"data_stored":7356243,"data_compressed":247722,"data_compressed_allocated":331776,"data_compressed_original":2162688,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":455,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":7,"num_read_kb":9,"num_write":38,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.207278"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.724344+0000","last_change":"2023-08-11T12:22:03.850538+0000","last_active":"2023-08-11T12:22:30.724344+0000","last_peered":"2023-08-11T12:22:30.724344+0000","last_clean":"2023-08-11T12:22:30.724344+0000","last_became_active":"2023-08-11T12:22:03.850220+0000","last_became_peered":"2023-08-11T12:22:03.850220+0000","last_unstale":"2023-08-11T12:22:30.724344+0000","last_undegraded":"2023-08-11T12:22:30.724344+0000","last_fullsized":"2023-08-11T12:22:30.724344+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:44:11.152122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716210+0000","last_change":"2023-08-11T12:22:03.843779+0000","last_active":"2023-08-11T12:22:30.716210+0000","last_peered":"2023-08-11T12:22:30.716210+0000","last_clean":"2023-08-11T12:22:30.716210+0000","last_became_active":"2023-08-11T12:22:03.843441+0000","last_became_peered":"2023-08-11T12:22:03.843441+0000","last_unstale":"2023-08-11T12:22:30.716210+0000","last_undegraded":"2023-08-11T12:22:30.716210+0000","last_fullsized":"2023-08-11T12:22:30.716210+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:11:50.295291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716835+0000","last_change":"2023-08-11T12:22:03.851996+0000","last_active":"2023-08-11T12:22:30.716835+0000","last_peered":"2023-08-11T12:22:30.716835+0000","last_clean":"2023-08-11T12:22:30.716835+0000","last_became_active":"2023-08-11T12:22:03.850821+0000","last_became_peered":"2023-08-11T12:22:03.850821+0000","last_unstale":"2023-08-11T12:22:30.716835+0000","last_undegraded":"2023-08-11T12:22:30.716835+0000","last_fullsized":"2023-08-11T12:22:30.716835+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:09:01.522001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067343+0000","last_change":"2023-08-11T12:22:03.842025+0000","last_active":"2023-08-11T12:22:09.067343+0000","last_peered":"2023-08-11T12:22:09.067343+0000","last_clean":"2023-08-11T12:22:09.067343+0000","last_became_active":"2023-08-11T12:22:03.841700+0000","last_became_peered":"2023-08-11T12:22:03.841700+0000","last_unstale":"2023-08-11T12:22:09.067343+0000","last_undegraded":"2023-08-11T12:22:09.067343+0000","last_fullsized":"2023-08-11T12:22:09.067343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:45:15.532577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879525+0000","last_change":"2023-08-11T12:22:03.844908+0000","last_active":"2023-08-11T12:22:08.879525+0000","last_peered":"2023-08-11T12:22:08.879525+0000","last_clean":"2023-08-11T12:22:08.879525+0000","last_became_active":"2023-08-11T12:22:03.844674+0000","last_became_peered":"2023-08-11T12:22:03.844674+0000","last_unstale":"2023-08-11T12:22:08.879525+0000","last_undegraded":"2023-08-11T12:22:08.879525+0000","last_fullsized":"2023-08-11T12:22:08.879525+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:13:32.050245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067181+0000","last_change":"2023-08-11T12:22:03.839915+0000","last_active":"2023-08-11T12:22:09.067181+0000","last_peered":"2023-08-11T12:22:09.067181+0000","last_clean":"2023-08-11T12:22:09.067181+0000","last_became_active":"2023-08-11T12:22:03.839099+0000","last_became_peered":"2023-08-11T12:22:03.839099+0000","last_unstale":"2023-08-11T12:22:09.067181+0000","last_undegraded":"2023-08-11T12:22:09.067181+0000","last_fullsized":"2023-08-11T12:22:09.067181+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:48:27.468032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880115+0000","last_change":"2023-08-11T12:22:03.841591+0000","last_active":"2023-08-11T12:22:08.880115+0000","last_peered":"2023-08-11T12:22:08.880115+0000","last_clean":"2023-08-11T12:22:08.880115+0000","last_became_active":"2023-08-11T12:22:03.841232+0000","last_became_peered":"2023-08-11T12:22:03.841232+0000","last_unstale":"2023-08-11T12:22:08.880115+0000","last_undegraded":"2023-08-11T12:22:08.880115+0000","last_fullsized":"2023-08-11T12:22:08.880115+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:57:51.227137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067792+0000","last_change":"2023-08-11T12:22:03.839516+0000","last_active":"2023-08-11T12:22:09.067792+0000","last_peered":"2023-08-11T12:22:09.067792+0000","last_clean":"2023-08-11T12:22:09.067792+0000","last_became_active":"2023-08-11T12:22:03.839058+0000","last_became_peered":"2023-08-11T12:22:03.839058+0000","last_unstale":"2023-08-11T12:22:09.067792+0000","last_undegraded":"2023-08-11T12:22:09.067792+0000","last_fullsized":"2023-08-11T12:22:09.067792+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:56:27.838147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.970642+0000","last_change":"2023-08-11T12:22:03.841033+0000","last_active":"2023-08-11T12:22:08.970642+0000","last_peered":"2023-08-11T12:22:08.970642+0000","last_clean":"2023-08-11T12:22:08.970642+0000","last_became_active":"2023-08-11T12:22:03.840665+0000","last_became_peered":"2023-08-11T12:22:03.840665+0000","last_unstale":"2023-08-11T12:22:08.970642+0000","last_undegraded":"2023-08-11T12:22:08.970642+0000","last_fullsized":"2023-08-11T12:22:08.970642+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:51:47.671738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067587+0000","last_change":"2023-08-11T12:22:03.839663+0000","last_active":"2023-08-11T12:22:09.067587+0000","last_peered":"2023-08-11T12:22:09.067587+0000","last_clean":"2023-08-11T12:22:09.067587+0000","last_became_active":"2023-08-11T12:22:03.838840+0000","last_became_peered":"2023-08-11T12:22:03.838840+0000","last_unstale":"2023-08-11T12:22:09.067587+0000","last_undegraded":"2023-08-11T12:22:09.067587+0000","last_fullsized":"2023-08-11T12:22:09.067587+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:57:09.615886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880443+0000","last_change":"2023-08-11T12:22:03.846288+0000","last_active":"2023-08-11T12:22:08.880443+0000","last_peered":"2023-08-11T12:22:08.880443+0000","last_clean":"2023-08-11T12:22:08.880443+0000","last_became_active":"2023-08-11T12:22:03.845962+0000","last_became_peered":"2023-08-11T12:22:03.845962+0000","last_unstale":"2023-08-11T12:22:08.880443+0000","last_undegraded":"2023-08-11T12:22:08.880443+0000","last_fullsized":"2023-08-11T12:22:08.880443+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:59:48.212360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067180+0000","last_change":"2023-08-11T12:22:03.846310+0000","last_active":"2023-08-11T12:22:09.067180+0000","last_peered":"2023-08-11T12:22:09.067180+0000","last_clean":"2023-08-11T12:22:09.067180+0000","last_became_active":"2023-08-11T12:22:03.845645+0000","last_became_peered":"2023-08-11T12:22:03.845645+0000","last_unstale":"2023-08-11T12:22:09.067180+0000","last_undegraded":"2023-08-11T12:22:09.067180+0000","last_fullsized":"2023-08-11T12:22:09.067180+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:28:27.446228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879206+0000","last_change":"2023-08-11T12:22:03.842249+0000","last_active":"2023-08-11T12:22:08.879206+0000","last_peered":"2023-08-11T12:22:08.879206+0000","last_clean":"2023-08-11T12:22:08.879206+0000","last_became_active":"2023-08-11T12:22:03.841887+0000","last_became_peered":"2023-08-11T12:22:03.841887+0000","last_unstale":"2023-08-11T12:22:08.879206+0000","last_undegraded":"2023-08-11T12:22:08.879206+0000","last_fullsized":"2023-08-11T12:22:08.879206+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:08:58.125728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716293+0000","last_change":"2023-08-11T12:22:03.843859+0000","last_active":"2023-08-11T12:22:30.716293+0000","last_peered":"2023-08-11T12:22:30.716293+0000","last_clean":"2023-08-11T12:22:30.716293+0000","last_became_active":"2023-08-11T12:22:03.843383+0000","last_became_peered":"2023-08-11T12:22:03.843383+0000","last_unstale":"2023-08-11T12:22:30.716293+0000","last_undegraded":"2023-08-11T12:22:30.716293+0000","last_fullsized":"2023-08-11T12:22:30.716293+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:32:20.669588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"peering","last_fresh":"2023-08-11T12:22:09.066359+0000","last_change":"2023-08-11T12:22:30.717444+0000","last_active":"2023-08-11T12:22:30.717444+0000","last_peered":"2023-08-11T12:22:09.066359+0000","last_clean":"2023-08-11T12:22:09.066359+0000","last_became_active":"2023-08-11T12:22:03.849130+0000","last_became_peered":"2023-08-11T12:22:03.849130+0000","last_unstale":"2023-08-11T12:22:09.066359+0000","last_undegraded":"2023-08-11T12:22:09.066359+0000","last_fullsized":"2023-08-11T12:22:09.066359+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4,8],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.969810+0000","last_change":"2023-08-11T12:22:03.850397+0000","last_active":"2023-08-11T12:22:08.969810+0000","last_peered":"2023-08-11T12:22:08.969810+0000","last_clean":"2023-08-11T12:22:08.969810+0000","last_became_active":"2023-08-11T12:22:03.850143+0000","last_became_peered":"2023-08-11T12:22:03.850143+0000","last_unstale":"2023-08-11T12:22:08.969810+0000","last_undegraded":"2023-08-11T12:22:08.969810+0000","last_fullsized":"2023-08-11T12:22:08.969810+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:16:12.580674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.724188+0000","last_change":"2023-08-11T12:22:03.850496+0000","last_active":"2023-08-11T12:22:30.724188+0000","last_peered":"2023-08-11T12:22:30.724188+0000","last_clean":"2023-08-11T12:22:30.724188+0000","last_became_active":"2023-08-11T12:22:03.850192+0000","last_became_peered":"2023-08-11T12:22:03.850192+0000","last_unstale":"2023-08-11T12:22:30.724188+0000","last_undegraded":"2023-08-11T12:22:30.724188+0000","last_fullsized":"2023-08-11T12:22:30.724188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:15:36.813034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067616+0000","last_change":"2023-08-11T12:22:03.841706+0000","last_active":"2023-08-11T12:22:09.067616+0000","last_peered":"2023-08-11T12:22:09.067616+0000","last_clean":"2023-08-11T12:22:09.067616+0000","last_became_active":"2023-08-11T12:22:03.841341+0000","last_became_peered":"2023-08-11T12:22:03.841341+0000","last_unstale":"2023-08-11T12:22:09.067616+0000","last_undegraded":"2023-08-11T12:22:09.067616+0000","last_fullsized":"2023-08-11T12:22:09.067616+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:43:00.871282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067783+0000","last_change":"2023-08-11T12:22:03.834450+0000","last_active":"2023-08-11T12:22:09.067783+0000","last_peered":"2023-08-11T12:22:09.067783+0000","last_clean":"2023-08-11T12:22:09.067783+0000","last_became_active":"2023-08-11T12:22:03.834154+0000","last_became_peered":"2023-08-11T12:22:03.834154+0000","last_unstale":"2023-08-11T12:22:09.067783+0000","last_undegraded":"2023-08-11T12:22:09.067783+0000","last_fullsized":"2023-08-11T12:22:09.067783+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:59:48.605877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066819+0000","last_change":"2023-08-11T12:22:07.886317+0000","last_active":"2023-08-11T12:22:09.066819+0000","last_peered":"2023-08-11T12:22:09.066819+0000","last_clean":"2023-08-11T12:22:09.066819+0000","last_became_active":"2023-08-11T12:22:07.885986+0000","last_became_peered":"2023-08-11T12:22:07.885986+0000","last_unstale":"2023-08-11T12:22:09.066819+0000","last_undegraded":"2023-08-11T12:22:09.066819+0000","last_fullsized":"2023-08-11T12:22:09.066819+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:36:54.443747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"82'4","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068612+0000","last_change":"2023-08-11T12:22:02.841759+0000","last_active":"2023-08-11T12:22:09.068612+0000","last_peered":"2023-08-11T12:22:09.068612+0000","last_clean":"2023-08-11T12:22:09.068612+0000","last_became_active":"2023-08-11T12:22:02.841326+0000","last_became_peered":"2023-08-11T12:22:02.841326+0000","last_unstale":"2023-08-11T12:22:09.068612+0000","last_undegraded":"2023-08-11T12:22:09.068612+0000","last_fullsized":"2023-08-11T12:22:09.068612+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:32:09.418999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068299+0000","last_change":"2023-08-11T12:22:03.831062+0000","last_active":"2023-08-11T12:22:09.068299+0000","last_peered":"2023-08-11T12:22:09.068299+0000","last_clean":"2023-08-11T12:22:09.068299+0000","last_became_active":"2023-08-11T12:22:03.830712+0000","last_became_peered":"2023-08-11T12:22:03.830712+0000","last_unstale":"2023-08-11T12:22:09.068299+0000","last_undegraded":"2023-08-11T12:22:09.068299+0000","last_fullsized":"2023-08-11T12:22:09.068299+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:48:30.789817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.065992+0000","last_change":"2023-08-11T12:22:07.875010+0000","last_active":"2023-08-11T12:22:09.065992+0000","last_peered":"2023-08-11T12:22:09.065992+0000","last_clean":"2023-08-11T12:22:09.065992+0000","last_became_active":"2023-08-11T12:22:07.874474+0000","last_became_peered":"2023-08-11T12:22:07.874474+0000","last_unstale":"2023-08-11T12:22:09.065992+0000","last_undegraded":"2023-08-11T12:22:09.065992+0000","last_fullsized":"2023-08-11T12:22:09.065992+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:54:41.734301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068448+0000","last_change":"2023-08-11T12:22:02.848299+0000","last_active":"2023-08-11T12:22:09.068448+0000","last_peered":"2023-08-11T12:22:09.068448+0000","last_clean":"2023-08-11T12:22:09.068448+0000","last_became_active":"2023-08-11T12:22:02.847869+0000","last_became_peered":"2023-08-11T12:22:02.847869+0000","last_unstale":"2023-08-11T12:22:09.068448+0000","last_undegraded":"2023-08-11T12:22:09.068448+0000","last_fullsized":"2023-08-11T12:22:09.068448+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:36:09.123226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716310+0000","last_change":"2023-08-11T12:22:03.841173+0000","last_active":"2023-08-11T12:22:30.716310+0000","last_peered":"2023-08-11T12:22:30.716310+0000","last_clean":"2023-08-11T12:22:30.716310+0000","last_became_active":"2023-08-11T12:22:03.840882+0000","last_became_peered":"2023-08-11T12:22:03.840882+0000","last_unstale":"2023-08-11T12:22:30.716310+0000","last_undegraded":"2023-08-11T12:22:30.716310+0000","last_fullsized":"2023-08-11T12:22:30.716310+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:58:38.141467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066479+0000","last_change":"2023-08-11T12:22:07.880756+0000","last_active":"2023-08-11T12:22:09.066479+0000","last_peered":"2023-08-11T12:22:09.066479+0000","last_clean":"2023-08-11T12:22:09.066479+0000","last_became_active":"2023-08-11T12:22:07.878866+0000","last_became_peered":"2023-08-11T12:22:07.878866+0000","last_unstale":"2023-08-11T12:22:09.066479+0000","last_undegraded":"2023-08-11T12:22:09.066479+0000","last_fullsized":"2023-08-11T12:22:09.066479+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:21:58.652424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'4","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:29.683617+0000","last_change":"2023-08-11T12:22:02.848543+0000","last_active":"2023-08-11T12:22:29.683617+0000","last_peered":"2023-08-11T12:22:29.683617+0000","last_clean":"2023-08-11T12:22:29.683617+0000","last_became_active":"2023-08-11T12:22:02.848008+0000","last_became_peered":"2023-08-11T12:22:02.848008+0000","last_unstale":"2023-08-11T12:22:29.683617+0000","last_undegraded":"2023-08-11T12:22:29.683617+0000","last_fullsized":"2023-08-11T12:22:29.683617+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:34:33.832747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.970098+0000","last_change":"2023-08-11T12:22:03.843651+0000","last_active":"2023-08-11T12:22:08.970098+0000","last_peered":"2023-08-11T12:22:08.970098+0000","last_clean":"2023-08-11T12:22:08.970098+0000","last_became_active":"2023-08-11T12:22:03.843392+0000","last_became_peered":"2023-08-11T12:22:03.843392+0000","last_unstale":"2023-08-11T12:22:08.970098+0000","last_undegraded":"2023-08-11T12:22:08.970098+0000","last_fullsized":"2023-08-11T12:22:08.970098+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:02:03.025511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066201+0000","last_change":"2023-08-11T12:22:07.879373+0000","last_active":"2023-08-11T12:22:09.066201+0000","last_peered":"2023-08-11T12:22:09.066201+0000","last_clean":"2023-08-11T12:22:09.066201+0000","last_became_active":"2023-08-11T12:22:07.878929+0000","last_became_peered":"2023-08-11T12:22:07.878929+0000","last_unstale":"2023-08-11T12:22:09.066201+0000","last_undegraded":"2023-08-11T12:22:09.066201+0000","last_fullsized":"2023-08-11T12:22:09.066201+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:44:35.895712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879734+0000","last_change":"2023-08-11T12:22:02.841984+0000","last_active":"2023-08-11T12:22:08.879734+0000","last_peered":"2023-08-11T12:22:08.879734+0000","last_clean":"2023-08-11T12:22:08.879734+0000","last_became_active":"2023-08-11T12:22:02.841585+0000","last_became_peered":"2023-08-11T12:22:02.841585+0000","last_unstale":"2023-08-11T12:22:08.879734+0000","last_undegraded":"2023-08-11T12:22:08.879734+0000","last_fullsized":"2023-08-11T12:22:08.879734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:22:35.974158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068146+0000","last_change":"2023-08-11T12:22:03.839381+0000","last_active":"2023-08-11T12:22:09.068146+0000","last_peered":"2023-08-11T12:22:09.068146+0000","last_clean":"2023-08-11T12:22:09.068146+0000","last_became_active":"2023-08-11T12:22:03.839091+0000","last_became_peered":"2023-08-11T12:22:03.839091+0000","last_unstale":"2023-08-11T12:22:09.068146+0000","last_undegraded":"2023-08-11T12:22:09.068146+0000","last_fullsized":"2023-08-11T12:22:09.068146+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:12:59.687698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067684+0000","last_change":"2023-08-11T12:22:07.881758+0000","last_active":"2023-08-11T12:22:09.067684+0000","last_peered":"2023-08-11T12:22:09.067684+0000","last_clean":"2023-08-11T12:22:09.067684+0000","last_became_active":"2023-08-11T12:22:07.881305+0000","last_became_peered":"2023-08-11T12:22:07.881305+0000","last_unstale":"2023-08-11T12:22:09.067684+0000","last_undegraded":"2023-08-11T12:22:09.067684+0000","last_fullsized":"2023-08-11T12:22:09.067684+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:08:17.423954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"82'1","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067097+0000","last_change":"2023-08-11T12:22:02.844138+0000","last_active":"2023-08-11T12:22:09.067097+0000","last_peered":"2023-08-11T12:22:09.067097+0000","last_clean":"2023-08-11T12:22:09.067097+0000","last_became_active":"2023-08-11T12:22:02.843234+0000","last_became_peered":"2023-08-11T12:22:02.843234+0000","last_unstale":"2023-08-11T12:22:09.067097+0000","last_undegraded":"2023-08-11T12:22:09.067097+0000","last_fullsized":"2023-08-11T12:22:09.067097+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:21:27.653637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879684+0000","last_change":"2023-08-11T12:22:03.845450+0000","last_active":"2023-08-11T12:22:08.879684+0000","last_peered":"2023-08-11T12:22:08.879684+0000","last_clean":"2023-08-11T12:22:08.879684+0000","last_became_active":"2023-08-11T12:22:03.845170+0000","last_became_peered":"2023-08-11T12:22:03.845170+0000","last_unstale":"2023-08-11T12:22:08.879684+0000","last_undegraded":"2023-08-11T12:22:08.879684+0000","last_fullsized":"2023-08-11T12:22:08.879684+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:54:39.747258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066775+0000","last_change":"2023-08-11T12:22:07.880663+0000","last_active":"2023-08-11T12:22:09.066775+0000","last_peered":"2023-08-11T12:22:09.066775+0000","last_clean":"2023-08-11T12:22:09.066775+0000","last_became_active":"2023-08-11T12:22:07.880282+0000","last_became_peered":"2023-08-11T12:22:07.880282+0000","last_unstale":"2023-08-11T12:22:09.066775+0000","last_undegraded":"2023-08-11T12:22:09.066775+0000","last_fullsized":"2023-08-11T12:22:09.066775+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:32:50.241286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"87'3","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:29.683550+0000","last_change":"2023-08-11T12:22:02.842206+0000","last_active":"2023-08-11T12:22:29.683550+0000","last_peered":"2023-08-11T12:22:29.683550+0000","last_clean":"2023-08-11T12:22:29.683550+0000","last_became_active":"2023-08-11T12:22:02.841815+0000","last_became_peered":"2023-08-11T12:22:02.841815+0000","last_unstale":"2023-08-11T12:22:29.683550+0000","last_undegraded":"2023-08-11T12:22:29.683550+0000","last_fullsized":"2023-08-11T12:22:29.683550+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:29:49.660552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067262+0000","last_change":"2023-08-11T12:22:03.825886+0000","last_active":"2023-08-11T12:22:09.067262+0000","last_peered":"2023-08-11T12:22:09.067262+0000","last_clean":"2023-08-11T12:22:09.067262+0000","last_became_active":"2023-08-11T12:22:03.825645+0000","last_became_peered":"2023-08-11T12:22:03.825645+0000","last_unstale":"2023-08-11T12:22:09.067262+0000","last_undegraded":"2023-08-11T12:22:09.067262+0000","last_fullsized":"2023-08-11T12:22:09.067262+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:27:52.324963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.723928+0000","last_change":"2023-08-11T12:22:07.890216+0000","last_active":"2023-08-11T12:22:30.723928+0000","last_peered":"2023-08-11T12:22:30.723928+0000","last_clean":"2023-08-11T12:22:30.723928+0000","last_became_active":"2023-08-11T12:22:07.889860+0000","last_became_peered":"2023-08-11T12:22:07.889860+0000","last_unstale":"2023-08-11T12:22:30.723928+0000","last_undegraded":"2023-08-11T12:22:30.723928+0000","last_fullsized":"2023-08-11T12:22:30.723928+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:26:31.744345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.878916+0000","last_change":"2023-08-11T12:22:02.835703+0000","last_active":"2023-08-11T12:22:08.878916+0000","last_peered":"2023-08-11T12:22:08.878916+0000","last_clean":"2023-08-11T12:22:08.878916+0000","last_became_active":"2023-08-11T12:22:02.835300+0000","last_became_peered":"2023-08-11T12:22:02.835300+0000","last_unstale":"2023-08-11T12:22:08.878916+0000","last_undegraded":"2023-08-11T12:22:08.878916+0000","last_fullsized":"2023-08-11T12:22:08.878916+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:05:05.549977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067658+0000","last_change":"2023-08-11T12:22:03.835619+0000","last_active":"2023-08-11T12:22:09.067658+0000","last_peered":"2023-08-11T12:22:09.067658+0000","last_clean":"2023-08-11T12:22:09.067658+0000","last_became_active":"2023-08-11T12:22:03.835365+0000","last_became_peered":"2023-08-11T12:22:03.835365+0000","last_unstale":"2023-08-11T12:22:09.067658+0000","last_undegraded":"2023-08-11T12:22:09.067658+0000","last_fullsized":"2023-08-11T12:22:09.067658+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:41:37.126989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716034+0000","last_change":"2023-08-11T12:22:07.893736+0000","last_active":"2023-08-11T12:22:30.716034+0000","last_peered":"2023-08-11T12:22:30.716034+0000","last_clean":"2023-08-11T12:22:30.716034+0000","last_became_active":"2023-08-11T12:22:07.893160+0000","last_became_peered":"2023-08-11T12:22:07.893160+0000","last_unstale":"2023-08-11T12:22:30.716034+0000","last_undegraded":"2023-08-11T12:22:30.716034+0000","last_fullsized":"2023-08-11T12:22:30.716034+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:15:12.861835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066672+0000","last_change":"2023-08-11T12:22:02.843819+0000","last_active":"2023-08-11T12:22:09.066672+0000","last_peered":"2023-08-11T12:22:09.066672+0000","last_clean":"2023-08-11T12:22:09.066672+0000","last_became_active":"2023-08-11T12:22:02.843062+0000","last_became_peered":"2023-08-11T12:22:02.843062+0000","last_unstale":"2023-08-11T12:22:09.066672+0000","last_undegraded":"2023-08-11T12:22:09.066672+0000","last_fullsized":"2023-08-11T12:22:09.066672+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:51:10.923574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066822+0000","last_change":"2023-08-11T12:22:03.845985+0000","last_active":"2023-08-11T12:22:09.066822+0000","last_peered":"2023-08-11T12:22:09.066822+0000","last_clean":"2023-08-11T12:22:09.066822+0000","last_became_active":"2023-08-11T12:22:03.845274+0000","last_became_peered":"2023-08-11T12:22:03.845274+0000","last_unstale":"2023-08-11T12:22:09.066822+0000","last_undegraded":"2023-08-11T12:22:09.066822+0000","last_fullsized":"2023-08-11T12:22:09.066822+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:02:19.795633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067853+0000","last_change":"2023-08-11T12:22:07.885017+0000","last_active":"2023-08-11T12:22:09.067853+0000","last_peered":"2023-08-11T12:22:09.067853+0000","last_clean":"2023-08-11T12:22:09.067853+0000","last_became_active":"2023-08-11T12:22:07.884610+0000","last_became_peered":"2023-08-11T12:22:07.884610+0000","last_unstale":"2023-08-11T12:22:09.067853+0000","last_undegraded":"2023-08-11T12:22:09.067853+0000","last_fullsized":"2023-08-11T12:22:09.067853+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:03:47.111702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"87'3","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:28.723792+0000","last_change":"2023-08-11T12:22:02.836591+0000","last_active":"2023-08-11T12:22:28.723792+0000","last_peered":"2023-08-11T12:22:28.723792+0000","last_clean":"2023-08-11T12:22:28.723792+0000","last_became_active":"2023-08-11T12:22:02.836223+0000","last_became_peered":"2023-08-11T12:22:02.836223+0000","last_unstale":"2023-08-11T12:22:28.723792+0000","last_undegraded":"2023-08-11T12:22:28.723792+0000","last_fullsized":"2023-08-11T12:22:28.723792+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:04:18.216860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.970378+0000","last_change":"2023-08-11T12:22:03.841719+0000","last_active":"2023-08-11T12:22:08.970378+0000","last_peered":"2023-08-11T12:22:08.970378+0000","last_clean":"2023-08-11T12:22:08.970378+0000","last_became_active":"2023-08-11T12:22:03.841381+0000","last_became_peered":"2023-08-11T12:22:03.841381+0000","last_unstale":"2023-08-11T12:22:08.970378+0000","last_undegraded":"2023-08-11T12:22:08.970378+0000","last_fullsized":"2023-08-11T12:22:08.970378+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:23:34.743266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066630+0000","last_change":"2023-08-11T12:22:07.889103+0000","last_active":"2023-08-11T12:22:09.066630+0000","last_peered":"2023-08-11T12:22:09.066630+0000","last_clean":"2023-08-11T12:22:09.066630+0000","last_became_active":"2023-08-11T12:22:07.888668+0000","last_became_peered":"2023-08-11T12:22:07.888668+0000","last_unstale":"2023-08-11T12:22:09.066630+0000","last_undegraded":"2023-08-11T12:22:09.066630+0000","last_fullsized":"2023-08-11T12:22:09.066630+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:36:17.061989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"87'2","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:28.721917+0000","last_change":"2023-08-11T12:22:02.841934+0000","last_active":"2023-08-11T12:22:28.721917+0000","last_peered":"2023-08-11T12:22:28.721917+0000","last_clean":"2023-08-11T12:22:28.721917+0000","last_became_active":"2023-08-11T12:22:02.841598+0000","last_became_peered":"2023-08-11T12:22:02.841598+0000","last_unstale":"2023-08-11T12:22:28.721917+0000","last_undegraded":"2023-08-11T12:22:28.721917+0000","last_fullsized":"2023-08-11T12:22:28.721917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:41:39.918666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716456+0000","last_change":"2023-08-11T12:22:03.848901+0000","last_active":"2023-08-11T12:22:30.716456+0000","last_peered":"2023-08-11T12:22:30.716456+0000","last_clean":"2023-08-11T12:22:30.716456+0000","last_became_active":"2023-08-11T12:22:03.848518+0000","last_became_peered":"2023-08-11T12:22:03.848518+0000","last_unstale":"2023-08-11T12:22:30.716456+0000","last_undegraded":"2023-08-11T12:22:30.716456+0000","last_fullsized":"2023-08-11T12:22:30.716456+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:28:39.018373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067078+0000","last_change":"2023-08-11T12:22:07.873734+0000","last_active":"2023-08-11T12:22:09.067078+0000","last_peered":"2023-08-11T12:22:09.067078+0000","last_clean":"2023-08-11T12:22:09.067078+0000","last_became_active":"2023-08-11T12:22:07.872986+0000","last_became_peered":"2023-08-11T12:22:07.872986+0000","last_unstale":"2023-08-11T12:22:09.067078+0000","last_undegraded":"2023-08-11T12:22:09.067078+0000","last_fullsized":"2023-08-11T12:22:09.067078+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:22:35.576079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"82'3","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068027+0000","last_change":"2023-08-11T12:22:02.846492+0000","last_active":"2023-08-11T12:22:09.068027+0000","last_peered":"2023-08-11T12:22:09.068027+0000","last_clean":"2023-08-11T12:22:09.068027+0000","last_became_active":"2023-08-11T12:22:02.846174+0000","last_became_peered":"2023-08-11T12:22:02.846174+0000","last_unstale":"2023-08-11T12:22:09.068027+0000","last_undegraded":"2023-08-11T12:22:09.068027+0000","last_fullsized":"2023-08-11T12:22:09.068027+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:20:48.965543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.970441+0000","last_change":"2023-08-11T12:22:03.840054+0000","last_active":"2023-08-11T12:22:08.970441+0000","last_peered":"2023-08-11T12:22:08.970441+0000","last_clean":"2023-08-11T12:22:08.970441+0000","last_became_active":"2023-08-11T12:22:03.839707+0000","last_became_peered":"2023-08-11T12:22:03.839707+0000","last_unstale":"2023-08-11T12:22:08.970441+0000","last_undegraded":"2023-08-11T12:22:08.970441+0000","last_fullsized":"2023-08-11T12:22:08.970441+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:57:01.883842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066884+0000","last_change":"2023-08-11T12:22:07.886900+0000","last_active":"2023-08-11T12:22:09.066884+0000","last_peered":"2023-08-11T12:22:09.066884+0000","last_clean":"2023-08-11T12:22:09.066884+0000","last_became_active":"2023-08-11T12:22:07.886228+0000","last_became_peered":"2023-08-11T12:22:07.886228+0000","last_unstale":"2023-08-11T12:22:09.066884+0000","last_undegraded":"2023-08-11T12:22:09.066884+0000","last_fullsized":"2023-08-11T12:22:09.066884+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:23:53.736228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"87'12","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:29.677313+0000","last_change":"2023-08-11T12:22:02.836520+0000","last_active":"2023-08-11T12:22:29.677313+0000","last_peered":"2023-08-11T12:22:29.677313+0000","last_clean":"2023-08-11T12:22:29.677313+0000","last_became_active":"2023-08-11T12:22:02.836201+0000","last_became_peered":"2023-08-11T12:22:02.836201+0000","last_unstale":"2023-08-11T12:22:29.677313+0000","last_undegraded":"2023-08-11T12:22:29.677313+0000","last_fullsized":"2023-08-11T12:22:29.677313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:41:20.418514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":6,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879606+0000","last_change":"2023-08-11T12:22:03.848104+0000","last_active":"2023-08-11T12:22:08.879606+0000","last_peered":"2023-08-11T12:22:08.879606+0000","last_clean":"2023-08-11T12:22:08.879606+0000","last_became_active":"2023-08-11T12:22:03.847801+0000","last_became_peered":"2023-08-11T12:22:03.847801+0000","last_unstale":"2023-08-11T12:22:08.879606+0000","last_undegraded":"2023-08-11T12:22:08.879606+0000","last_fullsized":"2023-08-11T12:22:08.879606+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:11:30.238632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068429+0000","last_change":"2023-08-11T12:22:07.893710+0000","last_active":"2023-08-11T12:22:09.068429+0000","last_peered":"2023-08-11T12:22:09.068429+0000","last_clean":"2023-08-11T12:22:09.068429+0000","last_became_active":"2023-08-11T12:22:07.893239+0000","last_became_peered":"2023-08-11T12:22:07.893239+0000","last_unstale":"2023-08-11T12:22:09.068429+0000","last_undegraded":"2023-08-11T12:22:09.068429+0000","last_fullsized":"2023-08-11T12:22:09.068429+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:42:45.168233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"87'4","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:28.722975+0000","last_change":"2023-08-11T12:22:02.849060+0000","last_active":"2023-08-11T12:22:28.722975+0000","last_peered":"2023-08-11T12:22:28.722975+0000","last_clean":"2023-08-11T12:22:28.722975+0000","last_became_active":"2023-08-11T12:22:02.848417+0000","last_became_peered":"2023-08-11T12:22:02.848417+0000","last_unstale":"2023-08-11T12:22:28.722975+0000","last_undegraded":"2023-08-11T12:22:28.722975+0000","last_fullsized":"2023-08-11T12:22:28.722975+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:09:38.023995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.878997+0000","last_change":"2023-08-11T12:22:03.848532+0000","last_active":"2023-08-11T12:22:08.878997+0000","last_peered":"2023-08-11T12:22:08.878997+0000","last_clean":"2023-08-11T12:22:08.878997+0000","last_became_active":"2023-08-11T12:22:03.848190+0000","last_became_peered":"2023-08-11T12:22:03.848190+0000","last_unstale":"2023-08-11T12:22:08.878997+0000","last_undegraded":"2023-08-11T12:22:08.878997+0000","last_fullsized":"2023-08-11T12:22:08.878997+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:24:10.506810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.723601+0000","last_change":"2023-08-11T12:22:07.882785+0000","last_active":"2023-08-11T12:22:30.723601+0000","last_peered":"2023-08-11T12:22:30.723601+0000","last_clean":"2023-08-11T12:22:30.723601+0000","last_became_active":"2023-08-11T12:22:07.880643+0000","last_became_peered":"2023-08-11T12:22:07.880643+0000","last_unstale":"2023-08-11T12:22:30.723601+0000","last_undegraded":"2023-08-11T12:22:30.723601+0000","last_fullsized":"2023-08-11T12:22:30.723601+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:13:01.597210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066777+0000","last_change":"2023-08-11T12:22:02.851416+0000","last_active":"2023-08-11T12:22:09.066777+0000","last_peered":"2023-08-11T12:22:09.066777+0000","last_clean":"2023-08-11T12:22:09.066777+0000","last_became_active":"2023-08-11T12:22:02.851114+0000","last_became_peered":"2023-08-11T12:22:02.851114+0000","last_unstale":"2023-08-11T12:22:09.066777+0000","last_undegraded":"2023-08-11T12:22:09.066777+0000","last_fullsized":"2023-08-11T12:22:09.066777+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:21:21.904496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880295+0000","last_change":"2023-08-11T12:22:03.849367+0000","last_active":"2023-08-11T12:22:08.880295+0000","last_peered":"2023-08-11T12:22:08.880295+0000","last_clean":"2023-08-11T12:22:08.880295+0000","last_became_active":"2023-08-11T12:22:03.849050+0000","last_became_peered":"2023-08-11T12:22:03.849050+0000","last_unstale":"2023-08-11T12:22:08.880295+0000","last_undegraded":"2023-08-11T12:22:08.880295+0000","last_fullsized":"2023-08-11T12:22:08.880295+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:01:37.018850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067215+0000","last_change":"2023-08-11T12:22:07.890992+0000","last_active":"2023-08-11T12:22:09.067215+0000","last_peered":"2023-08-11T12:22:09.067215+0000","last_clean":"2023-08-11T12:22:09.067215+0000","last_became_active":"2023-08-11T12:22:07.890384+0000","last_became_peered":"2023-08-11T12:22:07.890384+0000","last_unstale":"2023-08-11T12:22:09.067215+0000","last_undegraded":"2023-08-11T12:22:09.067215+0000","last_fullsized":"2023-08-11T12:22:09.067215+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:54:46.296607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066311+0000","last_change":"2023-08-11T12:22:02.843045+0000","last_active":"2023-08-11T12:22:09.066311+0000","last_peered":"2023-08-11T12:22:09.066311+0000","last_clean":"2023-08-11T12:22:09.066311+0000","last_became_active":"2023-08-11T12:22:02.842628+0000","last_became_peered":"2023-08-11T12:22:02.842628+0000","last_unstale":"2023-08-11T12:22:09.066311+0000","last_undegraded":"2023-08-11T12:22:09.066311+0000","last_fullsized":"2023-08-11T12:22:09.066311+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:24:30.251252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879762+0000","last_change":"2023-08-11T12:22:03.842526+0000","last_active":"2023-08-11T12:22:08.879762+0000","last_peered":"2023-08-11T12:22:08.879762+0000","last_clean":"2023-08-11T12:22:08.879762+0000","last_became_active":"2023-08-11T12:22:03.842183+0000","last_became_peered":"2023-08-11T12:22:03.842183+0000","last_unstale":"2023-08-11T12:22:08.879762+0000","last_undegraded":"2023-08-11T12:22:08.879762+0000","last_fullsized":"2023-08-11T12:22:08.879762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:15:28.619474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879644+0000","last_change":"2023-08-11T12:22:07.880768+0000","last_active":"2023-08-11T12:22:08.879644+0000","last_peered":"2023-08-11T12:22:08.879644+0000","last_clean":"2023-08-11T12:22:08.879644+0000","last_became_active":"2023-08-11T12:22:07.880335+0000","last_became_peered":"2023-08-11T12:22:07.880335+0000","last_unstale":"2023-08-11T12:22:08.879644+0000","last_undegraded":"2023-08-11T12:22:08.879644+0000","last_fullsized":"2023-08-11T12:22:08.879644+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:49:07.059346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"87'15","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:29.686619+0000","last_change":"2023-08-11T12:22:02.847271+0000","last_active":"2023-08-11T12:22:29.686619+0000","last_peered":"2023-08-11T12:22:29.686619+0000","last_clean":"2023-08-11T12:22:29.686619+0000","last_became_active":"2023-08-11T12:22:02.846974+0000","last_became_peered":"2023-08-11T12:22:02.846974+0000","last_unstale":"2023-08-11T12:22:29.686619+0000","last_undegraded":"2023-08-11T12:22:29.686619+0000","last_fullsized":"2023-08-11T12:22:29.686619+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:04:16.995048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068022+0000","last_change":"2023-08-11T12:22:03.838944+0000","last_active":"2023-08-11T12:22:09.068022+0000","last_peered":"2023-08-11T12:22:09.068022+0000","last_clean":"2023-08-11T12:22:09.068022+0000","last_became_active":"2023-08-11T12:22:03.838610+0000","last_became_peered":"2023-08-11T12:22:03.838610+0000","last_unstale":"2023-08-11T12:22:09.068022+0000","last_undegraded":"2023-08-11T12:22:09.068022+0000","last_fullsized":"2023-08-11T12:22:09.068022+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:40:51.718679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067929+0000","last_change":"2023-08-11T12:22:07.888812+0000","last_active":"2023-08-11T12:22:09.067929+0000","last_peered":"2023-08-11T12:22:09.067929+0000","last_clean":"2023-08-11T12:22:09.067929+0000","last_became_active":"2023-08-11T12:22:07.888423+0000","last_became_peered":"2023-08-11T12:22:07.888423+0000","last_unstale":"2023-08-11T12:22:09.067929+0000","last_undegraded":"2023-08-11T12:22:09.067929+0000","last_fullsized":"2023-08-11T12:22:09.067929+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:12:17.299557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'1","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879855+0000","last_change":"2023-08-11T12:22:02.842591+0000","last_active":"2023-08-11T12:22:08.879855+0000","last_peered":"2023-08-11T12:22:08.879855+0000","last_clean":"2023-08-11T12:22:08.879855+0000","last_became_active":"2023-08-11T12:22:02.842249+0000","last_became_peered":"2023-08-11T12:22:02.842249+0000","last_unstale":"2023-08-11T12:22:08.879855+0000","last_undegraded":"2023-08-11T12:22:08.879855+0000","last_fullsized":"2023-08-11T12:22:08.879855+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:53:56.628695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"peering","last_fresh":"2023-08-11T12:22:09.067384+0000","last_change":"2023-08-11T12:22:30.723122+0000","last_active":"2023-08-11T12:22:30.723122+0000","last_peered":"2023-08-11T12:22:09.067384+0000","last_clean":"2023-08-11T12:22:09.067384+0000","last_became_active":"2023-08-11T12:22:03.840210+0000","last_became_peered":"2023-08-11T12:22:03.840210+0000","last_unstale":"2023-08-11T12:22:09.067384+0000","last_undegraded":"2023-08-11T12:22:09.067384+0000","last_fullsized":"2023-08-11T12:22:09.067384+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,5,9],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879511+0000","last_change":"2023-08-11T12:22:08.068485+0000","last_active":"2023-08-11T12:22:08.879511+0000","last_peered":"2023-08-11T12:22:08.879511+0000","last_clean":"2023-08-11T12:22:08.879511+0000","last_became_active":"2023-08-11T12:22:08.068071+0000","last_became_peered":"2023-08-11T12:22:08.068071+0000","last_unstale":"2023-08-11T12:22:08.879511+0000","last_undegraded":"2023-08-11T12:22:08.879511+0000","last_fullsized":"2023-08-11T12:22:08.879511+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:06:34.158790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067365+0000","last_change":"2023-08-11T12:22:02.846614+0000","last_active":"2023-08-11T12:22:09.067365+0000","last_peered":"2023-08-11T12:22:09.067365+0000","last_clean":"2023-08-11T12:22:09.067365+0000","last_became_active":"2023-08-11T12:22:02.846300+0000","last_became_peered":"2023-08-11T12:22:02.846300+0000","last_unstale":"2023-08-11T12:22:09.067365+0000","last_undegraded":"2023-08-11T12:22:09.067365+0000","last_fullsized":"2023-08-11T12:22:09.067365+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:26:52.555189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067467+0000","last_change":"2023-08-11T12:22:03.843434+0000","last_active":"2023-08-11T12:22:09.067467+0000","last_peered":"2023-08-11T12:22:09.067467+0000","last_clean":"2023-08-11T12:22:09.067467+0000","last_became_active":"2023-08-11T12:22:03.843117+0000","last_became_peered":"2023-08-11T12:22:03.843117+0000","last_unstale":"2023-08-11T12:22:09.067467+0000","last_undegraded":"2023-08-11T12:22:09.067467+0000","last_fullsized":"2023-08-11T12:22:09.067467+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:24:56.881802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879498+0000","last_change":"2023-08-11T12:22:07.889740+0000","last_active":"2023-08-11T12:22:08.879498+0000","last_peered":"2023-08-11T12:22:08.879498+0000","last_clean":"2023-08-11T12:22:08.879498+0000","last_became_active":"2023-08-11T12:22:07.889272+0000","last_became_peered":"2023-08-11T12:22:07.889272+0000","last_unstale":"2023-08-11T12:22:08.879498+0000","last_undegraded":"2023-08-11T12:22:08.879498+0000","last_fullsized":"2023-08-11T12:22:08.879498+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:40:15.712138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"87'1","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879829+0000","last_change":"2023-08-11T12:22:02.846661+0000","last_active":"2023-08-11T12:22:08.879829+0000","last_peered":"2023-08-11T12:22:08.879829+0000","last_clean":"2023-08-11T12:22:08.879829+0000","last_became_active":"2023-08-11T12:22:02.846269+0000","last_became_peered":"2023-08-11T12:22:02.846269+0000","last_unstale":"2023-08-11T12:22:08.879829+0000","last_undegraded":"2023-08-11T12:22:08.879829+0000","last_fullsized":"2023-08-11T12:22:08.879829+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:47:43.138580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066619+0000","last_change":"2023-08-11T12:22:03.849653+0000","last_active":"2023-08-11T12:22:09.066619+0000","last_peered":"2023-08-11T12:22:09.066619+0000","last_clean":"2023-08-11T12:22:09.066619+0000","last_became_active":"2023-08-11T12:22:03.849303+0000","last_became_peered":"2023-08-11T12:22:03.849303+0000","last_unstale":"2023-08-11T12:22:09.066619+0000","last_undegraded":"2023-08-11T12:22:09.066619+0000","last_fullsized":"2023-08-11T12:22:09.066619+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:35:28.772541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879497+0000","last_change":"2023-08-11T12:22:08.068395+0000","last_active":"2023-08-11T12:22:08.879497+0000","last_peered":"2023-08-11T12:22:08.879497+0000","last_clean":"2023-08-11T12:22:08.879497+0000","last_became_active":"2023-08-11T12:22:08.067572+0000","last_became_peered":"2023-08-11T12:22:08.067572+0000","last_unstale":"2023-08-11T12:22:08.879497+0000","last_undegraded":"2023-08-11T12:22:08.879497+0000","last_fullsized":"2023-08-11T12:22:08.879497+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:18:19.641203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066941+0000","last_change":"2023-08-11T12:22:03.828971+0000","last_active":"2023-08-11T12:22:09.066941+0000","last_peered":"2023-08-11T12:22:09.066941+0000","last_clean":"2023-08-11T12:22:09.066941+0000","last_became_active":"2023-08-11T12:22:03.828653+0000","last_became_peered":"2023-08-11T12:22:03.828653+0000","last_unstale":"2023-08-11T12:22:09.066941+0000","last_undegraded":"2023-08-11T12:22:09.066941+0000","last_fullsized":"2023-08-11T12:22:09.066941+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:43:30.226114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'1","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.878818+0000","last_change":"2023-08-11T12:22:02.842419+0000","last_active":"2023-08-11T12:22:08.878818+0000","last_peered":"2023-08-11T12:22:08.878818+0000","last_clean":"2023-08-11T12:22:08.878818+0000","last_became_active":"2023-08-11T12:22:02.842105+0000","last_became_peered":"2023-08-11T12:22:02.842105+0000","last_unstale":"2023-08-11T12:22:08.878818+0000","last_undegraded":"2023-08-11T12:22:08.878818+0000","last_fullsized":"2023-08-11T12:22:08.878818+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:51:55.024962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880231+0000","last_change":"2023-08-11T12:22:07.880762+0000","last_active":"2023-08-11T12:22:08.880231+0000","last_peered":"2023-08-11T12:22:08.880231+0000","last_clean":"2023-08-11T12:22:08.880231+0000","last_became_active":"2023-08-11T12:22:07.880373+0000","last_became_peered":"2023-08-11T12:22:07.880373+0000","last_unstale":"2023-08-11T12:22:08.880231+0000","last_undegraded":"2023-08-11T12:22:08.880231+0000","last_fullsized":"2023-08-11T12:22:08.880231+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:07:55.656555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067945+0000","last_change":"2023-08-11T12:22:03.838555+0000","last_active":"2023-08-11T12:22:09.067945+0000","last_peered":"2023-08-11T12:22:09.067945+0000","last_clean":"2023-08-11T12:22:09.067945+0000","last_became_active":"2023-08-11T12:22:03.838135+0000","last_became_peered":"2023-08-11T12:22:03.838135+0000","last_unstale":"2023-08-11T12:22:09.067945+0000","last_undegraded":"2023-08-11T12:22:09.067945+0000","last_fullsized":"2023-08-11T12:22:09.067945+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:23:56.118058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066639+0000","last_change":"2023-08-11T12:22:02.835093+0000","last_active":"2023-08-11T12:22:09.066639+0000","last_peered":"2023-08-11T12:22:09.066639+0000","last_clean":"2023-08-11T12:22:09.066639+0000","last_became_active":"2023-08-11T12:22:02.834545+0000","last_became_peered":"2023-08-11T12:22:02.834545+0000","last_unstale":"2023-08-11T12:22:09.066639+0000","last_undegraded":"2023-08-11T12:22:09.066639+0000","last_fullsized":"2023-08-11T12:22:09.066639+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:59:41.870923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":350,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879552+0000","last_change":"2023-08-11T12:20:57.484190+0000","last_active":"2023-08-11T12:22:08.879552+0000","last_peered":"2023-08-11T12:22:08.879552+0000","last_clean":"2023-08-11T12:22:08.879552+0000","last_became_active":"2023-08-11T12:20:57.483655+0000","last_became_peered":"2023-08-11T12:20:57.483655+0000","last_unstale":"2023-08-11T12:22:08.879552+0000","last_undegraded":"2023-08-11T12:22:08.879552+0000","last_fullsized":"2023-08-11T12:22:08.879552+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:17:49.245488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:17:49.245488+0000","last_clean_scrub_stamp":"2023-08-11T12:17:49.245488+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:16:09.009846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068210+0000","last_change":"2023-08-11T12:22:08.068762+0000","last_active":"2023-08-11T12:22:09.068210+0000","last_peered":"2023-08-11T12:22:09.068210+0000","last_clean":"2023-08-11T12:22:09.068210+0000","last_became_active":"2023-08-11T12:22:08.068205+0000","last_became_peered":"2023-08-11T12:22:08.068205+0000","last_unstale":"2023-08-11T12:22:09.068210+0000","last_undegraded":"2023-08-11T12:22:09.068210+0000","last_fullsized":"2023-08-11T12:22:09.068210+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:58:49.800844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.878740+0000","last_change":"2023-08-11T12:22:03.837843+0000","last_active":"2023-08-11T12:22:08.878740+0000","last_peered":"2023-08-11T12:22:08.878740+0000","last_clean":"2023-08-11T12:22:08.878740+0000","last_became_active":"2023-08-11T12:22:03.837537+0000","last_became_peered":"2023-08-11T12:22:03.837537+0000","last_unstale":"2023-08-11T12:22:08.878740+0000","last_undegraded":"2023-08-11T12:22:08.878740+0000","last_fullsized":"2023-08-11T12:22:08.878740+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:22:17.517258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'3","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:29.683836+0000","last_change":"2023-08-11T12:22:02.843150+0000","last_active":"2023-08-11T12:22:29.683836+0000","last_peered":"2023-08-11T12:22:29.683836+0000","last_clean":"2023-08-11T12:22:29.683836+0000","last_became_active":"2023-08-11T12:22:02.842829+0000","last_became_peered":"2023-08-11T12:22:02.842829+0000","last_unstale":"2023-08-11T12:22:29.683836+0000","last_undegraded":"2023-08-11T12:22:29.683836+0000","last_fullsized":"2023-08-11T12:22:29.683836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:02:01.110571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.722844+0000","last_change":"2023-08-11T12:22:07.883050+0000","last_active":"2023-08-11T12:22:30.722844+0000","last_peered":"2023-08-11T12:22:30.722844+0000","last_clean":"2023-08-11T12:22:30.722844+0000","last_became_active":"2023-08-11T12:22:07.882423+0000","last_became_peered":"2023-08-11T12:22:07.882423+0000","last_unstale":"2023-08-11T12:22:30.722844+0000","last_undegraded":"2023-08-11T12:22:30.722844+0000","last_fullsized":"2023-08-11T12:22:30.722844+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:56:11.400367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"87'1","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:28.723841+0000","last_change":"2023-08-11T12:22:02.850632+0000","last_active":"2023-08-11T12:22:28.723841+0000","last_peered":"2023-08-11T12:22:28.723841+0000","last_clean":"2023-08-11T12:22:28.723841+0000","last_became_active":"2023-08-11T12:22:02.850312+0000","last_became_peered":"2023-08-11T12:22:02.850312+0000","last_unstale":"2023-08-11T12:22:28.723841+0000","last_undegraded":"2023-08-11T12:22:28.723841+0000","last_fullsized":"2023-08-11T12:22:28.723841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:17:36.156598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879376+0000","last_change":"2023-08-11T12:22:03.839869+0000","last_active":"2023-08-11T12:22:08.879376+0000","last_peered":"2023-08-11T12:22:08.879376+0000","last_clean":"2023-08-11T12:22:08.879376+0000","last_became_active":"2023-08-11T12:22:03.839486+0000","last_became_peered":"2023-08-11T12:22:03.839486+0000","last_unstale":"2023-08-11T12:22:08.879376+0000","last_undegraded":"2023-08-11T12:22:08.879376+0000","last_fullsized":"2023-08-11T12:22:08.879376+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:49:22.752990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067561+0000","last_change":"2023-08-11T12:22:08.066877+0000","last_active":"2023-08-11T12:22:09.067561+0000","last_peered":"2023-08-11T12:22:09.067561+0000","last_clean":"2023-08-11T12:22:09.067561+0000","last_became_active":"2023-08-11T12:22:08.066418+0000","last_became_peered":"2023-08-11T12:22:08.066418+0000","last_unstale":"2023-08-11T12:22:09.067561+0000","last_undegraded":"2023-08-11T12:22:09.067561+0000","last_fullsized":"2023-08-11T12:22:09.067561+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:57:08.687973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'1","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067500+0000","last_change":"2023-08-11T12:22:02.850505+0000","last_active":"2023-08-11T12:22:09.067500+0000","last_peered":"2023-08-11T12:22:09.067500+0000","last_clean":"2023-08-11T12:22:09.067500+0000","last_became_active":"2023-08-11T12:22:02.850104+0000","last_became_peered":"2023-08-11T12:22:02.850104+0000","last_unstale":"2023-08-11T12:22:09.067500+0000","last_undegraded":"2023-08-11T12:22:09.067500+0000","last_fullsized":"2023-08-11T12:22:09.067500+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:39:39.083894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068068+0000","last_change":"2023-08-11T12:22:03.837580+0000","last_active":"2023-08-11T12:22:09.068068+0000","last_peered":"2023-08-11T12:22:09.068068+0000","last_clean":"2023-08-11T12:22:09.068068+0000","last_became_active":"2023-08-11T12:22:03.837256+0000","last_became_peered":"2023-08-11T12:22:03.837256+0000","last_unstale":"2023-08-11T12:22:09.068068+0000","last_undegraded":"2023-08-11T12:22:09.068068+0000","last_fullsized":"2023-08-11T12:22:09.068068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:13:43.832719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066507+0000","last_change":"2023-08-11T12:22:07.873613+0000","last_active":"2023-08-11T12:22:09.066507+0000","last_peered":"2023-08-11T12:22:09.066507+0000","last_clean":"2023-08-11T12:22:09.066507+0000","last_became_active":"2023-08-11T12:22:07.873149+0000","last_became_peered":"2023-08-11T12:22:07.873149+0000","last_unstale":"2023-08-11T12:22:09.066507+0000","last_undegraded":"2023-08-11T12:22:09.066507+0000","last_fullsized":"2023-08-11T12:22:09.066507+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:18:27.597239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"82'2","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066917+0000","last_change":"2023-08-11T12:22:02.843146+0000","last_active":"2023-08-11T12:22:09.066917+0000","last_peered":"2023-08-11T12:22:09.066917+0000","last_clean":"2023-08-11T12:22:09.066917+0000","last_became_active":"2023-08-11T12:22:02.842663+0000","last_became_peered":"2023-08-11T12:22:02.842663+0000","last_unstale":"2023-08-11T12:22:09.066917+0000","last_undegraded":"2023-08-11T12:22:09.066917+0000","last_fullsized":"2023-08-11T12:22:09.066917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:07:46.505063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716061+0000","last_change":"2023-08-11T12:22:03.847351+0000","last_active":"2023-08-11T12:22:30.716061+0000","last_peered":"2023-08-11T12:22:30.716061+0000","last_clean":"2023-08-11T12:22:30.716061+0000","last_became_active":"2023-08-11T12:22:03.847044+0000","last_became_peered":"2023-08-11T12:22:03.847044+0000","last_unstale":"2023-08-11T12:22:30.716061+0000","last_undegraded":"2023-08-11T12:22:30.716061+0000","last_fullsized":"2023-08-11T12:22:30.716061+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:03:33.785374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066461+0000","last_change":"2023-08-11T12:22:08.068459+0000","last_active":"2023-08-11T12:22:09.066461+0000","last_peered":"2023-08-11T12:22:09.066461+0000","last_clean":"2023-08-11T12:22:09.066461+0000","last_became_active":"2023-08-11T12:22:08.067857+0000","last_became_peered":"2023-08-11T12:22:08.067857+0000","last_unstale":"2023-08-11T12:22:09.066461+0000","last_undegraded":"2023-08-11T12:22:09.066461+0000","last_fullsized":"2023-08-11T12:22:09.066461+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:04:45.455163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.969839+0000","last_change":"2023-08-11T12:22:02.846441+0000","last_active":"2023-08-11T12:22:08.969839+0000","last_peered":"2023-08-11T12:22:08.969839+0000","last_clean":"2023-08-11T12:22:08.969839+0000","last_became_active":"2023-08-11T12:22:02.846153+0000","last_became_peered":"2023-08-11T12:22:02.846153+0000","last_unstale":"2023-08-11T12:22:08.969839+0000","last_undegraded":"2023-08-11T12:22:08.969839+0000","last_fullsized":"2023-08-11T12:22:08.969839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:16:33.873694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879314+0000","last_change":"2023-08-11T12:22:03.841932+0000","last_active":"2023-08-11T12:22:08.879314+0000","last_peered":"2023-08-11T12:22:08.879314+0000","last_clean":"2023-08-11T12:22:08.879314+0000","last_became_active":"2023-08-11T12:22:03.841635+0000","last_became_peered":"2023-08-11T12:22:03.841635+0000","last_unstale":"2023-08-11T12:22:08.879314+0000","last_undegraded":"2023-08-11T12:22:08.879314+0000","last_fullsized":"2023-08-11T12:22:08.879314+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:29:41.880454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068562+0000","last_change":"2023-08-11T12:22:07.886160+0000","last_active":"2023-08-11T12:22:09.068562+0000","last_peered":"2023-08-11T12:22:09.068562+0000","last_clean":"2023-08-11T12:22:09.068562+0000","last_became_active":"2023-08-11T12:22:07.885703+0000","last_became_peered":"2023-08-11T12:22:07.885703+0000","last_unstale":"2023-08-11T12:22:09.068562+0000","last_undegraded":"2023-08-11T12:22:09.068562+0000","last_fullsized":"2023-08-11T12:22:09.068562+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:42:24.302734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"87'3","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:28.723203+0000","last_change":"2023-08-11T12:22:02.849360+0000","last_active":"2023-08-11T12:22:28.723203+0000","last_peered":"2023-08-11T12:22:28.723203+0000","last_clean":"2023-08-11T12:22:28.723203+0000","last_became_active":"2023-08-11T12:22:02.849028+0000","last_became_peered":"2023-08-11T12:22:02.849028+0000","last_unstale":"2023-08-11T12:22:28.723203+0000","last_undegraded":"2023-08-11T12:22:28.723203+0000","last_fullsized":"2023-08-11T12:22:28.723203+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:07:06.158016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.722533+0000","last_change":"2023-08-11T12:22:03.850285+0000","last_active":"2023-08-11T12:22:30.722533+0000","last_peered":"2023-08-11T12:22:30.722533+0000","last_clean":"2023-08-11T12:22:30.722533+0000","last_became_active":"2023-08-11T12:22:03.849978+0000","last_became_peered":"2023-08-11T12:22:03.849978+0000","last_unstale":"2023-08-11T12:22:30.722533+0000","last_undegraded":"2023-08-11T12:22:30.722533+0000","last_fullsized":"2023-08-11T12:22:30.722533+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:46:04.770888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066835+0000","last_change":"2023-08-11T12:22:07.881578+0000","last_active":"2023-08-11T12:22:09.066835+0000","last_peered":"2023-08-11T12:22:09.066835+0000","last_clean":"2023-08-11T12:22:09.066835+0000","last_became_active":"2023-08-11T12:22:07.881145+0000","last_became_peered":"2023-08-11T12:22:07.881145+0000","last_unstale":"2023-08-11T12:22:09.066835+0000","last_undegraded":"2023-08-11T12:22:09.066835+0000","last_fullsized":"2023-08-11T12:22:09.066835+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:07:17.931014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066542+0000","last_change":"2023-08-11T12:22:02.848875+0000","last_active":"2023-08-11T12:22:09.066542+0000","last_peered":"2023-08-11T12:22:09.066542+0000","last_clean":"2023-08-11T12:22:09.066542+0000","last_became_active":"2023-08-11T12:22:02.848578+0000","last_became_peered":"2023-08-11T12:22:02.848578+0000","last_unstale":"2023-08-11T12:22:09.066542+0000","last_undegraded":"2023-08-11T12:22:09.066542+0000","last_fullsized":"2023-08-11T12:22:09.066542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:57:52.903483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068323+0000","last_change":"2023-08-11T12:22:03.849865+0000","last_active":"2023-08-11T12:22:09.068323+0000","last_peered":"2023-08-11T12:22:09.068323+0000","last_clean":"2023-08-11T12:22:09.068323+0000","last_became_active":"2023-08-11T12:22:03.849557+0000","last_became_peered":"2023-08-11T12:22:03.849557+0000","last_unstale":"2023-08-11T12:22:09.068323+0000","last_undegraded":"2023-08-11T12:22:09.068323+0000","last_fullsized":"2023-08-11T12:22:09.068323+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:17:08.368108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066684+0000","last_change":"2023-08-11T12:22:08.067009+0000","last_active":"2023-08-11T12:22:09.066684+0000","last_peered":"2023-08-11T12:22:09.066684+0000","last_clean":"2023-08-11T12:22:09.066684+0000","last_became_active":"2023-08-11T12:22:08.066477+0000","last_became_peered":"2023-08-11T12:22:08.066477+0000","last_unstale":"2023-08-11T12:22:09.066684+0000","last_undegraded":"2023-08-11T12:22:09.066684+0000","last_fullsized":"2023-08-11T12:22:09.066684+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:05:08.273531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":2,"reported_epoch":88,"state":"peering","last_fresh":"2023-08-11T12:22:08.879523+0000","last_change":"2023-08-11T12:22:30.923867+0000","last_active":"2023-08-11T12:22:30.923867+0000","last_peered":"2023-08-11T12:22:08.879523+0000","last_clean":"2023-08-11T12:22:08.879523+0000","last_became_active":"2023-08-11T12:22:02.847394+0000","last_became_peered":"2023-08-11T12:22:02.847394+0000","last_unstale":"2023-08-11T12:22:08.879523+0000","last_undegraded":"2023-08-11T12:22:08.879523+0000","last_fullsized":"2023-08-11T12:22:08.879523+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880009+0000","last_change":"2023-08-11T12:22:03.848715+0000","last_active":"2023-08-11T12:22:08.880009+0000","last_peered":"2023-08-11T12:22:08.880009+0000","last_clean":"2023-08-11T12:22:08.880009+0000","last_became_active":"2023-08-11T12:22:03.848311+0000","last_became_peered":"2023-08-11T12:22:03.848311+0000","last_unstale":"2023-08-11T12:22:08.880009+0000","last_undegraded":"2023-08-11T12:22:08.880009+0000","last_fullsized":"2023-08-11T12:22:08.880009+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:58:34.865429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.969957+0000","last_change":"2023-08-11T12:22:07.882566+0000","last_active":"2023-08-11T12:22:08.969957+0000","last_peered":"2023-08-11T12:22:08.969957+0000","last_clean":"2023-08-11T12:22:08.969957+0000","last_became_active":"2023-08-11T12:22:07.882198+0000","last_became_peered":"2023-08-11T12:22:07.882198+0000","last_unstale":"2023-08-11T12:22:08.969957+0000","last_undegraded":"2023-08-11T12:22:08.969957+0000","last_fullsized":"2023-08-11T12:22:08.969957+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:59:38.231276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066849+0000","last_change":"2023-08-11T12:22:02.846424+0000","last_active":"2023-08-11T12:22:09.066849+0000","last_peered":"2023-08-11T12:22:09.066849+0000","last_clean":"2023-08-11T12:22:09.066849+0000","last_became_active":"2023-08-11T12:22:02.846063+0000","last_became_peered":"2023-08-11T12:22:02.846063+0000","last_unstale":"2023-08-11T12:22:09.066849+0000","last_undegraded":"2023-08-11T12:22:09.066849+0000","last_fullsized":"2023-08-11T12:22:09.066849+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:09:23.947071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880442+0000","last_change":"2023-08-11T12:22:03.845616+0000","last_active":"2023-08-11T12:22:08.880442+0000","last_peered":"2023-08-11T12:22:08.880442+0000","last_clean":"2023-08-11T12:22:08.880442+0000","last_became_active":"2023-08-11T12:22:03.845293+0000","last_became_peered":"2023-08-11T12:22:03.845293+0000","last_unstale":"2023-08-11T12:22:08.880442+0000","last_undegraded":"2023-08-11T12:22:08.880442+0000","last_fullsized":"2023-08-11T12:22:08.880442+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:43:24.438207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716312+0000","last_change":"2023-08-11T12:22:07.888963+0000","last_active":"2023-08-11T12:22:30.716312+0000","last_peered":"2023-08-11T12:22:30.716312+0000","last_clean":"2023-08-11T12:22:30.716312+0000","last_became_active":"2023-08-11T12:22:07.888513+0000","last_became_peered":"2023-08-11T12:22:07.888513+0000","last_unstale":"2023-08-11T12:22:30.716312+0000","last_undegraded":"2023-08-11T12:22:30.716312+0000","last_fullsized":"2023-08-11T12:22:30.716312+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:23:50.241697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068238+0000","last_change":"2023-08-11T12:22:02.850739+0000","last_active":"2023-08-11T12:22:09.068238+0000","last_peered":"2023-08-11T12:22:09.068238+0000","last_clean":"2023-08-11T12:22:09.068238+0000","last_became_active":"2023-08-11T12:22:02.850455+0000","last_became_peered":"2023-08-11T12:22:02.850455+0000","last_unstale":"2023-08-11T12:22:09.068238+0000","last_undegraded":"2023-08-11T12:22:09.068238+0000","last_fullsized":"2023-08-11T12:22:09.068238+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:48:26.768060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880073+0000","last_change":"2023-08-11T12:22:03.838834+0000","last_active":"2023-08-11T12:22:08.880073+0000","last_peered":"2023-08-11T12:22:08.880073+0000","last_clean":"2023-08-11T12:22:08.880073+0000","last_became_active":"2023-08-11T12:22:03.838435+0000","last_became_peered":"2023-08-11T12:22:03.838435+0000","last_unstale":"2023-08-11T12:22:08.880073+0000","last_undegraded":"2023-08-11T12:22:08.880073+0000","last_fullsized":"2023-08-11T12:22:08.880073+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:01:44.440343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066277+0000","last_change":"2023-08-11T12:22:07.884481+0000","last_active":"2023-08-11T12:22:09.066277+0000","last_peered":"2023-08-11T12:22:09.066277+0000","last_clean":"2023-08-11T12:22:09.066277+0000","last_became_active":"2023-08-11T12:22:07.884084+0000","last_became_peered":"2023-08-11T12:22:07.884084+0000","last_unstale":"2023-08-11T12:22:09.066277+0000","last_undegraded":"2023-08-11T12:22:09.066277+0000","last_fullsized":"2023-08-11T12:22:09.066277+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:54:33.489782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879471+0000","last_change":"2023-08-11T12:22:02.849339+0000","last_active":"2023-08-11T12:22:08.879471+0000","last_peered":"2023-08-11T12:22:08.879471+0000","last_clean":"2023-08-11T12:22:08.879471+0000","last_became_active":"2023-08-11T12:22:02.848986+0000","last_became_peered":"2023-08-11T12:22:02.848986+0000","last_unstale":"2023-08-11T12:22:08.879471+0000","last_undegraded":"2023-08-11T12:22:08.879471+0000","last_fullsized":"2023-08-11T12:22:08.879471+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:54:41.533973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880177+0000","last_change":"2023-08-11T12:22:03.846301+0000","last_active":"2023-08-11T12:22:08.880177+0000","last_peered":"2023-08-11T12:22:08.880177+0000","last_clean":"2023-08-11T12:22:08.880177+0000","last_became_active":"2023-08-11T12:22:03.845990+0000","last_became_peered":"2023-08-11T12:22:03.845990+0000","last_unstale":"2023-08-11T12:22:08.880177+0000","last_undegraded":"2023-08-11T12:22:08.880177+0000","last_fullsized":"2023-08-11T12:22:08.880177+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:13:13.325427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.722464+0000","last_change":"2023-08-11T12:22:03.836652+0000","last_active":"2023-08-11T12:22:30.722464+0000","last_peered":"2023-08-11T12:22:30.722464+0000","last_clean":"2023-08-11T12:22:30.722464+0000","last_became_active":"2023-08-11T12:22:03.836236+0000","last_became_peered":"2023-08-11T12:22:03.836236+0000","last_unstale":"2023-08-11T12:22:30.722464+0000","last_undegraded":"2023-08-11T12:22:30.722464+0000","last_fullsized":"2023-08-11T12:22:30.722464+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:22:25.801143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067076+0000","last_change":"2023-08-11T12:22:03.831318+0000","last_active":"2023-08-11T12:22:09.067076+0000","last_peered":"2023-08-11T12:22:09.067076+0000","last_clean":"2023-08-11T12:22:09.067076+0000","last_became_active":"2023-08-11T12:22:03.830670+0000","last_became_peered":"2023-08-11T12:22:03.830670+0000","last_unstale":"2023-08-11T12:22:09.067076+0000","last_undegraded":"2023-08-11T12:22:09.067076+0000","last_fullsized":"2023-08-11T12:22:09.067076+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:26:18.125172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066384+0000","last_change":"2023-08-11T12:22:03.841396+0000","last_active":"2023-08-11T12:22:09.066384+0000","last_peered":"2023-08-11T12:22:09.066384+0000","last_clean":"2023-08-11T12:22:09.066384+0000","last_became_active":"2023-08-11T12:22:03.841076+0000","last_became_peered":"2023-08-11T12:22:03.841076+0000","last_unstale":"2023-08-11T12:22:09.066384+0000","last_undegraded":"2023-08-11T12:22:09.066384+0000","last_fullsized":"2023-08-11T12:22:09.066384+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:31:49.747283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716636+0000","last_change":"2023-08-11T12:22:03.847266+0000","last_active":"2023-08-11T12:22:30.716636+0000","last_peered":"2023-08-11T12:22:30.716636+0000","last_clean":"2023-08-11T12:22:30.716636+0000","last_became_active":"2023-08-11T12:22:03.846898+0000","last_became_peered":"2023-08-11T12:22:03.846898+0000","last_unstale":"2023-08-11T12:22:30.716636+0000","last_undegraded":"2023-08-11T12:22:30.716636+0000","last_fullsized":"2023-08-11T12:22:30.716636+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:01:44.284193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879562+0000","last_change":"2023-08-11T12:22:03.843491+0000","last_active":"2023-08-11T12:22:08.879562+0000","last_peered":"2023-08-11T12:22:08.879562+0000","last_clean":"2023-08-11T12:22:08.879562+0000","last_became_active":"2023-08-11T12:22:03.843099+0000","last_became_peered":"2023-08-11T12:22:03.843099+0000","last_unstale":"2023-08-11T12:22:08.879562+0000","last_undegraded":"2023-08-11T12:22:08.879562+0000","last_fullsized":"2023-08-11T12:22:08.879562+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:06:59.399331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.724108+0000","last_change":"2023-08-11T12:22:03.840508+0000","last_active":"2023-08-11T12:22:30.724108+0000","last_peered":"2023-08-11T12:22:30.724108+0000","last_clean":"2023-08-11T12:22:30.724108+0000","last_became_active":"2023-08-11T12:22:03.840160+0000","last_became_peered":"2023-08-11T12:22:03.840160+0000","last_unstale":"2023-08-11T12:22:30.724108+0000","last_undegraded":"2023-08-11T12:22:30.724108+0000","last_fullsized":"2023-08-11T12:22:30.724108+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:42:10.983782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067345+0000","last_change":"2023-08-11T12:22:03.843724+0000","last_active":"2023-08-11T12:22:09.067345+0000","last_peered":"2023-08-11T12:22:09.067345+0000","last_clean":"2023-08-11T12:22:09.067345+0000","last_became_active":"2023-08-11T12:22:03.843431+0000","last_became_peered":"2023-08-11T12:22:03.843431+0000","last_unstale":"2023-08-11T12:22:09.067345+0000","last_undegraded":"2023-08-11T12:22:09.067345+0000","last_fullsized":"2023-08-11T12:22:09.067345+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:31:51.191070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068290+0000","last_change":"2023-08-11T12:22:03.831268+0000","last_active":"2023-08-11T12:22:09.068290+0000","last_peered":"2023-08-11T12:22:09.068290+0000","last_clean":"2023-08-11T12:22:09.068290+0000","last_became_active":"2023-08-11T12:22:03.830839+0000","last_became_peered":"2023-08-11T12:22:03.830839+0000","last_unstale":"2023-08-11T12:22:09.068290+0000","last_undegraded":"2023-08-11T12:22:09.068290+0000","last_fullsized":"2023-08-11T12:22:09.068290+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:56:40.087593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066807+0000","last_change":"2023-08-11T12:22:03.839227+0000","last_active":"2023-08-11T12:22:09.066807+0000","last_peered":"2023-08-11T12:22:09.066807+0000","last_clean":"2023-08-11T12:22:09.066807+0000","last_became_active":"2023-08-11T12:22:03.838526+0000","last_became_peered":"2023-08-11T12:22:03.838526+0000","last_unstale":"2023-08-11T12:22:09.066807+0000","last_undegraded":"2023-08-11T12:22:09.066807+0000","last_fullsized":"2023-08-11T12:22:09.066807+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:01:52.337807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067944+0000","last_change":"2023-08-11T12:22:03.834614+0000","last_active":"2023-08-11T12:22:09.067944+0000","last_peered":"2023-08-11T12:22:09.067944+0000","last_clean":"2023-08-11T12:22:09.067944+0000","last_became_active":"2023-08-11T12:22:03.834267+0000","last_became_peered":"2023-08-11T12:22:03.834267+0000","last_unstale":"2023-08-11T12:22:09.067944+0000","last_undegraded":"2023-08-11T12:22:09.067944+0000","last_fullsized":"2023-08-11T12:22:09.067944+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:22:51.239980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.970204+0000","last_change":"2023-08-11T12:22:03.846504+0000","last_active":"2023-08-11T12:22:08.970204+0000","last_peered":"2023-08-11T12:22:08.970204+0000","last_clean":"2023-08-11T12:22:08.970204+0000","last_became_active":"2023-08-11T12:22:03.846156+0000","last_became_peered":"2023-08-11T12:22:03.846156+0000","last_unstale":"2023-08-11T12:22:08.970204+0000","last_undegraded":"2023-08-11T12:22:08.970204+0000","last_fullsized":"2023-08-11T12:22:08.970204+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:37:05.136958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879069+0000","last_change":"2023-08-11T12:22:03.849854+0000","last_active":"2023-08-11T12:22:08.879069+0000","last_peered":"2023-08-11T12:22:08.879069+0000","last_clean":"2023-08-11T12:22:08.879069+0000","last_became_active":"2023-08-11T12:22:03.849553+0000","last_became_peered":"2023-08-11T12:22:03.849553+0000","last_unstale":"2023-08-11T12:22:08.879069+0000","last_undegraded":"2023-08-11T12:22:08.879069+0000","last_fullsized":"2023-08-11T12:22:08.879069+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:28:10.396410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.723809+0000","last_change":"2023-08-11T12:22:03.843511+0000","last_active":"2023-08-11T12:22:30.723809+0000","last_peered":"2023-08-11T12:22:30.723809+0000","last_clean":"2023-08-11T12:22:30.723809+0000","last_became_active":"2023-08-11T12:22:03.843206+0000","last_became_peered":"2023-08-11T12:22:03.843206+0000","last_unstale":"2023-08-11T12:22:30.723809+0000","last_undegraded":"2023-08-11T12:22:30.723809+0000","last_fullsized":"2023-08-11T12:22:30.723809+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:15:11.117760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":248338,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4954,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":7,"num_read_kb":9,"num_write":86,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200704,"data_stored":20618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449106,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":464654,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.753},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.76700000000000002}]},{"osd":1,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.61299999999999999}]},{"osd":2,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.66600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":4,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.88300000000000001}]},{"osd":6,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.81000000000000005}]},{"osd":7,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.82499999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":9,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.98199999999999998}]},{"osd":10,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.94099999999999995}]}]},{"osd":10,"up_from":71,"seq":304942678036,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":1058957,"data_compressed":47603,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":1,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.42699999999999999}]},{"osd":2,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.58299999999999996}]},{"osd":3,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.64800000000000002}]},{"osd":4,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.71299999999999997}]},{"osd":5,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.629},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.78300000000000003}]},{"osd":6,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.75600000000000001}]},{"osd":7,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.59099999999999997}]},{"osd":8,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.86799999999999999}]},{"osd":9,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.90500000000000003}]},{"osd":11,"last update":"Fri Aug 11 12:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.85299999999999998}]}]},{"osd":9,"up_from":66,"seq":283467841560,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":942080,"data_stored":464654,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.35899999999999999}]},{"osd":1,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.66300000000000003}]},{"osd":2,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.89700000000000002}]},{"osd":3,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.46700000000000003}]},{"osd":4,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.62},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.76600000000000001}]},{"osd":5,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.78300000000000003}]},{"osd":6,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.58999999999999997}]},{"osd":8,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.79800000000000004}]},{"osd":10,"last update":"Fri Aug 11 12:21:54 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.75},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.94399999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]}]},{"osd":8,"up_from":58,"seq":249108103199,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":464810,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.45700000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.75700000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72199999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.81100000000000005}]},{"osd":1,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.443,"5min":0.372,"15min":0.372},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54900000000000004}]},{"osd":2,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.437,"15min":0.42699999999999999},"min":{"1min":0.34100000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.45000000000000001,"15min":0.439},"min":{"1min":0.32500000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.76900000000000002,"5min":0.878,"15min":0.878},"last":0.39300000000000002}]},{"osd":3,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63700000000000001,"15min":0.63900000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82399999999999995,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.61899999999999999,"15min":0.60999999999999999},"min":{"1min":0.42899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.92900000000000005}]},{"osd":4,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.44500000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.66200000000000003,"15min":0.65200000000000002},"min":{"1min":0.49299999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.56599999999999995}]},{"osd":5,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.54300000000000004,"15min":0.52900000000000003},"min":{"1min":0.34899999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.44},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.57899999999999996,"15min":0.56299999999999994},"min":{"1min":0.40600000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.41699999999999998}]},{"osd":6,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.69799999999999995,"15min":0.68500000000000005},"min":{"1min":0.51300000000000001,"5min":0.441,"15min":0.441},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.72599999999999998,"15min":0.71499999999999997},"min":{"1min":0.59499999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.82499999999999996}]},{"osd":7,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.70699999999999996,"15min":0.69099999999999995},"min":{"1min":0.54200000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72299999999999998,"15min":0.71299999999999997},"min":{"1min":0.48899999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.58099999999999996}]},{"osd":9,"last update":"Fri Aug 11 12:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.86599999999999999}]},{"osd":10,"last update":"Fri Aug 11 12:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.89800000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":7,"up_from":51,"seq":219043332130,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":1055371,"data_compressed":47603,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.61399999999999999,"15min":0.60599999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.55200000000000005,"15min":0.53700000000000003},"min":{"1min":0.46999999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.65700000000000003}]},{"osd":1,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.41099999999999998,"15min":0.40100000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.45000000000000001,"15min":0.442},"min":{"1min":0.312,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.54400000000000004}]},{"osd":2,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.42899999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.59099999999999997,"15min":0.57999999999999996},"min":{"1min":0.498,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80900000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.61399999999999999}]},{"osd":3,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.61499999999999999,"15min":0.60699999999999998},"min":{"1min":0.432,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.64000000000000001,"15min":0.626},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.66100000000000003}]},{"osd":4,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.54400000000000004,"15min":0.53600000000000003},"min":{"1min":0.36199999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.434},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53800000000000003,"15min":0.53500000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.0149999999999999,"5min":1.105,"15min":1.105},"last":0.48499999999999999}]},{"osd":5,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.66300000000000003,"15min":0.65600000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.66200000000000003,"15min":0.65600000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.68600000000000005}]},{"osd":6,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.73299999999999998,"15min":0.71699999999999997},"min":{"1min":0.59399999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.70199999999999996,"15min":0.68500000000000005},"min":{"1min":0.59399999999999997,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.56399999999999995}]},{"osd":8,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.70099999999999996,"15min":0.68300000000000005},"min":{"1min":0.56899999999999995,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.69399999999999995,"15min":0.68000000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.78500000000000003}]},{"osd":9,"last update":"Fri Aug 11 12:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.75900000000000001}]},{"osd":10,"last update":"Fri Aug 11 12:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.80300000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]}]},{"osd":6,"up_from":46,"seq":197568495656,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":464072,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47499999999999998,"15min":0.46300000000000002},"min":{"1min":0.37,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.73599999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.435},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51800000000000002,"15min":0.50800000000000001},"min":{"1min":0.375,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61599999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.50900000000000001}]},{"osd":1,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.65400000000000003,"15min":0.63},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.878,"5min":1.327,"15min":1.327},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.69199999999999995,"15min":0.67500000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98599999999999999,"5min":1.206,"15min":1.206},"last":0.60299999999999998}]},{"osd":2,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.69199999999999995,"15min":0.68799999999999994},"min":{"1min":0.51000000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98399999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.70599999999999996,"15min":0.69299999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.63600000000000001}]},{"osd":3,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59699999999999998,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67400000000000004,"15min":0.66200000000000003},"min":{"1min":0.48499999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.05,"5min":1.196,"15min":1.196},"last":0.66100000000000003}]},{"osd":4,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69799999999999995,"15min":0.69599999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97199999999999998,"5min":1.139,"15min":1.139},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.752,"15min":0.74099999999999999},"min":{"1min":0.52600000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.012,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.81200000000000006}]},{"osd":5,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.77800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56599999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1499999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80600000000000005,"15min":0.80500000000000005},"min":{"1min":0.59299999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0109999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.84799999999999998}]},{"osd":7,"last update":"Fri Aug 11 12:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.81599999999999995,"15min":0.80400000000000005},"min":{"1min":0.59199999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.177,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.82099999999999995,"15min":0.81299999999999994},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.90600000000000003}]},{"osd":8,"last update":"Fri Aug 11 12:22:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.83199999999999996,"15min":0.83699999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.079,"5min":1.284,"15min":1.284},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.877,"15min":0.88500000000000001},"min":{"1min":0.65500000000000003,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1839999999999999,"5min":1.387,"15min":1.387},"last":0.83099999999999996}]},{"osd":9,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.86799999999999999}]},{"osd":10,"last update":"Fri Aug 11 12:21:54 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.88100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":467914,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.53400000000000003,"15min":0.51200000000000001},"min":{"1min":0.35099999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.96099999999999997,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.55500000000000005,"15min":0.56299999999999994},"min":{"1min":0.378,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.83199999999999996,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.69399999999999995}]},{"osd":2,"last update":"Fri Aug 11 12:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.40699999999999997,"5min":0.315,"15min":0.315},"max":{"1min":0.76000000000000001,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.53800000000000003,"15min":0.51100000000000001},"min":{"1min":0.40300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79400000000000004,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.752}]},{"osd":3,"last update":"Fri Aug 11 12:22:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80700000000000005,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65600000000000003,"15min":0.63200000000000001},"min":{"1min":0.49099999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90600000000000003,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.77500000000000002}]},{"osd":4,"last update":"Fri Aug 11 12:21:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46200000000000002,"15min":0.44500000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.745,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.47699999999999998,"15min":0.47299999999999998},"min":{"1min":0.26500000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.63,"15min":0.60799999999999998},"min":{"1min":0.44,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89000000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.60899999999999999,"15min":0.60099999999999998},"min":{"1min":0.48399999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.80900000000000005}]},{"osd":6,"last update":"Fri Aug 11 12:21:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72999999999999998,"15min":0.73499999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94399999999999995,"5min":1.095,"15min":1.095},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78000000000000003,"15min":0.78200000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.99299999999999999,"5min":1.159,"15min":1.159},"last":0.88900000000000001}]},{"osd":7,"last update":"Fri Aug 11 12:21:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.35799999999999998,"5min":0.31,"15min":0.31},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.90600000000000003}]},{"osd":8,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72799999999999998,"15min":0.72199999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93400000000000005,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.74199999999999999,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.436,"15min":0.436},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":1.008}]},{"osd":9,"last update":"Fri Aug 11 12:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.871},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.96499999999999997}]},{"osd":10,"last update":"Fri Aug 11 12:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.93400000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738435,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":465550,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 11 12:21:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.57799999999999996,"15min":0.52800000000000002},"min":{"1min":0.42899999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.96699999999999997,"5min":1.782,"15min":1.782},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.58799999999999997,"15min":0.53800000000000003},"min":{"1min":0.46400000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.069,"5min":2.7749999999999999,"15min":2.7749999999999999},"last":0.68200000000000005}]},{"osd":2,"last update":"Fri Aug 11 12:21:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59399999999999997,"15min":0.55300000000000005},"min":{"1min":0.40799999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.63400000000000001,"15min":0.57799999999999996},"min":{"1min":0.46400000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94699999999999995,"5min":1.879,"15min":1.879},"last":0.60699999999999998}]},{"osd":3,"last update":"Fri Aug 11 12:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.49399999999999999,"15min":0.48099999999999998},"min":{"1min":0.40500000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.36599999999999999}]},{"osd":4,"last update":"Fri Aug 11 12:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.66100000000000003,"15min":0.61199999999999999},"min":{"1min":0.503,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.016,"5min":1.849,"15min":1.849},"last":0.501},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.67800000000000005,"15min":0.63100000000000001},"min":{"1min":0.54600000000000004,"5min":0.443,"15min":0.443},"max":{"1min":1.085,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":0.42999999999999999}]},{"osd":5,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.71899999999999997,"15min":0.68999999999999995},"min":{"1min":0.54800000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.99399999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.748,"15min":0.71999999999999997},"min":{"1min":0.55200000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1020000000000001,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.82799999999999996}]},{"osd":6,"last update":"Fri Aug 11 12:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97699999999999998,"5min":2.8839999999999999,"15min":2.8839999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.70999999999999996,"15min":0.71599999999999997},"min":{"1min":0.41299999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.95799999999999996,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.76900000000000002}]},{"osd":7,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83799999999999997,"15min":0.83699999999999997},"min":{"1min":0.55400000000000005,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.409,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.628},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.91500000000000004,"15min":0.92600000000000005},"min":{"1min":0.61399999999999999,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.385,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.55100000000000005}]},{"osd":8,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.82899999999999996,"15min":0.84399999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.91800000000000004,"5min":1.262,"15min":1.262},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.92200000000000004,"15min":0.93700000000000006},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.079,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.65100000000000002}]},{"osd":9,"last update":"Fri Aug 11 12:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.86299999999999999}]},{"osd":10,"last update":"Fri Aug 11 12:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.748}]},{"osd":11,"last update":"Fri Aug 11 12:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.78900000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411386,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":467279,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.60899999999999999,"15min":0.54400000000000004},"min":{"1min":0.39100000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.80900000000000005,"5min":5.968,"15min":5.968},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.40600000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.50900000000000001}]},{"osd":1,"last update":"Fri Aug 11 12:21:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.52400000000000002,"15min":0.502},"min":{"1min":0.38200000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.55000000000000004,"15min":0.52300000000000002},"min":{"1min":0.45600000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.72599999999999998}]},{"osd":3,"last update":"Fri Aug 11 12:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61299999999999999,"15min":0.59699999999999998},"min":{"1min":0.45800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.623,"15min":0.59899999999999998},"min":{"1min":0.46899999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.76300000000000001}]},{"osd":4,"last update":"Fri Aug 11 12:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.57799999999999996,"15min":0.56799999999999995},"min":{"1min":0.441,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59999999999999998,"15min":0.58699999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.70399999999999996}]},{"osd":5,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.44400000000000001,"15min":0.42799999999999999},"min":{"1min":0.31,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.622},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.46800000000000003,"15min":0.44800000000000001},"min":{"1min":0.32800000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.54000000000000004}]},{"osd":6,"last update":"Fri Aug 11 12:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.48599999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.878,"5min":0.879,"15min":0.879},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.63100000000000001,"15min":0.61599999999999999},"min":{"1min":0.53200000000000003,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.84599999999999997}]},{"osd":7,"last update":"Fri Aug 11 12:21:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.59799999999999998,"15min":0.58399999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.53100000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.88800000000000001}]},{"osd":8,"last update":"Fri Aug 11 12:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.60299999999999998,"15min":0.58899999999999997},"min":{"1min":0.40000000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.57399999999999995,"15min":0.56000000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.81299999999999994}]},{"osd":9,"last update":"Fri Aug 11 12:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.874},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.97699999999999998}]},{"osd":10,"last update":"Fri Aug 11 12:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.92200000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]}]},{"osd":3,"up_from":25,"seq":107374182453,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":464266,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.437,"15min":0.38700000000000001},"min":{"1min":0.33900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.499,"5min":0.46999999999999997,"15min":0.438},"min":{"1min":0.36299999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67300000000000004,"5min":1.006,"15min":1.006},"last":0.59899999999999998}]},{"osd":1,"last update":"Fri Aug 11 12:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64200000000000002,"15min":0.57399999999999995},"min":{"1min":0.48399999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.98599999999999999,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.63200000000000001,"15min":0.59299999999999997},"min":{"1min":0.45100000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92200000000000004,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.69699999999999995}]},{"osd":2,"last update":"Fri Aug 11 12:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.64700000000000002,"15min":0.61799999999999999},"min":{"1min":0.54600000000000004,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85099999999999998,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.69699999999999995,"15min":0.63},"min":{"1min":0.56299999999999994,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":1.018}]},{"osd":4,"last update":"Fri Aug 11 12:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.64000000000000001,"15min":0.60799999999999998},"min":{"1min":0.53100000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.68899999999999995,"15min":0.63700000000000001},"min":{"1min":0.67200000000000004,"5min":0.435,"15min":0.435},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.82699999999999996}]},{"osd":5,"last update":"Fri Aug 11 12:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.68899999999999995,"15min":0.65100000000000002},"min":{"1min":0.629,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.70899999999999996,"15min":0.66900000000000004},"min":{"1min":0.60899999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.85699999999999998}]},{"osd":6,"last update":"Fri Aug 11 12:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.77400000000000002,"15min":0.76000000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0900000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.71599999999999997,"15min":0.71099999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":1.0309999999999999}]},{"osd":7,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.78300000000000003,"15min":0.76400000000000001},"min":{"1min":0.65800000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.89900000000000002,"15min":0.88500000000000001},"min":{"1min":0.71799999999999997,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.86899999999999999}]},{"osd":8,"last update":"Fri Aug 11 12:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":1.004},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.91600000000000004}]},{"osd":9,"last update":"Fri Aug 11 12:21:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.92900000000000005}]},{"osd":10,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]}]},{"osd":4,"up_from":33,"seq":141733920817,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":942080,"data_stored":464094,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.39900000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.81599999999999995,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.41399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80900000000000005,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.72099999999999997}]},{"osd":1,"last update":"Fri Aug 11 12:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.40400000000000003,"15min":0.39600000000000002},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.38700000000000001,"15min":0.372},"min":{"1min":0.308,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.60399999999999998}]},{"osd":2,"last update":"Fri Aug 11 12:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.59699999999999998,"15min":0.57299999999999995},"min":{"1min":0.48599999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.58699999999999997,"15min":0.55900000000000005},"min":{"1min":0.54400000000000004,"5min":0.378,"15min":0.378},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.83999999999999997}]},{"osd":3,"last update":"Fri Aug 11 12:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.57699999999999996,"15min":0.55900000000000005},"min":{"1min":0.439,"5min":0.379,"15min":0.379},"max":{"1min":0.77300000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.41099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.77700000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.73199999999999998}]},{"osd":5,"last update":"Fri Aug 11 12:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.59499999999999997,"15min":0.56699999999999995},"min":{"1min":0.42199999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.60899999999999999,"15min":0.57599999999999996},"min":{"1min":0.42099999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.92900000000000005}]},{"osd":6,"last update":"Fri Aug 11 12:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.71399999999999997,"15min":0.69599999999999995},"min":{"1min":0.53400000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.63,"15min":0.61599999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.878}]},{"osd":7,"last update":"Fri Aug 11 12:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.58599999999999997,"15min":0.57099999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.64500000000000002,"15min":0.629},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":1.0189999999999999}]},{"osd":8,"last update":"Fri Aug 11 12:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.76200000000000001,"15min":0.749},"min":{"1min":0.63900000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":1.0700000000000001}]},{"osd":9,"last update":"Fri Aug 11 12:21:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":1.1459999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":1.0429999999999999}]},{"osd":10,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.80900000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]}]},{"osd":5,"up_from":38,"seq":163208757292,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":1054622,"data_compressed":47603,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.51900000000000002},"min":{"1min":0.32200000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70599999999999996,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35399999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.624,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.439}]},{"osd":1,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.38100000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77500000000000002,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.623,"5min":0.57699999999999996,"15min":0.56100000000000005},"min":{"1min":0.42099999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.83499999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.77400000000000002}]},{"osd":2,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.29799999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.41399999999999998,"15min":0.39800000000000002},"min":{"1min":0.27700000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.46999999999999997}]},{"osd":3,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72299999999999998,"5min":0.751,"15min":0.751},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.41199999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.77500000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.504}]},{"osd":4,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.61199999999999999,"15min":0.59199999999999997},"min":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1,"5min":1.016,"15min":1.016},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60899999999999999,"15min":0.60299999999999998},"min":{"1min":0.443,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.58099999999999996}]},{"osd":6,"last update":"Fri Aug 11 12:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.623,"15min":0.61099999999999999},"min":{"1min":0.40300000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89300000000000002,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.625},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.68100000000000005,"15min":0.66800000000000004},"min":{"1min":0.499,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.64500000000000002}]},{"osd":7,"last update":"Fri Aug 11 12:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.47199999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.68000000000000005}]},{"osd":8,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.60299999999999998,"15min":0.59299999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.56499999999999995,"15min":0.55800000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.69699999999999995}]},{"osd":9,"last update":"Fri Aug 11 12:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.754},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.85099999999999998}]},{"osd":10,"last update":"Fri Aug 11 12:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.72099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34304,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34304,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-11T12:22:32.153 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-11T12:22:32.154 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:31 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2023-08-11T12:22:32.154 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:31 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2023-08-11T12:22:32.154 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:31 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2023-08-11T12:22:32.155 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:31 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2023-08-11T12:22:32.155 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:31 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2023-08-11T12:22:32.155 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:31 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2023-08-11T12:22:32.155 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:31 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.11", "id": [5, 8]}]': finished 2023-08-11T12:22:32.155 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:31 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2023-08-11T12:22:32.155 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:31 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2023-08-11T12:22:32.155 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:31 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]': finished 2023-08-11T12:22:32.156 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:31 smithi045 ceph-mon[130284]: osdmap e88: 12 total, 12 up, 12 in 2023-08-11T12:22:32.156 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:31 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2514839218' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:22:32.156 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:31 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3834049020' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:32.156 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:31 smithi045 ceph-mon[130284]: mds.? [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] up:active 2023-08-11T12:22:32.156 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:31 smithi045 ceph-mon[130284]: daemon mds.k assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-08-11T12:22:32.156 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:31 smithi045 ceph-mon[130284]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-08-11T12:22:32.156 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:31 smithi045 ceph-mon[130284]: Cluster is now healthy 2023-08-11T12:22:32.157 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:31 smithi045 ceph-mon[130284]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:active} 2 up:standby-replay 6 up:standby 2023-08-11T12:22:32.157 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:31 smithi045 ceph-mon[130284]: fsmap cephfs:5 2 up:standby-replay 1 up:creating 5 up:standby 4 up:active 2023-08-11T12:22:32.157 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:31 smithi045 ceph-mon[130284]: daemon mds.k is now active in filesystem cephfs as rank 4 2023-08-11T12:22:32.157 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:31 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2023-08-11T12:22:32.157 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:31 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2023-08-11T12:22:32.157 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:31 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2023-08-11T12:22:32.158 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:31 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2023-08-11T12:22:32.158 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:31 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2023-08-11T12:22:32.158 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:31 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2023-08-11T12:22:32.158 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:31 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.11", "id": [5, 8]}]': finished 2023-08-11T12:22:32.158 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:31 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2023-08-11T12:22:32.158 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:31 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2023-08-11T12:22:32.158 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:31 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]': finished 2023-08-11T12:22:32.159 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:31 smithi194 ceph-mon[130905]: osdmap e88: 12 total, 12 up, 12 in 2023-08-11T12:22:32.159 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:31 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2514839218' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:22:32.159 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:31 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3834049020' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:32.159 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:31 smithi194 ceph-mon[130905]: mds.? [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] up:active 2023-08-11T12:22:32.159 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:31 smithi194 ceph-mon[130905]: daemon mds.k assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-08-11T12:22:32.159 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:31 smithi194 ceph-mon[130905]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-08-11T12:22:32.159 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:31 smithi194 ceph-mon[130905]: Cluster is now healthy 2023-08-11T12:22:32.160 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:31 smithi194 ceph-mon[130905]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:active} 2 up:standby-replay 6 up:standby 2023-08-11T12:22:32.160 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:31 smithi194 ceph-mon[130905]: fsmap cephfs:5 2 up:standby-replay 1 up:creating 5 up:standby 4 up:active 2023-08-11T12:22:32.160 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:31 smithi194 ceph-mon[130905]: daemon mds.k is now active in filesystem cephfs as rank 4 2023-08-11T12:22:32.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.383+0000 7f9fe0bff700 1 -- 172.21.15.8:0/541191051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9fdc108890 msgr2=0x7f9fdc10ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:32.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.383+0000 7f9fe0bff700 1 --2- 172.21.15.8:0/541191051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9fdc108890 0x7f9fdc10ad20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9fd400b0a0 tx=0x7f9fd400b3b0 comp rx=0 tx=0).stop 2023-08-11T12:22:32.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.383+0000 7f9fe0bff700 1 -- 172.21.15.8:0/541191051 shutdown_connections 2023-08-11T12:22:32.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.383+0000 7f9fe0bff700 1 --2- 172.21.15.8:0/541191051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fdc074920 0x7f9fdc072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:32.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.383+0000 7f9fe0bff700 1 --2- 172.21.15.8:0/541191051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9fdc108890 0x7f9fdc10ad20 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:32.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.383+0000 7f9fe0bff700 1 --2- 172.21.15.8:0/541191051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fdc073340 0x7f9fdc0737a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:32.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.383+0000 7f9fe0bff700 1 -- 172.21.15.8:0/541191051 >> 172.21.15.8:0/541191051 conn(0x7f9fdc0fbf50 msgr2=0x7f9fdc0fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:32.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.383+0000 7f9fe0bff700 1 -- 172.21.15.8:0/541191051 shutdown_connections 2023-08-11T12:22:32.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.383+0000 7f9fe0bff700 1 -- 172.21.15.8:0/541191051 wait complete. 2023-08-11T12:22:32.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.385+0000 7f9fe0bff700 1 Processor -- start 2023-08-11T12:22:32.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.385+0000 7f9fe0bff700 1 -- start start 2023-08-11T12:22:32.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.385+0000 7f9fe0bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fdc073340 0x7f9fdc1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:32.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.385+0000 7f9fe0bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9fdc074920 0x7f9fdc198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:32.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.385+0000 7f9fe0bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fdc108890 0x7f9fdc19ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:32.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.385+0000 7f9fe0bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc1a0520 con 0x7f9fdc074920 2023-08-11T12:22:32.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.385+0000 7f9fe0bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc1a0660 con 0x7f9fdc073340 2023-08-11T12:22:32.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.385+0000 7f9fe0bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc1a07f0 con 0x7f9fdc108890 2023-08-11T12:22:32.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.386+0000 7f9fd9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9fdc074920 0x7f9fdc198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:32.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.386+0000 7f9fda59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fdc073340 0x7f9fdc1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:32.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.386+0000 7f9fda59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fdc073340 0x7f9fdc1989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:52486/0 (socket says 172.21.15.8:52486) 2023-08-11T12:22:32.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.386+0000 7f9fda59c700 1 -- 172.21.15.8:0/47834381 learned_addr learned my addr 172.21.15.8:0/47834381 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:32.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.386+0000 7f9fdad9d700 1 --2- 172.21.15.8:0/47834381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fdc108890 0x7f9fdc19ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:32.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.386+0000 7f9fda59c700 1 -- 172.21.15.8:0/47834381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fdc108890 msgr2=0x7f9fdc19ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:32.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.386+0000 7f9fda59c700 1 --2- 172.21.15.8:0/47834381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fdc108890 0x7f9fdc19ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:32.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.386+0000 7f9fda59c700 1 -- 172.21.15.8:0/47834381 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9fdc074920 msgr2=0x7f9fdc198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:32.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.386+0000 7f9fda59c700 1 --2- 172.21.15.8:0/47834381 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9fdc074920 0x7f9fdc198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:32.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.386+0000 7f9fda59c700 1 -- 172.21.15.8:0/47834381 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd4009d00 con 0x7f9fdc073340 2023-08-11T12:22:32.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.386+0000 7f9fda59c700 1 --2- 172.21.15.8:0/47834381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fdc073340 0x7f9fdc1989a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc00e9a0 tx=0x7f9fcc00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:32.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.387+0000 7f9fcb7fe700 1 -- 172.21.15.8:0/47834381 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc009790 con 0x7f9fdc073340 2023-08-11T12:22:32.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.387+0000 7f9fe0bff700 1 -- 172.21.15.8:0/47834381 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fdc1a0ad0 con 0x7f9fdc073340 2023-08-11T12:22:32.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.387+0000 7f9fcb7fe700 1 -- 172.21.15.8:0/47834381 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9fcc010430 con 0x7f9fdc073340 2023-08-11T12:22:32.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.387+0000 7f9fcb7fe700 1 -- 172.21.15.8:0/47834381 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc018680 con 0x7f9fdc073340 2023-08-11T12:22:32.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.387+0000 7f9fe0bff700 1 -- 172.21.15.8:0/47834381 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fdc1a1030 con 0x7f9fdc073340 2023-08-11T12:22:32.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.388+0000 7f9fe0bff700 1 -- 172.21.15.8:0/47834381 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fdc106f90 con 0x7f9fdc073340 2023-08-11T12:22:32.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.390+0000 7f9fcb7fe700 1 -- 172.21.15.8:0/47834381 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f9fcc0105a0 con 0x7f9fdc073340 2023-08-11T12:22:32.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.391+0000 7f9fcb7fe700 1 --2- 172.21.15.8:0/47834381 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9fc409ffd0 0x7f9fc40a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:32.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.391+0000 7f9fcb7fe700 1 -- 172.21.15.8:0/47834381 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f9fcc014070 con 0x7f9fdc073340 2023-08-11T12:22:32.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.392+0000 7f9fd9d9b700 1 --2- 172.21.15.8:0/47834381 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9fc409ffd0 0x7f9fc40a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:32.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.392+0000 7f9fd9d9b700 1 --2- 172.21.15.8:0/47834381 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9fc409ffd0 0x7f9fc40a2490 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0009c60 tx=0x7f9fd0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:32.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.394+0000 7f9fcb7fe700 1 -- 172.21.15.8:0/47834381 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f9fcc095340 con 0x7f9fdc073340 2023-08-11T12:22:32.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.600+0000 7f9fe0bff700 1 -- 172.21.15.8:0/47834381 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9fdc02ce20 con 0x7f9fc409ffd0 2023-08-11T12:22:32.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.612+0000 7f9fcb7fe700 1 -- 172.21.15.8:0/47834381 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+422525 (secure 0 0 0) 0x7f9fdc02ce20 con 0x7f9fc409ffd0 2023-08-11T12:22:32.619 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:22:32.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.618+0000 7f9fe0bff700 1 -- 172.21.15.8:0/47834381 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9fc409ffd0 msgr2=0x7f9fc40a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:32.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.618+0000 7f9fe0bff700 1 --2- 172.21.15.8:0/47834381 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9fc409ffd0 0x7f9fc40a2490 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0009c60 tx=0x7f9fd0009260 comp rx=0 tx=0).stop 2023-08-11T12:22:32.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.618+0000 7f9fe0bff700 1 -- 172.21.15.8:0/47834381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fdc073340 msgr2=0x7f9fdc1989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:32.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.618+0000 7f9fe0bff700 1 --2- 172.21.15.8:0/47834381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fdc073340 0x7f9fdc1989a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc00e9a0 tx=0x7f9fcc00ecb0 comp rx=0 tx=0).stop 2023-08-11T12:22:32.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.618+0000 7f9fe0bff700 1 -- 172.21.15.8:0/47834381 shutdown_connections 2023-08-11T12:22:32.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.618+0000 7f9fe0bff700 1 --2- 172.21.15.8:0/47834381 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9fc409ffd0 0x7f9fc40a2490 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:32.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.618+0000 7f9fe0bff700 1 --2- 172.21.15.8:0/47834381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fdc108890 0x7f9fdc19ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:32.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.618+0000 7f9fe0bff700 1 --2- 172.21.15.8:0/47834381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fdc073340 0x7f9fdc1989a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:32.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.618+0000 7f9fe0bff700 1 --2- 172.21.15.8:0/47834381 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9fdc074920 0x7f9fdc198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:32.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.618+0000 7f9fe0bff700 1 -- 172.21.15.8:0/47834381 >> 172.21.15.8:0/47834381 conn(0x7f9fdc0fbf50 msgr2=0x7f9fdc0fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:32.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.618+0000 7f9fe0bff700 1 -- 172.21.15.8:0/47834381 shutdown_connections 2023-08-11T12:22:32.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.618+0000 7f9fe0bff700 1 -- 172.21.15.8:0/47834381 wait complete. 2023-08-11T12:22:32.623 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-08-11T12:22:32.639 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":290,"stamp":"2023-08-11T12:22:32.510700+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595412,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":144,"num_read_kb":129,"num_write":286,"num_write_kb":2969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":421,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335552,"kb_used_data":11340,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124606272,"statfs":{"total":1151940427776,"available":1151596822528,"internally_reserved":0,"allocated":11612160,"data_stored":7375859,"data_compressed":253652,"data_compressed_allocated":339968,"data_compressed_original":2179072,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":545,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":8,"num_read_kb":10,"num_write":57,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002118"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.724344+0000","last_change":"2023-08-11T12:22:03.850538+0000","last_active":"2023-08-11T12:22:30.724344+0000","last_peered":"2023-08-11T12:22:30.724344+0000","last_clean":"2023-08-11T12:22:30.724344+0000","last_became_active":"2023-08-11T12:22:03.850220+0000","last_became_peered":"2023-08-11T12:22:03.850220+0000","last_unstale":"2023-08-11T12:22:30.724344+0000","last_undegraded":"2023-08-11T12:22:30.724344+0000","last_fullsized":"2023-08-11T12:22:30.724344+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:44:11.152122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716210+0000","last_change":"2023-08-11T12:22:03.843779+0000","last_active":"2023-08-11T12:22:30.716210+0000","last_peered":"2023-08-11T12:22:30.716210+0000","last_clean":"2023-08-11T12:22:30.716210+0000","last_became_active":"2023-08-11T12:22:03.843441+0000","last_became_peered":"2023-08-11T12:22:03.843441+0000","last_unstale":"2023-08-11T12:22:30.716210+0000","last_undegraded":"2023-08-11T12:22:30.716210+0000","last_fullsized":"2023-08-11T12:22:30.716210+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:11:50.295291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716835+0000","last_change":"2023-08-11T12:22:03.851996+0000","last_active":"2023-08-11T12:22:30.716835+0000","last_peered":"2023-08-11T12:22:30.716835+0000","last_clean":"2023-08-11T12:22:30.716835+0000","last_became_active":"2023-08-11T12:22:03.850821+0000","last_became_peered":"2023-08-11T12:22:03.850821+0000","last_unstale":"2023-08-11T12:22:30.716835+0000","last_undegraded":"2023-08-11T12:22:30.716835+0000","last_fullsized":"2023-08-11T12:22:30.716835+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:09:01.522001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067343+0000","last_change":"2023-08-11T12:22:03.842025+0000","last_active":"2023-08-11T12:22:09.067343+0000","last_peered":"2023-08-11T12:22:09.067343+0000","last_clean":"2023-08-11T12:22:09.067343+0000","last_became_active":"2023-08-11T12:22:03.841700+0000","last_became_peered":"2023-08-11T12:22:03.841700+0000","last_unstale":"2023-08-11T12:22:09.067343+0000","last_undegraded":"2023-08-11T12:22:09.067343+0000","last_fullsized":"2023-08-11T12:22:09.067343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:45:15.532577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879525+0000","last_change":"2023-08-11T12:22:03.844908+0000","last_active":"2023-08-11T12:22:08.879525+0000","last_peered":"2023-08-11T12:22:08.879525+0000","last_clean":"2023-08-11T12:22:08.879525+0000","last_became_active":"2023-08-11T12:22:03.844674+0000","last_became_peered":"2023-08-11T12:22:03.844674+0000","last_unstale":"2023-08-11T12:22:08.879525+0000","last_undegraded":"2023-08-11T12:22:08.879525+0000","last_fullsized":"2023-08-11T12:22:08.879525+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:13:32.050245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067181+0000","last_change":"2023-08-11T12:22:03.839915+0000","last_active":"2023-08-11T12:22:09.067181+0000","last_peered":"2023-08-11T12:22:09.067181+0000","last_clean":"2023-08-11T12:22:09.067181+0000","last_became_active":"2023-08-11T12:22:03.839099+0000","last_became_peered":"2023-08-11T12:22:03.839099+0000","last_unstale":"2023-08-11T12:22:09.067181+0000","last_undegraded":"2023-08-11T12:22:09.067181+0000","last_fullsized":"2023-08-11T12:22:09.067181+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:48:27.468032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880115+0000","last_change":"2023-08-11T12:22:03.841591+0000","last_active":"2023-08-11T12:22:08.880115+0000","last_peered":"2023-08-11T12:22:08.880115+0000","last_clean":"2023-08-11T12:22:08.880115+0000","last_became_active":"2023-08-11T12:22:03.841232+0000","last_became_peered":"2023-08-11T12:22:03.841232+0000","last_unstale":"2023-08-11T12:22:08.880115+0000","last_undegraded":"2023-08-11T12:22:08.880115+0000","last_fullsized":"2023-08-11T12:22:08.880115+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:57:51.227137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067792+0000","last_change":"2023-08-11T12:22:03.839516+0000","last_active":"2023-08-11T12:22:09.067792+0000","last_peered":"2023-08-11T12:22:09.067792+0000","last_clean":"2023-08-11T12:22:09.067792+0000","last_became_active":"2023-08-11T12:22:03.839058+0000","last_became_peered":"2023-08-11T12:22:03.839058+0000","last_unstale":"2023-08-11T12:22:09.067792+0000","last_undegraded":"2023-08-11T12:22:09.067792+0000","last_fullsized":"2023-08-11T12:22:09.067792+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:56:27.838147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.970642+0000","last_change":"2023-08-11T12:22:03.841033+0000","last_active":"2023-08-11T12:22:08.970642+0000","last_peered":"2023-08-11T12:22:08.970642+0000","last_clean":"2023-08-11T12:22:08.970642+0000","last_became_active":"2023-08-11T12:22:03.840665+0000","last_became_peered":"2023-08-11T12:22:03.840665+0000","last_unstale":"2023-08-11T12:22:08.970642+0000","last_undegraded":"2023-08-11T12:22:08.970642+0000","last_fullsized":"2023-08-11T12:22:08.970642+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:51:47.671738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067587+0000","last_change":"2023-08-11T12:22:03.839663+0000","last_active":"2023-08-11T12:22:09.067587+0000","last_peered":"2023-08-11T12:22:09.067587+0000","last_clean":"2023-08-11T12:22:09.067587+0000","last_became_active":"2023-08-11T12:22:03.838840+0000","last_became_peered":"2023-08-11T12:22:03.838840+0000","last_unstale":"2023-08-11T12:22:09.067587+0000","last_undegraded":"2023-08-11T12:22:09.067587+0000","last_fullsized":"2023-08-11T12:22:09.067587+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:57:09.615886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880443+0000","last_change":"2023-08-11T12:22:03.846288+0000","last_active":"2023-08-11T12:22:08.880443+0000","last_peered":"2023-08-11T12:22:08.880443+0000","last_clean":"2023-08-11T12:22:08.880443+0000","last_became_active":"2023-08-11T12:22:03.845962+0000","last_became_peered":"2023-08-11T12:22:03.845962+0000","last_unstale":"2023-08-11T12:22:08.880443+0000","last_undegraded":"2023-08-11T12:22:08.880443+0000","last_fullsized":"2023-08-11T12:22:08.880443+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:59:48.212360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.728022+0000","last_change":"2023-08-11T12:22:31.726774+0000","last_active":"2023-08-11T12:22:31.728022+0000","last_peered":"2023-08-11T12:22:31.728022+0000","last_clean":"2023-08-11T12:22:31.728022+0000","last_became_active":"2023-08-11T12:22:31.726437+0000","last_became_peered":"2023-08-11T12:22:31.726437+0000","last_unstale":"2023-08-11T12:22:31.728022+0000","last_undegraded":"2023-08-11T12:22:31.728022+0000","last_fullsized":"2023-08-11T12:22:31.728022+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:33:56.005318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879206+0000","last_change":"2023-08-11T12:22:03.842249+0000","last_active":"2023-08-11T12:22:08.879206+0000","last_peered":"2023-08-11T12:22:08.879206+0000","last_clean":"2023-08-11T12:22:08.879206+0000","last_became_active":"2023-08-11T12:22:03.841887+0000","last_became_peered":"2023-08-11T12:22:03.841887+0000","last_unstale":"2023-08-11T12:22:08.879206+0000","last_undegraded":"2023-08-11T12:22:08.879206+0000","last_fullsized":"2023-08-11T12:22:08.879206+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:08:58.125728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716293+0000","last_change":"2023-08-11T12:22:03.843859+0000","last_active":"2023-08-11T12:22:30.716293+0000","last_peered":"2023-08-11T12:22:30.716293+0000","last_clean":"2023-08-11T12:22:30.716293+0000","last_became_active":"2023-08-11T12:22:03.843383+0000","last_became_peered":"2023-08-11T12:22:03.843383+0000","last_unstale":"2023-08-11T12:22:30.716293+0000","last_undegraded":"2023-08-11T12:22:30.716293+0000","last_fullsized":"2023-08-11T12:22:30.716293+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:32:20.669588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"peering","last_fresh":"2023-08-11T12:22:09.066359+0000","last_change":"2023-08-11T12:22:30.717444+0000","last_active":"2023-08-11T12:22:30.717444+0000","last_peered":"2023-08-11T12:22:09.066359+0000","last_clean":"2023-08-11T12:22:09.066359+0000","last_became_active":"2023-08-11T12:22:03.849130+0000","last_became_peered":"2023-08-11T12:22:03.849130+0000","last_unstale":"2023-08-11T12:22:09.066359+0000","last_undegraded":"2023-08-11T12:22:09.066359+0000","last_fullsized":"2023-08-11T12:22:09.066359+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4,8],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.969810+0000","last_change":"2023-08-11T12:22:03.850397+0000","last_active":"2023-08-11T12:22:08.969810+0000","last_peered":"2023-08-11T12:22:08.969810+0000","last_clean":"2023-08-11T12:22:08.969810+0000","last_became_active":"2023-08-11T12:22:03.850143+0000","last_became_peered":"2023-08-11T12:22:03.850143+0000","last_unstale":"2023-08-11T12:22:08.969810+0000","last_undegraded":"2023-08-11T12:22:08.969810+0000","last_fullsized":"2023-08-11T12:22:08.969810+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:16:12.580674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.724188+0000","last_change":"2023-08-11T12:22:03.850496+0000","last_active":"2023-08-11T12:22:30.724188+0000","last_peered":"2023-08-11T12:22:30.724188+0000","last_clean":"2023-08-11T12:22:30.724188+0000","last_became_active":"2023-08-11T12:22:03.850192+0000","last_became_peered":"2023-08-11T12:22:03.850192+0000","last_unstale":"2023-08-11T12:22:30.724188+0000","last_undegraded":"2023-08-11T12:22:30.724188+0000","last_fullsized":"2023-08-11T12:22:30.724188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:15:36.813034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722136+0000","last_change":"2023-08-11T12:22:03.841706+0000","last_active":"2023-08-11T12:22:31.722136+0000","last_peered":"2023-08-11T12:22:31.722136+0000","last_clean":"2023-08-11T12:22:31.722136+0000","last_became_active":"2023-08-11T12:22:03.841341+0000","last_became_peered":"2023-08-11T12:22:03.841341+0000","last_unstale":"2023-08-11T12:22:31.722136+0000","last_undegraded":"2023-08-11T12:22:31.722136+0000","last_fullsized":"2023-08-11T12:22:31.722136+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:36:20.093373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067783+0000","last_change":"2023-08-11T12:22:03.834450+0000","last_active":"2023-08-11T12:22:09.067783+0000","last_peered":"2023-08-11T12:22:09.067783+0000","last_clean":"2023-08-11T12:22:09.067783+0000","last_became_active":"2023-08-11T12:22:03.834154+0000","last_became_peered":"2023-08-11T12:22:03.834154+0000","last_unstale":"2023-08-11T12:22:09.067783+0000","last_undegraded":"2023-08-11T12:22:09.067783+0000","last_fullsized":"2023-08-11T12:22:09.067783+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:59:48.605877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066819+0000","last_change":"2023-08-11T12:22:07.886317+0000","last_active":"2023-08-11T12:22:09.066819+0000","last_peered":"2023-08-11T12:22:09.066819+0000","last_clean":"2023-08-11T12:22:09.066819+0000","last_became_active":"2023-08-11T12:22:07.885986+0000","last_became_peered":"2023-08-11T12:22:07.885986+0000","last_unstale":"2023-08-11T12:22:09.066819+0000","last_undegraded":"2023-08-11T12:22:09.066819+0000","last_fullsized":"2023-08-11T12:22:09.066819+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:36:54.443747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722809+0000","last_change":"2023-08-11T12:22:02.841759+0000","last_active":"2023-08-11T12:22:31.722809+0000","last_peered":"2023-08-11T12:22:31.722809+0000","last_clean":"2023-08-11T12:22:31.722809+0000","last_became_active":"2023-08-11T12:22:02.841326+0000","last_became_peered":"2023-08-11T12:22:02.841326+0000","last_unstale":"2023-08-11T12:22:31.722809+0000","last_undegraded":"2023-08-11T12:22:31.722809+0000","last_fullsized":"2023-08-11T12:22:31.722809+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:09:30.085287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.802211+0000","last_change":"2023-08-11T12:22:31.801910+0000","last_active":"2023-08-11T12:22:31.802211+0000","last_peered":"2023-08-11T12:22:31.802211+0000","last_clean":"2023-08-11T12:22:31.802211+0000","last_became_active":"2023-08-11T12:22:31.801479+0000","last_became_peered":"2023-08-11T12:22:31.801479+0000","last_unstale":"2023-08-11T12:22:31.802211+0000","last_undegraded":"2023-08-11T12:22:31.802211+0000","last_fullsized":"2023-08-11T12:22:31.802211+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:52:21.489431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.065992+0000","last_change":"2023-08-11T12:22:07.875010+0000","last_active":"2023-08-11T12:22:09.065992+0000","last_peered":"2023-08-11T12:22:09.065992+0000","last_clean":"2023-08-11T12:22:09.065992+0000","last_became_active":"2023-08-11T12:22:07.874474+0000","last_became_peered":"2023-08-11T12:22:07.874474+0000","last_unstale":"2023-08-11T12:22:09.065992+0000","last_undegraded":"2023-08-11T12:22:09.065992+0000","last_fullsized":"2023-08-11T12:22:09.065992+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:54:41.734301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068448+0000","last_change":"2023-08-11T12:22:02.848299+0000","last_active":"2023-08-11T12:22:09.068448+0000","last_peered":"2023-08-11T12:22:09.068448+0000","last_clean":"2023-08-11T12:22:09.068448+0000","last_became_active":"2023-08-11T12:22:02.847869+0000","last_became_peered":"2023-08-11T12:22:02.847869+0000","last_unstale":"2023-08-11T12:22:09.068448+0000","last_undegraded":"2023-08-11T12:22:09.068448+0000","last_fullsized":"2023-08-11T12:22:09.068448+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:36:09.123226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716310+0000","last_change":"2023-08-11T12:22:03.841173+0000","last_active":"2023-08-11T12:22:30.716310+0000","last_peered":"2023-08-11T12:22:30.716310+0000","last_clean":"2023-08-11T12:22:30.716310+0000","last_became_active":"2023-08-11T12:22:03.840882+0000","last_became_peered":"2023-08-11T12:22:03.840882+0000","last_unstale":"2023-08-11T12:22:30.716310+0000","last_undegraded":"2023-08-11T12:22:30.716310+0000","last_fullsized":"2023-08-11T12:22:30.716310+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:58:38.141467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066479+0000","last_change":"2023-08-11T12:22:07.880756+0000","last_active":"2023-08-11T12:22:09.066479+0000","last_peered":"2023-08-11T12:22:09.066479+0000","last_clean":"2023-08-11T12:22:09.066479+0000","last_became_active":"2023-08-11T12:22:07.878866+0000","last_became_peered":"2023-08-11T12:22:07.878866+0000","last_unstale":"2023-08-11T12:22:09.066479+0000","last_undegraded":"2023-08-11T12:22:09.066479+0000","last_fullsized":"2023-08-11T12:22:09.066479+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:21:58.652424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'4","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:29.683617+0000","last_change":"2023-08-11T12:22:02.848543+0000","last_active":"2023-08-11T12:22:29.683617+0000","last_peered":"2023-08-11T12:22:29.683617+0000","last_clean":"2023-08-11T12:22:29.683617+0000","last_became_active":"2023-08-11T12:22:02.848008+0000","last_became_peered":"2023-08-11T12:22:02.848008+0000","last_unstale":"2023-08-11T12:22:29.683617+0000","last_undegraded":"2023-08-11T12:22:29.683617+0000","last_fullsized":"2023-08-11T12:22:29.683617+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:34:33.832747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.970098+0000","last_change":"2023-08-11T12:22:03.843651+0000","last_active":"2023-08-11T12:22:08.970098+0000","last_peered":"2023-08-11T12:22:08.970098+0000","last_clean":"2023-08-11T12:22:08.970098+0000","last_became_active":"2023-08-11T12:22:03.843392+0000","last_became_peered":"2023-08-11T12:22:03.843392+0000","last_unstale":"2023-08-11T12:22:08.970098+0000","last_undegraded":"2023-08-11T12:22:08.970098+0000","last_fullsized":"2023-08-11T12:22:08.970098+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:02:03.025511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066201+0000","last_change":"2023-08-11T12:22:07.879373+0000","last_active":"2023-08-11T12:22:09.066201+0000","last_peered":"2023-08-11T12:22:09.066201+0000","last_clean":"2023-08-11T12:22:09.066201+0000","last_became_active":"2023-08-11T12:22:07.878929+0000","last_became_peered":"2023-08-11T12:22:07.878929+0000","last_unstale":"2023-08-11T12:22:09.066201+0000","last_undegraded":"2023-08-11T12:22:09.066201+0000","last_fullsized":"2023-08-11T12:22:09.066201+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:44:35.895712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879734+0000","last_change":"2023-08-11T12:22:02.841984+0000","last_active":"2023-08-11T12:22:08.879734+0000","last_peered":"2023-08-11T12:22:08.879734+0000","last_clean":"2023-08-11T12:22:08.879734+0000","last_became_active":"2023-08-11T12:22:02.841585+0000","last_became_peered":"2023-08-11T12:22:02.841585+0000","last_unstale":"2023-08-11T12:22:08.879734+0000","last_undegraded":"2023-08-11T12:22:08.879734+0000","last_fullsized":"2023-08-11T12:22:08.879734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:22:35.974158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068146+0000","last_change":"2023-08-11T12:22:03.839381+0000","last_active":"2023-08-11T12:22:09.068146+0000","last_peered":"2023-08-11T12:22:09.068146+0000","last_clean":"2023-08-11T12:22:09.068146+0000","last_became_active":"2023-08-11T12:22:03.839091+0000","last_became_peered":"2023-08-11T12:22:03.839091+0000","last_unstale":"2023-08-11T12:22:09.068146+0000","last_undegraded":"2023-08-11T12:22:09.068146+0000","last_fullsized":"2023-08-11T12:22:09.068146+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:12:59.687698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067684+0000","last_change":"2023-08-11T12:22:07.881758+0000","last_active":"2023-08-11T12:22:09.067684+0000","last_peered":"2023-08-11T12:22:09.067684+0000","last_clean":"2023-08-11T12:22:09.067684+0000","last_became_active":"2023-08-11T12:22:07.881305+0000","last_became_peered":"2023-08-11T12:22:07.881305+0000","last_unstale":"2023-08-11T12:22:09.067684+0000","last_undegraded":"2023-08-11T12:22:09.067684+0000","last_fullsized":"2023-08-11T12:22:09.067684+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:08:17.423954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"82'1","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067097+0000","last_change":"2023-08-11T12:22:02.844138+0000","last_active":"2023-08-11T12:22:09.067097+0000","last_peered":"2023-08-11T12:22:09.067097+0000","last_clean":"2023-08-11T12:22:09.067097+0000","last_became_active":"2023-08-11T12:22:02.843234+0000","last_became_peered":"2023-08-11T12:22:02.843234+0000","last_unstale":"2023-08-11T12:22:09.067097+0000","last_undegraded":"2023-08-11T12:22:09.067097+0000","last_fullsized":"2023-08-11T12:22:09.067097+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:21:27.653637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879684+0000","last_change":"2023-08-11T12:22:03.845450+0000","last_active":"2023-08-11T12:22:08.879684+0000","last_peered":"2023-08-11T12:22:08.879684+0000","last_clean":"2023-08-11T12:22:08.879684+0000","last_became_active":"2023-08-11T12:22:03.845170+0000","last_became_peered":"2023-08-11T12:22:03.845170+0000","last_unstale":"2023-08-11T12:22:08.879684+0000","last_undegraded":"2023-08-11T12:22:08.879684+0000","last_fullsized":"2023-08-11T12:22:08.879684+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:54:39.747258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066775+0000","last_change":"2023-08-11T12:22:07.880663+0000","last_active":"2023-08-11T12:22:09.066775+0000","last_peered":"2023-08-11T12:22:09.066775+0000","last_clean":"2023-08-11T12:22:09.066775+0000","last_became_active":"2023-08-11T12:22:07.880282+0000","last_became_peered":"2023-08-11T12:22:07.880282+0000","last_unstale":"2023-08-11T12:22:09.066775+0000","last_undegraded":"2023-08-11T12:22:09.066775+0000","last_fullsized":"2023-08-11T12:22:09.066775+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:32:50.241286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"87'3","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:29.683550+0000","last_change":"2023-08-11T12:22:02.842206+0000","last_active":"2023-08-11T12:22:29.683550+0000","last_peered":"2023-08-11T12:22:29.683550+0000","last_clean":"2023-08-11T12:22:29.683550+0000","last_became_active":"2023-08-11T12:22:02.841815+0000","last_became_peered":"2023-08-11T12:22:02.841815+0000","last_unstale":"2023-08-11T12:22:29.683550+0000","last_undegraded":"2023-08-11T12:22:29.683550+0000","last_fullsized":"2023-08-11T12:22:29.683550+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:29:49.660552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067262+0000","last_change":"2023-08-11T12:22:03.825886+0000","last_active":"2023-08-11T12:22:09.067262+0000","last_peered":"2023-08-11T12:22:09.067262+0000","last_clean":"2023-08-11T12:22:09.067262+0000","last_became_active":"2023-08-11T12:22:03.825645+0000","last_became_peered":"2023-08-11T12:22:03.825645+0000","last_unstale":"2023-08-11T12:22:09.067262+0000","last_undegraded":"2023-08-11T12:22:09.067262+0000","last_fullsized":"2023-08-11T12:22:09.067262+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:27:52.324963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.723928+0000","last_change":"2023-08-11T12:22:07.890216+0000","last_active":"2023-08-11T12:22:30.723928+0000","last_peered":"2023-08-11T12:22:30.723928+0000","last_clean":"2023-08-11T12:22:30.723928+0000","last_became_active":"2023-08-11T12:22:07.889860+0000","last_became_peered":"2023-08-11T12:22:07.889860+0000","last_unstale":"2023-08-11T12:22:30.723928+0000","last_undegraded":"2023-08-11T12:22:30.723928+0000","last_fullsized":"2023-08-11T12:22:30.723928+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:26:31.744345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.878916+0000","last_change":"2023-08-11T12:22:02.835703+0000","last_active":"2023-08-11T12:22:08.878916+0000","last_peered":"2023-08-11T12:22:08.878916+0000","last_clean":"2023-08-11T12:22:08.878916+0000","last_became_active":"2023-08-11T12:22:02.835300+0000","last_became_peered":"2023-08-11T12:22:02.835300+0000","last_unstale":"2023-08-11T12:22:08.878916+0000","last_undegraded":"2023-08-11T12:22:08.878916+0000","last_fullsized":"2023-08-11T12:22:08.878916+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:05:05.549977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067658+0000","last_change":"2023-08-11T12:22:03.835619+0000","last_active":"2023-08-11T12:22:09.067658+0000","last_peered":"2023-08-11T12:22:09.067658+0000","last_clean":"2023-08-11T12:22:09.067658+0000","last_became_active":"2023-08-11T12:22:03.835365+0000","last_became_peered":"2023-08-11T12:22:03.835365+0000","last_unstale":"2023-08-11T12:22:09.067658+0000","last_undegraded":"2023-08-11T12:22:09.067658+0000","last_fullsized":"2023-08-11T12:22:09.067658+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:41:37.126989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716034+0000","last_change":"2023-08-11T12:22:07.893736+0000","last_active":"2023-08-11T12:22:30.716034+0000","last_peered":"2023-08-11T12:22:30.716034+0000","last_clean":"2023-08-11T12:22:30.716034+0000","last_became_active":"2023-08-11T12:22:07.893160+0000","last_became_peered":"2023-08-11T12:22:07.893160+0000","last_unstale":"2023-08-11T12:22:30.716034+0000","last_undegraded":"2023-08-11T12:22:30.716034+0000","last_fullsized":"2023-08-11T12:22:30.716034+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:15:12.861835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066672+0000","last_change":"2023-08-11T12:22:02.843819+0000","last_active":"2023-08-11T12:22:09.066672+0000","last_peered":"2023-08-11T12:22:09.066672+0000","last_clean":"2023-08-11T12:22:09.066672+0000","last_became_active":"2023-08-11T12:22:02.843062+0000","last_became_peered":"2023-08-11T12:22:02.843062+0000","last_unstale":"2023-08-11T12:22:09.066672+0000","last_undegraded":"2023-08-11T12:22:09.066672+0000","last_fullsized":"2023-08-11T12:22:09.066672+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:51:10.923574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722599+0000","last_change":"2023-08-11T12:22:03.845985+0000","last_active":"2023-08-11T12:22:31.722599+0000","last_peered":"2023-08-11T12:22:31.722599+0000","last_clean":"2023-08-11T12:22:31.722599+0000","last_became_active":"2023-08-11T12:22:03.845274+0000","last_became_peered":"2023-08-11T12:22:03.845274+0000","last_unstale":"2023-08-11T12:22:31.722599+0000","last_undegraded":"2023-08-11T12:22:31.722599+0000","last_fullsized":"2023-08-11T12:22:31.722599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:51:23.239546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067853+0000","last_change":"2023-08-11T12:22:07.885017+0000","last_active":"2023-08-11T12:22:09.067853+0000","last_peered":"2023-08-11T12:22:09.067853+0000","last_clean":"2023-08-11T12:22:09.067853+0000","last_became_active":"2023-08-11T12:22:07.884610+0000","last_became_peered":"2023-08-11T12:22:07.884610+0000","last_unstale":"2023-08-11T12:22:09.067853+0000","last_undegraded":"2023-08-11T12:22:09.067853+0000","last_fullsized":"2023-08-11T12:22:09.067853+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:03:47.111702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"87'3","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:28.723792+0000","last_change":"2023-08-11T12:22:02.836591+0000","last_active":"2023-08-11T12:22:28.723792+0000","last_peered":"2023-08-11T12:22:28.723792+0000","last_clean":"2023-08-11T12:22:28.723792+0000","last_became_active":"2023-08-11T12:22:02.836223+0000","last_became_peered":"2023-08-11T12:22:02.836223+0000","last_unstale":"2023-08-11T12:22:28.723792+0000","last_undegraded":"2023-08-11T12:22:28.723792+0000","last_fullsized":"2023-08-11T12:22:28.723792+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:04:18.216860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.970378+0000","last_change":"2023-08-11T12:22:03.841719+0000","last_active":"2023-08-11T12:22:08.970378+0000","last_peered":"2023-08-11T12:22:08.970378+0000","last_clean":"2023-08-11T12:22:08.970378+0000","last_became_active":"2023-08-11T12:22:03.841381+0000","last_became_peered":"2023-08-11T12:22:03.841381+0000","last_unstale":"2023-08-11T12:22:08.970378+0000","last_undegraded":"2023-08-11T12:22:08.970378+0000","last_fullsized":"2023-08-11T12:22:08.970378+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:23:34.743266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721200+0000","last_change":"2023-08-11T12:22:07.889103+0000","last_active":"2023-08-11T12:22:31.721200+0000","last_peered":"2023-08-11T12:22:31.721200+0000","last_clean":"2023-08-11T12:22:31.721200+0000","last_became_active":"2023-08-11T12:22:07.888668+0000","last_became_peered":"2023-08-11T12:22:07.888668+0000","last_unstale":"2023-08-11T12:22:31.721200+0000","last_undegraded":"2023-08-11T12:22:31.721200+0000","last_fullsized":"2023-08-11T12:22:31.721200+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:55:40.004921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"87'2","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:28.721917+0000","last_change":"2023-08-11T12:22:02.841934+0000","last_active":"2023-08-11T12:22:28.721917+0000","last_peered":"2023-08-11T12:22:28.721917+0000","last_clean":"2023-08-11T12:22:28.721917+0000","last_became_active":"2023-08-11T12:22:02.841598+0000","last_became_peered":"2023-08-11T12:22:02.841598+0000","last_unstale":"2023-08-11T12:22:28.721917+0000","last_undegraded":"2023-08-11T12:22:28.721917+0000","last_fullsized":"2023-08-11T12:22:28.721917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:41:39.918666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716456+0000","last_change":"2023-08-11T12:22:03.848901+0000","last_active":"2023-08-11T12:22:30.716456+0000","last_peered":"2023-08-11T12:22:30.716456+0000","last_clean":"2023-08-11T12:22:30.716456+0000","last_became_active":"2023-08-11T12:22:03.848518+0000","last_became_peered":"2023-08-11T12:22:03.848518+0000","last_unstale":"2023-08-11T12:22:30.716456+0000","last_undegraded":"2023-08-11T12:22:30.716456+0000","last_fullsized":"2023-08-11T12:22:30.716456+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:28:39.018373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067078+0000","last_change":"2023-08-11T12:22:07.873734+0000","last_active":"2023-08-11T12:22:09.067078+0000","last_peered":"2023-08-11T12:22:09.067078+0000","last_clean":"2023-08-11T12:22:09.067078+0000","last_became_active":"2023-08-11T12:22:07.872986+0000","last_became_peered":"2023-08-11T12:22:07.872986+0000","last_unstale":"2023-08-11T12:22:09.067078+0000","last_undegraded":"2023-08-11T12:22:09.067078+0000","last_fullsized":"2023-08-11T12:22:09.067078+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:22:35.576079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"82'3","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068027+0000","last_change":"2023-08-11T12:22:02.846492+0000","last_active":"2023-08-11T12:22:09.068027+0000","last_peered":"2023-08-11T12:22:09.068027+0000","last_clean":"2023-08-11T12:22:09.068027+0000","last_became_active":"2023-08-11T12:22:02.846174+0000","last_became_peered":"2023-08-11T12:22:02.846174+0000","last_unstale":"2023-08-11T12:22:09.068027+0000","last_undegraded":"2023-08-11T12:22:09.068027+0000","last_fullsized":"2023-08-11T12:22:09.068027+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:20:48.965543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.970441+0000","last_change":"2023-08-11T12:22:03.840054+0000","last_active":"2023-08-11T12:22:08.970441+0000","last_peered":"2023-08-11T12:22:08.970441+0000","last_clean":"2023-08-11T12:22:08.970441+0000","last_became_active":"2023-08-11T12:22:03.839707+0000","last_became_peered":"2023-08-11T12:22:03.839707+0000","last_unstale":"2023-08-11T12:22:08.970441+0000","last_undegraded":"2023-08-11T12:22:08.970441+0000","last_fullsized":"2023-08-11T12:22:08.970441+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:57:01.883842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066884+0000","last_change":"2023-08-11T12:22:07.886900+0000","last_active":"2023-08-11T12:22:09.066884+0000","last_peered":"2023-08-11T12:22:09.066884+0000","last_clean":"2023-08-11T12:22:09.066884+0000","last_became_active":"2023-08-11T12:22:07.886228+0000","last_became_peered":"2023-08-11T12:22:07.886228+0000","last_unstale":"2023-08-11T12:22:09.066884+0000","last_undegraded":"2023-08-11T12:22:09.066884+0000","last_fullsized":"2023-08-11T12:22:09.066884+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:23:53.736228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"87'12","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:29.677313+0000","last_change":"2023-08-11T12:22:02.836520+0000","last_active":"2023-08-11T12:22:29.677313+0000","last_peered":"2023-08-11T12:22:29.677313+0000","last_clean":"2023-08-11T12:22:29.677313+0000","last_became_active":"2023-08-11T12:22:02.836201+0000","last_became_peered":"2023-08-11T12:22:02.836201+0000","last_unstale":"2023-08-11T12:22:29.677313+0000","last_undegraded":"2023-08-11T12:22:29.677313+0000","last_fullsized":"2023-08-11T12:22:29.677313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:41:20.418514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":6,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879606+0000","last_change":"2023-08-11T12:22:03.848104+0000","last_active":"2023-08-11T12:22:08.879606+0000","last_peered":"2023-08-11T12:22:08.879606+0000","last_clean":"2023-08-11T12:22:08.879606+0000","last_became_active":"2023-08-11T12:22:03.847801+0000","last_became_peered":"2023-08-11T12:22:03.847801+0000","last_unstale":"2023-08-11T12:22:08.879606+0000","last_undegraded":"2023-08-11T12:22:08.879606+0000","last_fullsized":"2023-08-11T12:22:08.879606+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:11:30.238632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068429+0000","last_change":"2023-08-11T12:22:07.893710+0000","last_active":"2023-08-11T12:22:09.068429+0000","last_peered":"2023-08-11T12:22:09.068429+0000","last_clean":"2023-08-11T12:22:09.068429+0000","last_became_active":"2023-08-11T12:22:07.893239+0000","last_became_peered":"2023-08-11T12:22:07.893239+0000","last_unstale":"2023-08-11T12:22:09.068429+0000","last_undegraded":"2023-08-11T12:22:09.068429+0000","last_fullsized":"2023-08-11T12:22:09.068429+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:42:45.168233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"87'4","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:28.722975+0000","last_change":"2023-08-11T12:22:02.849060+0000","last_active":"2023-08-11T12:22:28.722975+0000","last_peered":"2023-08-11T12:22:28.722975+0000","last_clean":"2023-08-11T12:22:28.722975+0000","last_became_active":"2023-08-11T12:22:02.848417+0000","last_became_peered":"2023-08-11T12:22:02.848417+0000","last_unstale":"2023-08-11T12:22:28.722975+0000","last_undegraded":"2023-08-11T12:22:28.722975+0000","last_fullsized":"2023-08-11T12:22:28.722975+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:09:38.023995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.878997+0000","last_change":"2023-08-11T12:22:03.848532+0000","last_active":"2023-08-11T12:22:08.878997+0000","last_peered":"2023-08-11T12:22:08.878997+0000","last_clean":"2023-08-11T12:22:08.878997+0000","last_became_active":"2023-08-11T12:22:03.848190+0000","last_became_peered":"2023-08-11T12:22:03.848190+0000","last_unstale":"2023-08-11T12:22:08.878997+0000","last_undegraded":"2023-08-11T12:22:08.878997+0000","last_fullsized":"2023-08-11T12:22:08.878997+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:24:10.506810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.723601+0000","last_change":"2023-08-11T12:22:07.882785+0000","last_active":"2023-08-11T12:22:30.723601+0000","last_peered":"2023-08-11T12:22:30.723601+0000","last_clean":"2023-08-11T12:22:30.723601+0000","last_became_active":"2023-08-11T12:22:07.880643+0000","last_became_peered":"2023-08-11T12:22:07.880643+0000","last_unstale":"2023-08-11T12:22:30.723601+0000","last_undegraded":"2023-08-11T12:22:30.723601+0000","last_fullsized":"2023-08-11T12:22:30.723601+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:13:01.597210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066777+0000","last_change":"2023-08-11T12:22:02.851416+0000","last_active":"2023-08-11T12:22:09.066777+0000","last_peered":"2023-08-11T12:22:09.066777+0000","last_clean":"2023-08-11T12:22:09.066777+0000","last_became_active":"2023-08-11T12:22:02.851114+0000","last_became_peered":"2023-08-11T12:22:02.851114+0000","last_unstale":"2023-08-11T12:22:09.066777+0000","last_undegraded":"2023-08-11T12:22:09.066777+0000","last_fullsized":"2023-08-11T12:22:09.066777+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:21:21.904496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880295+0000","last_change":"2023-08-11T12:22:03.849367+0000","last_active":"2023-08-11T12:22:08.880295+0000","last_peered":"2023-08-11T12:22:08.880295+0000","last_clean":"2023-08-11T12:22:08.880295+0000","last_became_active":"2023-08-11T12:22:03.849050+0000","last_became_peered":"2023-08-11T12:22:03.849050+0000","last_unstale":"2023-08-11T12:22:08.880295+0000","last_undegraded":"2023-08-11T12:22:08.880295+0000","last_fullsized":"2023-08-11T12:22:08.880295+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:01:37.018850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722616+0000","last_change":"2023-08-11T12:22:07.890992+0000","last_active":"2023-08-11T12:22:31.722616+0000","last_peered":"2023-08-11T12:22:31.722616+0000","last_clean":"2023-08-11T12:22:31.722616+0000","last_became_active":"2023-08-11T12:22:07.890384+0000","last_became_peered":"2023-08-11T12:22:07.890384+0000","last_unstale":"2023-08-11T12:22:31.722616+0000","last_undegraded":"2023-08-11T12:22:31.722616+0000","last_fullsized":"2023-08-11T12:22:31.722616+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:00:55.230221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066311+0000","last_change":"2023-08-11T12:22:02.843045+0000","last_active":"2023-08-11T12:22:09.066311+0000","last_peered":"2023-08-11T12:22:09.066311+0000","last_clean":"2023-08-11T12:22:09.066311+0000","last_became_active":"2023-08-11T12:22:02.842628+0000","last_became_peered":"2023-08-11T12:22:02.842628+0000","last_unstale":"2023-08-11T12:22:09.066311+0000","last_undegraded":"2023-08-11T12:22:09.066311+0000","last_fullsized":"2023-08-11T12:22:09.066311+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:24:30.251252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879762+0000","last_change":"2023-08-11T12:22:03.842526+0000","last_active":"2023-08-11T12:22:08.879762+0000","last_peered":"2023-08-11T12:22:08.879762+0000","last_clean":"2023-08-11T12:22:08.879762+0000","last_became_active":"2023-08-11T12:22:03.842183+0000","last_became_peered":"2023-08-11T12:22:03.842183+0000","last_unstale":"2023-08-11T12:22:08.879762+0000","last_undegraded":"2023-08-11T12:22:08.879762+0000","last_fullsized":"2023-08-11T12:22:08.879762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:15:28.619474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879644+0000","last_change":"2023-08-11T12:22:07.880768+0000","last_active":"2023-08-11T12:22:08.879644+0000","last_peered":"2023-08-11T12:22:08.879644+0000","last_clean":"2023-08-11T12:22:08.879644+0000","last_became_active":"2023-08-11T12:22:07.880335+0000","last_became_peered":"2023-08-11T12:22:07.880335+0000","last_unstale":"2023-08-11T12:22:08.879644+0000","last_undegraded":"2023-08-11T12:22:08.879644+0000","last_fullsized":"2023-08-11T12:22:08.879644+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:49:07.059346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"87'15","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:29.686619+0000","last_change":"2023-08-11T12:22:02.847271+0000","last_active":"2023-08-11T12:22:29.686619+0000","last_peered":"2023-08-11T12:22:29.686619+0000","last_clean":"2023-08-11T12:22:29.686619+0000","last_became_active":"2023-08-11T12:22:02.846974+0000","last_became_peered":"2023-08-11T12:22:02.846974+0000","last_unstale":"2023-08-11T12:22:29.686619+0000","last_undegraded":"2023-08-11T12:22:29.686619+0000","last_fullsized":"2023-08-11T12:22:29.686619+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:04:16.995048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068022+0000","last_change":"2023-08-11T12:22:03.838944+0000","last_active":"2023-08-11T12:22:09.068022+0000","last_peered":"2023-08-11T12:22:09.068022+0000","last_clean":"2023-08-11T12:22:09.068022+0000","last_became_active":"2023-08-11T12:22:03.838610+0000","last_became_peered":"2023-08-11T12:22:03.838610+0000","last_unstale":"2023-08-11T12:22:09.068022+0000","last_undegraded":"2023-08-11T12:22:09.068022+0000","last_fullsized":"2023-08-11T12:22:09.068022+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:40:51.718679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067929+0000","last_change":"2023-08-11T12:22:07.888812+0000","last_active":"2023-08-11T12:22:09.067929+0000","last_peered":"2023-08-11T12:22:09.067929+0000","last_clean":"2023-08-11T12:22:09.067929+0000","last_became_active":"2023-08-11T12:22:07.888423+0000","last_became_peered":"2023-08-11T12:22:07.888423+0000","last_unstale":"2023-08-11T12:22:09.067929+0000","last_undegraded":"2023-08-11T12:22:09.067929+0000","last_fullsized":"2023-08-11T12:22:09.067929+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:12:17.299557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'1","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879855+0000","last_change":"2023-08-11T12:22:02.842591+0000","last_active":"2023-08-11T12:22:08.879855+0000","last_peered":"2023-08-11T12:22:08.879855+0000","last_clean":"2023-08-11T12:22:08.879855+0000","last_became_active":"2023-08-11T12:22:02.842249+0000","last_became_peered":"2023-08-11T12:22:02.842249+0000","last_unstale":"2023-08-11T12:22:08.879855+0000","last_undegraded":"2023-08-11T12:22:08.879855+0000","last_fullsized":"2023-08-11T12:22:08.879855+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:53:56.628695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"peering","last_fresh":"2023-08-11T12:22:09.067384+0000","last_change":"2023-08-11T12:22:30.723122+0000","last_active":"2023-08-11T12:22:30.723122+0000","last_peered":"2023-08-11T12:22:09.067384+0000","last_clean":"2023-08-11T12:22:09.067384+0000","last_became_active":"2023-08-11T12:22:03.840210+0000","last_became_peered":"2023-08-11T12:22:03.840210+0000","last_unstale":"2023-08-11T12:22:09.067384+0000","last_undegraded":"2023-08-11T12:22:09.067384+0000","last_fullsized":"2023-08-11T12:22:09.067384+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,5,9],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879511+0000","last_change":"2023-08-11T12:22:08.068485+0000","last_active":"2023-08-11T12:22:08.879511+0000","last_peered":"2023-08-11T12:22:08.879511+0000","last_clean":"2023-08-11T12:22:08.879511+0000","last_became_active":"2023-08-11T12:22:08.068071+0000","last_became_peered":"2023-08-11T12:22:08.068071+0000","last_unstale":"2023-08-11T12:22:08.879511+0000","last_undegraded":"2023-08-11T12:22:08.879511+0000","last_fullsized":"2023-08-11T12:22:08.879511+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:06:34.158790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"87'1","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.727900+0000","last_change":"2023-08-11T12:22:31.727900+0000","last_active":"2023-08-11T12:22:31.727900+0000","last_peered":"2023-08-11T12:22:31.727900+0000","last_clean":"2023-08-11T12:22:31.727900+0000","last_became_active":"2023-08-11T12:22:31.727346+0000","last_became_peered":"2023-08-11T12:22:31.727346+0000","last_unstale":"2023-08-11T12:22:31.727900+0000","last_undegraded":"2023-08-11T12:22:31.727900+0000","last_fullsized":"2023-08-11T12:22:31.727900+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:12:21.170378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067467+0000","last_change":"2023-08-11T12:22:03.843434+0000","last_active":"2023-08-11T12:22:09.067467+0000","last_peered":"2023-08-11T12:22:09.067467+0000","last_clean":"2023-08-11T12:22:09.067467+0000","last_became_active":"2023-08-11T12:22:03.843117+0000","last_became_peered":"2023-08-11T12:22:03.843117+0000","last_unstale":"2023-08-11T12:22:09.067467+0000","last_undegraded":"2023-08-11T12:22:09.067467+0000","last_fullsized":"2023-08-11T12:22:09.067467+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:24:56.881802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879498+0000","last_change":"2023-08-11T12:22:07.889740+0000","last_active":"2023-08-11T12:22:08.879498+0000","last_peered":"2023-08-11T12:22:08.879498+0000","last_clean":"2023-08-11T12:22:08.879498+0000","last_became_active":"2023-08-11T12:22:07.889272+0000","last_became_peered":"2023-08-11T12:22:07.889272+0000","last_unstale":"2023-08-11T12:22:08.879498+0000","last_undegraded":"2023-08-11T12:22:08.879498+0000","last_fullsized":"2023-08-11T12:22:08.879498+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:40:15.712138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"87'1","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879829+0000","last_change":"2023-08-11T12:22:02.846661+0000","last_active":"2023-08-11T12:22:08.879829+0000","last_peered":"2023-08-11T12:22:08.879829+0000","last_clean":"2023-08-11T12:22:08.879829+0000","last_became_active":"2023-08-11T12:22:02.846269+0000","last_became_peered":"2023-08-11T12:22:02.846269+0000","last_unstale":"2023-08-11T12:22:08.879829+0000","last_undegraded":"2023-08-11T12:22:08.879829+0000","last_fullsized":"2023-08-11T12:22:08.879829+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:47:43.138580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066619+0000","last_change":"2023-08-11T12:22:03.849653+0000","last_active":"2023-08-11T12:22:09.066619+0000","last_peered":"2023-08-11T12:22:09.066619+0000","last_clean":"2023-08-11T12:22:09.066619+0000","last_became_active":"2023-08-11T12:22:03.849303+0000","last_became_peered":"2023-08-11T12:22:03.849303+0000","last_unstale":"2023-08-11T12:22:09.066619+0000","last_undegraded":"2023-08-11T12:22:09.066619+0000","last_fullsized":"2023-08-11T12:22:09.066619+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:35:28.772541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879497+0000","last_change":"2023-08-11T12:22:08.068395+0000","last_active":"2023-08-11T12:22:08.879497+0000","last_peered":"2023-08-11T12:22:08.879497+0000","last_clean":"2023-08-11T12:22:08.879497+0000","last_became_active":"2023-08-11T12:22:08.067572+0000","last_became_peered":"2023-08-11T12:22:08.067572+0000","last_unstale":"2023-08-11T12:22:08.879497+0000","last_undegraded":"2023-08-11T12:22:08.879497+0000","last_fullsized":"2023-08-11T12:22:08.879497+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:18:19.641203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066941+0000","last_change":"2023-08-11T12:22:03.828971+0000","last_active":"2023-08-11T12:22:09.066941+0000","last_peered":"2023-08-11T12:22:09.066941+0000","last_clean":"2023-08-11T12:22:09.066941+0000","last_became_active":"2023-08-11T12:22:03.828653+0000","last_became_peered":"2023-08-11T12:22:03.828653+0000","last_unstale":"2023-08-11T12:22:09.066941+0000","last_undegraded":"2023-08-11T12:22:09.066941+0000","last_fullsized":"2023-08-11T12:22:09.066941+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:43:30.226114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'1","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.878818+0000","last_change":"2023-08-11T12:22:02.842419+0000","last_active":"2023-08-11T12:22:08.878818+0000","last_peered":"2023-08-11T12:22:08.878818+0000","last_clean":"2023-08-11T12:22:08.878818+0000","last_became_active":"2023-08-11T12:22:02.842105+0000","last_became_peered":"2023-08-11T12:22:02.842105+0000","last_unstale":"2023-08-11T12:22:08.878818+0000","last_undegraded":"2023-08-11T12:22:08.878818+0000","last_fullsized":"2023-08-11T12:22:08.878818+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:51:55.024962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880231+0000","last_change":"2023-08-11T12:22:07.880762+0000","last_active":"2023-08-11T12:22:08.880231+0000","last_peered":"2023-08-11T12:22:08.880231+0000","last_clean":"2023-08-11T12:22:08.880231+0000","last_became_active":"2023-08-11T12:22:07.880373+0000","last_became_peered":"2023-08-11T12:22:07.880373+0000","last_unstale":"2023-08-11T12:22:08.880231+0000","last_undegraded":"2023-08-11T12:22:08.880231+0000","last_fullsized":"2023-08-11T12:22:08.880231+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:07:55.656555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067945+0000","last_change":"2023-08-11T12:22:03.838555+0000","last_active":"2023-08-11T12:22:09.067945+0000","last_peered":"2023-08-11T12:22:09.067945+0000","last_clean":"2023-08-11T12:22:09.067945+0000","last_became_active":"2023-08-11T12:22:03.838135+0000","last_became_peered":"2023-08-11T12:22:03.838135+0000","last_unstale":"2023-08-11T12:22:09.067945+0000","last_undegraded":"2023-08-11T12:22:09.067945+0000","last_fullsized":"2023-08-11T12:22:09.067945+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:23:56.118058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066639+0000","last_change":"2023-08-11T12:22:02.835093+0000","last_active":"2023-08-11T12:22:09.066639+0000","last_peered":"2023-08-11T12:22:09.066639+0000","last_clean":"2023-08-11T12:22:09.066639+0000","last_became_active":"2023-08-11T12:22:02.834545+0000","last_became_peered":"2023-08-11T12:22:02.834545+0000","last_unstale":"2023-08-11T12:22:09.066639+0000","last_undegraded":"2023-08-11T12:22:09.066639+0000","last_fullsized":"2023-08-11T12:22:09.066639+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:59:41.870923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":350,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879552+0000","last_change":"2023-08-11T12:20:57.484190+0000","last_active":"2023-08-11T12:22:08.879552+0000","last_peered":"2023-08-11T12:22:08.879552+0000","last_clean":"2023-08-11T12:22:08.879552+0000","last_became_active":"2023-08-11T12:20:57.483655+0000","last_became_peered":"2023-08-11T12:20:57.483655+0000","last_unstale":"2023-08-11T12:22:08.879552+0000","last_undegraded":"2023-08-11T12:22:08.879552+0000","last_fullsized":"2023-08-11T12:22:08.879552+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:17:49.245488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:17:49.245488+0000","last_clean_scrub_stamp":"2023-08-11T12:17:49.245488+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:16:09.009846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068210+0000","last_change":"2023-08-11T12:22:08.068762+0000","last_active":"2023-08-11T12:22:09.068210+0000","last_peered":"2023-08-11T12:22:09.068210+0000","last_clean":"2023-08-11T12:22:09.068210+0000","last_became_active":"2023-08-11T12:22:08.068205+0000","last_became_peered":"2023-08-11T12:22:08.068205+0000","last_unstale":"2023-08-11T12:22:09.068210+0000","last_undegraded":"2023-08-11T12:22:09.068210+0000","last_fullsized":"2023-08-11T12:22:09.068210+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:58:49.800844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.878740+0000","last_change":"2023-08-11T12:22:03.837843+0000","last_active":"2023-08-11T12:22:08.878740+0000","last_peered":"2023-08-11T12:22:08.878740+0000","last_clean":"2023-08-11T12:22:08.878740+0000","last_became_active":"2023-08-11T12:22:03.837537+0000","last_became_peered":"2023-08-11T12:22:03.837537+0000","last_unstale":"2023-08-11T12:22:08.878740+0000","last_undegraded":"2023-08-11T12:22:08.878740+0000","last_fullsized":"2023-08-11T12:22:08.878740+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:22:17.517258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'3","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:29.683836+0000","last_change":"2023-08-11T12:22:02.843150+0000","last_active":"2023-08-11T12:22:29.683836+0000","last_peered":"2023-08-11T12:22:29.683836+0000","last_clean":"2023-08-11T12:22:29.683836+0000","last_became_active":"2023-08-11T12:22:02.842829+0000","last_became_peered":"2023-08-11T12:22:02.842829+0000","last_unstale":"2023-08-11T12:22:29.683836+0000","last_undegraded":"2023-08-11T12:22:29.683836+0000","last_fullsized":"2023-08-11T12:22:29.683836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:02:01.110571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.722844+0000","last_change":"2023-08-11T12:22:07.883050+0000","last_active":"2023-08-11T12:22:30.722844+0000","last_peered":"2023-08-11T12:22:30.722844+0000","last_clean":"2023-08-11T12:22:30.722844+0000","last_became_active":"2023-08-11T12:22:07.882423+0000","last_became_peered":"2023-08-11T12:22:07.882423+0000","last_unstale":"2023-08-11T12:22:30.722844+0000","last_undegraded":"2023-08-11T12:22:30.722844+0000","last_fullsized":"2023-08-11T12:22:30.722844+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:56:11.400367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"87'1","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:28.723841+0000","last_change":"2023-08-11T12:22:02.850632+0000","last_active":"2023-08-11T12:22:28.723841+0000","last_peered":"2023-08-11T12:22:28.723841+0000","last_clean":"2023-08-11T12:22:28.723841+0000","last_became_active":"2023-08-11T12:22:02.850312+0000","last_became_peered":"2023-08-11T12:22:02.850312+0000","last_unstale":"2023-08-11T12:22:28.723841+0000","last_undegraded":"2023-08-11T12:22:28.723841+0000","last_fullsized":"2023-08-11T12:22:28.723841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:17:36.156598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879376+0000","last_change":"2023-08-11T12:22:03.839869+0000","last_active":"2023-08-11T12:22:08.879376+0000","last_peered":"2023-08-11T12:22:08.879376+0000","last_clean":"2023-08-11T12:22:08.879376+0000","last_became_active":"2023-08-11T12:22:03.839486+0000","last_became_peered":"2023-08-11T12:22:03.839486+0000","last_unstale":"2023-08-11T12:22:08.879376+0000","last_undegraded":"2023-08-11T12:22:08.879376+0000","last_fullsized":"2023-08-11T12:22:08.879376+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:49:22.752990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067561+0000","last_change":"2023-08-11T12:22:08.066877+0000","last_active":"2023-08-11T12:22:09.067561+0000","last_peered":"2023-08-11T12:22:09.067561+0000","last_clean":"2023-08-11T12:22:09.067561+0000","last_became_active":"2023-08-11T12:22:08.066418+0000","last_became_peered":"2023-08-11T12:22:08.066418+0000","last_unstale":"2023-08-11T12:22:09.067561+0000","last_undegraded":"2023-08-11T12:22:09.067561+0000","last_fullsized":"2023-08-11T12:22:09.067561+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:57:08.687973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'7","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722268+0000","last_change":"2023-08-11T12:22:02.850505+0000","last_active":"2023-08-11T12:22:31.722268+0000","last_peered":"2023-08-11T12:22:31.722268+0000","last_clean":"2023-08-11T12:22:31.722268+0000","last_became_active":"2023-08-11T12:22:02.850104+0000","last_became_peered":"2023-08-11T12:22:02.850104+0000","last_unstale":"2023-08-11T12:22:31.722268+0000","last_undegraded":"2023-08-11T12:22:31.722268+0000","last_fullsized":"2023-08-11T12:22:31.722268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:33:50.319404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068068+0000","last_change":"2023-08-11T12:22:03.837580+0000","last_active":"2023-08-11T12:22:09.068068+0000","last_peered":"2023-08-11T12:22:09.068068+0000","last_clean":"2023-08-11T12:22:09.068068+0000","last_became_active":"2023-08-11T12:22:03.837256+0000","last_became_peered":"2023-08-11T12:22:03.837256+0000","last_unstale":"2023-08-11T12:22:09.068068+0000","last_undegraded":"2023-08-11T12:22:09.068068+0000","last_fullsized":"2023-08-11T12:22:09.068068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:13:43.832719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066507+0000","last_change":"2023-08-11T12:22:07.873613+0000","last_active":"2023-08-11T12:22:09.066507+0000","last_peered":"2023-08-11T12:22:09.066507+0000","last_clean":"2023-08-11T12:22:09.066507+0000","last_became_active":"2023-08-11T12:22:07.873149+0000","last_became_peered":"2023-08-11T12:22:07.873149+0000","last_unstale":"2023-08-11T12:22:09.066507+0000","last_undegraded":"2023-08-11T12:22:09.066507+0000","last_fullsized":"2023-08-11T12:22:09.066507+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:18:27.597239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"82'2","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066917+0000","last_change":"2023-08-11T12:22:02.843146+0000","last_active":"2023-08-11T12:22:09.066917+0000","last_peered":"2023-08-11T12:22:09.066917+0000","last_clean":"2023-08-11T12:22:09.066917+0000","last_became_active":"2023-08-11T12:22:02.842663+0000","last_became_peered":"2023-08-11T12:22:02.842663+0000","last_unstale":"2023-08-11T12:22:09.066917+0000","last_undegraded":"2023-08-11T12:22:09.066917+0000","last_fullsized":"2023-08-11T12:22:09.066917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:07:46.505063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716061+0000","last_change":"2023-08-11T12:22:03.847351+0000","last_active":"2023-08-11T12:22:30.716061+0000","last_peered":"2023-08-11T12:22:30.716061+0000","last_clean":"2023-08-11T12:22:30.716061+0000","last_became_active":"2023-08-11T12:22:03.847044+0000","last_became_peered":"2023-08-11T12:22:03.847044+0000","last_unstale":"2023-08-11T12:22:30.716061+0000","last_undegraded":"2023-08-11T12:22:30.716061+0000","last_fullsized":"2023-08-11T12:22:30.716061+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:03:33.785374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066461+0000","last_change":"2023-08-11T12:22:08.068459+0000","last_active":"2023-08-11T12:22:09.066461+0000","last_peered":"2023-08-11T12:22:09.066461+0000","last_clean":"2023-08-11T12:22:09.066461+0000","last_became_active":"2023-08-11T12:22:08.067857+0000","last_became_peered":"2023-08-11T12:22:08.067857+0000","last_unstale":"2023-08-11T12:22:09.066461+0000","last_undegraded":"2023-08-11T12:22:09.066461+0000","last_fullsized":"2023-08-11T12:22:09.066461+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:04:45.455163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.969839+0000","last_change":"2023-08-11T12:22:02.846441+0000","last_active":"2023-08-11T12:22:08.969839+0000","last_peered":"2023-08-11T12:22:08.969839+0000","last_clean":"2023-08-11T12:22:08.969839+0000","last_became_active":"2023-08-11T12:22:02.846153+0000","last_became_peered":"2023-08-11T12:22:02.846153+0000","last_unstale":"2023-08-11T12:22:08.969839+0000","last_undegraded":"2023-08-11T12:22:08.969839+0000","last_fullsized":"2023-08-11T12:22:08.969839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:16:33.873694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879314+0000","last_change":"2023-08-11T12:22:03.841932+0000","last_active":"2023-08-11T12:22:08.879314+0000","last_peered":"2023-08-11T12:22:08.879314+0000","last_clean":"2023-08-11T12:22:08.879314+0000","last_became_active":"2023-08-11T12:22:03.841635+0000","last_became_peered":"2023-08-11T12:22:03.841635+0000","last_unstale":"2023-08-11T12:22:08.879314+0000","last_undegraded":"2023-08-11T12:22:08.879314+0000","last_fullsized":"2023-08-11T12:22:08.879314+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:29:41.880454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722748+0000","last_change":"2023-08-11T12:22:07.886160+0000","last_active":"2023-08-11T12:22:31.722748+0000","last_peered":"2023-08-11T12:22:31.722748+0000","last_clean":"2023-08-11T12:22:31.722748+0000","last_became_active":"2023-08-11T12:22:07.885703+0000","last_became_peered":"2023-08-11T12:22:07.885703+0000","last_unstale":"2023-08-11T12:22:31.722748+0000","last_undegraded":"2023-08-11T12:22:31.722748+0000","last_fullsized":"2023-08-11T12:22:31.722748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:50:20.362829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"87'3","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:28.723203+0000","last_change":"2023-08-11T12:22:02.849360+0000","last_active":"2023-08-11T12:22:28.723203+0000","last_peered":"2023-08-11T12:22:28.723203+0000","last_clean":"2023-08-11T12:22:28.723203+0000","last_became_active":"2023-08-11T12:22:02.849028+0000","last_became_peered":"2023-08-11T12:22:02.849028+0000","last_unstale":"2023-08-11T12:22:28.723203+0000","last_undegraded":"2023-08-11T12:22:28.723203+0000","last_fullsized":"2023-08-11T12:22:28.723203+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:07:06.158016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.722533+0000","last_change":"2023-08-11T12:22:03.850285+0000","last_active":"2023-08-11T12:22:30.722533+0000","last_peered":"2023-08-11T12:22:30.722533+0000","last_clean":"2023-08-11T12:22:30.722533+0000","last_became_active":"2023-08-11T12:22:03.849978+0000","last_became_peered":"2023-08-11T12:22:03.849978+0000","last_unstale":"2023-08-11T12:22:30.722533+0000","last_undegraded":"2023-08-11T12:22:30.722533+0000","last_fullsized":"2023-08-11T12:22:30.722533+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:46:04.770888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066835+0000","last_change":"2023-08-11T12:22:07.881578+0000","last_active":"2023-08-11T12:22:09.066835+0000","last_peered":"2023-08-11T12:22:09.066835+0000","last_clean":"2023-08-11T12:22:09.066835+0000","last_became_active":"2023-08-11T12:22:07.881145+0000","last_became_peered":"2023-08-11T12:22:07.881145+0000","last_unstale":"2023-08-11T12:22:09.066835+0000","last_undegraded":"2023-08-11T12:22:09.066835+0000","last_fullsized":"2023-08-11T12:22:09.066835+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:07:17.931014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066542+0000","last_change":"2023-08-11T12:22:02.848875+0000","last_active":"2023-08-11T12:22:09.066542+0000","last_peered":"2023-08-11T12:22:09.066542+0000","last_clean":"2023-08-11T12:22:09.066542+0000","last_became_active":"2023-08-11T12:22:02.848578+0000","last_became_peered":"2023-08-11T12:22:02.848578+0000","last_unstale":"2023-08-11T12:22:09.066542+0000","last_undegraded":"2023-08-11T12:22:09.066542+0000","last_fullsized":"2023-08-11T12:22:09.066542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:57:52.903483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068323+0000","last_change":"2023-08-11T12:22:03.849865+0000","last_active":"2023-08-11T12:22:09.068323+0000","last_peered":"2023-08-11T12:22:09.068323+0000","last_clean":"2023-08-11T12:22:09.068323+0000","last_became_active":"2023-08-11T12:22:03.849557+0000","last_became_peered":"2023-08-11T12:22:03.849557+0000","last_unstale":"2023-08-11T12:22:09.068323+0000","last_undegraded":"2023-08-11T12:22:09.068323+0000","last_fullsized":"2023-08-11T12:22:09.068323+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:17:08.368108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066684+0000","last_change":"2023-08-11T12:22:08.067009+0000","last_active":"2023-08-11T12:22:09.066684+0000","last_peered":"2023-08-11T12:22:09.066684+0000","last_clean":"2023-08-11T12:22:09.066684+0000","last_became_active":"2023-08-11T12:22:08.066477+0000","last_became_peered":"2023-08-11T12:22:08.066477+0000","last_unstale":"2023-08-11T12:22:09.066684+0000","last_undegraded":"2023-08-11T12:22:09.066684+0000","last_fullsized":"2023-08-11T12:22:09.066684+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:05:08.273531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":2,"reported_epoch":88,"state":"peering","last_fresh":"2023-08-11T12:22:08.879523+0000","last_change":"2023-08-11T12:22:30.923867+0000","last_active":"2023-08-11T12:22:30.923867+0000","last_peered":"2023-08-11T12:22:08.879523+0000","last_clean":"2023-08-11T12:22:08.879523+0000","last_became_active":"2023-08-11T12:22:02.847394+0000","last_became_peered":"2023-08-11T12:22:02.847394+0000","last_unstale":"2023-08-11T12:22:08.879523+0000","last_undegraded":"2023-08-11T12:22:08.879523+0000","last_fullsized":"2023-08-11T12:22:08.879523+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880009+0000","last_change":"2023-08-11T12:22:03.848715+0000","last_active":"2023-08-11T12:22:08.880009+0000","last_peered":"2023-08-11T12:22:08.880009+0000","last_clean":"2023-08-11T12:22:08.880009+0000","last_became_active":"2023-08-11T12:22:03.848311+0000","last_became_peered":"2023-08-11T12:22:03.848311+0000","last_unstale":"2023-08-11T12:22:08.880009+0000","last_undegraded":"2023-08-11T12:22:08.880009+0000","last_fullsized":"2023-08-11T12:22:08.880009+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:58:34.865429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.969957+0000","last_change":"2023-08-11T12:22:07.882566+0000","last_active":"2023-08-11T12:22:08.969957+0000","last_peered":"2023-08-11T12:22:08.969957+0000","last_clean":"2023-08-11T12:22:08.969957+0000","last_became_active":"2023-08-11T12:22:07.882198+0000","last_became_peered":"2023-08-11T12:22:07.882198+0000","last_unstale":"2023-08-11T12:22:08.969957+0000","last_undegraded":"2023-08-11T12:22:08.969957+0000","last_fullsized":"2023-08-11T12:22:08.969957+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:59:38.231276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066849+0000","last_change":"2023-08-11T12:22:02.846424+0000","last_active":"2023-08-11T12:22:09.066849+0000","last_peered":"2023-08-11T12:22:09.066849+0000","last_clean":"2023-08-11T12:22:09.066849+0000","last_became_active":"2023-08-11T12:22:02.846063+0000","last_became_peered":"2023-08-11T12:22:02.846063+0000","last_unstale":"2023-08-11T12:22:09.066849+0000","last_undegraded":"2023-08-11T12:22:09.066849+0000","last_fullsized":"2023-08-11T12:22:09.066849+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:09:23.947071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880442+0000","last_change":"2023-08-11T12:22:03.845616+0000","last_active":"2023-08-11T12:22:08.880442+0000","last_peered":"2023-08-11T12:22:08.880442+0000","last_clean":"2023-08-11T12:22:08.880442+0000","last_became_active":"2023-08-11T12:22:03.845293+0000","last_became_peered":"2023-08-11T12:22:03.845293+0000","last_unstale":"2023-08-11T12:22:08.880442+0000","last_undegraded":"2023-08-11T12:22:08.880442+0000","last_fullsized":"2023-08-11T12:22:08.880442+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:43:24.438207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716312+0000","last_change":"2023-08-11T12:22:07.888963+0000","last_active":"2023-08-11T12:22:30.716312+0000","last_peered":"2023-08-11T12:22:30.716312+0000","last_clean":"2023-08-11T12:22:30.716312+0000","last_became_active":"2023-08-11T12:22:07.888513+0000","last_became_peered":"2023-08-11T12:22:07.888513+0000","last_unstale":"2023-08-11T12:22:30.716312+0000","last_undegraded":"2023-08-11T12:22:30.716312+0000","last_fullsized":"2023-08-11T12:22:30.716312+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:23:50.241697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068238+0000","last_change":"2023-08-11T12:22:02.850739+0000","last_active":"2023-08-11T12:22:09.068238+0000","last_peered":"2023-08-11T12:22:09.068238+0000","last_clean":"2023-08-11T12:22:09.068238+0000","last_became_active":"2023-08-11T12:22:02.850455+0000","last_became_peered":"2023-08-11T12:22:02.850455+0000","last_unstale":"2023-08-11T12:22:09.068238+0000","last_undegraded":"2023-08-11T12:22:09.068238+0000","last_fullsized":"2023-08-11T12:22:09.068238+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:48:26.768060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880073+0000","last_change":"2023-08-11T12:22:03.838834+0000","last_active":"2023-08-11T12:22:08.880073+0000","last_peered":"2023-08-11T12:22:08.880073+0000","last_clean":"2023-08-11T12:22:08.880073+0000","last_became_active":"2023-08-11T12:22:03.838435+0000","last_became_peered":"2023-08-11T12:22:03.838435+0000","last_unstale":"2023-08-11T12:22:08.880073+0000","last_undegraded":"2023-08-11T12:22:08.880073+0000","last_fullsized":"2023-08-11T12:22:08.880073+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:01:44.440343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066277+0000","last_change":"2023-08-11T12:22:07.884481+0000","last_active":"2023-08-11T12:22:09.066277+0000","last_peered":"2023-08-11T12:22:09.066277+0000","last_clean":"2023-08-11T12:22:09.066277+0000","last_became_active":"2023-08-11T12:22:07.884084+0000","last_became_peered":"2023-08-11T12:22:07.884084+0000","last_unstale":"2023-08-11T12:22:09.066277+0000","last_undegraded":"2023-08-11T12:22:09.066277+0000","last_fullsized":"2023-08-11T12:22:09.066277+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:54:33.489782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879471+0000","last_change":"2023-08-11T12:22:02.849339+0000","last_active":"2023-08-11T12:22:08.879471+0000","last_peered":"2023-08-11T12:22:08.879471+0000","last_clean":"2023-08-11T12:22:08.879471+0000","last_became_active":"2023-08-11T12:22:02.848986+0000","last_became_peered":"2023-08-11T12:22:02.848986+0000","last_unstale":"2023-08-11T12:22:08.879471+0000","last_undegraded":"2023-08-11T12:22:08.879471+0000","last_fullsized":"2023-08-11T12:22:08.879471+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:54:41.533973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880177+0000","last_change":"2023-08-11T12:22:03.846301+0000","last_active":"2023-08-11T12:22:08.880177+0000","last_peered":"2023-08-11T12:22:08.880177+0000","last_clean":"2023-08-11T12:22:08.880177+0000","last_became_active":"2023-08-11T12:22:03.845990+0000","last_became_peered":"2023-08-11T12:22:03.845990+0000","last_unstale":"2023-08-11T12:22:08.880177+0000","last_undegraded":"2023-08-11T12:22:08.880177+0000","last_fullsized":"2023-08-11T12:22:08.880177+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:13:13.325427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.722464+0000","last_change":"2023-08-11T12:22:03.836652+0000","last_active":"2023-08-11T12:22:30.722464+0000","last_peered":"2023-08-11T12:22:30.722464+0000","last_clean":"2023-08-11T12:22:30.722464+0000","last_became_active":"2023-08-11T12:22:03.836236+0000","last_became_peered":"2023-08-11T12:22:03.836236+0000","last_unstale":"2023-08-11T12:22:30.722464+0000","last_undegraded":"2023-08-11T12:22:30.722464+0000","last_fullsized":"2023-08-11T12:22:30.722464+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:22:25.801143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067076+0000","last_change":"2023-08-11T12:22:03.831318+0000","last_active":"2023-08-11T12:22:09.067076+0000","last_peered":"2023-08-11T12:22:09.067076+0000","last_clean":"2023-08-11T12:22:09.067076+0000","last_became_active":"2023-08-11T12:22:03.830670+0000","last_became_peered":"2023-08-11T12:22:03.830670+0000","last_unstale":"2023-08-11T12:22:09.067076+0000","last_undegraded":"2023-08-11T12:22:09.067076+0000","last_fullsized":"2023-08-11T12:22:09.067076+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:26:18.125172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066384+0000","last_change":"2023-08-11T12:22:03.841396+0000","last_active":"2023-08-11T12:22:09.066384+0000","last_peered":"2023-08-11T12:22:09.066384+0000","last_clean":"2023-08-11T12:22:09.066384+0000","last_became_active":"2023-08-11T12:22:03.841076+0000","last_became_peered":"2023-08-11T12:22:03.841076+0000","last_unstale":"2023-08-11T12:22:09.066384+0000","last_undegraded":"2023-08-11T12:22:09.066384+0000","last_fullsized":"2023-08-11T12:22:09.066384+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:31:49.747283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716636+0000","last_change":"2023-08-11T12:22:03.847266+0000","last_active":"2023-08-11T12:22:30.716636+0000","last_peered":"2023-08-11T12:22:30.716636+0000","last_clean":"2023-08-11T12:22:30.716636+0000","last_became_active":"2023-08-11T12:22:03.846898+0000","last_became_peered":"2023-08-11T12:22:03.846898+0000","last_unstale":"2023-08-11T12:22:30.716636+0000","last_undegraded":"2023-08-11T12:22:30.716636+0000","last_fullsized":"2023-08-11T12:22:30.716636+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:01:44.284193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879562+0000","last_change":"2023-08-11T12:22:03.843491+0000","last_active":"2023-08-11T12:22:08.879562+0000","last_peered":"2023-08-11T12:22:08.879562+0000","last_clean":"2023-08-11T12:22:08.879562+0000","last_became_active":"2023-08-11T12:22:03.843099+0000","last_became_peered":"2023-08-11T12:22:03.843099+0000","last_unstale":"2023-08-11T12:22:08.879562+0000","last_undegraded":"2023-08-11T12:22:08.879562+0000","last_fullsized":"2023-08-11T12:22:08.879562+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:06:59.399331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.724108+0000","last_change":"2023-08-11T12:22:03.840508+0000","last_active":"2023-08-11T12:22:30.724108+0000","last_peered":"2023-08-11T12:22:30.724108+0000","last_clean":"2023-08-11T12:22:30.724108+0000","last_became_active":"2023-08-11T12:22:03.840160+0000","last_became_peered":"2023-08-11T12:22:03.840160+0000","last_unstale":"2023-08-11T12:22:30.724108+0000","last_undegraded":"2023-08-11T12:22:30.724108+0000","last_fullsized":"2023-08-11T12:22:30.724108+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:42:10.983782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067345+0000","last_change":"2023-08-11T12:22:03.843724+0000","last_active":"2023-08-11T12:22:09.067345+0000","last_peered":"2023-08-11T12:22:09.067345+0000","last_clean":"2023-08-11T12:22:09.067345+0000","last_became_active":"2023-08-11T12:22:03.843431+0000","last_became_peered":"2023-08-11T12:22:03.843431+0000","last_unstale":"2023-08-11T12:22:09.067345+0000","last_undegraded":"2023-08-11T12:22:09.067345+0000","last_fullsized":"2023-08-11T12:22:09.067345+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:31:51.191070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068290+0000","last_change":"2023-08-11T12:22:03.831268+0000","last_active":"2023-08-11T12:22:09.068290+0000","last_peered":"2023-08-11T12:22:09.068290+0000","last_clean":"2023-08-11T12:22:09.068290+0000","last_became_active":"2023-08-11T12:22:03.830839+0000","last_became_peered":"2023-08-11T12:22:03.830839+0000","last_unstale":"2023-08-11T12:22:09.068290+0000","last_undegraded":"2023-08-11T12:22:09.068290+0000","last_fullsized":"2023-08-11T12:22:09.068290+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:56:40.087593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066807+0000","last_change":"2023-08-11T12:22:03.839227+0000","last_active":"2023-08-11T12:22:09.066807+0000","last_peered":"2023-08-11T12:22:09.066807+0000","last_clean":"2023-08-11T12:22:09.066807+0000","last_became_active":"2023-08-11T12:22:03.838526+0000","last_became_peered":"2023-08-11T12:22:03.838526+0000","last_unstale":"2023-08-11T12:22:09.066807+0000","last_undegraded":"2023-08-11T12:22:09.066807+0000","last_fullsized":"2023-08-11T12:22:09.066807+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:01:52.337807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067944+0000","last_change":"2023-08-11T12:22:03.834614+0000","last_active":"2023-08-11T12:22:09.067944+0000","last_peered":"2023-08-11T12:22:09.067944+0000","last_clean":"2023-08-11T12:22:09.067944+0000","last_became_active":"2023-08-11T12:22:03.834267+0000","last_became_peered":"2023-08-11T12:22:03.834267+0000","last_unstale":"2023-08-11T12:22:09.067944+0000","last_undegraded":"2023-08-11T12:22:09.067944+0000","last_fullsized":"2023-08-11T12:22:09.067944+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:22:51.239980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.970204+0000","last_change":"2023-08-11T12:22:03.846504+0000","last_active":"2023-08-11T12:22:08.970204+0000","last_peered":"2023-08-11T12:22:08.970204+0000","last_clean":"2023-08-11T12:22:08.970204+0000","last_became_active":"2023-08-11T12:22:03.846156+0000","last_became_peered":"2023-08-11T12:22:03.846156+0000","last_unstale":"2023-08-11T12:22:08.970204+0000","last_undegraded":"2023-08-11T12:22:08.970204+0000","last_fullsized":"2023-08-11T12:22:08.970204+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:37:05.136958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879069+0000","last_change":"2023-08-11T12:22:03.849854+0000","last_active":"2023-08-11T12:22:08.879069+0000","last_peered":"2023-08-11T12:22:08.879069+0000","last_clean":"2023-08-11T12:22:08.879069+0000","last_became_active":"2023-08-11T12:22:03.849553+0000","last_became_peered":"2023-08-11T12:22:03.849553+0000","last_unstale":"2023-08-11T12:22:08.879069+0000","last_undegraded":"2023-08-11T12:22:08.879069+0000","last_fullsized":"2023-08-11T12:22:08.879069+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:28:10.396410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.723809+0000","last_change":"2023-08-11T12:22:03.843511+0000","last_active":"2023-08-11T12:22:30.723809+0000","last_peered":"2023-08-11T12:22:30.723809+0000","last_clean":"2023-08-11T12:22:30.723809+0000","last_became_active":"2023-08-11T12:22:03.843206+0000","last_became_peered":"2023-08-11T12:22:03.843206+0000","last_unstale":"2023-08-11T12:22:30.723809+0000","last_undegraded":"2023-08-11T12:22:30.723809+0000","last_fullsized":"2023-08-11T12:22:30.723809+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:15:11.117760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":248338,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5044,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":8,"num_read_kb":10,"num_write":105,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":21158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91,"ondisk_log_size":91,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449106,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":464654,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.753},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.76700000000000002}]},{"osd":1,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.61299999999999999}]},{"osd":2,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.66600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":4,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.88300000000000001}]},{"osd":6,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.81000000000000005}]},{"osd":7,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.82499999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":9,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.98199999999999998}]},{"osd":10,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.94099999999999995}]}]},{"osd":10,"up_from":71,"seq":304942678036,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":1058957,"data_compressed":47603,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":1,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.42699999999999999}]},{"osd":2,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.58299999999999996}]},{"osd":3,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.64800000000000002}]},{"osd":4,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.71299999999999997}]},{"osd":5,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.629},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.78300000000000003}]},{"osd":6,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.75600000000000001}]},{"osd":7,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.59099999999999997}]},{"osd":8,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.86799999999999999}]},{"osd":9,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.90500000000000003}]},{"osd":11,"last update":"Fri Aug 11 12:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.85299999999999998}]}]},{"osd":9,"up_from":66,"seq":283467841561,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":484270,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.624}]},{"osd":2,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.79600000000000004}]},{"osd":3,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.71599999999999997}]},{"osd":4,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.69899999999999995}]},{"osd":5,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.754}]},{"osd":6,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.66900000000000004}]},{"osd":8,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.80900000000000005}]},{"osd":10,"last update":"Fri Aug 11 12:21:54 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.90900000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]}]},{"osd":8,"up_from":58,"seq":249108103199,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":464810,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.45700000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.75700000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72199999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.81100000000000005}]},{"osd":1,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.443,"5min":0.372,"15min":0.372},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54900000000000004}]},{"osd":2,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.437,"15min":0.42699999999999999},"min":{"1min":0.34100000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.45000000000000001,"15min":0.439},"min":{"1min":0.32500000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.76900000000000002,"5min":0.878,"15min":0.878},"last":0.39300000000000002}]},{"osd":3,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63700000000000001,"15min":0.63900000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82399999999999995,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.61899999999999999,"15min":0.60999999999999999},"min":{"1min":0.42899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.92900000000000005}]},{"osd":4,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.44500000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.66200000000000003,"15min":0.65200000000000002},"min":{"1min":0.49299999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.56599999999999995}]},{"osd":5,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.54300000000000004,"15min":0.52900000000000003},"min":{"1min":0.34899999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.44},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.57899999999999996,"15min":0.56299999999999994},"min":{"1min":0.40600000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.41699999999999998}]},{"osd":6,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.69799999999999995,"15min":0.68500000000000005},"min":{"1min":0.51300000000000001,"5min":0.441,"15min":0.441},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.72599999999999998,"15min":0.71499999999999997},"min":{"1min":0.59499999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.82499999999999996}]},{"osd":7,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.70699999999999996,"15min":0.69099999999999995},"min":{"1min":0.54200000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72299999999999998,"15min":0.71299999999999997},"min":{"1min":0.48899999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.58099999999999996}]},{"osd":9,"last update":"Fri Aug 11 12:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.86599999999999999}]},{"osd":10,"last update":"Fri Aug 11 12:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.89800000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":7,"up_from":51,"seq":219043332130,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":1055371,"data_compressed":47603,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.61399999999999999,"15min":0.60599999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.55200000000000005,"15min":0.53700000000000003},"min":{"1min":0.46999999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.65700000000000003}]},{"osd":1,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.41099999999999998,"15min":0.40100000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.45000000000000001,"15min":0.442},"min":{"1min":0.312,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.54400000000000004}]},{"osd":2,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.42899999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.59099999999999997,"15min":0.57999999999999996},"min":{"1min":0.498,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80900000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.61399999999999999}]},{"osd":3,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.61499999999999999,"15min":0.60699999999999998},"min":{"1min":0.432,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.64000000000000001,"15min":0.626},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.66100000000000003}]},{"osd":4,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.54400000000000004,"15min":0.53600000000000003},"min":{"1min":0.36199999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.434},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53800000000000003,"15min":0.53500000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.0149999999999999,"5min":1.105,"15min":1.105},"last":0.48499999999999999}]},{"osd":5,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.66300000000000003,"15min":0.65600000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.66200000000000003,"15min":0.65600000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.68600000000000005}]},{"osd":6,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.73299999999999998,"15min":0.71699999999999997},"min":{"1min":0.59399999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.70199999999999996,"15min":0.68500000000000005},"min":{"1min":0.59399999999999997,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.56399999999999995}]},{"osd":8,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.70099999999999996,"15min":0.68300000000000005},"min":{"1min":0.56899999999999995,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.69399999999999995,"15min":0.68000000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.78500000000000003}]},{"osd":9,"last update":"Fri Aug 11 12:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.75900000000000001}]},{"osd":10,"last update":"Fri Aug 11 12:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.80300000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]}]},{"osd":6,"up_from":46,"seq":197568495656,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":464072,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47499999999999998,"15min":0.46300000000000002},"min":{"1min":0.37,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.73599999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.435},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51800000000000002,"15min":0.50800000000000001},"min":{"1min":0.375,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61599999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.50900000000000001}]},{"osd":1,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.65400000000000003,"15min":0.63},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.878,"5min":1.327,"15min":1.327},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.69199999999999995,"15min":0.67500000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98599999999999999,"5min":1.206,"15min":1.206},"last":0.60299999999999998}]},{"osd":2,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.69199999999999995,"15min":0.68799999999999994},"min":{"1min":0.51000000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98399999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.70599999999999996,"15min":0.69299999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.63600000000000001}]},{"osd":3,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59699999999999998,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67400000000000004,"15min":0.66200000000000003},"min":{"1min":0.48499999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.05,"5min":1.196,"15min":1.196},"last":0.66100000000000003}]},{"osd":4,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69799999999999995,"15min":0.69599999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97199999999999998,"5min":1.139,"15min":1.139},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.752,"15min":0.74099999999999999},"min":{"1min":0.52600000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.012,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.81200000000000006}]},{"osd":5,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.77800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56599999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1499999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80600000000000005,"15min":0.80500000000000005},"min":{"1min":0.59299999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0109999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.84799999999999998}]},{"osd":7,"last update":"Fri Aug 11 12:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.81599999999999995,"15min":0.80400000000000005},"min":{"1min":0.59199999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.177,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.82099999999999995,"15min":0.81299999999999994},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.90600000000000003}]},{"osd":8,"last update":"Fri Aug 11 12:22:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.83199999999999996,"15min":0.83699999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.079,"5min":1.284,"15min":1.284},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.877,"15min":0.88500000000000001},"min":{"1min":0.65500000000000003,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1839999999999999,"5min":1.387,"15min":1.387},"last":0.83099999999999996}]},{"osd":9,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.86799999999999999}]},{"osd":10,"last update":"Fri Aug 11 12:21:54 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.88100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":467914,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.53400000000000003,"15min":0.51200000000000001},"min":{"1min":0.35099999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.96099999999999997,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.55500000000000005,"15min":0.56299999999999994},"min":{"1min":0.378,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.83199999999999996,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.69399999999999995}]},{"osd":2,"last update":"Fri Aug 11 12:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.40699999999999997,"5min":0.315,"15min":0.315},"max":{"1min":0.76000000000000001,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.53800000000000003,"15min":0.51100000000000001},"min":{"1min":0.40300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79400000000000004,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.752}]},{"osd":3,"last update":"Fri Aug 11 12:22:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80700000000000005,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65600000000000003,"15min":0.63200000000000001},"min":{"1min":0.49099999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90600000000000003,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.77500000000000002}]},{"osd":4,"last update":"Fri Aug 11 12:21:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46200000000000002,"15min":0.44500000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.745,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.47699999999999998,"15min":0.47299999999999998},"min":{"1min":0.26500000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.63,"15min":0.60799999999999998},"min":{"1min":0.44,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89000000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.60899999999999999,"15min":0.60099999999999998},"min":{"1min":0.48399999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.80900000000000005}]},{"osd":6,"last update":"Fri Aug 11 12:21:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72999999999999998,"15min":0.73499999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94399999999999995,"5min":1.095,"15min":1.095},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78000000000000003,"15min":0.78200000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.99299999999999999,"5min":1.159,"15min":1.159},"last":0.88900000000000001}]},{"osd":7,"last update":"Fri Aug 11 12:21:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.35799999999999998,"5min":0.31,"15min":0.31},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.90600000000000003}]},{"osd":8,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72799999999999998,"15min":0.72199999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93400000000000005,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.74199999999999999,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.436,"15min":0.436},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":1.008}]},{"osd":9,"last update":"Fri Aug 11 12:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.871},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.96499999999999997}]},{"osd":10,"last update":"Fri Aug 11 12:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.93400000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738435,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":465550,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 11 12:21:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.57799999999999996,"15min":0.52800000000000002},"min":{"1min":0.42899999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.96699999999999997,"5min":1.782,"15min":1.782},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.58799999999999997,"15min":0.53800000000000003},"min":{"1min":0.46400000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.069,"5min":2.7749999999999999,"15min":2.7749999999999999},"last":0.68200000000000005}]},{"osd":2,"last update":"Fri Aug 11 12:21:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59399999999999997,"15min":0.55300000000000005},"min":{"1min":0.40799999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.63400000000000001,"15min":0.57799999999999996},"min":{"1min":0.46400000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94699999999999995,"5min":1.879,"15min":1.879},"last":0.60699999999999998}]},{"osd":3,"last update":"Fri Aug 11 12:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.49399999999999999,"15min":0.48099999999999998},"min":{"1min":0.40500000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.36599999999999999}]},{"osd":4,"last update":"Fri Aug 11 12:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.66100000000000003,"15min":0.61199999999999999},"min":{"1min":0.503,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.016,"5min":1.849,"15min":1.849},"last":0.501},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.67800000000000005,"15min":0.63100000000000001},"min":{"1min":0.54600000000000004,"5min":0.443,"15min":0.443},"max":{"1min":1.085,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":0.42999999999999999}]},{"osd":5,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.71899999999999997,"15min":0.68999999999999995},"min":{"1min":0.54800000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.99399999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.748,"15min":0.71999999999999997},"min":{"1min":0.55200000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1020000000000001,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.82799999999999996}]},{"osd":6,"last update":"Fri Aug 11 12:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97699999999999998,"5min":2.8839999999999999,"15min":2.8839999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.70999999999999996,"15min":0.71599999999999997},"min":{"1min":0.41299999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.95799999999999996,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.76900000000000002}]},{"osd":7,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83799999999999997,"15min":0.83699999999999997},"min":{"1min":0.55400000000000005,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.409,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.628},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.91500000000000004,"15min":0.92600000000000005},"min":{"1min":0.61399999999999999,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.385,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.55100000000000005}]},{"osd":8,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.82899999999999996,"15min":0.84399999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.91800000000000004,"5min":1.262,"15min":1.262},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.92200000000000004,"15min":0.93700000000000006},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.079,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.65100000000000002}]},{"osd":9,"last update":"Fri Aug 11 12:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.86299999999999999}]},{"osd":10,"last update":"Fri Aug 11 12:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.748}]},{"osd":11,"last update":"Fri Aug 11 12:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.78900000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411386,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":467279,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.60899999999999999,"15min":0.54400000000000004},"min":{"1min":0.39100000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.80900000000000005,"5min":5.968,"15min":5.968},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.40600000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.50900000000000001}]},{"osd":1,"last update":"Fri Aug 11 12:21:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.52400000000000002,"15min":0.502},"min":{"1min":0.38200000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.55000000000000004,"15min":0.52300000000000002},"min":{"1min":0.45600000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.72599999999999998}]},{"osd":3,"last update":"Fri Aug 11 12:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61299999999999999,"15min":0.59699999999999998},"min":{"1min":0.45800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.623,"15min":0.59899999999999998},"min":{"1min":0.46899999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.76300000000000001}]},{"osd":4,"last update":"Fri Aug 11 12:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.57799999999999996,"15min":0.56799999999999995},"min":{"1min":0.441,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59999999999999998,"15min":0.58699999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.70399999999999996}]},{"osd":5,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.44400000000000001,"15min":0.42799999999999999},"min":{"1min":0.31,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.622},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.46800000000000003,"15min":0.44800000000000001},"min":{"1min":0.32800000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.54000000000000004}]},{"osd":6,"last update":"Fri Aug 11 12:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.48599999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.878,"5min":0.879,"15min":0.879},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.63100000000000001,"15min":0.61599999999999999},"min":{"1min":0.53200000000000003,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.84599999999999997}]},{"osd":7,"last update":"Fri Aug 11 12:21:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.59799999999999998,"15min":0.58399999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.53100000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.88800000000000001}]},{"osd":8,"last update":"Fri Aug 11 12:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.60299999999999998,"15min":0.58899999999999997},"min":{"1min":0.40000000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.57399999999999995,"15min":0.56000000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.81299999999999994}]},{"osd":9,"last update":"Fri Aug 11 12:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.874},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.97699999999999998}]},{"osd":10,"last update":"Fri Aug 11 12:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.92200000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]}]},{"osd":3,"up_from":25,"seq":107374182453,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":464266,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.437,"15min":0.38700000000000001},"min":{"1min":0.33900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.499,"5min":0.46999999999999997,"15min":0.438},"min":{"1min":0.36299999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67300000000000004,"5min":1.006,"15min":1.006},"last":0.59899999999999998}]},{"osd":1,"last update":"Fri Aug 11 12:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64200000000000002,"15min":0.57399999999999995},"min":{"1min":0.48399999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.98599999999999999,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.63200000000000001,"15min":0.59299999999999997},"min":{"1min":0.45100000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92200000000000004,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.69699999999999995}]},{"osd":2,"last update":"Fri Aug 11 12:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.64700000000000002,"15min":0.61799999999999999},"min":{"1min":0.54600000000000004,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85099999999999998,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.69699999999999995,"15min":0.63},"min":{"1min":0.56299999999999994,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":1.018}]},{"osd":4,"last update":"Fri Aug 11 12:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.64000000000000001,"15min":0.60799999999999998},"min":{"1min":0.53100000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.68899999999999995,"15min":0.63700000000000001},"min":{"1min":0.67200000000000004,"5min":0.435,"15min":0.435},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.82699999999999996}]},{"osd":5,"last update":"Fri Aug 11 12:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.68899999999999995,"15min":0.65100000000000002},"min":{"1min":0.629,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.70899999999999996,"15min":0.66900000000000004},"min":{"1min":0.60899999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.85699999999999998}]},{"osd":6,"last update":"Fri Aug 11 12:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.77400000000000002,"15min":0.76000000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0900000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.71599999999999997,"15min":0.71099999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":1.0309999999999999}]},{"osd":7,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.78300000000000003,"15min":0.76400000000000001},"min":{"1min":0.65800000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.89900000000000002,"15min":0.88500000000000001},"min":{"1min":0.71799999999999997,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.86899999999999999}]},{"osd":8,"last update":"Fri Aug 11 12:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":1.004},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.91600000000000004}]},{"osd":9,"last update":"Fri Aug 11 12:21:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.92900000000000005}]},{"osd":10,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]}]},{"osd":4,"up_from":33,"seq":141733920817,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":942080,"data_stored":464094,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.39900000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.81599999999999995,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.41399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80900000000000005,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.72099999999999997}]},{"osd":1,"last update":"Fri Aug 11 12:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.40400000000000003,"15min":0.39600000000000002},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.38700000000000001,"15min":0.372},"min":{"1min":0.308,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.60399999999999998}]},{"osd":2,"last update":"Fri Aug 11 12:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.59699999999999998,"15min":0.57299999999999995},"min":{"1min":0.48599999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.58699999999999997,"15min":0.55900000000000005},"min":{"1min":0.54400000000000004,"5min":0.378,"15min":0.378},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.83999999999999997}]},{"osd":3,"last update":"Fri Aug 11 12:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.57699999999999996,"15min":0.55900000000000005},"min":{"1min":0.439,"5min":0.379,"15min":0.379},"max":{"1min":0.77300000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.41099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.77700000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.73199999999999998}]},{"osd":5,"last update":"Fri Aug 11 12:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.59499999999999997,"15min":0.56699999999999995},"min":{"1min":0.42199999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.60899999999999999,"15min":0.57599999999999996},"min":{"1min":0.42099999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.92900000000000005}]},{"osd":6,"last update":"Fri Aug 11 12:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.71399999999999997,"15min":0.69599999999999995},"min":{"1min":0.53400000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.63,"15min":0.61599999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.878}]},{"osd":7,"last update":"Fri Aug 11 12:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.58599999999999997,"15min":0.57099999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.64500000000000002,"15min":0.629},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":1.0189999999999999}]},{"osd":8,"last update":"Fri Aug 11 12:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.76200000000000001,"15min":0.749},"min":{"1min":0.63900000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":1.0700000000000001}]},{"osd":9,"last update":"Fri Aug 11 12:21:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":1.1459999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":1.0429999999999999}]},{"osd":10,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.80900000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]}]},{"osd":5,"up_from":38,"seq":163208757292,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":1054622,"data_compressed":47603,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.51900000000000002},"min":{"1min":0.32200000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70599999999999996,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35399999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.624,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.439}]},{"osd":1,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.38100000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77500000000000002,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.623,"5min":0.57699999999999996,"15min":0.56100000000000005},"min":{"1min":0.42099999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.83499999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.77400000000000002}]},{"osd":2,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.29799999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.41399999999999998,"15min":0.39800000000000002},"min":{"1min":0.27700000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.46999999999999997}]},{"osd":3,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72299999999999998,"5min":0.751,"15min":0.751},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.41199999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.77500000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.504}]},{"osd":4,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.61199999999999999,"15min":0.59199999999999997},"min":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1,"5min":1.016,"15min":1.016},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60899999999999999,"15min":0.60299999999999998},"min":{"1min":0.443,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.58099999999999996}]},{"osd":6,"last update":"Fri Aug 11 12:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.623,"15min":0.61099999999999999},"min":{"1min":0.40300000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89300000000000002,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.625},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.68100000000000005,"15min":0.66800000000000004},"min":{"1min":0.499,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.64500000000000002}]},{"osd":7,"last update":"Fri Aug 11 12:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.47199999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.68000000000000005}]},{"osd":8,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.60299999999999998,"15min":0.59299999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.56499999999999995,"15min":0.55800000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.69699999999999995}]},{"osd":9,"last update":"Fri Aug 11 12:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.754},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.85099999999999998}]},{"osd":10,"last update":"Fri Aug 11 12:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.72099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34304,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34304,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-11T12:22:32.648 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-11T12:22:32.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.889+0000 7fb70c5ff700 1 -- 172.21.15.8:0/50631582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb704101bd0 msgr2=0x7fb704102030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:32.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.889+0000 7fb70c5ff700 1 --2- 172.21.15.8:0/50631582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb704101bd0 0x7fb704102030 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb6f40099c0 tx=0x7fb6f4009cd0 comp rx=0 tx=0).stop 2023-08-11T12:22:32.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.889+0000 7fb70c5ff700 1 -- 172.21.15.8:0/50631582 shutdown_connections 2023-08-11T12:22:32.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.889+0000 7fb70c5ff700 1 --2- 172.21.15.8:0/50631582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb704102570 0x7fb704108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:32.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.889+0000 7fb70c5ff700 1 --2- 172.21.15.8:0/50631582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7041009e0 0x7fb704100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:32.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.889+0000 7fb70c5ff700 1 --2- 172.21.15.8:0/50631582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb704101bd0 0x7fb704102030 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:32.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.889+0000 7fb70c5ff700 1 -- 172.21.15.8:0/50631582 >> 172.21.15.8:0/50631582 conn(0x7fb7040fbf50 msgr2=0x7fb7040fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:32.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.890+0000 7fb70c5ff700 1 -- 172.21.15.8:0/50631582 shutdown_connections 2023-08-11T12:22:32.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.890+0000 7fb70c5ff700 1 -- 172.21.15.8:0/50631582 wait complete. 2023-08-11T12:22:32.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.891+0000 7fb70c5ff700 1 Processor -- start 2023-08-11T12:22:32.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.891+0000 7fb70c5ff700 1 -- start start 2023-08-11T12:22:32.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.891+0000 7fb70c5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7041009e0 0x7fb7041988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:32.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.891+0000 7fb70c5ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb704101bd0 0x7fb704198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:32.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.891+0000 7fb70c5ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb704102570 0x7fb70419fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:32.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.891+0000 7fb70c5ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7041a0470 con 0x7fb704102570 2023-08-11T12:22:32.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.891+0000 7fb70c5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7041a05b0 con 0x7fb7041009e0 2023-08-11T12:22:32.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.891+0000 7fb70c5ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7041a0740 con 0x7fb704101bd0 2023-08-11T12:22:32.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.891+0000 7fb709b9a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb704101bd0 0x7fb704198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:32.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.891+0000 7fb70ab9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb704102570 0x7fb70419fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:32.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.891+0000 7fb70a39b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7041009e0 0x7fb7041988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:32.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.891+0000 7fb709b9a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb704101bd0 0x7fb704198e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:44900/0 (socket says 172.21.15.8:44900) 2023-08-11T12:22:32.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.892+0000 7fb709b9a700 1 -- 172.21.15.8:0/540907625 learned_addr learned my addr 172.21.15.8:0/540907625 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.892+0000 7fb70a39b700 1 -- 172.21.15.8:0/540907625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb704101bd0 msgr2=0x7fb704198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.892+0000 7fb70a39b700 1 --2- 172.21.15.8:0/540907625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb704101bd0 0x7fb704198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.892+0000 7fb70a39b700 1 -- 172.21.15.8:0/540907625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb704102570 msgr2=0x7fb70419fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.892+0000 7fb70a39b700 1 --2- 172.21.15.8:0/540907625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb704102570 0x7fb70419fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.892+0000 7fb70a39b700 1 -- 172.21.15.8:0/540907625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f40095f0 con 0x7fb7041009e0 2023-08-11T12:22:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.892+0000 7fb709b9a700 1 --2- 172.21.15.8:0/540907625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb704101bd0 0x7fb704198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:22:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.892+0000 7fb70ab9c700 1 --2- 172.21.15.8:0/540907625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb704102570 0x7fb70419fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:22:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.892+0000 7fb70a39b700 1 --2- 172.21.15.8:0/540907625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7041009e0 0x7fb7041988f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb70000e9c0 tx=0x7fb70000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.892+0000 7fb6fb7fe700 1 -- 172.21.15.8:0/540907625 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb700004220 con 0x7fb7041009e0 2023-08-11T12:22:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.893+0000 7fb6fb7fe700 1 -- 172.21.15.8:0/540907625 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb700004380 con 0x7fb7041009e0 2023-08-11T12:22:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.893+0000 7fb70c5ff700 1 -- 172.21.15.8:0/540907625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7041a0a20 con 0x7fb7041009e0 2023-08-11T12:22:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.893+0000 7fb6fb7fe700 1 -- 172.21.15.8:0/540907625 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb700003be0 con 0x7fb7041009e0 2023-08-11T12:22:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.893+0000 7fb70c5ff700 1 -- 172.21.15.8:0/540907625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7041a0f30 con 0x7fb7041009e0 2023-08-11T12:22:32.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.894+0000 7fb70c5ff700 1 -- 172.21.15.8:0/540907625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb70410c240 con 0x7fb7041009e0 2023-08-11T12:22:32.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.896+0000 7fb6fb7fe700 1 -- 172.21.15.8:0/540907625 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fb700003d40 con 0x7fb7041009e0 2023-08-11T12:22:32.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.897+0000 7fb6fb7fe700 1 --2- 172.21.15.8:0/540907625 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb6f009ff50 0x7fb6f00a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:32.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.897+0000 7fb6fb7fe700 1 -- 172.21.15.8:0/540907625 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb700014070 con 0x7fb7041009e0 2023-08-11T12:22:32.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.897+0000 7fb709b9a700 1 --2- 172.21.15.8:0/540907625 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb6f009ff50 0x7fb6f00a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:32.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.898+0000 7fb709b9a700 1 --2- 172.21.15.8:0/540907625 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb6f009ff50 0x7fb6f00a2410 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4004800 tx=0x7fb6f401a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:32.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:32.899+0000 7fb6fb7fe700 1 -- 172.21.15.8:0/540907625 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fb7000953e0 con 0x7fb7041009e0 2023-08-11T12:22:33.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:32 smithi008 ceph-mon[97158]: osdmap e89: 12 total, 12 up, 12 in 2023-08-11T12:22:33.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:32 smithi008 ceph-mon[97158]: from='client.24835 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:22:33.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:32 smithi008 ceph-mon[97158]: pgmap v290: 129 pgs: 3 peering, 126 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2023-08-11T12:22:33.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:32 smithi008 ceph-mon[97158]: mds.? [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] up:active 2023-08-11T12:22:33.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:32 smithi008 ceph-mon[97158]: fsmap cephfs:5 2 up:standby-replay 5 up:standby 5 up:active 2023-08-11T12:22:33.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:32 smithi008 ceph-mon[97158]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:22:33.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.107+0000 7fb70c5ff700 1 -- 172.21.15.8:0/540907625 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb7041a1120 con 0x7fb6f009ff50 2023-08-11T12:22:33.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.120+0000 7fb6fb7fe700 1 -- 172.21.15.8:0/540907625 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+422525 (secure 0 0 0) 0x7fb7041a1120 con 0x7fb6f009ff50 2023-08-11T12:22:33.127 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:22:33.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.125+0000 7fb70c5ff700 1 -- 172.21.15.8:0/540907625 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb6f009ff50 msgr2=0x7fb6f00a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:33.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.125+0000 7fb70c5ff700 1 --2- 172.21.15.8:0/540907625 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb6f009ff50 0x7fb6f00a2410 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4004800 tx=0x7fb6f401a040 comp rx=0 tx=0).stop 2023-08-11T12:22:33.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.125+0000 7fb70c5ff700 1 -- 172.21.15.8:0/540907625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7041009e0 msgr2=0x7fb7041988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:33.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.125+0000 7fb70c5ff700 1 --2- 172.21.15.8:0/540907625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7041009e0 0x7fb7041988f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb70000e9c0 tx=0x7fb70000ecd0 comp rx=0 tx=0).stop 2023-08-11T12:22:33.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.126+0000 7fb70c5ff700 1 -- 172.21.15.8:0/540907625 shutdown_connections 2023-08-11T12:22:33.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.126+0000 7fb70c5ff700 1 --2- 172.21.15.8:0/540907625 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb6f009ff50 0x7fb6f00a2410 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:33.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.126+0000 7fb70c5ff700 1 --2- 172.21.15.8:0/540907625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb704102570 0x7fb70419fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:33.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.126+0000 7fb70c5ff700 1 --2- 172.21.15.8:0/540907625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7041009e0 0x7fb7041988f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:33.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.126+0000 7fb70c5ff700 1 --2- 172.21.15.8:0/540907625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb704101bd0 0x7fb704198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:33.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.126+0000 7fb70c5ff700 1 -- 172.21.15.8:0/540907625 >> 172.21.15.8:0/540907625 conn(0x7fb7040fbf50 msgr2=0x7fb7040fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:33.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.126+0000 7fb70c5ff700 1 -- 172.21.15.8:0/540907625 shutdown_connections 2023-08-11T12:22:33.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.126+0000 7fb70c5ff700 1 -- 172.21.15.8:0/540907625 wait complete. 2023-08-11T12:22:33.133 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-08-11T12:22:33.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:32 smithi194 ceph-mon[130905]: osdmap e89: 12 total, 12 up, 12 in 2023-08-11T12:22:33.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:32 smithi194 ceph-mon[130905]: from='client.24835 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:22:33.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:32 smithi194 ceph-mon[130905]: pgmap v290: 129 pgs: 3 peering, 126 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2023-08-11T12:22:33.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:32 smithi194 ceph-mon[130905]: mds.? [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] up:active 2023-08-11T12:22:33.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:32 smithi194 ceph-mon[130905]: fsmap cephfs:5 2 up:standby-replay 5 up:standby 5 up:active 2023-08-11T12:22:33.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:32 smithi194 ceph-mon[130905]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:22:33.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:32 smithi045 ceph-mon[130284]: osdmap e89: 12 total, 12 up, 12 in 2023-08-11T12:22:33.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:32 smithi045 ceph-mon[130284]: from='client.24835 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:22:33.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:32 smithi045 ceph-mon[130284]: pgmap v290: 129 pgs: 3 peering, 126 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2023-08-11T12:22:33.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:32 smithi045 ceph-mon[130284]: mds.? [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] up:active 2023-08-11T12:22:33.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:32 smithi045 ceph-mon[130284]: fsmap cephfs:5 2 up:standby-replay 5 up:standby 5 up:active 2023-08-11T12:22:33.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:32 smithi045 ceph-mon[130284]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:22:33.146 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":290,"stamp":"2023-08-11T12:22:32.510700+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595412,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":144,"num_read_kb":129,"num_write":286,"num_write_kb":2969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":421,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335552,"kb_used_data":11340,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124606272,"statfs":{"total":1151940427776,"available":1151596822528,"internally_reserved":0,"allocated":11612160,"data_stored":7375859,"data_compressed":253652,"data_compressed_allocated":339968,"data_compressed_original":2179072,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":545,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":8,"num_read_kb":10,"num_write":57,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002118"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.724344+0000","last_change":"2023-08-11T12:22:03.850538+0000","last_active":"2023-08-11T12:22:30.724344+0000","last_peered":"2023-08-11T12:22:30.724344+0000","last_clean":"2023-08-11T12:22:30.724344+0000","last_became_active":"2023-08-11T12:22:03.850220+0000","last_became_peered":"2023-08-11T12:22:03.850220+0000","last_unstale":"2023-08-11T12:22:30.724344+0000","last_undegraded":"2023-08-11T12:22:30.724344+0000","last_fullsized":"2023-08-11T12:22:30.724344+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:44:11.152122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716210+0000","last_change":"2023-08-11T12:22:03.843779+0000","last_active":"2023-08-11T12:22:30.716210+0000","last_peered":"2023-08-11T12:22:30.716210+0000","last_clean":"2023-08-11T12:22:30.716210+0000","last_became_active":"2023-08-11T12:22:03.843441+0000","last_became_peered":"2023-08-11T12:22:03.843441+0000","last_unstale":"2023-08-11T12:22:30.716210+0000","last_undegraded":"2023-08-11T12:22:30.716210+0000","last_fullsized":"2023-08-11T12:22:30.716210+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:11:50.295291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716835+0000","last_change":"2023-08-11T12:22:03.851996+0000","last_active":"2023-08-11T12:22:30.716835+0000","last_peered":"2023-08-11T12:22:30.716835+0000","last_clean":"2023-08-11T12:22:30.716835+0000","last_became_active":"2023-08-11T12:22:03.850821+0000","last_became_peered":"2023-08-11T12:22:03.850821+0000","last_unstale":"2023-08-11T12:22:30.716835+0000","last_undegraded":"2023-08-11T12:22:30.716835+0000","last_fullsized":"2023-08-11T12:22:30.716835+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:09:01.522001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067343+0000","last_change":"2023-08-11T12:22:03.842025+0000","last_active":"2023-08-11T12:22:09.067343+0000","last_peered":"2023-08-11T12:22:09.067343+0000","last_clean":"2023-08-11T12:22:09.067343+0000","last_became_active":"2023-08-11T12:22:03.841700+0000","last_became_peered":"2023-08-11T12:22:03.841700+0000","last_unstale":"2023-08-11T12:22:09.067343+0000","last_undegraded":"2023-08-11T12:22:09.067343+0000","last_fullsized":"2023-08-11T12:22:09.067343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:45:15.532577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879525+0000","last_change":"2023-08-11T12:22:03.844908+0000","last_active":"2023-08-11T12:22:08.879525+0000","last_peered":"2023-08-11T12:22:08.879525+0000","last_clean":"2023-08-11T12:22:08.879525+0000","last_became_active":"2023-08-11T12:22:03.844674+0000","last_became_peered":"2023-08-11T12:22:03.844674+0000","last_unstale":"2023-08-11T12:22:08.879525+0000","last_undegraded":"2023-08-11T12:22:08.879525+0000","last_fullsized":"2023-08-11T12:22:08.879525+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:13:32.050245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067181+0000","last_change":"2023-08-11T12:22:03.839915+0000","last_active":"2023-08-11T12:22:09.067181+0000","last_peered":"2023-08-11T12:22:09.067181+0000","last_clean":"2023-08-11T12:22:09.067181+0000","last_became_active":"2023-08-11T12:22:03.839099+0000","last_became_peered":"2023-08-11T12:22:03.839099+0000","last_unstale":"2023-08-11T12:22:09.067181+0000","last_undegraded":"2023-08-11T12:22:09.067181+0000","last_fullsized":"2023-08-11T12:22:09.067181+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:48:27.468032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880115+0000","last_change":"2023-08-11T12:22:03.841591+0000","last_active":"2023-08-11T12:22:08.880115+0000","last_peered":"2023-08-11T12:22:08.880115+0000","last_clean":"2023-08-11T12:22:08.880115+0000","last_became_active":"2023-08-11T12:22:03.841232+0000","last_became_peered":"2023-08-11T12:22:03.841232+0000","last_unstale":"2023-08-11T12:22:08.880115+0000","last_undegraded":"2023-08-11T12:22:08.880115+0000","last_fullsized":"2023-08-11T12:22:08.880115+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:57:51.227137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067792+0000","last_change":"2023-08-11T12:22:03.839516+0000","last_active":"2023-08-11T12:22:09.067792+0000","last_peered":"2023-08-11T12:22:09.067792+0000","last_clean":"2023-08-11T12:22:09.067792+0000","last_became_active":"2023-08-11T12:22:03.839058+0000","last_became_peered":"2023-08-11T12:22:03.839058+0000","last_unstale":"2023-08-11T12:22:09.067792+0000","last_undegraded":"2023-08-11T12:22:09.067792+0000","last_fullsized":"2023-08-11T12:22:09.067792+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:56:27.838147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.970642+0000","last_change":"2023-08-11T12:22:03.841033+0000","last_active":"2023-08-11T12:22:08.970642+0000","last_peered":"2023-08-11T12:22:08.970642+0000","last_clean":"2023-08-11T12:22:08.970642+0000","last_became_active":"2023-08-11T12:22:03.840665+0000","last_became_peered":"2023-08-11T12:22:03.840665+0000","last_unstale":"2023-08-11T12:22:08.970642+0000","last_undegraded":"2023-08-11T12:22:08.970642+0000","last_fullsized":"2023-08-11T12:22:08.970642+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:51:47.671738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067587+0000","last_change":"2023-08-11T12:22:03.839663+0000","last_active":"2023-08-11T12:22:09.067587+0000","last_peered":"2023-08-11T12:22:09.067587+0000","last_clean":"2023-08-11T12:22:09.067587+0000","last_became_active":"2023-08-11T12:22:03.838840+0000","last_became_peered":"2023-08-11T12:22:03.838840+0000","last_unstale":"2023-08-11T12:22:09.067587+0000","last_undegraded":"2023-08-11T12:22:09.067587+0000","last_fullsized":"2023-08-11T12:22:09.067587+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:57:09.615886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880443+0000","last_change":"2023-08-11T12:22:03.846288+0000","last_active":"2023-08-11T12:22:08.880443+0000","last_peered":"2023-08-11T12:22:08.880443+0000","last_clean":"2023-08-11T12:22:08.880443+0000","last_became_active":"2023-08-11T12:22:03.845962+0000","last_became_peered":"2023-08-11T12:22:03.845962+0000","last_unstale":"2023-08-11T12:22:08.880443+0000","last_undegraded":"2023-08-11T12:22:08.880443+0000","last_fullsized":"2023-08-11T12:22:08.880443+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:59:48.212360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.728022+0000","last_change":"2023-08-11T12:22:31.726774+0000","last_active":"2023-08-11T12:22:31.728022+0000","last_peered":"2023-08-11T12:22:31.728022+0000","last_clean":"2023-08-11T12:22:31.728022+0000","last_became_active":"2023-08-11T12:22:31.726437+0000","last_became_peered":"2023-08-11T12:22:31.726437+0000","last_unstale":"2023-08-11T12:22:31.728022+0000","last_undegraded":"2023-08-11T12:22:31.728022+0000","last_fullsized":"2023-08-11T12:22:31.728022+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:33:56.005318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879206+0000","last_change":"2023-08-11T12:22:03.842249+0000","last_active":"2023-08-11T12:22:08.879206+0000","last_peered":"2023-08-11T12:22:08.879206+0000","last_clean":"2023-08-11T12:22:08.879206+0000","last_became_active":"2023-08-11T12:22:03.841887+0000","last_became_peered":"2023-08-11T12:22:03.841887+0000","last_unstale":"2023-08-11T12:22:08.879206+0000","last_undegraded":"2023-08-11T12:22:08.879206+0000","last_fullsized":"2023-08-11T12:22:08.879206+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:08:58.125728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716293+0000","last_change":"2023-08-11T12:22:03.843859+0000","last_active":"2023-08-11T12:22:30.716293+0000","last_peered":"2023-08-11T12:22:30.716293+0000","last_clean":"2023-08-11T12:22:30.716293+0000","last_became_active":"2023-08-11T12:22:03.843383+0000","last_became_peered":"2023-08-11T12:22:03.843383+0000","last_unstale":"2023-08-11T12:22:30.716293+0000","last_undegraded":"2023-08-11T12:22:30.716293+0000","last_fullsized":"2023-08-11T12:22:30.716293+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:32:20.669588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"peering","last_fresh":"2023-08-11T12:22:09.066359+0000","last_change":"2023-08-11T12:22:30.717444+0000","last_active":"2023-08-11T12:22:30.717444+0000","last_peered":"2023-08-11T12:22:09.066359+0000","last_clean":"2023-08-11T12:22:09.066359+0000","last_became_active":"2023-08-11T12:22:03.849130+0000","last_became_peered":"2023-08-11T12:22:03.849130+0000","last_unstale":"2023-08-11T12:22:09.066359+0000","last_undegraded":"2023-08-11T12:22:09.066359+0000","last_fullsized":"2023-08-11T12:22:09.066359+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4,8],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.969810+0000","last_change":"2023-08-11T12:22:03.850397+0000","last_active":"2023-08-11T12:22:08.969810+0000","last_peered":"2023-08-11T12:22:08.969810+0000","last_clean":"2023-08-11T12:22:08.969810+0000","last_became_active":"2023-08-11T12:22:03.850143+0000","last_became_peered":"2023-08-11T12:22:03.850143+0000","last_unstale":"2023-08-11T12:22:08.969810+0000","last_undegraded":"2023-08-11T12:22:08.969810+0000","last_fullsized":"2023-08-11T12:22:08.969810+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:16:12.580674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.724188+0000","last_change":"2023-08-11T12:22:03.850496+0000","last_active":"2023-08-11T12:22:30.724188+0000","last_peered":"2023-08-11T12:22:30.724188+0000","last_clean":"2023-08-11T12:22:30.724188+0000","last_became_active":"2023-08-11T12:22:03.850192+0000","last_became_peered":"2023-08-11T12:22:03.850192+0000","last_unstale":"2023-08-11T12:22:30.724188+0000","last_undegraded":"2023-08-11T12:22:30.724188+0000","last_fullsized":"2023-08-11T12:22:30.724188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:15:36.813034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722136+0000","last_change":"2023-08-11T12:22:03.841706+0000","last_active":"2023-08-11T12:22:31.722136+0000","last_peered":"2023-08-11T12:22:31.722136+0000","last_clean":"2023-08-11T12:22:31.722136+0000","last_became_active":"2023-08-11T12:22:03.841341+0000","last_became_peered":"2023-08-11T12:22:03.841341+0000","last_unstale":"2023-08-11T12:22:31.722136+0000","last_undegraded":"2023-08-11T12:22:31.722136+0000","last_fullsized":"2023-08-11T12:22:31.722136+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:36:20.093373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067783+0000","last_change":"2023-08-11T12:22:03.834450+0000","last_active":"2023-08-11T12:22:09.067783+0000","last_peered":"2023-08-11T12:22:09.067783+0000","last_clean":"2023-08-11T12:22:09.067783+0000","last_became_active":"2023-08-11T12:22:03.834154+0000","last_became_peered":"2023-08-11T12:22:03.834154+0000","last_unstale":"2023-08-11T12:22:09.067783+0000","last_undegraded":"2023-08-11T12:22:09.067783+0000","last_fullsized":"2023-08-11T12:22:09.067783+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:59:48.605877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066819+0000","last_change":"2023-08-11T12:22:07.886317+0000","last_active":"2023-08-11T12:22:09.066819+0000","last_peered":"2023-08-11T12:22:09.066819+0000","last_clean":"2023-08-11T12:22:09.066819+0000","last_became_active":"2023-08-11T12:22:07.885986+0000","last_became_peered":"2023-08-11T12:22:07.885986+0000","last_unstale":"2023-08-11T12:22:09.066819+0000","last_undegraded":"2023-08-11T12:22:09.066819+0000","last_fullsized":"2023-08-11T12:22:09.066819+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:36:54.443747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722809+0000","last_change":"2023-08-11T12:22:02.841759+0000","last_active":"2023-08-11T12:22:31.722809+0000","last_peered":"2023-08-11T12:22:31.722809+0000","last_clean":"2023-08-11T12:22:31.722809+0000","last_became_active":"2023-08-11T12:22:02.841326+0000","last_became_peered":"2023-08-11T12:22:02.841326+0000","last_unstale":"2023-08-11T12:22:31.722809+0000","last_undegraded":"2023-08-11T12:22:31.722809+0000","last_fullsized":"2023-08-11T12:22:31.722809+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:09:30.085287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.802211+0000","last_change":"2023-08-11T12:22:31.801910+0000","last_active":"2023-08-11T12:22:31.802211+0000","last_peered":"2023-08-11T12:22:31.802211+0000","last_clean":"2023-08-11T12:22:31.802211+0000","last_became_active":"2023-08-11T12:22:31.801479+0000","last_became_peered":"2023-08-11T12:22:31.801479+0000","last_unstale":"2023-08-11T12:22:31.802211+0000","last_undegraded":"2023-08-11T12:22:31.802211+0000","last_fullsized":"2023-08-11T12:22:31.802211+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:52:21.489431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.065992+0000","last_change":"2023-08-11T12:22:07.875010+0000","last_active":"2023-08-11T12:22:09.065992+0000","last_peered":"2023-08-11T12:22:09.065992+0000","last_clean":"2023-08-11T12:22:09.065992+0000","last_became_active":"2023-08-11T12:22:07.874474+0000","last_became_peered":"2023-08-11T12:22:07.874474+0000","last_unstale":"2023-08-11T12:22:09.065992+0000","last_undegraded":"2023-08-11T12:22:09.065992+0000","last_fullsized":"2023-08-11T12:22:09.065992+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:54:41.734301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068448+0000","last_change":"2023-08-11T12:22:02.848299+0000","last_active":"2023-08-11T12:22:09.068448+0000","last_peered":"2023-08-11T12:22:09.068448+0000","last_clean":"2023-08-11T12:22:09.068448+0000","last_became_active":"2023-08-11T12:22:02.847869+0000","last_became_peered":"2023-08-11T12:22:02.847869+0000","last_unstale":"2023-08-11T12:22:09.068448+0000","last_undegraded":"2023-08-11T12:22:09.068448+0000","last_fullsized":"2023-08-11T12:22:09.068448+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:36:09.123226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716310+0000","last_change":"2023-08-11T12:22:03.841173+0000","last_active":"2023-08-11T12:22:30.716310+0000","last_peered":"2023-08-11T12:22:30.716310+0000","last_clean":"2023-08-11T12:22:30.716310+0000","last_became_active":"2023-08-11T12:22:03.840882+0000","last_became_peered":"2023-08-11T12:22:03.840882+0000","last_unstale":"2023-08-11T12:22:30.716310+0000","last_undegraded":"2023-08-11T12:22:30.716310+0000","last_fullsized":"2023-08-11T12:22:30.716310+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:58:38.141467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066479+0000","last_change":"2023-08-11T12:22:07.880756+0000","last_active":"2023-08-11T12:22:09.066479+0000","last_peered":"2023-08-11T12:22:09.066479+0000","last_clean":"2023-08-11T12:22:09.066479+0000","last_became_active":"2023-08-11T12:22:07.878866+0000","last_became_peered":"2023-08-11T12:22:07.878866+0000","last_unstale":"2023-08-11T12:22:09.066479+0000","last_undegraded":"2023-08-11T12:22:09.066479+0000","last_fullsized":"2023-08-11T12:22:09.066479+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:21:58.652424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'4","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:29.683617+0000","last_change":"2023-08-11T12:22:02.848543+0000","last_active":"2023-08-11T12:22:29.683617+0000","last_peered":"2023-08-11T12:22:29.683617+0000","last_clean":"2023-08-11T12:22:29.683617+0000","last_became_active":"2023-08-11T12:22:02.848008+0000","last_became_peered":"2023-08-11T12:22:02.848008+0000","last_unstale":"2023-08-11T12:22:29.683617+0000","last_undegraded":"2023-08-11T12:22:29.683617+0000","last_fullsized":"2023-08-11T12:22:29.683617+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:34:33.832747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.970098+0000","last_change":"2023-08-11T12:22:03.843651+0000","last_active":"2023-08-11T12:22:08.970098+0000","last_peered":"2023-08-11T12:22:08.970098+0000","last_clean":"2023-08-11T12:22:08.970098+0000","last_became_active":"2023-08-11T12:22:03.843392+0000","last_became_peered":"2023-08-11T12:22:03.843392+0000","last_unstale":"2023-08-11T12:22:08.970098+0000","last_undegraded":"2023-08-11T12:22:08.970098+0000","last_fullsized":"2023-08-11T12:22:08.970098+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:02:03.025511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066201+0000","last_change":"2023-08-11T12:22:07.879373+0000","last_active":"2023-08-11T12:22:09.066201+0000","last_peered":"2023-08-11T12:22:09.066201+0000","last_clean":"2023-08-11T12:22:09.066201+0000","last_became_active":"2023-08-11T12:22:07.878929+0000","last_became_peered":"2023-08-11T12:22:07.878929+0000","last_unstale":"2023-08-11T12:22:09.066201+0000","last_undegraded":"2023-08-11T12:22:09.066201+0000","last_fullsized":"2023-08-11T12:22:09.066201+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:44:35.895712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879734+0000","last_change":"2023-08-11T12:22:02.841984+0000","last_active":"2023-08-11T12:22:08.879734+0000","last_peered":"2023-08-11T12:22:08.879734+0000","last_clean":"2023-08-11T12:22:08.879734+0000","last_became_active":"2023-08-11T12:22:02.841585+0000","last_became_peered":"2023-08-11T12:22:02.841585+0000","last_unstale":"2023-08-11T12:22:08.879734+0000","last_undegraded":"2023-08-11T12:22:08.879734+0000","last_fullsized":"2023-08-11T12:22:08.879734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:22:35.974158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068146+0000","last_change":"2023-08-11T12:22:03.839381+0000","last_active":"2023-08-11T12:22:09.068146+0000","last_peered":"2023-08-11T12:22:09.068146+0000","last_clean":"2023-08-11T12:22:09.068146+0000","last_became_active":"2023-08-11T12:22:03.839091+0000","last_became_peered":"2023-08-11T12:22:03.839091+0000","last_unstale":"2023-08-11T12:22:09.068146+0000","last_undegraded":"2023-08-11T12:22:09.068146+0000","last_fullsized":"2023-08-11T12:22:09.068146+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:12:59.687698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067684+0000","last_change":"2023-08-11T12:22:07.881758+0000","last_active":"2023-08-11T12:22:09.067684+0000","last_peered":"2023-08-11T12:22:09.067684+0000","last_clean":"2023-08-11T12:22:09.067684+0000","last_became_active":"2023-08-11T12:22:07.881305+0000","last_became_peered":"2023-08-11T12:22:07.881305+0000","last_unstale":"2023-08-11T12:22:09.067684+0000","last_undegraded":"2023-08-11T12:22:09.067684+0000","last_fullsized":"2023-08-11T12:22:09.067684+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:08:17.423954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"82'1","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067097+0000","last_change":"2023-08-11T12:22:02.844138+0000","last_active":"2023-08-11T12:22:09.067097+0000","last_peered":"2023-08-11T12:22:09.067097+0000","last_clean":"2023-08-11T12:22:09.067097+0000","last_became_active":"2023-08-11T12:22:02.843234+0000","last_became_peered":"2023-08-11T12:22:02.843234+0000","last_unstale":"2023-08-11T12:22:09.067097+0000","last_undegraded":"2023-08-11T12:22:09.067097+0000","last_fullsized":"2023-08-11T12:22:09.067097+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:21:27.653637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879684+0000","last_change":"2023-08-11T12:22:03.845450+0000","last_active":"2023-08-11T12:22:08.879684+0000","last_peered":"2023-08-11T12:22:08.879684+0000","last_clean":"2023-08-11T12:22:08.879684+0000","last_became_active":"2023-08-11T12:22:03.845170+0000","last_became_peered":"2023-08-11T12:22:03.845170+0000","last_unstale":"2023-08-11T12:22:08.879684+0000","last_undegraded":"2023-08-11T12:22:08.879684+0000","last_fullsized":"2023-08-11T12:22:08.879684+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:54:39.747258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066775+0000","last_change":"2023-08-11T12:22:07.880663+0000","last_active":"2023-08-11T12:22:09.066775+0000","last_peered":"2023-08-11T12:22:09.066775+0000","last_clean":"2023-08-11T12:22:09.066775+0000","last_became_active":"2023-08-11T12:22:07.880282+0000","last_became_peered":"2023-08-11T12:22:07.880282+0000","last_unstale":"2023-08-11T12:22:09.066775+0000","last_undegraded":"2023-08-11T12:22:09.066775+0000","last_fullsized":"2023-08-11T12:22:09.066775+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:32:50.241286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"87'3","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:29.683550+0000","last_change":"2023-08-11T12:22:02.842206+0000","last_active":"2023-08-11T12:22:29.683550+0000","last_peered":"2023-08-11T12:22:29.683550+0000","last_clean":"2023-08-11T12:22:29.683550+0000","last_became_active":"2023-08-11T12:22:02.841815+0000","last_became_peered":"2023-08-11T12:22:02.841815+0000","last_unstale":"2023-08-11T12:22:29.683550+0000","last_undegraded":"2023-08-11T12:22:29.683550+0000","last_fullsized":"2023-08-11T12:22:29.683550+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:29:49.660552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067262+0000","last_change":"2023-08-11T12:22:03.825886+0000","last_active":"2023-08-11T12:22:09.067262+0000","last_peered":"2023-08-11T12:22:09.067262+0000","last_clean":"2023-08-11T12:22:09.067262+0000","last_became_active":"2023-08-11T12:22:03.825645+0000","last_became_peered":"2023-08-11T12:22:03.825645+0000","last_unstale":"2023-08-11T12:22:09.067262+0000","last_undegraded":"2023-08-11T12:22:09.067262+0000","last_fullsized":"2023-08-11T12:22:09.067262+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:27:52.324963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.723928+0000","last_change":"2023-08-11T12:22:07.890216+0000","last_active":"2023-08-11T12:22:30.723928+0000","last_peered":"2023-08-11T12:22:30.723928+0000","last_clean":"2023-08-11T12:22:30.723928+0000","last_became_active":"2023-08-11T12:22:07.889860+0000","last_became_peered":"2023-08-11T12:22:07.889860+0000","last_unstale":"2023-08-11T12:22:30.723928+0000","last_undegraded":"2023-08-11T12:22:30.723928+0000","last_fullsized":"2023-08-11T12:22:30.723928+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:26:31.744345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.878916+0000","last_change":"2023-08-11T12:22:02.835703+0000","last_active":"2023-08-11T12:22:08.878916+0000","last_peered":"2023-08-11T12:22:08.878916+0000","last_clean":"2023-08-11T12:22:08.878916+0000","last_became_active":"2023-08-11T12:22:02.835300+0000","last_became_peered":"2023-08-11T12:22:02.835300+0000","last_unstale":"2023-08-11T12:22:08.878916+0000","last_undegraded":"2023-08-11T12:22:08.878916+0000","last_fullsized":"2023-08-11T12:22:08.878916+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:05:05.549977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067658+0000","last_change":"2023-08-11T12:22:03.835619+0000","last_active":"2023-08-11T12:22:09.067658+0000","last_peered":"2023-08-11T12:22:09.067658+0000","last_clean":"2023-08-11T12:22:09.067658+0000","last_became_active":"2023-08-11T12:22:03.835365+0000","last_became_peered":"2023-08-11T12:22:03.835365+0000","last_unstale":"2023-08-11T12:22:09.067658+0000","last_undegraded":"2023-08-11T12:22:09.067658+0000","last_fullsized":"2023-08-11T12:22:09.067658+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:41:37.126989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716034+0000","last_change":"2023-08-11T12:22:07.893736+0000","last_active":"2023-08-11T12:22:30.716034+0000","last_peered":"2023-08-11T12:22:30.716034+0000","last_clean":"2023-08-11T12:22:30.716034+0000","last_became_active":"2023-08-11T12:22:07.893160+0000","last_became_peered":"2023-08-11T12:22:07.893160+0000","last_unstale":"2023-08-11T12:22:30.716034+0000","last_undegraded":"2023-08-11T12:22:30.716034+0000","last_fullsized":"2023-08-11T12:22:30.716034+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:15:12.861835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066672+0000","last_change":"2023-08-11T12:22:02.843819+0000","last_active":"2023-08-11T12:22:09.066672+0000","last_peered":"2023-08-11T12:22:09.066672+0000","last_clean":"2023-08-11T12:22:09.066672+0000","last_became_active":"2023-08-11T12:22:02.843062+0000","last_became_peered":"2023-08-11T12:22:02.843062+0000","last_unstale":"2023-08-11T12:22:09.066672+0000","last_undegraded":"2023-08-11T12:22:09.066672+0000","last_fullsized":"2023-08-11T12:22:09.066672+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:51:10.923574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722599+0000","last_change":"2023-08-11T12:22:03.845985+0000","last_active":"2023-08-11T12:22:31.722599+0000","last_peered":"2023-08-11T12:22:31.722599+0000","last_clean":"2023-08-11T12:22:31.722599+0000","last_became_active":"2023-08-11T12:22:03.845274+0000","last_became_peered":"2023-08-11T12:22:03.845274+0000","last_unstale":"2023-08-11T12:22:31.722599+0000","last_undegraded":"2023-08-11T12:22:31.722599+0000","last_fullsized":"2023-08-11T12:22:31.722599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:51:23.239546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067853+0000","last_change":"2023-08-11T12:22:07.885017+0000","last_active":"2023-08-11T12:22:09.067853+0000","last_peered":"2023-08-11T12:22:09.067853+0000","last_clean":"2023-08-11T12:22:09.067853+0000","last_became_active":"2023-08-11T12:22:07.884610+0000","last_became_peered":"2023-08-11T12:22:07.884610+0000","last_unstale":"2023-08-11T12:22:09.067853+0000","last_undegraded":"2023-08-11T12:22:09.067853+0000","last_fullsized":"2023-08-11T12:22:09.067853+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:03:47.111702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"87'3","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:28.723792+0000","last_change":"2023-08-11T12:22:02.836591+0000","last_active":"2023-08-11T12:22:28.723792+0000","last_peered":"2023-08-11T12:22:28.723792+0000","last_clean":"2023-08-11T12:22:28.723792+0000","last_became_active":"2023-08-11T12:22:02.836223+0000","last_became_peered":"2023-08-11T12:22:02.836223+0000","last_unstale":"2023-08-11T12:22:28.723792+0000","last_undegraded":"2023-08-11T12:22:28.723792+0000","last_fullsized":"2023-08-11T12:22:28.723792+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:04:18.216860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.970378+0000","last_change":"2023-08-11T12:22:03.841719+0000","last_active":"2023-08-11T12:22:08.970378+0000","last_peered":"2023-08-11T12:22:08.970378+0000","last_clean":"2023-08-11T12:22:08.970378+0000","last_became_active":"2023-08-11T12:22:03.841381+0000","last_became_peered":"2023-08-11T12:22:03.841381+0000","last_unstale":"2023-08-11T12:22:08.970378+0000","last_undegraded":"2023-08-11T12:22:08.970378+0000","last_fullsized":"2023-08-11T12:22:08.970378+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:23:34.743266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721200+0000","last_change":"2023-08-11T12:22:07.889103+0000","last_active":"2023-08-11T12:22:31.721200+0000","last_peered":"2023-08-11T12:22:31.721200+0000","last_clean":"2023-08-11T12:22:31.721200+0000","last_became_active":"2023-08-11T12:22:07.888668+0000","last_became_peered":"2023-08-11T12:22:07.888668+0000","last_unstale":"2023-08-11T12:22:31.721200+0000","last_undegraded":"2023-08-11T12:22:31.721200+0000","last_fullsized":"2023-08-11T12:22:31.721200+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:55:40.004921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"87'2","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:28.721917+0000","last_change":"2023-08-11T12:22:02.841934+0000","last_active":"2023-08-11T12:22:28.721917+0000","last_peered":"2023-08-11T12:22:28.721917+0000","last_clean":"2023-08-11T12:22:28.721917+0000","last_became_active":"2023-08-11T12:22:02.841598+0000","last_became_peered":"2023-08-11T12:22:02.841598+0000","last_unstale":"2023-08-11T12:22:28.721917+0000","last_undegraded":"2023-08-11T12:22:28.721917+0000","last_fullsized":"2023-08-11T12:22:28.721917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:41:39.918666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716456+0000","last_change":"2023-08-11T12:22:03.848901+0000","last_active":"2023-08-11T12:22:30.716456+0000","last_peered":"2023-08-11T12:22:30.716456+0000","last_clean":"2023-08-11T12:22:30.716456+0000","last_became_active":"2023-08-11T12:22:03.848518+0000","last_became_peered":"2023-08-11T12:22:03.848518+0000","last_unstale":"2023-08-11T12:22:30.716456+0000","last_undegraded":"2023-08-11T12:22:30.716456+0000","last_fullsized":"2023-08-11T12:22:30.716456+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:28:39.018373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067078+0000","last_change":"2023-08-11T12:22:07.873734+0000","last_active":"2023-08-11T12:22:09.067078+0000","last_peered":"2023-08-11T12:22:09.067078+0000","last_clean":"2023-08-11T12:22:09.067078+0000","last_became_active":"2023-08-11T12:22:07.872986+0000","last_became_peered":"2023-08-11T12:22:07.872986+0000","last_unstale":"2023-08-11T12:22:09.067078+0000","last_undegraded":"2023-08-11T12:22:09.067078+0000","last_fullsized":"2023-08-11T12:22:09.067078+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:22:35.576079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"82'3","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068027+0000","last_change":"2023-08-11T12:22:02.846492+0000","last_active":"2023-08-11T12:22:09.068027+0000","last_peered":"2023-08-11T12:22:09.068027+0000","last_clean":"2023-08-11T12:22:09.068027+0000","last_became_active":"2023-08-11T12:22:02.846174+0000","last_became_peered":"2023-08-11T12:22:02.846174+0000","last_unstale":"2023-08-11T12:22:09.068027+0000","last_undegraded":"2023-08-11T12:22:09.068027+0000","last_fullsized":"2023-08-11T12:22:09.068027+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:20:48.965543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.970441+0000","last_change":"2023-08-11T12:22:03.840054+0000","last_active":"2023-08-11T12:22:08.970441+0000","last_peered":"2023-08-11T12:22:08.970441+0000","last_clean":"2023-08-11T12:22:08.970441+0000","last_became_active":"2023-08-11T12:22:03.839707+0000","last_became_peered":"2023-08-11T12:22:03.839707+0000","last_unstale":"2023-08-11T12:22:08.970441+0000","last_undegraded":"2023-08-11T12:22:08.970441+0000","last_fullsized":"2023-08-11T12:22:08.970441+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:57:01.883842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066884+0000","last_change":"2023-08-11T12:22:07.886900+0000","last_active":"2023-08-11T12:22:09.066884+0000","last_peered":"2023-08-11T12:22:09.066884+0000","last_clean":"2023-08-11T12:22:09.066884+0000","last_became_active":"2023-08-11T12:22:07.886228+0000","last_became_peered":"2023-08-11T12:22:07.886228+0000","last_unstale":"2023-08-11T12:22:09.066884+0000","last_undegraded":"2023-08-11T12:22:09.066884+0000","last_fullsized":"2023-08-11T12:22:09.066884+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:23:53.736228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"87'12","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:29.677313+0000","last_change":"2023-08-11T12:22:02.836520+0000","last_active":"2023-08-11T12:22:29.677313+0000","last_peered":"2023-08-11T12:22:29.677313+0000","last_clean":"2023-08-11T12:22:29.677313+0000","last_became_active":"2023-08-11T12:22:02.836201+0000","last_became_peered":"2023-08-11T12:22:02.836201+0000","last_unstale":"2023-08-11T12:22:29.677313+0000","last_undegraded":"2023-08-11T12:22:29.677313+0000","last_fullsized":"2023-08-11T12:22:29.677313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:41:20.418514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":6,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879606+0000","last_change":"2023-08-11T12:22:03.848104+0000","last_active":"2023-08-11T12:22:08.879606+0000","last_peered":"2023-08-11T12:22:08.879606+0000","last_clean":"2023-08-11T12:22:08.879606+0000","last_became_active":"2023-08-11T12:22:03.847801+0000","last_became_peered":"2023-08-11T12:22:03.847801+0000","last_unstale":"2023-08-11T12:22:08.879606+0000","last_undegraded":"2023-08-11T12:22:08.879606+0000","last_fullsized":"2023-08-11T12:22:08.879606+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:11:30.238632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068429+0000","last_change":"2023-08-11T12:22:07.893710+0000","last_active":"2023-08-11T12:22:09.068429+0000","last_peered":"2023-08-11T12:22:09.068429+0000","last_clean":"2023-08-11T12:22:09.068429+0000","last_became_active":"2023-08-11T12:22:07.893239+0000","last_became_peered":"2023-08-11T12:22:07.893239+0000","last_unstale":"2023-08-11T12:22:09.068429+0000","last_undegraded":"2023-08-11T12:22:09.068429+0000","last_fullsized":"2023-08-11T12:22:09.068429+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:42:45.168233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"87'4","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:28.722975+0000","last_change":"2023-08-11T12:22:02.849060+0000","last_active":"2023-08-11T12:22:28.722975+0000","last_peered":"2023-08-11T12:22:28.722975+0000","last_clean":"2023-08-11T12:22:28.722975+0000","last_became_active":"2023-08-11T12:22:02.848417+0000","last_became_peered":"2023-08-11T12:22:02.848417+0000","last_unstale":"2023-08-11T12:22:28.722975+0000","last_undegraded":"2023-08-11T12:22:28.722975+0000","last_fullsized":"2023-08-11T12:22:28.722975+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:09:38.023995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.878997+0000","last_change":"2023-08-11T12:22:03.848532+0000","last_active":"2023-08-11T12:22:08.878997+0000","last_peered":"2023-08-11T12:22:08.878997+0000","last_clean":"2023-08-11T12:22:08.878997+0000","last_became_active":"2023-08-11T12:22:03.848190+0000","last_became_peered":"2023-08-11T12:22:03.848190+0000","last_unstale":"2023-08-11T12:22:08.878997+0000","last_undegraded":"2023-08-11T12:22:08.878997+0000","last_fullsized":"2023-08-11T12:22:08.878997+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:24:10.506810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.723601+0000","last_change":"2023-08-11T12:22:07.882785+0000","last_active":"2023-08-11T12:22:30.723601+0000","last_peered":"2023-08-11T12:22:30.723601+0000","last_clean":"2023-08-11T12:22:30.723601+0000","last_became_active":"2023-08-11T12:22:07.880643+0000","last_became_peered":"2023-08-11T12:22:07.880643+0000","last_unstale":"2023-08-11T12:22:30.723601+0000","last_undegraded":"2023-08-11T12:22:30.723601+0000","last_fullsized":"2023-08-11T12:22:30.723601+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:13:01.597210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066777+0000","last_change":"2023-08-11T12:22:02.851416+0000","last_active":"2023-08-11T12:22:09.066777+0000","last_peered":"2023-08-11T12:22:09.066777+0000","last_clean":"2023-08-11T12:22:09.066777+0000","last_became_active":"2023-08-11T12:22:02.851114+0000","last_became_peered":"2023-08-11T12:22:02.851114+0000","last_unstale":"2023-08-11T12:22:09.066777+0000","last_undegraded":"2023-08-11T12:22:09.066777+0000","last_fullsized":"2023-08-11T12:22:09.066777+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:21:21.904496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880295+0000","last_change":"2023-08-11T12:22:03.849367+0000","last_active":"2023-08-11T12:22:08.880295+0000","last_peered":"2023-08-11T12:22:08.880295+0000","last_clean":"2023-08-11T12:22:08.880295+0000","last_became_active":"2023-08-11T12:22:03.849050+0000","last_became_peered":"2023-08-11T12:22:03.849050+0000","last_unstale":"2023-08-11T12:22:08.880295+0000","last_undegraded":"2023-08-11T12:22:08.880295+0000","last_fullsized":"2023-08-11T12:22:08.880295+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:01:37.018850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722616+0000","last_change":"2023-08-11T12:22:07.890992+0000","last_active":"2023-08-11T12:22:31.722616+0000","last_peered":"2023-08-11T12:22:31.722616+0000","last_clean":"2023-08-11T12:22:31.722616+0000","last_became_active":"2023-08-11T12:22:07.890384+0000","last_became_peered":"2023-08-11T12:22:07.890384+0000","last_unstale":"2023-08-11T12:22:31.722616+0000","last_undegraded":"2023-08-11T12:22:31.722616+0000","last_fullsized":"2023-08-11T12:22:31.722616+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:00:55.230221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066311+0000","last_change":"2023-08-11T12:22:02.843045+0000","last_active":"2023-08-11T12:22:09.066311+0000","last_peered":"2023-08-11T12:22:09.066311+0000","last_clean":"2023-08-11T12:22:09.066311+0000","last_became_active":"2023-08-11T12:22:02.842628+0000","last_became_peered":"2023-08-11T12:22:02.842628+0000","last_unstale":"2023-08-11T12:22:09.066311+0000","last_undegraded":"2023-08-11T12:22:09.066311+0000","last_fullsized":"2023-08-11T12:22:09.066311+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:24:30.251252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879762+0000","last_change":"2023-08-11T12:22:03.842526+0000","last_active":"2023-08-11T12:22:08.879762+0000","last_peered":"2023-08-11T12:22:08.879762+0000","last_clean":"2023-08-11T12:22:08.879762+0000","last_became_active":"2023-08-11T12:22:03.842183+0000","last_became_peered":"2023-08-11T12:22:03.842183+0000","last_unstale":"2023-08-11T12:22:08.879762+0000","last_undegraded":"2023-08-11T12:22:08.879762+0000","last_fullsized":"2023-08-11T12:22:08.879762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:15:28.619474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879644+0000","last_change":"2023-08-11T12:22:07.880768+0000","last_active":"2023-08-11T12:22:08.879644+0000","last_peered":"2023-08-11T12:22:08.879644+0000","last_clean":"2023-08-11T12:22:08.879644+0000","last_became_active":"2023-08-11T12:22:07.880335+0000","last_became_peered":"2023-08-11T12:22:07.880335+0000","last_unstale":"2023-08-11T12:22:08.879644+0000","last_undegraded":"2023-08-11T12:22:08.879644+0000","last_fullsized":"2023-08-11T12:22:08.879644+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:49:07.059346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"87'15","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:29.686619+0000","last_change":"2023-08-11T12:22:02.847271+0000","last_active":"2023-08-11T12:22:29.686619+0000","last_peered":"2023-08-11T12:22:29.686619+0000","last_clean":"2023-08-11T12:22:29.686619+0000","last_became_active":"2023-08-11T12:22:02.846974+0000","last_became_peered":"2023-08-11T12:22:02.846974+0000","last_unstale":"2023-08-11T12:22:29.686619+0000","last_undegraded":"2023-08-11T12:22:29.686619+0000","last_fullsized":"2023-08-11T12:22:29.686619+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:04:16.995048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068022+0000","last_change":"2023-08-11T12:22:03.838944+0000","last_active":"2023-08-11T12:22:09.068022+0000","last_peered":"2023-08-11T12:22:09.068022+0000","last_clean":"2023-08-11T12:22:09.068022+0000","last_became_active":"2023-08-11T12:22:03.838610+0000","last_became_peered":"2023-08-11T12:22:03.838610+0000","last_unstale":"2023-08-11T12:22:09.068022+0000","last_undegraded":"2023-08-11T12:22:09.068022+0000","last_fullsized":"2023-08-11T12:22:09.068022+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:40:51.718679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067929+0000","last_change":"2023-08-11T12:22:07.888812+0000","last_active":"2023-08-11T12:22:09.067929+0000","last_peered":"2023-08-11T12:22:09.067929+0000","last_clean":"2023-08-11T12:22:09.067929+0000","last_became_active":"2023-08-11T12:22:07.888423+0000","last_became_peered":"2023-08-11T12:22:07.888423+0000","last_unstale":"2023-08-11T12:22:09.067929+0000","last_undegraded":"2023-08-11T12:22:09.067929+0000","last_fullsized":"2023-08-11T12:22:09.067929+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:12:17.299557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'1","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879855+0000","last_change":"2023-08-11T12:22:02.842591+0000","last_active":"2023-08-11T12:22:08.879855+0000","last_peered":"2023-08-11T12:22:08.879855+0000","last_clean":"2023-08-11T12:22:08.879855+0000","last_became_active":"2023-08-11T12:22:02.842249+0000","last_became_peered":"2023-08-11T12:22:02.842249+0000","last_unstale":"2023-08-11T12:22:08.879855+0000","last_undegraded":"2023-08-11T12:22:08.879855+0000","last_fullsized":"2023-08-11T12:22:08.879855+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:53:56.628695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"peering","last_fresh":"2023-08-11T12:22:09.067384+0000","last_change":"2023-08-11T12:22:30.723122+0000","last_active":"2023-08-11T12:22:30.723122+0000","last_peered":"2023-08-11T12:22:09.067384+0000","last_clean":"2023-08-11T12:22:09.067384+0000","last_became_active":"2023-08-11T12:22:03.840210+0000","last_became_peered":"2023-08-11T12:22:03.840210+0000","last_unstale":"2023-08-11T12:22:09.067384+0000","last_undegraded":"2023-08-11T12:22:09.067384+0000","last_fullsized":"2023-08-11T12:22:09.067384+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,5,9],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879511+0000","last_change":"2023-08-11T12:22:08.068485+0000","last_active":"2023-08-11T12:22:08.879511+0000","last_peered":"2023-08-11T12:22:08.879511+0000","last_clean":"2023-08-11T12:22:08.879511+0000","last_became_active":"2023-08-11T12:22:08.068071+0000","last_became_peered":"2023-08-11T12:22:08.068071+0000","last_unstale":"2023-08-11T12:22:08.879511+0000","last_undegraded":"2023-08-11T12:22:08.879511+0000","last_fullsized":"2023-08-11T12:22:08.879511+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:06:34.158790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"87'1","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.727900+0000","last_change":"2023-08-11T12:22:31.727900+0000","last_active":"2023-08-11T12:22:31.727900+0000","last_peered":"2023-08-11T12:22:31.727900+0000","last_clean":"2023-08-11T12:22:31.727900+0000","last_became_active":"2023-08-11T12:22:31.727346+0000","last_became_peered":"2023-08-11T12:22:31.727346+0000","last_unstale":"2023-08-11T12:22:31.727900+0000","last_undegraded":"2023-08-11T12:22:31.727900+0000","last_fullsized":"2023-08-11T12:22:31.727900+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:12:21.170378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067467+0000","last_change":"2023-08-11T12:22:03.843434+0000","last_active":"2023-08-11T12:22:09.067467+0000","last_peered":"2023-08-11T12:22:09.067467+0000","last_clean":"2023-08-11T12:22:09.067467+0000","last_became_active":"2023-08-11T12:22:03.843117+0000","last_became_peered":"2023-08-11T12:22:03.843117+0000","last_unstale":"2023-08-11T12:22:09.067467+0000","last_undegraded":"2023-08-11T12:22:09.067467+0000","last_fullsized":"2023-08-11T12:22:09.067467+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:24:56.881802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879498+0000","last_change":"2023-08-11T12:22:07.889740+0000","last_active":"2023-08-11T12:22:08.879498+0000","last_peered":"2023-08-11T12:22:08.879498+0000","last_clean":"2023-08-11T12:22:08.879498+0000","last_became_active":"2023-08-11T12:22:07.889272+0000","last_became_peered":"2023-08-11T12:22:07.889272+0000","last_unstale":"2023-08-11T12:22:08.879498+0000","last_undegraded":"2023-08-11T12:22:08.879498+0000","last_fullsized":"2023-08-11T12:22:08.879498+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:40:15.712138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"87'1","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879829+0000","last_change":"2023-08-11T12:22:02.846661+0000","last_active":"2023-08-11T12:22:08.879829+0000","last_peered":"2023-08-11T12:22:08.879829+0000","last_clean":"2023-08-11T12:22:08.879829+0000","last_became_active":"2023-08-11T12:22:02.846269+0000","last_became_peered":"2023-08-11T12:22:02.846269+0000","last_unstale":"2023-08-11T12:22:08.879829+0000","last_undegraded":"2023-08-11T12:22:08.879829+0000","last_fullsized":"2023-08-11T12:22:08.879829+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:47:43.138580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066619+0000","last_change":"2023-08-11T12:22:03.849653+0000","last_active":"2023-08-11T12:22:09.066619+0000","last_peered":"2023-08-11T12:22:09.066619+0000","last_clean":"2023-08-11T12:22:09.066619+0000","last_became_active":"2023-08-11T12:22:03.849303+0000","last_became_peered":"2023-08-11T12:22:03.849303+0000","last_unstale":"2023-08-11T12:22:09.066619+0000","last_undegraded":"2023-08-11T12:22:09.066619+0000","last_fullsized":"2023-08-11T12:22:09.066619+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:35:28.772541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879497+0000","last_change":"2023-08-11T12:22:08.068395+0000","last_active":"2023-08-11T12:22:08.879497+0000","last_peered":"2023-08-11T12:22:08.879497+0000","last_clean":"2023-08-11T12:22:08.879497+0000","last_became_active":"2023-08-11T12:22:08.067572+0000","last_became_peered":"2023-08-11T12:22:08.067572+0000","last_unstale":"2023-08-11T12:22:08.879497+0000","last_undegraded":"2023-08-11T12:22:08.879497+0000","last_fullsized":"2023-08-11T12:22:08.879497+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:18:19.641203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066941+0000","last_change":"2023-08-11T12:22:03.828971+0000","last_active":"2023-08-11T12:22:09.066941+0000","last_peered":"2023-08-11T12:22:09.066941+0000","last_clean":"2023-08-11T12:22:09.066941+0000","last_became_active":"2023-08-11T12:22:03.828653+0000","last_became_peered":"2023-08-11T12:22:03.828653+0000","last_unstale":"2023-08-11T12:22:09.066941+0000","last_undegraded":"2023-08-11T12:22:09.066941+0000","last_fullsized":"2023-08-11T12:22:09.066941+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:43:30.226114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'1","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.878818+0000","last_change":"2023-08-11T12:22:02.842419+0000","last_active":"2023-08-11T12:22:08.878818+0000","last_peered":"2023-08-11T12:22:08.878818+0000","last_clean":"2023-08-11T12:22:08.878818+0000","last_became_active":"2023-08-11T12:22:02.842105+0000","last_became_peered":"2023-08-11T12:22:02.842105+0000","last_unstale":"2023-08-11T12:22:08.878818+0000","last_undegraded":"2023-08-11T12:22:08.878818+0000","last_fullsized":"2023-08-11T12:22:08.878818+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:51:55.024962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880231+0000","last_change":"2023-08-11T12:22:07.880762+0000","last_active":"2023-08-11T12:22:08.880231+0000","last_peered":"2023-08-11T12:22:08.880231+0000","last_clean":"2023-08-11T12:22:08.880231+0000","last_became_active":"2023-08-11T12:22:07.880373+0000","last_became_peered":"2023-08-11T12:22:07.880373+0000","last_unstale":"2023-08-11T12:22:08.880231+0000","last_undegraded":"2023-08-11T12:22:08.880231+0000","last_fullsized":"2023-08-11T12:22:08.880231+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:07:55.656555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067945+0000","last_change":"2023-08-11T12:22:03.838555+0000","last_active":"2023-08-11T12:22:09.067945+0000","last_peered":"2023-08-11T12:22:09.067945+0000","last_clean":"2023-08-11T12:22:09.067945+0000","last_became_active":"2023-08-11T12:22:03.838135+0000","last_became_peered":"2023-08-11T12:22:03.838135+0000","last_unstale":"2023-08-11T12:22:09.067945+0000","last_undegraded":"2023-08-11T12:22:09.067945+0000","last_fullsized":"2023-08-11T12:22:09.067945+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:23:56.118058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066639+0000","last_change":"2023-08-11T12:22:02.835093+0000","last_active":"2023-08-11T12:22:09.066639+0000","last_peered":"2023-08-11T12:22:09.066639+0000","last_clean":"2023-08-11T12:22:09.066639+0000","last_became_active":"2023-08-11T12:22:02.834545+0000","last_became_peered":"2023-08-11T12:22:02.834545+0000","last_unstale":"2023-08-11T12:22:09.066639+0000","last_undegraded":"2023-08-11T12:22:09.066639+0000","last_fullsized":"2023-08-11T12:22:09.066639+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:59:41.870923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":350,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879552+0000","last_change":"2023-08-11T12:20:57.484190+0000","last_active":"2023-08-11T12:22:08.879552+0000","last_peered":"2023-08-11T12:22:08.879552+0000","last_clean":"2023-08-11T12:22:08.879552+0000","last_became_active":"2023-08-11T12:20:57.483655+0000","last_became_peered":"2023-08-11T12:20:57.483655+0000","last_unstale":"2023-08-11T12:22:08.879552+0000","last_undegraded":"2023-08-11T12:22:08.879552+0000","last_fullsized":"2023-08-11T12:22:08.879552+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:17:49.245488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:17:49.245488+0000","last_clean_scrub_stamp":"2023-08-11T12:17:49.245488+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:16:09.009846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068210+0000","last_change":"2023-08-11T12:22:08.068762+0000","last_active":"2023-08-11T12:22:09.068210+0000","last_peered":"2023-08-11T12:22:09.068210+0000","last_clean":"2023-08-11T12:22:09.068210+0000","last_became_active":"2023-08-11T12:22:08.068205+0000","last_became_peered":"2023-08-11T12:22:08.068205+0000","last_unstale":"2023-08-11T12:22:09.068210+0000","last_undegraded":"2023-08-11T12:22:09.068210+0000","last_fullsized":"2023-08-11T12:22:09.068210+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:58:49.800844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.878740+0000","last_change":"2023-08-11T12:22:03.837843+0000","last_active":"2023-08-11T12:22:08.878740+0000","last_peered":"2023-08-11T12:22:08.878740+0000","last_clean":"2023-08-11T12:22:08.878740+0000","last_became_active":"2023-08-11T12:22:03.837537+0000","last_became_peered":"2023-08-11T12:22:03.837537+0000","last_unstale":"2023-08-11T12:22:08.878740+0000","last_undegraded":"2023-08-11T12:22:08.878740+0000","last_fullsized":"2023-08-11T12:22:08.878740+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:22:17.517258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'3","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:29.683836+0000","last_change":"2023-08-11T12:22:02.843150+0000","last_active":"2023-08-11T12:22:29.683836+0000","last_peered":"2023-08-11T12:22:29.683836+0000","last_clean":"2023-08-11T12:22:29.683836+0000","last_became_active":"2023-08-11T12:22:02.842829+0000","last_became_peered":"2023-08-11T12:22:02.842829+0000","last_unstale":"2023-08-11T12:22:29.683836+0000","last_undegraded":"2023-08-11T12:22:29.683836+0000","last_fullsized":"2023-08-11T12:22:29.683836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:02:01.110571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.722844+0000","last_change":"2023-08-11T12:22:07.883050+0000","last_active":"2023-08-11T12:22:30.722844+0000","last_peered":"2023-08-11T12:22:30.722844+0000","last_clean":"2023-08-11T12:22:30.722844+0000","last_became_active":"2023-08-11T12:22:07.882423+0000","last_became_peered":"2023-08-11T12:22:07.882423+0000","last_unstale":"2023-08-11T12:22:30.722844+0000","last_undegraded":"2023-08-11T12:22:30.722844+0000","last_fullsized":"2023-08-11T12:22:30.722844+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:56:11.400367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"87'1","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:28.723841+0000","last_change":"2023-08-11T12:22:02.850632+0000","last_active":"2023-08-11T12:22:28.723841+0000","last_peered":"2023-08-11T12:22:28.723841+0000","last_clean":"2023-08-11T12:22:28.723841+0000","last_became_active":"2023-08-11T12:22:02.850312+0000","last_became_peered":"2023-08-11T12:22:02.850312+0000","last_unstale":"2023-08-11T12:22:28.723841+0000","last_undegraded":"2023-08-11T12:22:28.723841+0000","last_fullsized":"2023-08-11T12:22:28.723841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:17:36.156598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879376+0000","last_change":"2023-08-11T12:22:03.839869+0000","last_active":"2023-08-11T12:22:08.879376+0000","last_peered":"2023-08-11T12:22:08.879376+0000","last_clean":"2023-08-11T12:22:08.879376+0000","last_became_active":"2023-08-11T12:22:03.839486+0000","last_became_peered":"2023-08-11T12:22:03.839486+0000","last_unstale":"2023-08-11T12:22:08.879376+0000","last_undegraded":"2023-08-11T12:22:08.879376+0000","last_fullsized":"2023-08-11T12:22:08.879376+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:49:22.752990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067561+0000","last_change":"2023-08-11T12:22:08.066877+0000","last_active":"2023-08-11T12:22:09.067561+0000","last_peered":"2023-08-11T12:22:09.067561+0000","last_clean":"2023-08-11T12:22:09.067561+0000","last_became_active":"2023-08-11T12:22:08.066418+0000","last_became_peered":"2023-08-11T12:22:08.066418+0000","last_unstale":"2023-08-11T12:22:09.067561+0000","last_undegraded":"2023-08-11T12:22:09.067561+0000","last_fullsized":"2023-08-11T12:22:09.067561+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:57:08.687973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'7","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722268+0000","last_change":"2023-08-11T12:22:02.850505+0000","last_active":"2023-08-11T12:22:31.722268+0000","last_peered":"2023-08-11T12:22:31.722268+0000","last_clean":"2023-08-11T12:22:31.722268+0000","last_became_active":"2023-08-11T12:22:02.850104+0000","last_became_peered":"2023-08-11T12:22:02.850104+0000","last_unstale":"2023-08-11T12:22:31.722268+0000","last_undegraded":"2023-08-11T12:22:31.722268+0000","last_fullsized":"2023-08-11T12:22:31.722268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:33:50.319404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068068+0000","last_change":"2023-08-11T12:22:03.837580+0000","last_active":"2023-08-11T12:22:09.068068+0000","last_peered":"2023-08-11T12:22:09.068068+0000","last_clean":"2023-08-11T12:22:09.068068+0000","last_became_active":"2023-08-11T12:22:03.837256+0000","last_became_peered":"2023-08-11T12:22:03.837256+0000","last_unstale":"2023-08-11T12:22:09.068068+0000","last_undegraded":"2023-08-11T12:22:09.068068+0000","last_fullsized":"2023-08-11T12:22:09.068068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:13:43.832719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066507+0000","last_change":"2023-08-11T12:22:07.873613+0000","last_active":"2023-08-11T12:22:09.066507+0000","last_peered":"2023-08-11T12:22:09.066507+0000","last_clean":"2023-08-11T12:22:09.066507+0000","last_became_active":"2023-08-11T12:22:07.873149+0000","last_became_peered":"2023-08-11T12:22:07.873149+0000","last_unstale":"2023-08-11T12:22:09.066507+0000","last_undegraded":"2023-08-11T12:22:09.066507+0000","last_fullsized":"2023-08-11T12:22:09.066507+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:18:27.597239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"82'2","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066917+0000","last_change":"2023-08-11T12:22:02.843146+0000","last_active":"2023-08-11T12:22:09.066917+0000","last_peered":"2023-08-11T12:22:09.066917+0000","last_clean":"2023-08-11T12:22:09.066917+0000","last_became_active":"2023-08-11T12:22:02.842663+0000","last_became_peered":"2023-08-11T12:22:02.842663+0000","last_unstale":"2023-08-11T12:22:09.066917+0000","last_undegraded":"2023-08-11T12:22:09.066917+0000","last_fullsized":"2023-08-11T12:22:09.066917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:07:46.505063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716061+0000","last_change":"2023-08-11T12:22:03.847351+0000","last_active":"2023-08-11T12:22:30.716061+0000","last_peered":"2023-08-11T12:22:30.716061+0000","last_clean":"2023-08-11T12:22:30.716061+0000","last_became_active":"2023-08-11T12:22:03.847044+0000","last_became_peered":"2023-08-11T12:22:03.847044+0000","last_unstale":"2023-08-11T12:22:30.716061+0000","last_undegraded":"2023-08-11T12:22:30.716061+0000","last_fullsized":"2023-08-11T12:22:30.716061+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:03:33.785374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066461+0000","last_change":"2023-08-11T12:22:08.068459+0000","last_active":"2023-08-11T12:22:09.066461+0000","last_peered":"2023-08-11T12:22:09.066461+0000","last_clean":"2023-08-11T12:22:09.066461+0000","last_became_active":"2023-08-11T12:22:08.067857+0000","last_became_peered":"2023-08-11T12:22:08.067857+0000","last_unstale":"2023-08-11T12:22:09.066461+0000","last_undegraded":"2023-08-11T12:22:09.066461+0000","last_fullsized":"2023-08-11T12:22:09.066461+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:04:45.455163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.969839+0000","last_change":"2023-08-11T12:22:02.846441+0000","last_active":"2023-08-11T12:22:08.969839+0000","last_peered":"2023-08-11T12:22:08.969839+0000","last_clean":"2023-08-11T12:22:08.969839+0000","last_became_active":"2023-08-11T12:22:02.846153+0000","last_became_peered":"2023-08-11T12:22:02.846153+0000","last_unstale":"2023-08-11T12:22:08.969839+0000","last_undegraded":"2023-08-11T12:22:08.969839+0000","last_fullsized":"2023-08-11T12:22:08.969839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:16:33.873694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879314+0000","last_change":"2023-08-11T12:22:03.841932+0000","last_active":"2023-08-11T12:22:08.879314+0000","last_peered":"2023-08-11T12:22:08.879314+0000","last_clean":"2023-08-11T12:22:08.879314+0000","last_became_active":"2023-08-11T12:22:03.841635+0000","last_became_peered":"2023-08-11T12:22:03.841635+0000","last_unstale":"2023-08-11T12:22:08.879314+0000","last_undegraded":"2023-08-11T12:22:08.879314+0000","last_fullsized":"2023-08-11T12:22:08.879314+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:29:41.880454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722748+0000","last_change":"2023-08-11T12:22:07.886160+0000","last_active":"2023-08-11T12:22:31.722748+0000","last_peered":"2023-08-11T12:22:31.722748+0000","last_clean":"2023-08-11T12:22:31.722748+0000","last_became_active":"2023-08-11T12:22:07.885703+0000","last_became_peered":"2023-08-11T12:22:07.885703+0000","last_unstale":"2023-08-11T12:22:31.722748+0000","last_undegraded":"2023-08-11T12:22:31.722748+0000","last_fullsized":"2023-08-11T12:22:31.722748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:50:20.362829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"87'3","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:28.723203+0000","last_change":"2023-08-11T12:22:02.849360+0000","last_active":"2023-08-11T12:22:28.723203+0000","last_peered":"2023-08-11T12:22:28.723203+0000","last_clean":"2023-08-11T12:22:28.723203+0000","last_became_active":"2023-08-11T12:22:02.849028+0000","last_became_peered":"2023-08-11T12:22:02.849028+0000","last_unstale":"2023-08-11T12:22:28.723203+0000","last_undegraded":"2023-08-11T12:22:28.723203+0000","last_fullsized":"2023-08-11T12:22:28.723203+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:07:06.158016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.722533+0000","last_change":"2023-08-11T12:22:03.850285+0000","last_active":"2023-08-11T12:22:30.722533+0000","last_peered":"2023-08-11T12:22:30.722533+0000","last_clean":"2023-08-11T12:22:30.722533+0000","last_became_active":"2023-08-11T12:22:03.849978+0000","last_became_peered":"2023-08-11T12:22:03.849978+0000","last_unstale":"2023-08-11T12:22:30.722533+0000","last_undegraded":"2023-08-11T12:22:30.722533+0000","last_fullsized":"2023-08-11T12:22:30.722533+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:46:04.770888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066835+0000","last_change":"2023-08-11T12:22:07.881578+0000","last_active":"2023-08-11T12:22:09.066835+0000","last_peered":"2023-08-11T12:22:09.066835+0000","last_clean":"2023-08-11T12:22:09.066835+0000","last_became_active":"2023-08-11T12:22:07.881145+0000","last_became_peered":"2023-08-11T12:22:07.881145+0000","last_unstale":"2023-08-11T12:22:09.066835+0000","last_undegraded":"2023-08-11T12:22:09.066835+0000","last_fullsized":"2023-08-11T12:22:09.066835+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:07:17.931014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066542+0000","last_change":"2023-08-11T12:22:02.848875+0000","last_active":"2023-08-11T12:22:09.066542+0000","last_peered":"2023-08-11T12:22:09.066542+0000","last_clean":"2023-08-11T12:22:09.066542+0000","last_became_active":"2023-08-11T12:22:02.848578+0000","last_became_peered":"2023-08-11T12:22:02.848578+0000","last_unstale":"2023-08-11T12:22:09.066542+0000","last_undegraded":"2023-08-11T12:22:09.066542+0000","last_fullsized":"2023-08-11T12:22:09.066542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:57:52.903483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068323+0000","last_change":"2023-08-11T12:22:03.849865+0000","last_active":"2023-08-11T12:22:09.068323+0000","last_peered":"2023-08-11T12:22:09.068323+0000","last_clean":"2023-08-11T12:22:09.068323+0000","last_became_active":"2023-08-11T12:22:03.849557+0000","last_became_peered":"2023-08-11T12:22:03.849557+0000","last_unstale":"2023-08-11T12:22:09.068323+0000","last_undegraded":"2023-08-11T12:22:09.068323+0000","last_fullsized":"2023-08-11T12:22:09.068323+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:17:08.368108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066684+0000","last_change":"2023-08-11T12:22:08.067009+0000","last_active":"2023-08-11T12:22:09.066684+0000","last_peered":"2023-08-11T12:22:09.066684+0000","last_clean":"2023-08-11T12:22:09.066684+0000","last_became_active":"2023-08-11T12:22:08.066477+0000","last_became_peered":"2023-08-11T12:22:08.066477+0000","last_unstale":"2023-08-11T12:22:09.066684+0000","last_undegraded":"2023-08-11T12:22:09.066684+0000","last_fullsized":"2023-08-11T12:22:09.066684+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:05:08.273531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":2,"reported_epoch":88,"state":"peering","last_fresh":"2023-08-11T12:22:08.879523+0000","last_change":"2023-08-11T12:22:30.923867+0000","last_active":"2023-08-11T12:22:30.923867+0000","last_peered":"2023-08-11T12:22:08.879523+0000","last_clean":"2023-08-11T12:22:08.879523+0000","last_became_active":"2023-08-11T12:22:02.847394+0000","last_became_peered":"2023-08-11T12:22:02.847394+0000","last_unstale":"2023-08-11T12:22:08.879523+0000","last_undegraded":"2023-08-11T12:22:08.879523+0000","last_fullsized":"2023-08-11T12:22:08.879523+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880009+0000","last_change":"2023-08-11T12:22:03.848715+0000","last_active":"2023-08-11T12:22:08.880009+0000","last_peered":"2023-08-11T12:22:08.880009+0000","last_clean":"2023-08-11T12:22:08.880009+0000","last_became_active":"2023-08-11T12:22:03.848311+0000","last_became_peered":"2023-08-11T12:22:03.848311+0000","last_unstale":"2023-08-11T12:22:08.880009+0000","last_undegraded":"2023-08-11T12:22:08.880009+0000","last_fullsized":"2023-08-11T12:22:08.880009+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:58:34.865429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.969957+0000","last_change":"2023-08-11T12:22:07.882566+0000","last_active":"2023-08-11T12:22:08.969957+0000","last_peered":"2023-08-11T12:22:08.969957+0000","last_clean":"2023-08-11T12:22:08.969957+0000","last_became_active":"2023-08-11T12:22:07.882198+0000","last_became_peered":"2023-08-11T12:22:07.882198+0000","last_unstale":"2023-08-11T12:22:08.969957+0000","last_undegraded":"2023-08-11T12:22:08.969957+0000","last_fullsized":"2023-08-11T12:22:08.969957+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:59:38.231276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066849+0000","last_change":"2023-08-11T12:22:02.846424+0000","last_active":"2023-08-11T12:22:09.066849+0000","last_peered":"2023-08-11T12:22:09.066849+0000","last_clean":"2023-08-11T12:22:09.066849+0000","last_became_active":"2023-08-11T12:22:02.846063+0000","last_became_peered":"2023-08-11T12:22:02.846063+0000","last_unstale":"2023-08-11T12:22:09.066849+0000","last_undegraded":"2023-08-11T12:22:09.066849+0000","last_fullsized":"2023-08-11T12:22:09.066849+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:09:23.947071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880442+0000","last_change":"2023-08-11T12:22:03.845616+0000","last_active":"2023-08-11T12:22:08.880442+0000","last_peered":"2023-08-11T12:22:08.880442+0000","last_clean":"2023-08-11T12:22:08.880442+0000","last_became_active":"2023-08-11T12:22:03.845293+0000","last_became_peered":"2023-08-11T12:22:03.845293+0000","last_unstale":"2023-08-11T12:22:08.880442+0000","last_undegraded":"2023-08-11T12:22:08.880442+0000","last_fullsized":"2023-08-11T12:22:08.880442+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:43:24.438207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716312+0000","last_change":"2023-08-11T12:22:07.888963+0000","last_active":"2023-08-11T12:22:30.716312+0000","last_peered":"2023-08-11T12:22:30.716312+0000","last_clean":"2023-08-11T12:22:30.716312+0000","last_became_active":"2023-08-11T12:22:07.888513+0000","last_became_peered":"2023-08-11T12:22:07.888513+0000","last_unstale":"2023-08-11T12:22:30.716312+0000","last_undegraded":"2023-08-11T12:22:30.716312+0000","last_fullsized":"2023-08-11T12:22:30.716312+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:23:50.241697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068238+0000","last_change":"2023-08-11T12:22:02.850739+0000","last_active":"2023-08-11T12:22:09.068238+0000","last_peered":"2023-08-11T12:22:09.068238+0000","last_clean":"2023-08-11T12:22:09.068238+0000","last_became_active":"2023-08-11T12:22:02.850455+0000","last_became_peered":"2023-08-11T12:22:02.850455+0000","last_unstale":"2023-08-11T12:22:09.068238+0000","last_undegraded":"2023-08-11T12:22:09.068238+0000","last_fullsized":"2023-08-11T12:22:09.068238+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:48:26.768060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880073+0000","last_change":"2023-08-11T12:22:03.838834+0000","last_active":"2023-08-11T12:22:08.880073+0000","last_peered":"2023-08-11T12:22:08.880073+0000","last_clean":"2023-08-11T12:22:08.880073+0000","last_became_active":"2023-08-11T12:22:03.838435+0000","last_became_peered":"2023-08-11T12:22:03.838435+0000","last_unstale":"2023-08-11T12:22:08.880073+0000","last_undegraded":"2023-08-11T12:22:08.880073+0000","last_fullsized":"2023-08-11T12:22:08.880073+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:01:44.440343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066277+0000","last_change":"2023-08-11T12:22:07.884481+0000","last_active":"2023-08-11T12:22:09.066277+0000","last_peered":"2023-08-11T12:22:09.066277+0000","last_clean":"2023-08-11T12:22:09.066277+0000","last_became_active":"2023-08-11T12:22:07.884084+0000","last_became_peered":"2023-08-11T12:22:07.884084+0000","last_unstale":"2023-08-11T12:22:09.066277+0000","last_undegraded":"2023-08-11T12:22:09.066277+0000","last_fullsized":"2023-08-11T12:22:09.066277+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:54:33.489782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879471+0000","last_change":"2023-08-11T12:22:02.849339+0000","last_active":"2023-08-11T12:22:08.879471+0000","last_peered":"2023-08-11T12:22:08.879471+0000","last_clean":"2023-08-11T12:22:08.879471+0000","last_became_active":"2023-08-11T12:22:02.848986+0000","last_became_peered":"2023-08-11T12:22:02.848986+0000","last_unstale":"2023-08-11T12:22:08.879471+0000","last_undegraded":"2023-08-11T12:22:08.879471+0000","last_fullsized":"2023-08-11T12:22:08.879471+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:54:41.533973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880177+0000","last_change":"2023-08-11T12:22:03.846301+0000","last_active":"2023-08-11T12:22:08.880177+0000","last_peered":"2023-08-11T12:22:08.880177+0000","last_clean":"2023-08-11T12:22:08.880177+0000","last_became_active":"2023-08-11T12:22:03.845990+0000","last_became_peered":"2023-08-11T12:22:03.845990+0000","last_unstale":"2023-08-11T12:22:08.880177+0000","last_undegraded":"2023-08-11T12:22:08.880177+0000","last_fullsized":"2023-08-11T12:22:08.880177+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:13:13.325427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.722464+0000","last_change":"2023-08-11T12:22:03.836652+0000","last_active":"2023-08-11T12:22:30.722464+0000","last_peered":"2023-08-11T12:22:30.722464+0000","last_clean":"2023-08-11T12:22:30.722464+0000","last_became_active":"2023-08-11T12:22:03.836236+0000","last_became_peered":"2023-08-11T12:22:03.836236+0000","last_unstale":"2023-08-11T12:22:30.722464+0000","last_undegraded":"2023-08-11T12:22:30.722464+0000","last_fullsized":"2023-08-11T12:22:30.722464+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:22:25.801143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067076+0000","last_change":"2023-08-11T12:22:03.831318+0000","last_active":"2023-08-11T12:22:09.067076+0000","last_peered":"2023-08-11T12:22:09.067076+0000","last_clean":"2023-08-11T12:22:09.067076+0000","last_became_active":"2023-08-11T12:22:03.830670+0000","last_became_peered":"2023-08-11T12:22:03.830670+0000","last_unstale":"2023-08-11T12:22:09.067076+0000","last_undegraded":"2023-08-11T12:22:09.067076+0000","last_fullsized":"2023-08-11T12:22:09.067076+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:26:18.125172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066384+0000","last_change":"2023-08-11T12:22:03.841396+0000","last_active":"2023-08-11T12:22:09.066384+0000","last_peered":"2023-08-11T12:22:09.066384+0000","last_clean":"2023-08-11T12:22:09.066384+0000","last_became_active":"2023-08-11T12:22:03.841076+0000","last_became_peered":"2023-08-11T12:22:03.841076+0000","last_unstale":"2023-08-11T12:22:09.066384+0000","last_undegraded":"2023-08-11T12:22:09.066384+0000","last_fullsized":"2023-08-11T12:22:09.066384+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:31:49.747283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716636+0000","last_change":"2023-08-11T12:22:03.847266+0000","last_active":"2023-08-11T12:22:30.716636+0000","last_peered":"2023-08-11T12:22:30.716636+0000","last_clean":"2023-08-11T12:22:30.716636+0000","last_became_active":"2023-08-11T12:22:03.846898+0000","last_became_peered":"2023-08-11T12:22:03.846898+0000","last_unstale":"2023-08-11T12:22:30.716636+0000","last_undegraded":"2023-08-11T12:22:30.716636+0000","last_fullsized":"2023-08-11T12:22:30.716636+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:01:44.284193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879562+0000","last_change":"2023-08-11T12:22:03.843491+0000","last_active":"2023-08-11T12:22:08.879562+0000","last_peered":"2023-08-11T12:22:08.879562+0000","last_clean":"2023-08-11T12:22:08.879562+0000","last_became_active":"2023-08-11T12:22:03.843099+0000","last_became_peered":"2023-08-11T12:22:03.843099+0000","last_unstale":"2023-08-11T12:22:08.879562+0000","last_undegraded":"2023-08-11T12:22:08.879562+0000","last_fullsized":"2023-08-11T12:22:08.879562+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:06:59.399331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.724108+0000","last_change":"2023-08-11T12:22:03.840508+0000","last_active":"2023-08-11T12:22:30.724108+0000","last_peered":"2023-08-11T12:22:30.724108+0000","last_clean":"2023-08-11T12:22:30.724108+0000","last_became_active":"2023-08-11T12:22:03.840160+0000","last_became_peered":"2023-08-11T12:22:03.840160+0000","last_unstale":"2023-08-11T12:22:30.724108+0000","last_undegraded":"2023-08-11T12:22:30.724108+0000","last_fullsized":"2023-08-11T12:22:30.724108+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:42:10.983782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067345+0000","last_change":"2023-08-11T12:22:03.843724+0000","last_active":"2023-08-11T12:22:09.067345+0000","last_peered":"2023-08-11T12:22:09.067345+0000","last_clean":"2023-08-11T12:22:09.067345+0000","last_became_active":"2023-08-11T12:22:03.843431+0000","last_became_peered":"2023-08-11T12:22:03.843431+0000","last_unstale":"2023-08-11T12:22:09.067345+0000","last_undegraded":"2023-08-11T12:22:09.067345+0000","last_fullsized":"2023-08-11T12:22:09.067345+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:31:51.191070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068290+0000","last_change":"2023-08-11T12:22:03.831268+0000","last_active":"2023-08-11T12:22:09.068290+0000","last_peered":"2023-08-11T12:22:09.068290+0000","last_clean":"2023-08-11T12:22:09.068290+0000","last_became_active":"2023-08-11T12:22:03.830839+0000","last_became_peered":"2023-08-11T12:22:03.830839+0000","last_unstale":"2023-08-11T12:22:09.068290+0000","last_undegraded":"2023-08-11T12:22:09.068290+0000","last_fullsized":"2023-08-11T12:22:09.068290+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:56:40.087593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066807+0000","last_change":"2023-08-11T12:22:03.839227+0000","last_active":"2023-08-11T12:22:09.066807+0000","last_peered":"2023-08-11T12:22:09.066807+0000","last_clean":"2023-08-11T12:22:09.066807+0000","last_became_active":"2023-08-11T12:22:03.838526+0000","last_became_peered":"2023-08-11T12:22:03.838526+0000","last_unstale":"2023-08-11T12:22:09.066807+0000","last_undegraded":"2023-08-11T12:22:09.066807+0000","last_fullsized":"2023-08-11T12:22:09.066807+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:01:52.337807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067944+0000","last_change":"2023-08-11T12:22:03.834614+0000","last_active":"2023-08-11T12:22:09.067944+0000","last_peered":"2023-08-11T12:22:09.067944+0000","last_clean":"2023-08-11T12:22:09.067944+0000","last_became_active":"2023-08-11T12:22:03.834267+0000","last_became_peered":"2023-08-11T12:22:03.834267+0000","last_unstale":"2023-08-11T12:22:09.067944+0000","last_undegraded":"2023-08-11T12:22:09.067944+0000","last_fullsized":"2023-08-11T12:22:09.067944+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:22:51.239980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.970204+0000","last_change":"2023-08-11T12:22:03.846504+0000","last_active":"2023-08-11T12:22:08.970204+0000","last_peered":"2023-08-11T12:22:08.970204+0000","last_clean":"2023-08-11T12:22:08.970204+0000","last_became_active":"2023-08-11T12:22:03.846156+0000","last_became_peered":"2023-08-11T12:22:03.846156+0000","last_unstale":"2023-08-11T12:22:08.970204+0000","last_undegraded":"2023-08-11T12:22:08.970204+0000","last_fullsized":"2023-08-11T12:22:08.970204+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:37:05.136958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879069+0000","last_change":"2023-08-11T12:22:03.849854+0000","last_active":"2023-08-11T12:22:08.879069+0000","last_peered":"2023-08-11T12:22:08.879069+0000","last_clean":"2023-08-11T12:22:08.879069+0000","last_became_active":"2023-08-11T12:22:03.849553+0000","last_became_peered":"2023-08-11T12:22:03.849553+0000","last_unstale":"2023-08-11T12:22:08.879069+0000","last_undegraded":"2023-08-11T12:22:08.879069+0000","last_fullsized":"2023-08-11T12:22:08.879069+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:28:10.396410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.723809+0000","last_change":"2023-08-11T12:22:03.843511+0000","last_active":"2023-08-11T12:22:30.723809+0000","last_peered":"2023-08-11T12:22:30.723809+0000","last_clean":"2023-08-11T12:22:30.723809+0000","last_became_active":"2023-08-11T12:22:03.843206+0000","last_became_peered":"2023-08-11T12:22:03.843206+0000","last_unstale":"2023-08-11T12:22:30.723809+0000","last_undegraded":"2023-08-11T12:22:30.723809+0000","last_fullsized":"2023-08-11T12:22:30.723809+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:15:11.117760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":248338,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5044,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":8,"num_read_kb":10,"num_write":105,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":21158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91,"ondisk_log_size":91,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449106,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":464654,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.753},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.76700000000000002}]},{"osd":1,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.61299999999999999}]},{"osd":2,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.66600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":4,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.88300000000000001}]},{"osd":6,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.81000000000000005}]},{"osd":7,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.82499999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":9,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.98199999999999998}]},{"osd":10,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.94099999999999995}]}]},{"osd":10,"up_from":71,"seq":304942678036,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":1058957,"data_compressed":47603,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":1,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.42699999999999999}]},{"osd":2,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.58299999999999996}]},{"osd":3,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.64800000000000002}]},{"osd":4,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.71299999999999997}]},{"osd":5,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.629},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.78300000000000003}]},{"osd":6,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.75600000000000001}]},{"osd":7,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.59099999999999997}]},{"osd":8,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.86799999999999999}]},{"osd":9,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.90500000000000003}]},{"osd":11,"last update":"Fri Aug 11 12:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.85299999999999998}]}]},{"osd":9,"up_from":66,"seq":283467841561,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":484270,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.624}]},{"osd":2,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.79600000000000004}]},{"osd":3,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.71599999999999997}]},{"osd":4,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.69899999999999995}]},{"osd":5,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.754}]},{"osd":6,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.66900000000000004}]},{"osd":8,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.80900000000000005}]},{"osd":10,"last update":"Fri Aug 11 12:21:54 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.90900000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]}]},{"osd":8,"up_from":58,"seq":249108103199,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":464810,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.45700000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.75700000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72199999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.81100000000000005}]},{"osd":1,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.443,"5min":0.372,"15min":0.372},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54900000000000004}]},{"osd":2,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.437,"15min":0.42699999999999999},"min":{"1min":0.34100000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.45000000000000001,"15min":0.439},"min":{"1min":0.32500000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.76900000000000002,"5min":0.878,"15min":0.878},"last":0.39300000000000002}]},{"osd":3,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63700000000000001,"15min":0.63900000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82399999999999995,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.61899999999999999,"15min":0.60999999999999999},"min":{"1min":0.42899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.92900000000000005}]},{"osd":4,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.44500000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.66200000000000003,"15min":0.65200000000000002},"min":{"1min":0.49299999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.56599999999999995}]},{"osd":5,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.54300000000000004,"15min":0.52900000000000003},"min":{"1min":0.34899999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.44},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.57899999999999996,"15min":0.56299999999999994},"min":{"1min":0.40600000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.41699999999999998}]},{"osd":6,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.69799999999999995,"15min":0.68500000000000005},"min":{"1min":0.51300000000000001,"5min":0.441,"15min":0.441},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.72599999999999998,"15min":0.71499999999999997},"min":{"1min":0.59499999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.82499999999999996}]},{"osd":7,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.70699999999999996,"15min":0.69099999999999995},"min":{"1min":0.54200000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72299999999999998,"15min":0.71299999999999997},"min":{"1min":0.48899999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.58099999999999996}]},{"osd":9,"last update":"Fri Aug 11 12:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.86599999999999999}]},{"osd":10,"last update":"Fri Aug 11 12:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.89800000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":7,"up_from":51,"seq":219043332130,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":1055371,"data_compressed":47603,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.61399999999999999,"15min":0.60599999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.55200000000000005,"15min":0.53700000000000003},"min":{"1min":0.46999999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.65700000000000003}]},{"osd":1,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.41099999999999998,"15min":0.40100000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.45000000000000001,"15min":0.442},"min":{"1min":0.312,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.54400000000000004}]},{"osd":2,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.42899999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.59099999999999997,"15min":0.57999999999999996},"min":{"1min":0.498,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80900000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.61399999999999999}]},{"osd":3,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.61499999999999999,"15min":0.60699999999999998},"min":{"1min":0.432,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.64000000000000001,"15min":0.626},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.66100000000000003}]},{"osd":4,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.54400000000000004,"15min":0.53600000000000003},"min":{"1min":0.36199999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.434},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53800000000000003,"15min":0.53500000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.0149999999999999,"5min":1.105,"15min":1.105},"last":0.48499999999999999}]},{"osd":5,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.66300000000000003,"15min":0.65600000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.66200000000000003,"15min":0.65600000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.68600000000000005}]},{"osd":6,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.73299999999999998,"15min":0.71699999999999997},"min":{"1min":0.59399999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.70199999999999996,"15min":0.68500000000000005},"min":{"1min":0.59399999999999997,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.56399999999999995}]},{"osd":8,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.70099999999999996,"15min":0.68300000000000005},"min":{"1min":0.56899999999999995,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.69399999999999995,"15min":0.68000000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.78500000000000003}]},{"osd":9,"last update":"Fri Aug 11 12:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.75900000000000001}]},{"osd":10,"last update":"Fri Aug 11 12:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.80300000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]}]},{"osd":6,"up_from":46,"seq":197568495656,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":464072,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47499999999999998,"15min":0.46300000000000002},"min":{"1min":0.37,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.73599999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.435},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51800000000000002,"15min":0.50800000000000001},"min":{"1min":0.375,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61599999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.50900000000000001}]},{"osd":1,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.65400000000000003,"15min":0.63},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.878,"5min":1.327,"15min":1.327},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.69199999999999995,"15min":0.67500000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98599999999999999,"5min":1.206,"15min":1.206},"last":0.60299999999999998}]},{"osd":2,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.69199999999999995,"15min":0.68799999999999994},"min":{"1min":0.51000000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98399999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.70599999999999996,"15min":0.69299999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.63600000000000001}]},{"osd":3,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59699999999999998,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67400000000000004,"15min":0.66200000000000003},"min":{"1min":0.48499999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.05,"5min":1.196,"15min":1.196},"last":0.66100000000000003}]},{"osd":4,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69799999999999995,"15min":0.69599999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97199999999999998,"5min":1.139,"15min":1.139},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.752,"15min":0.74099999999999999},"min":{"1min":0.52600000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.012,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.81200000000000006}]},{"osd":5,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.77800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56599999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1499999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80600000000000005,"15min":0.80500000000000005},"min":{"1min":0.59299999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0109999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.84799999999999998}]},{"osd":7,"last update":"Fri Aug 11 12:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.81599999999999995,"15min":0.80400000000000005},"min":{"1min":0.59199999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.177,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.82099999999999995,"15min":0.81299999999999994},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.90600000000000003}]},{"osd":8,"last update":"Fri Aug 11 12:22:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.83199999999999996,"15min":0.83699999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.079,"5min":1.284,"15min":1.284},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.877,"15min":0.88500000000000001},"min":{"1min":0.65500000000000003,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1839999999999999,"5min":1.387,"15min":1.387},"last":0.83099999999999996}]},{"osd":9,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.86799999999999999}]},{"osd":10,"last update":"Fri Aug 11 12:21:54 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.88100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":467914,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.53400000000000003,"15min":0.51200000000000001},"min":{"1min":0.35099999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.96099999999999997,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.55500000000000005,"15min":0.56299999999999994},"min":{"1min":0.378,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.83199999999999996,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.69399999999999995}]},{"osd":2,"last update":"Fri Aug 11 12:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.40699999999999997,"5min":0.315,"15min":0.315},"max":{"1min":0.76000000000000001,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.53800000000000003,"15min":0.51100000000000001},"min":{"1min":0.40300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79400000000000004,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.752}]},{"osd":3,"last update":"Fri Aug 11 12:22:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80700000000000005,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65600000000000003,"15min":0.63200000000000001},"min":{"1min":0.49099999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90600000000000003,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.77500000000000002}]},{"osd":4,"last update":"Fri Aug 11 12:21:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46200000000000002,"15min":0.44500000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.745,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.47699999999999998,"15min":0.47299999999999998},"min":{"1min":0.26500000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.63,"15min":0.60799999999999998},"min":{"1min":0.44,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89000000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.60899999999999999,"15min":0.60099999999999998},"min":{"1min":0.48399999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.80900000000000005}]},{"osd":6,"last update":"Fri Aug 11 12:21:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72999999999999998,"15min":0.73499999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94399999999999995,"5min":1.095,"15min":1.095},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78000000000000003,"15min":0.78200000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.99299999999999999,"5min":1.159,"15min":1.159},"last":0.88900000000000001}]},{"osd":7,"last update":"Fri Aug 11 12:21:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.35799999999999998,"5min":0.31,"15min":0.31},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.90600000000000003}]},{"osd":8,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72799999999999998,"15min":0.72199999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93400000000000005,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.74199999999999999,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.436,"15min":0.436},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":1.008}]},{"osd":9,"last update":"Fri Aug 11 12:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.871},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.96499999999999997}]},{"osd":10,"last update":"Fri Aug 11 12:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.93400000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738435,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":465550,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 11 12:21:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.57799999999999996,"15min":0.52800000000000002},"min":{"1min":0.42899999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.96699999999999997,"5min":1.782,"15min":1.782},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.58799999999999997,"15min":0.53800000000000003},"min":{"1min":0.46400000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.069,"5min":2.7749999999999999,"15min":2.7749999999999999},"last":0.68200000000000005}]},{"osd":2,"last update":"Fri Aug 11 12:21:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59399999999999997,"15min":0.55300000000000005},"min":{"1min":0.40799999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.63400000000000001,"15min":0.57799999999999996},"min":{"1min":0.46400000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94699999999999995,"5min":1.879,"15min":1.879},"last":0.60699999999999998}]},{"osd":3,"last update":"Fri Aug 11 12:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.49399999999999999,"15min":0.48099999999999998},"min":{"1min":0.40500000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.36599999999999999}]},{"osd":4,"last update":"Fri Aug 11 12:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.66100000000000003,"15min":0.61199999999999999},"min":{"1min":0.503,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.016,"5min":1.849,"15min":1.849},"last":0.501},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.67800000000000005,"15min":0.63100000000000001},"min":{"1min":0.54600000000000004,"5min":0.443,"15min":0.443},"max":{"1min":1.085,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":0.42999999999999999}]},{"osd":5,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.71899999999999997,"15min":0.68999999999999995},"min":{"1min":0.54800000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.99399999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.748,"15min":0.71999999999999997},"min":{"1min":0.55200000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1020000000000001,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.82799999999999996}]},{"osd":6,"last update":"Fri Aug 11 12:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97699999999999998,"5min":2.8839999999999999,"15min":2.8839999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.70999999999999996,"15min":0.71599999999999997},"min":{"1min":0.41299999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.95799999999999996,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.76900000000000002}]},{"osd":7,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83799999999999997,"15min":0.83699999999999997},"min":{"1min":0.55400000000000005,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.409,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.628},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.91500000000000004,"15min":0.92600000000000005},"min":{"1min":0.61399999999999999,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.385,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.55100000000000005}]},{"osd":8,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.82899999999999996,"15min":0.84399999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.91800000000000004,"5min":1.262,"15min":1.262},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.92200000000000004,"15min":0.93700000000000006},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.079,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.65100000000000002}]},{"osd":9,"last update":"Fri Aug 11 12:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.86299999999999999}]},{"osd":10,"last update":"Fri Aug 11 12:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.748}]},{"osd":11,"last update":"Fri Aug 11 12:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.78900000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411386,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":467279,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.60899999999999999,"15min":0.54400000000000004},"min":{"1min":0.39100000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.80900000000000005,"5min":5.968,"15min":5.968},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.40600000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.50900000000000001}]},{"osd":1,"last update":"Fri Aug 11 12:21:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.52400000000000002,"15min":0.502},"min":{"1min":0.38200000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.55000000000000004,"15min":0.52300000000000002},"min":{"1min":0.45600000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.72599999999999998}]},{"osd":3,"last update":"Fri Aug 11 12:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61299999999999999,"15min":0.59699999999999998},"min":{"1min":0.45800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.623,"15min":0.59899999999999998},"min":{"1min":0.46899999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.76300000000000001}]},{"osd":4,"last update":"Fri Aug 11 12:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.57799999999999996,"15min":0.56799999999999995},"min":{"1min":0.441,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59999999999999998,"15min":0.58699999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.70399999999999996}]},{"osd":5,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.44400000000000001,"15min":0.42799999999999999},"min":{"1min":0.31,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.622},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.46800000000000003,"15min":0.44800000000000001},"min":{"1min":0.32800000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.54000000000000004}]},{"osd":6,"last update":"Fri Aug 11 12:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.48599999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.878,"5min":0.879,"15min":0.879},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.63100000000000001,"15min":0.61599999999999999},"min":{"1min":0.53200000000000003,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.84599999999999997}]},{"osd":7,"last update":"Fri Aug 11 12:21:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.59799999999999998,"15min":0.58399999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.53100000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.88800000000000001}]},{"osd":8,"last update":"Fri Aug 11 12:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.60299999999999998,"15min":0.58899999999999997},"min":{"1min":0.40000000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.57399999999999995,"15min":0.56000000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.81299999999999994}]},{"osd":9,"last update":"Fri Aug 11 12:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.874},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.97699999999999998}]},{"osd":10,"last update":"Fri Aug 11 12:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.92200000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]}]},{"osd":3,"up_from":25,"seq":107374182453,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":464266,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.437,"15min":0.38700000000000001},"min":{"1min":0.33900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.499,"5min":0.46999999999999997,"15min":0.438},"min":{"1min":0.36299999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67300000000000004,"5min":1.006,"15min":1.006},"last":0.59899999999999998}]},{"osd":1,"last update":"Fri Aug 11 12:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64200000000000002,"15min":0.57399999999999995},"min":{"1min":0.48399999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.98599999999999999,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.63200000000000001,"15min":0.59299999999999997},"min":{"1min":0.45100000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92200000000000004,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.69699999999999995}]},{"osd":2,"last update":"Fri Aug 11 12:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.64700000000000002,"15min":0.61799999999999999},"min":{"1min":0.54600000000000004,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85099999999999998,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.69699999999999995,"15min":0.63},"min":{"1min":0.56299999999999994,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":1.018}]},{"osd":4,"last update":"Fri Aug 11 12:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.64000000000000001,"15min":0.60799999999999998},"min":{"1min":0.53100000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.68899999999999995,"15min":0.63700000000000001},"min":{"1min":0.67200000000000004,"5min":0.435,"15min":0.435},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.82699999999999996}]},{"osd":5,"last update":"Fri Aug 11 12:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.68899999999999995,"15min":0.65100000000000002},"min":{"1min":0.629,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.70899999999999996,"15min":0.66900000000000004},"min":{"1min":0.60899999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.85699999999999998}]},{"osd":6,"last update":"Fri Aug 11 12:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.77400000000000002,"15min":0.76000000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0900000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.71599999999999997,"15min":0.71099999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":1.0309999999999999}]},{"osd":7,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.78300000000000003,"15min":0.76400000000000001},"min":{"1min":0.65800000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.89900000000000002,"15min":0.88500000000000001},"min":{"1min":0.71799999999999997,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.86899999999999999}]},{"osd":8,"last update":"Fri Aug 11 12:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":1.004},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.91600000000000004}]},{"osd":9,"last update":"Fri Aug 11 12:21:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.92900000000000005}]},{"osd":10,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]}]},{"osd":4,"up_from":33,"seq":141733920817,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":942080,"data_stored":464094,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.39900000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.81599999999999995,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.41399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80900000000000005,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.72099999999999997}]},{"osd":1,"last update":"Fri Aug 11 12:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.40400000000000003,"15min":0.39600000000000002},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.38700000000000001,"15min":0.372},"min":{"1min":0.308,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.60399999999999998}]},{"osd":2,"last update":"Fri Aug 11 12:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.59699999999999998,"15min":0.57299999999999995},"min":{"1min":0.48599999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.58699999999999997,"15min":0.55900000000000005},"min":{"1min":0.54400000000000004,"5min":0.378,"15min":0.378},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.83999999999999997}]},{"osd":3,"last update":"Fri Aug 11 12:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.57699999999999996,"15min":0.55900000000000005},"min":{"1min":0.439,"5min":0.379,"15min":0.379},"max":{"1min":0.77300000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.41099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.77700000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.73199999999999998}]},{"osd":5,"last update":"Fri Aug 11 12:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.59499999999999997,"15min":0.56699999999999995},"min":{"1min":0.42199999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.60899999999999999,"15min":0.57599999999999996},"min":{"1min":0.42099999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.92900000000000005}]},{"osd":6,"last update":"Fri Aug 11 12:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.71399999999999997,"15min":0.69599999999999995},"min":{"1min":0.53400000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.63,"15min":0.61599999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.878}]},{"osd":7,"last update":"Fri Aug 11 12:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.58599999999999997,"15min":0.57099999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.64500000000000002,"15min":0.629},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":1.0189999999999999}]},{"osd":8,"last update":"Fri Aug 11 12:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.76200000000000001,"15min":0.749},"min":{"1min":0.63900000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":1.0700000000000001}]},{"osd":9,"last update":"Fri Aug 11 12:21:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":1.1459999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":1.0429999999999999}]},{"osd":10,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.80900000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]}]},{"osd":5,"up_from":38,"seq":163208757292,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":1054622,"data_compressed":47603,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.51900000000000002},"min":{"1min":0.32200000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70599999999999996,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35399999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.624,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.439}]},{"osd":1,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.38100000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77500000000000002,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.623,"5min":0.57699999999999996,"15min":0.56100000000000005},"min":{"1min":0.42099999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.83499999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.77400000000000002}]},{"osd":2,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.29799999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.41399999999999998,"15min":0.39800000000000002},"min":{"1min":0.27700000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.46999999999999997}]},{"osd":3,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72299999999999998,"5min":0.751,"15min":0.751},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.41199999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.77500000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.504}]},{"osd":4,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.61199999999999999,"15min":0.59199999999999997},"min":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1,"5min":1.016,"15min":1.016},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60899999999999999,"15min":0.60299999999999998},"min":{"1min":0.443,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.58099999999999996}]},{"osd":6,"last update":"Fri Aug 11 12:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.623,"15min":0.61099999999999999},"min":{"1min":0.40300000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89300000000000002,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.625},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.68100000000000005,"15min":0.66800000000000004},"min":{"1min":0.499,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.64500000000000002}]},{"osd":7,"last update":"Fri Aug 11 12:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.47199999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.68000000000000005}]},{"osd":8,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.60299999999999998,"15min":0.59299999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.56499999999999995,"15min":0.55800000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.69699999999999995}]},{"osd":9,"last update":"Fri Aug 11 12:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.754},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.85099999999999998}]},{"osd":10,"last update":"Fri Aug 11 12:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.72099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34304,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34304,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-11T12:22:33.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2023-08-11T12:22:33.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 21, 'reported_epoch': 87, 'state': 'peering', 'last_fresh': '2023-08-11T12:22:09.066359+0000', 'last_change': '2023-08-11T12:22:30.717444+0000', 'last_active': '2023-08-11T12:22:30.717444+0000', 'last_peered': '2023-08-11T12:22:09.066359+0000', 'last_clean': '2023-08-11T12:22:09.066359+0000', 'last_became_active': '2023-08-11T12:22:03.849130+0000', 'last_became_peered': '2023-08-11T12:22:03.849130+0000', 'last_unstale': '2023-08-11T12:22:09.066359+0000', 'last_undegraded': '2023-08-11T12:22:09.066359+0000', 'last_fullsized': '2023-08-11T12:22:09.066359+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 82, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-11T12:22:02.817170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-11T12:22:02.817170+0000', 'last_clean_scrub_stamp': '2023-08-11T12:22:02.817170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 8, 2], 'acting': [0, 8, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2, 4, 8], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-11T12:22:33.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-08-11T12:22:33.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 21, 'reported_epoch': 87, 'state': 'peering', 'last_fresh': '2023-08-11T12:22:09.067384+0000', 'last_change': '2023-08-11T12:22:30.723122+0000', 'last_active': '2023-08-11T12:22:30.723122+0000', 'last_peered': '2023-08-11T12:22:09.067384+0000', 'last_clean': '2023-08-11T12:22:09.067384+0000', 'last_became_active': '2023-08-11T12:22:03.840210+0000', 'last_became_peered': '2023-08-11T12:22:03.840210+0000', 'last_unstale': '2023-08-11T12:22:09.067384+0000', 'last_undegraded': '2023-08-11T12:22:09.067384+0000', 'last_fullsized': '2023-08-11T12:22:09.067384+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 82, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-11T12:22:02.817170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-11T12:22:02.817170+0000', 'last_clean_scrub_stamp': '2023-08-11T12:22:02.817170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [11, 9, 4], 'acting': [11, 9, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4, 5, 9], 'up_primary': 11, 'acting_primary': 11, 'purged_snaps': []} 2023-08-11T12:22:33.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.b is not active+clean 2023-08-11T12:22:33.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.b', 'version': "87'4", 'reported_seq': 2, 'reported_epoch': 88, 'state': 'peering', 'last_fresh': '2023-08-11T12:22:08.879523+0000', 'last_change': '2023-08-11T12:22:30.923867+0000', 'last_active': '2023-08-11T12:22:30.923867+0000', 'last_peered': '2023-08-11T12:22:08.879523+0000', 'last_clean': '2023-08-11T12:22:08.879523+0000', 'last_became_active': '2023-08-11T12:22:02.847394+0000', 'last_became_peered': '2023-08-11T12:22:02.847394+0000', 'last_unstale': '2023-08-11T12:22:08.879523+0000', 'last_undegraded': '2023-08-11T12:22:08.879523+0000', 'last_fullsized': '2023-08-11T12:22:08.879523+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 81, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-11T12:22:01.810315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-11T12:22:01.810315+0000', 'last_clean_scrub_stamp': '2023-08-11T12:22:01.810315+0000', 'objects_scrubbed': 0, 'log_size': 4, 'log_dups_size': 0, 'ondisk_log_size': 4, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 2, 'num_object_clones': 0, 'num_object_copies': 6, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 2, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 2, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 4, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 2, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [11, 2, 7], 'acting': [11, 2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 11, 'acting_primary': 11, 'purged_snaps': []} 2023-08-11T12:22:33.158 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-11T12:22:33.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.387+0000 7f1978dff700 1 -- 172.21.15.8:0/927556191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1974101bd0 msgr2=0x7f1974102030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:33.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.387+0000 7f1978dff700 1 --2- 172.21.15.8:0/927556191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1974101bd0 0x7f1974102030 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f195c0099c0 tx=0x7f195c009cd0 comp rx=0 tx=0).stop 2023-08-11T12:22:33.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.387+0000 7f1978dff700 1 -- 172.21.15.8:0/927556191 shutdown_connections 2023-08-11T12:22:33.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.387+0000 7f1978dff700 1 --2- 172.21.15.8:0/927556191 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19741009e0 0x7f1974100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:33.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.387+0000 7f1978dff700 1 --2- 172.21.15.8:0/927556191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1974102570 0x7f1974108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:33.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.387+0000 7f1978dff700 1 --2- 172.21.15.8:0/927556191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1974101bd0 0x7f1974102030 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:33.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.387+0000 7f1978dff700 1 -- 172.21.15.8:0/927556191 >> 172.21.15.8:0/927556191 conn(0x7f19740fbf50 msgr2=0x7f19740fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:33.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.387+0000 7f1978dff700 1 -- 172.21.15.8:0/927556191 shutdown_connections 2023-08-11T12:22:33.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.387+0000 7f1978dff700 1 -- 172.21.15.8:0/927556191 wait complete. 2023-08-11T12:22:33.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.388+0000 7f1978dff700 1 Processor -- start 2023-08-11T12:22:33.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.388+0000 7f1978dff700 1 -- start start 2023-08-11T12:22:33.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.388+0000 7f1978dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19741009e0 0x7f1974198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:33.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.388+0000 7f1978dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1974101bd0 0x7f1974198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:33.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.388+0000 7f1978dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1974102570 0x7f197419fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:33.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.388+0000 7f1978dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19741a04a0 con 0x7f1974102570 2023-08-11T12:22:33.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.388+0000 7f1978dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19741a05e0 con 0x7f1974101bd0 2023-08-11T12:22:33.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.388+0000 7f1978dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19741a0770 con 0x7f19741009e0 2023-08-11T12:22:33.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.389+0000 7f1972d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1974102570 0x7f197419fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:33.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.389+0000 7f197259c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19741009e0 0x7f1974198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:33.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.389+0000 7f197259c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19741009e0 0x7f1974198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:44932/0 (socket says 172.21.15.8:44932) 2023-08-11T12:22:33.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.389+0000 7f197259c700 1 -- 172.21.15.8:0/2635007446 learned_addr learned my addr 172.21.15.8:0/2635007446 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:33.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.389+0000 7f196bfff700 1 --2- 172.21.15.8:0/2635007446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1974101bd0 0x7f1974198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:33.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.389+0000 7f197259c700 1 -- 172.21.15.8:0/2635007446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1974101bd0 msgr2=0x7f1974198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:33.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.389+0000 7f197259c700 1 --2- 172.21.15.8:0/2635007446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1974101bd0 0x7f1974198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:33.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.389+0000 7f197259c700 1 -- 172.21.15.8:0/2635007446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1974102570 msgr2=0x7f197419fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:33.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.389+0000 7f197259c700 1 --2- 172.21.15.8:0/2635007446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1974102570 0x7f197419fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:33.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.389+0000 7f197259c700 1 -- 172.21.15.8:0/2635007446 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c009c40 con 0x7f19741009e0 2023-08-11T12:22:33.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.389+0000 7f197259c700 1 --2- 172.21.15.8:0/2635007446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19741009e0 0x7f1974198920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f196400e970 tx=0x7f196400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:33.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.390+0000 7f196b7fe700 1 -- 172.21.15.8:0/2635007446 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1964009790 con 0x7f19741009e0 2023-08-11T12:22:33.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.390+0000 7f196b7fe700 1 -- 172.21.15.8:0/2635007446 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f196400eeb0 con 0x7f19741009e0 2023-08-11T12:22:33.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.390+0000 7f1978dff700 1 -- 172.21.15.8:0/2635007446 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f195c0095f0 con 0x7f19741009e0 2023-08-11T12:22:33.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.390+0000 7f196b7fe700 1 -- 172.21.15.8:0/2635007446 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1964003d20 con 0x7f19741009e0 2023-08-11T12:22:33.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.390+0000 7f1978dff700 1 -- 172.21.15.8:0/2635007446 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19741a0e20 con 0x7f19741009e0 2023-08-11T12:22:33.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.391+0000 7f1978dff700 1 -- 172.21.15.8:0/2635007446 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f197410c240 con 0x7f19741009e0 2023-08-11T12:22:33.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.393+0000 7f196b7fe700 1 -- 172.21.15.8:0/2635007446 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f1964003e80 con 0x7f19741009e0 2023-08-11T12:22:33.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.394+0000 7f196b7fe700 1 --2- 172.21.15.8:0/2635007446 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f196009ffd0 0x7f19600a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:33.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.394+0000 7f196b7fe700 1 -- 172.21.15.8:0/2635007446 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f1964014070 con 0x7f19741009e0 2023-08-11T12:22:33.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.395+0000 7f196bfff700 1 --2- 172.21.15.8:0/2635007446 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f196009ffd0 0x7f19600a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:33.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.395+0000 7f196bfff700 1 --2- 172.21.15.8:0/2635007446 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f196009ffd0 0x7f19600a2490 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f195c00b580 tx=0x7f195c01a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:33.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.396+0000 7f196b7fe700 1 -- 172.21.15.8:0/2635007446 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f1964095300 con 0x7f19741009e0 2023-08-11T12:22:33.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.691+0000 7f1978dff700 1 -- 172.21.15.8:0/2635007446 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f197410c450 con 0x7f19741009e0 2023-08-11T12:22:33.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.692+0000 7f196b7fe700 1 -- 172.21.15.8:0/2635007446 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3201 (secure 0 0 0) 0x7f1964098920 con 0x7f19741009e0 2023-08-11T12:22:33.694 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:22:33.695 INFO:teuthology.orchestra.run.smithi008.stdout:{"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_age":365,"monmap":{"epoch":3,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":89,"num_osds":12,"num_up_osds":12,"osd_up_since":1691756474,"num_in_osds":12,"osd_in_since":1691756457,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":126},{"state_name":"peering","count":3}],"num_pgs":129,"num_pools":4,"num_objects":47,"data_bytes":595412,"bytes_used":343605248,"bytes_avail":1151596822528,"bytes_total":1151940427776,"inactive_pgs_ratio":0.023255813866853714,"read_bytes_sec":1279,"write_bytes_sec":1663,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":27,"id":1,"up":5,"in":5,"max":5,"by_rank":[{"filesystem_id":1,"rank":4,"name":"g","status":"up:standby-replay","gid":14526},{"filesystem_id":1,"rank":3,"name":"a","status":"up:standby-replay","gid":14538},{"filesystem_id":1,"rank":2,"name":"l","status":"up:standby-replay","gid":24457},{"filesystem_id":1,"rank":4,"name":"k","status":"up:active","gid":24464},{"filesystem_id":1,"rank":3,"name":"e","status":"up:active","gid":24500},{"filesystem_id":1,"rank":2,"name":"f","status":"up:active","gid":24517},{"filesystem_id":1,"rank":1,"name":"c","status":"up:standby-replay","gid":24529},{"filesystem_id":1,"rank":0,"name":"h","status":"up:standby-replay","gid":24533},{"filesystem_id":1,"rank":1,"name":"i","status":"up:active","gid":24550},{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":24575}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":2,"modules":["cephadm","dashboard","iostat","nfs","restful"],"services":{"dashboard":"https://172.21.15.8:8443/"}},"servicemap":{"epoch":20,"modified":"2023-08-11T12:22:32.510793+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"e":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"f":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"g":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"h":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"i":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"j":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-11T12:22:33.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.695+0000 7f1978dff700 1 -- 172.21.15.8:0/2635007446 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f196009ffd0 msgr2=0x7f19600a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:33.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.695+0000 7f1978dff700 1 --2- 172.21.15.8:0/2635007446 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f196009ffd0 0x7f19600a2490 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f195c00b580 tx=0x7f195c01a040 comp rx=0 tx=0).stop 2023-08-11T12:22:33.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.695+0000 7f1978dff700 1 -- 172.21.15.8:0/2635007446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19741009e0 msgr2=0x7f1974198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:33.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.695+0000 7f1978dff700 1 --2- 172.21.15.8:0/2635007446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19741009e0 0x7f1974198920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f196400e970 tx=0x7f196400ed30 comp rx=0 tx=0).stop 2023-08-11T12:22:33.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.695+0000 7f1978dff700 1 -- 172.21.15.8:0/2635007446 shutdown_connections 2023-08-11T12:22:33.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.695+0000 7f1978dff700 1 --2- 172.21.15.8:0/2635007446 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f196009ffd0 0x7f19600a2490 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:33.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.695+0000 7f1978dff700 1 --2- 172.21.15.8:0/2635007446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19741009e0 0x7f1974198920 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:33.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.695+0000 7f1978dff700 1 --2- 172.21.15.8:0/2635007446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1974102570 0x7f197419fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:33.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.695+0000 7f1978dff700 1 --2- 172.21.15.8:0/2635007446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1974101bd0 0x7f1974198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:33.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.695+0000 7f1978dff700 1 -- 172.21.15.8:0/2635007446 >> 172.21.15.8:0/2635007446 conn(0x7f19740fbf50 msgr2=0x7f19740fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:33.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.695+0000 7f1978dff700 1 -- 172.21.15.8:0/2635007446 shutdown_connections 2023-08-11T12:22:33.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.695+0000 7f1978dff700 1 -- 172.21.15.8:0/2635007446 wait complete. 2023-08-11T12:22:33.716 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-11T12:22:33.716 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-11T12:22:33.732 INFO:journalctl@ceph.mds.b.smithi045.stdout:Aug 11 12:22:33 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-b[155632]: 2023-08-11T12:22:33.415+0000 7fc35a79a700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-08-11T12:22:33.732 INFO:journalctl@ceph.mds.b.smithi045.stdout:Aug 11 12:22:33 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-b[155632]: 2023-08-11T12:22:33.415+0000 7fc35a79a700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2023-08-11T12:22:33.732 INFO:journalctl@ceph.mds.b.smithi045.stdout:Aug 11 12:22:33 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-b[155632]: 2023-08-11T12:22:33.415+0000 7fc35a79a700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2023-08-11T12:22:33.732 INFO:journalctl@ceph.mds.b.smithi045.stdout:Aug 11 12:22:33 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-b[155632]: 2023-08-11T12:22:33.415+0000 7fc35a79a700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2023-08-11T12:22:33.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.919+0000 7f7abc7ff700 1 -- 172.21.15.8:0/1096984767 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ab41009e0 msgr2=0x7f7ab4100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:33.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.919+0000 7f7abc7ff700 1 --2- 172.21.15.8:0/1096984767 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ab41009e0 0x7f7ab4100e00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00099c0 tx=0x7f7ab0009cd0 comp rx=0 tx=0).stop 2023-08-11T12:22:33.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.919+0000 7f7abc7ff700 1 -- 172.21.15.8:0/1096984767 shutdown_connections 2023-08-11T12:22:33.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.919+0000 7f7abc7ff700 1 --2- 172.21.15.8:0/1096984767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ab4102570 0x7f7ab4108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:33.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.919+0000 7f7abc7ff700 1 --2- 172.21.15.8:0/1096984767 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ab41009e0 0x7f7ab4100e00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:33.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.919+0000 7f7abc7ff700 1 --2- 172.21.15.8:0/1096984767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ab4101bd0 0x7f7ab4102030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:33.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.919+0000 7f7abc7ff700 1 -- 172.21.15.8:0/1096984767 >> 172.21.15.8:0/1096984767 conn(0x7f7ab40fbf50 msgr2=0x7f7ab40fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:33.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.919+0000 7f7abc7ff700 1 -- 172.21.15.8:0/1096984767 shutdown_connections 2023-08-11T12:22:33.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.919+0000 7f7abc7ff700 1 -- 172.21.15.8:0/1096984767 wait complete. 2023-08-11T12:22:33.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.920+0000 7f7abc7ff700 1 Processor -- start 2023-08-11T12:22:33.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.921+0000 7f7abc7ff700 1 -- start start 2023-08-11T12:22:33.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.921+0000 7f7abc7ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ab41009e0 0x7f7ab4196720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:33.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.921+0000 7f7abc7ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ab4101bd0 0x7f7ab4196c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:33.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.921+0000 7f7abc7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ab4102570 0x7f7ab419dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:33.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.921+0000 7f7abc7ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab419e2a0 con 0x7f7ab4101bd0 2023-08-11T12:22:33.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.921+0000 7f7abc7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab419e3e0 con 0x7f7ab4102570 2023-08-11T12:22:33.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.921+0000 7f7abc7ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab419e570 con 0x7f7ab41009e0 2023-08-11T12:22:33.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.921+0000 7f7ab9d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ab4101bd0 0x7f7ab4196c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:33.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.921+0000 7f7aba59b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ab41009e0 0x7f7ab4196720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:33.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.921+0000 7f7ab9d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ab4101bd0 0x7f7ab4196c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50910/0 (socket says 172.21.15.8:50910) 2023-08-11T12:22:33.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.921+0000 7f7aba59b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ab41009e0 0x7f7ab4196720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:44942/0 (socket says 172.21.15.8:44942) 2023-08-11T12:22:33.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.921+0000 7f7ab9d9a700 1 -- 172.21.15.8:0/3867334174 learned_addr learned my addr 172.21.15.8:0/3867334174 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:33.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.921+0000 7f7abad9c700 1 --2- 172.21.15.8:0/3867334174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ab4102570 0x7f7ab419dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:33.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.922+0000 7f7ab9d9a700 1 -- 172.21.15.8:0/3867334174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ab41009e0 msgr2=0x7f7ab4196720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:33.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.922+0000 7f7ab9d9a700 1 --2- 172.21.15.8:0/3867334174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ab41009e0 0x7f7ab4196720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:33.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.922+0000 7f7ab9d9a700 1 -- 172.21.15.8:0/3867334174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ab4102570 msgr2=0x7f7ab419dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:33.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.922+0000 7f7ab9d9a700 1 --2- 172.21.15.8:0/3867334174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ab4102570 0x7f7ab419dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:33.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.922+0000 7f7ab9d9a700 1 -- 172.21.15.8:0/3867334174 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab00095f0 con 0x7f7ab4101bd0 2023-08-11T12:22:33.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.922+0000 7f7ab9d9a700 1 --2- 172.21.15.8:0/3867334174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ab4101bd0 0x7f7ab4196c60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400e9a0 tx=0x7f7aa400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:33.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.922+0000 7f7aab7fe700 1 -- 172.21.15.8:0/3867334174 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4009790 con 0x7f7ab4101bd0 2023-08-11T12:22:33.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.922+0000 7f7aab7fe700 1 -- 172.21.15.8:0/3867334174 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7aa4010430 con 0x7f7ab4101bd0 2023-08-11T12:22:33.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.922+0000 7f7abc7ff700 1 -- 172.21.15.8:0/3867334174 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab419e850 con 0x7f7ab4101bd0 2023-08-11T12:22:33.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.922+0000 7f7aab7fe700 1 -- 172.21.15.8:0/3867334174 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4018680 con 0x7f7ab4101bd0 2023-08-11T12:22:33.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.922+0000 7f7abc7ff700 1 -- 172.21.15.8:0/3867334174 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab419edb0 con 0x7f7ab4101bd0 2023-08-11T12:22:33.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.923+0000 7f7abc7ff700 1 -- 172.21.15.8:0/3867334174 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab410c240 con 0x7f7ab4101bd0 2023-08-11T12:22:33.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.925+0000 7f7aab7fe700 1 -- 172.21.15.8:0/3867334174 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f7aa40105a0 con 0x7f7ab4101bd0 2023-08-11T12:22:33.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.927+0000 7f7aab7fe700 1 --2- 172.21.15.8:0/3867334174 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f7aa009ffd0 0x7f7aa00a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:33.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.927+0000 7f7aab7fe700 1 -- 172.21.15.8:0/3867334174 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f7aa4014070 con 0x7f7ab4101bd0 2023-08-11T12:22:33.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.927+0000 7f7aba59b700 1 --2- 172.21.15.8:0/3867334174 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f7aa009ffd0 0x7f7aa00a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:33.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.928+0000 7f7aba59b700 1 --2- 172.21.15.8:0/3867334174 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f7aa009ffd0 0x7f7aa00a2490 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0009990 tx=0x7f7ab0005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:33.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:33.931+0000 7f7aab7fe700 1 -- 172.21.15.8:0/3867334174 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f7aa4051c30 con 0x7f7ab4101bd0 2023-08-11T12:22:34.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:33 smithi008 ceph-mon[97158]: from='client.24833 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:22:34.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:33 smithi008 ceph-mon[97158]: from='client.24839 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:22:34.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:33 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2635007446' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2023-08-11T12:22:34.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:34.136+0000 7f7abc7ff700 1 -- 172.21.15.8:0/3867334174 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7ab4060d60 con 0x7f7aa009ffd0 2023-08-11T12:22:34.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:33 smithi194 ceph-mon[130905]: from='client.24833 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:22:34.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:33 smithi194 ceph-mon[130905]: from='client.24839 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:22:34.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:33 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2635007446' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2023-08-11T12:22:34.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:33 smithi045 ceph-mon[130284]: from='client.24833 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:22:34.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:33 smithi045 ceph-mon[130284]: from='client.24839 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:22:34.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:33 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2635007446' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2023-08-11T12:22:34.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:34.149+0000 7f7aab7fe700 1 -- 172.21.15.8:0/3867334174 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+422525 (secure 0 0 0) 0x7f7ab4060d60 con 0x7f7aa009ffd0 2023-08-11T12:22:34.156 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:22:34.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:34.154+0000 7f7abc7ff700 1 -- 172.21.15.8:0/3867334174 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f7aa009ffd0 msgr2=0x7f7aa00a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:34.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:34.154+0000 7f7abc7ff700 1 --2- 172.21.15.8:0/3867334174 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f7aa009ffd0 0x7f7aa00a2490 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0009990 tx=0x7f7ab0005fb0 comp rx=0 tx=0).stop 2023-08-11T12:22:34.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:34.154+0000 7f7abc7ff700 1 -- 172.21.15.8:0/3867334174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ab4101bd0 msgr2=0x7f7ab4196c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:34.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:34.154+0000 7f7abc7ff700 1 --2- 172.21.15.8:0/3867334174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ab4101bd0 0x7f7ab4196c60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400e9a0 tx=0x7f7aa400ecb0 comp rx=0 tx=0).stop 2023-08-11T12:22:34.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:34.154+0000 7f7abc7ff700 1 -- 172.21.15.8:0/3867334174 shutdown_connections 2023-08-11T12:22:34.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:34.154+0000 7f7abc7ff700 1 --2- 172.21.15.8:0/3867334174 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f7aa009ffd0 0x7f7aa00a2490 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:34.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:34.154+0000 7f7abc7ff700 1 --2- 172.21.15.8:0/3867334174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ab41009e0 0x7f7ab4196720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:34.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:34.154+0000 7f7abc7ff700 1 --2- 172.21.15.8:0/3867334174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ab4102570 0x7f7ab419dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:34.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:34.154+0000 7f7abc7ff700 1 --2- 172.21.15.8:0/3867334174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ab4101bd0 0x7f7ab4196c60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:34.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:34.154+0000 7f7abc7ff700 1 -- 172.21.15.8:0/3867334174 >> 172.21.15.8:0/3867334174 conn(0x7f7ab40fbf50 msgr2=0x7f7ab40fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:34.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:34.154+0000 7f7abc7ff700 1 -- 172.21.15.8:0/3867334174 shutdown_connections 2023-08-11T12:22:34.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:34.154+0000 7f7abc7ff700 1 -- 172.21.15.8:0/3867334174 wait complete. 2023-08-11T12:22:34.160 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-08-11T12:22:34.175 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":290,"stamp":"2023-08-11T12:22:32.510700+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595412,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":144,"num_read_kb":129,"num_write":286,"num_write_kb":2969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":421,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335552,"kb_used_data":11340,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124606272,"statfs":{"total":1151940427776,"available":1151596822528,"internally_reserved":0,"allocated":11612160,"data_stored":7375859,"data_compressed":253652,"data_compressed_allocated":339968,"data_compressed_original":2179072,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":545,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":8,"num_read_kb":10,"num_write":57,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002118"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.724344+0000","last_change":"2023-08-11T12:22:03.850538+0000","last_active":"2023-08-11T12:22:30.724344+0000","last_peered":"2023-08-11T12:22:30.724344+0000","last_clean":"2023-08-11T12:22:30.724344+0000","last_became_active":"2023-08-11T12:22:03.850220+0000","last_became_peered":"2023-08-11T12:22:03.850220+0000","last_unstale":"2023-08-11T12:22:30.724344+0000","last_undegraded":"2023-08-11T12:22:30.724344+0000","last_fullsized":"2023-08-11T12:22:30.724344+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:44:11.152122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716210+0000","last_change":"2023-08-11T12:22:03.843779+0000","last_active":"2023-08-11T12:22:30.716210+0000","last_peered":"2023-08-11T12:22:30.716210+0000","last_clean":"2023-08-11T12:22:30.716210+0000","last_became_active":"2023-08-11T12:22:03.843441+0000","last_became_peered":"2023-08-11T12:22:03.843441+0000","last_unstale":"2023-08-11T12:22:30.716210+0000","last_undegraded":"2023-08-11T12:22:30.716210+0000","last_fullsized":"2023-08-11T12:22:30.716210+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:11:50.295291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716835+0000","last_change":"2023-08-11T12:22:03.851996+0000","last_active":"2023-08-11T12:22:30.716835+0000","last_peered":"2023-08-11T12:22:30.716835+0000","last_clean":"2023-08-11T12:22:30.716835+0000","last_became_active":"2023-08-11T12:22:03.850821+0000","last_became_peered":"2023-08-11T12:22:03.850821+0000","last_unstale":"2023-08-11T12:22:30.716835+0000","last_undegraded":"2023-08-11T12:22:30.716835+0000","last_fullsized":"2023-08-11T12:22:30.716835+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:09:01.522001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067343+0000","last_change":"2023-08-11T12:22:03.842025+0000","last_active":"2023-08-11T12:22:09.067343+0000","last_peered":"2023-08-11T12:22:09.067343+0000","last_clean":"2023-08-11T12:22:09.067343+0000","last_became_active":"2023-08-11T12:22:03.841700+0000","last_became_peered":"2023-08-11T12:22:03.841700+0000","last_unstale":"2023-08-11T12:22:09.067343+0000","last_undegraded":"2023-08-11T12:22:09.067343+0000","last_fullsized":"2023-08-11T12:22:09.067343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:45:15.532577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879525+0000","last_change":"2023-08-11T12:22:03.844908+0000","last_active":"2023-08-11T12:22:08.879525+0000","last_peered":"2023-08-11T12:22:08.879525+0000","last_clean":"2023-08-11T12:22:08.879525+0000","last_became_active":"2023-08-11T12:22:03.844674+0000","last_became_peered":"2023-08-11T12:22:03.844674+0000","last_unstale":"2023-08-11T12:22:08.879525+0000","last_undegraded":"2023-08-11T12:22:08.879525+0000","last_fullsized":"2023-08-11T12:22:08.879525+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:13:32.050245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067181+0000","last_change":"2023-08-11T12:22:03.839915+0000","last_active":"2023-08-11T12:22:09.067181+0000","last_peered":"2023-08-11T12:22:09.067181+0000","last_clean":"2023-08-11T12:22:09.067181+0000","last_became_active":"2023-08-11T12:22:03.839099+0000","last_became_peered":"2023-08-11T12:22:03.839099+0000","last_unstale":"2023-08-11T12:22:09.067181+0000","last_undegraded":"2023-08-11T12:22:09.067181+0000","last_fullsized":"2023-08-11T12:22:09.067181+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:48:27.468032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880115+0000","last_change":"2023-08-11T12:22:03.841591+0000","last_active":"2023-08-11T12:22:08.880115+0000","last_peered":"2023-08-11T12:22:08.880115+0000","last_clean":"2023-08-11T12:22:08.880115+0000","last_became_active":"2023-08-11T12:22:03.841232+0000","last_became_peered":"2023-08-11T12:22:03.841232+0000","last_unstale":"2023-08-11T12:22:08.880115+0000","last_undegraded":"2023-08-11T12:22:08.880115+0000","last_fullsized":"2023-08-11T12:22:08.880115+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:57:51.227137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067792+0000","last_change":"2023-08-11T12:22:03.839516+0000","last_active":"2023-08-11T12:22:09.067792+0000","last_peered":"2023-08-11T12:22:09.067792+0000","last_clean":"2023-08-11T12:22:09.067792+0000","last_became_active":"2023-08-11T12:22:03.839058+0000","last_became_peered":"2023-08-11T12:22:03.839058+0000","last_unstale":"2023-08-11T12:22:09.067792+0000","last_undegraded":"2023-08-11T12:22:09.067792+0000","last_fullsized":"2023-08-11T12:22:09.067792+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:56:27.838147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.970642+0000","last_change":"2023-08-11T12:22:03.841033+0000","last_active":"2023-08-11T12:22:08.970642+0000","last_peered":"2023-08-11T12:22:08.970642+0000","last_clean":"2023-08-11T12:22:08.970642+0000","last_became_active":"2023-08-11T12:22:03.840665+0000","last_became_peered":"2023-08-11T12:22:03.840665+0000","last_unstale":"2023-08-11T12:22:08.970642+0000","last_undegraded":"2023-08-11T12:22:08.970642+0000","last_fullsized":"2023-08-11T12:22:08.970642+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:51:47.671738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067587+0000","last_change":"2023-08-11T12:22:03.839663+0000","last_active":"2023-08-11T12:22:09.067587+0000","last_peered":"2023-08-11T12:22:09.067587+0000","last_clean":"2023-08-11T12:22:09.067587+0000","last_became_active":"2023-08-11T12:22:03.838840+0000","last_became_peered":"2023-08-11T12:22:03.838840+0000","last_unstale":"2023-08-11T12:22:09.067587+0000","last_undegraded":"2023-08-11T12:22:09.067587+0000","last_fullsized":"2023-08-11T12:22:09.067587+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:57:09.615886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880443+0000","last_change":"2023-08-11T12:22:03.846288+0000","last_active":"2023-08-11T12:22:08.880443+0000","last_peered":"2023-08-11T12:22:08.880443+0000","last_clean":"2023-08-11T12:22:08.880443+0000","last_became_active":"2023-08-11T12:22:03.845962+0000","last_became_peered":"2023-08-11T12:22:03.845962+0000","last_unstale":"2023-08-11T12:22:08.880443+0000","last_undegraded":"2023-08-11T12:22:08.880443+0000","last_fullsized":"2023-08-11T12:22:08.880443+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:59:48.212360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.728022+0000","last_change":"2023-08-11T12:22:31.726774+0000","last_active":"2023-08-11T12:22:31.728022+0000","last_peered":"2023-08-11T12:22:31.728022+0000","last_clean":"2023-08-11T12:22:31.728022+0000","last_became_active":"2023-08-11T12:22:31.726437+0000","last_became_peered":"2023-08-11T12:22:31.726437+0000","last_unstale":"2023-08-11T12:22:31.728022+0000","last_undegraded":"2023-08-11T12:22:31.728022+0000","last_fullsized":"2023-08-11T12:22:31.728022+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:33:56.005318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879206+0000","last_change":"2023-08-11T12:22:03.842249+0000","last_active":"2023-08-11T12:22:08.879206+0000","last_peered":"2023-08-11T12:22:08.879206+0000","last_clean":"2023-08-11T12:22:08.879206+0000","last_became_active":"2023-08-11T12:22:03.841887+0000","last_became_peered":"2023-08-11T12:22:03.841887+0000","last_unstale":"2023-08-11T12:22:08.879206+0000","last_undegraded":"2023-08-11T12:22:08.879206+0000","last_fullsized":"2023-08-11T12:22:08.879206+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:08:58.125728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716293+0000","last_change":"2023-08-11T12:22:03.843859+0000","last_active":"2023-08-11T12:22:30.716293+0000","last_peered":"2023-08-11T12:22:30.716293+0000","last_clean":"2023-08-11T12:22:30.716293+0000","last_became_active":"2023-08-11T12:22:03.843383+0000","last_became_peered":"2023-08-11T12:22:03.843383+0000","last_unstale":"2023-08-11T12:22:30.716293+0000","last_undegraded":"2023-08-11T12:22:30.716293+0000","last_fullsized":"2023-08-11T12:22:30.716293+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:32:20.669588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"peering","last_fresh":"2023-08-11T12:22:09.066359+0000","last_change":"2023-08-11T12:22:30.717444+0000","last_active":"2023-08-11T12:22:30.717444+0000","last_peered":"2023-08-11T12:22:09.066359+0000","last_clean":"2023-08-11T12:22:09.066359+0000","last_became_active":"2023-08-11T12:22:03.849130+0000","last_became_peered":"2023-08-11T12:22:03.849130+0000","last_unstale":"2023-08-11T12:22:09.066359+0000","last_undegraded":"2023-08-11T12:22:09.066359+0000","last_fullsized":"2023-08-11T12:22:09.066359+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4,8],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.969810+0000","last_change":"2023-08-11T12:22:03.850397+0000","last_active":"2023-08-11T12:22:08.969810+0000","last_peered":"2023-08-11T12:22:08.969810+0000","last_clean":"2023-08-11T12:22:08.969810+0000","last_became_active":"2023-08-11T12:22:03.850143+0000","last_became_peered":"2023-08-11T12:22:03.850143+0000","last_unstale":"2023-08-11T12:22:08.969810+0000","last_undegraded":"2023-08-11T12:22:08.969810+0000","last_fullsized":"2023-08-11T12:22:08.969810+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:16:12.580674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.724188+0000","last_change":"2023-08-11T12:22:03.850496+0000","last_active":"2023-08-11T12:22:30.724188+0000","last_peered":"2023-08-11T12:22:30.724188+0000","last_clean":"2023-08-11T12:22:30.724188+0000","last_became_active":"2023-08-11T12:22:03.850192+0000","last_became_peered":"2023-08-11T12:22:03.850192+0000","last_unstale":"2023-08-11T12:22:30.724188+0000","last_undegraded":"2023-08-11T12:22:30.724188+0000","last_fullsized":"2023-08-11T12:22:30.724188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:15:36.813034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722136+0000","last_change":"2023-08-11T12:22:03.841706+0000","last_active":"2023-08-11T12:22:31.722136+0000","last_peered":"2023-08-11T12:22:31.722136+0000","last_clean":"2023-08-11T12:22:31.722136+0000","last_became_active":"2023-08-11T12:22:03.841341+0000","last_became_peered":"2023-08-11T12:22:03.841341+0000","last_unstale":"2023-08-11T12:22:31.722136+0000","last_undegraded":"2023-08-11T12:22:31.722136+0000","last_fullsized":"2023-08-11T12:22:31.722136+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:36:20.093373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067783+0000","last_change":"2023-08-11T12:22:03.834450+0000","last_active":"2023-08-11T12:22:09.067783+0000","last_peered":"2023-08-11T12:22:09.067783+0000","last_clean":"2023-08-11T12:22:09.067783+0000","last_became_active":"2023-08-11T12:22:03.834154+0000","last_became_peered":"2023-08-11T12:22:03.834154+0000","last_unstale":"2023-08-11T12:22:09.067783+0000","last_undegraded":"2023-08-11T12:22:09.067783+0000","last_fullsized":"2023-08-11T12:22:09.067783+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:59:48.605877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066819+0000","last_change":"2023-08-11T12:22:07.886317+0000","last_active":"2023-08-11T12:22:09.066819+0000","last_peered":"2023-08-11T12:22:09.066819+0000","last_clean":"2023-08-11T12:22:09.066819+0000","last_became_active":"2023-08-11T12:22:07.885986+0000","last_became_peered":"2023-08-11T12:22:07.885986+0000","last_unstale":"2023-08-11T12:22:09.066819+0000","last_undegraded":"2023-08-11T12:22:09.066819+0000","last_fullsized":"2023-08-11T12:22:09.066819+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:36:54.443747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722809+0000","last_change":"2023-08-11T12:22:02.841759+0000","last_active":"2023-08-11T12:22:31.722809+0000","last_peered":"2023-08-11T12:22:31.722809+0000","last_clean":"2023-08-11T12:22:31.722809+0000","last_became_active":"2023-08-11T12:22:02.841326+0000","last_became_peered":"2023-08-11T12:22:02.841326+0000","last_unstale":"2023-08-11T12:22:31.722809+0000","last_undegraded":"2023-08-11T12:22:31.722809+0000","last_fullsized":"2023-08-11T12:22:31.722809+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:09:30.085287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.802211+0000","last_change":"2023-08-11T12:22:31.801910+0000","last_active":"2023-08-11T12:22:31.802211+0000","last_peered":"2023-08-11T12:22:31.802211+0000","last_clean":"2023-08-11T12:22:31.802211+0000","last_became_active":"2023-08-11T12:22:31.801479+0000","last_became_peered":"2023-08-11T12:22:31.801479+0000","last_unstale":"2023-08-11T12:22:31.802211+0000","last_undegraded":"2023-08-11T12:22:31.802211+0000","last_fullsized":"2023-08-11T12:22:31.802211+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:52:21.489431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.065992+0000","last_change":"2023-08-11T12:22:07.875010+0000","last_active":"2023-08-11T12:22:09.065992+0000","last_peered":"2023-08-11T12:22:09.065992+0000","last_clean":"2023-08-11T12:22:09.065992+0000","last_became_active":"2023-08-11T12:22:07.874474+0000","last_became_peered":"2023-08-11T12:22:07.874474+0000","last_unstale":"2023-08-11T12:22:09.065992+0000","last_undegraded":"2023-08-11T12:22:09.065992+0000","last_fullsized":"2023-08-11T12:22:09.065992+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:54:41.734301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068448+0000","last_change":"2023-08-11T12:22:02.848299+0000","last_active":"2023-08-11T12:22:09.068448+0000","last_peered":"2023-08-11T12:22:09.068448+0000","last_clean":"2023-08-11T12:22:09.068448+0000","last_became_active":"2023-08-11T12:22:02.847869+0000","last_became_peered":"2023-08-11T12:22:02.847869+0000","last_unstale":"2023-08-11T12:22:09.068448+0000","last_undegraded":"2023-08-11T12:22:09.068448+0000","last_fullsized":"2023-08-11T12:22:09.068448+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:36:09.123226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716310+0000","last_change":"2023-08-11T12:22:03.841173+0000","last_active":"2023-08-11T12:22:30.716310+0000","last_peered":"2023-08-11T12:22:30.716310+0000","last_clean":"2023-08-11T12:22:30.716310+0000","last_became_active":"2023-08-11T12:22:03.840882+0000","last_became_peered":"2023-08-11T12:22:03.840882+0000","last_unstale":"2023-08-11T12:22:30.716310+0000","last_undegraded":"2023-08-11T12:22:30.716310+0000","last_fullsized":"2023-08-11T12:22:30.716310+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:58:38.141467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066479+0000","last_change":"2023-08-11T12:22:07.880756+0000","last_active":"2023-08-11T12:22:09.066479+0000","last_peered":"2023-08-11T12:22:09.066479+0000","last_clean":"2023-08-11T12:22:09.066479+0000","last_became_active":"2023-08-11T12:22:07.878866+0000","last_became_peered":"2023-08-11T12:22:07.878866+0000","last_unstale":"2023-08-11T12:22:09.066479+0000","last_undegraded":"2023-08-11T12:22:09.066479+0000","last_fullsized":"2023-08-11T12:22:09.066479+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:21:58.652424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'4","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:29.683617+0000","last_change":"2023-08-11T12:22:02.848543+0000","last_active":"2023-08-11T12:22:29.683617+0000","last_peered":"2023-08-11T12:22:29.683617+0000","last_clean":"2023-08-11T12:22:29.683617+0000","last_became_active":"2023-08-11T12:22:02.848008+0000","last_became_peered":"2023-08-11T12:22:02.848008+0000","last_unstale":"2023-08-11T12:22:29.683617+0000","last_undegraded":"2023-08-11T12:22:29.683617+0000","last_fullsized":"2023-08-11T12:22:29.683617+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:34:33.832747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.970098+0000","last_change":"2023-08-11T12:22:03.843651+0000","last_active":"2023-08-11T12:22:08.970098+0000","last_peered":"2023-08-11T12:22:08.970098+0000","last_clean":"2023-08-11T12:22:08.970098+0000","last_became_active":"2023-08-11T12:22:03.843392+0000","last_became_peered":"2023-08-11T12:22:03.843392+0000","last_unstale":"2023-08-11T12:22:08.970098+0000","last_undegraded":"2023-08-11T12:22:08.970098+0000","last_fullsized":"2023-08-11T12:22:08.970098+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:02:03.025511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066201+0000","last_change":"2023-08-11T12:22:07.879373+0000","last_active":"2023-08-11T12:22:09.066201+0000","last_peered":"2023-08-11T12:22:09.066201+0000","last_clean":"2023-08-11T12:22:09.066201+0000","last_became_active":"2023-08-11T12:22:07.878929+0000","last_became_peered":"2023-08-11T12:22:07.878929+0000","last_unstale":"2023-08-11T12:22:09.066201+0000","last_undegraded":"2023-08-11T12:22:09.066201+0000","last_fullsized":"2023-08-11T12:22:09.066201+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:44:35.895712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879734+0000","last_change":"2023-08-11T12:22:02.841984+0000","last_active":"2023-08-11T12:22:08.879734+0000","last_peered":"2023-08-11T12:22:08.879734+0000","last_clean":"2023-08-11T12:22:08.879734+0000","last_became_active":"2023-08-11T12:22:02.841585+0000","last_became_peered":"2023-08-11T12:22:02.841585+0000","last_unstale":"2023-08-11T12:22:08.879734+0000","last_undegraded":"2023-08-11T12:22:08.879734+0000","last_fullsized":"2023-08-11T12:22:08.879734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:22:35.974158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068146+0000","last_change":"2023-08-11T12:22:03.839381+0000","last_active":"2023-08-11T12:22:09.068146+0000","last_peered":"2023-08-11T12:22:09.068146+0000","last_clean":"2023-08-11T12:22:09.068146+0000","last_became_active":"2023-08-11T12:22:03.839091+0000","last_became_peered":"2023-08-11T12:22:03.839091+0000","last_unstale":"2023-08-11T12:22:09.068146+0000","last_undegraded":"2023-08-11T12:22:09.068146+0000","last_fullsized":"2023-08-11T12:22:09.068146+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:12:59.687698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067684+0000","last_change":"2023-08-11T12:22:07.881758+0000","last_active":"2023-08-11T12:22:09.067684+0000","last_peered":"2023-08-11T12:22:09.067684+0000","last_clean":"2023-08-11T12:22:09.067684+0000","last_became_active":"2023-08-11T12:22:07.881305+0000","last_became_peered":"2023-08-11T12:22:07.881305+0000","last_unstale":"2023-08-11T12:22:09.067684+0000","last_undegraded":"2023-08-11T12:22:09.067684+0000","last_fullsized":"2023-08-11T12:22:09.067684+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:08:17.423954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"82'1","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067097+0000","last_change":"2023-08-11T12:22:02.844138+0000","last_active":"2023-08-11T12:22:09.067097+0000","last_peered":"2023-08-11T12:22:09.067097+0000","last_clean":"2023-08-11T12:22:09.067097+0000","last_became_active":"2023-08-11T12:22:02.843234+0000","last_became_peered":"2023-08-11T12:22:02.843234+0000","last_unstale":"2023-08-11T12:22:09.067097+0000","last_undegraded":"2023-08-11T12:22:09.067097+0000","last_fullsized":"2023-08-11T12:22:09.067097+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:21:27.653637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879684+0000","last_change":"2023-08-11T12:22:03.845450+0000","last_active":"2023-08-11T12:22:08.879684+0000","last_peered":"2023-08-11T12:22:08.879684+0000","last_clean":"2023-08-11T12:22:08.879684+0000","last_became_active":"2023-08-11T12:22:03.845170+0000","last_became_peered":"2023-08-11T12:22:03.845170+0000","last_unstale":"2023-08-11T12:22:08.879684+0000","last_undegraded":"2023-08-11T12:22:08.879684+0000","last_fullsized":"2023-08-11T12:22:08.879684+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:54:39.747258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066775+0000","last_change":"2023-08-11T12:22:07.880663+0000","last_active":"2023-08-11T12:22:09.066775+0000","last_peered":"2023-08-11T12:22:09.066775+0000","last_clean":"2023-08-11T12:22:09.066775+0000","last_became_active":"2023-08-11T12:22:07.880282+0000","last_became_peered":"2023-08-11T12:22:07.880282+0000","last_unstale":"2023-08-11T12:22:09.066775+0000","last_undegraded":"2023-08-11T12:22:09.066775+0000","last_fullsized":"2023-08-11T12:22:09.066775+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:32:50.241286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"87'3","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:29.683550+0000","last_change":"2023-08-11T12:22:02.842206+0000","last_active":"2023-08-11T12:22:29.683550+0000","last_peered":"2023-08-11T12:22:29.683550+0000","last_clean":"2023-08-11T12:22:29.683550+0000","last_became_active":"2023-08-11T12:22:02.841815+0000","last_became_peered":"2023-08-11T12:22:02.841815+0000","last_unstale":"2023-08-11T12:22:29.683550+0000","last_undegraded":"2023-08-11T12:22:29.683550+0000","last_fullsized":"2023-08-11T12:22:29.683550+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:29:49.660552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067262+0000","last_change":"2023-08-11T12:22:03.825886+0000","last_active":"2023-08-11T12:22:09.067262+0000","last_peered":"2023-08-11T12:22:09.067262+0000","last_clean":"2023-08-11T12:22:09.067262+0000","last_became_active":"2023-08-11T12:22:03.825645+0000","last_became_peered":"2023-08-11T12:22:03.825645+0000","last_unstale":"2023-08-11T12:22:09.067262+0000","last_undegraded":"2023-08-11T12:22:09.067262+0000","last_fullsized":"2023-08-11T12:22:09.067262+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:27:52.324963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.723928+0000","last_change":"2023-08-11T12:22:07.890216+0000","last_active":"2023-08-11T12:22:30.723928+0000","last_peered":"2023-08-11T12:22:30.723928+0000","last_clean":"2023-08-11T12:22:30.723928+0000","last_became_active":"2023-08-11T12:22:07.889860+0000","last_became_peered":"2023-08-11T12:22:07.889860+0000","last_unstale":"2023-08-11T12:22:30.723928+0000","last_undegraded":"2023-08-11T12:22:30.723928+0000","last_fullsized":"2023-08-11T12:22:30.723928+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:26:31.744345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.878916+0000","last_change":"2023-08-11T12:22:02.835703+0000","last_active":"2023-08-11T12:22:08.878916+0000","last_peered":"2023-08-11T12:22:08.878916+0000","last_clean":"2023-08-11T12:22:08.878916+0000","last_became_active":"2023-08-11T12:22:02.835300+0000","last_became_peered":"2023-08-11T12:22:02.835300+0000","last_unstale":"2023-08-11T12:22:08.878916+0000","last_undegraded":"2023-08-11T12:22:08.878916+0000","last_fullsized":"2023-08-11T12:22:08.878916+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:05:05.549977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067658+0000","last_change":"2023-08-11T12:22:03.835619+0000","last_active":"2023-08-11T12:22:09.067658+0000","last_peered":"2023-08-11T12:22:09.067658+0000","last_clean":"2023-08-11T12:22:09.067658+0000","last_became_active":"2023-08-11T12:22:03.835365+0000","last_became_peered":"2023-08-11T12:22:03.835365+0000","last_unstale":"2023-08-11T12:22:09.067658+0000","last_undegraded":"2023-08-11T12:22:09.067658+0000","last_fullsized":"2023-08-11T12:22:09.067658+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:41:37.126989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716034+0000","last_change":"2023-08-11T12:22:07.893736+0000","last_active":"2023-08-11T12:22:30.716034+0000","last_peered":"2023-08-11T12:22:30.716034+0000","last_clean":"2023-08-11T12:22:30.716034+0000","last_became_active":"2023-08-11T12:22:07.893160+0000","last_became_peered":"2023-08-11T12:22:07.893160+0000","last_unstale":"2023-08-11T12:22:30.716034+0000","last_undegraded":"2023-08-11T12:22:30.716034+0000","last_fullsized":"2023-08-11T12:22:30.716034+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:15:12.861835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066672+0000","last_change":"2023-08-11T12:22:02.843819+0000","last_active":"2023-08-11T12:22:09.066672+0000","last_peered":"2023-08-11T12:22:09.066672+0000","last_clean":"2023-08-11T12:22:09.066672+0000","last_became_active":"2023-08-11T12:22:02.843062+0000","last_became_peered":"2023-08-11T12:22:02.843062+0000","last_unstale":"2023-08-11T12:22:09.066672+0000","last_undegraded":"2023-08-11T12:22:09.066672+0000","last_fullsized":"2023-08-11T12:22:09.066672+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:51:10.923574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722599+0000","last_change":"2023-08-11T12:22:03.845985+0000","last_active":"2023-08-11T12:22:31.722599+0000","last_peered":"2023-08-11T12:22:31.722599+0000","last_clean":"2023-08-11T12:22:31.722599+0000","last_became_active":"2023-08-11T12:22:03.845274+0000","last_became_peered":"2023-08-11T12:22:03.845274+0000","last_unstale":"2023-08-11T12:22:31.722599+0000","last_undegraded":"2023-08-11T12:22:31.722599+0000","last_fullsized":"2023-08-11T12:22:31.722599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:51:23.239546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067853+0000","last_change":"2023-08-11T12:22:07.885017+0000","last_active":"2023-08-11T12:22:09.067853+0000","last_peered":"2023-08-11T12:22:09.067853+0000","last_clean":"2023-08-11T12:22:09.067853+0000","last_became_active":"2023-08-11T12:22:07.884610+0000","last_became_peered":"2023-08-11T12:22:07.884610+0000","last_unstale":"2023-08-11T12:22:09.067853+0000","last_undegraded":"2023-08-11T12:22:09.067853+0000","last_fullsized":"2023-08-11T12:22:09.067853+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:03:47.111702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"87'3","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:28.723792+0000","last_change":"2023-08-11T12:22:02.836591+0000","last_active":"2023-08-11T12:22:28.723792+0000","last_peered":"2023-08-11T12:22:28.723792+0000","last_clean":"2023-08-11T12:22:28.723792+0000","last_became_active":"2023-08-11T12:22:02.836223+0000","last_became_peered":"2023-08-11T12:22:02.836223+0000","last_unstale":"2023-08-11T12:22:28.723792+0000","last_undegraded":"2023-08-11T12:22:28.723792+0000","last_fullsized":"2023-08-11T12:22:28.723792+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:04:18.216860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.970378+0000","last_change":"2023-08-11T12:22:03.841719+0000","last_active":"2023-08-11T12:22:08.970378+0000","last_peered":"2023-08-11T12:22:08.970378+0000","last_clean":"2023-08-11T12:22:08.970378+0000","last_became_active":"2023-08-11T12:22:03.841381+0000","last_became_peered":"2023-08-11T12:22:03.841381+0000","last_unstale":"2023-08-11T12:22:08.970378+0000","last_undegraded":"2023-08-11T12:22:08.970378+0000","last_fullsized":"2023-08-11T12:22:08.970378+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:23:34.743266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721200+0000","last_change":"2023-08-11T12:22:07.889103+0000","last_active":"2023-08-11T12:22:31.721200+0000","last_peered":"2023-08-11T12:22:31.721200+0000","last_clean":"2023-08-11T12:22:31.721200+0000","last_became_active":"2023-08-11T12:22:07.888668+0000","last_became_peered":"2023-08-11T12:22:07.888668+0000","last_unstale":"2023-08-11T12:22:31.721200+0000","last_undegraded":"2023-08-11T12:22:31.721200+0000","last_fullsized":"2023-08-11T12:22:31.721200+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:55:40.004921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"87'2","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:28.721917+0000","last_change":"2023-08-11T12:22:02.841934+0000","last_active":"2023-08-11T12:22:28.721917+0000","last_peered":"2023-08-11T12:22:28.721917+0000","last_clean":"2023-08-11T12:22:28.721917+0000","last_became_active":"2023-08-11T12:22:02.841598+0000","last_became_peered":"2023-08-11T12:22:02.841598+0000","last_unstale":"2023-08-11T12:22:28.721917+0000","last_undegraded":"2023-08-11T12:22:28.721917+0000","last_fullsized":"2023-08-11T12:22:28.721917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:41:39.918666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716456+0000","last_change":"2023-08-11T12:22:03.848901+0000","last_active":"2023-08-11T12:22:30.716456+0000","last_peered":"2023-08-11T12:22:30.716456+0000","last_clean":"2023-08-11T12:22:30.716456+0000","last_became_active":"2023-08-11T12:22:03.848518+0000","last_became_peered":"2023-08-11T12:22:03.848518+0000","last_unstale":"2023-08-11T12:22:30.716456+0000","last_undegraded":"2023-08-11T12:22:30.716456+0000","last_fullsized":"2023-08-11T12:22:30.716456+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:28:39.018373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067078+0000","last_change":"2023-08-11T12:22:07.873734+0000","last_active":"2023-08-11T12:22:09.067078+0000","last_peered":"2023-08-11T12:22:09.067078+0000","last_clean":"2023-08-11T12:22:09.067078+0000","last_became_active":"2023-08-11T12:22:07.872986+0000","last_became_peered":"2023-08-11T12:22:07.872986+0000","last_unstale":"2023-08-11T12:22:09.067078+0000","last_undegraded":"2023-08-11T12:22:09.067078+0000","last_fullsized":"2023-08-11T12:22:09.067078+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:22:35.576079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"82'3","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068027+0000","last_change":"2023-08-11T12:22:02.846492+0000","last_active":"2023-08-11T12:22:09.068027+0000","last_peered":"2023-08-11T12:22:09.068027+0000","last_clean":"2023-08-11T12:22:09.068027+0000","last_became_active":"2023-08-11T12:22:02.846174+0000","last_became_peered":"2023-08-11T12:22:02.846174+0000","last_unstale":"2023-08-11T12:22:09.068027+0000","last_undegraded":"2023-08-11T12:22:09.068027+0000","last_fullsized":"2023-08-11T12:22:09.068027+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:20:48.965543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.970441+0000","last_change":"2023-08-11T12:22:03.840054+0000","last_active":"2023-08-11T12:22:08.970441+0000","last_peered":"2023-08-11T12:22:08.970441+0000","last_clean":"2023-08-11T12:22:08.970441+0000","last_became_active":"2023-08-11T12:22:03.839707+0000","last_became_peered":"2023-08-11T12:22:03.839707+0000","last_unstale":"2023-08-11T12:22:08.970441+0000","last_undegraded":"2023-08-11T12:22:08.970441+0000","last_fullsized":"2023-08-11T12:22:08.970441+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:57:01.883842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066884+0000","last_change":"2023-08-11T12:22:07.886900+0000","last_active":"2023-08-11T12:22:09.066884+0000","last_peered":"2023-08-11T12:22:09.066884+0000","last_clean":"2023-08-11T12:22:09.066884+0000","last_became_active":"2023-08-11T12:22:07.886228+0000","last_became_peered":"2023-08-11T12:22:07.886228+0000","last_unstale":"2023-08-11T12:22:09.066884+0000","last_undegraded":"2023-08-11T12:22:09.066884+0000","last_fullsized":"2023-08-11T12:22:09.066884+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:23:53.736228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"87'12","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:29.677313+0000","last_change":"2023-08-11T12:22:02.836520+0000","last_active":"2023-08-11T12:22:29.677313+0000","last_peered":"2023-08-11T12:22:29.677313+0000","last_clean":"2023-08-11T12:22:29.677313+0000","last_became_active":"2023-08-11T12:22:02.836201+0000","last_became_peered":"2023-08-11T12:22:02.836201+0000","last_unstale":"2023-08-11T12:22:29.677313+0000","last_undegraded":"2023-08-11T12:22:29.677313+0000","last_fullsized":"2023-08-11T12:22:29.677313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:41:20.418514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":6,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879606+0000","last_change":"2023-08-11T12:22:03.848104+0000","last_active":"2023-08-11T12:22:08.879606+0000","last_peered":"2023-08-11T12:22:08.879606+0000","last_clean":"2023-08-11T12:22:08.879606+0000","last_became_active":"2023-08-11T12:22:03.847801+0000","last_became_peered":"2023-08-11T12:22:03.847801+0000","last_unstale":"2023-08-11T12:22:08.879606+0000","last_undegraded":"2023-08-11T12:22:08.879606+0000","last_fullsized":"2023-08-11T12:22:08.879606+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:11:30.238632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068429+0000","last_change":"2023-08-11T12:22:07.893710+0000","last_active":"2023-08-11T12:22:09.068429+0000","last_peered":"2023-08-11T12:22:09.068429+0000","last_clean":"2023-08-11T12:22:09.068429+0000","last_became_active":"2023-08-11T12:22:07.893239+0000","last_became_peered":"2023-08-11T12:22:07.893239+0000","last_unstale":"2023-08-11T12:22:09.068429+0000","last_undegraded":"2023-08-11T12:22:09.068429+0000","last_fullsized":"2023-08-11T12:22:09.068429+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:42:45.168233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"87'4","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:28.722975+0000","last_change":"2023-08-11T12:22:02.849060+0000","last_active":"2023-08-11T12:22:28.722975+0000","last_peered":"2023-08-11T12:22:28.722975+0000","last_clean":"2023-08-11T12:22:28.722975+0000","last_became_active":"2023-08-11T12:22:02.848417+0000","last_became_peered":"2023-08-11T12:22:02.848417+0000","last_unstale":"2023-08-11T12:22:28.722975+0000","last_undegraded":"2023-08-11T12:22:28.722975+0000","last_fullsized":"2023-08-11T12:22:28.722975+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:09:38.023995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.878997+0000","last_change":"2023-08-11T12:22:03.848532+0000","last_active":"2023-08-11T12:22:08.878997+0000","last_peered":"2023-08-11T12:22:08.878997+0000","last_clean":"2023-08-11T12:22:08.878997+0000","last_became_active":"2023-08-11T12:22:03.848190+0000","last_became_peered":"2023-08-11T12:22:03.848190+0000","last_unstale":"2023-08-11T12:22:08.878997+0000","last_undegraded":"2023-08-11T12:22:08.878997+0000","last_fullsized":"2023-08-11T12:22:08.878997+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:24:10.506810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.723601+0000","last_change":"2023-08-11T12:22:07.882785+0000","last_active":"2023-08-11T12:22:30.723601+0000","last_peered":"2023-08-11T12:22:30.723601+0000","last_clean":"2023-08-11T12:22:30.723601+0000","last_became_active":"2023-08-11T12:22:07.880643+0000","last_became_peered":"2023-08-11T12:22:07.880643+0000","last_unstale":"2023-08-11T12:22:30.723601+0000","last_undegraded":"2023-08-11T12:22:30.723601+0000","last_fullsized":"2023-08-11T12:22:30.723601+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:13:01.597210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066777+0000","last_change":"2023-08-11T12:22:02.851416+0000","last_active":"2023-08-11T12:22:09.066777+0000","last_peered":"2023-08-11T12:22:09.066777+0000","last_clean":"2023-08-11T12:22:09.066777+0000","last_became_active":"2023-08-11T12:22:02.851114+0000","last_became_peered":"2023-08-11T12:22:02.851114+0000","last_unstale":"2023-08-11T12:22:09.066777+0000","last_undegraded":"2023-08-11T12:22:09.066777+0000","last_fullsized":"2023-08-11T12:22:09.066777+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:21:21.904496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880295+0000","last_change":"2023-08-11T12:22:03.849367+0000","last_active":"2023-08-11T12:22:08.880295+0000","last_peered":"2023-08-11T12:22:08.880295+0000","last_clean":"2023-08-11T12:22:08.880295+0000","last_became_active":"2023-08-11T12:22:03.849050+0000","last_became_peered":"2023-08-11T12:22:03.849050+0000","last_unstale":"2023-08-11T12:22:08.880295+0000","last_undegraded":"2023-08-11T12:22:08.880295+0000","last_fullsized":"2023-08-11T12:22:08.880295+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:01:37.018850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722616+0000","last_change":"2023-08-11T12:22:07.890992+0000","last_active":"2023-08-11T12:22:31.722616+0000","last_peered":"2023-08-11T12:22:31.722616+0000","last_clean":"2023-08-11T12:22:31.722616+0000","last_became_active":"2023-08-11T12:22:07.890384+0000","last_became_peered":"2023-08-11T12:22:07.890384+0000","last_unstale":"2023-08-11T12:22:31.722616+0000","last_undegraded":"2023-08-11T12:22:31.722616+0000","last_fullsized":"2023-08-11T12:22:31.722616+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:00:55.230221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066311+0000","last_change":"2023-08-11T12:22:02.843045+0000","last_active":"2023-08-11T12:22:09.066311+0000","last_peered":"2023-08-11T12:22:09.066311+0000","last_clean":"2023-08-11T12:22:09.066311+0000","last_became_active":"2023-08-11T12:22:02.842628+0000","last_became_peered":"2023-08-11T12:22:02.842628+0000","last_unstale":"2023-08-11T12:22:09.066311+0000","last_undegraded":"2023-08-11T12:22:09.066311+0000","last_fullsized":"2023-08-11T12:22:09.066311+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:24:30.251252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879762+0000","last_change":"2023-08-11T12:22:03.842526+0000","last_active":"2023-08-11T12:22:08.879762+0000","last_peered":"2023-08-11T12:22:08.879762+0000","last_clean":"2023-08-11T12:22:08.879762+0000","last_became_active":"2023-08-11T12:22:03.842183+0000","last_became_peered":"2023-08-11T12:22:03.842183+0000","last_unstale":"2023-08-11T12:22:08.879762+0000","last_undegraded":"2023-08-11T12:22:08.879762+0000","last_fullsized":"2023-08-11T12:22:08.879762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:15:28.619474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879644+0000","last_change":"2023-08-11T12:22:07.880768+0000","last_active":"2023-08-11T12:22:08.879644+0000","last_peered":"2023-08-11T12:22:08.879644+0000","last_clean":"2023-08-11T12:22:08.879644+0000","last_became_active":"2023-08-11T12:22:07.880335+0000","last_became_peered":"2023-08-11T12:22:07.880335+0000","last_unstale":"2023-08-11T12:22:08.879644+0000","last_undegraded":"2023-08-11T12:22:08.879644+0000","last_fullsized":"2023-08-11T12:22:08.879644+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:49:07.059346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"87'15","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:29.686619+0000","last_change":"2023-08-11T12:22:02.847271+0000","last_active":"2023-08-11T12:22:29.686619+0000","last_peered":"2023-08-11T12:22:29.686619+0000","last_clean":"2023-08-11T12:22:29.686619+0000","last_became_active":"2023-08-11T12:22:02.846974+0000","last_became_peered":"2023-08-11T12:22:02.846974+0000","last_unstale":"2023-08-11T12:22:29.686619+0000","last_undegraded":"2023-08-11T12:22:29.686619+0000","last_fullsized":"2023-08-11T12:22:29.686619+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:04:16.995048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068022+0000","last_change":"2023-08-11T12:22:03.838944+0000","last_active":"2023-08-11T12:22:09.068022+0000","last_peered":"2023-08-11T12:22:09.068022+0000","last_clean":"2023-08-11T12:22:09.068022+0000","last_became_active":"2023-08-11T12:22:03.838610+0000","last_became_peered":"2023-08-11T12:22:03.838610+0000","last_unstale":"2023-08-11T12:22:09.068022+0000","last_undegraded":"2023-08-11T12:22:09.068022+0000","last_fullsized":"2023-08-11T12:22:09.068022+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:40:51.718679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067929+0000","last_change":"2023-08-11T12:22:07.888812+0000","last_active":"2023-08-11T12:22:09.067929+0000","last_peered":"2023-08-11T12:22:09.067929+0000","last_clean":"2023-08-11T12:22:09.067929+0000","last_became_active":"2023-08-11T12:22:07.888423+0000","last_became_peered":"2023-08-11T12:22:07.888423+0000","last_unstale":"2023-08-11T12:22:09.067929+0000","last_undegraded":"2023-08-11T12:22:09.067929+0000","last_fullsized":"2023-08-11T12:22:09.067929+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:12:17.299557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'1","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879855+0000","last_change":"2023-08-11T12:22:02.842591+0000","last_active":"2023-08-11T12:22:08.879855+0000","last_peered":"2023-08-11T12:22:08.879855+0000","last_clean":"2023-08-11T12:22:08.879855+0000","last_became_active":"2023-08-11T12:22:02.842249+0000","last_became_peered":"2023-08-11T12:22:02.842249+0000","last_unstale":"2023-08-11T12:22:08.879855+0000","last_undegraded":"2023-08-11T12:22:08.879855+0000","last_fullsized":"2023-08-11T12:22:08.879855+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:53:56.628695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"peering","last_fresh":"2023-08-11T12:22:09.067384+0000","last_change":"2023-08-11T12:22:30.723122+0000","last_active":"2023-08-11T12:22:30.723122+0000","last_peered":"2023-08-11T12:22:09.067384+0000","last_clean":"2023-08-11T12:22:09.067384+0000","last_became_active":"2023-08-11T12:22:03.840210+0000","last_became_peered":"2023-08-11T12:22:03.840210+0000","last_unstale":"2023-08-11T12:22:09.067384+0000","last_undegraded":"2023-08-11T12:22:09.067384+0000","last_fullsized":"2023-08-11T12:22:09.067384+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,5,9],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879511+0000","last_change":"2023-08-11T12:22:08.068485+0000","last_active":"2023-08-11T12:22:08.879511+0000","last_peered":"2023-08-11T12:22:08.879511+0000","last_clean":"2023-08-11T12:22:08.879511+0000","last_became_active":"2023-08-11T12:22:08.068071+0000","last_became_peered":"2023-08-11T12:22:08.068071+0000","last_unstale":"2023-08-11T12:22:08.879511+0000","last_undegraded":"2023-08-11T12:22:08.879511+0000","last_fullsized":"2023-08-11T12:22:08.879511+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:06:34.158790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"87'1","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.727900+0000","last_change":"2023-08-11T12:22:31.727900+0000","last_active":"2023-08-11T12:22:31.727900+0000","last_peered":"2023-08-11T12:22:31.727900+0000","last_clean":"2023-08-11T12:22:31.727900+0000","last_became_active":"2023-08-11T12:22:31.727346+0000","last_became_peered":"2023-08-11T12:22:31.727346+0000","last_unstale":"2023-08-11T12:22:31.727900+0000","last_undegraded":"2023-08-11T12:22:31.727900+0000","last_fullsized":"2023-08-11T12:22:31.727900+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:12:21.170378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067467+0000","last_change":"2023-08-11T12:22:03.843434+0000","last_active":"2023-08-11T12:22:09.067467+0000","last_peered":"2023-08-11T12:22:09.067467+0000","last_clean":"2023-08-11T12:22:09.067467+0000","last_became_active":"2023-08-11T12:22:03.843117+0000","last_became_peered":"2023-08-11T12:22:03.843117+0000","last_unstale":"2023-08-11T12:22:09.067467+0000","last_undegraded":"2023-08-11T12:22:09.067467+0000","last_fullsized":"2023-08-11T12:22:09.067467+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:24:56.881802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879498+0000","last_change":"2023-08-11T12:22:07.889740+0000","last_active":"2023-08-11T12:22:08.879498+0000","last_peered":"2023-08-11T12:22:08.879498+0000","last_clean":"2023-08-11T12:22:08.879498+0000","last_became_active":"2023-08-11T12:22:07.889272+0000","last_became_peered":"2023-08-11T12:22:07.889272+0000","last_unstale":"2023-08-11T12:22:08.879498+0000","last_undegraded":"2023-08-11T12:22:08.879498+0000","last_fullsized":"2023-08-11T12:22:08.879498+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:40:15.712138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"87'1","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879829+0000","last_change":"2023-08-11T12:22:02.846661+0000","last_active":"2023-08-11T12:22:08.879829+0000","last_peered":"2023-08-11T12:22:08.879829+0000","last_clean":"2023-08-11T12:22:08.879829+0000","last_became_active":"2023-08-11T12:22:02.846269+0000","last_became_peered":"2023-08-11T12:22:02.846269+0000","last_unstale":"2023-08-11T12:22:08.879829+0000","last_undegraded":"2023-08-11T12:22:08.879829+0000","last_fullsized":"2023-08-11T12:22:08.879829+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:47:43.138580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066619+0000","last_change":"2023-08-11T12:22:03.849653+0000","last_active":"2023-08-11T12:22:09.066619+0000","last_peered":"2023-08-11T12:22:09.066619+0000","last_clean":"2023-08-11T12:22:09.066619+0000","last_became_active":"2023-08-11T12:22:03.849303+0000","last_became_peered":"2023-08-11T12:22:03.849303+0000","last_unstale":"2023-08-11T12:22:09.066619+0000","last_undegraded":"2023-08-11T12:22:09.066619+0000","last_fullsized":"2023-08-11T12:22:09.066619+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:35:28.772541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879497+0000","last_change":"2023-08-11T12:22:08.068395+0000","last_active":"2023-08-11T12:22:08.879497+0000","last_peered":"2023-08-11T12:22:08.879497+0000","last_clean":"2023-08-11T12:22:08.879497+0000","last_became_active":"2023-08-11T12:22:08.067572+0000","last_became_peered":"2023-08-11T12:22:08.067572+0000","last_unstale":"2023-08-11T12:22:08.879497+0000","last_undegraded":"2023-08-11T12:22:08.879497+0000","last_fullsized":"2023-08-11T12:22:08.879497+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:18:19.641203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066941+0000","last_change":"2023-08-11T12:22:03.828971+0000","last_active":"2023-08-11T12:22:09.066941+0000","last_peered":"2023-08-11T12:22:09.066941+0000","last_clean":"2023-08-11T12:22:09.066941+0000","last_became_active":"2023-08-11T12:22:03.828653+0000","last_became_peered":"2023-08-11T12:22:03.828653+0000","last_unstale":"2023-08-11T12:22:09.066941+0000","last_undegraded":"2023-08-11T12:22:09.066941+0000","last_fullsized":"2023-08-11T12:22:09.066941+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:43:30.226114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'1","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.878818+0000","last_change":"2023-08-11T12:22:02.842419+0000","last_active":"2023-08-11T12:22:08.878818+0000","last_peered":"2023-08-11T12:22:08.878818+0000","last_clean":"2023-08-11T12:22:08.878818+0000","last_became_active":"2023-08-11T12:22:02.842105+0000","last_became_peered":"2023-08-11T12:22:02.842105+0000","last_unstale":"2023-08-11T12:22:08.878818+0000","last_undegraded":"2023-08-11T12:22:08.878818+0000","last_fullsized":"2023-08-11T12:22:08.878818+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:51:55.024962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880231+0000","last_change":"2023-08-11T12:22:07.880762+0000","last_active":"2023-08-11T12:22:08.880231+0000","last_peered":"2023-08-11T12:22:08.880231+0000","last_clean":"2023-08-11T12:22:08.880231+0000","last_became_active":"2023-08-11T12:22:07.880373+0000","last_became_peered":"2023-08-11T12:22:07.880373+0000","last_unstale":"2023-08-11T12:22:08.880231+0000","last_undegraded":"2023-08-11T12:22:08.880231+0000","last_fullsized":"2023-08-11T12:22:08.880231+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:07:55.656555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067945+0000","last_change":"2023-08-11T12:22:03.838555+0000","last_active":"2023-08-11T12:22:09.067945+0000","last_peered":"2023-08-11T12:22:09.067945+0000","last_clean":"2023-08-11T12:22:09.067945+0000","last_became_active":"2023-08-11T12:22:03.838135+0000","last_became_peered":"2023-08-11T12:22:03.838135+0000","last_unstale":"2023-08-11T12:22:09.067945+0000","last_undegraded":"2023-08-11T12:22:09.067945+0000","last_fullsized":"2023-08-11T12:22:09.067945+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:23:56.118058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066639+0000","last_change":"2023-08-11T12:22:02.835093+0000","last_active":"2023-08-11T12:22:09.066639+0000","last_peered":"2023-08-11T12:22:09.066639+0000","last_clean":"2023-08-11T12:22:09.066639+0000","last_became_active":"2023-08-11T12:22:02.834545+0000","last_became_peered":"2023-08-11T12:22:02.834545+0000","last_unstale":"2023-08-11T12:22:09.066639+0000","last_undegraded":"2023-08-11T12:22:09.066639+0000","last_fullsized":"2023-08-11T12:22:09.066639+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:59:41.870923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":350,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879552+0000","last_change":"2023-08-11T12:20:57.484190+0000","last_active":"2023-08-11T12:22:08.879552+0000","last_peered":"2023-08-11T12:22:08.879552+0000","last_clean":"2023-08-11T12:22:08.879552+0000","last_became_active":"2023-08-11T12:20:57.483655+0000","last_became_peered":"2023-08-11T12:20:57.483655+0000","last_unstale":"2023-08-11T12:22:08.879552+0000","last_undegraded":"2023-08-11T12:22:08.879552+0000","last_fullsized":"2023-08-11T12:22:08.879552+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:17:49.245488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:17:49.245488+0000","last_clean_scrub_stamp":"2023-08-11T12:17:49.245488+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:16:09.009846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068210+0000","last_change":"2023-08-11T12:22:08.068762+0000","last_active":"2023-08-11T12:22:09.068210+0000","last_peered":"2023-08-11T12:22:09.068210+0000","last_clean":"2023-08-11T12:22:09.068210+0000","last_became_active":"2023-08-11T12:22:08.068205+0000","last_became_peered":"2023-08-11T12:22:08.068205+0000","last_unstale":"2023-08-11T12:22:09.068210+0000","last_undegraded":"2023-08-11T12:22:09.068210+0000","last_fullsized":"2023-08-11T12:22:09.068210+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:58:49.800844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.878740+0000","last_change":"2023-08-11T12:22:03.837843+0000","last_active":"2023-08-11T12:22:08.878740+0000","last_peered":"2023-08-11T12:22:08.878740+0000","last_clean":"2023-08-11T12:22:08.878740+0000","last_became_active":"2023-08-11T12:22:03.837537+0000","last_became_peered":"2023-08-11T12:22:03.837537+0000","last_unstale":"2023-08-11T12:22:08.878740+0000","last_undegraded":"2023-08-11T12:22:08.878740+0000","last_fullsized":"2023-08-11T12:22:08.878740+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:22:17.517258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'3","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:29.683836+0000","last_change":"2023-08-11T12:22:02.843150+0000","last_active":"2023-08-11T12:22:29.683836+0000","last_peered":"2023-08-11T12:22:29.683836+0000","last_clean":"2023-08-11T12:22:29.683836+0000","last_became_active":"2023-08-11T12:22:02.842829+0000","last_became_peered":"2023-08-11T12:22:02.842829+0000","last_unstale":"2023-08-11T12:22:29.683836+0000","last_undegraded":"2023-08-11T12:22:29.683836+0000","last_fullsized":"2023-08-11T12:22:29.683836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:02:01.110571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.722844+0000","last_change":"2023-08-11T12:22:07.883050+0000","last_active":"2023-08-11T12:22:30.722844+0000","last_peered":"2023-08-11T12:22:30.722844+0000","last_clean":"2023-08-11T12:22:30.722844+0000","last_became_active":"2023-08-11T12:22:07.882423+0000","last_became_peered":"2023-08-11T12:22:07.882423+0000","last_unstale":"2023-08-11T12:22:30.722844+0000","last_undegraded":"2023-08-11T12:22:30.722844+0000","last_fullsized":"2023-08-11T12:22:30.722844+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:56:11.400367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"87'1","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:28.723841+0000","last_change":"2023-08-11T12:22:02.850632+0000","last_active":"2023-08-11T12:22:28.723841+0000","last_peered":"2023-08-11T12:22:28.723841+0000","last_clean":"2023-08-11T12:22:28.723841+0000","last_became_active":"2023-08-11T12:22:02.850312+0000","last_became_peered":"2023-08-11T12:22:02.850312+0000","last_unstale":"2023-08-11T12:22:28.723841+0000","last_undegraded":"2023-08-11T12:22:28.723841+0000","last_fullsized":"2023-08-11T12:22:28.723841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:17:36.156598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879376+0000","last_change":"2023-08-11T12:22:03.839869+0000","last_active":"2023-08-11T12:22:08.879376+0000","last_peered":"2023-08-11T12:22:08.879376+0000","last_clean":"2023-08-11T12:22:08.879376+0000","last_became_active":"2023-08-11T12:22:03.839486+0000","last_became_peered":"2023-08-11T12:22:03.839486+0000","last_unstale":"2023-08-11T12:22:08.879376+0000","last_undegraded":"2023-08-11T12:22:08.879376+0000","last_fullsized":"2023-08-11T12:22:08.879376+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:49:22.752990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067561+0000","last_change":"2023-08-11T12:22:08.066877+0000","last_active":"2023-08-11T12:22:09.067561+0000","last_peered":"2023-08-11T12:22:09.067561+0000","last_clean":"2023-08-11T12:22:09.067561+0000","last_became_active":"2023-08-11T12:22:08.066418+0000","last_became_peered":"2023-08-11T12:22:08.066418+0000","last_unstale":"2023-08-11T12:22:09.067561+0000","last_undegraded":"2023-08-11T12:22:09.067561+0000","last_fullsized":"2023-08-11T12:22:09.067561+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:57:08.687973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'7","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722268+0000","last_change":"2023-08-11T12:22:02.850505+0000","last_active":"2023-08-11T12:22:31.722268+0000","last_peered":"2023-08-11T12:22:31.722268+0000","last_clean":"2023-08-11T12:22:31.722268+0000","last_became_active":"2023-08-11T12:22:02.850104+0000","last_became_peered":"2023-08-11T12:22:02.850104+0000","last_unstale":"2023-08-11T12:22:31.722268+0000","last_undegraded":"2023-08-11T12:22:31.722268+0000","last_fullsized":"2023-08-11T12:22:31.722268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:33:50.319404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068068+0000","last_change":"2023-08-11T12:22:03.837580+0000","last_active":"2023-08-11T12:22:09.068068+0000","last_peered":"2023-08-11T12:22:09.068068+0000","last_clean":"2023-08-11T12:22:09.068068+0000","last_became_active":"2023-08-11T12:22:03.837256+0000","last_became_peered":"2023-08-11T12:22:03.837256+0000","last_unstale":"2023-08-11T12:22:09.068068+0000","last_undegraded":"2023-08-11T12:22:09.068068+0000","last_fullsized":"2023-08-11T12:22:09.068068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:13:43.832719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066507+0000","last_change":"2023-08-11T12:22:07.873613+0000","last_active":"2023-08-11T12:22:09.066507+0000","last_peered":"2023-08-11T12:22:09.066507+0000","last_clean":"2023-08-11T12:22:09.066507+0000","last_became_active":"2023-08-11T12:22:07.873149+0000","last_became_peered":"2023-08-11T12:22:07.873149+0000","last_unstale":"2023-08-11T12:22:09.066507+0000","last_undegraded":"2023-08-11T12:22:09.066507+0000","last_fullsized":"2023-08-11T12:22:09.066507+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:18:27.597239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"82'2","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066917+0000","last_change":"2023-08-11T12:22:02.843146+0000","last_active":"2023-08-11T12:22:09.066917+0000","last_peered":"2023-08-11T12:22:09.066917+0000","last_clean":"2023-08-11T12:22:09.066917+0000","last_became_active":"2023-08-11T12:22:02.842663+0000","last_became_peered":"2023-08-11T12:22:02.842663+0000","last_unstale":"2023-08-11T12:22:09.066917+0000","last_undegraded":"2023-08-11T12:22:09.066917+0000","last_fullsized":"2023-08-11T12:22:09.066917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:07:46.505063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716061+0000","last_change":"2023-08-11T12:22:03.847351+0000","last_active":"2023-08-11T12:22:30.716061+0000","last_peered":"2023-08-11T12:22:30.716061+0000","last_clean":"2023-08-11T12:22:30.716061+0000","last_became_active":"2023-08-11T12:22:03.847044+0000","last_became_peered":"2023-08-11T12:22:03.847044+0000","last_unstale":"2023-08-11T12:22:30.716061+0000","last_undegraded":"2023-08-11T12:22:30.716061+0000","last_fullsized":"2023-08-11T12:22:30.716061+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:03:33.785374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066461+0000","last_change":"2023-08-11T12:22:08.068459+0000","last_active":"2023-08-11T12:22:09.066461+0000","last_peered":"2023-08-11T12:22:09.066461+0000","last_clean":"2023-08-11T12:22:09.066461+0000","last_became_active":"2023-08-11T12:22:08.067857+0000","last_became_peered":"2023-08-11T12:22:08.067857+0000","last_unstale":"2023-08-11T12:22:09.066461+0000","last_undegraded":"2023-08-11T12:22:09.066461+0000","last_fullsized":"2023-08-11T12:22:09.066461+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:04:45.455163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.969839+0000","last_change":"2023-08-11T12:22:02.846441+0000","last_active":"2023-08-11T12:22:08.969839+0000","last_peered":"2023-08-11T12:22:08.969839+0000","last_clean":"2023-08-11T12:22:08.969839+0000","last_became_active":"2023-08-11T12:22:02.846153+0000","last_became_peered":"2023-08-11T12:22:02.846153+0000","last_unstale":"2023-08-11T12:22:08.969839+0000","last_undegraded":"2023-08-11T12:22:08.969839+0000","last_fullsized":"2023-08-11T12:22:08.969839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:16:33.873694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879314+0000","last_change":"2023-08-11T12:22:03.841932+0000","last_active":"2023-08-11T12:22:08.879314+0000","last_peered":"2023-08-11T12:22:08.879314+0000","last_clean":"2023-08-11T12:22:08.879314+0000","last_became_active":"2023-08-11T12:22:03.841635+0000","last_became_peered":"2023-08-11T12:22:03.841635+0000","last_unstale":"2023-08-11T12:22:08.879314+0000","last_undegraded":"2023-08-11T12:22:08.879314+0000","last_fullsized":"2023-08-11T12:22:08.879314+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:29:41.880454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722748+0000","last_change":"2023-08-11T12:22:07.886160+0000","last_active":"2023-08-11T12:22:31.722748+0000","last_peered":"2023-08-11T12:22:31.722748+0000","last_clean":"2023-08-11T12:22:31.722748+0000","last_became_active":"2023-08-11T12:22:07.885703+0000","last_became_peered":"2023-08-11T12:22:07.885703+0000","last_unstale":"2023-08-11T12:22:31.722748+0000","last_undegraded":"2023-08-11T12:22:31.722748+0000","last_fullsized":"2023-08-11T12:22:31.722748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:50:20.362829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"87'3","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:28.723203+0000","last_change":"2023-08-11T12:22:02.849360+0000","last_active":"2023-08-11T12:22:28.723203+0000","last_peered":"2023-08-11T12:22:28.723203+0000","last_clean":"2023-08-11T12:22:28.723203+0000","last_became_active":"2023-08-11T12:22:02.849028+0000","last_became_peered":"2023-08-11T12:22:02.849028+0000","last_unstale":"2023-08-11T12:22:28.723203+0000","last_undegraded":"2023-08-11T12:22:28.723203+0000","last_fullsized":"2023-08-11T12:22:28.723203+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:07:06.158016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.722533+0000","last_change":"2023-08-11T12:22:03.850285+0000","last_active":"2023-08-11T12:22:30.722533+0000","last_peered":"2023-08-11T12:22:30.722533+0000","last_clean":"2023-08-11T12:22:30.722533+0000","last_became_active":"2023-08-11T12:22:03.849978+0000","last_became_peered":"2023-08-11T12:22:03.849978+0000","last_unstale":"2023-08-11T12:22:30.722533+0000","last_undegraded":"2023-08-11T12:22:30.722533+0000","last_fullsized":"2023-08-11T12:22:30.722533+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:46:04.770888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066835+0000","last_change":"2023-08-11T12:22:07.881578+0000","last_active":"2023-08-11T12:22:09.066835+0000","last_peered":"2023-08-11T12:22:09.066835+0000","last_clean":"2023-08-11T12:22:09.066835+0000","last_became_active":"2023-08-11T12:22:07.881145+0000","last_became_peered":"2023-08-11T12:22:07.881145+0000","last_unstale":"2023-08-11T12:22:09.066835+0000","last_undegraded":"2023-08-11T12:22:09.066835+0000","last_fullsized":"2023-08-11T12:22:09.066835+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:07:17.931014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066542+0000","last_change":"2023-08-11T12:22:02.848875+0000","last_active":"2023-08-11T12:22:09.066542+0000","last_peered":"2023-08-11T12:22:09.066542+0000","last_clean":"2023-08-11T12:22:09.066542+0000","last_became_active":"2023-08-11T12:22:02.848578+0000","last_became_peered":"2023-08-11T12:22:02.848578+0000","last_unstale":"2023-08-11T12:22:09.066542+0000","last_undegraded":"2023-08-11T12:22:09.066542+0000","last_fullsized":"2023-08-11T12:22:09.066542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:57:52.903483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068323+0000","last_change":"2023-08-11T12:22:03.849865+0000","last_active":"2023-08-11T12:22:09.068323+0000","last_peered":"2023-08-11T12:22:09.068323+0000","last_clean":"2023-08-11T12:22:09.068323+0000","last_became_active":"2023-08-11T12:22:03.849557+0000","last_became_peered":"2023-08-11T12:22:03.849557+0000","last_unstale":"2023-08-11T12:22:09.068323+0000","last_undegraded":"2023-08-11T12:22:09.068323+0000","last_fullsized":"2023-08-11T12:22:09.068323+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:17:08.368108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066684+0000","last_change":"2023-08-11T12:22:08.067009+0000","last_active":"2023-08-11T12:22:09.066684+0000","last_peered":"2023-08-11T12:22:09.066684+0000","last_clean":"2023-08-11T12:22:09.066684+0000","last_became_active":"2023-08-11T12:22:08.066477+0000","last_became_peered":"2023-08-11T12:22:08.066477+0000","last_unstale":"2023-08-11T12:22:09.066684+0000","last_undegraded":"2023-08-11T12:22:09.066684+0000","last_fullsized":"2023-08-11T12:22:09.066684+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:05:08.273531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":2,"reported_epoch":88,"state":"peering","last_fresh":"2023-08-11T12:22:08.879523+0000","last_change":"2023-08-11T12:22:30.923867+0000","last_active":"2023-08-11T12:22:30.923867+0000","last_peered":"2023-08-11T12:22:08.879523+0000","last_clean":"2023-08-11T12:22:08.879523+0000","last_became_active":"2023-08-11T12:22:02.847394+0000","last_became_peered":"2023-08-11T12:22:02.847394+0000","last_unstale":"2023-08-11T12:22:08.879523+0000","last_undegraded":"2023-08-11T12:22:08.879523+0000","last_fullsized":"2023-08-11T12:22:08.879523+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880009+0000","last_change":"2023-08-11T12:22:03.848715+0000","last_active":"2023-08-11T12:22:08.880009+0000","last_peered":"2023-08-11T12:22:08.880009+0000","last_clean":"2023-08-11T12:22:08.880009+0000","last_became_active":"2023-08-11T12:22:03.848311+0000","last_became_peered":"2023-08-11T12:22:03.848311+0000","last_unstale":"2023-08-11T12:22:08.880009+0000","last_undegraded":"2023-08-11T12:22:08.880009+0000","last_fullsized":"2023-08-11T12:22:08.880009+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:58:34.865429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.969957+0000","last_change":"2023-08-11T12:22:07.882566+0000","last_active":"2023-08-11T12:22:08.969957+0000","last_peered":"2023-08-11T12:22:08.969957+0000","last_clean":"2023-08-11T12:22:08.969957+0000","last_became_active":"2023-08-11T12:22:07.882198+0000","last_became_peered":"2023-08-11T12:22:07.882198+0000","last_unstale":"2023-08-11T12:22:08.969957+0000","last_undegraded":"2023-08-11T12:22:08.969957+0000","last_fullsized":"2023-08-11T12:22:08.969957+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:59:38.231276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066849+0000","last_change":"2023-08-11T12:22:02.846424+0000","last_active":"2023-08-11T12:22:09.066849+0000","last_peered":"2023-08-11T12:22:09.066849+0000","last_clean":"2023-08-11T12:22:09.066849+0000","last_became_active":"2023-08-11T12:22:02.846063+0000","last_became_peered":"2023-08-11T12:22:02.846063+0000","last_unstale":"2023-08-11T12:22:09.066849+0000","last_undegraded":"2023-08-11T12:22:09.066849+0000","last_fullsized":"2023-08-11T12:22:09.066849+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:09:23.947071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880442+0000","last_change":"2023-08-11T12:22:03.845616+0000","last_active":"2023-08-11T12:22:08.880442+0000","last_peered":"2023-08-11T12:22:08.880442+0000","last_clean":"2023-08-11T12:22:08.880442+0000","last_became_active":"2023-08-11T12:22:03.845293+0000","last_became_peered":"2023-08-11T12:22:03.845293+0000","last_unstale":"2023-08-11T12:22:08.880442+0000","last_undegraded":"2023-08-11T12:22:08.880442+0000","last_fullsized":"2023-08-11T12:22:08.880442+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:43:24.438207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716312+0000","last_change":"2023-08-11T12:22:07.888963+0000","last_active":"2023-08-11T12:22:30.716312+0000","last_peered":"2023-08-11T12:22:30.716312+0000","last_clean":"2023-08-11T12:22:30.716312+0000","last_became_active":"2023-08-11T12:22:07.888513+0000","last_became_peered":"2023-08-11T12:22:07.888513+0000","last_unstale":"2023-08-11T12:22:30.716312+0000","last_undegraded":"2023-08-11T12:22:30.716312+0000","last_fullsized":"2023-08-11T12:22:30.716312+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:23:50.241697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068238+0000","last_change":"2023-08-11T12:22:02.850739+0000","last_active":"2023-08-11T12:22:09.068238+0000","last_peered":"2023-08-11T12:22:09.068238+0000","last_clean":"2023-08-11T12:22:09.068238+0000","last_became_active":"2023-08-11T12:22:02.850455+0000","last_became_peered":"2023-08-11T12:22:02.850455+0000","last_unstale":"2023-08-11T12:22:09.068238+0000","last_undegraded":"2023-08-11T12:22:09.068238+0000","last_fullsized":"2023-08-11T12:22:09.068238+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:48:26.768060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880073+0000","last_change":"2023-08-11T12:22:03.838834+0000","last_active":"2023-08-11T12:22:08.880073+0000","last_peered":"2023-08-11T12:22:08.880073+0000","last_clean":"2023-08-11T12:22:08.880073+0000","last_became_active":"2023-08-11T12:22:03.838435+0000","last_became_peered":"2023-08-11T12:22:03.838435+0000","last_unstale":"2023-08-11T12:22:08.880073+0000","last_undegraded":"2023-08-11T12:22:08.880073+0000","last_fullsized":"2023-08-11T12:22:08.880073+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:01:44.440343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066277+0000","last_change":"2023-08-11T12:22:07.884481+0000","last_active":"2023-08-11T12:22:09.066277+0000","last_peered":"2023-08-11T12:22:09.066277+0000","last_clean":"2023-08-11T12:22:09.066277+0000","last_became_active":"2023-08-11T12:22:07.884084+0000","last_became_peered":"2023-08-11T12:22:07.884084+0000","last_unstale":"2023-08-11T12:22:09.066277+0000","last_undegraded":"2023-08-11T12:22:09.066277+0000","last_fullsized":"2023-08-11T12:22:09.066277+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:54:33.489782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879471+0000","last_change":"2023-08-11T12:22:02.849339+0000","last_active":"2023-08-11T12:22:08.879471+0000","last_peered":"2023-08-11T12:22:08.879471+0000","last_clean":"2023-08-11T12:22:08.879471+0000","last_became_active":"2023-08-11T12:22:02.848986+0000","last_became_peered":"2023-08-11T12:22:02.848986+0000","last_unstale":"2023-08-11T12:22:08.879471+0000","last_undegraded":"2023-08-11T12:22:08.879471+0000","last_fullsized":"2023-08-11T12:22:08.879471+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:54:41.533973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.880177+0000","last_change":"2023-08-11T12:22:03.846301+0000","last_active":"2023-08-11T12:22:08.880177+0000","last_peered":"2023-08-11T12:22:08.880177+0000","last_clean":"2023-08-11T12:22:08.880177+0000","last_became_active":"2023-08-11T12:22:03.845990+0000","last_became_peered":"2023-08-11T12:22:03.845990+0000","last_unstale":"2023-08-11T12:22:08.880177+0000","last_undegraded":"2023-08-11T12:22:08.880177+0000","last_fullsized":"2023-08-11T12:22:08.880177+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:13:13.325427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.722464+0000","last_change":"2023-08-11T12:22:03.836652+0000","last_active":"2023-08-11T12:22:30.722464+0000","last_peered":"2023-08-11T12:22:30.722464+0000","last_clean":"2023-08-11T12:22:30.722464+0000","last_became_active":"2023-08-11T12:22:03.836236+0000","last_became_peered":"2023-08-11T12:22:03.836236+0000","last_unstale":"2023-08-11T12:22:30.722464+0000","last_undegraded":"2023-08-11T12:22:30.722464+0000","last_fullsized":"2023-08-11T12:22:30.722464+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:22:25.801143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067076+0000","last_change":"2023-08-11T12:22:03.831318+0000","last_active":"2023-08-11T12:22:09.067076+0000","last_peered":"2023-08-11T12:22:09.067076+0000","last_clean":"2023-08-11T12:22:09.067076+0000","last_became_active":"2023-08-11T12:22:03.830670+0000","last_became_peered":"2023-08-11T12:22:03.830670+0000","last_unstale":"2023-08-11T12:22:09.067076+0000","last_undegraded":"2023-08-11T12:22:09.067076+0000","last_fullsized":"2023-08-11T12:22:09.067076+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:26:18.125172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066384+0000","last_change":"2023-08-11T12:22:03.841396+0000","last_active":"2023-08-11T12:22:09.066384+0000","last_peered":"2023-08-11T12:22:09.066384+0000","last_clean":"2023-08-11T12:22:09.066384+0000","last_became_active":"2023-08-11T12:22:03.841076+0000","last_became_peered":"2023-08-11T12:22:03.841076+0000","last_unstale":"2023-08-11T12:22:09.066384+0000","last_undegraded":"2023-08-11T12:22:09.066384+0000","last_fullsized":"2023-08-11T12:22:09.066384+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:31:49.747283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.716636+0000","last_change":"2023-08-11T12:22:03.847266+0000","last_active":"2023-08-11T12:22:30.716636+0000","last_peered":"2023-08-11T12:22:30.716636+0000","last_clean":"2023-08-11T12:22:30.716636+0000","last_became_active":"2023-08-11T12:22:03.846898+0000","last_became_peered":"2023-08-11T12:22:03.846898+0000","last_unstale":"2023-08-11T12:22:30.716636+0000","last_undegraded":"2023-08-11T12:22:30.716636+0000","last_fullsized":"2023-08-11T12:22:30.716636+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:01:44.284193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879562+0000","last_change":"2023-08-11T12:22:03.843491+0000","last_active":"2023-08-11T12:22:08.879562+0000","last_peered":"2023-08-11T12:22:08.879562+0000","last_clean":"2023-08-11T12:22:08.879562+0000","last_became_active":"2023-08-11T12:22:03.843099+0000","last_became_peered":"2023-08-11T12:22:03.843099+0000","last_unstale":"2023-08-11T12:22:08.879562+0000","last_undegraded":"2023-08-11T12:22:08.879562+0000","last_fullsized":"2023-08-11T12:22:08.879562+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:06:59.399331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.724108+0000","last_change":"2023-08-11T12:22:03.840508+0000","last_active":"2023-08-11T12:22:30.724108+0000","last_peered":"2023-08-11T12:22:30.724108+0000","last_clean":"2023-08-11T12:22:30.724108+0000","last_became_active":"2023-08-11T12:22:03.840160+0000","last_became_peered":"2023-08-11T12:22:03.840160+0000","last_unstale":"2023-08-11T12:22:30.724108+0000","last_undegraded":"2023-08-11T12:22:30.724108+0000","last_fullsized":"2023-08-11T12:22:30.724108+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:42:10.983782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067345+0000","last_change":"2023-08-11T12:22:03.843724+0000","last_active":"2023-08-11T12:22:09.067345+0000","last_peered":"2023-08-11T12:22:09.067345+0000","last_clean":"2023-08-11T12:22:09.067345+0000","last_became_active":"2023-08-11T12:22:03.843431+0000","last_became_peered":"2023-08-11T12:22:03.843431+0000","last_unstale":"2023-08-11T12:22:09.067345+0000","last_undegraded":"2023-08-11T12:22:09.067345+0000","last_fullsized":"2023-08-11T12:22:09.067345+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:31:51.191070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.068290+0000","last_change":"2023-08-11T12:22:03.831268+0000","last_active":"2023-08-11T12:22:09.068290+0000","last_peered":"2023-08-11T12:22:09.068290+0000","last_clean":"2023-08-11T12:22:09.068290+0000","last_became_active":"2023-08-11T12:22:03.830839+0000","last_became_peered":"2023-08-11T12:22:03.830839+0000","last_unstale":"2023-08-11T12:22:09.068290+0000","last_undegraded":"2023-08-11T12:22:09.068290+0000","last_fullsized":"2023-08-11T12:22:09.068290+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:56:40.087593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.066807+0000","last_change":"2023-08-11T12:22:03.839227+0000","last_active":"2023-08-11T12:22:09.066807+0000","last_peered":"2023-08-11T12:22:09.066807+0000","last_clean":"2023-08-11T12:22:09.066807+0000","last_became_active":"2023-08-11T12:22:03.838526+0000","last_became_peered":"2023-08-11T12:22:03.838526+0000","last_unstale":"2023-08-11T12:22:09.066807+0000","last_undegraded":"2023-08-11T12:22:09.066807+0000","last_fullsized":"2023-08-11T12:22:09.066807+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:01:52.337807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:09.067944+0000","last_change":"2023-08-11T12:22:03.834614+0000","last_active":"2023-08-11T12:22:09.067944+0000","last_peered":"2023-08-11T12:22:09.067944+0000","last_clean":"2023-08-11T12:22:09.067944+0000","last_became_active":"2023-08-11T12:22:03.834267+0000","last_became_peered":"2023-08-11T12:22:03.834267+0000","last_unstale":"2023-08-11T12:22:09.067944+0000","last_undegraded":"2023-08-11T12:22:09.067944+0000","last_fullsized":"2023-08-11T12:22:09.067944+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:22:51.239980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.970204+0000","last_change":"2023-08-11T12:22:03.846504+0000","last_active":"2023-08-11T12:22:08.970204+0000","last_peered":"2023-08-11T12:22:08.970204+0000","last_clean":"2023-08-11T12:22:08.970204+0000","last_became_active":"2023-08-11T12:22:03.846156+0000","last_became_peered":"2023-08-11T12:22:03.846156+0000","last_unstale":"2023-08-11T12:22:08.970204+0000","last_undegraded":"2023-08-11T12:22:08.970204+0000","last_fullsized":"2023-08-11T12:22:08.970204+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:37:05.136958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-08-11T12:22:08.879069+0000","last_change":"2023-08-11T12:22:03.849854+0000","last_active":"2023-08-11T12:22:08.879069+0000","last_peered":"2023-08-11T12:22:08.879069+0000","last_clean":"2023-08-11T12:22:08.879069+0000","last_became_active":"2023-08-11T12:22:03.849553+0000","last_became_peered":"2023-08-11T12:22:03.849553+0000","last_unstale":"2023-08-11T12:22:08.879069+0000","last_undegraded":"2023-08-11T12:22:08.879069+0000","last_fullsized":"2023-08-11T12:22:08.879069+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:28:10.396410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-08-11T12:22:30.723809+0000","last_change":"2023-08-11T12:22:03.843511+0000","last_active":"2023-08-11T12:22:30.723809+0000","last_peered":"2023-08-11T12:22:30.723809+0000","last_clean":"2023-08-11T12:22:30.723809+0000","last_became_active":"2023-08-11T12:22:03.843206+0000","last_became_peered":"2023-08-11T12:22:03.843206+0000","last_unstale":"2023-08-11T12:22:30.723809+0000","last_undegraded":"2023-08-11T12:22:30.723809+0000","last_fullsized":"2023-08-11T12:22:30.723809+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:15:11.117760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":248338,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5044,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":8,"num_read_kb":10,"num_write":105,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":21158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91,"ondisk_log_size":91,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449106,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":464654,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.753},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.76700000000000002}]},{"osd":1,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.61299999999999999}]},{"osd":2,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.66600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":4,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.88300000000000001}]},{"osd":6,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.81000000000000005}]},{"osd":7,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.82499999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":9,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.98199999999999998}]},{"osd":10,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.94099999999999995}]}]},{"osd":10,"up_from":71,"seq":304942678036,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":1058957,"data_compressed":47603,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":1,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.42699999999999999}]},{"osd":2,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.58299999999999996}]},{"osd":3,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.64800000000000002}]},{"osd":4,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.71299999999999997}]},{"osd":5,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.629},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.78300000000000003}]},{"osd":6,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.75600000000000001}]},{"osd":7,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.59099999999999997}]},{"osd":8,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.86799999999999999}]},{"osd":9,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.90500000000000003}]},{"osd":11,"last update":"Fri Aug 11 12:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.85299999999999998}]}]},{"osd":9,"up_from":66,"seq":283467841561,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":484270,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.624}]},{"osd":2,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.79600000000000004}]},{"osd":3,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.71599999999999997}]},{"osd":4,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.69899999999999995}]},{"osd":5,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.754}]},{"osd":6,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.66900000000000004}]},{"osd":8,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.80900000000000005}]},{"osd":10,"last update":"Fri Aug 11 12:21:54 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.90900000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]}]},{"osd":8,"up_from":58,"seq":249108103199,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":464810,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.45700000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.75700000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72199999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.81100000000000005}]},{"osd":1,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.443,"5min":0.372,"15min":0.372},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54900000000000004}]},{"osd":2,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.437,"15min":0.42699999999999999},"min":{"1min":0.34100000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.45000000000000001,"15min":0.439},"min":{"1min":0.32500000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.76900000000000002,"5min":0.878,"15min":0.878},"last":0.39300000000000002}]},{"osd":3,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63700000000000001,"15min":0.63900000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82399999999999995,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.61899999999999999,"15min":0.60999999999999999},"min":{"1min":0.42899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.92900000000000005}]},{"osd":4,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.44500000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.66200000000000003,"15min":0.65200000000000002},"min":{"1min":0.49299999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.56599999999999995}]},{"osd":5,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.54300000000000004,"15min":0.52900000000000003},"min":{"1min":0.34899999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.44},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.57899999999999996,"15min":0.56299999999999994},"min":{"1min":0.40600000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.41699999999999998}]},{"osd":6,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.69799999999999995,"15min":0.68500000000000005},"min":{"1min":0.51300000000000001,"5min":0.441,"15min":0.441},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.72599999999999998,"15min":0.71499999999999997},"min":{"1min":0.59499999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.82499999999999996}]},{"osd":7,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.70699999999999996,"15min":0.69099999999999995},"min":{"1min":0.54200000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72299999999999998,"15min":0.71299999999999997},"min":{"1min":0.48899999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.58099999999999996}]},{"osd":9,"last update":"Fri Aug 11 12:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.86599999999999999}]},{"osd":10,"last update":"Fri Aug 11 12:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.89800000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":7,"up_from":51,"seq":219043332130,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":1055371,"data_compressed":47603,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.61399999999999999,"15min":0.60599999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.55200000000000005,"15min":0.53700000000000003},"min":{"1min":0.46999999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.65700000000000003}]},{"osd":1,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.41099999999999998,"15min":0.40100000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.45000000000000001,"15min":0.442},"min":{"1min":0.312,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.54400000000000004}]},{"osd":2,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.42899999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.59099999999999997,"15min":0.57999999999999996},"min":{"1min":0.498,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80900000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.61399999999999999}]},{"osd":3,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.61499999999999999,"15min":0.60699999999999998},"min":{"1min":0.432,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.64000000000000001,"15min":0.626},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.66100000000000003}]},{"osd":4,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.54400000000000004,"15min":0.53600000000000003},"min":{"1min":0.36199999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.434},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53800000000000003,"15min":0.53500000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.0149999999999999,"5min":1.105,"15min":1.105},"last":0.48499999999999999}]},{"osd":5,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.66300000000000003,"15min":0.65600000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.66200000000000003,"15min":0.65600000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.68600000000000005}]},{"osd":6,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.73299999999999998,"15min":0.71699999999999997},"min":{"1min":0.59399999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.70199999999999996,"15min":0.68500000000000005},"min":{"1min":0.59399999999999997,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.56399999999999995}]},{"osd":8,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.70099999999999996,"15min":0.68300000000000005},"min":{"1min":0.56899999999999995,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.69399999999999995,"15min":0.68000000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.78500000000000003}]},{"osd":9,"last update":"Fri Aug 11 12:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.75900000000000001}]},{"osd":10,"last update":"Fri Aug 11 12:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.80300000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]}]},{"osd":6,"up_from":46,"seq":197568495656,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":464072,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47499999999999998,"15min":0.46300000000000002},"min":{"1min":0.37,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.73599999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.435},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51800000000000002,"15min":0.50800000000000001},"min":{"1min":0.375,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61599999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.50900000000000001}]},{"osd":1,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.65400000000000003,"15min":0.63},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.878,"5min":1.327,"15min":1.327},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.69199999999999995,"15min":0.67500000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98599999999999999,"5min":1.206,"15min":1.206},"last":0.60299999999999998}]},{"osd":2,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.69199999999999995,"15min":0.68799999999999994},"min":{"1min":0.51000000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98399999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.70599999999999996,"15min":0.69299999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.63600000000000001}]},{"osd":3,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59699999999999998,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67400000000000004,"15min":0.66200000000000003},"min":{"1min":0.48499999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.05,"5min":1.196,"15min":1.196},"last":0.66100000000000003}]},{"osd":4,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69799999999999995,"15min":0.69599999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97199999999999998,"5min":1.139,"15min":1.139},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.752,"15min":0.74099999999999999},"min":{"1min":0.52600000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.012,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.81200000000000006}]},{"osd":5,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.77800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56599999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1499999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80600000000000005,"15min":0.80500000000000005},"min":{"1min":0.59299999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0109999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.84799999999999998}]},{"osd":7,"last update":"Fri Aug 11 12:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.81599999999999995,"15min":0.80400000000000005},"min":{"1min":0.59199999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.177,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.82099999999999995,"15min":0.81299999999999994},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.90600000000000003}]},{"osd":8,"last update":"Fri Aug 11 12:22:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.83199999999999996,"15min":0.83699999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.079,"5min":1.284,"15min":1.284},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.877,"15min":0.88500000000000001},"min":{"1min":0.65500000000000003,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1839999999999999,"5min":1.387,"15min":1.387},"last":0.83099999999999996}]},{"osd":9,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.86799999999999999}]},{"osd":10,"last update":"Fri Aug 11 12:21:54 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.88100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":467914,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.53400000000000003,"15min":0.51200000000000001},"min":{"1min":0.35099999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.96099999999999997,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.55500000000000005,"15min":0.56299999999999994},"min":{"1min":0.378,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.83199999999999996,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.69399999999999995}]},{"osd":2,"last update":"Fri Aug 11 12:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.40699999999999997,"5min":0.315,"15min":0.315},"max":{"1min":0.76000000000000001,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.53800000000000003,"15min":0.51100000000000001},"min":{"1min":0.40300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79400000000000004,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.752}]},{"osd":3,"last update":"Fri Aug 11 12:22:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80700000000000005,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65600000000000003,"15min":0.63200000000000001},"min":{"1min":0.49099999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90600000000000003,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.77500000000000002}]},{"osd":4,"last update":"Fri Aug 11 12:21:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46200000000000002,"15min":0.44500000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.745,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.47699999999999998,"15min":0.47299999999999998},"min":{"1min":0.26500000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.63,"15min":0.60799999999999998},"min":{"1min":0.44,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89000000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.60899999999999999,"15min":0.60099999999999998},"min":{"1min":0.48399999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.80900000000000005}]},{"osd":6,"last update":"Fri Aug 11 12:21:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72999999999999998,"15min":0.73499999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94399999999999995,"5min":1.095,"15min":1.095},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78000000000000003,"15min":0.78200000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.99299999999999999,"5min":1.159,"15min":1.159},"last":0.88900000000000001}]},{"osd":7,"last update":"Fri Aug 11 12:21:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.35799999999999998,"5min":0.31,"15min":0.31},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.90600000000000003}]},{"osd":8,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72799999999999998,"15min":0.72199999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93400000000000005,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.74199999999999999,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.436,"15min":0.436},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":1.008}]},{"osd":9,"last update":"Fri Aug 11 12:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.871},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.96499999999999997}]},{"osd":10,"last update":"Fri Aug 11 12:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.93400000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738435,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":465550,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 11 12:21:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.57799999999999996,"15min":0.52800000000000002},"min":{"1min":0.42899999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.96699999999999997,"5min":1.782,"15min":1.782},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.58799999999999997,"15min":0.53800000000000003},"min":{"1min":0.46400000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.069,"5min":2.7749999999999999,"15min":2.7749999999999999},"last":0.68200000000000005}]},{"osd":2,"last update":"Fri Aug 11 12:21:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59399999999999997,"15min":0.55300000000000005},"min":{"1min":0.40799999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.63400000000000001,"15min":0.57799999999999996},"min":{"1min":0.46400000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94699999999999995,"5min":1.879,"15min":1.879},"last":0.60699999999999998}]},{"osd":3,"last update":"Fri Aug 11 12:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.49399999999999999,"15min":0.48099999999999998},"min":{"1min":0.40500000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.36599999999999999}]},{"osd":4,"last update":"Fri Aug 11 12:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.66100000000000003,"15min":0.61199999999999999},"min":{"1min":0.503,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.016,"5min":1.849,"15min":1.849},"last":0.501},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.67800000000000005,"15min":0.63100000000000001},"min":{"1min":0.54600000000000004,"5min":0.443,"15min":0.443},"max":{"1min":1.085,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":0.42999999999999999}]},{"osd":5,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.71899999999999997,"15min":0.68999999999999995},"min":{"1min":0.54800000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.99399999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.748,"15min":0.71999999999999997},"min":{"1min":0.55200000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1020000000000001,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.82799999999999996}]},{"osd":6,"last update":"Fri Aug 11 12:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97699999999999998,"5min":2.8839999999999999,"15min":2.8839999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.70999999999999996,"15min":0.71599999999999997},"min":{"1min":0.41299999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.95799999999999996,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.76900000000000002}]},{"osd":7,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83799999999999997,"15min":0.83699999999999997},"min":{"1min":0.55400000000000005,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.409,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.628},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.91500000000000004,"15min":0.92600000000000005},"min":{"1min":0.61399999999999999,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.385,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.55100000000000005}]},{"osd":8,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.82899999999999996,"15min":0.84399999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.91800000000000004,"5min":1.262,"15min":1.262},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.92200000000000004,"15min":0.93700000000000006},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.079,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.65100000000000002}]},{"osd":9,"last update":"Fri Aug 11 12:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.86299999999999999}]},{"osd":10,"last update":"Fri Aug 11 12:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.748}]},{"osd":11,"last update":"Fri Aug 11 12:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.78900000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411386,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":467279,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.60899999999999999,"15min":0.54400000000000004},"min":{"1min":0.39100000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.80900000000000005,"5min":5.968,"15min":5.968},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.40600000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.50900000000000001}]},{"osd":1,"last update":"Fri Aug 11 12:21:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.52400000000000002,"15min":0.502},"min":{"1min":0.38200000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.55000000000000004,"15min":0.52300000000000002},"min":{"1min":0.45600000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.72599999999999998}]},{"osd":3,"last update":"Fri Aug 11 12:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61299999999999999,"15min":0.59699999999999998},"min":{"1min":0.45800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.623,"15min":0.59899999999999998},"min":{"1min":0.46899999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.76300000000000001}]},{"osd":4,"last update":"Fri Aug 11 12:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.57799999999999996,"15min":0.56799999999999995},"min":{"1min":0.441,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59999999999999998,"15min":0.58699999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.70399999999999996}]},{"osd":5,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.44400000000000001,"15min":0.42799999999999999},"min":{"1min":0.31,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.622},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.46800000000000003,"15min":0.44800000000000001},"min":{"1min":0.32800000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.54000000000000004}]},{"osd":6,"last update":"Fri Aug 11 12:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.48599999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.878,"5min":0.879,"15min":0.879},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.63100000000000001,"15min":0.61599999999999999},"min":{"1min":0.53200000000000003,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.84599999999999997}]},{"osd":7,"last update":"Fri Aug 11 12:21:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.59799999999999998,"15min":0.58399999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.53100000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.88800000000000001}]},{"osd":8,"last update":"Fri Aug 11 12:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.60299999999999998,"15min":0.58899999999999997},"min":{"1min":0.40000000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.57399999999999995,"15min":0.56000000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.81299999999999994}]},{"osd":9,"last update":"Fri Aug 11 12:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.874},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.97699999999999998}]},{"osd":10,"last update":"Fri Aug 11 12:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.92200000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]}]},{"osd":3,"up_from":25,"seq":107374182453,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":464266,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.437,"15min":0.38700000000000001},"min":{"1min":0.33900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.499,"5min":0.46999999999999997,"15min":0.438},"min":{"1min":0.36299999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67300000000000004,"5min":1.006,"15min":1.006},"last":0.59899999999999998}]},{"osd":1,"last update":"Fri Aug 11 12:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64200000000000002,"15min":0.57399999999999995},"min":{"1min":0.48399999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.98599999999999999,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.63200000000000001,"15min":0.59299999999999997},"min":{"1min":0.45100000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92200000000000004,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.69699999999999995}]},{"osd":2,"last update":"Fri Aug 11 12:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.64700000000000002,"15min":0.61799999999999999},"min":{"1min":0.54600000000000004,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85099999999999998,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.69699999999999995,"15min":0.63},"min":{"1min":0.56299999999999994,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":1.018}]},{"osd":4,"last update":"Fri Aug 11 12:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.64000000000000001,"15min":0.60799999999999998},"min":{"1min":0.53100000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.68899999999999995,"15min":0.63700000000000001},"min":{"1min":0.67200000000000004,"5min":0.435,"15min":0.435},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.82699999999999996}]},{"osd":5,"last update":"Fri Aug 11 12:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.68899999999999995,"15min":0.65100000000000002},"min":{"1min":0.629,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.70899999999999996,"15min":0.66900000000000004},"min":{"1min":0.60899999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.85699999999999998}]},{"osd":6,"last update":"Fri Aug 11 12:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.77400000000000002,"15min":0.76000000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0900000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.71599999999999997,"15min":0.71099999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":1.0309999999999999}]},{"osd":7,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.78300000000000003,"15min":0.76400000000000001},"min":{"1min":0.65800000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.89900000000000002,"15min":0.88500000000000001},"min":{"1min":0.71799999999999997,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.86899999999999999}]},{"osd":8,"last update":"Fri Aug 11 12:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":1.004},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.91600000000000004}]},{"osd":9,"last update":"Fri Aug 11 12:21:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.92900000000000005}]},{"osd":10,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]}]},{"osd":4,"up_from":33,"seq":141733920817,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":942080,"data_stored":464094,"data_compressed":11657,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.39900000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.81599999999999995,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.41399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80900000000000005,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.72099999999999997}]},{"osd":1,"last update":"Fri Aug 11 12:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.40400000000000003,"15min":0.39600000000000002},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.38700000000000001,"15min":0.372},"min":{"1min":0.308,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.60399999999999998}]},{"osd":2,"last update":"Fri Aug 11 12:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.59699999999999998,"15min":0.57299999999999995},"min":{"1min":0.48599999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.58699999999999997,"15min":0.55900000000000005},"min":{"1min":0.54400000000000004,"5min":0.378,"15min":0.378},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.83999999999999997}]},{"osd":3,"last update":"Fri Aug 11 12:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.57699999999999996,"15min":0.55900000000000005},"min":{"1min":0.439,"5min":0.379,"15min":0.379},"max":{"1min":0.77300000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.41099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.77700000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.73199999999999998}]},{"osd":5,"last update":"Fri Aug 11 12:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.59499999999999997,"15min":0.56699999999999995},"min":{"1min":0.42199999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.60899999999999999,"15min":0.57599999999999996},"min":{"1min":0.42099999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.92900000000000005}]},{"osd":6,"last update":"Fri Aug 11 12:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.71399999999999997,"15min":0.69599999999999995},"min":{"1min":0.53400000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.63,"15min":0.61599999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.878}]},{"osd":7,"last update":"Fri Aug 11 12:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.58599999999999997,"15min":0.57099999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.64500000000000002,"15min":0.629},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":1.0189999999999999}]},{"osd":8,"last update":"Fri Aug 11 12:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.76200000000000001,"15min":0.749},"min":{"1min":0.63900000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":1.0700000000000001}]},{"osd":9,"last update":"Fri Aug 11 12:21:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":1.1459999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":1.0429999999999999}]},{"osd":10,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.80900000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]}]},{"osd":5,"up_from":38,"seq":163208757292,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":1054622,"data_compressed":47603,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.51900000000000002},"min":{"1min":0.32200000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70599999999999996,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35399999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.624,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.439}]},{"osd":1,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.38100000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77500000000000002,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.623,"5min":0.57699999999999996,"15min":0.56100000000000005},"min":{"1min":0.42099999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.83499999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.77400000000000002}]},{"osd":2,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.29799999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.41399999999999998,"15min":0.39800000000000002},"min":{"1min":0.27700000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.46999999999999997}]},{"osd":3,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72299999999999998,"5min":0.751,"15min":0.751},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.41199999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.77500000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.504}]},{"osd":4,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.61199999999999999,"15min":0.59199999999999997},"min":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1,"5min":1.016,"15min":1.016},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60899999999999999,"15min":0.60299999999999998},"min":{"1min":0.443,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.58099999999999996}]},{"osd":6,"last update":"Fri Aug 11 12:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.623,"15min":0.61099999999999999},"min":{"1min":0.40300000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89300000000000002,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.625},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.68100000000000005,"15min":0.66800000000000004},"min":{"1min":0.499,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.64500000000000002}]},{"osd":7,"last update":"Fri Aug 11 12:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.47199999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.68000000000000005}]},{"osd":8,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.60299999999999998,"15min":0.59299999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.56499999999999995,"15min":0.55800000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.69699999999999995}]},{"osd":9,"last update":"Fri Aug 11 12:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.754},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.85099999999999998}]},{"osd":10,"last update":"Fri Aug 11 12:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.72099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34304,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34304,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-11T12:22:35.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:34 smithi008 ceph-mon[97158]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:22:35.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:34 smithi008 ceph-mon[97158]: pgmap v291: 129 pgs: 3 peering, 126 active+clean; 585 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5.5 KiB/s wr, 18 op/s 2023-08-11T12:22:35.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:34 smithi194 ceph-mon[130905]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:22:35.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:34 smithi194 ceph-mon[130905]: pgmap v291: 129 pgs: 3 peering, 126 active+clean; 585 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5.5 KiB/s wr, 18 op/s 2023-08-11T12:22:35.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:34 smithi045 ceph-mon[130284]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:22:35.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:34 smithi045 ceph-mon[130284]: pgmap v291: 129 pgs: 3 peering, 126 active+clean; 585 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5.5 KiB/s wr, 18 op/s 2023-08-11T12:22:37.185 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-11T12:22:37.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.399+0000 7fa2359ff700 1 -- 172.21.15.8:0/3243627682 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa230102570 msgr2=0x7fa230108e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:37.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.399+0000 7fa2359ff700 1 --2- 172.21.15.8:0/3243627682 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa230102570 0x7fa230108e20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa22800b0d0 tx=0x7fa22800b3e0 comp rx=0 tx=0).stop 2023-08-11T12:22:37.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.399+0000 7fa2359ff700 1 -- 172.21.15.8:0/3243627682 shutdown_connections 2023-08-11T12:22:37.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.399+0000 7fa2359ff700 1 --2- 172.21.15.8:0/3243627682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2301009e0 0x7fa230100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:37.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.399+0000 7fa2359ff700 1 --2- 172.21.15.8:0/3243627682 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa230102570 0x7fa230108e20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:37.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.399+0000 7fa2359ff700 1 --2- 172.21.15.8:0/3243627682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa230101bd0 0x7fa230102030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:37.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.399+0000 7fa2359ff700 1 -- 172.21.15.8:0/3243627682 >> 172.21.15.8:0/3243627682 conn(0x7fa2300fbf50 msgr2=0x7fa2300fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:37.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.399+0000 7fa2359ff700 1 -- 172.21.15.8:0/3243627682 shutdown_connections 2023-08-11T12:22:37.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.399+0000 7fa2359ff700 1 -- 172.21.15.8:0/3243627682 wait complete. 2023-08-11T12:22:37.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.400+0000 7fa2359ff700 1 Processor -- start 2023-08-11T12:22:37.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.400+0000 7fa2359ff700 1 -- start start 2023-08-11T12:22:37.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.401+0000 7fa2359ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2301009e0 0x7fa2301989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:37.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.401+0000 7fa2359ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa230101bd0 0x7fa230198f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:37.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.401+0000 7fa2359ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa230102570 0x7fa23019ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:37.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.401+0000 7fa2359ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2301a0550 con 0x7fa230101bd0 2023-08-11T12:22:37.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.401+0000 7fa2359ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2301a0690 con 0x7fa2301009e0 2023-08-11T12:22:37.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.401+0000 7fa2359ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2301a0820 con 0x7fa230102570 2023-08-11T12:22:37.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.401+0000 7fa227fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa230101bd0 0x7fa230198f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:37.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.401+0000 7fa22effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2301009e0 0x7fa2301989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:37.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.401+0000 7fa227fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa230101bd0 0x7fa230198f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50940/0 (socket says 172.21.15.8:50940) 2023-08-11T12:22:37.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.401+0000 7fa227fff700 1 -- 172.21.15.8:0/2721385024 learned_addr learned my addr 172.21.15.8:0/2721385024 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:37.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.401+0000 7fa22f7fe700 1 --2- 172.21.15.8:0/2721385024 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa230102570 0x7fa23019ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:37.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.401+0000 7fa22effd700 1 -- 172.21.15.8:0/2721385024 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa230102570 msgr2=0x7fa23019ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:37.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.401+0000 7fa22effd700 1 --2- 172.21.15.8:0/2721385024 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa230102570 0x7fa23019ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:37.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.401+0000 7fa22effd700 1 -- 172.21.15.8:0/2721385024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa230101bd0 msgr2=0x7fa230198f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:37.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.401+0000 7fa22effd700 1 --2- 172.21.15.8:0/2721385024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa230101bd0 0x7fa230198f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:37.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.401+0000 7fa22effd700 1 -- 172.21.15.8:0/2721385024 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa228009d00 con 0x7fa2301009e0 2023-08-11T12:22:37.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.402+0000 7fa227fff700 1 --2- 172.21.15.8:0/2721385024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa230101bd0 0x7fa230198f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:22:37.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.402+0000 7fa22effd700 1 --2- 172.21.15.8:0/2721385024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2301009e0 0x7fa2301989d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa22000e9c0 tx=0x7fa22000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:37.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.402+0000 7fa2349fd700 1 -- 172.21.15.8:0/2721385024 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa220004220 con 0x7fa2301009e0 2023-08-11T12:22:37.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.402+0000 7fa2349fd700 1 -- 172.21.15.8:0/2721385024 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa220004380 con 0x7fa2301009e0 2023-08-11T12:22:37.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.402+0000 7fa2349fd700 1 -- 172.21.15.8:0/2721385024 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa220003be0 con 0x7fa2301009e0 2023-08-11T12:22:37.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.402+0000 7fa2359ff700 1 -- 172.21.15.8:0/2721385024 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2301a0b00 con 0x7fa2301009e0 2023-08-11T12:22:37.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.403+0000 7fa2359ff700 1 -- 172.21.15.8:0/2721385024 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2301a1010 con 0x7fa2301009e0 2023-08-11T12:22:37.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.403+0000 7fa2359ff700 1 -- 172.21.15.8:0/2721385024 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa23010c250 con 0x7fa2301009e0 2023-08-11T12:22:37.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.406+0000 7fa2349fd700 1 -- 172.21.15.8:0/2721385024 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fa220003d40 con 0x7fa2301009e0 2023-08-11T12:22:37.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.408+0000 7fa2349fd700 1 --2- 172.21.15.8:0/2721385024 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa21c09ffd0 0x7fa21c0a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:37.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.408+0000 7fa2349fd700 1 -- 172.21.15.8:0/2721385024 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fa220014070 con 0x7fa2301009e0 2023-08-11T12:22:37.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.408+0000 7fa227fff700 1 --2- 172.21.15.8:0/2721385024 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa21c09ffd0 0x7fa21c0a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:37.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.409+0000 7fa227fff700 1 --2- 172.21.15.8:0/2721385024 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa21c09ffd0 0x7fa21c0a2490 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa218011550 tx=0x7fa218009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:37.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.409+0000 7fa2349fd700 1 -- 172.21.15.8:0/2721385024 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fa220095380 con 0x7fa2301009e0 2023-08-11T12:22:37.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.618+0000 7fa2359ff700 1 -- 172.21.15.8:0/2721385024 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa230108b20 con 0x7fa21c09ffd0 2023-08-11T12:22:37.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.631+0000 7fa2349fd700 1 -- 172.21.15.8:0/2721385024 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+422492 (secure 0 0 0) 0x7fa230108b20 con 0x7fa21c09ffd0 2023-08-11T12:22:37.864 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:22:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.636+0000 7fa2359ff700 1 -- 172.21.15.8:0/2721385024 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa21c09ffd0 msgr2=0x7fa21c0a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.636+0000 7fa2359ff700 1 --2- 172.21.15.8:0/2721385024 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa21c09ffd0 0x7fa21c0a2490 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa218011550 tx=0x7fa218009260 comp rx=0 tx=0).stop 2023-08-11T12:22:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.636+0000 7fa2359ff700 1 -- 172.21.15.8:0/2721385024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2301009e0 msgr2=0x7fa2301989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.636+0000 7fa2359ff700 1 --2- 172.21.15.8:0/2721385024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2301009e0 0x7fa2301989d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa22000e9c0 tx=0x7fa22000ecd0 comp rx=0 tx=0).stop 2023-08-11T12:22:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.636+0000 7fa2359ff700 1 -- 172.21.15.8:0/2721385024 shutdown_connections 2023-08-11T12:22:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.636+0000 7fa2359ff700 1 --2- 172.21.15.8:0/2721385024 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa21c09ffd0 0x7fa21c0a2490 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.636+0000 7fa2359ff700 1 --2- 172.21.15.8:0/2721385024 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa230102570 0x7fa23019ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:37.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.636+0000 7fa2359ff700 1 --2- 172.21.15.8:0/2721385024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2301009e0 0x7fa2301989d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:37.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.636+0000 7fa2359ff700 1 --2- 172.21.15.8:0/2721385024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa230101bd0 0x7fa230198f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:37.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.636+0000 7fa2359ff700 1 -- 172.21.15.8:0/2721385024 >> 172.21.15.8:0/2721385024 conn(0x7fa2300fbf50 msgr2=0x7fa230107400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:37.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.636+0000 7fa2359ff700 1 -- 172.21.15.8:0/2721385024 shutdown_connections 2023-08-11T12:22:37.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:37.636+0000 7fa2359ff700 1 -- 172.21.15.8:0/2721385024 wait complete. 2023-08-11T12:22:37.868 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-08-11T12:22:37.869 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2023-08-11T12:22:36.511837+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600632,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":195,"num_read_kb":166,"num_write":388,"num_write_kb":3005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":64,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":318,"ondisk_log_size":318,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":424,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336064,"kb_used_data":11796,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124605760,"statfs":{"total":1151940427776,"available":1151596298240,"internally_reserved":0,"allocated":12079104,"data_stored":7598449,"data_compressed":318882,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5624,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":158,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":50,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002209"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720907+0000","last_change":"2023-08-11T12:22:03.850538+0000","last_active":"2023-08-11T12:22:31.720907+0000","last_peered":"2023-08-11T12:22:31.720907+0000","last_clean":"2023-08-11T12:22:31.720907+0000","last_became_active":"2023-08-11T12:22:03.850220+0000","last_became_peered":"2023-08-11T12:22:03.850220+0000","last_unstale":"2023-08-11T12:22:31.720907+0000","last_undegraded":"2023-08-11T12:22:31.720907+0000","last_fullsized":"2023-08-11T12:22:31.720907+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:10:46.194341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719647+0000","last_change":"2023-08-11T12:22:03.843779+0000","last_active":"2023-08-11T12:22:31.719647+0000","last_peered":"2023-08-11T12:22:31.719647+0000","last_clean":"2023-08-11T12:22:31.719647+0000","last_became_active":"2023-08-11T12:22:03.843441+0000","last_became_peered":"2023-08-11T12:22:03.843441+0000","last_unstale":"2023-08-11T12:22:31.719647+0000","last_undegraded":"2023-08-11T12:22:31.719647+0000","last_fullsized":"2023-08-11T12:22:31.719647+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:51:42.363862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719082+0000","last_change":"2023-08-11T12:22:03.851996+0000","last_active":"2023-08-11T12:22:31.719082+0000","last_peered":"2023-08-11T12:22:31.719082+0000","last_clean":"2023-08-11T12:22:31.719082+0000","last_became_active":"2023-08-11T12:22:03.850821+0000","last_became_peered":"2023-08-11T12:22:03.850821+0000","last_unstale":"2023-08-11T12:22:31.719082+0000","last_undegraded":"2023-08-11T12:22:31.719082+0000","last_fullsized":"2023-08-11T12:22:31.719082+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:54:54.152911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722080+0000","last_change":"2023-08-11T12:22:03.842025+0000","last_active":"2023-08-11T12:22:31.722080+0000","last_peered":"2023-08-11T12:22:31.722080+0000","last_clean":"2023-08-11T12:22:31.722080+0000","last_became_active":"2023-08-11T12:22:03.841700+0000","last_became_peered":"2023-08-11T12:22:03.841700+0000","last_unstale":"2023-08-11T12:22:31.722080+0000","last_undegraded":"2023-08-11T12:22:31.722080+0000","last_fullsized":"2023-08-11T12:22:31.722080+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:13:45.519007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723174+0000","last_change":"2023-08-11T12:22:03.844908+0000","last_active":"2023-08-11T12:22:31.723174+0000","last_peered":"2023-08-11T12:22:31.723174+0000","last_clean":"2023-08-11T12:22:31.723174+0000","last_became_active":"2023-08-11T12:22:03.844674+0000","last_became_peered":"2023-08-11T12:22:03.844674+0000","last_unstale":"2023-08-11T12:22:31.723174+0000","last_undegraded":"2023-08-11T12:22:31.723174+0000","last_fullsized":"2023-08-11T12:22:31.723174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:10:22.657255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721437+0000","last_change":"2023-08-11T12:22:03.839915+0000","last_active":"2023-08-11T12:22:31.721437+0000","last_peered":"2023-08-11T12:22:31.721437+0000","last_clean":"2023-08-11T12:22:31.721437+0000","last_became_active":"2023-08-11T12:22:03.839099+0000","last_became_peered":"2023-08-11T12:22:03.839099+0000","last_unstale":"2023-08-11T12:22:31.721437+0000","last_undegraded":"2023-08-11T12:22:31.721437+0000","last_fullsized":"2023-08-11T12:22:31.721437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:51:17.642383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717754+0000","last_change":"2023-08-11T12:22:03.841591+0000","last_active":"2023-08-11T12:22:31.717754+0000","last_peered":"2023-08-11T12:22:31.717754+0000","last_clean":"2023-08-11T12:22:31.717754+0000","last_became_active":"2023-08-11T12:22:03.841232+0000","last_became_peered":"2023-08-11T12:22:03.841232+0000","last_unstale":"2023-08-11T12:22:31.717754+0000","last_undegraded":"2023-08-11T12:22:31.717754+0000","last_fullsized":"2023-08-11T12:22:31.717754+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:12:40.032896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720595+0000","last_change":"2023-08-11T12:22:03.839516+0000","last_active":"2023-08-11T12:22:31.720595+0000","last_peered":"2023-08-11T12:22:31.720595+0000","last_clean":"2023-08-11T12:22:31.720595+0000","last_became_active":"2023-08-11T12:22:03.839058+0000","last_became_peered":"2023-08-11T12:22:03.839058+0000","last_unstale":"2023-08-11T12:22:31.720595+0000","last_undegraded":"2023-08-11T12:22:31.720595+0000","last_fullsized":"2023-08-11T12:22:31.720595+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:01:10.744970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774871+0000","last_change":"2023-08-11T12:22:03.841033+0000","last_active":"2023-08-11T12:22:31.774871+0000","last_peered":"2023-08-11T12:22:31.774871+0000","last_clean":"2023-08-11T12:22:31.774871+0000","last_became_active":"2023-08-11T12:22:03.840665+0000","last_became_peered":"2023-08-11T12:22:03.840665+0000","last_unstale":"2023-08-11T12:22:31.774871+0000","last_undegraded":"2023-08-11T12:22:31.774871+0000","last_fullsized":"2023-08-11T12:22:31.774871+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:08:51.628782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721119+0000","last_change":"2023-08-11T12:22:03.839663+0000","last_active":"2023-08-11T12:22:31.721119+0000","last_peered":"2023-08-11T12:22:31.721119+0000","last_clean":"2023-08-11T12:22:31.721119+0000","last_became_active":"2023-08-11T12:22:03.838840+0000","last_became_peered":"2023-08-11T12:22:03.838840+0000","last_unstale":"2023-08-11T12:22:31.721119+0000","last_undegraded":"2023-08-11T12:22:31.721119+0000","last_fullsized":"2023-08-11T12:22:31.721119+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:28:57.495510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717811+0000","last_change":"2023-08-11T12:22:03.846288+0000","last_active":"2023-08-11T12:22:31.717811+0000","last_peered":"2023-08-11T12:22:31.717811+0000","last_clean":"2023-08-11T12:22:31.717811+0000","last_became_active":"2023-08-11T12:22:03.845962+0000","last_became_peered":"2023-08-11T12:22:03.845962+0000","last_unstale":"2023-08-11T12:22:31.717811+0000","last_undegraded":"2023-08-11T12:22:31.717811+0000","last_fullsized":"2023-08-11T12:22:31.717811+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:42:37.154687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.728022+0000","last_change":"2023-08-11T12:22:31.726774+0000","last_active":"2023-08-11T12:22:31.728022+0000","last_peered":"2023-08-11T12:22:31.728022+0000","last_clean":"2023-08-11T12:22:31.728022+0000","last_became_active":"2023-08-11T12:22:31.726437+0000","last_became_peered":"2023-08-11T12:22:31.726437+0000","last_unstale":"2023-08-11T12:22:31.728022+0000","last_undegraded":"2023-08-11T12:22:31.728022+0000","last_fullsized":"2023-08-11T12:22:31.728022+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:33:56.005318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717500+0000","last_change":"2023-08-11T12:22:03.842249+0000","last_active":"2023-08-11T12:22:31.717500+0000","last_peered":"2023-08-11T12:22:31.717500+0000","last_clean":"2023-08-11T12:22:31.717500+0000","last_became_active":"2023-08-11T12:22:03.841887+0000","last_became_peered":"2023-08-11T12:22:03.841887+0000","last_unstale":"2023-08-11T12:22:31.717500+0000","last_undegraded":"2023-08-11T12:22:31.717500+0000","last_fullsized":"2023-08-11T12:22:31.717500+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:24:16.685728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718746+0000","last_change":"2023-08-11T12:22:03.843859+0000","last_active":"2023-08-11T12:22:31.718746+0000","last_peered":"2023-08-11T12:22:31.718746+0000","last_clean":"2023-08-11T12:22:31.718746+0000","last_became_active":"2023-08-11T12:22:03.843383+0000","last_became_peered":"2023-08-11T12:22:03.843383+0000","last_unstale":"2023-08-11T12:22:31.718746+0000","last_undegraded":"2023-08-11T12:22:31.718746+0000","last_fullsized":"2023-08-11T12:22:31.718746+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:19:55.006972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.726241+0000","last_change":"2023-08-11T12:22:31.726241+0000","last_active":"2023-08-11T12:22:31.726241+0000","last_peered":"2023-08-11T12:22:31.726241+0000","last_clean":"2023-08-11T12:22:31.726241+0000","last_became_active":"2023-08-11T12:22:31.725852+0000","last_became_peered":"2023-08-11T12:22:31.725852+0000","last_unstale":"2023-08-11T12:22:31.726241+0000","last_undegraded":"2023-08-11T12:22:31.726241+0000","last_fullsized":"2023-08-11T12:22:31.726241+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:37:58.350171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774047+0000","last_change":"2023-08-11T12:22:03.850397+0000","last_active":"2023-08-11T12:22:31.774047+0000","last_peered":"2023-08-11T12:22:31.774047+0000","last_clean":"2023-08-11T12:22:31.774047+0000","last_became_active":"2023-08-11T12:22:03.850143+0000","last_became_peered":"2023-08-11T12:22:03.850143+0000","last_unstale":"2023-08-11T12:22:31.774047+0000","last_undegraded":"2023-08-11T12:22:31.774047+0000","last_fullsized":"2023-08-11T12:22:31.774047+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:13:22.558148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721002+0000","last_change":"2023-08-11T12:22:03.850496+0000","last_active":"2023-08-11T12:22:31.721002+0000","last_peered":"2023-08-11T12:22:31.721002+0000","last_clean":"2023-08-11T12:22:31.721002+0000","last_became_active":"2023-08-11T12:22:03.850192+0000","last_became_peered":"2023-08-11T12:22:03.850192+0000","last_unstale":"2023-08-11T12:22:31.721002+0000","last_undegraded":"2023-08-11T12:22:31.721002+0000","last_fullsized":"2023-08-11T12:22:31.721002+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:54:50.626326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722136+0000","last_change":"2023-08-11T12:22:03.841706+0000","last_active":"2023-08-11T12:22:31.722136+0000","last_peered":"2023-08-11T12:22:31.722136+0000","last_clean":"2023-08-11T12:22:31.722136+0000","last_became_active":"2023-08-11T12:22:03.841341+0000","last_became_peered":"2023-08-11T12:22:03.841341+0000","last_unstale":"2023-08-11T12:22:31.722136+0000","last_undegraded":"2023-08-11T12:22:31.722136+0000","last_fullsized":"2023-08-11T12:22:31.722136+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:36:20.093373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722972+0000","last_change":"2023-08-11T12:22:03.834450+0000","last_active":"2023-08-11T12:22:31.722972+0000","last_peered":"2023-08-11T12:22:31.722972+0000","last_clean":"2023-08-11T12:22:31.722972+0000","last_became_active":"2023-08-11T12:22:03.834154+0000","last_became_peered":"2023-08-11T12:22:03.834154+0000","last_unstale":"2023-08-11T12:22:31.722972+0000","last_undegraded":"2023-08-11T12:22:31.722972+0000","last_fullsized":"2023-08-11T12:22:31.722972+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:08:49.920575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.727577+0000","last_change":"2023-08-11T12:22:31.727577+0000","last_active":"2023-08-11T12:22:31.727577+0000","last_peered":"2023-08-11T12:22:31.727577+0000","last_clean":"2023-08-11T12:22:31.727577+0000","last_became_active":"2023-08-11T12:22:31.727034+0000","last_became_peered":"2023-08-11T12:22:31.727034+0000","last_unstale":"2023-08-11T12:22:31.727577+0000","last_undegraded":"2023-08-11T12:22:31.727577+0000","last_fullsized":"2023-08-11T12:22:31.727577+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:14:44.681877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722809+0000","last_change":"2023-08-11T12:22:02.841759+0000","last_active":"2023-08-11T12:22:31.722809+0000","last_peered":"2023-08-11T12:22:31.722809+0000","last_clean":"2023-08-11T12:22:31.722809+0000","last_became_active":"2023-08-11T12:22:02.841326+0000","last_became_peered":"2023-08-11T12:22:02.841326+0000","last_unstale":"2023-08-11T12:22:31.722809+0000","last_undegraded":"2023-08-11T12:22:31.722809+0000","last_fullsized":"2023-08-11T12:22:31.722809+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:09:30.085287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.802211+0000","last_change":"2023-08-11T12:22:31.801910+0000","last_active":"2023-08-11T12:22:31.802211+0000","last_peered":"2023-08-11T12:22:31.802211+0000","last_clean":"2023-08-11T12:22:31.802211+0000","last_became_active":"2023-08-11T12:22:31.801479+0000","last_became_peered":"2023-08-11T12:22:31.801479+0000","last_unstale":"2023-08-11T12:22:31.802211+0000","last_undegraded":"2023-08-11T12:22:31.802211+0000","last_fullsized":"2023-08-11T12:22:31.802211+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:52:21.489431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720477+0000","last_change":"2023-08-11T12:22:07.875010+0000","last_active":"2023-08-11T12:22:31.720477+0000","last_peered":"2023-08-11T12:22:31.720477+0000","last_clean":"2023-08-11T12:22:31.720477+0000","last_became_active":"2023-08-11T12:22:07.874474+0000","last_became_peered":"2023-08-11T12:22:07.874474+0000","last_unstale":"2023-08-11T12:22:31.720477+0000","last_undegraded":"2023-08-11T12:22:31.720477+0000","last_fullsized":"2023-08-11T12:22:31.720477+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:41:20.795124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721140+0000","last_change":"2023-08-11T12:22:02.848299+0000","last_active":"2023-08-11T12:22:31.721140+0000","last_peered":"2023-08-11T12:22:31.721140+0000","last_clean":"2023-08-11T12:22:31.721140+0000","last_became_active":"2023-08-11T12:22:02.847869+0000","last_became_peered":"2023-08-11T12:22:02.847869+0000","last_unstale":"2023-08-11T12:22:31.721140+0000","last_undegraded":"2023-08-11T12:22:31.721140+0000","last_fullsized":"2023-08-11T12:22:31.721140+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:09:15.600582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719818+0000","last_change":"2023-08-11T12:22:03.841173+0000","last_active":"2023-08-11T12:22:31.719818+0000","last_peered":"2023-08-11T12:22:31.719818+0000","last_clean":"2023-08-11T12:22:31.719818+0000","last_became_active":"2023-08-11T12:22:03.840882+0000","last_became_peered":"2023-08-11T12:22:03.840882+0000","last_unstale":"2023-08-11T12:22:31.719818+0000","last_undegraded":"2023-08-11T12:22:31.719818+0000","last_fullsized":"2023-08-11T12:22:31.719818+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:50:28.937358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721470+0000","last_change":"2023-08-11T12:22:07.880756+0000","last_active":"2023-08-11T12:22:31.721470+0000","last_peered":"2023-08-11T12:22:31.721470+0000","last_clean":"2023-08-11T12:22:31.721470+0000","last_became_active":"2023-08-11T12:22:07.878866+0000","last_became_peered":"2023-08-11T12:22:07.878866+0000","last_unstale":"2023-08-11T12:22:31.721470+0000","last_undegraded":"2023-08-11T12:22:31.721470+0000","last_fullsized":"2023-08-11T12:22:31.721470+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:30:28.617039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'11","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.724264+0000","last_change":"2023-08-11T12:22:02.848543+0000","last_active":"2023-08-11T12:22:31.724264+0000","last_peered":"2023-08-11T12:22:31.724264+0000","last_clean":"2023-08-11T12:22:31.724264+0000","last_became_active":"2023-08-11T12:22:02.848008+0000","last_became_peered":"2023-08-11T12:22:02.848008+0000","last_unstale":"2023-08-11T12:22:31.724264+0000","last_undegraded":"2023-08-11T12:22:31.724264+0000","last_fullsized":"2023-08-11T12:22:31.724264+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:57:46.484932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774382+0000","last_change":"2023-08-11T12:22:03.843651+0000","last_active":"2023-08-11T12:22:31.774382+0000","last_peered":"2023-08-11T12:22:31.774382+0000","last_clean":"2023-08-11T12:22:31.774382+0000","last_became_active":"2023-08-11T12:22:03.843392+0000","last_became_peered":"2023-08-11T12:22:03.843392+0000","last_unstale":"2023-08-11T12:22:31.774382+0000","last_undegraded":"2023-08-11T12:22:31.774382+0000","last_fullsized":"2023-08-11T12:22:31.774382+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:27:25.825805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721058+0000","last_change":"2023-08-11T12:22:07.879373+0000","last_active":"2023-08-11T12:22:31.721058+0000","last_peered":"2023-08-11T12:22:31.721058+0000","last_clean":"2023-08-11T12:22:31.721058+0000","last_became_active":"2023-08-11T12:22:07.878929+0000","last_became_peered":"2023-08-11T12:22:07.878929+0000","last_unstale":"2023-08-11T12:22:31.721058+0000","last_undegraded":"2023-08-11T12:22:31.721058+0000","last_fullsized":"2023-08-11T12:22:31.721058+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:37:29.598815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723705+0000","last_change":"2023-08-11T12:22:02.841984+0000","last_active":"2023-08-11T12:22:31.723705+0000","last_peered":"2023-08-11T12:22:31.723705+0000","last_clean":"2023-08-11T12:22:31.723705+0000","last_became_active":"2023-08-11T12:22:02.841585+0000","last_became_peered":"2023-08-11T12:22:02.841585+0000","last_unstale":"2023-08-11T12:22:31.723705+0000","last_undegraded":"2023-08-11T12:22:31.723705+0000","last_fullsized":"2023-08-11T12:22:31.723705+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:18:28.740155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800688+0000","last_change":"2023-08-11T12:22:03.839381+0000","last_active":"2023-08-11T12:22:31.800688+0000","last_peered":"2023-08-11T12:22:31.800688+0000","last_clean":"2023-08-11T12:22:31.800688+0000","last_became_active":"2023-08-11T12:22:03.839091+0000","last_became_peered":"2023-08-11T12:22:03.839091+0000","last_unstale":"2023-08-11T12:22:31.800688+0000","last_undegraded":"2023-08-11T12:22:31.800688+0000","last_fullsized":"2023-08-11T12:22:31.800688+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:45:52.205138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722725+0000","last_change":"2023-08-11T12:22:07.881758+0000","last_active":"2023-08-11T12:22:31.722725+0000","last_peered":"2023-08-11T12:22:31.722725+0000","last_clean":"2023-08-11T12:22:31.722725+0000","last_became_active":"2023-08-11T12:22:07.881305+0000","last_became_peered":"2023-08-11T12:22:07.881305+0000","last_unstale":"2023-08-11T12:22:31.722725+0000","last_undegraded":"2023-08-11T12:22:31.722725+0000","last_fullsized":"2023-08-11T12:22:31.722725+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:25:48.595182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'5","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800586+0000","last_change":"2023-08-11T12:22:02.844138+0000","last_active":"2023-08-11T12:22:31.800586+0000","last_peered":"2023-08-11T12:22:31.800586+0000","last_clean":"2023-08-11T12:22:31.800586+0000","last_became_active":"2023-08-11T12:22:02.843234+0000","last_became_peered":"2023-08-11T12:22:02.843234+0000","last_unstale":"2023-08-11T12:22:31.800586+0000","last_undegraded":"2023-08-11T12:22:31.800586+0000","last_fullsized":"2023-08-11T12:22:31.800586+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:53:48.033181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723640+0000","last_change":"2023-08-11T12:22:03.845450+0000","last_active":"2023-08-11T12:22:31.723640+0000","last_peered":"2023-08-11T12:22:31.723640+0000","last_clean":"2023-08-11T12:22:31.723640+0000","last_became_active":"2023-08-11T12:22:03.845170+0000","last_became_peered":"2023-08-11T12:22:03.845170+0000","last_unstale":"2023-08-11T12:22:31.723640+0000","last_undegraded":"2023-08-11T12:22:31.723640+0000","last_fullsized":"2023-08-11T12:22:31.723640+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:35:09.789210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722268+0000","last_change":"2023-08-11T12:22:07.880663+0000","last_active":"2023-08-11T12:22:31.722268+0000","last_peered":"2023-08-11T12:22:31.722268+0000","last_clean":"2023-08-11T12:22:31.722268+0000","last_became_active":"2023-08-11T12:22:07.880282+0000","last_became_peered":"2023-08-11T12:22:07.880282+0000","last_unstale":"2023-08-11T12:22:31.722268+0000","last_undegraded":"2023-08-11T12:22:31.722268+0000","last_fullsized":"2023-08-11T12:22:31.722268+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:36:05.356885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"87'7","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721289+0000","last_change":"2023-08-11T12:22:02.842206+0000","last_active":"2023-08-11T12:22:31.721289+0000","last_peered":"2023-08-11T12:22:31.721289+0000","last_clean":"2023-08-11T12:22:31.721289+0000","last_became_active":"2023-08-11T12:22:02.841815+0000","last_became_peered":"2023-08-11T12:22:02.841815+0000","last_unstale":"2023-08-11T12:22:31.721289+0000","last_undegraded":"2023-08-11T12:22:31.721289+0000","last_fullsized":"2023-08-11T12:22:31.721289+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:15:01.305404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800934+0000","last_change":"2023-08-11T12:22:03.825886+0000","last_active":"2023-08-11T12:22:31.800934+0000","last_peered":"2023-08-11T12:22:31.800934+0000","last_clean":"2023-08-11T12:22:31.800934+0000","last_became_active":"2023-08-11T12:22:03.825645+0000","last_became_peered":"2023-08-11T12:22:03.825645+0000","last_unstale":"2023-08-11T12:22:31.800934+0000","last_undegraded":"2023-08-11T12:22:31.800934+0000","last_fullsized":"2023-08-11T12:22:31.800934+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:03:34.650801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720447+0000","last_change":"2023-08-11T12:22:07.890216+0000","last_active":"2023-08-11T12:22:31.720447+0000","last_peered":"2023-08-11T12:22:31.720447+0000","last_clean":"2023-08-11T12:22:31.720447+0000","last_became_active":"2023-08-11T12:22:07.889860+0000","last_became_peered":"2023-08-11T12:22:07.889860+0000","last_unstale":"2023-08-11T12:22:31.720447+0000","last_undegraded":"2023-08-11T12:22:31.720447+0000","last_fullsized":"2023-08-11T12:22:31.720447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:03:54.952887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.716962+0000","last_change":"2023-08-11T12:22:02.835703+0000","last_active":"2023-08-11T12:22:31.716962+0000","last_peered":"2023-08-11T12:22:31.716962+0000","last_clean":"2023-08-11T12:22:31.716962+0000","last_became_active":"2023-08-11T12:22:02.835300+0000","last_became_peered":"2023-08-11T12:22:02.835300+0000","last_unstale":"2023-08-11T12:22:31.716962+0000","last_undegraded":"2023-08-11T12:22:31.716962+0000","last_fullsized":"2023-08-11T12:22:31.716962+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:55:13.953193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720447+0000","last_change":"2023-08-11T12:22:03.835619+0000","last_active":"2023-08-11T12:22:31.720447+0000","last_peered":"2023-08-11T12:22:31.720447+0000","last_clean":"2023-08-11T12:22:31.720447+0000","last_became_active":"2023-08-11T12:22:03.835365+0000","last_became_peered":"2023-08-11T12:22:03.835365+0000","last_unstale":"2023-08-11T12:22:31.720447+0000","last_undegraded":"2023-08-11T12:22:31.720447+0000","last_fullsized":"2023-08-11T12:22:31.720447+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:36:40.129412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719371+0000","last_change":"2023-08-11T12:22:07.893736+0000","last_active":"2023-08-11T12:22:31.719371+0000","last_peered":"2023-08-11T12:22:31.719371+0000","last_clean":"2023-08-11T12:22:31.719371+0000","last_became_active":"2023-08-11T12:22:07.893160+0000","last_became_peered":"2023-08-11T12:22:07.893160+0000","last_unstale":"2023-08-11T12:22:31.719371+0000","last_undegraded":"2023-08-11T12:22:31.719371+0000","last_fullsized":"2023-08-11T12:22:31.719371+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:55:46.234346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800126+0000","last_change":"2023-08-11T12:22:02.843819+0000","last_active":"2023-08-11T12:22:31.800126+0000","last_peered":"2023-08-11T12:22:31.800126+0000","last_clean":"2023-08-11T12:22:31.800126+0000","last_became_active":"2023-08-11T12:22:02.843062+0000","last_became_peered":"2023-08-11T12:22:02.843062+0000","last_unstale":"2023-08-11T12:22:31.800126+0000","last_undegraded":"2023-08-11T12:22:31.800126+0000","last_fullsized":"2023-08-11T12:22:31.800126+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:59:34.378593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722599+0000","last_change":"2023-08-11T12:22:03.845985+0000","last_active":"2023-08-11T12:22:31.722599+0000","last_peered":"2023-08-11T12:22:31.722599+0000","last_clean":"2023-08-11T12:22:31.722599+0000","last_became_active":"2023-08-11T12:22:03.845274+0000","last_became_peered":"2023-08-11T12:22:03.845274+0000","last_unstale":"2023-08-11T12:22:31.722599+0000","last_undegraded":"2023-08-11T12:22:31.722599+0000","last_fullsized":"2023-08-11T12:22:31.722599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:51:23.239546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.775632+0000","last_change":"2023-08-11T12:22:31.775632+0000","last_active":"2023-08-11T12:22:31.775632+0000","last_peered":"2023-08-11T12:22:31.775632+0000","last_clean":"2023-08-11T12:22:31.775632+0000","last_became_active":"2023-08-11T12:22:31.775282+0000","last_became_peered":"2023-08-11T12:22:31.775282+0000","last_unstale":"2023-08-11T12:22:31.775632+0000","last_undegraded":"2023-08-11T12:22:31.775632+0000","last_fullsized":"2023-08-11T12:22:31.775632+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:59:53.378227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,8],"acting":[3,7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"87'4","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:34.686851+0000","last_change":"2023-08-11T12:22:02.836591+0000","last_active":"2023-08-11T12:22:34.686851+0000","last_peered":"2023-08-11T12:22:34.686851+0000","last_clean":"2023-08-11T12:22:34.686851+0000","last_became_active":"2023-08-11T12:22:02.836223+0000","last_became_peered":"2023-08-11T12:22:02.836223+0000","last_unstale":"2023-08-11T12:22:34.686851+0000","last_undegraded":"2023-08-11T12:22:34.686851+0000","last_fullsized":"2023-08-11T12:22:34.686851+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:30:37.183588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774757+0000","last_change":"2023-08-11T12:22:03.841719+0000","last_active":"2023-08-11T12:22:31.774757+0000","last_peered":"2023-08-11T12:22:31.774757+0000","last_clean":"2023-08-11T12:22:31.774757+0000","last_became_active":"2023-08-11T12:22:03.841381+0000","last_became_peered":"2023-08-11T12:22:03.841381+0000","last_unstale":"2023-08-11T12:22:31.774757+0000","last_undegraded":"2023-08-11T12:22:31.774757+0000","last_fullsized":"2023-08-11T12:22:31.774757+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:29:35.108655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721200+0000","last_change":"2023-08-11T12:22:07.889103+0000","last_active":"2023-08-11T12:22:31.721200+0000","last_peered":"2023-08-11T12:22:31.721200+0000","last_clean":"2023-08-11T12:22:31.721200+0000","last_became_active":"2023-08-11T12:22:07.888668+0000","last_became_peered":"2023-08-11T12:22:07.888668+0000","last_unstale":"2023-08-11T12:22:31.721200+0000","last_undegraded":"2023-08-11T12:22:31.721200+0000","last_fullsized":"2023-08-11T12:22:31.721200+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:55:40.004921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717773+0000","last_change":"2023-08-11T12:22:02.841934+0000","last_active":"2023-08-11T12:22:31.717773+0000","last_peered":"2023-08-11T12:22:31.717773+0000","last_clean":"2023-08-11T12:22:31.717773+0000","last_became_active":"2023-08-11T12:22:02.841598+0000","last_became_peered":"2023-08-11T12:22:02.841598+0000","last_unstale":"2023-08-11T12:22:31.717773+0000","last_undegraded":"2023-08-11T12:22:31.717773+0000","last_fullsized":"2023-08-11T12:22:31.717773+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:20:04.206298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719796+0000","last_change":"2023-08-11T12:22:03.848901+0000","last_active":"2023-08-11T12:22:31.719796+0000","last_peered":"2023-08-11T12:22:31.719796+0000","last_clean":"2023-08-11T12:22:31.719796+0000","last_became_active":"2023-08-11T12:22:03.848518+0000","last_became_peered":"2023-08-11T12:22:03.848518+0000","last_unstale":"2023-08-11T12:22:31.719796+0000","last_undegraded":"2023-08-11T12:22:31.719796+0000","last_fullsized":"2023-08-11T12:22:31.719796+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:20:08.007934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.775821+0000","last_change":"2023-08-11T12:22:31.775821+0000","last_active":"2023-08-11T12:22:31.775821+0000","last_peered":"2023-08-11T12:22:31.775821+0000","last_clean":"2023-08-11T12:22:31.775821+0000","last_became_active":"2023-08-11T12:22:31.775264+0000","last_became_peered":"2023-08-11T12:22:31.775264+0000","last_unstale":"2023-08-11T12:22:31.775821+0000","last_undegraded":"2023-08-11T12:22:31.775821+0000","last_fullsized":"2023-08-11T12:22:31.775821+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:28:22.561726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"87'5","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800805+0000","last_change":"2023-08-11T12:22:02.846492+0000","last_active":"2023-08-11T12:22:31.800805+0000","last_peered":"2023-08-11T12:22:31.800805+0000","last_clean":"2023-08-11T12:22:31.800805+0000","last_became_active":"2023-08-11T12:22:02.846174+0000","last_became_peered":"2023-08-11T12:22:02.846174+0000","last_unstale":"2023-08-11T12:22:31.800805+0000","last_undegraded":"2023-08-11T12:22:31.800805+0000","last_fullsized":"2023-08-11T12:22:31.800805+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:09:18.245164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774783+0000","last_change":"2023-08-11T12:22:03.840054+0000","last_active":"2023-08-11T12:22:31.774783+0000","last_peered":"2023-08-11T12:22:31.774783+0000","last_clean":"2023-08-11T12:22:31.774783+0000","last_became_active":"2023-08-11T12:22:03.839707+0000","last_became_peered":"2023-08-11T12:22:03.839707+0000","last_unstale":"2023-08-11T12:22:31.774783+0000","last_undegraded":"2023-08-11T12:22:31.774783+0000","last_fullsized":"2023-08-11T12:22:31.774783+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:47:30.898127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.802304+0000","last_change":"2023-08-11T12:22:31.801931+0000","last_active":"2023-08-11T12:22:31.802304+0000","last_peered":"2023-08-11T12:22:31.802304+0000","last_clean":"2023-08-11T12:22:31.802304+0000","last_became_active":"2023-08-11T12:22:31.801522+0000","last_became_peered":"2023-08-11T12:22:31.801522+0000","last_unstale":"2023-08-11T12:22:31.802304+0000","last_undegraded":"2023-08-11T12:22:31.802304+0000","last_fullsized":"2023-08-11T12:22:31.802304+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:03:22.570814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.14","version":"88'14","reported_seq":54,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:34.686630+0000","last_change":"2023-08-11T12:22:02.836520+0000","last_active":"2023-08-11T12:22:34.686630+0000","last_peered":"2023-08-11T12:22:34.686630+0000","last_clean":"2023-08-11T12:22:34.686630+0000","last_became_active":"2023-08-11T12:22:02.836201+0000","last_became_peered":"2023-08-11T12:22:02.836201+0000","last_unstale":"2023-08-11T12:22:34.686630+0000","last_undegraded":"2023-08-11T12:22:34.686630+0000","last_fullsized":"2023-08-11T12:22:34.686630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:58:37.750229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723852+0000","last_change":"2023-08-11T12:22:03.848104+0000","last_active":"2023-08-11T12:22:31.723852+0000","last_peered":"2023-08-11T12:22:31.723852+0000","last_clean":"2023-08-11T12:22:31.723852+0000","last_became_active":"2023-08-11T12:22:03.847801+0000","last_became_peered":"2023-08-11T12:22:03.847801+0000","last_unstale":"2023-08-11T12:22:31.723852+0000","last_undegraded":"2023-08-11T12:22:31.723852+0000","last_fullsized":"2023-08-11T12:22:31.723852+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:56:47.846229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.801121+0000","last_change":"2023-08-11T12:22:07.893710+0000","last_active":"2023-08-11T12:22:31.801121+0000","last_peered":"2023-08-11T12:22:31.801121+0000","last_clean":"2023-08-11T12:22:31.801121+0000","last_became_active":"2023-08-11T12:22:07.893239+0000","last_became_peered":"2023-08-11T12:22:07.893239+0000","last_unstale":"2023-08-11T12:22:31.801121+0000","last_undegraded":"2023-08-11T12:22:31.801121+0000","last_fullsized":"2023-08-11T12:22:31.801121+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:24:55.563178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.724184+0000","last_change":"2023-08-11T12:22:02.849060+0000","last_active":"2023-08-11T12:22:31.724184+0000","last_peered":"2023-08-11T12:22:31.724184+0000","last_clean":"2023-08-11T12:22:31.724184+0000","last_became_active":"2023-08-11T12:22:02.848417+0000","last_became_peered":"2023-08-11T12:22:02.848417+0000","last_unstale":"2023-08-11T12:22:31.724184+0000","last_undegraded":"2023-08-11T12:22:31.724184+0000","last_fullsized":"2023-08-11T12:22:31.724184+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:48:47.925134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717206+0000","last_change":"2023-08-11T12:22:03.848532+0000","last_active":"2023-08-11T12:22:31.717206+0000","last_peered":"2023-08-11T12:22:31.717206+0000","last_clean":"2023-08-11T12:22:31.717206+0000","last_became_active":"2023-08-11T12:22:03.848190+0000","last_became_peered":"2023-08-11T12:22:03.848190+0000","last_unstale":"2023-08-11T12:22:31.717206+0000","last_undegraded":"2023-08-11T12:22:31.717206+0000","last_fullsized":"2023-08-11T12:22:31.717206+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:24:49.898432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720024+0000","last_change":"2023-08-11T12:22:07.882785+0000","last_active":"2023-08-11T12:22:31.720024+0000","last_peered":"2023-08-11T12:22:31.720024+0000","last_clean":"2023-08-11T12:22:31.720024+0000","last_became_active":"2023-08-11T12:22:07.880643+0000","last_became_peered":"2023-08-11T12:22:07.880643+0000","last_unstale":"2023-08-11T12:22:31.720024+0000","last_undegraded":"2023-08-11T12:22:31.720024+0000","last_fullsized":"2023-08-11T12:22:31.720024+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:40:21.114572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800501+0000","last_change":"2023-08-11T12:22:02.851416+0000","last_active":"2023-08-11T12:22:31.800501+0000","last_peered":"2023-08-11T12:22:31.800501+0000","last_clean":"2023-08-11T12:22:31.800501+0000","last_became_active":"2023-08-11T12:22:02.851114+0000","last_became_peered":"2023-08-11T12:22:02.851114+0000","last_unstale":"2023-08-11T12:22:31.800501+0000","last_undegraded":"2023-08-11T12:22:31.800501+0000","last_fullsized":"2023-08-11T12:22:31.800501+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:27:37.565292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717994+0000","last_change":"2023-08-11T12:22:03.849367+0000","last_active":"2023-08-11T12:22:31.717994+0000","last_peered":"2023-08-11T12:22:31.717994+0000","last_clean":"2023-08-11T12:22:31.717994+0000","last_became_active":"2023-08-11T12:22:03.849050+0000","last_became_peered":"2023-08-11T12:22:03.849050+0000","last_unstale":"2023-08-11T12:22:31.717994+0000","last_undegraded":"2023-08-11T12:22:31.717994+0000","last_fullsized":"2023-08-11T12:22:31.717994+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:54:43.936124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722616+0000","last_change":"2023-08-11T12:22:07.890992+0000","last_active":"2023-08-11T12:22:31.722616+0000","last_peered":"2023-08-11T12:22:31.722616+0000","last_clean":"2023-08-11T12:22:31.722616+0000","last_became_active":"2023-08-11T12:22:07.890384+0000","last_became_peered":"2023-08-11T12:22:07.890384+0000","last_unstale":"2023-08-11T12:22:31.722616+0000","last_undegraded":"2023-08-11T12:22:31.722616+0000","last_fullsized":"2023-08-11T12:22:31.722616+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:00:55.230221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"87'5","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:32.700702+0000","last_change":"2023-08-11T12:22:02.843045+0000","last_active":"2023-08-11T12:22:32.700702+0000","last_peered":"2023-08-11T12:22:32.700702+0000","last_clean":"2023-08-11T12:22:32.700702+0000","last_became_active":"2023-08-11T12:22:02.842628+0000","last_became_peered":"2023-08-11T12:22:02.842628+0000","last_unstale":"2023-08-11T12:22:32.700702+0000","last_undegraded":"2023-08-11T12:22:32.700702+0000","last_fullsized":"2023-08-11T12:22:32.700702+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:45:36.283695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717456+0000","last_change":"2023-08-11T12:22:03.842526+0000","last_active":"2023-08-11T12:22:31.717456+0000","last_peered":"2023-08-11T12:22:31.717456+0000","last_clean":"2023-08-11T12:22:31.717456+0000","last_became_active":"2023-08-11T12:22:03.842183+0000","last_became_peered":"2023-08-11T12:22:03.842183+0000","last_unstale":"2023-08-11T12:22:31.717456+0000","last_undegraded":"2023-08-11T12:22:31.717456+0000","last_fullsized":"2023-08-11T12:22:31.717456+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:20:56.195693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717389+0000","last_change":"2023-08-11T12:22:07.880768+0000","last_active":"2023-08-11T12:22:31.717389+0000","last_peered":"2023-08-11T12:22:31.717389+0000","last_clean":"2023-08-11T12:22:31.717389+0000","last_became_active":"2023-08-11T12:22:07.880335+0000","last_became_peered":"2023-08-11T12:22:07.880335+0000","last_unstale":"2023-08-11T12:22:31.717389+0000","last_undegraded":"2023-08-11T12:22:31.717389+0000","last_fullsized":"2023-08-11T12:22:31.717389+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:35:51.736025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721841+0000","last_change":"2023-08-11T12:22:02.847271+0000","last_active":"2023-08-11T12:22:31.721841+0000","last_peered":"2023-08-11T12:22:31.721841+0000","last_clean":"2023-08-11T12:22:31.721841+0000","last_became_active":"2023-08-11T12:22:02.846974+0000","last_became_peered":"2023-08-11T12:22:02.846974+0000","last_unstale":"2023-08-11T12:22:31.721841+0000","last_undegraded":"2023-08-11T12:22:31.721841+0000","last_fullsized":"2023-08-11T12:22:31.721841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:43:35.198876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800817+0000","last_change":"2023-08-11T12:22:03.838944+0000","last_active":"2023-08-11T12:22:31.800817+0000","last_peered":"2023-08-11T12:22:31.800817+0000","last_clean":"2023-08-11T12:22:31.800817+0000","last_became_active":"2023-08-11T12:22:03.838610+0000","last_became_peered":"2023-08-11T12:22:03.838610+0000","last_unstale":"2023-08-11T12:22:31.800817+0000","last_undegraded":"2023-08-11T12:22:31.800817+0000","last_fullsized":"2023-08-11T12:22:31.800817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:10:20.371629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800680+0000","last_change":"2023-08-11T12:22:07.888812+0000","last_active":"2023-08-11T12:22:31.800680+0000","last_peered":"2023-08-11T12:22:31.800680+0000","last_clean":"2023-08-11T12:22:31.800680+0000","last_became_active":"2023-08-11T12:22:07.888423+0000","last_became_peered":"2023-08-11T12:22:07.888423+0000","last_unstale":"2023-08-11T12:22:31.800680+0000","last_undegraded":"2023-08-11T12:22:31.800680+0000","last_fullsized":"2023-08-11T12:22:31.800680+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:07:17.536681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723473+0000","last_change":"2023-08-11T12:22:02.842591+0000","last_active":"2023-08-11T12:22:31.723473+0000","last_peered":"2023-08-11T12:22:31.723473+0000","last_clean":"2023-08-11T12:22:31.723473+0000","last_became_active":"2023-08-11T12:22:02.842249+0000","last_became_peered":"2023-08-11T12:22:02.842249+0000","last_unstale":"2023-08-11T12:22:31.723473+0000","last_undegraded":"2023-08-11T12:22:31.723473+0000","last_fullsized":"2023-08-11T12:22:31.723473+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:28:10.930413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.725791+0000","last_change":"2023-08-11T12:22:31.725791+0000","last_active":"2023-08-11T12:22:31.725791+0000","last_peered":"2023-08-11T12:22:31.725791+0000","last_clean":"2023-08-11T12:22:31.725791+0000","last_became_active":"2023-08-11T12:22:31.724950+0000","last_became_peered":"2023-08-11T12:22:31.724950+0000","last_unstale":"2023-08-11T12:22:31.725791+0000","last_undegraded":"2023-08-11T12:22:31.725791+0000","last_fullsized":"2023-08-11T12:22:31.725791+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:59:37.392626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723495+0000","last_change":"2023-08-11T12:22:08.068485+0000","last_active":"2023-08-11T12:22:31.723495+0000","last_peered":"2023-08-11T12:22:31.723495+0000","last_clean":"2023-08-11T12:22:31.723495+0000","last_became_active":"2023-08-11T12:22:08.068071+0000","last_became_peered":"2023-08-11T12:22:08.068071+0000","last_unstale":"2023-08-11T12:22:31.723495+0000","last_undegraded":"2023-08-11T12:22:31.723495+0000","last_fullsized":"2023-08-11T12:22:31.723495+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:35:49.958958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"87'1","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.727900+0000","last_change":"2023-08-11T12:22:31.727900+0000","last_active":"2023-08-11T12:22:31.727900+0000","last_peered":"2023-08-11T12:22:31.727900+0000","last_clean":"2023-08-11T12:22:31.727900+0000","last_became_active":"2023-08-11T12:22:31.727346+0000","last_became_peered":"2023-08-11T12:22:31.727346+0000","last_unstale":"2023-08-11T12:22:31.727900+0000","last_undegraded":"2023-08-11T12:22:31.727900+0000","last_fullsized":"2023-08-11T12:22:31.727900+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:12:21.170378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722892+0000","last_change":"2023-08-11T12:22:03.843434+0000","last_active":"2023-08-11T12:22:31.722892+0000","last_peered":"2023-08-11T12:22:31.722892+0000","last_clean":"2023-08-11T12:22:31.722892+0000","last_became_active":"2023-08-11T12:22:03.843117+0000","last_became_peered":"2023-08-11T12:22:03.843117+0000","last_unstale":"2023-08-11T12:22:31.722892+0000","last_undegraded":"2023-08-11T12:22:31.722892+0000","last_fullsized":"2023-08-11T12:22:31.722892+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:30:45.835632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717364+0000","last_change":"2023-08-11T12:22:07.889740+0000","last_active":"2023-08-11T12:22:31.717364+0000","last_peered":"2023-08-11T12:22:31.717364+0000","last_clean":"2023-08-11T12:22:31.717364+0000","last_became_active":"2023-08-11T12:22:07.889272+0000","last_became_peered":"2023-08-11T12:22:07.889272+0000","last_unstale":"2023-08-11T12:22:31.717364+0000","last_undegraded":"2023-08-11T12:22:31.717364+0000","last_fullsized":"2023-08-11T12:22:31.717364+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:48:06.207915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:33.705153+0000","last_change":"2023-08-11T12:22:02.846661+0000","last_active":"2023-08-11T12:22:33.705153+0000","last_peered":"2023-08-11T12:22:33.705153+0000","last_clean":"2023-08-11T12:22:33.705153+0000","last_became_active":"2023-08-11T12:22:02.846269+0000","last_became_peered":"2023-08-11T12:22:02.846269+0000","last_unstale":"2023-08-11T12:22:33.705153+0000","last_undegraded":"2023-08-11T12:22:33.705153+0000","last_fullsized":"2023-08-11T12:22:33.705153+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:06:18.229850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720867+0000","last_change":"2023-08-11T12:22:03.849653+0000","last_active":"2023-08-11T12:22:31.720867+0000","last_peered":"2023-08-11T12:22:31.720867+0000","last_clean":"2023-08-11T12:22:31.720867+0000","last_became_active":"2023-08-11T12:22:03.849303+0000","last_became_peered":"2023-08-11T12:22:03.849303+0000","last_unstale":"2023-08-11T12:22:31.720867+0000","last_undegraded":"2023-08-11T12:22:31.720867+0000","last_fullsized":"2023-08-11T12:22:31.720867+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:06:11.551259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717043+0000","last_change":"2023-08-11T12:22:08.068395+0000","last_active":"2023-08-11T12:22:31.717043+0000","last_peered":"2023-08-11T12:22:31.717043+0000","last_clean":"2023-08-11T12:22:31.717043+0000","last_became_active":"2023-08-11T12:22:08.067572+0000","last_became_peered":"2023-08-11T12:22:08.067572+0000","last_unstale":"2023-08-11T12:22:31.717043+0000","last_undegraded":"2023-08-11T12:22:31.717043+0000","last_fullsized":"2023-08-11T12:22:31.717043+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:17:59.273227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800419+0000","last_change":"2023-08-11T12:22:03.828971+0000","last_active":"2023-08-11T12:22:31.800419+0000","last_peered":"2023-08-11T12:22:31.800419+0000","last_clean":"2023-08-11T12:22:31.800419+0000","last_became_active":"2023-08-11T12:22:03.828653+0000","last_became_peered":"2023-08-11T12:22:03.828653+0000","last_unstale":"2023-08-11T12:22:31.800419+0000","last_undegraded":"2023-08-11T12:22:31.800419+0000","last_fullsized":"2023-08-11T12:22:31.800419+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:03:54.904360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:32.700215+0000","last_change":"2023-08-11T12:22:02.842419+0000","last_active":"2023-08-11T12:22:32.700215+0000","last_peered":"2023-08-11T12:22:32.700215+0000","last_clean":"2023-08-11T12:22:32.700215+0000","last_became_active":"2023-08-11T12:22:02.842105+0000","last_became_peered":"2023-08-11T12:22:02.842105+0000","last_unstale":"2023-08-11T12:22:32.700215+0000","last_undegraded":"2023-08-11T12:22:32.700215+0000","last_fullsized":"2023-08-11T12:22:32.700215+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:32:13.063912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717659+0000","last_change":"2023-08-11T12:22:07.880762+0000","last_active":"2023-08-11T12:22:31.717659+0000","last_peered":"2023-08-11T12:22:31.717659+0000","last_clean":"2023-08-11T12:22:31.717659+0000","last_became_active":"2023-08-11T12:22:07.880373+0000","last_became_peered":"2023-08-11T12:22:07.880373+0000","last_unstale":"2023-08-11T12:22:31.717659+0000","last_undegraded":"2023-08-11T12:22:31.717659+0000","last_fullsized":"2023-08-11T12:22:31.717659+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:07:06.457583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720306+0000","last_change":"2023-08-11T12:22:03.838555+0000","last_active":"2023-08-11T12:22:31.720306+0000","last_peered":"2023-08-11T12:22:31.720306+0000","last_clean":"2023-08-11T12:22:31.720306+0000","last_became_active":"2023-08-11T12:22:03.838135+0000","last_became_peered":"2023-08-11T12:22:03.838135+0000","last_unstale":"2023-08-11T12:22:31.720306+0000","last_undegraded":"2023-08-11T12:22:31.720306+0000","last_fullsized":"2023-08-11T12:22:31.720306+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:36:24.934863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:32.698313+0000","last_change":"2023-08-11T12:22:02.835093+0000","last_active":"2023-08-11T12:22:32.698313+0000","last_peered":"2023-08-11T12:22:32.698313+0000","last_clean":"2023-08-11T12:22:32.698313+0000","last_became_active":"2023-08-11T12:22:02.834545+0000","last_became_peered":"2023-08-11T12:22:02.834545+0000","last_unstale":"2023-08-11T12:22:32.698313+0000","last_undegraded":"2023-08-11T12:22:32.698313+0000","last_fullsized":"2023-08-11T12:22:32.698313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:21:54.371599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":354,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717267+0000","last_change":"2023-08-11T12:20:57.484190+0000","last_active":"2023-08-11T12:22:31.717267+0000","last_peered":"2023-08-11T12:22:31.717267+0000","last_clean":"2023-08-11T12:22:31.717267+0000","last_became_active":"2023-08-11T12:20:57.483655+0000","last_became_peered":"2023-08-11T12:20:57.483655+0000","last_unstale":"2023-08-11T12:22:31.717267+0000","last_undegraded":"2023-08-11T12:22:31.717267+0000","last_fullsized":"2023-08-11T12:22:31.717267+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:17:49.245488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:17:49.245488+0000","last_clean_scrub_stamp":"2023-08-11T12:17:49.245488+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:25:33.880946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800856+0000","last_change":"2023-08-11T12:22:08.068762+0000","last_active":"2023-08-11T12:22:31.800856+0000","last_peered":"2023-08-11T12:22:31.800856+0000","last_clean":"2023-08-11T12:22:31.800856+0000","last_became_active":"2023-08-11T12:22:08.068205+0000","last_became_peered":"2023-08-11T12:22:08.068205+0000","last_unstale":"2023-08-11T12:22:31.800856+0000","last_undegraded":"2023-08-11T12:22:31.800856+0000","last_fullsized":"2023-08-11T12:22:31.800856+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:55:06.744751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.716768+0000","last_change":"2023-08-11T12:22:03.837843+0000","last_active":"2023-08-11T12:22:31.716768+0000","last_peered":"2023-08-11T12:22:31.716768+0000","last_clean":"2023-08-11T12:22:31.716768+0000","last_became_active":"2023-08-11T12:22:03.837537+0000","last_became_peered":"2023-08-11T12:22:03.837537+0000","last_unstale":"2023-08-11T12:22:31.716768+0000","last_undegraded":"2023-08-11T12:22:31.716768+0000","last_fullsized":"2023-08-11T12:22:31.716768+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:17:41.517052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717347+0000","last_change":"2023-08-11T12:22:02.843150+0000","last_active":"2023-08-11T12:22:31.717347+0000","last_peered":"2023-08-11T12:22:31.717347+0000","last_clean":"2023-08-11T12:22:31.717347+0000","last_became_active":"2023-08-11T12:22:02.842829+0000","last_became_peered":"2023-08-11T12:22:02.842829+0000","last_unstale":"2023-08-11T12:22:31.717347+0000","last_undegraded":"2023-08-11T12:22:31.717347+0000","last_fullsized":"2023-08-11T12:22:31.717347+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:09:48.420755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720687+0000","last_change":"2023-08-11T12:22:07.883050+0000","last_active":"2023-08-11T12:22:31.720687+0000","last_peered":"2023-08-11T12:22:31.720687+0000","last_clean":"2023-08-11T12:22:31.720687+0000","last_became_active":"2023-08-11T12:22:07.882423+0000","last_became_peered":"2023-08-11T12:22:07.882423+0000","last_unstale":"2023-08-11T12:22:31.720687+0000","last_undegraded":"2023-08-11T12:22:31.720687+0000","last_fullsized":"2023-08-11T12:22:31.720687+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:14:51.848070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.724001+0000","last_change":"2023-08-11T12:22:02.850632+0000","last_active":"2023-08-11T12:22:31.724001+0000","last_peered":"2023-08-11T12:22:31.724001+0000","last_clean":"2023-08-11T12:22:31.724001+0000","last_became_active":"2023-08-11T12:22:02.850312+0000","last_became_peered":"2023-08-11T12:22:02.850312+0000","last_unstale":"2023-08-11T12:22:31.724001+0000","last_undegraded":"2023-08-11T12:22:31.724001+0000","last_fullsized":"2023-08-11T12:22:31.724001+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:54:50.288288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717639+0000","last_change":"2023-08-11T12:22:03.839869+0000","last_active":"2023-08-11T12:22:31.717639+0000","last_peered":"2023-08-11T12:22:31.717639+0000","last_clean":"2023-08-11T12:22:31.717639+0000","last_became_active":"2023-08-11T12:22:03.839486+0000","last_became_peered":"2023-08-11T12:22:03.839486+0000","last_unstale":"2023-08-11T12:22:31.717639+0000","last_undegraded":"2023-08-11T12:22:31.717639+0000","last_fullsized":"2023-08-11T12:22:31.717639+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:23:04.341624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720307+0000","last_change":"2023-08-11T12:22:08.066877+0000","last_active":"2023-08-11T12:22:31.720307+0000","last_peered":"2023-08-11T12:22:31.720307+0000","last_clean":"2023-08-11T12:22:31.720307+0000","last_became_active":"2023-08-11T12:22:08.066418+0000","last_became_peered":"2023-08-11T12:22:08.066418+0000","last_unstale":"2023-08-11T12:22:31.720307+0000","last_undegraded":"2023-08-11T12:22:31.720307+0000","last_fullsized":"2023-08-11T12:22:31.720307+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:12:43.228455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'7","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722268+0000","last_change":"2023-08-11T12:22:02.850505+0000","last_active":"2023-08-11T12:22:31.722268+0000","last_peered":"2023-08-11T12:22:31.722268+0000","last_clean":"2023-08-11T12:22:31.722268+0000","last_became_active":"2023-08-11T12:22:02.850104+0000","last_became_peered":"2023-08-11T12:22:02.850104+0000","last_unstale":"2023-08-11T12:22:31.722268+0000","last_undegraded":"2023-08-11T12:22:31.722268+0000","last_fullsized":"2023-08-11T12:22:31.722268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:33:50.319404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721594+0000","last_change":"2023-08-11T12:22:03.837580+0000","last_active":"2023-08-11T12:22:31.721594+0000","last_peered":"2023-08-11T12:22:31.721594+0000","last_clean":"2023-08-11T12:22:31.721594+0000","last_became_active":"2023-08-11T12:22:03.837256+0000","last_became_peered":"2023-08-11T12:22:03.837256+0000","last_unstale":"2023-08-11T12:22:31.721594+0000","last_undegraded":"2023-08-11T12:22:31.721594+0000","last_fullsized":"2023-08-11T12:22:31.721594+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:07:44.899244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722304+0000","last_change":"2023-08-11T12:22:07.873613+0000","last_active":"2023-08-11T12:22:31.722304+0000","last_peered":"2023-08-11T12:22:31.722304+0000","last_clean":"2023-08-11T12:22:31.722304+0000","last_became_active":"2023-08-11T12:22:07.873149+0000","last_became_peered":"2023-08-11T12:22:07.873149+0000","last_unstale":"2023-08-11T12:22:31.722304+0000","last_undegraded":"2023-08-11T12:22:31.722304+0000","last_fullsized":"2023-08-11T12:22:31.722304+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:38:35.678888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722476+0000","last_change":"2023-08-11T12:22:02.843146+0000","last_active":"2023-08-11T12:22:31.722476+0000","last_peered":"2023-08-11T12:22:31.722476+0000","last_clean":"2023-08-11T12:22:31.722476+0000","last_became_active":"2023-08-11T12:22:02.842663+0000","last_became_peered":"2023-08-11T12:22:02.842663+0000","last_unstale":"2023-08-11T12:22:31.722476+0000","last_undegraded":"2023-08-11T12:22:31.722476+0000","last_fullsized":"2023-08-11T12:22:31.722476+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:32:13.084100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719503+0000","last_change":"2023-08-11T12:22:03.847351+0000","last_active":"2023-08-11T12:22:31.719503+0000","last_peered":"2023-08-11T12:22:31.719503+0000","last_clean":"2023-08-11T12:22:31.719503+0000","last_became_active":"2023-08-11T12:22:03.847044+0000","last_became_peered":"2023-08-11T12:22:03.847044+0000","last_unstale":"2023-08-11T12:22:31.719503+0000","last_undegraded":"2023-08-11T12:22:31.719503+0000","last_fullsized":"2023-08-11T12:22:31.719503+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:17:19.004762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721751+0000","last_change":"2023-08-11T12:22:08.068459+0000","last_active":"2023-08-11T12:22:31.721751+0000","last_peered":"2023-08-11T12:22:31.721751+0000","last_clean":"2023-08-11T12:22:31.721751+0000","last_became_active":"2023-08-11T12:22:08.067857+0000","last_became_peered":"2023-08-11T12:22:08.067857+0000","last_unstale":"2023-08-11T12:22:31.721751+0000","last_undegraded":"2023-08-11T12:22:31.721751+0000","last_fullsized":"2023-08-11T12:22:31.721751+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:15:05.931547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774122+0000","last_change":"2023-08-11T12:22:02.846441+0000","last_active":"2023-08-11T12:22:31.774122+0000","last_peered":"2023-08-11T12:22:31.774122+0000","last_clean":"2023-08-11T12:22:31.774122+0000","last_became_active":"2023-08-11T12:22:02.846153+0000","last_became_peered":"2023-08-11T12:22:02.846153+0000","last_unstale":"2023-08-11T12:22:31.774122+0000","last_undegraded":"2023-08-11T12:22:31.774122+0000","last_fullsized":"2023-08-11T12:22:31.774122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:00:55.631058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723349+0000","last_change":"2023-08-11T12:22:03.841932+0000","last_active":"2023-08-11T12:22:31.723349+0000","last_peered":"2023-08-11T12:22:31.723349+0000","last_clean":"2023-08-11T12:22:31.723349+0000","last_became_active":"2023-08-11T12:22:03.841635+0000","last_became_peered":"2023-08-11T12:22:03.841635+0000","last_unstale":"2023-08-11T12:22:31.723349+0000","last_undegraded":"2023-08-11T12:22:31.723349+0000","last_fullsized":"2023-08-11T12:22:31.723349+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:01:57.888877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722748+0000","last_change":"2023-08-11T12:22:07.886160+0000","last_active":"2023-08-11T12:22:31.722748+0000","last_peered":"2023-08-11T12:22:31.722748+0000","last_clean":"2023-08-11T12:22:31.722748+0000","last_became_active":"2023-08-11T12:22:07.885703+0000","last_became_peered":"2023-08-11T12:22:07.885703+0000","last_unstale":"2023-08-11T12:22:31.722748+0000","last_undegraded":"2023-08-11T12:22:31.722748+0000","last_fullsized":"2023-08-11T12:22:31.722748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:50:20.362829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720503+0000","last_change":"2023-08-11T12:22:02.849360+0000","last_active":"2023-08-11T12:22:31.720503+0000","last_peered":"2023-08-11T12:22:31.720503+0000","last_clean":"2023-08-11T12:22:31.720503+0000","last_became_active":"2023-08-11T12:22:02.849028+0000","last_became_peered":"2023-08-11T12:22:02.849028+0000","last_unstale":"2023-08-11T12:22:31.720503+0000","last_undegraded":"2023-08-11T12:22:31.720503+0000","last_fullsized":"2023-08-11T12:22:31.720503+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:55:24.114464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719824+0000","last_change":"2023-08-11T12:22:03.850285+0000","last_active":"2023-08-11T12:22:31.719824+0000","last_peered":"2023-08-11T12:22:31.719824+0000","last_clean":"2023-08-11T12:22:31.719824+0000","last_became_active":"2023-08-11T12:22:03.849978+0000","last_became_peered":"2023-08-11T12:22:03.849978+0000","last_unstale":"2023-08-11T12:22:31.719824+0000","last_undegraded":"2023-08-11T12:22:31.719824+0000","last_fullsized":"2023-08-11T12:22:31.719824+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:29:51.679282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721058+0000","last_change":"2023-08-11T12:22:07.881578+0000","last_active":"2023-08-11T12:22:31.721058+0000","last_peered":"2023-08-11T12:22:31.721058+0000","last_clean":"2023-08-11T12:22:31.721058+0000","last_became_active":"2023-08-11T12:22:07.881145+0000","last_became_peered":"2023-08-11T12:22:07.881145+0000","last_unstale":"2023-08-11T12:22:31.721058+0000","last_undegraded":"2023-08-11T12:22:31.721058+0000","last_fullsized":"2023-08-11T12:22:31.721058+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:32:16.462208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"89'2","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722664+0000","last_change":"2023-08-11T12:22:02.848875+0000","last_active":"2023-08-11T12:22:31.722664+0000","last_peered":"2023-08-11T12:22:31.722664+0000","last_clean":"2023-08-11T12:22:31.722664+0000","last_became_active":"2023-08-11T12:22:02.848578+0000","last_became_peered":"2023-08-11T12:22:02.848578+0000","last_unstale":"2023-08-11T12:22:31.722664+0000","last_undegraded":"2023-08-11T12:22:31.722664+0000","last_fullsized":"2023-08-11T12:22:31.722664+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:29:40.949795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721051+0000","last_change":"2023-08-11T12:22:03.849865+0000","last_active":"2023-08-11T12:22:31.721051+0000","last_peered":"2023-08-11T12:22:31.721051+0000","last_clean":"2023-08-11T12:22:31.721051+0000","last_became_active":"2023-08-11T12:22:03.849557+0000","last_became_peered":"2023-08-11T12:22:03.849557+0000","last_unstale":"2023-08-11T12:22:31.721051+0000","last_undegraded":"2023-08-11T12:22:31.721051+0000","last_fullsized":"2023-08-11T12:22:31.721051+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:49:27.142464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721537+0000","last_change":"2023-08-11T12:22:08.067009+0000","last_active":"2023-08-11T12:22:31.721537+0000","last_peered":"2023-08-11T12:22:31.721537+0000","last_clean":"2023-08-11T12:22:31.721537+0000","last_became_active":"2023-08-11T12:22:08.066477+0000","last_became_peered":"2023-08-11T12:22:08.066477+0000","last_unstale":"2023-08-11T12:22:31.721537+0000","last_undegraded":"2023-08-11T12:22:31.721537+0000","last_fullsized":"2023-08-11T12:22:31.721537+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:07:02.380225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.731106+0000","last_change":"2023-08-11T12:22:31.731106+0000","last_active":"2023-08-11T12:22:31.731106+0000","last_peered":"2023-08-11T12:22:31.731106+0000","last_clean":"2023-08-11T12:22:31.731106+0000","last_became_active":"2023-08-11T12:22:31.724944+0000","last_became_peered":"2023-08-11T12:22:31.724944+0000","last_unstale":"2023-08-11T12:22:31.731106+0000","last_undegraded":"2023-08-11T12:22:31.731106+0000","last_fullsized":"2023-08-11T12:22:31.731106+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:56:41.188015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718051+0000","last_change":"2023-08-11T12:22:03.848715+0000","last_active":"2023-08-11T12:22:31.718051+0000","last_peered":"2023-08-11T12:22:31.718051+0000","last_clean":"2023-08-11T12:22:31.718051+0000","last_became_active":"2023-08-11T12:22:03.848311+0000","last_became_peered":"2023-08-11T12:22:03.848311+0000","last_unstale":"2023-08-11T12:22:31.718051+0000","last_undegraded":"2023-08-11T12:22:31.718051+0000","last_fullsized":"2023-08-11T12:22:31.718051+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:45:14.152855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774112+0000","last_change":"2023-08-11T12:22:07.882566+0000","last_active":"2023-08-11T12:22:31.774112+0000","last_peered":"2023-08-11T12:22:31.774112+0000","last_clean":"2023-08-11T12:22:31.774112+0000","last_became_active":"2023-08-11T12:22:07.882198+0000","last_became_peered":"2023-08-11T12:22:07.882198+0000","last_unstale":"2023-08-11T12:22:31.774112+0000","last_undegraded":"2023-08-11T12:22:31.774112+0000","last_fullsized":"2023-08-11T12:22:31.774112+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:21:03.227408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"87'5","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:32.703084+0000","last_change":"2023-08-11T12:22:02.846424+0000","last_active":"2023-08-11T12:22:32.703084+0000","last_peered":"2023-08-11T12:22:32.703084+0000","last_clean":"2023-08-11T12:22:32.703084+0000","last_became_active":"2023-08-11T12:22:02.846063+0000","last_became_peered":"2023-08-11T12:22:02.846063+0000","last_unstale":"2023-08-11T12:22:32.703084+0000","last_undegraded":"2023-08-11T12:22:32.703084+0000","last_fullsized":"2023-08-11T12:22:32.703084+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:28:14.946971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717852+0000","last_change":"2023-08-11T12:22:03.845616+0000","last_active":"2023-08-11T12:22:31.717852+0000","last_peered":"2023-08-11T12:22:31.717852+0000","last_clean":"2023-08-11T12:22:31.717852+0000","last_became_active":"2023-08-11T12:22:03.845293+0000","last_became_peered":"2023-08-11T12:22:03.845293+0000","last_unstale":"2023-08-11T12:22:31.717852+0000","last_undegraded":"2023-08-11T12:22:31.717852+0000","last_fullsized":"2023-08-11T12:22:31.717852+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:28:30.374044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718737+0000","last_change":"2023-08-11T12:22:07.888963+0000","last_active":"2023-08-11T12:22:31.718737+0000","last_peered":"2023-08-11T12:22:31.718737+0000","last_clean":"2023-08-11T12:22:31.718737+0000","last_became_active":"2023-08-11T12:22:07.888513+0000","last_became_peered":"2023-08-11T12:22:07.888513+0000","last_unstale":"2023-08-11T12:22:31.718737+0000","last_undegraded":"2023-08-11T12:22:31.718737+0000","last_fullsized":"2023-08-11T12:22:31.718737+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:44:29.823122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800936+0000","last_change":"2023-08-11T12:22:02.850739+0000","last_active":"2023-08-11T12:22:31.800936+0000","last_peered":"2023-08-11T12:22:31.800936+0000","last_clean":"2023-08-11T12:22:31.800936+0000","last_became_active":"2023-08-11T12:22:02.850455+0000","last_became_peered":"2023-08-11T12:22:02.850455+0000","last_unstale":"2023-08-11T12:22:31.800936+0000","last_undegraded":"2023-08-11T12:22:31.800936+0000","last_fullsized":"2023-08-11T12:22:31.800936+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:37:48.954343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718121+0000","last_change":"2023-08-11T12:22:03.838834+0000","last_active":"2023-08-11T12:22:31.718121+0000","last_peered":"2023-08-11T12:22:31.718121+0000","last_clean":"2023-08-11T12:22:31.718121+0000","last_became_active":"2023-08-11T12:22:03.838435+0000","last_became_peered":"2023-08-11T12:22:03.838435+0000","last_unstale":"2023-08-11T12:22:31.718121+0000","last_undegraded":"2023-08-11T12:22:31.718121+0000","last_fullsized":"2023-08-11T12:22:31.718121+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:42:39.127547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.799908+0000","last_change":"2023-08-11T12:22:07.884481+0000","last_active":"2023-08-11T12:22:31.799908+0000","last_peered":"2023-08-11T12:22:31.799908+0000","last_clean":"2023-08-11T12:22:31.799908+0000","last_became_active":"2023-08-11T12:22:07.884084+0000","last_became_peered":"2023-08-11T12:22:07.884084+0000","last_unstale":"2023-08-11T12:22:31.799908+0000","last_undegraded":"2023-08-11T12:22:31.799908+0000","last_fullsized":"2023-08-11T12:22:31.799908+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:06:29.852022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717356+0000","last_change":"2023-08-11T12:22:02.849339+0000","last_active":"2023-08-11T12:22:31.717356+0000","last_peered":"2023-08-11T12:22:31.717356+0000","last_clean":"2023-08-11T12:22:31.717356+0000","last_became_active":"2023-08-11T12:22:02.848986+0000","last_became_peered":"2023-08-11T12:22:02.848986+0000","last_unstale":"2023-08-11T12:22:31.717356+0000","last_undegraded":"2023-08-11T12:22:31.717356+0000","last_fullsized":"2023-08-11T12:22:31.717356+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:00:28.458884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718009+0000","last_change":"2023-08-11T12:22:03.846301+0000","last_active":"2023-08-11T12:22:31.718009+0000","last_peered":"2023-08-11T12:22:31.718009+0000","last_clean":"2023-08-11T12:22:31.718009+0000","last_became_active":"2023-08-11T12:22:03.845990+0000","last_became_peered":"2023-08-11T12:22:03.845990+0000","last_unstale":"2023-08-11T12:22:31.718009+0000","last_undegraded":"2023-08-11T12:22:31.718009+0000","last_fullsized":"2023-08-11T12:22:31.718009+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:30:23.134555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719713+0000","last_change":"2023-08-11T12:22:03.836652+0000","last_active":"2023-08-11T12:22:31.719713+0000","last_peered":"2023-08-11T12:22:31.719713+0000","last_clean":"2023-08-11T12:22:31.719713+0000","last_became_active":"2023-08-11T12:22:03.836236+0000","last_became_peered":"2023-08-11T12:22:03.836236+0000","last_unstale":"2023-08-11T12:22:31.719713+0000","last_undegraded":"2023-08-11T12:22:31.719713+0000","last_fullsized":"2023-08-11T12:22:31.719713+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:15:43.477085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722669+0000","last_change":"2023-08-11T12:22:03.831318+0000","last_active":"2023-08-11T12:22:31.722669+0000","last_peered":"2023-08-11T12:22:31.722669+0000","last_clean":"2023-08-11T12:22:31.722669+0000","last_became_active":"2023-08-11T12:22:03.830670+0000","last_became_peered":"2023-08-11T12:22:03.830670+0000","last_unstale":"2023-08-11T12:22:31.722669+0000","last_undegraded":"2023-08-11T12:22:31.722669+0000","last_fullsized":"2023-08-11T12:22:31.722669+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:27:54.407934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722460+0000","last_change":"2023-08-11T12:22:03.841396+0000","last_active":"2023-08-11T12:22:31.722460+0000","last_peered":"2023-08-11T12:22:31.722460+0000","last_clean":"2023-08-11T12:22:31.722460+0000","last_became_active":"2023-08-11T12:22:03.841076+0000","last_became_peered":"2023-08-11T12:22:03.841076+0000","last_unstale":"2023-08-11T12:22:31.722460+0000","last_undegraded":"2023-08-11T12:22:31.722460+0000","last_fullsized":"2023-08-11T12:22:31.722460+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:14:14.365513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719065+0000","last_change":"2023-08-11T12:22:03.847266+0000","last_active":"2023-08-11T12:22:31.719065+0000","last_peered":"2023-08-11T12:22:31.719065+0000","last_clean":"2023-08-11T12:22:31.719065+0000","last_became_active":"2023-08-11T12:22:03.846898+0000","last_became_peered":"2023-08-11T12:22:03.846898+0000","last_unstale":"2023-08-11T12:22:31.719065+0000","last_undegraded":"2023-08-11T12:22:31.719065+0000","last_fullsized":"2023-08-11T12:22:31.719065+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:05:00.055352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717696+0000","last_change":"2023-08-11T12:22:03.843491+0000","last_active":"2023-08-11T12:22:31.717696+0000","last_peered":"2023-08-11T12:22:31.717696+0000","last_clean":"2023-08-11T12:22:31.717696+0000","last_became_active":"2023-08-11T12:22:03.843099+0000","last_became_peered":"2023-08-11T12:22:03.843099+0000","last_unstale":"2023-08-11T12:22:31.717696+0000","last_undegraded":"2023-08-11T12:22:31.717696+0000","last_fullsized":"2023-08-11T12:22:31.717696+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:24:27.850492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720347+0000","last_change":"2023-08-11T12:22:03.840508+0000","last_active":"2023-08-11T12:22:31.720347+0000","last_peered":"2023-08-11T12:22:31.720347+0000","last_clean":"2023-08-11T12:22:31.720347+0000","last_became_active":"2023-08-11T12:22:03.840160+0000","last_became_peered":"2023-08-11T12:22:03.840160+0000","last_unstale":"2023-08-11T12:22:31.720347+0000","last_undegraded":"2023-08-11T12:22:31.720347+0000","last_fullsized":"2023-08-11T12:22:31.720347+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:09:11.925192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723599+0000","last_change":"2023-08-11T12:22:03.843724+0000","last_active":"2023-08-11T12:22:31.723599+0000","last_peered":"2023-08-11T12:22:31.723599+0000","last_clean":"2023-08-11T12:22:31.723599+0000","last_became_active":"2023-08-11T12:22:03.843431+0000","last_became_peered":"2023-08-11T12:22:03.843431+0000","last_unstale":"2023-08-11T12:22:31.723599+0000","last_undegraded":"2023-08-11T12:22:31.723599+0000","last_fullsized":"2023-08-11T12:22:31.723599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:02:15.971280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721778+0000","last_change":"2023-08-11T12:22:03.831268+0000","last_active":"2023-08-11T12:22:31.721778+0000","last_peered":"2023-08-11T12:22:31.721778+0000","last_clean":"2023-08-11T12:22:31.721778+0000","last_became_active":"2023-08-11T12:22:03.830839+0000","last_became_peered":"2023-08-11T12:22:03.830839+0000","last_unstale":"2023-08-11T12:22:31.721778+0000","last_undegraded":"2023-08-11T12:22:31.721778+0000","last_fullsized":"2023-08-11T12:22:31.721778+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:25:09.422026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800266+0000","last_change":"2023-08-11T12:22:03.839227+0000","last_active":"2023-08-11T12:22:31.800266+0000","last_peered":"2023-08-11T12:22:31.800266+0000","last_clean":"2023-08-11T12:22:31.800266+0000","last_became_active":"2023-08-11T12:22:03.838526+0000","last_became_peered":"2023-08-11T12:22:03.838526+0000","last_unstale":"2023-08-11T12:22:31.800266+0000","last_undegraded":"2023-08-11T12:22:31.800266+0000","last_fullsized":"2023-08-11T12:22:31.800266+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:56:06.609931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720671+0000","last_change":"2023-08-11T12:22:03.834614+0000","last_active":"2023-08-11T12:22:31.720671+0000","last_peered":"2023-08-11T12:22:31.720671+0000","last_clean":"2023-08-11T12:22:31.720671+0000","last_became_active":"2023-08-11T12:22:03.834267+0000","last_became_peered":"2023-08-11T12:22:03.834267+0000","last_unstale":"2023-08-11T12:22:31.720671+0000","last_undegraded":"2023-08-11T12:22:31.720671+0000","last_fullsized":"2023-08-11T12:22:31.720671+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:05:00.003830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774418+0000","last_change":"2023-08-11T12:22:03.846504+0000","last_active":"2023-08-11T12:22:31.774418+0000","last_peered":"2023-08-11T12:22:31.774418+0000","last_clean":"2023-08-11T12:22:31.774418+0000","last_became_active":"2023-08-11T12:22:03.846156+0000","last_became_peered":"2023-08-11T12:22:03.846156+0000","last_unstale":"2023-08-11T12:22:31.774418+0000","last_undegraded":"2023-08-11T12:22:31.774418+0000","last_fullsized":"2023-08-11T12:22:31.774418+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:54:38.654858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717285+0000","last_change":"2023-08-11T12:22:03.849854+0000","last_active":"2023-08-11T12:22:31.717285+0000","last_peered":"2023-08-11T12:22:31.717285+0000","last_clean":"2023-08-11T12:22:31.717285+0000","last_became_active":"2023-08-11T12:22:03.849553+0000","last_became_peered":"2023-08-11T12:22:03.849553+0000","last_unstale":"2023-08-11T12:22:31.717285+0000","last_undegraded":"2023-08-11T12:22:31.717285+0000","last_fullsized":"2023-08-11T12:22:31.717285+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:14:27.485150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720171+0000","last_change":"2023-08-11T12:22:03.843511+0000","last_active":"2023-08-11T12:22:31.720171+0000","last_peered":"2023-08-11T12:22:31.720171+0000","last_clean":"2023-08-11T12:22:31.720171+0000","last_became_active":"2023-08-11T12:22:03.843206+0000","last_became_peered":"2023-08-11T12:22:03.843206+0000","last_unstale":"2023-08-11T12:22:31.720171+0000","last_undegraded":"2023-08-11T12:22:31.720171+0000","last_fullsized":"2023-08-11T12:22:31.720171+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:19:44.978907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":248338,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10264,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":207,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":64,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":30792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":181,"ondisk_log_size":181,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449107,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":484340,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.54500000000000004}]},{"osd":1,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.626}]},{"osd":2,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.79100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":4,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.67500000000000004}]},{"osd":5,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.997}]},{"osd":6,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.81899999999999995}]},{"osd":7,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.86499999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":9,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.071}]},{"osd":10,"last update":"Fri Aug 11 12:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.94499999999999995}]}]},{"osd":10,"up_from":71,"seq":304942678037,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1064960,"data_stored":1078813,"data_compressed":53533,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":1,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.34300000000000003}]},{"osd":2,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.63},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.69999999999999996}]},{"osd":3,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.64100000000000001}]},{"osd":4,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.44}]},{"osd":5,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.66400000000000003}]},{"osd":6,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.74199999999999999}]},{"osd":7,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.59099999999999997}]},{"osd":8,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.68100000000000005}]},{"osd":9,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.70999999999999996}]},{"osd":11,"last update":"Fri Aug 11 12:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.874}]}]},{"osd":9,"up_from":66,"seq":283467841561,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":484270,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.624}]},{"osd":2,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.79600000000000004}]},{"osd":3,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.71599999999999997}]},{"osd":4,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.69899999999999995}]},{"osd":5,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.754}]},{"osd":6,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.66900000000000004}]},{"osd":8,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.80900000000000005}]},{"osd":10,"last update":"Fri Aug 11 12:21:54 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.90900000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]}]},{"osd":8,"up_from":58,"seq":249108103200,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":484648,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.45700000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.75700000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72199999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.58599999999999997}]},{"osd":1,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.443,"5min":0.372,"15min":0.372},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.73499999999999999}]},{"osd":2,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.437,"15min":0.42699999999999999},"min":{"1min":0.34100000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.45000000000000001,"15min":0.439},"min":{"1min":0.32500000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.76900000000000002,"5min":0.878,"15min":0.878},"last":0.63400000000000001}]},{"osd":3,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63700000000000001,"15min":0.63900000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82399999999999995,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.61899999999999999,"15min":0.60999999999999999},"min":{"1min":0.42899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.83999999999999997}]},{"osd":4,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.44500000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.66200000000000003,"15min":0.65200000000000002},"min":{"1min":0.49299999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.93500000000000005}]},{"osd":5,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.54300000000000004,"15min":0.52900000000000003},"min":{"1min":0.34899999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.57899999999999996,"15min":0.56299999999999994},"min":{"1min":0.40600000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.752}]},{"osd":6,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.69799999999999995,"15min":0.68500000000000005},"min":{"1min":0.51300000000000001,"5min":0.441,"15min":0.441},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.72599999999999998,"15min":0.71499999999999997},"min":{"1min":0.59499999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.68700000000000006}]},{"osd":7,"last update":"Fri Aug 11 12:22:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.70699999999999996,"15min":0.69099999999999995},"min":{"1min":0.54200000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72299999999999998,"15min":0.71299999999999997},"min":{"1min":0.48899999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.92000000000000004}]},{"osd":9,"last update":"Fri Aug 11 12:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.88600000000000001}]},{"osd":10,"last update":"Fri Aug 11 12:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":1.0089999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]}]},{"osd":7,"up_from":51,"seq":219043332131,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1040384,"data_stored":1076385,"data_compressed":53533,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.61399999999999999,"15min":0.60599999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.55200000000000005,"15min":0.53700000000000003},"min":{"1min":0.46999999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.65700000000000003}]},{"osd":1,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.41099999999999998,"15min":0.40100000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.443},{"interface":"front","average":{"1min":0.502,"5min":0.45000000000000001,"15min":0.442},"min":{"1min":0.312,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.46999999999999997}]},{"osd":2,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.42899999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.625},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.59099999999999997,"15min":0.57999999999999996},"min":{"1min":0.498,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80900000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.60499999999999998}]},{"osd":3,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.61499999999999999,"15min":0.60699999999999998},"min":{"1min":0.432,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.64000000000000001,"15min":0.626},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.72699999999999998}]},{"osd":4,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.54400000000000004,"15min":0.53600000000000003},"min":{"1min":0.36199999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53800000000000003,"15min":0.53500000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.0149999999999999,"5min":1.105,"15min":1.105},"last":0.504}]},{"osd":5,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.66300000000000003,"15min":0.65600000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.66200000000000003,"15min":0.65600000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.81100000000000005}]},{"osd":6,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.73299999999999998,"15min":0.71699999999999997},"min":{"1min":0.59399999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.70199999999999996,"15min":0.68500000000000005},"min":{"1min":0.59399999999999997,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.59399999999999997}]},{"osd":8,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.70099999999999996,"15min":0.68300000000000005},"min":{"1min":0.56899999999999995,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.69399999999999995,"15min":0.68000000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.82599999999999996}]},{"osd":9,"last update":"Fri Aug 11 12:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.748}]},{"osd":10,"last update":"Fri Aug 11 12:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.69699999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]}]},{"osd":6,"up_from":46,"seq":197568495657,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":483870,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47499999999999998,"15min":0.46300000000000002},"min":{"1min":0.37,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.73599999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51800000000000002,"15min":0.50800000000000001},"min":{"1min":0.375,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61599999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.58899999999999997}]},{"osd":1,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.65400000000000003,"15min":0.63},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.878,"5min":1.327,"15min":1.327},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.69199999999999995,"15min":0.67500000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98599999999999999,"5min":1.206,"15min":1.206},"last":0.83599999999999997}]},{"osd":2,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.69199999999999995,"15min":0.68799999999999994},"min":{"1min":0.51000000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98399999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.63},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.70599999999999996,"15min":0.69299999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.64700000000000002}]},{"osd":3,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59699999999999998,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67400000000000004,"15min":0.66200000000000003},"min":{"1min":0.48499999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.05,"5min":1.196,"15min":1.196},"last":0.871}]},{"osd":4,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69799999999999995,"15min":0.69599999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97199999999999998,"5min":1.139,"15min":1.139},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.752,"15min":0.74099999999999999},"min":{"1min":0.52600000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.012,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.57399999999999995}]},{"osd":5,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.77800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56599999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1499999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.748},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80600000000000005,"15min":0.80500000000000005},"min":{"1min":0.59299999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0109999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.68400000000000005}]},{"osd":7,"last update":"Fri Aug 11 12:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.81599999999999995,"15min":0.80400000000000005},"min":{"1min":0.59199999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.177,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.82099999999999995,"15min":0.81299999999999994},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.79200000000000004}]},{"osd":8,"last update":"Fri Aug 11 12:22:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.83199999999999996,"15min":0.83699999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.079,"5min":1.284,"15min":1.284},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.877,"15min":0.88500000000000001},"min":{"1min":0.65500000000000003,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1839999999999999,"5min":1.387,"15min":1.387},"last":0.89700000000000002}]},{"osd":9,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.91600000000000004}]},{"osd":10,"last update":"Fri Aug 11 12:21:54 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.81599999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":488742,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.53400000000000003,"15min":0.51200000000000001},"min":{"1min":0.35099999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.96099999999999997,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.55500000000000005,"15min":0.56299999999999994},"min":{"1min":0.378,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.83199999999999996,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.59999999999999998}]},{"osd":2,"last update":"Fri Aug 11 12:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.40699999999999997,"5min":0.315,"15min":0.315},"max":{"1min":0.76000000000000001,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.53800000000000003,"15min":0.51100000000000001},"min":{"1min":0.40300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79400000000000004,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.72699999999999998}]},{"osd":3,"last update":"Fri Aug 11 12:22:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80700000000000005,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65600000000000003,"15min":0.63200000000000001},"min":{"1min":0.49099999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90600000000000003,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.78400000000000003}]},{"osd":4,"last update":"Fri Aug 11 12:21:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46200000000000002,"15min":0.44500000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.745,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.47699999999999998,"15min":0.47299999999999998},"min":{"1min":0.26500000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.628}]},{"osd":5,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.63,"15min":0.60799999999999998},"min":{"1min":0.44,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89000000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.60899999999999999,"15min":0.60099999999999998},"min":{"1min":0.48399999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.81299999999999994}]},{"osd":6,"last update":"Fri Aug 11 12:22:31 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.73299999999999998,"15min":0.73599999999999999},"min":{"1min":0.59299999999999997,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0720000000000001,"5min":1.095,"15min":1.095},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.79600000000000004,"15min":0.78800000000000003},"min":{"1min":0.57999999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.147,"5min":1.159,"15min":1.159},"last":0.84699999999999998}]},{"osd":7,"last update":"Fri Aug 11 12:21:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.35799999999999998,"5min":0.31,"15min":0.31},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":1.0369999999999999}]},{"osd":8,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72799999999999998,"15min":0.72199999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93400000000000005,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.74199999999999999,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.436,"15min":0.436},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.92500000000000004}]},{"osd":9,"last update":"Fri Aug 11 12:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":1.133}]},{"osd":10,"last update":"Fri Aug 11 12:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":1.1080000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.90200000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]}]},{"osd":0,"up_from":8,"seq":34359738436,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":485326,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 11 12:21:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.57799999999999996,"15min":0.52800000000000002},"min":{"1min":0.42899999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.96699999999999997,"5min":1.782,"15min":1.782},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.58799999999999997,"15min":0.53800000000000003},"min":{"1min":0.46400000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.069,"5min":2.7749999999999999,"15min":2.7749999999999999},"last":0.751}]},{"osd":2,"last update":"Fri Aug 11 12:21:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59399999999999997,"15min":0.55300000000000005},"min":{"1min":0.40799999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.63400000000000001,"15min":0.57799999999999996},"min":{"1min":0.46400000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94699999999999995,"5min":1.879,"15min":1.879},"last":0.77000000000000002}]},{"osd":3,"last update":"Fri Aug 11 12:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.49399999999999999,"15min":0.48099999999999998},"min":{"1min":0.40500000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.59699999999999998}]},{"osd":4,"last update":"Fri Aug 11 12:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.66100000000000003,"15min":0.61199999999999999},"min":{"1min":0.503,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.016,"5min":1.849,"15min":1.849},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.67800000000000005,"15min":0.63100000000000001},"min":{"1min":0.54600000000000004,"5min":0.443,"15min":0.443},"max":{"1min":1.085,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":0.81599999999999995}]},{"osd":5,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.71899999999999997,"15min":0.68999999999999995},"min":{"1min":0.54800000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.99399999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.748,"15min":0.71999999999999997},"min":{"1min":0.55200000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1020000000000001,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.85899999999999999}]},{"osd":6,"last update":"Fri Aug 11 12:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97699999999999998,"5min":2.8839999999999999,"15min":2.8839999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.70999999999999996,"15min":0.71599999999999997},"min":{"1min":0.41299999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.95799999999999996,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.88900000000000001}]},{"osd":7,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83799999999999997,"15min":0.83699999999999997},"min":{"1min":0.55400000000000005,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.409,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.91500000000000004,"15min":0.92600000000000005},"min":{"1min":0.61399999999999999,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.385,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":1.0369999999999999}]},{"osd":8,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.82899999999999996,"15min":0.84399999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.91800000000000004,"5min":1.262,"15min":1.262},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.92200000000000004,"15min":0.93700000000000006},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.079,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.96099999999999997}]},{"osd":9,"last update":"Fri Aug 11 12:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.997},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.018}]},{"osd":10,"last update":"Fri Aug 11 12:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.97999999999999998}]},{"osd":11,"last update":"Fri Aug 11 12:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":1.091},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":1.115}]}]},{"osd":2,"up_from":18,"seq":77309411387,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":488293,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.60899999999999999,"15min":0.54400000000000004},"min":{"1min":0.39100000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.80900000000000005,"5min":5.968,"15min":5.968},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.40600000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.56899999999999995}]},{"osd":1,"last update":"Fri Aug 11 12:21:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.52400000000000002,"15min":0.502},"min":{"1min":0.38200000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.55000000000000004,"15min":0.52300000000000002},"min":{"1min":0.45600000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.62}]},{"osd":3,"last update":"Fri Aug 11 12:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61299999999999999,"15min":0.59699999999999998},"min":{"1min":0.45800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.623,"15min":0.59899999999999998},"min":{"1min":0.46899999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.77200000000000002}]},{"osd":4,"last update":"Fri Aug 11 12:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.57799999999999996,"15min":0.56799999999999995},"min":{"1min":0.441,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59999999999999998,"15min":0.58699999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.63500000000000001}]},{"osd":5,"last update":"Fri Aug 11 12:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.44400000000000001,"15min":0.42799999999999999},"min":{"1min":0.31,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.46800000000000003,"15min":0.44800000000000001},"min":{"1min":0.32800000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.52000000000000002}]},{"osd":6,"last update":"Fri Aug 11 12:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64000000000000001,"15min":0.624},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.66200000000000003,"15min":0.626},"min":{"1min":0.504,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.66400000000000003}]},{"osd":7,"last update":"Fri Aug 11 12:21:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.59799999999999998,"15min":0.58399999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.53100000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.80300000000000005}]},{"osd":8,"last update":"Fri Aug 11 12:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.60299999999999998,"15min":0.58899999999999997},"min":{"1min":0.40000000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.749},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.57399999999999995,"15min":0.56000000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.73699999999999999}]},{"osd":9,"last update":"Fri Aug 11 12:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.85099999999999998}]},{"osd":10,"last update":"Fri Aug 11 12:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.878}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]}]},{"osd":3,"up_from":25,"seq":107374182454,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":483578,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.437,"15min":0.38700000000000001},"min":{"1min":0.33900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.499,"5min":0.46999999999999997,"15min":0.438},"min":{"1min":0.36299999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67300000000000004,"5min":1.006,"15min":1.006},"last":0.51200000000000001}]},{"osd":1,"last update":"Fri Aug 11 12:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64200000000000002,"15min":0.57399999999999995},"min":{"1min":0.48399999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.98599999999999999,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.63200000000000001,"15min":0.59299999999999997},"min":{"1min":0.45100000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92200000000000004,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.78000000000000003}]},{"osd":2,"last update":"Fri Aug 11 12:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.64700000000000002,"15min":0.61799999999999999},"min":{"1min":0.54600000000000004,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85099999999999998,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.69699999999999995,"15min":0.63},"min":{"1min":0.56299999999999994,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.79400000000000004}]},{"osd":4,"last update":"Fri Aug 11 12:21:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.64000000000000001,"15min":0.60799999999999998},"min":{"1min":0.53100000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.68899999999999995,"15min":0.63700000000000001},"min":{"1min":0.67200000000000004,"5min":0.435,"15min":0.435},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.90200000000000002}]},{"osd":5,"last update":"Fri Aug 11 12:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.68899999999999995,"15min":0.65100000000000002},"min":{"1min":0.629,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.70899999999999996,"15min":0.66900000000000004},"min":{"1min":0.60899999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.83199999999999996}]},{"osd":6,"last update":"Fri Aug 11 12:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78000000000000003,"15min":0.76200000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0760000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.72399999999999998,"15min":0.71399999999999997},"min":{"1min":0.49099999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0309999999999999,"5min":1.056,"15min":1.056},"last":0.72099999999999997}]},{"osd":7,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.78300000000000003,"15min":0.76400000000000001},"min":{"1min":0.65800000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.89900000000000002,"15min":0.88500000000000001},"min":{"1min":0.71799999999999997,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":1.0860000000000001}]},{"osd":8,"last update":"Fri Aug 11 12:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":1.1240000000000001},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.85099999999999998}]},{"osd":9,"last update":"Fri Aug 11 12:21:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.92600000000000005}]},{"osd":10,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]}]},{"osd":4,"up_from":33,"seq":141733920818,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":483848,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.39900000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.81599999999999995,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.41399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80900000000000005,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.72099999999999997}]},{"osd":1,"last update":"Fri Aug 11 12:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.40400000000000003,"15min":0.39600000000000002},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.432,"5min":0.38700000000000001,"15min":0.372},"min":{"1min":0.308,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.379}]},{"osd":2,"last update":"Fri Aug 11 12:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.59699999999999998,"15min":0.57299999999999995},"min":{"1min":0.48599999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.755},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.58699999999999997,"15min":0.55900000000000005},"min":{"1min":0.54400000000000004,"5min":0.378,"15min":0.378},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.63900000000000001}]},{"osd":3,"last update":"Fri Aug 11 12:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.57699999999999996,"15min":0.55900000000000005},"min":{"1min":0.439,"5min":0.379,"15min":0.379},"max":{"1min":0.77300000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.437},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.41099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.77700000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.56399999999999995}]},{"osd":5,"last update":"Fri Aug 11 12:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.59499999999999997,"15min":0.56699999999999995},"min":{"1min":0.42199999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.60899999999999999,"15min":0.57599999999999996},"min":{"1min":0.42099999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.59699999999999998}]},{"osd":6,"last update":"Fri Aug 11 12:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.71399999999999997,"15min":0.69599999999999995},"min":{"1min":0.53400000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.63,"15min":0.61599999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.5}]},{"osd":7,"last update":"Fri Aug 11 12:21:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.58599999999999997,"15min":0.57099999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.64500000000000002,"15min":0.629},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.52200000000000002}]},{"osd":8,"last update":"Fri Aug 11 12:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.76200000000000001,"15min":0.749},"min":{"1min":0.63900000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.65400000000000003}]},{"osd":9,"last update":"Fri Aug 11 12:22:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.85199999999999998,"15min":0.84099999999999997},"min":{"1min":0.626,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.874,"5min":0.83399999999999996,"15min":0.82799999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.67000000000000004}]},{"osd":10,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.62}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]},{"osd":5,"up_from":38,"seq":163208757293,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1056768,"data_stored":1076336,"data_compressed":53533,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.51900000000000002},"min":{"1min":0.32200000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70599999999999996,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.5,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35399999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.624,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.74399999999999999}]},{"osd":1,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.38100000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77500000000000002,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.57699999999999996,"15min":0.56100000000000005},"min":{"1min":0.42099999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.83499999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.88200000000000001}]},{"osd":2,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.29799999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.5},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.41399999999999998,"15min":0.39800000000000002},"min":{"1min":0.27700000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.46999999999999997}]},{"osd":3,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72299999999999998,"5min":0.751,"15min":0.751},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.41199999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.77500000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.624}]},{"osd":4,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.61199999999999999,"15min":0.59199999999999997},"min":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1,"5min":1.016,"15min":1.016},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60899999999999999,"15min":0.60299999999999998},"min":{"1min":0.443,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.83299999999999996}]},{"osd":6,"last update":"Fri Aug 11 12:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.623,"15min":0.61099999999999999},"min":{"1min":0.40300000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89300000000000002,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.68100000000000005,"15min":0.66800000000000004},"min":{"1min":0.499,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.71999999999999997}]},{"osd":7,"last update":"Fri Aug 11 12:21:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.47199999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.81200000000000006}]},{"osd":8,"last update":"Fri Aug 11 12:22:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.60299999999999998,"15min":0.59299999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.56499999999999995,"15min":0.55800000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59499999999999997}]},{"osd":9,"last update":"Fri Aug 11 12:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.78000000000000003}]},{"osd":10,"last update":"Fri Aug 11 12:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.89700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34304,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34304,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":5578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-11T12:22:37.878 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-11T12:22:37.879 INFO:tasks.cephadm:Setting up client nodes... 2023-08-11T12:22:37.879 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-08-11T12:22:37.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:37 smithi194 ceph-mon[130905]: pgmap v292: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 6.0 KiB/s wr, 27 op/s; 0 B/s, 0 objects/s recovering 2023-08-11T12:22:37.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:37 smithi045 ceph-mon[130284]: pgmap v292: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 6.0 KiB/s wr, 27 op/s; 0 B/s, 0 objects/s recovering 2023-08-11T12:22:37.941 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:37 smithi008 ceph-mon[97158]: pgmap v292: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 6.0 KiB/s wr, 27 op/s; 0 B/s, 0 objects/s recovering 2023-08-11T12:22:38.613 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:22:39.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:39 smithi008 ceph-mon[97158]: from='client.24857 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:22:39.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:39 smithi008 ceph-mon[97158]: pgmap v293: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.7 KiB/s wr, 24 op/s; 0 B/s, 0 objects/s recovering 2023-08-11T12:22:39.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:39 smithi194 ceph-mon[130905]: from='client.24857 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:22:39.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:39 smithi194 ceph-mon[130905]: pgmap v293: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.7 KiB/s wr, 24 op/s; 0 B/s, 0 objects/s recovering 2023-08-11T12:22:39.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:39 smithi045 ceph-mon[130284]: from='client.24857 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:22:39.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:39 smithi045 ceph-mon[130284]: pgmap v293: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.7 KiB/s wr, 24 op/s; 0 B/s, 0 objects/s recovering 2023-08-11T12:22:40.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.143+0000 7fea7ee5e700 1 -- 172.21.15.8:0/725828070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea781009e0 msgr2=0x7fea78100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:40.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.143+0000 7fea7ee5e700 1 --2- 172.21.15.8:0/725828070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea781009e0 0x7fea78100e00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fea6c0099c0 tx=0x7fea6c009cd0 comp rx=0 tx=0).stop 2023-08-11T12:22:40.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.143+0000 7fea7ee5e700 1 -- 172.21.15.8:0/725828070 shutdown_connections 2023-08-11T12:22:40.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.143+0000 7fea7ee5e700 1 --2- 172.21.15.8:0/725828070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea78102580 0x7fea78108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:40.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.143+0000 7fea7ee5e700 1 --2- 172.21.15.8:0/725828070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea781009e0 0x7fea78100e00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:40.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.143+0000 7fea7ee5e700 1 --2- 172.21.15.8:0/725828070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea78101be0 0x7fea78102040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:40.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.143+0000 7fea7ee5e700 1 -- 172.21.15.8:0/725828070 >> 172.21.15.8:0/725828070 conn(0x7fea780fbfa0 msgr2=0x7fea780fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:40.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.143+0000 7fea7ee5e700 1 -- 172.21.15.8:0/725828070 shutdown_connections 2023-08-11T12:22:40.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.143+0000 7fea7ee5e700 1 -- 172.21.15.8:0/725828070 wait complete. 2023-08-11T12:22:40.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.144+0000 7fea7ee5e700 1 Processor -- start 2023-08-11T12:22:40.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.144+0000 7fea7ee5e700 1 -- start start 2023-08-11T12:22:40.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.145+0000 7fea7ee5e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea781009e0 0x7fea780746c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:40.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.145+0000 7fea7ee5e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea78101be0 0x7fea78072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:40.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.145+0000 7fea7ee5e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea78102580 0x7fea78073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:40.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.145+0000 7fea7ee5e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea780739d0 con 0x7fea781009e0 2023-08-11T12:22:40.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.145+0000 7fea7ee5e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea78073b40 con 0x7fea78101be0 2023-08-11T12:22:40.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.145+0000 7fea7ee5e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea781a0720 con 0x7fea78102580 2023-08-11T12:22:40.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.145+0000 7fea7cbfa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea781009e0 0x7fea780746c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:40.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.145+0000 7fea7cbfa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea781009e0 0x7fea780746c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43600/0 (socket says 172.21.15.8:43600) 2023-08-11T12:22:40.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.145+0000 7fea7cbfa700 1 -- 172.21.15.8:0/2388162068 learned_addr learned my addr 172.21.15.8:0/2388162068 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:40.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.145+0000 7fea77fff700 1 --2- 172.21.15.8:0/2388162068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea78101be0 0x7fea78072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:40.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.145+0000 7fea7d3fb700 1 --2- 172.21.15.8:0/2388162068 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea78102580 0x7fea78073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:40.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.145+0000 7fea7cbfa700 1 -- 172.21.15.8:0/2388162068 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea78102580 msgr2=0x7fea78073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:40.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.145+0000 7fea7cbfa700 1 --2- 172.21.15.8:0/2388162068 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea78102580 0x7fea78073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:40.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.145+0000 7fea7cbfa700 1 -- 172.21.15.8:0/2388162068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea78101be0 msgr2=0x7fea78072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:40.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.146+0000 7fea7cbfa700 1 --2- 172.21.15.8:0/2388162068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea78101be0 0x7fea78072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:40.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.146+0000 7fea7cbfa700 1 -- 172.21.15.8:0/2388162068 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6c0095f0 con 0x7fea781009e0 2023-08-11T12:22:40.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.146+0000 7fea7d3fb700 1 --2- 172.21.15.8:0/2388162068 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea78102580 0x7fea78073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:22:40.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.146+0000 7fea7cbfa700 1 --2- 172.21.15.8:0/2388162068 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea781009e0 0x7fea780746c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fea6c009fd0 tx=0x7fea6c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:40.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.146+0000 7fea75ffb700 1 -- 172.21.15.8:0/2388162068 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c01d070 con 0x7fea781009e0 2023-08-11T12:22:40.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.146+0000 7fea7ee5e700 1 -- 172.21.15.8:0/2388162068 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea781a09a0 con 0x7fea781009e0 2023-08-11T12:22:40.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.146+0000 7fea75ffb700 1 -- 172.21.15.8:0/2388162068 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea6c005510 con 0x7fea781009e0 2023-08-11T12:22:40.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.146+0000 7fea75ffb700 1 -- 172.21.15.8:0/2388162068 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c004b00 con 0x7fea781009e0 2023-08-11T12:22:40.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.146+0000 7fea7ee5e700 1 -- 172.21.15.8:0/2388162068 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea781a0e10 con 0x7fea781009e0 2023-08-11T12:22:40.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.147+0000 7fea7ee5e700 1 -- 172.21.15.8:0/2388162068 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea78107fe0 con 0x7fea781009e0 2023-08-11T12:22:40.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.149+0000 7fea75ffb700 1 -- 172.21.15.8:0/2388162068 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fea6c004ca0 con 0x7fea781009e0 2023-08-11T12:22:40.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.151+0000 7fea75ffb700 1 --2- 172.21.15.8:0/2388162068 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fea6809ffd0 0x7fea680a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:40.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.151+0000 7fea75ffb700 1 -- 172.21.15.8:0/2388162068 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fea6c0cc330 con 0x7fea781009e0 2023-08-11T12:22:40.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.151+0000 7fea77fff700 1 --2- 172.21.15.8:0/2388162068 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fea6809ffd0 0x7fea680a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:40.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.152+0000 7fea77fff700 1 --2- 172.21.15.8:0/2388162068 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fea6809ffd0 0x7fea680a2490 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fea64009c60 tx=0x7fea64009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:40.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.155+0000 7fea75ffb700 1 -- 172.21.15.8:0/2388162068 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fea6c095de0 con 0x7fea781009e0 2023-08-11T12:22:40.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.446+0000 7fea7ee5e700 1 -- 172.21.15.8:0/2388162068 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fea7802cd50 con 0x7fea781009e0 2023-08-11T12:22:40.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.450+0000 7fea75ffb700 1 -- 172.21.15.8:0/2388162068 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) v1 ==== 170+0+59 (secure 0 0 0) 0x7fea6c099400 con 0x7fea781009e0 2023-08-11T12:22:40.453 INFO:teuthology.orchestra.run.smithi008.stdout:[client.0] 2023-08-11T12:22:40.453 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQAQKNZkhIOkGhAA33tTa8zE0M8FEqtidiOskA== 2023-08-11T12:22:40.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.453+0000 7fea7ee5e700 1 -- 172.21.15.8:0/2388162068 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fea6809ffd0 msgr2=0x7fea680a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:40.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.453+0000 7fea7ee5e700 1 --2- 172.21.15.8:0/2388162068 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fea6809ffd0 0x7fea680a2490 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fea64009c60 tx=0x7fea64009260 comp rx=0 tx=0).stop 2023-08-11T12:22:40.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.453+0000 7fea7ee5e700 1 -- 172.21.15.8:0/2388162068 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea781009e0 msgr2=0x7fea780746c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:40.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.453+0000 7fea7ee5e700 1 --2- 172.21.15.8:0/2388162068 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea781009e0 0x7fea780746c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fea6c009fd0 tx=0x7fea6c00f690 comp rx=0 tx=0).stop 2023-08-11T12:22:40.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.453+0000 7fea7ee5e700 1 -- 172.21.15.8:0/2388162068 shutdown_connections 2023-08-11T12:22:40.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.453+0000 7fea7ee5e700 1 --2- 172.21.15.8:0/2388162068 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fea6809ffd0 0x7fea680a2490 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:40.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.453+0000 7fea7ee5e700 1 --2- 172.21.15.8:0/2388162068 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea78102580 0x7fea78073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:40.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.453+0000 7fea7ee5e700 1 --2- 172.21.15.8:0/2388162068 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea781009e0 0x7fea780746c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:40.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.453+0000 7fea7ee5e700 1 --2- 172.21.15.8:0/2388162068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea78101be0 0x7fea78072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:40.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.453+0000 7fea7ee5e700 1 -- 172.21.15.8:0/2388162068 >> 172.21.15.8:0/2388162068 conn(0x7fea780fbfa0 msgr2=0x7fea78105120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:40.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.453+0000 7fea7ee5e700 1 -- 172.21.15.8:0/2388162068 shutdown_connections 2023-08-11T12:22:40.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:40.453+0000 7fea7ee5e700 1 -- 172.21.15.8:0/2388162068 wait complete. 2023-08-11T12:22:40.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:40 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2388162068' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-08-11T12:22:40.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:40 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2388162068' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-08-11T12:22:40.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:40 smithi008 ceph-mon[97158]: pgmap v294: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5 KiB/s rd, 3.8 KiB/s wr, 21 op/s; 0 B/s, 0 objects/s recovering 2023-08-11T12:22:40.912 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-11T12:22:40.916 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-08-11T12:22:40.916 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-08-11T12:22:41.019 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-08-11T12:22:41.020 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-08-11T12:22:41.021 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph mgr dump --format=json 2023-08-11T12:22:41.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:40 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2388162068' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-08-11T12:22:41.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:40 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2388162068' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-08-11T12:22:41.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:40 smithi194 ceph-mon[130905]: pgmap v294: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5 KiB/s rd, 3.8 KiB/s wr, 21 op/s; 0 B/s, 0 objects/s recovering 2023-08-11T12:22:41.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:40 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2388162068' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-08-11T12:22:41.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:40 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2388162068' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-08-11T12:22:41.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:40 smithi045 ceph-mon[130284]: pgmap v294: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5 KiB/s rd, 3.8 KiB/s wr, 21 op/s; 0 B/s, 0 objects/s recovering 2023-08-11T12:22:41.791 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:22:43.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.366+0000 7f0bee4f6700 1 -- 172.21.15.8:0/3526356639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0be8104730 msgr2=0x7f0be8104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:43.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.366+0000 7f0bee4f6700 1 --2- 172.21.15.8:0/3526356639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0be8104730 0x7f0be8104b10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8009990 tx=0x7f0bd8009ca0 comp rx=0 tx=0).stop 2023-08-11T12:22:43.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.366+0000 7f0bee4f6700 1 -- 172.21.15.8:0/3526356639 shutdown_connections 2023-08-11T12:22:43.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.366+0000 7f0bee4f6700 1 --2- 172.21.15.8:0/3526356639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0be8100220 0x7f0be810c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:43.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.366+0000 7f0bee4f6700 1 --2- 172.21.15.8:0/3526356639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0be8104730 0x7f0be8104b10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:43.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.366+0000 7f0bee4f6700 1 --2- 172.21.15.8:0/3526356639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0be80ff860 0x7f0be80ffce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:43.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.366+0000 7f0bee4f6700 1 -- 172.21.15.8:0/3526356639 >> 172.21.15.8:0/3526356639 conn(0x7f0be8076920 msgr2=0x7f0be8076d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:43.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.366+0000 7f0bee4f6700 1 -- 172.21.15.8:0/3526356639 shutdown_connections 2023-08-11T12:22:43.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.366+0000 7f0bee4f6700 1 -- 172.21.15.8:0/3526356639 wait complete. 2023-08-11T12:22:43.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.367+0000 7f0bee4f6700 1 Processor -- start 2023-08-11T12:22:43.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.367+0000 7f0bee4f6700 1 -- start start 2023-08-11T12:22:43.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.367+0000 7f0bee4f6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0be80ff860 0x7f0be8195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:43.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.367+0000 7f0bee4f6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0be8100220 0x7f0be8195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:43.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.367+0000 7f0bee4f6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0be8104730 0x7f0be819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:43.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.367+0000 7f0bee4f6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be819ac20 con 0x7f0be80ff860 2023-08-11T12:22:43.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.367+0000 7f0bee4f6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be819ad90 con 0x7f0be8104730 2023-08-11T12:22:43.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.367+0000 7f0bee4f6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be819af50 con 0x7f0be8100220 2023-08-11T12:22:43.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.368+0000 7f0be7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0be80ff860 0x7f0be8195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:43.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.368+0000 7f0be7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0be80ff860 0x7f0be8195690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43622/0 (socket says 172.21.15.8:43622) 2023-08-11T12:22:43.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.368+0000 7f0be7fff700 1 -- 172.21.15.8:0/684887539 learned_addr learned my addr 172.21.15.8:0/684887539 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:43.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.368+0000 7f0be77fe700 1 --2- 172.21.15.8:0/684887539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0be8100220 0x7f0be8195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:43.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.368+0000 7f0beca93700 1 --2- 172.21.15.8:0/684887539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0be8104730 0x7f0be819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:43.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.368+0000 7f0be7fff700 1 -- 172.21.15.8:0/684887539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0be8100220 msgr2=0x7f0be8195bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:43.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.368+0000 7f0be7fff700 1 --2- 172.21.15.8:0/684887539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0be8100220 0x7f0be8195bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:43.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.368+0000 7f0be7fff700 1 -- 172.21.15.8:0/684887539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0be8104730 msgr2=0x7f0be819a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:43.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.368+0000 7f0be7fff700 1 --2- 172.21.15.8:0/684887539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0be8104730 0x7f0be819a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:43.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.368+0000 7f0be7fff700 1 -- 172.21.15.8:0/684887539 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd80095f0 con 0x7f0be80ff860 2023-08-11T12:22:43.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.368+0000 7f0beca93700 1 --2- 172.21.15.8:0/684887539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0be8104730 0x7f0be819a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:22:43.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.369+0000 7f0be7fff700 1 --2- 172.21.15.8:0/684887539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0be80ff860 0x7f0be8195690 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8000c00 tx=0x7f0bd80047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:43.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.369+0000 7f0be57fa700 1 -- 172.21.15.8:0/684887539 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd801d070 con 0x7f0be80ff860 2023-08-11T12:22:43.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.369+0000 7f0bee4f6700 1 -- 172.21.15.8:0/684887539 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be819b1d0 con 0x7f0be80ff860 2023-08-11T12:22:43.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.369+0000 7f0be57fa700 1 -- 172.21.15.8:0/684887539 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0bd800fb80 con 0x7f0be80ff860 2023-08-11T12:22:43.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.369+0000 7f0be57fa700 1 -- 172.21.15.8:0/684887539 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd80173f0 con 0x7f0be80ff860 2023-08-11T12:22:43.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.369+0000 7f0bee4f6700 1 -- 172.21.15.8:0/684887539 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be819b670 con 0x7f0be80ff860 2023-08-11T12:22:43.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.370+0000 7f0bee4f6700 1 -- 172.21.15.8:0/684887539 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0be804e620 con 0x7f0be80ff860 2023-08-11T12:22:43.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.372+0000 7f0be57fa700 1 -- 172.21.15.8:0/684887539 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f0bd800fcf0 con 0x7f0be80ff860 2023-08-11T12:22:43.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.373+0000 7f0be57fa700 1 --2- 172.21.15.8:0/684887539 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0bd009ff50 0x7f0bd00a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:43.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.374+0000 7f0be57fa700 1 -- 172.21.15.8:0/684887539 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f0bd80cc900 con 0x7f0be80ff860 2023-08-11T12:22:43.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.374+0000 7f0be77fe700 1 --2- 172.21.15.8:0/684887539 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0bd009ff50 0x7f0bd00a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:43.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.374+0000 7f0be77fe700 1 --2- 172.21.15.8:0/684887539 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0bd009ff50 0x7f0bd00a2410 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0be80694c0 tx=0x7f0bdc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:43.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.377+0000 7f0be57fa700 1 -- 172.21.15.8:0/684887539 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f0bd80963b0 con 0x7f0be80ff860 2023-08-11T12:22:43.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.645+0000 7f0bee4f6700 1 -- 172.21.15.8:0/684887539 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f0be819b890 con 0x7f0be80ff860 2023-08-11T12:22:43.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.650+0000 7f0be57fa700 1 -- 172.21.15.8:0/684887539 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v16) v1 ==== 74+0+258004 (secure 0 0 0) 0x7f0bd80999d0 con 0x7f0be80ff860 2023-08-11T12:22:43.657 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:22:43.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.655+0000 7f0bee4f6700 1 -- 172.21.15.8:0/684887539 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0bd009ff50 msgr2=0x7f0bd00a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:43.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.655+0000 7f0bee4f6700 1 --2- 172.21.15.8:0/684887539 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0bd009ff50 0x7f0bd00a2410 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0be80694c0 tx=0x7f0bdc00b410 comp rx=0 tx=0).stop 2023-08-11T12:22:43.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.655+0000 7f0bee4f6700 1 -- 172.21.15.8:0/684887539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0be80ff860 msgr2=0x7f0be8195690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:43.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.655+0000 7f0bee4f6700 1 --2- 172.21.15.8:0/684887539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0be80ff860 0x7f0be8195690 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8000c00 tx=0x7f0bd80047b0 comp rx=0 tx=0).stop 2023-08-11T12:22:43.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.656+0000 7f0bee4f6700 1 -- 172.21.15.8:0/684887539 shutdown_connections 2023-08-11T12:22:43.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.656+0000 7f0bee4f6700 1 --2- 172.21.15.8:0/684887539 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0bd009ff50 0x7f0bd00a2410 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:43.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.656+0000 7f0bee4f6700 1 --2- 172.21.15.8:0/684887539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0be8104730 0x7f0be819a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:43.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.656+0000 7f0bee4f6700 1 --2- 172.21.15.8:0/684887539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0be80ff860 0x7f0be8195690 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:43.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.656+0000 7f0bee4f6700 1 --2- 172.21.15.8:0/684887539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0be8100220 0x7f0be8195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:43.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.656+0000 7f0bee4f6700 1 -- 172.21.15.8:0/684887539 >> 172.21.15.8:0/684887539 conn(0x7f0be8076920 msgr2=0x7f0be80fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:43.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.656+0000 7f0bee4f6700 1 -- 172.21.15.8:0/684887539 shutdown_connections 2023-08-11T12:22:43.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:43.656+0000 7f0bee4f6700 1 -- 172.21.15.8:0/684887539 wait complete. 2023-08-11T12:22:43.820 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:43 smithi008 ceph-mon[97158]: pgmap v295: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.4 KiB/s wr, 21 op/s; 0 B/s, 0 objects/s recovering 2023-08-11T12:22:43.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:43 smithi194 ceph-mon[130905]: pgmap v295: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.4 KiB/s wr, 21 op/s; 0 B/s, 0 objects/s recovering 2023-08-11T12:22:43.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:43 smithi045 ceph-mon[130284]: pgmap v295: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.4 KiB/s wr, 21 op/s; 0 B/s, 0 objects/s recovering 2023-08-11T12:22:44.195 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":16,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":2041276411},{"type":"v1","addr":"172.21.15.8:6801","nonce":2041276411}]},"active_addr":"172.21.15.8:6801/2041276411","active_change":"2023-08-11T12:15:30.423884+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.8:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":2764282698}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":2132227156}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":3461107704}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":340114165}]}]} 2023-08-11T12:22:44.202 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-08-11T12:22:44.202 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-08-11T12:22:44.202 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph osd dump --format=json 2023-08-11T12:22:44.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:44 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/684887539' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-08-11T12:22:44.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:44 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/684887539' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-08-11T12:22:44.935 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:22:45.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:44 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/684887539' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-08-11T12:22:45.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:45 smithi008 ceph-mon[97158]: pgmap v296: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.0 KiB/s wr, 19 op/s; 0 B/s, 0 objects/s recovering 2023-08-11T12:22:45.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:45 smithi194 ceph-mon[130905]: pgmap v296: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.0 KiB/s wr, 19 op/s; 0 B/s, 0 objects/s recovering 2023-08-11T12:22:45.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:45 smithi045 ceph-mon[130284]: pgmap v296: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.0 KiB/s wr, 19 op/s; 0 B/s, 0 objects/s recovering 2023-08-11T12:22:46.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.472+0000 7f91d3014700 1 -- 172.21.15.8:0/1016276291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91cc100940 msgr2=0x7f91cc100dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:46.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.472+0000 7f91d3014700 1 --2- 172.21.15.8:0/1016276291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91cc100940 0x7f91cc100dc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009990 tx=0x7f91b8009ca0 comp rx=0 tx=0).stop 2023-08-11T12:22:46.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.472+0000 7f91d3014700 1 -- 172.21.15.8:0/1016276291 shutdown_connections 2023-08-11T12:22:46.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.472+0000 7f91d3014700 1 --2- 172.21.15.8:0/1016276291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91cc101300 0x7f91cc10d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:46.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.472+0000 7f91d3014700 1 --2- 172.21.15.8:0/1016276291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91cc106940 0x7f91cc106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:46.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.472+0000 7f91d3014700 1 --2- 172.21.15.8:0/1016276291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91cc100940 0x7f91cc100dc0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:46.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.472+0000 7f91d3014700 1 -- 172.21.15.8:0/1016276291 >> 172.21.15.8:0/1016276291 conn(0x7f91cc0fc410 msgr2=0x7f91cc0fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:46.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.472+0000 7f91d3014700 1 -- 172.21.15.8:0/1016276291 shutdown_connections 2023-08-11T12:22:46.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.472+0000 7f91d3014700 1 -- 172.21.15.8:0/1016276291 wait complete. 2023-08-11T12:22:46.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.474+0000 7f91d3014700 1 Processor -- start 2023-08-11T12:22:46.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.474+0000 7f91d3014700 1 -- start start 2023-08-11T12:22:46.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.475+0000 7f91d3014700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91cc100940 0x7f91cc19c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:46.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.475+0000 7f91d3014700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91cc101300 0x7f91cc19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:46.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.475+0000 7f91d3014700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91cc106940 0x7f91cc196890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:46.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.475+0000 7f91d3014700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc196f00 con 0x7f91cc100940 2023-08-11T12:22:46.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.475+0000 7f91d3014700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc197070 con 0x7f91cc106940 2023-08-11T12:22:46.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.475+0000 7f91d3014700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc197230 con 0x7f91cc101300 2023-08-11T12:22:46.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.475+0000 7f91d0db0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91cc100940 0x7f91cc19c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:46.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.475+0000 7f91cbfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91cc101300 0x7f91cc19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:46.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.475+0000 7f91d0db0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91cc100940 0x7f91cc19c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43642/0 (socket says 172.21.15.8:43642) 2023-08-11T12:22:46.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.475+0000 7f91d0db0700 1 -- 172.21.15.8:0/4270421140 learned_addr learned my addr 172.21.15.8:0/4270421140 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:46.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.475+0000 7f91d15b1700 1 --2- 172.21.15.8:0/4270421140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91cc106940 0x7f91cc196890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:46.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.475+0000 7f91cbfff700 1 -- 172.21.15.8:0/4270421140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91cc106940 msgr2=0x7f91cc196890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:46.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.475+0000 7f91cbfff700 1 --2- 172.21.15.8:0/4270421140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91cc106940 0x7f91cc196890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:46.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.475+0000 7f91cbfff700 1 -- 172.21.15.8:0/4270421140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91cc100940 msgr2=0x7f91cc19c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:46.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.475+0000 7f91cbfff700 1 --2- 172.21.15.8:0/4270421140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91cc100940 0x7f91cc19c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:46.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.475+0000 7f91cbfff700 1 -- 172.21.15.8:0/4270421140 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b80095f0 con 0x7f91cc101300 2023-08-11T12:22:46.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.476+0000 7f91cbfff700 1 --2- 172.21.15.8:0/4270421140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91cc101300 0x7f91cc19cd50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f91b80098e0 tx=0x7f91b8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:46.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.476+0000 7f91c9ffb700 1 -- 172.21.15.8:0/4270421140 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b801d070 con 0x7f91cc101300 2023-08-11T12:22:46.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.476+0000 7f91d3014700 1 -- 172.21.15.8:0/4270421140 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91cc1974b0 con 0x7f91cc101300 2023-08-11T12:22:46.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.476+0000 7f91c9ffb700 1 -- 172.21.15.8:0/4270421140 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91b8005030 con 0x7f91cc101300 2023-08-11T12:22:46.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.476+0000 7f91c9ffb700 1 -- 172.21.15.8:0/4270421140 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b8004ab0 con 0x7f91cc101300 2023-08-11T12:22:46.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.476+0000 7f91d3014700 1 -- 172.21.15.8:0/4270421140 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91cc1a3800 con 0x7f91cc101300 2023-08-11T12:22:46.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.477+0000 7f91d3014700 1 -- 172.21.15.8:0/4270421140 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91cc04e620 con 0x7f91cc101300 2023-08-11T12:22:46.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.480+0000 7f91c9ffb700 1 -- 172.21.15.8:0/4270421140 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f91b8005410 con 0x7f91cc101300 2023-08-11T12:22:46.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.481+0000 7f91c9ffb700 1 --2- 172.21.15.8:0/4270421140 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f91bc09ffd0 0x7f91bc0a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:46.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.481+0000 7f91c9ffb700 1 -- 172.21.15.8:0/4270421140 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f91b80cc700 con 0x7f91cc101300 2023-08-11T12:22:46.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.481+0000 7f91d0db0700 1 --2- 172.21.15.8:0/4270421140 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f91bc09ffd0 0x7f91bc0a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:46.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.482+0000 7f91d0db0700 1 --2- 172.21.15.8:0/4270421140 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f91bc09ffd0 0x7f91bc0a2490 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f91c0007c10 tx=0x7f91c0007480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:46.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.483+0000 7f91c9ffb700 1 -- 172.21.15.8:0/4270421140 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f91b80961b0 con 0x7f91cc101300 2023-08-11T12:22:46.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.695+0000 7f91d3014700 1 -- 172.21.15.8:0/4270421140 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91cc1109b0 con 0x7f91cc101300 2023-08-11T12:22:46.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.697+0000 7f91c9ffb700 1 -- 172.21.15.8:0/4270421140 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24348 (secure 0 0 0) 0x7f91b80997d0 con 0x7f91cc101300 2023-08-11T12:22:46.700 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:22:46.700 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":89,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","created":"2023-08-11T12:14:28.341113+0000","modified":"2023-08-11T12:22:31.713248+0000","last_up_change":"2023-08-11T12:21:14.913735+0000","last_in_change":"2023-08-11T12:20:57.476558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-11T12:17:49.040758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-11T12:22:01.383296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-11T12:22:02.816329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-11T12:22:06.369375+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f903e393-7894-42d6-8b11-737ceef1f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6803","nonce":664104961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6805","nonce":664104961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6809","nonce":664104961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6807","nonce":664104961}]},"public_addr":"172.21.15.8:6803/664104961","cluster_addr":"172.21.15.8:6805/664104961","heartbeat_back_addr":"172.21.15.8:6809/664104961","heartbeat_front_addr":"172.21.15.8:6807/664104961","state":["exists","up"]},{"osd":1,"uuid":"1e988e5c-e78c-46d5-80a5-dff7ac38cbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6801","nonce":4187350703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6803","nonce":4187350703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6807","nonce":4187350703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6805","nonce":4187350703}]},"public_addr":"172.21.15.45:6801/4187350703","cluster_addr":"172.21.15.45:6803/4187350703","heartbeat_back_addr":"172.21.15.45:6807/4187350703","heartbeat_front_addr":"172.21.15.45:6805/4187350703","state":["exists","up"]},{"osd":2,"uuid":"1835217c-a93c-4181-b8b8-cc410bab1a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6801","nonce":2547818140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6803","nonce":2547818140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6807","nonce":2547818140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6805","nonce":2547818140}]},"public_addr":"172.21.15.194:6801/2547818140","cluster_addr":"172.21.15.194:6803/2547818140","heartbeat_back_addr":"172.21.15.194:6807/2547818140","heartbeat_front_addr":"172.21.15.194:6805/2547818140","state":["exists","up"]},{"osd":3,"uuid":"b55ae61a-731c-4312-a998-661122b84788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6811","nonce":187418883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6813","nonce":187418883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6817","nonce":187418883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6815","nonce":187418883}]},"public_addr":"172.21.15.8:6811/187418883","cluster_addr":"172.21.15.8:6813/187418883","heartbeat_back_addr":"172.21.15.8:6817/187418883","heartbeat_front_addr":"172.21.15.8:6815/187418883","state":["exists","up"]},{"osd":4,"uuid":"2c28acbb-e807-4559-8aa2-a35ca84b5d43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6809","nonce":3099704571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6811","nonce":3099704571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6815","nonce":3099704571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6813","nonce":3099704571}]},"public_addr":"172.21.15.45:6809/3099704571","cluster_addr":"172.21.15.45:6811/3099704571","heartbeat_back_addr":"172.21.15.45:6815/3099704571","heartbeat_front_addr":"172.21.15.45:6813/3099704571","state":["exists","up"]},{"osd":5,"uuid":"37032289-8016-4730-9b69-f7985e058ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6809","nonce":263803874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6811","nonce":263803874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6815","nonce":263803874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6813","nonce":263803874}]},"public_addr":"172.21.15.194:6809/263803874","cluster_addr":"172.21.15.194:6811/263803874","heartbeat_back_addr":"172.21.15.194:6815/263803874","heartbeat_front_addr":"172.21.15.194:6813/263803874","state":["exists","up"]},{"osd":6,"uuid":"32d2dab9-6944-40d1-ada9-4f941821b063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6819","nonce":1802966829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6821","nonce":1802966829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6825","nonce":1802966829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6823","nonce":1802966829}]},"public_addr":"172.21.15.8:6819/1802966829","cluster_addr":"172.21.15.8:6821/1802966829","heartbeat_back_addr":"172.21.15.8:6825/1802966829","heartbeat_front_addr":"172.21.15.8:6823/1802966829","state":["exists","up"]},{"osd":7,"uuid":"086aff58-1554-49fe-92ff-5166b115aeef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6817","nonce":3715737148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6819","nonce":3715737148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6823","nonce":3715737148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6821","nonce":3715737148}]},"public_addr":"172.21.15.45:6817/3715737148","cluster_addr":"172.21.15.45:6819/3715737148","heartbeat_back_addr":"172.21.15.45:6823/3715737148","heartbeat_front_addr":"172.21.15.45:6821/3715737148","state":["exists","up"]},{"osd":8,"uuid":"7fff5e95-2453-4ea6-a5c1-3bba6a1f6400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6817","nonce":57497127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6819","nonce":57497127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6823","nonce":57497127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6821","nonce":57497127}]},"public_addr":"172.21.15.194:6817/57497127","cluster_addr":"172.21.15.194:6819/57497127","heartbeat_back_addr":"172.21.15.194:6823/57497127","heartbeat_front_addr":"172.21.15.194:6821/57497127","state":["exists","up"]},{"osd":9,"uuid":"31ab0121-4c92-42ec-9f19-e672062e8814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6827","nonce":434661930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6829","nonce":434661930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6833","nonce":434661930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6831","nonce":434661930}]},"public_addr":"172.21.15.8:6827/434661930","cluster_addr":"172.21.15.8:6829/434661930","heartbeat_back_addr":"172.21.15.8:6833/434661930","heartbeat_front_addr":"172.21.15.8:6831/434661930","state":["exists","up"]},{"osd":10,"uuid":"62c632e4-94f6-4630-9d94-8d28fccacf45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6825","nonce":3281212184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6827","nonce":3281212184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6831","nonce":3281212184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6829","nonce":3281212184}]},"public_addr":"172.21.15.45:6825/3281212184","cluster_addr":"172.21.15.45:6827/3281212184","heartbeat_back_addr":"172.21.15.45:6831/3281212184","heartbeat_front_addr":"172.21.15.45:6829/3281212184","state":["exists","up"]},{"osd":11,"uuid":"8ca4a80d-cd75-4230-b46d-aef6fdc03e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6825","nonce":1637875895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6827","nonce":1637875895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6831","nonce":1637875895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6829","nonce":1637875895}]},"public_addr":"172.21.15.194:6825/1637875895","cluster_addr":"172.21.15.194:6827/1637875895","heartbeat_back_addr":"172.21.15.194:6831/1637875895","heartbeat_front_addr":"172.21.15.194:6829/1637875895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:04.255616+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:26.243863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:46.630365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:12.926291+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:35.747049+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:55.793767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:21.685725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:43.703215+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:04.043674+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:30.320026+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:52.751974+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:21:13.230024+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/2000592056":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2102228072":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2374527928":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2928221278":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2744750874":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/3681755887":"2023-08-12T12:15:02.528403+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-11T12:22:46.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.699+0000 7f91d3014700 1 -- 172.21.15.8:0/4270421140 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f91bc09ffd0 msgr2=0x7f91bc0a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:46.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.699+0000 7f91d3014700 1 --2- 172.21.15.8:0/4270421140 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f91bc09ffd0 0x7f91bc0a2490 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f91c0007c10 tx=0x7f91c0007480 comp rx=0 tx=0).stop 2023-08-11T12:22:46.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.699+0000 7f91d3014700 1 -- 172.21.15.8:0/4270421140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91cc101300 msgr2=0x7f91cc19cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:46.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.699+0000 7f91d3014700 1 --2- 172.21.15.8:0/4270421140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91cc101300 0x7f91cc19cd50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f91b80098e0 tx=0x7f91b8004730 comp rx=0 tx=0).stop 2023-08-11T12:22:46.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.700+0000 7f91d3014700 1 -- 172.21.15.8:0/4270421140 shutdown_connections 2023-08-11T12:22:46.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.700+0000 7f91d3014700 1 --2- 172.21.15.8:0/4270421140 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f91bc09ffd0 0x7f91bc0a2490 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:46.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.700+0000 7f91d3014700 1 --2- 172.21.15.8:0/4270421140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91cc106940 0x7f91cc196890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:46.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.700+0000 7f91d3014700 1 --2- 172.21.15.8:0/4270421140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91cc100940 0x7f91cc19c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:46.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.700+0000 7f91d3014700 1 --2- 172.21.15.8:0/4270421140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91cc101300 0x7f91cc19cd50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:46.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.700+0000 7f91d3014700 1 -- 172.21.15.8:0/4270421140 >> 172.21.15.8:0/4270421140 conn(0x7f91cc0fc410 msgr2=0x7f91cc0fca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:46.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.700+0000 7f91d3014700 1 -- 172.21.15.8:0/4270421140 shutdown_connections 2023-08-11T12:22:46.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:46.700+0000 7f91d3014700 1 -- 172.21.15.8:0/4270421140 wait complete. 2023-08-11T12:22:47.227 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-08-11T12:22:47.227 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph osd dump --format=json 2023-08-11T12:22:47.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:47 smithi194 ceph-mon[130905]: pgmap v297: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 14 op/s; 0 B/s, 0 objects/s recovering 2023-08-11T12:22:47.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:47 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/4270421140' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:47.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:47 smithi045 ceph-mon[130284]: pgmap v297: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 14 op/s; 0 B/s, 0 objects/s recovering 2023-08-11T12:22:47.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:47 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/4270421140' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:22:48.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:47 smithi008 ceph-mon[97158]: pgmap v297: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 14 op/s; 0 B/s, 0 objects/s recovering 2023-08-11T12:22:48.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:47 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/4270421140' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:49.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.374+0000 7f09e8283700 1 -- 172.21.15.8:0/3189305894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09e0100940 msgr2=0x7f09e0100dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:49.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.374+0000 7f09e8283700 1 --2- 172.21.15.8:0/3189305894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09e0100940 0x7f09e0100dc0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f09d0009990 tx=0x7f09d0009ca0 comp rx=0 tx=0).stop 2023-08-11T12:22:49.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.374+0000 7f09e8283700 1 -- 172.21.15.8:0/3189305894 shutdown_connections 2023-08-11T12:22:49.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.374+0000 7f09e8283700 1 --2- 172.21.15.8:0/3189305894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09e0106940 0x7f09e0106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:49.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.374+0000 7f09e8283700 1 --2- 172.21.15.8:0/3189305894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09e0101300 0x7f09e010d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:49.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.374+0000 7f09e8283700 1 --2- 172.21.15.8:0/3189305894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09e0100940 0x7f09e0100dc0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:49.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.374+0000 7f09e8283700 1 -- 172.21.15.8:0/3189305894 >> 172.21.15.8:0/3189305894 conn(0x7f09e00fc410 msgr2=0x7f09e00fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:49.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.374+0000 7f09e8283700 1 -- 172.21.15.8:0/3189305894 shutdown_connections 2023-08-11T12:22:49.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.374+0000 7f09e8283700 1 -- 172.21.15.8:0/3189305894 wait complete. 2023-08-11T12:22:49.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.375+0000 7f09e8283700 1 Processor -- start 2023-08-11T12:22:49.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.375+0000 7f09e8283700 1 -- start start 2023-08-11T12:22:49.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.375+0000 7f09e8283700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09e0100940 0x7f09e019ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:49.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.375+0000 7f09e8283700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09e0101300 0x7f09e019ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:49.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.375+0000 7f09e8283700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09e0106940 0x7f09e0198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:49.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.376+0000 7f09e8283700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e0199110 con 0x7f09e0106940 2023-08-11T12:22:49.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.376+0000 7f09e8283700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e0199280 con 0x7f09e0101300 2023-08-11T12:22:49.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.376+0000 7f09e8283700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e0199440 con 0x7f09e0100940 2023-08-11T12:22:49.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.376+0000 7f09e6820700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09e0106940 0x7f09e0198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:49.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.376+0000 7f09e6820700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09e0106940 0x7f09e0198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58454/0 (socket says 172.21.15.8:58454) 2023-08-11T12:22:49.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.376+0000 7f09e6820700 1 -- 172.21.15.8:0/2697964869 learned_addr learned my addr 172.21.15.8:0/2697964869 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:49.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.376+0000 7f09e601f700 1 --2- 172.21.15.8:0/2697964869 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09e0100940 0x7f09e019ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:49.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.376+0000 7f09e581e700 1 --2- 172.21.15.8:0/2697964869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09e0101300 0x7f09e019ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:49.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.376+0000 7f09e6820700 1 -- 172.21.15.8:0/2697964869 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09e0100940 msgr2=0x7f09e019ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:49.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.376+0000 7f09e6820700 1 --2- 172.21.15.8:0/2697964869 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09e0100940 0x7f09e019ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:49.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.376+0000 7f09e6820700 1 -- 172.21.15.8:0/2697964869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09e0101300 msgr2=0x7f09e019ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:49.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.376+0000 7f09e6820700 1 --2- 172.21.15.8:0/2697964869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09e0101300 0x7f09e019ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:49.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.376+0000 7f09e6820700 1 -- 172.21.15.8:0/2697964869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d00095f0 con 0x7f09e0106940 2023-08-11T12:22:49.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.377+0000 7f09e6820700 1 --2- 172.21.15.8:0/2697964869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09e0106940 0x7f09e0198aa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f09d800ef30 tx=0x7f09d800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:49.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.377+0000 7f09d77fe700 1 -- 172.21.15.8:0/2697964869 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d8018070 con 0x7f09e0106940 2023-08-11T12:22:49.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.377+0000 7f09e8283700 1 -- 172.21.15.8:0/2697964869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e01996c0 con 0x7f09e0106940 2023-08-11T12:22:49.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.377+0000 7f09d77fe700 1 -- 172.21.15.8:0/2697964869 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f09d800f040 con 0x7f09e0106940 2023-08-11T12:22:49.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.377+0000 7f09d77fe700 1 -- 172.21.15.8:0/2697964869 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d800cd00 con 0x7f09e0106940 2023-08-11T12:22:49.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.377+0000 7f09e8283700 1 -- 172.21.15.8:0/2697964869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e01a5a10 con 0x7f09e0106940 2023-08-11T12:22:49.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.378+0000 7f09e8283700 1 -- 172.21.15.8:0/2697964869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e004e620 con 0x7f09e0106940 2023-08-11T12:22:49.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.380+0000 7f09d77fe700 1 -- 172.21.15.8:0/2697964869 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f09d8003a00 con 0x7f09e0106940 2023-08-11T12:22:49.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.382+0000 7f09d77fe700 1 --2- 172.21.15.8:0/2697964869 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f09cc09ff50 0x7f09cc0a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:49.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.382+0000 7f09d77fe700 1 -- 172.21.15.8:0/2697964869 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f09d80cbaa0 con 0x7f09e0106940 2023-08-11T12:22:49.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.382+0000 7f09e601f700 1 --2- 172.21.15.8:0/2697964869 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f09cc09ff50 0x7f09cc0a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:49.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.383+0000 7f09e601f700 1 --2- 172.21.15.8:0/2697964869 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f09cc09ff50 0x7f09cc0a2410 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009be0 tx=0x7f09dc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:49.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.385+0000 7f09d77fe700 1 -- 172.21.15.8:0/2697964869 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f09d8095550 con 0x7f09e0106940 2023-08-11T12:22:49.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.594+0000 7f09e8283700 1 -- 172.21.15.8:0/2697964869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09e0110a80 con 0x7f09e0106940 2023-08-11T12:22:49.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.596+0000 7f09d77fe700 1 -- 172.21.15.8:0/2697964869 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24348 (secure 0 0 0) 0x7f09d80b8070 con 0x7f09e0106940 2023-08-11T12:22:49.598 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:22:49.599 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":89,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","created":"2023-08-11T12:14:28.341113+0000","modified":"2023-08-11T12:22:31.713248+0000","last_up_change":"2023-08-11T12:21:14.913735+0000","last_in_change":"2023-08-11T12:20:57.476558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-11T12:17:49.040758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-11T12:22:01.383296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-11T12:22:02.816329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-11T12:22:06.369375+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f903e393-7894-42d6-8b11-737ceef1f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6803","nonce":664104961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6805","nonce":664104961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6809","nonce":664104961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6807","nonce":664104961}]},"public_addr":"172.21.15.8:6803/664104961","cluster_addr":"172.21.15.8:6805/664104961","heartbeat_back_addr":"172.21.15.8:6809/664104961","heartbeat_front_addr":"172.21.15.8:6807/664104961","state":["exists","up"]},{"osd":1,"uuid":"1e988e5c-e78c-46d5-80a5-dff7ac38cbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6801","nonce":4187350703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6803","nonce":4187350703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6807","nonce":4187350703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6805","nonce":4187350703}]},"public_addr":"172.21.15.45:6801/4187350703","cluster_addr":"172.21.15.45:6803/4187350703","heartbeat_back_addr":"172.21.15.45:6807/4187350703","heartbeat_front_addr":"172.21.15.45:6805/4187350703","state":["exists","up"]},{"osd":2,"uuid":"1835217c-a93c-4181-b8b8-cc410bab1a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6801","nonce":2547818140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6803","nonce":2547818140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6807","nonce":2547818140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6805","nonce":2547818140}]},"public_addr":"172.21.15.194:6801/2547818140","cluster_addr":"172.21.15.194:6803/2547818140","heartbeat_back_addr":"172.21.15.194:6807/2547818140","heartbeat_front_addr":"172.21.15.194:6805/2547818140","state":["exists","up"]},{"osd":3,"uuid":"b55ae61a-731c-4312-a998-661122b84788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6811","nonce":187418883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6813","nonce":187418883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6817","nonce":187418883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6815","nonce":187418883}]},"public_addr":"172.21.15.8:6811/187418883","cluster_addr":"172.21.15.8:6813/187418883","heartbeat_back_addr":"172.21.15.8:6817/187418883","heartbeat_front_addr":"172.21.15.8:6815/187418883","state":["exists","up"]},{"osd":4,"uuid":"2c28acbb-e807-4559-8aa2-a35ca84b5d43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6809","nonce":3099704571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6811","nonce":3099704571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6815","nonce":3099704571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6813","nonce":3099704571}]},"public_addr":"172.21.15.45:6809/3099704571","cluster_addr":"172.21.15.45:6811/3099704571","heartbeat_back_addr":"172.21.15.45:6815/3099704571","heartbeat_front_addr":"172.21.15.45:6813/3099704571","state":["exists","up"]},{"osd":5,"uuid":"37032289-8016-4730-9b69-f7985e058ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6809","nonce":263803874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6811","nonce":263803874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6815","nonce":263803874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6813","nonce":263803874}]},"public_addr":"172.21.15.194:6809/263803874","cluster_addr":"172.21.15.194:6811/263803874","heartbeat_back_addr":"172.21.15.194:6815/263803874","heartbeat_front_addr":"172.21.15.194:6813/263803874","state":["exists","up"]},{"osd":6,"uuid":"32d2dab9-6944-40d1-ada9-4f941821b063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6819","nonce":1802966829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6821","nonce":1802966829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6825","nonce":1802966829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6823","nonce":1802966829}]},"public_addr":"172.21.15.8:6819/1802966829","cluster_addr":"172.21.15.8:6821/1802966829","heartbeat_back_addr":"172.21.15.8:6825/1802966829","heartbeat_front_addr":"172.21.15.8:6823/1802966829","state":["exists","up"]},{"osd":7,"uuid":"086aff58-1554-49fe-92ff-5166b115aeef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6817","nonce":3715737148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6819","nonce":3715737148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6823","nonce":3715737148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6821","nonce":3715737148}]},"public_addr":"172.21.15.45:6817/3715737148","cluster_addr":"172.21.15.45:6819/3715737148","heartbeat_back_addr":"172.21.15.45:6823/3715737148","heartbeat_front_addr":"172.21.15.45:6821/3715737148","state":["exists","up"]},{"osd":8,"uuid":"7fff5e95-2453-4ea6-a5c1-3bba6a1f6400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6817","nonce":57497127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6819","nonce":57497127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6823","nonce":57497127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6821","nonce":57497127}]},"public_addr":"172.21.15.194:6817/57497127","cluster_addr":"172.21.15.194:6819/57497127","heartbeat_back_addr":"172.21.15.194:6823/57497127","heartbeat_front_addr":"172.21.15.194:6821/57497127","state":["exists","up"]},{"osd":9,"uuid":"31ab0121-4c92-42ec-9f19-e672062e8814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6827","nonce":434661930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6829","nonce":434661930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6833","nonce":434661930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6831","nonce":434661930}]},"public_addr":"172.21.15.8:6827/434661930","cluster_addr":"172.21.15.8:6829/434661930","heartbeat_back_addr":"172.21.15.8:6833/434661930","heartbeat_front_addr":"172.21.15.8:6831/434661930","state":["exists","up"]},{"osd":10,"uuid":"62c632e4-94f6-4630-9d94-8d28fccacf45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6825","nonce":3281212184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6827","nonce":3281212184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6831","nonce":3281212184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6829","nonce":3281212184}]},"public_addr":"172.21.15.45:6825/3281212184","cluster_addr":"172.21.15.45:6827/3281212184","heartbeat_back_addr":"172.21.15.45:6831/3281212184","heartbeat_front_addr":"172.21.15.45:6829/3281212184","state":["exists","up"]},{"osd":11,"uuid":"8ca4a80d-cd75-4230-b46d-aef6fdc03e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6825","nonce":1637875895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6827","nonce":1637875895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6831","nonce":1637875895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6829","nonce":1637875895}]},"public_addr":"172.21.15.194:6825/1637875895","cluster_addr":"172.21.15.194:6827/1637875895","heartbeat_back_addr":"172.21.15.194:6831/1637875895","heartbeat_front_addr":"172.21.15.194:6829/1637875895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:04.255616+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:26.243863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:46.630365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:12.926291+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:35.747049+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:55.793767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:21.685725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:43.703215+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:04.043674+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:30.320026+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:52.751974+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:21:13.230024+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/2000592056":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2102228072":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2374527928":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2928221278":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2744750874":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/3681755887":"2023-08-12T12:15:02.528403+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-11T12:22:49.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.598+0000 7f09e8283700 1 -- 172.21.15.8:0/2697964869 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f09cc09ff50 msgr2=0x7f09cc0a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:49.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.598+0000 7f09e8283700 1 --2- 172.21.15.8:0/2697964869 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f09cc09ff50 0x7f09cc0a2410 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009be0 tx=0x7f09dc009260 comp rx=0 tx=0).stop 2023-08-11T12:22:49.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.598+0000 7f09e8283700 1 -- 172.21.15.8:0/2697964869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09e0106940 msgr2=0x7f09e0198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:49.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.598+0000 7f09e8283700 1 --2- 172.21.15.8:0/2697964869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09e0106940 0x7f09e0198aa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f09d800ef30 tx=0x7f09d800c3a0 comp rx=0 tx=0).stop 2023-08-11T12:22:49.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.598+0000 7f09e8283700 1 -- 172.21.15.8:0/2697964869 shutdown_connections 2023-08-11T12:22:49.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.598+0000 7f09e8283700 1 --2- 172.21.15.8:0/2697964869 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f09cc09ff50 0x7f09cc0a2410 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:49.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.598+0000 7f09e8283700 1 --2- 172.21.15.8:0/2697964869 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09e0100940 0x7f09e019ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:49.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.598+0000 7f09e8283700 1 --2- 172.21.15.8:0/2697964869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09e0106940 0x7f09e0198aa0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:49.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.598+0000 7f09e8283700 1 --2- 172.21.15.8:0/2697964869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09e0101300 0x7f09e019ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:49.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.598+0000 7f09e8283700 1 -- 172.21.15.8:0/2697964869 >> 172.21.15.8:0/2697964869 conn(0x7f09e00fc410 msgr2=0x7f09e010bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:49.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.598+0000 7f09e8283700 1 -- 172.21.15.8:0/2697964869 shutdown_connections 2023-08-11T12:22:49.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:49.599+0000 7f09e8283700 1 -- 172.21.15.8:0/2697964869 wait complete. 2023-08-11T12:22:49.834 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:49 smithi008 ceph-mon[97158]: pgmap v298: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 0 B/s wr, 9 op/s 2023-08-11T12:22:49.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:49 smithi194 ceph-mon[130905]: pgmap v298: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 0 B/s wr, 9 op/s 2023-08-11T12:22:49.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:49 smithi045 ceph-mon[130284]: pgmap v298: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 0 B/s wr, 9 op/s 2023-08-11T12:22:50.161 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2023-08-11T12:22:50.162 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2023-08-11T12:22:50.163 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2023-08-11T12:22:50.163 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2023-08-11T12:22:50.163 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2023-08-11T12:22:50.164 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2023-08-11T12:22:50.165 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2023-08-11T12:22:50.165 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2023-08-11T12:22:50.166 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph tell osd.8 flush_pg_stats 2023-08-11T12:22:50.166 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph tell osd.9 flush_pg_stats 2023-08-11T12:22:50.167 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph tell osd.10 flush_pg_stats 2023-08-11T12:22:50.167 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph tell osd.11 flush_pg_stats 2023-08-11T12:22:50.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:50 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2697964869' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:50.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:50 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2697964869' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:50.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:50 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2697964869' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:22:51.882 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:22:51.886 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:22:51.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:51 smithi194 ceph-mon[130905]: pgmap v299: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 10 op/s 2023-08-11T12:22:51.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:51 smithi045 ceph-mon[130284]: pgmap v299: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 10 op/s 2023-08-11T12:22:52.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:51 smithi008 ceph-mon[97158]: pgmap v299: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 10 op/s 2023-08-11T12:22:52.065 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:22:52.094 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:22:52.097 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:22:52.099 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:22:52.307 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:22:52.310 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:22:52.342 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:22:52.354 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:22:52.878 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:22:52.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:52 smithi194 ceph-mon[130905]: pgmap v300: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-08-11T12:22:52.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:52 smithi045 ceph-mon[130284]: pgmap v300: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-08-11T12:22:52.927 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:22:53.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:52 smithi008 ceph-mon[97158]: pgmap v300: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-08-11T12:22:55.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:55 smithi008 ceph-mon[97158]: pgmap v301: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:22:55.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:55 smithi194 ceph-mon[130905]: pgmap v301: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:22:55.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:55 smithi045 ceph-mon[130284]: pgmap v301: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:22:57.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.459+0000 7f46c15e3700 1 -- 172.21.15.8:0/3965579653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46bc102470 msgr2=0x7f46bc10a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:57.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.459+0000 7f46c15e3700 1 --2- 172.21.15.8:0/3965579653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46bc102470 0x7f46bc10a960 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f46b0009990 tx=0x7f46b0009ca0 comp rx=0 tx=0).stop 2023-08-11T12:22:57.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.460+0000 7f46c15e3700 1 -- 172.21.15.8:0/3965579653 shutdown_connections 2023-08-11T12:22:57.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.460+0000 7f46c15e3700 1 --2- 172.21.15.8:0/3965579653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46bc10af30 0x7f46bc10d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:57.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.460+0000 7f46c15e3700 1 --2- 172.21.15.8:0/3965579653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46bc101b50 0x7f46bc101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:57.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.460+0000 7f46c15e3700 1 --2- 172.21.15.8:0/3965579653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46bc102470 0x7f46bc10a960 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:57.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.460+0000 7f46c15e3700 1 -- 172.21.15.8:0/3965579653 >> 172.21.15.8:0/3965579653 conn(0x7f46bc0fb2e0 msgr2=0x7f46bc0fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:57.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.460+0000 7f46c15e3700 1 -- 172.21.15.8:0/3965579653 shutdown_connections 2023-08-11T12:22:57.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.460+0000 7f46c15e3700 1 -- 172.21.15.8:0/3965579653 wait complete. 2023-08-11T12:22:57.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.461+0000 7f46c15e3700 1 Processor -- start 2023-08-11T12:22:57.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.461+0000 7f46c15e3700 1 -- start start 2023-08-11T12:22:57.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.461+0000 7f46c15e3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46bc101b50 0x7f46bc198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:57.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.461+0000 7f46c15e3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46bc102470 0x7f46bc199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:57.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.461+0000 7f46c15e3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46bc10af30 0x7f46bc19c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:57.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.461+0000 7f46c15e3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc19cbc0 con 0x7f46bc101b50 2023-08-11T12:22:57.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.461+0000 7f46c15e3700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc19cd30 con 0x7f46bc102470 2023-08-11T12:22:57.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.461+0000 7f46c15e3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc19cef0 con 0x7f46bc10af30 2023-08-11T12:22:57.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.461+0000 7f46baffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46bc101b50 0x7f46bc198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:57.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.462+0000 7f46baffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46bc101b50 0x7f46bc198cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58468/0 (socket says 172.21.15.8:58468) 2023-08-11T12:22:57.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.462+0000 7f46baffd700 1 -- 172.21.15.8:0/131110816 learned_addr learned my addr 172.21.15.8:0/131110816 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:57.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.462+0000 7f46bb7fe700 1 --2- 172.21.15.8:0/131110816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46bc10af30 0x7f46bc19c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:57.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.462+0000 7f46ba7fc700 1 --2- 172.21.15.8:0/131110816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46bc102470 0x7f46bc199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:57.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.462+0000 7f46baffd700 1 -- 172.21.15.8:0/131110816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46bc10af30 msgr2=0x7f46bc19c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:57.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.462+0000 7f46baffd700 1 --2- 172.21.15.8:0/131110816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46bc10af30 0x7f46bc19c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:57.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.462+0000 7f46baffd700 1 -- 172.21.15.8:0/131110816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46bc102470 msgr2=0x7f46bc199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:57.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.462+0000 7f46baffd700 1 --2- 172.21.15.8:0/131110816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46bc102470 0x7f46bc199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:57.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.462+0000 7f46baffd700 1 -- 172.21.15.8:0/131110816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b00095f0 con 0x7f46bc101b50 2023-08-11T12:22:57.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.462+0000 7f46baffd700 1 --2- 172.21.15.8:0/131110816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46bc101b50 0x7f46bc198cc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f46ac00e9a0 tx=0x7f46ac00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:57.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.462+0000 7f46a3fff700 1 -- 172.21.15.8:0/131110816 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac009790 con 0x7f46bc101b50 2023-08-11T12:22:57.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.462+0000 7f46a3fff700 1 -- 172.21.15.8:0/131110816 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46ac010430 con 0x7f46bc101b50 2023-08-11T12:22:57.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.462+0000 7f46c15e3700 1 -- 172.21.15.8:0/131110816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46bc19d1d0 con 0x7f46bc101b50 2023-08-11T12:22:57.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.462+0000 7f46a3fff700 1 -- 172.21.15.8:0/131110816 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac018680 con 0x7f46bc101b50 2023-08-11T12:22:57.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.463+0000 7f46c15e3700 1 -- 172.21.15.8:0/131110816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46bc1a5b20 con 0x7f46bc101b50 2023-08-11T12:22:57.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.463+0000 7f46c15e3700 1 -- 172.21.15.8:0/131110816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f46bc110bc0 con 0x7f46bc101b50 2023-08-11T12:22:57.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.466+0000 7f46a3fff700 1 -- 172.21.15.8:0/131110816 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f46ac0105a0 con 0x7f46bc101b50 2023-08-11T12:22:57.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.467+0000 7f46a3fff700 1 --2- 172.21.15.8:0/131110816 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f46a409ff50 0x7f46a40a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:57.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.468+0000 7f46a3fff700 1 -- 172.21.15.8:0/131110816 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f46ac014070 con 0x7f46bc101b50 2023-08-11T12:22:57.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.468+0000 7f46ba7fc700 1 --2- 172.21.15.8:0/131110816 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f46a409ff50 0x7f46a40a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:57.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.468+0000 7f46a3fff700 1 --2- 172.21.15.8:0/131110816 >> [v2:172.21.15.194:6800/2547818140,v1:172.21.15.194:6801/2547818140] conn(0x7f46a40aaf70 0x7f46a40ad410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:57.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.468+0000 7f46a3fff700 1 -- 172.21.15.8:0/131110816 --> [v2:172.21.15.194:6800/2547818140,v1:172.21.15.194:6801/2547818140] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f46a40adae0 con 0x7f46a40aaf70 2023-08-11T12:22:57.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.468+0000 7f46a3fff700 1 -- 172.21.15.8:0/131110816 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46ac0cbe10 con 0x7f46bc101b50 2023-08-11T12:22:57.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.469+0000 7f46bb7fe700 1 --2- 172.21.15.8:0/131110816 >> [v2:172.21.15.194:6800/2547818140,v1:172.21.15.194:6801/2547818140] conn(0x7f46a40aaf70 0x7f46a40ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:57.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.469+0000 7f46ba7fc700 1 --2- 172.21.15.8:0/131110816 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f46a409ff50 0x7f46a40a2410 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f46bc19a340 tx=0x7f46b0005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:57.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.469+0000 7f46bb7fe700 1 --2- 172.21.15.8:0/131110816 >> [v2:172.21.15.194:6800/2547818140,v1:172.21.15.194:6801/2547818140] conn(0x7f46a40aaf70 0x7f46a40ad410 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:57.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.470+0000 7f46a3fff700 1 -- 172.21.15.8:0/131110816 <== osd.2 v2:172.21.15.194:6800/2547818140 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f46a40adae0 con 0x7f46a40aaf70 2023-08-11T12:22:57.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.488+0000 7f46c15e3700 1 -- 172.21.15.8:0/131110816 --> [v2:172.21.15.194:6800/2547818140,v1:172.21.15.194:6801/2547818140] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f46bc04e620 con 0x7f46a40aaf70 2023-08-11T12:22:57.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.488+0000 7f46a3fff700 1 -- 172.21.15.8:0/131110816 <== osd.2 v2:172.21.15.194:6800/2547818140 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f46bc04e620 con 0x7f46a40aaf70 2023-08-11T12:22:57.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.489+0000 7f46c15e3700 1 -- 172.21.15.8:0/131110816 >> [v2:172.21.15.194:6800/2547818140,v1:172.21.15.194:6801/2547818140] conn(0x7f46a40aaf70 msgr2=0x7f46a40ad410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:57.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.489+0000 7f46c15e3700 1 --2- 172.21.15.8:0/131110816 >> [v2:172.21.15.194:6800/2547818140,v1:172.21.15.194:6801/2547818140] conn(0x7f46a40aaf70 0x7f46a40ad410 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:57.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.489+0000 7f46c15e3700 1 -- 172.21.15.8:0/131110816 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f46a409ff50 msgr2=0x7f46a40a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:57.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.489+0000 7f46c15e3700 1 --2- 172.21.15.8:0/131110816 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f46a409ff50 0x7f46a40a2410 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f46bc19a340 tx=0x7f46b0005fb0 comp rx=0 tx=0).stop 2023-08-11T12:22:57.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.489+0000 7f46c15e3700 1 -- 172.21.15.8:0/131110816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46bc101b50 msgr2=0x7f46bc198cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:57.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.489+0000 7f46c15e3700 1 --2- 172.21.15.8:0/131110816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46bc101b50 0x7f46bc198cc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f46ac00e9a0 tx=0x7f46ac00ecb0 comp rx=0 tx=0).stop 2023-08-11T12:22:57.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.489+0000 7f46bb7fe700 1 -- 172.21.15.8:0/131110816 reap_dead start 2023-08-11T12:22:57.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.489+0000 7f46c15e3700 1 -- 172.21.15.8:0/131110816 shutdown_connections 2023-08-11T12:22:57.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.489+0000 7f46c15e3700 1 -- 172.21.15.8:0/131110816 >> 172.21.15.8:0/131110816 conn(0x7f46bc0fb2e0 msgr2=0x7f46bc10d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:57.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.489+0000 7f46c15e3700 1 -- 172.21.15.8:0/131110816 shutdown_connections 2023-08-11T12:22:57.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.489+0000 7f46c15e3700 1 -- 172.21.15.8:0/131110816 wait complete. 2023-08-11T12:22:57.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:57 smithi008 ceph-mon[97158]: pgmap v302: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-08-11T12:22:57.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:57 smithi194 ceph-mon[130905]: pgmap v302: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-08-11T12:22:57.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:57 smithi045 ceph-mon[130284]: pgmap v302: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-08-11T12:22:58.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.877+0000 7f46916f3700 1 -- 172.21.15.8:0/3262761250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f468c0688e0 msgr2=0x7f468c068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:58.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.877+0000 7f46916f3700 1 --2- 172.21.15.8:0/3262761250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f468c0688e0 0x7f468c068cc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f468400b080 tx=0x7f468400b390 comp rx=0 tx=0).stop 2023-08-11T12:22:58.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.878+0000 7f46916f3700 1 -- 172.21.15.8:0/3262761250 shutdown_connections 2023-08-11T12:22:58.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.878+0000 7f46916f3700 1 --2- 172.21.15.8:0/3262761250 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f468c105d50 0x7f468c10d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:58.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.878+0000 7f46916f3700 1 --2- 172.21.15.8:0/3262761250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f468c0688e0 0x7f468c068cc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:58.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.878+0000 7f46916f3700 1 --2- 172.21.15.8:0/3262761250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f468c105390 0x7f468c105810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:58.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.878+0000 7f46916f3700 1 -- 172.21.15.8:0/3262761250 >> 172.21.15.8:0/3262761250 conn(0x7f468c076920 msgr2=0x7f468c076d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:58.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.878+0000 7f46916f3700 1 -- 172.21.15.8:0/3262761250 shutdown_connections 2023-08-11T12:22:58.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.878+0000 7f46916f3700 1 -- 172.21.15.8:0/3262761250 wait complete. 2023-08-11T12:22:58.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.879+0000 7f46916f3700 1 Processor -- start 2023-08-11T12:22:58.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.879+0000 7f46916f3700 1 -- start start 2023-08-11T12:22:58.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.879+0000 7f46916f3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f468c0688e0 0x7f468c0ff8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:58.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.879+0000 7f46916f3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f468c105390 0x7f468c0ffe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:58.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.879+0000 7f46916f3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f468c105d50 0x7f468c1a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:58.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.879+0000 7f46916f3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468c100700 con 0x7f468c105390 2023-08-11T12:22:58.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.879+0000 7f46916f3700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468c1a51a0 con 0x7f468c0688e0 2023-08-11T12:22:58.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.879+0000 7f46916f3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468c1a5310 con 0x7f468c105d50 2023-08-11T12:22:58.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.880+0000 7f468a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f468c105390 0x7f468c0ffe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:58.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.880+0000 7f468affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f468c0688e0 0x7f468c0ff8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:58.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.880+0000 7f468a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f468c105390 0x7f468c0ffe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58702/0 (socket says 172.21.15.8:58702) 2023-08-11T12:22:58.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.880+0000 7f468a7fc700 1 -- 172.21.15.8:0/2090027392 learned_addr learned my addr 172.21.15.8:0/2090027392 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:58.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.880+0000 7f468b7fe700 1 --2- 172.21.15.8:0/2090027392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f468c105d50 0x7f468c1a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:58.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.880+0000 7f468a7fc700 1 -- 172.21.15.8:0/2090027392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f468c105d50 msgr2=0x7f468c1a4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:58.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.880+0000 7f468a7fc700 1 --2- 172.21.15.8:0/2090027392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f468c105d50 0x7f468c1a4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:58.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.880+0000 7f468a7fc700 1 -- 172.21.15.8:0/2090027392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f468c0688e0 msgr2=0x7f468c0ff8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:58.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.880+0000 7f468a7fc700 1 --2- 172.21.15.8:0/2090027392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f468c0688e0 0x7f468c0ff8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:58.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.880+0000 7f468a7fc700 1 -- 172.21.15.8:0/2090027392 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4684009c40 con 0x7f468c105390 2023-08-11T12:22:58.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.880+0000 7f468affd700 1 --2- 172.21.15.8:0/2090027392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f468c0688e0 0x7f468c0ff8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:22:58.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.881+0000 7f468a7fc700 1 --2- 172.21.15.8:0/2090027392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f468c105390 0x7f468c0ffe10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f467c00e9a0 tx=0x7f467c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:58.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.881+0000 7f4673fff700 1 -- 172.21.15.8:0/2090027392 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c009790 con 0x7f468c105390 2023-08-11T12:22:58.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.881+0000 7f4673fff700 1 -- 172.21.15.8:0/2090027392 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f467c010430 con 0x7f468c105390 2023-08-11T12:22:58.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.881+0000 7f46916f3700 1 -- 172.21.15.8:0/2090027392 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f468c1a5590 con 0x7f468c105390 2023-08-11T12:22:58.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.881+0000 7f4673fff700 1 -- 172.21.15.8:0/2090027392 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c018680 con 0x7f468c105390 2023-08-11T12:22:58.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.881+0000 7f46916f3700 1 -- 172.21.15.8:0/2090027392 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f468c1a5ae0 con 0x7f468c105390 2023-08-11T12:22:58.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.882+0000 7f46916f3700 1 -- 172.21.15.8:0/2090027392 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f468c110b80 con 0x7f468c105390 2023-08-11T12:22:58.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.884+0000 7f4673fff700 1 -- 172.21.15.8:0/2090027392 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f467c0105a0 con 0x7f468c105390 2023-08-11T12:22:58.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.886+0000 7f4673fff700 1 --2- 172.21.15.8:0/2090027392 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f467409ffd0 0x7f46740a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:58.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.886+0000 7f4673fff700 1 -- 172.21.15.8:0/2090027392 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f467c014070 con 0x7f468c105390 2023-08-11T12:22:58.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.886+0000 7f468affd700 1 --2- 172.21.15.8:0/2090027392 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f467409ffd0 0x7f46740a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:58.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.886+0000 7f4673fff700 1 --2- 172.21.15.8:0/2090027392 >> [v2:172.21.15.45:6808/3099704571,v1:172.21.15.45:6809/3099704571] conn(0x7f46740aaff0 0x7f46740ad490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:58.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.886+0000 7f4673fff700 1 -- 172.21.15.8:0/2090027392 --> [v2:172.21.15.45:6808/3099704571,v1:172.21.15.45:6809/3099704571] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f46740adb60 con 0x7f46740aaff0 2023-08-11T12:22:58.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.886+0000 7f4673fff700 1 -- 172.21.15.8:0/2090027392 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f467c0cbf30 con 0x7f468c105390 2023-08-11T12:22:58.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.887+0000 7f468b7fe700 1 --2- 172.21.15.8:0/2090027392 >> [v2:172.21.15.45:6808/3099704571,v1:172.21.15.45:6809/3099704571] conn(0x7f46740aaff0 0x7f46740ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:58.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.887+0000 7f468affd700 1 --2- 172.21.15.8:0/2090027392 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f467409ffd0 0x7f46740a2490 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4684009c10 tx=0x7f4684009ac0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:58.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.887+0000 7f468b7fe700 1 --2- 172.21.15.8:0/2090027392 >> [v2:172.21.15.45:6808/3099704571,v1:172.21.15.45:6809/3099704571] conn(0x7f46740aaff0 0x7f46740ad490 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:58.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.888+0000 7f4673fff700 1 -- 172.21.15.8:0/2090027392 <== osd.4 v2:172.21.15.45:6808/3099704571 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f46740adb60 con 0x7f46740aaff0 2023-08-11T12:22:58.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.907+0000 7f46916f3700 1 -- 172.21.15.8:0/2090027392 --> [v2:172.21.15.45:6808/3099704571,v1:172.21.15.45:6809/3099704571] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f468c04e620 con 0x7f46740aaff0 2023-08-11T12:22:58.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.907+0000 7f4673fff700 1 -- 172.21.15.8:0/2090027392 <== osd.4 v2:172.21.15.45:6808/3099704571 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f468c04e620 con 0x7f46740aaff0 2023-08-11T12:22:58.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.908+0000 7f46916f3700 1 -- 172.21.15.8:0/2090027392 >> [v2:172.21.15.45:6808/3099704571,v1:172.21.15.45:6809/3099704571] conn(0x7f46740aaff0 msgr2=0x7f46740ad490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:58.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.908+0000 7f46916f3700 1 --2- 172.21.15.8:0/2090027392 >> [v2:172.21.15.45:6808/3099704571,v1:172.21.15.45:6809/3099704571] conn(0x7f46740aaff0 0x7f46740ad490 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:58.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.908+0000 7f46916f3700 1 -- 172.21.15.8:0/2090027392 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f467409ffd0 msgr2=0x7f46740a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:58.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.908+0000 7f46916f3700 1 --2- 172.21.15.8:0/2090027392 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f467409ffd0 0x7f46740a2490 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4684009c10 tx=0x7f4684009ac0 comp rx=0 tx=0).stop 2023-08-11T12:22:58.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.908+0000 7f46916f3700 1 -- 172.21.15.8:0/2090027392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f468c105390 msgr2=0x7f468c0ffe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:58.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.908+0000 7f46916f3700 1 --2- 172.21.15.8:0/2090027392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f468c105390 0x7f468c0ffe10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f467c00e9a0 tx=0x7f467c00ecb0 comp rx=0 tx=0).stop 2023-08-11T12:22:58.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.908+0000 7f468b7fe700 1 -- 172.21.15.8:0/2090027392 reap_dead start 2023-08-11T12:22:58.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.908+0000 7f46916f3700 1 -- 172.21.15.8:0/2090027392 shutdown_connections 2023-08-11T12:22:58.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.908+0000 7f46916f3700 1 -- 172.21.15.8:0/2090027392 >> 172.21.15.8:0/2090027392 conn(0x7f468c076920 msgr2=0x7f468c0fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:58.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.908+0000 7f46916f3700 1 -- 172.21.15.8:0/2090027392 shutdown_connections 2023-08-11T12:22:58.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:57.908+0000 7f46916f3700 1 -- 172.21.15.8:0/2090027392 wait complete. 2023-08-11T12:22:59.866 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:22:59 smithi008 ceph-mon[97158]: pgmap v303: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:22:59.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:22:59 smithi194 ceph-mon[130905]: pgmap v303: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:22:59.894 INFO:teuthology.orchestra.run.smithi008.stdout:77309411392 2023-08-11T12:22:59.895 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.2 2023-08-11T12:22:59.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:22:59 smithi045 ceph-mon[130284]: pgmap v303: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:22:59.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.979+0000 7f8f10bff700 1 -- 172.21.15.8:0/2571979341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f0c11a100 msgr2=0x7f8f0c11c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:59.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.979+0000 7f8f10bff700 1 --2- 172.21.15.8:0/2571979341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f0c11a100 0x7f8f0c11c4f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8f0400b0a0 tx=0x7f8f0400b3b0 comp rx=0 tx=0).stop 2023-08-11T12:22:59.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.981+0000 7f8f10bff700 1 -- 172.21.15.8:0/2571979341 shutdown_connections 2023-08-11T12:22:59.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.981+0000 7f8f10bff700 1 --2- 172.21.15.8:0/2571979341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f0c11a100 0x7f8f0c11c4f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:59.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.981+0000 7f8f10bff700 1 --2- 172.21.15.8:0/2571979341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f0c10f180 0x7f8f0c10cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:59.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.981+0000 7f8f10bff700 1 --2- 172.21.15.8:0/2571979341 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f0c10d1a0 0x7f8f0c10d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:59.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.981+0000 7f8f10bff700 1 -- 172.21.15.8:0/2571979341 >> 172.21.15.8:0/2571979341 conn(0x7f8f0c06cb20 msgr2=0x7f8f0c06cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:22:59.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.982+0000 7f8f10bff700 1 -- 172.21.15.8:0/2571979341 shutdown_connections 2023-08-11T12:22:59.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.982+0000 7f8f10bff700 1 -- 172.21.15.8:0/2571979341 wait complete. 2023-08-11T12:22:59.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.983+0000 7f8f10bff700 1 Processor -- start 2023-08-11T12:22:59.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.984+0000 7f8f10bff700 1 -- start start 2023-08-11T12:22:59.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.984+0000 7f8f10bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f0c10d1a0 0x7f8f0c1ab660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:59.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.984+0000 7f8f10bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f0c10f180 0x7f8f0c1abba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:59.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.984+0000 7f8f10bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f0c11a100 0x7f8f0c1a56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:59.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.984+0000 7f8f10bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c1a5d50 con 0x7f8f0c10f180 2023-08-11T12:22:59.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.984+0000 7f8f10bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c1a5ec0 con 0x7f8f0c10d1a0 2023-08-11T12:22:59.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.984+0000 7f8f10bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c1a6080 con 0x7f8f0c11a100 2023-08-11T12:22:59.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.985+0000 7f8f0a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f0c10d1a0 0x7f8f0c1ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:59.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.985+0000 7f8f0a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f0c10d1a0 0x7f8f0c1ab660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:58496/0 (socket says 172.21.15.8:58496) 2023-08-11T12:22:59.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.985+0000 7f8f0a59c700 1 -- 172.21.15.8:0/2317609476 learned_addr learned my addr 172.21.15.8:0/2317609476 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:22:59.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.985+0000 7f8f0ad9d700 1 --2- 172.21.15.8:0/2317609476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f0c11a100 0x7f8f0c1a56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:59.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.986+0000 7f8f09d9b700 1 --2- 172.21.15.8:0/2317609476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f0c10f180 0x7f8f0c1abba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:59.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.986+0000 7f8f0ad9d700 1 -- 172.21.15.8:0/2317609476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f0c10d1a0 msgr2=0x7f8f0c1ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:59.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.986+0000 7f8f0ad9d700 1 --2- 172.21.15.8:0/2317609476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f0c10d1a0 0x7f8f0c1ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:59.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.986+0000 7f8f0ad9d700 1 -- 172.21.15.8:0/2317609476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f0c10f180 msgr2=0x7f8f0c1abba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:22:59.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.986+0000 7f8f0ad9d700 1 --2- 172.21.15.8:0/2317609476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f0c10f180 0x7f8f0c1abba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:22:59.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.986+0000 7f8f0ad9d700 1 -- 172.21.15.8:0/2317609476 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f04009d00 con 0x7f8f0c11a100 2023-08-11T12:22:59.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.989+0000 7f8f0ad9d700 1 --2- 172.21.15.8:0/2317609476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f0c11a100 0x7f8f0c1a56e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8f0400b830 tx=0x7f8f0400cf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:22:59.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.991+0000 7f8efb7fe700 1 -- 172.21.15.8:0/2317609476 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0400e040 con 0x7f8f0c11a100 2023-08-11T12:22:59.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.991+0000 7f8efb7fe700 1 -- 172.21.15.8:0/2317609476 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f040079c0 con 0x7f8f0c11a100 2023-08-11T12:22:59.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.991+0000 7f8efb7fe700 1 -- 172.21.15.8:0/2317609476 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0401bb80 con 0x7f8f0c11a100 2023-08-11T12:22:59.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.991+0000 7f8f10bff700 1 -- 172.21.15.8:0/2317609476 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f0c1a6300 con 0x7f8f0c11a100 2023-08-11T12:22:59.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.991+0000 7f8f10bff700 1 -- 172.21.15.8:0/2317609476 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0c10fb30 con 0x7f8f0c11a100 2023-08-11T12:22:59.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.993+0000 7f8f10bff700 1 -- 172.21.15.8:0/2317609476 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8f0c04e620 con 0x7f8f0c11a100 2023-08-11T12:22:59.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.995+0000 7f8efb7fe700 1 -- 172.21.15.8:0/2317609476 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f8f0401bce0 con 0x7f8f0c11a100 2023-08-11T12:22:59.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.996+0000 7f8efb7fe700 1 --2- 172.21.15.8:0/2317609476 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8ef409ffd0 0x7f8ef40a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:59.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.997+0000 7f8efb7fe700 1 -- 172.21.15.8:0/2317609476 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f8f040cdc50 con 0x7f8f0c11a100 2023-08-11T12:22:59.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.997+0000 7f8f0a59c700 1 --2- 172.21.15.8:0/2317609476 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8ef409ffd0 0x7f8ef40a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:22:59.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.997+0000 7f8efb7fe700 1 --2- 172.21.15.8:0/2317609476 >> [v2:172.21.15.8:6802/664104961,v1:172.21.15.8:6803/664104961] conn(0x7f8ef40aaff0 0x7f8ef40ad490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:22:59.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.997+0000 7f8efb7fe700 1 -- 172.21.15.8:0/2317609476 --> [v2:172.21.15.8:6802/664104961,v1:172.21.15.8:6803/664104961] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8ef40adb60 con 0x7f8ef40aaff0 2023-08-11T12:22:59.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.997+0000 7f8efb7fe700 1 -- 172.21.15.8:0/2317609476 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f040cdfc0 con 0x7f8f0c11a100 2023-08-11T12:23:00.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.998+0000 7f8f09d9b700 1 --2- 172.21.15.8:0/2317609476 >> [v2:172.21.15.8:6802/664104961,v1:172.21.15.8:6803/664104961] conn(0x7f8ef40aaff0 0x7f8ef40ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:00.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.998+0000 7f8f0a59c700 1 --2- 172.21.15.8:0/2317609476 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8ef409ffd0 0x7f8ef40a2490 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8efc009ad0 tx=0x7f8efc009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:00.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.998+0000 7f8f09d9b700 1 --2- 172.21.15.8:0/2317609476 >> [v2:172.21.15.8:6802/664104961,v1:172.21.15.8:6803/664104961] conn(0x7f8ef40aaff0 0x7f8ef40ad490 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:00.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:22:59.999+0000 7f8efb7fe700 1 -- 172.21.15.8:0/2317609476 <== osd.0 v2:172.21.15.8:6802/664104961 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f8ef40adb60 con 0x7f8ef40aaff0 2023-08-11T12:23:00.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:00.035+0000 7f8f10bff700 1 -- 172.21.15.8:0/2317609476 --> [v2:172.21.15.8:6802/664104961,v1:172.21.15.8:6803/664104961] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8f0c11fa50 con 0x7f8ef40aaff0 2023-08-11T12:23:00.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:00.036+0000 7f8efb7fe700 1 -- 172.21.15.8:0/2317609476 <== osd.0 v2:172.21.15.8:6802/664104961 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8f0000a770 con 0x7f8ef40aaff0 2023-08-11T12:23:00.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:00.036+0000 7f8f10bff700 1 -- 172.21.15.8:0/2317609476 >> [v2:172.21.15.8:6802/664104961,v1:172.21.15.8:6803/664104961] conn(0x7f8ef40aaff0 msgr2=0x7f8ef40ad490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:00.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:00.036+0000 7f8f10bff700 1 --2- 172.21.15.8:0/2317609476 >> [v2:172.21.15.8:6802/664104961,v1:172.21.15.8:6803/664104961] conn(0x7f8ef40aaff0 0x7f8ef40ad490 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:00.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:00.036+0000 7f8f10bff700 1 -- 172.21.15.8:0/2317609476 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8ef409ffd0 msgr2=0x7f8ef40a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:00.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:00.036+0000 7f8f10bff700 1 --2- 172.21.15.8:0/2317609476 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8ef409ffd0 0x7f8ef40a2490 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8efc009ad0 tx=0x7f8efc009290 comp rx=0 tx=0).stop 2023-08-11T12:23:00.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:00.036+0000 7f8f10bff700 1 -- 172.21.15.8:0/2317609476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f0c11a100 msgr2=0x7f8f0c1a56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:00.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:00.036+0000 7f8f10bff700 1 --2- 172.21.15.8:0/2317609476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f0c11a100 0x7f8f0c1a56e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8f0400b830 tx=0x7f8f0400cf50 comp rx=0 tx=0).stop 2023-08-11T12:23:00.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:00.036+0000 7f8f0ad9d700 1 -- 172.21.15.8:0/2317609476 reap_dead start 2023-08-11T12:23:00.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:00.036+0000 7f8f10bff700 1 -- 172.21.15.8:0/2317609476 shutdown_connections 2023-08-11T12:23:00.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:00.036+0000 7f8f10bff700 1 -- 172.21.15.8:0/2317609476 >> 172.21.15.8:0/2317609476 conn(0x7f8f0c06cb20 msgr2=0x7f8f0c06f400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:00.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:00.037+0000 7f8f10bff700 1 -- 172.21.15.8:0/2317609476 shutdown_connections 2023-08-11T12:23:00.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:00.037+0000 7f8f10bff700 1 -- 172.21.15.8:0/2317609476 wait complete. 2023-08-11T12:23:00.916 INFO:teuthology.orchestra.run.smithi008.stdout:141733920823 2023-08-11T12:23:00.917 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.4 2023-08-11T12:23:00.984 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:00 smithi008 ceph-mon[97158]: pgmap v304: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:01.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.134+0000 7fb23703a700 1 -- 172.21.15.8:0/1943559509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2300688e0 msgr2=0x7fb230068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:01.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.134+0000 7fb23703a700 1 --2- 172.21.15.8:0/1943559509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2300688e0 0x7fb230068cc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb2240099c0 tx=0x7fb224009cd0 comp rx=0 tx=0).stop 2023-08-11T12:23:01.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.135+0000 7fb23703a700 1 -- 172.21.15.8:0/1943559509 shutdown_connections 2023-08-11T12:23:01.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.135+0000 7fb23703a700 1 --2- 172.21.15.8:0/1943559509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb230105d50 0x7fb23010d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:01.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.135+0000 7fb23703a700 1 --2- 172.21.15.8:0/1943559509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2300688e0 0x7fb230068cc0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:01.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.135+0000 7fb23703a700 1 --2- 172.21.15.8:0/1943559509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb230105390 0x7fb230105810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:01.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.135+0000 7fb23703a700 1 -- 172.21.15.8:0/1943559509 >> 172.21.15.8:0/1943559509 conn(0x7fb230076920 msgr2=0x7fb230076d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:01.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.135+0000 7fb23703a700 1 -- 172.21.15.8:0/1943559509 shutdown_connections 2023-08-11T12:23:01.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.135+0000 7fb23703a700 1 -- 172.21.15.8:0/1943559509 wait complete. 2023-08-11T12:23:01.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.136+0000 7fb23703a700 1 Processor -- start 2023-08-11T12:23:01.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.136+0000 7fb23703a700 1 -- start start 2023-08-11T12:23:01.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.136+0000 7fb23703a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2300688e0 0x7fb23019c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:01.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.137+0000 7fb23703a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb230105390 0x7fb23019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:01.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.137+0000 7fb23703a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb230105d50 0x7fb230196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:01.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.137+0000 7fb23703a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb230196e90 con 0x7fb230105390 2023-08-11T12:23:01.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.137+0000 7fb23703a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb230197000 con 0x7fb2300688e0 2023-08-11T12:23:01.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.137+0000 7fb23703a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2301971c0 con 0x7fb230105d50 2023-08-11T12:23:01.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.137+0000 7fb22ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb230105390 0x7fb23019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:01.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.137+0000 7fb22ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb230105390 0x7fb23019cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58720/0 (socket says 172.21.15.8:58720) 2023-08-11T12:23:01.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.137+0000 7fb2355d7700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb230105d50 0x7fb230196820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:01.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.137+0000 7fb22ffff700 1 -- 172.21.15.8:0/3107650141 learned_addr learned my addr 172.21.15.8:0/3107650141 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:01.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.137+0000 7fb234dd6700 1 --2- 172.21.15.8:0/3107650141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2300688e0 0x7fb23019c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:01.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.138+0000 7fb2355d7700 1 -- 172.21.15.8:0/3107650141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2300688e0 msgr2=0x7fb23019c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:01.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.138+0000 7fb2355d7700 1 --2- 172.21.15.8:0/3107650141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2300688e0 0x7fb23019c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:01.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.138+0000 7fb2355d7700 1 -- 172.21.15.8:0/3107650141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb230105390 msgr2=0x7fb23019cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:01.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.138+0000 7fb2355d7700 1 --2- 172.21.15.8:0/3107650141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb230105390 0x7fb23019cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:01.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.138+0000 7fb2355d7700 1 -- 172.21.15.8:0/3107650141 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2240095f0 con 0x7fb230105d50 2023-08-11T12:23:01.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.138+0000 7fb22ffff700 1 --2- 172.21.15.8:0/3107650141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb230105390 0x7fb23019cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:01.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.138+0000 7fb2355d7700 1 --2- 172.21.15.8:0/3107650141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb230105d50 0x7fb230196820 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb22800efc0 tx=0x7fb22800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:01.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.138+0000 7fb22dffb700 1 -- 172.21.15.8:0/3107650141 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb228018070 con 0x7fb230105d50 2023-08-11T12:23:01.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.138+0000 7fb23703a700 1 -- 172.21.15.8:0/3107650141 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb230197440 con 0x7fb230105d50 2023-08-11T12:23:01.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.138+0000 7fb22dffb700 1 -- 172.21.15.8:0/3107650141 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb22800f040 con 0x7fb230105d50 2023-08-11T12:23:01.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.138+0000 7fb22dffb700 1 -- 172.21.15.8:0/3107650141 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22800cd30 con 0x7fb230105d50 2023-08-11T12:23:01.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:00 smithi194 ceph-mon[130905]: pgmap v304: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:01.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.138+0000 7fb23703a700 1 -- 172.21.15.8:0/3107650141 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2301a3790 con 0x7fb230105d50 2023-08-11T12:23:01.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.139+0000 7fb23703a700 1 -- 172.21.15.8:0/3107650141 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb23004e620 con 0x7fb230105d50 2023-08-11T12:23:01.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.142+0000 7fb22dffb700 1 -- 172.21.15.8:0/3107650141 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fb228003a00 con 0x7fb230105d50 2023-08-11T12:23:01.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.143+0000 7fb22dffb700 1 --2- 172.21.15.8:0/3107650141 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb22009ff50 0x7fb2200a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:01.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:00 smithi045 ceph-mon[130284]: pgmap v304: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:01.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.143+0000 7fb22dffb700 1 -- 172.21.15.8:0/3107650141 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb2280cba40 con 0x7fb230105d50 2023-08-11T12:23:01.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.143+0000 7fb234dd6700 1 --2- 172.21.15.8:0/3107650141 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb22009ff50 0x7fb2200a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:01.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.144+0000 7fb22dffb700 1 --2- 172.21.15.8:0/3107650141 >> [v2:172.21.15.45:6800/4187350703,v1:172.21.15.45:6801/4187350703] conn(0x7fb2200aaf70 0x7fb2200ad410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:01.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.144+0000 7fb22dffb700 1 -- 172.21.15.8:0/3107650141 --> [v2:172.21.15.45:6800/4187350703,v1:172.21.15.45:6801/4187350703] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb2200adae0 con 0x7fb2200aaf70 2023-08-11T12:23:01.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.144+0000 7fb22dffb700 1 -- 172.21.15.8:0/3107650141 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2280cbdb0 con 0x7fb230105d50 2023-08-11T12:23:01.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.144+0000 7fb22ffff700 1 --2- 172.21.15.8:0/3107650141 >> [v2:172.21.15.45:6800/4187350703,v1:172.21.15.45:6801/4187350703] conn(0x7fb2200aaf70 0x7fb2200ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:01.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.144+0000 7fb234dd6700 1 --2- 172.21.15.8:0/3107650141 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb22009ff50 0x7fb2200a2410 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb224000c00 tx=0x7fb224005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:01.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.145+0000 7fb22ffff700 1 --2- 172.21.15.8:0/3107650141 >> [v2:172.21.15.45:6800/4187350703,v1:172.21.15.45:6801/4187350703] conn(0x7fb2200aaf70 0x7fb2200ad410 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:01.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.145+0000 7fb22dffb700 1 -- 172.21.15.8:0/3107650141 <== osd.1 v2:172.21.15.45:6800/4187350703 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fb2200adae0 con 0x7fb2200aaf70 2023-08-11T12:23:01.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.163+0000 7fb23703a700 1 -- 172.21.15.8:0/3107650141 --> [v2:172.21.15.45:6800/4187350703,v1:172.21.15.45:6801/4187350703] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb230110be0 con 0x7fb2200aaf70 2023-08-11T12:23:01.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.164+0000 7fb22dffb700 1 -- 172.21.15.8:0/3107650141 <== osd.1 v2:172.21.15.45:6800/4187350703 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb21c009e40 con 0x7fb2200aaf70 2023-08-11T12:23:01.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.164+0000 7fb23703a700 1 -- 172.21.15.8:0/3107650141 >> [v2:172.21.15.45:6800/4187350703,v1:172.21.15.45:6801/4187350703] conn(0x7fb2200aaf70 msgr2=0x7fb2200ad410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:01.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.164+0000 7fb23703a700 1 --2- 172.21.15.8:0/3107650141 >> [v2:172.21.15.45:6800/4187350703,v1:172.21.15.45:6801/4187350703] conn(0x7fb2200aaf70 0x7fb2200ad410 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:01.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.164+0000 7fb23703a700 1 -- 172.21.15.8:0/3107650141 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb22009ff50 msgr2=0x7fb2200a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:01.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.164+0000 7fb23703a700 1 --2- 172.21.15.8:0/3107650141 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb22009ff50 0x7fb2200a2410 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb224000c00 tx=0x7fb224005fb0 comp rx=0 tx=0).stop 2023-08-11T12:23:01.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.164+0000 7fb23703a700 1 -- 172.21.15.8:0/3107650141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb230105d50 msgr2=0x7fb230196820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:01.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.164+0000 7fb23703a700 1 --2- 172.21.15.8:0/3107650141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb230105d50 0x7fb230196820 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb22800efc0 tx=0x7fb22800c3a0 comp rx=0 tx=0).stop 2023-08-11T12:23:01.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.164+0000 7fb2355d7700 1 -- 172.21.15.8:0/3107650141 reap_dead start 2023-08-11T12:23:01.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.164+0000 7fb23703a700 1 -- 172.21.15.8:0/3107650141 shutdown_connections 2023-08-11T12:23:01.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.164+0000 7fb23703a700 1 -- 172.21.15.8:0/3107650141 >> 172.21.15.8:0/3107650141 conn(0x7fb230076920 msgr2=0x7fb2300fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:01.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.165+0000 7fb23703a700 1 -- 172.21.15.8:0/3107650141 shutdown_connections 2023-08-11T12:23:01.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.165+0000 7fb23703a700 1 -- 172.21.15.8:0/3107650141 wait complete. 2023-08-11T12:23:01.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.373+0000 7fd13cb04700 1 -- 172.21.15.8:0/1890397779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd138105d50 msgr2=0x7fd13810d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:01.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.373+0000 7fd13cb04700 1 --2- 172.21.15.8:0/1890397779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd138105d50 0x7fd13810d760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd130009fc0 tx=0x7fd13000b330 comp rx=0 tx=0).stop 2023-08-11T12:23:01.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.374+0000 7fd13cb04700 1 -- 172.21.15.8:0/1890397779 shutdown_connections 2023-08-11T12:23:01.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.374+0000 7fd13cb04700 1 --2- 172.21.15.8:0/1890397779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd138105d50 0x7fd13810d760 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:01.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.374+0000 7fd13cb04700 1 --2- 172.21.15.8:0/1890397779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1380688e0 0x7fd138068cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:01.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.374+0000 7fd13cb04700 1 --2- 172.21.15.8:0/1890397779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd138105390 0x7fd138105810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:01.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.374+0000 7fd13cb04700 1 -- 172.21.15.8:0/1890397779 >> 172.21.15.8:0/1890397779 conn(0x7fd138076920 msgr2=0x7fd138076d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:01.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.374+0000 7fd13cb04700 1 -- 172.21.15.8:0/1890397779 shutdown_connections 2023-08-11T12:23:01.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.374+0000 7fd13cb04700 1 -- 172.21.15.8:0/1890397779 wait complete. 2023-08-11T12:23:01.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.375+0000 7fd13cb04700 1 Processor -- start 2023-08-11T12:23:01.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.375+0000 7fd13cb04700 1 -- start start 2023-08-11T12:23:01.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.375+0000 7fd13cb04700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1380688e0 0x7fd138072120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:01.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.375+0000 7fd13cb04700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd138105390 0x7fd1380ff880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:01.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.375+0000 7fd13cb04700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd138105d50 0x7fd1380ffdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:01.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.375+0000 7fd13cb04700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1380728f0 con 0x7fd1380688e0 2023-08-11T12:23:01.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.375+0000 7fd13cb04700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd138100300 con 0x7fd138105390 2023-08-11T12:23:01.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.375+0000 7fd13cb04700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1381004c0 con 0x7fd138105d50 2023-08-11T12:23:01.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.376+0000 7fd136d9d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd138105d50 0x7fd1380ffdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:01.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.376+0000 7fd136d9d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd138105d50 0x7fd1380ffdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:37782/0 (socket says 172.21.15.8:37782) 2023-08-11T12:23:01.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.376+0000 7fd136d9d700 1 -- 172.21.15.8:0/1312658523 learned_addr learned my addr 172.21.15.8:0/1312658523 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:01.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.376+0000 7fd13659c700 1 --2- 172.21.15.8:0/1312658523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1380688e0 0x7fd138072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:01.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.376+0000 7fd135d9b700 1 --2- 172.21.15.8:0/1312658523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd138105390 0x7fd1380ff880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:01.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.376+0000 7fd136d9d700 1 -- 172.21.15.8:0/1312658523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd138105390 msgr2=0x7fd1380ff880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:01.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.376+0000 7fd136d9d700 1 --2- 172.21.15.8:0/1312658523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd138105390 0x7fd1380ff880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:01.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.376+0000 7fd136d9d700 1 -- 172.21.15.8:0/1312658523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1380688e0 msgr2=0x7fd138072120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:01.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.376+0000 7fd136d9d700 1 --2- 172.21.15.8:0/1312658523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1380688e0 0x7fd138072120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:01.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.376+0000 7fd136d9d700 1 -- 172.21.15.8:0/1312658523 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd130009c40 con 0x7fd138105d50 2023-08-11T12:23:01.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.377+0000 7fd136d9d700 1 --2- 172.21.15.8:0/1312658523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd138105d50 0x7fd1380ffdc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd130009000 tx=0x7fd1300094d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:01.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.377+0000 7fd1277fe700 1 -- 172.21.15.8:0/1312658523 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13000e040 con 0x7fd138105d50 2023-08-11T12:23:01.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.377+0000 7fd13cb04700 1 -- 172.21.15.8:0/1312658523 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd13806ace0 con 0x7fd138105d50 2023-08-11T12:23:01.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.377+0000 7fd13cb04700 1 -- 172.21.15.8:0/1312658523 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd13806b230 con 0x7fd138105d50 2023-08-11T12:23:01.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.377+0000 7fd1277fe700 1 -- 172.21.15.8:0/1312658523 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd130024070 con 0x7fd138105d50 2023-08-11T12:23:01.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.377+0000 7fd1277fe700 1 -- 172.21.15.8:0/1312658523 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13002b9b0 con 0x7fd138105d50 2023-08-11T12:23:01.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.379+0000 7fd1257fa700 1 -- 172.21.15.8:0/1312658523 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd11c000fc0 con 0x7fd138105d50 2023-08-11T12:23:01.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.381+0000 7fd1277fe700 1 -- 172.21.15.8:0/1312658523 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fd13002bb10 con 0x7fd138105d50 2023-08-11T12:23:01.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.382+0000 7fd1277fe700 1 --2- 172.21.15.8:0/1312658523 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd12009ffd0 0x7fd1200a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:01.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.382+0000 7fd1277fe700 1 -- 172.21.15.8:0/1312658523 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fd130026070 con 0x7fd138105d50 2023-08-11T12:23:01.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.383+0000 7fd13659c700 1 --2- 172.21.15.8:0/1312658523 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd12009ffd0 0x7fd1200a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:01.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.383+0000 7fd1277fe700 1 --2- 172.21.15.8:0/1312658523 >> [v2:172.21.15.194:6808/263803874,v1:172.21.15.194:6809/263803874] conn(0x7fd1200aaff0 0x7fd1200ad490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:01.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.383+0000 7fd1277fe700 1 -- 172.21.15.8:0/1312658523 --> [v2:172.21.15.194:6808/263803874,v1:172.21.15.194:6809/263803874] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd1200adb60 con 0x7fd1200aaff0 2023-08-11T12:23:01.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.383+0000 7fd1277fe700 1 -- 172.21.15.8:0/1312658523 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1300d5420 con 0x7fd138105d50 2023-08-11T12:23:01.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.383+0000 7fd135d9b700 1 --2- 172.21.15.8:0/1312658523 >> [v2:172.21.15.194:6808/263803874,v1:172.21.15.194:6809/263803874] conn(0x7fd1200aaff0 0x7fd1200ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:01.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.383+0000 7fd13659c700 1 --2- 172.21.15.8:0/1312658523 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd12009ffd0 0x7fd1200a2490 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd128005fd0 tx=0x7fd128009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:01.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.384+0000 7fd135d9b700 1 --2- 172.21.15.8:0/1312658523 >> [v2:172.21.15.194:6808/263803874,v1:172.21.15.194:6809/263803874] conn(0x7fd1200aaff0 0x7fd1200ad490 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:01.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.385+0000 7fd1277fe700 1 -- 172.21.15.8:0/1312658523 <== osd.5 v2:172.21.15.194:6808/263803874 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd1200adb60 con 0x7fd1200aaff0 2023-08-11T12:23:01.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.401+0000 7fd1257fa700 1 -- 172.21.15.8:0/1312658523 --> [v2:172.21.15.194:6808/263803874,v1:172.21.15.194:6809/263803874] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd11c002d40 con 0x7fd1200aaff0 2023-08-11T12:23:01.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.402+0000 7fd1277fe700 1 -- 172.21.15.8:0/1312658523 <== osd.5 v2:172.21.15.194:6808/263803874 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd11c002d40 con 0x7fd1200aaff0 2023-08-11T12:23:01.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.402+0000 7fd1257fa700 1 -- 172.21.15.8:0/1312658523 >> [v2:172.21.15.194:6808/263803874,v1:172.21.15.194:6809/263803874] conn(0x7fd1200aaff0 msgr2=0x7fd1200ad490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:01.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.402+0000 7fd1257fa700 1 --2- 172.21.15.8:0/1312658523 >> [v2:172.21.15.194:6808/263803874,v1:172.21.15.194:6809/263803874] conn(0x7fd1200aaff0 0x7fd1200ad490 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:01.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.402+0000 7fd1257fa700 1 -- 172.21.15.8:0/1312658523 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd12009ffd0 msgr2=0x7fd1200a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:01.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.402+0000 7fd1257fa700 1 --2- 172.21.15.8:0/1312658523 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd12009ffd0 0x7fd1200a2490 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd128005fd0 tx=0x7fd128009310 comp rx=0 tx=0).stop 2023-08-11T12:23:01.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.402+0000 7fd1257fa700 1 -- 172.21.15.8:0/1312658523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd138105d50 msgr2=0x7fd1380ffdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:01.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.402+0000 7fd1257fa700 1 --2- 172.21.15.8:0/1312658523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd138105d50 0x7fd1380ffdc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd130009000 tx=0x7fd1300094d0 comp rx=0 tx=0).stop 2023-08-11T12:23:01.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.402+0000 7fd136d9d700 1 -- 172.21.15.8:0/1312658523 reap_dead start 2023-08-11T12:23:01.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.403+0000 7fd1257fa700 1 -- 172.21.15.8:0/1312658523 shutdown_connections 2023-08-11T12:23:01.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.403+0000 7fd1257fa700 1 -- 172.21.15.8:0/1312658523 >> 172.21.15.8:0/1312658523 conn(0x7fd138076920 msgr2=0x7fd1380fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:01.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.403+0000 7fd1257fa700 1 -- 172.21.15.8:0/1312658523 shutdown_connections 2023-08-11T12:23:01.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.403+0000 7fd1257fa700 1 -- 172.21.15.8:0/1312658523 wait complete. 2023-08-11T12:23:02.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.526+0000 7fc969a62700 1 -- 172.21.15.8:0/150960929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc964100940 msgr2=0x7fc964100dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:02.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.526+0000 7fc969a62700 1 --2- 172.21.15.8:0/150960929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc964100940 0x7fc964100dc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc958009990 tx=0x7fc958009ca0 comp rx=0 tx=0).stop 2023-08-11T12:23:02.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.526+0000 7fc969a62700 1 -- 172.21.15.8:0/150960929 shutdown_connections 2023-08-11T12:23:02.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.526+0000 7fc969a62700 1 --2- 172.21.15.8:0/150960929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc964106940 0x7fc964106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:02.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.526+0000 7fc969a62700 1 --2- 172.21.15.8:0/150960929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc964101300 0x7fc96410d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:02.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.526+0000 7fc969a62700 1 --2- 172.21.15.8:0/150960929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc964100940 0x7fc964100dc0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:02.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.526+0000 7fc969a62700 1 -- 172.21.15.8:0/150960929 >> 172.21.15.8:0/150960929 conn(0x7fc9640fc410 msgr2=0x7fc9640fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:02.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.526+0000 7fc969a62700 1 -- 172.21.15.8:0/150960929 shutdown_connections 2023-08-11T12:23:02.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.527+0000 7fc969a62700 1 -- 172.21.15.8:0/150960929 wait complete. 2023-08-11T12:23:02.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.528+0000 7fc969a62700 1 Processor -- start 2023-08-11T12:23:02.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.528+0000 7fc969a62700 1 -- start start 2023-08-11T12:23:02.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.528+0000 7fc969a62700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc964100940 0x7fc96419e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:02.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.528+0000 7fc969a62700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc964101300 0x7fc96419ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:02.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.528+0000 7fc969a62700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc964106940 0x7fc964198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:02.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.528+0000 7fc969a62700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9641990c0 con 0x7fc964106940 2023-08-11T12:23:02.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.528+0000 7fc969a62700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc964199230 con 0x7fc964100940 2023-08-11T12:23:02.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.528+0000 7fc969a62700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9641993f0 con 0x7fc964101300 2023-08-11T12:23:02.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.528+0000 7fc962ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc964101300 0x7fc96419ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:02.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.528+0000 7fc9637fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc964100940 0x7fc96419e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:02.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.529+0000 7fc962ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc964101300 0x7fc96419ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:37788/0 (socket says 172.21.15.8:37788) 2023-08-11T12:23:02.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.529+0000 7fc963fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc964106940 0x7fc964198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:02.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.529+0000 7fc962ffd700 1 -- 172.21.15.8:0/1230588332 learned_addr learned my addr 172.21.15.8:0/1230588332 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:02.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.529+0000 7fc9637fe700 1 -- 172.21.15.8:0/1230588332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc964101300 msgr2=0x7fc96419ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:02.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.529+0000 7fc9637fe700 1 --2- 172.21.15.8:0/1230588332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc964101300 0x7fc96419ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:02.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.529+0000 7fc9637fe700 1 -- 172.21.15.8:0/1230588332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc964106940 msgr2=0x7fc964198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:02.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.529+0000 7fc9637fe700 1 --2- 172.21.15.8:0/1230588332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc964106940 0x7fc964198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:02.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.529+0000 7fc9637fe700 1 -- 172.21.15.8:0/1230588332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9580095f0 con 0x7fc964100940 2023-08-11T12:23:02.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.529+0000 7fc963fff700 1 --2- 172.21.15.8:0/1230588332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc964106940 0x7fc964198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:02.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.529+0000 7fc962ffd700 1 --2- 172.21.15.8:0/1230588332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc964101300 0x7fc96419ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:02.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.529+0000 7fc9637fe700 1 --2- 172.21.15.8:0/1230588332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc964100940 0x7fc96419e9d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc95400e9f0 tx=0x7fc95400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:02.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.530+0000 7fc960ff9700 1 -- 172.21.15.8:0/1230588332 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95400c9c0 con 0x7fc964100940 2023-08-11T12:23:02.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.530+0000 7fc960ff9700 1 -- 172.21.15.8:0/1230588332 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc954010430 con 0x7fc964100940 2023-08-11T12:23:02.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.530+0000 7fc969a62700 1 -- 172.21.15.8:0/1230588332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9641996d0 con 0x7fc964100940 2023-08-11T12:23:02.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.530+0000 7fc960ff9700 1 -- 172.21.15.8:0/1230588332 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc954018680 con 0x7fc964100940 2023-08-11T12:23:02.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.530+0000 7fc969a62700 1 -- 172.21.15.8:0/1230588332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9641a59c0 con 0x7fc964100940 2023-08-11T12:23:02.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.531+0000 7fc969a62700 1 -- 172.21.15.8:0/1230588332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc96404e620 con 0x7fc964100940 2023-08-11T12:23:02.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.533+0000 7fc960ff9700 1 -- 172.21.15.8:0/1230588332 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fc954010860 con 0x7fc964100940 2023-08-11T12:23:02.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.534+0000 7fc960ff9700 1 --2- 172.21.15.8:0/1230588332 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc94c09ff50 0x7fc94c0a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:02.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.534+0000 7fc960ff9700 1 -- 172.21.15.8:0/1230588332 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc954014070 con 0x7fc964100940 2023-08-11T12:23:02.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.535+0000 7fc962ffd700 1 --2- 172.21.15.8:0/1230588332 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc94c09ff50 0x7fc94c0a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:02.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.535+0000 7fc960ff9700 1 --2- 172.21.15.8:0/1230588332 >> [v2:172.21.15.8:6818/1802966829,v1:172.21.15.8:6819/1802966829] conn(0x7fc94c0aaf70 0x7fc94c0ad410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:02.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.535+0000 7fc960ff9700 1 -- 172.21.15.8:0/1230588332 --> [v2:172.21.15.8:6818/1802966829,v1:172.21.15.8:6819/1802966829] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc94c0adae0 con 0x7fc94c0aaf70 2023-08-11T12:23:02.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.535+0000 7fc960ff9700 1 -- 172.21.15.8:0/1230588332 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9540cbc70 con 0x7fc964100940 2023-08-11T12:23:02.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.535+0000 7fc963fff700 1 --2- 172.21.15.8:0/1230588332 >> [v2:172.21.15.8:6818/1802966829,v1:172.21.15.8:6819/1802966829] conn(0x7fc94c0aaf70 0x7fc94c0ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:02.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.535+0000 7fc962ffd700 1 --2- 172.21.15.8:0/1230588332 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc94c09ff50 0x7fc94c0a2410 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc964105eb0 tx=0x7fc958005960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:02.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.536+0000 7fc963fff700 1 --2- 172.21.15.8:0/1230588332 >> [v2:172.21.15.8:6818/1802966829,v1:172.21.15.8:6819/1802966829] conn(0x7fc94c0aaf70 0x7fc94c0ad410 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:02.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.537+0000 7fc960ff9700 1 -- 172.21.15.8:0/1230588332 <== osd.6 v2:172.21.15.8:6818/1802966829 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fc94c0adae0 con 0x7fc94c0aaf70 2023-08-11T12:23:02.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.557+0000 7fc969a62700 1 -- 172.21.15.8:0/1230588332 --> [v2:172.21.15.8:6818/1802966829,v1:172.21.15.8:6819/1802966829] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc9640fdba0 con 0x7fc94c0aaf70 2023-08-11T12:23:02.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.557+0000 7fc960ff9700 1 -- 172.21.15.8:0/1230588332 <== osd.6 v2:172.21.15.8:6818/1802966829 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc9640fdba0 con 0x7fc94c0aaf70 2023-08-11T12:23:02.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.558+0000 7fc969a62700 1 -- 172.21.15.8:0/1230588332 >> [v2:172.21.15.8:6818/1802966829,v1:172.21.15.8:6819/1802966829] conn(0x7fc94c0aaf70 msgr2=0x7fc94c0ad410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:02.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.558+0000 7fc969a62700 1 --2- 172.21.15.8:0/1230588332 >> [v2:172.21.15.8:6818/1802966829,v1:172.21.15.8:6819/1802966829] conn(0x7fc94c0aaf70 0x7fc94c0ad410 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:02.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.558+0000 7fc969a62700 1 -- 172.21.15.8:0/1230588332 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc94c09ff50 msgr2=0x7fc94c0a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:02.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.558+0000 7fc969a62700 1 --2- 172.21.15.8:0/1230588332 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc94c09ff50 0x7fc94c0a2410 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc964105eb0 tx=0x7fc958005960 comp rx=0 tx=0).stop 2023-08-11T12:23:02.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.558+0000 7fc969a62700 1 -- 172.21.15.8:0/1230588332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc964100940 msgr2=0x7fc96419e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:02.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.558+0000 7fc969a62700 1 --2- 172.21.15.8:0/1230588332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc964100940 0x7fc96419e9d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc95400e9f0 tx=0x7fc95400ed00 comp rx=0 tx=0).stop 2023-08-11T12:23:02.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.558+0000 7fc963fff700 1 -- 172.21.15.8:0/1230588332 reap_dead start 2023-08-11T12:23:02.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.558+0000 7fc969a62700 1 -- 172.21.15.8:0/1230588332 shutdown_connections 2023-08-11T12:23:02.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.558+0000 7fc969a62700 1 -- 172.21.15.8:0/1230588332 >> 172.21.15.8:0/1230588332 conn(0x7fc9640fc410 msgr2=0x7fc96410bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:02.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.558+0000 7fc969a62700 1 -- 172.21.15.8:0/1230588332 shutdown_connections 2023-08-11T12:23:02.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:01.558+0000 7fc969a62700 1 -- 172.21.15.8:0/1230588332 wait complete. 2023-08-11T12:23:02.472 INFO:teuthology.orchestra.run.smithi008.stdout:34359738441 2023-08-11T12:23:02.473 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.0 2023-08-11T12:23:02.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.986+0000 7fdaa13bd700 1 -- 172.21.15.8:0/3834976658 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda9c101300 msgr2=0x7fda9c10d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:02.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.986+0000 7fdaa13bd700 1 --2- 172.21.15.8:0/3834976658 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda9c101300 0x7fda9c10d810 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fda9400b0a0 tx=0x7fda9400b3b0 comp rx=0 tx=0).stop 2023-08-11T12:23:02.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.986+0000 7fdaa13bd700 1 -- 172.21.15.8:0/3834976658 shutdown_connections 2023-08-11T12:23:02.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.986+0000 7fdaa13bd700 1 --2- 172.21.15.8:0/3834976658 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda9c101300 0x7fda9c10d810 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:02.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.986+0000 7fdaa13bd700 1 --2- 172.21.15.8:0/3834976658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda9c106940 0x7fda9c106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:02.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.986+0000 7fdaa13bd700 1 --2- 172.21.15.8:0/3834976658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda9c100940 0x7fda9c100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:02.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.986+0000 7fdaa13bd700 1 -- 172.21.15.8:0/3834976658 >> 172.21.15.8:0/3834976658 conn(0x7fda9c0fc410 msgr2=0x7fda9c0fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:02.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.986+0000 7fdaa13bd700 1 -- 172.21.15.8:0/3834976658 shutdown_connections 2023-08-11T12:23:02.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.986+0000 7fdaa13bd700 1 -- 172.21.15.8:0/3834976658 wait complete. 2023-08-11T12:23:02.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.987+0000 7fdaa13bd700 1 Processor -- start 2023-08-11T12:23:02.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.987+0000 7fdaa13bd700 1 -- start start 2023-08-11T12:23:02.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.988+0000 7fdaa13bd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda9c100940 0x7fda9c072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:02.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.988+0000 7fdaa13bd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda9c101300 0x7fda9c073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:02.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.988+0000 7fdaa13bd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda9c106940 0x7fda9c0736e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:02.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.988+0000 7fdaa13bd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c1a4f90 con 0x7fda9c100940 2023-08-11T12:23:02.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.988+0000 7fdaa13bd700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c1a5100 con 0x7fda9c101300 2023-08-11T12:23:02.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.988+0000 7fdaa13bd700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c1a52c0 con 0x7fda9c106940 2023-08-11T12:23:02.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.988+0000 7fda92ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda9c100940 0x7fda9c072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:02.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.988+0000 7fda9affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda9c101300 0x7fda9c073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:02.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.988+0000 7fda9affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda9c101300 0x7fda9c073160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:58568/0 (socket says 172.21.15.8:58568) 2023-08-11T12:23:02.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.988+0000 7fda9affd700 1 -- 172.21.15.8:0/1599638715 learned_addr learned my addr 172.21.15.8:0/1599638715 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:02.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.988+0000 7fda9b7fe700 1 --2- 172.21.15.8:0/1599638715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda9c106940 0x7fda9c0736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:02.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.989+0000 7fda9b7fe700 1 -- 172.21.15.8:0/1599638715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda9c101300 msgr2=0x7fda9c073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:02.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.989+0000 7fda9b7fe700 1 --2- 172.21.15.8:0/1599638715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda9c101300 0x7fda9c073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:02.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.989+0000 7fda9b7fe700 1 -- 172.21.15.8:0/1599638715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda9c100940 msgr2=0x7fda9c072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:02.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.989+0000 7fda9b7fe700 1 --2- 172.21.15.8:0/1599638715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda9c100940 0x7fda9c072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:02.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.989+0000 7fda9b7fe700 1 -- 172.21.15.8:0/1599638715 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c009520 con 0x7fda9c106940 2023-08-11T12:23:02.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.989+0000 7fda9affd700 1 --2- 172.21.15.8:0/1599638715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda9c101300 0x7fda9c073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:02.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.989+0000 7fda9b7fe700 1 --2- 172.21.15.8:0/1599638715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda9c106940 0x7fda9c0736e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fda94009fd0 tx=0x7fda94007930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:02.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.989+0000 7fda98ff9700 1 -- 172.21.15.8:0/1599638715 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9400e040 con 0x7fda9c106940 2023-08-11T12:23:02.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.989+0000 7fda98ff9700 1 -- 172.21.15.8:0/1599638715 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda9401d470 con 0x7fda9c106940 2023-08-11T12:23:02.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.989+0000 7fdaa13bd700 1 -- 172.21.15.8:0/1599638715 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda94009d00 con 0x7fda9c106940 2023-08-11T12:23:02.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.989+0000 7fda98ff9700 1 -- 172.21.15.8:0/1599638715 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda940052a0 con 0x7fda9c106940 2023-08-11T12:23:02.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.989+0000 7fdaa13bd700 1 -- 172.21.15.8:0/1599638715 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9c1a5820 con 0x7fda9c106940 2023-08-11T12:23:02.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.990+0000 7fdaa13bd700 1 -- 172.21.15.8:0/1599638715 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fda9c04e620 con 0x7fda9c106940 2023-08-11T12:23:02.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.993+0000 7fda98ff9700 1 -- 172.21.15.8:0/1599638715 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fda9401d5e0 con 0x7fda9c106940 2023-08-11T12:23:02.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.994+0000 7fda98ff9700 1 --2- 172.21.15.8:0/1599638715 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fda8809ff50 0x7fda880a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:02.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.994+0000 7fda98ff9700 1 -- 172.21.15.8:0/1599638715 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fda940ccbf0 con 0x7fda9c106940 2023-08-11T12:23:02.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.994+0000 7fda92ffd700 1 --2- 172.21.15.8:0/1599638715 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fda8809ff50 0x7fda880a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:02.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.994+0000 7fda98ff9700 1 --2- 172.21.15.8:0/1599638715 >> [v2:172.21.15.194:6824/1637875895,v1:172.21.15.194:6825/1637875895] conn(0x7fda880aaf70 0x7fda880ad410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:02.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.994+0000 7fda98ff9700 1 -- 172.21.15.8:0/1599638715 --> [v2:172.21.15.194:6824/1637875895,v1:172.21.15.194:6825/1637875895] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fda880adae0 con 0x7fda880aaf70 2023-08-11T12:23:02.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.994+0000 7fda98ff9700 1 -- 172.21.15.8:0/1599638715 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda940ccf60 con 0x7fda9c106940 2023-08-11T12:23:02.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.995+0000 7fda9affd700 1 --2- 172.21.15.8:0/1599638715 >> [v2:172.21.15.194:6824/1637875895,v1:172.21.15.194:6825/1637875895] conn(0x7fda880aaf70 0x7fda880ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:02.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.995+0000 7fda92ffd700 1 --2- 172.21.15.8:0/1599638715 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fda8809ff50 0x7fda880a2410 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fda8c009d70 tx=0x7fda8c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:02.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.995+0000 7fda9affd700 1 --2- 172.21.15.8:0/1599638715 >> [v2:172.21.15.194:6824/1637875895,v1:172.21.15.194:6825/1637875895] conn(0x7fda880aaf70 0x7fda880ad410 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:02.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.996+0000 7fda98ff9700 1 -- 172.21.15.8:0/1599638715 <== osd.11 v2:172.21.15.194:6824/1637875895 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fda880adae0 con 0x7fda880aaf70 2023-08-11T12:23:03.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.015+0000 7fdaa13bd700 1 -- 172.21.15.8:0/1599638715 --> [v2:172.21.15.194:6824/1637875895,v1:172.21.15.194:6825/1637875895] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fda9c110c20 con 0x7fda880aaf70 2023-08-11T12:23:03.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.016+0000 7fda98ff9700 1 -- 172.21.15.8:0/1599638715 <== osd.11 v2:172.21.15.194:6824/1637875895 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fda84009e40 con 0x7fda880aaf70 2023-08-11T12:23:03.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.016+0000 7fdaa13bd700 1 -- 172.21.15.8:0/1599638715 >> [v2:172.21.15.194:6824/1637875895,v1:172.21.15.194:6825/1637875895] conn(0x7fda880aaf70 msgr2=0x7fda880ad410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:03.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.016+0000 7fdaa13bd700 1 --2- 172.21.15.8:0/1599638715 >> [v2:172.21.15.194:6824/1637875895,v1:172.21.15.194:6825/1637875895] conn(0x7fda880aaf70 0x7fda880ad410 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:03.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.016+0000 7fdaa13bd700 1 -- 172.21.15.8:0/1599638715 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fda8809ff50 msgr2=0x7fda880a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:03.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.016+0000 7fdaa13bd700 1 --2- 172.21.15.8:0/1599638715 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fda8809ff50 0x7fda880a2410 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fda8c009d70 tx=0x7fda8c009260 comp rx=0 tx=0).stop 2023-08-11T12:23:03.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.016+0000 7fdaa13bd700 1 -- 172.21.15.8:0/1599638715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda9c106940 msgr2=0x7fda9c0736e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:03.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.016+0000 7fdaa13bd700 1 --2- 172.21.15.8:0/1599638715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda9c106940 0x7fda9c0736e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fda94009fd0 tx=0x7fda94007930 comp rx=0 tx=0).stop 2023-08-11T12:23:03.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.016+0000 7fda9b7fe700 1 -- 172.21.15.8:0/1599638715 reap_dead start 2023-08-11T12:23:03.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.016+0000 7fdaa13bd700 1 -- 172.21.15.8:0/1599638715 shutdown_connections 2023-08-11T12:23:03.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.016+0000 7fdaa13bd700 1 -- 172.21.15.8:0/1599638715 >> 172.21.15.8:0/1599638715 conn(0x7fda9c0fc410 msgr2=0x7fda9c104450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:03.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.016+0000 7fdaa13bd700 1 -- 172.21.15.8:0/1599638715 shutdown_connections 2023-08-11T12:23:03.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.016+0000 7fdaa13bd700 1 -- 172.21.15.8:0/1599638715 wait complete. 2023-08-11T12:23:03.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.956+0000 7fbe9dbdc700 1 -- 172.21.15.8:0/1313152151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe98111950 msgr2=0x7fbe98113d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:03.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.956+0000 7fbe9dbdc700 1 --2- 172.21.15.8:0/1313152151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe98111950 0x7fbe98113d40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000b0a0 tx=0x7fbe9000b3b0 comp rx=0 tx=0).stop 2023-08-11T12:23:03.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.956+0000 7fbe9dbdc700 1 -- 172.21.15.8:0/1313152151 shutdown_connections 2023-08-11T12:23:03.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.956+0000 7fbe9dbdc700 1 --2- 172.21.15.8:0/1313152151 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe98072cc0 0x7fbe980730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:03.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.956+0000 7fbe9dbdc700 1 --2- 172.21.15.8:0/1313152151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe98111950 0x7fbe98113d40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:03.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.956+0000 7fbe9dbdc700 1 --2- 172.21.15.8:0/1313152151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe980735e0 0x7fbe98111410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:03.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.956+0000 7fbe9dbdc700 1 -- 172.21.15.8:0/1313152151 >> 172.21.15.8:0/1313152151 conn(0x7fbe980fc410 msgr2=0x7fbe980fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:03.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.956+0000 7fbe9dbdc700 1 -- 172.21.15.8:0/1313152151 shutdown_connections 2023-08-11T12:23:03.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.956+0000 7fbe9dbdc700 1 -- 172.21.15.8:0/1313152151 wait complete. 2023-08-11T12:23:03.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.957+0000 7fbe9dbdc700 1 Processor -- start 2023-08-11T12:23:03.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.957+0000 7fbe9dbdc700 1 -- start start 2023-08-11T12:23:03.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.958+0000 7fbe9dbdc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe98072cc0 0x7fbe9819d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:03.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.958+0000 7fbe9dbdc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe980735e0 0x7fbe9819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:03.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.958+0000 7fbe9dbdc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe98111950 0x7fbe981a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:03.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.958+0000 7fbe9dbdc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe981a20f0 con 0x7fbe98072cc0 2023-08-11T12:23:03.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.958+0000 7fbe9dbdc700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe981a2260 con 0x7fbe98111950 2023-08-11T12:23:03.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.958+0000 7fbe9dbdc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe981a2420 con 0x7fbe980735e0 2023-08-11T12:23:03.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.958+0000 7fbe8f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe98072cc0 0x7fbe9819d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:03.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.958+0000 7fbe977fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe980735e0 0x7fbe9819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:03.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.958+0000 7fbe977fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe980735e0 0x7fbe9819d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:37798/0 (socket says 172.21.15.8:37798) 2023-08-11T12:23:03.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.958+0000 7fbe977fe700 1 -- 172.21.15.8:0/3513809995 learned_addr learned my addr 172.21.15.8:0/3513809995 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:03.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.958+0000 7fbe8f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe98072cc0 0x7fbe9819d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58794/0 (socket says 172.21.15.8:58794) 2023-08-11T12:23:03.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.958+0000 7fbe97fff700 1 --2- 172.21.15.8:0/3513809995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe98111950 0x7fbe981a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:03.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.958+0000 7fbe977fe700 1 -- 172.21.15.8:0/3513809995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe98111950 msgr2=0x7fbe981a1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:03.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.958+0000 7fbe977fe700 1 --2- 172.21.15.8:0/3513809995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe98111950 0x7fbe981a1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:03.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.958+0000 7fbe977fe700 1 -- 172.21.15.8:0/3513809995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe98072cc0 msgr2=0x7fbe9819d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:03.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.958+0000 7fbe977fe700 1 --2- 172.21.15.8:0/3513809995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe98072cc0 0x7fbe9819d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:03.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.958+0000 7fbe977fe700 1 -- 172.21.15.8:0/3513809995 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe90009d00 con 0x7fbe980735e0 2023-08-11T12:23:03.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.959+0000 7fbe8f7fe700 1 --2- 172.21.15.8:0/3513809995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe98072cc0 0x7fbe9819d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:03.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.959+0000 7fbe977fe700 1 --2- 172.21.15.8:0/3513809995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe980735e0 0x7fbe9819d670 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000e9a0 tx=0x7fbe8000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:03.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.959+0000 7fbe957fa700 1 -- 172.21.15.8:0/3513809995 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe80009790 con 0x7fbe980735e0 2023-08-11T12:23:03.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.959+0000 7fbe9dbdc700 1 -- 172.21.15.8:0/3513809995 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe981a2700 con 0x7fbe980735e0 2023-08-11T12:23:03.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.959+0000 7fbe957fa700 1 -- 172.21.15.8:0/3513809995 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe80010430 con 0x7fbe980735e0 2023-08-11T12:23:03.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.959+0000 7fbe957fa700 1 -- 172.21.15.8:0/3513809995 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe80018680 con 0x7fbe980735e0 2023-08-11T12:23:03.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.959+0000 7fbe9dbdc700 1 -- 172.21.15.8:0/3513809995 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe981a9f60 con 0x7fbe980735e0 2023-08-11T12:23:03.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.960+0000 7fbe9dbdc700 1 -- 172.21.15.8:0/3513809995 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbe98117180 con 0x7fbe980735e0 2023-08-11T12:23:03.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.962+0000 7fbe957fa700 1 -- 172.21.15.8:0/3513809995 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fbe800105a0 con 0x7fbe980735e0 2023-08-11T12:23:03.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.964+0000 7fbe957fa700 1 --2- 172.21.15.8:0/3513809995 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fbe8409ff50 0x7fbe840a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:03.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.964+0000 7fbe957fa700 1 -- 172.21.15.8:0/3513809995 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fbe80014070 con 0x7fbe980735e0 2023-08-11T12:23:03.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.964+0000 7fbe8f7fe700 1 --2- 172.21.15.8:0/3513809995 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fbe8409ff50 0x7fbe840a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:03.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.964+0000 7fbe957fa700 1 --2- 172.21.15.8:0/3513809995 >> [v2:172.21.15.8:6810/187418883,v1:172.21.15.8:6811/187418883] conn(0x7fbe840aaf70 0x7fbe840ad410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:03.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.964+0000 7fbe957fa700 1 -- 172.21.15.8:0/3513809995 --> [v2:172.21.15.8:6810/187418883,v1:172.21.15.8:6811/187418883] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe840adae0 con 0x7fbe840aaf70 2023-08-11T12:23:03.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.964+0000 7fbe957fa700 1 -- 172.21.15.8:0/3513809995 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe800cbd30 con 0x7fbe980735e0 2023-08-11T12:23:03.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.964+0000 7fbe97fff700 1 --2- 172.21.15.8:0/3513809995 >> [v2:172.21.15.8:6810/187418883,v1:172.21.15.8:6811/187418883] conn(0x7fbe840aaf70 0x7fbe840ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:03.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.965+0000 7fbe8f7fe700 1 --2- 172.21.15.8:0/3513809995 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fbe8409ff50 0x7fbe840a2410 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbe88011490 tx=0x7fbe88009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:03.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.965+0000 7fbe97fff700 1 --2- 172.21.15.8:0/3513809995 >> [v2:172.21.15.8:6810/187418883,v1:172.21.15.8:6811/187418883] conn(0x7fbe840aaf70 0x7fbe840ad410 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:03.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.966+0000 7fbe957fa700 1 -- 172.21.15.8:0/3513809995 <== osd.3 v2:172.21.15.8:6810/187418883 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fbe840adae0 con 0x7fbe840aaf70 2023-08-11T12:23:03.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.983+0000 7fbe9dbdc700 1 -- 172.21.15.8:0/3513809995 --> [v2:172.21.15.8:6810/187418883,v1:172.21.15.8:6811/187418883] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbe9804e620 con 0x7fbe840aaf70 2023-08-11T12:23:03.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.983+0000 7fbe957fa700 1 -- 172.21.15.8:0/3513809995 <== osd.3 v2:172.21.15.8:6810/187418883 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fbe9804e620 con 0x7fbe840aaf70 2023-08-11T12:23:03.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.984+0000 7fbe9dbdc700 1 -- 172.21.15.8:0/3513809995 >> [v2:172.21.15.8:6810/187418883,v1:172.21.15.8:6811/187418883] conn(0x7fbe840aaf70 msgr2=0x7fbe840ad410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:03.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.984+0000 7fbe9dbdc700 1 --2- 172.21.15.8:0/3513809995 >> [v2:172.21.15.8:6810/187418883,v1:172.21.15.8:6811/187418883] conn(0x7fbe840aaf70 0x7fbe840ad410 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:03.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.984+0000 7fbe9dbdc700 1 -- 172.21.15.8:0/3513809995 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fbe8409ff50 msgr2=0x7fbe840a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:03.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.984+0000 7fbe9dbdc700 1 --2- 172.21.15.8:0/3513809995 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fbe8409ff50 0x7fbe840a2410 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbe88011490 tx=0x7fbe88009260 comp rx=0 tx=0).stop 2023-08-11T12:23:03.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.984+0000 7fbe9dbdc700 1 -- 172.21.15.8:0/3513809995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe980735e0 msgr2=0x7fbe9819d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:03.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.984+0000 7fbe9dbdc700 1 --2- 172.21.15.8:0/3513809995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe980735e0 0x7fbe9819d670 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000e9a0 tx=0x7fbe8000ecb0 comp rx=0 tx=0).stop 2023-08-11T12:23:03.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.984+0000 7fbe97fff700 1 -- 172.21.15.8:0/3513809995 reap_dead start 2023-08-11T12:23:03.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.984+0000 7fbe9dbdc700 1 -- 172.21.15.8:0/3513809995 shutdown_connections 2023-08-11T12:23:03.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.984+0000 7fbe9dbdc700 1 -- 172.21.15.8:0/3513809995 >> 172.21.15.8:0/3513809995 conn(0x7fbe980fc410 msgr2=0x7fbe980fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:03.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.984+0000 7fbe9dbdc700 1 -- 172.21.15.8:0/3513809995 shutdown_connections 2023-08-11T12:23:03.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:02.985+0000 7fbe9dbdc700 1 -- 172.21.15.8:0/3513809995 wait complete. 2023-08-11T12:23:03.609 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:03 smithi008 ceph-mon[97158]: pgmap v305: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2023-08-11T12:23:03.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.396+0000 7f257c3fb700 1 -- 172.21.15.8:0/2915856046 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2574100940 msgr2=0x7f2574100dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:03.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.396+0000 7f257c3fb700 1 --2- 172.21.15.8:0/2915856046 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2574100940 0x7f2574100dc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2564009990 tx=0x7f2564009ca0 comp rx=0 tx=0).stop 2023-08-11T12:23:03.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.397+0000 7f257c3fb700 1 -- 172.21.15.8:0/2915856046 shutdown_connections 2023-08-11T12:23:03.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.397+0000 7f257c3fb700 1 --2- 172.21.15.8:0/2915856046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2574101300 0x7f257410d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:03.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.397+0000 7f257c3fb700 1 --2- 172.21.15.8:0/2915856046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2574106940 0x7f2574106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:03.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.397+0000 7f257c3fb700 1 --2- 172.21.15.8:0/2915856046 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2574100940 0x7f2574100dc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:03.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.397+0000 7f257c3fb700 1 -- 172.21.15.8:0/2915856046 >> 172.21.15.8:0/2915856046 conn(0x7f25740fc410 msgr2=0x7f25740fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:03.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.397+0000 7f257c3fb700 1 -- 172.21.15.8:0/2915856046 shutdown_connections 2023-08-11T12:23:03.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.397+0000 7f257c3fb700 1 -- 172.21.15.8:0/2915856046 wait complete. 2023-08-11T12:23:03.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.398+0000 7f257c3fb700 1 Processor -- start 2023-08-11T12:23:03.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.398+0000 7f257c3fb700 1 -- start start 2023-08-11T12:23:03.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.398+0000 7f257c3fb700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2574100940 0x7f257419d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:03.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.398+0000 7f257c3fb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2574101300 0x7f257419d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:03.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.398+0000 7f257c3fb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2574106940 0x7f25741a1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:03.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.398+0000 7f257c3fb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25741a2040 con 0x7f2574101300 2023-08-11T12:23:03.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.398+0000 7f257c3fb700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25741a21b0 con 0x7f2574106940 2023-08-11T12:23:03.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.398+0000 7f257c3fb700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25741a2370 con 0x7f2574100940 2023-08-11T12:23:03.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.399+0000 7f257a197700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2574100940 0x7f257419d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:03.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.399+0000 7f257a197700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2574100940 0x7f257419d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:37822/0 (socket says 172.21.15.8:37822) 2023-08-11T12:23:03.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.399+0000 7f257a197700 1 -- 172.21.15.8:0/2410309005 learned_addr learned my addr 172.21.15.8:0/2410309005 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:03.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.399+0000 7f2579996700 1 --2- 172.21.15.8:0/2410309005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2574101300 0x7f257419d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:03.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.399+0000 7f257a998700 1 --2- 172.21.15.8:0/2410309005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2574106940 0x7f25741a1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:03.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.399+0000 7f257a998700 1 -- 172.21.15.8:0/2410309005 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2574100940 msgr2=0x7f257419d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:03.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.399+0000 7f257a998700 1 --2- 172.21.15.8:0/2410309005 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2574100940 0x7f257419d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:03.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.399+0000 7f257a998700 1 -- 172.21.15.8:0/2410309005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2574101300 msgr2=0x7f257419d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:03.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.399+0000 7f257a998700 1 --2- 172.21.15.8:0/2410309005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2574101300 0x7f257419d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:03.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.399+0000 7f257a998700 1 -- 172.21.15.8:0/2410309005 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25640095f0 con 0x7f2574106940 2023-08-11T12:23:03.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.400+0000 7f257a998700 1 --2- 172.21.15.8:0/2410309005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2574106940 0x7f25741a1a30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f256c00efc0 tx=0x7f256c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:03.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.400+0000 7f256b7fe700 1 -- 172.21.15.8:0/2410309005 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c018070 con 0x7f2574106940 2023-08-11T12:23:03.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.400+0000 7f256b7fe700 1 -- 172.21.15.8:0/2410309005 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f256c00f040 con 0x7f2574106940 2023-08-11T12:23:03.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.400+0000 7f256b7fe700 1 -- 172.21.15.8:0/2410309005 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c00cd40 con 0x7f2574106940 2023-08-11T12:23:03.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.400+0000 7f257c3fb700 1 -- 172.21.15.8:0/2410309005 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25741a25f0 con 0x7f2574106940 2023-08-11T12:23:03.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.400+0000 7f257c3fb700 1 -- 172.21.15.8:0/2410309005 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25741a9eb0 con 0x7f2574106940 2023-08-11T12:23:03.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.401+0000 7f257c3fb700 1 -- 172.21.15.8:0/2410309005 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f257410ea90 con 0x7f2574106940 2023-08-11T12:23:03.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.404+0000 7f256b7fe700 1 -- 172.21.15.8:0/2410309005 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f256c007500 con 0x7f2574106940 2023-08-11T12:23:03.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.405+0000 7f256b7fe700 1 --2- 172.21.15.8:0/2410309005 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f256009ff80 0x7f25600a2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:03.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.405+0000 7f256b7fe700 1 -- 172.21.15.8:0/2410309005 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f256c0cbb00 con 0x7f2574106940 2023-08-11T12:23:03.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.406+0000 7f256b7fe700 1 --2- 172.21.15.8:0/2410309005 >> [v2:172.21.15.8:6826/434661930,v1:172.21.15.8:6827/434661930] conn(0x7f25600aafa0 0x7f25600ad440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:03.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.406+0000 7f256b7fe700 1 -- 172.21.15.8:0/2410309005 --> [v2:172.21.15.8:6826/434661930,v1:172.21.15.8:6827/434661930] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f25600adb10 con 0x7f25600aafa0 2023-08-11T12:23:03.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.406+0000 7f256b7fe700 1 -- 172.21.15.8:0/2410309005 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f256c0cbe70 con 0x7f2574106940 2023-08-11T12:23:03.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.406+0000 7f257a197700 1 --2- 172.21.15.8:0/2410309005 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f256009ff80 0x7f25600a2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:03.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.406+0000 7f2579996700 1 --2- 172.21.15.8:0/2410309005 >> [v2:172.21.15.8:6826/434661930,v1:172.21.15.8:6827/434661930] conn(0x7f25600aafa0 0x7f25600ad440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:03.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.407+0000 7f257a197700 1 --2- 172.21.15.8:0/2410309005 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f256009ff80 0x7f25600a2440 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2570005950 tx=0x7f257000b500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:03.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.407+0000 7f2579996700 1 --2- 172.21.15.8:0/2410309005 >> [v2:172.21.15.8:6826/434661930,v1:172.21.15.8:6827/434661930] conn(0x7f25600aafa0 0x7f25600ad440 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:03.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.408+0000 7f256b7fe700 1 -- 172.21.15.8:0/2410309005 <== osd.9 v2:172.21.15.8:6826/434661930 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f25600adb10 con 0x7f25600aafa0 2023-08-11T12:23:03.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.426+0000 7f257c3fb700 1 -- 172.21.15.8:0/2410309005 --> [v2:172.21.15.8:6826/434661930,v1:172.21.15.8:6827/434661930] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f257404e620 con 0x7f25600aafa0 2023-08-11T12:23:03.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.426+0000 7f256b7fe700 1 -- 172.21.15.8:0/2410309005 <== osd.9 v2:172.21.15.8:6826/434661930 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f257404e620 con 0x7f25600aafa0 2023-08-11T12:23:03.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.427+0000 7f257c3fb700 1 -- 172.21.15.8:0/2410309005 >> [v2:172.21.15.8:6826/434661930,v1:172.21.15.8:6827/434661930] conn(0x7f25600aafa0 msgr2=0x7f25600ad440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:03.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.427+0000 7f257c3fb700 1 --2- 172.21.15.8:0/2410309005 >> [v2:172.21.15.8:6826/434661930,v1:172.21.15.8:6827/434661930] conn(0x7f25600aafa0 0x7f25600ad440 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:03.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.427+0000 7f257c3fb700 1 -- 172.21.15.8:0/2410309005 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f256009ff80 msgr2=0x7f25600a2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:03.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.427+0000 7f257c3fb700 1 --2- 172.21.15.8:0/2410309005 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f256009ff80 0x7f25600a2440 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2570005950 tx=0x7f257000b500 comp rx=0 tx=0).stop 2023-08-11T12:23:03.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.427+0000 7f257c3fb700 1 -- 172.21.15.8:0/2410309005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2574106940 msgr2=0x7f25741a1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:03.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.427+0000 7f257c3fb700 1 --2- 172.21.15.8:0/2410309005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2574106940 0x7f25741a1a30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f256c00efc0 tx=0x7f256c00c3a0 comp rx=0 tx=0).stop 2023-08-11T12:23:03.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.427+0000 7f257a998700 1 -- 172.21.15.8:0/2410309005 reap_dead start 2023-08-11T12:23:03.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.427+0000 7f257c3fb700 1 -- 172.21.15.8:0/2410309005 shutdown_connections 2023-08-11T12:23:03.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.427+0000 7f257c3fb700 1 -- 172.21.15.8:0/2410309005 >> 172.21.15.8:0/2410309005 conn(0x7f25740fc410 msgr2=0x7f25740fc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:03.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.427+0000 7f257c3fb700 1 -- 172.21.15.8:0/2410309005 shutdown_connections 2023-08-11T12:23:03.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.427+0000 7f257c3fb700 1 -- 172.21.15.8:0/2410309005 wait complete. 2023-08-11T12:23:03.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:03 smithi194 ceph-mon[130905]: pgmap v305: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2023-08-11T12:23:03.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:03 smithi045 ceph-mon[130284]: pgmap v305: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2023-08-11T12:23:03.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.707+0000 7f626f06d700 1 -- 172.21.15.8:0/345453577 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6268106940 msgr2=0x7f6268106d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:03.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.707+0000 7f626f06d700 1 --2- 172.21.15.8:0/345453577 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6268106940 0x7f6268106d20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f625c009990 tx=0x7f625c009ca0 comp rx=0 tx=0).stop 2023-08-11T12:23:03.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.707+0000 7f626f06d700 1 -- 172.21.15.8:0/345453577 shutdown_connections 2023-08-11T12:23:03.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.707+0000 7f626f06d700 1 --2- 172.21.15.8:0/345453577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6268101300 0x7f626810d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:03.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.707+0000 7f626f06d700 1 --2- 172.21.15.8:0/345453577 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6268106940 0x7f6268106d20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:03.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.707+0000 7f626f06d700 1 --2- 172.21.15.8:0/345453577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6268100940 0x7f6268100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:03.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.707+0000 7f626f06d700 1 -- 172.21.15.8:0/345453577 >> 172.21.15.8:0/345453577 conn(0x7f62680fc410 msgr2=0x7f62680fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:03.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.707+0000 7f626f06d700 1 -- 172.21.15.8:0/345453577 shutdown_connections 2023-08-11T12:23:03.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.707+0000 7f626f06d700 1 -- 172.21.15.8:0/345453577 wait complete. 2023-08-11T12:23:03.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.708+0000 7f626f06d700 1 Processor -- start 2023-08-11T12:23:03.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.708+0000 7f626f06d700 1 -- start start 2023-08-11T12:23:03.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.708+0000 7f626f06d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6268100940 0x7f6268072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:03.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.708+0000 7f626f06d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6268101300 0x7f6268073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:03.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.708+0000 7f626f06d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6268106940 0x7f62680736e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:03.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.708+0000 7f626f06d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62681a4ee0 con 0x7f6268100940 2023-08-11T12:23:03.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.708+0000 7f626f06d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62681a5050 con 0x7f6268106940 2023-08-11T12:23:03.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.708+0000 7f626f06d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62681a5210 con 0x7f6268101300 2023-08-11T12:23:03.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.709+0000 7f626ce09700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6268100940 0x7f6268072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:03.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.709+0000 7f626ce09700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6268100940 0x7f6268072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58850/0 (socket says 172.21.15.8:58850) 2023-08-11T12:23:03.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.709+0000 7f626ce09700 1 -- 172.21.15.8:0/1758530957 learned_addr learned my addr 172.21.15.8:0/1758530957 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:03.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.709+0000 7f6267fff700 1 --2- 172.21.15.8:0/1758530957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6268101300 0x7f6268073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:03.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.709+0000 7f626d60a700 1 --2- 172.21.15.8:0/1758530957 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6268106940 0x7f62680736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:03.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.709+0000 7f626ce09700 1 -- 172.21.15.8:0/1758530957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6268101300 msgr2=0x7f6268073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:03.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.709+0000 7f626ce09700 1 --2- 172.21.15.8:0/1758530957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6268101300 0x7f6268073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:03.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.709+0000 7f626ce09700 1 -- 172.21.15.8:0/1758530957 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6268106940 msgr2=0x7f62680736e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:03.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.709+0000 7f626ce09700 1 --2- 172.21.15.8:0/1758530957 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6268106940 0x7f62680736e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:03.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.709+0000 7f626ce09700 1 -- 172.21.15.8:0/1758530957 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c0095f0 con 0x7f6268100940 2023-08-11T12:23:03.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.709+0000 7f626d60a700 1 --2- 172.21.15.8:0/1758530957 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6268106940 0x7f62680736e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:23:03.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.709+0000 7f626ce09700 1 --2- 172.21.15.8:0/1758530957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6268100940 0x7f6268072c20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f625c005910 tx=0x7f625c004710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:03.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.710+0000 7f6265ffb700 1 -- 172.21.15.8:0/1758530957 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c01d070 con 0x7f6268100940 2023-08-11T12:23:03.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.710+0000 7f626f06d700 1 -- 172.21.15.8:0/1758530957 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62681a5490 con 0x7f6268100940 2023-08-11T12:23:03.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.710+0000 7f6265ffb700 1 -- 172.21.15.8:0/1758530957 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f625c022470 con 0x7f6268100940 2023-08-11T12:23:03.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.710+0000 7f6265ffb700 1 -- 172.21.15.8:0/1758530957 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c017650 con 0x7f6268100940 2023-08-11T12:23:03.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.710+0000 7f626f06d700 1 -- 172.21.15.8:0/1758530957 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62681a58a0 con 0x7f6268100940 2023-08-11T12:23:03.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.711+0000 7f626f06d700 1 -- 172.21.15.8:0/1758530957 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f626804e620 con 0x7f6268100940 2023-08-11T12:23:03.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.713+0000 7f6265ffb700 1 -- 172.21.15.8:0/1758530957 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f625c0225e0 con 0x7f6268100940 2023-08-11T12:23:03.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.714+0000 7f6265ffb700 1 --2- 172.21.15.8:0/1758530957 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f625809ff50 0x7f62580a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:03.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.714+0000 7f6265ffb700 1 -- 172.21.15.8:0/1758530957 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f625c0cd0b0 con 0x7f6268100940 2023-08-11T12:23:03.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.715+0000 7f6267fff700 1 --2- 172.21.15.8:0/1758530957 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f625809ff50 0x7f62580a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:03.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.715+0000 7f6265ffb700 1 --2- 172.21.15.8:0/1758530957 >> [v2:172.21.15.194:6816/57497127,v1:172.21.15.194:6817/57497127] conn(0x7f62580aaf70 0x7f62580ad410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:03.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.715+0000 7f6265ffb700 1 -- 172.21.15.8:0/1758530957 --> [v2:172.21.15.194:6816/57497127,v1:172.21.15.194:6817/57497127] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f62580adae0 con 0x7f62580aaf70 2023-08-11T12:23:03.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.715+0000 7f6265ffb700 1 -- 172.21.15.8:0/1758530957 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f625c0cd420 con 0x7f6268100940 2023-08-11T12:23:03.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.715+0000 7f626d60a700 1 --2- 172.21.15.8:0/1758530957 >> [v2:172.21.15.194:6816/57497127,v1:172.21.15.194:6817/57497127] conn(0x7f62580aaf70 0x7f62580ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:03.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.715+0000 7f6267fff700 1 --2- 172.21.15.8:0/1758530957 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f625809ff50 0x7f62580a2410 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6268074410 tx=0x7f6254009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:03.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.716+0000 7f626d60a700 1 --2- 172.21.15.8:0/1758530957 >> [v2:172.21.15.194:6816/57497127,v1:172.21.15.194:6817/57497127] conn(0x7f62580aaf70 0x7f62580ad410 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:03.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.717+0000 7f6265ffb700 1 -- 172.21.15.8:0/1758530957 <== osd.8 v2:172.21.15.194:6816/57497127 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f62580adae0 con 0x7f62580aaf70 2023-08-11T12:23:03.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.735+0000 7f626f06d700 1 -- 172.21.15.8:0/1758530957 --> [v2:172.21.15.194:6816/57497127,v1:172.21.15.194:6817/57497127] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6268110c20 con 0x7f62580aaf70 2023-08-11T12:23:03.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.736+0000 7f6265ffb700 1 -- 172.21.15.8:0/1758530957 <== osd.8 v2:172.21.15.194:6816/57497127 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f626000f040 con 0x7f62580aaf70 2023-08-11T12:23:03.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.736+0000 7f626f06d700 1 -- 172.21.15.8:0/1758530957 >> [v2:172.21.15.194:6816/57497127,v1:172.21.15.194:6817/57497127] conn(0x7f62580aaf70 msgr2=0x7f62580ad410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:03.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.736+0000 7f626f06d700 1 --2- 172.21.15.8:0/1758530957 >> [v2:172.21.15.194:6816/57497127,v1:172.21.15.194:6817/57497127] conn(0x7f62580aaf70 0x7f62580ad410 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:03.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.736+0000 7f626f06d700 1 -- 172.21.15.8:0/1758530957 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f625809ff50 msgr2=0x7f62580a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:03.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.736+0000 7f626f06d700 1 --2- 172.21.15.8:0/1758530957 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f625809ff50 0x7f62580a2410 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6268074410 tx=0x7f6254009260 comp rx=0 tx=0).stop 2023-08-11T12:23:03.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.736+0000 7f626f06d700 1 -- 172.21.15.8:0/1758530957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6268100940 msgr2=0x7f6268072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:03.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.736+0000 7f626f06d700 1 --2- 172.21.15.8:0/1758530957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6268100940 0x7f6268072c20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f625c005910 tx=0x7f625c004710 comp rx=0 tx=0).stop 2023-08-11T12:23:03.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.736+0000 7f626d60a700 1 -- 172.21.15.8:0/1758530957 reap_dead start 2023-08-11T12:23:03.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.736+0000 7f626f06d700 1 -- 172.21.15.8:0/1758530957 shutdown_connections 2023-08-11T12:23:03.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.736+0000 7f626f06d700 1 -- 172.21.15.8:0/1758530957 >> 172.21.15.8:0/1758530957 conn(0x7f62680fc410 msgr2=0x7f62680fcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:03.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.736+0000 7f626f06d700 1 -- 172.21.15.8:0/1758530957 shutdown_connections 2023-08-11T12:23:03.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:03.737+0000 7f626f06d700 1 -- 172.21.15.8:0/1758530957 wait complete. 2023-08-11T12:23:03.916 INFO:teuthology.orchestra.run.smithi008.stdout:163208757299 2023-08-11T12:23:03.916 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.5 2023-08-11T12:23:04.743 INFO:teuthology.orchestra.run.smithi008.stdout:107374182460 2023-08-11T12:23:04.743 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.3 2023-08-11T12:23:04.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.539+0000 7eff975f3700 1 -- 172.21.15.8:0/3518964225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff900688e0 msgr2=0x7eff90068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:04.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.539+0000 7eff975f3700 1 --2- 172.21.15.8:0/3518964225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff900688e0 0x7eff90068cc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0099f0 tx=0x7eff8c009d00 comp rx=0 tx=0).stop 2023-08-11T12:23:04.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.540+0000 7eff975f3700 1 -- 172.21.15.8:0/3518964225 shutdown_connections 2023-08-11T12:23:04.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.540+0000 7eff975f3700 1 --2- 172.21.15.8:0/3518964225 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff90105d50 0x7eff9010d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:04.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.540+0000 7eff975f3700 1 --2- 172.21.15.8:0/3518964225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff900688e0 0x7eff90068cc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:04.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.540+0000 7eff975f3700 1 --2- 172.21.15.8:0/3518964225 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff90105390 0x7eff90105810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:04.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.540+0000 7eff975f3700 1 -- 172.21.15.8:0/3518964225 >> 172.21.15.8:0/3518964225 conn(0x7eff90076920 msgr2=0x7eff90076d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:04.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.540+0000 7eff975f3700 1 -- 172.21.15.8:0/3518964225 shutdown_connections 2023-08-11T12:23:04.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.540+0000 7eff975f3700 1 -- 172.21.15.8:0/3518964225 wait complete. 2023-08-11T12:23:04.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.541+0000 7eff975f3700 1 Processor -- start 2023-08-11T12:23:04.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.541+0000 7eff975f3700 1 -- start start 2023-08-11T12:23:04.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.541+0000 7eff975f3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff900688e0 0x7eff9019ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:04.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.541+0000 7eff975f3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff90105390 0x7eff9019efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:04.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.541+0000 7eff975f3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff90105d50 0x7eff90198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:04.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.541+0000 7eff975f3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff90199220 con 0x7eff90105390 2023-08-11T12:23:04.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.541+0000 7eff975f3700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff90199390 con 0x7eff90105d50 2023-08-11T12:23:04.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.541+0000 7eff975f3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff90199550 con 0x7eff900688e0 2023-08-11T12:23:04.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.542+0000 7eff94b8e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff90105390 0x7eff9019efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:04.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.542+0000 7eff9538f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff900688e0 0x7eff9019ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:04.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.542+0000 7eff9538f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff900688e0 0x7eff9019ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:37874/0 (socket says 172.21.15.8:37874) 2023-08-11T12:23:04.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.542+0000 7eff9538f700 1 -- 172.21.15.8:0/3725203696 learned_addr learned my addr 172.21.15.8:0/3725203696 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:04.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.542+0000 7eff95b90700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff90105d50 0x7eff90198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:04.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.542+0000 7eff9538f700 1 -- 172.21.15.8:0/3725203696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff90105d50 msgr2=0x7eff90198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:04.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.542+0000 7eff9538f700 1 --2- 172.21.15.8:0/3725203696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff90105d50 0x7eff90198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:04.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.542+0000 7eff9538f700 1 -- 172.21.15.8:0/3725203696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff90105390 msgr2=0x7eff9019efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:04.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.542+0000 7eff9538f700 1 --2- 172.21.15.8:0/3725203696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff90105390 0x7eff9019efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:04.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.542+0000 7eff9538f700 1 -- 172.21.15.8:0/3725203696 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff80009520 con 0x7eff900688e0 2023-08-11T12:23:04.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.543+0000 7eff9538f700 1 --2- 172.21.15.8:0/3725203696 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff900688e0 0x7eff9019ea80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7eff8c005910 tx=0x7eff8c00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:04.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.543+0000 7eff867fc700 1 -- 172.21.15.8:0/3725203696 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c01d070 con 0x7eff900688e0 2023-08-11T12:23:04.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.543+0000 7eff975f3700 1 -- 172.21.15.8:0/3725203696 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff8c0095f0 con 0x7eff900688e0 2023-08-11T12:23:04.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.543+0000 7eff867fc700 1 -- 172.21.15.8:0/3725203696 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff8c022470 con 0x7eff900688e0 2023-08-11T12:23:04.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.543+0000 7eff867fc700 1 -- 172.21.15.8:0/3725203696 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c017650 con 0x7eff900688e0 2023-08-11T12:23:04.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.543+0000 7eff975f3700 1 -- 172.21.15.8:0/3725203696 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff901a5830 con 0x7eff900688e0 2023-08-11T12:23:04.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.544+0000 7eff975f3700 1 -- 172.21.15.8:0/3725203696 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7eff90110af0 con 0x7eff900688e0 2023-08-11T12:23:04.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.546+0000 7eff867fc700 1 -- 172.21.15.8:0/3725203696 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7eff8c0225e0 con 0x7eff900688e0 2023-08-11T12:23:04.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.548+0000 7eff867fc700 1 --2- 172.21.15.8:0/3725203696 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7eff7c09ff50 0x7eff7c0a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:04.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.548+0000 7eff867fc700 1 -- 172.21.15.8:0/3725203696 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7eff8c0ccf90 con 0x7eff900688e0 2023-08-11T12:23:04.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.548+0000 7eff94b8e700 1 --2- 172.21.15.8:0/3725203696 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7eff7c09ff50 0x7eff7c0a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:04.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.548+0000 7eff867fc700 1 --2- 172.21.15.8:0/3725203696 >> [v2:172.21.15.45:6824/3281212184,v1:172.21.15.45:6825/3281212184] conn(0x7eff7c0aaf70 0x7eff7c0ad410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:04.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.548+0000 7eff867fc700 1 -- 172.21.15.8:0/3725203696 --> [v2:172.21.15.45:6824/3281212184,v1:172.21.15.45:6825/3281212184] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7eff7c0adae0 con 0x7eff7c0aaf70 2023-08-11T12:23:04.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.548+0000 7eff867fc700 1 -- 172.21.15.8:0/3725203696 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff8c0cd300 con 0x7eff900688e0 2023-08-11T12:23:04.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.548+0000 7eff95b90700 1 --2- 172.21.15.8:0/3725203696 >> [v2:172.21.15.45:6824/3281212184,v1:172.21.15.45:6825/3281212184] conn(0x7eff7c0aaf70 0x7eff7c0ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:04.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.548+0000 7eff94b8e700 1 --2- 172.21.15.8:0/3725203696 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7eff7c09ff50 0x7eff7c0a2410 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7eff9019a2a0 tx=0x7eff80009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:04.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.549+0000 7eff95b90700 1 --2- 172.21.15.8:0/3725203696 >> [v2:172.21.15.45:6824/3281212184,v1:172.21.15.45:6825/3281212184] conn(0x7eff7c0aaf70 0x7eff7c0ad410 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:04.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.550+0000 7eff867fc700 1 -- 172.21.15.8:0/3725203696 <== osd.10 v2:172.21.15.45:6824/3281212184 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7eff7c0adae0 con 0x7eff7c0aaf70 2023-08-11T12:23:04.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.567+0000 7eff975f3700 1 -- 172.21.15.8:0/3725203696 --> [v2:172.21.15.45:6824/3281212184,v1:172.21.15.45:6825/3281212184] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7eff9004e620 con 0x7eff7c0aaf70 2023-08-11T12:23:04.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.568+0000 7eff867fc700 1 -- 172.21.15.8:0/3725203696 <== osd.10 v2:172.21.15.45:6824/3281212184 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7eff9004e620 con 0x7eff7c0aaf70 2023-08-11T12:23:04.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.568+0000 7eff975f3700 1 -- 172.21.15.8:0/3725203696 >> [v2:172.21.15.45:6824/3281212184,v1:172.21.15.45:6825/3281212184] conn(0x7eff7c0aaf70 msgr2=0x7eff7c0ad410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:04.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.568+0000 7eff975f3700 1 --2- 172.21.15.8:0/3725203696 >> [v2:172.21.15.45:6824/3281212184,v1:172.21.15.45:6825/3281212184] conn(0x7eff7c0aaf70 0x7eff7c0ad410 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:04.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.568+0000 7eff975f3700 1 -- 172.21.15.8:0/3725203696 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7eff7c09ff50 msgr2=0x7eff7c0a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:04.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.568+0000 7eff975f3700 1 --2- 172.21.15.8:0/3725203696 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7eff7c09ff50 0x7eff7c0a2410 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7eff9019a2a0 tx=0x7eff80009260 comp rx=0 tx=0).stop 2023-08-11T12:23:04.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.568+0000 7eff975f3700 1 -- 172.21.15.8:0/3725203696 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff900688e0 msgr2=0x7eff9019ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:04.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.568+0000 7eff975f3700 1 --2- 172.21.15.8:0/3725203696 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff900688e0 0x7eff9019ea80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7eff8c005910 tx=0x7eff8c00f690 comp rx=0 tx=0).stop 2023-08-11T12:23:04.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.568+0000 7eff95b90700 1 -- 172.21.15.8:0/3725203696 reap_dead start 2023-08-11T12:23:04.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.568+0000 7eff975f3700 1 -- 172.21.15.8:0/3725203696 shutdown_connections 2023-08-11T12:23:04.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.568+0000 7eff975f3700 1 -- 172.21.15.8:0/3725203696 >> 172.21.15.8:0/3725203696 conn(0x7eff90076920 msgr2=0x7eff9010ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:04.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.569+0000 7eff975f3700 1 -- 172.21.15.8:0/3725203696 shutdown_connections 2023-08-11T12:23:04.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.569+0000 7eff975f3700 1 -- 172.21.15.8:0/3725203696 wait complete. 2023-08-11T12:23:04.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.877+0000 7f09d39d0700 1 -- 172.21.15.8:0/79543047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09cc073670 msgr2=0x7f09cc10cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:04.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.877+0000 7f09d39d0700 1 --2- 172.21.15.8:0/79543047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09cc073670 0x7f09cc10cc40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f09bc009990 tx=0x7f09bc009ca0 comp rx=0 tx=0).stop 2023-08-11T12:23:04.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.878+0000 7f09d39d0700 1 -- 172.21.15.8:0/79543047 shutdown_connections 2023-08-11T12:23:04.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.878+0000 7f09d39d0700 1 --2- 172.21.15.8:0/79543047 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09cc10d180 0x7f09cc10f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:04.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.878+0000 7f09d39d0700 1 --2- 172.21.15.8:0/79543047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09cc072d50 0x7f09cc073130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:04.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.878+0000 7f09d39d0700 1 --2- 172.21.15.8:0/79543047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09cc073670 0x7f09cc10cc40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:04.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.878+0000 7f09d39d0700 1 -- 172.21.15.8:0/79543047 >> 172.21.15.8:0/79543047 conn(0x7f09cc0fc410 msgr2=0x7f09cc0fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:04.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.878+0000 7f09d39d0700 1 -- 172.21.15.8:0/79543047 shutdown_connections 2023-08-11T12:23:04.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.878+0000 7f09d39d0700 1 -- 172.21.15.8:0/79543047 wait complete. 2023-08-11T12:23:04.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.879+0000 7f09d39d0700 1 Processor -- start 2023-08-11T12:23:04.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.879+0000 7f09d39d0700 1 -- start start 2023-08-11T12:23:04.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.880+0000 7f09d39d0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09cc072d50 0x7f09cc198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:04.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.880+0000 7f09d39d0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09cc073670 0x7f09cc199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:04.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.880+0000 7f09d39d0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09cc10d180 0x7f09cc19c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:04.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.880+0000 7f09d39d0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc19cbc0 con 0x7f09cc073670 2023-08-11T12:23:04.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.880+0000 7f09d39d0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc19cd30 con 0x7f09cc072d50 2023-08-11T12:23:04.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.880+0000 7f09d39d0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc19cef0 con 0x7f09cc10d180 2023-08-11T12:23:04.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.880+0000 7f09d1f6d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09cc10d180 0x7f09cc19c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:04.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.880+0000 7f09d0f6b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09cc073670 0x7f09cc199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:04.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.880+0000 7f09d1f6d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09cc10d180 0x7f09cc19c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:37882/0 (socket says 172.21.15.8:37882) 2023-08-11T12:23:04.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.880+0000 7f09d1f6d700 1 -- 172.21.15.8:0/4082805257 learned_addr learned my addr 172.21.15.8:0/4082805257 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:04.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.881+0000 7f09d1f6d700 1 -- 172.21.15.8:0/4082805257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09cc072d50 msgr2=0x7f09cc198cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:04.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.881+0000 7f09d1f6d700 1 --2- 172.21.15.8:0/4082805257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09cc072d50 0x7f09cc198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:04.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.881+0000 7f09d1f6d700 1 -- 172.21.15.8:0/4082805257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09cc073670 msgr2=0x7f09cc199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:04.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.881+0000 7f09d1f6d700 1 --2- 172.21.15.8:0/4082805257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09cc073670 0x7f09cc199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:04.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.881+0000 7f09d1f6d700 1 -- 172.21.15.8:0/4082805257 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09bc0095f0 con 0x7f09cc10d180 2023-08-11T12:23:04.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.881+0000 7f09d1f6d700 1 --2- 172.21.15.8:0/4082805257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09cc10d180 0x7f09cc19c5c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f09c4007ee0 tx=0x7f09c400d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:04.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.882+0000 7f09c27fc700 1 -- 172.21.15.8:0/4082805257 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c400ddd0 con 0x7f09cc10d180 2023-08-11T12:23:04.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.882+0000 7f09c27fc700 1 -- 172.21.15.8:0/4082805257 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f09c400f040 con 0x7f09cc10d180 2023-08-11T12:23:04.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.882+0000 7f09c27fc700 1 -- 172.21.15.8:0/4082805257 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c40048e0 con 0x7f09cc10d180 2023-08-11T12:23:04.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.882+0000 7f09d39d0700 1 -- 172.21.15.8:0/4082805257 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09cc19d1d0 con 0x7f09cc10d180 2023-08-11T12:23:04.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.882+0000 7f09d39d0700 1 -- 172.21.15.8:0/4082805257 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09cc1a5b20 con 0x7f09cc10d180 2023-08-11T12:23:04.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.883+0000 7f09d39d0700 1 -- 172.21.15.8:0/4082805257 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f09cc112df0 con 0x7f09cc10d180 2023-08-11T12:23:04.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.885+0000 7f09c27fc700 1 -- 172.21.15.8:0/4082805257 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f09c4003a00 con 0x7f09cc10d180 2023-08-11T12:23:04.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.887+0000 7f09c27fc700 1 --2- 172.21.15.8:0/4082805257 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f09b809ffd0 0x7f09b80a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:04.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.887+0000 7f09c27fc700 1 -- 172.21.15.8:0/4082805257 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f09c40cb950 con 0x7f09cc10d180 2023-08-11T12:23:04.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.887+0000 7f09d176c700 1 --2- 172.21.15.8:0/4082805257 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f09b809ffd0 0x7f09b80a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:04.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.887+0000 7f09c27fc700 1 --2- 172.21.15.8:0/4082805257 >> [v2:172.21.15.45:6816/3715737148,v1:172.21.15.45:6817/3715737148] conn(0x7f09b80aae80 0x7f09b80ad320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:04.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.887+0000 7f09c27fc700 1 -- 172.21.15.8:0/4082805257 --> [v2:172.21.15.45:6816/3715737148,v1:172.21.15.45:6817/3715737148] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f09b80ad9f0 con 0x7f09b80aae80 2023-08-11T12:23:04.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.887+0000 7f09c27fc700 1 -- 172.21.15.8:0/4082805257 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09c40cbcc0 con 0x7f09cc10d180 2023-08-11T12:23:04.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.888+0000 7f09d176c700 1 --2- 172.21.15.8:0/4082805257 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f09b809ffd0 0x7f09b80a2490 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f09c8005950 tx=0x7f09c80058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:04.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.888+0000 7f09d0f6b700 1 --2- 172.21.15.8:0/4082805257 >> [v2:172.21.15.45:6816/3715737148,v1:172.21.15.45:6817/3715737148] conn(0x7f09b80aae80 0x7f09b80ad320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:04.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.889+0000 7f09d0f6b700 1 --2- 172.21.15.8:0/4082805257 >> [v2:172.21.15.45:6816/3715737148,v1:172.21.15.45:6817/3715737148] conn(0x7f09b80aae80 0x7f09b80ad320 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:04.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.889+0000 7f09c27fc700 1 -- 172.21.15.8:0/4082805257 <== osd.7 v2:172.21.15.45:6816/3715737148 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f09b80ad9f0 con 0x7f09b80aae80 2023-08-11T12:23:04.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.907+0000 7f09d39d0700 1 -- 172.21.15.8:0/4082805257 --> [v2:172.21.15.45:6816/3715737148,v1:172.21.15.45:6817/3715737148] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f09cc04e620 con 0x7f09b80aae80 2023-08-11T12:23:04.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.908+0000 7f09c27fc700 1 -- 172.21.15.8:0/4082805257 <== osd.7 v2:172.21.15.45:6816/3715737148 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f09cc04e620 con 0x7f09b80aae80 2023-08-11T12:23:04.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.908+0000 7f09d39d0700 1 -- 172.21.15.8:0/4082805257 >> [v2:172.21.15.45:6816/3715737148,v1:172.21.15.45:6817/3715737148] conn(0x7f09b80aae80 msgr2=0x7f09b80ad320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:04.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.908+0000 7f09d39d0700 1 --2- 172.21.15.8:0/4082805257 >> [v2:172.21.15.45:6816/3715737148,v1:172.21.15.45:6817/3715737148] conn(0x7f09b80aae80 0x7f09b80ad320 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:04.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.908+0000 7f09d39d0700 1 -- 172.21.15.8:0/4082805257 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f09b809ffd0 msgr2=0x7f09b80a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:04.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.908+0000 7f09d39d0700 1 --2- 172.21.15.8:0/4082805257 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f09b809ffd0 0x7f09b80a2490 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f09c8005950 tx=0x7f09c80058e0 comp rx=0 tx=0).stop 2023-08-11T12:23:04.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.908+0000 7f09d39d0700 1 -- 172.21.15.8:0/4082805257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09cc10d180 msgr2=0x7f09cc19c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:04.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.908+0000 7f09d39d0700 1 --2- 172.21.15.8:0/4082805257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09cc10d180 0x7f09cc19c5c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f09c4007ee0 tx=0x7f09c400d3b0 comp rx=0 tx=0).stop 2023-08-11T12:23:04.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.908+0000 7f09d1f6d700 1 -- 172.21.15.8:0/4082805257 reap_dead start 2023-08-11T12:23:04.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.908+0000 7f09d39d0700 1 -- 172.21.15.8:0/4082805257 shutdown_connections 2023-08-11T12:23:04.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.908+0000 7f09d39d0700 1 -- 172.21.15.8:0/4082805257 >> 172.21.15.8:0/4082805257 conn(0x7f09cc0fc410 msgr2=0x7f09cc10f330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:04.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.909+0000 7f09d39d0700 1 -- 172.21.15.8:0/4082805257 shutdown_connections 2023-08-11T12:23:04.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:04.909+0000 7f09d39d0700 1 -- 172.21.15.8:0/4082805257 wait complete. 2023-08-11T12:23:05.018 INFO:teuthology.orchestra.run.smithi008.stdout:249108103206 2023-08-11T12:23:05.018 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.8 2023-08-11T12:23:05.585 INFO:teuthology.orchestra.run.smithi008.stdout:197568495663 2023-08-11T12:23:05.585 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.6 2023-08-11T12:23:05.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:05 smithi194 ceph-mon[130905]: pgmap v306: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2023-08-11T12:23:05.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:05 smithi045 ceph-mon[130284]: pgmap v306: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2023-08-11T12:23:05.998 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:05 smithi008 ceph-mon[97158]: pgmap v306: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2023-08-11T12:23:06.000 INFO:teuthology.orchestra.run.smithi008.stdout:55834574916 2023-08-11T12:23:06.001 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.1 2023-08-11T12:23:06.210 INFO:teuthology.orchestra.run.smithi008.stdout:283467841568 2023-08-11T12:23:06.211 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.9 2023-08-11T12:23:06.310 INFO:teuthology.orchestra.run.smithi008.stdout:304942678043 2023-08-11T12:23:06.310 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.10 2023-08-11T12:23:06.358 INFO:teuthology.orchestra.run.smithi008.stdout:335007449113 2023-08-11T12:23:06.359 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.11 2023-08-11T12:23:06.500 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:23:07.058 INFO:teuthology.orchestra.run.smithi008.stdout:219043332137 2023-08-11T12:23:07.058 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.7 2023-08-11T12:23:07.778 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:23:07.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:07 smithi008 ceph-mon[97158]: pgmap v307: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-08-11T12:23:07.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:07 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:23:07.827 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:23:07.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:07 smithi194 ceph-mon[130905]: pgmap v307: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-08-11T12:23:07.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:07 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:23:07.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:07 smithi045 ceph-mon[130284]: pgmap v307: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-08-11T12:23:07.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:07 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:23:08.356 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:23:08.364 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:23:08.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.830+0000 7fe08b28e700 1 -- 172.21.15.8:0/2151461214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe084100940 msgr2=0x7fe084100dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:08.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.830+0000 7fe08b28e700 1 --2- 172.21.15.8:0/2151461214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe084100940 0x7fe084100dc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe074009990 tx=0x7fe074009ca0 comp rx=0 tx=0).stop 2023-08-11T12:23:08.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.830+0000 7fe08b28e700 1 -- 172.21.15.8:0/2151461214 shutdown_connections 2023-08-11T12:23:08.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.830+0000 7fe08b28e700 1 --2- 172.21.15.8:0/2151461214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe084101300 0x7fe08410d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:08.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.830+0000 7fe08b28e700 1 --2- 172.21.15.8:0/2151461214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe084106940 0x7fe084106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:08.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.830+0000 7fe08b28e700 1 --2- 172.21.15.8:0/2151461214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe084100940 0x7fe084100dc0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:08.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.830+0000 7fe08b28e700 1 -- 172.21.15.8:0/2151461214 >> 172.21.15.8:0/2151461214 conn(0x7fe0840fc410 msgr2=0x7fe0840fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:08.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.830+0000 7fe08b28e700 1 -- 172.21.15.8:0/2151461214 shutdown_connections 2023-08-11T12:23:08.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.830+0000 7fe08b28e700 1 -- 172.21.15.8:0/2151461214 wait complete. 2023-08-11T12:23:08.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.831+0000 7fe08b28e700 1 Processor -- start 2023-08-11T12:23:08.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.831+0000 7fe08b28e700 1 -- start start 2023-08-11T12:23:08.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.832+0000 7fe08b28e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe084100940 0x7fe084072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:08.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.832+0000 7fe08b28e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe084101300 0x7fe084073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:08.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.832+0000 7fe08b28e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe084106940 0x7fe0840736e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:08.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.832+0000 7fe08b28e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0841a4e80 con 0x7fe084101300 2023-08-11T12:23:08.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.832+0000 7fe08b28e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0841a4ff0 con 0x7fe084100940 2023-08-11T12:23:08.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.832+0000 7fe08b28e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0841a51b0 con 0x7fe084106940 2023-08-11T12:23:08.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.832+0000 7fe08902a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe084100940 0x7fe084072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:08.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.832+0000 7fe08902a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe084100940 0x7fe084072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:39626/0 (socket says 172.21.15.8:39626) 2023-08-11T12:23:08.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.832+0000 7fe08902a700 1 -- 172.21.15.8:0/512248106 learned_addr learned my addr 172.21.15.8:0/512248106 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:08.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.832+0000 7fe08982b700 1 --2- 172.21.15.8:0/512248106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe084106940 0x7fe0840736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:08.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.832+0000 7fe088829700 1 --2- 172.21.15.8:0/512248106 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe084101300 0x7fe084073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:08.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.832+0000 7fe08902a700 1 -- 172.21.15.8:0/512248106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe084106940 msgr2=0x7fe0840736e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:08.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.832+0000 7fe08902a700 1 --2- 172.21.15.8:0/512248106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe084106940 0x7fe0840736e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:08.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.832+0000 7fe08902a700 1 -- 172.21.15.8:0/512248106 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe084101300 msgr2=0x7fe084073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:08.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.833+0000 7fe08902a700 1 --2- 172.21.15.8:0/512248106 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe084101300 0x7fe084073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:08.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.833+0000 7fe08902a700 1 -- 172.21.15.8:0/512248106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0740095f0 con 0x7fe084100940 2023-08-11T12:23:08.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.833+0000 7fe08902a700 1 --2- 172.21.15.8:0/512248106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe084100940 0x7fe084072c20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe08000e9a0 tx=0x7fe08000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:08.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.833+0000 7fe07a7fc700 1 -- 172.21.15.8:0/512248106 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe080009790 con 0x7fe084100940 2023-08-11T12:23:08.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.833+0000 7fe07a7fc700 1 -- 172.21.15.8:0/512248106 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe08000cbd0 con 0x7fe084100940 2023-08-11T12:23:08.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.833+0000 7fe08b28e700 1 -- 172.21.15.8:0/512248106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0841a5490 con 0x7fe084100940 2023-08-11T12:23:08.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.833+0000 7fe08b28e700 1 -- 172.21.15.8:0/512248106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0841a59e0 con 0x7fe084100940 2023-08-11T12:23:08.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.833+0000 7fe07a7fc700 1 -- 172.21.15.8:0/512248106 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe080018680 con 0x7fe084100940 2023-08-11T12:23:08.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.835+0000 7fe08b28e700 1 -- 172.21.15.8:0/512248106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe068005320 con 0x7fe084100940 2023-08-11T12:23:08.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.837+0000 7fe07a7fc700 1 -- 172.21.15.8:0/512248106 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fe080010430 con 0x7fe084100940 2023-08-11T12:23:08.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.839+0000 7fe07a7fc700 1 --2- 172.21.15.8:0/512248106 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe07009ffd0 0x7fe0700a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:08.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.839+0000 7fe07a7fc700 1 -- 172.21.15.8:0/512248106 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fe080014070 con 0x7fe084100940 2023-08-11T12:23:08.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.839+0000 7fe088829700 1 --2- 172.21.15.8:0/512248106 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe07009ffd0 0x7fe0700a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:08.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.840+0000 7fe088829700 1 --2- 172.21.15.8:0/512248106 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe07009ffd0 0x7fe0700a2490 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe074006010 tx=0x7fe07400b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:08.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:08.843+0000 7fe07a7fc700 1 -- 172.21.15.8:0/512248106 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fe080051c30 con 0x7fe084100940 2023-08-11T12:23:08.941 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:23:08.994 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:23:09.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:09.102+0000 7fe08b28e700 1 -- 172.21.15.8:0/512248106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe068005190 con 0x7fe084100940 2023-08-11T12:23:09.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:09.102+0000 7fe07a7fc700 1 -- 172.21.15.8:0/512248106 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe080098b50 con 0x7fe084100940 2023-08-11T12:23:09.106 INFO:teuthology.orchestra.run.smithi008.stdout:77309411394 2023-08-11T12:23:09.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:09.105+0000 7fe08b28e700 1 -- 172.21.15.8:0/512248106 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe07009ffd0 msgr2=0x7fe0700a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:09.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:09.105+0000 7fe08b28e700 1 --2- 172.21.15.8:0/512248106 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe07009ffd0 0x7fe0700a2490 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe074006010 tx=0x7fe07400b260 comp rx=0 tx=0).stop 2023-08-11T12:23:09.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:09.105+0000 7fe08b28e700 1 -- 172.21.15.8:0/512248106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe084100940 msgr2=0x7fe084072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:09.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:09.105+0000 7fe08b28e700 1 --2- 172.21.15.8:0/512248106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe084100940 0x7fe084072c20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe08000e9a0 tx=0x7fe08000ecb0 comp rx=0 tx=0).stop 2023-08-11T12:23:09.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:09.105+0000 7fe08b28e700 1 -- 172.21.15.8:0/512248106 shutdown_connections 2023-08-11T12:23:09.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:09.105+0000 7fe08b28e700 1 --2- 172.21.15.8:0/512248106 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe07009ffd0 0x7fe0700a2490 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:09.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:09.105+0000 7fe08b28e700 1 --2- 172.21.15.8:0/512248106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe084106940 0x7fe0840736e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:09.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:09.105+0000 7fe08b28e700 1 --2- 172.21.15.8:0/512248106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe084100940 0x7fe084072c20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:09.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:09.105+0000 7fe08b28e700 1 --2- 172.21.15.8:0/512248106 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe084101300 0x7fe084073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:09.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:09.105+0000 7fe08b28e700 1 -- 172.21.15.8:0/512248106 >> 172.21.15.8:0/512248106 conn(0x7fe0840fc410 msgr2=0x7fe0840fca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:09.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:09.105+0000 7fe08b28e700 1 -- 172.21.15.8:0/512248106 shutdown_connections 2023-08-11T12:23:09.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:09.105+0000 7fe08b28e700 1 -- 172.21.15.8:0/512248106 wait complete. 2023-08-11T12:23:09.655 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:09 smithi008 ceph-mon[97158]: pgmap v308: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:09.656 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:09 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/512248106' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-08-11T12:23:09.656 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:09 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:23:09.656 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:09 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:23:09.656 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:09 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:23:09.656 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:09 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:23:09.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:09 smithi194 ceph-mon[130905]: pgmap v308: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:09.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:09 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/512248106' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-08-11T12:23:09.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:09 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:23:09.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:09 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:23:09.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:09 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:23:09.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:09 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:23:09.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:09 smithi045 ceph-mon[130284]: pgmap v308: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:09.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:09 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/512248106' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-08-11T12:23:09.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:09 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:23:09.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:09 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:23:09.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:09 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:23:09.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:09 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:23:10.240 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:23:10.270 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:23:10.398 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:23:10.910 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:10 smithi008 ceph-mon[97158]: pgmap v309: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-08-11T12:23:11.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:10 smithi194 ceph-mon[130905]: pgmap v309: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-08-11T12:23:11.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:10 smithi045 ceph-mon[130284]: pgmap v309: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-08-11T12:23:11.875 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411392 got 77309411394 for osd.2 2023-08-11T12:23:11.876 DEBUG:teuthology.parallel:result is None 2023-08-11T12:23:12.273 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:23:12.383 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:23:12.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.422+0000 7fa9a7a8f700 1 -- 172.21.15.8:0/743550733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9a0100940 msgr2=0x7fa9a0100dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:12.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.422+0000 7fa9a7a8f700 1 --2- 172.21.15.8:0/743550733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9a0100940 0x7fa9a0100dc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa990009990 tx=0x7fa990009ca0 comp rx=0 tx=0).stop 2023-08-11T12:23:12.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.422+0000 7fa9a7a8f700 1 -- 172.21.15.8:0/743550733 shutdown_connections 2023-08-11T12:23:12.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.422+0000 7fa9a7a8f700 1 --2- 172.21.15.8:0/743550733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9a0101300 0x7fa9a010d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:12.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.422+0000 7fa9a7a8f700 1 --2- 172.21.15.8:0/743550733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9a0106940 0x7fa9a0106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:12.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.422+0000 7fa9a7a8f700 1 --2- 172.21.15.8:0/743550733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9a0100940 0x7fa9a0100dc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:12.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.422+0000 7fa9a7a8f700 1 -- 172.21.15.8:0/743550733 >> 172.21.15.8:0/743550733 conn(0x7fa9a00fc410 msgr2=0x7fa9a00fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:12.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.422+0000 7fa9a7a8f700 1 -- 172.21.15.8:0/743550733 shutdown_connections 2023-08-11T12:23:12.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.422+0000 7fa9a7a8f700 1 -- 172.21.15.8:0/743550733 wait complete. 2023-08-11T12:23:12.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.424+0000 7fa9a7a8f700 1 Processor -- start 2023-08-11T12:23:12.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.424+0000 7fa9a7a8f700 1 -- start start 2023-08-11T12:23:12.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.425+0000 7fa9a7a8f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9a0100940 0x7fa9a0194870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:12.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.425+0000 7fa9a7a8f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9a0101300 0x7fa9a0194db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:12.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.425+0000 7fa9a7a8f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9a0106940 0x7fa9a01b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:12.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.425+0000 7fa9a7a8f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a01b1b70 con 0x7fa9a0101300 2023-08-11T12:23:12.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.425+0000 7fa9a7a8f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a006a370 con 0x7fa9a0100940 2023-08-11T12:23:12.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.425+0000 7fa9a7a8f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a006a530 con 0x7fa9a0106940 2023-08-11T12:23:12.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.426+0000 7fa9a582b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9a0100940 0x7fa9a0194870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:12.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.427+0000 7fa9a582b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9a0100940 0x7fa9a0194870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:39638/0 (socket says 172.21.15.8:39638) 2023-08-11T12:23:12.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.427+0000 7fa9a582b700 1 -- 172.21.15.8:0/1284933136 learned_addr learned my addr 172.21.15.8:0/1284933136 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:12.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.434+0000 7fa9a602c700 1 --2- 172.21.15.8:0/1284933136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9a0106940 0x7fa9a01b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:12.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.435+0000 7fa9a502a700 1 --2- 172.21.15.8:0/1284933136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9a0101300 0x7fa9a0194db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:12.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.435+0000 7fa9a502a700 1 -- 172.21.15.8:0/1284933136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9a0106940 msgr2=0x7fa9a01b15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:12.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.435+0000 7fa9a502a700 1 --2- 172.21.15.8:0/1284933136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9a0106940 0x7fa9a01b15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:12.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.435+0000 7fa9a502a700 1 -- 172.21.15.8:0/1284933136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9a0100940 msgr2=0x7fa9a0194870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:12.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.435+0000 7fa9a502a700 1 --2- 172.21.15.8:0/1284933136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9a0100940 0x7fa9a0194870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:12.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.435+0000 7fa9a502a700 1 -- 172.21.15.8:0/1284933136 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9900095f0 con 0x7fa9a0101300 2023-08-11T12:23:12.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.436+0000 7fa9a502a700 1 --2- 172.21.15.8:0/1284933136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9a0101300 0x7fa9a0194db0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa990006010 tx=0x7fa990005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:12.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.436+0000 7fa996ffd700 1 -- 172.21.15.8:0/1284933136 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99001d070 con 0x7fa9a0101300 2023-08-11T12:23:12.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.436+0000 7fa996ffd700 1 -- 172.21.15.8:0/1284933136 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa990021410 con 0x7fa9a0101300 2023-08-11T12:23:12.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.436+0000 7fa996ffd700 1 -- 172.21.15.8:0/1284933136 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990017650 con 0x7fa9a0101300 2023-08-11T12:23:12.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.436+0000 7fa9a7a8f700 1 -- 172.21.15.8:0/1284933136 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a006a7b0 con 0x7fa9a0101300 2023-08-11T12:23:12.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.437+0000 7fa9a7a8f700 1 -- 172.21.15.8:0/1284933136 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a006abd0 con 0x7fa9a0101300 2023-08-11T12:23:12.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.439+0000 7fa9a7a8f700 1 -- 172.21.15.8:0/1284933136 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa984005320 con 0x7fa9a0101300 2023-08-11T12:23:12.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.445+0000 7fa996ffd700 1 -- 172.21.15.8:0/1284933136 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fa99000fb10 con 0x7fa9a0101300 2023-08-11T12:23:12.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.447+0000 7fa996ffd700 1 --2- 172.21.15.8:0/1284933136 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa98c0a0140 0x7fa98c0a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:12.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.447+0000 7fa996ffd700 1 -- 172.21.15.8:0/1284933136 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fa9900cced0 con 0x7fa9a0101300 2023-08-11T12:23:12.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.448+0000 7fa9a582b700 1 --2- 172.21.15.8:0/1284933136 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa98c0a0140 0x7fa98c0a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:12.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.449+0000 7fa996ffd700 1 -- 172.21.15.8:0/1284933136 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fa990096a00 con 0x7fa9a0101300 2023-08-11T12:23:12.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.449+0000 7fa9a582b700 1 --2- 172.21.15.8:0/1284933136 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa98c0a0140 0x7fa98c0a2600 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa99c009ca0 tx=0x7fa99c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:12.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.793+0000 7fa9a7a8f700 1 -- 172.21.15.8:0/1284933136 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa984005190 con 0x7fa9a0101300 2023-08-11T12:23:12.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.794+0000 7fa996ffd700 1 -- 172.21.15.8:0/1284933136 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa990026020 con 0x7fa9a0101300 2023-08-11T12:23:12.798 INFO:teuthology.orchestra.run.smithi008.stdout:163208757301 2023-08-11T12:23:12.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.796+0000 7fa9a7a8f700 1 -- 172.21.15.8:0/1284933136 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa98c0a0140 msgr2=0x7fa98c0a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:12.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.796+0000 7fa9a7a8f700 1 --2- 172.21.15.8:0/1284933136 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa98c0a0140 0x7fa98c0a2600 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa99c009ca0 tx=0x7fa99c009260 comp rx=0 tx=0).stop 2023-08-11T12:23:12.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.796+0000 7fa9a7a8f700 1 -- 172.21.15.8:0/1284933136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9a0101300 msgr2=0x7fa9a0194db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:12.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.796+0000 7fa9a7a8f700 1 --2- 172.21.15.8:0/1284933136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9a0101300 0x7fa9a0194db0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa990006010 tx=0x7fa990005740 comp rx=0 tx=0).stop 2023-08-11T12:23:12.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.797+0000 7fa9a7a8f700 1 -- 172.21.15.8:0/1284933136 shutdown_connections 2023-08-11T12:23:12.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.797+0000 7fa9a7a8f700 1 --2- 172.21.15.8:0/1284933136 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa98c0a0140 0x7fa98c0a2600 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:12.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.797+0000 7fa9a7a8f700 1 --2- 172.21.15.8:0/1284933136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9a0106940 0x7fa9a01b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:12.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.797+0000 7fa9a7a8f700 1 --2- 172.21.15.8:0/1284933136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9a0100940 0x7fa9a0194870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:12.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.797+0000 7fa9a7a8f700 1 --2- 172.21.15.8:0/1284933136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9a0101300 0x7fa9a0194db0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:12.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.797+0000 7fa9a7a8f700 1 -- 172.21.15.8:0/1284933136 >> 172.21.15.8:0/1284933136 conn(0x7fa9a00fc410 msgr2=0x7fa9a00fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:12.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.797+0000 7fa9a7a8f700 1 -- 172.21.15.8:0/1284933136 shutdown_connections 2023-08-11T12:23:12.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:12.797+0000 7fa9a7a8f700 1 -- 172.21.15.8:0/1284933136 wait complete. 2023-08-11T12:23:13.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.490+0000 7f4500a1d700 1 -- 172.21.15.8:0/2457244605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44fc106940 msgr2=0x7f44fc106d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:13.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.490+0000 7f4500a1d700 1 --2- 172.21.15.8:0/2457244605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44fc106940 0x7f44fc106d20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f44ec009990 tx=0x7f44ec009ca0 comp rx=0 tx=0).stop 2023-08-11T12:23:13.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.490+0000 7f4500a1d700 1 -- 172.21.15.8:0/2457244605 shutdown_connections 2023-08-11T12:23:13.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.490+0000 7f4500a1d700 1 --2- 172.21.15.8:0/2457244605 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44fc101300 0x7f44fc10d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:13.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.490+0000 7f4500a1d700 1 --2- 172.21.15.8:0/2457244605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44fc106940 0x7f44fc106d20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.490+0000 7f4500a1d700 1 --2- 172.21.15.8:0/2457244605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44fc100940 0x7f44fc100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.490+0000 7f4500a1d700 1 -- 172.21.15.8:0/2457244605 >> 172.21.15.8:0/2457244605 conn(0x7f44fc0fc410 msgr2=0x7f44fc0fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.491+0000 7f4500a1d700 1 -- 172.21.15.8:0/2457244605 shutdown_connections 2023-08-11T12:23:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.491+0000 7f4500a1d700 1 -- 172.21.15.8:0/2457244605 wait complete. 2023-08-11T12:23:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.492+0000 7f4500a1d700 1 Processor -- start 2023-08-11T12:23:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.492+0000 7f4500a1d700 1 -- start start 2023-08-11T12:23:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.492+0000 7f4500a1d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44fc100940 0x7f44fc19e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.492+0000 7f4500a1d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44fc101300 0x7f44fc19ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.492+0000 7f4500a1d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44fc106940 0x7f44fc198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.492+0000 7f4500a1d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc1990d0 con 0x7f44fc100940 2023-08-11T12:23:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.492+0000 7f4500a1d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc199240 con 0x7f44fc101300 2023-08-11T12:23:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.492+0000 7f4500a1d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc199400 con 0x7f44fc106940 2023-08-11T12:23:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.493+0000 7f44f259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44fc100940 0x7f44fc19e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.493+0000 7f44fa59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44fc101300 0x7f44fc19ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.493+0000 7f44f259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44fc100940 0x7f44fc19e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53262/0 (socket says 172.21.15.8:53262) 2023-08-11T12:23:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.493+0000 7f44f259c700 1 -- 172.21.15.8:0/871380771 learned_addr learned my addr 172.21.15.8:0/871380771 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.493+0000 7f44fad9d700 1 --2- 172.21.15.8:0/871380771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44fc106940 0x7f44fc198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.493+0000 7f44fa59c700 1 -- 172.21.15.8:0/871380771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44fc106940 msgr2=0x7f44fc198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.493+0000 7f44fa59c700 1 --2- 172.21.15.8:0/871380771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44fc106940 0x7f44fc198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.493+0000 7f44fa59c700 1 -- 172.21.15.8:0/871380771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44fc100940 msgr2=0x7f44fc19e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.493+0000 7f44fa59c700 1 --2- 172.21.15.8:0/871380771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44fc100940 0x7f44fc19e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.493+0000 7f44fa59c700 1 -- 172.21.15.8:0/871380771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ec0095f0 con 0x7f44fc101300 2023-08-11T12:23:13.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.493+0000 7f44f259c700 1 --2- 172.21.15.8:0/871380771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44fc100940 0x7f44fc19e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:13.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.493+0000 7f44fa59c700 1 --2- 172.21.15.8:0/871380771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44fc101300 0x7f44fc19ef20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f44e400e9f0 tx=0x7f44e400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:13.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.494+0000 7f44f3fff700 1 -- 172.21.15.8:0/871380771 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e400c9c0 con 0x7f44fc101300 2023-08-11T12:23:13.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.494+0000 7f4500a1d700 1 -- 172.21.15.8:0/871380771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44fc1996e0 con 0x7f44fc101300 2023-08-11T12:23:13.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.494+0000 7f4500a1d700 1 -- 172.21.15.8:0/871380771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44fc1a59d0 con 0x7f44fc101300 2023-08-11T12:23:13.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.494+0000 7f44f3fff700 1 -- 172.21.15.8:0/871380771 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f44e4010430 con 0x7f44fc101300 2023-08-11T12:23:13.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.494+0000 7f44f3fff700 1 -- 172.21.15.8:0/871380771 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e4018680 con 0x7f44fc101300 2023-08-11T12:23:13.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.495+0000 7f4500a1d700 1 -- 172.21.15.8:0/871380771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44dc005320 con 0x7f44fc101300 2023-08-11T12:23:13.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.497+0000 7f44f3fff700 1 -- 172.21.15.8:0/871380771 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f44e400cb20 con 0x7f44fc101300 2023-08-11T12:23:13.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.499+0000 7f44f3fff700 1 --2- 172.21.15.8:0/871380771 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f44e809ffd0 0x7f44e80a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:13.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.499+0000 7f44f3fff700 1 -- 172.21.15.8:0/871380771 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f44e4014070 con 0x7f44fc101300 2023-08-11T12:23:13.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.499+0000 7f44f259c700 1 --2- 172.21.15.8:0/871380771 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f44e809ffd0 0x7f44e80a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:13.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.500+0000 7f44f259c700 1 --2- 172.21.15.8:0/871380771 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f44e809ffd0 0x7f44e80a2490 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f44ec00b6f0 tx=0x7f44ec005bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:13.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.503+0000 7f44f3fff700 1 -- 172.21.15.8:0/871380771 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f44e4051c30 con 0x7f44fc101300 2023-08-11T12:23:13.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.734+0000 7f4500a1d700 1 -- 172.21.15.8:0/871380771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f44dc005190 con 0x7f44fc101300 2023-08-11T12:23:13.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.735+0000 7f44f3fff700 1 -- 172.21.15.8:0/871380771 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f44e4098a50 con 0x7f44fc101300 2023-08-11T12:23:13.739 INFO:teuthology.orchestra.run.smithi008.stdout:34359738444 2023-08-11T12:23:13.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.738+0000 7f4500a1d700 1 -- 172.21.15.8:0/871380771 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f44e809ffd0 msgr2=0x7f44e80a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:13.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.738+0000 7f4500a1d700 1 --2- 172.21.15.8:0/871380771 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f44e809ffd0 0x7f44e80a2490 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f44ec00b6f0 tx=0x7f44ec005bc0 comp rx=0 tx=0).stop 2023-08-11T12:23:13.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.738+0000 7f4500a1d700 1 -- 172.21.15.8:0/871380771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44fc101300 msgr2=0x7f44fc19ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:13.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.738+0000 7f4500a1d700 1 --2- 172.21.15.8:0/871380771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44fc101300 0x7f44fc19ef20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f44e400e9f0 tx=0x7f44e400ed00 comp rx=0 tx=0).stop 2023-08-11T12:23:13.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.739+0000 7f4500a1d700 1 -- 172.21.15.8:0/871380771 shutdown_connections 2023-08-11T12:23:13.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.739+0000 7f4500a1d700 1 --2- 172.21.15.8:0/871380771 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f44e809ffd0 0x7f44e80a2490 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:13.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.739+0000 7f4500a1d700 1 --2- 172.21.15.8:0/871380771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44fc106940 0x7f44fc198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:13.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.739+0000 7f4500a1d700 1 --2- 172.21.15.8:0/871380771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44fc100940 0x7f44fc19e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:13.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.739+0000 7f4500a1d700 1 --2- 172.21.15.8:0/871380771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44fc101300 0x7f44fc19ef20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:13.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.739+0000 7f4500a1d700 1 -- 172.21.15.8:0/871380771 >> 172.21.15.8:0/871380771 conn(0x7f44fc0fc410 msgr2=0x7f44fc0fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:13.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.739+0000 7f4500a1d700 1 -- 172.21.15.8:0/871380771 shutdown_connections 2023-08-11T12:23:13.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.739+0000 7f4500a1d700 1 -- 172.21.15.8:0/871380771 wait complete. 2023-08-11T12:23:13.844 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:13 smithi008 ceph-mon[97158]: pgmap v310: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-08-11T12:23:13.844 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:13 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1284933136' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-08-11T12:23:13.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:13 smithi194 ceph-mon[130905]: pgmap v310: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-08-11T12:23:13.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:13 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1284933136' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-08-11T12:23:13.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:13 smithi045 ceph-mon[130284]: pgmap v310: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-08-11T12:23:13.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:13 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1284933136' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-08-11T12:23:14.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:14 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/871380771' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-08-11T12:23:14.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:14 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3825273230' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-08-11T12:23:14.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:14 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/871380771' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-08-11T12:23:14.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:14 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3825273230' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-08-11T12:23:14.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:14 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/871380771' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-08-11T12:23:14.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:14 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3825273230' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-08-11T12:23:15.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.931+0000 7fec829ed700 1 -- 172.21.15.8:0/1087255655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec7c107200 msgr2=0x7fec7c1075e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:15.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.931+0000 7fec829ed700 1 --2- 172.21.15.8:0/1087255655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec7c107200 0x7fec7c1075e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fec6c01a9a0 tx=0x7fec6c01acb0 comp rx=0 tx=0).stop 2023-08-11T12:23:15.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.934+0000 7fec829ed700 1 -- 172.21.15.8:0/1087255655 shutdown_connections 2023-08-11T12:23:15.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.934+0000 7fec829ed700 1 --2- 172.21.15.8:0/1087255655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec7c107200 0x7fec7c1075e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:15.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.934+0000 7fec829ed700 1 --2- 172.21.15.8:0/1087255655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec7c10c2e0 0x7fec7c113eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:15.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.934+0000 7fec829ed700 1 --2- 172.21.15.8:0/1087255655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec7c107bb0 0x7fec7c10bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:15.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.934+0000 7fec829ed700 1 -- 172.21.15.8:0/1087255655 >> 172.21.15.8:0/1087255655 conn(0x7fec7c074f10 msgr2=0x7fec7c077330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:15.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.934+0000 7fec829ed700 1 -- 172.21.15.8:0/1087255655 shutdown_connections 2023-08-11T12:23:15.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.934+0000 7fec829ed700 1 -- 172.21.15.8:0/1087255655 wait complete. 2023-08-11T12:23:15.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.936+0000 7fec829ed700 1 Processor -- start 2023-08-11T12:23:15.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.936+0000 7fec829ed700 1 -- start start 2023-08-11T12:23:15.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.936+0000 7fec829ed700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec7c107200 0x7fec7c10f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:15.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.936+0000 7fec829ed700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec7c107bb0 0x7fec7c10fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:15.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.936+0000 7fec829ed700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec7c10c2e0 0x7fec7c1c26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:15.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.936+0000 7fec829ed700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c1c2be0 con 0x7fec7c10c2e0 2023-08-11T12:23:15.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.936+0000 7fec829ed700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c1c2d20 con 0x7fec7c107200 2023-08-11T12:23:15.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.936+0000 7fec829ed700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c1c2e90 con 0x7fec7c107bb0 2023-08-11T12:23:15.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.937+0000 7fec7b7fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec7c107bb0 0x7fec7c10fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:15.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.937+0000 7fec7b7fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec7c107bb0 0x7fec7c10fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:43902/0 (socket says 172.21.15.8:43902) 2023-08-11T12:23:15.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.937+0000 7fec7b7fe700 1 -- 172.21.15.8:0/3825273230 learned_addr learned my addr 172.21.15.8:0/3825273230 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:15.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.937+0000 7fec80f8a700 1 --2- 172.21.15.8:0/3825273230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec7c10c2e0 0x7fec7c1c26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:15.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.937+0000 7fec7b7fe700 1 -- 172.21.15.8:0/3825273230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec7c107200 msgr2=0x7fec7c10f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:15.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.937+0000 7fec7b7fe700 1 --2- 172.21.15.8:0/3825273230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec7c107200 0x7fec7c10f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:15.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.937+0000 7fec7b7fe700 1 -- 172.21.15.8:0/3825273230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec7c10c2e0 msgr2=0x7fec7c1c26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:15.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.937+0000 7fec7b7fe700 1 --2- 172.21.15.8:0/3825273230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec7c10c2e0 0x7fec7c1c26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:15.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.937+0000 7fec7b7fe700 1 -- 172.21.15.8:0/3825273230 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6c01a600 con 0x7fec7c107bb0 2023-08-11T12:23:15.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.938+0000 7fec7b7fe700 1 --2- 172.21.15.8:0/3825273230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec7c107bb0 0x7fec7c10fb60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fec6800d980 tx=0x7fec6800dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:15.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.939+0000 7fec797fa700 1 -- 172.21.15.8:0/3825273230 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec68009930 con 0x7fec7c107bb0 2023-08-11T12:23:15.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.939+0000 7fec797fa700 1 -- 172.21.15.8:0/3825273230 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec68010460 con 0x7fec7c107bb0 2023-08-11T12:23:15.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.939+0000 7fec797fa700 1 -- 172.21.15.8:0/3825273230 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6800f620 con 0x7fec7c107bb0 2023-08-11T12:23:15.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.940+0000 7fec829ed700 1 -- 172.21.15.8:0/3825273230 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec7c1c3110 con 0x7fec7c107bb0 2023-08-11T12:23:15.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.940+0000 7fec829ed700 1 -- 172.21.15.8:0/3825273230 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec7c1c3590 con 0x7fec7c107bb0 2023-08-11T12:23:15.094 INFO:teuthology.orchestra.run.smithi008.stdout:141733920826 2023-08-11T12:23:15.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.941+0000 7fec829ed700 1 -- 172.21.15.8:0/3825273230 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec7c04e620 con 0x7fec7c107bb0 2023-08-11T12:23:15.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.946+0000 7fec797fa700 1 -- 172.21.15.8:0/3825273230 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fec680108d0 con 0x7fec7c107bb0 2023-08-11T12:23:15.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.948+0000 7fec797fa700 1 --2- 172.21.15.8:0/3825273230 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fec600a0050 0x7fec600a2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:15.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.948+0000 7fec797fa700 1 -- 172.21.15.8:0/3825273230 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fec680cb720 con 0x7fec7c107bb0 2023-08-11T12:23:15.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.949+0000 7fec797fa700 1 -- 172.21.15.8:0/3825273230 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fec680951c0 con 0x7fec7c107bb0 2023-08-11T12:23:15.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.950+0000 7fec7bfff700 1 --2- 172.21.15.8:0/3825273230 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fec600a0050 0x7fec600a2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:15.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:13.951+0000 7fec7bfff700 1 --2- 172.21.15.8:0/3825273230 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fec600a0050 0x7fec600a2510 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fec6c003800 tx=0x7fec6c005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:15.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:14.183+0000 7fec829ed700 1 -- 172.21.15.8:0/3825273230 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fec7c110980 con 0x7fec7c107bb0 2023-08-11T12:23:15.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:14.184+0000 7fec797fa700 1 -- 172.21.15.8:0/3825273230 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fec68017020 con 0x7fec7c107bb0 2023-08-11T12:23:15.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:14.187+0000 7fec829ed700 1 -- 172.21.15.8:0/3825273230 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fec600a0050 msgr2=0x7fec600a2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:15.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:14.187+0000 7fec829ed700 1 --2- 172.21.15.8:0/3825273230 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fec600a0050 0x7fec600a2510 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fec6c003800 tx=0x7fec6c005e80 comp rx=0 tx=0).stop 2023-08-11T12:23:15.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:14.187+0000 7fec829ed700 1 -- 172.21.15.8:0/3825273230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec7c107bb0 msgr2=0x7fec7c10fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:15.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:14.187+0000 7fec829ed700 1 --2- 172.21.15.8:0/3825273230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec7c107bb0 0x7fec7c10fb60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fec6800d980 tx=0x7fec6800dc90 comp rx=0 tx=0).stop 2023-08-11T12:23:15.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:14.187+0000 7fec829ed700 1 -- 172.21.15.8:0/3825273230 shutdown_connections 2023-08-11T12:23:15.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:14.187+0000 7fec829ed700 1 --2- 172.21.15.8:0/3825273230 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fec600a0050 0x7fec600a2510 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:15.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:14.187+0000 7fec829ed700 1 --2- 172.21.15.8:0/3825273230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec7c10c2e0 0x7fec7c1c26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:15.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:14.187+0000 7fec829ed700 1 --2- 172.21.15.8:0/3825273230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec7c107200 0x7fec7c10f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:15.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:14.187+0000 7fec829ed700 1 --2- 172.21.15.8:0/3825273230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec7c107bb0 0x7fec7c10fb60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:15.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:14.187+0000 7fec829ed700 1 -- 172.21.15.8:0/3825273230 >> 172.21.15.8:0/3825273230 conn(0x7fec7c074f10 msgr2=0x7fec7c10abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:15.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:14.187+0000 7fec829ed700 1 -- 172.21.15.8:0/3825273230 shutdown_connections 2023-08-11T12:23:15.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:14.187+0000 7fec829ed700 1 -- 172.21.15.8:0/3825273230 wait complete. 2023-08-11T12:23:15.700 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:15 smithi008 ceph-mon[97158]: pgmap v311: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2023-08-11T12:23:15.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:15 smithi194 ceph-mon[130905]: pgmap v311: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2023-08-11T12:23:15.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:15 smithi045 ceph-mon[130284]: pgmap v311: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2023-08-11T12:23:16.482 INFO:teuthology.orchestra.run.smithi008.stdout:55834574919 2023-08-11T12:23:16.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.064+0000 7f4719e87700 1 -- 172.21.15.8:0/2988423202 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f471410d180 msgr2=0x7f471410f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:16.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.064+0000 7f4719e87700 1 --2- 172.21.15.8:0/2988423202 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f471410d180 0x7f471410f5f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f470c00b0a0 tx=0x7f470c00b3b0 comp rx=0 tx=0).stop 2023-08-11T12:23:16.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.064+0000 7f4719e87700 1 -- 172.21.15.8:0/2988423202 shutdown_connections 2023-08-11T12:23:16.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.064+0000 7f4719e87700 1 --2- 172.21.15.8:0/2988423202 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f471410d180 0x7f471410f5f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:16.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.064+0000 7f4719e87700 1 --2- 172.21.15.8:0/2988423202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4714072d50 0x7f4714073130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:16.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.064+0000 7f4719e87700 1 --2- 172.21.15.8:0/2988423202 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4714073670 0x7f471410cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:16.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.064+0000 7f4719e87700 1 -- 172.21.15.8:0/2988423202 >> 172.21.15.8:0/2988423202 conn(0x7f47140fc410 msgr2=0x7f47140fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:16.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.064+0000 7f4719e87700 1 -- 172.21.15.8:0/2988423202 shutdown_connections 2023-08-11T12:23:16.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.064+0000 7f4719e87700 1 -- 172.21.15.8:0/2988423202 wait complete. 2023-08-11T12:23:16.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.065+0000 7f4719e87700 1 Processor -- start 2023-08-11T12:23:16.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.065+0000 7f4719e87700 1 -- start start 2023-08-11T12:23:16.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.066+0000 7f4719e87700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4714072d50 0x7f471419eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:16.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.066+0000 7f4719e87700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4714073670 0x7f471419f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:16.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.066+0000 7f4719e87700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f471410d180 0x7f4714198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:16.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.066+0000 7f4719e87700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47141991b0 con 0x7f4714072d50 2023-08-11T12:23:16.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.066+0000 7f4719e87700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4714199320 con 0x7f471410d180 2023-08-11T12:23:16.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.066+0000 7f4719e87700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47141994e0 con 0x7f4714073670 2023-08-11T12:23:16.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.066+0000 7f470b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4714072d50 0x7f471419eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:16.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.066+0000 7f47137fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4714073670 0x7f471419f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:16.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.066+0000 7f470b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4714072d50 0x7f471419eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53304/0 (socket says 172.21.15.8:53304) 2023-08-11T12:23:16.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.066+0000 7f470b7fe700 1 -- 172.21.15.8:0/194700160 learned_addr learned my addr 172.21.15.8:0/194700160 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:16.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.066+0000 7f4713fff700 1 --2- 172.21.15.8:0/194700160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f471410d180 0x7f4714198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:16.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.066+0000 7f470b7fe700 1 -- 172.21.15.8:0/194700160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4714073670 msgr2=0x7f471419f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:16.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.067+0000 7f470b7fe700 1 --2- 172.21.15.8:0/194700160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4714073670 0x7f471419f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:16.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.067+0000 7f470b7fe700 1 -- 172.21.15.8:0/194700160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f471410d180 msgr2=0x7f4714198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:16.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.067+0000 7f470b7fe700 1 --2- 172.21.15.8:0/194700160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f471410d180 0x7f4714198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:16.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.067+0000 7f470b7fe700 1 -- 172.21.15.8:0/194700160 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470c009d00 con 0x7f4714072d50 2023-08-11T12:23:16.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.067+0000 7f4713fff700 1 --2- 172.21.15.8:0/194700160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f471410d180 0x7f4714198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:23:16.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.067+0000 7f470b7fe700 1 --2- 172.21.15.8:0/194700160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4714072d50 0x7f471419eac0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f470400e9a0 tx=0x7f470400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:16.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.067+0000 7f47117fa700 1 -- 172.21.15.8:0/194700160 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4704009790 con 0x7f4714072d50 2023-08-11T12:23:16.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.067+0000 7f47117fa700 1 -- 172.21.15.8:0/194700160 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f470400cbd0 con 0x7f4714072d50 2023-08-11T12:23:16.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.067+0000 7f47117fa700 1 -- 172.21.15.8:0/194700160 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4704018680 con 0x7f4714072d50 2023-08-11T12:23:16.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.067+0000 7f4719e87700 1 -- 172.21.15.8:0/194700160 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47141997c0 con 0x7f4714072d50 2023-08-11T12:23:16.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.067+0000 7f4719e87700 1 -- 172.21.15.8:0/194700160 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47141a5ab0 con 0x7f4714072d50 2023-08-11T12:23:16.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.068+0000 7f4719e87700 1 -- 172.21.15.8:0/194700160 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f471404e620 con 0x7f4714072d50 2023-08-11T12:23:16.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.071+0000 7f47117fa700 1 -- 172.21.15.8:0/194700160 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f470400cd40 con 0x7f4714072d50 2023-08-11T12:23:16.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.072+0000 7f47117fa700 1 --2- 172.21.15.8:0/194700160 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f470009ffd0 0x7f47000a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:16.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.072+0000 7f47117fa700 1 -- 172.21.15.8:0/194700160 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f4704014070 con 0x7f4714072d50 2023-08-11T12:23:16.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.072+0000 7f47137fe700 1 --2- 172.21.15.8:0/194700160 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f470009ffd0 0x7f47000a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:16.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.073+0000 7f47137fe700 1 --2- 172.21.15.8:0/194700160 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f470009ffd0 0x7f47000a2490 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f471410e4c0 tx=0x7f46fc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:16.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.074+0000 7f47117fa700 1 -- 172.21.15.8:0/194700160 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f47040954b0 con 0x7f4714072d50 2023-08-11T12:23:16.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.303+0000 7f4719e87700 1 -- 172.21.15.8:0/194700160 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4714112b40 con 0x7f4714072d50 2023-08-11T12:23:16.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.304+0000 7f47117fa700 1 -- 172.21.15.8:0/194700160 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4704026020 con 0x7f4714072d50 2023-08-11T12:23:16.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.306+0000 7f4719e87700 1 -- 172.21.15.8:0/194700160 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f470009ffd0 msgr2=0x7f47000a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:16.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.306+0000 7f4719e87700 1 --2- 172.21.15.8:0/194700160 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f470009ffd0 0x7f47000a2490 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f471410e4c0 tx=0x7f46fc009260 comp rx=0 tx=0).stop 2023-08-11T12:23:16.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.306+0000 7f4719e87700 1 -- 172.21.15.8:0/194700160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4714072d50 msgr2=0x7f471419eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:16.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.306+0000 7f4719e87700 1 --2- 172.21.15.8:0/194700160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4714072d50 0x7f471419eac0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f470400e9a0 tx=0x7f470400ecb0 comp rx=0 tx=0).stop 2023-08-11T12:23:16.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.307+0000 7f4719e87700 1 -- 172.21.15.8:0/194700160 shutdown_connections 2023-08-11T12:23:16.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.307+0000 7f4719e87700 1 --2- 172.21.15.8:0/194700160 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f470009ffd0 0x7f47000a2490 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:16.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.307+0000 7f4719e87700 1 --2- 172.21.15.8:0/194700160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f471410d180 0x7f4714198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:16.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.307+0000 7f4719e87700 1 --2- 172.21.15.8:0/194700160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4714072d50 0x7f471419eac0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:16.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.307+0000 7f4719e87700 1 --2- 172.21.15.8:0/194700160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4714073670 0x7f471419f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:16.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.307+0000 7f4719e87700 1 -- 172.21.15.8:0/194700160 >> 172.21.15.8:0/194700160 conn(0x7f47140fc410 msgr2=0x7f471410f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:16.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.307+0000 7f4719e87700 1 -- 172.21.15.8:0/194700160 shutdown_connections 2023-08-11T12:23:16.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:16.307+0000 7f4719e87700 1 -- 172.21.15.8:0/194700160 wait complete. 2023-08-11T12:23:16.531 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757299 got 163208757301 for osd.5 2023-08-11T12:23:16.531 DEBUG:teuthology.parallel:result is None 2023-08-11T12:23:16.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.491+0000 7faefe730700 1 -- 172.21.15.8:0/2612393962 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faef8105d50 msgr2=0x7faef810d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:16.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.491+0000 7faefe730700 1 --2- 172.21.15.8:0/2612393962 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faef8105d50 0x7faef810d760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faef000b100 tx=0x7faef000b410 comp rx=0 tx=0).stop 2023-08-11T12:23:16.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.491+0000 7faefe730700 1 -- 172.21.15.8:0/2612393962 shutdown_connections 2023-08-11T12:23:16.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.491+0000 7faefe730700 1 --2- 172.21.15.8:0/2612393962 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faef8105d50 0x7faef810d760 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:16.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.491+0000 7faefe730700 1 --2- 172.21.15.8:0/2612393962 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faef80688e0 0x7faef8068cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:16.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.491+0000 7faefe730700 1 --2- 172.21.15.8:0/2612393962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faef8105390 0x7faef8105810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:16.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.491+0000 7faefe730700 1 -- 172.21.15.8:0/2612393962 >> 172.21.15.8:0/2612393962 conn(0x7faef8076920 msgr2=0x7faef8076d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:16.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.492+0000 7faefe730700 1 -- 172.21.15.8:0/2612393962 shutdown_connections 2023-08-11T12:23:16.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.492+0000 7faefe730700 1 -- 172.21.15.8:0/2612393962 wait complete. 2023-08-11T12:23:16.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.493+0000 7faefe730700 1 Processor -- start 2023-08-11T12:23:16.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.493+0000 7faefe730700 1 -- start start 2023-08-11T12:23:16.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.494+0000 7faefe730700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faef80688e0 0x7faef819c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:16.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.494+0000 7faefe730700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faef8105390 0x7faef819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:16.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.494+0000 7faefe730700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faef8105d50 0x7faef8196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:16.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.494+0000 7faefe730700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef8196fb0 con 0x7faef8105d50 2023-08-11T12:23:16.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.494+0000 7faefe730700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef8197120 con 0x7faef8105390 2023-08-11T12:23:16.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.494+0000 7faefe730700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef81972e0 con 0x7faef80688e0 2023-08-11T12:23:16.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.494+0000 7faef7fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faef80688e0 0x7faef819c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:16.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.494+0000 7faef7fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faef80688e0 0x7faef819c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:43918/0 (socket says 172.21.15.8:43918) 2023-08-11T12:23:16.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.494+0000 7faef7fff700 1 -- 172.21.15.8:0/2818629879 learned_addr learned my addr 172.21.15.8:0/2818629879 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:16.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.494+0000 7faef77fe700 1 --2- 172.21.15.8:0/2818629879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faef8105390 0x7faef819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:16.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.494+0000 7faefcccd700 1 --2- 172.21.15.8:0/2818629879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faef8105d50 0x7faef8196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:16.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.495+0000 7faef77fe700 1 -- 172.21.15.8:0/2818629879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faef80688e0 msgr2=0x7faef819c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:16.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.495+0000 7faef77fe700 1 --2- 172.21.15.8:0/2818629879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faef80688e0 0x7faef819c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:16.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.495+0000 7faef77fe700 1 -- 172.21.15.8:0/2818629879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faef8105d50 msgr2=0x7faef8196940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:16.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.495+0000 7faef77fe700 1 --2- 172.21.15.8:0/2818629879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faef8105d50 0x7faef8196940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:16.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.495+0000 7faef77fe700 1 -- 172.21.15.8:0/2818629879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef0009d00 con 0x7faef8105390 2023-08-11T12:23:16.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.495+0000 7faef77fe700 1 --2- 172.21.15.8:0/2818629879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faef8105390 0x7faef819ce00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faeec00e9f0 tx=0x7faeec00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:16.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.495+0000 7faef57fa700 1 -- 172.21.15.8:0/2818629879 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec00c9c0 con 0x7faef8105390 2023-08-11T12:23:16.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.495+0000 7faef57fa700 1 -- 172.21.15.8:0/2818629879 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faeec010430 con 0x7faef8105390 2023-08-11T12:23:16.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.495+0000 7faef57fa700 1 -- 172.21.15.8:0/2818629879 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec018680 con 0x7faef8105390 2023-08-11T12:23:16.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.496+0000 7faefe730700 1 -- 172.21.15.8:0/2818629879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef81975c0 con 0x7faef8105390 2023-08-11T12:23:16.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.496+0000 7faefe730700 1 -- 172.21.15.8:0/2818629879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef80ff9d0 con 0x7faef8105390 2023-08-11T12:23:16.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.498+0000 7faefe730700 1 -- 172.21.15.8:0/2818629879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faef81977b0 con 0x7faef8105390 2023-08-11T12:23:16.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.500+0000 7faef57fa700 1 -- 172.21.15.8:0/2818629879 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7faeec010860 con 0x7faef8105390 2023-08-11T12:23:16.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.502+0000 7faef57fa700 1 --2- 172.21.15.8:0/2818629879 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7faee009ffd0 0x7faee00a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:16.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.502+0000 7faef57fa700 1 -- 172.21.15.8:0/2818629879 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7faeec014070 con 0x7faef8105390 2023-08-11T12:23:16.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.502+0000 7faef7fff700 1 --2- 172.21.15.8:0/2818629879 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7faee009ffd0 0x7faee00a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:16.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.503+0000 7faef7fff700 1 --2- 172.21.15.8:0/2818629879 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7faee009ffd0 0x7faee00a2490 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faee8009d20 tx=0x7faee8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:16.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.506+0000 7faef57fa700 1 -- 172.21.15.8:0/2818629879 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7faef81977b0 con 0x7faef8105390 2023-08-11T12:23:16.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.744+0000 7faefe730700 1 -- 172.21.15.8:0/2818629879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7faef81977b0 con 0x7faef8105390 2023-08-11T12:23:16.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.745+0000 7faef57fa700 1 -- 172.21.15.8:0/2818629879 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faef81977b0 con 0x7faef8105390 2023-08-11T12:23:16.562 INFO:teuthology.orchestra.run.smithi008.stdout:249108103208 2023-08-11T12:23:16.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.747+0000 7faefe730700 1 -- 172.21.15.8:0/2818629879 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7faee009ffd0 msgr2=0x7faee00a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:16.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.747+0000 7faefe730700 1 --2- 172.21.15.8:0/2818629879 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7faee009ffd0 0x7faee00a2490 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faee8009d20 tx=0x7faee8009260 comp rx=0 tx=0).stop 2023-08-11T12:23:16.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.747+0000 7faefe730700 1 -- 172.21.15.8:0/2818629879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faef8105390 msgr2=0x7faef819ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:16.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.747+0000 7faefe730700 1 --2- 172.21.15.8:0/2818629879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faef8105390 0x7faef819ce00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faeec00e9f0 tx=0x7faeec00ed00 comp rx=0 tx=0).stop 2023-08-11T12:23:16.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.748+0000 7faefe730700 1 -- 172.21.15.8:0/2818629879 shutdown_connections 2023-08-11T12:23:16.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.748+0000 7faefe730700 1 --2- 172.21.15.8:0/2818629879 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7faee009ffd0 0x7faee00a2490 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:16.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.748+0000 7faefe730700 1 --2- 172.21.15.8:0/2818629879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faef80688e0 0x7faef819c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:16.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.748+0000 7faefe730700 1 --2- 172.21.15.8:0/2818629879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faef8105d50 0x7faef8196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:16.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.748+0000 7faefe730700 1 --2- 172.21.15.8:0/2818629879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faef8105390 0x7faef819ce00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:16.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.748+0000 7faefe730700 1 -- 172.21.15.8:0/2818629879 >> 172.21.15.8:0/2818629879 conn(0x7faef8076920 msgr2=0x7faef80fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:16.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.748+0000 7faefe730700 1 -- 172.21.15.8:0/2818629879 shutdown_connections 2023-08-11T12:23:16.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:15.748+0000 7faefe730700 1 -- 172.21.15.8:0/2818629879 wait complete. 2023-08-11T12:23:16.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:16 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2818629879' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-08-11T12:23:16.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:16 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/194700160' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-08-11T12:23:16.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:16 smithi008 ceph-mon[97158]: pgmap v312: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2023-08-11T12:23:16.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:16 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2818629879' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-08-11T12:23:16.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:16 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/194700160' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-08-11T12:23:16.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:16 smithi194 ceph-mon[130905]: pgmap v312: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2023-08-11T12:23:16.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:16 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2818629879' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-08-11T12:23:16.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:16 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/194700160' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-08-11T12:23:16.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:16 smithi045 ceph-mon[130284]: pgmap v312: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2023-08-11T12:23:17.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.370+0000 7f0144823700 1 -- 172.21.15.8:0/220903706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01400688e0 msgr2=0x7f0140068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:17.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.370+0000 7f0144823700 1 --2- 172.21.15.8:0/220903706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01400688e0 0x7f0140068cc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f01300099c0 tx=0x7f0130009cd0 comp rx=0 tx=0).stop 2023-08-11T12:23:17.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.371+0000 7f0144823700 1 -- 172.21.15.8:0/220903706 shutdown_connections 2023-08-11T12:23:17.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.371+0000 7f0144823700 1 --2- 172.21.15.8:0/220903706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0140105d50 0x7f014010d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:17.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.371+0000 7f0144823700 1 --2- 172.21.15.8:0/220903706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01400688e0 0x7f0140068cc0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:17.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.371+0000 7f0144823700 1 --2- 172.21.15.8:0/220903706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0140105390 0x7f0140105810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:17.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.371+0000 7f0144823700 1 -- 172.21.15.8:0/220903706 >> 172.21.15.8:0/220903706 conn(0x7f0140076920 msgr2=0x7f0140076d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:17.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.371+0000 7f0144823700 1 -- 172.21.15.8:0/220903706 shutdown_connections 2023-08-11T12:23:17.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.371+0000 7f0144823700 1 -- 172.21.15.8:0/220903706 wait complete. 2023-08-11T12:23:17.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.372+0000 7f0144823700 1 Processor -- start 2023-08-11T12:23:17.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.372+0000 7f0144823700 1 -- start start 2023-08-11T12:23:17.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.372+0000 7f0144823700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01400688e0 0x7f0140107750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:17.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.372+0000 7f0144823700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0140105390 0x7f0140107c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:17.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.372+0000 7f0144823700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0140105d50 0x7f01401081d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:17.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.373+0000 7f0144823700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01401a92a0 con 0x7f01400688e0 2023-08-11T12:23:17.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.373+0000 7f0144823700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01401989a0 con 0x7f0140105390 2023-08-11T12:23:17.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.373+0000 7f0144823700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0140198b60 con 0x7f0140105d50 2023-08-11T12:23:17.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.373+0000 7f013e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01400688e0 0x7f0140107750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:17.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.373+0000 7f013ed9d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0140105d50 0x7f01401081d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:17.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.373+0000 7f013e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01400688e0 0x7f0140107750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53324/0 (socket says 172.21.15.8:53324) 2023-08-11T12:23:17.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.373+0000 7f013e59c700 1 -- 172.21.15.8:0/3033481645 learned_addr learned my addr 172.21.15.8:0/3033481645 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:17.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.373+0000 7f013dd9b700 1 --2- 172.21.15.8:0/3033481645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0140105390 0x7f0140107c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:17.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.373+0000 7f013e59c700 1 -- 172.21.15.8:0/3033481645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0140105d50 msgr2=0x7f01401081d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:17.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.373+0000 7f013e59c700 1 --2- 172.21.15.8:0/3033481645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0140105d50 0x7f01401081d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:17.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.373+0000 7f013e59c700 1 -- 172.21.15.8:0/3033481645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0140105390 msgr2=0x7f0140107c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:17.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.373+0000 7f013e59c700 1 --2- 172.21.15.8:0/3033481645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0140105390 0x7f0140107c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:17.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.373+0000 7f013e59c700 1 -- 172.21.15.8:0/3033481645 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01300095f0 con 0x7f01400688e0 2023-08-11T12:23:17.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.373+0000 7f013dd9b700 1 --2- 172.21.15.8:0/3033481645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0140105390 0x7f0140107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:17.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.374+0000 7f013e59c700 1 --2- 172.21.15.8:0/3033481645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01400688e0 0x7f0140107750 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0130009fd0 tx=0x7f013000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:17.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.374+0000 7f012f7fe700 1 -- 172.21.15.8:0/3033481645 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013001d070 con 0x7f01400688e0 2023-08-11T12:23:17.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.374+0000 7f012f7fe700 1 -- 172.21.15.8:0/3033481645 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0130005050 con 0x7f01400688e0 2023-08-11T12:23:17.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.374+0000 7f0144823700 1 -- 172.21.15.8:0/3033481645 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0140198de0 con 0x7f01400688e0 2023-08-11T12:23:17.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.374+0000 7f012f7fe700 1 -- 172.21.15.8:0/3033481645 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130004950 con 0x7f01400688e0 2023-08-11T12:23:17.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.374+0000 7f0144823700 1 -- 172.21.15.8:0/3033481645 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0140199280 con 0x7f01400688e0 2023-08-11T12:23:17.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.376+0000 7f012d7fa700 1 -- 172.21.15.8:0/3033481645 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01240052f0 con 0x7f01400688e0 2023-08-11T12:23:17.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.378+0000 7f012f7fe700 1 -- 172.21.15.8:0/3033481645 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f013000fa90 con 0x7f01400688e0 2023-08-11T12:23:17.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.379+0000 7f012f7fe700 1 --2- 172.21.15.8:0/3033481645 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f012809ff50 0x7f01280a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:17.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.380+0000 7f012f7fe700 1 -- 172.21.15.8:0/3033481645 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f01300cc290 con 0x7f01400688e0 2023-08-11T12:23:17.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.380+0000 7f013dd9b700 1 --2- 172.21.15.8:0/3033481645 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f012809ff50 0x7f01280a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:17.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.381+0000 7f013dd9b700 1 --2- 172.21.15.8:0/3033481645 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f012809ff50 0x7f01280a2410 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0140108f40 tx=0x7f0134009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:17.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.383+0000 7f012f7fe700 1 -- 172.21.15.8:0/3033481645 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f0130095d40 con 0x7f01400688e0 2023-08-11T12:23:17.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.433+0000 7ff4e99a9700 1 -- 172.21.15.8:0/3574374483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4e410d0f0 msgr2=0x7ff4e410f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:17.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.433+0000 7ff4e99a9700 1 --2- 172.21.15.8:0/3574374483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4e410d0f0 0x7ff4e410f4e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00b0a0 tx=0x7ff4dc00b3b0 comp rx=0 tx=0).stop 2023-08-11T12:23:17.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.433+0000 7ff4e99a9700 1 -- 172.21.15.8:0/3574374483 shutdown_connections 2023-08-11T12:23:17.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.433+0000 7ff4e99a9700 1 --2- 172.21.15.8:0/3574374483 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4e40ff540 0x7ff4e40ff920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:17.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.433+0000 7ff4e99a9700 1 --2- 172.21.15.8:0/3574374483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4e410d0f0 0x7ff4e410f4e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:17.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.433+0000 7ff4e99a9700 1 --2- 172.21.15.8:0/3574374483 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4e40ffef0 0x7ff4e410cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:17.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.433+0000 7ff4e99a9700 1 -- 172.21.15.8:0/3574374483 >> 172.21.15.8:0/3574374483 conn(0x7ff4e40fb1c0 msgr2=0x7ff4e40fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:17.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.433+0000 7ff4e99a9700 1 -- 172.21.15.8:0/3574374483 shutdown_connections 2023-08-11T12:23:17.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.434+0000 7ff4e99a9700 1 -- 172.21.15.8:0/3574374483 wait complete. 2023-08-11T12:23:17.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.435+0000 7ff4e99a9700 1 Processor -- start 2023-08-11T12:23:17.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.435+0000 7ff4e99a9700 1 -- start start 2023-08-11T12:23:17.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.436+0000 7ff4e99a9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4e40ff540 0x7ff4e419ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:17.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.436+0000 7ff4e99a9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4e40ffef0 0x7ff4e419ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:17.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.436+0000 7ff4e99a9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4e410d0f0 0x7ff4e4198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:17.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.436+0000 7ff4e99a9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e41991d0 con 0x7ff4e40ff540 2023-08-11T12:23:17.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.436+0000 7ff4e99a9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e4199340 con 0x7ff4e410d0f0 2023-08-11T12:23:17.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.436+0000 7ff4e99a9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e4199500 con 0x7ff4e40ffef0 2023-08-11T12:23:17.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.436+0000 7ff4e89a7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4e40ff540 0x7ff4e419ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:17.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.436+0000 7ff4e89a7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4e40ff540 0x7ff4e419ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53344/0 (socket says 172.21.15.8:53344) 2023-08-11T12:23:17.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.437+0000 7ff4e89a7700 1 -- 172.21.15.8:0/2547256855 learned_addr learned my addr 172.21.15.8:0/2547256855 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:17.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.437+0000 7ff4e3fff700 1 --2- 172.21.15.8:0/2547256855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4e40ffef0 0x7ff4e419ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:17.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.437+0000 7ff4e91a8700 1 --2- 172.21.15.8:0/2547256855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4e410d0f0 0x7ff4e4198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:17.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.437+0000 7ff4e89a7700 1 -- 172.21.15.8:0/2547256855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4e40ffef0 msgr2=0x7ff4e419ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:17.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.437+0000 7ff4e89a7700 1 --2- 172.21.15.8:0/2547256855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4e40ffef0 0x7ff4e419ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:17.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.437+0000 7ff4e89a7700 1 -- 172.21.15.8:0/2547256855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4e410d0f0 msgr2=0x7ff4e4198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:17.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.437+0000 7ff4e89a7700 1 --2- 172.21.15.8:0/2547256855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4e410d0f0 0x7ff4e4198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:17.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.437+0000 7ff4e89a7700 1 -- 172.21.15.8:0/2547256855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d8009520 con 0x7ff4e40ff540 2023-08-11T12:23:17.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.437+0000 7ff4e3fff700 1 --2- 172.21.15.8:0/2547256855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4e40ffef0 0x7ff4e419ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:17.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.437+0000 7ff4e89a7700 1 --2- 172.21.15.8:0/2547256855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4e40ff540 0x7ff4e419ea30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff4d800eb30 tx=0x7ff4d800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:17.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.438+0000 7ff4e1ffb700 1 -- 172.21.15.8:0/2547256855 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d8009880 con 0x7ff4e40ff540 2023-08-11T12:23:17.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.438+0000 7ff4e99a9700 1 -- 172.21.15.8:0/2547256855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4dc009d00 con 0x7ff4e40ff540 2023-08-11T12:23:17.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.438+0000 7ff4e1ffb700 1 -- 172.21.15.8:0/2547256855 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff4d80044e0 con 0x7ff4e40ff540 2023-08-11T12:23:17.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.438+0000 7ff4e1ffb700 1 -- 172.21.15.8:0/2547256855 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d8003e90 con 0x7ff4e40ff540 2023-08-11T12:23:17.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.438+0000 7ff4e99a9700 1 -- 172.21.15.8:0/2547256855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e41a59b0 con 0x7ff4e40ff540 2023-08-11T12:23:17.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.439+0000 7ff4e99a9700 1 -- 172.21.15.8:0/2547256855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4e404ee70 con 0x7ff4e40ff540 2023-08-11T12:23:17.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.441+0000 7ff4e1ffb700 1 -- 172.21.15.8:0/2547256855 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7ff4d8004000 con 0x7ff4e40ff540 2023-08-11T12:23:17.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.443+0000 7ff4e1ffb700 1 --2- 172.21.15.8:0/2547256855 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff4d409ffd0 0x7ff4d40a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:17.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.443+0000 7ff4e1ffb700 1 -- 172.21.15.8:0/2547256855 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7ff4d8014070 con 0x7ff4e40ff540 2023-08-11T12:23:17.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.443+0000 7ff4e3fff700 1 --2- 172.21.15.8:0/2547256855 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff4d409ffd0 0x7ff4d40a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:17.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.444+0000 7ff4e3fff700 1 --2- 172.21.15.8:0/2547256855 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff4d409ffd0 0x7ff4d40a2490 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff4e419a250 tx=0x7ff4d0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:17.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.449+0000 7ff4e1ffb700 1 -- 172.21.15.8:0/2547256855 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7ff4d8095540 con 0x7ff4e40ff540 2023-08-11T12:23:17.586 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738441 got 34359738444 for osd.0 2023-08-11T12:23:17.586 DEBUG:teuthology.parallel:result is None 2023-08-11T12:23:17.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.623+0000 7f012d7fa700 1 -- 172.21.15.8:0/3033481645 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0124005160 con 0x7f01400688e0 2023-08-11T12:23:17.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.624+0000 7f012f7fe700 1 -- 172.21.15.8:0/3033481645 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0130099360 con 0x7f01400688e0 2023-08-11T12:23:17.627 INFO:teuthology.orchestra.run.smithi008.stdout:107374182463 2023-08-11T12:23:17.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.627+0000 7f012d7fa700 1 -- 172.21.15.8:0/3033481645 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f012809ff50 msgr2=0x7f01280a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:17.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.627+0000 7f012d7fa700 1 --2- 172.21.15.8:0/3033481645 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f012809ff50 0x7f01280a2410 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0140108f40 tx=0x7f0134009260 comp rx=0 tx=0).stop 2023-08-11T12:23:17.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.627+0000 7f012d7fa700 1 -- 172.21.15.8:0/3033481645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01400688e0 msgr2=0x7f0140107750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:17.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.627+0000 7f012d7fa700 1 --2- 172.21.15.8:0/3033481645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01400688e0 0x7f0140107750 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0130009fd0 tx=0x7f013000f690 comp rx=0 tx=0).stop 2023-08-11T12:23:17.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.627+0000 7f012d7fa700 1 -- 172.21.15.8:0/3033481645 shutdown_connections 2023-08-11T12:23:17.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.627+0000 7f012d7fa700 1 --2- 172.21.15.8:0/3033481645 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f012809ff50 0x7f01280a2410 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:17.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.627+0000 7f012d7fa700 1 --2- 172.21.15.8:0/3033481645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0140105d50 0x7f01401081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:17.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.627+0000 7f012d7fa700 1 --2- 172.21.15.8:0/3033481645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01400688e0 0x7f0140107750 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:17.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.627+0000 7f012d7fa700 1 --2- 172.21.15.8:0/3033481645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0140105390 0x7f0140107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:17.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.627+0000 7f012d7fa700 1 -- 172.21.15.8:0/3033481645 >> 172.21.15.8:0/3033481645 conn(0x7f0140076920 msgr2=0x7f01400fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:17.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.627+0000 7f012d7fa700 1 -- 172.21.15.8:0/3033481645 shutdown_connections 2023-08-11T12:23:17.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.627+0000 7f012d7fa700 1 -- 172.21.15.8:0/3033481645 wait complete. 2023-08-11T12:23:17.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.688+0000 7ff4e99a9700 1 -- 172.21.15.8:0/2547256855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff4e40008d0 con 0x7ff4e40ff540 2023-08-11T12:23:17.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.688+0000 7ff4e1ffb700 1 -- 172.21.15.8:0/2547256855 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff4d8098b60 con 0x7ff4e40ff540 2023-08-11T12:23:17.692 INFO:teuthology.orchestra.run.smithi008.stdout:197568495666 2023-08-11T12:23:17.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.691+0000 7ff4e99a9700 1 -- 172.21.15.8:0/2547256855 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff4d409ffd0 msgr2=0x7ff4d40a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:17.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.691+0000 7ff4e99a9700 1 --2- 172.21.15.8:0/2547256855 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff4d409ffd0 0x7ff4d40a2490 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff4e419a250 tx=0x7ff4d0009260 comp rx=0 tx=0).stop 2023-08-11T12:23:17.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.691+0000 7ff4e99a9700 1 -- 172.21.15.8:0/2547256855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4e40ff540 msgr2=0x7ff4e419ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:17.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.691+0000 7ff4e99a9700 1 --2- 172.21.15.8:0/2547256855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4e40ff540 0x7ff4e419ea30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff4d800eb30 tx=0x7ff4d800ee40 comp rx=0 tx=0).stop 2023-08-11T12:23:17.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.691+0000 7ff4e99a9700 1 -- 172.21.15.8:0/2547256855 shutdown_connections 2023-08-11T12:23:17.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.691+0000 7ff4e99a9700 1 --2- 172.21.15.8:0/2547256855 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff4d409ffd0 0x7ff4d40a2490 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:17.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.691+0000 7ff4e99a9700 1 --2- 172.21.15.8:0/2547256855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4e410d0f0 0x7ff4e4198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:17.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.691+0000 7ff4e99a9700 1 --2- 172.21.15.8:0/2547256855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4e40ff540 0x7ff4e419ea30 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:17.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.691+0000 7ff4e99a9700 1 --2- 172.21.15.8:0/2547256855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4e40ffef0 0x7ff4e419ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:17.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.691+0000 7ff4e99a9700 1 -- 172.21.15.8:0/2547256855 >> 172.21.15.8:0/2547256855 conn(0x7ff4e40fb1c0 msgr2=0x7ff4e410e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:17.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.691+0000 7ff4e99a9700 1 -- 172.21.15.8:0/2547256855 shutdown_connections 2023-08-11T12:23:17.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:17.691+0000 7ff4e99a9700 1 -- 172.21.15.8:0/2547256855 wait complete. 2023-08-11T12:23:17.911 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:17 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3033481645' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-08-11T12:23:18.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:17 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3033481645' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-08-11T12:23:18.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:17 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3033481645' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-08-11T12:23:18.675 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574916 got 55834574919 for osd.1 2023-08-11T12:23:18.676 DEBUG:teuthology.parallel:result is None 2023-08-11T12:23:18.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:18 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2547256855' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-08-11T12:23:18.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:18 smithi008 ceph-mon[97158]: pgmap v313: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-08-11T12:23:19.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:18 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2547256855' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-08-11T12:23:19.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:18 smithi194 ceph-mon[130905]: pgmap v313: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-08-11T12:23:19.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:18 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2547256855' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-08-11T12:23:19.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:18 smithi045 ceph-mon[130284]: pgmap v313: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-08-11T12:23:19.422 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920823 got 141733920826 for osd.4 2023-08-11T12:23:19.423 DEBUG:teuthology.parallel:result is None 2023-08-11T12:23:19.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.703+0000 7f8361a66700 1 -- 172.21.15.8:0/1339556444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f835c105390 msgr2=0x7f835c105810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:19.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.703+0000 7f8361a66700 1 --2- 172.21.15.8:0/1339556444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f835c105390 0x7f835c105810 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f835000fb20 tx=0x7f835000fe30 comp rx=0 tx=0).stop 2023-08-11T12:23:19.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.703+0000 7f8361a66700 1 -- 172.21.15.8:0/1339556444 shutdown_connections 2023-08-11T12:23:19.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.703+0000 7f8361a66700 1 --2- 172.21.15.8:0/1339556444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f835c105d50 0x7f835c10d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:19.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.703+0000 7f8361a66700 1 --2- 172.21.15.8:0/1339556444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f835c0688e0 0x7f835c068cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:19.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.703+0000 7f8361a66700 1 --2- 172.21.15.8:0/1339556444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f835c105390 0x7f835c105810 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:19.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.703+0000 7f8361a66700 1 -- 172.21.15.8:0/1339556444 >> 172.21.15.8:0/1339556444 conn(0x7f835c076920 msgr2=0x7f835c076d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:19.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.703+0000 7f8361a66700 1 -- 172.21.15.8:0/1339556444 shutdown_connections 2023-08-11T12:23:19.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.703+0000 7f8361a66700 1 -- 172.21.15.8:0/1339556444 wait complete. 2023-08-11T12:23:19.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.705+0000 7f8361a66700 1 Processor -- start 2023-08-11T12:23:19.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.705+0000 7f8361a66700 1 -- start start 2023-08-11T12:23:19.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.706+0000 7f8361a66700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f835c0688e0 0x7f835c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:19.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.706+0000 7f8361a66700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f835c105390 0x7f835c19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:19.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.706+0000 7f8361a66700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f835c105d50 0x7f835c194690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:19.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.706+0000 7f8361a66700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835c194d00 con 0x7f835c0688e0 2023-08-11T12:23:19.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.706+0000 7f8361a66700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835c194e70 con 0x7f835c105d50 2023-08-11T12:23:19.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.706+0000 7f8361a66700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835c195030 con 0x7f835c105390 2023-08-11T12:23:19.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.706+0000 7f835b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f835c0688e0 0x7f835c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:19.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.706+0000 7f835b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f835c0688e0 0x7f835c19a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39148/0 (socket says 172.21.15.8:39148) 2023-08-11T12:23:19.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.706+0000 7f835b7fe700 1 -- 172.21.15.8:0/2052655804 learned_addr learned my addr 172.21.15.8:0/2052655804 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:19.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.706+0000 7f835bfff700 1 --2- 172.21.15.8:0/2052655804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f835c105d50 0x7f835c194690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:19.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.707+0000 7f835affd700 1 --2- 172.21.15.8:0/2052655804 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f835c105390 0x7f835c19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:19.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.707+0000 7f835b7fe700 1 -- 172.21.15.8:0/2052655804 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f835c105390 msgr2=0x7f835c19ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:19.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.707+0000 7f835b7fe700 1 --2- 172.21.15.8:0/2052655804 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f835c105390 0x7f835c19ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:19.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.707+0000 7f835b7fe700 1 -- 172.21.15.8:0/2052655804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f835c105d50 msgr2=0x7f835c194690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:19.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.707+0000 7f835b7fe700 1 --2- 172.21.15.8:0/2052655804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f835c105d50 0x7f835c194690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:19.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.707+0000 7f835b7fe700 1 -- 172.21.15.8:0/2052655804 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835000f750 con 0x7f835c0688e0 2023-08-11T12:23:19.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.707+0000 7f835b7fe700 1 --2- 172.21.15.8:0/2052655804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f835c0688e0 0x7f835c19a610 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f834c00e9a0 tx=0x7f834c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:19.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.708+0000 7f8358ff9700 1 -- 172.21.15.8:0/2052655804 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c009790 con 0x7f835c0688e0 2023-08-11T12:23:19.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.708+0000 7f8361a66700 1 -- 172.21.15.8:0/2052655804 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f835c195310 con 0x7f835c0688e0 2023-08-11T12:23:19.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.708+0000 7f8361a66700 1 -- 172.21.15.8:0/2052655804 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f835c1a1600 con 0x7f835c0688e0 2023-08-11T12:23:19.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.708+0000 7f8358ff9700 1 -- 172.21.15.8:0/2052655804 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f834c00cbd0 con 0x7f835c0688e0 2023-08-11T12:23:19.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.708+0000 7f8358ff9700 1 -- 172.21.15.8:0/2052655804 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c018680 con 0x7f835c0688e0 2023-08-11T12:23:19.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.709+0000 7f8361a66700 1 -- 172.21.15.8:0/2052655804 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8348005320 con 0x7f835c0688e0 2023-08-11T12:23:19.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.711+0000 7f8358ff9700 1 -- 172.21.15.8:0/2052655804 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f834c00cd40 con 0x7f835c0688e0 2023-08-11T12:23:19.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.714+0000 7f8358ff9700 1 --2- 172.21.15.8:0/2052655804 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f834409ff50 0x7f83440a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:19.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.714+0000 7f8358ff9700 1 -- 172.21.15.8:0/2052655804 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f834c014070 con 0x7f835c0688e0 2023-08-11T12:23:19.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.714+0000 7f835affd700 1 --2- 172.21.15.8:0/2052655804 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f834409ff50 0x7f83440a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:19.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.717+0000 7f835affd700 1 --2- 172.21.15.8:0/2052655804 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f834409ff50 0x7f83440a2410 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f835c076e00 tx=0x7f8350011040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:19.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.718+0000 7f8358ff9700 1 -- 172.21.15.8:0/2052655804 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f834c051c30 con 0x7f835c0688e0 2023-08-11T12:23:19.722 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103206 got 249108103208 for osd.8 2023-08-11T12:23:19.722 DEBUG:teuthology.parallel:result is None 2023-08-11T12:23:19.927 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182460 got 107374182463 for osd.3 2023-08-11T12:23:19.927 DEBUG:teuthology.parallel:result is None 2023-08-11T12:23:19.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.956+0000 7f8361a66700 1 -- 172.21.15.8:0/2052655804 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f8348005190 con 0x7f835c0688e0 2023-08-11T12:23:19.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.957+0000 7f8358ff9700 1 -- 172.21.15.8:0/2052655804 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f834c098c30 con 0x7f835c0688e0 2023-08-11T12:23:19.960 INFO:teuthology.orchestra.run.smithi008.stdout:219043332140 2023-08-11T12:23:19.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.959+0000 7f8361a66700 1 -- 172.21.15.8:0/2052655804 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f834409ff50 msgr2=0x7f83440a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:19.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.959+0000 7f8361a66700 1 --2- 172.21.15.8:0/2052655804 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f834409ff50 0x7f83440a2410 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f835c076e00 tx=0x7f8350011040 comp rx=0 tx=0).stop 2023-08-11T12:23:19.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.959+0000 7f8361a66700 1 -- 172.21.15.8:0/2052655804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f835c0688e0 msgr2=0x7f835c19a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:19.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.959+0000 7f8361a66700 1 --2- 172.21.15.8:0/2052655804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f835c0688e0 0x7f835c19a610 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f834c00e9a0 tx=0x7f834c00ecb0 comp rx=0 tx=0).stop 2023-08-11T12:23:19.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.960+0000 7f8361a66700 1 -- 172.21.15.8:0/2052655804 shutdown_connections 2023-08-11T12:23:19.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.960+0000 7f8361a66700 1 --2- 172.21.15.8:0/2052655804 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f834409ff50 0x7f83440a2410 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:19.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.960+0000 7f8361a66700 1 --2- 172.21.15.8:0/2052655804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f835c105d50 0x7f835c194690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:19.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.960+0000 7f8361a66700 1 --2- 172.21.15.8:0/2052655804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f835c0688e0 0x7f835c19a610 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:19.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.960+0000 7f8361a66700 1 --2- 172.21.15.8:0/2052655804 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f835c105390 0x7f835c19ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:19.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.960+0000 7f8361a66700 1 -- 172.21.15.8:0/2052655804 >> 172.21.15.8:0/2052655804 conn(0x7f835c076920 msgr2=0x7f835c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:19.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.961+0000 7f8361a66700 1 -- 172.21.15.8:0/2052655804 shutdown_connections 2023-08-11T12:23:19.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:19.962+0000 7f8361a66700 1 -- 172.21.15.8:0/2052655804 wait complete. 2023-08-11T12:23:20.182 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495663 got 197568495666 for osd.6 2023-08-11T12:23:20.182 DEBUG:teuthology.parallel:result is None 2023-08-11T12:23:20.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.820+0000 7fc5bba85700 1 -- 172.21.15.8:0/3651216841 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5b4072cf0 msgr2=0x7fc5b40730d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:20.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.820+0000 7fc5bba85700 1 --2- 172.21.15.8:0/3651216841 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5b4072cf0 0x7fc5b40730d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0009990 tx=0x7fc5b0009ca0 comp rx=0 tx=0).stop 2023-08-11T12:23:20.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.821+0000 7fc5bba85700 1 -- 172.21.15.8:0/3651216841 shutdown_connections 2023-08-11T12:23:20.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.821+0000 7fc5bba85700 1 --2- 172.21.15.8:0/3651216841 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5b410d1e0 0x7fc5b410f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:20.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.821+0000 7fc5bba85700 1 --2- 172.21.15.8:0/3651216841 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5b4072cf0 0x7fc5b40730d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:20.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.821+0000 7fc5bba85700 1 --2- 172.21.15.8:0/3651216841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5b4073610 0x7fc5b410cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:20.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.821+0000 7fc5bba85700 1 -- 172.21.15.8:0/3651216841 >> 172.21.15.8:0/3651216841 conn(0x7fc5b40fc410 msgr2=0x7fc5b40fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:20.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.821+0000 7fc5bba85700 1 -- 172.21.15.8:0/3651216841 shutdown_connections 2023-08-11T12:23:20.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.821+0000 7fc5bba85700 1 -- 172.21.15.8:0/3651216841 wait complete. 2023-08-11T12:23:20.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.824+0000 7fc5bba85700 1 Processor -- start 2023-08-11T12:23:20.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.824+0000 7fc5bba85700 1 -- start start 2023-08-11T12:23:20.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.825+0000 7fc5bba85700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5b4072cf0 0x7fc5b419eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:20.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.825+0000 7fc5bba85700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5b4073610 0x7fc5b419eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:20.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.825+0000 7fc5bba85700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5b410d1e0 0x7fc5b4198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:20.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.825+0000 7fc5bba85700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b41991a0 con 0x7fc5b4073610 2023-08-11T12:23:20.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.825+0000 7fc5bba85700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b4199310 con 0x7fc5b410d1e0 2023-08-11T12:23:20.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.825+0000 7fc5bba85700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b41994d0 con 0x7fc5b4072cf0 2023-08-11T12:23:20.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.826+0000 7fc5b9821700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5b4072cf0 0x7fc5b419eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:20.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.826+0000 7fc5b9020700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5b4073610 0x7fc5b419eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:20.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.826+0000 7fc5b9821700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5b4072cf0 0x7fc5b419eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:40194/0 (socket says 172.21.15.8:40194) 2023-08-11T12:23:20.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.826+0000 7fc5b9821700 1 -- 172.21.15.8:0/103254708 learned_addr learned my addr 172.21.15.8:0/103254708 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:20.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.826+0000 7fc5ba022700 1 --2- 172.21.15.8:0/103254708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5b410d1e0 0x7fc5b4198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:20.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.826+0000 7fc5b9020700 1 -- 172.21.15.8:0/103254708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5b4072cf0 msgr2=0x7fc5b419eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:20.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.826+0000 7fc5b9020700 1 --2- 172.21.15.8:0/103254708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5b4072cf0 0x7fc5b419eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:20.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.826+0000 7fc5b9020700 1 -- 172.21.15.8:0/103254708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5b410d1e0 msgr2=0x7fc5b4198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:20.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.826+0000 7fc5b9020700 1 --2- 172.21.15.8:0/103254708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5b410d1e0 0x7fc5b4198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:20.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.826+0000 7fc5b9020700 1 -- 172.21.15.8:0/103254708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ac009c40 con 0x7fc5b4073610 2023-08-11T12:23:20.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.827+0000 7fc5b9020700 1 --2- 172.21.15.8:0/103254708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5b4073610 0x7fc5b419eff0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400e9f0 tx=0x7fc5a400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:20.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.827+0000 7fc5aaffd700 1 -- 172.21.15.8:0/103254708 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a400c9c0 con 0x7fc5b4073610 2023-08-11T12:23:20.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.827+0000 7fc5bba85700 1 -- 172.21.15.8:0/103254708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b00095f0 con 0x7fc5b4073610 2023-08-11T12:23:20.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.827+0000 7fc5aaffd700 1 -- 172.21.15.8:0/103254708 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc5a4010430 con 0x7fc5b4073610 2023-08-11T12:23:20.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.827+0000 7fc5aaffd700 1 -- 172.21.15.8:0/103254708 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4018680 con 0x7fc5b4073610 2023-08-11T12:23:20.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.827+0000 7fc5bba85700 1 -- 172.21.15.8:0/103254708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b41999a0 con 0x7fc5b4073610 2023-08-11T12:23:20.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.829+0000 7fc5bba85700 1 -- 172.21.15.8:0/103254708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b404e620 con 0x7fc5b4073610 2023-08-11T12:23:20.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.832+0000 7fc5aaffd700 1 -- 172.21.15.8:0/103254708 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fc5a400cd30 con 0x7fc5b4073610 2023-08-11T12:23:20.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.833+0000 7fc5aaffd700 1 --2- 172.21.15.8:0/103254708 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc5a009ffd0 0x7fc5a00a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:20.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.833+0000 7fc5aaffd700 1 -- 172.21.15.8:0/103254708 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc5a4014070 con 0x7fc5b4073610 2023-08-11T12:23:20.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.834+0000 7fc5b9821700 1 --2- 172.21.15.8:0/103254708 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc5a009ffd0 0x7fc5a00a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:20.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.835+0000 7fc5b9821700 1 --2- 172.21.15.8:0/103254708 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc5a009ffd0 0x7fc5a00a2490 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0006010 tx=0x7fc5b000b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:20.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:20.839+0000 7fc5aaffd700 1 -- 172.21.15.8:0/103254708 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fc5a40952d0 con 0x7fc5b4073610 2023-08-11T12:23:20.863 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332137 got 219043332140 for osd.7 2023-08-11T12:23:20.864 DEBUG:teuthology.parallel:result is None 2023-08-11T12:23:20.931 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:20 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2052655804' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-08-11T12:23:20.931 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:20 smithi008 ceph-mon[97158]: pgmap v314: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-11T12:23:21.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.003+0000 7fdfe8d68700 1 -- 172.21.15.8:0/1714539464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfe4100c60 msgr2=0x7fdfe410ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:21.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.003+0000 7fdfe8d68700 1 --2- 172.21.15.8:0/1714539464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfe4100c60 0x7fdfe410ce70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8009990 tx=0x7fdfd8009ca0 comp rx=0 tx=0).stop 2023-08-11T12:23:21.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.004+0000 7fdfe8d68700 1 -- 172.21.15.8:0/1714539464 shutdown_connections 2023-08-11T12:23:21.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.004+0000 7fdfe8d68700 1 --2- 172.21.15.8:0/1714539464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfe410d3b0 0x7fdfe410f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:21.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.004+0000 7fdfe8d68700 1 --2- 172.21.15.8:0/1714539464 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdfe4100340 0x7fdfe4100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:21.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.004+0000 7fdfe8d68700 1 --2- 172.21.15.8:0/1714539464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfe4100c60 0x7fdfe410ce70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:21.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.004+0000 7fdfe8d68700 1 -- 172.21.15.8:0/1714539464 >> 172.21.15.8:0/1714539464 conn(0x7fdfe4076920 msgr2=0x7fdfe4076d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:21.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.004+0000 7fdfe8d68700 1 -- 172.21.15.8:0/1714539464 shutdown_connections 2023-08-11T12:23:21.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.004+0000 7fdfe8d68700 1 -- 172.21.15.8:0/1714539464 wait complete. 2023-08-11T12:23:21.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.005+0000 7fdfe8d68700 1 Processor -- start 2023-08-11T12:23:21.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.006+0000 7fdfe8d68700 1 -- start start 2023-08-11T12:23:21.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.006+0000 7fdfe8d68700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfe4100340 0x7fdfe4198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:21.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.006+0000 7fdfe8d68700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdfe4100c60 0x7fdfe41992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:21.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.006+0000 7fdfe8d68700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfe410d3b0 0x7fdfe419d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:21.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.006+0000 7fdfe8d68700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe419dd70 con 0x7fdfe4100c60 2023-08-11T12:23:21.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.006+0000 7fdfe8d68700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe419dee0 con 0x7fdfe4100340 2023-08-11T12:23:21.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.007+0000 7fdfe8d68700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe419e0a0 con 0x7fdfe410d3b0 2023-08-11T12:23:21.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.007+0000 7fdfe1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdfe4100c60 0x7fdfe41992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:21.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.007+0000 7fdfe1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdfe4100c60 0x7fdfe41992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39188/0 (socket says 172.21.15.8:39188) 2023-08-11T12:23:21.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.007+0000 7fdfe1d9b700 1 -- 172.21.15.8:0/1737275083 learned_addr learned my addr 172.21.15.8:0/1737275083 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:21.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.007+0000 7fdfe2d9d700 1 --2- 172.21.15.8:0/1737275083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfe410d3b0 0x7fdfe419d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:21.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.007+0000 7fdfe259c700 1 --2- 172.21.15.8:0/1737275083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfe4100340 0x7fdfe4198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:21.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.008+0000 7fdfe1d9b700 1 -- 172.21.15.8:0/1737275083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfe410d3b0 msgr2=0x7fdfe419d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:21.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.008+0000 7fdfe1d9b700 1 --2- 172.21.15.8:0/1737275083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfe410d3b0 0x7fdfe419d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:21.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.008+0000 7fdfe1d9b700 1 -- 172.21.15.8:0/1737275083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfe4100340 msgr2=0x7fdfe4198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:21.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.008+0000 7fdfe1d9b700 1 --2- 172.21.15.8:0/1737275083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfe4100340 0x7fdfe4198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:21.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.008+0000 7fdfe1d9b700 1 -- 172.21.15.8:0/1737275083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd80095f0 con 0x7fdfe4100c60 2023-08-11T12:23:21.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.008+0000 7fdfe259c700 1 --2- 172.21.15.8:0/1737275083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfe4100340 0x7fdfe4198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:21.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.008+0000 7fdfe1d9b700 1 --2- 172.21.15.8:0/1737275083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdfe4100c60 0x7fdfe41992f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdfd800b650 tx=0x7fdfd8005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:21.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.009+0000 7fdfd37fe700 1 -- 172.21.15.8:0/1737275083 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd801d070 con 0x7fdfe4100c60 2023-08-11T12:23:21.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.009+0000 7fdfd37fe700 1 -- 172.21.15.8:0/1737275083 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdfd8021410 con 0x7fdfe4100c60 2023-08-11T12:23:21.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.009+0000 7fdfd37fe700 1 -- 172.21.15.8:0/1737275083 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd8017650 con 0x7fdfe4100c60 2023-08-11T12:23:21.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.010+0000 7fdfe8d68700 1 -- 172.21.15.8:0/1737275083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfe419e320 con 0x7fdfe4100c60 2023-08-11T12:23:21.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.010+0000 7fdfe8d68700 1 -- 172.21.15.8:0/1737275083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfe41a5a10 con 0x7fdfe4100c60 2023-08-11T12:23:21.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.011+0000 7fdfe8d68700 1 -- 172.21.15.8:0/1737275083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfe404e620 con 0x7fdfe4100c60 2023-08-11T12:23:21.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.013+0000 7fdfd37fe700 1 -- 172.21.15.8:0/1737275083 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fdfd8021580 con 0x7fdfe4100c60 2023-08-11T12:23:21.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.015+0000 7fdfd37fe700 1 --2- 172.21.15.8:0/1737275083 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fdfcc0a00a0 0x7fdfcc0a2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:21.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.016+0000 7fdfd37fe700 1 -- 172.21.15.8:0/1737275083 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fdfd80cccd0 con 0x7fdfe4100c60 2023-08-11T12:23:21.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.016+0000 7fdfe259c700 1 --2- 172.21.15.8:0/1737275083 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fdfcc0a00a0 0x7fdfcc0a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:21.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.017+0000 7fdfe259c700 1 --2- 172.21.15.8:0/1737275083 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fdfcc0a00a0 0x7fdfcc0a2560 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009de0 tx=0x7fdfd4009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:21.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.017+0000 7fdfd37fe700 1 -- 172.21.15.8:0/1737275083 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fdfd8096810 con 0x7fdfe4100c60 2023-08-11T12:23:21.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.096+0000 7fc5bba85700 1 -- 172.21.15.8:0/103254708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7fc5b4199fd0 con 0x7fc5b4073610 2023-08-11T12:23:21.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.096+0000 7fc5aaffd700 1 -- 172.21.15.8:0/103254708 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7fc5a4026020 con 0x7fc5b4073610 2023-08-11T12:23:21.100 INFO:teuthology.orchestra.run.smithi008.stdout:304942678047 2023-08-11T12:23:21.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.099+0000 7fc5bba85700 1 -- 172.21.15.8:0/103254708 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc5a009ffd0 msgr2=0x7fc5a00a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:21.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.099+0000 7fc5bba85700 1 --2- 172.21.15.8:0/103254708 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc5a009ffd0 0x7fc5a00a2490 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0006010 tx=0x7fc5b000b260 comp rx=0 tx=0).stop 2023-08-11T12:23:21.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.099+0000 7fc5bba85700 1 -- 172.21.15.8:0/103254708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5b4073610 msgr2=0x7fc5b419eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:21.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.099+0000 7fc5bba85700 1 --2- 172.21.15.8:0/103254708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5b4073610 0x7fc5b419eff0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400e9f0 tx=0x7fc5a400ed00 comp rx=0 tx=0).stop 2023-08-11T12:23:21.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.100+0000 7fc5bba85700 1 -- 172.21.15.8:0/103254708 shutdown_connections 2023-08-11T12:23:21.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.100+0000 7fc5bba85700 1 --2- 172.21.15.8:0/103254708 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc5a009ffd0 0x7fc5a00a2490 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:21.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.100+0000 7fc5bba85700 1 --2- 172.21.15.8:0/103254708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5b4072cf0 0x7fc5b419eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:21.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.100+0000 7fc5bba85700 1 --2- 172.21.15.8:0/103254708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5b410d1e0 0x7fc5b4198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:21.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.100+0000 7fc5bba85700 1 --2- 172.21.15.8:0/103254708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5b4073610 0x7fc5b419eff0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:21.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.100+0000 7fc5bba85700 1 -- 172.21.15.8:0/103254708 >> 172.21.15.8:0/103254708 conn(0x7fc5b40fc410 msgr2=0x7fc5b410f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:21.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.100+0000 7fc5bba85700 1 -- 172.21.15.8:0/103254708 shutdown_connections 2023-08-11T12:23:21.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.100+0000 7fc5bba85700 1 -- 172.21.15.8:0/103254708 wait complete. 2023-08-11T12:23:21.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:20 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2052655804' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-08-11T12:23:21.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:20 smithi194 ceph-mon[130905]: pgmap v314: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-11T12:23:21.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:20 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2052655804' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-08-11T12:23:21.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:20 smithi045 ceph-mon[130284]: pgmap v314: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-11T12:23:21.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.296+0000 7f7deb3cb700 1 -- 172.21.15.8:0/164737845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7de410ad60 msgr2=0x7f7de410d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:21.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.296+0000 7f7deb3cb700 1 --2- 172.21.15.8:0/164737845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7de410ad60 0x7f7de410d220 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc009f90 tx=0x7f7ddc00b330 comp rx=0 tx=0).stop 2023-08-11T12:23:21.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.296+0000 7f7deb3cb700 1 -- 172.21.15.8:0/164737845 shutdown_connections 2023-08-11T12:23:21.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.296+0000 7f7deb3cb700 1 --2- 172.21.15.8:0/164737845 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7de4101930 0x7f7de4101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:21.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.296+0000 7f7deb3cb700 1 --2- 172.21.15.8:0/164737845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7de410ad60 0x7f7de410d220 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:21.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.296+0000 7f7deb3cb700 1 --2- 172.21.15.8:0/164737845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7de4102250 0x7f7de410a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:21.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.296+0000 7f7deb3cb700 1 -- 172.21.15.8:0/164737845 >> 172.21.15.8:0/164737845 conn(0x7f7de40fb1c0 msgr2=0x7f7de40fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:21.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.296+0000 7f7deb3cb700 1 -- 172.21.15.8:0/164737845 shutdown_connections 2023-08-11T12:23:21.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.296+0000 7f7deb3cb700 1 -- 172.21.15.8:0/164737845 wait complete. 2023-08-11T12:23:21.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.298+0000 7f7deb3cb700 1 Processor -- start 2023-08-11T12:23:21.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.298+0000 7f7deb3cb700 1 -- start start 2023-08-11T12:23:21.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.298+0000 7f7deb3cb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7de4101930 0x7f7de419e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:21.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.298+0000 7f7deb3cb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7de4102250 0x7f7de419ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:21.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.298+0000 7f7deb3cb700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7de410ad60 0x7f7de4198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:21.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.298+0000 7f7deb3cb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de41990b0 con 0x7f7de4102250 2023-08-11T12:23:21.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.298+0000 7f7deb3cb700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de4199220 con 0x7f7de4101930 2023-08-11T12:23:21.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.298+0000 7f7deb3cb700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de41993e0 con 0x7f7de410ad60 2023-08-11T12:23:21.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.299+0000 7f7dea3c9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7de4101930 0x7f7de419e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:21.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.299+0000 7f7de9bc8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7de4102250 0x7f7de419ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:21.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.299+0000 7f7dea3c9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7de4101930 0x7f7de419e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:53504/0 (socket says 172.21.15.8:53504) 2023-08-11T12:23:21.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.299+0000 7f7dea3c9700 1 -- 172.21.15.8:0/3540110791 learned_addr learned my addr 172.21.15.8:0/3540110791 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:21.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.299+0000 7f7deabca700 1 --2- 172.21.15.8:0/3540110791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7de410ad60 0x7f7de4198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:21.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.299+0000 7f7de9bc8700 1 -- 172.21.15.8:0/3540110791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7de410ad60 msgr2=0x7f7de4198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:21.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.299+0000 7f7de9bc8700 1 --2- 172.21.15.8:0/3540110791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7de410ad60 0x7f7de4198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:21.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.299+0000 7f7de9bc8700 1 -- 172.21.15.8:0/3540110791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7de4101930 msgr2=0x7f7de419e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:21.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.299+0000 7f7de9bc8700 1 --2- 172.21.15.8:0/3540110791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7de4101930 0x7f7de419e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:21.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.299+0000 7f7de9bc8700 1 -- 172.21.15.8:0/3540110791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ddc009c40 con 0x7f7de4102250 2023-08-11T12:23:21.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.300+0000 7f7de9bc8700 1 --2- 172.21.15.8:0/3540110791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7de4102250 0x7f7de419ef00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400e9c0 tx=0x7f7dd400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:21.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.300+0000 7f7ddb7fe700 1 -- 172.21.15.8:0/3540110791 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd400c9c0 con 0x7f7de4102250 2023-08-11T12:23:21.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.300+0000 7f7ddb7fe700 1 -- 172.21.15.8:0/3540110791 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7dd4010430 con 0x7f7de4102250 2023-08-11T12:23:21.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.300+0000 7f7ddb7fe700 1 -- 172.21.15.8:0/3540110791 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4018680 con 0x7f7de4102250 2023-08-11T12:23:21.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.300+0000 7f7deb3cb700 1 -- 172.21.15.8:0/3540110791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de41996c0 con 0x7f7de4102250 2023-08-11T12:23:21.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.300+0000 7f7deb3cb700 1 -- 172.21.15.8:0/3540110791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de41a59b0 con 0x7f7de4102250 2023-08-11T12:23:21.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.302+0000 7f7deb3cb700 1 -- 172.21.15.8:0/3540110791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de4108290 con 0x7f7de4102250 2023-08-11T12:23:21.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.303+0000 7f7ddb7fe700 1 -- 172.21.15.8:0/3540110791 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f7dd4010860 con 0x7f7de4102250 2023-08-11T12:23:21.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.306+0000 7f7ddb7fe700 1 --2- 172.21.15.8:0/3540110791 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f7dd009ff50 0x7f7dd00a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:21.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.306+0000 7f7ddb7fe700 1 -- 172.21.15.8:0/3540110791 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f7dd4014070 con 0x7f7de4102250 2023-08-11T12:23:21.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.306+0000 7f7dea3c9700 1 --2- 172.21.15.8:0/3540110791 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f7dd009ff50 0x7f7dd00a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:21.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.307+0000 7f7dea3c9700 1 --2- 172.21.15.8:0/3540110791 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f7dd009ff50 0x7f7dd00a2410 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7de0005950 tx=0x7f7de0009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:21.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.309+0000 7f7ddb7fe700 1 -- 172.21.15.8:0/3540110791 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f7dd4051c30 con 0x7f7de4102250 2023-08-11T12:23:21.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.348+0000 7fdfe8d68700 1 -- 172.21.15.8:0/1737275083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7fdfe4112c70 con 0x7fdfe4100c60 2023-08-11T12:23:21.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.349+0000 7fdfd37fe700 1 -- 172.21.15.8:0/1737275083 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdfd8099e30 con 0x7fdfe4100c60 2023-08-11T12:23:21.354 INFO:teuthology.orchestra.run.smithi008.stdout:283467841571 2023-08-11T12:23:21.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.351+0000 7fdfe8d68700 1 -- 172.21.15.8:0/1737275083 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fdfcc0a00a0 msgr2=0x7fdfcc0a2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:21.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.351+0000 7fdfe8d68700 1 --2- 172.21.15.8:0/1737275083 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fdfcc0a00a0 0x7fdfcc0a2560 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009de0 tx=0x7fdfd4009190 comp rx=0 tx=0).stop 2023-08-11T12:23:21.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.351+0000 7fdfe8d68700 1 -- 172.21.15.8:0/1737275083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdfe4100c60 msgr2=0x7fdfe41992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:21.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.351+0000 7fdfe8d68700 1 --2- 172.21.15.8:0/1737275083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdfe4100c60 0x7fdfe41992f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdfd800b650 tx=0x7fdfd8005740 comp rx=0 tx=0).stop 2023-08-11T12:23:21.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.351+0000 7fdfe8d68700 1 -- 172.21.15.8:0/1737275083 shutdown_connections 2023-08-11T12:23:21.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.351+0000 7fdfe8d68700 1 --2- 172.21.15.8:0/1737275083 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fdfcc0a00a0 0x7fdfcc0a2560 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:21.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.351+0000 7fdfe8d68700 1 --2- 172.21.15.8:0/1737275083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfe410d3b0 0x7fdfe419d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:21.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.351+0000 7fdfe8d68700 1 --2- 172.21.15.8:0/1737275083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfe4100340 0x7fdfe4198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:21.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.351+0000 7fdfe8d68700 1 --2- 172.21.15.8:0/1737275083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdfe4100c60 0x7fdfe41992f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:21.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.351+0000 7fdfe8d68700 1 -- 172.21.15.8:0/1737275083 >> 172.21.15.8:0/1737275083 conn(0x7fdfe4076920 msgr2=0x7fdfe410e860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:21.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.352+0000 7fdfe8d68700 1 -- 172.21.15.8:0/1737275083 shutdown_connections 2023-08-11T12:23:21.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.352+0000 7fdfe8d68700 1 -- 172.21.15.8:0/1737275083 wait complete. 2023-08-11T12:23:21.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.540+0000 7f7deb3cb700 1 -- 172.21.15.8:0/3540110791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f7de404ee70 con 0x7f7de4102250 2023-08-11T12:23:21.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.540+0000 7f7ddb7fe700 1 -- 172.21.15.8:0/3540110791 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f7dd4094fa0 con 0x7f7de4102250 2023-08-11T12:23:21.544 INFO:teuthology.orchestra.run.smithi008.stdout:335007449116 2023-08-11T12:23:21.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.543+0000 7f7deb3cb700 1 -- 172.21.15.8:0/3540110791 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f7dd009ff50 msgr2=0x7f7dd00a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:21.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.543+0000 7f7deb3cb700 1 --2- 172.21.15.8:0/3540110791 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f7dd009ff50 0x7f7dd00a2410 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7de0005950 tx=0x7f7de0009310 comp rx=0 tx=0).stop 2023-08-11T12:23:21.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.543+0000 7f7deb3cb700 1 -- 172.21.15.8:0/3540110791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7de4102250 msgr2=0x7f7de419ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:21.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.543+0000 7f7deb3cb700 1 --2- 172.21.15.8:0/3540110791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7de4102250 0x7f7de419ef00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400e9c0 tx=0x7f7dd400ecd0 comp rx=0 tx=0).stop 2023-08-11T12:23:21.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.543+0000 7f7deb3cb700 1 -- 172.21.15.8:0/3540110791 shutdown_connections 2023-08-11T12:23:21.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.543+0000 7f7deb3cb700 1 --2- 172.21.15.8:0/3540110791 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f7dd009ff50 0x7f7dd00a2410 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:21.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.543+0000 7f7deb3cb700 1 --2- 172.21.15.8:0/3540110791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7de410ad60 0x7f7de4198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:21.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.543+0000 7f7deb3cb700 1 --2- 172.21.15.8:0/3540110791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7de4101930 0x7f7de419e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:21.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.543+0000 7f7deb3cb700 1 --2- 172.21.15.8:0/3540110791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7de4102250 0x7f7de419ef00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:21.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.543+0000 7f7deb3cb700 1 -- 172.21.15.8:0/3540110791 >> 172.21.15.8:0/3540110791 conn(0x7f7de40fb1c0 msgr2=0x7f7de410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:21.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.543+0000 7f7deb3cb700 1 -- 172.21.15.8:0/3540110791 shutdown_connections 2023-08-11T12:23:21.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:21.543+0000 7f7deb3cb700 1 -- 172.21.15.8:0/3540110791 wait complete. 2023-08-11T12:23:21.731 INFO:tasks.cephadm.ceph_manager.ceph:need seq 304942678043 got 304942678047 for osd.10 2023-08-11T12:23:21.731 DEBUG:teuthology.parallel:result is None 2023-08-11T12:23:22.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:21 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/103254708' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-08-11T12:23:22.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:21 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1737275083' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-08-11T12:23:22.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:21 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3540110791' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-08-11T12:23:22.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:21 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/103254708' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-08-11T12:23:22.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:21 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1737275083' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-08-11T12:23:22.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:21 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3540110791' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-08-11T12:23:22.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:21 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/103254708' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-08-11T12:23:22.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:21 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1737275083' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-08-11T12:23:22.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:21 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3540110791' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-08-11T12:23:22.205 INFO:tasks.cephadm.ceph_manager.ceph:need seq 335007449113 got 335007449116 for osd.11 2023-08-11T12:23:22.205 DEBUG:teuthology.parallel:result is None 2023-08-11T12:23:22.416 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841568 got 283467841571 for osd.9 2023-08-11T12:23:22.416 DEBUG:teuthology.parallel:result is None 2023-08-11T12:23:22.416 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-08-11T12:23:22.417 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph pg dump --format=json 2023-08-11T12:23:22.702 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:22 smithi008 ceph-mon[97158]: pgmap v315: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-11T12:23:23.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:22 smithi194 ceph-mon[130905]: pgmap v315: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-11T12:23:23.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:22 smithi045 ceph-mon[130284]: pgmap v315: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-11T12:23:23.198 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:23:24.275 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:23 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:23:24.276 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:23 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:23:24.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:23 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:23:24.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:23 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:23:24.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:23 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:23:24.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:23 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:23:24.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.916+0000 7fbe71354700 1 -- 172.21.15.8:0/198066750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe6c101b00 msgr2=0x7fbe6c101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:24.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.916+0000 7fbe71354700 1 --2- 172.21.15.8:0/198066750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe6c101b00 0x7fbe6c101ee0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c0098f0 tx=0x7fbe5c009c00 comp rx=0 tx=0).stop 2023-08-11T12:23:24.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.916+0000 7fbe71354700 1 -- 172.21.15.8:0/198066750 shutdown_connections 2023-08-11T12:23:24.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.916+0000 7fbe71354700 1 --2- 172.21.15.8:0/198066750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe6c101b00 0x7fbe6c101ee0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:24.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.916+0000 7fbe71354700 1 --2- 172.21.15.8:0/198066750 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe6c10af30 0x7fbe6c10d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:24.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.916+0000 7fbe71354700 1 --2- 172.21.15.8:0/198066750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe6c102420 0x7fbe6c10a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:24.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.916+0000 7fbe71354700 1 -- 172.21.15.8:0/198066750 >> 172.21.15.8:0/198066750 conn(0x7fbe6c0fb390 msgr2=0x7fbe6c0fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:24.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.916+0000 7fbe71354700 1 -- 172.21.15.8:0/198066750 shutdown_connections 2023-08-11T12:23:24.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.916+0000 7fbe71354700 1 -- 172.21.15.8:0/198066750 wait complete. 2023-08-11T12:23:24.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.918+0000 7fbe71354700 1 Processor -- start 2023-08-11T12:23:24.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.918+0000 7fbe71354700 1 -- start start 2023-08-11T12:23:24.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.919+0000 7fbe71354700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe6c101b00 0x7fbe6c19c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:24.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.919+0000 7fbe71354700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe6c102420 0x7fbe6c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:24.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.919+0000 7fbe71354700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe6c10af30 0x7fbe6c196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:24.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.919+0000 7fbe71354700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c196fb0 con 0x7fbe6c101b00 2023-08-11T12:23:24.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.919+0000 7fbe71354700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c197120 con 0x7fbe6c102420 2023-08-11T12:23:24.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.919+0000 7fbe71354700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c1972e0 con 0x7fbe6c10af30 2023-08-11T12:23:24.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.919+0000 7fbe6affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe6c101b00 0x7fbe6c19c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:24.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.919+0000 7fbe6affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe6c101b00 0x7fbe6c19c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39230/0 (socket says 172.21.15.8:39230) 2023-08-11T12:23:24.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.919+0000 7fbe6affd700 1 -- 172.21.15.8:0/3590263001 learned_addr learned my addr 172.21.15.8:0/3590263001 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:24.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.919+0000 7fbe6a7fc700 1 --2- 172.21.15.8:0/3590263001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe6c102420 0x7fbe6c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:24.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.919+0000 7fbe6b7fe700 1 --2- 172.21.15.8:0/3590263001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe6c10af30 0x7fbe6c196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:24.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.919+0000 7fbe6affd700 1 -- 172.21.15.8:0/3590263001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe6c10af30 msgr2=0x7fbe6c196940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:24.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.919+0000 7fbe6affd700 1 --2- 172.21.15.8:0/3590263001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe6c10af30 0x7fbe6c196940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:24.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.919+0000 7fbe6affd700 1 -- 172.21.15.8:0/3590263001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe6c102420 msgr2=0x7fbe6c19ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:24.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.919+0000 7fbe6affd700 1 --2- 172.21.15.8:0/3590263001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe6c102420 0x7fbe6c19ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:24.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.919+0000 7fbe6affd700 1 -- 172.21.15.8:0/3590263001 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5c009520 con 0x7fbe6c101b00 2023-08-11T12:23:24.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.920+0000 7fbe6affd700 1 --2- 172.21.15.8:0/3590263001 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe6c101b00 0x7fbe6c19c8c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c009810 tx=0x7fbe5c00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:24.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.920+0000 7fbe53fff700 1 -- 172.21.15.8:0/3590263001 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c01c070 con 0x7fbe6c101b00 2023-08-11T12:23:24.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.920+0000 7fbe71354700 1 -- 172.21.15.8:0/3590263001 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe6c197560 con 0x7fbe6c101b00 2023-08-11T12:23:24.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.920+0000 7fbe53fff700 1 -- 172.21.15.8:0/3590263001 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe5c00bb20 con 0x7fbe6c101b00 2023-08-11T12:23:24.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.920+0000 7fbe53fff700 1 -- 172.21.15.8:0/3590263001 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c004930 con 0x7fbe6c101b00 2023-08-11T12:23:24.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.920+0000 7fbe71354700 1 -- 172.21.15.8:0/3590263001 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe6c1a38b0 con 0x7fbe6c101b00 2023-08-11T12:23:24.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.921+0000 7fbe71354700 1 -- 172.21.15.8:0/3590263001 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe6c0685b0 con 0x7fbe6c101b00 2023-08-11T12:23:24.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.923+0000 7fbe53fff700 1 -- 172.21.15.8:0/3590263001 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fbe5c020070 con 0x7fbe6c101b00 2023-08-11T12:23:24.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.925+0000 7fbe53fff700 1 --2- 172.21.15.8:0/3590263001 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fbe5409ff50 0x7fbe540a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:24.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.925+0000 7fbe53fff700 1 -- 172.21.15.8:0/3590263001 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fbe5c0cc5f0 con 0x7fbe6c101b00 2023-08-11T12:23:24.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.925+0000 7fbe6a7fc700 1 --2- 172.21.15.8:0/3590263001 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fbe5409ff50 0x7fbe540a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:24.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.926+0000 7fbe6a7fc700 1 --2- 172.21.15.8:0/3590263001 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fbe5409ff50 0x7fbe540a2410 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c10c6c0 tx=0x7fbe60009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:24.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:24.927+0000 7fbe53fff700 1 -- 172.21.15.8:0/3590263001 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fbe5c096100 con 0x7fbe6c101b00 2023-08-11T12:23:25.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:25.133+0000 7fbe71354700 1 -- 172.21.15.8:0/3590263001 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbe6c110970 con 0x7fbe5409ff50 2023-08-11T12:23:25.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:25.147+0000 7fbe53fff700 1 -- 172.21.15.8:0/3590263001 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426719 (secure 0 0 0) 0x7fbe6c110970 con 0x7fbe5409ff50 2023-08-11T12:23:25.157 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:23:25.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:25.154+0000 7fbe71354700 1 -- 172.21.15.8:0/3590263001 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fbe5409ff50 msgr2=0x7fbe540a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:25.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:25.154+0000 7fbe71354700 1 --2- 172.21.15.8:0/3590263001 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fbe5409ff50 0x7fbe540a2410 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c10c6c0 tx=0x7fbe60009260 comp rx=0 tx=0).stop 2023-08-11T12:23:25.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:25.154+0000 7fbe71354700 1 -- 172.21.15.8:0/3590263001 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe6c101b00 msgr2=0x7fbe6c19c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:25.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:25.154+0000 7fbe71354700 1 --2- 172.21.15.8:0/3590263001 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe6c101b00 0x7fbe6c19c8c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c009810 tx=0x7fbe5c00fa00 comp rx=0 tx=0).stop 2023-08-11T12:23:25.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:25.155+0000 7fbe71354700 1 -- 172.21.15.8:0/3590263001 shutdown_connections 2023-08-11T12:23:25.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:25.155+0000 7fbe71354700 1 --2- 172.21.15.8:0/3590263001 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fbe5409ff50 0x7fbe540a2410 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:25.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:25.155+0000 7fbe71354700 1 --2- 172.21.15.8:0/3590263001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe6c10af30 0x7fbe6c196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:25.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:25.155+0000 7fbe71354700 1 --2- 172.21.15.8:0/3590263001 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe6c101b00 0x7fbe6c19c8c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:25.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:25.155+0000 7fbe71354700 1 --2- 172.21.15.8:0/3590263001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe6c102420 0x7fbe6c19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:25.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:25.155+0000 7fbe71354700 1 -- 172.21.15.8:0/3590263001 >> 172.21.15.8:0/3590263001 conn(0x7fbe6c0fb390 msgr2=0x7fbe6c10d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:25.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:25.155+0000 7fbe71354700 1 -- 172.21.15.8:0/3590263001 shutdown_connections 2023-08-11T12:23:25.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:25.155+0000 7fbe71354700 1 -- 172.21.15.8:0/3590263001 wait complete. 2023-08-11T12:23:25.161 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-08-11T12:23:25.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:24 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:23:25.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:24 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:23:25.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:24 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:23:25.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:24 smithi008 ceph-mon[97158]: pgmap v316: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:25.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:24 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:23:25.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:24 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:23:25.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:24 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:23:25.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:24 smithi194 ceph-mon[130905]: pgmap v316: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:25.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:24 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:23:25.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:24 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:23:25.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:24 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' 2023-08-11T12:23:25.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:24 smithi045 ceph-mon[130284]: pgmap v316: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:25.645 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2023-08-11T12:23:24.527796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600632,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":673,"num_read_kb":404,"num_write":390,"num_write_kb":3005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":320,"ondisk_log_size":320,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336048,"kb_used_data":11796,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124605776,"statfs":{"total":1151940427776,"available":1151596314624,"internally_reserved":0,"allocated":12079104,"data_stored":7598449,"data_compressed":318882,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003205"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720907+0000","last_change":"2023-08-11T12:22:03.850538+0000","last_active":"2023-08-11T12:22:31.720907+0000","last_peered":"2023-08-11T12:22:31.720907+0000","last_clean":"2023-08-11T12:22:31.720907+0000","last_became_active":"2023-08-11T12:22:03.850220+0000","last_became_peered":"2023-08-11T12:22:03.850220+0000","last_unstale":"2023-08-11T12:22:31.720907+0000","last_undegraded":"2023-08-11T12:22:31.720907+0000","last_fullsized":"2023-08-11T12:22:31.720907+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:10:46.194341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719647+0000","last_change":"2023-08-11T12:22:03.843779+0000","last_active":"2023-08-11T12:22:31.719647+0000","last_peered":"2023-08-11T12:22:31.719647+0000","last_clean":"2023-08-11T12:22:31.719647+0000","last_became_active":"2023-08-11T12:22:03.843441+0000","last_became_peered":"2023-08-11T12:22:03.843441+0000","last_unstale":"2023-08-11T12:22:31.719647+0000","last_undegraded":"2023-08-11T12:22:31.719647+0000","last_fullsized":"2023-08-11T12:22:31.719647+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:51:42.363862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719082+0000","last_change":"2023-08-11T12:22:03.851996+0000","last_active":"2023-08-11T12:22:31.719082+0000","last_peered":"2023-08-11T12:22:31.719082+0000","last_clean":"2023-08-11T12:22:31.719082+0000","last_became_active":"2023-08-11T12:22:03.850821+0000","last_became_peered":"2023-08-11T12:22:03.850821+0000","last_unstale":"2023-08-11T12:22:31.719082+0000","last_undegraded":"2023-08-11T12:22:31.719082+0000","last_fullsized":"2023-08-11T12:22:31.719082+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:54:54.152911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722080+0000","last_change":"2023-08-11T12:22:03.842025+0000","last_active":"2023-08-11T12:22:31.722080+0000","last_peered":"2023-08-11T12:22:31.722080+0000","last_clean":"2023-08-11T12:22:31.722080+0000","last_became_active":"2023-08-11T12:22:03.841700+0000","last_became_peered":"2023-08-11T12:22:03.841700+0000","last_unstale":"2023-08-11T12:22:31.722080+0000","last_undegraded":"2023-08-11T12:22:31.722080+0000","last_fullsized":"2023-08-11T12:22:31.722080+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:13:45.519007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723174+0000","last_change":"2023-08-11T12:22:03.844908+0000","last_active":"2023-08-11T12:22:31.723174+0000","last_peered":"2023-08-11T12:22:31.723174+0000","last_clean":"2023-08-11T12:22:31.723174+0000","last_became_active":"2023-08-11T12:22:03.844674+0000","last_became_peered":"2023-08-11T12:22:03.844674+0000","last_unstale":"2023-08-11T12:22:31.723174+0000","last_undegraded":"2023-08-11T12:22:31.723174+0000","last_fullsized":"2023-08-11T12:22:31.723174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:10:22.657255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721437+0000","last_change":"2023-08-11T12:22:03.839915+0000","last_active":"2023-08-11T12:22:31.721437+0000","last_peered":"2023-08-11T12:22:31.721437+0000","last_clean":"2023-08-11T12:22:31.721437+0000","last_became_active":"2023-08-11T12:22:03.839099+0000","last_became_peered":"2023-08-11T12:22:03.839099+0000","last_unstale":"2023-08-11T12:22:31.721437+0000","last_undegraded":"2023-08-11T12:22:31.721437+0000","last_fullsized":"2023-08-11T12:22:31.721437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:51:17.642383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717754+0000","last_change":"2023-08-11T12:22:03.841591+0000","last_active":"2023-08-11T12:22:31.717754+0000","last_peered":"2023-08-11T12:22:31.717754+0000","last_clean":"2023-08-11T12:22:31.717754+0000","last_became_active":"2023-08-11T12:22:03.841232+0000","last_became_peered":"2023-08-11T12:22:03.841232+0000","last_unstale":"2023-08-11T12:22:31.717754+0000","last_undegraded":"2023-08-11T12:22:31.717754+0000","last_fullsized":"2023-08-11T12:22:31.717754+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:12:40.032896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720595+0000","last_change":"2023-08-11T12:22:03.839516+0000","last_active":"2023-08-11T12:22:31.720595+0000","last_peered":"2023-08-11T12:22:31.720595+0000","last_clean":"2023-08-11T12:22:31.720595+0000","last_became_active":"2023-08-11T12:22:03.839058+0000","last_became_peered":"2023-08-11T12:22:03.839058+0000","last_unstale":"2023-08-11T12:22:31.720595+0000","last_undegraded":"2023-08-11T12:22:31.720595+0000","last_fullsized":"2023-08-11T12:22:31.720595+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:01:10.744970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774871+0000","last_change":"2023-08-11T12:22:03.841033+0000","last_active":"2023-08-11T12:22:31.774871+0000","last_peered":"2023-08-11T12:22:31.774871+0000","last_clean":"2023-08-11T12:22:31.774871+0000","last_became_active":"2023-08-11T12:22:03.840665+0000","last_became_peered":"2023-08-11T12:22:03.840665+0000","last_unstale":"2023-08-11T12:22:31.774871+0000","last_undegraded":"2023-08-11T12:22:31.774871+0000","last_fullsized":"2023-08-11T12:22:31.774871+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:08:51.628782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721119+0000","last_change":"2023-08-11T12:22:03.839663+0000","last_active":"2023-08-11T12:22:31.721119+0000","last_peered":"2023-08-11T12:22:31.721119+0000","last_clean":"2023-08-11T12:22:31.721119+0000","last_became_active":"2023-08-11T12:22:03.838840+0000","last_became_peered":"2023-08-11T12:22:03.838840+0000","last_unstale":"2023-08-11T12:22:31.721119+0000","last_undegraded":"2023-08-11T12:22:31.721119+0000","last_fullsized":"2023-08-11T12:22:31.721119+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:28:57.495510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717811+0000","last_change":"2023-08-11T12:22:03.846288+0000","last_active":"2023-08-11T12:22:31.717811+0000","last_peered":"2023-08-11T12:22:31.717811+0000","last_clean":"2023-08-11T12:22:31.717811+0000","last_became_active":"2023-08-11T12:22:03.845962+0000","last_became_peered":"2023-08-11T12:22:03.845962+0000","last_unstale":"2023-08-11T12:22:31.717811+0000","last_undegraded":"2023-08-11T12:22:31.717811+0000","last_fullsized":"2023-08-11T12:22:31.717811+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:42:37.154687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.728022+0000","last_change":"2023-08-11T12:22:31.726774+0000","last_active":"2023-08-11T12:22:31.728022+0000","last_peered":"2023-08-11T12:22:31.728022+0000","last_clean":"2023-08-11T12:22:31.728022+0000","last_became_active":"2023-08-11T12:22:31.726437+0000","last_became_peered":"2023-08-11T12:22:31.726437+0000","last_unstale":"2023-08-11T12:22:31.728022+0000","last_undegraded":"2023-08-11T12:22:31.728022+0000","last_fullsized":"2023-08-11T12:22:31.728022+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:33:56.005318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717500+0000","last_change":"2023-08-11T12:22:03.842249+0000","last_active":"2023-08-11T12:22:31.717500+0000","last_peered":"2023-08-11T12:22:31.717500+0000","last_clean":"2023-08-11T12:22:31.717500+0000","last_became_active":"2023-08-11T12:22:03.841887+0000","last_became_peered":"2023-08-11T12:22:03.841887+0000","last_unstale":"2023-08-11T12:22:31.717500+0000","last_undegraded":"2023-08-11T12:22:31.717500+0000","last_fullsized":"2023-08-11T12:22:31.717500+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:24:16.685728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718746+0000","last_change":"2023-08-11T12:22:03.843859+0000","last_active":"2023-08-11T12:22:31.718746+0000","last_peered":"2023-08-11T12:22:31.718746+0000","last_clean":"2023-08-11T12:22:31.718746+0000","last_became_active":"2023-08-11T12:22:03.843383+0000","last_became_peered":"2023-08-11T12:22:03.843383+0000","last_unstale":"2023-08-11T12:22:31.718746+0000","last_undegraded":"2023-08-11T12:22:31.718746+0000","last_fullsized":"2023-08-11T12:22:31.718746+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:19:55.006972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.726241+0000","last_change":"2023-08-11T12:22:31.726241+0000","last_active":"2023-08-11T12:22:31.726241+0000","last_peered":"2023-08-11T12:22:31.726241+0000","last_clean":"2023-08-11T12:22:31.726241+0000","last_became_active":"2023-08-11T12:22:31.725852+0000","last_became_peered":"2023-08-11T12:22:31.725852+0000","last_unstale":"2023-08-11T12:22:31.726241+0000","last_undegraded":"2023-08-11T12:22:31.726241+0000","last_fullsized":"2023-08-11T12:22:31.726241+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:37:58.350171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774047+0000","last_change":"2023-08-11T12:22:03.850397+0000","last_active":"2023-08-11T12:22:31.774047+0000","last_peered":"2023-08-11T12:22:31.774047+0000","last_clean":"2023-08-11T12:22:31.774047+0000","last_became_active":"2023-08-11T12:22:03.850143+0000","last_became_peered":"2023-08-11T12:22:03.850143+0000","last_unstale":"2023-08-11T12:22:31.774047+0000","last_undegraded":"2023-08-11T12:22:31.774047+0000","last_fullsized":"2023-08-11T12:22:31.774047+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:13:22.558148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721002+0000","last_change":"2023-08-11T12:22:03.850496+0000","last_active":"2023-08-11T12:22:31.721002+0000","last_peered":"2023-08-11T12:22:31.721002+0000","last_clean":"2023-08-11T12:22:31.721002+0000","last_became_active":"2023-08-11T12:22:03.850192+0000","last_became_peered":"2023-08-11T12:22:03.850192+0000","last_unstale":"2023-08-11T12:22:31.721002+0000","last_undegraded":"2023-08-11T12:22:31.721002+0000","last_fullsized":"2023-08-11T12:22:31.721002+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:54:50.626326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722136+0000","last_change":"2023-08-11T12:22:03.841706+0000","last_active":"2023-08-11T12:22:31.722136+0000","last_peered":"2023-08-11T12:22:31.722136+0000","last_clean":"2023-08-11T12:22:31.722136+0000","last_became_active":"2023-08-11T12:22:03.841341+0000","last_became_peered":"2023-08-11T12:22:03.841341+0000","last_unstale":"2023-08-11T12:22:31.722136+0000","last_undegraded":"2023-08-11T12:22:31.722136+0000","last_fullsized":"2023-08-11T12:22:31.722136+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:36:20.093373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722972+0000","last_change":"2023-08-11T12:22:03.834450+0000","last_active":"2023-08-11T12:22:31.722972+0000","last_peered":"2023-08-11T12:22:31.722972+0000","last_clean":"2023-08-11T12:22:31.722972+0000","last_became_active":"2023-08-11T12:22:03.834154+0000","last_became_peered":"2023-08-11T12:22:03.834154+0000","last_unstale":"2023-08-11T12:22:31.722972+0000","last_undegraded":"2023-08-11T12:22:31.722972+0000","last_fullsized":"2023-08-11T12:22:31.722972+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:08:49.920575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.727577+0000","last_change":"2023-08-11T12:22:31.727577+0000","last_active":"2023-08-11T12:22:31.727577+0000","last_peered":"2023-08-11T12:22:31.727577+0000","last_clean":"2023-08-11T12:22:31.727577+0000","last_became_active":"2023-08-11T12:22:31.727034+0000","last_became_peered":"2023-08-11T12:22:31.727034+0000","last_unstale":"2023-08-11T12:22:31.727577+0000","last_undegraded":"2023-08-11T12:22:31.727577+0000","last_fullsized":"2023-08-11T12:22:31.727577+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:14:44.681877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":90,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:23:20.781228+0000","last_change":"2023-08-11T12:22:02.841759+0000","last_active":"2023-08-11T12:23:20.781228+0000","last_peered":"2023-08-11T12:23:20.781228+0000","last_clean":"2023-08-11T12:23:20.781228+0000","last_became_active":"2023-08-11T12:22:02.841326+0000","last_became_peered":"2023-08-11T12:22:02.841326+0000","last_unstale":"2023-08-11T12:23:20.781228+0000","last_undegraded":"2023-08-11T12:23:20.781228+0000","last_fullsized":"2023-08-11T12:23:20.781228+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:09:30.085287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.802211+0000","last_change":"2023-08-11T12:22:31.801910+0000","last_active":"2023-08-11T12:22:31.802211+0000","last_peered":"2023-08-11T12:22:31.802211+0000","last_clean":"2023-08-11T12:22:31.802211+0000","last_became_active":"2023-08-11T12:22:31.801479+0000","last_became_peered":"2023-08-11T12:22:31.801479+0000","last_unstale":"2023-08-11T12:22:31.802211+0000","last_undegraded":"2023-08-11T12:22:31.802211+0000","last_fullsized":"2023-08-11T12:22:31.802211+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:52:21.489431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720477+0000","last_change":"2023-08-11T12:22:07.875010+0000","last_active":"2023-08-11T12:22:31.720477+0000","last_peered":"2023-08-11T12:22:31.720477+0000","last_clean":"2023-08-11T12:22:31.720477+0000","last_became_active":"2023-08-11T12:22:07.874474+0000","last_became_peered":"2023-08-11T12:22:07.874474+0000","last_unstale":"2023-08-11T12:22:31.720477+0000","last_undegraded":"2023-08-11T12:22:31.720477+0000","last_fullsized":"2023-08-11T12:22:31.720477+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:41:20.795124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721140+0000","last_change":"2023-08-11T12:22:02.848299+0000","last_active":"2023-08-11T12:22:31.721140+0000","last_peered":"2023-08-11T12:22:31.721140+0000","last_clean":"2023-08-11T12:22:31.721140+0000","last_became_active":"2023-08-11T12:22:02.847869+0000","last_became_peered":"2023-08-11T12:22:02.847869+0000","last_unstale":"2023-08-11T12:22:31.721140+0000","last_undegraded":"2023-08-11T12:22:31.721140+0000","last_fullsized":"2023-08-11T12:22:31.721140+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:09:15.600582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719818+0000","last_change":"2023-08-11T12:22:03.841173+0000","last_active":"2023-08-11T12:22:31.719818+0000","last_peered":"2023-08-11T12:22:31.719818+0000","last_clean":"2023-08-11T12:22:31.719818+0000","last_became_active":"2023-08-11T12:22:03.840882+0000","last_became_peered":"2023-08-11T12:22:03.840882+0000","last_unstale":"2023-08-11T12:22:31.719818+0000","last_undegraded":"2023-08-11T12:22:31.719818+0000","last_fullsized":"2023-08-11T12:22:31.719818+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:50:28.937358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721470+0000","last_change":"2023-08-11T12:22:07.880756+0000","last_active":"2023-08-11T12:22:31.721470+0000","last_peered":"2023-08-11T12:22:31.721470+0000","last_clean":"2023-08-11T12:22:31.721470+0000","last_became_active":"2023-08-11T12:22:07.878866+0000","last_became_peered":"2023-08-11T12:22:07.878866+0000","last_unstale":"2023-08-11T12:22:31.721470+0000","last_undegraded":"2023-08-11T12:22:31.721470+0000","last_fullsized":"2023-08-11T12:22:31.721470+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:30:28.617039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:32.698559+0000","last_change":"2023-08-11T12:22:02.848543+0000","last_active":"2023-08-11T12:22:32.698559+0000","last_peered":"2023-08-11T12:22:32.698559+0000","last_clean":"2023-08-11T12:22:32.698559+0000","last_became_active":"2023-08-11T12:22:02.848008+0000","last_became_peered":"2023-08-11T12:22:02.848008+0000","last_unstale":"2023-08-11T12:22:32.698559+0000","last_undegraded":"2023-08-11T12:22:32.698559+0000","last_fullsized":"2023-08-11T12:22:32.698559+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:57:46.484932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774382+0000","last_change":"2023-08-11T12:22:03.843651+0000","last_active":"2023-08-11T12:22:31.774382+0000","last_peered":"2023-08-11T12:22:31.774382+0000","last_clean":"2023-08-11T12:22:31.774382+0000","last_became_active":"2023-08-11T12:22:03.843392+0000","last_became_peered":"2023-08-11T12:22:03.843392+0000","last_unstale":"2023-08-11T12:22:31.774382+0000","last_undegraded":"2023-08-11T12:22:31.774382+0000","last_fullsized":"2023-08-11T12:22:31.774382+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:27:25.825805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721058+0000","last_change":"2023-08-11T12:22:07.879373+0000","last_active":"2023-08-11T12:22:31.721058+0000","last_peered":"2023-08-11T12:22:31.721058+0000","last_clean":"2023-08-11T12:22:31.721058+0000","last_became_active":"2023-08-11T12:22:07.878929+0000","last_became_peered":"2023-08-11T12:22:07.878929+0000","last_unstale":"2023-08-11T12:22:31.721058+0000","last_undegraded":"2023-08-11T12:22:31.721058+0000","last_fullsized":"2023-08-11T12:22:31.721058+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:37:29.598815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723705+0000","last_change":"2023-08-11T12:22:02.841984+0000","last_active":"2023-08-11T12:22:31.723705+0000","last_peered":"2023-08-11T12:22:31.723705+0000","last_clean":"2023-08-11T12:22:31.723705+0000","last_became_active":"2023-08-11T12:22:02.841585+0000","last_became_peered":"2023-08-11T12:22:02.841585+0000","last_unstale":"2023-08-11T12:22:31.723705+0000","last_undegraded":"2023-08-11T12:22:31.723705+0000","last_fullsized":"2023-08-11T12:22:31.723705+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:18:28.740155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800688+0000","last_change":"2023-08-11T12:22:03.839381+0000","last_active":"2023-08-11T12:22:31.800688+0000","last_peered":"2023-08-11T12:22:31.800688+0000","last_clean":"2023-08-11T12:22:31.800688+0000","last_became_active":"2023-08-11T12:22:03.839091+0000","last_became_peered":"2023-08-11T12:22:03.839091+0000","last_unstale":"2023-08-11T12:22:31.800688+0000","last_undegraded":"2023-08-11T12:22:31.800688+0000","last_fullsized":"2023-08-11T12:22:31.800688+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:45:52.205138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722725+0000","last_change":"2023-08-11T12:22:07.881758+0000","last_active":"2023-08-11T12:22:31.722725+0000","last_peered":"2023-08-11T12:22:31.722725+0000","last_clean":"2023-08-11T12:22:31.722725+0000","last_became_active":"2023-08-11T12:22:07.881305+0000","last_became_peered":"2023-08-11T12:22:07.881305+0000","last_unstale":"2023-08-11T12:22:31.722725+0000","last_undegraded":"2023-08-11T12:22:31.722725+0000","last_fullsized":"2023-08-11T12:22:31.722725+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:25:48.595182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'5","reported_seq":86,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:23:20.754384+0000","last_change":"2023-08-11T12:22:02.844138+0000","last_active":"2023-08-11T12:23:20.754384+0000","last_peered":"2023-08-11T12:23:20.754384+0000","last_clean":"2023-08-11T12:23:20.754384+0000","last_became_active":"2023-08-11T12:22:02.843234+0000","last_became_peered":"2023-08-11T12:22:02.843234+0000","last_unstale":"2023-08-11T12:23:20.754384+0000","last_undegraded":"2023-08-11T12:23:20.754384+0000","last_fullsized":"2023-08-11T12:23:20.754384+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:53:48.033181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723640+0000","last_change":"2023-08-11T12:22:03.845450+0000","last_active":"2023-08-11T12:22:31.723640+0000","last_peered":"2023-08-11T12:22:31.723640+0000","last_clean":"2023-08-11T12:22:31.723640+0000","last_became_active":"2023-08-11T12:22:03.845170+0000","last_became_peered":"2023-08-11T12:22:03.845170+0000","last_unstale":"2023-08-11T12:22:31.723640+0000","last_undegraded":"2023-08-11T12:22:31.723640+0000","last_fullsized":"2023-08-11T12:22:31.723640+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:35:09.789210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722268+0000","last_change":"2023-08-11T12:22:07.880663+0000","last_active":"2023-08-11T12:22:31.722268+0000","last_peered":"2023-08-11T12:22:31.722268+0000","last_clean":"2023-08-11T12:22:31.722268+0000","last_became_active":"2023-08-11T12:22:07.880282+0000","last_became_peered":"2023-08-11T12:22:07.880282+0000","last_unstale":"2023-08-11T12:22:31.722268+0000","last_undegraded":"2023-08-11T12:22:31.722268+0000","last_fullsized":"2023-08-11T12:22:31.722268+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:36:05.356885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"87'7","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721289+0000","last_change":"2023-08-11T12:22:02.842206+0000","last_active":"2023-08-11T12:22:31.721289+0000","last_peered":"2023-08-11T12:22:31.721289+0000","last_clean":"2023-08-11T12:22:31.721289+0000","last_became_active":"2023-08-11T12:22:02.841815+0000","last_became_peered":"2023-08-11T12:22:02.841815+0000","last_unstale":"2023-08-11T12:22:31.721289+0000","last_undegraded":"2023-08-11T12:22:31.721289+0000","last_fullsized":"2023-08-11T12:22:31.721289+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:15:01.305404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800934+0000","last_change":"2023-08-11T12:22:03.825886+0000","last_active":"2023-08-11T12:22:31.800934+0000","last_peered":"2023-08-11T12:22:31.800934+0000","last_clean":"2023-08-11T12:22:31.800934+0000","last_became_active":"2023-08-11T12:22:03.825645+0000","last_became_peered":"2023-08-11T12:22:03.825645+0000","last_unstale":"2023-08-11T12:22:31.800934+0000","last_undegraded":"2023-08-11T12:22:31.800934+0000","last_fullsized":"2023-08-11T12:22:31.800934+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:03:34.650801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720447+0000","last_change":"2023-08-11T12:22:07.890216+0000","last_active":"2023-08-11T12:22:31.720447+0000","last_peered":"2023-08-11T12:22:31.720447+0000","last_clean":"2023-08-11T12:22:31.720447+0000","last_became_active":"2023-08-11T12:22:07.889860+0000","last_became_peered":"2023-08-11T12:22:07.889860+0000","last_unstale":"2023-08-11T12:22:31.720447+0000","last_undegraded":"2023-08-11T12:22:31.720447+0000","last_fullsized":"2023-08-11T12:22:31.720447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:03:54.952887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.716962+0000","last_change":"2023-08-11T12:22:02.835703+0000","last_active":"2023-08-11T12:22:31.716962+0000","last_peered":"2023-08-11T12:22:31.716962+0000","last_clean":"2023-08-11T12:22:31.716962+0000","last_became_active":"2023-08-11T12:22:02.835300+0000","last_became_peered":"2023-08-11T12:22:02.835300+0000","last_unstale":"2023-08-11T12:22:31.716962+0000","last_undegraded":"2023-08-11T12:22:31.716962+0000","last_fullsized":"2023-08-11T12:22:31.716962+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:55:13.953193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720447+0000","last_change":"2023-08-11T12:22:03.835619+0000","last_active":"2023-08-11T12:22:31.720447+0000","last_peered":"2023-08-11T12:22:31.720447+0000","last_clean":"2023-08-11T12:22:31.720447+0000","last_became_active":"2023-08-11T12:22:03.835365+0000","last_became_peered":"2023-08-11T12:22:03.835365+0000","last_unstale":"2023-08-11T12:22:31.720447+0000","last_undegraded":"2023-08-11T12:22:31.720447+0000","last_fullsized":"2023-08-11T12:22:31.720447+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:36:40.129412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719371+0000","last_change":"2023-08-11T12:22:07.893736+0000","last_active":"2023-08-11T12:22:31.719371+0000","last_peered":"2023-08-11T12:22:31.719371+0000","last_clean":"2023-08-11T12:22:31.719371+0000","last_became_active":"2023-08-11T12:22:07.893160+0000","last_became_peered":"2023-08-11T12:22:07.893160+0000","last_unstale":"2023-08-11T12:22:31.719371+0000","last_undegraded":"2023-08-11T12:22:31.719371+0000","last_fullsized":"2023-08-11T12:22:31.719371+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:55:46.234346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800174+0000","last_change":"2023-08-11T12:22:02.843819+0000","last_active":"2023-08-11T12:22:31.800174+0000","last_peered":"2023-08-11T12:22:31.800174+0000","last_clean":"2023-08-11T12:22:31.800174+0000","last_became_active":"2023-08-11T12:22:02.843062+0000","last_became_peered":"2023-08-11T12:22:02.843062+0000","last_unstale":"2023-08-11T12:22:31.800174+0000","last_undegraded":"2023-08-11T12:22:31.800174+0000","last_fullsized":"2023-08-11T12:22:31.800174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:59:34.378593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722599+0000","last_change":"2023-08-11T12:22:03.845985+0000","last_active":"2023-08-11T12:22:31.722599+0000","last_peered":"2023-08-11T12:22:31.722599+0000","last_clean":"2023-08-11T12:22:31.722599+0000","last_became_active":"2023-08-11T12:22:03.845274+0000","last_became_peered":"2023-08-11T12:22:03.845274+0000","last_unstale":"2023-08-11T12:22:31.722599+0000","last_undegraded":"2023-08-11T12:22:31.722599+0000","last_fullsized":"2023-08-11T12:22:31.722599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:51:23.239546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.775632+0000","last_change":"2023-08-11T12:22:31.775632+0000","last_active":"2023-08-11T12:22:31.775632+0000","last_peered":"2023-08-11T12:22:31.775632+0000","last_clean":"2023-08-11T12:22:31.775632+0000","last_became_active":"2023-08-11T12:22:31.775282+0000","last_became_peered":"2023-08-11T12:22:31.775282+0000","last_unstale":"2023-08-11T12:22:31.775632+0000","last_undegraded":"2023-08-11T12:22:31.775632+0000","last_fullsized":"2023-08-11T12:22:31.775632+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:59:53.378227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,8],"acting":[3,7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"87'4","reported_seq":129,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:23:19.751865+0000","last_change":"2023-08-11T12:22:02.836591+0000","last_active":"2023-08-11T12:23:19.751865+0000","last_peered":"2023-08-11T12:23:19.751865+0000","last_clean":"2023-08-11T12:23:19.751865+0000","last_became_active":"2023-08-11T12:22:02.836223+0000","last_became_peered":"2023-08-11T12:22:02.836223+0000","last_unstale":"2023-08-11T12:23:19.751865+0000","last_undegraded":"2023-08-11T12:23:19.751865+0000","last_fullsized":"2023-08-11T12:23:19.751865+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:30:37.183588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774757+0000","last_change":"2023-08-11T12:22:03.841719+0000","last_active":"2023-08-11T12:22:31.774757+0000","last_peered":"2023-08-11T12:22:31.774757+0000","last_clean":"2023-08-11T12:22:31.774757+0000","last_became_active":"2023-08-11T12:22:03.841381+0000","last_became_peered":"2023-08-11T12:22:03.841381+0000","last_unstale":"2023-08-11T12:22:31.774757+0000","last_undegraded":"2023-08-11T12:22:31.774757+0000","last_fullsized":"2023-08-11T12:22:31.774757+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:29:35.108655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721200+0000","last_change":"2023-08-11T12:22:07.889103+0000","last_active":"2023-08-11T12:22:31.721200+0000","last_peered":"2023-08-11T12:22:31.721200+0000","last_clean":"2023-08-11T12:22:31.721200+0000","last_became_active":"2023-08-11T12:22:07.888668+0000","last_became_peered":"2023-08-11T12:22:07.888668+0000","last_unstale":"2023-08-11T12:22:31.721200+0000","last_undegraded":"2023-08-11T12:22:31.721200+0000","last_fullsized":"2023-08-11T12:22:31.721200+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:55:40.004921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717773+0000","last_change":"2023-08-11T12:22:02.841934+0000","last_active":"2023-08-11T12:22:31.717773+0000","last_peered":"2023-08-11T12:22:31.717773+0000","last_clean":"2023-08-11T12:22:31.717773+0000","last_became_active":"2023-08-11T12:22:02.841598+0000","last_became_peered":"2023-08-11T12:22:02.841598+0000","last_unstale":"2023-08-11T12:22:31.717773+0000","last_undegraded":"2023-08-11T12:22:31.717773+0000","last_fullsized":"2023-08-11T12:22:31.717773+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:20:04.206298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719796+0000","last_change":"2023-08-11T12:22:03.848901+0000","last_active":"2023-08-11T12:22:31.719796+0000","last_peered":"2023-08-11T12:22:31.719796+0000","last_clean":"2023-08-11T12:22:31.719796+0000","last_became_active":"2023-08-11T12:22:03.848518+0000","last_became_peered":"2023-08-11T12:22:03.848518+0000","last_unstale":"2023-08-11T12:22:31.719796+0000","last_undegraded":"2023-08-11T12:22:31.719796+0000","last_fullsized":"2023-08-11T12:22:31.719796+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:20:08.007934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.775821+0000","last_change":"2023-08-11T12:22:31.775821+0000","last_active":"2023-08-11T12:22:31.775821+0000","last_peered":"2023-08-11T12:22:31.775821+0000","last_clean":"2023-08-11T12:22:31.775821+0000","last_became_active":"2023-08-11T12:22:31.775264+0000","last_became_peered":"2023-08-11T12:22:31.775264+0000","last_unstale":"2023-08-11T12:22:31.775821+0000","last_undegraded":"2023-08-11T12:22:31.775821+0000","last_fullsized":"2023-08-11T12:22:31.775821+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:28:22.561726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"87'5","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800805+0000","last_change":"2023-08-11T12:22:02.846492+0000","last_active":"2023-08-11T12:22:31.800805+0000","last_peered":"2023-08-11T12:22:31.800805+0000","last_clean":"2023-08-11T12:22:31.800805+0000","last_became_active":"2023-08-11T12:22:02.846174+0000","last_became_peered":"2023-08-11T12:22:02.846174+0000","last_unstale":"2023-08-11T12:22:31.800805+0000","last_undegraded":"2023-08-11T12:22:31.800805+0000","last_fullsized":"2023-08-11T12:22:31.800805+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:09:18.245164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774783+0000","last_change":"2023-08-11T12:22:03.840054+0000","last_active":"2023-08-11T12:22:31.774783+0000","last_peered":"2023-08-11T12:22:31.774783+0000","last_clean":"2023-08-11T12:22:31.774783+0000","last_became_active":"2023-08-11T12:22:03.839707+0000","last_became_peered":"2023-08-11T12:22:03.839707+0000","last_unstale":"2023-08-11T12:22:31.774783+0000","last_undegraded":"2023-08-11T12:22:31.774783+0000","last_fullsized":"2023-08-11T12:22:31.774783+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:47:30.898127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.802304+0000","last_change":"2023-08-11T12:22:31.801931+0000","last_active":"2023-08-11T12:22:31.802304+0000","last_peered":"2023-08-11T12:22:31.802304+0000","last_clean":"2023-08-11T12:22:31.802304+0000","last_became_active":"2023-08-11T12:22:31.801522+0000","last_became_peered":"2023-08-11T12:22:31.801522+0000","last_unstale":"2023-08-11T12:22:31.802304+0000","last_undegraded":"2023-08-11T12:22:31.802304+0000","last_fullsized":"2023-08-11T12:22:31.802304+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:03:22.570814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.14","version":"88'14","reported_seq":144,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:23:19.751918+0000","last_change":"2023-08-11T12:22:02.836520+0000","last_active":"2023-08-11T12:23:19.751918+0000","last_peered":"2023-08-11T12:23:19.751918+0000","last_clean":"2023-08-11T12:23:19.751918+0000","last_became_active":"2023-08-11T12:22:02.836201+0000","last_became_peered":"2023-08-11T12:22:02.836201+0000","last_unstale":"2023-08-11T12:23:19.751918+0000","last_undegraded":"2023-08-11T12:23:19.751918+0000","last_fullsized":"2023-08-11T12:23:19.751918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:58:37.750229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":104,"num_read_kb":56,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723852+0000","last_change":"2023-08-11T12:22:03.848104+0000","last_active":"2023-08-11T12:22:31.723852+0000","last_peered":"2023-08-11T12:22:31.723852+0000","last_clean":"2023-08-11T12:22:31.723852+0000","last_became_active":"2023-08-11T12:22:03.847801+0000","last_became_peered":"2023-08-11T12:22:03.847801+0000","last_unstale":"2023-08-11T12:22:31.723852+0000","last_undegraded":"2023-08-11T12:22:31.723852+0000","last_fullsized":"2023-08-11T12:22:31.723852+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:56:47.846229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.801121+0000","last_change":"2023-08-11T12:22:07.893710+0000","last_active":"2023-08-11T12:22:31.801121+0000","last_peered":"2023-08-11T12:22:31.801121+0000","last_clean":"2023-08-11T12:22:31.801121+0000","last_became_active":"2023-08-11T12:22:07.893239+0000","last_became_peered":"2023-08-11T12:22:07.893239+0000","last_unstale":"2023-08-11T12:22:31.801121+0000","last_undegraded":"2023-08-11T12:22:31.801121+0000","last_fullsized":"2023-08-11T12:22:31.801121+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:24:55.563178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.724184+0000","last_change":"2023-08-11T12:22:02.849060+0000","last_active":"2023-08-11T12:22:31.724184+0000","last_peered":"2023-08-11T12:22:31.724184+0000","last_clean":"2023-08-11T12:22:31.724184+0000","last_became_active":"2023-08-11T12:22:02.848417+0000","last_became_peered":"2023-08-11T12:22:02.848417+0000","last_unstale":"2023-08-11T12:22:31.724184+0000","last_undegraded":"2023-08-11T12:22:31.724184+0000","last_fullsized":"2023-08-11T12:22:31.724184+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:48:47.925134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717206+0000","last_change":"2023-08-11T12:22:03.848532+0000","last_active":"2023-08-11T12:22:31.717206+0000","last_peered":"2023-08-11T12:22:31.717206+0000","last_clean":"2023-08-11T12:22:31.717206+0000","last_became_active":"2023-08-11T12:22:03.848190+0000","last_became_peered":"2023-08-11T12:22:03.848190+0000","last_unstale":"2023-08-11T12:22:31.717206+0000","last_undegraded":"2023-08-11T12:22:31.717206+0000","last_fullsized":"2023-08-11T12:22:31.717206+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:24:49.898432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720024+0000","last_change":"2023-08-11T12:22:07.882785+0000","last_active":"2023-08-11T12:22:31.720024+0000","last_peered":"2023-08-11T12:22:31.720024+0000","last_clean":"2023-08-11T12:22:31.720024+0000","last_became_active":"2023-08-11T12:22:07.880643+0000","last_became_peered":"2023-08-11T12:22:07.880643+0000","last_unstale":"2023-08-11T12:22:31.720024+0000","last_undegraded":"2023-08-11T12:22:31.720024+0000","last_fullsized":"2023-08-11T12:22:31.720024+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:40:21.114572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800547+0000","last_change":"2023-08-11T12:22:02.851416+0000","last_active":"2023-08-11T12:22:31.800547+0000","last_peered":"2023-08-11T12:22:31.800547+0000","last_clean":"2023-08-11T12:22:31.800547+0000","last_became_active":"2023-08-11T12:22:02.851114+0000","last_became_peered":"2023-08-11T12:22:02.851114+0000","last_unstale":"2023-08-11T12:22:31.800547+0000","last_undegraded":"2023-08-11T12:22:31.800547+0000","last_fullsized":"2023-08-11T12:22:31.800547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:27:37.565292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717994+0000","last_change":"2023-08-11T12:22:03.849367+0000","last_active":"2023-08-11T12:22:31.717994+0000","last_peered":"2023-08-11T12:22:31.717994+0000","last_clean":"2023-08-11T12:22:31.717994+0000","last_became_active":"2023-08-11T12:22:03.849050+0000","last_became_peered":"2023-08-11T12:22:03.849050+0000","last_unstale":"2023-08-11T12:22:31.717994+0000","last_undegraded":"2023-08-11T12:22:31.717994+0000","last_fullsized":"2023-08-11T12:22:31.717994+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:54:43.936124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722616+0000","last_change":"2023-08-11T12:22:07.890992+0000","last_active":"2023-08-11T12:22:31.722616+0000","last_peered":"2023-08-11T12:22:31.722616+0000","last_clean":"2023-08-11T12:22:31.722616+0000","last_became_active":"2023-08-11T12:22:07.890384+0000","last_became_peered":"2023-08-11T12:22:07.890384+0000","last_unstale":"2023-08-11T12:22:31.722616+0000","last_undegraded":"2023-08-11T12:22:31.722616+0000","last_fullsized":"2023-08-11T12:22:31.722616+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:00:55.230221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"87'5","reported_seq":84,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:23:21.789694+0000","last_change":"2023-08-11T12:22:02.843045+0000","last_active":"2023-08-11T12:23:21.789694+0000","last_peered":"2023-08-11T12:23:21.789694+0000","last_clean":"2023-08-11T12:23:21.789694+0000","last_became_active":"2023-08-11T12:22:02.842628+0000","last_became_peered":"2023-08-11T12:22:02.842628+0000","last_unstale":"2023-08-11T12:23:21.789694+0000","last_undegraded":"2023-08-11T12:23:21.789694+0000","last_fullsized":"2023-08-11T12:23:21.789694+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:45:36.283695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717456+0000","last_change":"2023-08-11T12:22:03.842526+0000","last_active":"2023-08-11T12:22:31.717456+0000","last_peered":"2023-08-11T12:22:31.717456+0000","last_clean":"2023-08-11T12:22:31.717456+0000","last_became_active":"2023-08-11T12:22:03.842183+0000","last_became_peered":"2023-08-11T12:22:03.842183+0000","last_unstale":"2023-08-11T12:22:31.717456+0000","last_undegraded":"2023-08-11T12:22:31.717456+0000","last_fullsized":"2023-08-11T12:22:31.717456+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:20:56.195693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717389+0000","last_change":"2023-08-11T12:22:07.880768+0000","last_active":"2023-08-11T12:22:31.717389+0000","last_peered":"2023-08-11T12:22:31.717389+0000","last_clean":"2023-08-11T12:22:31.717389+0000","last_became_active":"2023-08-11T12:22:07.880335+0000","last_became_peered":"2023-08-11T12:22:07.880335+0000","last_unstale":"2023-08-11T12:22:31.717389+0000","last_undegraded":"2023-08-11T12:22:31.717389+0000","last_fullsized":"2023-08-11T12:22:31.717389+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:35:51.736025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721841+0000","last_change":"2023-08-11T12:22:02.847271+0000","last_active":"2023-08-11T12:22:31.721841+0000","last_peered":"2023-08-11T12:22:31.721841+0000","last_clean":"2023-08-11T12:22:31.721841+0000","last_became_active":"2023-08-11T12:22:02.846974+0000","last_became_peered":"2023-08-11T12:22:02.846974+0000","last_unstale":"2023-08-11T12:22:31.721841+0000","last_undegraded":"2023-08-11T12:22:31.721841+0000","last_fullsized":"2023-08-11T12:22:31.721841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:43:35.198876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800817+0000","last_change":"2023-08-11T12:22:03.838944+0000","last_active":"2023-08-11T12:22:31.800817+0000","last_peered":"2023-08-11T12:22:31.800817+0000","last_clean":"2023-08-11T12:22:31.800817+0000","last_became_active":"2023-08-11T12:22:03.838610+0000","last_became_peered":"2023-08-11T12:22:03.838610+0000","last_unstale":"2023-08-11T12:22:31.800817+0000","last_undegraded":"2023-08-11T12:22:31.800817+0000","last_fullsized":"2023-08-11T12:22:31.800817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:10:20.371629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800680+0000","last_change":"2023-08-11T12:22:07.888812+0000","last_active":"2023-08-11T12:22:31.800680+0000","last_peered":"2023-08-11T12:22:31.800680+0000","last_clean":"2023-08-11T12:22:31.800680+0000","last_became_active":"2023-08-11T12:22:07.888423+0000","last_became_peered":"2023-08-11T12:22:07.888423+0000","last_unstale":"2023-08-11T12:22:31.800680+0000","last_undegraded":"2023-08-11T12:22:31.800680+0000","last_fullsized":"2023-08-11T12:22:31.800680+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:07:17.536681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723473+0000","last_change":"2023-08-11T12:22:02.842591+0000","last_active":"2023-08-11T12:22:31.723473+0000","last_peered":"2023-08-11T12:22:31.723473+0000","last_clean":"2023-08-11T12:22:31.723473+0000","last_became_active":"2023-08-11T12:22:02.842249+0000","last_became_peered":"2023-08-11T12:22:02.842249+0000","last_unstale":"2023-08-11T12:22:31.723473+0000","last_undegraded":"2023-08-11T12:22:31.723473+0000","last_fullsized":"2023-08-11T12:22:31.723473+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:28:10.930413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.725791+0000","last_change":"2023-08-11T12:22:31.725791+0000","last_active":"2023-08-11T12:22:31.725791+0000","last_peered":"2023-08-11T12:22:31.725791+0000","last_clean":"2023-08-11T12:22:31.725791+0000","last_became_active":"2023-08-11T12:22:31.724950+0000","last_became_peered":"2023-08-11T12:22:31.724950+0000","last_unstale":"2023-08-11T12:22:31.725791+0000","last_undegraded":"2023-08-11T12:22:31.725791+0000","last_fullsized":"2023-08-11T12:22:31.725791+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:59:37.392626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723495+0000","last_change":"2023-08-11T12:22:08.068485+0000","last_active":"2023-08-11T12:22:31.723495+0000","last_peered":"2023-08-11T12:22:31.723495+0000","last_clean":"2023-08-11T12:22:31.723495+0000","last_became_active":"2023-08-11T12:22:08.068071+0000","last_became_peered":"2023-08-11T12:22:08.068071+0000","last_unstale":"2023-08-11T12:22:31.723495+0000","last_undegraded":"2023-08-11T12:22:31.723495+0000","last_fullsized":"2023-08-11T12:22:31.723495+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:35:49.958958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"87'1","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.727900+0000","last_change":"2023-08-11T12:22:31.727900+0000","last_active":"2023-08-11T12:22:31.727900+0000","last_peered":"2023-08-11T12:22:31.727900+0000","last_clean":"2023-08-11T12:22:31.727900+0000","last_became_active":"2023-08-11T12:22:31.727346+0000","last_became_peered":"2023-08-11T12:22:31.727346+0000","last_unstale":"2023-08-11T12:22:31.727900+0000","last_undegraded":"2023-08-11T12:22:31.727900+0000","last_fullsized":"2023-08-11T12:22:31.727900+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:12:21.170378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722892+0000","last_change":"2023-08-11T12:22:03.843434+0000","last_active":"2023-08-11T12:22:31.722892+0000","last_peered":"2023-08-11T12:22:31.722892+0000","last_clean":"2023-08-11T12:22:31.722892+0000","last_became_active":"2023-08-11T12:22:03.843117+0000","last_became_peered":"2023-08-11T12:22:03.843117+0000","last_unstale":"2023-08-11T12:22:31.722892+0000","last_undegraded":"2023-08-11T12:22:31.722892+0000","last_fullsized":"2023-08-11T12:22:31.722892+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:30:45.835632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717364+0000","last_change":"2023-08-11T12:22:07.889740+0000","last_active":"2023-08-11T12:22:31.717364+0000","last_peered":"2023-08-11T12:22:31.717364+0000","last_clean":"2023-08-11T12:22:31.717364+0000","last_became_active":"2023-08-11T12:22:07.889272+0000","last_became_peered":"2023-08-11T12:22:07.889272+0000","last_unstale":"2023-08-11T12:22:31.717364+0000","last_undegraded":"2023-08-11T12:22:31.717364+0000","last_fullsized":"2023-08-11T12:22:31.717364+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:48:06.207915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":80,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:23:18.778937+0000","last_change":"2023-08-11T12:22:02.846661+0000","last_active":"2023-08-11T12:23:18.778937+0000","last_peered":"2023-08-11T12:23:18.778937+0000","last_clean":"2023-08-11T12:23:18.778937+0000","last_became_active":"2023-08-11T12:22:02.846269+0000","last_became_peered":"2023-08-11T12:22:02.846269+0000","last_unstale":"2023-08-11T12:23:18.778937+0000","last_undegraded":"2023-08-11T12:23:18.778937+0000","last_fullsized":"2023-08-11T12:23:18.778937+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:06:18.229850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720867+0000","last_change":"2023-08-11T12:22:03.849653+0000","last_active":"2023-08-11T12:22:31.720867+0000","last_peered":"2023-08-11T12:22:31.720867+0000","last_clean":"2023-08-11T12:22:31.720867+0000","last_became_active":"2023-08-11T12:22:03.849303+0000","last_became_peered":"2023-08-11T12:22:03.849303+0000","last_unstale":"2023-08-11T12:22:31.720867+0000","last_undegraded":"2023-08-11T12:22:31.720867+0000","last_fullsized":"2023-08-11T12:22:31.720867+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:06:11.551259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717043+0000","last_change":"2023-08-11T12:22:08.068395+0000","last_active":"2023-08-11T12:22:31.717043+0000","last_peered":"2023-08-11T12:22:31.717043+0000","last_clean":"2023-08-11T12:22:31.717043+0000","last_became_active":"2023-08-11T12:22:08.067572+0000","last_became_peered":"2023-08-11T12:22:08.067572+0000","last_unstale":"2023-08-11T12:22:31.717043+0000","last_undegraded":"2023-08-11T12:22:31.717043+0000","last_fullsized":"2023-08-11T12:22:31.717043+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:17:59.273227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800419+0000","last_change":"2023-08-11T12:22:03.828971+0000","last_active":"2023-08-11T12:22:31.800419+0000","last_peered":"2023-08-11T12:22:31.800419+0000","last_clean":"2023-08-11T12:22:31.800419+0000","last_became_active":"2023-08-11T12:22:03.828653+0000","last_became_peered":"2023-08-11T12:22:03.828653+0000","last_unstale":"2023-08-11T12:22:31.800419+0000","last_undegraded":"2023-08-11T12:22:31.800419+0000","last_fullsized":"2023-08-11T12:22:31.800419+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:03:54.904360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":84,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:23:22.790484+0000","last_change":"2023-08-11T12:22:02.842419+0000","last_active":"2023-08-11T12:23:22.790484+0000","last_peered":"2023-08-11T12:23:22.790484+0000","last_clean":"2023-08-11T12:23:22.790484+0000","last_became_active":"2023-08-11T12:22:02.842105+0000","last_became_peered":"2023-08-11T12:22:02.842105+0000","last_unstale":"2023-08-11T12:23:22.790484+0000","last_undegraded":"2023-08-11T12:23:22.790484+0000","last_fullsized":"2023-08-11T12:23:22.790484+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:32:13.063912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717659+0000","last_change":"2023-08-11T12:22:07.880762+0000","last_active":"2023-08-11T12:22:31.717659+0000","last_peered":"2023-08-11T12:22:31.717659+0000","last_clean":"2023-08-11T12:22:31.717659+0000","last_became_active":"2023-08-11T12:22:07.880373+0000","last_became_peered":"2023-08-11T12:22:07.880373+0000","last_unstale":"2023-08-11T12:22:31.717659+0000","last_undegraded":"2023-08-11T12:22:31.717659+0000","last_fullsized":"2023-08-11T12:22:31.717659+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:07:06.457583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720306+0000","last_change":"2023-08-11T12:22:03.838555+0000","last_active":"2023-08-11T12:22:31.720306+0000","last_peered":"2023-08-11T12:22:31.720306+0000","last_clean":"2023-08-11T12:22:31.720306+0000","last_became_active":"2023-08-11T12:22:03.838135+0000","last_became_peered":"2023-08-11T12:22:03.838135+0000","last_unstale":"2023-08-11T12:22:31.720306+0000","last_undegraded":"2023-08-11T12:22:31.720306+0000","last_fullsized":"2023-08-11T12:22:31.720306+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:36:24.934863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:32.698313+0000","last_change":"2023-08-11T12:22:02.835093+0000","last_active":"2023-08-11T12:22:32.698313+0000","last_peered":"2023-08-11T12:22:32.698313+0000","last_clean":"2023-08-11T12:22:32.698313+0000","last_became_active":"2023-08-11T12:22:02.834545+0000","last_became_peered":"2023-08-11T12:22:02.834545+0000","last_unstale":"2023-08-11T12:22:32.698313+0000","last_undegraded":"2023-08-11T12:22:32.698313+0000","last_fullsized":"2023-08-11T12:22:32.698313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:21:54.371599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":354,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717267+0000","last_change":"2023-08-11T12:20:57.484190+0000","last_active":"2023-08-11T12:22:31.717267+0000","last_peered":"2023-08-11T12:22:31.717267+0000","last_clean":"2023-08-11T12:22:31.717267+0000","last_became_active":"2023-08-11T12:20:57.483655+0000","last_became_peered":"2023-08-11T12:20:57.483655+0000","last_unstale":"2023-08-11T12:22:31.717267+0000","last_undegraded":"2023-08-11T12:22:31.717267+0000","last_fullsized":"2023-08-11T12:22:31.717267+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:17:49.245488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:17:49.245488+0000","last_clean_scrub_stamp":"2023-08-11T12:17:49.245488+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:25:33.880946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800856+0000","last_change":"2023-08-11T12:22:08.068762+0000","last_active":"2023-08-11T12:22:31.800856+0000","last_peered":"2023-08-11T12:22:31.800856+0000","last_clean":"2023-08-11T12:22:31.800856+0000","last_became_active":"2023-08-11T12:22:08.068205+0000","last_became_peered":"2023-08-11T12:22:08.068205+0000","last_unstale":"2023-08-11T12:22:31.800856+0000","last_undegraded":"2023-08-11T12:22:31.800856+0000","last_fullsized":"2023-08-11T12:22:31.800856+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:55:06.744751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.716768+0000","last_change":"2023-08-11T12:22:03.837843+0000","last_active":"2023-08-11T12:22:31.716768+0000","last_peered":"2023-08-11T12:22:31.716768+0000","last_clean":"2023-08-11T12:22:31.716768+0000","last_became_active":"2023-08-11T12:22:03.837537+0000","last_became_peered":"2023-08-11T12:22:03.837537+0000","last_unstale":"2023-08-11T12:22:31.716768+0000","last_undegraded":"2023-08-11T12:22:31.716768+0000","last_fullsized":"2023-08-11T12:22:31.716768+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:17:41.517052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717347+0000","last_change":"2023-08-11T12:22:02.843150+0000","last_active":"2023-08-11T12:22:31.717347+0000","last_peered":"2023-08-11T12:22:31.717347+0000","last_clean":"2023-08-11T12:22:31.717347+0000","last_became_active":"2023-08-11T12:22:02.842829+0000","last_became_peered":"2023-08-11T12:22:02.842829+0000","last_unstale":"2023-08-11T12:22:31.717347+0000","last_undegraded":"2023-08-11T12:22:31.717347+0000","last_fullsized":"2023-08-11T12:22:31.717347+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:09:48.420755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720687+0000","last_change":"2023-08-11T12:22:07.883050+0000","last_active":"2023-08-11T12:22:31.720687+0000","last_peered":"2023-08-11T12:22:31.720687+0000","last_clean":"2023-08-11T12:22:31.720687+0000","last_became_active":"2023-08-11T12:22:07.882423+0000","last_became_peered":"2023-08-11T12:22:07.882423+0000","last_unstale":"2023-08-11T12:22:31.720687+0000","last_undegraded":"2023-08-11T12:22:31.720687+0000","last_fullsized":"2023-08-11T12:22:31.720687+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:14:51.848070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.724001+0000","last_change":"2023-08-11T12:22:02.850632+0000","last_active":"2023-08-11T12:22:31.724001+0000","last_peered":"2023-08-11T12:22:31.724001+0000","last_clean":"2023-08-11T12:22:31.724001+0000","last_became_active":"2023-08-11T12:22:02.850312+0000","last_became_peered":"2023-08-11T12:22:02.850312+0000","last_unstale":"2023-08-11T12:22:31.724001+0000","last_undegraded":"2023-08-11T12:22:31.724001+0000","last_fullsized":"2023-08-11T12:22:31.724001+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:54:50.288288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717639+0000","last_change":"2023-08-11T12:22:03.839869+0000","last_active":"2023-08-11T12:22:31.717639+0000","last_peered":"2023-08-11T12:22:31.717639+0000","last_clean":"2023-08-11T12:22:31.717639+0000","last_became_active":"2023-08-11T12:22:03.839486+0000","last_became_peered":"2023-08-11T12:22:03.839486+0000","last_unstale":"2023-08-11T12:22:31.717639+0000","last_undegraded":"2023-08-11T12:22:31.717639+0000","last_fullsized":"2023-08-11T12:22:31.717639+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:23:04.341624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720307+0000","last_change":"2023-08-11T12:22:08.066877+0000","last_active":"2023-08-11T12:22:31.720307+0000","last_peered":"2023-08-11T12:22:31.720307+0000","last_clean":"2023-08-11T12:22:31.720307+0000","last_became_active":"2023-08-11T12:22:08.066418+0000","last_became_peered":"2023-08-11T12:22:08.066418+0000","last_unstale":"2023-08-11T12:22:31.720307+0000","last_undegraded":"2023-08-11T12:22:31.720307+0000","last_fullsized":"2023-08-11T12:22:31.720307+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:12:43.228455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'7","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722268+0000","last_change":"2023-08-11T12:22:02.850505+0000","last_active":"2023-08-11T12:22:31.722268+0000","last_peered":"2023-08-11T12:22:31.722268+0000","last_clean":"2023-08-11T12:22:31.722268+0000","last_became_active":"2023-08-11T12:22:02.850104+0000","last_became_peered":"2023-08-11T12:22:02.850104+0000","last_unstale":"2023-08-11T12:22:31.722268+0000","last_undegraded":"2023-08-11T12:22:31.722268+0000","last_fullsized":"2023-08-11T12:22:31.722268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:33:50.319404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721594+0000","last_change":"2023-08-11T12:22:03.837580+0000","last_active":"2023-08-11T12:22:31.721594+0000","last_peered":"2023-08-11T12:22:31.721594+0000","last_clean":"2023-08-11T12:22:31.721594+0000","last_became_active":"2023-08-11T12:22:03.837256+0000","last_became_peered":"2023-08-11T12:22:03.837256+0000","last_unstale":"2023-08-11T12:22:31.721594+0000","last_undegraded":"2023-08-11T12:22:31.721594+0000","last_fullsized":"2023-08-11T12:22:31.721594+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:07:44.899244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722304+0000","last_change":"2023-08-11T12:22:07.873613+0000","last_active":"2023-08-11T12:22:31.722304+0000","last_peered":"2023-08-11T12:22:31.722304+0000","last_clean":"2023-08-11T12:22:31.722304+0000","last_became_active":"2023-08-11T12:22:07.873149+0000","last_became_peered":"2023-08-11T12:22:07.873149+0000","last_unstale":"2023-08-11T12:22:31.722304+0000","last_undegraded":"2023-08-11T12:22:31.722304+0000","last_fullsized":"2023-08-11T12:22:31.722304+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:38:35.678888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722476+0000","last_change":"2023-08-11T12:22:02.843146+0000","last_active":"2023-08-11T12:22:31.722476+0000","last_peered":"2023-08-11T12:22:31.722476+0000","last_clean":"2023-08-11T12:22:31.722476+0000","last_became_active":"2023-08-11T12:22:02.842663+0000","last_became_peered":"2023-08-11T12:22:02.842663+0000","last_unstale":"2023-08-11T12:22:31.722476+0000","last_undegraded":"2023-08-11T12:22:31.722476+0000","last_fullsized":"2023-08-11T12:22:31.722476+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:32:13.084100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719503+0000","last_change":"2023-08-11T12:22:03.847351+0000","last_active":"2023-08-11T12:22:31.719503+0000","last_peered":"2023-08-11T12:22:31.719503+0000","last_clean":"2023-08-11T12:22:31.719503+0000","last_became_active":"2023-08-11T12:22:03.847044+0000","last_became_peered":"2023-08-11T12:22:03.847044+0000","last_unstale":"2023-08-11T12:22:31.719503+0000","last_undegraded":"2023-08-11T12:22:31.719503+0000","last_fullsized":"2023-08-11T12:22:31.719503+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:17:19.004762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721751+0000","last_change":"2023-08-11T12:22:08.068459+0000","last_active":"2023-08-11T12:22:31.721751+0000","last_peered":"2023-08-11T12:22:31.721751+0000","last_clean":"2023-08-11T12:22:31.721751+0000","last_became_active":"2023-08-11T12:22:08.067857+0000","last_became_peered":"2023-08-11T12:22:08.067857+0000","last_unstale":"2023-08-11T12:22:31.721751+0000","last_undegraded":"2023-08-11T12:22:31.721751+0000","last_fullsized":"2023-08-11T12:22:31.721751+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:15:05.931547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774122+0000","last_change":"2023-08-11T12:22:02.846441+0000","last_active":"2023-08-11T12:22:31.774122+0000","last_peered":"2023-08-11T12:22:31.774122+0000","last_clean":"2023-08-11T12:22:31.774122+0000","last_became_active":"2023-08-11T12:22:02.846153+0000","last_became_peered":"2023-08-11T12:22:02.846153+0000","last_unstale":"2023-08-11T12:22:31.774122+0000","last_undegraded":"2023-08-11T12:22:31.774122+0000","last_fullsized":"2023-08-11T12:22:31.774122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:00:55.631058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723349+0000","last_change":"2023-08-11T12:22:03.841932+0000","last_active":"2023-08-11T12:22:31.723349+0000","last_peered":"2023-08-11T12:22:31.723349+0000","last_clean":"2023-08-11T12:22:31.723349+0000","last_became_active":"2023-08-11T12:22:03.841635+0000","last_became_peered":"2023-08-11T12:22:03.841635+0000","last_unstale":"2023-08-11T12:22:31.723349+0000","last_undegraded":"2023-08-11T12:22:31.723349+0000","last_fullsized":"2023-08-11T12:22:31.723349+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:01:57.888877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722748+0000","last_change":"2023-08-11T12:22:07.886160+0000","last_active":"2023-08-11T12:22:31.722748+0000","last_peered":"2023-08-11T12:22:31.722748+0000","last_clean":"2023-08-11T12:22:31.722748+0000","last_became_active":"2023-08-11T12:22:07.885703+0000","last_became_peered":"2023-08-11T12:22:07.885703+0000","last_unstale":"2023-08-11T12:22:31.722748+0000","last_undegraded":"2023-08-11T12:22:31.722748+0000","last_fullsized":"2023-08-11T12:22:31.722748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:50:20.362829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720503+0000","last_change":"2023-08-11T12:22:02.849360+0000","last_active":"2023-08-11T12:22:31.720503+0000","last_peered":"2023-08-11T12:22:31.720503+0000","last_clean":"2023-08-11T12:22:31.720503+0000","last_became_active":"2023-08-11T12:22:02.849028+0000","last_became_peered":"2023-08-11T12:22:02.849028+0000","last_unstale":"2023-08-11T12:22:31.720503+0000","last_undegraded":"2023-08-11T12:22:31.720503+0000","last_fullsized":"2023-08-11T12:22:31.720503+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:55:24.114464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719824+0000","last_change":"2023-08-11T12:22:03.850285+0000","last_active":"2023-08-11T12:22:31.719824+0000","last_peered":"2023-08-11T12:22:31.719824+0000","last_clean":"2023-08-11T12:22:31.719824+0000","last_became_active":"2023-08-11T12:22:03.849978+0000","last_became_peered":"2023-08-11T12:22:03.849978+0000","last_unstale":"2023-08-11T12:22:31.719824+0000","last_undegraded":"2023-08-11T12:22:31.719824+0000","last_fullsized":"2023-08-11T12:22:31.719824+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:29:51.679282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721058+0000","last_change":"2023-08-11T12:22:07.881578+0000","last_active":"2023-08-11T12:22:31.721058+0000","last_peered":"2023-08-11T12:22:31.721058+0000","last_clean":"2023-08-11T12:22:31.721058+0000","last_became_active":"2023-08-11T12:22:07.881145+0000","last_became_peered":"2023-08-11T12:22:07.881145+0000","last_unstale":"2023-08-11T12:22:31.721058+0000","last_undegraded":"2023-08-11T12:22:31.721058+0000","last_fullsized":"2023-08-11T12:22:31.721058+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:32:16.462208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:33.797689+0000","last_change":"2023-08-11T12:22:02.848875+0000","last_active":"2023-08-11T12:22:33.797689+0000","last_peered":"2023-08-11T12:22:33.797689+0000","last_clean":"2023-08-11T12:22:33.797689+0000","last_became_active":"2023-08-11T12:22:02.848578+0000","last_became_peered":"2023-08-11T12:22:02.848578+0000","last_unstale":"2023-08-11T12:22:33.797689+0000","last_undegraded":"2023-08-11T12:22:33.797689+0000","last_fullsized":"2023-08-11T12:22:33.797689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:29:40.949795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721051+0000","last_change":"2023-08-11T12:22:03.849865+0000","last_active":"2023-08-11T12:22:31.721051+0000","last_peered":"2023-08-11T12:22:31.721051+0000","last_clean":"2023-08-11T12:22:31.721051+0000","last_became_active":"2023-08-11T12:22:03.849557+0000","last_became_peered":"2023-08-11T12:22:03.849557+0000","last_unstale":"2023-08-11T12:22:31.721051+0000","last_undegraded":"2023-08-11T12:22:31.721051+0000","last_fullsized":"2023-08-11T12:22:31.721051+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:49:27.142464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721537+0000","last_change":"2023-08-11T12:22:08.067009+0000","last_active":"2023-08-11T12:22:31.721537+0000","last_peered":"2023-08-11T12:22:31.721537+0000","last_clean":"2023-08-11T12:22:31.721537+0000","last_became_active":"2023-08-11T12:22:08.066477+0000","last_became_peered":"2023-08-11T12:22:08.066477+0000","last_unstale":"2023-08-11T12:22:31.721537+0000","last_undegraded":"2023-08-11T12:22:31.721537+0000","last_fullsized":"2023-08-11T12:22:31.721537+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:07:02.380225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.731106+0000","last_change":"2023-08-11T12:22:31.731106+0000","last_active":"2023-08-11T12:22:31.731106+0000","last_peered":"2023-08-11T12:22:31.731106+0000","last_clean":"2023-08-11T12:22:31.731106+0000","last_became_active":"2023-08-11T12:22:31.724944+0000","last_became_peered":"2023-08-11T12:22:31.724944+0000","last_unstale":"2023-08-11T12:22:31.731106+0000","last_undegraded":"2023-08-11T12:22:31.731106+0000","last_fullsized":"2023-08-11T12:22:31.731106+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:56:41.188015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718051+0000","last_change":"2023-08-11T12:22:03.848715+0000","last_active":"2023-08-11T12:22:31.718051+0000","last_peered":"2023-08-11T12:22:31.718051+0000","last_clean":"2023-08-11T12:22:31.718051+0000","last_became_active":"2023-08-11T12:22:03.848311+0000","last_became_peered":"2023-08-11T12:22:03.848311+0000","last_unstale":"2023-08-11T12:22:31.718051+0000","last_undegraded":"2023-08-11T12:22:31.718051+0000","last_fullsized":"2023-08-11T12:22:31.718051+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:45:14.152855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774112+0000","last_change":"2023-08-11T12:22:07.882566+0000","last_active":"2023-08-11T12:22:31.774112+0000","last_peered":"2023-08-11T12:22:31.774112+0000","last_clean":"2023-08-11T12:22:31.774112+0000","last_became_active":"2023-08-11T12:22:07.882198+0000","last_became_peered":"2023-08-11T12:22:07.882198+0000","last_unstale":"2023-08-11T12:22:31.774112+0000","last_undegraded":"2023-08-11T12:22:31.774112+0000","last_fullsized":"2023-08-11T12:22:31.774112+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:21:03.227408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"87'5","reported_seq":85,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:23:22.809651+0000","last_change":"2023-08-11T12:22:02.846424+0000","last_active":"2023-08-11T12:23:22.809651+0000","last_peered":"2023-08-11T12:23:22.809651+0000","last_clean":"2023-08-11T12:23:22.809651+0000","last_became_active":"2023-08-11T12:22:02.846063+0000","last_became_peered":"2023-08-11T12:22:02.846063+0000","last_unstale":"2023-08-11T12:23:22.809651+0000","last_undegraded":"2023-08-11T12:23:22.809651+0000","last_fullsized":"2023-08-11T12:23:22.809651+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:28:14.946971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717852+0000","last_change":"2023-08-11T12:22:03.845616+0000","last_active":"2023-08-11T12:22:31.717852+0000","last_peered":"2023-08-11T12:22:31.717852+0000","last_clean":"2023-08-11T12:22:31.717852+0000","last_became_active":"2023-08-11T12:22:03.845293+0000","last_became_peered":"2023-08-11T12:22:03.845293+0000","last_unstale":"2023-08-11T12:22:31.717852+0000","last_undegraded":"2023-08-11T12:22:31.717852+0000","last_fullsized":"2023-08-11T12:22:31.717852+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:28:30.374044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718737+0000","last_change":"2023-08-11T12:22:07.888963+0000","last_active":"2023-08-11T12:22:31.718737+0000","last_peered":"2023-08-11T12:22:31.718737+0000","last_clean":"2023-08-11T12:22:31.718737+0000","last_became_active":"2023-08-11T12:22:07.888513+0000","last_became_peered":"2023-08-11T12:22:07.888513+0000","last_unstale":"2023-08-11T12:22:31.718737+0000","last_undegraded":"2023-08-11T12:22:31.718737+0000","last_fullsized":"2023-08-11T12:22:31.718737+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:44:29.823122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800936+0000","last_change":"2023-08-11T12:22:02.850739+0000","last_active":"2023-08-11T12:22:31.800936+0000","last_peered":"2023-08-11T12:22:31.800936+0000","last_clean":"2023-08-11T12:22:31.800936+0000","last_became_active":"2023-08-11T12:22:02.850455+0000","last_became_peered":"2023-08-11T12:22:02.850455+0000","last_unstale":"2023-08-11T12:22:31.800936+0000","last_undegraded":"2023-08-11T12:22:31.800936+0000","last_fullsized":"2023-08-11T12:22:31.800936+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:37:48.954343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718121+0000","last_change":"2023-08-11T12:22:03.838834+0000","last_active":"2023-08-11T12:22:31.718121+0000","last_peered":"2023-08-11T12:22:31.718121+0000","last_clean":"2023-08-11T12:22:31.718121+0000","last_became_active":"2023-08-11T12:22:03.838435+0000","last_became_peered":"2023-08-11T12:22:03.838435+0000","last_unstale":"2023-08-11T12:22:31.718121+0000","last_undegraded":"2023-08-11T12:22:31.718121+0000","last_fullsized":"2023-08-11T12:22:31.718121+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:42:39.127547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.799908+0000","last_change":"2023-08-11T12:22:07.884481+0000","last_active":"2023-08-11T12:22:31.799908+0000","last_peered":"2023-08-11T12:22:31.799908+0000","last_clean":"2023-08-11T12:22:31.799908+0000","last_became_active":"2023-08-11T12:22:07.884084+0000","last_became_peered":"2023-08-11T12:22:07.884084+0000","last_unstale":"2023-08-11T12:22:31.799908+0000","last_undegraded":"2023-08-11T12:22:31.799908+0000","last_fullsized":"2023-08-11T12:22:31.799908+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:06:29.852022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717356+0000","last_change":"2023-08-11T12:22:02.849339+0000","last_active":"2023-08-11T12:22:31.717356+0000","last_peered":"2023-08-11T12:22:31.717356+0000","last_clean":"2023-08-11T12:22:31.717356+0000","last_became_active":"2023-08-11T12:22:02.848986+0000","last_became_peered":"2023-08-11T12:22:02.848986+0000","last_unstale":"2023-08-11T12:22:31.717356+0000","last_undegraded":"2023-08-11T12:22:31.717356+0000","last_fullsized":"2023-08-11T12:22:31.717356+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:00:28.458884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718009+0000","last_change":"2023-08-11T12:22:03.846301+0000","last_active":"2023-08-11T12:22:31.718009+0000","last_peered":"2023-08-11T12:22:31.718009+0000","last_clean":"2023-08-11T12:22:31.718009+0000","last_became_active":"2023-08-11T12:22:03.845990+0000","last_became_peered":"2023-08-11T12:22:03.845990+0000","last_unstale":"2023-08-11T12:22:31.718009+0000","last_undegraded":"2023-08-11T12:22:31.718009+0000","last_fullsized":"2023-08-11T12:22:31.718009+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:30:23.134555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719713+0000","last_change":"2023-08-11T12:22:03.836652+0000","last_active":"2023-08-11T12:22:31.719713+0000","last_peered":"2023-08-11T12:22:31.719713+0000","last_clean":"2023-08-11T12:22:31.719713+0000","last_became_active":"2023-08-11T12:22:03.836236+0000","last_became_peered":"2023-08-11T12:22:03.836236+0000","last_unstale":"2023-08-11T12:22:31.719713+0000","last_undegraded":"2023-08-11T12:22:31.719713+0000","last_fullsized":"2023-08-11T12:22:31.719713+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:15:43.477085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722669+0000","last_change":"2023-08-11T12:22:03.831318+0000","last_active":"2023-08-11T12:22:31.722669+0000","last_peered":"2023-08-11T12:22:31.722669+0000","last_clean":"2023-08-11T12:22:31.722669+0000","last_became_active":"2023-08-11T12:22:03.830670+0000","last_became_peered":"2023-08-11T12:22:03.830670+0000","last_unstale":"2023-08-11T12:22:31.722669+0000","last_undegraded":"2023-08-11T12:22:31.722669+0000","last_fullsized":"2023-08-11T12:22:31.722669+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:27:54.407934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722460+0000","last_change":"2023-08-11T12:22:03.841396+0000","last_active":"2023-08-11T12:22:31.722460+0000","last_peered":"2023-08-11T12:22:31.722460+0000","last_clean":"2023-08-11T12:22:31.722460+0000","last_became_active":"2023-08-11T12:22:03.841076+0000","last_became_peered":"2023-08-11T12:22:03.841076+0000","last_unstale":"2023-08-11T12:22:31.722460+0000","last_undegraded":"2023-08-11T12:22:31.722460+0000","last_fullsized":"2023-08-11T12:22:31.722460+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:14:14.365513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719065+0000","last_change":"2023-08-11T12:22:03.847266+0000","last_active":"2023-08-11T12:22:31.719065+0000","last_peered":"2023-08-11T12:22:31.719065+0000","last_clean":"2023-08-11T12:22:31.719065+0000","last_became_active":"2023-08-11T12:22:03.846898+0000","last_became_peered":"2023-08-11T12:22:03.846898+0000","last_unstale":"2023-08-11T12:22:31.719065+0000","last_undegraded":"2023-08-11T12:22:31.719065+0000","last_fullsized":"2023-08-11T12:22:31.719065+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:05:00.055352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717696+0000","last_change":"2023-08-11T12:22:03.843491+0000","last_active":"2023-08-11T12:22:31.717696+0000","last_peered":"2023-08-11T12:22:31.717696+0000","last_clean":"2023-08-11T12:22:31.717696+0000","last_became_active":"2023-08-11T12:22:03.843099+0000","last_became_peered":"2023-08-11T12:22:03.843099+0000","last_unstale":"2023-08-11T12:22:31.717696+0000","last_undegraded":"2023-08-11T12:22:31.717696+0000","last_fullsized":"2023-08-11T12:22:31.717696+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:24:27.850492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720347+0000","last_change":"2023-08-11T12:22:03.840508+0000","last_active":"2023-08-11T12:22:31.720347+0000","last_peered":"2023-08-11T12:22:31.720347+0000","last_clean":"2023-08-11T12:22:31.720347+0000","last_became_active":"2023-08-11T12:22:03.840160+0000","last_became_peered":"2023-08-11T12:22:03.840160+0000","last_unstale":"2023-08-11T12:22:31.720347+0000","last_undegraded":"2023-08-11T12:22:31.720347+0000","last_fullsized":"2023-08-11T12:22:31.720347+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:09:11.925192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723599+0000","last_change":"2023-08-11T12:22:03.843724+0000","last_active":"2023-08-11T12:22:31.723599+0000","last_peered":"2023-08-11T12:22:31.723599+0000","last_clean":"2023-08-11T12:22:31.723599+0000","last_became_active":"2023-08-11T12:22:03.843431+0000","last_became_peered":"2023-08-11T12:22:03.843431+0000","last_unstale":"2023-08-11T12:22:31.723599+0000","last_undegraded":"2023-08-11T12:22:31.723599+0000","last_fullsized":"2023-08-11T12:22:31.723599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:02:15.971280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721778+0000","last_change":"2023-08-11T12:22:03.831268+0000","last_active":"2023-08-11T12:22:31.721778+0000","last_peered":"2023-08-11T12:22:31.721778+0000","last_clean":"2023-08-11T12:22:31.721778+0000","last_became_active":"2023-08-11T12:22:03.830839+0000","last_became_peered":"2023-08-11T12:22:03.830839+0000","last_unstale":"2023-08-11T12:22:31.721778+0000","last_undegraded":"2023-08-11T12:22:31.721778+0000","last_fullsized":"2023-08-11T12:22:31.721778+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:25:09.422026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800266+0000","last_change":"2023-08-11T12:22:03.839227+0000","last_active":"2023-08-11T12:22:31.800266+0000","last_peered":"2023-08-11T12:22:31.800266+0000","last_clean":"2023-08-11T12:22:31.800266+0000","last_became_active":"2023-08-11T12:22:03.838526+0000","last_became_peered":"2023-08-11T12:22:03.838526+0000","last_unstale":"2023-08-11T12:22:31.800266+0000","last_undegraded":"2023-08-11T12:22:31.800266+0000","last_fullsized":"2023-08-11T12:22:31.800266+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:56:06.609931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720671+0000","last_change":"2023-08-11T12:22:03.834614+0000","last_active":"2023-08-11T12:22:31.720671+0000","last_peered":"2023-08-11T12:22:31.720671+0000","last_clean":"2023-08-11T12:22:31.720671+0000","last_became_active":"2023-08-11T12:22:03.834267+0000","last_became_peered":"2023-08-11T12:22:03.834267+0000","last_unstale":"2023-08-11T12:22:31.720671+0000","last_undegraded":"2023-08-11T12:22:31.720671+0000","last_fullsized":"2023-08-11T12:22:31.720671+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:05:00.003830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774418+0000","last_change":"2023-08-11T12:22:03.846504+0000","last_active":"2023-08-11T12:22:31.774418+0000","last_peered":"2023-08-11T12:22:31.774418+0000","last_clean":"2023-08-11T12:22:31.774418+0000","last_became_active":"2023-08-11T12:22:03.846156+0000","last_became_peered":"2023-08-11T12:22:03.846156+0000","last_unstale":"2023-08-11T12:22:31.774418+0000","last_undegraded":"2023-08-11T12:22:31.774418+0000","last_fullsized":"2023-08-11T12:22:31.774418+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:54:38.654858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717285+0000","last_change":"2023-08-11T12:22:03.849854+0000","last_active":"2023-08-11T12:22:31.717285+0000","last_peered":"2023-08-11T12:22:31.717285+0000","last_clean":"2023-08-11T12:22:31.717285+0000","last_became_active":"2023-08-11T12:22:03.849553+0000","last_became_peered":"2023-08-11T12:22:03.849553+0000","last_unstale":"2023-08-11T12:22:31.717285+0000","last_undegraded":"2023-08-11T12:22:31.717285+0000","last_fullsized":"2023-08-11T12:22:31.717285+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:14:27.485150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720171+0000","last_change":"2023-08-11T12:22:03.843511+0000","last_active":"2023-08-11T12:22:31.720171+0000","last_peered":"2023-08-11T12:22:31.720171+0000","last_clean":"2023-08-11T12:22:31.720171+0000","last_became_active":"2023-08-11T12:22:03.843206+0000","last_became_peered":"2023-08-11T12:22:03.843206+0000","last_unstale":"2023-08-11T12:22:31.720171+0000","last_undegraded":"2023-08-11T12:22:31.720171+0000","last_fullsized":"2023-08-11T12:22:31.720171+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:19:44.978907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":248338,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10264,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":537,"num_read_kb":285,"num_write":209,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":30792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449117,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":484340,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.443,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":1.2989999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.48999999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.70899999999999996}]},{"osd":1,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.51000000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.41499999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77800000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.76500000000000001}]},{"osd":2,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.52500000000000002,"15min":0.53200000000000003},"min":{"1min":0.35599999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70899999999999996,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.33200000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79100000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":4,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.69899999999999995,"15min":0.69599999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89700000000000002,"5min":1.032,"15min":1.032},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.60999999999999999},"min":{"1min":0.46000000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.78100000000000003,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.629}]},{"osd":5,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.64900000000000002,"15min":0.66100000000000003},"min":{"1min":0.34799999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77500000000000002,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65900000000000003,"15min":0.65700000000000003},"min":{"1min":0.437,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.68700000000000006}]},{"osd":6,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.68400000000000005,"15min":0.69099999999999995},"min":{"1min":0.46500000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86499999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.98299999999999998,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.073}]},{"osd":7,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.79100000000000004,"15min":0.78700000000000003},"min":{"1min":0.55100000000000005,"5min":0.503,"15min":0.503},"max":{"1min":1.0229999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.751},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.56100000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.873,"5min":1.302,"15min":1.302},"last":0.73799999999999999}]},{"osd":8,"last update":"Fri Aug 11 12:23:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.80600000000000005}]},{"osd":9,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.61899999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.3380000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.81100000000000005,"15min":0.80500000000000005},"min":{"1min":0.59999999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.071,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.1499999999999999}]},{"osd":10,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.61299999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93000000000000005,"5min":1.341,"15min":1.341},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.82199999999999995,"15min":0.82399999999999995},"min":{"1min":0.59099999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.95099999999999996,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.873}]}]},{"osd":10,"up_from":71,"seq":304942678047,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1064960,"data_stored":1078813,"data_compressed":53533,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.63},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.42099999999999999}]},{"osd":1,"last update":"Fri Aug 11 12:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.48499999999999999,"15min":0.48299999999999998},"min":{"1min":0.36099999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65800000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.443},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.34300000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73799999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.38800000000000001}]},{"osd":2,"last update":"Fri Aug 11 12:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64000000000000001,"15min":0.63600000000000001},"min":{"1min":0.50700000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.85399999999999998,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.66200000000000003,"15min":0.65700000000000003},"min":{"1min":0.53800000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.80900000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.55900000000000005}]},{"osd":3,"last update":"Fri Aug 11 12:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.67400000000000004,"15min":0.68600000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.71999999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.72899999999999998,"15min":0.72599999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.85499999999999998,"5min":1.528,"15min":1.528},"last":0.58399999999999996}]},{"osd":4,"last update":"Fri Aug 11 12:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.624,"15min":0.62},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.624,"15min":0.628},"min":{"1min":0.33800000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.81999999999999995,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.47099999999999997}]},{"osd":5,"last update":"Fri Aug 11 12:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72299999999999998,"15min":0.72099999999999997},"min":{"1min":0.57599999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98499999999999999,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.747,"15min":0.74199999999999999},"min":{"1min":0.56899999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95699999999999996,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.67700000000000005}]},{"osd":6,"last update":"Fri Aug 11 12:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.80900000000000005,"15min":0.81200000000000006},"min":{"1min":0.55700000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.96899999999999997,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82199999999999995,"15min":0.81799999999999995},"min":{"1min":0.53000000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98899999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.70299999999999996}]},{"osd":7,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.59099999999999997}]},{"osd":8,"last update":"Fri Aug 11 12:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.84199999999999997,"15min":0.83599999999999997},"min":{"1min":0.68700000000000006,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.004,"5min":1.296,"15min":1.296},"last":0.751},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.85299999999999998,"15min":0.85499999999999998},"min":{"1min":0.68100000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.0409999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.57099999999999995}]},{"osd":9,"last update":"Fri Aug 11 12:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.88300000000000001,"15min":0.879},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0589999999999999,"5min":1.21,"15min":1.21},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.86099999999999999,"15min":0.86499999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.996,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.62}]},{"osd":11,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.86099999999999999,"15min":0.86499999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0900000000000001,"5min":1.323,"15min":1.323},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.86499999999999999,"15min":0.85899999999999999},"min":{"1min":0.61099999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0549999999999999,"5min":1.341,"15min":1.341},"last":0.81100000000000005}]}]},{"osd":9,"up_from":66,"seq":283467841572,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":484270,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.38500000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77300000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.65500000000000003}]},{"osd":1,"last update":"Fri Aug 11 12:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.746,"15min":0.753},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83799999999999997,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64000000000000001,"15min":0.63700000000000001},"min":{"1min":0.42899999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86499999999999999,"5min":1.024,"15min":1.024},"last":0.79300000000000004}]},{"osd":2,"last update":"Fri Aug 11 12:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78200000000000003,"15min":0.78900000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96999999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.75,"15min":0.76000000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.96199999999999997,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.67800000000000005}]},{"osd":3,"last update":"Fri Aug 11 12:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.71199999999999997,"15min":0.73999999999999999},"min":{"1min":0.41299999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75900000000000001,"5min":1.355,"15min":1.355},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.76000000000000001,"15min":0.79000000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.74399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.63100000000000001}]},{"osd":4,"last update":"Fri Aug 11 12:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.748,"15min":0.752},"min":{"1min":0.56799999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.89700000000000002,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.81899999999999995,"15min":0.82899999999999996},"min":{"1min":0.64200000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.96499999999999997,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.81999999999999995}]},{"osd":5,"last update":"Fri Aug 11 12:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.89700000000000002,"15min":0.92300000000000004},"min":{"1min":0.54100000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.0620000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.90700000000000003,"15min":0.92900000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1060000000000001,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.81000000000000005}]},{"osd":6,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Aug 11 12:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.94099999999999995,"15min":0.95899999999999996},"min":{"1min":0.69399999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":0.98899999999999999,"5min":1.163,"15min":1.163},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.98899999999999999,"15min":1.0129999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.97299999999999998,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.84899999999999998}]},{"osd":8,"last update":"Fri Aug 11 12:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.95399999999999996,"15min":0.97799999999999998},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.085,"5min":1.319,"15min":1.319},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.97999999999999998,"15min":1.002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.86199999999999999}]},{"osd":10,"last update":"Fri Aug 11 12:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.95599999999999996,"15min":0.97399999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.0589999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.878}]},{"osd":11,"last update":"Fri Aug 11 12:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.90800000000000003}]}]},{"osd":8,"up_from":58,"seq":249108103210,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":484648,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:23:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":0.70799999999999996,"15min":0.59099999999999997},"min":{"1min":0.432,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":12.307,"5min":12.307,"15min":12.307},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.42799999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.81100000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.45000000000000001}]},{"osd":1,"last update":"Fri Aug 11 12:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.60999999999999999,"15min":0.59899999999999998},"min":{"1min":0.437,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89800000000000002,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61699999999999999,"15min":0.60499999999999998},"min":{"1min":0.41999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.89500000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54100000000000004}]},{"osd":2,"last update":"Fri Aug 11 12:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.45300000000000001,"15min":0.432},"min":{"1min":0.32900000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.68500000000000005,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.46800000000000003,"15min":0.44500000000000001},"min":{"1min":0.39000000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66000000000000003,"5min":0.878,"15min":0.878},"last":0.376}]},{"osd":3,"last update":"Fri Aug 11 12:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.68100000000000005,"15min":0.65300000000000002},"min":{"1min":0.39000000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":4.2599999999999998,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.68799999999999994,"15min":0.63300000000000001},"min":{"1min":0.55100000000000005,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":4.0970000000000004,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":0.629}]},{"osd":4,"last update":"Fri Aug 11 12:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.64600000000000002,"15min":0.622},"min":{"1min":0.50800000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67300000000000004,"15min":0.65500000000000003},"min":{"1min":0.505,"5min":0.432,"15min":0.432},"max":{"1min":0.94199999999999995,"5min":1.107,"15min":1.107},"last":0.89400000000000002}]},{"osd":5,"last update":"Fri Aug 11 12:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.56699999999999995,"15min":0.53700000000000003},"min":{"1min":0.44,"5min":0.309,"15min":0.309},"max":{"1min":0.93000000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.60199999999999998,"15min":0.57099999999999995},"min":{"1min":0.41699999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.92200000000000004,"5min":1.177,"15min":1.177},"last":0.65600000000000003}]},{"osd":6,"last update":"Fri Aug 11 12:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.748,"15min":0.70199999999999996},"min":{"1min":0.62,"5min":0.441,"15min":0.441},"max":{"1min":3.1709999999999998,"5min":3.1709999999999998,"15min":3.1709999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.78200000000000003,"15min":0.73399999999999999},"min":{"1min":0.65400000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":4.1180000000000003,"5min":4.1180000000000003,"15min":4.1180000000000003},"last":0.48699999999999999}]},{"osd":7,"last update":"Fri Aug 11 12:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.72899999999999998,"15min":0.69799999999999995},"min":{"1min":0.60199999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97399999999999998,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.74399999999999999,"15min":0.71999999999999997},"min":{"1min":0.58099999999999996,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.071,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.77300000000000002}]},{"osd":9,"last update":"Fri Aug 11 12:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.78400000000000003,"15min":0.76800000000000002},"min":{"1min":0.63,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.874,"5min":0.80100000000000005,"15min":0.78900000000000003},"min":{"1min":0.622,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.78800000000000003}]},{"osd":10,"last update":"Fri Aug 11 12:22:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.78200000000000003,"15min":0.76400000000000001},"min":{"1min":0.627,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.80100000000000005,"15min":0.78400000000000003},"min":{"1min":0.65500000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.86799999999999999}]},{"osd":11,"last update":"Fri Aug 11 12:23:07 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.75600000000000001}]}]},{"osd":7,"up_from":51,"seq":219043332141,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1040384,"data_stored":1076385,"data_compressed":53533,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.61399999999999999,"15min":0.60599999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.55200000000000005,"15min":0.53700000000000003},"min":{"1min":0.46999999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.65700000000000003}]},{"osd":1,"last update":"Fri Aug 11 12:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.42799999999999999,"15min":0.40600000000000003},"min":{"1min":0.35899999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.65400000000000003,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.442},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.46800000000000003,"15min":0.44800000000000001},"min":{"1min":0.34699999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72099999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.41399999999999998}]},{"osd":2,"last update":"Fri Aug 11 12:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61299999999999999,"15min":0.60499999999999998},"min":{"1min":0.44600000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79000000000000004,"5min":0.879,"15min":0.879},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.61099999999999999,"15min":0.58699999999999997},"min":{"1min":0.48499999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.75800000000000001}]},{"osd":3,"last update":"Fri Aug 11 12:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.63400000000000001,"15min":0.61299999999999999},"min":{"1min":0.50800000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.70899999999999996,"15min":0.64900000000000002},"min":{"1min":0.48099999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":5.8419999999999996,"5min":5.8419999999999996,"15min":5.8419999999999996},"last":0.58899999999999997}]},{"osd":4,"last update":"Fri Aug 11 12:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.55700000000000005,"15min":0.54000000000000004},"min":{"1min":0.41999999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80700000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.38500000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.89300000000000002,"5min":1.105,"15min":1.105},"last":0.50600000000000001}]},{"osd":5,"last update":"Fri Aug 11 12:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.67300000000000004,"15min":0.65900000000000003},"min":{"1min":0.50600000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.86199999999999999,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.68200000000000005,"15min":0.66200000000000003},"min":{"1min":0.55700000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.69099999999999995}]},{"osd":6,"last update":"Fri Aug 11 12:22:56 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.80200000000000005,"15min":0.73999999999999999},"min":{"1min":0.59399999999999997,"5min":0.503,"15min":0.503},"max":{"1min":5.7199999999999998,"5min":5.7199999999999998,"15min":5.7199999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.73599999999999999,"15min":0.69599999999999995},"min":{"1min":0.56399999999999995,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.629}]},{"osd":8,"last update":"Fri Aug 11 12:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.73499999999999999,"15min":0.69499999999999995},"min":{"1min":0.60299999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1830000000000001,"5min":1.206,"15min":1.206},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.72099999999999997,"15min":0.68899999999999995},"min":{"1min":0.57699999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.97199999999999998,"5min":1.018,"15min":1.018},"last":0.78600000000000003}]},{"osd":9,"last update":"Fri Aug 11 12:22:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.83599999999999997,"15min":0.84199999999999997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.0049999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.83899999999999997,"15min":0.84499999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.98599999999999999,"5min":1.087,"15min":1.087},"last":0.82099999999999995}]},{"osd":10,"last update":"Fri Aug 11 12:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.82299999999999995,"15min":0.81799999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.77600000000000002,"15min":0.76400000000000001},"min":{"1min":0.61399999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98199999999999998,"5min":1.036,"15min":1.036},"last":0.89600000000000002}]},{"osd":11,"last update":"Fri Aug 11 12:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.94799999999999995}]}]},{"osd":6,"up_from":46,"seq":197568495668,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":483870,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47499999999999998,"15min":0.46300000000000002},"min":{"1min":0.37,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.73599999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51800000000000002,"15min":0.50800000000000001},"min":{"1min":0.375,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61599999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.41799999999999998}]},{"osd":1,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.65400000000000003,"15min":0.63},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.878,"5min":1.327,"15min":1.327},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.69199999999999995,"15min":0.67500000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98599999999999999,"5min":1.206,"15min":1.206},"last":0.83299999999999996}]},{"osd":2,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.69199999999999995,"15min":0.68799999999999994},"min":{"1min":0.51000000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98399999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.70599999999999996,"15min":0.69299999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.63400000000000001}]},{"osd":3,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59699999999999998,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67400000000000004,"15min":0.66200000000000003},"min":{"1min":0.48499999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.05,"5min":1.196,"15min":1.196},"last":0.53000000000000003}]},{"osd":4,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69799999999999995,"15min":0.69599999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97199999999999998,"5min":1.139,"15min":1.139},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.752,"15min":0.74099999999999999},"min":{"1min":0.52600000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.012,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.96399999999999997}]},{"osd":5,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.77800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56599999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1499999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80600000000000005,"15min":0.80500000000000005},"min":{"1min":0.59299999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0109999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.72399999999999998}]},{"osd":7,"last update":"Fri Aug 11 12:22:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.82599999999999996,"15min":0.80800000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.097,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.81699999999999995,"15min":0.81200000000000006},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0840000000000001,"5min":1.222,"15min":1.222},"last":0.85699999999999998}]},{"osd":8,"last update":"Fri Aug 11 12:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.84599999999999997,"15min":0.84199999999999997},"min":{"1min":0.66300000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.745},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.89500000000000002,"15min":0.89100000000000001},"min":{"1min":0.80000000000000004,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.0569999999999999}]},{"osd":9,"last update":"Fri Aug 11 12:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.90300000000000002,"15min":0.90900000000000003},"min":{"1min":0.58799999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2250000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.876},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.91900000000000004,"15min":0.92100000000000004},"min":{"1min":0.61699999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2190000000000001,"5min":1.246,"15min":1.246},"last":1.1100000000000001}]},{"osd":10,"last update":"Fri Aug 11 12:22:55 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.89300000000000002,"15min":0.89400000000000002},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1799999999999999,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.012},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.4139999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.0309999999999999}]},{"osd":11,"last update":"Fri Aug 11 12:23:07 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":1.153}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":488742,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54700000000000004,"15min":0.51700000000000002},"min":{"1min":0.34699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.81899999999999995,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.32600000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.75700000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.42499999999999999}]},{"osd":2,"last update":"Fri Aug 11 12:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.58999999999999997,"15min":0.54200000000000004},"min":{"1min":0.504,"5min":0.315,"15min":0.315},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.57099999999999995,"15min":0.52200000000000002},"min":{"1min":0.41399999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.81499999999999995,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.57699999999999996}]},{"osd":3,"last update":"Fri Aug 11 12:22:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80700000000000005,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65600000000000003,"15min":0.63200000000000001},"min":{"1min":0.49099999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90600000000000003,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.70599999999999996}]},{"osd":4,"last update":"Fri Aug 11 12:22:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.48799999999999999,"15min":0.45400000000000001},"min":{"1min":0.36199999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.495,"15min":0.47899999999999998},"min":{"1min":0.33800000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.82799999999999996,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.45600000000000002}]},{"osd":5,"last update":"Fri Aug 11 12:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.68000000000000005,"15min":0.625},"min":{"1min":0.70099999999999996,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.64000000000000001,"15min":0.61199999999999999},"min":{"1min":0.55300000000000005,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.874,"5min":0.875,"15min":0.875},"last":0.73599999999999999}]},{"osd":6,"last update":"Fri Aug 11 12:22:31 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.73299999999999998,"15min":0.73599999999999999},"min":{"1min":0.59299999999999997,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0720000000000001,"5min":1.095,"15min":1.095},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.79600000000000004,"15min":0.78800000000000003},"min":{"1min":0.57999999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.147,"5min":1.159,"15min":1.159},"last":0.83699999999999997}]},{"osd":7,"last update":"Fri Aug 11 12:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.70099999999999996,"15min":0.68300000000000005},"min":{"1min":0.43099999999999999,"5min":0.31,"15min":0.31},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.69699999999999995,"15min":0.68400000000000005},"min":{"1min":0.54500000000000004,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.76000000000000001}]},{"osd":8,"last update":"Fri Aug 11 12:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.76900000000000002,"15min":0.73599999999999999},"min":{"1min":0.72699999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.79200000000000004,"15min":0.747},"min":{"1min":0.57499999999999996,"5min":0.436,"15min":0.436},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.996}]},{"osd":9,"last update":"Fri Aug 11 12:22:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.75800000000000001,"15min":0.752},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.88,"5min":0.82099999999999995,"15min":0.81100000000000005},"min":{"1min":0.61399999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.871}]},{"osd":10,"last update":"Fri Aug 11 12:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.82999999999999996,"15min":0.80200000000000005},"min":{"1min":0.623,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.78600000000000003,"15min":0.77600000000000002},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.91600000000000004}]},{"osd":11,"last update":"Fri Aug 11 12:23:06 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.85399999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":485326,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 11 12:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.61099999999999999,"15min":0.53900000000000003},"min":{"1min":0.40200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.93100000000000005,"5min":1.782,"15min":1.782},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.623,"15min":0.55000000000000004},"min":{"1min":0.45900000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.92600000000000005,"5min":2.7749999999999999,"15min":2.7749999999999999},"last":0.90500000000000003}]},{"osd":2,"last update":"Fri Aug 11 12:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.623,"15min":0.56299999999999994},"min":{"1min":0.45400000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86099999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.66300000000000003,"15min":0.58799999999999997},"min":{"1min":0.53600000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.89000000000000001,"5min":1.879,"15min":1.879},"last":0.67500000000000004}]},{"osd":3,"last update":"Fri Aug 11 12:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.83199999999999996}]},{"osd":4,"last update":"Fri Aug 11 12:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68100000000000005,"15min":0.61899999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.04,"5min":1.849,"15min":1.849},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.70099999999999996,"15min":0.63900000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.872,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":0.95299999999999996}]},{"osd":5,"last update":"Fri Aug 11 12:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.74199999999999999,"15min":0.69799999999999995},"min":{"1min":0.56599999999999995,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.522,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75800000000000001,"15min":0.72299999999999998},"min":{"1min":0.56100000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2290000000000001,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.86399999999999999}]},{"osd":6,"last update":"Fri Aug 11 12:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97699999999999998,"5min":2.8839999999999999,"15min":2.8839999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.70999999999999996,"15min":0.71599999999999997},"min":{"1min":0.41299999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.95799999999999996,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.47499999999999998}]},{"osd":7,"last update":"Fri Aug 11 12:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":1.042},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.629}]},{"osd":8,"last update":"Fri Aug 11 12:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.82199999999999995,"15min":0.84199999999999997},"min":{"1min":0.57199999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0600000000000001,"5min":1.262,"15min":1.262},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.90500000000000003,"15min":0.93100000000000005},"min":{"1min":0.57799999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.5609999999999999,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.085}]},{"osd":9,"last update":"Fri Aug 11 12:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.85899999999999999,"15min":0.87},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0980000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.93999999999999995,"15min":0.95899999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0860000000000001,"5min":1.452,"15min":1.452},"last":0.93000000000000005}]},{"osd":10,"last update":"Fri Aug 11 12:22:57 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.93899999999999995,"15min":0.94599999999999995},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.1040000000000001,"5min":1.48,"15min":1.48},"last":1.1719999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.89100000000000001,"15min":0.89500000000000002},"min":{"1min":0.63200000000000001,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0800000000000001,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":1.234}]},{"osd":11,"last update":"Fri Aug 11 12:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.876,"15min":0.876},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1399999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.94999999999999996,"15min":0.94499999999999995},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.145}]}]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":488293,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63100000000000001,"15min":0.55100000000000005},"min":{"1min":0.38400000000000001,"5min":0.316,"15min":0.316},"max":{"1min":1.343,"5min":5.968,"15min":5.968},"last":0.44},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.40500000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.47799999999999998}]},{"osd":1,"last update":"Fri Aug 11 12:22:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.56799999999999995,"15min":0.51700000000000002},"min":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.58899999999999997,"15min":0.53600000000000003},"min":{"1min":0.45600000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.65900000000000003}]},{"osd":3,"last update":"Fri Aug 11 12:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.63200000000000001,"15min":0.60299999999999998},"min":{"1min":0.45500000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88900000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.64800000000000002,"15min":0.60699999999999998},"min":{"1min":0.47999999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86199999999999999,"5min":1.306,"15min":1.306},"last":0.67600000000000005}]},{"osd":4,"last update":"Fri Aug 11 12:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Aug 11 12:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.46400000000000002,"15min":0.435},"min":{"1min":0.374,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.66500000000000004,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.47999999999999998,"15min":0.45200000000000001},"min":{"1min":0.40600000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63400000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.77200000000000002}]},{"osd":6,"last update":"Fri Aug 11 12:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64000000000000001,"15min":0.624},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.66200000000000003,"15min":0.626},"min":{"1min":0.504,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.89500000000000002}]},{"osd":7,"last update":"Fri Aug 11 12:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.753},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.83799999999999997}]},{"osd":8,"last update":"Fri Aug 11 12:23:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.621,"15min":0.59499999999999997},"min":{"1min":0.44500000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91300000000000003,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.59699999999999998,"15min":0.56699999999999995},"min":{"1min":0.441,"5min":0.439,"15min":0.439},"max":{"1min":0.93200000000000005,"5min":1.325,"15min":1.325},"last":0.70299999999999996}]},{"osd":9,"last update":"Fri Aug 11 12:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.73899999999999999,"15min":0.72999999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.80300000000000005,"15min":0.80100000000000005},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.92100000000000004}]},{"osd":10,"last update":"Fri Aug 11 12:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.79100000000000004,"15min":0.78300000000000003},"min":{"1min":0.57899999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.83699999999999997,"15min":0.82899999999999996},"min":{"1min":0.65500000000000003,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.94599999999999995}]},{"osd":11,"last update":"Fri Aug 11 12:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.88}]}]},{"osd":3,"up_from":25,"seq":107374182464,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":483578,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.437,"15min":0.38700000000000001},"min":{"1min":0.33900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.46999999999999997,"15min":0.438},"min":{"1min":0.36299999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67300000000000004,"5min":1.006,"15min":1.006},"last":0.97299999999999998}]},{"osd":1,"last update":"Fri Aug 11 12:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64200000000000002,"15min":0.57399999999999995},"min":{"1min":0.48399999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.98599999999999999,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.63200000000000001,"15min":0.59299999999999997},"min":{"1min":0.45100000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92200000000000004,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.70499999999999996}]},{"osd":2,"last update":"Fri Aug 11 12:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.64700000000000002,"15min":0.61799999999999999},"min":{"1min":0.54600000000000004,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85099999999999998,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.69699999999999995,"15min":0.63},"min":{"1min":0.56299999999999994,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.95299999999999996}]},{"osd":4,"last update":"Fri Aug 11 12:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.66200000000000003,"15min":0.61599999999999999},"min":{"1min":0.48099999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88700000000000001,"5min":1.242,"15min":1.242},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72299999999999998,"15min":0.64900000000000002},"min":{"1min":0.51900000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.0029999999999999,"5min":1.073,"15min":1.073},"last":0.877}]},{"osd":5,"last update":"Fri Aug 11 12:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70699999999999996,"15min":0.65700000000000003},"min":{"1min":0.52100000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.996,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.73099999999999998,"15min":0.67600000000000005},"min":{"1min":0.54400000000000004,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.016,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.629}]},{"osd":6,"last update":"Fri Aug 11 12:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78000000000000003,"15min":0.76200000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0760000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.72399999999999998,"15min":0.71399999999999997},"min":{"1min":0.49099999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0309999999999999,"5min":1.056,"15min":1.056},"last":1.321}]},{"osd":7,"last update":"Fri Aug 11 12:22:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78900000000000003,"15min":0.76600000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.98399999999999999,"5min":1.131,"15min":1.131},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.90200000000000002,"15min":0.88600000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1619999999999999,"5min":1.361,"15min":1.361},"last":0.83699999999999997}]},{"osd":8,"last update":"Fri Aug 11 12:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":1.246},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":1.194}]},{"osd":9,"last update":"Fri Aug 11 12:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.97899999999999998,"15min":0.995},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.1579999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.298},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.92500000000000004,"15min":0.94299999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.113,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.161}]},{"osd":10,"last update":"Fri Aug 11 12:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.97999999999999998,"15min":0.996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1910000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.2809999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.96599999999999997,"15min":0.97899999999999998},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.214,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.89000000000000001}]},{"osd":11,"last update":"Fri Aug 11 12:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.365}]}]},{"osd":4,"up_from":33,"seq":141733920829,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":483848,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.39900000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.81599999999999995,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.41399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80900000000000005,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.72099999999999997}]},{"osd":1,"last update":"Fri Aug 11 12:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.42999999999999999,"15min":0.40400000000000003},"min":{"1min":0.29599999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.42299999999999999,"15min":0.38400000000000001},"min":{"1min":0.27700000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.82899999999999996}]},{"osd":2,"last update":"Fri Aug 11 12:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.63400000000000001,"15min":0.58499999999999996},"min":{"1min":0.39700000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.61799999999999999,"15min":0.56999999999999995},"min":{"1min":0.499,"5min":0.378,"15min":0.378},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.98499999999999999}]},{"osd":3,"last update":"Fri Aug 11 12:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.61299999999999999,"15min":0.57099999999999995},"min":{"1min":0.437,"5min":0.379,"15min":0.379},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.57399999999999995,"15min":0.56000000000000005},"min":{"1min":0.35999999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.71399999999999997}]},{"osd":5,"last update":"Fri Aug 11 12:23:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.624,"15min":0.57599999999999996},"min":{"1min":0.51200000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.66000000000000003,"15min":0.59299999999999997},"min":{"1min":0.59699999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.95499999999999996}]},{"osd":6,"last update":"Fri Aug 11 12:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.71399999999999997,"15min":0.69599999999999995},"min":{"1min":0.53400000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.879},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.63,"15min":0.61599999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.85899999999999999}]},{"osd":7,"last update":"Fri Aug 11 12:22:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.621,"15min":0.58299999999999996},"min":{"1min":0.38100000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.69099999999999995,"15min":0.64400000000000002},"min":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":1.01}]},{"osd":8,"last update":"Fri Aug 11 12:23:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.65700000000000003,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.006,"5min":1.016,"15min":1.016},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.80200000000000005,"15min":0.76200000000000001},"min":{"1min":0.65400000000000003,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":1.0940000000000001}]},{"osd":9,"last update":"Fri Aug 11 12:22:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.85199999999999998,"15min":0.84099999999999997},"min":{"1min":0.626,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.157},{"interface":"front","average":{"1min":0.874,"5min":0.83399999999999996,"15min":0.82799999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.143}]},{"osd":10,"last update":"Fri Aug 11 12:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.83799999999999997,"15min":0.83999999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":1.1779999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.746,"15min":0.749},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":1.032}]},{"osd":11,"last update":"Fri Aug 11 12:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.123}]}]},{"osd":5,"up_from":38,"seq":163208757304,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1056768,"data_stored":1076336,"data_compressed":53533,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:23:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.36299999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.627},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.56799999999999995}]},{"osd":1,"last update":"Fri Aug 11 12:23:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55600000000000005,"15min":0.54400000000000004},"min":{"1min":0.441,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77400000000000002,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.59499999999999997,"15min":0.56699999999999995},"min":{"1min":0.42799999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.88200000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.67600000000000005}]},{"osd":2,"last update":"Fri Aug 11 12:23:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.41399999999999998,"15min":0.40100000000000002},"min":{"1min":0.29899999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.441,"15min":0.40699999999999997},"min":{"1min":0.27900000000000003,"5min":0.248,"15min":0.248},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.51300000000000001}]},{"osd":3,"last update":"Fri Aug 11 12:23:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57299999999999995,"15min":0.56999999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.39700000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.89300000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.74399999999999999}]},{"osd":4,"last update":"Fri Aug 11 12:23:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.64100000000000001,"15min":0.60199999999999998},"min":{"1min":0.45800000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.95499999999999996,"5min":1.016,"15min":1.016},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.62,"15min":0.60599999999999998},"min":{"1min":0.41799999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85799999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.71099999999999997}]},{"osd":6,"last update":"Fri Aug 11 12:22:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.628,"15min":0.61299999999999999},"min":{"1min":0.434,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84999999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.69599999999999995,"15min":0.67300000000000004},"min":{"1min":0.48799999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.75700000000000001}]},{"osd":7,"last update":"Fri Aug 11 12:22:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.69799999999999995,"15min":0.67800000000000005},"min":{"1min":0.56899999999999995,"5min":0.438,"15min":0.438},"max":{"1min":0.91700000000000004,"5min":1.048,"15min":1.048},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68200000000000005,"15min":0.66800000000000004},"min":{"1min":0.50800000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89700000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.83999999999999997}]},{"osd":8,"last update":"Fri Aug 11 12:23:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.63200000000000001,"15min":0.60299999999999998},"min":{"1min":0.48199999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58199999999999996,"15min":0.56399999999999995},"min":{"1min":0.46100000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.77000000000000002}]},{"osd":9,"last update":"Fri Aug 11 12:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72999999999999998,"15min":0.73099999999999998},"min":{"1min":0.55000000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.88400000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.89600000000000002}]},{"osd":10,"last update":"Fri Aug 11 12:22:57 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.82299999999999995,"15min":0.81899999999999995},"min":{"1min":0.67500000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0169999999999999,"5min":1.083,"15min":1.083},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.76300000000000001,"15min":0.75900000000000001},"min":{"1min":0.61499999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.88100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34304,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34304,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":5578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-11T12:23:25.655 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph pg dump --format=json 2023-08-11T12:23:26.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:25 smithi008 ceph-mon[97158]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:23:26.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:25 smithi194 ceph-mon[130905]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:23:26.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:25 smithi045 ceph-mon[130284]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:23:26.428 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:23:27.289 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:26 smithi008 ceph-mon[97158]: pgmap v317: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-08-11T12:23:27.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:26 smithi194 ceph-mon[130905]: pgmap v317: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-08-11T12:23:27.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:26 smithi045 ceph-mon[130284]: pgmap v317: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-08-11T12:23:28.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.218+0000 7fcce02e0700 1 -- 172.21.15.8:0/3979596007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccd8072d50 msgr2=0x7fccd8073130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:28.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.218+0000 7fcce02e0700 1 --2- 172.21.15.8:0/3979596007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccd8072d50 0x7fccd8073130 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fccd4009990 tx=0x7fccd4009ca0 comp rx=0 tx=0).stop 2023-08-11T12:23:28.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.218+0000 7fcce02e0700 1 -- 172.21.15.8:0/3979596007 shutdown_connections 2023-08-11T12:23:28.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.218+0000 7fcce02e0700 1 --2- 172.21.15.8:0/3979596007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccd810d180 0x7fccd810f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:28.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.218+0000 7fcce02e0700 1 --2- 172.21.15.8:0/3979596007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccd8072d50 0x7fccd8073130 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:28.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.218+0000 7fcce02e0700 1 --2- 172.21.15.8:0/3979596007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccd8073670 0x7fccd810cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:28.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.218+0000 7fcce02e0700 1 -- 172.21.15.8:0/3979596007 >> 172.21.15.8:0/3979596007 conn(0x7fccd80fc410 msgr2=0x7fccd80fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:28.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.218+0000 7fcce02e0700 1 -- 172.21.15.8:0/3979596007 shutdown_connections 2023-08-11T12:23:28.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.218+0000 7fcce02e0700 1 -- 172.21.15.8:0/3979596007 wait complete. 2023-08-11T12:23:28.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.219+0000 7fcce02e0700 1 Processor -- start 2023-08-11T12:23:28.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.219+0000 7fcce02e0700 1 -- start start 2023-08-11T12:23:28.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.219+0000 7fcce02e0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccd8072d50 0x7fccd81008a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:28.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.220+0000 7fcce02e0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccd8073670 0x7fccd8100de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:28.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.220+0000 7fcce02e0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccd810d180 0x7fccd8101320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:28.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.220+0000 7fcce02e0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd81a93d0 con 0x7fccd8072d50 2023-08-11T12:23:28.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.220+0000 7fcce02e0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd81a9540 con 0x7fccd810d180 2023-08-11T12:23:28.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.220+0000 7fcce02e0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd81a9700 con 0x7fccd8073670 2023-08-11T12:23:28.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.220+0000 7fccde07c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccd8072d50 0x7fccd81008a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:28.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.220+0000 7fccde07c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccd8072d50 0x7fccd81008a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40512/0 (socket says 172.21.15.8:40512) 2023-08-11T12:23:28.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.220+0000 7fccde07c700 1 -- 172.21.15.8:0/1639913364 learned_addr learned my addr 172.21.15.8:0/1639913364 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:28.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.220+0000 7fccdd87b700 1 --2- 172.21.15.8:0/1639913364 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccd8073670 0x7fccd8100de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:28.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.220+0000 7fccde87d700 1 --2- 172.21.15.8:0/1639913364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccd810d180 0x7fccd8101320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:28.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.220+0000 7fccde07c700 1 -- 172.21.15.8:0/1639913364 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccd8073670 msgr2=0x7fccd8100de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:28.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.220+0000 7fccde07c700 1 --2- 172.21.15.8:0/1639913364 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccd8073670 0x7fccd8100de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:28.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.220+0000 7fccde07c700 1 -- 172.21.15.8:0/1639913364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccd810d180 msgr2=0x7fccd8101320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:28.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.220+0000 7fccde07c700 1 --2- 172.21.15.8:0/1639913364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccd810d180 0x7fccd8101320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:28.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.220+0000 7fccde07c700 1 -- 172.21.15.8:0/1639913364 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd40095f0 con 0x7fccd8072d50 2023-08-11T12:23:28.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.220+0000 7fccdd87b700 1 --2- 172.21.15.8:0/1639913364 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccd8073670 0x7fccd8100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:28.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.220+0000 7fccde87d700 1 --2- 172.21.15.8:0/1639913364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccd810d180 0x7fccd8101320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:23:28.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.221+0000 7fccde07c700 1 --2- 172.21.15.8:0/1639913364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccd8072d50 0x7fccd81008a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fccd4005910 tx=0x7fccd4005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:28.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.221+0000 7fcccf7fe700 1 -- 172.21.15.8:0/1639913364 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd401d070 con 0x7fccd8072d50 2023-08-11T12:23:28.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.221+0000 7fcce02e0700 1 -- 172.21.15.8:0/1639913364 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd81a9980 con 0x7fccd8072d50 2023-08-11T12:23:28.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.221+0000 7fcccf7fe700 1 -- 172.21.15.8:0/1639913364 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fccd4022470 con 0x7fccd8072d50 2023-08-11T12:23:28.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.221+0000 7fcccf7fe700 1 -- 172.21.15.8:0/1639913364 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd4017650 con 0x7fccd8072d50 2023-08-11T12:23:28.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.221+0000 7fcce02e0700 1 -- 172.21.15.8:0/1639913364 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd81a9e70 con 0x7fccd8072d50 2023-08-11T12:23:28.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.222+0000 7fcce02e0700 1 -- 172.21.15.8:0/1639913364 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd804e620 con 0x7fccd8072d50 2023-08-11T12:23:28.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.224+0000 7fcccf7fe700 1 -- 172.21.15.8:0/1639913364 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fccd40225e0 con 0x7fccd8072d50 2023-08-11T12:23:28.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.225+0000 7fcccf7fe700 1 --2- 172.21.15.8:0/1639913364 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fccc409ffd0 0x7fccc40a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:28.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.226+0000 7fcccf7fe700 1 -- 172.21.15.8:0/1639913364 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fccd40cc840 con 0x7fccd8072d50 2023-08-11T12:23:28.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.226+0000 7fccdd87b700 1 --2- 172.21.15.8:0/1639913364 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fccc409ffd0 0x7fccc40a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:28.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.226+0000 7fccdd87b700 1 --2- 172.21.15.8:0/1639913364 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fccc409ffd0 0x7fccc40a2490 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fccd8102090 tx=0x7fccc8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:28.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.234+0000 7fcccf7fe700 1 -- 172.21.15.8:0/1639913364 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fccd40962f0 con 0x7fccd8072d50 2023-08-11T12:23:28.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.439+0000 7fcce02e0700 1 -- 172.21.15.8:0/1639913364 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fccd8112d40 con 0x7fccc409ffd0 2023-08-11T12:23:28.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.452+0000 7fcccf7fe700 1 -- 172.21.15.8:0/1639913364 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426827 (secure 0 0 0) 0x7fccd8112d40 con 0x7fccc409ffd0 2023-08-11T12:23:28.462 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:23:28.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.458+0000 7fcce02e0700 1 -- 172.21.15.8:0/1639913364 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fccc409ffd0 msgr2=0x7fccc40a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:28.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.458+0000 7fcce02e0700 1 --2- 172.21.15.8:0/1639913364 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fccc409ffd0 0x7fccc40a2490 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fccd8102090 tx=0x7fccc8009260 comp rx=0 tx=0).stop 2023-08-11T12:23:28.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.458+0000 7fcce02e0700 1 -- 172.21.15.8:0/1639913364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccd8072d50 msgr2=0x7fccd81008a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:28.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.458+0000 7fcce02e0700 1 --2- 172.21.15.8:0/1639913364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccd8072d50 0x7fccd81008a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fccd4005910 tx=0x7fccd4005720 comp rx=0 tx=0).stop 2023-08-11T12:23:28.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.458+0000 7fcce02e0700 1 -- 172.21.15.8:0/1639913364 shutdown_connections 2023-08-11T12:23:28.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.458+0000 7fcce02e0700 1 --2- 172.21.15.8:0/1639913364 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fccc409ffd0 0x7fccc40a2490 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:28.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.458+0000 7fcce02e0700 1 --2- 172.21.15.8:0/1639913364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccd810d180 0x7fccd8101320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:28.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.458+0000 7fcce02e0700 1 --2- 172.21.15.8:0/1639913364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccd8072d50 0x7fccd81008a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:28.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.458+0000 7fcce02e0700 1 --2- 172.21.15.8:0/1639913364 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccd8073670 0x7fccd8100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:28.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.458+0000 7fcce02e0700 1 -- 172.21.15.8:0/1639913364 >> 172.21.15.8:0/1639913364 conn(0x7fccd80fc410 msgr2=0x7fccd810f360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:28.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.458+0000 7fcce02e0700 1 -- 172.21.15.8:0/1639913364 shutdown_connections 2023-08-11T12:23:28.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:28.458+0000 7fcce02e0700 1 -- 172.21.15.8:0/1639913364 wait complete. 2023-08-11T12:23:28.466 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-08-11T12:23:28.934 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2023-08-11T12:23:26.528278+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600632,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":698,"num_read_kb":419,"num_write":390,"num_write_kb":3005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":320,"ondisk_log_size":320,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336048,"kb_used_data":11796,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124605776,"statfs":{"total":1151940427776,"available":1151596314624,"internally_reserved":0,"allocated":12079104,"data_stored":7598449,"data_compressed":318882,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":65,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003119"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720907+0000","last_change":"2023-08-11T12:22:03.850538+0000","last_active":"2023-08-11T12:22:31.720907+0000","last_peered":"2023-08-11T12:22:31.720907+0000","last_clean":"2023-08-11T12:22:31.720907+0000","last_became_active":"2023-08-11T12:22:03.850220+0000","last_became_peered":"2023-08-11T12:22:03.850220+0000","last_unstale":"2023-08-11T12:22:31.720907+0000","last_undegraded":"2023-08-11T12:22:31.720907+0000","last_fullsized":"2023-08-11T12:22:31.720907+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:10:46.194341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719647+0000","last_change":"2023-08-11T12:22:03.843779+0000","last_active":"2023-08-11T12:22:31.719647+0000","last_peered":"2023-08-11T12:22:31.719647+0000","last_clean":"2023-08-11T12:22:31.719647+0000","last_became_active":"2023-08-11T12:22:03.843441+0000","last_became_peered":"2023-08-11T12:22:03.843441+0000","last_unstale":"2023-08-11T12:22:31.719647+0000","last_undegraded":"2023-08-11T12:22:31.719647+0000","last_fullsized":"2023-08-11T12:22:31.719647+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:51:42.363862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719082+0000","last_change":"2023-08-11T12:22:03.851996+0000","last_active":"2023-08-11T12:22:31.719082+0000","last_peered":"2023-08-11T12:22:31.719082+0000","last_clean":"2023-08-11T12:22:31.719082+0000","last_became_active":"2023-08-11T12:22:03.850821+0000","last_became_peered":"2023-08-11T12:22:03.850821+0000","last_unstale":"2023-08-11T12:22:31.719082+0000","last_undegraded":"2023-08-11T12:22:31.719082+0000","last_fullsized":"2023-08-11T12:22:31.719082+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:54:54.152911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722080+0000","last_change":"2023-08-11T12:22:03.842025+0000","last_active":"2023-08-11T12:22:31.722080+0000","last_peered":"2023-08-11T12:22:31.722080+0000","last_clean":"2023-08-11T12:22:31.722080+0000","last_became_active":"2023-08-11T12:22:03.841700+0000","last_became_peered":"2023-08-11T12:22:03.841700+0000","last_unstale":"2023-08-11T12:22:31.722080+0000","last_undegraded":"2023-08-11T12:22:31.722080+0000","last_fullsized":"2023-08-11T12:22:31.722080+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:13:45.519007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723174+0000","last_change":"2023-08-11T12:22:03.844908+0000","last_active":"2023-08-11T12:22:31.723174+0000","last_peered":"2023-08-11T12:22:31.723174+0000","last_clean":"2023-08-11T12:22:31.723174+0000","last_became_active":"2023-08-11T12:22:03.844674+0000","last_became_peered":"2023-08-11T12:22:03.844674+0000","last_unstale":"2023-08-11T12:22:31.723174+0000","last_undegraded":"2023-08-11T12:22:31.723174+0000","last_fullsized":"2023-08-11T12:22:31.723174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:10:22.657255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721437+0000","last_change":"2023-08-11T12:22:03.839915+0000","last_active":"2023-08-11T12:22:31.721437+0000","last_peered":"2023-08-11T12:22:31.721437+0000","last_clean":"2023-08-11T12:22:31.721437+0000","last_became_active":"2023-08-11T12:22:03.839099+0000","last_became_peered":"2023-08-11T12:22:03.839099+0000","last_unstale":"2023-08-11T12:22:31.721437+0000","last_undegraded":"2023-08-11T12:22:31.721437+0000","last_fullsized":"2023-08-11T12:22:31.721437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:51:17.642383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717754+0000","last_change":"2023-08-11T12:22:03.841591+0000","last_active":"2023-08-11T12:22:31.717754+0000","last_peered":"2023-08-11T12:22:31.717754+0000","last_clean":"2023-08-11T12:22:31.717754+0000","last_became_active":"2023-08-11T12:22:03.841232+0000","last_became_peered":"2023-08-11T12:22:03.841232+0000","last_unstale":"2023-08-11T12:22:31.717754+0000","last_undegraded":"2023-08-11T12:22:31.717754+0000","last_fullsized":"2023-08-11T12:22:31.717754+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:12:40.032896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720595+0000","last_change":"2023-08-11T12:22:03.839516+0000","last_active":"2023-08-11T12:22:31.720595+0000","last_peered":"2023-08-11T12:22:31.720595+0000","last_clean":"2023-08-11T12:22:31.720595+0000","last_became_active":"2023-08-11T12:22:03.839058+0000","last_became_peered":"2023-08-11T12:22:03.839058+0000","last_unstale":"2023-08-11T12:22:31.720595+0000","last_undegraded":"2023-08-11T12:22:31.720595+0000","last_fullsized":"2023-08-11T12:22:31.720595+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:01:10.744970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774871+0000","last_change":"2023-08-11T12:22:03.841033+0000","last_active":"2023-08-11T12:22:31.774871+0000","last_peered":"2023-08-11T12:22:31.774871+0000","last_clean":"2023-08-11T12:22:31.774871+0000","last_became_active":"2023-08-11T12:22:03.840665+0000","last_became_peered":"2023-08-11T12:22:03.840665+0000","last_unstale":"2023-08-11T12:22:31.774871+0000","last_undegraded":"2023-08-11T12:22:31.774871+0000","last_fullsized":"2023-08-11T12:22:31.774871+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:08:51.628782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721119+0000","last_change":"2023-08-11T12:22:03.839663+0000","last_active":"2023-08-11T12:22:31.721119+0000","last_peered":"2023-08-11T12:22:31.721119+0000","last_clean":"2023-08-11T12:22:31.721119+0000","last_became_active":"2023-08-11T12:22:03.838840+0000","last_became_peered":"2023-08-11T12:22:03.838840+0000","last_unstale":"2023-08-11T12:22:31.721119+0000","last_undegraded":"2023-08-11T12:22:31.721119+0000","last_fullsized":"2023-08-11T12:22:31.721119+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:28:57.495510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717811+0000","last_change":"2023-08-11T12:22:03.846288+0000","last_active":"2023-08-11T12:22:31.717811+0000","last_peered":"2023-08-11T12:22:31.717811+0000","last_clean":"2023-08-11T12:22:31.717811+0000","last_became_active":"2023-08-11T12:22:03.845962+0000","last_became_peered":"2023-08-11T12:22:03.845962+0000","last_unstale":"2023-08-11T12:22:31.717811+0000","last_undegraded":"2023-08-11T12:22:31.717811+0000","last_fullsized":"2023-08-11T12:22:31.717811+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:42:37.154687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.728022+0000","last_change":"2023-08-11T12:22:31.726774+0000","last_active":"2023-08-11T12:22:31.728022+0000","last_peered":"2023-08-11T12:22:31.728022+0000","last_clean":"2023-08-11T12:22:31.728022+0000","last_became_active":"2023-08-11T12:22:31.726437+0000","last_became_peered":"2023-08-11T12:22:31.726437+0000","last_unstale":"2023-08-11T12:22:31.728022+0000","last_undegraded":"2023-08-11T12:22:31.728022+0000","last_fullsized":"2023-08-11T12:22:31.728022+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:33:56.005318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717500+0000","last_change":"2023-08-11T12:22:03.842249+0000","last_active":"2023-08-11T12:22:31.717500+0000","last_peered":"2023-08-11T12:22:31.717500+0000","last_clean":"2023-08-11T12:22:31.717500+0000","last_became_active":"2023-08-11T12:22:03.841887+0000","last_became_peered":"2023-08-11T12:22:03.841887+0000","last_unstale":"2023-08-11T12:22:31.717500+0000","last_undegraded":"2023-08-11T12:22:31.717500+0000","last_fullsized":"2023-08-11T12:22:31.717500+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:24:16.685728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718746+0000","last_change":"2023-08-11T12:22:03.843859+0000","last_active":"2023-08-11T12:22:31.718746+0000","last_peered":"2023-08-11T12:22:31.718746+0000","last_clean":"2023-08-11T12:22:31.718746+0000","last_became_active":"2023-08-11T12:22:03.843383+0000","last_became_peered":"2023-08-11T12:22:03.843383+0000","last_unstale":"2023-08-11T12:22:31.718746+0000","last_undegraded":"2023-08-11T12:22:31.718746+0000","last_fullsized":"2023-08-11T12:22:31.718746+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:19:55.006972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.726241+0000","last_change":"2023-08-11T12:22:31.726241+0000","last_active":"2023-08-11T12:22:31.726241+0000","last_peered":"2023-08-11T12:22:31.726241+0000","last_clean":"2023-08-11T12:22:31.726241+0000","last_became_active":"2023-08-11T12:22:31.725852+0000","last_became_peered":"2023-08-11T12:22:31.725852+0000","last_unstale":"2023-08-11T12:22:31.726241+0000","last_undegraded":"2023-08-11T12:22:31.726241+0000","last_fullsized":"2023-08-11T12:22:31.726241+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:37:58.350171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774047+0000","last_change":"2023-08-11T12:22:03.850397+0000","last_active":"2023-08-11T12:22:31.774047+0000","last_peered":"2023-08-11T12:22:31.774047+0000","last_clean":"2023-08-11T12:22:31.774047+0000","last_became_active":"2023-08-11T12:22:03.850143+0000","last_became_peered":"2023-08-11T12:22:03.850143+0000","last_unstale":"2023-08-11T12:22:31.774047+0000","last_undegraded":"2023-08-11T12:22:31.774047+0000","last_fullsized":"2023-08-11T12:22:31.774047+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:13:22.558148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721002+0000","last_change":"2023-08-11T12:22:03.850496+0000","last_active":"2023-08-11T12:22:31.721002+0000","last_peered":"2023-08-11T12:22:31.721002+0000","last_clean":"2023-08-11T12:22:31.721002+0000","last_became_active":"2023-08-11T12:22:03.850192+0000","last_became_peered":"2023-08-11T12:22:03.850192+0000","last_unstale":"2023-08-11T12:22:31.721002+0000","last_undegraded":"2023-08-11T12:22:31.721002+0000","last_fullsized":"2023-08-11T12:22:31.721002+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:54:50.626326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722136+0000","last_change":"2023-08-11T12:22:03.841706+0000","last_active":"2023-08-11T12:22:31.722136+0000","last_peered":"2023-08-11T12:22:31.722136+0000","last_clean":"2023-08-11T12:22:31.722136+0000","last_became_active":"2023-08-11T12:22:03.841341+0000","last_became_peered":"2023-08-11T12:22:03.841341+0000","last_unstale":"2023-08-11T12:22:31.722136+0000","last_undegraded":"2023-08-11T12:22:31.722136+0000","last_fullsized":"2023-08-11T12:22:31.722136+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:36:20.093373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722972+0000","last_change":"2023-08-11T12:22:03.834450+0000","last_active":"2023-08-11T12:22:31.722972+0000","last_peered":"2023-08-11T12:22:31.722972+0000","last_clean":"2023-08-11T12:22:31.722972+0000","last_became_active":"2023-08-11T12:22:03.834154+0000","last_became_peered":"2023-08-11T12:22:03.834154+0000","last_unstale":"2023-08-11T12:22:31.722972+0000","last_undegraded":"2023-08-11T12:22:31.722972+0000","last_fullsized":"2023-08-11T12:22:31.722972+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:08:49.920575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.727577+0000","last_change":"2023-08-11T12:22:31.727577+0000","last_active":"2023-08-11T12:22:31.727577+0000","last_peered":"2023-08-11T12:22:31.727577+0000","last_clean":"2023-08-11T12:22:31.727577+0000","last_became_active":"2023-08-11T12:22:31.727034+0000","last_became_peered":"2023-08-11T12:22:31.727034+0000","last_unstale":"2023-08-11T12:22:31.727577+0000","last_undegraded":"2023-08-11T12:22:31.727577+0000","last_fullsized":"2023-08-11T12:22:31.727577+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:14:44.681877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":90,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:23:20.781228+0000","last_change":"2023-08-11T12:22:02.841759+0000","last_active":"2023-08-11T12:23:20.781228+0000","last_peered":"2023-08-11T12:23:20.781228+0000","last_clean":"2023-08-11T12:23:20.781228+0000","last_became_active":"2023-08-11T12:22:02.841326+0000","last_became_peered":"2023-08-11T12:22:02.841326+0000","last_unstale":"2023-08-11T12:23:20.781228+0000","last_undegraded":"2023-08-11T12:23:20.781228+0000","last_fullsized":"2023-08-11T12:23:20.781228+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:09:30.085287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.802211+0000","last_change":"2023-08-11T12:22:31.801910+0000","last_active":"2023-08-11T12:22:31.802211+0000","last_peered":"2023-08-11T12:22:31.802211+0000","last_clean":"2023-08-11T12:22:31.802211+0000","last_became_active":"2023-08-11T12:22:31.801479+0000","last_became_peered":"2023-08-11T12:22:31.801479+0000","last_unstale":"2023-08-11T12:22:31.802211+0000","last_undegraded":"2023-08-11T12:22:31.802211+0000","last_fullsized":"2023-08-11T12:22:31.802211+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:52:21.489431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720477+0000","last_change":"2023-08-11T12:22:07.875010+0000","last_active":"2023-08-11T12:22:31.720477+0000","last_peered":"2023-08-11T12:22:31.720477+0000","last_clean":"2023-08-11T12:22:31.720477+0000","last_became_active":"2023-08-11T12:22:07.874474+0000","last_became_peered":"2023-08-11T12:22:07.874474+0000","last_unstale":"2023-08-11T12:22:31.720477+0000","last_undegraded":"2023-08-11T12:22:31.720477+0000","last_fullsized":"2023-08-11T12:22:31.720477+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:41:20.795124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721140+0000","last_change":"2023-08-11T12:22:02.848299+0000","last_active":"2023-08-11T12:22:31.721140+0000","last_peered":"2023-08-11T12:22:31.721140+0000","last_clean":"2023-08-11T12:22:31.721140+0000","last_became_active":"2023-08-11T12:22:02.847869+0000","last_became_peered":"2023-08-11T12:22:02.847869+0000","last_unstale":"2023-08-11T12:22:31.721140+0000","last_undegraded":"2023-08-11T12:22:31.721140+0000","last_fullsized":"2023-08-11T12:22:31.721140+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:09:15.600582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719818+0000","last_change":"2023-08-11T12:22:03.841173+0000","last_active":"2023-08-11T12:22:31.719818+0000","last_peered":"2023-08-11T12:22:31.719818+0000","last_clean":"2023-08-11T12:22:31.719818+0000","last_became_active":"2023-08-11T12:22:03.840882+0000","last_became_peered":"2023-08-11T12:22:03.840882+0000","last_unstale":"2023-08-11T12:22:31.719818+0000","last_undegraded":"2023-08-11T12:22:31.719818+0000","last_fullsized":"2023-08-11T12:22:31.719818+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:50:28.937358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721470+0000","last_change":"2023-08-11T12:22:07.880756+0000","last_active":"2023-08-11T12:22:31.721470+0000","last_peered":"2023-08-11T12:22:31.721470+0000","last_clean":"2023-08-11T12:22:31.721470+0000","last_became_active":"2023-08-11T12:22:07.878866+0000","last_became_peered":"2023-08-11T12:22:07.878866+0000","last_unstale":"2023-08-11T12:22:31.721470+0000","last_undegraded":"2023-08-11T12:22:31.721470+0000","last_fullsized":"2023-08-11T12:22:31.721470+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:30:28.617039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:32.698559+0000","last_change":"2023-08-11T12:22:02.848543+0000","last_active":"2023-08-11T12:22:32.698559+0000","last_peered":"2023-08-11T12:22:32.698559+0000","last_clean":"2023-08-11T12:22:32.698559+0000","last_became_active":"2023-08-11T12:22:02.848008+0000","last_became_peered":"2023-08-11T12:22:02.848008+0000","last_unstale":"2023-08-11T12:22:32.698559+0000","last_undegraded":"2023-08-11T12:22:32.698559+0000","last_fullsized":"2023-08-11T12:22:32.698559+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:57:46.484932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774382+0000","last_change":"2023-08-11T12:22:03.843651+0000","last_active":"2023-08-11T12:22:31.774382+0000","last_peered":"2023-08-11T12:22:31.774382+0000","last_clean":"2023-08-11T12:22:31.774382+0000","last_became_active":"2023-08-11T12:22:03.843392+0000","last_became_peered":"2023-08-11T12:22:03.843392+0000","last_unstale":"2023-08-11T12:22:31.774382+0000","last_undegraded":"2023-08-11T12:22:31.774382+0000","last_fullsized":"2023-08-11T12:22:31.774382+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:27:25.825805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721058+0000","last_change":"2023-08-11T12:22:07.879373+0000","last_active":"2023-08-11T12:22:31.721058+0000","last_peered":"2023-08-11T12:22:31.721058+0000","last_clean":"2023-08-11T12:22:31.721058+0000","last_became_active":"2023-08-11T12:22:07.878929+0000","last_became_peered":"2023-08-11T12:22:07.878929+0000","last_unstale":"2023-08-11T12:22:31.721058+0000","last_undegraded":"2023-08-11T12:22:31.721058+0000","last_fullsized":"2023-08-11T12:22:31.721058+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:37:29.598815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723705+0000","last_change":"2023-08-11T12:22:02.841984+0000","last_active":"2023-08-11T12:22:31.723705+0000","last_peered":"2023-08-11T12:22:31.723705+0000","last_clean":"2023-08-11T12:22:31.723705+0000","last_became_active":"2023-08-11T12:22:02.841585+0000","last_became_peered":"2023-08-11T12:22:02.841585+0000","last_unstale":"2023-08-11T12:22:31.723705+0000","last_undegraded":"2023-08-11T12:22:31.723705+0000","last_fullsized":"2023-08-11T12:22:31.723705+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:18:28.740155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800688+0000","last_change":"2023-08-11T12:22:03.839381+0000","last_active":"2023-08-11T12:22:31.800688+0000","last_peered":"2023-08-11T12:22:31.800688+0000","last_clean":"2023-08-11T12:22:31.800688+0000","last_became_active":"2023-08-11T12:22:03.839091+0000","last_became_peered":"2023-08-11T12:22:03.839091+0000","last_unstale":"2023-08-11T12:22:31.800688+0000","last_undegraded":"2023-08-11T12:22:31.800688+0000","last_fullsized":"2023-08-11T12:22:31.800688+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:45:52.205138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722725+0000","last_change":"2023-08-11T12:22:07.881758+0000","last_active":"2023-08-11T12:22:31.722725+0000","last_peered":"2023-08-11T12:22:31.722725+0000","last_clean":"2023-08-11T12:22:31.722725+0000","last_became_active":"2023-08-11T12:22:07.881305+0000","last_became_peered":"2023-08-11T12:22:07.881305+0000","last_unstale":"2023-08-11T12:22:31.722725+0000","last_undegraded":"2023-08-11T12:22:31.722725+0000","last_fullsized":"2023-08-11T12:22:31.722725+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:25:48.595182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'5","reported_seq":86,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:23:20.754384+0000","last_change":"2023-08-11T12:22:02.844138+0000","last_active":"2023-08-11T12:23:20.754384+0000","last_peered":"2023-08-11T12:23:20.754384+0000","last_clean":"2023-08-11T12:23:20.754384+0000","last_became_active":"2023-08-11T12:22:02.843234+0000","last_became_peered":"2023-08-11T12:22:02.843234+0000","last_unstale":"2023-08-11T12:23:20.754384+0000","last_undegraded":"2023-08-11T12:23:20.754384+0000","last_fullsized":"2023-08-11T12:23:20.754384+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:53:48.033181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723640+0000","last_change":"2023-08-11T12:22:03.845450+0000","last_active":"2023-08-11T12:22:31.723640+0000","last_peered":"2023-08-11T12:22:31.723640+0000","last_clean":"2023-08-11T12:22:31.723640+0000","last_became_active":"2023-08-11T12:22:03.845170+0000","last_became_peered":"2023-08-11T12:22:03.845170+0000","last_unstale":"2023-08-11T12:22:31.723640+0000","last_undegraded":"2023-08-11T12:22:31.723640+0000","last_fullsized":"2023-08-11T12:22:31.723640+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:35:09.789210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722268+0000","last_change":"2023-08-11T12:22:07.880663+0000","last_active":"2023-08-11T12:22:31.722268+0000","last_peered":"2023-08-11T12:22:31.722268+0000","last_clean":"2023-08-11T12:22:31.722268+0000","last_became_active":"2023-08-11T12:22:07.880282+0000","last_became_peered":"2023-08-11T12:22:07.880282+0000","last_unstale":"2023-08-11T12:22:31.722268+0000","last_undegraded":"2023-08-11T12:22:31.722268+0000","last_fullsized":"2023-08-11T12:22:31.722268+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:36:05.356885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"87'7","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721289+0000","last_change":"2023-08-11T12:22:02.842206+0000","last_active":"2023-08-11T12:22:31.721289+0000","last_peered":"2023-08-11T12:22:31.721289+0000","last_clean":"2023-08-11T12:22:31.721289+0000","last_became_active":"2023-08-11T12:22:02.841815+0000","last_became_peered":"2023-08-11T12:22:02.841815+0000","last_unstale":"2023-08-11T12:22:31.721289+0000","last_undegraded":"2023-08-11T12:22:31.721289+0000","last_fullsized":"2023-08-11T12:22:31.721289+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:15:01.305404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800934+0000","last_change":"2023-08-11T12:22:03.825886+0000","last_active":"2023-08-11T12:22:31.800934+0000","last_peered":"2023-08-11T12:22:31.800934+0000","last_clean":"2023-08-11T12:22:31.800934+0000","last_became_active":"2023-08-11T12:22:03.825645+0000","last_became_peered":"2023-08-11T12:22:03.825645+0000","last_unstale":"2023-08-11T12:22:31.800934+0000","last_undegraded":"2023-08-11T12:22:31.800934+0000","last_fullsized":"2023-08-11T12:22:31.800934+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:03:34.650801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720447+0000","last_change":"2023-08-11T12:22:07.890216+0000","last_active":"2023-08-11T12:22:31.720447+0000","last_peered":"2023-08-11T12:22:31.720447+0000","last_clean":"2023-08-11T12:22:31.720447+0000","last_became_active":"2023-08-11T12:22:07.889860+0000","last_became_peered":"2023-08-11T12:22:07.889860+0000","last_unstale":"2023-08-11T12:22:31.720447+0000","last_undegraded":"2023-08-11T12:22:31.720447+0000","last_fullsized":"2023-08-11T12:22:31.720447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:03:54.952887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.716962+0000","last_change":"2023-08-11T12:22:02.835703+0000","last_active":"2023-08-11T12:22:31.716962+0000","last_peered":"2023-08-11T12:22:31.716962+0000","last_clean":"2023-08-11T12:22:31.716962+0000","last_became_active":"2023-08-11T12:22:02.835300+0000","last_became_peered":"2023-08-11T12:22:02.835300+0000","last_unstale":"2023-08-11T12:22:31.716962+0000","last_undegraded":"2023-08-11T12:22:31.716962+0000","last_fullsized":"2023-08-11T12:22:31.716962+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:55:13.953193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720447+0000","last_change":"2023-08-11T12:22:03.835619+0000","last_active":"2023-08-11T12:22:31.720447+0000","last_peered":"2023-08-11T12:22:31.720447+0000","last_clean":"2023-08-11T12:22:31.720447+0000","last_became_active":"2023-08-11T12:22:03.835365+0000","last_became_peered":"2023-08-11T12:22:03.835365+0000","last_unstale":"2023-08-11T12:22:31.720447+0000","last_undegraded":"2023-08-11T12:22:31.720447+0000","last_fullsized":"2023-08-11T12:22:31.720447+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:36:40.129412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719371+0000","last_change":"2023-08-11T12:22:07.893736+0000","last_active":"2023-08-11T12:22:31.719371+0000","last_peered":"2023-08-11T12:22:31.719371+0000","last_clean":"2023-08-11T12:22:31.719371+0000","last_became_active":"2023-08-11T12:22:07.893160+0000","last_became_peered":"2023-08-11T12:22:07.893160+0000","last_unstale":"2023-08-11T12:22:31.719371+0000","last_undegraded":"2023-08-11T12:22:31.719371+0000","last_fullsized":"2023-08-11T12:22:31.719371+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:55:46.234346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800174+0000","last_change":"2023-08-11T12:22:02.843819+0000","last_active":"2023-08-11T12:22:31.800174+0000","last_peered":"2023-08-11T12:22:31.800174+0000","last_clean":"2023-08-11T12:22:31.800174+0000","last_became_active":"2023-08-11T12:22:02.843062+0000","last_became_peered":"2023-08-11T12:22:02.843062+0000","last_unstale":"2023-08-11T12:22:31.800174+0000","last_undegraded":"2023-08-11T12:22:31.800174+0000","last_fullsized":"2023-08-11T12:22:31.800174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:59:34.378593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722599+0000","last_change":"2023-08-11T12:22:03.845985+0000","last_active":"2023-08-11T12:22:31.722599+0000","last_peered":"2023-08-11T12:22:31.722599+0000","last_clean":"2023-08-11T12:22:31.722599+0000","last_became_active":"2023-08-11T12:22:03.845274+0000","last_became_peered":"2023-08-11T12:22:03.845274+0000","last_unstale":"2023-08-11T12:22:31.722599+0000","last_undegraded":"2023-08-11T12:22:31.722599+0000","last_fullsized":"2023-08-11T12:22:31.722599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:51:23.239546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.775632+0000","last_change":"2023-08-11T12:22:31.775632+0000","last_active":"2023-08-11T12:22:31.775632+0000","last_peered":"2023-08-11T12:22:31.775632+0000","last_clean":"2023-08-11T12:22:31.775632+0000","last_became_active":"2023-08-11T12:22:31.775282+0000","last_became_peered":"2023-08-11T12:22:31.775282+0000","last_unstale":"2023-08-11T12:22:31.775632+0000","last_undegraded":"2023-08-11T12:22:31.775632+0000","last_fullsized":"2023-08-11T12:22:31.775632+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:59:53.378227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,8],"acting":[3,7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"87'4","reported_seq":139,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:23:24.759730+0000","last_change":"2023-08-11T12:22:02.836591+0000","last_active":"2023-08-11T12:23:24.759730+0000","last_peered":"2023-08-11T12:23:24.759730+0000","last_clean":"2023-08-11T12:23:24.759730+0000","last_became_active":"2023-08-11T12:22:02.836223+0000","last_became_peered":"2023-08-11T12:22:02.836223+0000","last_unstale":"2023-08-11T12:23:24.759730+0000","last_undegraded":"2023-08-11T12:23:24.759730+0000","last_fullsized":"2023-08-11T12:23:24.759730+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:30:37.183588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774757+0000","last_change":"2023-08-11T12:22:03.841719+0000","last_active":"2023-08-11T12:22:31.774757+0000","last_peered":"2023-08-11T12:22:31.774757+0000","last_clean":"2023-08-11T12:22:31.774757+0000","last_became_active":"2023-08-11T12:22:03.841381+0000","last_became_peered":"2023-08-11T12:22:03.841381+0000","last_unstale":"2023-08-11T12:22:31.774757+0000","last_undegraded":"2023-08-11T12:22:31.774757+0000","last_fullsized":"2023-08-11T12:22:31.774757+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:29:35.108655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721200+0000","last_change":"2023-08-11T12:22:07.889103+0000","last_active":"2023-08-11T12:22:31.721200+0000","last_peered":"2023-08-11T12:22:31.721200+0000","last_clean":"2023-08-11T12:22:31.721200+0000","last_became_active":"2023-08-11T12:22:07.888668+0000","last_became_peered":"2023-08-11T12:22:07.888668+0000","last_unstale":"2023-08-11T12:22:31.721200+0000","last_undegraded":"2023-08-11T12:22:31.721200+0000","last_fullsized":"2023-08-11T12:22:31.721200+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:55:40.004921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717773+0000","last_change":"2023-08-11T12:22:02.841934+0000","last_active":"2023-08-11T12:22:31.717773+0000","last_peered":"2023-08-11T12:22:31.717773+0000","last_clean":"2023-08-11T12:22:31.717773+0000","last_became_active":"2023-08-11T12:22:02.841598+0000","last_became_peered":"2023-08-11T12:22:02.841598+0000","last_unstale":"2023-08-11T12:22:31.717773+0000","last_undegraded":"2023-08-11T12:22:31.717773+0000","last_fullsized":"2023-08-11T12:22:31.717773+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:20:04.206298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719796+0000","last_change":"2023-08-11T12:22:03.848901+0000","last_active":"2023-08-11T12:22:31.719796+0000","last_peered":"2023-08-11T12:22:31.719796+0000","last_clean":"2023-08-11T12:22:31.719796+0000","last_became_active":"2023-08-11T12:22:03.848518+0000","last_became_peered":"2023-08-11T12:22:03.848518+0000","last_unstale":"2023-08-11T12:22:31.719796+0000","last_undegraded":"2023-08-11T12:22:31.719796+0000","last_fullsized":"2023-08-11T12:22:31.719796+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:20:08.007934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.775821+0000","last_change":"2023-08-11T12:22:31.775821+0000","last_active":"2023-08-11T12:22:31.775821+0000","last_peered":"2023-08-11T12:22:31.775821+0000","last_clean":"2023-08-11T12:22:31.775821+0000","last_became_active":"2023-08-11T12:22:31.775264+0000","last_became_peered":"2023-08-11T12:22:31.775264+0000","last_unstale":"2023-08-11T12:22:31.775821+0000","last_undegraded":"2023-08-11T12:22:31.775821+0000","last_fullsized":"2023-08-11T12:22:31.775821+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:28:22.561726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"87'5","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800805+0000","last_change":"2023-08-11T12:22:02.846492+0000","last_active":"2023-08-11T12:22:31.800805+0000","last_peered":"2023-08-11T12:22:31.800805+0000","last_clean":"2023-08-11T12:22:31.800805+0000","last_became_active":"2023-08-11T12:22:02.846174+0000","last_became_peered":"2023-08-11T12:22:02.846174+0000","last_unstale":"2023-08-11T12:22:31.800805+0000","last_undegraded":"2023-08-11T12:22:31.800805+0000","last_fullsized":"2023-08-11T12:22:31.800805+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:09:18.245164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774783+0000","last_change":"2023-08-11T12:22:03.840054+0000","last_active":"2023-08-11T12:22:31.774783+0000","last_peered":"2023-08-11T12:22:31.774783+0000","last_clean":"2023-08-11T12:22:31.774783+0000","last_became_active":"2023-08-11T12:22:03.839707+0000","last_became_peered":"2023-08-11T12:22:03.839707+0000","last_unstale":"2023-08-11T12:22:31.774783+0000","last_undegraded":"2023-08-11T12:22:31.774783+0000","last_fullsized":"2023-08-11T12:22:31.774783+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:47:30.898127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.802304+0000","last_change":"2023-08-11T12:22:31.801931+0000","last_active":"2023-08-11T12:22:31.802304+0000","last_peered":"2023-08-11T12:22:31.802304+0000","last_clean":"2023-08-11T12:22:31.802304+0000","last_became_active":"2023-08-11T12:22:31.801522+0000","last_became_peered":"2023-08-11T12:22:31.801522+0000","last_unstale":"2023-08-11T12:22:31.802304+0000","last_undegraded":"2023-08-11T12:22:31.802304+0000","last_fullsized":"2023-08-11T12:22:31.802304+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:03:22.570814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.14","version":"88'14","reported_seq":154,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:23:24.759420+0000","last_change":"2023-08-11T12:22:02.836520+0000","last_active":"2023-08-11T12:23:24.759420+0000","last_peered":"2023-08-11T12:23:24.759420+0000","last_clean":"2023-08-11T12:23:24.759420+0000","last_became_active":"2023-08-11T12:22:02.836201+0000","last_became_peered":"2023-08-11T12:22:02.836201+0000","last_unstale":"2023-08-11T12:23:24.759420+0000","last_undegraded":"2023-08-11T12:23:24.759420+0000","last_fullsized":"2023-08-11T12:23:24.759420+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:58:37.750229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":114,"num_read_kb":61,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723852+0000","last_change":"2023-08-11T12:22:03.848104+0000","last_active":"2023-08-11T12:22:31.723852+0000","last_peered":"2023-08-11T12:22:31.723852+0000","last_clean":"2023-08-11T12:22:31.723852+0000","last_became_active":"2023-08-11T12:22:03.847801+0000","last_became_peered":"2023-08-11T12:22:03.847801+0000","last_unstale":"2023-08-11T12:22:31.723852+0000","last_undegraded":"2023-08-11T12:22:31.723852+0000","last_fullsized":"2023-08-11T12:22:31.723852+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:56:47.846229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.801121+0000","last_change":"2023-08-11T12:22:07.893710+0000","last_active":"2023-08-11T12:22:31.801121+0000","last_peered":"2023-08-11T12:22:31.801121+0000","last_clean":"2023-08-11T12:22:31.801121+0000","last_became_active":"2023-08-11T12:22:07.893239+0000","last_became_peered":"2023-08-11T12:22:07.893239+0000","last_unstale":"2023-08-11T12:22:31.801121+0000","last_undegraded":"2023-08-11T12:22:31.801121+0000","last_fullsized":"2023-08-11T12:22:31.801121+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:24:55.563178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.724184+0000","last_change":"2023-08-11T12:22:02.849060+0000","last_active":"2023-08-11T12:22:31.724184+0000","last_peered":"2023-08-11T12:22:31.724184+0000","last_clean":"2023-08-11T12:22:31.724184+0000","last_became_active":"2023-08-11T12:22:02.848417+0000","last_became_peered":"2023-08-11T12:22:02.848417+0000","last_unstale":"2023-08-11T12:22:31.724184+0000","last_undegraded":"2023-08-11T12:22:31.724184+0000","last_fullsized":"2023-08-11T12:22:31.724184+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:48:47.925134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717206+0000","last_change":"2023-08-11T12:22:03.848532+0000","last_active":"2023-08-11T12:22:31.717206+0000","last_peered":"2023-08-11T12:22:31.717206+0000","last_clean":"2023-08-11T12:22:31.717206+0000","last_became_active":"2023-08-11T12:22:03.848190+0000","last_became_peered":"2023-08-11T12:22:03.848190+0000","last_unstale":"2023-08-11T12:22:31.717206+0000","last_undegraded":"2023-08-11T12:22:31.717206+0000","last_fullsized":"2023-08-11T12:22:31.717206+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:24:49.898432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720024+0000","last_change":"2023-08-11T12:22:07.882785+0000","last_active":"2023-08-11T12:22:31.720024+0000","last_peered":"2023-08-11T12:22:31.720024+0000","last_clean":"2023-08-11T12:22:31.720024+0000","last_became_active":"2023-08-11T12:22:07.880643+0000","last_became_peered":"2023-08-11T12:22:07.880643+0000","last_unstale":"2023-08-11T12:22:31.720024+0000","last_undegraded":"2023-08-11T12:22:31.720024+0000","last_fullsized":"2023-08-11T12:22:31.720024+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:40:21.114572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800547+0000","last_change":"2023-08-11T12:22:02.851416+0000","last_active":"2023-08-11T12:22:31.800547+0000","last_peered":"2023-08-11T12:22:31.800547+0000","last_clean":"2023-08-11T12:22:31.800547+0000","last_became_active":"2023-08-11T12:22:02.851114+0000","last_became_peered":"2023-08-11T12:22:02.851114+0000","last_unstale":"2023-08-11T12:22:31.800547+0000","last_undegraded":"2023-08-11T12:22:31.800547+0000","last_fullsized":"2023-08-11T12:22:31.800547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:27:37.565292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717994+0000","last_change":"2023-08-11T12:22:03.849367+0000","last_active":"2023-08-11T12:22:31.717994+0000","last_peered":"2023-08-11T12:22:31.717994+0000","last_clean":"2023-08-11T12:22:31.717994+0000","last_became_active":"2023-08-11T12:22:03.849050+0000","last_became_peered":"2023-08-11T12:22:03.849050+0000","last_unstale":"2023-08-11T12:22:31.717994+0000","last_undegraded":"2023-08-11T12:22:31.717994+0000","last_fullsized":"2023-08-11T12:22:31.717994+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:54:43.936124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722616+0000","last_change":"2023-08-11T12:22:07.890992+0000","last_active":"2023-08-11T12:22:31.722616+0000","last_peered":"2023-08-11T12:22:31.722616+0000","last_clean":"2023-08-11T12:22:31.722616+0000","last_became_active":"2023-08-11T12:22:07.890384+0000","last_became_peered":"2023-08-11T12:22:07.890384+0000","last_unstale":"2023-08-11T12:22:31.722616+0000","last_undegraded":"2023-08-11T12:22:31.722616+0000","last_fullsized":"2023-08-11T12:22:31.722616+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:00:55.230221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"87'5","reported_seq":84,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:23:21.789694+0000","last_change":"2023-08-11T12:22:02.843045+0000","last_active":"2023-08-11T12:23:21.789694+0000","last_peered":"2023-08-11T12:23:21.789694+0000","last_clean":"2023-08-11T12:23:21.789694+0000","last_became_active":"2023-08-11T12:22:02.842628+0000","last_became_peered":"2023-08-11T12:22:02.842628+0000","last_unstale":"2023-08-11T12:23:21.789694+0000","last_undegraded":"2023-08-11T12:23:21.789694+0000","last_fullsized":"2023-08-11T12:23:21.789694+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:45:36.283695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717456+0000","last_change":"2023-08-11T12:22:03.842526+0000","last_active":"2023-08-11T12:22:31.717456+0000","last_peered":"2023-08-11T12:22:31.717456+0000","last_clean":"2023-08-11T12:22:31.717456+0000","last_became_active":"2023-08-11T12:22:03.842183+0000","last_became_peered":"2023-08-11T12:22:03.842183+0000","last_unstale":"2023-08-11T12:22:31.717456+0000","last_undegraded":"2023-08-11T12:22:31.717456+0000","last_fullsized":"2023-08-11T12:22:31.717456+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:20:56.195693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717389+0000","last_change":"2023-08-11T12:22:07.880768+0000","last_active":"2023-08-11T12:22:31.717389+0000","last_peered":"2023-08-11T12:22:31.717389+0000","last_clean":"2023-08-11T12:22:31.717389+0000","last_became_active":"2023-08-11T12:22:07.880335+0000","last_became_peered":"2023-08-11T12:22:07.880335+0000","last_unstale":"2023-08-11T12:22:31.717389+0000","last_undegraded":"2023-08-11T12:22:31.717389+0000","last_fullsized":"2023-08-11T12:22:31.717389+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:35:51.736025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721841+0000","last_change":"2023-08-11T12:22:02.847271+0000","last_active":"2023-08-11T12:22:31.721841+0000","last_peered":"2023-08-11T12:22:31.721841+0000","last_clean":"2023-08-11T12:22:31.721841+0000","last_became_active":"2023-08-11T12:22:02.846974+0000","last_became_peered":"2023-08-11T12:22:02.846974+0000","last_unstale":"2023-08-11T12:22:31.721841+0000","last_undegraded":"2023-08-11T12:22:31.721841+0000","last_fullsized":"2023-08-11T12:22:31.721841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:43:35.198876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800817+0000","last_change":"2023-08-11T12:22:03.838944+0000","last_active":"2023-08-11T12:22:31.800817+0000","last_peered":"2023-08-11T12:22:31.800817+0000","last_clean":"2023-08-11T12:22:31.800817+0000","last_became_active":"2023-08-11T12:22:03.838610+0000","last_became_peered":"2023-08-11T12:22:03.838610+0000","last_unstale":"2023-08-11T12:22:31.800817+0000","last_undegraded":"2023-08-11T12:22:31.800817+0000","last_fullsized":"2023-08-11T12:22:31.800817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:10:20.371629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800680+0000","last_change":"2023-08-11T12:22:07.888812+0000","last_active":"2023-08-11T12:22:31.800680+0000","last_peered":"2023-08-11T12:22:31.800680+0000","last_clean":"2023-08-11T12:22:31.800680+0000","last_became_active":"2023-08-11T12:22:07.888423+0000","last_became_peered":"2023-08-11T12:22:07.888423+0000","last_unstale":"2023-08-11T12:22:31.800680+0000","last_undegraded":"2023-08-11T12:22:31.800680+0000","last_fullsized":"2023-08-11T12:22:31.800680+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:07:17.536681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723473+0000","last_change":"2023-08-11T12:22:02.842591+0000","last_active":"2023-08-11T12:22:31.723473+0000","last_peered":"2023-08-11T12:22:31.723473+0000","last_clean":"2023-08-11T12:22:31.723473+0000","last_became_active":"2023-08-11T12:22:02.842249+0000","last_became_peered":"2023-08-11T12:22:02.842249+0000","last_unstale":"2023-08-11T12:22:31.723473+0000","last_undegraded":"2023-08-11T12:22:31.723473+0000","last_fullsized":"2023-08-11T12:22:31.723473+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:28:10.930413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.725791+0000","last_change":"2023-08-11T12:22:31.725791+0000","last_active":"2023-08-11T12:22:31.725791+0000","last_peered":"2023-08-11T12:22:31.725791+0000","last_clean":"2023-08-11T12:22:31.725791+0000","last_became_active":"2023-08-11T12:22:31.724950+0000","last_became_peered":"2023-08-11T12:22:31.724950+0000","last_unstale":"2023-08-11T12:22:31.725791+0000","last_undegraded":"2023-08-11T12:22:31.725791+0000","last_fullsized":"2023-08-11T12:22:31.725791+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:59:37.392626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723495+0000","last_change":"2023-08-11T12:22:08.068485+0000","last_active":"2023-08-11T12:22:31.723495+0000","last_peered":"2023-08-11T12:22:31.723495+0000","last_clean":"2023-08-11T12:22:31.723495+0000","last_became_active":"2023-08-11T12:22:08.068071+0000","last_became_peered":"2023-08-11T12:22:08.068071+0000","last_unstale":"2023-08-11T12:22:31.723495+0000","last_undegraded":"2023-08-11T12:22:31.723495+0000","last_fullsized":"2023-08-11T12:22:31.723495+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:35:49.958958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"87'1","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.727900+0000","last_change":"2023-08-11T12:22:31.727900+0000","last_active":"2023-08-11T12:22:31.727900+0000","last_peered":"2023-08-11T12:22:31.727900+0000","last_clean":"2023-08-11T12:22:31.727900+0000","last_became_active":"2023-08-11T12:22:31.727346+0000","last_became_peered":"2023-08-11T12:22:31.727346+0000","last_unstale":"2023-08-11T12:22:31.727900+0000","last_undegraded":"2023-08-11T12:22:31.727900+0000","last_fullsized":"2023-08-11T12:22:31.727900+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:12:21.170378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722892+0000","last_change":"2023-08-11T12:22:03.843434+0000","last_active":"2023-08-11T12:22:31.722892+0000","last_peered":"2023-08-11T12:22:31.722892+0000","last_clean":"2023-08-11T12:22:31.722892+0000","last_became_active":"2023-08-11T12:22:03.843117+0000","last_became_peered":"2023-08-11T12:22:03.843117+0000","last_unstale":"2023-08-11T12:22:31.722892+0000","last_undegraded":"2023-08-11T12:22:31.722892+0000","last_fullsized":"2023-08-11T12:22:31.722892+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:30:45.835632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717364+0000","last_change":"2023-08-11T12:22:07.889740+0000","last_active":"2023-08-11T12:22:31.717364+0000","last_peered":"2023-08-11T12:22:31.717364+0000","last_clean":"2023-08-11T12:22:31.717364+0000","last_became_active":"2023-08-11T12:22:07.889272+0000","last_became_peered":"2023-08-11T12:22:07.889272+0000","last_unstale":"2023-08-11T12:22:31.717364+0000","last_undegraded":"2023-08-11T12:22:31.717364+0000","last_fullsized":"2023-08-11T12:22:31.717364+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:48:06.207915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":85,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:23:23.786295+0000","last_change":"2023-08-11T12:22:02.846661+0000","last_active":"2023-08-11T12:23:23.786295+0000","last_peered":"2023-08-11T12:23:23.786295+0000","last_clean":"2023-08-11T12:23:23.786295+0000","last_became_active":"2023-08-11T12:22:02.846269+0000","last_became_peered":"2023-08-11T12:22:02.846269+0000","last_unstale":"2023-08-11T12:23:23.786295+0000","last_undegraded":"2023-08-11T12:23:23.786295+0000","last_fullsized":"2023-08-11T12:23:23.786295+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:06:18.229850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720867+0000","last_change":"2023-08-11T12:22:03.849653+0000","last_active":"2023-08-11T12:22:31.720867+0000","last_peered":"2023-08-11T12:22:31.720867+0000","last_clean":"2023-08-11T12:22:31.720867+0000","last_became_active":"2023-08-11T12:22:03.849303+0000","last_became_peered":"2023-08-11T12:22:03.849303+0000","last_unstale":"2023-08-11T12:22:31.720867+0000","last_undegraded":"2023-08-11T12:22:31.720867+0000","last_fullsized":"2023-08-11T12:22:31.720867+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:06:11.551259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717043+0000","last_change":"2023-08-11T12:22:08.068395+0000","last_active":"2023-08-11T12:22:31.717043+0000","last_peered":"2023-08-11T12:22:31.717043+0000","last_clean":"2023-08-11T12:22:31.717043+0000","last_became_active":"2023-08-11T12:22:08.067572+0000","last_became_peered":"2023-08-11T12:22:08.067572+0000","last_unstale":"2023-08-11T12:22:31.717043+0000","last_undegraded":"2023-08-11T12:22:31.717043+0000","last_fullsized":"2023-08-11T12:22:31.717043+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:17:59.273227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800419+0000","last_change":"2023-08-11T12:22:03.828971+0000","last_active":"2023-08-11T12:22:31.800419+0000","last_peered":"2023-08-11T12:22:31.800419+0000","last_clean":"2023-08-11T12:22:31.800419+0000","last_became_active":"2023-08-11T12:22:03.828653+0000","last_became_peered":"2023-08-11T12:22:03.828653+0000","last_unstale":"2023-08-11T12:22:31.800419+0000","last_undegraded":"2023-08-11T12:22:31.800419+0000","last_fullsized":"2023-08-11T12:22:31.800419+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:03:54.904360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":84,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:23:22.790484+0000","last_change":"2023-08-11T12:22:02.842419+0000","last_active":"2023-08-11T12:23:22.790484+0000","last_peered":"2023-08-11T12:23:22.790484+0000","last_clean":"2023-08-11T12:23:22.790484+0000","last_became_active":"2023-08-11T12:22:02.842105+0000","last_became_peered":"2023-08-11T12:22:02.842105+0000","last_unstale":"2023-08-11T12:23:22.790484+0000","last_undegraded":"2023-08-11T12:23:22.790484+0000","last_fullsized":"2023-08-11T12:23:22.790484+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:32:13.063912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717659+0000","last_change":"2023-08-11T12:22:07.880762+0000","last_active":"2023-08-11T12:22:31.717659+0000","last_peered":"2023-08-11T12:22:31.717659+0000","last_clean":"2023-08-11T12:22:31.717659+0000","last_became_active":"2023-08-11T12:22:07.880373+0000","last_became_peered":"2023-08-11T12:22:07.880373+0000","last_unstale":"2023-08-11T12:22:31.717659+0000","last_undegraded":"2023-08-11T12:22:31.717659+0000","last_fullsized":"2023-08-11T12:22:31.717659+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:07:06.457583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720306+0000","last_change":"2023-08-11T12:22:03.838555+0000","last_active":"2023-08-11T12:22:31.720306+0000","last_peered":"2023-08-11T12:22:31.720306+0000","last_clean":"2023-08-11T12:22:31.720306+0000","last_became_active":"2023-08-11T12:22:03.838135+0000","last_became_peered":"2023-08-11T12:22:03.838135+0000","last_unstale":"2023-08-11T12:22:31.720306+0000","last_undegraded":"2023-08-11T12:22:31.720306+0000","last_fullsized":"2023-08-11T12:22:31.720306+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:36:24.934863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:32.698313+0000","last_change":"2023-08-11T12:22:02.835093+0000","last_active":"2023-08-11T12:22:32.698313+0000","last_peered":"2023-08-11T12:22:32.698313+0000","last_clean":"2023-08-11T12:22:32.698313+0000","last_became_active":"2023-08-11T12:22:02.834545+0000","last_became_peered":"2023-08-11T12:22:02.834545+0000","last_unstale":"2023-08-11T12:22:32.698313+0000","last_undegraded":"2023-08-11T12:22:32.698313+0000","last_fullsized":"2023-08-11T12:22:32.698313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:21:54.371599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":354,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717267+0000","last_change":"2023-08-11T12:20:57.484190+0000","last_active":"2023-08-11T12:22:31.717267+0000","last_peered":"2023-08-11T12:22:31.717267+0000","last_clean":"2023-08-11T12:22:31.717267+0000","last_became_active":"2023-08-11T12:20:57.483655+0000","last_became_peered":"2023-08-11T12:20:57.483655+0000","last_unstale":"2023-08-11T12:22:31.717267+0000","last_undegraded":"2023-08-11T12:22:31.717267+0000","last_fullsized":"2023-08-11T12:22:31.717267+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:17:49.245488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:17:49.245488+0000","last_clean_scrub_stamp":"2023-08-11T12:17:49.245488+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:25:33.880946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800856+0000","last_change":"2023-08-11T12:22:08.068762+0000","last_active":"2023-08-11T12:22:31.800856+0000","last_peered":"2023-08-11T12:22:31.800856+0000","last_clean":"2023-08-11T12:22:31.800856+0000","last_became_active":"2023-08-11T12:22:08.068205+0000","last_became_peered":"2023-08-11T12:22:08.068205+0000","last_unstale":"2023-08-11T12:22:31.800856+0000","last_undegraded":"2023-08-11T12:22:31.800856+0000","last_fullsized":"2023-08-11T12:22:31.800856+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:55:06.744751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.716768+0000","last_change":"2023-08-11T12:22:03.837843+0000","last_active":"2023-08-11T12:22:31.716768+0000","last_peered":"2023-08-11T12:22:31.716768+0000","last_clean":"2023-08-11T12:22:31.716768+0000","last_became_active":"2023-08-11T12:22:03.837537+0000","last_became_peered":"2023-08-11T12:22:03.837537+0000","last_unstale":"2023-08-11T12:22:31.716768+0000","last_undegraded":"2023-08-11T12:22:31.716768+0000","last_fullsized":"2023-08-11T12:22:31.716768+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:17:41.517052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717347+0000","last_change":"2023-08-11T12:22:02.843150+0000","last_active":"2023-08-11T12:22:31.717347+0000","last_peered":"2023-08-11T12:22:31.717347+0000","last_clean":"2023-08-11T12:22:31.717347+0000","last_became_active":"2023-08-11T12:22:02.842829+0000","last_became_peered":"2023-08-11T12:22:02.842829+0000","last_unstale":"2023-08-11T12:22:31.717347+0000","last_undegraded":"2023-08-11T12:22:31.717347+0000","last_fullsized":"2023-08-11T12:22:31.717347+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:09:48.420755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720687+0000","last_change":"2023-08-11T12:22:07.883050+0000","last_active":"2023-08-11T12:22:31.720687+0000","last_peered":"2023-08-11T12:22:31.720687+0000","last_clean":"2023-08-11T12:22:31.720687+0000","last_became_active":"2023-08-11T12:22:07.882423+0000","last_became_peered":"2023-08-11T12:22:07.882423+0000","last_unstale":"2023-08-11T12:22:31.720687+0000","last_undegraded":"2023-08-11T12:22:31.720687+0000","last_fullsized":"2023-08-11T12:22:31.720687+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:14:51.848070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.724001+0000","last_change":"2023-08-11T12:22:02.850632+0000","last_active":"2023-08-11T12:22:31.724001+0000","last_peered":"2023-08-11T12:22:31.724001+0000","last_clean":"2023-08-11T12:22:31.724001+0000","last_became_active":"2023-08-11T12:22:02.850312+0000","last_became_peered":"2023-08-11T12:22:02.850312+0000","last_unstale":"2023-08-11T12:22:31.724001+0000","last_undegraded":"2023-08-11T12:22:31.724001+0000","last_fullsized":"2023-08-11T12:22:31.724001+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:54:50.288288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717639+0000","last_change":"2023-08-11T12:22:03.839869+0000","last_active":"2023-08-11T12:22:31.717639+0000","last_peered":"2023-08-11T12:22:31.717639+0000","last_clean":"2023-08-11T12:22:31.717639+0000","last_became_active":"2023-08-11T12:22:03.839486+0000","last_became_peered":"2023-08-11T12:22:03.839486+0000","last_unstale":"2023-08-11T12:22:31.717639+0000","last_undegraded":"2023-08-11T12:22:31.717639+0000","last_fullsized":"2023-08-11T12:22:31.717639+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:23:04.341624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720307+0000","last_change":"2023-08-11T12:22:08.066877+0000","last_active":"2023-08-11T12:22:31.720307+0000","last_peered":"2023-08-11T12:22:31.720307+0000","last_clean":"2023-08-11T12:22:31.720307+0000","last_became_active":"2023-08-11T12:22:08.066418+0000","last_became_peered":"2023-08-11T12:22:08.066418+0000","last_unstale":"2023-08-11T12:22:31.720307+0000","last_undegraded":"2023-08-11T12:22:31.720307+0000","last_fullsized":"2023-08-11T12:22:31.720307+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:12:43.228455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'7","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722268+0000","last_change":"2023-08-11T12:22:02.850505+0000","last_active":"2023-08-11T12:22:31.722268+0000","last_peered":"2023-08-11T12:22:31.722268+0000","last_clean":"2023-08-11T12:22:31.722268+0000","last_became_active":"2023-08-11T12:22:02.850104+0000","last_became_peered":"2023-08-11T12:22:02.850104+0000","last_unstale":"2023-08-11T12:22:31.722268+0000","last_undegraded":"2023-08-11T12:22:31.722268+0000","last_fullsized":"2023-08-11T12:22:31.722268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:33:50.319404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721594+0000","last_change":"2023-08-11T12:22:03.837580+0000","last_active":"2023-08-11T12:22:31.721594+0000","last_peered":"2023-08-11T12:22:31.721594+0000","last_clean":"2023-08-11T12:22:31.721594+0000","last_became_active":"2023-08-11T12:22:03.837256+0000","last_became_peered":"2023-08-11T12:22:03.837256+0000","last_unstale":"2023-08-11T12:22:31.721594+0000","last_undegraded":"2023-08-11T12:22:31.721594+0000","last_fullsized":"2023-08-11T12:22:31.721594+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:07:44.899244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722304+0000","last_change":"2023-08-11T12:22:07.873613+0000","last_active":"2023-08-11T12:22:31.722304+0000","last_peered":"2023-08-11T12:22:31.722304+0000","last_clean":"2023-08-11T12:22:31.722304+0000","last_became_active":"2023-08-11T12:22:07.873149+0000","last_became_peered":"2023-08-11T12:22:07.873149+0000","last_unstale":"2023-08-11T12:22:31.722304+0000","last_undegraded":"2023-08-11T12:22:31.722304+0000","last_fullsized":"2023-08-11T12:22:31.722304+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:38:35.678888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722476+0000","last_change":"2023-08-11T12:22:02.843146+0000","last_active":"2023-08-11T12:22:31.722476+0000","last_peered":"2023-08-11T12:22:31.722476+0000","last_clean":"2023-08-11T12:22:31.722476+0000","last_became_active":"2023-08-11T12:22:02.842663+0000","last_became_peered":"2023-08-11T12:22:02.842663+0000","last_unstale":"2023-08-11T12:22:31.722476+0000","last_undegraded":"2023-08-11T12:22:31.722476+0000","last_fullsized":"2023-08-11T12:22:31.722476+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:32:13.084100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719503+0000","last_change":"2023-08-11T12:22:03.847351+0000","last_active":"2023-08-11T12:22:31.719503+0000","last_peered":"2023-08-11T12:22:31.719503+0000","last_clean":"2023-08-11T12:22:31.719503+0000","last_became_active":"2023-08-11T12:22:03.847044+0000","last_became_peered":"2023-08-11T12:22:03.847044+0000","last_unstale":"2023-08-11T12:22:31.719503+0000","last_undegraded":"2023-08-11T12:22:31.719503+0000","last_fullsized":"2023-08-11T12:22:31.719503+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:17:19.004762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721751+0000","last_change":"2023-08-11T12:22:08.068459+0000","last_active":"2023-08-11T12:22:31.721751+0000","last_peered":"2023-08-11T12:22:31.721751+0000","last_clean":"2023-08-11T12:22:31.721751+0000","last_became_active":"2023-08-11T12:22:08.067857+0000","last_became_peered":"2023-08-11T12:22:08.067857+0000","last_unstale":"2023-08-11T12:22:31.721751+0000","last_undegraded":"2023-08-11T12:22:31.721751+0000","last_fullsized":"2023-08-11T12:22:31.721751+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:15:05.931547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774122+0000","last_change":"2023-08-11T12:22:02.846441+0000","last_active":"2023-08-11T12:22:31.774122+0000","last_peered":"2023-08-11T12:22:31.774122+0000","last_clean":"2023-08-11T12:22:31.774122+0000","last_became_active":"2023-08-11T12:22:02.846153+0000","last_became_peered":"2023-08-11T12:22:02.846153+0000","last_unstale":"2023-08-11T12:22:31.774122+0000","last_undegraded":"2023-08-11T12:22:31.774122+0000","last_fullsized":"2023-08-11T12:22:31.774122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:00:55.631058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723349+0000","last_change":"2023-08-11T12:22:03.841932+0000","last_active":"2023-08-11T12:22:31.723349+0000","last_peered":"2023-08-11T12:22:31.723349+0000","last_clean":"2023-08-11T12:22:31.723349+0000","last_became_active":"2023-08-11T12:22:03.841635+0000","last_became_peered":"2023-08-11T12:22:03.841635+0000","last_unstale":"2023-08-11T12:22:31.723349+0000","last_undegraded":"2023-08-11T12:22:31.723349+0000","last_fullsized":"2023-08-11T12:22:31.723349+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:01:57.888877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722748+0000","last_change":"2023-08-11T12:22:07.886160+0000","last_active":"2023-08-11T12:22:31.722748+0000","last_peered":"2023-08-11T12:22:31.722748+0000","last_clean":"2023-08-11T12:22:31.722748+0000","last_became_active":"2023-08-11T12:22:07.885703+0000","last_became_peered":"2023-08-11T12:22:07.885703+0000","last_unstale":"2023-08-11T12:22:31.722748+0000","last_undegraded":"2023-08-11T12:22:31.722748+0000","last_fullsized":"2023-08-11T12:22:31.722748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:50:20.362829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720503+0000","last_change":"2023-08-11T12:22:02.849360+0000","last_active":"2023-08-11T12:22:31.720503+0000","last_peered":"2023-08-11T12:22:31.720503+0000","last_clean":"2023-08-11T12:22:31.720503+0000","last_became_active":"2023-08-11T12:22:02.849028+0000","last_became_peered":"2023-08-11T12:22:02.849028+0000","last_unstale":"2023-08-11T12:22:31.720503+0000","last_undegraded":"2023-08-11T12:22:31.720503+0000","last_fullsized":"2023-08-11T12:22:31.720503+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:55:24.114464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719824+0000","last_change":"2023-08-11T12:22:03.850285+0000","last_active":"2023-08-11T12:22:31.719824+0000","last_peered":"2023-08-11T12:22:31.719824+0000","last_clean":"2023-08-11T12:22:31.719824+0000","last_became_active":"2023-08-11T12:22:03.849978+0000","last_became_peered":"2023-08-11T12:22:03.849978+0000","last_unstale":"2023-08-11T12:22:31.719824+0000","last_undegraded":"2023-08-11T12:22:31.719824+0000","last_fullsized":"2023-08-11T12:22:31.719824+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:29:51.679282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721058+0000","last_change":"2023-08-11T12:22:07.881578+0000","last_active":"2023-08-11T12:22:31.721058+0000","last_peered":"2023-08-11T12:22:31.721058+0000","last_clean":"2023-08-11T12:22:31.721058+0000","last_became_active":"2023-08-11T12:22:07.881145+0000","last_became_peered":"2023-08-11T12:22:07.881145+0000","last_unstale":"2023-08-11T12:22:31.721058+0000","last_undegraded":"2023-08-11T12:22:31.721058+0000","last_fullsized":"2023-08-11T12:22:31.721058+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:32:16.462208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:33.797689+0000","last_change":"2023-08-11T12:22:02.848875+0000","last_active":"2023-08-11T12:22:33.797689+0000","last_peered":"2023-08-11T12:22:33.797689+0000","last_clean":"2023-08-11T12:22:33.797689+0000","last_became_active":"2023-08-11T12:22:02.848578+0000","last_became_peered":"2023-08-11T12:22:02.848578+0000","last_unstale":"2023-08-11T12:22:33.797689+0000","last_undegraded":"2023-08-11T12:22:33.797689+0000","last_fullsized":"2023-08-11T12:22:33.797689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:29:40.949795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721051+0000","last_change":"2023-08-11T12:22:03.849865+0000","last_active":"2023-08-11T12:22:31.721051+0000","last_peered":"2023-08-11T12:22:31.721051+0000","last_clean":"2023-08-11T12:22:31.721051+0000","last_became_active":"2023-08-11T12:22:03.849557+0000","last_became_peered":"2023-08-11T12:22:03.849557+0000","last_unstale":"2023-08-11T12:22:31.721051+0000","last_undegraded":"2023-08-11T12:22:31.721051+0000","last_fullsized":"2023-08-11T12:22:31.721051+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:49:27.142464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721537+0000","last_change":"2023-08-11T12:22:08.067009+0000","last_active":"2023-08-11T12:22:31.721537+0000","last_peered":"2023-08-11T12:22:31.721537+0000","last_clean":"2023-08-11T12:22:31.721537+0000","last_became_active":"2023-08-11T12:22:08.066477+0000","last_became_peered":"2023-08-11T12:22:08.066477+0000","last_unstale":"2023-08-11T12:22:31.721537+0000","last_undegraded":"2023-08-11T12:22:31.721537+0000","last_fullsized":"2023-08-11T12:22:31.721537+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:07:02.380225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.731106+0000","last_change":"2023-08-11T12:22:31.731106+0000","last_active":"2023-08-11T12:22:31.731106+0000","last_peered":"2023-08-11T12:22:31.731106+0000","last_clean":"2023-08-11T12:22:31.731106+0000","last_became_active":"2023-08-11T12:22:31.724944+0000","last_became_peered":"2023-08-11T12:22:31.724944+0000","last_unstale":"2023-08-11T12:22:31.731106+0000","last_undegraded":"2023-08-11T12:22:31.731106+0000","last_fullsized":"2023-08-11T12:22:31.731106+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:56:41.188015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718051+0000","last_change":"2023-08-11T12:22:03.848715+0000","last_active":"2023-08-11T12:22:31.718051+0000","last_peered":"2023-08-11T12:22:31.718051+0000","last_clean":"2023-08-11T12:22:31.718051+0000","last_became_active":"2023-08-11T12:22:03.848311+0000","last_became_peered":"2023-08-11T12:22:03.848311+0000","last_unstale":"2023-08-11T12:22:31.718051+0000","last_undegraded":"2023-08-11T12:22:31.718051+0000","last_fullsized":"2023-08-11T12:22:31.718051+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:45:14.152855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774112+0000","last_change":"2023-08-11T12:22:07.882566+0000","last_active":"2023-08-11T12:22:31.774112+0000","last_peered":"2023-08-11T12:22:31.774112+0000","last_clean":"2023-08-11T12:22:31.774112+0000","last_became_active":"2023-08-11T12:22:07.882198+0000","last_became_peered":"2023-08-11T12:22:07.882198+0000","last_unstale":"2023-08-11T12:22:31.774112+0000","last_undegraded":"2023-08-11T12:22:31.774112+0000","last_fullsized":"2023-08-11T12:22:31.774112+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:21:03.227408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"87'5","reported_seq":85,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:23:22.809651+0000","last_change":"2023-08-11T12:22:02.846424+0000","last_active":"2023-08-11T12:23:22.809651+0000","last_peered":"2023-08-11T12:23:22.809651+0000","last_clean":"2023-08-11T12:23:22.809651+0000","last_became_active":"2023-08-11T12:22:02.846063+0000","last_became_peered":"2023-08-11T12:22:02.846063+0000","last_unstale":"2023-08-11T12:23:22.809651+0000","last_undegraded":"2023-08-11T12:23:22.809651+0000","last_fullsized":"2023-08-11T12:23:22.809651+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:28:14.946971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717852+0000","last_change":"2023-08-11T12:22:03.845616+0000","last_active":"2023-08-11T12:22:31.717852+0000","last_peered":"2023-08-11T12:22:31.717852+0000","last_clean":"2023-08-11T12:22:31.717852+0000","last_became_active":"2023-08-11T12:22:03.845293+0000","last_became_peered":"2023-08-11T12:22:03.845293+0000","last_unstale":"2023-08-11T12:22:31.717852+0000","last_undegraded":"2023-08-11T12:22:31.717852+0000","last_fullsized":"2023-08-11T12:22:31.717852+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:28:30.374044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718737+0000","last_change":"2023-08-11T12:22:07.888963+0000","last_active":"2023-08-11T12:22:31.718737+0000","last_peered":"2023-08-11T12:22:31.718737+0000","last_clean":"2023-08-11T12:22:31.718737+0000","last_became_active":"2023-08-11T12:22:07.888513+0000","last_became_peered":"2023-08-11T12:22:07.888513+0000","last_unstale":"2023-08-11T12:22:31.718737+0000","last_undegraded":"2023-08-11T12:22:31.718737+0000","last_fullsized":"2023-08-11T12:22:31.718737+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:44:29.823122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800936+0000","last_change":"2023-08-11T12:22:02.850739+0000","last_active":"2023-08-11T12:22:31.800936+0000","last_peered":"2023-08-11T12:22:31.800936+0000","last_clean":"2023-08-11T12:22:31.800936+0000","last_became_active":"2023-08-11T12:22:02.850455+0000","last_became_peered":"2023-08-11T12:22:02.850455+0000","last_unstale":"2023-08-11T12:22:31.800936+0000","last_undegraded":"2023-08-11T12:22:31.800936+0000","last_fullsized":"2023-08-11T12:22:31.800936+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:37:48.954343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718121+0000","last_change":"2023-08-11T12:22:03.838834+0000","last_active":"2023-08-11T12:22:31.718121+0000","last_peered":"2023-08-11T12:22:31.718121+0000","last_clean":"2023-08-11T12:22:31.718121+0000","last_became_active":"2023-08-11T12:22:03.838435+0000","last_became_peered":"2023-08-11T12:22:03.838435+0000","last_unstale":"2023-08-11T12:22:31.718121+0000","last_undegraded":"2023-08-11T12:22:31.718121+0000","last_fullsized":"2023-08-11T12:22:31.718121+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:42:39.127547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.799908+0000","last_change":"2023-08-11T12:22:07.884481+0000","last_active":"2023-08-11T12:22:31.799908+0000","last_peered":"2023-08-11T12:22:31.799908+0000","last_clean":"2023-08-11T12:22:31.799908+0000","last_became_active":"2023-08-11T12:22:07.884084+0000","last_became_peered":"2023-08-11T12:22:07.884084+0000","last_unstale":"2023-08-11T12:22:31.799908+0000","last_undegraded":"2023-08-11T12:22:31.799908+0000","last_fullsized":"2023-08-11T12:22:31.799908+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:06:29.852022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717356+0000","last_change":"2023-08-11T12:22:02.849339+0000","last_active":"2023-08-11T12:22:31.717356+0000","last_peered":"2023-08-11T12:22:31.717356+0000","last_clean":"2023-08-11T12:22:31.717356+0000","last_became_active":"2023-08-11T12:22:02.848986+0000","last_became_peered":"2023-08-11T12:22:02.848986+0000","last_unstale":"2023-08-11T12:22:31.717356+0000","last_undegraded":"2023-08-11T12:22:31.717356+0000","last_fullsized":"2023-08-11T12:22:31.717356+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:00:28.458884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718009+0000","last_change":"2023-08-11T12:22:03.846301+0000","last_active":"2023-08-11T12:22:31.718009+0000","last_peered":"2023-08-11T12:22:31.718009+0000","last_clean":"2023-08-11T12:22:31.718009+0000","last_became_active":"2023-08-11T12:22:03.845990+0000","last_became_peered":"2023-08-11T12:22:03.845990+0000","last_unstale":"2023-08-11T12:22:31.718009+0000","last_undegraded":"2023-08-11T12:22:31.718009+0000","last_fullsized":"2023-08-11T12:22:31.718009+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:30:23.134555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719713+0000","last_change":"2023-08-11T12:22:03.836652+0000","last_active":"2023-08-11T12:22:31.719713+0000","last_peered":"2023-08-11T12:22:31.719713+0000","last_clean":"2023-08-11T12:22:31.719713+0000","last_became_active":"2023-08-11T12:22:03.836236+0000","last_became_peered":"2023-08-11T12:22:03.836236+0000","last_unstale":"2023-08-11T12:22:31.719713+0000","last_undegraded":"2023-08-11T12:22:31.719713+0000","last_fullsized":"2023-08-11T12:22:31.719713+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:15:43.477085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722669+0000","last_change":"2023-08-11T12:22:03.831318+0000","last_active":"2023-08-11T12:22:31.722669+0000","last_peered":"2023-08-11T12:22:31.722669+0000","last_clean":"2023-08-11T12:22:31.722669+0000","last_became_active":"2023-08-11T12:22:03.830670+0000","last_became_peered":"2023-08-11T12:22:03.830670+0000","last_unstale":"2023-08-11T12:22:31.722669+0000","last_undegraded":"2023-08-11T12:22:31.722669+0000","last_fullsized":"2023-08-11T12:22:31.722669+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:27:54.407934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722460+0000","last_change":"2023-08-11T12:22:03.841396+0000","last_active":"2023-08-11T12:22:31.722460+0000","last_peered":"2023-08-11T12:22:31.722460+0000","last_clean":"2023-08-11T12:22:31.722460+0000","last_became_active":"2023-08-11T12:22:03.841076+0000","last_became_peered":"2023-08-11T12:22:03.841076+0000","last_unstale":"2023-08-11T12:22:31.722460+0000","last_undegraded":"2023-08-11T12:22:31.722460+0000","last_fullsized":"2023-08-11T12:22:31.722460+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:14:14.365513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719065+0000","last_change":"2023-08-11T12:22:03.847266+0000","last_active":"2023-08-11T12:22:31.719065+0000","last_peered":"2023-08-11T12:22:31.719065+0000","last_clean":"2023-08-11T12:22:31.719065+0000","last_became_active":"2023-08-11T12:22:03.846898+0000","last_became_peered":"2023-08-11T12:22:03.846898+0000","last_unstale":"2023-08-11T12:22:31.719065+0000","last_undegraded":"2023-08-11T12:22:31.719065+0000","last_fullsized":"2023-08-11T12:22:31.719065+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:05:00.055352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717696+0000","last_change":"2023-08-11T12:22:03.843491+0000","last_active":"2023-08-11T12:22:31.717696+0000","last_peered":"2023-08-11T12:22:31.717696+0000","last_clean":"2023-08-11T12:22:31.717696+0000","last_became_active":"2023-08-11T12:22:03.843099+0000","last_became_peered":"2023-08-11T12:22:03.843099+0000","last_unstale":"2023-08-11T12:22:31.717696+0000","last_undegraded":"2023-08-11T12:22:31.717696+0000","last_fullsized":"2023-08-11T12:22:31.717696+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:24:27.850492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720347+0000","last_change":"2023-08-11T12:22:03.840508+0000","last_active":"2023-08-11T12:22:31.720347+0000","last_peered":"2023-08-11T12:22:31.720347+0000","last_clean":"2023-08-11T12:22:31.720347+0000","last_became_active":"2023-08-11T12:22:03.840160+0000","last_became_peered":"2023-08-11T12:22:03.840160+0000","last_unstale":"2023-08-11T12:22:31.720347+0000","last_undegraded":"2023-08-11T12:22:31.720347+0000","last_fullsized":"2023-08-11T12:22:31.720347+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:09:11.925192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723599+0000","last_change":"2023-08-11T12:22:03.843724+0000","last_active":"2023-08-11T12:22:31.723599+0000","last_peered":"2023-08-11T12:22:31.723599+0000","last_clean":"2023-08-11T12:22:31.723599+0000","last_became_active":"2023-08-11T12:22:03.843431+0000","last_became_peered":"2023-08-11T12:22:03.843431+0000","last_unstale":"2023-08-11T12:22:31.723599+0000","last_undegraded":"2023-08-11T12:22:31.723599+0000","last_fullsized":"2023-08-11T12:22:31.723599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:02:15.971280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721778+0000","last_change":"2023-08-11T12:22:03.831268+0000","last_active":"2023-08-11T12:22:31.721778+0000","last_peered":"2023-08-11T12:22:31.721778+0000","last_clean":"2023-08-11T12:22:31.721778+0000","last_became_active":"2023-08-11T12:22:03.830839+0000","last_became_peered":"2023-08-11T12:22:03.830839+0000","last_unstale":"2023-08-11T12:22:31.721778+0000","last_undegraded":"2023-08-11T12:22:31.721778+0000","last_fullsized":"2023-08-11T12:22:31.721778+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:25:09.422026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800266+0000","last_change":"2023-08-11T12:22:03.839227+0000","last_active":"2023-08-11T12:22:31.800266+0000","last_peered":"2023-08-11T12:22:31.800266+0000","last_clean":"2023-08-11T12:22:31.800266+0000","last_became_active":"2023-08-11T12:22:03.838526+0000","last_became_peered":"2023-08-11T12:22:03.838526+0000","last_unstale":"2023-08-11T12:22:31.800266+0000","last_undegraded":"2023-08-11T12:22:31.800266+0000","last_fullsized":"2023-08-11T12:22:31.800266+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:56:06.609931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720671+0000","last_change":"2023-08-11T12:22:03.834614+0000","last_active":"2023-08-11T12:22:31.720671+0000","last_peered":"2023-08-11T12:22:31.720671+0000","last_clean":"2023-08-11T12:22:31.720671+0000","last_became_active":"2023-08-11T12:22:03.834267+0000","last_became_peered":"2023-08-11T12:22:03.834267+0000","last_unstale":"2023-08-11T12:22:31.720671+0000","last_undegraded":"2023-08-11T12:22:31.720671+0000","last_fullsized":"2023-08-11T12:22:31.720671+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:05:00.003830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774418+0000","last_change":"2023-08-11T12:22:03.846504+0000","last_active":"2023-08-11T12:22:31.774418+0000","last_peered":"2023-08-11T12:22:31.774418+0000","last_clean":"2023-08-11T12:22:31.774418+0000","last_became_active":"2023-08-11T12:22:03.846156+0000","last_became_peered":"2023-08-11T12:22:03.846156+0000","last_unstale":"2023-08-11T12:22:31.774418+0000","last_undegraded":"2023-08-11T12:22:31.774418+0000","last_fullsized":"2023-08-11T12:22:31.774418+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:54:38.654858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717285+0000","last_change":"2023-08-11T12:22:03.849854+0000","last_active":"2023-08-11T12:22:31.717285+0000","last_peered":"2023-08-11T12:22:31.717285+0000","last_clean":"2023-08-11T12:22:31.717285+0000","last_became_active":"2023-08-11T12:22:03.849553+0000","last_became_peered":"2023-08-11T12:22:03.849553+0000","last_unstale":"2023-08-11T12:22:31.717285+0000","last_undegraded":"2023-08-11T12:22:31.717285+0000","last_fullsized":"2023-08-11T12:22:31.717285+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:14:27.485150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720171+0000","last_change":"2023-08-11T12:22:03.843511+0000","last_active":"2023-08-11T12:22:31.720171+0000","last_peered":"2023-08-11T12:22:31.720171+0000","last_clean":"2023-08-11T12:22:31.720171+0000","last_became_active":"2023-08-11T12:22:03.843206+0000","last_became_peered":"2023-08-11T12:22:03.843206+0000","last_unstale":"2023-08-11T12:22:31.720171+0000","last_undegraded":"2023-08-11T12:22:31.720171+0000","last_fullsized":"2023-08-11T12:22:31.720171+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:19:44.978907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":248338,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10264,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":562,"num_read_kb":300,"num_write":209,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":30792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449118,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":484340,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.443,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.48999999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.52200000000000002}]},{"osd":1,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.51000000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.41499999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77800000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.72699999999999998}]},{"osd":2,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.52500000000000002,"15min":0.53200000000000003},"min":{"1min":0.35599999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70899999999999996,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.33200000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79100000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":4,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.69899999999999995,"15min":0.69599999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89700000000000002,"5min":1.032,"15min":1.032},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.60999999999999999},"min":{"1min":0.46000000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.78100000000000003,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.63100000000000001}]},{"osd":5,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.64900000000000002,"15min":0.66100000000000003},"min":{"1min":0.34799999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77500000000000002,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65900000000000003,"15min":0.65700000000000003},"min":{"1min":0.437,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.748}]},{"osd":6,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.68400000000000005,"15min":0.69099999999999995},"min":{"1min":0.46500000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86499999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.98299999999999998,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.81399999999999995}]},{"osd":7,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.79100000000000004,"15min":0.78700000000000003},"min":{"1min":0.55100000000000005,"5min":0.503,"15min":0.503},"max":{"1min":1.0229999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.56100000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.873,"5min":1.302,"15min":1.302},"last":0.91100000000000003}]},{"osd":8,"last update":"Fri Aug 11 12:23:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.874}]},{"osd":9,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.61899999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.81100000000000005,"15min":0.80500000000000005},"min":{"1min":0.59999999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.071,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.99099999999999999}]},{"osd":10,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.61299999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93000000000000005,"5min":1.341,"15min":1.341},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.82199999999999995,"15min":0.82399999999999995},"min":{"1min":0.59099999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.95099999999999996,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.94399999999999995}]}]},{"osd":10,"up_from":71,"seq":304942678048,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1064960,"data_stored":1078813,"data_compressed":53533,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.67600000000000005}]},{"osd":1,"last update":"Fri Aug 11 12:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.48499999999999999,"15min":0.48299999999999998},"min":{"1min":0.36099999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65800000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.34300000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73799999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Aug 11 12:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64000000000000001,"15min":0.63600000000000001},"min":{"1min":0.50700000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.85399999999999998,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.66200000000000003,"15min":0.65700000000000003},"min":{"1min":0.53800000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.80900000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.90200000000000002}]},{"osd":3,"last update":"Fri Aug 11 12:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.67400000000000004,"15min":0.68600000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.71999999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.72899999999999998,"15min":0.72599999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.85499999999999998,"5min":1.528,"15min":1.528},"last":0.78200000000000003}]},{"osd":4,"last update":"Fri Aug 11 12:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.624,"15min":0.62},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.624,"15min":0.628},"min":{"1min":0.33800000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.81999999999999995,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.84799999999999998}]},{"osd":5,"last update":"Fri Aug 11 12:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72299999999999998,"15min":0.72099999999999997},"min":{"1min":0.57599999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98499999999999999,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.747,"15min":0.74199999999999999},"min":{"1min":0.56899999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95699999999999996,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.99099999999999999}]},{"osd":6,"last update":"Fri Aug 11 12:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.80900000000000005,"15min":0.81200000000000006},"min":{"1min":0.55700000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.96899999999999997,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82199999999999995,"15min":0.81799999999999995},"min":{"1min":0.53000000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98899999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.88500000000000001}]},{"osd":7,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.59099999999999997}]},{"osd":8,"last update":"Fri Aug 11 12:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.84199999999999997,"15min":0.83599999999999997},"min":{"1min":0.68700000000000006,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.004,"5min":1.296,"15min":1.296},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.85299999999999998,"15min":0.85499999999999998},"min":{"1min":0.68100000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.0409999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.1100000000000001}]},{"osd":9,"last update":"Fri Aug 11 12:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.88300000000000001,"15min":0.879},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0589999999999999,"5min":1.21,"15min":1.21},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.86099999999999999,"15min":0.86499999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.996,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.157}]},{"osd":11,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.86099999999999999,"15min":0.86499999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0900000000000001,"5min":1.323,"15min":1.323},"last":1.05},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.86499999999999999,"15min":0.85899999999999999},"min":{"1min":0.61099999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0549999999999999,"5min":1.341,"15min":1.341},"last":1.1339999999999999}]}]},{"osd":9,"up_from":66,"seq":283467841572,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":484270,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.38500000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77300000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.65500000000000003}]},{"osd":1,"last update":"Fri Aug 11 12:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.746,"15min":0.753},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83799999999999997,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64000000000000001,"15min":0.63700000000000001},"min":{"1min":0.42899999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86499999999999999,"5min":1.024,"15min":1.024},"last":0.79300000000000004}]},{"osd":2,"last update":"Fri Aug 11 12:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78200000000000003,"15min":0.78900000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96999999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.75,"15min":0.76000000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.96199999999999997,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.67800000000000005}]},{"osd":3,"last update":"Fri Aug 11 12:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.71199999999999997,"15min":0.73999999999999999},"min":{"1min":0.41299999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75900000000000001,"5min":1.355,"15min":1.355},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.76000000000000001,"15min":0.79000000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.74399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.63100000000000001}]},{"osd":4,"last update":"Fri Aug 11 12:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.748,"15min":0.752},"min":{"1min":0.56799999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.89700000000000002,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.81899999999999995,"15min":0.82899999999999996},"min":{"1min":0.64200000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.96499999999999997,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.81999999999999995}]},{"osd":5,"last update":"Fri Aug 11 12:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.89700000000000002,"15min":0.92300000000000004},"min":{"1min":0.54100000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.0620000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.90700000000000003,"15min":0.92900000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1060000000000001,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.81000000000000005}]},{"osd":6,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Aug 11 12:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.94099999999999995,"15min":0.95899999999999996},"min":{"1min":0.69399999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":0.98899999999999999,"5min":1.163,"15min":1.163},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.98899999999999999,"15min":1.0129999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.97299999999999998,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.84899999999999998}]},{"osd":8,"last update":"Fri Aug 11 12:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.95399999999999996,"15min":0.97799999999999998},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.085,"5min":1.319,"15min":1.319},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.97999999999999998,"15min":1.002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.86199999999999999}]},{"osd":10,"last update":"Fri Aug 11 12:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.95599999999999996,"15min":0.97399999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.0589999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.878}]},{"osd":11,"last update":"Fri Aug 11 12:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.90800000000000003}]}]},{"osd":8,"up_from":58,"seq":249108103211,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":484648,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:23:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":0.70799999999999996,"15min":0.59099999999999997},"min":{"1min":0.432,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":12.307,"5min":12.307,"15min":12.307},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.42799999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.81100000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.47999999999999998}]},{"osd":1,"last update":"Fri Aug 11 12:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.60999999999999999,"15min":0.59899999999999998},"min":{"1min":0.437,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89800000000000002,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61699999999999999,"15min":0.60499999999999998},"min":{"1min":0.41999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.89500000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.629}]},{"osd":2,"last update":"Fri Aug 11 12:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.45300000000000001,"15min":0.432},"min":{"1min":0.32900000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.68500000000000005,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.46800000000000003,"15min":0.44500000000000001},"min":{"1min":0.39000000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66000000000000003,"5min":0.878,"15min":0.878},"last":0.44500000000000001}]},{"osd":3,"last update":"Fri Aug 11 12:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.68100000000000005,"15min":0.65300000000000002},"min":{"1min":0.39000000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":4.2599999999999998,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.68799999999999994,"15min":0.63300000000000001},"min":{"1min":0.55100000000000005,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":4.0970000000000004,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":0.50600000000000001}]},{"osd":4,"last update":"Fri Aug 11 12:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.64600000000000002,"15min":0.622},"min":{"1min":0.50800000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67300000000000004,"15min":0.65500000000000003},"min":{"1min":0.505,"5min":0.432,"15min":0.432},"max":{"1min":0.94199999999999995,"5min":1.107,"15min":1.107},"last":0.75900000000000001}]},{"osd":5,"last update":"Fri Aug 11 12:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.56699999999999995,"15min":0.53700000000000003},"min":{"1min":0.44,"5min":0.309,"15min":0.309},"max":{"1min":0.93000000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.60199999999999998,"15min":0.57099999999999995},"min":{"1min":0.41699999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.92200000000000004,"5min":1.177,"15min":1.177},"last":0.68400000000000005}]},{"osd":6,"last update":"Fri Aug 11 12:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.748,"15min":0.70199999999999996},"min":{"1min":0.62,"5min":0.441,"15min":0.441},"max":{"1min":3.1709999999999998,"5min":3.1709999999999998,"15min":3.1709999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.78200000000000003,"15min":0.73399999999999999},"min":{"1min":0.65400000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":4.1180000000000003,"5min":4.1180000000000003,"15min":4.1180000000000003},"last":0.66600000000000004}]},{"osd":7,"last update":"Fri Aug 11 12:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.72899999999999998,"15min":0.69799999999999995},"min":{"1min":0.60199999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97399999999999998,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.74399999999999999,"15min":0.71999999999999997},"min":{"1min":0.58099999999999996,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.071,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.78400000000000003}]},{"osd":9,"last update":"Fri Aug 11 12:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.78400000000000003,"15min":0.76800000000000002},"min":{"1min":0.63,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.874,"5min":0.80100000000000005,"15min":0.78900000000000003},"min":{"1min":0.622,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.84599999999999997}]},{"osd":10,"last update":"Fri Aug 11 12:22:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.78200000000000003,"15min":0.76400000000000001},"min":{"1min":0.627,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.80100000000000005,"15min":0.78400000000000003},"min":{"1min":0.65500000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.879}]},{"osd":11,"last update":"Fri Aug 11 12:23:07 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.91200000000000003}]}]},{"osd":7,"up_from":51,"seq":219043332142,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1040384,"data_stored":1076385,"data_compressed":53533,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.61399999999999999,"15min":0.60599999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.55200000000000005,"15min":0.53700000000000003},"min":{"1min":0.46999999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.65700000000000003}]},{"osd":1,"last update":"Fri Aug 11 12:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.42799999999999999,"15min":0.40600000000000003},"min":{"1min":0.35899999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.65400000000000003,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.46800000000000003,"15min":0.44800000000000001},"min":{"1min":0.34699999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72099999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.63900000000000001}]},{"osd":2,"last update":"Fri Aug 11 12:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61299999999999999,"15min":0.60499999999999998},"min":{"1min":0.44600000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79000000000000004,"5min":0.879,"15min":0.879},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.61099999999999999,"15min":0.58699999999999997},"min":{"1min":0.48499999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.745}]},{"osd":3,"last update":"Fri Aug 11 12:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.63400000000000001,"15min":0.61299999999999999},"min":{"1min":0.50800000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.70899999999999996,"15min":0.64900000000000002},"min":{"1min":0.48099999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":5.8419999999999996,"5min":5.8419999999999996,"15min":5.8419999999999996},"last":0.55100000000000005}]},{"osd":4,"last update":"Fri Aug 11 12:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.55700000000000005,"15min":0.54000000000000004},"min":{"1min":0.41999999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80700000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.38500000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.89300000000000002,"5min":1.105,"15min":1.105},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri Aug 11 12:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.67300000000000004,"15min":0.65900000000000003},"min":{"1min":0.50600000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.86199999999999999,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.68200000000000005,"15min":0.66200000000000003},"min":{"1min":0.55700000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.88200000000000001}]},{"osd":6,"last update":"Fri Aug 11 12:22:56 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.80200000000000005,"15min":0.73999999999999999},"min":{"1min":0.59399999999999997,"5min":0.503,"15min":0.503},"max":{"1min":5.7199999999999998,"5min":5.7199999999999998,"15min":5.7199999999999998},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.73599999999999999,"15min":0.69599999999999995},"min":{"1min":0.56399999999999995,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.82199999999999995}]},{"osd":8,"last update":"Fri Aug 11 12:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.73499999999999999,"15min":0.69499999999999995},"min":{"1min":0.60299999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1830000000000001,"5min":1.206,"15min":1.206},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.72099999999999997,"15min":0.68899999999999995},"min":{"1min":0.57699999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.97199999999999998,"5min":1.018,"15min":1.018},"last":0.85099999999999998}]},{"osd":9,"last update":"Fri Aug 11 12:22:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.83599999999999997,"15min":0.84199999999999997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.0049999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.83899999999999997,"15min":0.84499999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.98599999999999999,"5min":1.087,"15min":1.087},"last":0.83899999999999997}]},{"osd":10,"last update":"Fri Aug 11 12:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.82299999999999995,"15min":0.81799999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.77600000000000002,"15min":0.76400000000000001},"min":{"1min":0.61399999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98199999999999998,"5min":1.036,"15min":1.036},"last":0.92800000000000005}]},{"osd":11,"last update":"Fri Aug 11 12:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.96899999999999997}]}]},{"osd":6,"up_from":46,"seq":197568495668,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":483870,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47499999999999998,"15min":0.46300000000000002},"min":{"1min":0.37,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.73599999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51800000000000002,"15min":0.50800000000000001},"min":{"1min":0.375,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61599999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.41799999999999998}]},{"osd":1,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.65400000000000003,"15min":0.63},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.878,"5min":1.327,"15min":1.327},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.69199999999999995,"15min":0.67500000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98599999999999999,"5min":1.206,"15min":1.206},"last":0.83299999999999996}]},{"osd":2,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.69199999999999995,"15min":0.68799999999999994},"min":{"1min":0.51000000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98399999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.70599999999999996,"15min":0.69299999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.63400000000000001}]},{"osd":3,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59699999999999998,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67400000000000004,"15min":0.66200000000000003},"min":{"1min":0.48499999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.05,"5min":1.196,"15min":1.196},"last":0.53000000000000003}]},{"osd":4,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69799999999999995,"15min":0.69599999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97199999999999998,"5min":1.139,"15min":1.139},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.752,"15min":0.74099999999999999},"min":{"1min":0.52600000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.012,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.96399999999999997}]},{"osd":5,"last update":"Fri Aug 11 12:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.77800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56599999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1499999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80600000000000005,"15min":0.80500000000000005},"min":{"1min":0.59299999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0109999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.72399999999999998}]},{"osd":7,"last update":"Fri Aug 11 12:22:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.82599999999999996,"15min":0.80800000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.097,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.81699999999999995,"15min":0.81200000000000006},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0840000000000001,"5min":1.222,"15min":1.222},"last":0.85699999999999998}]},{"osd":8,"last update":"Fri Aug 11 12:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.84599999999999997,"15min":0.84199999999999997},"min":{"1min":0.66300000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.745},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.89500000000000002,"15min":0.89100000000000001},"min":{"1min":0.80000000000000004,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.0569999999999999}]},{"osd":9,"last update":"Fri Aug 11 12:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.90300000000000002,"15min":0.90900000000000003},"min":{"1min":0.58799999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2250000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.876},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.91900000000000004,"15min":0.92100000000000004},"min":{"1min":0.61699999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2190000000000001,"5min":1.246,"15min":1.246},"last":1.1100000000000001}]},{"osd":10,"last update":"Fri Aug 11 12:22:55 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.89300000000000002,"15min":0.89400000000000002},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1799999999999999,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.012},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.4139999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.0309999999999999}]},{"osd":11,"last update":"Fri Aug 11 12:23:07 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":1.153}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":488742,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54700000000000004,"15min":0.51700000000000002},"min":{"1min":0.34699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.81899999999999995,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.32600000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.75700000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.42499999999999999}]},{"osd":2,"last update":"Fri Aug 11 12:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.58999999999999997,"15min":0.54200000000000004},"min":{"1min":0.504,"5min":0.315,"15min":0.315},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.57099999999999995,"15min":0.52200000000000002},"min":{"1min":0.41399999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.81499999999999995,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.57699999999999996}]},{"osd":3,"last update":"Fri Aug 11 12:22:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80700000000000005,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65600000000000003,"15min":0.63200000000000001},"min":{"1min":0.49099999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90600000000000003,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.70599999999999996}]},{"osd":4,"last update":"Fri Aug 11 12:22:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.48799999999999999,"15min":0.45400000000000001},"min":{"1min":0.36199999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.495,"15min":0.47899999999999998},"min":{"1min":0.33800000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.82799999999999996,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.45600000000000002}]},{"osd":5,"last update":"Fri Aug 11 12:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.68000000000000005,"15min":0.625},"min":{"1min":0.70099999999999996,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.64000000000000001,"15min":0.61199999999999999},"min":{"1min":0.55300000000000005,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.874,"5min":0.875,"15min":0.875},"last":0.73599999999999999}]},{"osd":6,"last update":"Fri Aug 11 12:22:31 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.73299999999999998,"15min":0.73599999999999999},"min":{"1min":0.59299999999999997,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0720000000000001,"5min":1.095,"15min":1.095},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.79600000000000004,"15min":0.78800000000000003},"min":{"1min":0.57999999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.147,"5min":1.159,"15min":1.159},"last":0.83699999999999997}]},{"osd":7,"last update":"Fri Aug 11 12:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.70099999999999996,"15min":0.68300000000000005},"min":{"1min":0.43099999999999999,"5min":0.31,"15min":0.31},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.69699999999999995,"15min":0.68400000000000005},"min":{"1min":0.54500000000000004,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.76000000000000001}]},{"osd":8,"last update":"Fri Aug 11 12:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.76900000000000002,"15min":0.73599999999999999},"min":{"1min":0.72699999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.79200000000000004,"15min":0.747},"min":{"1min":0.57499999999999996,"5min":0.436,"15min":0.436},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.996}]},{"osd":9,"last update":"Fri Aug 11 12:22:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.75800000000000001,"15min":0.752},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.88,"5min":0.82099999999999995,"15min":0.81100000000000005},"min":{"1min":0.61399999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.871}]},{"osd":10,"last update":"Fri Aug 11 12:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.82999999999999996,"15min":0.80200000000000005},"min":{"1min":0.623,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.78600000000000003,"15min":0.77600000000000002},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.91600000000000004}]},{"osd":11,"last update":"Fri Aug 11 12:23:06 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.85399999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":485326,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 11 12:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.61099999999999999,"15min":0.53900000000000003},"min":{"1min":0.40200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.93100000000000005,"5min":1.782,"15min":1.782},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.623,"15min":0.55000000000000004},"min":{"1min":0.45900000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.92600000000000005,"5min":2.7749999999999999,"15min":2.7749999999999999},"last":0.57699999999999996}]},{"osd":2,"last update":"Fri Aug 11 12:22:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.623,"15min":0.56299999999999994},"min":{"1min":0.45400000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86099999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.66300000000000003,"15min":0.58799999999999997},"min":{"1min":0.53600000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.89000000000000001,"5min":1.879,"15min":1.879},"last":0.84499999999999997}]},{"osd":3,"last update":"Fri Aug 11 12:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.48799999999999999}]},{"osd":4,"last update":"Fri Aug 11 12:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68100000000000005,"15min":0.61899999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.04,"5min":1.849,"15min":1.849},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.70099999999999996,"15min":0.63900000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.872,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":0.61799999999999999}]},{"osd":5,"last update":"Fri Aug 11 12:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.74199999999999999,"15min":0.69799999999999995},"min":{"1min":0.56599999999999995,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.522,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75800000000000001,"15min":0.72299999999999998},"min":{"1min":0.56100000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2290000000000001,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.70799999999999996}]},{"osd":6,"last update":"Fri Aug 11 12:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97699999999999998,"5min":2.8839999999999999,"15min":2.8839999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.70999999999999996,"15min":0.71599999999999997},"min":{"1min":0.41299999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.95799999999999996,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.78400000000000003}]},{"osd":7,"last update":"Fri Aug 11 12:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.871},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.92500000000000004}]},{"osd":8,"last update":"Fri Aug 11 12:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.82199999999999995,"15min":0.84199999999999997},"min":{"1min":0.57199999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0600000000000001,"5min":1.262,"15min":1.262},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.90500000000000003,"15min":0.93100000000000005},"min":{"1min":0.57799999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.5609999999999999,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.91400000000000003}]},{"osd":9,"last update":"Fri Aug 11 12:22:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.85899999999999999,"15min":0.87},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0980000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.93999999999999995,"15min":0.95899999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0860000000000001,"5min":1.452,"15min":1.452},"last":0.96999999999999997}]},{"osd":10,"last update":"Fri Aug 11 12:22:57 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.93899999999999995,"15min":0.94599999999999995},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.1040000000000001,"5min":1.48,"15min":1.48},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.89100000000000001,"15min":0.89500000000000002},"min":{"1min":0.63200000000000001,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0800000000000001,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.82899999999999996}]},{"osd":11,"last update":"Fri Aug 11 12:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.876,"15min":0.876},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1399999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.94999999999999996,"15min":0.94499999999999995},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1}]}]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":488293,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63100000000000001,"15min":0.55100000000000005},"min":{"1min":0.38400000000000001,"5min":0.316,"15min":0.316},"max":{"1min":1.343,"5min":5.968,"15min":5.968},"last":0.44},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.40500000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.47799999999999998}]},{"osd":1,"last update":"Fri Aug 11 12:22:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.56799999999999995,"15min":0.51700000000000002},"min":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.58899999999999997,"15min":0.53600000000000003},"min":{"1min":0.45600000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.65900000000000003}]},{"osd":3,"last update":"Fri Aug 11 12:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.63200000000000001,"15min":0.60299999999999998},"min":{"1min":0.45500000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88900000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.64800000000000002,"15min":0.60699999999999998},"min":{"1min":0.47999999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86199999999999999,"5min":1.306,"15min":1.306},"last":0.67600000000000005}]},{"osd":4,"last update":"Fri Aug 11 12:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Aug 11 12:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.46400000000000002,"15min":0.435},"min":{"1min":0.374,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.66500000000000004,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.47999999999999998,"15min":0.45200000000000001},"min":{"1min":0.40600000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63400000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.77200000000000002}]},{"osd":6,"last update":"Fri Aug 11 12:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64000000000000001,"15min":0.624},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.66200000000000003,"15min":0.626},"min":{"1min":0.504,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.89500000000000002}]},{"osd":7,"last update":"Fri Aug 11 12:23:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.753},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.83799999999999997}]},{"osd":8,"last update":"Fri Aug 11 12:23:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.621,"15min":0.59499999999999997},"min":{"1min":0.44500000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91300000000000003,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.59699999999999998,"15min":0.56699999999999995},"min":{"1min":0.441,"5min":0.439,"15min":0.439},"max":{"1min":0.93200000000000005,"5min":1.325,"15min":1.325},"last":0.70299999999999996}]},{"osd":9,"last update":"Fri Aug 11 12:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.73899999999999999,"15min":0.72999999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.80300000000000005,"15min":0.80100000000000005},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.92100000000000004}]},{"osd":10,"last update":"Fri Aug 11 12:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.79100000000000004,"15min":0.78300000000000003},"min":{"1min":0.57899999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.83699999999999997,"15min":0.82899999999999996},"min":{"1min":0.65500000000000003,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.94599999999999995}]},{"osd":11,"last update":"Fri Aug 11 12:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.88}]}]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":483578,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.437,"15min":0.38700000000000001},"min":{"1min":0.33900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":1.3089999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.46999999999999997,"15min":0.438},"min":{"1min":0.36299999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67300000000000004,"5min":1.006,"15min":1.006},"last":1.498}]},{"osd":1,"last update":"Fri Aug 11 12:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64200000000000002,"15min":0.57399999999999995},"min":{"1min":0.48399999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.98599999999999999,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.433},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.63200000000000001,"15min":0.59299999999999997},"min":{"1min":0.45100000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92200000000000004,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.67500000000000004}]},{"osd":2,"last update":"Fri Aug 11 12:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.64700000000000002,"15min":0.61799999999999999},"min":{"1min":0.54600000000000004,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85099999999999998,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":1.4019999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.69699999999999995,"15min":0.63},"min":{"1min":0.56299999999999994,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.89800000000000002}]},{"osd":4,"last update":"Fri Aug 11 12:22:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.66200000000000003,"15min":0.61599999999999999},"min":{"1min":0.48099999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88700000000000001,"5min":1.242,"15min":1.242},"last":0.63},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72299999999999998,"15min":0.64900000000000002},"min":{"1min":0.51900000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.0029999999999999,"5min":1.073,"15min":1.073},"last":0.56200000000000006}]},{"osd":5,"last update":"Fri Aug 11 12:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70699999999999996,"15min":0.65700000000000003},"min":{"1min":0.52100000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.996,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.73099999999999998,"15min":0.67600000000000005},"min":{"1min":0.54400000000000004,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.016,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":1.3660000000000001}]},{"osd":6,"last update":"Fri Aug 11 12:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78000000000000003,"15min":0.76200000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0760000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.72399999999999998,"15min":0.71399999999999997},"min":{"1min":0.49099999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0309999999999999,"5min":1.056,"15min":1.056},"last":1.518}]},{"osd":7,"last update":"Fri Aug 11 12:22:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78900000000000003,"15min":0.76600000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.98399999999999999,"5min":1.131,"15min":1.131},"last":1.321},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.90200000000000002,"15min":0.88600000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1619999999999999,"5min":1.361,"15min":1.361},"last":0.84899999999999998}]},{"osd":8,"last update":"Fri Aug 11 12:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.75700000000000001}]},{"osd":9,"last update":"Fri Aug 11 12:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.97899999999999998,"15min":0.995},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.1579999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.208},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.92500000000000004,"15min":0.94299999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.113,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.569}]},{"osd":10,"last update":"Fri Aug 11 12:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.97999999999999998,"15min":0.996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1910000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.96599999999999997,"15min":0.97899999999999998},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.214,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.681}]},{"osd":11,"last update":"Fri Aug 11 12:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.96599999999999997}]}]},{"osd":4,"up_from":33,"seq":141733920829,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":483848,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.39900000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.81599999999999995,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.41399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80900000000000005,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.72099999999999997}]},{"osd":1,"last update":"Fri Aug 11 12:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.42999999999999999,"15min":0.40400000000000003},"min":{"1min":0.29599999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.42299999999999999,"15min":0.38400000000000001},"min":{"1min":0.27700000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.82899999999999996}]},{"osd":2,"last update":"Fri Aug 11 12:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.63400000000000001,"15min":0.58499999999999996},"min":{"1min":0.39700000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.61799999999999999,"15min":0.56999999999999995},"min":{"1min":0.499,"5min":0.378,"15min":0.378},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.98499999999999999}]},{"osd":3,"last update":"Fri Aug 11 12:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.61299999999999999,"15min":0.57099999999999995},"min":{"1min":0.437,"5min":0.379,"15min":0.379},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.57399999999999995,"15min":0.56000000000000005},"min":{"1min":0.35999999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.71399999999999997}]},{"osd":5,"last update":"Fri Aug 11 12:23:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.624,"15min":0.57599999999999996},"min":{"1min":0.51200000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.66000000000000003,"15min":0.59299999999999997},"min":{"1min":0.59699999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.95499999999999996}]},{"osd":6,"last update":"Fri Aug 11 12:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.71399999999999997,"15min":0.69599999999999995},"min":{"1min":0.53400000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.879},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.63,"15min":0.61599999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.85899999999999999}]},{"osd":7,"last update":"Fri Aug 11 12:22:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.621,"15min":0.58299999999999996},"min":{"1min":0.38100000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.69099999999999995,"15min":0.64400000000000002},"min":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":1.01}]},{"osd":8,"last update":"Fri Aug 11 12:23:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.65700000000000003,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.006,"5min":1.016,"15min":1.016},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.80200000000000005,"15min":0.76200000000000001},"min":{"1min":0.65400000000000003,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":1.0940000000000001}]},{"osd":9,"last update":"Fri Aug 11 12:22:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.85199999999999998,"15min":0.84099999999999997},"min":{"1min":0.626,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.157},{"interface":"front","average":{"1min":0.874,"5min":0.83399999999999996,"15min":0.82799999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.143}]},{"osd":10,"last update":"Fri Aug 11 12:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.83799999999999997,"15min":0.83999999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":1.1779999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.746,"15min":0.749},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":1.032}]},{"osd":11,"last update":"Fri Aug 11 12:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.123}]}]},{"osd":5,"up_from":38,"seq":163208757304,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1056768,"data_stored":1076336,"data_compressed":53533,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:23:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.36299999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.627},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.56799999999999995}]},{"osd":1,"last update":"Fri Aug 11 12:23:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55600000000000005,"15min":0.54400000000000004},"min":{"1min":0.441,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77400000000000002,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.59499999999999997,"15min":0.56699999999999995},"min":{"1min":0.42799999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.88200000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.67600000000000005}]},{"osd":2,"last update":"Fri Aug 11 12:23:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.41399999999999998,"15min":0.40100000000000002},"min":{"1min":0.29899999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.441,"15min":0.40699999999999997},"min":{"1min":0.27900000000000003,"5min":0.248,"15min":0.248},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.51300000000000001}]},{"osd":3,"last update":"Fri Aug 11 12:23:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57299999999999995,"15min":0.56999999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.39700000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.89300000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.74399999999999999}]},{"osd":4,"last update":"Fri Aug 11 12:23:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.64100000000000001,"15min":0.60199999999999998},"min":{"1min":0.45800000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.95499999999999996,"5min":1.016,"15min":1.016},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.62,"15min":0.60599999999999998},"min":{"1min":0.41799999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85799999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.71099999999999997}]},{"osd":6,"last update":"Fri Aug 11 12:22:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.628,"15min":0.61299999999999999},"min":{"1min":0.434,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84999999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.69599999999999995,"15min":0.67300000000000004},"min":{"1min":0.48799999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.75700000000000001}]},{"osd":7,"last update":"Fri Aug 11 12:22:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.69799999999999995,"15min":0.67800000000000005},"min":{"1min":0.56899999999999995,"5min":0.438,"15min":0.438},"max":{"1min":0.91700000000000004,"5min":1.048,"15min":1.048},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68200000000000005,"15min":0.66800000000000004},"min":{"1min":0.50800000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89700000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.83999999999999997}]},{"osd":8,"last update":"Fri Aug 11 12:23:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.63200000000000001,"15min":0.60299999999999998},"min":{"1min":0.48199999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58199999999999996,"15min":0.56399999999999995},"min":{"1min":0.46100000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.77000000000000002}]},{"osd":9,"last update":"Fri Aug 11 12:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72999999999999998,"15min":0.73099999999999998},"min":{"1min":0.55000000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.88400000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.89600000000000002}]},{"osd":10,"last update":"Fri Aug 11 12:22:57 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.82299999999999995,"15min":0.81899999999999995},"min":{"1min":0.67500000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0169999999999999,"5min":1.083,"15min":1.083},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.76300000000000001,"15min":0.75900000000000001},"min":{"1min":0.61499999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.88100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34304,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34304,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":5578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-11T12:23:28.949 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-08-11T12:23:28.950 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-08-11T12:23:28.950 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-08-11T12:23:28.951 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph health --format=json 2023-08-11T12:23:29.690 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:23:29.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:29 smithi194 ceph-mon[130905]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:23:29.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:29 smithi194 ceph-mon[130905]: pgmap v318: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:29.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:29 smithi045 ceph-mon[130284]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:23:29.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:29 smithi045 ceph-mon[130284]: pgmap v318: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:30.002 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:29 smithi008 ceph-mon[97158]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:23:30.003 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:29 smithi008 ceph-mon[97158]: pgmap v318: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:31.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:30 smithi008 ceph-mon[97158]: pgmap v319: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-11T12:23:31.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:30 smithi194 ceph-mon[130905]: pgmap v319: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-11T12:23:31.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:30 smithi045 ceph-mon[130284]: pgmap v319: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-11T12:23:31.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.541+0000 7f7bd5500700 1 -- 172.21.15.8:0/2981274062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bd0101300 msgr2=0x7f7bd010d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:31.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.541+0000 7f7bd5500700 1 --2- 172.21.15.8:0/2981274062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bd0101300 0x7f7bd010d810 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7bc800b0a0 tx=0x7f7bc800b3b0 comp rx=0 tx=0).stop 2023-08-11T12:23:31.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.541+0000 7f7bd5500700 1 -- 172.21.15.8:0/2981274062 shutdown_connections 2023-08-11T12:23:31.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.541+0000 7f7bd5500700 1 --2- 172.21.15.8:0/2981274062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bd0101300 0x7f7bd010d810 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:31.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.542+0000 7f7bd5500700 1 --2- 172.21.15.8:0/2981274062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bd0106940 0x7f7bd0106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:31.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.542+0000 7f7bd5500700 1 --2- 172.21.15.8:0/2981274062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bd0100940 0x7f7bd0100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:31.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.542+0000 7f7bd5500700 1 -- 172.21.15.8:0/2981274062 >> 172.21.15.8:0/2981274062 conn(0x7f7bd00fc410 msgr2=0x7f7bd00fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:31.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.542+0000 7f7bd5500700 1 -- 172.21.15.8:0/2981274062 shutdown_connections 2023-08-11T12:23:31.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.542+0000 7f7bd5500700 1 -- 172.21.15.8:0/2981274062 wait complete. 2023-08-11T12:23:31.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.543+0000 7f7bd5500700 1 Processor -- start 2023-08-11T12:23:31.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.543+0000 7f7bd5500700 1 -- start start 2023-08-11T12:23:31.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.543+0000 7f7bd5500700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bd0100940 0x7f7bd019ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:31.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.543+0000 7f7bd5500700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bd0101300 0x7f7bd019ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:31.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.543+0000 7f7bd5500700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bd0106940 0x7f7bd0198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:31.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.543+0000 7f7bd5500700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd01991a0 con 0x7f7bd0101300 2023-08-11T12:23:31.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.543+0000 7f7bd5500700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd0199310 con 0x7f7bd0100940 2023-08-11T12:23:31.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.543+0000 7f7bd5500700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd01994d0 con 0x7f7bd0106940 2023-08-11T12:23:31.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.544+0000 7f7bce7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bd0101300 0x7f7bd019ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:31.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.544+0000 7f7bce7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bd0101300 0x7f7bd019ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40524/0 (socket says 172.21.15.8:40524) 2023-08-11T12:23:31.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.544+0000 7f7bce7fc700 1 -- 172.21.15.8:0/1889717343 learned_addr learned my addr 172.21.15.8:0/1889717343 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:31.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.544+0000 7f7bceffd700 1 --2- 172.21.15.8:0/1889717343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bd0100940 0x7f7bd019ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:31.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.544+0000 7f7bcf7fe700 1 --2- 172.21.15.8:0/1889717343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bd0106940 0x7f7bd0198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:31.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.544+0000 7f7bce7fc700 1 -- 172.21.15.8:0/1889717343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bd0106940 msgr2=0x7f7bd0198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:31.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.544+0000 7f7bce7fc700 1 --2- 172.21.15.8:0/1889717343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bd0106940 0x7f7bd0198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:31.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.544+0000 7f7bce7fc700 1 -- 172.21.15.8:0/1889717343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bd0100940 msgr2=0x7f7bd019ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:31.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.544+0000 7f7bce7fc700 1 --2- 172.21.15.8:0/1889717343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bd0100940 0x7f7bd019ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:31.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.544+0000 7f7bce7fc700 1 -- 172.21.15.8:0/1889717343 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc8009d00 con 0x7f7bd0101300 2023-08-11T12:23:31.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.544+0000 7f7bce7fc700 1 --2- 172.21.15.8:0/1889717343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bd0101300 0x7f7bd019ef80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7bc400e9a0 tx=0x7f7bc400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:31.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.545+0000 7f7bb7fff700 1 -- 172.21.15.8:0/1889717343 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4009790 con 0x7f7bd0101300 2023-08-11T12:23:31.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.545+0000 7f7bd5500700 1 -- 172.21.15.8:0/1889717343 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd01997b0 con 0x7f7bd0101300 2023-08-11T12:23:31.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.545+0000 7f7bb7fff700 1 -- 172.21.15.8:0/1889717343 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7bc4010430 con 0x7f7bd0101300 2023-08-11T12:23:31.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.545+0000 7f7bb7fff700 1 -- 172.21.15.8:0/1889717343 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4018680 con 0x7f7bd0101300 2023-08-11T12:23:31.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.545+0000 7f7bd5500700 1 -- 172.21.15.8:0/1889717343 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd01a5a30 con 0x7f7bd0101300 2023-08-11T12:23:31.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.546+0000 7f7bd5500700 1 -- 172.21.15.8:0/1889717343 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd004e620 con 0x7f7bd0101300 2023-08-11T12:23:31.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.548+0000 7f7bb7fff700 1 -- 172.21.15.8:0/1889717343 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f7bc40105a0 con 0x7f7bd0101300 2023-08-11T12:23:31.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.549+0000 7f7bb7fff700 1 --2- 172.21.15.8:0/1889717343 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f7bb809ff50 0x7f7bb80a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:31.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.550+0000 7f7bb7fff700 1 -- 172.21.15.8:0/1889717343 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f7bc4014070 con 0x7f7bd0101300 2023-08-11T12:23:31.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.550+0000 7f7bceffd700 1 --2- 172.21.15.8:0/1889717343 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f7bb809ff50 0x7f7bb80a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:31.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.551+0000 7f7bceffd700 1 --2- 172.21.15.8:0/1889717343 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f7bb809ff50 0x7f7bb80a2410 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0009be0 tx=0x7f7bc0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:31.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.554+0000 7f7bb7fff700 1 -- 172.21.15.8:0/1889717343 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f7bc4051c30 con 0x7f7bd0101300 2023-08-11T12:23:31.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.811+0000 7f7bd5500700 1 -- 172.21.15.8:0/1889717343 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7bd01109e0 con 0x7f7bd0101300 2023-08-11T12:23:31.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.812+0000 7f7bb7fff700 1 -- 172.21.15.8:0/1889717343 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f7bc4095180 con 0x7f7bd0101300 2023-08-11T12:23:31.815 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:23:31.815 INFO:teuthology.orchestra.run.smithi008.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-08-11T12:23:31.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.814+0000 7f7bd5500700 1 -- 172.21.15.8:0/1889717343 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f7bb809ff50 msgr2=0x7f7bb80a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:31.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.814+0000 7f7bd5500700 1 --2- 172.21.15.8:0/1889717343 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f7bb809ff50 0x7f7bb80a2410 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0009be0 tx=0x7f7bc0009260 comp rx=0 tx=0).stop 2023-08-11T12:23:31.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.814+0000 7f7bd5500700 1 -- 172.21.15.8:0/1889717343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bd0101300 msgr2=0x7f7bd019ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:31.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.814+0000 7f7bd5500700 1 --2- 172.21.15.8:0/1889717343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bd0101300 0x7f7bd019ef80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7bc400e9a0 tx=0x7f7bc400ecb0 comp rx=0 tx=0).stop 2023-08-11T12:23:31.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.814+0000 7f7bd5500700 1 -- 172.21.15.8:0/1889717343 shutdown_connections 2023-08-11T12:23:31.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.814+0000 7f7bd5500700 1 --2- 172.21.15.8:0/1889717343 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f7bb809ff50 0x7f7bb80a2410 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:31.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.814+0000 7f7bd5500700 1 --2- 172.21.15.8:0/1889717343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bd0106940 0x7f7bd0198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:31.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.814+0000 7f7bd5500700 1 --2- 172.21.15.8:0/1889717343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bd0100940 0x7f7bd019ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:31.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.814+0000 7f7bd5500700 1 --2- 172.21.15.8:0/1889717343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bd0101300 0x7f7bd019ef80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:31.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.814+0000 7f7bd5500700 1 -- 172.21.15.8:0/1889717343 >> 172.21.15.8:0/1889717343 conn(0x7f7bd00fc410 msgr2=0x7f7bd010bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:31.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.814+0000 7f7bd5500700 1 -- 172.21.15.8:0/1889717343 shutdown_connections 2023-08-11T12:23:31.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:31.814+0000 7f7bd5500700 1 -- 172.21.15.8:0/1889717343 wait complete. 2023-08-11T12:23:32.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:31 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1889717343' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-08-11T12:23:32.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:31 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1889717343' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-08-11T12:23:32.162 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:31 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1889717343' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-08-11T12:23:32.301 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-08-11T12:23:32.302 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-11T12:23:32.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.508+0000 7f61fd7ff700 1 -- 172.21.15.8:0/1516756729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61f81014f0 msgr2=0x7f61f81038e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:32.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.508+0000 7f61fd7ff700 1 --2- 172.21.15.8:0/1516756729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61f81014f0 0x7f61f81038e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f61e8009990 tx=0x7f61e8009ca0 comp rx=0 tx=0).stop 2023-08-11T12:23:32.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.509+0000 7f61fd7ff700 1 -- 172.21.15.8:0/1516756729 shutdown_connections 2023-08-11T12:23:32.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.509+0000 7f61fd7ff700 1 --2- 172.21.15.8:0/1516756729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61f8106750 0x7f61f8108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:32.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.509+0000 7f61fd7ff700 1 --2- 172.21.15.8:0/1516756729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61f81014f0 0x7f61f81038e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:32.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.509+0000 7f61fd7ff700 1 --2- 172.21.15.8:0/1516756729 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61f8103e20 0x7f61f8106210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:32.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.509+0000 7f61fd7ff700 1 -- 172.21.15.8:0/1516756729 >> 172.21.15.8:0/1516756729 conn(0x7f61f80fae60 msgr2=0x7f61f80fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:32.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.509+0000 7f61fd7ff700 1 -- 172.21.15.8:0/1516756729 shutdown_connections 2023-08-11T12:23:32.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.509+0000 7f61fd7ff700 1 -- 172.21.15.8:0/1516756729 wait complete. 2023-08-11T12:23:32.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.510+0000 7f61fd7ff700 1 Processor -- start 2023-08-11T12:23:32.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.510+0000 7f61fd7ff700 1 -- start start 2023-08-11T12:23:32.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.510+0000 7f61fd7ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61f81014f0 0x7f61f81966b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:32.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.510+0000 7f61fd7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61f8103e20 0x7f61f8196bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:32.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.510+0000 7f61fd7ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61f8106750 0x7f61f819dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:32.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.510+0000 7f61fd7ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f819e230 con 0x7f61f8106750 2023-08-11T12:23:32.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.510+0000 7f61fd7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f819e370 con 0x7f61f8103e20 2023-08-11T12:23:32.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.510+0000 7f61fd7ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f819e500 con 0x7f61f81014f0 2023-08-11T12:23:32.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.511+0000 7f61f6ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61f81014f0 0x7f61f81966b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:32.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.511+0000 7f61f67fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61f8103e20 0x7f61f8196bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:32.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.511+0000 7f61f6ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61f81014f0 0x7f61f81966b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:34314/0 (socket says 172.21.15.8:34314) 2023-08-11T12:23:32.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.511+0000 7f61f6ffd700 1 -- 172.21.15.8:0/2902273638 learned_addr learned my addr 172.21.15.8:0/2902273638 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:32.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.511+0000 7f61f77fe700 1 --2- 172.21.15.8:0/2902273638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61f8106750 0x7f61f819dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:32.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.511+0000 7f61f6ffd700 1 -- 172.21.15.8:0/2902273638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61f8103e20 msgr2=0x7f61f8196bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:32.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.511+0000 7f61f6ffd700 1 --2- 172.21.15.8:0/2902273638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61f8103e20 0x7f61f8196bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:32.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.511+0000 7f61f6ffd700 1 -- 172.21.15.8:0/2902273638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61f8106750 msgr2=0x7f61f819dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:32.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.511+0000 7f61f6ffd700 1 --2- 172.21.15.8:0/2902273638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61f8106750 0x7f61f819dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:32.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.511+0000 7f61f6ffd700 1 -- 172.21.15.8:0/2902273638 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e80095f0 con 0x7f61f81014f0 2023-08-11T12:23:32.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.511+0000 7f61f6ffd700 1 --2- 172.21.15.8:0/2902273638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61f81014f0 0x7f61f81966b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f61e8004730 tx=0x7f61e8004760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:32.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.511+0000 7f61dffff700 1 -- 172.21.15.8:0/2902273638 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e801d070 con 0x7f61f81014f0 2023-08-11T12:23:32.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.512+0000 7f61fd7ff700 1 -- 172.21.15.8:0/2902273638 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f819e780 con 0x7f61f81014f0 2023-08-11T12:23:32.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.512+0000 7f61dffff700 1 -- 172.21.15.8:0/2902273638 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61e8004c90 con 0x7f61f81014f0 2023-08-11T12:23:32.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.512+0000 7f61dffff700 1 -- 172.21.15.8:0/2902273638 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e8005490 con 0x7f61f81014f0 2023-08-11T12:23:32.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.512+0000 7f61fd7ff700 1 -- 172.21.15.8:0/2902273638 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f819eba0 con 0x7f61f81014f0 2023-08-11T12:23:32.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.513+0000 7f61fd7ff700 1 -- 172.21.15.8:0/2902273638 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f80fc9e0 con 0x7f61f81014f0 2023-08-11T12:23:32.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.515+0000 7f61dffff700 1 -- 172.21.15.8:0/2902273638 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f61e800fbc0 con 0x7f61f81014f0 2023-08-11T12:23:32.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.516+0000 7f61dffff700 1 --2- 172.21.15.8:0/2902273638 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f61e009ff50 0x7f61e00a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:32.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.516+0000 7f61dffff700 1 -- 172.21.15.8:0/2902273638 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f61e80ccc20 con 0x7f61f81014f0 2023-08-11T12:23:32.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.517+0000 7f61f67fc700 1 --2- 172.21.15.8:0/2902273638 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f61e009ff50 0x7f61e00a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:32.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.517+0000 7f61f67fc700 1 --2- 172.21.15.8:0/2902273638 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f61e009ff50 0x7f61e00a2410 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f61ec009c60 tx=0x7f61ec009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:32.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.518+0000 7f61dffff700 1 -- 172.21.15.8:0/2902273638 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f61e80966d0 con 0x7f61f81014f0 2023-08-11T12:23:32.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.731+0000 7f61fd7ff700 1 -- 172.21.15.8:0/2902273638 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61f810c200 con 0x7f61f81014f0 2023-08-11T12:23:32.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.733+0000 7f61dffff700 1 -- 172.21.15.8:0/2902273638 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24348 (secure 0 0 0) 0x7f61e8099cf0 con 0x7f61f81014f0 2023-08-11T12:23:32.737 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:23:32.737 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":89,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","created":"2023-08-11T12:14:28.341113+0000","modified":"2023-08-11T12:22:31.713248+0000","last_up_change":"2023-08-11T12:21:14.913735+0000","last_in_change":"2023-08-11T12:20:57.476558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-11T12:17:49.040758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-11T12:22:01.383296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-11T12:22:02.816329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-11T12:22:06.369375+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f903e393-7894-42d6-8b11-737ceef1f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6803","nonce":664104961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6805","nonce":664104961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6809","nonce":664104961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6807","nonce":664104961}]},"public_addr":"172.21.15.8:6803/664104961","cluster_addr":"172.21.15.8:6805/664104961","heartbeat_back_addr":"172.21.15.8:6809/664104961","heartbeat_front_addr":"172.21.15.8:6807/664104961","state":["exists","up"]},{"osd":1,"uuid":"1e988e5c-e78c-46d5-80a5-dff7ac38cbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6801","nonce":4187350703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6803","nonce":4187350703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6807","nonce":4187350703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6805","nonce":4187350703}]},"public_addr":"172.21.15.45:6801/4187350703","cluster_addr":"172.21.15.45:6803/4187350703","heartbeat_back_addr":"172.21.15.45:6807/4187350703","heartbeat_front_addr":"172.21.15.45:6805/4187350703","state":["exists","up"]},{"osd":2,"uuid":"1835217c-a93c-4181-b8b8-cc410bab1a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6801","nonce":2547818140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6803","nonce":2547818140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6807","nonce":2547818140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6805","nonce":2547818140}]},"public_addr":"172.21.15.194:6801/2547818140","cluster_addr":"172.21.15.194:6803/2547818140","heartbeat_back_addr":"172.21.15.194:6807/2547818140","heartbeat_front_addr":"172.21.15.194:6805/2547818140","state":["exists","up"]},{"osd":3,"uuid":"b55ae61a-731c-4312-a998-661122b84788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6811","nonce":187418883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6813","nonce":187418883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6817","nonce":187418883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6815","nonce":187418883}]},"public_addr":"172.21.15.8:6811/187418883","cluster_addr":"172.21.15.8:6813/187418883","heartbeat_back_addr":"172.21.15.8:6817/187418883","heartbeat_front_addr":"172.21.15.8:6815/187418883","state":["exists","up"]},{"osd":4,"uuid":"2c28acbb-e807-4559-8aa2-a35ca84b5d43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6809","nonce":3099704571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6811","nonce":3099704571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6815","nonce":3099704571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6813","nonce":3099704571}]},"public_addr":"172.21.15.45:6809/3099704571","cluster_addr":"172.21.15.45:6811/3099704571","heartbeat_back_addr":"172.21.15.45:6815/3099704571","heartbeat_front_addr":"172.21.15.45:6813/3099704571","state":["exists","up"]},{"osd":5,"uuid":"37032289-8016-4730-9b69-f7985e058ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6809","nonce":263803874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6811","nonce":263803874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6815","nonce":263803874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6813","nonce":263803874}]},"public_addr":"172.21.15.194:6809/263803874","cluster_addr":"172.21.15.194:6811/263803874","heartbeat_back_addr":"172.21.15.194:6815/263803874","heartbeat_front_addr":"172.21.15.194:6813/263803874","state":["exists","up"]},{"osd":6,"uuid":"32d2dab9-6944-40d1-ada9-4f941821b063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6819","nonce":1802966829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6821","nonce":1802966829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6825","nonce":1802966829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6823","nonce":1802966829}]},"public_addr":"172.21.15.8:6819/1802966829","cluster_addr":"172.21.15.8:6821/1802966829","heartbeat_back_addr":"172.21.15.8:6825/1802966829","heartbeat_front_addr":"172.21.15.8:6823/1802966829","state":["exists","up"]},{"osd":7,"uuid":"086aff58-1554-49fe-92ff-5166b115aeef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6817","nonce":3715737148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6819","nonce":3715737148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6823","nonce":3715737148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6821","nonce":3715737148}]},"public_addr":"172.21.15.45:6817/3715737148","cluster_addr":"172.21.15.45:6819/3715737148","heartbeat_back_addr":"172.21.15.45:6823/3715737148","heartbeat_front_addr":"172.21.15.45:6821/3715737148","state":["exists","up"]},{"osd":8,"uuid":"7fff5e95-2453-4ea6-a5c1-3bba6a1f6400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6817","nonce":57497127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6819","nonce":57497127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6823","nonce":57497127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6821","nonce":57497127}]},"public_addr":"172.21.15.194:6817/57497127","cluster_addr":"172.21.15.194:6819/57497127","heartbeat_back_addr":"172.21.15.194:6823/57497127","heartbeat_front_addr":"172.21.15.194:6821/57497127","state":["exists","up"]},{"osd":9,"uuid":"31ab0121-4c92-42ec-9f19-e672062e8814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6827","nonce":434661930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6829","nonce":434661930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6833","nonce":434661930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6831","nonce":434661930}]},"public_addr":"172.21.15.8:6827/434661930","cluster_addr":"172.21.15.8:6829/434661930","heartbeat_back_addr":"172.21.15.8:6833/434661930","heartbeat_front_addr":"172.21.15.8:6831/434661930","state":["exists","up"]},{"osd":10,"uuid":"62c632e4-94f6-4630-9d94-8d28fccacf45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6825","nonce":3281212184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6827","nonce":3281212184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6831","nonce":3281212184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6829","nonce":3281212184}]},"public_addr":"172.21.15.45:6825/3281212184","cluster_addr":"172.21.15.45:6827/3281212184","heartbeat_back_addr":"172.21.15.45:6831/3281212184","heartbeat_front_addr":"172.21.15.45:6829/3281212184","state":["exists","up"]},{"osd":11,"uuid":"8ca4a80d-cd75-4230-b46d-aef6fdc03e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6825","nonce":1637875895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6827","nonce":1637875895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6831","nonce":1637875895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6829","nonce":1637875895}]},"public_addr":"172.21.15.194:6825/1637875895","cluster_addr":"172.21.15.194:6827/1637875895","heartbeat_back_addr":"172.21.15.194:6831/1637875895","heartbeat_front_addr":"172.21.15.194:6829/1637875895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:04.255616+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:26.243863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:46.630365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:12.926291+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:35.747049+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:55.793767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:21.685725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:43.703215+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:04.043674+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:30.320026+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:52.751974+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:21:13.230024+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/2000592056":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2102228072":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2374527928":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2928221278":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2744750874":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/3681755887":"2023-08-12T12:15:02.528403+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-11T12:23:32.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.736+0000 7f61fd7ff700 1 -- 172.21.15.8:0/2902273638 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f61e009ff50 msgr2=0x7f61e00a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:32.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.736+0000 7f61fd7ff700 1 --2- 172.21.15.8:0/2902273638 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f61e009ff50 0x7f61e00a2410 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f61ec009c60 tx=0x7f61ec009260 comp rx=0 tx=0).stop 2023-08-11T12:23:32.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.736+0000 7f61fd7ff700 1 -- 172.21.15.8:0/2902273638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61f81014f0 msgr2=0x7f61f81966b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:32.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.736+0000 7f61fd7ff700 1 --2- 172.21.15.8:0/2902273638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61f81014f0 0x7f61f81966b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f61e8004730 tx=0x7f61e8004760 comp rx=0 tx=0).stop 2023-08-11T12:23:32.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.736+0000 7f61fd7ff700 1 -- 172.21.15.8:0/2902273638 shutdown_connections 2023-08-11T12:23:32.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.736+0000 7f61fd7ff700 1 --2- 172.21.15.8:0/2902273638 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f61e009ff50 0x7f61e00a2410 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:32.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.736+0000 7f61fd7ff700 1 --2- 172.21.15.8:0/2902273638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61f81014f0 0x7f61f81966b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:32.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.736+0000 7f61fd7ff700 1 --2- 172.21.15.8:0/2902273638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61f8106750 0x7f61f819dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:32.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.736+0000 7f61fd7ff700 1 --2- 172.21.15.8:0/2902273638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61f8103e20 0x7f61f8196bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:32.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.736+0000 7f61fd7ff700 1 -- 172.21.15.8:0/2902273638 >> 172.21.15.8:0/2902273638 conn(0x7f61f80fae60 msgr2=0x7f61f8102160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:32.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.736+0000 7f61fd7ff700 1 -- 172.21.15.8:0/2902273638 shutdown_connections 2023-08-11T12:23:32.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.736+0000 7f61fd7ff700 1 -- 172.21.15.8:0/2902273638 wait complete. 2023-08-11T12:23:32.759 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-11T12:17:49.040758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-11T12:22:01.383296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-11T12:22:02.816329+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-11T12:22:06.369375+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-11T12:23:32.760 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-11T12:23:32.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.966+0000 7fe3f67ff700 1 -- 172.21.15.8:0/2895563567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3f0101c00 msgr2=0x7fe3f0102060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:32.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.966+0000 7fe3f67ff700 1 --2- 172.21.15.8:0/2895563567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3f0101c00 0x7fe3f0102060 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40099c0 tx=0x7fe3e4009cd0 comp rx=0 tx=0).stop 2023-08-11T12:23:32.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.966+0000 7fe3f67ff700 1 -- 172.21.15.8:0/2895563567 shutdown_connections 2023-08-11T12:23:32.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.966+0000 7fe3f67ff700 1 --2- 172.21.15.8:0/2895563567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3f0100a10 0x7fe3f0100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:32.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.966+0000 7fe3f67ff700 1 --2- 172.21.15.8:0/2895563567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3f01025a0 0x7fe3f0108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:32.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.966+0000 7fe3f67ff700 1 --2- 172.21.15.8:0/2895563567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3f0101c00 0x7fe3f0102060 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:32.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.966+0000 7fe3f67ff700 1 -- 172.21.15.8:0/2895563567 >> 172.21.15.8:0/2895563567 conn(0x7fe3f00fbf80 msgr2=0x7fe3f00fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:32.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.967+0000 7fe3f67ff700 1 -- 172.21.15.8:0/2895563567 shutdown_connections 2023-08-11T12:23:32.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.967+0000 7fe3f67ff700 1 -- 172.21.15.8:0/2895563567 wait complete. 2023-08-11T12:23:32.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.968+0000 7fe3f67ff700 1 Processor -- start 2023-08-11T12:23:32.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.968+0000 7fe3f67ff700 1 -- start start 2023-08-11T12:23:32.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.968+0000 7fe3f67ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3f0100a10 0x7fe3f0198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:32.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.968+0000 7fe3f67ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3f0101c00 0x7fe3f0198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:32.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.968+0000 7fe3f67ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3f01025a0 0x7fe3f019fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:32.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.968+0000 7fe3f67ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f01a03d0 con 0x7fe3f0101c00 2023-08-11T12:23:32.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.968+0000 7fe3f67ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f01a0510 con 0x7fe3f01025a0 2023-08-11T12:23:32.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.968+0000 7fe3f67ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f01a06a0 con 0x7fe3f0100a10 2023-08-11T12:23:32.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.968+0000 7fe3effff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3f0100a10 0x7fe3f0198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:32.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.968+0000 7fe3effff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3f0100a10 0x7fe3f0198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:34332/0 (socket says 172.21.15.8:34332) 2023-08-11T12:23:32.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.969+0000 7fe3effff700 1 -- 172.21.15.8:0/171323373 learned_addr learned my addr 172.21.15.8:0/171323373 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:32.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.969+0000 7fe3f4d9c700 1 --2- 172.21.15.8:0/171323373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3f01025a0 0x7fe3f019fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:32.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.969+0000 7fe3ef7fe700 1 --2- 172.21.15.8:0/171323373 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3f0101c00 0x7fe3f0198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:32.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.969+0000 7fe3effff700 1 -- 172.21.15.8:0/171323373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3f01025a0 msgr2=0x7fe3f019fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:32.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.969+0000 7fe3effff700 1 --2- 172.21.15.8:0/171323373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3f01025a0 0x7fe3f019fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:32.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.969+0000 7fe3effff700 1 -- 172.21.15.8:0/171323373 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3f0101c00 msgr2=0x7fe3f0198d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:32.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.969+0000 7fe3effff700 1 --2- 172.21.15.8:0/171323373 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3f0101c00 0x7fe3f0198d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:32.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.969+0000 7fe3effff700 1 -- 172.21.15.8:0/171323373 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e40095f0 con 0x7fe3f0100a10 2023-08-11T12:23:32.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.969+0000 7fe3f4d9c700 1 --2- 172.21.15.8:0/171323373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3f01025a0 0x7fe3f019fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:23:32.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.969+0000 7fe3effff700 1 --2- 172.21.15.8:0/171323373 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3f0100a10 0x7fe3f0198850 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe3e000e970 tx=0x7fe3e000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:32.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.969+0000 7fe3ed7fa700 1 -- 172.21.15.8:0/171323373 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0009790 con 0x7fe3f0100a10 2023-08-11T12:23:32.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.970+0000 7fe3ed7fa700 1 -- 172.21.15.8:0/171323373 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe3e00044e0 con 0x7fe3f0100a10 2023-08-11T12:23:32.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.970+0000 7fe3ed7fa700 1 -- 172.21.15.8:0/171323373 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0003e30 con 0x7fe3f0100a10 2023-08-11T12:23:32.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.970+0000 7fe3f67ff700 1 -- 172.21.15.8:0/171323373 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f01a0980 con 0x7fe3f0100a10 2023-08-11T12:23:32.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.970+0000 7fe3f67ff700 1 -- 172.21.15.8:0/171323373 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f01a0e40 con 0x7fe3f0100a10 2023-08-11T12:23:32.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.971+0000 7fe3f67ff700 1 -- 172.21.15.8:0/171323373 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f010c270 con 0x7fe3f0100a10 2023-08-11T12:23:32.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.973+0000 7fe3ed7fa700 1 -- 172.21.15.8:0/171323373 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fe3e0003f90 con 0x7fe3f0100a10 2023-08-11T12:23:32.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.974+0000 7fe3ed7fa700 1 --2- 172.21.15.8:0/171323373 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe3d809ffd0 0x7fe3d80a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:32.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.974+0000 7fe3ed7fa700 1 -- 172.21.15.8:0/171323373 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fe3e0014070 con 0x7fe3f0100a10 2023-08-11T12:23:32.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.974+0000 7fe3ef7fe700 1 --2- 172.21.15.8:0/171323373 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe3d809ffd0 0x7fe3d80a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:32.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.975+0000 7fe3ef7fe700 1 --2- 172.21.15.8:0/171323373 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe3d809ffd0 0x7fe3d80a2490 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe3e400b580 tx=0x7fe3e401a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:32.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:32.976+0000 7fe3ed7fa700 1 -- 172.21.15.8:0/171323373 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fe3e00953b0 con 0x7fe3f0100a10 2023-08-11T12:23:33.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:32 smithi008 ceph-mon[97158]: pgmap v320: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-11T12:23:33.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:32 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2902273638' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:23:33.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:32 smithi194 ceph-mon[130905]: pgmap v320: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-11T12:23:33.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:32 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2902273638' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:23:33.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:32 smithi045 ceph-mon[130284]: pgmap v320: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-11T12:23:33.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:32 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2902273638' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:23:33.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.198+0000 7fe3f67ff700 1 -- 172.21.15.8:0/171323373 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe3f01a1090 con 0x7fe3f0100a10 2023-08-11T12:23:33.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.199+0000 7fe3ed7fa700 1 -- 172.21.15.8:0/171323373 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe3e00989d0 con 0x7fe3f0100a10 2023-08-11T12:23:33.202 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-08-11T12:23:33.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.203+0000 7fe3f67ff700 1 -- 172.21.15.8:0/171323373 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe3d809ffd0 msgr2=0x7fe3d80a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:33.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.203+0000 7fe3f67ff700 1 --2- 172.21.15.8:0/171323373 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe3d809ffd0 0x7fe3d80a2490 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe3e400b580 tx=0x7fe3e401a040 comp rx=0 tx=0).stop 2023-08-11T12:23:33.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.203+0000 7fe3f67ff700 1 -- 172.21.15.8:0/171323373 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3f0100a10 msgr2=0x7fe3f0198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:33.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.203+0000 7fe3f67ff700 1 --2- 172.21.15.8:0/171323373 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3f0100a10 0x7fe3f0198850 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe3e000e970 tx=0x7fe3e000ed30 comp rx=0 tx=0).stop 2023-08-11T12:23:33.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.203+0000 7fe3f67ff700 1 -- 172.21.15.8:0/171323373 shutdown_connections 2023-08-11T12:23:33.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.203+0000 7fe3f67ff700 1 --2- 172.21.15.8:0/171323373 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe3d809ffd0 0x7fe3d80a2490 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:33.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.203+0000 7fe3f67ff700 1 --2- 172.21.15.8:0/171323373 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3f0100a10 0x7fe3f0198850 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:33.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.203+0000 7fe3f67ff700 1 --2- 172.21.15.8:0/171323373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3f01025a0 0x7fe3f019fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:33.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.203+0000 7fe3f67ff700 1 --2- 172.21.15.8:0/171323373 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3f0101c00 0x7fe3f0198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:33.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.203+0000 7fe3f67ff700 1 -- 172.21.15.8:0/171323373 >> 172.21.15.8:0/171323373 conn(0x7fe3f00fbf80 msgr2=0x7fe3f00fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:33.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.203+0000 7fe3f67ff700 1 -- 172.21.15.8:0/171323373 shutdown_connections 2023-08-11T12:23:33.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.203+0000 7fe3f67ff700 1 -- 172.21.15.8:0/171323373 wait complete. 2023-08-11T12:23:33.235 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-11T12:23:33.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.440+0000 7f17345ff700 1 -- 172.21.15.8:0/2327723919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f172c102590 msgr2=0x7f172c108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:33.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.440+0000 7f17345ff700 1 --2- 172.21.15.8:0/2327723919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f172c102590 0x7f172c108e40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f172400b0d0 tx=0x7f172400b3e0 comp rx=0 tx=0).stop 2023-08-11T12:23:33.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.440+0000 7f17345ff700 1 -- 172.21.15.8:0/2327723919 shutdown_connections 2023-08-11T12:23:33.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.440+0000 7f17345ff700 1 --2- 172.21.15.8:0/2327723919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f172c102590 0x7f172c108e40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:33.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.440+0000 7f17345ff700 1 --2- 172.21.15.8:0/2327723919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f172c100a00 0x7f172c100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:33.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.440+0000 7f17345ff700 1 --2- 172.21.15.8:0/2327723919 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f172c101bf0 0x7f172c102050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:33.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.440+0000 7f17345ff700 1 -- 172.21.15.8:0/2327723919 >> 172.21.15.8:0/2327723919 conn(0x7f172c0fbf70 msgr2=0x7f172c0fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:33.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.440+0000 7f17345ff700 1 -- 172.21.15.8:0/2327723919 shutdown_connections 2023-08-11T12:23:33.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.440+0000 7f17345ff700 1 -- 172.21.15.8:0/2327723919 wait complete. 2023-08-11T12:23:33.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.441+0000 7f17345ff700 1 Processor -- start 2023-08-11T12:23:33.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.442+0000 7f17345ff700 1 -- start start 2023-08-11T12:23:33.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.442+0000 7f17345ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f172c100a00 0x7f172c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:33.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.442+0000 7f17345ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f172c101bf0 0x7f172c198f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:33.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.442+0000 7f17345ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f172c102590 0x7f172c19ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:33.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.442+0000 7f17345ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172c1a0550 con 0x7f172c101bf0 2023-08-11T12:23:33.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.442+0000 7f17345ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172c1a0690 con 0x7f172c100a00 2023-08-11T12:23:33.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.442+0000 7f17345ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172c1a0820 con 0x7f172c102590 2023-08-11T12:23:33.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.442+0000 7f1731b9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f172c101bf0 0x7f172c198f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:33.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.442+0000 7f1731b9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f172c101bf0 0x7f172c198f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40578/0 (socket says 172.21.15.8:40578) 2023-08-11T12:23:33.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.442+0000 7f1731b9a700 1 -- 172.21.15.8:0/517601986 learned_addr learned my addr 172.21.15.8:0/517601986 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:33.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.442+0000 7f173239b700 1 --2- 172.21.15.8:0/517601986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f172c100a00 0x7f172c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:33.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.442+0000 7f1732b9c700 1 --2- 172.21.15.8:0/517601986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f172c102590 0x7f172c19ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:33.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.442+0000 7f1731b9a700 1 -- 172.21.15.8:0/517601986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f172c102590 msgr2=0x7f172c19ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:33.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.443+0000 7f1731b9a700 1 --2- 172.21.15.8:0/517601986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f172c102590 0x7f172c19ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:33.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.443+0000 7f1731b9a700 1 -- 172.21.15.8:0/517601986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f172c100a00 msgr2=0x7f172c1989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:33.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.443+0000 7f1731b9a700 1 --2- 172.21.15.8:0/517601986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f172c100a00 0x7f172c1989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:33.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.443+0000 7f1731b9a700 1 -- 172.21.15.8:0/517601986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1728009520 con 0x7f172c101bf0 2023-08-11T12:23:33.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.443+0000 7f1731b9a700 1 --2- 172.21.15.8:0/517601986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f172c101bf0 0x7f172c198f10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f171c00e9a0 tx=0x7f171c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:33.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.443+0000 7f17237fe700 1 -- 172.21.15.8:0/517601986 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c009790 con 0x7f172c101bf0 2023-08-11T12:23:33.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.443+0000 7f17237fe700 1 -- 172.21.15.8:0/517601986 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f171c010430 con 0x7f172c101bf0 2023-08-11T12:23:33.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.443+0000 7f17237fe700 1 -- 172.21.15.8:0/517601986 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c018680 con 0x7f172c101bf0 2023-08-11T12:23:33.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.443+0000 7f17345ff700 1 -- 172.21.15.8:0/517601986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1724009d00 con 0x7f172c101bf0 2023-08-11T12:23:33.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.443+0000 7f17345ff700 1 -- 172.21.15.8:0/517601986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f172c1a0e30 con 0x7f172c101bf0 2023-08-11T12:23:33.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.444+0000 7f17345ff700 1 -- 172.21.15.8:0/517601986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f172c10c270 con 0x7f172c101bf0 2023-08-11T12:23:33.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.446+0000 7f17237fe700 1 -- 172.21.15.8:0/517601986 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f171c0105a0 con 0x7f172c101bf0 2023-08-11T12:23:33.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.448+0000 7f17237fe700 1 --2- 172.21.15.8:0/517601986 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f171809ff50 0x7f17180a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:33.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.448+0000 7f17237fe700 1 -- 172.21.15.8:0/517601986 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f171c014070 con 0x7f172c101bf0 2023-08-11T12:23:33.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.448+0000 7f173239b700 1 --2- 172.21.15.8:0/517601986 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f171809ff50 0x7f17180a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:33.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.449+0000 7f173239b700 1 --2- 172.21.15.8:0/517601986 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f171809ff50 0x7f17180a2410 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f172c101a50 tx=0x7f1728009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:33.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.452+0000 7f17237fe700 1 -- 172.21.15.8:0/517601986 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f171c051c30 con 0x7f172c101bf0 2023-08-11T12:23:33.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.663+0000 7f17345ff700 1 -- 172.21.15.8:0/517601986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f172c1a1050 con 0x7f172c101bf0 2023-08-11T12:23:33.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.663+0000 7f17237fe700 1 -- 172.21.15.8:0/517601986 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f171c095180 con 0x7f172c101bf0 2023-08-11T12:23:33.666 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-08-11T12:23:33.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.666+0000 7f17345ff700 1 -- 172.21.15.8:0/517601986 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f171809ff50 msgr2=0x7f17180a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:33.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.666+0000 7f17345ff700 1 --2- 172.21.15.8:0/517601986 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f171809ff50 0x7f17180a2410 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f172c101a50 tx=0x7f1728009260 comp rx=0 tx=0).stop 2023-08-11T12:23:33.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.666+0000 7f17345ff700 1 -- 172.21.15.8:0/517601986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f172c101bf0 msgr2=0x7f172c198f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:33.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.666+0000 7f17345ff700 1 --2- 172.21.15.8:0/517601986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f172c101bf0 0x7f172c198f10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f171c00e9a0 tx=0x7f171c00ecb0 comp rx=0 tx=0).stop 2023-08-11T12:23:33.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.666+0000 7f17345ff700 1 -- 172.21.15.8:0/517601986 shutdown_connections 2023-08-11T12:23:33.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.666+0000 7f17345ff700 1 --2- 172.21.15.8:0/517601986 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f171809ff50 0x7f17180a2410 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:33.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.666+0000 7f17345ff700 1 --2- 172.21.15.8:0/517601986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f172c102590 0x7f172c19ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:33.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.666+0000 7f17345ff700 1 --2- 172.21.15.8:0/517601986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f172c100a00 0x7f172c1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:33.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.666+0000 7f17345ff700 1 --2- 172.21.15.8:0/517601986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f172c101bf0 0x7f172c198f10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:33.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.666+0000 7f17345ff700 1 -- 172.21.15.8:0/517601986 >> 172.21.15.8:0/517601986 conn(0x7f172c0fbf70 msgr2=0x7f172c107440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:33.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.666+0000 7f17345ff700 1 -- 172.21.15.8:0/517601986 shutdown_connections 2023-08-11T12:23:33.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.666+0000 7f17345ff700 1 -- 172.21.15.8:0/517601986 wait complete. 2023-08-11T12:23:33.687 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-11T12:23:33.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.893+0000 7f98545ff700 1 -- 172.21.15.8:0/116871793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f984c101bf0 msgr2=0x7f984c102050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:33.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.893+0000 7f98545ff700 1 --2- 172.21.15.8:0/116871793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f984c101bf0 0x7f984c102050 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f983c009920 tx=0x7f983c009c30 comp rx=0 tx=0).stop 2023-08-11T12:23:33.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.893+0000 7f98545ff700 1 -- 172.21.15.8:0/116871793 shutdown_connections 2023-08-11T12:23:33.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.893+0000 7f98545ff700 1 --2- 172.21.15.8:0/116871793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f984c100a00 0x7f984c100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:33.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.893+0000 7f98545ff700 1 --2- 172.21.15.8:0/116871793 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f984c102590 0x7f984c108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:33.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.893+0000 7f98545ff700 1 --2- 172.21.15.8:0/116871793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f984c101bf0 0x7f984c102050 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:33.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.893+0000 7f98545ff700 1 -- 172.21.15.8:0/116871793 >> 172.21.15.8:0/116871793 conn(0x7f984c0fbf70 msgr2=0x7f984c0fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:33.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.893+0000 7f98545ff700 1 -- 172.21.15.8:0/116871793 shutdown_connections 2023-08-11T12:23:33.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.893+0000 7f98545ff700 1 -- 172.21.15.8:0/116871793 wait complete. 2023-08-11T12:23:33.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.894+0000 7f98545ff700 1 Processor -- start 2023-08-11T12:23:33.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.894+0000 7f98545ff700 1 -- start start 2023-08-11T12:23:33.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.895+0000 7f98545ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f984c100a00 0x7f984c0746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:33.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.895+0000 7f98545ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f984c101bf0 0x7f984c072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:33.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.895+0000 7f98545ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f984c102590 0x7f984c073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:33.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.895+0000 7f98545ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984c0739f0 con 0x7f984c102590 2023-08-11T12:23:33.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.895+0000 7f98545ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984c073b60 con 0x7f984c101bf0 2023-08-11T12:23:33.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.895+0000 7f98545ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984c1a0800 con 0x7f984c100a00 2023-08-11T12:23:33.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.895+0000 7f985239b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f984c100a00 0x7f984c0746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:33.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.895+0000 7f9852b9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f984c102590 0x7f984c073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:33.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.895+0000 7f985239b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f984c100a00 0x7f984c0746d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:34382/0 (socket says 172.21.15.8:34382) 2023-08-11T12:23:33.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.895+0000 7f985239b700 1 -- 172.21.15.8:0/2629770518 learned_addr learned my addr 172.21.15.8:0/2629770518 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:33.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.895+0000 7f9851b9a700 1 --2- 172.21.15.8:0/2629770518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f984c101bf0 0x7f984c072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:33.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.895+0000 7f985239b700 1 -- 172.21.15.8:0/2629770518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f984c101bf0 msgr2=0x7f984c072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:33.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.895+0000 7f985239b700 1 --2- 172.21.15.8:0/2629770518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f984c101bf0 0x7f984c072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:33.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.895+0000 7f985239b700 1 -- 172.21.15.8:0/2629770518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f984c102590 msgr2=0x7f984c073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:33.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.895+0000 7f985239b700 1 --2- 172.21.15.8:0/2629770518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f984c102590 0x7f984c073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:33.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.895+0000 7f985239b700 1 -- 172.21.15.8:0/2629770518 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c009520 con 0x7f984c100a00 2023-08-11T12:23:33.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.895+0000 7f9852b9c700 1 --2- 172.21.15.8:0/2629770518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f984c102590 0x7f984c073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:33.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.896+0000 7f985239b700 1 --2- 172.21.15.8:0/2629770518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f984c100a00 0x7f984c0746d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f984800e970 tx=0x7f984800ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:33.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.896+0000 7f98437fe700 1 -- 172.21.15.8:0/2629770518 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9848009790 con 0x7f984c100a00 2023-08-11T12:23:33.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.896+0000 7f98545ff700 1 -- 172.21.15.8:0/2629770518 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f984c1a0ae0 con 0x7f984c100a00 2023-08-11T12:23:33.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.896+0000 7f98437fe700 1 -- 172.21.15.8:0/2629770518 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f984800c7e0 con 0x7f984c100a00 2023-08-11T12:23:33.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.896+0000 7f98437fe700 1 -- 172.21.15.8:0/2629770518 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9848003c70 con 0x7f984c100a00 2023-08-11T12:23:33.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.896+0000 7f98545ff700 1 -- 172.21.15.8:0/2629770518 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984c1a1040 con 0x7f984c100a00 2023-08-11T12:23:33.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.897+0000 7f98545ff700 1 -- 172.21.15.8:0/2629770518 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f984c10c260 con 0x7f984c100a00 2023-08-11T12:23:33.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.899+0000 7f98437fe700 1 -- 172.21.15.8:0/2629770518 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f984800cc50 con 0x7f984c100a00 2023-08-11T12:23:33.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.900+0000 7f98437fe700 1 --2- 172.21.15.8:0/2629770518 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f983809ff50 0x7f98380a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:33.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.901+0000 7f98437fe700 1 -- 172.21.15.8:0/2629770518 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f9848014070 con 0x7f984c100a00 2023-08-11T12:23:33.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.901+0000 7f9851b9a700 1 --2- 172.21.15.8:0/2629770518 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f983809ff50 0x7f98380a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:33.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.901+0000 7f9851b9a700 1 --2- 172.21.15.8:0/2629770518 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f983809ff50 0x7f98380a2410 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f983c00fa40 tx=0x7f983c019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:33.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:33.903+0000 7f98437fe700 1 -- 172.21.15.8:0/2629770518 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f9848095310 con 0x7f984c100a00 2023-08-11T12:23:34.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:33 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/171323373' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:23:34.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:33 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/517601986' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:23:34.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.114+0000 7f98545ff700 1 -- 172.21.15.8:0/2629770518 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f984c107980 con 0x7f984c100a00 2023-08-11T12:23:34.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.115+0000 7f98437fe700 1 -- 172.21.15.8:0/2629770518 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9848098930 con 0x7f984c100a00 2023-08-11T12:23:34.118 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-08-11T12:23:34.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.117+0000 7f98545ff700 1 -- 172.21.15.8:0/2629770518 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f983809ff50 msgr2=0x7f98380a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:34.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.117+0000 7f98545ff700 1 --2- 172.21.15.8:0/2629770518 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f983809ff50 0x7f98380a2410 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f983c00fa40 tx=0x7f983c019040 comp rx=0 tx=0).stop 2023-08-11T12:23:34.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.117+0000 7f98545ff700 1 -- 172.21.15.8:0/2629770518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f984c100a00 msgr2=0x7f984c0746d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:34.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.117+0000 7f98545ff700 1 --2- 172.21.15.8:0/2629770518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f984c100a00 0x7f984c0746d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f984800e970 tx=0x7f984800ec80 comp rx=0 tx=0).stop 2023-08-11T12:23:34.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.117+0000 7f98545ff700 1 -- 172.21.15.8:0/2629770518 shutdown_connections 2023-08-11T12:23:34.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.117+0000 7f98545ff700 1 --2- 172.21.15.8:0/2629770518 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f983809ff50 0x7f98380a2410 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:34.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.117+0000 7f98545ff700 1 --2- 172.21.15.8:0/2629770518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f984c100a00 0x7f984c0746d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:34.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.117+0000 7f98545ff700 1 --2- 172.21.15.8:0/2629770518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f984c102590 0x7f984c073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:34.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.117+0000 7f98545ff700 1 --2- 172.21.15.8:0/2629770518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f984c101bf0 0x7f984c072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:34.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.117+0000 7f98545ff700 1 -- 172.21.15.8:0/2629770518 >> 172.21.15.8:0/2629770518 conn(0x7f984c0fbf70 msgr2=0x7f984c0fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:34.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.117+0000 7f98545ff700 1 -- 172.21.15.8:0/2629770518 shutdown_connections 2023-08-11T12:23:34.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.117+0000 7f98545ff700 1 -- 172.21.15.8:0/2629770518 wait complete. 2023-08-11T12:23:34.139 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-11T12:23:34.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:33 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/171323373' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:23:34.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:33 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/517601986' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:23:34.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:33 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/171323373' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:23:34.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:33 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/517601986' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:23:34.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.353+0000 7f0a4edff700 1 -- 172.21.15.8:0/723309069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a48074960 msgr2=0x7f0a48072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:34.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.353+0000 7f0a4edff700 1 --2- 172.21.15.8:0/723309069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a48074960 0x7f0a48072db0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c009990 tx=0x7f0a3c009ca0 comp rx=0 tx=0).stop 2023-08-11T12:23:34.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.354+0000 7f0a4edff700 1 -- 172.21.15.8:0/723309069 shutdown_connections 2023-08-11T12:23:34.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.354+0000 7f0a4edff700 1 --2- 172.21.15.8:0/723309069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a4810cfe0 0x7f0a4810f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:34.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.354+0000 7f0a4edff700 1 --2- 172.21.15.8:0/723309069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a48074960 0x7f0a48072db0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:34.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.354+0000 7f0a4edff700 1 --2- 172.21.15.8:0/723309069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a48073380 0x7f0a48073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:34.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.354+0000 7f0a4edff700 1 -- 172.21.15.8:0/723309069 >> 172.21.15.8:0/723309069 conn(0x7f0a480fbf80 msgr2=0x7f0a480fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:34.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.354+0000 7f0a4edff700 1 -- 172.21.15.8:0/723309069 shutdown_connections 2023-08-11T12:23:34.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.354+0000 7f0a4edff700 1 -- 172.21.15.8:0/723309069 wait complete. 2023-08-11T12:23:34.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.355+0000 7f0a4edff700 1 Processor -- start 2023-08-11T12:23:34.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.355+0000 7f0a4edff700 1 -- start start 2023-08-11T12:23:34.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.356+0000 7f0a4edff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a48073380 0x7f0a4819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:34.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.356+0000 7f0a4edff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a48074960 0x7f0a4819d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:34.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.356+0000 7f0a4edff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a4810cfe0 0x7f0a481a4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:34.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.356+0000 7f0a4edff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a481a4820 con 0x7f0a48074960 2023-08-11T12:23:34.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.356+0000 7f0a4edff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a481a4990 con 0x7f0a4810cfe0 2023-08-11T12:23:34.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.356+0000 7f0a4edff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a481a4b50 con 0x7f0a48073380 2023-08-11T12:23:34.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.356+0000 7f0a47fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a48074960 0x7f0a4819d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:34.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.356+0000 7f0a47fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a48074960 0x7f0a4819d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40616/0 (socket says 172.21.15.8:40616) 2023-08-11T12:23:34.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.356+0000 7f0a47fff700 1 -- 172.21.15.8:0/903582980 learned_addr learned my addr 172.21.15.8:0/903582980 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:34.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.356+0000 7f0a4cb9b700 1 --2- 172.21.15.8:0/903582980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a48073380 0x7f0a4819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:34.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.356+0000 7f0a4d39c700 1 --2- 172.21.15.8:0/903582980 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a4810cfe0 0x7f0a481a4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:34.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.357+0000 7f0a47fff700 1 -- 172.21.15.8:0/903582980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a48073380 msgr2=0x7f0a4819ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:34.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.357+0000 7f0a47fff700 1 --2- 172.21.15.8:0/903582980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a48073380 0x7f0a4819ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:34.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.357+0000 7f0a47fff700 1 -- 172.21.15.8:0/903582980 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a4810cfe0 msgr2=0x7f0a481a4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:34.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.357+0000 7f0a47fff700 1 --2- 172.21.15.8:0/903582980 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a4810cfe0 0x7f0a481a4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:34.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.357+0000 7f0a47fff700 1 -- 172.21.15.8:0/903582980 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c0095f0 con 0x7f0a48074960 2023-08-11T12:23:34.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.357+0000 7f0a47fff700 1 --2- 172.21.15.8:0/903582980 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a48074960 0x7f0a4819d1f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0a3400e970 tx=0x7f0a3400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:34.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.357+0000 7f0a45ffb700 1 -- 172.21.15.8:0/903582980 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a34009790 con 0x7f0a48074960 2023-08-11T12:23:34.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.357+0000 7f0a45ffb700 1 -- 172.21.15.8:0/903582980 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a3400c7e0 con 0x7f0a48074960 2023-08-11T12:23:34.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.357+0000 7f0a45ffb700 1 -- 172.21.15.8:0/903582980 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a34003c70 con 0x7f0a48074960 2023-08-11T12:23:34.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.357+0000 7f0a4edff700 1 -- 172.21.15.8:0/903582980 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a481a4e30 con 0x7f0a48074960 2023-08-11T12:23:34.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.357+0000 7f0a4edff700 1 -- 172.21.15.8:0/903582980 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a481a52b0 con 0x7f0a48074960 2023-08-11T12:23:34.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.358+0000 7f0a4edff700 1 -- 172.21.15.8:0/903582980 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a48102b30 con 0x7f0a48074960 2023-08-11T12:23:34.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.361+0000 7f0a45ffb700 1 -- 172.21.15.8:0/903582980 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f0a3400cc50 con 0x7f0a48074960 2023-08-11T12:23:34.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.363+0000 7f0a45ffb700 1 --2- 172.21.15.8:0/903582980 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0a3809ffd0 0x7f0a380a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:34.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.363+0000 7f0a45ffb700 1 -- 172.21.15.8:0/903582980 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f0a34014070 con 0x7f0a48074960 2023-08-11T12:23:34.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.363+0000 7f0a4cb9b700 1 --2- 172.21.15.8:0/903582980 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0a3809ffd0 0x7f0a380a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:34.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.364+0000 7f0a4cb9b700 1 --2- 172.21.15.8:0/903582980 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0a3809ffd0 0x7f0a380a2490 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c00b2e0 tx=0x7f0a3c005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:34.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.365+0000 7f0a45ffb700 1 -- 172.21.15.8:0/903582980 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f0a34095220 con 0x7f0a48074960 2023-08-11T12:23:34.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.578+0000 7f0a4edff700 1 -- 172.21.15.8:0/903582980 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0a48112aa0 con 0x7f0a48074960 2023-08-11T12:23:34.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.578+0000 7f0a45ffb700 1 -- 172.21.15.8:0/903582980 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0a34003dd0 con 0x7f0a48074960 2023-08-11T12:23:34.582 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-08-11T12:23:34.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.580+0000 7f0a4edff700 1 -- 172.21.15.8:0/903582980 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0a3809ffd0 msgr2=0x7f0a380a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:34.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.581+0000 7f0a4edff700 1 --2- 172.21.15.8:0/903582980 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0a3809ffd0 0x7f0a380a2490 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c00b2e0 tx=0x7f0a3c005fb0 comp rx=0 tx=0).stop 2023-08-11T12:23:34.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.581+0000 7f0a4edff700 1 -- 172.21.15.8:0/903582980 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a48074960 msgr2=0x7f0a4819d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:34.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.581+0000 7f0a4edff700 1 --2- 172.21.15.8:0/903582980 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a48074960 0x7f0a4819d1f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0a3400e970 tx=0x7f0a3400ec80 comp rx=0 tx=0).stop 2023-08-11T12:23:34.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.581+0000 7f0a4edff700 1 -- 172.21.15.8:0/903582980 shutdown_connections 2023-08-11T12:23:34.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.581+0000 7f0a4edff700 1 --2- 172.21.15.8:0/903582980 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f0a3809ffd0 0x7f0a380a2490 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:34.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.581+0000 7f0a4edff700 1 --2- 172.21.15.8:0/903582980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a48073380 0x7f0a4819ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:34.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.581+0000 7f0a4edff700 1 --2- 172.21.15.8:0/903582980 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a4810cfe0 0x7f0a481a4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:34.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.581+0000 7f0a4edff700 1 --2- 172.21.15.8:0/903582980 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a48074960 0x7f0a4819d1f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:34.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.581+0000 7f0a4edff700 1 -- 172.21.15.8:0/903582980 >> 172.21.15.8:0/903582980 conn(0x7f0a480fbf80 msgr2=0x7f0a480fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:34.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.581+0000 7f0a4edff700 1 -- 172.21.15.8:0/903582980 shutdown_connections 2023-08-11T12:23:34.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.581+0000 7f0a4edff700 1 -- 172.21.15.8:0/903582980 wait complete. 2023-08-11T12:23:34.604 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-11T12:23:34.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.809+0000 7f82747ff700 1 -- 172.21.15.8:0/2267829604 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f826c101bd0 msgr2=0x7f826c102030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:34.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.809+0000 7f82747ff700 1 --2- 172.21.15.8:0/2267829604 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f826c101bd0 0x7f826c102030 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f825c0099c0 tx=0x7f825c009cd0 comp rx=0 tx=0).stop 2023-08-11T12:23:34.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.810+0000 7f82747ff700 1 -- 172.21.15.8:0/2267829604 shutdown_connections 2023-08-11T12:23:34.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.810+0000 7f82747ff700 1 --2- 172.21.15.8:0/2267829604 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f826c102570 0x7f826c108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:34.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.810+0000 7f82747ff700 1 --2- 172.21.15.8:0/2267829604 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f826c1009e0 0x7f826c100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:34.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.810+0000 7f82747ff700 1 --2- 172.21.15.8:0/2267829604 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f826c101bd0 0x7f826c102030 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:34.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.810+0000 7f82747ff700 1 -- 172.21.15.8:0/2267829604 >> 172.21.15.8:0/2267829604 conn(0x7f826c0fbf50 msgr2=0x7f826c0fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:34.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.810+0000 7f82747ff700 1 -- 172.21.15.8:0/2267829604 shutdown_connections 2023-08-11T12:23:34.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.810+0000 7f82747ff700 1 -- 172.21.15.8:0/2267829604 wait complete. 2023-08-11T12:23:34.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.811+0000 7f82747ff700 1 Processor -- start 2023-08-11T12:23:34.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.811+0000 7f82747ff700 1 -- start start 2023-08-11T12:23:34.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.812+0000 7f82747ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f826c1009e0 0x7f826c198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:34.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.812+0000 7f82747ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f826c101bd0 0x7f826c198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:34.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.812+0000 7f82747ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f826c102570 0x7f826c19fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:34.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.812+0000 7f82747ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c1a04b0 con 0x7f826c101bd0 2023-08-11T12:23:34.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.812+0000 7f82747ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c1a05f0 con 0x7f826c102570 2023-08-11T12:23:34.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.812+0000 7f82747ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c1a0780 con 0x7f826c1009e0 2023-08-11T12:23:34.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.812+0000 7f8271d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f826c101bd0 0x7f826c198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:34.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.812+0000 7f8271d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f826c101bd0 0x7f826c198e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40634/0 (socket says 172.21.15.8:40634) 2023-08-11T12:23:34.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.812+0000 7f8271d9a700 1 -- 172.21.15.8:0/2367909910 learned_addr learned my addr 172.21.15.8:0/2367909910 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:34.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.812+0000 7f827259b700 1 --2- 172.21.15.8:0/2367909910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f826c1009e0 0x7f826c198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:34.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.812+0000 7f8272d9c700 1 --2- 172.21.15.8:0/2367909910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f826c102570 0x7f826c19fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:34.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.812+0000 7f8271d9a700 1 -- 172.21.15.8:0/2367909910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f826c1009e0 msgr2=0x7f826c198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:34.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.812+0000 7f8271d9a700 1 --2- 172.21.15.8:0/2367909910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f826c1009e0 0x7f826c198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:34.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.812+0000 7f8271d9a700 1 -- 172.21.15.8:0/2367909910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f826c102570 msgr2=0x7f826c19fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:34.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.812+0000 7f8271d9a700 1 --2- 172.21.15.8:0/2367909910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f826c102570 0x7f826c19fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:34.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.812+0000 7f8271d9a700 1 -- 172.21.15.8:0/2367909910 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825c0095f0 con 0x7f826c101bd0 2023-08-11T12:23:34.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.813+0000 7f8271d9a700 1 --2- 172.21.15.8:0/2367909910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f826c101bd0 0x7f826c198e70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f825c009990 tx=0x7f825c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:34.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.813+0000 7f82637fe700 1 -- 172.21.15.8:0/2367909910 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c01d070 con 0x7f826c101bd0 2023-08-11T12:23:34.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.813+0000 7f82747ff700 1 -- 172.21.15.8:0/2367909910 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f826c1a0a00 con 0x7f826c101bd0 2023-08-11T12:23:34.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.813+0000 7f82637fe700 1 -- 172.21.15.8:0/2367909910 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f825c005030 con 0x7f826c101bd0 2023-08-11T12:23:34.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.813+0000 7f82637fe700 1 -- 172.21.15.8:0/2367909910 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c004b30 con 0x7f826c101bd0 2023-08-11T12:23:34.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.813+0000 7f82747ff700 1 -- 172.21.15.8:0/2367909910 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f826c1a0e80 con 0x7f826c101bd0 2023-08-11T12:23:34.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.815+0000 7f82747ff700 1 -- 172.21.15.8:0/2367909910 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f826c10c270 con 0x7f826c101bd0 2023-08-11T12:23:34.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.816+0000 7f82637fe700 1 -- 172.21.15.8:0/2367909910 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f825c004cd0 con 0x7f826c101bd0 2023-08-11T12:23:34.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.817+0000 7f82637fe700 1 --2- 172.21.15.8:0/2367909910 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f825809ff50 0x7f82580a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:34.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.818+0000 7f82637fe700 1 -- 172.21.15.8:0/2367909910 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f825c0cc380 con 0x7f826c101bd0 2023-08-11T12:23:34.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.818+0000 7f827259b700 1 --2- 172.21.15.8:0/2367909910 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f825809ff50 0x7f82580a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:34.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.819+0000 7f827259b700 1 --2- 172.21.15.8:0/2367909910 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f825809ff50 0x7f82580a2410 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f826c101a30 tx=0x7f826800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:34.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:34.822+0000 7f82637fe700 1 -- 172.21.15.8:0/2367909910 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f825c095e30 con 0x7f826c101bd0 2023-08-11T12:23:35.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.087+0000 7f82747ff700 1 -- 172.21.15.8:0/2367909910 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f826c1a1070 con 0x7f826c101bd0 2023-08-11T12:23:35.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.088+0000 7f82637fe700 1 -- 172.21.15.8:0/2367909910 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11351 (secure 0 0 0) 0x7f825c099450 con 0x7f826c101bd0 2023-08-11T12:23:35.092 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:23:35.092 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14469,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2854286216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2854286216},{"type":"v1","addr":"172.21.15.8:6835","nonce":2854286216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/805368621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":805368621},{"type":"v1","addr":"172.21.15.8:6837","nonce":805368621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-11T12:22:03.398475+0000","modified":"2023-08-11T12:22:32.690553+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24575,"mds_1":24550,"mds_2":24517,"mds_3":24500,"mds_4":24464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14526":{"gid":14526,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/2990530720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":2990530720},{"type":"v1","addr":"172.21.15.8:6839","nonce":2990530720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14538":{"gid":14538,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6841/3589272762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":3589272762},{"type":"v1","addr":"172.21.15.8:6841","nonce":3589272762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6833/2043443402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2043443402},{"type":"v1","addr":"172.21.15.194:6833","nonce":2043443402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24464":{"gid":24464,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.45:6833/1208864615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1208864615},{"type":"v1","addr":"172.21.15.45:6833","nonce":1208864615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24500":{"gid":24500,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.45:6835/1776075470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1776075470},{"type":"v1","addr":"172.21.15.45:6835","nonce":1776075470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24517":{"gid":24517,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.194:6835/2457430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2457430285},{"type":"v1","addr":"172.21.15.194:6835","nonce":2457430285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24529":{"gid":24529,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/3072808560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":3072808560},{"type":"v1","addr":"172.21.15.194:6837","nonce":3072808560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/641549061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":641549061},{"type":"v1","addr":"172.21.15.45:6837","nonce":641549061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.194:6839/2174476491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":2174476491},{"type":"v1","addr":"172.21.15.194:6839","nonce":2174476491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6839/119684732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":119684732},{"type":"v1","addr":"172.21.15.45:6839","nonce":119684732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-11T12:23:35.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.090+0000 7f82747ff700 1 -- 172.21.15.8:0/2367909910 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f825809ff50 msgr2=0x7f82580a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:35.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.090+0000 7f82747ff700 1 --2- 172.21.15.8:0/2367909910 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f825809ff50 0x7f82580a2410 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f826c101a30 tx=0x7f826800b410 comp rx=0 tx=0).stop 2023-08-11T12:23:35.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.090+0000 7f82747ff700 1 -- 172.21.15.8:0/2367909910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f826c101bd0 msgr2=0x7f826c198e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:35.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.090+0000 7f82747ff700 1 --2- 172.21.15.8:0/2367909910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f826c101bd0 0x7f826c198e70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f825c009990 tx=0x7f825c00f690 comp rx=0 tx=0).stop 2023-08-11T12:23:35.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.090+0000 7f82747ff700 1 -- 172.21.15.8:0/2367909910 shutdown_connections 2023-08-11T12:23:35.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.090+0000 7f82747ff700 1 --2- 172.21.15.8:0/2367909910 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f825809ff50 0x7f82580a2410 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:35.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.090+0000 7f82747ff700 1 --2- 172.21.15.8:0/2367909910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f826c1009e0 0x7f826c198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:35.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.090+0000 7f82747ff700 1 --2- 172.21.15.8:0/2367909910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f826c102570 0x7f826c19fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:35.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.090+0000 7f82747ff700 1 --2- 172.21.15.8:0/2367909910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f826c101bd0 0x7f826c198e70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:35.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.090+0000 7f82747ff700 1 -- 172.21.15.8:0/2367909910 >> 172.21.15.8:0/2367909910 conn(0x7f826c0fbf50 msgr2=0x7f826c0fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:35.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.091+0000 7f82747ff700 1 -- 172.21.15.8:0/2367909910 shutdown_connections 2023-08-11T12:23:35.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.091+0000 7f82747ff700 1 -- 172.21.15.8:0/2367909910 wait complete. 2023-08-11T12:23:35.095 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 27 2023-08-11T12:23:35.113 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-11T12:23:35.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:34 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2629770518' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:23:35.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:34 smithi194 ceph-mon[130905]: pgmap v321: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:35.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:34 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/903582980' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:23:35.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:34 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2629770518' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:23:35.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:34 smithi045 ceph-mon[130284]: pgmap v321: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:35.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:34 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/903582980' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:23:35.174 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:34 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2629770518' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:23:35.174 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:34 smithi008 ceph-mon[97158]: pgmap v321: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:35.175 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:34 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/903582980' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:23:35.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.314+0000 7fcaa73ff700 1 -- 172.21.15.8:0/271999845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaa0101450 msgr2=0x7fcaa0103840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:35.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.314+0000 7fcaa73ff700 1 --2- 172.21.15.8:0/271999845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaa0101450 0x7fcaa0103840 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fca9c009990 tx=0x7fca9c009ca0 comp rx=0 tx=0).stop 2023-08-11T12:23:35.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.314+0000 7fcaa73ff700 1 -- 172.21.15.8:0/271999845 shutdown_connections 2023-08-11T12:23:35.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.314+0000 7fcaa73ff700 1 --2- 172.21.15.8:0/271999845 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcaa01066b0 0x7fcaa0108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:35.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.314+0000 7fcaa73ff700 1 --2- 172.21.15.8:0/271999845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaa0101450 0x7fcaa0103840 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:35.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.314+0000 7fcaa73ff700 1 --2- 172.21.15.8:0/271999845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa0103d80 0x7fcaa0106170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:35.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.314+0000 7fcaa73ff700 1 -- 172.21.15.8:0/271999845 >> 172.21.15.8:0/271999845 conn(0x7fcaa00fae60 msgr2=0x7fcaa00fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:35.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.314+0000 7fcaa73ff700 1 -- 172.21.15.8:0/271999845 shutdown_connections 2023-08-11T12:23:35.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.314+0000 7fcaa73ff700 1 -- 172.21.15.8:0/271999845 wait complete. 2023-08-11T12:23:35.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.315+0000 7fcaa73ff700 1 Processor -- start 2023-08-11T12:23:35.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.315+0000 7fcaa73ff700 1 -- start start 2023-08-11T12:23:35.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.316+0000 7fcaa73ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcaa0101450 0x7fcaa01988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:35.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.316+0000 7fcaa73ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa0103d80 0x7fcaa0198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:35.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.316+0000 7fcaa73ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaa01066b0 0x7fcaa019fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:35.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.316+0000 7fcaa73ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa01a0440 con 0x7fcaa01066b0 2023-08-11T12:23:35.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.316+0000 7fcaa73ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa01a0580 con 0x7fcaa0103d80 2023-08-11T12:23:35.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.316+0000 7fcaa73ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa01a0710 con 0x7fcaa0101450 2023-08-11T12:23:35.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.316+0000 7fcaa499a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa0103d80 0x7fcaa0198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:35.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.316+0000 7fcaa519b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcaa0101450 0x7fcaa01988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:35.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.316+0000 7fcaa599c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaa01066b0 0x7fcaa019fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:35.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.316+0000 7fcaa519b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcaa0101450 0x7fcaa01988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:34442/0 (socket says 172.21.15.8:34442) 2023-08-11T12:23:35.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.316+0000 7fcaa519b700 1 -- 172.21.15.8:0/1493263311 learned_addr learned my addr 172.21.15.8:0/1493263311 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:35.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.316+0000 7fcaa499a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa0103d80 0x7fcaa0198e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:41804/0 (socket says 172.21.15.8:41804) 2023-08-11T12:23:35.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.317+0000 7fcaa519b700 1 -- 172.21.15.8:0/1493263311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa0103d80 msgr2=0x7fcaa0198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:35.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.317+0000 7fcaa519b700 1 --2- 172.21.15.8:0/1493263311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa0103d80 0x7fcaa0198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:35.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.317+0000 7fcaa519b700 1 -- 172.21.15.8:0/1493263311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaa01066b0 msgr2=0x7fcaa019fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:35.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.317+0000 7fcaa519b700 1 --2- 172.21.15.8:0/1493263311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaa01066b0 0x7fcaa019fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:35.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.317+0000 7fcaa519b700 1 -- 172.21.15.8:0/1493263311 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c0095f0 con 0x7fcaa0101450 2023-08-11T12:23:35.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.317+0000 7fcaa499a700 1 --2- 172.21.15.8:0/1493263311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa0103d80 0x7fcaa0198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:35.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.317+0000 7fcaa599c700 1 --2- 172.21.15.8:0/1493263311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaa01066b0 0x7fcaa019fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:35.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.317+0000 7fcaa519b700 1 --2- 172.21.15.8:0/1493263311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcaa0101450 0x7fcaa01988c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00b680 tx=0x7fca9c0057b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:35.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.317+0000 7fca967fc700 1 -- 172.21.15.8:0/1493263311 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c01d070 con 0x7fcaa0101450 2023-08-11T12:23:35.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.317+0000 7fcaa73ff700 1 -- 172.21.15.8:0/1493263311 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa01a0990 con 0x7fcaa0101450 2023-08-11T12:23:35.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.317+0000 7fca967fc700 1 -- 172.21.15.8:0/1493263311 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca9c022470 con 0x7fcaa0101450 2023-08-11T12:23:35.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.317+0000 7fca967fc700 1 -- 172.21.15.8:0/1493263311 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c017650 con 0x7fcaa0101450 2023-08-11T12:23:35.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.317+0000 7fcaa73ff700 1 -- 172.21.15.8:0/1493263311 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa01a0e10 con 0x7fcaa0101450 2023-08-11T12:23:35.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.318+0000 7fcaa73ff700 1 -- 172.21.15.8:0/1493263311 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa0108280 con 0x7fcaa0101450 2023-08-11T12:23:35.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.320+0000 7fca967fc700 1 -- 172.21.15.8:0/1493263311 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fca9c0225e0 con 0x7fcaa0101450 2023-08-11T12:23:35.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.322+0000 7fca967fc700 1 --2- 172.21.15.8:0/1493263311 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fca8c09ff50 0x7fca8c0a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:35.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.322+0000 7fca967fc700 1 -- 172.21.15.8:0/1493263311 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fca9c0ccc60 con 0x7fcaa0101450 2023-08-11T12:23:35.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.322+0000 7fcaa499a700 1 --2- 172.21.15.8:0/1493263311 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fca8c09ff50 0x7fca8c0a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:35.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.323+0000 7fcaa499a700 1 --2- 172.21.15.8:0/1493263311 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fca8c09ff50 0x7fca8c0a2410 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fca90005950 tx=0x7fca9000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:35.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.324+0000 7fca967fc700 1 -- 172.21.15.8:0/1493263311 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fca9c096710 con 0x7fcaa0101450 2023-08-11T12:23:35.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.536+0000 7fcaa73ff700 1 -- 172.21.15.8:0/1493263311 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcaa010c400 con 0x7fcaa0101450 2023-08-11T12:23:35.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.538+0000 7fca967fc700 1 -- 172.21.15.8:0/1493263311 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24348 (secure 0 0 0) 0x7fca9c099d30 con 0x7fcaa0101450 2023-08-11T12:23:35.541 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:23:35.541 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":89,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","created":"2023-08-11T12:14:28.341113+0000","modified":"2023-08-11T12:22:31.713248+0000","last_up_change":"2023-08-11T12:21:14.913735+0000","last_in_change":"2023-08-11T12:20:57.476558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-11T12:17:49.040758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-11T12:22:01.383296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-11T12:22:02.816329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-11T12:22:06.369375+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f903e393-7894-42d6-8b11-737ceef1f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6803","nonce":664104961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6805","nonce":664104961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6809","nonce":664104961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6807","nonce":664104961}]},"public_addr":"172.21.15.8:6803/664104961","cluster_addr":"172.21.15.8:6805/664104961","heartbeat_back_addr":"172.21.15.8:6809/664104961","heartbeat_front_addr":"172.21.15.8:6807/664104961","state":["exists","up"]},{"osd":1,"uuid":"1e988e5c-e78c-46d5-80a5-dff7ac38cbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6801","nonce":4187350703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6803","nonce":4187350703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6807","nonce":4187350703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6805","nonce":4187350703}]},"public_addr":"172.21.15.45:6801/4187350703","cluster_addr":"172.21.15.45:6803/4187350703","heartbeat_back_addr":"172.21.15.45:6807/4187350703","heartbeat_front_addr":"172.21.15.45:6805/4187350703","state":["exists","up"]},{"osd":2,"uuid":"1835217c-a93c-4181-b8b8-cc410bab1a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6801","nonce":2547818140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6803","nonce":2547818140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6807","nonce":2547818140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6805","nonce":2547818140}]},"public_addr":"172.21.15.194:6801/2547818140","cluster_addr":"172.21.15.194:6803/2547818140","heartbeat_back_addr":"172.21.15.194:6807/2547818140","heartbeat_front_addr":"172.21.15.194:6805/2547818140","state":["exists","up"]},{"osd":3,"uuid":"b55ae61a-731c-4312-a998-661122b84788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6811","nonce":187418883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6813","nonce":187418883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6817","nonce":187418883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6815","nonce":187418883}]},"public_addr":"172.21.15.8:6811/187418883","cluster_addr":"172.21.15.8:6813/187418883","heartbeat_back_addr":"172.21.15.8:6817/187418883","heartbeat_front_addr":"172.21.15.8:6815/187418883","state":["exists","up"]},{"osd":4,"uuid":"2c28acbb-e807-4559-8aa2-a35ca84b5d43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6809","nonce":3099704571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6811","nonce":3099704571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6815","nonce":3099704571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6813","nonce":3099704571}]},"public_addr":"172.21.15.45:6809/3099704571","cluster_addr":"172.21.15.45:6811/3099704571","heartbeat_back_addr":"172.21.15.45:6815/3099704571","heartbeat_front_addr":"172.21.15.45:6813/3099704571","state":["exists","up"]},{"osd":5,"uuid":"37032289-8016-4730-9b69-f7985e058ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6809","nonce":263803874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6811","nonce":263803874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6815","nonce":263803874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6813","nonce":263803874}]},"public_addr":"172.21.15.194:6809/263803874","cluster_addr":"172.21.15.194:6811/263803874","heartbeat_back_addr":"172.21.15.194:6815/263803874","heartbeat_front_addr":"172.21.15.194:6813/263803874","state":["exists","up"]},{"osd":6,"uuid":"32d2dab9-6944-40d1-ada9-4f941821b063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6819","nonce":1802966829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6821","nonce":1802966829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6825","nonce":1802966829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6823","nonce":1802966829}]},"public_addr":"172.21.15.8:6819/1802966829","cluster_addr":"172.21.15.8:6821/1802966829","heartbeat_back_addr":"172.21.15.8:6825/1802966829","heartbeat_front_addr":"172.21.15.8:6823/1802966829","state":["exists","up"]},{"osd":7,"uuid":"086aff58-1554-49fe-92ff-5166b115aeef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6817","nonce":3715737148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6819","nonce":3715737148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6823","nonce":3715737148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6821","nonce":3715737148}]},"public_addr":"172.21.15.45:6817/3715737148","cluster_addr":"172.21.15.45:6819/3715737148","heartbeat_back_addr":"172.21.15.45:6823/3715737148","heartbeat_front_addr":"172.21.15.45:6821/3715737148","state":["exists","up"]},{"osd":8,"uuid":"7fff5e95-2453-4ea6-a5c1-3bba6a1f6400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6817","nonce":57497127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6819","nonce":57497127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6823","nonce":57497127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6821","nonce":57497127}]},"public_addr":"172.21.15.194:6817/57497127","cluster_addr":"172.21.15.194:6819/57497127","heartbeat_back_addr":"172.21.15.194:6823/57497127","heartbeat_front_addr":"172.21.15.194:6821/57497127","state":["exists","up"]},{"osd":9,"uuid":"31ab0121-4c92-42ec-9f19-e672062e8814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6827","nonce":434661930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6829","nonce":434661930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6833","nonce":434661930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6831","nonce":434661930}]},"public_addr":"172.21.15.8:6827/434661930","cluster_addr":"172.21.15.8:6829/434661930","heartbeat_back_addr":"172.21.15.8:6833/434661930","heartbeat_front_addr":"172.21.15.8:6831/434661930","state":["exists","up"]},{"osd":10,"uuid":"62c632e4-94f6-4630-9d94-8d28fccacf45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6825","nonce":3281212184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6827","nonce":3281212184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6831","nonce":3281212184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6829","nonce":3281212184}]},"public_addr":"172.21.15.45:6825/3281212184","cluster_addr":"172.21.15.45:6827/3281212184","heartbeat_back_addr":"172.21.15.45:6831/3281212184","heartbeat_front_addr":"172.21.15.45:6829/3281212184","state":["exists","up"]},{"osd":11,"uuid":"8ca4a80d-cd75-4230-b46d-aef6fdc03e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6825","nonce":1637875895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6827","nonce":1637875895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6831","nonce":1637875895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6829","nonce":1637875895}]},"public_addr":"172.21.15.194:6825/1637875895","cluster_addr":"172.21.15.194:6827/1637875895","heartbeat_back_addr":"172.21.15.194:6831/1637875895","heartbeat_front_addr":"172.21.15.194:6829/1637875895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:04.255616+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:26.243863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:46.630365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:12.926291+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:35.747049+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:55.793767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:21.685725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:43.703215+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:04.043674+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:30.320026+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:52.751974+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:21:13.230024+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/2000592056":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2102228072":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2374527928":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2928221278":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2744750874":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/3681755887":"2023-08-12T12:15:02.528403+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-11T12:23:35.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.540+0000 7fcaa73ff700 1 -- 172.21.15.8:0/1493263311 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fca8c09ff50 msgr2=0x7fca8c0a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:35.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.540+0000 7fcaa73ff700 1 --2- 172.21.15.8:0/1493263311 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fca8c09ff50 0x7fca8c0a2410 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fca90005950 tx=0x7fca9000b410 comp rx=0 tx=0).stop 2023-08-11T12:23:35.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.540+0000 7fcaa73ff700 1 -- 172.21.15.8:0/1493263311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcaa0101450 msgr2=0x7fcaa01988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:35.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.540+0000 7fcaa73ff700 1 --2- 172.21.15.8:0/1493263311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcaa0101450 0x7fcaa01988c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00b680 tx=0x7fca9c0057b0 comp rx=0 tx=0).stop 2023-08-11T12:23:35.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.540+0000 7fcaa73ff700 1 -- 172.21.15.8:0/1493263311 shutdown_connections 2023-08-11T12:23:35.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.540+0000 7fcaa73ff700 1 --2- 172.21.15.8:0/1493263311 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fca8c09ff50 0x7fca8c0a2410 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:35.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.540+0000 7fcaa73ff700 1 --2- 172.21.15.8:0/1493263311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcaa0101450 0x7fcaa01988c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:35.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.540+0000 7fcaa73ff700 1 --2- 172.21.15.8:0/1493263311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaa01066b0 0x7fcaa019fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:35.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.540+0000 7fcaa73ff700 1 --2- 172.21.15.8:0/1493263311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa0103d80 0x7fcaa0198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:35.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.540+0000 7fcaa73ff700 1 -- 172.21.15.8:0/1493263311 >> 172.21.15.8:0/1493263311 conn(0x7fcaa00fae60 msgr2=0x7fcaa00ffad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:35.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.540+0000 7fcaa73ff700 1 -- 172.21.15.8:0/1493263311 shutdown_connections 2023-08-11T12:23:35.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.540+0000 7fcaa73ff700 1 -- 172.21.15.8:0/1493263311 wait complete. 2023-08-11T12:23:35.562 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-11T12:17:49.040758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-11T12:22:01.383296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-11T12:22:02.816329+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-11T12:22:06.369375+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-11T12:23:35.563 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-11T12:23:35.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.767+0000 7fe3731ff700 1 -- 172.21.15.8:0/3142153806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe36c074960 msgr2=0x7fe36c072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:35.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.767+0000 7fe3731ff700 1 --2- 172.21.15.8:0/3142153806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe36c074960 0x7fe36c072db0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe3600098f0 tx=0x7fe360009c00 comp rx=0 tx=0).stop 2023-08-11T12:23:35.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.767+0000 7fe3731ff700 1 -- 172.21.15.8:0/3142153806 shutdown_connections 2023-08-11T12:23:35.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.767+0000 7fe3731ff700 1 --2- 172.21.15.8:0/3142153806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe36c10cfe0 0x7fe36c10f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:35.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.767+0000 7fe3731ff700 1 --2- 172.21.15.8:0/3142153806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe36c074960 0x7fe36c072db0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:35.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.767+0000 7fe3731ff700 1 --2- 172.21.15.8:0/3142153806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe36c073380 0x7fe36c073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:35.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.767+0000 7fe3731ff700 1 -- 172.21.15.8:0/3142153806 >> 172.21.15.8:0/3142153806 conn(0x7fe36c0fbf80 msgr2=0x7fe36c0fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:35.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.767+0000 7fe3731ff700 1 -- 172.21.15.8:0/3142153806 shutdown_connections 2023-08-11T12:23:35.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.767+0000 7fe3731ff700 1 -- 172.21.15.8:0/3142153806 wait complete. 2023-08-11T12:23:35.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.768+0000 7fe3731ff700 1 Processor -- start 2023-08-11T12:23:35.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.768+0000 7fe3731ff700 1 -- start start 2023-08-11T12:23:35.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.768+0000 7fe3731ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe36c073380 0x7fe36c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:35.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.768+0000 7fe3731ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe36c074960 0x7fe36c19d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:35.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.769+0000 7fe3731ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe36c10cfe0 0x7fe36c1a42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:35.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.769+0000 7fe3731ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c1a48c0 con 0x7fe36c074960 2023-08-11T12:23:35.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.769+0000 7fe3731ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c1a4a00 con 0x7fe36c10cfe0 2023-08-11T12:23:35.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.769+0000 7fe3731ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c1a4b90 con 0x7fe36c073380 2023-08-11T12:23:35.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.769+0000 7fe36bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe36c074960 0x7fe36c19d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:35.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.769+0000 7fe370f9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe36c073380 0x7fe36c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:35.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.769+0000 7fe36bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe36c074960 0x7fe36c19d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40678/0 (socket says 172.21.15.8:40678) 2023-08-11T12:23:35.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.769+0000 7fe370f9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe36c073380 0x7fe36c19cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:34464/0 (socket says 172.21.15.8:34464) 2023-08-11T12:23:35.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.769+0000 7fe36bfff700 1 -- 172.21.15.8:0/838604013 learned_addr learned my addr 172.21.15.8:0/838604013 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:35.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.769+0000 7fe37179c700 1 --2- 172.21.15.8:0/838604013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe36c10cfe0 0x7fe36c1a42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:35.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.769+0000 7fe36bfff700 1 -- 172.21.15.8:0/838604013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe36c073380 msgr2=0x7fe36c19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:35.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.769+0000 7fe36bfff700 1 --2- 172.21.15.8:0/838604013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe36c073380 0x7fe36c19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:35.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.769+0000 7fe36bfff700 1 -- 172.21.15.8:0/838604013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe36c10cfe0 msgr2=0x7fe36c1a42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:35.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.769+0000 7fe36bfff700 1 --2- 172.21.15.8:0/838604013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe36c10cfe0 0x7fe36c1a42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:35.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.769+0000 7fe36bfff700 1 -- 172.21.15.8:0/838604013 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe360009520 con 0x7fe36c074960 2023-08-11T12:23:35.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.769+0000 7fe370f9b700 1 --2- 172.21.15.8:0/838604013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe36c073380 0x7fe36c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:35.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.770+0000 7fe36bfff700 1 --2- 172.21.15.8:0/838604013 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe36c074960 0x7fe36c19d280 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe35800e9f0 tx=0x7fe35800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:35.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.770+0000 7fe369ffb700 1 -- 172.21.15.8:0/838604013 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe358004220 con 0x7fe36c074960 2023-08-11T12:23:35.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.770+0000 7fe369ffb700 1 -- 172.21.15.8:0/838604013 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe358004380 con 0x7fe36c074960 2023-08-11T12:23:35.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.770+0000 7fe3731ff700 1 -- 172.21.15.8:0/838604013 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe36c1a4e70 con 0x7fe36c074960 2023-08-11T12:23:35.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.770+0000 7fe369ffb700 1 -- 172.21.15.8:0/838604013 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe358003be0 con 0x7fe36c074960 2023-08-11T12:23:35.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.770+0000 7fe3731ff700 1 -- 172.21.15.8:0/838604013 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe36c1a52f0 con 0x7fe36c074960 2023-08-11T12:23:35.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.772+0000 7fe3731ff700 1 -- 172.21.15.8:0/838604013 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe36c102b30 con 0x7fe36c074960 2023-08-11T12:23:35.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.773+0000 7fe369ffb700 1 -- 172.21.15.8:0/838604013 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fe358003d40 con 0x7fe36c074960 2023-08-11T12:23:35.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.775+0000 7fe369ffb700 1 --2- 172.21.15.8:0/838604013 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe35c09ff50 0x7fe35c0a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:35.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.775+0000 7fe369ffb700 1 -- 172.21.15.8:0/838604013 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fe358014070 con 0x7fe36c074960 2023-08-11T12:23:35.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.775+0000 7fe370f9b700 1 --2- 172.21.15.8:0/838604013 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe35c09ff50 0x7fe35c0a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:35.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.776+0000 7fe370f9b700 1 --2- 172.21.15.8:0/838604013 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe35c09ff50 0x7fe35c0a2410 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe360005e90 tx=0x7fe360019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:35.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.779+0000 7fe369ffb700 1 -- 172.21.15.8:0/838604013 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fe358095030 con 0x7fe36c074960 2023-08-11T12:23:35.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.992+0000 7fe3731ff700 1 -- 172.21.15.8:0/838604013 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe36c02cde0 con 0x7fe36c074960 2023-08-11T12:23:35.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.993+0000 7fe369ffb700 1 -- 172.21.15.8:0/838604013 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe358098650 con 0x7fe36c074960 2023-08-11T12:23:35.996 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-08-11T12:23:35.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.995+0000 7fe3731ff700 1 -- 172.21.15.8:0/838604013 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe35c09ff50 msgr2=0x7fe35c0a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:35.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.995+0000 7fe3731ff700 1 --2- 172.21.15.8:0/838604013 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe35c09ff50 0x7fe35c0a2410 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe360005e90 tx=0x7fe360019040 comp rx=0 tx=0).stop 2023-08-11T12:23:35.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.995+0000 7fe3731ff700 1 -- 172.21.15.8:0/838604013 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe36c074960 msgr2=0x7fe36c19d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:35.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.995+0000 7fe3731ff700 1 --2- 172.21.15.8:0/838604013 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe36c074960 0x7fe36c19d280 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe35800e9f0 tx=0x7fe35800ed00 comp rx=0 tx=0).stop 2023-08-11T12:23:35.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.995+0000 7fe3731ff700 1 -- 172.21.15.8:0/838604013 shutdown_connections 2023-08-11T12:23:35.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.995+0000 7fe3731ff700 1 --2- 172.21.15.8:0/838604013 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe35c09ff50 0x7fe35c0a2410 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:35.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.995+0000 7fe3731ff700 1 --2- 172.21.15.8:0/838604013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe36c073380 0x7fe36c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:35.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.995+0000 7fe3731ff700 1 --2- 172.21.15.8:0/838604013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe36c10cfe0 0x7fe36c1a42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:35.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.995+0000 7fe3731ff700 1 --2- 172.21.15.8:0/838604013 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe36c074960 0x7fe36c19d280 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:35.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.995+0000 7fe3731ff700 1 -- 172.21.15.8:0/838604013 >> 172.21.15.8:0/838604013 conn(0x7fe36c0fbf80 msgr2=0x7fe36c0fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:36.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.995+0000 7fe3731ff700 1 -- 172.21.15.8:0/838604013 shutdown_connections 2023-08-11T12:23:36.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:35.995+0000 7fe3731ff700 1 -- 172.21.15.8:0/838604013 wait complete. 2023-08-11T12:23:36.018 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-11T12:23:36.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:35 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2367909910' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:23:36.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:35 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1493263311' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:23:36.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:35 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2367909910' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:23:36.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:35 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1493263311' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:23:36.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.234+0000 7f6c515ff700 1 -- 172.21.15.8:0/1786651386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c4c102c00 msgr2=0x7f6c4c103020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:36.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.234+0000 7f6c515ff700 1 --2- 172.21.15.8:0/1786651386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c4c102c00 0x7f6c4c103020 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c009990 tx=0x7f6c3c009ca0 comp rx=0 tx=0).stop 2023-08-11T12:23:36.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.235+0000 7f6c515ff700 1 -- 172.21.15.8:0/1786651386 shutdown_connections 2023-08-11T12:23:36.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.235+0000 7f6c515ff700 1 --2- 172.21.15.8:0/1786651386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c4c102c00 0x7f6c4c103020 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:36.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.235+0000 7f6c515ff700 1 --2- 172.21.15.8:0/1786651386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c4c104790 0x7f6c4c10b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:36.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.235+0000 7f6c515ff700 1 --2- 172.21.15.8:0/1786651386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c4c103df0 0x7f6c4c104250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:36.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.235+0000 7f6c515ff700 1 -- 172.21.15.8:0/1786651386 >> 172.21.15.8:0/1786651386 conn(0x7f6c4c0fe170 msgr2=0x7f6c4c1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:36.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.235+0000 7f6c515ff700 1 -- 172.21.15.8:0/1786651386 shutdown_connections 2023-08-11T12:23:36.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.235+0000 7f6c515ff700 1 -- 172.21.15.8:0/1786651386 wait complete. 2023-08-11T12:23:36.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.236+0000 7f6c515ff700 1 Processor -- start 2023-08-11T12:23:36.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.236+0000 7f6c515ff700 1 -- start start 2023-08-11T12:23:36.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.236+0000 7f6c515ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c4c102c00 0x7f6c4c198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:36.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.236+0000 7f6c515ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c4c103df0 0x7f6c4c198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:36.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.236+0000 7f6c515ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c4c104790 0x7f6c4c19fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:36.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.236+0000 7f6c515ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c1a0410 con 0x7f6c4c102c00 2023-08-11T12:23:36.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.236+0000 7f6c515ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c1a0550 con 0x7f6c4c104790 2023-08-11T12:23:36.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.236+0000 7f6c515ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c1a06e0 con 0x7f6c4c103df0 2023-08-11T12:23:36.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.236+0000 7f6c4affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c4c102c00 0x7f6c4c198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:36.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.236+0000 7f6c4affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c4c102c00 0x7f6c4c198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40706/0 (socket says 172.21.15.8:40706) 2023-08-11T12:23:36.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.236+0000 7f6c4affd700 1 -- 172.21.15.8:0/2743203305 learned_addr learned my addr 172.21.15.8:0/2743203305 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:36.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.236+0000 7f6c4a7fc700 1 --2- 172.21.15.8:0/2743203305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c4c103df0 0x7f6c4c198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:36.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.237+0000 7f6c4b7fe700 1 --2- 172.21.15.8:0/2743203305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c4c104790 0x7f6c4c19fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:36.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.237+0000 7f6c4affd700 1 -- 172.21.15.8:0/2743203305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c4c103df0 msgr2=0x7f6c4c198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:36.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.237+0000 7f6c4affd700 1 --2- 172.21.15.8:0/2743203305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c4c103df0 0x7f6c4c198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:36.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.237+0000 7f6c4affd700 1 -- 172.21.15.8:0/2743203305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c4c104790 msgr2=0x7f6c4c19fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:36.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.237+0000 7f6c4affd700 1 --2- 172.21.15.8:0/2743203305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c4c104790 0x7f6c4c19fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:36.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.237+0000 7f6c4affd700 1 -- 172.21.15.8:0/2743203305 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3c0095f0 con 0x7f6c4c102c00 2023-08-11T12:23:36.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.237+0000 7f6c4affd700 1 --2- 172.21.15.8:0/2743203305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c4c102c00 0x7f6c4c198890 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c000c00 tx=0x7f6c3c005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:36.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.237+0000 7f6c33fff700 1 -- 172.21.15.8:0/2743203305 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c01d070 con 0x7f6c4c102c00 2023-08-11T12:23:36.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.237+0000 7f6c33fff700 1 -- 172.21.15.8:0/2743203305 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c3c022470 con 0x7f6c4c102c00 2023-08-11T12:23:36.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.237+0000 7f6c515ff700 1 -- 172.21.15.8:0/2743203305 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4c1a0960 con 0x7f6c4c102c00 2023-08-11T12:23:36.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.237+0000 7f6c33fff700 1 -- 172.21.15.8:0/2743203305 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c017650 con 0x7f6c4c102c00 2023-08-11T12:23:36.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.238+0000 7f6c515ff700 1 -- 172.21.15.8:0/2743203305 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c4c1a0d80 con 0x7f6c4c102c00 2023-08-11T12:23:36.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.239+0000 7f6c515ff700 1 -- 172.21.15.8:0/2743203305 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c4c10a140 con 0x7f6c4c102c00 2023-08-11T12:23:36.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.240+0000 7f6c33fff700 1 -- 172.21.15.8:0/2743203305 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f6c3c0225e0 con 0x7f6c4c102c00 2023-08-11T12:23:36.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.242+0000 7f6c33fff700 1 --2- 172.21.15.8:0/2743203305 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6c3409ff50 0x7f6c340a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:36.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.242+0000 7f6c33fff700 1 -- 172.21.15.8:0/2743203305 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f6c3c0cc830 con 0x7f6c4c102c00 2023-08-11T12:23:36.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.242+0000 7f6c4a7fc700 1 --2- 172.21.15.8:0/2743203305 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6c3409ff50 0x7f6c340a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:36.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.243+0000 7f6c4a7fc700 1 --2- 172.21.15.8:0/2743203305 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6c3409ff50 0x7f6c340a2410 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009c60 tx=0x7f6c40009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:36.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.245+0000 7f6c33fff700 1 -- 172.21.15.8:0/2743203305 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f6c3c05cc30 con 0x7f6c4c102c00 2023-08-11T12:23:36.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:35 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2367909910' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:23:36.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:35 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1493263311' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:23:36.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.476+0000 7f6c515ff700 1 -- 172.21.15.8:0/2743203305 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c4c10e550 con 0x7f6c4c102c00 2023-08-11T12:23:36.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.477+0000 7f6c33fff700 1 -- 172.21.15.8:0/2743203305 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c3c0962e0 con 0x7f6c4c102c00 2023-08-11T12:23:36.480 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-08-11T12:23:36.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.479+0000 7f6c515ff700 1 -- 172.21.15.8:0/2743203305 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6c3409ff50 msgr2=0x7f6c340a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:36.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.479+0000 7f6c515ff700 1 --2- 172.21.15.8:0/2743203305 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6c3409ff50 0x7f6c340a2410 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009c60 tx=0x7f6c40009260 comp rx=0 tx=0).stop 2023-08-11T12:23:36.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.479+0000 7f6c515ff700 1 -- 172.21.15.8:0/2743203305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c4c102c00 msgr2=0x7f6c4c198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:36.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.479+0000 7f6c515ff700 1 --2- 172.21.15.8:0/2743203305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c4c102c00 0x7f6c4c198890 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c000c00 tx=0x7f6c3c005720 comp rx=0 tx=0).stop 2023-08-11T12:23:36.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.479+0000 7f6c515ff700 1 -- 172.21.15.8:0/2743203305 shutdown_connections 2023-08-11T12:23:36.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.479+0000 7f6c515ff700 1 --2- 172.21.15.8:0/2743203305 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6c3409ff50 0x7f6c340a2410 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:36.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.479+0000 7f6c515ff700 1 --2- 172.21.15.8:0/2743203305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c4c104790 0x7f6c4c19fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:36.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.479+0000 7f6c515ff700 1 --2- 172.21.15.8:0/2743203305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c4c102c00 0x7f6c4c198890 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:36.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.479+0000 7f6c515ff700 1 --2- 172.21.15.8:0/2743203305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c4c103df0 0x7f6c4c198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:36.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.479+0000 7f6c515ff700 1 -- 172.21.15.8:0/2743203305 >> 172.21.15.8:0/2743203305 conn(0x7f6c4c0fe170 msgr2=0x7f6c4c107280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:36.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.479+0000 7f6c515ff700 1 -- 172.21.15.8:0/2743203305 shutdown_connections 2023-08-11T12:23:36.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.480+0000 7f6c515ff700 1 -- 172.21.15.8:0/2743203305 wait complete. 2023-08-11T12:23:36.501 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-11T12:23:36.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.706+0000 7f57577ff700 1 -- 172.21.15.8:0/3394974157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5750073380 msgr2=0x7f5750073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:36.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.706+0000 7f57577ff700 1 --2- 172.21.15.8:0/3394974157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5750073380 0x7f5750073800 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5740009990 tx=0x7f5740009ca0 comp rx=0 tx=0).stop 2023-08-11T12:23:36.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.706+0000 7f57577ff700 1 -- 172.21.15.8:0/3394974157 shutdown_connections 2023-08-11T12:23:36.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.706+0000 7f57577ff700 1 --2- 172.21.15.8:0/3394974157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57501088c0 0x7f575010ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:36.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.706+0000 7f57577ff700 1 --2- 172.21.15.8:0/3394974157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5750074960 0x7f5750072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:36.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.706+0000 7f57577ff700 1 --2- 172.21.15.8:0/3394974157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5750073380 0x7f5750073800 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:36.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.706+0000 7f57577ff700 1 -- 172.21.15.8:0/3394974157 >> 172.21.15.8:0/3394974157 conn(0x7f57500fbf70 msgr2=0x7f57500fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:36.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.706+0000 7f57577ff700 1 -- 172.21.15.8:0/3394974157 shutdown_connections 2023-08-11T12:23:36.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.706+0000 7f57577ff700 1 -- 172.21.15.8:0/3394974157 wait complete. 2023-08-11T12:23:36.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.707+0000 7f57577ff700 1 Processor -- start 2023-08-11T12:23:36.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.707+0000 7f57577ff700 1 -- start start 2023-08-11T12:23:36.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.707+0000 7f57577ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5750073380 0x7f5750198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:36.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.707+0000 7f57577ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5750074960 0x7f5750198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:36.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.707+0000 7f57577ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57501088c0 0x7f575019fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:36.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.707+0000 7f57577ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57501a0490 con 0x7f57501088c0 2023-08-11T12:23:36.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.707+0000 7f57577ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57501a05d0 con 0x7f5750074960 2023-08-11T12:23:36.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.707+0000 7f57577ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57501a0760 con 0x7f5750073380 2023-08-11T12:23:36.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.708+0000 7f575559b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5750073380 0x7f5750198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:36.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.708+0000 7f575559b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5750073380 0x7f5750198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:34504/0 (socket says 172.21.15.8:34504) 2023-08-11T12:23:36.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.708+0000 7f575559b700 1 -- 172.21.15.8:0/3171791170 learned_addr learned my addr 172.21.15.8:0/3171791170 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:36.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.708+0000 7f5755d9c700 1 --2- 172.21.15.8:0/3171791170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57501088c0 0x7f575019fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:36.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.708+0000 7f5754d9a700 1 --2- 172.21.15.8:0/3171791170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5750074960 0x7f5750198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:36.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.708+0000 7f575559b700 1 -- 172.21.15.8:0/3171791170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5750074960 msgr2=0x7f5750198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:36.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.708+0000 7f575559b700 1 --2- 172.21.15.8:0/3171791170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5750074960 0x7f5750198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:36.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.708+0000 7f575559b700 1 -- 172.21.15.8:0/3171791170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57501088c0 msgr2=0x7f575019fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:36.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.708+0000 7f575559b700 1 --2- 172.21.15.8:0/3171791170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57501088c0 0x7f575019fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:36.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.708+0000 7f575559b700 1 -- 172.21.15.8:0/3171791170 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57400095f0 con 0x7f5750073380 2023-08-11T12:23:36.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.708+0000 7f5754d9a700 1 --2- 172.21.15.8:0/3171791170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5750074960 0x7f5750198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:36.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.708+0000 7f575559b700 1 --2- 172.21.15.8:0/3171791170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5750073380 0x7f5750198910 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f574c00e9a0 tx=0x7f574c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:36.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.709+0000 7f57467fc700 1 -- 172.21.15.8:0/3171791170 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574c009790 con 0x7f5750073380 2023-08-11T12:23:36.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.709+0000 7f57577ff700 1 -- 172.21.15.8:0/3171791170 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57501a0a40 con 0x7f5750073380 2023-08-11T12:23:36.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.709+0000 7f57467fc700 1 -- 172.21.15.8:0/3171791170 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f574c010430 con 0x7f5750073380 2023-08-11T12:23:36.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.709+0000 7f57467fc700 1 -- 172.21.15.8:0/3171791170 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574c018680 con 0x7f5750073380 2023-08-11T12:23:36.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.709+0000 7f57577ff700 1 -- 172.21.15.8:0/3171791170 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57501a0f50 con 0x7f5750073380 2023-08-11T12:23:36.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.710+0000 7f57577ff700 1 -- 172.21.15.8:0/3171791170 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5750106f70 con 0x7f5750073380 2023-08-11T12:23:36.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.712+0000 7f57467fc700 1 -- 172.21.15.8:0/3171791170 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f574c0105a0 con 0x7f5750073380 2023-08-11T12:23:36.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.713+0000 7f57467fc700 1 --2- 172.21.15.8:0/3171791170 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f573c09ff50 0x7f573c0a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:36.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.713+0000 7f57467fc700 1 -- 172.21.15.8:0/3171791170 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f574c014070 con 0x7f5750073380 2023-08-11T12:23:36.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.714+0000 7f5754d9a700 1 --2- 172.21.15.8:0/3171791170 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f573c09ff50 0x7f573c0a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:36.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.714+0000 7f5754d9a700 1 --2- 172.21.15.8:0/3171791170 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f573c09ff50 0x7f573c0a2410 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f574000b2e0 tx=0x7f5740005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:36.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.715+0000 7f57467fc700 1 -- 172.21.15.8:0/3171791170 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f574c095380 con 0x7f5750073380 2023-08-11T12:23:36.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.928+0000 7f57577ff700 1 -- 172.21.15.8:0/3171791170 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f575010e5f0 con 0x7f5750073380 2023-08-11T12:23:36.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.928+0000 7f57467fc700 1 -- 172.21.15.8:0/3171791170 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f574c0260a0 con 0x7f5750073380 2023-08-11T12:23:36.932 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-08-11T12:23:36.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.931+0000 7f57577ff700 1 -- 172.21.15.8:0/3171791170 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f573c09ff50 msgr2=0x7f573c0a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:36.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.931+0000 7f57577ff700 1 --2- 172.21.15.8:0/3171791170 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f573c09ff50 0x7f573c0a2410 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f574000b2e0 tx=0x7f5740005fb0 comp rx=0 tx=0).stop 2023-08-11T12:23:36.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.931+0000 7f57577ff700 1 -- 172.21.15.8:0/3171791170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5750073380 msgr2=0x7f5750198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:36.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.931+0000 7f57577ff700 1 --2- 172.21.15.8:0/3171791170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5750073380 0x7f5750198910 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f574c00e9a0 tx=0x7f574c00ecb0 comp rx=0 tx=0).stop 2023-08-11T12:23:36.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.931+0000 7f57577ff700 1 -- 172.21.15.8:0/3171791170 shutdown_connections 2023-08-11T12:23:36.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.931+0000 7f57577ff700 1 --2- 172.21.15.8:0/3171791170 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f573c09ff50 0x7f573c0a2410 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:36.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.931+0000 7f57577ff700 1 --2- 172.21.15.8:0/3171791170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5750073380 0x7f5750198910 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:36.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.931+0000 7f57577ff700 1 --2- 172.21.15.8:0/3171791170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57501088c0 0x7f575019fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:36.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.931+0000 7f57577ff700 1 --2- 172.21.15.8:0/3171791170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5750074960 0x7f5750198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:36.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.931+0000 7f57577ff700 1 -- 172.21.15.8:0/3171791170 >> 172.21.15.8:0/3171791170 conn(0x7f57500fbf70 msgr2=0x7f57500fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:36.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.931+0000 7f57577ff700 1 -- 172.21.15.8:0/3171791170 shutdown_connections 2023-08-11T12:23:36.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:36.931+0000 7f57577ff700 1 -- 172.21.15.8:0/3171791170 wait complete. 2023-08-11T12:23:36.953 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-11T12:23:37.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:36 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/838604013' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:23:37.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:36 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2743203305' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:23:37.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:36 smithi194 ceph-mon[130905]: pgmap v322: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-08-11T12:23:37.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:36 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/838604013' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:23:37.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:36 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2743203305' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:23:37.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:36 smithi045 ceph-mon[130284]: pgmap v322: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-08-11T12:23:37.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.156+0000 7f64a83ff700 1 -- 172.21.15.8:0/731883032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64a0073380 msgr2=0x7f64a0073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:37.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.156+0000 7f64a83ff700 1 --2- 172.21.15.8:0/731883032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64a0073380 0x7f64a0073800 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f64900098f0 tx=0x7f6490009c00 comp rx=0 tx=0).stop 2023-08-11T12:23:37.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.156+0000 7f64a83ff700 1 -- 172.21.15.8:0/731883032 shutdown_connections 2023-08-11T12:23:37.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.156+0000 7f64a83ff700 1 --2- 172.21.15.8:0/731883032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64a0074960 0x7f64a0072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:37.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.156+0000 7f64a83ff700 1 --2- 172.21.15.8:0/731883032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64a010cfd0 0x7f64a010f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:37.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.156+0000 7f64a83ff700 1 --2- 172.21.15.8:0/731883032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64a0073380 0x7f64a0073800 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:37.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.156+0000 7f64a83ff700 1 -- 172.21.15.8:0/731883032 >> 172.21.15.8:0/731883032 conn(0x7f64a00fbf70 msgr2=0x7f64a00fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:37.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.156+0000 7f64a83ff700 1 -- 172.21.15.8:0/731883032 shutdown_connections 2023-08-11T12:23:37.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.156+0000 7f64a83ff700 1 -- 172.21.15.8:0/731883032 wait complete. 2023-08-11T12:23:37.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.157+0000 7f64a83ff700 1 Processor -- start 2023-08-11T12:23:37.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.157+0000 7f64a83ff700 1 -- start start 2023-08-11T12:23:37.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.157+0000 7f64a83ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64a0073380 0x7f64a019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:37.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.158+0000 7f64a83ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64a0074960 0x7f64a019d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:37.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.158+0000 7f64a83ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64a010cfd0 0x7f64a01a4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:37.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.158+0000 7f64a83ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a01a4850 con 0x7f64a0074960 2023-08-11T12:23:37.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.158+0000 7f64a83ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a01a49c0 con 0x7f64a0073380 2023-08-11T12:23:37.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.158+0000 7f64a83ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a01a4b80 con 0x7f64a010cfd0 2023-08-11T12:23:37.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.158+0000 7f64a599a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64a0074960 0x7f64a019d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:37.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.158+0000 7f64a619b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64a0073380 0x7f64a019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:37.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.158+0000 7f64a619b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64a0073380 0x7f64a019cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:41882/0 (socket says 172.21.15.8:41882) 2023-08-11T12:23:37.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.158+0000 7f64a619b700 1 -- 172.21.15.8:0/1342098483 learned_addr learned my addr 172.21.15.8:0/1342098483 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:37.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.158+0000 7f64a599a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64a0074960 0x7f64a019d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40754/0 (socket says 172.21.15.8:40754) 2023-08-11T12:23:37.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.158+0000 7f64a699c700 1 --2- 172.21.15.8:0/1342098483 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64a010cfd0 0x7f64a01a4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:37.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.158+0000 7f64a599a700 1 -- 172.21.15.8:0/1342098483 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64a010cfd0 msgr2=0x7f64a01a4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:37.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.158+0000 7f64a599a700 1 --2- 172.21.15.8:0/1342098483 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64a010cfd0 0x7f64a01a4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:37.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.158+0000 7f64a599a700 1 -- 172.21.15.8:0/1342098483 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64a0073380 msgr2=0x7f64a019cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:37.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.158+0000 7f64a599a700 1 --2- 172.21.15.8:0/1342098483 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64a0073380 0x7f64a019cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:37.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.158+0000 7f64a599a700 1 -- 172.21.15.8:0/1342098483 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6490009520 con 0x7f64a0074960 2023-08-11T12:23:37.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.158+0000 7f64a619b700 1 --2- 172.21.15.8:0/1342098483 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64a0073380 0x7f64a019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:37.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.158+0000 7f64a699c700 1 --2- 172.21.15.8:0/1342098483 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64a010cfd0 0x7f64a01a4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:23:37.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.159+0000 7f64a599a700 1 --2- 172.21.15.8:0/1342098483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64a0074960 0x7f64a019d250 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6490000c00 tx=0x7f649000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:37.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.159+0000 7f64977fe700 1 -- 172.21.15.8:0/1342098483 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649001c070 con 0x7f64a0074960 2023-08-11T12:23:37.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.159+0000 7f64a83ff700 1 -- 172.21.15.8:0/1342098483 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a01a4e00 con 0x7f64a0074960 2023-08-11T12:23:37.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.159+0000 7f64977fe700 1 -- 172.21.15.8:0/1342098483 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f649000f7d0 con 0x7f64a0074960 2023-08-11T12:23:37.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.159+0000 7f64977fe700 1 -- 172.21.15.8:0/1342098483 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6490003a40 con 0x7f64a0074960 2023-08-11T12:23:37.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.159+0000 7f64a83ff700 1 -- 172.21.15.8:0/1342098483 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a01a51d0 con 0x7f64a0074960 2023-08-11T12:23:37.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.160+0000 7f64a83ff700 1 -- 172.21.15.8:0/1342098483 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64a0102b20 con 0x7f64a0074960 2023-08-11T12:23:37.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.162+0000 7f64977fe700 1 -- 172.21.15.8:0/1342098483 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f6490020070 con 0x7f64a0074960 2023-08-11T12:23:37.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.163+0000 7f64977fe700 1 --2- 172.21.15.8:0/1342098483 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f648c09ff50 0x7f648c0a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:37.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.163+0000 7f64977fe700 1 -- 172.21.15.8:0/1342098483 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f64900cc130 con 0x7f64a0074960 2023-08-11T12:23:37.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.164+0000 7f64a619b700 1 --2- 172.21.15.8:0/1342098483 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f648c09ff50 0x7f648c0a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:37.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.164+0000 7f64a619b700 1 --2- 172.21.15.8:0/1342098483 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f648c09ff50 0x7f648c0a2410 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f64a019e1e0 tx=0x7f649c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:37.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.167+0000 7f64977fe700 1 -- 172.21.15.8:0/1342098483 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f6490095be0 con 0x7f64a0074960 2023-08-11T12:23:37.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:36 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/838604013' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:23:37.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:36 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2743203305' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:23:37.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:36 smithi008 ceph-mon[97158]: pgmap v322: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-08-11T12:23:37.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.376+0000 7f64a83ff700 1 -- 172.21.15.8:0/1342098483 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f64a0112a10 con 0x7f64a0074960 2023-08-11T12:23:37.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.376+0000 7f64977fe700 1 -- 172.21.15.8:0/1342098483 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6490099200 con 0x7f64a0074960 2023-08-11T12:23:37.380 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-08-11T12:23:37.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.379+0000 7f64a83ff700 1 -- 172.21.15.8:0/1342098483 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f648c09ff50 msgr2=0x7f648c0a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:37.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.379+0000 7f64a83ff700 1 --2- 172.21.15.8:0/1342098483 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f648c09ff50 0x7f648c0a2410 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f64a019e1e0 tx=0x7f649c009260 comp rx=0 tx=0).stop 2023-08-11T12:23:37.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.379+0000 7f64a83ff700 1 -- 172.21.15.8:0/1342098483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64a0074960 msgr2=0x7f64a019d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:37.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.379+0000 7f64a83ff700 1 --2- 172.21.15.8:0/1342098483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64a0074960 0x7f64a019d250 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6490000c00 tx=0x7f649000b790 comp rx=0 tx=0).stop 2023-08-11T12:23:37.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.379+0000 7f64a83ff700 1 -- 172.21.15.8:0/1342098483 shutdown_connections 2023-08-11T12:23:37.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.379+0000 7f64a83ff700 1 --2- 172.21.15.8:0/1342098483 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f648c09ff50 0x7f648c0a2410 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:37.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.379+0000 7f64a83ff700 1 --2- 172.21.15.8:0/1342098483 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64a010cfd0 0x7f64a01a4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:37.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.379+0000 7f64a83ff700 1 --2- 172.21.15.8:0/1342098483 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64a0073380 0x7f64a019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:37.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.379+0000 7f64a83ff700 1 --2- 172.21.15.8:0/1342098483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64a0074960 0x7f64a019d250 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:37.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.379+0000 7f64a83ff700 1 -- 172.21.15.8:0/1342098483 >> 172.21.15.8:0/1342098483 conn(0x7f64a00fbf70 msgr2=0x7f64a00fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:37.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.379+0000 7f64a83ff700 1 -- 172.21.15.8:0/1342098483 shutdown_connections 2023-08-11T12:23:37.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.379+0000 7f64a83ff700 1 -- 172.21.15.8:0/1342098483 wait complete. 2023-08-11T12:23:37.402 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-11T12:23:37.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.609+0000 7fb3ac7ff700 1 -- 172.21.15.8:0/2760190216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3a41009e0 msgr2=0x7fb3a4100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:37.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.609+0000 7fb3ac7ff700 1 --2- 172.21.15.8:0/2760190216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3a41009e0 0x7fb3a4100e00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0009990 tx=0x7fb3a0009ca0 comp rx=0 tx=0).stop 2023-08-11T12:23:37.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.609+0000 7fb3ac7ff700 1 -- 172.21.15.8:0/2760190216 shutdown_connections 2023-08-11T12:23:37.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.609+0000 7fb3ac7ff700 1 --2- 172.21.15.8:0/2760190216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3a41009e0 0x7fb3a4100e00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:37.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.609+0000 7fb3ac7ff700 1 --2- 172.21.15.8:0/2760190216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3a4102570 0x7fb3a4108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:37.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.609+0000 7fb3ac7ff700 1 --2- 172.21.15.8:0/2760190216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3a4101bd0 0x7fb3a4102030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:37.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.609+0000 7fb3ac7ff700 1 -- 172.21.15.8:0/2760190216 >> 172.21.15.8:0/2760190216 conn(0x7fb3a40fbf50 msgr2=0x7fb3a40fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:37.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.610+0000 7fb3ac7ff700 1 -- 172.21.15.8:0/2760190216 shutdown_connections 2023-08-11T12:23:37.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.610+0000 7fb3ac7ff700 1 -- 172.21.15.8:0/2760190216 wait complete. 2023-08-11T12:23:37.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.611+0000 7fb3ac7ff700 1 Processor -- start 2023-08-11T12:23:37.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.611+0000 7fb3ac7ff700 1 -- start start 2023-08-11T12:23:37.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.611+0000 7fb3ac7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3a41009e0 0x7fb3a41966f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:37.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.611+0000 7fb3ac7ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3a4101bd0 0x7fb3a4196c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:37.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.611+0000 7fb3ac7ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3a4102570 0x7fb3a419dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:37.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.611+0000 7fb3ac7ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a419e270 con 0x7fb3a4102570 2023-08-11T12:23:37.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.611+0000 7fb3ac7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a419e3b0 con 0x7fb3a41009e0 2023-08-11T12:23:37.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.611+0000 7fb3ac7ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a419e540 con 0x7fb3a4101bd0 2023-08-11T12:23:37.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.611+0000 7fb3aa59b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3a41009e0 0x7fb3a41966f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:37.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.611+0000 7fb3aa59b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3a41009e0 0x7fb3a41966f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:41902/0 (socket says 172.21.15.8:41902) 2023-08-11T12:23:37.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.611+0000 7fb3aa59b700 1 -- 172.21.15.8:0/458364049 learned_addr learned my addr 172.21.15.8:0/458364049 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:37.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.611+0000 7fb3a9d9a700 1 --2- 172.21.15.8:0/458364049 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3a4101bd0 0x7fb3a4196c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:37.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.611+0000 7fb3aad9c700 1 --2- 172.21.15.8:0/458364049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3a4102570 0x7fb3a419dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:37.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.612+0000 7fb3aa59b700 1 -- 172.21.15.8:0/458364049 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3a4101bd0 msgr2=0x7fb3a4196c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:37.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.612+0000 7fb3aa59b700 1 --2- 172.21.15.8:0/458364049 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3a4101bd0 0x7fb3a4196c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:37.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.612+0000 7fb3aa59b700 1 -- 172.21.15.8:0/458364049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3a4102570 msgr2=0x7fb3a419dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:37.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.612+0000 7fb3aa59b700 1 --2- 172.21.15.8:0/458364049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3a4102570 0x7fb3a419dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:37.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.612+0000 7fb3aa59b700 1 -- 172.21.15.8:0/458364049 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a00095f0 con 0x7fb3a41009e0 2023-08-11T12:23:37.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.612+0000 7fb3aa59b700 1 --2- 172.21.15.8:0/458364049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3a41009e0 0x7fb3a41966f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0004710 tx=0x7fb3a0009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:37.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.612+0000 7fb39b7fe700 1 -- 172.21.15.8:0/458364049 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a001d070 con 0x7fb3a41009e0 2023-08-11T12:23:37.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.612+0000 7fb39b7fe700 1 -- 172.21.15.8:0/458364049 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb3a0021410 con 0x7fb3a41009e0 2023-08-11T12:23:37.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.612+0000 7fb3ac7ff700 1 -- 172.21.15.8:0/458364049 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a419e7c0 con 0x7fb3a41009e0 2023-08-11T12:23:37.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.612+0000 7fb39b7fe700 1 -- 172.21.15.8:0/458364049 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a0017650 con 0x7fb3a41009e0 2023-08-11T12:23:37.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.613+0000 7fb3ac7ff700 1 -- 172.21.15.8:0/458364049 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a419ebe0 con 0x7fb3a41009e0 2023-08-11T12:23:37.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.614+0000 7fb3ac7ff700 1 -- 172.21.15.8:0/458364049 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a4107f70 con 0x7fb3a41009e0 2023-08-11T12:23:37.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.616+0000 7fb39b7fe700 1 -- 172.21.15.8:0/458364049 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fb3a0021580 con 0x7fb3a41009e0 2023-08-11T12:23:37.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.617+0000 7fb39b7fe700 1 --2- 172.21.15.8:0/458364049 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb39009ff50 0x7fb3900a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:37.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.617+0000 7fb39b7fe700 1 -- 172.21.15.8:0/458364049 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb3a00cd090 con 0x7fb3a41009e0 2023-08-11T12:23:37.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.617+0000 7fb3a9d9a700 1 --2- 172.21.15.8:0/458364049 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb39009ff50 0x7fb3900a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:37.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.618+0000 7fb3a9d9a700 1 --2- 172.21.15.8:0/458364049 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb39009ff50 0x7fb3900a2410 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb394009c60 tx=0x7fb394009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:37.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.619+0000 7fb39b7fe700 1 -- 172.21.15.8:0/458364049 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fb3a0096b40 con 0x7fb3a41009e0 2023-08-11T12:23:37.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.878+0000 7fb3ac7ff700 1 -- 172.21.15.8:0/458364049 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3a410c490 con 0x7fb3a41009e0 2023-08-11T12:23:37.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.879+0000 7fb39b7fe700 1 -- 172.21.15.8:0/458364049 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11351 (secure 0 0 0) 0x7fb3a009a160 con 0x7fb3a41009e0 2023-08-11T12:23:37.882 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:23:37.882 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14469,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2854286216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2854286216},{"type":"v1","addr":"172.21.15.8:6835","nonce":2854286216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/805368621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":805368621},{"type":"v1","addr":"172.21.15.8:6837","nonce":805368621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-11T12:22:03.398475+0000","modified":"2023-08-11T12:22:32.690553+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24575,"mds_1":24550,"mds_2":24517,"mds_3":24500,"mds_4":24464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14526":{"gid":14526,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/2990530720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":2990530720},{"type":"v1","addr":"172.21.15.8:6839","nonce":2990530720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14538":{"gid":14538,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6841/3589272762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":3589272762},{"type":"v1","addr":"172.21.15.8:6841","nonce":3589272762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6833/2043443402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2043443402},{"type":"v1","addr":"172.21.15.194:6833","nonce":2043443402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24464":{"gid":24464,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.45:6833/1208864615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1208864615},{"type":"v1","addr":"172.21.15.45:6833","nonce":1208864615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24500":{"gid":24500,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.45:6835/1776075470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1776075470},{"type":"v1","addr":"172.21.15.45:6835","nonce":1776075470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24517":{"gid":24517,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.194:6835/2457430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2457430285},{"type":"v1","addr":"172.21.15.194:6835","nonce":2457430285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24529":{"gid":24529,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/3072808560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":3072808560},{"type":"v1","addr":"172.21.15.194:6837","nonce":3072808560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/641549061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":641549061},{"type":"v1","addr":"172.21.15.45:6837","nonce":641549061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.194:6839/2174476491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":2174476491},{"type":"v1","addr":"172.21.15.194:6839","nonce":2174476491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6839/119684732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":119684732},{"type":"v1","addr":"172.21.15.45:6839","nonce":119684732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-11T12:23:37.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.883+0000 7fb3ac7ff700 1 -- 172.21.15.8:0/458364049 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb39009ff50 msgr2=0x7fb3900a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:37.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.883+0000 7fb3ac7ff700 1 --2- 172.21.15.8:0/458364049 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb39009ff50 0x7fb3900a2410 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb394009c60 tx=0x7fb394009260 comp rx=0 tx=0).stop 2023-08-11T12:23:37.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.883+0000 7fb3ac7ff700 1 -- 172.21.15.8:0/458364049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3a41009e0 msgr2=0x7fb3a41966f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:37.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.883+0000 7fb3ac7ff700 1 --2- 172.21.15.8:0/458364049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3a41009e0 0x7fb3a41966f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0004710 tx=0x7fb3a0009580 comp rx=0 tx=0).stop 2023-08-11T12:23:37.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.883+0000 7fb3ac7ff700 1 -- 172.21.15.8:0/458364049 shutdown_connections 2023-08-11T12:23:37.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.883+0000 7fb3ac7ff700 1 --2- 172.21.15.8:0/458364049 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb39009ff50 0x7fb3900a2410 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:37.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.883+0000 7fb3ac7ff700 1 --2- 172.21.15.8:0/458364049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3a4102570 0x7fb3a419dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:37.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.883+0000 7fb3ac7ff700 1 --2- 172.21.15.8:0/458364049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3a41009e0 0x7fb3a41966f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:37.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.883+0000 7fb3ac7ff700 1 --2- 172.21.15.8:0/458364049 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3a4101bd0 0x7fb3a4196c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:37.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.883+0000 7fb3ac7ff700 1 -- 172.21.15.8:0/458364049 >> 172.21.15.8:0/458364049 conn(0x7fb3a40fbf50 msgr2=0x7fb3a41050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:37.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.883+0000 7fb3ac7ff700 1 -- 172.21.15.8:0/458364049 shutdown_connections 2023-08-11T12:23:37.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:37.884+0000 7fb3ac7ff700 1 -- 172.21.15.8:0/458364049 wait complete. 2023-08-11T12:23:37.888 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 27 2023-08-11T12:23:37.916 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-11T12:23:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.118+0000 7fc951dff700 1 -- 172.21.15.8:0/2212002706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc94c073380 msgr2=0x7fc94c073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.118+0000 7fc951dff700 1 --2- 172.21.15.8:0/2212002706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc94c073380 0x7fc94c073800 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc940009990 tx=0x7fc940009ca0 comp rx=0 tx=0).stop 2023-08-11T12:23:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.118+0000 7fc951dff700 1 -- 172.21.15.8:0/2212002706 shutdown_connections 2023-08-11T12:23:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.118+0000 7fc951dff700 1 --2- 172.21.15.8:0/2212002706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc94c074960 0x7fc94c072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.118+0000 7fc951dff700 1 --2- 172.21.15.8:0/2212002706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc94c10cfb0 0x7fc94c10f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:38.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.118+0000 7fc951dff700 1 --2- 172.21.15.8:0/2212002706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc94c073380 0x7fc94c073800 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:38.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.118+0000 7fc951dff700 1 -- 172.21.15.8:0/2212002706 >> 172.21.15.8:0/2212002706 conn(0x7fc94c0fbf50 msgr2=0x7fc94c0fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:38.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.118+0000 7fc951dff700 1 -- 172.21.15.8:0/2212002706 shutdown_connections 2023-08-11T12:23:38.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.118+0000 7fc951dff700 1 -- 172.21.15.8:0/2212002706 wait complete. 2023-08-11T12:23:38.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.119+0000 7fc951dff700 1 Processor -- start 2023-08-11T12:23:38.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.119+0000 7fc951dff700 1 -- start start 2023-08-11T12:23:38.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.120+0000 7fc951dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc94c073380 0x7fc94c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:38.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.120+0000 7fc951dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc94c074960 0x7fc94c19d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:38.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.120+0000 7fc951dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc94c10cfb0 0x7fc94c1a42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:38.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.120+0000 7fc951dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c1a48c0 con 0x7fc94c074960 2023-08-11T12:23:38.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.120+0000 7fc951dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c1a4a00 con 0x7fc94c073380 2023-08-11T12:23:38.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.120+0000 7fc951dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c1a4b90 con 0x7fc94c10cfb0 2023-08-11T12:23:38.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.120+0000 7fc94affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc94c074960 0x7fc94c19d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:38.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.120+0000 7fc94affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc94c074960 0x7fc94c19d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51472/0 (socket says 172.21.15.8:51472) 2023-08-11T12:23:38.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.120+0000 7fc94b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc94c073380 0x7fc94c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:38.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.120+0000 7fc94affd700 1 -- 172.21.15.8:0/207445627 learned_addr learned my addr 172.21.15.8:0/207445627 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:38.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.120+0000 7fc94bfff700 1 --2- 172.21.15.8:0/207445627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc94c10cfb0 0x7fc94c1a42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:38.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.121+0000 7fc94affd700 1 -- 172.21.15.8:0/207445627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc94c10cfb0 msgr2=0x7fc94c1a42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:38.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.121+0000 7fc94affd700 1 --2- 172.21.15.8:0/207445627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc94c10cfb0 0x7fc94c1a42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:38.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.121+0000 7fc94affd700 1 -- 172.21.15.8:0/207445627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc94c073380 msgr2=0x7fc94c19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:38.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.121+0000 7fc94affd700 1 --2- 172.21.15.8:0/207445627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc94c073380 0x7fc94c19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:38.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.121+0000 7fc94affd700 1 -- 172.21.15.8:0/207445627 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9400095f0 con 0x7fc94c074960 2023-08-11T12:23:38.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.121+0000 7fc94affd700 1 --2- 172.21.15.8:0/207445627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc94c074960 0x7fc94c19d280 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc9400098e0 tx=0x7fc940004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:38.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.121+0000 7fc948ff9700 1 -- 172.21.15.8:0/207445627 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94001d070 con 0x7fc94c074960 2023-08-11T12:23:38.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.121+0000 7fc951dff700 1 -- 172.21.15.8:0/207445627 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc94c1a4e10 con 0x7fc94c074960 2023-08-11T12:23:38.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.121+0000 7fc948ff9700 1 -- 172.21.15.8:0/207445627 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc9400054f0 con 0x7fc94c074960 2023-08-11T12:23:38.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.121+0000 7fc948ff9700 1 -- 172.21.15.8:0/207445627 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc940004ca0 con 0x7fc94c074960 2023-08-11T12:23:38.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.121+0000 7fc951dff700 1 -- 172.21.15.8:0/207445627 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94c1a5180 con 0x7fc94c074960 2023-08-11T12:23:38.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.123+0000 7fc951dff700 1 -- 172.21.15.8:0/207445627 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94c102b00 con 0x7fc94c074960 2023-08-11T12:23:38.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.125+0000 7fc948ff9700 1 -- 172.21.15.8:0/207445627 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fc94000fc70 con 0x7fc94c074960 2023-08-11T12:23:38.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.126+0000 7fc948ff9700 1 --2- 172.21.15.8:0/207445627 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc93409ffd0 0x7fc9340a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:38.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.126+0000 7fc948ff9700 1 -- 172.21.15.8:0/207445627 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc9400cc840 con 0x7fc94c074960 2023-08-11T12:23:38.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.126+0000 7fc94b7fe700 1 --2- 172.21.15.8:0/207445627 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc93409ffd0 0x7fc9340a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:38.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.127+0000 7fc94b7fe700 1 --2- 172.21.15.8:0/207445627 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc93409ffd0 0x7fc9340a2490 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009c60 tx=0x7fc93c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:38.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.130+0000 7fc948ff9700 1 -- 172.21.15.8:0/207445627 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fc94005ac30 con 0x7fc94c074960 2023-08-11T12:23:38.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:37 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3171791170' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:23:38.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:37 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1342098483' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:23:38.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:37 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/458364049' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:23:38.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:37 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3171791170' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:23:38.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:37 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1342098483' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:23:38.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:37 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/458364049' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:23:38.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:37 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3171791170' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:23:38.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:37 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1342098483' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:23:38.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:37 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/458364049' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:23:38.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.341+0000 7fc951dff700 1 -- 172.21.15.8:0/207445627 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc94c112820 con 0x7fc94c074960 2023-08-11T12:23:38.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.342+0000 7fc948ff9700 1 -- 172.21.15.8:0/207445627 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24348 (secure 0 0 0) 0x7fc940096350 con 0x7fc94c074960 2023-08-11T12:23:38.346 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:23:38.346 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":89,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","created":"2023-08-11T12:14:28.341113+0000","modified":"2023-08-11T12:22:31.713248+0000","last_up_change":"2023-08-11T12:21:14.913735+0000","last_in_change":"2023-08-11T12:20:57.476558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-11T12:17:49.040758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-11T12:22:01.383296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-11T12:22:02.816329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-11T12:22:06.369375+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f903e393-7894-42d6-8b11-737ceef1f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6803","nonce":664104961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6805","nonce":664104961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6809","nonce":664104961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6807","nonce":664104961}]},"public_addr":"172.21.15.8:6803/664104961","cluster_addr":"172.21.15.8:6805/664104961","heartbeat_back_addr":"172.21.15.8:6809/664104961","heartbeat_front_addr":"172.21.15.8:6807/664104961","state":["exists","up"]},{"osd":1,"uuid":"1e988e5c-e78c-46d5-80a5-dff7ac38cbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6801","nonce":4187350703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6803","nonce":4187350703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6807","nonce":4187350703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6805","nonce":4187350703}]},"public_addr":"172.21.15.45:6801/4187350703","cluster_addr":"172.21.15.45:6803/4187350703","heartbeat_back_addr":"172.21.15.45:6807/4187350703","heartbeat_front_addr":"172.21.15.45:6805/4187350703","state":["exists","up"]},{"osd":2,"uuid":"1835217c-a93c-4181-b8b8-cc410bab1a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6801","nonce":2547818140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6803","nonce":2547818140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6807","nonce":2547818140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6805","nonce":2547818140}]},"public_addr":"172.21.15.194:6801/2547818140","cluster_addr":"172.21.15.194:6803/2547818140","heartbeat_back_addr":"172.21.15.194:6807/2547818140","heartbeat_front_addr":"172.21.15.194:6805/2547818140","state":["exists","up"]},{"osd":3,"uuid":"b55ae61a-731c-4312-a998-661122b84788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6811","nonce":187418883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6813","nonce":187418883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6817","nonce":187418883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6815","nonce":187418883}]},"public_addr":"172.21.15.8:6811/187418883","cluster_addr":"172.21.15.8:6813/187418883","heartbeat_back_addr":"172.21.15.8:6817/187418883","heartbeat_front_addr":"172.21.15.8:6815/187418883","state":["exists","up"]},{"osd":4,"uuid":"2c28acbb-e807-4559-8aa2-a35ca84b5d43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6809","nonce":3099704571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6811","nonce":3099704571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6815","nonce":3099704571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6813","nonce":3099704571}]},"public_addr":"172.21.15.45:6809/3099704571","cluster_addr":"172.21.15.45:6811/3099704571","heartbeat_back_addr":"172.21.15.45:6815/3099704571","heartbeat_front_addr":"172.21.15.45:6813/3099704571","state":["exists","up"]},{"osd":5,"uuid":"37032289-8016-4730-9b69-f7985e058ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6809","nonce":263803874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6811","nonce":263803874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6815","nonce":263803874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6813","nonce":263803874}]},"public_addr":"172.21.15.194:6809/263803874","cluster_addr":"172.21.15.194:6811/263803874","heartbeat_back_addr":"172.21.15.194:6815/263803874","heartbeat_front_addr":"172.21.15.194:6813/263803874","state":["exists","up"]},{"osd":6,"uuid":"32d2dab9-6944-40d1-ada9-4f941821b063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6819","nonce":1802966829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6821","nonce":1802966829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6825","nonce":1802966829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6823","nonce":1802966829}]},"public_addr":"172.21.15.8:6819/1802966829","cluster_addr":"172.21.15.8:6821/1802966829","heartbeat_back_addr":"172.21.15.8:6825/1802966829","heartbeat_front_addr":"172.21.15.8:6823/1802966829","state":["exists","up"]},{"osd":7,"uuid":"086aff58-1554-49fe-92ff-5166b115aeef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6817","nonce":3715737148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6819","nonce":3715737148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6823","nonce":3715737148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6821","nonce":3715737148}]},"public_addr":"172.21.15.45:6817/3715737148","cluster_addr":"172.21.15.45:6819/3715737148","heartbeat_back_addr":"172.21.15.45:6823/3715737148","heartbeat_front_addr":"172.21.15.45:6821/3715737148","state":["exists","up"]},{"osd":8,"uuid":"7fff5e95-2453-4ea6-a5c1-3bba6a1f6400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6817","nonce":57497127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6819","nonce":57497127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6823","nonce":57497127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6821","nonce":57497127}]},"public_addr":"172.21.15.194:6817/57497127","cluster_addr":"172.21.15.194:6819/57497127","heartbeat_back_addr":"172.21.15.194:6823/57497127","heartbeat_front_addr":"172.21.15.194:6821/57497127","state":["exists","up"]},{"osd":9,"uuid":"31ab0121-4c92-42ec-9f19-e672062e8814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6827","nonce":434661930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6829","nonce":434661930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6833","nonce":434661930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6831","nonce":434661930}]},"public_addr":"172.21.15.8:6827/434661930","cluster_addr":"172.21.15.8:6829/434661930","heartbeat_back_addr":"172.21.15.8:6833/434661930","heartbeat_front_addr":"172.21.15.8:6831/434661930","state":["exists","up"]},{"osd":10,"uuid":"62c632e4-94f6-4630-9d94-8d28fccacf45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6825","nonce":3281212184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6827","nonce":3281212184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6831","nonce":3281212184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6829","nonce":3281212184}]},"public_addr":"172.21.15.45:6825/3281212184","cluster_addr":"172.21.15.45:6827/3281212184","heartbeat_back_addr":"172.21.15.45:6831/3281212184","heartbeat_front_addr":"172.21.15.45:6829/3281212184","state":["exists","up"]},{"osd":11,"uuid":"8ca4a80d-cd75-4230-b46d-aef6fdc03e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6825","nonce":1637875895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6827","nonce":1637875895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6831","nonce":1637875895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6829","nonce":1637875895}]},"public_addr":"172.21.15.194:6825/1637875895","cluster_addr":"172.21.15.194:6827/1637875895","heartbeat_back_addr":"172.21.15.194:6831/1637875895","heartbeat_front_addr":"172.21.15.194:6829/1637875895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:04.255616+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:26.243863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:46.630365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:12.926291+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:35.747049+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:55.793767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:21.685725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:43.703215+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:04.043674+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:30.320026+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:52.751974+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:21:13.230024+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/2000592056":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2102228072":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2374527928":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2928221278":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2744750874":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/3681755887":"2023-08-12T12:15:02.528403+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-11T12:23:38.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.345+0000 7fc951dff700 1 -- 172.21.15.8:0/207445627 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc93409ffd0 msgr2=0x7fc9340a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:38.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.345+0000 7fc951dff700 1 --2- 172.21.15.8:0/207445627 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc93409ffd0 0x7fc9340a2490 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009c60 tx=0x7fc93c009260 comp rx=0 tx=0).stop 2023-08-11T12:23:38.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.345+0000 7fc951dff700 1 -- 172.21.15.8:0/207445627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc94c074960 msgr2=0x7fc94c19d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:38.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.345+0000 7fc951dff700 1 --2- 172.21.15.8:0/207445627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc94c074960 0x7fc94c19d280 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc9400098e0 tx=0x7fc940004730 comp rx=0 tx=0).stop 2023-08-11T12:23:38.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.345+0000 7fc951dff700 1 -- 172.21.15.8:0/207445627 shutdown_connections 2023-08-11T12:23:38.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.345+0000 7fc951dff700 1 --2- 172.21.15.8:0/207445627 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc93409ffd0 0x7fc9340a2490 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:38.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.345+0000 7fc951dff700 1 --2- 172.21.15.8:0/207445627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc94c10cfb0 0x7fc94c1a42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:38.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.345+0000 7fc951dff700 1 --2- 172.21.15.8:0/207445627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc94c073380 0x7fc94c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:38.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.345+0000 7fc951dff700 1 --2- 172.21.15.8:0/207445627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc94c074960 0x7fc94c19d280 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:38.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.345+0000 7fc951dff700 1 -- 172.21.15.8:0/207445627 >> 172.21.15.8:0/207445627 conn(0x7fc94c0fbf50 msgr2=0x7fc94c0fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:38.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.345+0000 7fc951dff700 1 -- 172.21.15.8:0/207445627 shutdown_connections 2023-08-11T12:23:38.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.345+0000 7fc951dff700 1 -- 172.21.15.8:0/207445627 wait complete. 2023-08-11T12:23:38.369 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-11T12:23:38.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.571+0000 7ff89e9ff700 1 -- 172.21.15.8:0/3564801651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff898073380 msgr2=0x7ff898073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:38.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.571+0000 7ff89e9ff700 1 --2- 172.21.15.8:0/3564801651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff898073380 0x7ff898073800 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff88c0098f0 tx=0x7ff88c009c00 comp rx=0 tx=0).stop 2023-08-11T12:23:38.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.571+0000 7ff89e9ff700 1 -- 172.21.15.8:0/3564801651 shutdown_connections 2023-08-11T12:23:38.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.571+0000 7ff89e9ff700 1 --2- 172.21.15.8:0/3564801651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff898074960 0x7ff898072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:38.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.571+0000 7ff89e9ff700 1 --2- 172.21.15.8:0/3564801651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff89810cfc0 0x7ff89810f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:38.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.571+0000 7ff89e9ff700 1 --2- 172.21.15.8:0/3564801651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff898073380 0x7ff898073800 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:38.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.571+0000 7ff89e9ff700 1 -- 172.21.15.8:0/3564801651 >> 172.21.15.8:0/3564801651 conn(0x7ff8980fbf80 msgr2=0x7ff8980fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:38.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.571+0000 7ff89e9ff700 1 -- 172.21.15.8:0/3564801651 shutdown_connections 2023-08-11T12:23:38.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.571+0000 7ff89e9ff700 1 -- 172.21.15.8:0/3564801651 wait complete. 2023-08-11T12:23:38.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.572+0000 7ff89e9ff700 1 Processor -- start 2023-08-11T12:23:38.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.573+0000 7ff89e9ff700 1 -- start start 2023-08-11T12:23:38.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.573+0000 7ff89e9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff898073380 0x7ff89819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:38.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.573+0000 7ff89e9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff898074960 0x7ff89819d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:38.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.573+0000 7ff89e9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff89810cfc0 0x7ff8981a42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:38.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.573+0000 7ff89e9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8981a4870 con 0x7ff89810cfc0 2023-08-11T12:23:38.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.573+0000 7ff89e9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8981a49e0 con 0x7ff898073380 2023-08-11T12:23:38.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.573+0000 7ff89e9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8981a4ba0 con 0x7ff898074960 2023-08-11T12:23:38.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.573+0000 7ff897fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff898073380 0x7ff89819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:38.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.573+0000 7ff897fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff898073380 0x7ff89819cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:60296/0 (socket says 172.21.15.8:60296) 2023-08-11T12:23:38.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.573+0000 7ff897fff700 1 -- 172.21.15.8:0/91955477 learned_addr learned my addr 172.21.15.8:0/91955477 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:38.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.573+0000 7ff89cf9c700 1 --2- 172.21.15.8:0/91955477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff89810cfc0 0x7ff8981a42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:38.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.573+0000 7ff8977fe700 1 --2- 172.21.15.8:0/91955477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff898074960 0x7ff89819d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:38.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.574+0000 7ff897fff700 1 -- 172.21.15.8:0/91955477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff898074960 msgr2=0x7ff89819d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:38.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.574+0000 7ff897fff700 1 --2- 172.21.15.8:0/91955477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff898074960 0x7ff89819d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:38.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.574+0000 7ff897fff700 1 -- 172.21.15.8:0/91955477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff89810cfc0 msgr2=0x7ff8981a42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:38.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.574+0000 7ff897fff700 1 --2- 172.21.15.8:0/91955477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff89810cfc0 0x7ff8981a42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:38.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.574+0000 7ff897fff700 1 -- 172.21.15.8:0/91955477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff890009d00 con 0x7ff898073380 2023-08-11T12:23:38.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.574+0000 7ff897fff700 1 --2- 172.21.15.8:0/91955477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff898073380 0x7ff89819cd30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff88800e9a0 tx=0x7ff88800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:38.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.574+0000 7ff8957fa700 1 -- 172.21.15.8:0/91955477 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff888009790 con 0x7ff898073380 2023-08-11T12:23:38.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.574+0000 7ff89e9ff700 1 -- 172.21.15.8:0/91955477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff88c009520 con 0x7ff898073380 2023-08-11T12:23:38.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.574+0000 7ff8957fa700 1 -- 172.21.15.8:0/91955477 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff888010430 con 0x7ff898073380 2023-08-11T12:23:38.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.574+0000 7ff8957fa700 1 -- 172.21.15.8:0/91955477 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff888018680 con 0x7ff898073380 2023-08-11T12:23:38.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.574+0000 7ff89e9ff700 1 -- 172.21.15.8:0/91955477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8981a51b0 con 0x7ff898073380 2023-08-11T12:23:38.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.575+0000 7ff89e9ff700 1 -- 172.21.15.8:0/91955477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff898102b10 con 0x7ff898073380 2023-08-11T12:23:38.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.578+0000 7ff8957fa700 1 -- 172.21.15.8:0/91955477 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7ff8880105a0 con 0x7ff898073380 2023-08-11T12:23:38.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.579+0000 7ff8957fa700 1 --2- 172.21.15.8:0/91955477 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff88009ff50 0x7ff8800a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:38.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.579+0000 7ff8957fa700 1 -- 172.21.15.8:0/91955477 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7ff888014070 con 0x7ff898073380 2023-08-11T12:23:38.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.579+0000 7ff8977fe700 1 --2- 172.21.15.8:0/91955477 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff88009ff50 0x7ff8800a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:38.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.580+0000 7ff8977fe700 1 --2- 172.21.15.8:0/91955477 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff88009ff50 0x7ff8800a2410 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff88c0098c0 tx=0x7ff88c019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:38.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.581+0000 7ff8957fa700 1 -- 172.21.15.8:0/91955477 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7ff8880953a0 con 0x7ff898073380 2023-08-11T12:23:38.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.844+0000 7ff89e9ff700 1 -- 172.21.15.8:0/91955477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8981127e0 con 0x7ff898073380 2023-08-11T12:23:38.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.845+0000 7ff8957fa700 1 -- 172.21.15.8:0/91955477 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11351 (secure 0 0 0) 0x7ff8880989c0 con 0x7ff898073380 2023-08-11T12:23:38.850 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:23:38.850 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14469,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2854286216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2854286216},{"type":"v1","addr":"172.21.15.8:6835","nonce":2854286216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/805368621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":805368621},{"type":"v1","addr":"172.21.15.8:6837","nonce":805368621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-11T12:22:03.398475+0000","modified":"2023-08-11T12:22:32.690553+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24575,"mds_1":24550,"mds_2":24517,"mds_3":24500,"mds_4":24464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14526":{"gid":14526,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/2990530720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":2990530720},{"type":"v1","addr":"172.21.15.8:6839","nonce":2990530720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14538":{"gid":14538,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6841/3589272762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":3589272762},{"type":"v1","addr":"172.21.15.8:6841","nonce":3589272762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6833/2043443402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2043443402},{"type":"v1","addr":"172.21.15.194:6833","nonce":2043443402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24464":{"gid":24464,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.45:6833/1208864615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1208864615},{"type":"v1","addr":"172.21.15.45:6833","nonce":1208864615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24500":{"gid":24500,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.45:6835/1776075470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1776075470},{"type":"v1","addr":"172.21.15.45:6835","nonce":1776075470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24517":{"gid":24517,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.194:6835/2457430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2457430285},{"type":"v1","addr":"172.21.15.194:6835","nonce":2457430285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24529":{"gid":24529,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/3072808560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":3072808560},{"type":"v1","addr":"172.21.15.194:6837","nonce":3072808560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/641549061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":641549061},{"type":"v1","addr":"172.21.15.45:6837","nonce":641549061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.194:6839/2174476491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":2174476491},{"type":"v1","addr":"172.21.15.194:6839","nonce":2174476491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6839/119684732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":119684732},{"type":"v1","addr":"172.21.15.45:6839","nonce":119684732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-11T12:23:38.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.848+0000 7ff89e9ff700 1 -- 172.21.15.8:0/91955477 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff88009ff50 msgr2=0x7ff8800a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:38.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.848+0000 7ff89e9ff700 1 --2- 172.21.15.8:0/91955477 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff88009ff50 0x7ff8800a2410 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff88c0098c0 tx=0x7ff88c019040 comp rx=0 tx=0).stop 2023-08-11T12:23:38.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.848+0000 7ff89e9ff700 1 -- 172.21.15.8:0/91955477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff898073380 msgr2=0x7ff89819cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:38.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.848+0000 7ff89e9ff700 1 --2- 172.21.15.8:0/91955477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff898073380 0x7ff89819cd30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff88800e9a0 tx=0x7ff88800ecb0 comp rx=0 tx=0).stop 2023-08-11T12:23:38.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.848+0000 7ff89e9ff700 1 -- 172.21.15.8:0/91955477 shutdown_connections 2023-08-11T12:23:38.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.848+0000 7ff89e9ff700 1 --2- 172.21.15.8:0/91955477 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7ff88009ff50 0x7ff8800a2410 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:38.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.848+0000 7ff89e9ff700 1 --2- 172.21.15.8:0/91955477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff89810cfc0 0x7ff8981a42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:38.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.848+0000 7ff89e9ff700 1 --2- 172.21.15.8:0/91955477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff898073380 0x7ff89819cd30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:38.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.848+0000 7ff89e9ff700 1 --2- 172.21.15.8:0/91955477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff898074960 0x7ff89819d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:38.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.848+0000 7ff89e9ff700 1 -- 172.21.15.8:0/91955477 >> 172.21.15.8:0/91955477 conn(0x7ff8980fbf80 msgr2=0x7ff8980fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:38.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.848+0000 7ff89e9ff700 1 -- 172.21.15.8:0/91955477 shutdown_connections 2023-08-11T12:23:38.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:38.848+0000 7ff89e9ff700 1 -- 172.21.15.8:0/91955477 wait complete. 2023-08-11T12:23:38.856 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 27 2023-08-11T12:23:38.872 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-08-11T12:22:03.398475+0000', 'modified': '2023-08-11T12:22:32.690553+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24575, 'mds_1': 24550, 'mds_2': 24517, 'mds_3': 24500, 'mds_4': 24464}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14526': {'gid': 14526, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.8:6839/2990530720', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6838', 'nonce': 2990530720}, {'type': 'v1', 'addr': '172.21.15.8:6839', 'nonce': 2990530720}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14538': {'gid': 14538, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.8:6841/3589272762', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6840', 'nonce': 3589272762}, {'type': 'v1', 'addr': '172.21.15.8:6841', 'nonce': 3589272762}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24457': {'gid': 24457, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.194:6833/2043443402', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6832', 'nonce': 2043443402}, {'type': 'v1', 'addr': '172.21.15.194:6833', 'nonce': 2043443402}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24464': {'gid': 24464, 'name': 'k', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.45:6833/1208864615', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6832', 'nonce': 1208864615}, {'type': 'v1', 'addr': '172.21.15.45:6833', 'nonce': 1208864615}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24500': {'gid': 24500, 'name': 'e', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.45:6835/1776075470', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6834', 'nonce': 1776075470}, {'type': 'v1', 'addr': '172.21.15.45:6835', 'nonce': 1776075470}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24517': {'gid': 24517, 'name': 'f', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.194:6835/2457430285', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6834', 'nonce': 2457430285}, {'type': 'v1', 'addr': '172.21.15.194:6835', 'nonce': 2457430285}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24529': {'gid': 24529, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.194:6837/3072808560', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6836', 'nonce': 3072808560}, {'type': 'v1', 'addr': '172.21.15.194:6837', 'nonce': 3072808560}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24533': {'gid': 24533, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.45:6837/641549061', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6836', 'nonce': 641549061}, {'type': 'v1', 'addr': '172.21.15.45:6837', 'nonce': 641549061}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24550': {'gid': 24550, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.194:6839/2174476491', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6838', 'nonce': 2174476491}, {'type': 'v1', 'addr': '172.21.15.194:6839', 'nonce': 2174476491}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24575': {'gid': 24575, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6839/119684732', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6838', 'nonce': 119684732}, {'type': 'v1', 'addr': '172.21.15.45:6839', 'nonce': 119684732}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-11T12:23:38.873 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-08-11T12:23:38.874 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.k status 2023-08-11T12:23:39.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.079+0000 7f6f5fbff700 1 -- 172.21.15.8:0/171080889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f580ff260 msgr2=0x7f6f58101690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.079+0000 7f6f5fbff700 1 --2- 172.21.15.8:0/171080889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f580ff260 0x7f6f58101690 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6f54009990 tx=0x7f6f54009ca0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.079+0000 7f6f5fbff700 1 -- 172.21.15.8:0/171080889 shutdown_connections 2023-08-11T12:23:39.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.079+0000 7f6f5fbff700 1 --2- 172.21.15.8:0/171080889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f581045a0 0x7f6f58104a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.079+0000 7f6f5fbff700 1 --2- 172.21.15.8:0/171080889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f580ff260 0x7f6f58101690 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.079+0000 7f6f5fbff700 1 --2- 172.21.15.8:0/171080889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f58101bd0 0x7f6f58104060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.079+0000 7f6f5fbff700 1 -- 172.21.15.8:0/171080889 >> 172.21.15.8:0/171080889 conn(0x7f6f580faea0 msgr2=0x7f6f580fd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:39.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.079+0000 7f6f5fbff700 1 -- 172.21.15.8:0/171080889 shutdown_connections 2023-08-11T12:23:39.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.079+0000 7f6f5fbff700 1 -- 172.21.15.8:0/171080889 wait complete. 2023-08-11T12:23:39.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.080+0000 7f6f5fbff700 1 Processor -- start 2023-08-11T12:23:39.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.081+0000 7f6f5fbff700 1 -- start start 2023-08-11T12:23:39.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.081+0000 7f6f5fbff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f580ff260 0x7f6f5819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.081+0000 7f6f5fbff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f58101bd0 0x7f6f5819d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.081+0000 7f6f5fbff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f581045a0 0x7f6f581a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.081+0000 7f6f5fbff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f581a4810 con 0x7f6f581045a0 2023-08-11T12:23:39.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.081+0000 7f6f5fbff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f581a4980 con 0x7f6f58101bd0 2023-08-11T12:23:39.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.081+0000 7f6f5fbff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f581a4b40 con 0x7f6f580ff260 2023-08-11T12:23:39.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.081+0000 7f6f5d19a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f58101bd0 0x7f6f5819d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.081+0000 7f6f5e19c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f581045a0 0x7f6f581a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.081+0000 7f6f5d19a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f58101bd0 0x7f6f5819d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:60312/0 (socket says 172.21.15.8:60312) 2023-08-11T12:23:39.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.081+0000 7f6f5d19a700 1 -- 172.21.15.8:0/1595681437 learned_addr learned my addr 172.21.15.8:0/1595681437 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:39.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.081+0000 7f6f5d99b700 1 --2- 172.21.15.8:0/1595681437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f580ff260 0x7f6f5819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.082+0000 7f6f5e19c700 1 -- 172.21.15.8:0/1595681437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f580ff260 msgr2=0x7f6f5819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.082+0000 7f6f5e19c700 1 --2- 172.21.15.8:0/1595681437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f580ff260 0x7f6f5819cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.082+0000 7f6f5e19c700 1 -- 172.21.15.8:0/1595681437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f58101bd0 msgr2=0x7f6f5819d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.082+0000 7f6f5e19c700 1 --2- 172.21.15.8:0/1595681437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f58101bd0 0x7f6f5819d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.082+0000 7f6f5e19c700 1 -- 172.21.15.8:0/1595681437 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f540095f0 con 0x7f6f581045a0 2023-08-11T12:23:39.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.082+0000 7f6f5d19a700 1 --2- 172.21.15.8:0/1595681437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f58101bd0 0x7f6f5819d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:39.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.082+0000 7f6f5e19c700 1 --2- 172.21.15.8:0/1595681437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f581045a0 0x7f6f581a4240 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000efc0 tx=0x7f6f5000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:39.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.082+0000 7f6f4effd700 1 -- 172.21.15.8:0/1595681437 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f50018070 con 0x7f6f581045a0 2023-08-11T12:23:39.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.082+0000 7f6f4effd700 1 -- 172.21.15.8:0/1595681437 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6f5000f040 con 0x7f6f581045a0 2023-08-11T12:23:39.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.082+0000 7f6f5fbff700 1 -- 172.21.15.8:0/1595681437 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f581a4dc0 con 0x7f6f581045a0 2023-08-11T12:23:39.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.082+0000 7f6f4effd700 1 -- 172.21.15.8:0/1595681437 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5000cd40 con 0x7f6f581045a0 2023-08-11T12:23:39.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.082+0000 7f6f5fbff700 1 -- 172.21.15.8:0/1595681437 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f581a5220 con 0x7f6f581045a0 2023-08-11T12:23:39.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.085+0000 7f6f4effd700 1 -- 172.21.15.8:0/1595681437 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f6f50003a00 con 0x7f6f581045a0 2023-08-11T12:23:39.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.087+0000 7f6f73490b80 1 Processor -- start 2023-08-11T12:23:39.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.088+0000 7f6f73490b80 1 -- start start 2023-08-11T12:23:39.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.088+0000 7f6f4effd700 1 --2- 172.21.15.8:0/1595681437 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6f4409ff50 0x7f6f440a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.088+0000 7f6f73490b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b59bc38a80 0x55b59bc38ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.088+0000 7f6f73490b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b59bc393e0 0x55b59bc39860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.088+0000 7f6f73490b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b59bc39da0 0x55b59bc3a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.088+0000 7f6f73490b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b59bb915e0 con 0x55b59bc38a80 2023-08-11T12:23:39.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.088+0000 7f6f73490b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b59bb8ef00 con 0x55b59bc39da0 2023-08-11T12:23:39.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.088+0000 7f6f73490b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b59bb8a7f0 con 0x55b59bc393e0 2023-08-11T12:23:39.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.088+0000 7f6f4effd700 1 -- 172.21.15.8:0/1595681437 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f6f500cb180 con 0x7f6f581045a0 2023-08-11T12:23:39.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.088+0000 7f6f5d99b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b59bc38a80 0x55b59bc38ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.088+0000 7f6f5d99b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b59bc38a80 0x55b59bc38ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51520/0 (socket says 172.21.15.8:51520) 2023-08-11T12:23:39.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.088+0000 7f6f5d99b700 1 -- 172.21.15.8:0/1385813192 learned_addr learned my addr 172.21.15.8:0/1385813192 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:39.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.088+0000 7f6f5d19a700 1 --2- 172.21.15.8:0/1595681437 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6f4409ff50 0x7f6f440a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.089+0000 7f6f5e19c700 1 --2- 172.21.15.8:0/1385813192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b59bc39da0 0x55b59bc3a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.089+0000 7f6f5d19a700 1 --2- 172.21.15.8:0/1385813192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b59bc393e0 0x55b59bc39860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.089+0000 7f6f5d99b700 1 -- 172.21.15.8:0/1385813192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b59bc393e0 msgr2=0x55b59bc39860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.089+0000 7f6f5d99b700 1 --2- 172.21.15.8:0/1385813192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b59bc393e0 0x55b59bc39860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.089+0000 7f6f5d99b700 1 -- 172.21.15.8:0/1385813192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b59bc39da0 msgr2=0x55b59bc3a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.089+0000 7f6f5d99b700 1 --2- 172.21.15.8:0/1385813192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b59bc39da0 0x55b59bc3a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.089+0000 7f6f5d99b700 1 -- 172.21.15.8:0/1385813192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b59ba0a5e0 con 0x55b59bc38a80 2023-08-11T12:23:39.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.089+0000 7f6f5d99b700 1 --2- 172.21.15.8:0/1385813192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b59bc38a80 0x55b59bc38ea0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6f54009990 tx=0x7f6f54005ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7e50a633cb5438 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:39.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.089+0000 7f6f5d19a700 1 --2- 172.21.15.8:0/1595681437 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6f4409ff50 0x7f6f440a2410 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6f480096b0 tx=0x7f6f480095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:39.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.090+0000 7f6f43fff700 1 -- 172.21.15.8:0/1385813192 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5401d070 con 0x55b59bc38a80 2023-08-11T12:23:39.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.090+0000 7f6f43fff700 1 -- 172.21.15.8:0/1385813192 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6f5401e040 con 0x55b59bc38a80 2023-08-11T12:23:39.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.090+0000 7f6f43fff700 1 -- 172.21.15.8:0/1385813192 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f54004920 con 0x55b59bc38a80 2023-08-11T12:23:39.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.090+0000 7f6f73490b80 1 -- 172.21.15.8:0/1385813192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b59bc38a80 msgr2=0x55b59bc38ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.090+0000 7f6f73490b80 1 --2- 172.21.15.8:0/1385813192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b59bc38a80 0x55b59bc38ea0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6f54009990 tx=0x7f6f54005ec0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.090+0000 7f6f73490b80 1 -- 172.21.15.8:0/1385813192 shutdown_connections 2023-08-11T12:23:39.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.090+0000 7f6f73490b80 1 --2- 172.21.15.8:0/1385813192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b59bc39da0 0x55b59bc3a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.090+0000 7f6f73490b80 1 --2- 172.21.15.8:0/1385813192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b59bc38a80 0x55b59bc38ea0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.090+0000 7f6f73490b80 1 --2- 172.21.15.8:0/1385813192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b59bc393e0 0x55b59bc39860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.090+0000 7f6f73490b80 1 -- 172.21.15.8:0/1385813192 >> 172.21.15.8:0/1385813192 conn(0x55b59bb65900 msgr2=0x55b59bc333d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:39.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.091+0000 7f6f73490b80 1 -- 172.21.15.8:0/1385813192 shutdown_connections 2023-08-11T12:23:39.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.091+0000 7f6f73490b80 1 -- 172.21.15.8:0/1385813192 wait complete. 2023-08-11T12:23:39.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.091+0000 7f6f73490b80 1 -- start start 2023-08-11T12:23:39.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.091+0000 7f6f73490b80 1 Processor -- start 2023-08-11T12:23:39.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.092+0000 7f6f73490b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b59bc38a80 0x55b59bc42010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.092+0000 7f6f73490b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b59bc393e0 0x55b59bc42550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.092+0000 7f6f73490b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b59bc39da0 0x55b59bc49590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.092+0000 7f6f73490b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b59bb28a70 con 0x55b59bc393e0 2023-08-11T12:23:39.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.092+0000 7f6f73490b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b59bb28770 con 0x55b59bc38a80 2023-08-11T12:23:39.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.092+0000 7f6f73490b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b59ba0c8d0 con 0x55b59bc39da0 2023-08-11T12:23:39.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.092+0000 7f6f73490b80 10 client.0 _ll_register_callbacks cb 0x55b59bb2ba60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:23:39.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.092+0000 7f6f5d19a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b59bc393e0 0x55b59bc42550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.092+0000 7f6f5d19a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b59bc393e0 0x55b59bc42550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51532/0 (socket says 172.21.15.8:51532) 2023-08-11T12:23:39.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.092+0000 7f6f5d19a700 1 -- 172.21.15.8:0/1031531491 learned_addr learned my addr 172.21.15.8:0/1031531491 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:39.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.092+0000 7f6f5d99b700 1 --2- 172.21.15.8:0/1031531491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b59bc38a80 0x55b59bc42010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.092+0000 7f6f5e19c700 1 --2- 172.21.15.8:0/1031531491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b59bc39da0 0x55b59bc49590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.092+0000 7f6f5d19a700 1 -- 172.21.15.8:0/1031531491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b59bc39da0 msgr2=0x55b59bc49590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.092+0000 7f6f5d19a700 1 --2- 172.21.15.8:0/1031531491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b59bc39da0 0x55b59bc49590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.092+0000 7f6f5d19a700 1 -- 172.21.15.8:0/1031531491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b59bc38a80 msgr2=0x55b59bc42010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.092+0000 7f6f5d19a700 1 --2- 172.21.15.8:0/1031531491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b59bc38a80 0x55b59bc42010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.092+0000 7f6f5d19a700 1 -- 172.21.15.8:0/1031531491 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f58105550 con 0x55b59bc393e0 2023-08-11T12:23:39.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.093+0000 7f6f5d19a700 1 --2- 172.21.15.8:0/1031531491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b59bc393e0 0x55b59bc42550 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6f480216c0 tx=0x7f6f480047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb437025a3e5b0db server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:39.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.093+0000 7f6f417fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:23:39.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.093+0000 7f6f417fa700 1 -- 172.21.15.8:0/1031531491 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4800fee0 con 0x55b59bc393e0 2023-08-11T12:23:39.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.093+0000 7f6f73490b80 1 -- 172.21.15.8:0/1031531491 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b59bc2ba40 con 0x55b59bc393e0 2023-08-11T12:23:39.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.093+0000 7f6f417fa700 1 -- 172.21.15.8:0/1031531491 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f6f48004830 con 0x55b59bc393e0 2023-08-11T12:23:39.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.093+0000 7f6f417fa700 1 -- 172.21.15.8:0/1031531491 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f48010a10 con 0x55b59bc393e0 2023-08-11T12:23:39.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.093+0000 7f6f73490b80 10 client.15105 fetch_fsmap learned FSMap version 27 2023-08-11T12:23:39.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.093+0000 7f6f73490b80 1 -- 172.21.15.8:0/1031531491 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b59b9b6d90 con 0x55b59bc393e0 2023-08-11T12:23:39.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.094+0000 7f6f417fa700 1 -- 172.21.15.8:0/1031531491 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b59bc2ba40 con 0x55b59bc393e0 2023-08-11T12:23:39.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.094+0000 7f6f417fa700 1 -- 172.21.15.8:0/1031531491 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6f48029630 con 0x55b59bc393e0 2023-08-11T12:23:39.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.094+0000 7f6f73490b80 10 client.15105 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:23:39.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.094+0000 7f6f73490b80 10 client.15105 resolve_mds: resolved name 'k' to daemon mds.k 2023-08-11T12:23:39.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.094+0000 7f6f73490b80 20 client.15105 populate_metadata read hostname 'smithi008' 2023-08-11T12:23:39.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.094+0000 7f6f73490b80 1 --2- 172.21.15.8:0/1031531491 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x55b59bc4dcb0 0x55b59bc4c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.094+0000 7f6f73490b80 4 client.15105 mds_command: new command op to 24464 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:23:39.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.094+0000 7f6f73490b80 1 -- 172.21.15.8:0/1031531491 --> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b59bc07490 con 0x55b59bc4dcb0 2023-08-11T12:23:39.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.094+0000 7f6f5d99b700 1 --2- 172.21.15.8:0/1031531491 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x55b59bc4dcb0 0x55b59bc4c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.095+0000 7f6f417fa700 10 client.15105 ms_handle_connect on v2:172.21.15.45:6832/1208864615 2023-08-11T12:23:39.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.095+0000 7f6f5d99b700 1 --2- 172.21.15.8:0/1031531491 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x55b59bc4dcb0 0x55b59bc4c6f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d7150b5770e67ae7 server_cookie=b534ee7df75a317c in_seq=0 out_seq=0 2023-08-11T12:23:39.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.096+0000 7f6f417fa700 1 -- 172.21.15.8:0/1031531491 <== mds.4 v2:172.21.15.45:6832/1208864615 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55b59bc07490 con 0x55b59bc4dcb0 2023-08-11T12:23:39.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.096+0000 7f6f417fa700 10 client.15105 handle_command_reply: tid=0 2023-08-11T12:23:39.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.096+0000 7f6f73490b80 1 client.15105 shutdown 2023-08-11T12:23:39.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.096+0000 7f6f73490b80 1 -- 172.21.15.8:0/1031531491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b59bc393e0 msgr2=0x55b59bc42550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.096+0000 7f6f73490b80 1 --2- 172.21.15.8:0/1031531491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b59bc393e0 0x55b59bc42550 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6f480216c0 tx=0x7f6f480047c0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.096+0000 7f6f73490b80 1 -- 172.21.15.8:0/1031531491 shutdown_connections 2023-08-11T12:23:39.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.096+0000 7f6f73490b80 1 --2- 172.21.15.8:0/1031531491 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x55b59bc4dcb0 0x55b59bc4c6f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.096+0000 7f6f73490b80 1 --2- 172.21.15.8:0/1031531491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b59bc39da0 0x55b59bc49590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.096+0000 7f6f73490b80 1 --2- 172.21.15.8:0/1031531491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b59bc38a80 0x55b59bc42010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.096+0000 7f6f73490b80 1 --2- 172.21.15.8:0/1031531491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b59bc393e0 0x55b59bc42550 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.096+0000 7f6f73490b80 1 -- 172.21.15.8:0/1031531491 >> 172.21.15.8:0/1031531491 conn(0x55b59bb65900 msgr2=0x55b59bc2dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:39.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.096+0000 7f6f417fa700 0 client.15105 ms_handle_reset on v2:172.21.15.45:6832/1208864615 2023-08-11T12:23:39.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.096+0000 7f6f73490b80 1 -- 172.21.15.8:0/1031531491 shutdown_connections 2023-08-11T12:23:39.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.096+0000 7f6f73490b80 1 -- 172.21.15.8:0/1031531491 wait complete. 2023-08-11T12:23:39.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.097+0000 7f6f73490b80 20 client.15105 trim_cache size 0 max 16384 2023-08-11T12:23:39.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.115+0000 7f6f73490b80 1 Processor -- start 2023-08-11T12:23:39.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.115+0000 7f6f73490b80 1 -- start start 2023-08-11T12:23:39.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.115+0000 7f6f73490b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b59bc38a80 0x55b59bc2ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.115+0000 7f6f73490b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b59bc393e0 0x55b59bc49520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.115+0000 7f6f73490b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b59bc39da0 0x55b59bc33340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.115+0000 7f6f73490b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b59bc342c0 con 0x55b59bc39da0 2023-08-11T12:23:39.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.115+0000 7f6f73490b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b59bc33ec0 con 0x55b59bc38a80 2023-08-11T12:23:39.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.115+0000 7f6f73490b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b59bc41560 con 0x55b59bc393e0 2023-08-11T12:23:39.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.115+0000 7f6f5e19c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b59bc39da0 0x55b59bc33340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.115+0000 7f6f5e19c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b59bc39da0 0x55b59bc33340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51542/0 (socket says 172.21.15.8:51542) 2023-08-11T12:23:39.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.115+0000 7f6f5e19c700 1 -- 172.21.15.8:0/2266292743 learned_addr learned my addr 172.21.15.8:0/2266292743 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:39.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.116+0000 7f6f5d99b700 1 --2- 172.21.15.8:0/2266292743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b59bc38a80 0x55b59bc2ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.116+0000 7f6f5d19a700 1 --2- 172.21.15.8:0/2266292743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b59bc393e0 0x55b59bc49520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.116+0000 7f6f5e19c700 1 -- 172.21.15.8:0/2266292743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b59bc393e0 msgr2=0x55b59bc49520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.116+0000 7f6f5e19c700 1 --2- 172.21.15.8:0/2266292743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b59bc393e0 0x55b59bc49520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.116+0000 7f6f5e19c700 1 -- 172.21.15.8:0/2266292743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b59bc38a80 msgr2=0x55b59bc2ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.116+0000 7f6f5e19c700 1 --2- 172.21.15.8:0/2266292743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b59bc38a80 0x55b59bc2ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.116+0000 7f6f5e19c700 1 -- 172.21.15.8:0/2266292743 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b59b99fc10 con 0x55b59bc39da0 2023-08-11T12:23:39.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.116+0000 7f6f5d19a700 1 --2- 172.21.15.8:0/2266292743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b59bc393e0 0x55b59bc49520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:39.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.116+0000 7f6f5e19c700 1 --2- 172.21.15.8:0/2266292743 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b59bc39da0 0x55b59bc33340 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000c6f0 tx=0x7f6f500cb080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47fa701ef5c59664 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:39.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.116+0000 7f6f4cbff700 1 -- 172.21.15.8:0/2266292743 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f500988f0 con 0x55b59bc39da0 2023-08-11T12:23:39.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.117+0000 7f6f4cbff700 1 -- 172.21.15.8:0/2266292743 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6f50083040 con 0x55b59bc39da0 2023-08-11T12:23:39.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.117+0000 7f6f4cbff700 1 -- 172.21.15.8:0/2266292743 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5001b320 con 0x55b59bc39da0 2023-08-11T12:23:39.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.117+0000 7f6f73490b80 1 -- 172.21.15.8:0/2266292743 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b59bc39da0 msgr2=0x55b59bc33340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.117+0000 7f6f73490b80 1 --2- 172.21.15.8:0/2266292743 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b59bc39da0 0x55b59bc33340 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000c6f0 tx=0x7f6f500cb080 comp rx=0 tx=0).stop 2023-08-11T12:23:39.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.117+0000 7f6f73490b80 1 -- 172.21.15.8:0/2266292743 shutdown_connections 2023-08-11T12:23:39.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.117+0000 7f6f73490b80 1 --2- 172.21.15.8:0/2266292743 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b59bc39da0 0x55b59bc33340 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.117+0000 7f6f73490b80 1 --2- 172.21.15.8:0/2266292743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b59bc38a80 0x55b59bc2ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.117+0000 7f6f73490b80 1 --2- 172.21.15.8:0/2266292743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b59bc393e0 0x55b59bc49520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.117+0000 7f6f73490b80 1 -- 172.21.15.8:0/2266292743 >> 172.21.15.8:0/2266292743 conn(0x55b59bb65900 msgr2=0x55b59bc3cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:39.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.117+0000 7f6f73490b80 1 -- 172.21.15.8:0/2266292743 shutdown_connections 2023-08-11T12:23:39.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.117+0000 7f6f73490b80 1 -- 172.21.15.8:0/2266292743 wait complete. 2023-08-11T12:23:39.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.118+0000 7f6f73490b80 1 -- start start 2023-08-11T12:23:39.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.118+0000 7f6f73490b80 1 Processor -- start 2023-08-11T12:23:39.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.118+0000 7f6f73490b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b59bc38a80 0x55b59bc2d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.118+0000 7f6f73490b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b59bc393e0 0x55b59bc494b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.118+0000 7f6f73490b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b59bc39da0 0x55b59bc2d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.118+0000 7f6f73490b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b59bc2de50 con 0x55b59bc393e0 2023-08-11T12:23:39.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.118+0000 7f6f73490b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b59bc2dfc0 con 0x55b59bc38a80 2023-08-11T12:23:39.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.118+0000 7f6f73490b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b59bc2e180 con 0x55b59bc39da0 2023-08-11T12:23:39.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.118+0000 7f6f73490b80 10 client.0 _ll_register_callbacks cb 0x55b59bb2ba60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:23:39.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.119+0000 7f6f5d99b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b59bc38a80 0x55b59bc2d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.119+0000 7f6f5d19a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b59bc393e0 0x55b59bc494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.119+0000 7f6f5d99b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b59bc38a80 0x55b59bc2d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:60336/0 (socket says 172.21.15.8:60336) 2023-08-11T12:23:39.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.119+0000 7f6f5d99b700 1 -- 172.21.15.8:0/2641449582 learned_addr learned my addr 172.21.15.8:0/2641449582 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:39.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.119+0000 7f6f5e19c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b59bc39da0 0x55b59bc2d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.119+0000 7f6f5d99b700 1 -- 172.21.15.8:0/2641449582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b59bc39da0 msgr2=0x55b59bc2d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.119+0000 7f6f5d99b700 1 --2- 172.21.15.8:0/2641449582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b59bc39da0 0x55b59bc2d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.119+0000 7f6f5d99b700 1 -- 172.21.15.8:0/2641449582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b59bc393e0 msgr2=0x55b59bc494b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.119+0000 7f6f5d99b700 1 --2- 172.21.15.8:0/2641449582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b59bc393e0 0x55b59bc494b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.119+0000 7f6f5d99b700 1 -- 172.21.15.8:0/2641449582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b59b9b6d90 con 0x55b59bc38a80 2023-08-11T12:23:39.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.119+0000 7f6f5d19a700 1 --2- 172.21.15.8:0/2641449582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b59bc393e0 0x55b59bc494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:39.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.119+0000 7f6f5d99b700 1 --2- 172.21.15.8:0/2641449582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b59bc38a80 0x55b59bc2d3d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6f54009ce0 tx=0x7f6f5400b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=742cb148f3a55983 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:39.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.119+0000 7f6f417fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:23:39.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.120+0000 7f6f417fa700 1 -- 172.21.15.8:0/2641449582 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5401d040 con 0x55b59bc38a80 2023-08-11T12:23:39.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.120+0000 7f6f73490b80 1 -- 172.21.15.8:0/2641449582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6f5401e040 con 0x55b59bc38a80 2023-08-11T12:23:39.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.120+0000 7f6f417fa700 1 -- 172.21.15.8:0/2641449582 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f6f54031070 con 0x55b59bc38a80 2023-08-11T12:23:39.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.120+0000 7f6f417fa700 1 -- 172.21.15.8:0/2641449582 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f540055a0 con 0x55b59bc38a80 2023-08-11T12:23:39.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.120+0000 7f6f73490b80 10 client.25136 fetch_fsmap learned FSMap version 27 2023-08-11T12:23:39.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.120+0000 7f6f73490b80 1 -- 172.21.15.8:0/2641449582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f6f581a5220 con 0x55b59bc38a80 2023-08-11T12:23:39.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.120+0000 7f6f417fa700 1 -- 172.21.15.8:0/2641449582 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6f5401e040 con 0x55b59bc38a80 2023-08-11T12:23:39.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.120+0000 7f6f417fa700 1 -- 172.21.15.8:0/2641449582 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6f54035a60 con 0x55b59bc38a80 2023-08-11T12:23:39.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.121+0000 7f6f73490b80 10 client.25136 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:23:39.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.121+0000 7f6f73490b80 10 client.25136 resolve_mds: resolved name 'k' to daemon mds.k 2023-08-11T12:23:39.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.121+0000 7f6f73490b80 20 client.25136 populate_metadata read hostname 'smithi008' 2023-08-11T12:23:39.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.121+0000 7f6f73490b80 1 --2- 172.21.15.8:0/2641449582 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x55b59bca60f0 0x55b59bca2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.121+0000 7f6f73490b80 4 client.25136 mds_command: new command op to 24464 tid=0[{"prefix": "status"}] 2023-08-11T12:23:39.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.121+0000 7f6f73490b80 1 -- 172.21.15.8:0/2641449582 --> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b59bb837d0 con 0x55b59bca60f0 2023-08-11T12:23:39.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.121+0000 7f6f5d19a700 1 --2- 172.21.15.8:0/2641449582 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x55b59bca60f0 0x55b59bca2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.121+0000 7f6f5d19a700 1 --2- 172.21.15.8:0/2641449582 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x55b59bca60f0 0x55b59bca2570 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2537860d2ba6103b server_cookie=f1f73d6c75ea1132 in_seq=0 out_seq=0 2023-08-11T12:23:39.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.121+0000 7f6f417fa700 10 client.25136 ms_handle_connect on v2:172.21.15.45:6832/1208864615 2023-08-11T12:23:39.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.122+0000 7f6f417fa700 1 -- 172.21.15.8:0/2641449582 <== mds.4 v2:172.21.15.45:6832/1208864615 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55b59bb837d0 con 0x55b59bca60f0 2023-08-11T12:23:39.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.122+0000 7f6f417fa700 10 client.25136 handle_command_reply: tid=0 2023-08-11T12:23:39.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.122+0000 7f6f73490b80 1 client.25136 shutdown 2023-08-11T12:23:39.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.122+0000 7f6f73490b80 1 -- 172.21.15.8:0/2641449582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b59bc38a80 msgr2=0x55b59bc2d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.122+0000 7f6f73490b80 1 --2- 172.21.15.8:0/2641449582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b59bc38a80 0x55b59bc2d3d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6f54009ce0 tx=0x7f6f5400b260 comp rx=0 tx=0).stop 2023-08-11T12:23:39.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.122+0000 7f6f73490b80 1 -- 172.21.15.8:0/2641449582 shutdown_connections 2023-08-11T12:23:39.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.122+0000 7f6f73490b80 1 --2- 172.21.15.8:0/2641449582 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x55b59bca60f0 0x55b59bca2570 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.122+0000 7f6f73490b80 1 --2- 172.21.15.8:0/2641449582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b59bc39da0 0x55b59bc2d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.122+0000 7f6f73490b80 1 --2- 172.21.15.8:0/2641449582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b59bc38a80 0x55b59bc2d3d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.122+0000 7f6f417fa700 0 client.25136 ms_handle_reset on v2:172.21.15.45:6832/1208864615 2023-08-11T12:23:39.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.122+0000 7f6f73490b80 1 --2- 172.21.15.8:0/2641449582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b59bc393e0 0x55b59bc494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.122+0000 7f6f73490b80 1 -- 172.21.15.8:0/2641449582 >> 172.21.15.8:0/2641449582 conn(0x55b59bb65900 msgr2=0x55b59bc33230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:39.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.122+0000 7f6f73490b80 1 -- 172.21.15.8:0/2641449582 shutdown_connections 2023-08-11T12:23:39.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.122+0000 7f6f73490b80 1 -- 172.21.15.8:0/2641449582 wait complete. 2023-08-11T12:23:39.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.122+0000 7f6f73490b80 20 client.25136 trim_cache size 0 max 16384 2023-08-11T12:23:39.134 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:23:39.135 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "815f94ae-3840-11ee-9b37-001a4aab830c", 2023-08-11T12:23:39.135 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 4, 2023-08-11T12:23:39.135 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24464, 2023-08-11T12:23:39.135 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-08-11T12:23:39.135 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-08-11T12:23:39.135 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-08-11T12:23:39.135 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 67.436511687999996, 2023-08-11T12:23:39.135 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 27, 2023-08-11T12:23:39.136 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 89, 2023-08-11T12:23:39.136 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 89, 2023-08-11T12:23:39.136 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 127.928203673 2023-08-11T12:23:39.136 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:23:39.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.123+0000 7f6f5fbff700 1 -- 172.21.15.8:0/1595681437 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6f4409ff50 msgr2=0x7f6f440a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.123+0000 7f6f5fbff700 1 --2- 172.21.15.8:0/1595681437 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6f4409ff50 0x7f6f440a2410 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6f480096b0 tx=0x7f6f480095c0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.123+0000 7f6f5fbff700 1 -- 172.21.15.8:0/1595681437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f581045a0 msgr2=0x7f6f581a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.123+0000 7f6f5fbff700 1 --2- 172.21.15.8:0/1595681437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f581045a0 0x7f6f581a4240 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000efc0 tx=0x7f6f5000c3a0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.123+0000 7f6f5fbff700 1 -- 172.21.15.8:0/1595681437 shutdown_connections 2023-08-11T12:23:39.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.123+0000 7f6f5fbff700 1 --2- 172.21.15.8:0/1595681437 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6f4409ff50 0x7f6f440a2410 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.123+0000 7f6f5fbff700 1 --2- 172.21.15.8:0/1595681437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f580ff260 0x7f6f5819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.123+0000 7f6f5fbff700 1 --2- 172.21.15.8:0/1595681437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f581045a0 0x7f6f581a4240 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.123+0000 7f6f5fbff700 1 --2- 172.21.15.8:0/1595681437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f58101bd0 0x7f6f5819d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.123+0000 7f6f5fbff700 1 -- 172.21.15.8:0/1595681437 >> 172.21.15.8:0/1595681437 conn(0x7f6f580faea0 msgr2=0x7f6f581028b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:39.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.123+0000 7f6f5fbff700 1 -- 172.21.15.8:0/1595681437 shutdown_connections 2023-08-11T12:23:39.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.123+0000 7f6f5fbff700 1 -- 172.21.15.8:0/1595681437 wait complete. 2023-08-11T12:23:39.142 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:38 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/207445627' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:23:39.142 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:38 smithi008 ceph-mon[97158]: pgmap v323: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:39.142 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:38 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/91955477' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:23:39.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:38 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/207445627' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:23:39.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:38 smithi194 ceph-mon[130905]: pgmap v323: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:39.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:38 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/91955477' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:23:39.144 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-08-11T12:23:39.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:38 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/207445627' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:23:39.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:38 smithi045 ceph-mon[130284]: pgmap v323: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:39.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:38 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/91955477' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:23:39.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.352+0000 7facce5ff700 1 -- 172.21.15.8:0/3786152203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facc8074960 msgr2=0x7facc8072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.352+0000 7facce5ff700 1 --2- 172.21.15.8:0/3786152203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facc8074960 0x7facc8072db0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7facb8009990 tx=0x7facb8009ca0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.352+0000 7facce5ff700 1 -- 172.21.15.8:0/3786152203 shutdown_connections 2023-08-11T12:23:39.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.352+0000 7facce5ff700 1 --2- 172.21.15.8:0/3786152203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facc81088c0 0x7facc810ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.352+0000 7facce5ff700 1 --2- 172.21.15.8:0/3786152203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facc8074960 0x7facc8072db0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.352+0000 7facce5ff700 1 --2- 172.21.15.8:0/3786152203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7facc8073380 0x7facc8073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.352+0000 7facce5ff700 1 -- 172.21.15.8:0/3786152203 >> 172.21.15.8:0/3786152203 conn(0x7facc80fbf70 msgr2=0x7facc80fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:39.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.352+0000 7facce5ff700 1 -- 172.21.15.8:0/3786152203 shutdown_connections 2023-08-11T12:23:39.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.352+0000 7facce5ff700 1 -- 172.21.15.8:0/3786152203 wait complete. 2023-08-11T12:23:39.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.353+0000 7facce5ff700 1 Processor -- start 2023-08-11T12:23:39.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.353+0000 7facce5ff700 1 -- start start 2023-08-11T12:23:39.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.354+0000 7facce5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facc8073380 0x7facc8198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.354+0000 7facce5ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7facc8074960 0x7facc8198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.354+0000 7facce5ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facc81088c0 0x7facc819fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.354+0000 7facce5ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc81a0490 con 0x7facc81088c0 2023-08-11T12:23:39.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.354+0000 7facce5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc81a05d0 con 0x7facc8073380 2023-08-11T12:23:39.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.354+0000 7facce5ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc81a0760 con 0x7facc8074960 2023-08-11T12:23:39.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.354+0000 7facccb9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facc81088c0 0x7facc819fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.354+0000 7facccb9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facc81088c0 0x7facc819fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51572/0 (socket says 172.21.15.8:51572) 2023-08-11T12:23:39.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.354+0000 7facccb9c700 1 -- 172.21.15.8:0/1393234439 learned_addr learned my addr 172.21.15.8:0/1393234439 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:39.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.354+0000 7facc7fff700 1 --2- 172.21.15.8:0/1393234439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facc8073380 0x7facc8198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.354+0000 7facc77fe700 1 --2- 172.21.15.8:0/1393234439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7facc8074960 0x7facc8198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.354+0000 7facccb9c700 1 -- 172.21.15.8:0/1393234439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7facc8074960 msgr2=0x7facc8198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.354+0000 7facccb9c700 1 --2- 172.21.15.8:0/1393234439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7facc8074960 0x7facc8198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.354+0000 7facccb9c700 1 -- 172.21.15.8:0/1393234439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facc8073380 msgr2=0x7facc8198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.354+0000 7facccb9c700 1 --2- 172.21.15.8:0/1393234439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facc8073380 0x7facc8198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.354+0000 7facccb9c700 1 -- 172.21.15.8:0/1393234439 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb80095f0 con 0x7facc81088c0 2023-08-11T12:23:39.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.354+0000 7facc77fe700 1 --2- 172.21.15.8:0/1393234439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7facc8074960 0x7facc8198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:23:39.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.355+0000 7facccb9c700 1 --2- 172.21.15.8:0/1393234439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facc81088c0 0x7facc819fec0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7facc000ef30 tx=0x7facc000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:39.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.355+0000 7facc57fa700 1 -- 172.21.15.8:0/1393234439 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc0018070 con 0x7facc81088c0 2023-08-11T12:23:39.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.355+0000 7facc57fa700 1 -- 172.21.15.8:0/1393234439 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7facc000f040 con 0x7facc81088c0 2023-08-11T12:23:39.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.355+0000 7facc57fa700 1 -- 172.21.15.8:0/1393234439 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc000cdb0 con 0x7facc81088c0 2023-08-11T12:23:39.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.355+0000 7facce5ff700 1 -- 172.21.15.8:0/1393234439 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc81a09e0 con 0x7facc81088c0 2023-08-11T12:23:39.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.355+0000 7facce5ff700 1 -- 172.21.15.8:0/1393234439 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc81a0ea0 con 0x7facc81088c0 2023-08-11T12:23:39.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.359+0000 7facc57fa700 1 -- 172.21.15.8:0/1393234439 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7facc0003a00 con 0x7facc81088c0 2023-08-11T12:23:39.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.360+0000 7facc57fa700 1 --2- 172.21.15.8:0/1393234439 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7facb009ff50 0x7facb00a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.360+0000 7facc57fa700 1 -- 172.21.15.8:0/1393234439 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7facc00cb1a0 con 0x7facc81088c0 2023-08-11T12:23:39.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.360+0000 7facc7fff700 1 --2- 172.21.15.8:0/1393234439 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7facb009ff50 0x7facb00a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.361+0000 7facc7fff700 1 --2- 172.21.15.8:0/1393234439 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7facb009ff50 0x7facb00a2410 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7facb800b2e0 tx=0x7facb8005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:39.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.362+0000 7face1ffbb80 1 Processor -- start 2023-08-11T12:23:39.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.363+0000 7face1ffbb80 1 -- start start 2023-08-11T12:23:39.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.363+0000 7face1ffbb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561dbc10fa80 0x561dbc10fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.363+0000 7face1ffbb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561dbc1103e0 0x561dbc110860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.363+0000 7face1ffbb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561dbc110da0 0x561dbc111220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.363+0000 7face1ffbb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dbc0685e0 con 0x561dbc1103e0 2023-08-11T12:23:39.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.363+0000 7face1ffbb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dbc065f00 con 0x561dbc10fa80 2023-08-11T12:23:39.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.363+0000 7face1ffbb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dbc0617f0 con 0x561dbc110da0 2023-08-11T12:23:39.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.363+0000 7facc77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561dbc1103e0 0x561dbc110860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.363+0000 7facc77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561dbc1103e0 0x561dbc110860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51576/0 (socket says 172.21.15.8:51576) 2023-08-11T12:23:39.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.363+0000 7facc77fe700 1 -- 172.21.15.8:0/821419807 learned_addr learned my addr 172.21.15.8:0/821419807 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:39.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.363+0000 7facc7fff700 1 --2- 172.21.15.8:0/821419807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561dbc10fa80 0x561dbc10fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.363+0000 7facccb9c700 1 --2- 172.21.15.8:0/821419807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561dbc110da0 0x561dbc111220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.364+0000 7facc77fe700 1 -- 172.21.15.8:0/821419807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561dbc110da0 msgr2=0x561dbc111220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.364+0000 7facc77fe700 1 --2- 172.21.15.8:0/821419807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561dbc110da0 0x561dbc111220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.364+0000 7facc77fe700 1 -- 172.21.15.8:0/821419807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561dbc10fa80 msgr2=0x561dbc10fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.364+0000 7facc77fe700 1 --2- 172.21.15.8:0/821419807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561dbc10fa80 0x561dbc10fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.364+0000 7facc77fe700 1 -- 172.21.15.8:0/821419807 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561dbbee15e0 con 0x561dbc1103e0 2023-08-11T12:23:39.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.364+0000 7facccb9c700 1 --2- 172.21.15.8:0/821419807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561dbc110da0 0x561dbc111220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:39.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.364+0000 7facc77fe700 1 --2- 172.21.15.8:0/821419807 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561dbc1103e0 0x561dbc110860 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7facbc009d60 tx=0x7facbc0116c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d4b22314a6bd67 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:39.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.364+0000 7facae7fc700 1 -- 172.21.15.8:0/821419807 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc011dc0 con 0x561dbc1103e0 2023-08-11T12:23:39.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.364+0000 7facae7fc700 1 -- 172.21.15.8:0/821419807 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7facbc012910 con 0x561dbc1103e0 2023-08-11T12:23:39.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.364+0000 7facae7fc700 1 -- 172.21.15.8:0/821419807 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc00f780 con 0x561dbc1103e0 2023-08-11T12:23:39.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.365+0000 7face1ffbb80 1 -- 172.21.15.8:0/821419807 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561dbc1103e0 msgr2=0x561dbc110860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.365+0000 7face1ffbb80 1 --2- 172.21.15.8:0/821419807 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561dbc1103e0 0x561dbc110860 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7facbc009d60 tx=0x7facbc0116c0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.365+0000 7face1ffbb80 1 -- 172.21.15.8:0/821419807 shutdown_connections 2023-08-11T12:23:39.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.365+0000 7face1ffbb80 1 --2- 172.21.15.8:0/821419807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561dbc110da0 0x561dbc111220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.365+0000 7face1ffbb80 1 --2- 172.21.15.8:0/821419807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561dbc10fa80 0x561dbc10fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.365+0000 7face1ffbb80 1 --2- 172.21.15.8:0/821419807 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561dbc1103e0 0x561dbc110860 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.365+0000 7face1ffbb80 1 -- 172.21.15.8:0/821419807 >> 172.21.15.8:0/821419807 conn(0x561dbc03c900 msgr2=0x561dbc10a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:39.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.365+0000 7face1ffbb80 1 -- 172.21.15.8:0/821419807 shutdown_connections 2023-08-11T12:23:39.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.365+0000 7face1ffbb80 1 -- 172.21.15.8:0/821419807 wait complete. 2023-08-11T12:23:39.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.366+0000 7face1ffbb80 1 -- start start 2023-08-11T12:23:39.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.366+0000 7face1ffbb80 1 Processor -- start 2023-08-11T12:23:39.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.367+0000 7face1ffbb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561dbc10fa80 0x561dbc1190b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.367+0000 7face1ffbb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561dbc1103e0 0x561dbc1195f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.367+0000 7face1ffbb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561dbc110da0 0x561dbc120630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.367+0000 7face1ffbb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dbbfffa70 con 0x561dbc110da0 2023-08-11T12:23:39.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.367+0000 7face1ffbb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dbbfff770 con 0x561dbc1103e0 2023-08-11T12:23:39.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.367+0000 7face1ffbb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dbbee38d0 con 0x561dbc10fa80 2023-08-11T12:23:39.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.367+0000 7face1ffbb80 10 client.0 _ll_register_callbacks cb 0x561dbc002a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:23:39.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.367+0000 7facccb9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561dbc110da0 0x561dbc120630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.367+0000 7facc7fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561dbc10fa80 0x561dbc1190b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.368+0000 7facccb9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561dbc110da0 0x561dbc120630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51578/0 (socket says 172.21.15.8:51578) 2023-08-11T12:23:39.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.368+0000 7facccb9c700 1 -- 172.21.15.8:0/3562248122 learned_addr learned my addr 172.21.15.8:0/3562248122 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:39.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.368+0000 7facc77fe700 1 --2- 172.21.15.8:0/3562248122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561dbc1103e0 0x561dbc1195f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.368+0000 7facc7fff700 1 -- 172.21.15.8:0/3562248122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561dbc1103e0 msgr2=0x561dbc1195f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.368+0000 7facc7fff700 1 --2- 172.21.15.8:0/3562248122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561dbc1103e0 0x561dbc1195f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.368+0000 7facc7fff700 1 -- 172.21.15.8:0/3562248122 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561dbc110da0 msgr2=0x561dbc120630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.368+0000 7facc7fff700 1 --2- 172.21.15.8:0/3562248122 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561dbc110da0 0x561dbc120630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.368+0000 7facc7fff700 1 -- 172.21.15.8:0/3562248122 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc81a0ea0 con 0x561dbc10fa80 2023-08-11T12:23:39.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.368+0000 7facc7fff700 1 --2- 172.21.15.8:0/3562248122 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561dbc10fa80 0x561dbc1190b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7facb8000c00 tx=0x7facb801a050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e86c34f80e65f83b server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:39.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.368+0000 7faca77fe700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:23:39.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.369+0000 7faca77fe700 1 -- 172.21.15.8:0/3562248122 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb802b050 con 0x561dbc10fa80 2023-08-11T12:23:39.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.369+0000 7face1ffbb80 1 -- 172.21.15.8:0/3562248122 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561dbc102a40 con 0x561dbc10fa80 2023-08-11T12:23:39.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.369+0000 7faca77fe700 1 -- 172.21.15.8:0/3562248122 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7facb800f460 con 0x561dbc10fa80 2023-08-11T12:23:39.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.369+0000 7faca77fe700 1 -- 172.21.15.8:0/3562248122 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7facb800f620 con 0x561dbc10fa80 2023-08-11T12:23:39.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.369+0000 7face1ffbb80 10 client.25162 fetch_fsmap learned FSMap version 27 2023-08-11T12:23:39.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.369+0000 7face1ffbb80 1 -- 172.21.15.8:0/3562248122 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7facbc009990 con 0x561dbc10fa80 2023-08-11T12:23:39.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.369+0000 7faca77fe700 1 -- 172.21.15.8:0/3562248122 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561dbc102a40 con 0x561dbc10fa80 2023-08-11T12:23:39.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.370+0000 7faca77fe700 1 -- 172.21.15.8:0/3562248122 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7facb8038070 con 0x561dbc10fa80 2023-08-11T12:23:39.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.370+0000 7face1ffbb80 10 client.25162 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:23:39.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.370+0000 7face1ffbb80 10 client.25162 resolve_mds: resolved name 'e' to daemon mds.e 2023-08-11T12:23:39.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.370+0000 7face1ffbb80 20 client.25162 populate_metadata read hostname 'smithi008' 2023-08-11T12:23:39.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.370+0000 7face1ffbb80 1 --2- 172.21.15.8:0/3562248122 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x561dbc124c90 0x561dbc123780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.370+0000 7face1ffbb80 4 client.25162 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:23:39.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.370+0000 7face1ffbb80 1 -- 172.21.15.8:0/3562248122 --> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561dbc0de490 con 0x561dbc124c90 2023-08-11T12:23:39.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.370+0000 7facc77fe700 1 --2- 172.21.15.8:0/3562248122 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x561dbc124c90 0x561dbc123780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.371+0000 7facc77fe700 1 --2- 172.21.15.8:0/3562248122 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x561dbc124c90 0x561dbc123780 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1fe95c14a393bf75 server_cookie=66219857b6ac80cc in_seq=0 out_seq=0 2023-08-11T12:23:39.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.371+0000 7faca77fe700 10 client.25162 ms_handle_connect on v2:172.21.15.45:6834/1776075470 2023-08-11T12:23:39.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.372+0000 7faca77fe700 1 -- 172.21.15.8:0/3562248122 <== mds.3 v2:172.21.15.45:6834/1776075470 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x561dbc0de490 con 0x561dbc124c90 2023-08-11T12:23:39.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.372+0000 7faca77fe700 10 client.25162 handle_command_reply: tid=0 2023-08-11T12:23:39.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.372+0000 7face1ffbb80 1 client.25162 shutdown 2023-08-11T12:23:39.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.372+0000 7face1ffbb80 1 -- 172.21.15.8:0/3562248122 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561dbc10fa80 msgr2=0x561dbc1190b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.372+0000 7face1ffbb80 1 --2- 172.21.15.8:0/3562248122 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561dbc10fa80 0x561dbc1190b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7facb8000c00 tx=0x7facb801a050 comp rx=0 tx=0).stop 2023-08-11T12:23:39.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.372+0000 7face1ffbb80 1 -- 172.21.15.8:0/3562248122 shutdown_connections 2023-08-11T12:23:39.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.372+0000 7face1ffbb80 1 --2- 172.21.15.8:0/3562248122 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x561dbc124c90 0x561dbc123780 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.372+0000 7face1ffbb80 1 --2- 172.21.15.8:0/3562248122 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561dbc10fa80 0x561dbc1190b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.372+0000 7face1ffbb80 1 --2- 172.21.15.8:0/3562248122 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561dbc110da0 0x561dbc120630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.372+0000 7faca77fe700 0 client.25162 ms_handle_reset on v2:172.21.15.45:6834/1776075470 2023-08-11T12:23:39.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.372+0000 7face1ffbb80 1 --2- 172.21.15.8:0/3562248122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561dbc1103e0 0x561dbc1195f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.372+0000 7face1ffbb80 1 -- 172.21.15.8:0/3562248122 >> 172.21.15.8:0/3562248122 conn(0x561dbc03c900 msgr2=0x561dbc104c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:39.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.372+0000 7face1ffbb80 1 -- 172.21.15.8:0/3562248122 shutdown_connections 2023-08-11T12:23:39.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.372+0000 7face1ffbb80 1 -- 172.21.15.8:0/3562248122 wait complete. 2023-08-11T12:23:39.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.372+0000 7face1ffbb80 20 client.25162 trim_cache size 0 max 16384 2023-08-11T12:23:39.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.391+0000 7face1ffbb80 1 Processor -- start 2023-08-11T12:23:39.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.391+0000 7face1ffbb80 1 -- start start 2023-08-11T12:23:39.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.391+0000 7face1ffbb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561dbc10fa80 0x561dbc123e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.391+0000 7face1ffbb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561dbc1103e0 0x561dbc1205f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.391+0000 7face1ffbb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561dbc110da0 0x561dbc1043d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.391+0000 7face1ffbb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dbc118630 con 0x561dbc110da0 2023-08-11T12:23:39.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.391+0000 7face1ffbb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dbc102a50 con 0x561dbc1103e0 2023-08-11T12:23:39.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.391+0000 7face1ffbb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dbc10ba90 con 0x561dbc10fa80 2023-08-11T12:23:39.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.391+0000 7facccb9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561dbc110da0 0x561dbc1043d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.391+0000 7facc77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561dbc1103e0 0x561dbc1205f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.391+0000 7facc77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561dbc1103e0 0x561dbc1205f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:60376/0 (socket says 172.21.15.8:60376) 2023-08-11T12:23:39.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.391+0000 7facc77fe700 1 -- 172.21.15.8:0/3591645028 learned_addr learned my addr 172.21.15.8:0/3591645028 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:39.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.392+0000 7facc7fff700 1 --2- 172.21.15.8:0/3591645028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561dbc10fa80 0x561dbc123e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.392+0000 7facc77fe700 1 -- 172.21.15.8:0/3591645028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561dbc10fa80 msgr2=0x561dbc123e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.392+0000 7facc77fe700 1 --2- 172.21.15.8:0/3591645028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561dbc10fa80 0x561dbc123e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.392+0000 7facc77fe700 1 -- 172.21.15.8:0/3591645028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561dbc110da0 msgr2=0x561dbc1043d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.392+0000 7facc77fe700 1 --2- 172.21.15.8:0/3591645028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561dbc110da0 0x561dbc1043d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.392+0000 7facc77fe700 1 -- 172.21.15.8:0/3591645028 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561dbbe8dd90 con 0x561dbc1103e0 2023-08-11T12:23:39.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.392+0000 7facc77fe700 1 --2- 172.21.15.8:0/3591645028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561dbc1103e0 0x561dbc1205f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7facbc000c00 tx=0x7facbc009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8bae01d46b74fd4 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:39.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.392+0000 7facaeffd700 1 -- 172.21.15.8:0/3591645028 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc011da0 con 0x561dbc1103e0 2023-08-11T12:23:39.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.392+0000 7facaeffd700 1 -- 172.21.15.8:0/3591645028 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7facbc029150 con 0x561dbc1103e0 2023-08-11T12:23:39.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.392+0000 7facaeffd700 1 -- 172.21.15.8:0/3591645028 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc029d40 con 0x561dbc1103e0 2023-08-11T12:23:39.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.393+0000 7face1ffbb80 1 -- 172.21.15.8:0/3591645028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561dbc1103e0 msgr2=0x561dbc1205f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.393+0000 7face1ffbb80 1 --2- 172.21.15.8:0/3591645028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561dbc1103e0 0x561dbc1205f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7facbc000c00 tx=0x7facbc009260 comp rx=0 tx=0).stop 2023-08-11T12:23:39.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.393+0000 7face1ffbb80 1 -- 172.21.15.8:0/3591645028 shutdown_connections 2023-08-11T12:23:39.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.393+0000 7face1ffbb80 1 --2- 172.21.15.8:0/3591645028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561dbc10fa80 0x561dbc123e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.393+0000 7face1ffbb80 1 --2- 172.21.15.8:0/3591645028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561dbc110da0 0x561dbc1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.393+0000 7face1ffbb80 1 --2- 172.21.15.8:0/3591645028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561dbc1103e0 0x561dbc1205f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.393+0000 7face1ffbb80 1 -- 172.21.15.8:0/3591645028 >> 172.21.15.8:0/3591645028 conn(0x561dbc03c900 msgr2=0x561dbc123780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:39.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.393+0000 7face1ffbb80 1 -- 172.21.15.8:0/3591645028 shutdown_connections 2023-08-11T12:23:39.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.393+0000 7face1ffbb80 1 -- 172.21.15.8:0/3591645028 wait complete. 2023-08-11T12:23:39.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.394+0000 7face1ffbb80 1 -- start start 2023-08-11T12:23:39.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.394+0000 7face1ffbb80 1 Processor -- start 2023-08-11T12:23:39.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.394+0000 7face1ffbb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561dbc10fa80 0x561dbc11af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.394+0000 7face1ffbb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561dbc1103e0 0x561dbc120470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.394+0000 7face1ffbb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561dbc110da0 0x561dbc11b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.394+0000 7face1ffbb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dbc11bb50 con 0x561dbc10fa80 2023-08-11T12:23:39.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.394+0000 7face1ffbb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dbc178500 con 0x561dbc110da0 2023-08-11T12:23:39.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.394+0000 7face1ffbb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dbc178640 con 0x561dbc1103e0 2023-08-11T12:23:39.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.394+0000 7face1ffbb80 10 client.0 _ll_register_callbacks cb 0x7facb8005350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:23:39.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.394+0000 7facc7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561dbc10fa80 0x561dbc11af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.395+0000 7facc77fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561dbc1103e0 0x561dbc120470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.395+0000 7facc7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561dbc10fa80 0x561dbc11af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51598/0 (socket says 172.21.15.8:51598) 2023-08-11T12:23:39.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.395+0000 7facc7fff700 1 -- 172.21.15.8:0/2846088363 learned_addr learned my addr 172.21.15.8:0/2846088363 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:39.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.395+0000 7facccb9c700 1 --2- 172.21.15.8:0/2846088363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561dbc110da0 0x561dbc11b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.395+0000 7facc77fe700 1 -- 172.21.15.8:0/2846088363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561dbc110da0 msgr2=0x561dbc11b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.395+0000 7facc77fe700 1 --2- 172.21.15.8:0/2846088363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561dbc110da0 0x561dbc11b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.395+0000 7facc77fe700 1 -- 172.21.15.8:0/2846088363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561dbc10fa80 msgr2=0x561dbc11af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.395+0000 7facc77fe700 1 --2- 172.21.15.8:0/2846088363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561dbc10fa80 0x561dbc11af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.395+0000 7facc77fe700 1 -- 172.21.15.8:0/2846088363 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561dbbee15e0 con 0x561dbc1103e0 2023-08-11T12:23:39.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.395+0000 7facc7fff700 1 --2- 172.21.15.8:0/2846088363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561dbc10fa80 0x561dbc11af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:39.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.395+0000 7facc77fe700 1 --2- 172.21.15.8:0/2846088363 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561dbc1103e0 0x561dbc120470 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7facbc01c040 tx=0x7facbc011c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb1ff828533df6e0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:39.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.395+0000 7faca77fe700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:23:39.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.396+0000 7faca77fe700 1 -- 172.21.15.8:0/2846088363 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc0294d0 con 0x561dbc1103e0 2023-08-11T12:23:39.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.396+0000 7face1ffbb80 1 -- 172.21.15.8:0/2846088363 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7facbc012910 con 0x561dbc1103e0 2023-08-11T12:23:39.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.396+0000 7faca77fe700 1 -- 172.21.15.8:0/2846088363 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7facbc012450 con 0x561dbc1103e0 2023-08-11T12:23:39.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.396+0000 7faca77fe700 1 -- 172.21.15.8:0/2846088363 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7facbc012630 con 0x561dbc1103e0 2023-08-11T12:23:39.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.396+0000 7face1ffbb80 10 client.25168 fetch_fsmap learned FSMap version 27 2023-08-11T12:23:39.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.396+0000 7face1ffbb80 1 -- 172.21.15.8:0/2846088363 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561dbbe76c10 con 0x561dbc1103e0 2023-08-11T12:23:39.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.396+0000 7faca77fe700 1 -- 172.21.15.8:0/2846088363 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7facbc012910 con 0x561dbc1103e0 2023-08-11T12:23:39.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.397+0000 7faca77fe700 1 -- 172.21.15.8:0/2846088363 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7facbc03a070 con 0x561dbc1103e0 2023-08-11T12:23:39.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.397+0000 7face1ffbb80 10 client.25168 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:23:39.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.397+0000 7face1ffbb80 10 client.25168 resolve_mds: resolved name 'e' to daemon mds.e 2023-08-11T12:23:39.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.397+0000 7face1ffbb80 20 client.25168 populate_metadata read hostname 'smithi008' 2023-08-11T12:23:39.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.397+0000 7face1ffbb80 1 --2- 172.21.15.8:0/2846088363 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x561dbc17d540 0x561dbc1799a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.397+0000 7face1ffbb80 4 client.25168 mds_command: new command op to 24500 tid=0[{"prefix": "status"}] 2023-08-11T12:23:39.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.397+0000 7face1ffbb80 1 -- 172.21.15.8:0/2846088363 --> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561dbc05a7d0 con 0x561dbc17d540 2023-08-11T12:23:39.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.397+0000 7facc7fff700 1 --2- 172.21.15.8:0/2846088363 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x561dbc17d540 0x561dbc1799a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.398+0000 7faca77fe700 10 client.25168 ms_handle_connect on v2:172.21.15.45:6834/1776075470 2023-08-11T12:23:39.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.398+0000 7facc7fff700 1 --2- 172.21.15.8:0/2846088363 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x561dbc17d540 0x561dbc1799a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=458f2fafe0cbe52d server_cookie=1a585c7f54e05808 in_seq=0 out_seq=0 2023-08-11T12:23:39.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.398+0000 7faca77fe700 1 -- 172.21.15.8:0/2846088363 <== mds.3 v2:172.21.15.45:6834/1776075470 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x561dbc05a7d0 con 0x561dbc17d540 2023-08-11T12:23:39.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.398+0000 7faca77fe700 10 client.25168 handle_command_reply: tid=0 2023-08-11T12:23:39.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.398+0000 7face1ffbb80 1 client.25168 shutdown 2023-08-11T12:23:39.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.398+0000 7face1ffbb80 1 -- 172.21.15.8:0/2846088363 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561dbc1103e0 msgr2=0x561dbc120470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.398+0000 7face1ffbb80 1 --2- 172.21.15.8:0/2846088363 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561dbc1103e0 0x561dbc120470 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7facbc01c040 tx=0x7facbc011c10 comp rx=0 tx=0).stop 2023-08-11T12:23:39.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.398+0000 7face1ffbb80 1 -- 172.21.15.8:0/2846088363 shutdown_connections 2023-08-11T12:23:39.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.398+0000 7face1ffbb80 1 --2- 172.21.15.8:0/2846088363 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x561dbc17d540 0x561dbc1799a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.398+0000 7face1ffbb80 1 --2- 172.21.15.8:0/2846088363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561dbc110da0 0x561dbc11b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.398+0000 7face1ffbb80 1 --2- 172.21.15.8:0/2846088363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561dbc10fa80 0x561dbc11af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.398+0000 7face1ffbb80 1 --2- 172.21.15.8:0/2846088363 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561dbc1103e0 0x561dbc120470 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.398+0000 7faca77fe700 0 client.25168 ms_handle_reset on v2:172.21.15.45:6834/1776075470 2023-08-11T12:23:39.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.398+0000 7face1ffbb80 1 -- 172.21.15.8:0/2846088363 >> 172.21.15.8:0/2846088363 conn(0x561dbc03c900 msgr2=0x561dbc10e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:39.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.399+0000 7face1ffbb80 1 -- 172.21.15.8:0/2846088363 shutdown_connections 2023-08-11T12:23:39.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.399+0000 7face1ffbb80 1 -- 172.21.15.8:0/2846088363 wait complete. 2023-08-11T12:23:39.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.399+0000 7face1ffbb80 20 client.25168 trim_cache size 0 max 16384 2023-08-11T12:23:39.411 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:23:39.411 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "815f94ae-3840-11ee-9b37-001a4aab830c", 2023-08-11T12:23:39.411 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 3, 2023-08-11T12:23:39.411 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24500, 2023-08-11T12:23:39.412 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-08-11T12:23:39.412 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-08-11T12:23:39.412 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-08-11T12:23:39.412 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 68.719511202999996, 2023-08-11T12:23:39.412 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 27, 2023-08-11T12:23:39.412 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 89, 2023-08-11T12:23:39.413 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 89, 2023-08-11T12:23:39.413 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 119.413141626 2023-08-11T12:23:39.413 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:23:39.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.399+0000 7facce5ff700 1 -- 172.21.15.8:0/1393234439 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7facb009ff50 msgr2=0x7facb00a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.399+0000 7facce5ff700 1 --2- 172.21.15.8:0/1393234439 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7facb009ff50 0x7facb00a2410 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7facb800b2e0 tx=0x7facb8005fb0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.399+0000 7facce5ff700 1 -- 172.21.15.8:0/1393234439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facc81088c0 msgr2=0x7facc819fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.399+0000 7facce5ff700 1 --2- 172.21.15.8:0/1393234439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facc81088c0 0x7facc819fec0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7facc000ef30 tx=0x7facc000c3a0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.399+0000 7facce5ff700 1 -- 172.21.15.8:0/1393234439 shutdown_connections 2023-08-11T12:23:39.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.399+0000 7facce5ff700 1 --2- 172.21.15.8:0/1393234439 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7facb009ff50 0x7facb00a2410 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.399+0000 7facce5ff700 1 --2- 172.21.15.8:0/1393234439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facc81088c0 0x7facc819fec0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.399+0000 7facce5ff700 1 --2- 172.21.15.8:0/1393234439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facc8073380 0x7facc8198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.399+0000 7facce5ff700 1 --2- 172.21.15.8:0/1393234439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7facc8074960 0x7facc8198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.399+0000 7facce5ff700 1 -- 172.21.15.8:0/1393234439 >> 172.21.15.8:0/1393234439 conn(0x7facc80fbf70 msgr2=0x7facc80fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:39.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.400+0000 7facce5ff700 1 -- 172.21.15.8:0/1393234439 shutdown_connections 2023-08-11T12:23:39.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.400+0000 7facce5ff700 1 -- 172.21.15.8:0/1393234439 wait complete. 2023-08-11T12:23:39.421 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-08-11T12:23:39.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.622+0000 7fb83b9ff700 1 -- 172.21.15.8:0/3672292493 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb834073380 msgr2=0x7fb834073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.622+0000 7fb83b9ff700 1 --2- 172.21.15.8:0/3672292493 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb834073380 0x7fb834073800 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb824009990 tx=0x7fb824009ca0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.622+0000 7fb83b9ff700 1 -- 172.21.15.8:0/3672292493 shutdown_connections 2023-08-11T12:23:39.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.622+0000 7fb83b9ff700 1 --2- 172.21.15.8:0/3672292493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb834074960 0x7fb834072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.622+0000 7fb83b9ff700 1 --2- 172.21.15.8:0/3672292493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb83410cfe0 0x7fb83410f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.622+0000 7fb83b9ff700 1 --2- 172.21.15.8:0/3672292493 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb834073380 0x7fb834073800 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.622+0000 7fb83b9ff700 1 -- 172.21.15.8:0/3672292493 >> 172.21.15.8:0/3672292493 conn(0x7fb8340fbf80 msgr2=0x7fb8340fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:39.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.622+0000 7fb83b9ff700 1 -- 172.21.15.8:0/3672292493 shutdown_connections 2023-08-11T12:23:39.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.622+0000 7fb83b9ff700 1 -- 172.21.15.8:0/3672292493 wait complete. 2023-08-11T12:23:39.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.623+0000 7fb83b9ff700 1 Processor -- start 2023-08-11T12:23:39.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.623+0000 7fb83b9ff700 1 -- start start 2023-08-11T12:23:39.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.624+0000 7fb83b9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb834073380 0x7fb83419ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.624+0000 7fb83b9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb834074960 0x7fb83419d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.624+0000 7fb83b9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb83410cfe0 0x7fb8341a4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.624+0000 7fb83b9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8341a4830 con 0x7fb83410cfe0 2023-08-11T12:23:39.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.624+0000 7fb83b9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8341a49a0 con 0x7fb834073380 2023-08-11T12:23:39.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.624+0000 7fb83b9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8341a4b60 con 0x7fb834074960 2023-08-11T12:23:39.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.624+0000 7fb83979b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb834073380 0x7fb83419ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.624+0000 7fb839f9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb83410cfe0 0x7fb8341a4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.624+0000 7fb83979b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb834073380 0x7fb83419ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:60408/0 (socket says 172.21.15.8:60408) 2023-08-11T12:23:39.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.624+0000 7fb83979b700 1 -- 172.21.15.8:0/120276820 learned_addr learned my addr 172.21.15.8:0/120276820 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:39.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.624+0000 7fb838f9a700 1 --2- 172.21.15.8:0/120276820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb834074960 0x7fb83419d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.625+0000 7fb83979b700 1 -- 172.21.15.8:0/120276820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb834074960 msgr2=0x7fb83419d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.625+0000 7fb83979b700 1 --2- 172.21.15.8:0/120276820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb834074960 0x7fb83419d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.625+0000 7fb83979b700 1 -- 172.21.15.8:0/120276820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb83410cfe0 msgr2=0x7fb8341a4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.625+0000 7fb83979b700 1 --2- 172.21.15.8:0/120276820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb83410cfe0 0x7fb8341a4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.625+0000 7fb83979b700 1 -- 172.21.15.8:0/120276820 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8240095f0 con 0x7fb834073380 2023-08-11T12:23:39.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.625+0000 7fb839f9c700 1 --2- 172.21.15.8:0/120276820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb83410cfe0 0x7fb8341a4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:39.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.625+0000 7fb83979b700 1 --2- 172.21.15.8:0/120276820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb834073380 0x7fb83419ccf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb83000e9a0 tx=0x7fb83000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:39.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.625+0000 7fb82a7fc700 1 -- 172.21.15.8:0/120276820 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830009790 con 0x7fb834073380 2023-08-11T12:23:39.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.625+0000 7fb83b9ff700 1 -- 172.21.15.8:0/120276820 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8341a4e40 con 0x7fb834073380 2023-08-11T12:23:39.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.625+0000 7fb82a7fc700 1 -- 172.21.15.8:0/120276820 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb830010430 con 0x7fb834073380 2023-08-11T12:23:39.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.625+0000 7fb82a7fc700 1 -- 172.21.15.8:0/120276820 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830018680 con 0x7fb834073380 2023-08-11T12:23:39.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.625+0000 7fb83b9ff700 1 -- 172.21.15.8:0/120276820 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8341a5270 con 0x7fb834073380 2023-08-11T12:23:39.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.630+0000 7fb84f2f6b80 1 Processor -- start 2023-08-11T12:23:39.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.630+0000 7fb84f2f6b80 1 -- start start 2023-08-11T12:23:39.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.630+0000 7fb84f2f6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559594330a80 0x559594330ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.630+0000 7fb84f2f6b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5595943313e0 0x559594331860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.630+0000 7fb84f2f6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559594331da0 0x559594332220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.630+0000 7fb84f2f6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595942895e0 con 0x559594330a80 2023-08-11T12:23:39.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.630+0000 7fb84f2f6b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559594286f00 con 0x5595943313e0 2023-08-11T12:23:39.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.630+0000 7fb84f2f6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595942827f0 con 0x559594331da0 2023-08-11T12:23:39.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.630+0000 7fb839f9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559594330a80 0x559594330ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.630+0000 7fb839f9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559594330a80 0x559594330ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51624/0 (socket says 172.21.15.8:51624) 2023-08-11T12:23:39.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.630+0000 7fb839f9c700 1 -- 172.21.15.8:0/2309251957 learned_addr learned my addr 172.21.15.8:0/2309251957 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:39.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.630+0000 7fb838f9a700 1 --2- 172.21.15.8:0/2309251957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559594331da0 0x559594332220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.631+0000 7fb839f9c700 1 -- 172.21.15.8:0/2309251957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559594331da0 msgr2=0x559594332220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.631+0000 7fb839f9c700 1 --2- 172.21.15.8:0/2309251957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559594331da0 0x559594332220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.631+0000 7fb82a7fc700 1 -- 172.21.15.8:0/120276820 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fb8300105a0 con 0x7fb834073380 2023-08-11T12:23:39.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.631+0000 7fb839f9c700 1 -- 172.21.15.8:0/2309251957 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5595943313e0 msgr2=0x559594331860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-11T12:23:39.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.631+0000 7fb839f9c700 1 --2- 172.21.15.8:0/2309251957 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5595943313e0 0x559594331860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.631+0000 7fb839f9c700 1 -- 172.21.15.8:0/2309251957 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595941025e0 con 0x559594330a80 2023-08-11T12:23:39.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.631+0000 7fb839f9c700 1 --2- 172.21.15.8:0/2309251957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559594330a80 0x559594330ea0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb82c003eb0 tx=0x7fb82c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c021426f0e9f56a7 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:39.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.631+0000 7fb81f7fe700 1 -- 172.21.15.8:0/2309251957 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c0092d0 con 0x559594330a80 2023-08-11T12:23:39.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.631+0000 7fb81f7fe700 1 -- 172.21.15.8:0/2309251957 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb82c00f040 con 0x559594330a80 2023-08-11T12:23:39.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.631+0000 7fb81f7fe700 1 -- 172.21.15.8:0/2309251957 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c00e750 con 0x559594330a80 2023-08-11T12:23:39.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.632+0000 7fb84f2f6b80 1 -- 172.21.15.8:0/2309251957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559594330a80 msgr2=0x559594330ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.632+0000 7fb84f2f6b80 1 --2- 172.21.15.8:0/2309251957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559594330a80 0x559594330ea0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb82c003eb0 tx=0x7fb82c009920 comp rx=0 tx=0).stop 2023-08-11T12:23:39.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.632+0000 7fb84f2f6b80 1 -- 172.21.15.8:0/2309251957 shutdown_connections 2023-08-11T12:23:39.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.632+0000 7fb84f2f6b80 1 --2- 172.21.15.8:0/2309251957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559594331da0 0x559594332220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.632+0000 7fb84f2f6b80 1 --2- 172.21.15.8:0/2309251957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559594330a80 0x559594330ea0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.632+0000 7fb84f2f6b80 1 --2- 172.21.15.8:0/2309251957 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5595943313e0 0x559594331860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.632+0000 7fb84f2f6b80 1 -- 172.21.15.8:0/2309251957 >> 172.21.15.8:0/2309251957 conn(0x55959425d900 msgr2=0x55959432b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:39.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.632+0000 7fb84f2f6b80 1 -- 172.21.15.8:0/2309251957 shutdown_connections 2023-08-11T12:23:39.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.632+0000 7fb84f2f6b80 1 -- 172.21.15.8:0/2309251957 wait complete. 2023-08-11T12:23:39.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.632+0000 7fb82a7fc700 1 --2- 172.21.15.8:0/120276820 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb82009fe60 0x7fb8200a2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.633+0000 7fb82a7fc700 1 -- 172.21.15.8:0/120276820 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb830014070 con 0x7fb834073380 2023-08-11T12:23:39.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.633+0000 7fb838f9a700 1 --2- 172.21.15.8:0/120276820 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb82009fe60 0x7fb8200a2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.633+0000 7fb84f2f6b80 1 -- start start 2023-08-11T12:23:39.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.633+0000 7fb84f2f6b80 1 Processor -- start 2023-08-11T12:23:39.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.634+0000 7fb838f9a700 1 --2- 172.21.15.8:0/120276820 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb82009fe60 0x7fb8200a2320 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb82400b2e0 tx=0x7fb824005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:39.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.634+0000 7fb84f2f6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559594330a80 0x55959433a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.634+0000 7fb84f2f6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595943313e0 0x55959433a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.634+0000 7fb84f2f6b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559594331da0 0x559594341660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.634+0000 7fb84f2f6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559594220a70 con 0x5595943313e0 2023-08-11T12:23:39.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.634+0000 7fb84f2f6b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559594220770 con 0x559594331da0 2023-08-11T12:23:39.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.634+0000 7fb84f2f6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595941048d0 con 0x559594330a80 2023-08-11T12:23:39.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.634+0000 7fb84f2f6b80 10 client.0 _ll_register_callbacks cb 0x559594223a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:23:39.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.634+0000 7fb838f9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595943313e0 0x55959433a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.634+0000 7fb83979b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559594330a80 0x55959433a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.634+0000 7fb838f9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595943313e0 0x55959433a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51628/0 (socket says 172.21.15.8:51628) 2023-08-11T12:23:39.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.634+0000 7fb838f9a700 1 -- 172.21.15.8:0/950138666 learned_addr learned my addr 172.21.15.8:0/950138666 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:39.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.634+0000 7fb839f9c700 1 --2- 172.21.15.8:0/950138666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559594331da0 0x559594341660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.635+0000 7fb83979b700 1 -- 172.21.15.8:0/950138666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559594331da0 msgr2=0x559594341660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.635+0000 7fb83979b700 1 --2- 172.21.15.8:0/950138666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559594331da0 0x559594341660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.635+0000 7fb83979b700 1 -- 172.21.15.8:0/950138666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595943313e0 msgr2=0x55959433a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.635+0000 7fb83979b700 1 --2- 172.21.15.8:0/950138666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595943313e0 0x55959433a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.635+0000 7fb83979b700 1 -- 172.21.15.8:0/950138666 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82c003b90 con 0x559594330a80 2023-08-11T12:23:39.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.635+0000 7fb838f9a700 1 --2- 172.21.15.8:0/950138666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595943313e0 0x55959433a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:39.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.635+0000 7fb83979b700 1 --2- 172.21.15.8:0/950138666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559594330a80 0x55959433a0e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb83000c2d0 tx=0x7fb830099340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f236b2e6015f3312 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:39.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.635+0000 7fb81cff9700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:23:39.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.635+0000 7fb81cff9700 1 -- 172.21.15.8:0/950138666 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830098e00 con 0x559594330a80 2023-08-11T12:23:39.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.635+0000 7fb84f2f6b80 1 -- 172.21.15.8:0/950138666 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559594323a40 con 0x559594330a80 2023-08-11T12:23:39.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.635+0000 7fb81cff9700 1 -- 172.21.15.8:0/950138666 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb83009cc30 con 0x559594330a80 2023-08-11T12:23:39.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.635+0000 7fb81cff9700 1 -- 172.21.15.8:0/950138666 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8300a0c10 con 0x559594330a80 2023-08-11T12:23:39.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.636+0000 7fb84f2f6b80 10 client.25180 fetch_fsmap learned FSMap version 27 2023-08-11T12:23:39.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.636+0000 7fb84f2f6b80 1 -- 172.21.15.8:0/950138666 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5595940aed90 con 0x559594330a80 2023-08-11T12:23:39.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.636+0000 7fb81cff9700 1 -- 172.21.15.8:0/950138666 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559594323a40 con 0x559594330a80 2023-08-11T12:23:39.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.636+0000 7fb81cff9700 1 -- 172.21.15.8:0/950138666 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb8300a0780 con 0x559594330a80 2023-08-11T12:23:39.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.636+0000 7fb84f2f6b80 10 client.25180 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:23:39.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.636+0000 7fb84f2f6b80 10 client.25180 resolve_mds: resolved name 'f' to daemon mds.f 2023-08-11T12:23:39.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.636+0000 7fb84f2f6b80 20 client.25180 populate_metadata read hostname 'smithi008' 2023-08-11T12:23:39.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.636+0000 7fb84f2f6b80 1 --2- 172.21.15.8:0/950138666 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x559594345bc0 0x5595943447b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.636+0000 7fb84f2f6b80 4 client.25180 mds_command: new command op to 24517 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:23:39.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.636+0000 7fb84f2f6b80 1 -- 172.21.15.8:0/950138666 --> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5595942ff490 con 0x559594345bc0 2023-08-11T12:23:39.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.637+0000 7fb838f9a700 1 --2- 172.21.15.8:0/950138666 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x559594345bc0 0x5595943447b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.637+0000 7fb81cff9700 10 client.25180 ms_handle_connect on v2:172.21.15.194:6834/2457430285 2023-08-11T12:23:39.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.637+0000 7fb838f9a700 1 --2- 172.21.15.8:0/950138666 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x559594345bc0 0x5595943447b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=24adce4a0ace2850 server_cookie=dc21f5bd82947391 in_seq=0 out_seq=0 2023-08-11T12:23:39.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.638+0000 7fb81cff9700 1 -- 172.21.15.8:0/950138666 <== mds.2 v2:172.21.15.194:6834/2457430285 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5595942ff490 con 0x559594345bc0 2023-08-11T12:23:39.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.638+0000 7fb81cff9700 10 client.25180 handle_command_reply: tid=0 2023-08-11T12:23:39.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.638+0000 7fb84f2f6b80 1 client.25180 shutdown 2023-08-11T12:23:39.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.638+0000 7fb84f2f6b80 1 -- 172.21.15.8:0/950138666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559594330a80 msgr2=0x55959433a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.638+0000 7fb84f2f6b80 1 --2- 172.21.15.8:0/950138666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559594330a80 0x55959433a0e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb83000c2d0 tx=0x7fb830099340 comp rx=0 tx=0).stop 2023-08-11T12:23:39.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.639+0000 7fb84f2f6b80 1 -- 172.21.15.8:0/950138666 shutdown_connections 2023-08-11T12:23:39.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.639+0000 7fb84f2f6b80 1 --2- 172.21.15.8:0/950138666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559594330a80 0x55959433a0e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.639+0000 7fb84f2f6b80 1 --2- 172.21.15.8:0/950138666 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x559594345bc0 0x5595943447b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.639+0000 7fb84f2f6b80 1 --2- 172.21.15.8:0/950138666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559594331da0 0x559594341660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.639+0000 7fb81cff9700 0 client.25180 ms_handle_reset on v2:172.21.15.194:6834/2457430285 2023-08-11T12:23:39.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.639+0000 7fb84f2f6b80 1 --2- 172.21.15.8:0/950138666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595943313e0 0x55959433a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.639+0000 7fb84f2f6b80 1 -- 172.21.15.8:0/950138666 >> 172.21.15.8:0/950138666 conn(0x55959425d900 msgr2=0x559594325c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:39.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.639+0000 7fb84f2f6b80 1 -- 172.21.15.8:0/950138666 shutdown_connections 2023-08-11T12:23:39.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.639+0000 7fb84f2f6b80 1 -- 172.21.15.8:0/950138666 wait complete. 2023-08-11T12:23:39.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.639+0000 7fb84f2f6b80 20 client.25180 trim_cache size 0 max 16384 2023-08-11T12:23:39.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.672+0000 7fb84f2f6b80 1 Processor -- start 2023-08-11T12:23:39.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.672+0000 7fb84f2f6b80 1 -- start start 2023-08-11T12:23:39.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.672+0000 7fb84f2f6b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559594330a80 0x5595943447b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.672+0000 7fb84f2f6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5595943313e0 0x559594341620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.672+0000 7fb84f2f6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559594331da0 0x559594344cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.672+0000 7fb84f2f6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595942ff490 con 0x559594331da0 2023-08-11T12:23:39.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.672+0000 7fb84f2f6b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559594110de0 con 0x559594330a80 2023-08-11T12:23:39.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.672+0000 7fb84f2f6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55959424bef0 con 0x5595943313e0 2023-08-11T12:23:39.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.672+0000 7fb839f9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559594331da0 0x559594344cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.672+0000 7fb839f9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559594331da0 0x559594344cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51640/0 (socket says 172.21.15.8:51640) 2023-08-11T12:23:39.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.672+0000 7fb839f9c700 1 -- 172.21.15.8:0/2881232473 learned_addr learned my addr 172.21.15.8:0/2881232473 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:39.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.673+0000 7fb83979b700 1 --2- 172.21.15.8:0/2881232473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559594330a80 0x5595943447b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.673+0000 7fb838f9a700 1 --2- 172.21.15.8:0/2881232473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5595943313e0 0x559594341620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.673+0000 7fb839f9c700 1 -- 172.21.15.8:0/2881232473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5595943313e0 msgr2=0x559594341620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.673+0000 7fb839f9c700 1 --2- 172.21.15.8:0/2881232473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5595943313e0 0x559594341620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.673+0000 7fb839f9c700 1 -- 172.21.15.8:0/2881232473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559594330a80 msgr2=0x5595943447b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.673+0000 7fb839f9c700 1 --2- 172.21.15.8:0/2881232473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559594330a80 0x5595943447b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.673+0000 7fb839f9c700 1 -- 172.21.15.8:0/2881232473 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559594332450 con 0x559594331da0 2023-08-11T12:23:39.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.673+0000 7fb839f9c700 1 --2- 172.21.15.8:0/2881232473 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559594331da0 0x559594344cf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb82c01a000 tx=0x7fb82c009ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dafb1389c7d6d2 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:39.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.673+0000 7fb81ffff700 1 -- 172.21.15.8:0/2881232473 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c004c70 con 0x559594331da0 2023-08-11T12:23:39.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.673+0000 7fb81ffff700 1 -- 172.21.15.8:0/2881232473 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb82c009330 con 0x559594331da0 2023-08-11T12:23:39.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.673+0000 7fb81ffff700 1 -- 172.21.15.8:0/2881232473 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c00e770 con 0x559594331da0 2023-08-11T12:23:39.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.674+0000 7fb84f2f6b80 1 -- 172.21.15.8:0/2881232473 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559594331da0 msgr2=0x559594344cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.674+0000 7fb84f2f6b80 1 --2- 172.21.15.8:0/2881232473 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559594331da0 0x559594344cf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb82c01a000 tx=0x7fb82c009ac0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.674+0000 7fb84f2f6b80 1 -- 172.21.15.8:0/2881232473 shutdown_connections 2023-08-11T12:23:39.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.674+0000 7fb84f2f6b80 1 --2- 172.21.15.8:0/2881232473 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559594331da0 0x559594344cf0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.674+0000 7fb84f2f6b80 1 --2- 172.21.15.8:0/2881232473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559594330a80 0x5595943447b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.674+0000 7fb84f2f6b80 1 --2- 172.21.15.8:0/2881232473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5595943313e0 0x559594341620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.674+0000 7fb84f2f6b80 1 -- 172.21.15.8:0/2881232473 >> 172.21.15.8:0/2881232473 conn(0x55959425d900 msgr2=0x559594334d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:39.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.674+0000 7fb84f2f6b80 1 -- 172.21.15.8:0/2881232473 shutdown_connections 2023-08-11T12:23:39.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.674+0000 7fb84f2f6b80 1 -- 172.21.15.8:0/2881232473 wait complete. 2023-08-11T12:23:39.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.675+0000 7fb84f2f6b80 1 -- start start 2023-08-11T12:23:39.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.675+0000 7fb84f2f6b80 1 Processor -- start 2023-08-11T12:23:39.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.675+0000 7fb84f2f6b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559594330a80 0x5595943365e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.675+0000 7fb84f2f6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5595943313e0 0x5595943415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.675+0000 7fb84f2f6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559594331da0 0x559594336b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.675+0000 7fb84f2f6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559594337140 con 0x559594331da0 2023-08-11T12:23:39.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.675+0000 7fb84f2f6b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559594399430 con 0x559594330a80 2023-08-11T12:23:39.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.675+0000 7fb84f2f6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x559594399570 con 0x5595943313e0 2023-08-11T12:23:39.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.675+0000 7fb84f2f6b80 10 client.0 _ll_register_callbacks cb 0x7fb830098bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:23:39.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.676+0000 7fb838f9a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5595943313e0 0x5595943415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.676+0000 7fb838f9a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5595943313e0 0x5595943415f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:48822/0 (socket says 172.21.15.8:48822) 2023-08-11T12:23:39.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.676+0000 7fb838f9a700 1 -- 172.21.15.8:0/2409482741 learned_addr learned my addr 172.21.15.8:0/2409482741 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:39.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.676+0000 7fb839f9c700 1 --2- 172.21.15.8:0/2409482741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559594331da0 0x559594336b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.676+0000 7fb83979b700 1 --2- 172.21.15.8:0/2409482741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559594330a80 0x5595943365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.676+0000 7fb838f9a700 1 -- 172.21.15.8:0/2409482741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559594330a80 msgr2=0x5595943365e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.676+0000 7fb838f9a700 1 --2- 172.21.15.8:0/2409482741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559594330a80 0x5595943365e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.676+0000 7fb838f9a700 1 -- 172.21.15.8:0/2409482741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559594331da0 msgr2=0x559594336b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.676+0000 7fb838f9a700 1 --2- 172.21.15.8:0/2409482741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559594331da0 0x559594336b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.676+0000 7fb838f9a700 1 -- 172.21.15.8:0/2409482741 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595941025e0 con 0x5595943313e0 2023-08-11T12:23:39.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.676+0000 7fb838f9a700 1 --2- 172.21.15.8:0/2409482741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5595943313e0 0x5595943415f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x55959433b140 tx=0x7fb824009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e7838b953c8b99f server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:39.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.676+0000 7fb81cff9700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:23:39.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.677+0000 7fb81cff9700 1 -- 172.21.15.8:0/2409482741 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb824035040 con 0x5595943313e0 2023-08-11T12:23:39.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.677+0000 7fb84f2f6b80 1 -- 172.21.15.8:0/2409482741 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb82c00f040 con 0x5595943313e0 2023-08-11T12:23:39.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.677+0000 7fb81cff9700 1 -- 172.21.15.8:0/2409482741 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb8240366e0 con 0x5595943313e0 2023-08-11T12:23:39.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.677+0000 7fb81cff9700 1 -- 172.21.15.8:0/2409482741 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb824029040 con 0x5595943313e0 2023-08-11T12:23:39.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.677+0000 7fb84f2f6b80 10 client.25186 fetch_fsmap learned FSMap version 27 2023-08-11T12:23:39.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.677+0000 7fb84f2f6b80 1 -- 172.21.15.8:0/2409482741 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559594097c10 con 0x5595943313e0 2023-08-11T12:23:39.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.677+0000 7fb81cff9700 1 -- 172.21.15.8:0/2409482741 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb82c00f040 con 0x5595943313e0 2023-08-11T12:23:39.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.678+0000 7fb81cff9700 1 -- 172.21.15.8:0/2409482741 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb824024960 con 0x5595943313e0 2023-08-11T12:23:39.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.678+0000 7fb84f2f6b80 10 client.25186 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:23:39.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.678+0000 7fb84f2f6b80 10 client.25186 resolve_mds: resolved name 'f' to daemon mds.f 2023-08-11T12:23:39.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.678+0000 7fb84f2f6b80 20 client.25186 populate_metadata read hostname 'smithi008' 2023-08-11T12:23:39.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.678+0000 7fb84f2f6b80 1 --2- 172.21.15.8:0/2409482741 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x55959439e6a0 0x55959439aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.678+0000 7fb84f2f6b80 4 client.25186 mds_command: new command op to 24517 tid=0[{"prefix": "status"}] 2023-08-11T12:23:39.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.678+0000 7fb84f2f6b80 1 -- 172.21.15.8:0/2409482741 --> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55959427b7d0 con 0x55959439e6a0 2023-08-11T12:23:39.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.678+0000 7fb83979b700 1 --2- 172.21.15.8:0/2409482741 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x55959439e6a0 0x55959439aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.678+0000 7fb83979b700 1 --2- 172.21.15.8:0/2409482741 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x55959439e6a0 0x55959439aae0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=63d7da0450f784d server_cookie=ae46d9fca209f871 in_seq=0 out_seq=0 2023-08-11T12:23:39.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.678+0000 7fb81cff9700 10 client.25186 ms_handle_connect on v2:172.21.15.194:6834/2457430285 2023-08-11T12:23:39.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.679+0000 7fb81cff9700 1 -- 172.21.15.8:0/2409482741 <== mds.2 v2:172.21.15.194:6834/2457430285 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55959427b7d0 con 0x55959439e6a0 2023-08-11T12:23:39.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.679+0000 7fb81cff9700 10 client.25186 handle_command_reply: tid=0 2023-08-11T12:23:39.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.679+0000 7fb84f2f6b80 1 client.25186 shutdown 2023-08-11T12:23:39.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.679+0000 7fb84f2f6b80 1 -- 172.21.15.8:0/2409482741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5595943313e0 msgr2=0x5595943415f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.679+0000 7fb84f2f6b80 1 --2- 172.21.15.8:0/2409482741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5595943313e0 0x5595943415f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x55959433b140 tx=0x7fb824009310 comp rx=0 tx=0).stop 2023-08-11T12:23:39.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.679+0000 7fb84f2f6b80 1 -- 172.21.15.8:0/2409482741 shutdown_connections 2023-08-11T12:23:39.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.679+0000 7fb84f2f6b80 1 --2- 172.21.15.8:0/2409482741 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x55959439e6a0 0x55959439aae0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.679+0000 7fb84f2f6b80 1 --2- 172.21.15.8:0/2409482741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559594331da0 0x559594336b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.679+0000 7fb84f2f6b80 1 --2- 172.21.15.8:0/2409482741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559594330a80 0x5595943365e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.679+0000 7fb81cff9700 0 client.25186 ms_handle_reset on v2:172.21.15.194:6834/2457430285 2023-08-11T12:23:39.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.679+0000 7fb84f2f6b80 1 --2- 172.21.15.8:0/2409482741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5595943313e0 0x5595943415f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.679+0000 7fb84f2f6b80 1 -- 172.21.15.8:0/2409482741 >> 172.21.15.8:0/2409482741 conn(0x55959425d900 msgr2=0x5595943447b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:39.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.679+0000 7fb84f2f6b80 1 -- 172.21.15.8:0/2409482741 shutdown_connections 2023-08-11T12:23:39.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.679+0000 7fb84f2f6b80 1 -- 172.21.15.8:0/2409482741 wait complete. 2023-08-11T12:23:39.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.679+0000 7fb84f2f6b80 20 client.25186 trim_cache size 0 max 16384 2023-08-11T12:23:39.691 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:23:39.691 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "815f94ae-3840-11ee-9b37-001a4aab830c", 2023-08-11T12:23:39.691 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 2, 2023-08-11T12:23:39.691 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24517, 2023-08-11T12:23:39.691 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-08-11T12:23:39.691 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-08-11T12:23:39.691 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-08-11T12:23:39.692 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 70.006383137, 2023-08-11T12:23:39.692 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 27, 2023-08-11T12:23:39.692 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 89, 2023-08-11T12:23:39.692 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 89, 2023-08-11T12:23:39.692 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 117.65665993899999 2023-08-11T12:23:39.692 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:23:39.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.680+0000 7fb83b9ff700 1 -- 172.21.15.8:0/120276820 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb82009fe60 msgr2=0x7fb8200a2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.680+0000 7fb83b9ff700 1 --2- 172.21.15.8:0/120276820 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb82009fe60 0x7fb8200a2320 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb82400b2e0 tx=0x7fb824005fb0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.680+0000 7fb83b9ff700 1 -- 172.21.15.8:0/120276820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb834073380 msgr2=0x7fb83419ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.680+0000 7fb83b9ff700 1 --2- 172.21.15.8:0/120276820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb834073380 0x7fb83419ccf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb83000e9a0 tx=0x7fb83000ecb0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.680+0000 7fb83b9ff700 1 -- 172.21.15.8:0/120276820 shutdown_connections 2023-08-11T12:23:39.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.680+0000 7fb83b9ff700 1 --2- 172.21.15.8:0/120276820 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb82009fe60 0x7fb8200a2320 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.680+0000 7fb83b9ff700 1 --2- 172.21.15.8:0/120276820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb83410cfe0 0x7fb8341a4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.680+0000 7fb83b9ff700 1 --2- 172.21.15.8:0/120276820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb834073380 0x7fb83419ccf0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.680+0000 7fb83b9ff700 1 --2- 172.21.15.8:0/120276820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb834074960 0x7fb83419d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.680+0000 7fb83b9ff700 1 -- 172.21.15.8:0/120276820 >> 172.21.15.8:0/120276820 conn(0x7fb8340fbf80 msgr2=0x7fb8340fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:39.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.680+0000 7fb83b9ff700 1 -- 172.21.15.8:0/120276820 shutdown_connections 2023-08-11T12:23:39.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.680+0000 7fb83b9ff700 1 -- 172.21.15.8:0/120276820 wait complete. 2023-08-11T12:23:39.702 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-08-11T12:23:39.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.913+0000 7f1ae83ff700 1 -- 172.21.15.8:0/2282478947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ae0074960 msgr2=0x7f1ae0072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.913+0000 7f1ae83ff700 1 --2- 172.21.15.8:0/2282478947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ae0074960 0x7f1ae0072db0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1adc0098f0 tx=0x7f1adc009c00 comp rx=0 tx=0).stop 2023-08-11T12:23:39.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.914+0000 7f1ae83ff700 1 -- 172.21.15.8:0/2282478947 shutdown_connections 2023-08-11T12:23:39.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.914+0000 7f1ae83ff700 1 --2- 172.21.15.8:0/2282478947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ae0074960 0x7f1ae0072db0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.914+0000 7f1ae83ff700 1 --2- 172.21.15.8:0/2282478947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ae010cfd0 0x7f1ae010f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.914+0000 7f1ae83ff700 1 --2- 172.21.15.8:0/2282478947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae0073380 0x7f1ae0073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.914+0000 7f1ae83ff700 1 -- 172.21.15.8:0/2282478947 >> 172.21.15.8:0/2282478947 conn(0x7f1ae00fbf70 msgr2=0x7f1ae00fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:39.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.914+0000 7f1ae83ff700 1 -- 172.21.15.8:0/2282478947 shutdown_connections 2023-08-11T12:23:39.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.914+0000 7f1ae83ff700 1 -- 172.21.15.8:0/2282478947 wait complete. 2023-08-11T12:23:39.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.915+0000 7f1ae83ff700 1 Processor -- start 2023-08-11T12:23:39.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.915+0000 7f1ae83ff700 1 -- start start 2023-08-11T12:23:39.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.916+0000 7f1ae83ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae0073380 0x7f1ae019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.916+0000 7f1ae83ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ae0074960 0x7f1ae019d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.916+0000 7f1ae83ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ae010cfd0 0x7f1ae01a4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.916+0000 7f1ae83ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae01a48e0 con 0x7f1ae010cfd0 2023-08-11T12:23:39.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.916+0000 7f1ae83ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae01a4a20 con 0x7f1ae0073380 2023-08-11T12:23:39.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.916+0000 7f1ae83ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae01a4bb0 con 0x7f1ae0074960 2023-08-11T12:23:39.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.916+0000 7f1ae619b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae0073380 0x7f1ae019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.916+0000 7f1ae619b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae0073380 0x7f1ae019cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:60452/0 (socket says 172.21.15.8:60452) 2023-08-11T12:23:39.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.916+0000 7f1ae619b700 1 -- 172.21.15.8:0/1899447575 learned_addr learned my addr 172.21.15.8:0/1899447575 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:39.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.916+0000 7f1ae699c700 1 --2- 172.21.15.8:0/1899447575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ae010cfd0 0x7f1ae01a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.916+0000 7f1ae599a700 1 --2- 172.21.15.8:0/1899447575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ae0074960 0x7f1ae019d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.916+0000 7f1ae619b700 1 -- 172.21.15.8:0/1899447575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ae0074960 msgr2=0x7f1ae019d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.916+0000 7f1ae619b700 1 --2- 172.21.15.8:0/1899447575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ae0074960 0x7f1ae019d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.917+0000 7f1ae619b700 1 -- 172.21.15.8:0/1899447575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ae010cfd0 msgr2=0x7f1ae01a4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.917+0000 7f1ae619b700 1 --2- 172.21.15.8:0/1899447575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ae010cfd0 0x7f1ae01a4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.917+0000 7f1ae619b700 1 -- 172.21.15.8:0/1899447575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1adc009520 con 0x7f1ae0073380 2023-08-11T12:23:39.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.917+0000 7f1ae599a700 1 --2- 172.21.15.8:0/1899447575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ae0074960 0x7f1ae019d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:23:39.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.917+0000 7f1ae619b700 1 --2- 172.21.15.8:0/1899447575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae0073380 0x7f1ae019cd60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1adc009fd0 tx=0x7f1adc00b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:39.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.917+0000 7f1ad77fe700 1 -- 172.21.15.8:0/1899447575 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc01c070 con 0x7f1ae0073380 2023-08-11T12:23:39.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.917+0000 7f1ae83ff700 1 -- 172.21.15.8:0/1899447575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae01a4e30 con 0x7f1ae0073380 2023-08-11T12:23:39.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.917+0000 7f1ad77fe700 1 -- 172.21.15.8:0/1899447575 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1adc00f7d0 con 0x7f1ae0073380 2023-08-11T12:23:39.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.917+0000 7f1ad77fe700 1 -- 172.21.15.8:0/1899447575 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc004b90 con 0x7f1ae0073380 2023-08-11T12:23:39.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.917+0000 7f1ae83ff700 1 -- 172.21.15.8:0/1899447575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae01a51a0 con 0x7f1ae0073380 2023-08-11T12:23:39.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.921+0000 7f1afbd4bb80 1 Processor -- start 2023-08-11T12:23:39.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.922+0000 7f1afbd4bb80 1 -- start start 2023-08-11T12:23:39.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.922+0000 7f1afbd4bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f2cf84a80 0x562f2cf84ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.922+0000 7f1afbd4bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562f2cf853e0 0x562f2cf85860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.922+0000 7f1afbd4bb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f2cf85da0 0x562f2cf86220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.922+0000 7f1afbd4bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f2cedd5e0 con 0x562f2cf84a80 2023-08-11T12:23:39.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.922+0000 7f1afbd4bb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f2cedaf00 con 0x562f2cf85da0 2023-08-11T12:23:39.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.922+0000 7f1afbd4bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f2ced67f0 con 0x562f2cf853e0 2023-08-11T12:23:39.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.922+0000 7f1ae699c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f2cf84a80 0x562f2cf84ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.922+0000 7f1ae599a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f2cf85da0 0x562f2cf86220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.922+0000 7f1ae599a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f2cf85da0 0x562f2cf86220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:60458/0 (socket says 172.21.15.8:60458) 2023-08-11T12:23:39.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.922+0000 7f1ae599a700 1 -- 172.21.15.8:0/2540922277 learned_addr learned my addr 172.21.15.8:0/2540922277 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:39.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.922+0000 7f1ad77fe700 1 -- 172.21.15.8:0/1899447575 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f1adc020070 con 0x7f1ae0073380 2023-08-11T12:23:39.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.923+0000 7f1ae599a700 1 -- 172.21.15.8:0/2540922277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562f2cf853e0 msgr2=0x562f2cf85860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.923+0000 7f1ae599a700 1 --2- 172.21.15.8:0/2540922277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562f2cf853e0 0x562f2cf85860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.923+0000 7f1ae599a700 1 -- 172.21.15.8:0/2540922277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f2cf84a80 msgr2=0x562f2cf84ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.923+0000 7f1ae599a700 1 --2- 172.21.15.8:0/2540922277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f2cf84a80 0x562f2cf84ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.923+0000 7f1ae599a700 1 -- 172.21.15.8:0/2540922277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f2cd565e0 con 0x562f2cf85da0 2023-08-11T12:23:39.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.923+0000 7f1ae699c700 1 --2- 172.21.15.8:0/2540922277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f2cf84a80 0x562f2cf84ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:39.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.923+0000 7f1ae599a700 1 --2- 172.21.15.8:0/2540922277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f2cf85da0 0x562f2cf86220 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0009d60 tx=0x7f1ad00116c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab4ca289bb575d7 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:39.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.923+0000 7f1ad4bfe700 1 -- 172.21.15.8:0/2540922277 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad0011dc0 con 0x562f2cf85da0 2023-08-11T12:23:39.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.923+0000 7f1ad4bfe700 1 -- 172.21.15.8:0/2540922277 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1ad0012910 con 0x562f2cf85da0 2023-08-11T12:23:39.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.923+0000 7f1ad4bfe700 1 -- 172.21.15.8:0/2540922277 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad000f7c0 con 0x562f2cf85da0 2023-08-11T12:23:39.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.924+0000 7f1afbd4bb80 1 -- 172.21.15.8:0/2540922277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f2cf85da0 msgr2=0x562f2cf86220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.924+0000 7f1afbd4bb80 1 --2- 172.21.15.8:0/2540922277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f2cf85da0 0x562f2cf86220 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0009d60 tx=0x7f1ad00116c0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.924+0000 7f1afbd4bb80 1 -- 172.21.15.8:0/2540922277 shutdown_connections 2023-08-11T12:23:39.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.924+0000 7f1afbd4bb80 1 --2- 172.21.15.8:0/2540922277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f2cf85da0 0x562f2cf86220 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.924+0000 7f1afbd4bb80 1 --2- 172.21.15.8:0/2540922277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f2cf84a80 0x562f2cf84ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.924+0000 7f1afbd4bb80 1 --2- 172.21.15.8:0/2540922277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562f2cf853e0 0x562f2cf85860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.924+0000 7f1afbd4bb80 1 -- 172.21.15.8:0/2540922277 >> 172.21.15.8:0/2540922277 conn(0x562f2ceb1900 msgr2=0x562f2cf7f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:39.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.924+0000 7f1afbd4bb80 1 -- 172.21.15.8:0/2540922277 shutdown_connections 2023-08-11T12:23:39.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.924+0000 7f1afbd4bb80 1 -- 172.21.15.8:0/2540922277 wait complete. 2023-08-11T12:23:39.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.925+0000 7f1afbd4bb80 1 -- start start 2023-08-11T12:23:39.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.925+0000 7f1ad77fe700 1 --2- 172.21.15.8:0/1899447575 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f1acc09fe10 0x7f1acc0a22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.925+0000 7f1afbd4bb80 1 Processor -- start 2023-08-11T12:23:39.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.925+0000 7f1ad77fe700 1 -- 172.21.15.8:0/1899447575 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f1adc0cc280 con 0x7f1ae0073380 2023-08-11T12:23:39.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.925+0000 7f1ae699c700 1 --2- 172.21.15.8:0/1899447575 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f1acc09fe10 0x7f1acc0a22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.926+0000 7f1afbd4bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562f2cf84a80 0x562f2cf8e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.926+0000 7f1afbd4bb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f2cf853e0 0x562f2cf8e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.926+0000 7f1afbd4bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f2cf85da0 0x562f2cf956c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.926+0000 7f1afbd4bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f2ce74a70 con 0x562f2cf85da0 2023-08-11T12:23:39.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.926+0000 7f1afbd4bb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f2ce74770 con 0x562f2cf853e0 2023-08-11T12:23:39.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.926+0000 7f1afbd4bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f2cd588d0 con 0x562f2cf84a80 2023-08-11T12:23:39.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.926+0000 7f1afbd4bb80 10 client.0 _ll_register_callbacks cb 0x562f2ce77a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:23:39.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.926+0000 7f1ae699c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f2cf85da0 0x562f2cf956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.926+0000 7f1ae699c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f2cf85da0 0x562f2cf956c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51684/0 (socket says 172.21.15.8:51684) 2023-08-11T12:23:39.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.926+0000 7f1ae699c700 1 -- 172.21.15.8:0/3785371959 learned_addr learned my addr 172.21.15.8:0/3785371959 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:39.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.926+0000 7f1ae599a700 1 --2- 172.21.15.8:0/3785371959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f2cf853e0 0x562f2cf8e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.926+0000 7f1ae699c700 1 --2- 172.21.15.8:0/1899447575 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f1acc09fe10 0x7f1acc0a22d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80095a0 tx=0x7f1ad800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:39.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.927+0000 7f1ae599a700 1 -- 172.21.15.8:0/3785371959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562f2cf84a80 msgr2=0x562f2cf8e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.927+0000 7f1ae599a700 1 --2- 172.21.15.8:0/3785371959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562f2cf84a80 0x562f2cf8e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.927+0000 7f1ae599a700 1 -- 172.21.15.8:0/3785371959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f2cf85da0 msgr2=0x562f2cf956c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.927+0000 7f1ae599a700 1 --2- 172.21.15.8:0/3785371959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f2cf85da0 0x562f2cf956c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.927+0000 7f1ae599a700 1 -- 172.21.15.8:0/3785371959 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad8011230 con 0x562f2cf853e0 2023-08-11T12:23:39.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.927+0000 7f1ae699c700 1 --2- 172.21.15.8:0/3785371959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f2cf85da0 0x562f2cf956c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:39.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.927+0000 7f1ae599a700 1 --2- 172.21.15.8:0/3785371959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f2cf853e0 0x562f2cf8e680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0012f90 tx=0x7f1ad0012df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb2f906c12a9e0e server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:39.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.927+0000 7f1ac9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:23:39.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.927+0000 7f1ac9ffb700 1 -- 172.21.15.8:0/3785371959 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad0005070 con 0x562f2cf853e0 2023-08-11T12:23:39.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.927+0000 7f1afbd4bb80 1 -- 172.21.15.8:0/3785371959 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562f2cf77a40 con 0x562f2cf853e0 2023-08-11T12:23:39.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.927+0000 7f1ac9ffb700 1 -- 172.21.15.8:0/3785371959 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f1ad00051d0 con 0x562f2cf853e0 2023-08-11T12:23:39.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.928+0000 7f1ac9ffb700 1 -- 172.21.15.8:0/3785371959 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ad0005390 con 0x562f2cf853e0 2023-08-11T12:23:39.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.928+0000 7f1afbd4bb80 10 client.25181 fetch_fsmap learned FSMap version 27 2023-08-11T12:23:39.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.928+0000 7f1afbd4bb80 1 -- 172.21.15.8:0/3785371959 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f1ad0009990 con 0x562f2cf853e0 2023-08-11T12:23:39.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.928+0000 7f1ac9ffb700 1 -- 172.21.15.8:0/3785371959 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562f2cf77a40 con 0x562f2cf853e0 2023-08-11T12:23:39.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.928+0000 7f1ac9ffb700 1 -- 172.21.15.8:0/3785371959 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1ad0022070 con 0x562f2cf853e0 2023-08-11T12:23:39.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.928+0000 7f1afbd4bb80 10 client.25181 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:23:39.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.928+0000 7f1afbd4bb80 10 client.25181 resolve_mds: resolved name 'i' to daemon mds.i 2023-08-11T12:23:39.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.928+0000 7f1afbd4bb80 20 client.25181 populate_metadata read hostname 'smithi008' 2023-08-11T12:23:39.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.928+0000 7f1afbd4bb80 1 --2- 172.21.15.8:0/3785371959 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x562f2cf99ce0 0x562f2cf98760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.928+0000 7f1afbd4bb80 4 client.25181 mds_command: new command op to 24550 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:23:39.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.928+0000 7f1afbd4bb80 1 -- 172.21.15.8:0/3785371959 --> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562f2cf53490 con 0x562f2cf99ce0 2023-08-11T12:23:39.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.929+0000 7f1ae619b700 1 --2- 172.21.15.8:0/3785371959 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x562f2cf99ce0 0x562f2cf98760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.929+0000 7f1ae619b700 1 --2- 172.21.15.8:0/3785371959 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x562f2cf99ce0 0x562f2cf98760 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dd7c49999f9a8832 server_cookie=4fcbf632eff29c31 in_seq=0 out_seq=0 2023-08-11T12:23:39.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.929+0000 7f1ac9ffb700 10 client.25181 ms_handle_connect on v2:172.21.15.194:6838/2174476491 2023-08-11T12:23:39.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.930+0000 7f1ac9ffb700 1 -- 172.21.15.8:0/3785371959 <== mds.1 v2:172.21.15.194:6838/2174476491 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x562f2cf53490 con 0x562f2cf99ce0 2023-08-11T12:23:39.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.930+0000 7f1ac9ffb700 10 client.25181 handle_command_reply: tid=0 2023-08-11T12:23:39.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.930+0000 7f1afbd4bb80 1 client.25181 shutdown 2023-08-11T12:23:39.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.930+0000 7f1afbd4bb80 1 -- 172.21.15.8:0/3785371959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f2cf853e0 msgr2=0x562f2cf8e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.930+0000 7f1afbd4bb80 1 --2- 172.21.15.8:0/3785371959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f2cf853e0 0x562f2cf8e680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0012f90 tx=0x7f1ad0012df0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.930+0000 7f1afbd4bb80 1 -- 172.21.15.8:0/3785371959 shutdown_connections 2023-08-11T12:23:39.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.930+0000 7f1afbd4bb80 1 --2- 172.21.15.8:0/3785371959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562f2cf84a80 0x562f2cf8e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.930+0000 7f1afbd4bb80 1 --2- 172.21.15.8:0/3785371959 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x562f2cf99ce0 0x562f2cf98760 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.930+0000 7f1afbd4bb80 1 --2- 172.21.15.8:0/3785371959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f2cf85da0 0x562f2cf956c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.930+0000 7f1afbd4bb80 1 --2- 172.21.15.8:0/3785371959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f2cf853e0 0x562f2cf8e680 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.930+0000 7f1afbd4bb80 1 -- 172.21.15.8:0/3785371959 >> 172.21.15.8:0/3785371959 conn(0x562f2ceb1900 msgr2=0x562f2cf79c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:39.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.930+0000 7f1ac9ffb700 0 client.25181 ms_handle_reset on v2:172.21.15.194:6838/2174476491 2023-08-11T12:23:39.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.931+0000 7f1afbd4bb80 1 -- 172.21.15.8:0/3785371959 shutdown_connections 2023-08-11T12:23:39.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.931+0000 7f1afbd4bb80 1 -- 172.21.15.8:0/3785371959 wait complete. 2023-08-11T12:23:39.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.931+0000 7f1afbd4bb80 20 client.25181 trim_cache size 0 max 16384 2023-08-11T12:23:39.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.955+0000 7f1afbd4bb80 1 Processor -- start 2023-08-11T12:23:39.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.955+0000 7f1afbd4bb80 1 -- start start 2023-08-11T12:23:39.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.956+0000 7f1afbd4bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562f2cf84a80 0x562f2cf7f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.956+0000 7f1afbd4bb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f2cf853e0 0x562f2cf7f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.956+0000 7f1afbd4bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f2cf85da0 0x562f2cf95680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.956+0000 7f1afbd4bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f2ce93480 con 0x562f2cf85da0 2023-08-11T12:23:39.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.956+0000 7f1afbd4bb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f2cf77a20 con 0x562f2cf853e0 2023-08-11T12:23:39.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.956+0000 7f1afbd4bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f2cf7bd90 con 0x562f2cf84a80 2023-08-11T12:23:39.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.956+0000 7f1ae699c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f2cf85da0 0x562f2cf95680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.956+0000 7f1ae699c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f2cf85da0 0x562f2cf95680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51694/0 (socket says 172.21.15.8:51694) 2023-08-11T12:23:39.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.956+0000 7f1ae699c700 1 -- 172.21.15.8:0/1526689509 learned_addr learned my addr 172.21.15.8:0/1526689509 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:39.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.956+0000 7f1ae619b700 1 --2- 172.21.15.8:0/1526689509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562f2cf84a80 0x562f2cf7f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.956+0000 7f1ae599a700 1 --2- 172.21.15.8:0/1526689509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f2cf853e0 0x562f2cf7f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.957+0000 7f1ae699c700 1 -- 172.21.15.8:0/1526689509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562f2cf84a80 msgr2=0x562f2cf7f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.957+0000 7f1ae699c700 1 --2- 172.21.15.8:0/1526689509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562f2cf84a80 0x562f2cf7f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.957+0000 7f1ae699c700 1 -- 172.21.15.8:0/1526689509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f2cf853e0 msgr2=0x562f2cf7f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.957+0000 7f1ae699c700 1 --2- 172.21.15.8:0/1526689509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f2cf853e0 0x562f2cf7f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.957+0000 7f1ae699c700 1 -- 172.21.15.8:0/1526689509 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f2cd02d90 con 0x562f2cf85da0 2023-08-11T12:23:39.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.957+0000 7f1ae599a700 1 --2- 172.21.15.8:0/1526689509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f2cf853e0 0x562f2cf7f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:39.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.957+0000 7f1ae619b700 1 --2- 172.21.15.8:0/1526689509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562f2cf84a80 0x562f2cf7f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:39.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.957+0000 7f1ae699c700 1 --2- 172.21.15.8:0/1526689509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f2cf85da0 0x562f2cf95680 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8016c30 tx=0x7f1ad8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=616f7236b1aa9371 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:39.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.957+0000 7f1ad53ff700 1 -- 172.21.15.8:0/1526689509 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad800e040 con 0x562f2cf85da0 2023-08-11T12:23:39.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.957+0000 7f1ad53ff700 1 -- 172.21.15.8:0/1526689509 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1ad800f040 con 0x562f2cf85da0 2023-08-11T12:23:39.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.957+0000 7f1ad53ff700 1 -- 172.21.15.8:0/1526689509 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8023ca0 con 0x562f2cf85da0 2023-08-11T12:23:39.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.958+0000 7f1afbd4bb80 1 -- 172.21.15.8:0/1526689509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f2cf85da0 msgr2=0x562f2cf95680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.958+0000 7f1afbd4bb80 1 --2- 172.21.15.8:0/1526689509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f2cf85da0 0x562f2cf95680 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8016c30 tx=0x7f1ad8017000 comp rx=0 tx=0).stop 2023-08-11T12:23:39.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.958+0000 7f1afbd4bb80 1 -- 172.21.15.8:0/1526689509 shutdown_connections 2023-08-11T12:23:39.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.958+0000 7f1afbd4bb80 1 --2- 172.21.15.8:0/1526689509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562f2cf84a80 0x562f2cf7f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.958+0000 7f1afbd4bb80 1 --2- 172.21.15.8:0/1526689509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f2cf85da0 0x562f2cf95680 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.958+0000 7f1afbd4bb80 1 --2- 172.21.15.8:0/1526689509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f2cf853e0 0x562f2cf7f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.958+0000 7f1afbd4bb80 1 -- 172.21.15.8:0/1526689509 >> 172.21.15.8:0/1526689509 conn(0x562f2ceb1900 msgr2=0x562f2cf88ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:39.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.958+0000 7f1afbd4bb80 1 -- 172.21.15.8:0/1526689509 shutdown_connections 2023-08-11T12:23:39.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.958+0000 7f1afbd4bb80 1 -- 172.21.15.8:0/1526689509 wait complete. 2023-08-11T12:23:39.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.958+0000 7f1afbd4bb80 1 -- start start 2023-08-11T12:23:39.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.959+0000 7f1afbd4bb80 1 Processor -- start 2023-08-11T12:23:39.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.959+0000 7f1afbd4bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562f2cf84a80 0x562f2cf8fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.959+0000 7f1afbd4bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f2cf853e0 0x562f2cf903a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.959+0000 7f1afbd4bb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f2cf85da0 0x562f2cf953d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.959+0000 7f1afbd4bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f2cf95910 con 0x562f2cf853e0 2023-08-11T12:23:39.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.959+0000 7f1afbd4bb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f2cf95a80 con 0x562f2cf85da0 2023-08-11T12:23:39.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.959+0000 7f1afbd4bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f2cfed550 con 0x562f2cf84a80 2023-08-11T12:23:39.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.959+0000 7f1afbd4bb80 10 client.0 _ll_register_callbacks cb 0x7f1ad8009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:23:39.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.959+0000 7f1ae599a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f2cf853e0 0x562f2cf903a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.959+0000 7f1ae619b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562f2cf84a80 0x562f2cf8fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.959+0000 7f1ae599a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f2cf853e0 0x562f2cf903a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51702/0 (socket says 172.21.15.8:51702) 2023-08-11T12:23:39.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.960+0000 7f1ae599a700 1 -- 172.21.15.8:0/506014691 learned_addr learned my addr 172.21.15.8:0/506014691 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:39.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.960+0000 7f1ae699c700 1 --2- 172.21.15.8:0/506014691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f2cf85da0 0x562f2cf953d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.960+0000 7f1ae599a700 1 -- 172.21.15.8:0/506014691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562f2cf84a80 msgr2=0x562f2cf8fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.960+0000 7f1ae599a700 1 --2- 172.21.15.8:0/506014691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562f2cf84a80 0x562f2cf8fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.960+0000 7f1ae599a700 1 -- 172.21.15.8:0/506014691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f2cf85da0 msgr2=0x562f2cf953d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:39.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.960+0000 7f1ae599a700 1 --2- 172.21.15.8:0/506014691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f2cf85da0 0x562f2cf953d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.960+0000 7f1ae599a700 1 -- 172.21.15.8:0/506014691 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae01a51a0 con 0x562f2cf853e0 2023-08-11T12:23:39.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.960+0000 7f1ae599a700 1 --2- 172.21.15.8:0/506014691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f2cf853e0 0x562f2cf903a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x562f2cf7bf30 tx=0x7f1ad000f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d4d5999ad4024f server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:39.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.960+0000 7f1ac9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:23:39.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.960+0000 7f1ac9ffb700 1 -- 172.21.15.8:0/506014691 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad00092d0 con 0x562f2cf853e0 2023-08-11T12:23:39.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.960+0000 7f1afbd4bb80 1 -- 172.21.15.8:0/506014691 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1ad0012910 con 0x562f2cf853e0 2023-08-11T12:23:39.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.960+0000 7f1ac9ffb700 1 -- 172.21.15.8:0/506014691 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f1ad0000e40 con 0x562f2cf853e0 2023-08-11T12:23:39.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.961+0000 7f1ac9ffb700 1 -- 172.21.15.8:0/506014691 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ad0012450 con 0x562f2cf853e0 2023-08-11T12:23:39.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.961+0000 7f1afbd4bb80 10 client.15165 fetch_fsmap learned FSMap version 27 2023-08-11T12:23:39.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.961+0000 7f1afbd4bb80 1 -- 172.21.15.8:0/506014691 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f1ad0009990 con 0x562f2cf853e0 2023-08-11T12:23:39.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.961+0000 7f1ac9ffb700 1 -- 172.21.15.8:0/506014691 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1ad0012910 con 0x562f2cf853e0 2023-08-11T12:23:39.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.961+0000 7f1ac9ffb700 1 -- 172.21.15.8:0/506014691 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1ad0011730 con 0x562f2cf853e0 2023-08-11T12:23:39.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.961+0000 7f1afbd4bb80 10 client.15165 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:23:39.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.961+0000 7f1afbd4bb80 10 client.15165 resolve_mds: resolved name 'i' to daemon mds.i 2023-08-11T12:23:39.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.961+0000 7f1afbd4bb80 20 client.15165 populate_metadata read hostname 'smithi008' 2023-08-11T12:23:39.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.961+0000 7f1afbd4bb80 1 --2- 172.21.15.8:0/506014691 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x562f2cff2470 0x562f2cfee8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:39.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.961+0000 7f1afbd4bb80 4 client.15165 mds_command: new command op to 24550 tid=0[{"prefix": "status"}] 2023-08-11T12:23:39.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.961+0000 7f1afbd4bb80 1 -- 172.21.15.8:0/506014691 --> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562f2cecf7d0 con 0x562f2cff2470 2023-08-11T12:23:39.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.962+0000 7f1ae619b700 1 --2- 172.21.15.8:0/506014691 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x562f2cff2470 0x562f2cfee8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:39.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.962+0000 7f1ae619b700 1 --2- 172.21.15.8:0/506014691 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x562f2cff2470 0x562f2cfee8f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e51ccbf776b65931 server_cookie=b13b432c0e83b1b4 in_seq=0 out_seq=0 2023-08-11T12:23:39.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.962+0000 7f1ac9ffb700 10 client.15165 ms_handle_connect on v2:172.21.15.194:6838/2174476491 2023-08-11T12:23:39.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.962+0000 7f1ac9ffb700 1 -- 172.21.15.8:0/506014691 <== mds.1 v2:172.21.15.194:6838/2174476491 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x562f2cecf7d0 con 0x562f2cff2470 2023-08-11T12:23:39.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.962+0000 7f1ac9ffb700 10 client.15165 handle_command_reply: tid=0 2023-08-11T12:23:39.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.962+0000 7f1afbd4bb80 1 client.15165 shutdown 2023-08-11T12:23:39.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.962+0000 7f1afbd4bb80 1 -- 172.21.15.8:0/506014691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f2cf853e0 msgr2=0x562f2cf903a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.962+0000 7f1afbd4bb80 1 --2- 172.21.15.8:0/506014691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f2cf853e0 0x562f2cf903a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x562f2cf7bf30 tx=0x7f1ad000f7a0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.962+0000 7f1afbd4bb80 1 -- 172.21.15.8:0/506014691 shutdown_connections 2023-08-11T12:23:39.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.962+0000 7f1afbd4bb80 1 --2- 172.21.15.8:0/506014691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562f2cf84a80 0x562f2cf8fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.962+0000 7f1afbd4bb80 1 --2- 172.21.15.8:0/506014691 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x562f2cff2470 0x562f2cfee8f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.963+0000 7f1afbd4bb80 1 --2- 172.21.15.8:0/506014691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f2cf85da0 0x562f2cf953d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.963+0000 7f1afbd4bb80 1 --2- 172.21.15.8:0/506014691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f2cf853e0 0x562f2cf903a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.963+0000 7f1afbd4bb80 1 -- 172.21.15.8:0/506014691 >> 172.21.15.8:0/506014691 conn(0x562f2ceb1900 msgr2=0x562f2cf7f310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:39.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.963+0000 7f1ac9ffb700 0 client.15165 ms_handle_reset on v2:172.21.15.194:6838/2174476491 2023-08-11T12:23:39.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.963+0000 7f1afbd4bb80 1 -- 172.21.15.8:0/506014691 shutdown_connections 2023-08-11T12:23:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.963+0000 7f1afbd4bb80 1 -- 172.21.15.8:0/506014691 wait complete. 2023-08-11T12:23:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.963+0000 7f1afbd4bb80 20 client.15165 trim_cache size 0 max 16384 2023-08-11T12:23:39.976 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:23:39.976 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "815f94ae-3840-11ee-9b37-001a4aab830c", 2023-08-11T12:23:39.976 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 1, 2023-08-11T12:23:39.977 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24550, 2023-08-11T12:23:39.977 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-08-11T12:23:39.977 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-08-11T12:23:39.977 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-08-11T12:23:39.977 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 71.250494314999997, 2023-08-11T12:23:39.977 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 27, 2023-08-11T12:23:39.977 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 89, 2023-08-11T12:23:39.977 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 89, 2023-08-11T12:23:39.978 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 111.170901965 2023-08-11T12:23:39.978 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:23:39.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.963+0000 7f1ae83ff700 1 -- 172.21.15.8:0/1899447575 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f1acc09fe10 msgr2=0x7f1acc0a22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.963+0000 7f1ae83ff700 1 --2- 172.21.15.8:0/1899447575 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f1acc09fe10 0x7f1acc0a22d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80095a0 tx=0x7f1ad800b040 comp rx=0 tx=0).stop 2023-08-11T12:23:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.963+0000 7f1ae83ff700 1 -- 172.21.15.8:0/1899447575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae0073380 msgr2=0x7f1ae019cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.963+0000 7f1ae83ff700 1 --2- 172.21.15.8:0/1899447575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae0073380 0x7f1ae019cd60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1adc009fd0 tx=0x7f1adc00b790 comp rx=0 tx=0).stop 2023-08-11T12:23:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.963+0000 7f1ae83ff700 1 -- 172.21.15.8:0/1899447575 shutdown_connections 2023-08-11T12:23:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.963+0000 7f1ae83ff700 1 --2- 172.21.15.8:0/1899447575 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f1acc09fe10 0x7f1acc0a22d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.963+0000 7f1ae83ff700 1 --2- 172.21.15.8:0/1899447575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ae010cfd0 0x7f1ae01a4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.963+0000 7f1ae83ff700 1 --2- 172.21.15.8:0/1899447575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae0073380 0x7f1ae019cd60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.963+0000 7f1ae83ff700 1 --2- 172.21.15.8:0/1899447575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ae0074960 0x7f1ae019d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.963+0000 7f1ae83ff700 1 -- 172.21.15.8:0/1899447575 >> 172.21.15.8:0/1899447575 conn(0x7f1ae00fbf70 msgr2=0x7f1ae00fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.964+0000 7f1ae83ff700 1 -- 172.21.15.8:0/1899447575 shutdown_connections 2023-08-11T12:23:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:39.964+0000 7f1ae83ff700 1 -- 172.21.15.8:0/1899447575 wait complete. 2023-08-11T12:23:39.988 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-08-11T12:23:40.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.198+0000 7f78e4bff700 1 -- 172.21.15.8:0/4235779818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e0101bf0 msgr2=0x7f78e0102050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.198+0000 7f78e4bff700 1 --2- 172.21.15.8:0/4235779818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e0101bf0 0x7f78e0102050 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f78d4009920 tx=0x7f78d4009c30 comp rx=0 tx=0).stop 2023-08-11T12:23:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.198+0000 7f78e4bff700 1 -- 172.21.15.8:0/4235779818 shutdown_connections 2023-08-11T12:23:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.198+0000 7f78e4bff700 1 --2- 172.21.15.8:0/4235779818 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78e0100a00 0x7f78e0100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.198+0000 7f78e4bff700 1 --2- 172.21.15.8:0/4235779818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78e0102590 0x7f78e0108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.198+0000 7f78e4bff700 1 --2- 172.21.15.8:0/4235779818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e0101bf0 0x7f78e0102050 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.198+0000 7f78e4bff700 1 -- 172.21.15.8:0/4235779818 >> 172.21.15.8:0/4235779818 conn(0x7f78e00fbf70 msgr2=0x7f78e00fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:40.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.199+0000 7f78e4bff700 1 -- 172.21.15.8:0/4235779818 shutdown_connections 2023-08-11T12:23:40.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.199+0000 7f78e4bff700 1 -- 172.21.15.8:0/4235779818 wait complete. 2023-08-11T12:23:40.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.200+0000 7f78e4bff700 1 Processor -- start 2023-08-11T12:23:40.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.200+0000 7f78e4bff700 1 -- start start 2023-08-11T12:23:40.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.200+0000 7f78e4bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78e0100a00 0x7f78e00746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:40.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.200+0000 7f78e4bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78e0101bf0 0x7f78e0072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:40.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.200+0000 7f78e4bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e0102590 0x7f78e0073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:40.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.200+0000 7f78e4bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e00739f0 con 0x7f78e0100a00 2023-08-11T12:23:40.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.200+0000 7f78e4bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e0073b60 con 0x7f78e0102590 2023-08-11T12:23:40.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.200+0000 7f78e4bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e01a0820 con 0x7f78e0101bf0 2023-08-11T12:23:40.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.201+0000 7f78de59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78e0100a00 0x7f78e00746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:40.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.201+0000 7f78de59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78e0100a00 0x7f78e00746d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51714/0 (socket says 172.21.15.8:51714) 2023-08-11T12:23:40.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.201+0000 7f78de59c700 1 -- 172.21.15.8:0/3846168952 learned_addr learned my addr 172.21.15.8:0/3846168952 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:40.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.201+0000 7f78ddd9b700 1 --2- 172.21.15.8:0/3846168952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78e0101bf0 0x7f78e0072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:40.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.201+0000 7f78ded9d700 1 --2- 172.21.15.8:0/3846168952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e0102590 0x7f78e0073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:40.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.201+0000 7f78ddd9b700 1 -- 172.21.15.8:0/3846168952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e0102590 msgr2=0x7f78e0073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:40.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.201+0000 7f78ddd9b700 1 --2- 172.21.15.8:0/3846168952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e0102590 0x7f78e0073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.201+0000 7f78ddd9b700 1 -- 172.21.15.8:0/3846168952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78e0100a00 msgr2=0x7f78e00746d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:40.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.201+0000 7f78ddd9b700 1 --2- 172.21.15.8:0/3846168952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78e0100a00 0x7f78e00746d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.201+0000 7f78ddd9b700 1 -- 172.21.15.8:0/3846168952 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d0009520 con 0x7f78e0101bf0 2023-08-11T12:23:40.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.201+0000 7f78de59c700 1 --2- 172.21.15.8:0/3846168952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78e0100a00 0x7f78e00746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:40.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.201+0000 7f78ddd9b700 1 --2- 172.21.15.8:0/3846168952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78e0101bf0 0x7f78e0072d10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f78d4000c00 tx=0x7f78d400b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:40.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.202+0000 7f78cf7fe700 1 -- 172.21.15.8:0/3846168952 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d401c070 con 0x7f78e0101bf0 2023-08-11T12:23:40.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.202+0000 7f78cf7fe700 1 -- 172.21.15.8:0/3846168952 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78d400f7d0 con 0x7f78e0101bf0 2023-08-11T12:23:40.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.202+0000 7f78cf7fe700 1 -- 172.21.15.8:0/3846168952 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d40038e0 con 0x7f78e0101bf0 2023-08-11T12:23:40.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.202+0000 7f78e4bff700 1 -- 172.21.15.8:0/3846168952 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d8009d00 con 0x7f78e0101bf0 2023-08-11T12:23:40.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.202+0000 7f78e4bff700 1 -- 172.21.15.8:0/3846168952 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d4009520 con 0x7f78e0101bf0 2023-08-11T12:23:40.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.207+0000 7f78cf7fe700 1 -- 172.21.15.8:0/3846168952 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f78d4020030 con 0x7f78e0101bf0 2023-08-11T12:23:40.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.208+0000 7f78f8498b80 1 Processor -- start 2023-08-11T12:23:40.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.208+0000 7f78f8498b80 1 -- start start 2023-08-11T12:23:40.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.208+0000 7f78f8498b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556e4fe33a80 0x556e4fe33ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:40.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.208+0000 7f78f8498b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e4fe343e0 0x556e4fe34860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:40.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.208+0000 7f78f8498b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556e4fe34da0 0x556e4fe35220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:40.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.208+0000 7f78f8498b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e4fd8c5e0 con 0x556e4fe343e0 2023-08-11T12:23:40.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.208+0000 7f78f8498b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e4fd89f00 con 0x556e4fe34da0 2023-08-11T12:23:40.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.208+0000 7f78f8498b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e4fd857f0 con 0x556e4fe33a80 2023-08-11T12:23:40.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.208+0000 7f78de59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e4fe343e0 0x556e4fe34860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:40.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.209+0000 7f78ded9d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556e4fe33a80 0x556e4fe33ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:40.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.209+0000 7f78de59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e4fe343e0 0x556e4fe34860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51730/0 (socket says 172.21.15.8:51730) 2023-08-11T12:23:40.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.209+0000 7f78de59c700 1 -- 172.21.15.8:0/700081070 learned_addr learned my addr 172.21.15.8:0/700081070 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:40.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.209+0000 7f78ddd9b700 1 --2- 172.21.15.8:0/700081070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556e4fe34da0 0x556e4fe35220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:40.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.209+0000 7f78cf7fe700 1 --2- 172.21.15.8:0/3846168952 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f78c809ffd0 0x7f78c80a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:40.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.209+0000 7f78de59c700 1 -- 172.21.15.8:0/700081070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556e4fe33a80 msgr2=0x556e4fe33ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:40.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.209+0000 7f78de59c700 1 --2- 172.21.15.8:0/700081070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556e4fe33a80 0x556e4fe33ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.209+0000 7f78de59c700 1 -- 172.21.15.8:0/700081070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556e4fe34da0 msgr2=0x556e4fe35220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:40.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.209+0000 7f78de59c700 1 --2- 172.21.15.8:0/700081070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556e4fe34da0 0x556e4fe35220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.209+0000 7f78cf7fe700 1 -- 172.21.15.8:0/3846168952 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f78d40cc590 con 0x7f78e0101bf0 2023-08-11T12:23:40.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.209+0000 7f78de59c700 1 -- 172.21.15.8:0/700081070 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e4fc055e0 con 0x556e4fe343e0 2023-08-11T12:23:40.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.209+0000 7f78ded9d700 1 --2- 172.21.15.8:0/3846168952 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f78c809ffd0 0x7f78c80a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:40.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.209+0000 7f78de59c700 1 --2- 172.21.15.8:0/700081070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e4fe343e0 0x556e4fe34860 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f78d0011810 tx=0x7f78d0011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44f962b20d98eacd server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:40.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.210+0000 7f78ccff9700 1 -- 172.21.15.8:0/700081070 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d0004830 con 0x556e4fe343e0 2023-08-11T12:23:40.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.210+0000 7f78ccff9700 1 -- 172.21.15.8:0/700081070 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78d0004e50 con 0x556e4fe343e0 2023-08-11T12:23:40.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.210+0000 7f78ccff9700 1 -- 172.21.15.8:0/700081070 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d000f820 con 0x556e4fe343e0 2023-08-11T12:23:40.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.210+0000 7f78f8498b80 1 -- 172.21.15.8:0/700081070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e4fe343e0 msgr2=0x556e4fe34860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:40.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.210+0000 7f78ded9d700 1 --2- 172.21.15.8:0/3846168952 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f78c809ffd0 0x7f78c80a2490 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f78e0074d30 tx=0x7f78d8004ad0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:40.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.210+0000 7f78f8498b80 1 --2- 172.21.15.8:0/700081070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e4fe343e0 0x556e4fe34860 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f78d0011810 tx=0x7f78d0011b20 comp rx=0 tx=0).stop 2023-08-11T12:23:40.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.211+0000 7f78f8498b80 1 -- 172.21.15.8:0/700081070 shutdown_connections 2023-08-11T12:23:40.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.211+0000 7f78f8498b80 1 --2- 172.21.15.8:0/700081070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556e4fe33a80 0x556e4fe33ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.211+0000 7f78f8498b80 1 --2- 172.21.15.8:0/700081070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556e4fe34da0 0x556e4fe35220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.211+0000 7f78f8498b80 1 --2- 172.21.15.8:0/700081070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e4fe343e0 0x556e4fe34860 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.211+0000 7f78f8498b80 1 -- 172.21.15.8:0/700081070 >> 172.21.15.8:0/700081070 conn(0x556e4fd60900 msgr2=0x556e4fe2e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:40.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.211+0000 7f78f8498b80 1 -- 172.21.15.8:0/700081070 shutdown_connections 2023-08-11T12:23:40.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.211+0000 7f78f8498b80 1 -- 172.21.15.8:0/700081070 wait complete. 2023-08-11T12:23:40.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.211+0000 7f78f8498b80 1 -- start start 2023-08-11T12:23:40.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.212+0000 7f78f8498b80 1 Processor -- start 2023-08-11T12:23:40.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.212+0000 7f78f8498b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556e4fe33a80 0x556e4fe3d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:40.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.212+0000 7f78f8498b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556e4fe343e0 0x556e4fe3d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:40.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.212+0000 7f78f8498b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e4fe34da0 0x556e4fe445d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:40.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.212+0000 7f78f8498b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e4fd23a70 con 0x556e4fe34da0 2023-08-11T12:23:40.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.212+0000 7f78f8498b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e4fd23770 con 0x556e4fe343e0 2023-08-11T12:23:40.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.212+0000 7f78f8498b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e4fc078d0 con 0x556e4fe33a80 2023-08-11T12:23:40.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.212+0000 7f78f8498b80 10 client.0 _ll_register_callbacks cb 0x556e4fd26a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:23:40.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.212+0000 7f78ddd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556e4fe343e0 0x556e4fe3d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:40.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.212+0000 7f78ddd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556e4fe343e0 0x556e4fe3d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:60524/0 (socket says 172.21.15.8:60524) 2023-08-11T12:23:40.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.212+0000 7f78ddd9b700 1 -- 172.21.15.8:0/3515697938 learned_addr learned my addr 172.21.15.8:0/3515697938 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:40.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.213+0000 7f78de59c700 1 --2- 172.21.15.8:0/3515697938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556e4fe33a80 0x556e4fe3d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:40.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.213+0000 7f78ded9d700 1 --2- 172.21.15.8:0/3515697938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e4fe34da0 0x556e4fe445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:40.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.213+0000 7f78ddd9b700 1 -- 172.21.15.8:0/3515697938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556e4fe33a80 msgr2=0x556e4fe3d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:40.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.213+0000 7f78ddd9b700 1 --2- 172.21.15.8:0/3515697938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556e4fe33a80 0x556e4fe3d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.213+0000 7f78ddd9b700 1 -- 172.21.15.8:0/3515697938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e4fe34da0 msgr2=0x556e4fe445d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:40.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.213+0000 7f78ddd9b700 1 --2- 172.21.15.8:0/3515697938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e4fe34da0 0x556e4fe445d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.213+0000 7f78ddd9b700 1 -- 172.21.15.8:0/3515697938 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d0011440 con 0x556e4fe343e0 2023-08-11T12:23:40.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.213+0000 7f78ddd9b700 1 --2- 172.21.15.8:0/3515697938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556e4fe343e0 0x556e4fe3d590 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f78d400bd50 tx=0x7f78d40058d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4143a09378b8ed08 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:40.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.213+0000 7f78c5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:23:40.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.213+0000 7f78c5ffb700 1 -- 172.21.15.8:0/3515697938 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d4099660 con 0x556e4fe343e0 2023-08-11T12:23:40.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.213+0000 7f78f8498b80 1 -- 172.21.15.8:0/3515697938 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556e4fe26a40 con 0x556e4fe343e0 2023-08-11T12:23:40.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.213+0000 7f78c5ffb700 1 -- 172.21.15.8:0/3515697938 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f78d409a400 con 0x556e4fe343e0 2023-08-11T12:23:40.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.214+0000 7f78c5ffb700 1 -- 172.21.15.8:0/3515697938 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78d4005590 con 0x556e4fe343e0 2023-08-11T12:23:40.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.214+0000 7f78f8498b80 10 client.25199 fetch_fsmap learned FSMap version 27 2023-08-11T12:23:40.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.214+0000 7f78f8498b80 1 -- 172.21.15.8:0/3515697938 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x556e4fbb1d90 con 0x556e4fe343e0 2023-08-11T12:23:40.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.214+0000 7f78c5ffb700 1 -- 172.21.15.8:0/3515697938 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556e4fe26a40 con 0x556e4fe343e0 2023-08-11T12:23:40.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.214+0000 7f78c5ffb700 1 -- 172.21.15.8:0/3515697938 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f78d4096410 con 0x556e4fe343e0 2023-08-11T12:23:40.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.214+0000 7f78f8498b80 10 client.25199 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:23:40.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.214+0000 7f78f8498b80 10 client.25199 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-11T12:23:40.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.214+0000 7f78f8498b80 20 client.25199 populate_metadata read hostname 'smithi008' 2023-08-11T12:23:40.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.214+0000 7f78f8498b80 1 --2- 172.21.15.8:0/3515697938 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556e4fe48870 0x556e4fe47500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:40.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.214+0000 7f78f8498b80 4 client.25199 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:23:40.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.214+0000 7f78f8498b80 1 -- 172.21.15.8:0/3515697938 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556e4fe02490 con 0x556e4fe48870 2023-08-11T12:23:40.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.215+0000 7f78de59c700 1 --2- 172.21.15.8:0/3515697938 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556e4fe48870 0x556e4fe47500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:40.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.215+0000 7f78de59c700 1 --2- 172.21.15.8:0/3515697938 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556e4fe48870 0x556e4fe47500 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5bf3c6f453802e2 server_cookie=c43813d5ea5f55f9 in_seq=0 out_seq=0 2023-08-11T12:23:40.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.215+0000 7f78c5ffb700 10 client.25199 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:23:40.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.216+0000 7f78c5ffb700 1 -- 172.21.15.8:0/3515697938 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x556e4fe02490 con 0x556e4fe48870 2023-08-11T12:23:40.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.216+0000 7f78c5ffb700 10 client.25199 handle_command_reply: tid=0 2023-08-11T12:23:40.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.216+0000 7f78f8498b80 1 client.25199 shutdown 2023-08-11T12:23:40.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.216+0000 7f78f8498b80 1 -- 172.21.15.8:0/3515697938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556e4fe343e0 msgr2=0x556e4fe3d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:40.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.216+0000 7f78f8498b80 1 --2- 172.21.15.8:0/3515697938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556e4fe343e0 0x556e4fe3d590 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f78d400bd50 tx=0x7f78d40058d0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.216+0000 7f78f8498b80 1 -- 172.21.15.8:0/3515697938 shutdown_connections 2023-08-11T12:23:40.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.216+0000 7f78f8498b80 1 --2- 172.21.15.8:0/3515697938 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556e4fe48870 0x556e4fe47500 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.216+0000 7f78f8498b80 1 --2- 172.21.15.8:0/3515697938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556e4fe33a80 0x556e4fe3d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.216+0000 7f78f8498b80 1 --2- 172.21.15.8:0/3515697938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e4fe34da0 0x556e4fe445d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.216+0000 7f78f8498b80 1 --2- 172.21.15.8:0/3515697938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556e4fe343e0 0x556e4fe3d590 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.216+0000 7f78c5ffb700 0 client.25199 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:23:40.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.216+0000 7f78f8498b80 1 -- 172.21.15.8:0/3515697938 >> 172.21.15.8:0/3515697938 conn(0x556e4fd60900 msgr2=0x556e4fe28c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:40.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.216+0000 7f78f8498b80 1 -- 172.21.15.8:0/3515697938 shutdown_connections 2023-08-11T12:23:40.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.216+0000 7f78f8498b80 1 -- 172.21.15.8:0/3515697938 wait complete. 2023-08-11T12:23:40.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.217+0000 7f78f8498b80 20 client.25199 trim_cache size 0 max 16384 2023-08-11T12:23:40.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.235+0000 7f78f8498b80 1 Processor -- start 2023-08-11T12:23:40.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.235+0000 7f78f8498b80 1 -- start start 2023-08-11T12:23:40.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.235+0000 7f78f8498b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e4fe33a80 0x556e4fe283d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:40.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.236+0000 7f78f8498b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556e4fe343e0 0x556e4fe44590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:40.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.236+0000 7f78f8498b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556e4fe34da0 0x556e4fe28910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:40.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.236+0000 7f78f8498b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e4fe26a40 con 0x556e4fe33a80 2023-08-11T12:23:40.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.236+0000 7f78f8498b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e4fd4fc30 con 0x556e4fe34da0 2023-08-11T12:23:40.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.236+0000 7f78f8498b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e4fc13de0 con 0x556e4fe343e0 2023-08-11T12:23:40.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.236+0000 7f78de59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e4fe33a80 0x556e4fe283d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:40.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.236+0000 7f78de59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e4fe33a80 0x556e4fe283d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51760/0 (socket says 172.21.15.8:51760) 2023-08-11T12:23:40.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.236+0000 7f78de59c700 1 -- 172.21.15.8:0/1298002353 learned_addr learned my addr 172.21.15.8:0/1298002353 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:40.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.236+0000 7f78ddd9b700 1 --2- 172.21.15.8:0/1298002353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556e4fe343e0 0x556e4fe44590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:40.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.236+0000 7f78ded9d700 1 --2- 172.21.15.8:0/1298002353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556e4fe34da0 0x556e4fe28910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:40.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.236+0000 7f78de59c700 1 -- 172.21.15.8:0/1298002353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556e4fe343e0 msgr2=0x556e4fe44590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:40.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.236+0000 7f78de59c700 1 --2- 172.21.15.8:0/1298002353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556e4fe343e0 0x556e4fe44590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.236+0000 7f78de59c700 1 -- 172.21.15.8:0/1298002353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556e4fe34da0 msgr2=0x556e4fe28910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:40.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.236+0000 7f78de59c700 1 --2- 172.21.15.8:0/1298002353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556e4fe34da0 0x556e4fe28910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.236+0000 7f78de59c700 1 -- 172.21.15.8:0/1298002353 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e4fb9ac10 con 0x556e4fe33a80 2023-08-11T12:23:40.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.237+0000 7f78de59c700 1 --2- 172.21.15.8:0/1298002353 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e4fe33a80 0x556e4fe283d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f78d0006010 tx=0x7f78d0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1eb92dffa43d871 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:40.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.237+0000 7f78cd7fa700 1 -- 172.21.15.8:0/1298002353 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d0004fc0 con 0x556e4fe33a80 2023-08-11T12:23:40.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.237+0000 7f78cd7fa700 1 -- 172.21.15.8:0/1298002353 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78d00056a0 con 0x556e4fe33a80 2023-08-11T12:23:40.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.237+0000 7f78cd7fa700 1 -- 172.21.15.8:0/1298002353 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d0029940 con 0x556e4fe33a80 2023-08-11T12:23:40.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.238+0000 7f78f8498b80 1 -- 172.21.15.8:0/1298002353 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e4fe33a80 msgr2=0x556e4fe283d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:40.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.238+0000 7f78f8498b80 1 --2- 172.21.15.8:0/1298002353 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e4fe33a80 0x556e4fe283d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f78d0006010 tx=0x7f78d0009260 comp rx=0 tx=0).stop 2023-08-11T12:23:40.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.238+0000 7f78f8498b80 1 -- 172.21.15.8:0/1298002353 shutdown_connections 2023-08-11T12:23:40.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.238+0000 7f78f8498b80 1 --2- 172.21.15.8:0/1298002353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556e4fe34da0 0x556e4fe28910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.238+0000 7f78f8498b80 1 --2- 172.21.15.8:0/1298002353 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e4fe33a80 0x556e4fe283d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.238+0000 7f78f8498b80 1 --2- 172.21.15.8:0/1298002353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556e4fe343e0 0x556e4fe44590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.238+0000 7f78f8498b80 1 -- 172.21.15.8:0/1298002353 >> 172.21.15.8:0/1298002353 conn(0x556e4fd60900 msgr2=0x556e4fe47500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:40.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.238+0000 7f78f8498b80 1 -- 172.21.15.8:0/1298002353 shutdown_connections 2023-08-11T12:23:40.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.238+0000 7f78f8498b80 1 -- 172.21.15.8:0/1298002353 wait complete. 2023-08-11T12:23:40.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.238+0000 7f78f8498b80 1 -- start start 2023-08-11T12:23:40.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.239+0000 7f78f8498b80 1 Processor -- start 2023-08-11T12:23:40.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.239+0000 7f78f8498b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556e4fe33a80 0x556e4fe3ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:40.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.239+0000 7f78f8498b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e4fe343e0 0x556e4fe444b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:40.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.239+0000 7f78f8498b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556e4fe34da0 0x556e4fe3f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:40.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.239+0000 7f78f8498b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e4fe3fb20 con 0x556e4fe343e0 2023-08-11T12:23:40.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.239+0000 7f78f8498b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e4fe9c0e0 con 0x556e4fe33a80 2023-08-11T12:23:40.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.239+0000 7f78f8498b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e4fe9c250 con 0x556e4fe34da0 2023-08-11T12:23:40.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.239+0000 7f78f8498b80 10 client.0 _ll_register_callbacks cb 0x556e4fd26a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:23:40.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.239+0000 7f78de59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556e4fe33a80 0x556e4fe3ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:40.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.239+0000 7f78ddd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e4fe343e0 0x556e4fe444b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:40.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.239+0000 7f78de59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556e4fe33a80 0x556e4fe3ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:60546/0 (socket says 172.21.15.8:60546) 2023-08-11T12:23:40.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.239+0000 7f78de59c700 1 -- 172.21.15.8:0/1655273350 learned_addr learned my addr 172.21.15.8:0/1655273350 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:40.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.239+0000 7f78ded9d700 1 --2- 172.21.15.8:0/1655273350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556e4fe34da0 0x556e4fe3f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:40.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.240+0000 7f78de59c700 1 -- 172.21.15.8:0/1655273350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556e4fe34da0 msgr2=0x556e4fe3f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:40.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.240+0000 7f78de59c700 1 --2- 172.21.15.8:0/1655273350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556e4fe34da0 0x556e4fe3f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.240+0000 7f78de59c700 1 -- 172.21.15.8:0/1655273350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e4fe343e0 msgr2=0x556e4fe444b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:23:40.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.240+0000 7f78de59c700 1 --2- 172.21.15.8:0/1655273350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e4fe343e0 0x556e4fe444b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.240+0000 7f78de59c700 1 -- 172.21.15.8:0/1655273350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556e4fc055e0 con 0x556e4fe33a80 2023-08-11T12:23:40.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.240+0000 7f78de59c700 1 --2- 172.21.15.8:0/1655273350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556e4fe33a80 0x556e4fe3ef40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f78d00117e0 tx=0x7f78d0005810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=236df967046a746a server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:40.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.240+0000 7f78c5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:23:40.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.240+0000 7f78c5ffb700 1 -- 172.21.15.8:0/1655273350 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d0005380 con 0x556e4fe33a80 2023-08-11T12:23:40.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.240+0000 7f78c5ffb700 1 -- 172.21.15.8:0/1655273350 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f78d0039030 con 0x556e4fe33a80 2023-08-11T12:23:40.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.240+0000 7f78f8498b80 1 -- 172.21.15.8:0/1655273350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f78d0004e50 con 0x556e4fe33a80 2023-08-11T12:23:40.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.241+0000 7f78c5ffb700 1 -- 172.21.15.8:0/1655273350 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78d0004920 con 0x556e4fe33a80 2023-08-11T12:23:40.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.241+0000 7f78f8498b80 10 client.25205 fetch_fsmap learned FSMap version 27 2023-08-11T12:23:40.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.241+0000 7f78f8498b80 1 -- 172.21.15.8:0/1655273350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x556e4fbd8200 con 0x556e4fe33a80 2023-08-11T12:23:40.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.241+0000 7f78c5ffb700 1 -- 172.21.15.8:0/1655273350 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78d0004e50 con 0x556e4fe33a80 2023-08-11T12:23:40.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.241+0000 7f78c5ffb700 1 -- 172.21.15.8:0/1655273350 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f78d0029460 con 0x556e4fe33a80 2023-08-11T12:23:40.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.241+0000 7f78f8498b80 10 client.25205 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:23:40.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.241+0000 7f78f8498b80 10 client.25205 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-11T12:23:40.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.241+0000 7f78f8498b80 20 client.25205 populate_metadata read hostname 'smithi008' 2023-08-11T12:23:40.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.241+0000 7f78f8498b80 1 --2- 172.21.15.8:0/1655273350 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556e4fea1170 0x556e4fe9d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:40.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.241+0000 7f78f8498b80 4 client.25205 mds_command: new command op to 24575 tid=0[{"prefix": "status"}] 2023-08-11T12:23:40.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.241+0000 7f78f8498b80 1 -- 172.21.15.8:0/1655273350 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556e4fd7e7d0 con 0x556e4fea1170 2023-08-11T12:23:40.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.241+0000 7f78ddd9b700 1 --2- 172.21.15.8:0/1655273350 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556e4fea1170 0x556e4fe9d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:40.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.242+0000 7f78c5ffb700 10 client.25205 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:23:40.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.242+0000 7f78ddd9b700 1 --2- 172.21.15.8:0/1655273350 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556e4fea1170 0x556e4fe9d5f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26f2d05e02d1006c server_cookie=3654c23e93e6dc98 in_seq=0 out_seq=0 2023-08-11T12:23:40.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.242+0000 7f78c5ffb700 1 -- 172.21.15.8:0/1655273350 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x556e4fd7e7d0 con 0x556e4fea1170 2023-08-11T12:23:40.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.242+0000 7f78c5ffb700 10 client.25205 handle_command_reply: tid=0 2023-08-11T12:23:40.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.242+0000 7f78f8498b80 1 client.25205 shutdown 2023-08-11T12:23:40.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.242+0000 7f78f8498b80 1 -- 172.21.15.8:0/1655273350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556e4fe33a80 msgr2=0x556e4fe3ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:40.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.242+0000 7f78f8498b80 1 --2- 172.21.15.8:0/1655273350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556e4fe33a80 0x556e4fe3ef40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f78d00117e0 tx=0x7f78d0005810 comp rx=0 tx=0).stop 2023-08-11T12:23:40.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.242+0000 7f78f8498b80 1 -- 172.21.15.8:0/1655273350 shutdown_connections 2023-08-11T12:23:40.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.242+0000 7f78f8498b80 1 --2- 172.21.15.8:0/1655273350 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556e4fea1170 0x556e4fe9d5f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.242+0000 7f78f8498b80 1 --2- 172.21.15.8:0/1655273350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556e4fe34da0 0x556e4fe3f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.242+0000 7f78f8498b80 1 --2- 172.21.15.8:0/1655273350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556e4fe33a80 0x556e4fe3ef40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.242+0000 7f78c5ffb700 0 client.25205 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:23:40.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.242+0000 7f78f8498b80 1 --2- 172.21.15.8:0/1655273350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e4fe343e0 0x556e4fe444b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.242+0000 7f78f8498b80 1 -- 172.21.15.8:0/1655273350 >> 172.21.15.8:0/1655273350 conn(0x556e4fd60900 msgr2=0x556e4fe32880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:40.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.243+0000 7f78f8498b80 1 -- 172.21.15.8:0/1655273350 shutdown_connections 2023-08-11T12:23:40.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.243+0000 7f78f8498b80 1 -- 172.21.15.8:0/1655273350 wait complete. 2023-08-11T12:23:40.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.243+0000 7f78f8498b80 20 client.25205 trim_cache size 0 max 16384 2023-08-11T12:23:40.264 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:23:40.264 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "815f94ae-3840-11ee-9b37-001a4aab830c", 2023-08-11T12:23:40.264 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2023-08-11T12:23:40.264 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24575, 2023-08-11T12:23:40.265 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-08-11T12:23:40.265 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-08-11T12:23:40.265 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-08-11T12:23:40.265 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 96.391310771999997, 2023-08-11T12:23:40.265 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 27, 2023-08-11T12:23:40.265 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 89, 2023-08-11T12:23:40.265 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 89, 2023-08-11T12:23:40.265 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 102.602674979 2023-08-11T12:23:40.266 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:23:40.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.243+0000 7f78e4bff700 1 -- 172.21.15.8:0/3846168952 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f78c809ffd0 msgr2=0x7f78c80a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:40.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.243+0000 7f78e4bff700 1 --2- 172.21.15.8:0/3846168952 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f78c809ffd0 0x7f78c80a2490 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f78e0074d30 tx=0x7f78d8004ad0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.243+0000 7f78e4bff700 1 -- 172.21.15.8:0/3846168952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78e0101bf0 msgr2=0x7f78e0072d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:40.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.243+0000 7f78e4bff700 1 --2- 172.21.15.8:0/3846168952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78e0101bf0 0x7f78e0072d10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f78d4000c00 tx=0x7f78d400b790 comp rx=0 tx=0).stop 2023-08-11T12:23:40.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.243+0000 7f78e4bff700 1 -- 172.21.15.8:0/3846168952 shutdown_connections 2023-08-11T12:23:40.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.243+0000 7f78e4bff700 1 --2- 172.21.15.8:0/3846168952 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f78c809ffd0 0x7f78c80a2490 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.243+0000 7f78e4bff700 1 --2- 172.21.15.8:0/3846168952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e0102590 0x7f78e0073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.243+0000 7f78e4bff700 1 --2- 172.21.15.8:0/3846168952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78e0100a00 0x7f78e00746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.243+0000 7f78e4bff700 1 --2- 172.21.15.8:0/3846168952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78e0101bf0 0x7f78e0072d10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:40.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.243+0000 7f78e4bff700 1 -- 172.21.15.8:0/3846168952 >> 172.21.15.8:0/3846168952 conn(0x7f78e00fbf70 msgr2=0x7f78e01051d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:40.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.244+0000 7f78e4bff700 1 -- 172.21.15.8:0/3846168952 shutdown_connections 2023-08-11T12:23:40.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:40.244+0000 7f78e4bff700 1 -- 172.21.15.8:0/3846168952 wait complete. 2023-08-11T12:23:40.269 INFO:tasks.cephadm:Setup complete, yielding 2023-08-11T12:23:40.269 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-08-11T12:23:40.293 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi008.front.sepia.ceph.com 2023-08-11T12:23:40.294 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- bash -c 'ceph orch status' 2023-08-11T12:23:41.035 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:23:41.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:40 smithi008 ceph-mon[97158]: pgmap v324: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-11T12:23:41.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:40 smithi194 ceph-mon[130905]: pgmap v324: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-11T12:23:41.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:40 smithi045 ceph-mon[130284]: pgmap v324: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-11T12:23:42.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.584+0000 7f3ed773b700 1 -- 172.21.15.8:0/2581105812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ed0102550 msgr2=0x7f3ed0108e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:42.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.584+0000 7f3ed773b700 1 --2- 172.21.15.8:0/2581105812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ed0102550 0x7f3ed0108e00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3ec800b0a0 tx=0x7f3ec800b3b0 comp rx=0 tx=0).stop 2023-08-11T12:23:42.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.584+0000 7f3ed773b700 1 -- 172.21.15.8:0/2581105812 shutdown_connections 2023-08-11T12:23:42.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.584+0000 7f3ed773b700 1 --2- 172.21.15.8:0/2581105812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ed0102550 0x7f3ed0108e00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:42.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.584+0000 7f3ed773b700 1 --2- 172.21.15.8:0/2581105812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ed01009b0 0x7f3ed0100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:42.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.584+0000 7f3ed773b700 1 --2- 172.21.15.8:0/2581105812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed0101bb0 0x7f3ed0102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.584+0000 7f3ed773b700 1 -- 172.21.15.8:0/2581105812 >> 172.21.15.8:0/2581105812 conn(0x7f3ed00fbf10 msgr2=0x7f3ed00fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.584+0000 7f3ed773b700 1 -- 172.21.15.8:0/2581105812 shutdown_connections 2023-08-11T12:23:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.584+0000 7f3ed773b700 1 -- 172.21.15.8:0/2581105812 wait complete. 2023-08-11T12:23:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.586+0000 7f3ed773b700 1 Processor -- start 2023-08-11T12:23:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.586+0000 7f3ed773b700 1 -- start start 2023-08-11T12:23:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.587+0000 7f3ed773b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ed01009b0 0x7f3ed01989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.587+0000 7f3ed773b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed0101bb0 0x7f3ed0198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.587+0000 7f3ed773b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ed0102550 0x7f3ed019ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.587+0000 7f3ed773b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed01a0530 con 0x7f3ed0102550 2023-08-11T12:23:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.587+0000 7f3ed773b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed01a0670 con 0x7f3ed0101bb0 2023-08-11T12:23:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.587+0000 7f3ed773b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed01a0800 con 0x7f3ed01009b0 2023-08-11T12:23:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.587+0000 7f3ed4cd6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed0101bb0 0x7f3ed0198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.587+0000 7f3ed4cd6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed0101bb0 0x7f3ed0198ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:60570/0 (socket says 172.21.15.8:60570) 2023-08-11T12:23:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.587+0000 7f3ed5cd8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ed0102550 0x7f3ed019ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.587+0000 7f3ed54d7700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ed01009b0 0x7f3ed01989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.587+0000 7f3ed4cd6700 1 -- 172.21.15.8:0/2573465286 learned_addr learned my addr 172.21.15.8:0/2573465286 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.588+0000 7f3ed54d7700 1 -- 172.21.15.8:0/2573465286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed0101bb0 msgr2=0x7f3ed0198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.588+0000 7f3ed54d7700 1 --2- 172.21.15.8:0/2573465286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed0101bb0 0x7f3ed0198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.588+0000 7f3ed54d7700 1 -- 172.21.15.8:0/2573465286 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ed0102550 msgr2=0x7f3ed019ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.588+0000 7f3ed54d7700 1 --2- 172.21.15.8:0/2573465286 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ed0102550 0x7f3ed019ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.588+0000 7f3ed54d7700 1 -- 172.21.15.8:0/2573465286 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc009520 con 0x7f3ed01009b0 2023-08-11T12:23:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.588+0000 7f3ed4cd6700 1 --2- 172.21.15.8:0/2573465286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed0101bb0 0x7f3ed0198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.588+0000 7f3ed54d7700 1 --2- 172.21.15.8:0/2573465286 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ed01009b0 0x7f3ed01989a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00e9f0 tx=0x7f3ecc00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.588+0000 7f3ec67fc700 1 -- 172.21.15.8:0/2573465286 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc00cb70 con 0x7f3ed01009b0 2023-08-11T12:23:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.588+0000 7f3ec67fc700 1 -- 172.21.15.8:0/2573465286 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3ecc00ee90 con 0x7f3ed01009b0 2023-08-11T12:23:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.588+0000 7f3ec67fc700 1 -- 172.21.15.8:0/2573465286 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc018680 con 0x7f3ed01009b0 2023-08-11T12:23:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.588+0000 7f3ed773b700 1 -- 172.21.15.8:0/2573465286 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec8009d00 con 0x7f3ed01009b0 2023-08-11T12:23:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.588+0000 7f3ed773b700 1 -- 172.21.15.8:0/2573465286 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed01a0e50 con 0x7f3ed01009b0 2023-08-11T12:23:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.589+0000 7f3ed773b700 1 -- 172.21.15.8:0/2573465286 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed0193000 con 0x7f3ed01009b0 2023-08-11T12:23:42.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.593+0000 7f3ec67fc700 1 -- 172.21.15.8:0/2573465286 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f3ecc010430 con 0x7f3ed01009b0 2023-08-11T12:23:42.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.594+0000 7f3ec67fc700 1 --2- 172.21.15.8:0/2573465286 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3ebc09ffd0 0x7f3ebc0a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:42.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.595+0000 7f3ec67fc700 1 -- 172.21.15.8:0/2573465286 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f3ecc014070 con 0x7f3ed01009b0 2023-08-11T12:23:42.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.595+0000 7f3ed4cd6700 1 --2- 172.21.15.8:0/2573465286 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3ebc09ffd0 0x7f3ebc0a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:42.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.595+0000 7f3ed4cd6700 1 --2- 172.21.15.8:0/2573465286 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3ebc09ffd0 0x7f3ebc0a2490 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0011550 tx=0x7f3ec0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:42.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.598+0000 7f3ec67fc700 1 -- 172.21.15.8:0/2573465286 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f3ecc095190 con 0x7f3ed01009b0 2023-08-11T12:23:42.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.829+0000 7f3ed773b700 1 -- 172.21.15.8:0/2573465286 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ed002ce50 con 0x7f3ebc09ffd0 2023-08-11T12:23:42.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.830+0000 7f3ec67fc700 1 -- 172.21.15.8:0/2573465286 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f3ed002ce50 con 0x7f3ebc09ffd0 2023-08-11T12:23:42.833 INFO:teuthology.orchestra.run.smithi008.stdout:Backend: cephadm 2023-08-11T12:23:42.833 INFO:teuthology.orchestra.run.smithi008.stdout:Available: Yes 2023-08-11T12:23:42.833 INFO:teuthology.orchestra.run.smithi008.stdout:Paused: No 2023-08-11T12:23:42.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.833+0000 7f3ed773b700 1 -- 172.21.15.8:0/2573465286 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3ebc09ffd0 msgr2=0x7f3ebc0a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:42.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.833+0000 7f3ed773b700 1 --2- 172.21.15.8:0/2573465286 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3ebc09ffd0 0x7f3ebc0a2490 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0011550 tx=0x7f3ec0009260 comp rx=0 tx=0).stop 2023-08-11T12:23:42.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.833+0000 7f3ed773b700 1 -- 172.21.15.8:0/2573465286 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ed01009b0 msgr2=0x7f3ed01989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:42.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.833+0000 7f3ed773b700 1 --2- 172.21.15.8:0/2573465286 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ed01009b0 0x7f3ed01989a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00e9f0 tx=0x7f3ecc00ed00 comp rx=0 tx=0).stop 2023-08-11T12:23:42.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.833+0000 7f3ed773b700 1 -- 172.21.15.8:0/2573465286 shutdown_connections 2023-08-11T12:23:42.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.833+0000 7f3ed773b700 1 --2- 172.21.15.8:0/2573465286 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3ebc09ffd0 0x7f3ebc0a2490 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:42.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.833+0000 7f3ed773b700 1 --2- 172.21.15.8:0/2573465286 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ed01009b0 0x7f3ed01989a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:42.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.833+0000 7f3ed773b700 1 --2- 172.21.15.8:0/2573465286 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ed0102550 0x7f3ed019ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:42.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.833+0000 7f3ed773b700 1 --2- 172.21.15.8:0/2573465286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed0101bb0 0x7f3ed0198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:42.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.833+0000 7f3ed773b700 1 -- 172.21.15.8:0/2573465286 >> 172.21.15.8:0/2573465286 conn(0x7f3ed00fbf10 msgr2=0x7f3ed0107490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:42.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.833+0000 7f3ed773b700 1 -- 172.21.15.8:0/2573465286 shutdown_connections 2023-08-11T12:23:42.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:42.833+0000 7f3ed773b700 1 -- 172.21.15.8:0/2573465286 wait complete. 2023-08-11T12:23:43.440 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- bash -c 'ceph orch ps' 2023-08-11T12:23:43.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:43 smithi008 ceph-mon[97158]: pgmap v325: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-11T12:23:43.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:43 smithi194 ceph-mon[130905]: pgmap v325: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-11T12:23:43.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:43 smithi045 ceph-mon[130284]: pgmap v325: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-11T12:23:44.173 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:23:44.787 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:44 smithi008 ceph-mon[97158]: from='client.25222 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:23:44.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:44 smithi194 ceph-mon[130905]: from='client.25222 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:23:44.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:44 smithi045 ceph-mon[130284]: from='client.25222 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:23:45.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.852+0000 7fb25b3b2700 1 -- 172.21.15.8:0/2073525944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb254101440 msgr2=0x7fb254103830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:45.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.852+0000 7fb25b3b2700 1 --2- 172.21.15.8:0/2073525944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb254101440 0x7fb254103830 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb250009990 tx=0x7fb250009ca0 comp rx=0 tx=0).stop 2023-08-11T12:23:45.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.853+0000 7fb25b3b2700 1 -- 172.21.15.8:0/2073525944 shutdown_connections 2023-08-11T12:23:45.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.853+0000 7fb25b3b2700 1 --2- 172.21.15.8:0/2073525944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2541066a0 0x7fb254108b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:45.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.853+0000 7fb25b3b2700 1 --2- 172.21.15.8:0/2073525944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb254101440 0x7fb254103830 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:45.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.853+0000 7fb25b3b2700 1 --2- 172.21.15.8:0/2073525944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb254103d70 0x7fb254106160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:45.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.853+0000 7fb25b3b2700 1 -- 172.21.15.8:0/2073525944 >> 172.21.15.8:0/2073525944 conn(0x7fb2540fae30 msgr2=0x7fb2540fd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:45.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.853+0000 7fb25b3b2700 1 -- 172.21.15.8:0/2073525944 shutdown_connections 2023-08-11T12:23:45.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.853+0000 7fb25b3b2700 1 -- 172.21.15.8:0/2073525944 wait complete. 2023-08-11T12:23:45.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.854+0000 7fb25b3b2700 1 Processor -- start 2023-08-11T12:23:45.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.854+0000 7fb25b3b2700 1 -- start start 2023-08-11T12:23:45.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.855+0000 7fb25b3b2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb254101440 0x7fb2541988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:45.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.855+0000 7fb25b3b2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb254103d70 0x7fb254198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:45.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.855+0000 7fb25b3b2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2541066a0 0x7fb25419fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:45.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.855+0000 7fb25b3b2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2541a0440 con 0x7fb254103d70 2023-08-11T12:23:45.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.855+0000 7fb25b3b2700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2541a0580 con 0x7fb254101440 2023-08-11T12:23:45.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.855+0000 7fb25b3b2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2541a0710 con 0x7fb2541066a0 2023-08-11T12:23:45.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.855+0000 7fb25914e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb254101440 0x7fb2541988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:45.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.855+0000 7fb25914e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb254101440 0x7fb2541988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:60582/0 (socket says 172.21.15.8:60582) 2023-08-11T12:23:45.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.855+0000 7fb25894d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb254103d70 0x7fb254198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:45.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.855+0000 7fb25914e700 1 -- 172.21.15.8:0/3188304082 learned_addr learned my addr 172.21.15.8:0/3188304082 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:45.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.855+0000 7fb25994f700 1 --2- 172.21.15.8:0/3188304082 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2541066a0 0x7fb25419fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:45.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.856+0000 7fb25914e700 1 -- 172.21.15.8:0/3188304082 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2541066a0 msgr2=0x7fb25419fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:45.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.856+0000 7fb25914e700 1 --2- 172.21.15.8:0/3188304082 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2541066a0 0x7fb25419fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:45.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.856+0000 7fb25914e700 1 -- 172.21.15.8:0/3188304082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb254103d70 msgr2=0x7fb254198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:45.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.856+0000 7fb25914e700 1 --2- 172.21.15.8:0/3188304082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb254103d70 0x7fb254198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:45.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.856+0000 7fb25914e700 1 -- 172.21.15.8:0/3188304082 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2500095f0 con 0x7fb254101440 2023-08-11T12:23:45.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.856+0000 7fb25894d700 1 --2- 172.21.15.8:0/3188304082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb254103d70 0x7fb254198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:45.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.856+0000 7fb25914e700 1 --2- 172.21.15.8:0/3188304082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb254101440 0x7fb2541988b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb250005910 tx=0x7fb25000f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:45.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.856+0000 7fb24a7fc700 1 -- 172.21.15.8:0/3188304082 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25001d070 con 0x7fb254101440 2023-08-11T12:23:45.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.856+0000 7fb24a7fc700 1 -- 172.21.15.8:0/3188304082 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb25000fb80 con 0x7fb254101440 2023-08-11T12:23:45.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.856+0000 7fb25b3b2700 1 -- 172.21.15.8:0/3188304082 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2541a0990 con 0x7fb254101440 2023-08-11T12:23:45.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.856+0000 7fb24a7fc700 1 -- 172.21.15.8:0/3188304082 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb250017650 con 0x7fb254101440 2023-08-11T12:23:45.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.856+0000 7fb25b3b2700 1 -- 172.21.15.8:0/3188304082 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2541a0da0 con 0x7fb254101440 2023-08-11T12:23:45.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.857+0000 7fb25b3b2700 1 -- 172.21.15.8:0/3188304082 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb254108270 con 0x7fb254101440 2023-08-11T12:23:45.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.860+0000 7fb24a7fc700 1 -- 172.21.15.8:0/3188304082 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fb25000fcf0 con 0x7fb254101440 2023-08-11T12:23:45.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.861+0000 7fb24a7fc700 1 --2- 172.21.15.8:0/3188304082 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb24009ff50 0x7fb2400a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:45.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.861+0000 7fb24a7fc700 1 -- 172.21.15.8:0/3188304082 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb250022e40 con 0x7fb254101440 2023-08-11T12:23:45.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.861+0000 7fb25894d700 1 --2- 172.21.15.8:0/3188304082 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb24009ff50 0x7fb2400a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:45.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.862+0000 7fb25894d700 1 --2- 172.21.15.8:0/3188304082 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb24009ff50 0x7fb2400a2410 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb244005950 tx=0x7fb24400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:45.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:45.863+0000 7fb24a7fc700 1 -- 172.21.15.8:0/3188304082 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fb250096740 con 0x7fb254101440 2023-08-11T12:23:45.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:45 smithi194 ceph-mon[130905]: pgmap v326: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:45.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:45 smithi045 ceph-mon[130284]: pgmap v326: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:46.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:45 smithi008 ceph-mon[97158]: pgmap v326: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:46.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:46.084+0000 7fb25b3b2700 1 -- 172.21.15.8:0/3188304082 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb25402ce00 con 0x7fb24009ff50 2023-08-11T12:23:46.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:46.097+0000 7fb24a7fc700 1 -- 172.21.15.8:0/3188304082 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7fb25402ce00 con 0x7fb24009ff50 2023-08-11T12:23:46.101 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-08-11T12:23:46.101 INFO:teuthology.orchestra.run.smithi008.stdout:mds.a smithi008 running (111s) - 110s 15.9M - 18.0.0-5437-g92684807 a2667c7aa6ee fef274065715 2023-08-11T12:23:46.101 INFO:teuthology.orchestra.run.smithi008.stdout:mds.b smithi045 running (108s) - 108s 23.2M - 18.0.0-5437-g92684807 a2667c7aa6ee 8334d9e74303 2023-08-11T12:23:46.101 INFO:teuthology.orchestra.run.smithi008.stdout:mds.c smithi194 running (2m) - 2m 18.7M - 18.0.0-5437-g92684807 a2667c7aa6ee 4b773b9892ad 2023-08-11T12:23:46.101 INFO:teuthology.orchestra.run.smithi008.stdout:mds.d smithi008 running (2m) - 2m 13.5M - 18.0.0-5437-g92684807 a2667c7aa6ee 4432a53902eb 2023-08-11T12:23:46.101 INFO:teuthology.orchestra.run.smithi008.stdout:mds.e smithi045 running (2m) - 2m 18.3M - 18.0.0-5437-g92684807 a2667c7aa6ee 648230d0bb9f 2023-08-11T12:23:46.102 INFO:teuthology.orchestra.run.smithi008.stdout:mds.f smithi194 running (2m) - 2m 18.2M - 18.0.0-5437-g92684807 a2667c7aa6ee 8b284be89609 2023-08-11T12:23:46.102 INFO:teuthology.orchestra.run.smithi008.stdout:mds.g smithi008 running (114s) - 113s 15.7M - 18.0.0-5437-g92684807 a2667c7aa6ee 514684eaa3df 2023-08-11T12:23:46.102 INFO:teuthology.orchestra.run.smithi008.stdout:mds.h smithi045 running (119s) - 119s 19.6M - 18.0.0-5437-g92684807 a2667c7aa6ee 2225f98b5238 2023-08-11T12:23:46.102 INFO:teuthology.orchestra.run.smithi008.stdout:mds.i smithi194 running (117s) - 117s 19.7M - 18.0.0-5437-g92684807 a2667c7aa6ee 5b6f49ff61e5 2023-08-11T12:23:46.102 INFO:teuthology.orchestra.run.smithi008.stdout:mds.j smithi008 running (2m) - 2m 13.5M - 18.0.0-5437-g92684807 a2667c7aa6ee c15de7f911da 2023-08-11T12:23:46.102 INFO:teuthology.orchestra.run.smithi008.stdout:mds.k smithi045 running (2m) - 2m 18.4M - 18.0.0-5437-g92684807 a2667c7aa6ee a245f51d41c6 2023-08-11T12:23:46.102 INFO:teuthology.orchestra.run.smithi008.stdout:mds.l smithi194 running (2m) - 2m 17.2M - 18.0.0-5437-g92684807 a2667c7aa6ee 83a8d819d5c8 2023-08-11T12:23:46.102 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.x smithi008 *:9283,8765 running (9m) - 9m 526M - 18.0.0-5437-g92684807 a2667c7aa6ee e940becb014c 2023-08-11T12:23:46.103 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.y smithi045 *:8443,8765 running (7m) - 7m 449M - 18.0.0-5437-g92684807 a2667c7aa6ee 3a1ae74e8a5c 2023-08-11T12:23:46.103 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.z smithi194 *:8443,8765 running (7m) - 7m 452M - 18.0.0-5437-g92684807 a2667c7aa6ee 9fd8ad25fe15 2023-08-11T12:23:46.103 INFO:teuthology.orchestra.run.smithi008.stdout:mon.a smithi008 running (9m) - 9m 92.4M 2048M 18.0.0-5437-g92684807 a2667c7aa6ee 312f2c098cf7 2023-08-11T12:23:46.103 INFO:teuthology.orchestra.run.smithi008.stdout:mon.b smithi045 running (7m) - 7m 63.6M 2048M 18.0.0-5437-g92684807 a2667c7aa6ee fc53258bbff5 2023-08-11T12:23:46.103 INFO:teuthology.orchestra.run.smithi008.stdout:mon.c smithi194 running (7m) - 7m 65.3M 2048M 18.0.0-5437-g92684807 a2667c7aa6ee 8218a9e78837 2023-08-11T12:23:46.103 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (6m) - 6m 71.6M 4318M 18.0.0-5437-g92684807 a2667c7aa6ee 788feae1b11c 2023-08-11T12:23:46.103 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi045 running (6m) - 6m 79.3M 4293M 18.0.0-5437-g92684807 a2667c7aa6ee b79387101ddb 2023-08-11T12:23:46.103 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi194 running (6m) - 6m 74.9M 4292M 18.0.0-5437-g92684807 a2667c7aa6ee 9deac9c04637 2023-08-11T12:23:46.104 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi008 running (5m) - 5m 66.1M 4318M 18.0.0-5437-g92684807 a2667c7aa6ee eaa23b70b424 2023-08-11T12:23:46.104 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi045 running (5m) - 5m 64.3M 4293M 18.0.0-5437-g92684807 a2667c7aa6ee 24561dd8f06f 2023-08-11T12:23:46.104 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi194 running (4m) - 4m 69.6M 4292M 18.0.0-5437-g92684807 a2667c7aa6ee de59c26a708c 2023-08-11T12:23:46.104 INFO:teuthology.orchestra.run.smithi008.stdout:osd.6 smithi008 running (4m) - 4m 61.4M 4318M 18.0.0-5437-g92684807 a2667c7aa6ee 51cc10901642 2023-08-11T12:23:46.104 INFO:teuthology.orchestra.run.smithi008.stdout:osd.7 smithi045 running (4m) - 4m 66.1M 4293M 18.0.0-5437-g92684807 a2667c7aa6ee 161da6ed1032 2023-08-11T12:23:46.104 INFO:teuthology.orchestra.run.smithi008.stdout:osd.8 smithi194 running (3m) - 3m 63.6M 4292M 18.0.0-5437-g92684807 a2667c7aa6ee 69778211cca7 2023-08-11T12:23:46.104 INFO:teuthology.orchestra.run.smithi008.stdout:osd.9 smithi008 running (3m) - 3m 61.0M 4318M 18.0.0-5437-g92684807 a2667c7aa6ee 1a239ea815ab 2023-08-11T12:23:46.104 INFO:teuthology.orchestra.run.smithi008.stdout:osd.10 smithi045 running (2m) - 2m 63.0M 4293M 18.0.0-5437-g92684807 a2667c7aa6ee 6dbfdef24bfd 2023-08-11T12:23:46.105 INFO:teuthology.orchestra.run.smithi008.stdout:osd.11 smithi194 running (2m) - 2m 58.8M 4292M 18.0.0-5437-g92684807 a2667c7aa6ee 00eb8505f670 2023-08-11T12:23:46.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:46.100+0000 7fb25b3b2700 1 -- 172.21.15.8:0/3188304082 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb24009ff50 msgr2=0x7fb2400a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:46.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:46.100+0000 7fb25b3b2700 1 --2- 172.21.15.8:0/3188304082 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb24009ff50 0x7fb2400a2410 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb244005950 tx=0x7fb24400b410 comp rx=0 tx=0).stop 2023-08-11T12:23:46.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:46.100+0000 7fb25b3b2700 1 -- 172.21.15.8:0/3188304082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb254101440 msgr2=0x7fb2541988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:46.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:46.100+0000 7fb25b3b2700 1 --2- 172.21.15.8:0/3188304082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb254101440 0x7fb2541988b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb250005910 tx=0x7fb25000f690 comp rx=0 tx=0).stop 2023-08-11T12:23:46.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:46.100+0000 7fb25b3b2700 1 -- 172.21.15.8:0/3188304082 shutdown_connections 2023-08-11T12:23:46.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:46.100+0000 7fb25b3b2700 1 --2- 172.21.15.8:0/3188304082 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb24009ff50 0x7fb2400a2410 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:46.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:46.100+0000 7fb25b3b2700 1 --2- 172.21.15.8:0/3188304082 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2541066a0 0x7fb25419fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:46.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:46.100+0000 7fb25b3b2700 1 --2- 172.21.15.8:0/3188304082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb254101440 0x7fb2541988b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:46.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:46.100+0000 7fb25b3b2700 1 --2- 172.21.15.8:0/3188304082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb254103d70 0x7fb254198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:46.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:46.100+0000 7fb25b3b2700 1 -- 172.21.15.8:0/3188304082 >> 172.21.15.8:0/3188304082 conn(0x7fb2540fae30 msgr2=0x7fb2540ffac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:46.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:46.100+0000 7fb25b3b2700 1 -- 172.21.15.8:0/3188304082 shutdown_connections 2023-08-11T12:23:46.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:46.100+0000 7fb25b3b2700 1 -- 172.21.15.8:0/3188304082 wait complete. 2023-08-11T12:23:46.579 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- bash -c 'ceph orch ls' 2023-08-11T12:23:47.315 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:23:47.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:47 smithi194 ceph-mon[130905]: from='client.25217 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:23:47.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:47 smithi194 ceph-mon[130905]: pgmap v327: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-08-11T12:23:47.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:47 smithi045 ceph-mon[130284]: from='client.25217 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:23:47.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:47 smithi045 ceph-mon[130284]: pgmap v327: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-08-11T12:23:47.928 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:47 smithi008 ceph-mon[97158]: from='client.25217 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:23:47.928 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:47 smithi008 ceph-mon[97158]: pgmap v327: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-08-11T12:23:48.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.992+0000 7fa6217ad700 1 -- 172.21.15.8:0/3629224260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa61c102520 msgr2=0x7fa61c108dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:48.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.992+0000 7fa6217ad700 1 --2- 172.21.15.8:0/3629224260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa61c102520 0x7fa61c108dd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa61400b0d0 tx=0x7fa61400b3e0 comp rx=0 tx=0).stop 2023-08-11T12:23:48.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.992+0000 7fa6217ad700 1 -- 172.21.15.8:0/3629224260 shutdown_connections 2023-08-11T12:23:48.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.992+0000 7fa6217ad700 1 --2- 172.21.15.8:0/3629224260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa61c102520 0x7fa61c108dd0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:48.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.992+0000 7fa6217ad700 1 --2- 172.21.15.8:0/3629224260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa61c100980 0x7fa61c100da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:48.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.992+0000 7fa6217ad700 1 --2- 172.21.15.8:0/3629224260 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa61c101b80 0x7fa61c101fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:48.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.992+0000 7fa6217ad700 1 -- 172.21.15.8:0/3629224260 >> 172.21.15.8:0/3629224260 conn(0x7fa61c0fbf00 msgr2=0x7fa61c0fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:48.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.992+0000 7fa6217ad700 1 -- 172.21.15.8:0/3629224260 shutdown_connections 2023-08-11T12:23:48.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.992+0000 7fa6217ad700 1 -- 172.21.15.8:0/3629224260 wait complete. 2023-08-11T12:23:48.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.993+0000 7fa6217ad700 1 Processor -- start 2023-08-11T12:23:48.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.993+0000 7fa6217ad700 1 -- start start 2023-08-11T12:23:48.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.994+0000 7fa6217ad700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa61c100980 0x7fa61c1988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:48.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.994+0000 7fa6217ad700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa61c101b80 0x7fa61c198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:48.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.994+0000 7fa6217ad700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa61c102520 0x7fa61c19fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:48.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.994+0000 7fa6217ad700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c1a0470 con 0x7fa61c102520 2023-08-11T12:23:48.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.994+0000 7fa6217ad700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c1a05b0 con 0x7fa61c101b80 2023-08-11T12:23:48.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.994+0000 7fa6217ad700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c1a0740 con 0x7fa61c100980 2023-08-11T12:23:48.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.994+0000 7fa61a7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa61c101b80 0x7fa61c198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:48.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.994+0000 7fa61a7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa61c101b80 0x7fa61c198e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:36338/0 (socket says 172.21.15.8:36338) 2023-08-11T12:23:48.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.994+0000 7fa61a7fc700 1 -- 172.21.15.8:0/3341951230 learned_addr learned my addr 172.21.15.8:0/3341951230 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:48.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.994+0000 7fa61b7fe700 1 --2- 172.21.15.8:0/3341951230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa61c102520 0x7fa61c19fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:48.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.994+0000 7fa61affd700 1 --2- 172.21.15.8:0/3341951230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa61c100980 0x7fa61c1988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:48.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.995+0000 7fa61b7fe700 1 -- 172.21.15.8:0/3341951230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa61c100980 msgr2=0x7fa61c1988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:48.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.995+0000 7fa61b7fe700 1 --2- 172.21.15.8:0/3341951230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa61c100980 0x7fa61c1988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:48.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.995+0000 7fa61b7fe700 1 -- 172.21.15.8:0/3341951230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa61c101b80 msgr2=0x7fa61c198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:48.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.995+0000 7fa61b7fe700 1 --2- 172.21.15.8:0/3341951230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa61c101b80 0x7fa61c198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:48.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.995+0000 7fa61b7fe700 1 -- 172.21.15.8:0/3341951230 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa614009d00 con 0x7fa61c102520 2023-08-11T12:23:48.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.995+0000 7fa61a7fc700 1 --2- 172.21.15.8:0/3341951230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa61c101b80 0x7fa61c198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:48.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.995+0000 7fa61b7fe700 1 --2- 172.21.15.8:0/3341951230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa61c102520 0x7fa61c19fea0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa614007a30 tx=0x7fa614008f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:49.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.995+0000 7fa603fff700 1 -- 172.21.15.8:0/3341951230 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61400e040 con 0x7fa61c102520 2023-08-11T12:23:49.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.995+0000 7fa603fff700 1 -- 172.21.15.8:0/3341951230 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa61401d930 con 0x7fa61c102520 2023-08-11T12:23:49.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.995+0000 7fa603fff700 1 -- 172.21.15.8:0/3341951230 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61401b920 con 0x7fa61c102520 2023-08-11T12:23:49.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.995+0000 7fa6217ad700 1 -- 172.21.15.8:0/3341951230 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa61c1a09c0 con 0x7fa61c102520 2023-08-11T12:23:49.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.995+0000 7fa6217ad700 1 -- 172.21.15.8:0/3341951230 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa61c1a0e30 con 0x7fa61c102520 2023-08-11T12:23:49.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.997+0000 7fa6217ad700 1 -- 172.21.15.8:0/3341951230 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61c10c190 con 0x7fa61c102520 2023-08-11T12:23:49.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:48.998+0000 7fa603fff700 1 -- 172.21.15.8:0/3341951230 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fa61401d470 con 0x7fa61c102520 2023-08-11T12:23:49.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:49.000+0000 7fa603fff700 1 --2- 172.21.15.8:0/3341951230 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa60409ffd0 0x7fa6040a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:49.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:49.000+0000 7fa603fff700 1 -- 172.21.15.8:0/3341951230 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fa6140cc940 con 0x7fa61c102520 2023-08-11T12:23:49.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:49.000+0000 7fa61affd700 1 --2- 172.21.15.8:0/3341951230 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa60409ffd0 0x7fa6040a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:49.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:49.001+0000 7fa61affd700 1 --2- 172.21.15.8:0/3341951230 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa60409ffd0 0x7fa6040a2490 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa61c1019e0 tx=0x7fa60c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:49.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:49.004+0000 7fa603fff700 1 -- 172.21.15.8:0/3341951230 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fa6140963f0 con 0x7fa61c102520 2023-08-11T12:23:49.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:49.221+0000 7fa6217ad700 1 -- 172.21.15.8:0/3341951230 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa61c108b40 con 0x7fa60409ffd0 2023-08-11T12:23:49.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:49.226+0000 7fa603fff700 1 -- 172.21.15.8:0/3341951230 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7fa61c108b40 con 0x7fa60409ffd0 2023-08-11T12:23:49.228 INFO:teuthology.orchestra.run.smithi008.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-08-11T12:23:49.228 INFO:teuthology.orchestra.run.smithi008.stdout:mds.all 12/12 - 2m smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi045=b;smithi045=e;smithi045=h;smithi045=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l;count:12 2023-08-11T12:23:49.228 INFO:teuthology.orchestra.run.smithi008.stdout:mgr 3/3 - 7m smithi008=x;smithi045=y;smithi194=z;count:3 2023-08-11T12:23:49.229 INFO:teuthology.orchestra.run.smithi008.stdout:mon 3/3 - 7m smithi008:172.21.15.8=a;smithi045:172.21.15.45=b;smithi194:172.21.15.194=c;count:3 2023-08-11T12:23:49.229 INFO:teuthology.orchestra.run.smithi008.stdout:osd 12 - - 2023-08-11T12:23:49.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:49.228+0000 7fa6217ad700 1 -- 172.21.15.8:0/3341951230 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa60409ffd0 msgr2=0x7fa6040a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:49.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:49.228+0000 7fa6217ad700 1 --2- 172.21.15.8:0/3341951230 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa60409ffd0 0x7fa6040a2490 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa61c1019e0 tx=0x7fa60c00b410 comp rx=0 tx=0).stop 2023-08-11T12:23:49.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:49.228+0000 7fa6217ad700 1 -- 172.21.15.8:0/3341951230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa61c102520 msgr2=0x7fa61c19fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:49.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:49.228+0000 7fa6217ad700 1 --2- 172.21.15.8:0/3341951230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa61c102520 0x7fa61c19fea0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa614007a30 tx=0x7fa614008f10 comp rx=0 tx=0).stop 2023-08-11T12:23:49.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:49.228+0000 7fa6217ad700 1 -- 172.21.15.8:0/3341951230 shutdown_connections 2023-08-11T12:23:49.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:49.228+0000 7fa6217ad700 1 --2- 172.21.15.8:0/3341951230 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa60409ffd0 0x7fa6040a2490 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:49.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:49.228+0000 7fa6217ad700 1 --2- 172.21.15.8:0/3341951230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa61c100980 0x7fa61c1988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:49.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:49.228+0000 7fa6217ad700 1 --2- 172.21.15.8:0/3341951230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa61c102520 0x7fa61c19fea0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:49.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:49.228+0000 7fa6217ad700 1 --2- 172.21.15.8:0/3341951230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa61c101b80 0x7fa61c198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:49.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:49.228+0000 7fa6217ad700 1 -- 172.21.15.8:0/3341951230 >> 172.21.15.8:0/3341951230 conn(0x7fa61c0fbf00 msgr2=0x7fa61c107420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:49.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:49.228+0000 7fa6217ad700 1 -- 172.21.15.8:0/3341951230 shutdown_connections 2023-08-11T12:23:49.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:49.229+0000 7fa6217ad700 1 -- 172.21.15.8:0/3341951230 wait complete. 2023-08-11T12:23:49.811 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- bash -c 'ceph orch host ls' 2023-08-11T12:23:49.875 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:49 smithi008 ceph-mon[97158]: pgmap v328: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:49.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:49 smithi194 ceph-mon[130905]: pgmap v328: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:49.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:49 smithi045 ceph-mon[130284]: pgmap v328: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:50.547 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:23:50.860 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:50 smithi008 ceph-mon[97158]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:23:50.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:50 smithi194 ceph-mon[130905]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:23:50.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:50 smithi045 ceph-mon[130284]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:23:51.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:51 smithi194 ceph-mon[130905]: pgmap v329: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-11T12:23:51.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:51 smithi045 ceph-mon[130284]: pgmap v329: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-11T12:23:52.044 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:51 smithi008 ceph-mon[97158]: pgmap v329: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-11T12:23:52.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.284+0000 7f88709b0700 1 -- 172.21.15.8:0/1951117548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f886c102550 msgr2=0x7f886c108e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:52.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.284+0000 7f88709b0700 1 --2- 172.21.15.8:0/1951117548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f886c102550 0x7f886c108e00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f886400b0d0 tx=0x7f886400b3e0 comp rx=0 tx=0).stop 2023-08-11T12:23:52.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.284+0000 7f88709b0700 1 -- 172.21.15.8:0/1951117548 shutdown_connections 2023-08-11T12:23:52.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.284+0000 7f88709b0700 1 --2- 172.21.15.8:0/1951117548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f886c102550 0x7f886c108e00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:52.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.284+0000 7f88709b0700 1 --2- 172.21.15.8:0/1951117548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f886c1009b0 0x7f886c100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:52.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.284+0000 7f88709b0700 1 --2- 172.21.15.8:0/1951117548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f886c101bb0 0x7f886c102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:52.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.284+0000 7f88709b0700 1 -- 172.21.15.8:0/1951117548 >> 172.21.15.8:0/1951117548 conn(0x7f886c0fbf10 msgr2=0x7f886c0fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:52.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.284+0000 7f88709b0700 1 -- 172.21.15.8:0/1951117548 shutdown_connections 2023-08-11T12:23:52.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.284+0000 7f88709b0700 1 -- 172.21.15.8:0/1951117548 wait complete. 2023-08-11T12:23:52.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.285+0000 7f88709b0700 1 Processor -- start 2023-08-11T12:23:52.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.286+0000 7f88709b0700 1 -- start start 2023-08-11T12:23:52.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.286+0000 7f88709b0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f886c1009b0 0x7f886c196790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:52.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.286+0000 7f88709b0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f886c101bb0 0x7f886c196cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:52.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.286+0000 7f88709b0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f886c102550 0x7f886c19dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:52.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.286+0000 7f88709b0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886c19e320 con 0x7f886c102550 2023-08-11T12:23:52.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.286+0000 7f88709b0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886c19e460 con 0x7f886c101bb0 2023-08-11T12:23:52.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.286+0000 7f88709b0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886c19e5f0 con 0x7f886c1009b0 2023-08-11T12:23:52.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.286+0000 7f886a59c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f886c1009b0 0x7f886c196790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:52.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.286+0000 7f886ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f886c102550 0x7f886c19dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:52.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.286+0000 7f886a59c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f886c1009b0 0x7f886c196790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:51650/0 (socket says 172.21.15.8:51650) 2023-08-11T12:23:52.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.286+0000 7f886a59c700 1 -- 172.21.15.8:0/4167986559 learned_addr learned my addr 172.21.15.8:0/4167986559 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:52.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.286+0000 7f8869d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f886c101bb0 0x7f886c196cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:52.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.287+0000 7f886ad9d700 1 -- 172.21.15.8:0/4167986559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f886c1009b0 msgr2=0x7f886c196790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:52.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.287+0000 7f886ad9d700 1 --2- 172.21.15.8:0/4167986559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f886c1009b0 0x7f886c196790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:52.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.287+0000 7f886ad9d700 1 -- 172.21.15.8:0/4167986559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f886c101bb0 msgr2=0x7f886c196cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:52.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.287+0000 7f886ad9d700 1 --2- 172.21.15.8:0/4167986559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f886c101bb0 0x7f886c196cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:52.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.287+0000 7f886ad9d700 1 -- 172.21.15.8:0/4167986559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885c009520 con 0x7f886c102550 2023-08-11T12:23:52.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.287+0000 7f8869d9b700 1 --2- 172.21.15.8:0/4167986559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f886c101bb0 0x7f886c196cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:52.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.287+0000 7f886ad9d700 1 --2- 172.21.15.8:0/4167986559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f886c102550 0x7f886c19dd50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8864009fd0 tx=0x7f8864008eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:52.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.287+0000 7f885b7fe700 1 -- 172.21.15.8:0/4167986559 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886400e040 con 0x7f886c102550 2023-08-11T12:23:52.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.287+0000 7f885b7fe700 1 -- 172.21.15.8:0/4167986559 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f886400bd30 con 0x7f886c102550 2023-08-11T12:23:52.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.287+0000 7f88709b0700 1 -- 172.21.15.8:0/4167986559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8864009d00 con 0x7f886c102550 2023-08-11T12:23:52.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.287+0000 7f88709b0700 1 -- 172.21.15.8:0/4167986559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f886c19eb50 con 0x7f886c102550 2023-08-11T12:23:52.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.287+0000 7f885b7fe700 1 -- 172.21.15.8:0/4167986559 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886401d470 con 0x7f886c102550 2023-08-11T12:23:52.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.288+0000 7f88709b0700 1 -- 172.21.15.8:0/4167986559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f886c107ef0 con 0x7f886c102550 2023-08-11T12:23:52.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.290+0000 7f885b7fe700 1 -- 172.21.15.8:0/4167986559 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f8864004a50 con 0x7f886c102550 2023-08-11T12:23:52.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.292+0000 7f885b7fe700 1 --2- 172.21.15.8:0/4167986559 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f885409ff50 0x7f88540a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:52.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.292+0000 7f885b7fe700 1 -- 172.21.15.8:0/4167986559 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f88640cc560 con 0x7f886c102550 2023-08-11T12:23:52.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.292+0000 7f886a59c700 1 --2- 172.21.15.8:0/4167986559 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f885409ff50 0x7f88540a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:52.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.293+0000 7f886a59c700 1 --2- 172.21.15.8:0/4167986559 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f885409ff50 0x7f88540a2410 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f885c005950 tx=0x7f885c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:52.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.296+0000 7f885b7fe700 1 -- 172.21.15.8:0/4167986559 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f8864096010 con 0x7f886c102550 2023-08-11T12:23:52.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.508+0000 7f88709b0700 1 -- 172.21.15.8:0/4167986559 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f886c02cd60 con 0x7f885409ff50 2023-08-11T12:23:52.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.509+0000 7f885b7fe700 1 -- 172.21.15.8:0/4167986559 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f886c02cd60 con 0x7f885409ff50 2023-08-11T12:23:52.511 INFO:teuthology.orchestra.run.smithi008.stdout:HOST ADDR LABELS STATUS 2023-08-11T12:23:52.511 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008 172.21.15.8 2023-08-11T12:23:52.512 INFO:teuthology.orchestra.run.smithi008.stdout:smithi045 172.21.15.45 2023-08-11T12:23:52.512 INFO:teuthology.orchestra.run.smithi008.stdout:smithi194 172.21.15.194 2023-08-11T12:23:52.512 INFO:teuthology.orchestra.run.smithi008.stdout:3 hosts in cluster 2023-08-11T12:23:52.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.511+0000 7f88709b0700 1 -- 172.21.15.8:0/4167986559 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f885409ff50 msgr2=0x7f88540a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:52.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.511+0000 7f88709b0700 1 --2- 172.21.15.8:0/4167986559 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f885409ff50 0x7f88540a2410 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f885c005950 tx=0x7f885c009260 comp rx=0 tx=0).stop 2023-08-11T12:23:52.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.511+0000 7f88709b0700 1 -- 172.21.15.8:0/4167986559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f886c102550 msgr2=0x7f886c19dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:52.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.511+0000 7f88709b0700 1 --2- 172.21.15.8:0/4167986559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f886c102550 0x7f886c19dd50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8864009fd0 tx=0x7f8864008eb0 comp rx=0 tx=0).stop 2023-08-11T12:23:52.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.511+0000 7f88709b0700 1 -- 172.21.15.8:0/4167986559 shutdown_connections 2023-08-11T12:23:52.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.511+0000 7f88709b0700 1 --2- 172.21.15.8:0/4167986559 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f885409ff50 0x7f88540a2410 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:52.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.511+0000 7f88709b0700 1 --2- 172.21.15.8:0/4167986559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f886c1009b0 0x7f886c196790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:52.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.511+0000 7f88709b0700 1 --2- 172.21.15.8:0/4167986559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f886c102550 0x7f886c19dd50 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:52.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.511+0000 7f88709b0700 1 --2- 172.21.15.8:0/4167986559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f886c101bb0 0x7f886c196cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:52.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.511+0000 7f88709b0700 1 -- 172.21.15.8:0/4167986559 >> 172.21.15.8:0/4167986559 conn(0x7f886c0fbf10 msgr2=0x7f886c105030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:52.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.512+0000 7f88709b0700 1 -- 172.21.15.8:0/4167986559 shutdown_connections 2023-08-11T12:23:52.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:52.512+0000 7f88709b0700 1 -- 172.21.15.8:0/4167986559 wait complete. 2023-08-11T12:23:52.941 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- bash -c 'ceph orch device ls' 2023-08-11T12:23:53.678 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:23:53.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:53 smithi194 ceph-mon[130905]: from='client.15207 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:23:53.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:53 smithi194 ceph-mon[130905]: pgmap v330: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-11T12:23:53.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:53 smithi045 ceph-mon[130284]: from='client.15207 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:23:53.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:53 smithi045 ceph-mon[130284]: pgmap v330: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-11T12:23:53.962 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:53 smithi008 ceph-mon[97158]: from='client.15207 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:23:53.963 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:53 smithi008 ceph-mon[97158]: pgmap v330: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-11T12:23:55.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.309+0000 7f5820b4f700 1 -- 172.21.15.8:0/3537267321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f581c108880 msgr2=0x7f581c10ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:55.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.309+0000 7f5820b4f700 1 --2- 172.21.15.8:0/3537267321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f581c108880 0x7f581c10ad10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f581400b0a0 tx=0x7f581400b3b0 comp rx=0 tx=0).stop 2023-08-11T12:23:55.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.310+0000 7f5820b4f700 1 -- 172.21.15.8:0/3537267321 shutdown_connections 2023-08-11T12:23:55.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.310+0000 7f5820b4f700 1 --2- 172.21.15.8:0/3537267321 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f581c074950 0x7f581c072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.310+0000 7f5820b4f700 1 --2- 172.21.15.8:0/3537267321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f581c108880 0x7f581c10ad10 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.310+0000 7f5820b4f700 1 --2- 172.21.15.8:0/3537267321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f581c073380 0x7f581c073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.310+0000 7f5820b4f700 1 -- 172.21.15.8:0/3537267321 >> 172.21.15.8:0/3537267321 conn(0x7f581c0fbf10 msgr2=0x7f581c0fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.310+0000 7f5820b4f700 1 -- 172.21.15.8:0/3537267321 shutdown_connections 2023-08-11T12:23:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.310+0000 7f5820b4f700 1 -- 172.21.15.8:0/3537267321 wait complete. 2023-08-11T12:23:55.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.311+0000 7f5820b4f700 1 Processor -- start 2023-08-11T12:23:55.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.311+0000 7f5820b4f700 1 -- start start 2023-08-11T12:23:55.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.311+0000 7f5820b4f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f581c073380 0x7f581c1989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:55.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.311+0000 7f5820b4f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f581c074950 0x7f581c198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:55.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.311+0000 7f5820b4f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f581c108880 0x7f581c19ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:55.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.311+0000 7f5820b4f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581c1a0570 con 0x7f581c074950 2023-08-11T12:23:55.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.311+0000 7f5820b4f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581c1a06b0 con 0x7f581c073380 2023-08-11T12:23:55.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.311+0000 7f5820b4f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581c1a0840 con 0x7f581c108880 2023-08-11T12:23:55.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.312+0000 7f5819d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f581c074950 0x7f581c198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:55.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.312+0000 7f581a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f581c073380 0x7f581c1989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:55.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.312+0000 7f5819d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f581c074950 0x7f581c198f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45952/0 (socket says 172.21.15.8:45952) 2023-08-11T12:23:55.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.312+0000 7f5819d9b700 1 -- 172.21.15.8:0/2712178185 learned_addr learned my addr 172.21.15.8:0/2712178185 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:55.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.312+0000 7f581ad9d700 1 --2- 172.21.15.8:0/2712178185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f581c108880 0x7f581c19ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:55.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.312+0000 7f5819d9b700 1 -- 172.21.15.8:0/2712178185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f581c108880 msgr2=0x7f581c19ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:55.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.312+0000 7f5819d9b700 1 --2- 172.21.15.8:0/2712178185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f581c108880 0x7f581c19ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:55.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.312+0000 7f5819d9b700 1 -- 172.21.15.8:0/2712178185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f581c073380 msgr2=0x7f581c1989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:55.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.312+0000 7f5819d9b700 1 --2- 172.21.15.8:0/2712178185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f581c073380 0x7f581c1989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:55.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.312+0000 7f5819d9b700 1 -- 172.21.15.8:0/2712178185 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5814009d00 con 0x7f581c074950 2023-08-11T12:23:55.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.312+0000 7f5819d9b700 1 --2- 172.21.15.8:0/2712178185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f581c074950 0x7f581c198f20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f581000e9a0 tx=0x7f581000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:55.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.313+0000 7f580b7fe700 1 -- 172.21.15.8:0/2712178185 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5810009790 con 0x7f581c074950 2023-08-11T12:23:55.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.313+0000 7f5820b4f700 1 -- 172.21.15.8:0/2712178185 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f581c1a0b20 con 0x7f581c074950 2023-08-11T12:23:55.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.313+0000 7f580b7fe700 1 -- 172.21.15.8:0/2712178185 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f581000c810 con 0x7f581c074950 2023-08-11T12:23:55.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.313+0000 7f580b7fe700 1 -- 172.21.15.8:0/2712178185 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5810003c70 con 0x7f581c074950 2023-08-11T12:23:55.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.313+0000 7f5820b4f700 1 -- 172.21.15.8:0/2712178185 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f581c1a1070 con 0x7f581c074950 2023-08-11T12:23:55.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.314+0000 7f5820b4f700 1 -- 172.21.15.8:0/2712178185 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f581c106f30 con 0x7f581c074950 2023-08-11T12:23:55.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.316+0000 7f580b7fe700 1 -- 172.21.15.8:0/2712178185 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f581000cc80 con 0x7f581c074950 2023-08-11T12:23:55.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.317+0000 7f580b7fe700 1 --2- 172.21.15.8:0/2712178185 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f580409ffd0 0x7f58040a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:55.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.317+0000 7f580b7fe700 1 -- 172.21.15.8:0/2712178185 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f5810014070 con 0x7f581c074950 2023-08-11T12:23:55.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.317+0000 7f581a59c700 1 --2- 172.21.15.8:0/2712178185 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f580409ffd0 0x7f58040a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:55.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.318+0000 7f581a59c700 1 --2- 172.21.15.8:0/2712178185 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f580409ffd0 0x7f58040a2490 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f581c074d30 tx=0x7f580c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:55.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.321+0000 7f580b7fe700 1 -- 172.21.15.8:0/2712178185 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f58100950d0 con 0x7f581c074950 2023-08-11T12:23:55.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.536+0000 7f5820b4f700 1 -- 172.21.15.8:0/2712178185 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f581c02ced0 con 0x7f580409ffd0 2023-08-11T12:23:55.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.538+0000 7f580b7fe700 1 -- 172.21.15.8:0/2712178185 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+492 (secure 0 0 0) 0x7f581c02ced0 con 0x7f580409ffd0 2023-08-11T12:23:55.541 INFO:teuthology.orchestra.run.smithi008.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-08-11T12:23:55.541 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476004A480DGN 447G No 3m ago LVM detected, locked 2023-08-11T12:23:55.541 INFO:teuthology.orchestra.run.smithi008.stdout:smithi045 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75120098480DGN 447G No 3m ago LVM detected, locked 2023-08-11T12:23:55.541 INFO:teuthology.orchestra.run.smithi008.stdout:smithi194 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6240002A400BGN 372G No 2m ago LVM detected, locked 2023-08-11T12:23:55.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.541+0000 7f5820b4f700 1 -- 172.21.15.8:0/2712178185 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f580409ffd0 msgr2=0x7f58040a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:55.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.541+0000 7f5820b4f700 1 --2- 172.21.15.8:0/2712178185 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f580409ffd0 0x7f58040a2490 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f581c074d30 tx=0x7f580c009260 comp rx=0 tx=0).stop 2023-08-11T12:23:55.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.541+0000 7f5820b4f700 1 -- 172.21.15.8:0/2712178185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f581c074950 msgr2=0x7f581c198f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:55.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.541+0000 7f5820b4f700 1 --2- 172.21.15.8:0/2712178185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f581c074950 0x7f581c198f20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f581000e9a0 tx=0x7f581000ecb0 comp rx=0 tx=0).stop 2023-08-11T12:23:55.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.541+0000 7f5820b4f700 1 -- 172.21.15.8:0/2712178185 shutdown_connections 2023-08-11T12:23:55.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.541+0000 7f5820b4f700 1 --2- 172.21.15.8:0/2712178185 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f580409ffd0 0x7f58040a2490 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:55.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.541+0000 7f5820b4f700 1 --2- 172.21.15.8:0/2712178185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f581c108880 0x7f581c19ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:55.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.541+0000 7f5820b4f700 1 --2- 172.21.15.8:0/2712178185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f581c073380 0x7f581c1989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:55.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.541+0000 7f5820b4f700 1 --2- 172.21.15.8:0/2712178185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f581c074950 0x7f581c198f20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:55.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.541+0000 7f5820b4f700 1 -- 172.21.15.8:0/2712178185 >> 172.21.15.8:0/2712178185 conn(0x7f581c0fbf10 msgr2=0x7f581c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:55.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.541+0000 7f5820b4f700 1 -- 172.21.15.8:0/2712178185 shutdown_connections 2023-08-11T12:23:55.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:55.541+0000 7f5820b4f700 1 -- 172.21.15.8:0/2712178185 wait complete. 2023-08-11T12:23:55.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:55 smithi194 ceph-mon[130905]: pgmap v331: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:55.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:55 smithi045 ceph-mon[130284]: pgmap v331: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:55.974 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:55 smithi008 ceph-mon[97158]: pgmap v331: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:55.979 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-08-11T12:23:55.989 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi008.front.sepia.ceph.com 2023-08-11T12:23:55.989 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- bash -c 'ceph fs dump' 2023-08-11T12:23:56.743 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:23:56.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:56 smithi194 ceph-mon[130905]: from='client.15213 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:23:56.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:56 smithi045 ceph-mon[130284]: from='client.15213 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:23:57.035 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:56 smithi008 ceph-mon[97158]: from='client.15213 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:23:57.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:57 smithi194 ceph-mon[130905]: pgmap v332: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-08-11T12:23:57.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:57 smithi045 ceph-mon[130284]: pgmap v332: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-08-11T12:23:58.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:57 smithi008 ceph-mon[97158]: pgmap v332: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-08-11T12:23:58.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.400+0000 7fbac48e3700 1 -- 172.21.15.8:0/793707160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbac0101bc0 msgr2=0x7fbac0102020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:58.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.400+0000 7fbac48e3700 1 --2- 172.21.15.8:0/793707160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbac0101bc0 0x7fbac0102020 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbab40099c0 tx=0x7fbab4009cd0 comp rx=0 tx=0).stop 2023-08-11T12:23:58.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.401+0000 7fbac48e3700 1 -- 172.21.15.8:0/793707160 shutdown_connections 2023-08-11T12:23:58.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.401+0000 7fbac48e3700 1 --2- 172.21.15.8:0/793707160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbac0102560 0x7fbac0108e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:58.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.401+0000 7fbac48e3700 1 --2- 172.21.15.8:0/793707160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbac01009c0 0x7fbac0100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:58.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.401+0000 7fbac48e3700 1 --2- 172.21.15.8:0/793707160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbac0101bc0 0x7fbac0102020 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:58.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.401+0000 7fbac48e3700 1 -- 172.21.15.8:0/793707160 >> 172.21.15.8:0/793707160 conn(0x7fbac00fbf40 msgr2=0x7fbac00fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:58.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.401+0000 7fbac48e3700 1 -- 172.21.15.8:0/793707160 shutdown_connections 2023-08-11T12:23:58.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.401+0000 7fbac48e3700 1 -- 172.21.15.8:0/793707160 wait complete. 2023-08-11T12:23:58.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.402+0000 7fbac48e3700 1 Processor -- start 2023-08-11T12:23:58.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.402+0000 7fbac48e3700 1 -- start start 2023-08-11T12:23:58.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.402+0000 7fbac48e3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbac01009c0 0x7fbac0198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:58.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.402+0000 7fbac48e3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbac0101bc0 0x7fbac0198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:58.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.402+0000 7fbac48e3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbac0102560 0x7fbac019fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:58.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.402+0000 7fbac48e3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac01a0420 con 0x7fbac01009c0 2023-08-11T12:23:58.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.402+0000 7fbac48e3700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac01a0560 con 0x7fbac0101bc0 2023-08-11T12:23:58.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.402+0000 7fbac48e3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac01a06f0 con 0x7fbac0102560 2023-08-11T12:23:58.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.402+0000 7fbabe59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbac01009c0 0x7fbac0198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:58.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.403+0000 7fbabe59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbac01009c0 0x7fbac0198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53514/0 (socket says 172.21.15.8:53514) 2023-08-11T12:23:58.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.403+0000 7fbabe59c700 1 -- 172.21.15.8:0/3874600745 learned_addr learned my addr 172.21.15.8:0/3874600745 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:23:58.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.403+0000 7fbabed9d700 1 --2- 172.21.15.8:0/3874600745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbac0102560 0x7fbac019fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:58.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.403+0000 7fbabdd9b700 1 --2- 172.21.15.8:0/3874600745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbac0101bc0 0x7fbac0198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:58.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.403+0000 7fbabe59c700 1 -- 172.21.15.8:0/3874600745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbac0102560 msgr2=0x7fbac019fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:58.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.403+0000 7fbabe59c700 1 --2- 172.21.15.8:0/3874600745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbac0102560 0x7fbac019fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:58.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.403+0000 7fbabe59c700 1 -- 172.21.15.8:0/3874600745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbac0101bc0 msgr2=0x7fbac0198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:58.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.403+0000 7fbabe59c700 1 --2- 172.21.15.8:0/3874600745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbac0101bc0 0x7fbac0198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:58.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.403+0000 7fbabe59c700 1 -- 172.21.15.8:0/3874600745 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab40095f0 con 0x7fbac01009c0 2023-08-11T12:23:58.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.403+0000 7fbabed9d700 1 --2- 172.21.15.8:0/3874600745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbac0102560 0x7fbac019fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:58.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.403+0000 7fbabdd9b700 1 --2- 172.21.15.8:0/3874600745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbac0101bc0 0x7fbac0198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:23:58.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.403+0000 7fbabe59c700 1 --2- 172.21.15.8:0/3874600745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbac01009c0 0x7fbac0198890 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbab000e9a0 tx=0x7fbab000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:58.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.404+0000 7fbaaf7fe700 1 -- 172.21.15.8:0/3874600745 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab0009790 con 0x7fbac01009c0 2023-08-11T12:23:58.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.404+0000 7fbaaf7fe700 1 -- 172.21.15.8:0/3874600745 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbab000c810 con 0x7fbac01009c0 2023-08-11T12:23:58.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.404+0000 7fbaaf7fe700 1 -- 172.21.15.8:0/3874600745 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab0003c70 con 0x7fbac01009c0 2023-08-11T12:23:58.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.404+0000 7fbac48e3700 1 -- 172.21.15.8:0/3874600745 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac01a09d0 con 0x7fbac01009c0 2023-08-11T12:23:58.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.404+0000 7fbac48e3700 1 -- 172.21.15.8:0/3874600745 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac01a0e80 con 0x7fbac01009c0 2023-08-11T12:23:58.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.405+0000 7fbac48e3700 1 -- 172.21.15.8:0/3874600745 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac010c1c0 con 0x7fbac01009c0 2023-08-11T12:23:58.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.407+0000 7fbaaf7fe700 1 -- 172.21.15.8:0/3874600745 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fbab000cc80 con 0x7fbac01009c0 2023-08-11T12:23:58.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.408+0000 7fbaaf7fe700 1 --2- 172.21.15.8:0/3874600745 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fbaa809ffd0 0x7fbaa80a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:23:58.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.408+0000 7fbaaf7fe700 1 -- 172.21.15.8:0/3874600745 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fbab0014070 con 0x7fbac01009c0 2023-08-11T12:23:58.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.408+0000 7fbabdd9b700 1 --2- 172.21.15.8:0/3874600745 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fbaa809ffd0 0x7fbaa80a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:23:58.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.409+0000 7fbabdd9b700 1 --2- 172.21.15.8:0/3874600745 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fbaa809ffd0 0x7fbaa80a2490 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbab400b580 tx=0x7fbab4005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:23:58.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.412+0000 7fbaaf7fe700 1 -- 172.21.15.8:0/3874600745 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fbab00950b0 con 0x7fbac01009c0 2023-08-11T12:23:58.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.672+0000 7fbac48e3700 1 -- 172.21.15.8:0/3874600745 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbac01a10d0 con 0x7fbac01009c0 2023-08-11T12:23:58.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.672+0000 7fbaaf7fe700 1 -- 172.21.15.8:0/3874600745 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+2961 (secure 0 0 0) 0x7fbab00986d0 con 0x7fbac01009c0 2023-08-11T12:23:58.675 INFO:teuthology.orchestra.run.smithi008.stdout:e27 2023-08-11T12:23:58.675 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-08-11T12:23:58.675 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-08-11T12:23:58.675 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-08-11T12:23:58.675 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:23:58.676 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-08-11T12:23:58.676 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-08-11T12:23:58.676 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 27 2023-08-11T12:23:58.676 INFO:teuthology.orchestra.run.smithi008.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-08-11T12:23:58.676 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-08-11T12:22:03.398475+0000 2023-08-11T12:23:58.676 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-08-11T12:22:32.690553+0000 2023-08-11T12:23:58.676 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-08-11T12:23:58.676 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-08-11T12:23:58.677 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 300 2023-08-11T12:23:58.677 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-08-11T12:23:58.677 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-08-11T12:23:58.677 INFO:teuthology.orchestra.run.smithi008.stdout:max_xattr_size 65536 2023-08-11T12:23:58.677 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-08-11T12:23:58.677 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-08-11T12:23:58.677 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 0 2023-08-11T12:23:58.678 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-08-11T12:23:58.678 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 5 2023-08-11T12:23:58.678 INFO:teuthology.orchestra.run.smithi008.stdout:in 0,1,2,3,4 2023-08-11T12:23:58.678 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=24575,1=24550,2=24517,3=24500,4=24464} 2023-08-11T12:23:58.678 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-08-11T12:23:58.678 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-08-11T12:23:58.679 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 2023-08-11T12:23:58.679 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3,4] 2023-08-11T12:23:58.679 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-08-11T12:23:58.679 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-08-11T12:23:58.679 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-08-11T12:23:58.679 INFO:teuthology.orchestra.run.smithi008.stdout:bal_rank_mask -1 2023-08-11T12:23:58.679 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 0 2023-08-11T12:23:58.680 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.b{0:24575} state up:active seq 3 addr [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] compat {c=[1],r=[1],i=[fff]}] 2023-08-11T12:23:58.680 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.h{0:24533} state up:standby-replay seq 1 addr [v2:172.21.15.45:6836/641549061,v1:172.21.15.45:6837/641549061] compat {c=[1],r=[1],i=[fff]}] 2023-08-11T12:23:58.680 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.i{1:24550} state up:active seq 11 addr [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] compat {c=[1],r=[1],i=[fff]}] 2023-08-11T12:23:58.680 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.c{1:24529} state up:standby-replay seq 1 addr [v2:172.21.15.194:6836/3072808560,v1:172.21.15.194:6837/3072808560] compat {c=[1],r=[1],i=[fff]}] 2023-08-11T12:23:58.680 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.f{2:24517} state up:active seq 13 addr [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] compat {c=[1],r=[1],i=[fff]}] 2023-08-11T12:23:58.680 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.l{2:24457} state up:standby-replay seq 1 addr [v2:172.21.15.194:6832/2043443402,v1:172.21.15.194:6833/2043443402] compat {c=[1],r=[1],i=[fff]}] 2023-08-11T12:23:58.680 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.e{3:24500} state up:active seq 14 addr [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] compat {c=[1],r=[1],i=[fff]}] 2023-08-11T12:23:58.680 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.a{3:14538} state up:standby-replay seq 1 addr [v2:172.21.15.8:6840/3589272762,v1:172.21.15.8:6841/3589272762] compat {c=[1],r=[1],i=[fff]}] 2023-08-11T12:23:58.681 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.k{4:24464} state up:active seq 17 addr [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] compat {c=[1],r=[1],i=[fff]}] 2023-08-11T12:23:58.681 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.g{4:14526} state up:standby-replay seq 1 addr [v2:172.21.15.8:6838/2990530720,v1:172.21.15.8:6839/2990530720] compat {c=[1],r=[1],i=[fff]}] 2023-08-11T12:23:58.681 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:23:58.681 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:23:58.681 INFO:teuthology.orchestra.run.smithi008.stdout:Standby daemons: 2023-08-11T12:23:58.681 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:23:58.681 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.j{-1:14469} state up:standby seq 1 addr [v2:172.21.15.8:6834/2854286216,v1:172.21.15.8:6835/2854286216] compat {c=[1],r=[1],i=[fff]}] 2023-08-11T12:23:58.681 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.d{-1:14481} state up:standby seq 1 addr [v2:172.21.15.8:6836/805368621,v1:172.21.15.8:6837/805368621] compat {c=[1],r=[1],i=[fff]}] 2023-08-11T12:23:58.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.675+0000 7fbac48e3700 1 -- 172.21.15.8:0/3874600745 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fbaa809ffd0 msgr2=0x7fbaa80a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:58.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.675+0000 7fbac48e3700 1 --2- 172.21.15.8:0/3874600745 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fbaa809ffd0 0x7fbaa80a2490 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbab400b580 tx=0x7fbab4005fb0 comp rx=0 tx=0).stop 2023-08-11T12:23:58.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.675+0000 7fbac48e3700 1 -- 172.21.15.8:0/3874600745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbac01009c0 msgr2=0x7fbac0198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:23:58.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.675+0000 7fbac48e3700 1 --2- 172.21.15.8:0/3874600745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbac01009c0 0x7fbac0198890 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbab000e9a0 tx=0x7fbab000ecb0 comp rx=0 tx=0).stop 2023-08-11T12:23:58.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.675+0000 7fbac48e3700 1 -- 172.21.15.8:0/3874600745 shutdown_connections 2023-08-11T12:23:58.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.675+0000 7fbac48e3700 1 --2- 172.21.15.8:0/3874600745 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fbaa809ffd0 0x7fbaa80a2490 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:58.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.675+0000 7fbac48e3700 1 --2- 172.21.15.8:0/3874600745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbac0102560 0x7fbac019fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:58.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.675+0000 7fbac48e3700 1 --2- 172.21.15.8:0/3874600745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbac01009c0 0x7fbac0198890 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:58.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.675+0000 7fbac48e3700 1 --2- 172.21.15.8:0/3874600745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbac0101bc0 0x7fbac0198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:23:58.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.675+0000 7fbac48e3700 1 -- 172.21.15.8:0/3874600745 >> 172.21.15.8:0/3874600745 conn(0x7fbac00fbf40 msgr2=0x7fbac00fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:23:58.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.675+0000 7fbac48e3700 1 -- 172.21.15.8:0/3874600745 shutdown_connections 2023-08-11T12:23:58.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:23:58.675+0000 7fbac48e3700 1 -- 172.21.15.8:0/3874600745 wait complete. 2023-08-11T12:23:58.684 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 27 2023-08-11T12:23:58.875 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:58 smithi008 ceph-mon[97158]: pgmap v333: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:58.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:58 smithi194 ceph-mon[130905]: pgmap v333: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:58.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:58 smithi045 ceph-mon[130284]: pgmap v333: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:23:59.242 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- bash -c 'ceph osd dump' 2023-08-11T12:23:59.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:23:59 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3874600745' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-08-11T12:23:59.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:23:59 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3874600745' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-08-11T12:23:59.975 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:24:00.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:23:59 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3874600745' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-08-11T12:24:00.855 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:00 smithi008 ceph-mon[97158]: pgmap v334: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-11T12:24:01.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:00 smithi194 ceph-mon[130905]: pgmap v334: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-11T12:24:01.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:00 smithi045 ceph-mon[130284]: pgmap v334: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-11T12:24:01.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.499+0000 7fe21e8df700 1 -- 172.21.15.8:0/1581321297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2181009b0 msgr2=0x7fe218100dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:01.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.499+0000 7fe21e8df700 1 --2- 172.21.15.8:0/1581321297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2181009b0 0x7fe218100dd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe2080099c0 tx=0x7fe208009cd0 comp rx=0 tx=0).stop 2023-08-11T12:24:01.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.499+0000 7fe21e8df700 1 -- 172.21.15.8:0/1581321297 shutdown_connections 2023-08-11T12:24:01.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.499+0000 7fe21e8df700 1 --2- 172.21.15.8:0/1581321297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe218102550 0x7fe218108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:01.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.499+0000 7fe21e8df700 1 --2- 172.21.15.8:0/1581321297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2181009b0 0x7fe218100dd0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:01.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.499+0000 7fe21e8df700 1 --2- 172.21.15.8:0/1581321297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe218101bb0 0x7fe218102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:01.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.499+0000 7fe21e8df700 1 -- 172.21.15.8:0/1581321297 >> 172.21.15.8:0/1581321297 conn(0x7fe2180fbf10 msgr2=0x7fe2180fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:01.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.499+0000 7fe21e8df700 1 -- 172.21.15.8:0/1581321297 shutdown_connections 2023-08-11T12:24:01.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.499+0000 7fe21e8df700 1 -- 172.21.15.8:0/1581321297 wait complete. 2023-08-11T12:24:01.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.500+0000 7fe21e8df700 1 Processor -- start 2023-08-11T12:24:01.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.500+0000 7fe21e8df700 1 -- start start 2023-08-11T12:24:01.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.501+0000 7fe21e8df700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2181009b0 0x7fe2180746c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:01.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.501+0000 7fe21e8df700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe218101bb0 0x7fe218072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:01.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.501+0000 7fe21e8df700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe218102550 0x7fe218073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:01.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.501+0000 7fe21e8df700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2180739d0 con 0x7fe218101bb0 2023-08-11T12:24:01.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.501+0000 7fe21e8df700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe218073b40 con 0x7fe218102550 2023-08-11T12:24:01.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.501+0000 7fe21e8df700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2181a0710 con 0x7fe2181009b0 2023-08-11T12:24:01.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.501+0000 7fe2177fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe218101bb0 0x7fe218072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:01.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.501+0000 7fe2177fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe218101bb0 0x7fe218072d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53532/0 (socket says 172.21.15.8:53532) 2023-08-11T12:24:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.501+0000 7fe2177fe700 1 -- 172.21.15.8:0/2295258916 learned_addr learned my addr 172.21.15.8:0/2295258916 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.501+0000 7fe21ce7c700 1 --2- 172.21.15.8:0/2295258916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe218102550 0x7fe218073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.501+0000 7fe217fff700 1 --2- 172.21.15.8:0/2295258916 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2181009b0 0x7fe2180746c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.502+0000 7fe2177fe700 1 -- 172.21.15.8:0/2295258916 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2181009b0 msgr2=0x7fe2180746c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.502+0000 7fe2177fe700 1 --2- 172.21.15.8:0/2295258916 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2181009b0 0x7fe2180746c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.502+0000 7fe2177fe700 1 -- 172.21.15.8:0/2295258916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe218102550 msgr2=0x7fe218073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.502+0000 7fe2177fe700 1 --2- 172.21.15.8:0/2295258916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe218102550 0x7fe218073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.502+0000 7fe2177fe700 1 -- 172.21.15.8:0/2295258916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2080095f0 con 0x7fe218101bb0 2023-08-11T12:24:01.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.502+0000 7fe2177fe700 1 --2- 172.21.15.8:0/2295258916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe218101bb0 0x7fe218072d10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe20c00e9a0 tx=0x7fe20c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:01.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.502+0000 7fe2157fa700 1 -- 172.21.15.8:0/2295258916 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20c009790 con 0x7fe218101bb0 2023-08-11T12:24:01.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.502+0000 7fe21e8df700 1 -- 172.21.15.8:0/2295258916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2181a09f0 con 0x7fe218101bb0 2023-08-11T12:24:01.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.502+0000 7fe2157fa700 1 -- 172.21.15.8:0/2295258916 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe20c010430 con 0x7fe218101bb0 2023-08-11T12:24:01.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.502+0000 7fe2157fa700 1 -- 172.21.15.8:0/2295258916 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20c018680 con 0x7fe218101bb0 2023-08-11T12:24:01.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.502+0000 7fe21e8df700 1 -- 172.21.15.8:0/2295258916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2181a0f40 con 0x7fe218101bb0 2023-08-11T12:24:01.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.503+0000 7fe21e8df700 1 -- 172.21.15.8:0/2295258916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe218107fd0 con 0x7fe218101bb0 2023-08-11T12:24:01.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.505+0000 7fe2157fa700 1 -- 172.21.15.8:0/2295258916 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fe20c0105a0 con 0x7fe218101bb0 2023-08-11T12:24:01.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.507+0000 7fe2157fa700 1 --2- 172.21.15.8:0/2295258916 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe20009ff50 0x7fe2000a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:01.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.508+0000 7fe2157fa700 1 -- 172.21.15.8:0/2295258916 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fe20c014070 con 0x7fe218101bb0 2023-08-11T12:24:01.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.508+0000 7fe217fff700 1 --2- 172.21.15.8:0/2295258916 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe20009ff50 0x7fe2000a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:01.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.508+0000 7fe217fff700 1 --2- 172.21.15.8:0/2295258916 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe20009ff50 0x7fe2000a2410 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe208009990 tx=0x7fe208005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:01.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.512+0000 7fe2157fa700 1 -- 172.21.15.8:0/2295258916 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fe20c051c30 con 0x7fe218101bb0 2023-08-11T12:24:01.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.721+0000 7fe21e8df700 1 -- 172.21.15.8:0/2295258916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7fe21810c200 con 0x7fe218101bb0 2023-08-11T12:24:01.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.722+0000 7fe2157fa700 1 -- 172.21.15.8:0/2295258916 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v89) v1 ==== 56+0+5550 (secure 0 0 0) 0x7fe20c095130 con 0x7fe218101bb0 2023-08-11T12:24:01.724 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 89 2023-08-11T12:24:01.724 INFO:teuthology.orchestra.run.smithi008.stdout:fsid 815f94ae-3840-11ee-9b37-001a4aab830c 2023-08-11T12:24:01.724 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-08-11T12:14:28.341113+0000 2023-08-11T12:24:01.724 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-08-11T12:22:31.713248+0000 2023-08-11T12:24:01.725 INFO:teuthology.orchestra.run.smithi008.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-08-11T12:24:01.725 INFO:teuthology.orchestra.run.smithi008.stdout:crush_version 27 2023-08-11T12:24:01.725 INFO:teuthology.orchestra.run.smithi008.stdout:full_ratio 0.95 2023-08-11T12:24:01.725 INFO:teuthology.orchestra.run.smithi008.stdout:backfillfull_ratio 0.9 2023-08-11T12:24:01.725 INFO:teuthology.orchestra.run.smithi008.stdout:nearfull_ratio 0.85 2023-08-11T12:24:01.725 INFO:teuthology.orchestra.run.smithi008.stdout:require_min_compat_client luminous 2023-08-11T12:24:01.725 INFO:teuthology.orchestra.run.smithi008.stdout:min_compat_client luminous 2023-08-11T12:24:01.725 INFO:teuthology.orchestra.run.smithi008.stdout:require_osd_release reef 2023-08-11T12:24:01.726 INFO:teuthology.orchestra.run.smithi008.stdout:stretch_mode_enabled false 2023-08-11T12:24:01.726 INFO:teuthology.orchestra.run.smithi008.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-08-11T12:24:01.726 INFO:teuthology.orchestra.run.smithi008.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2023-08-11T12:24:01.726 INFO:teuthology.orchestra.run.smithi008.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 83 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2023-08-11T12:24:01.726 INFO:teuthology.orchestra.run.smithi008.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 87 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2023-08-11T12:24:01.726 INFO:teuthology.orchestra.run.smithi008.stdout:max_osd 12 2023-08-11T12:24:01.726 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 up in weight 1 up_from 8 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.8:6802/664104961,v1:172.21.15.8:6803/664104961] [v2:172.21.15.8:6804/664104961,v1:172.21.15.8:6805/664104961] exists,up f903e393-7894-42d6-8b11-737ceef1f4c5 2023-08-11T12:24:01.727 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 up in weight 1 up_from 13 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.45:6800/4187350703,v1:172.21.15.45:6801/4187350703] [v2:172.21.15.45:6802/4187350703,v1:172.21.15.45:6803/4187350703] exists,up 1e988e5c-e78c-46d5-80a5-dff7ac38cbeb 2023-08-11T12:24:01.727 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 up in weight 1 up_from 18 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6800/2547818140,v1:172.21.15.194:6801/2547818140] [v2:172.21.15.194:6802/2547818140,v1:172.21.15.194:6803/2547818140] exists,up 1835217c-a93c-4181-b8b8-cc410bab1a89 2023-08-11T12:24:01.727 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 up in weight 1 up_from 25 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.8:6810/187418883,v1:172.21.15.8:6811/187418883] [v2:172.21.15.8:6812/187418883,v1:172.21.15.8:6813/187418883] exists,up b55ae61a-731c-4312-a998-661122b84788 2023-08-11T12:24:01.727 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 up in weight 1 up_from 33 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.45:6808/3099704571,v1:172.21.15.45:6809/3099704571] [v2:172.21.15.45:6810/3099704571,v1:172.21.15.45:6811/3099704571] exists,up 2c28acbb-e807-4559-8aa2-a35ca84b5d43 2023-08-11T12:24:01.727 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 up in weight 1 up_from 38 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6808/263803874,v1:172.21.15.194:6809/263803874] [v2:172.21.15.194:6810/263803874,v1:172.21.15.194:6811/263803874] exists,up 37032289-8016-4730-9b69-f7985e058ff9 2023-08-11T12:24:01.727 INFO:teuthology.orchestra.run.smithi008.stdout:osd.6 up in weight 1 up_from 46 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.8:6818/1802966829,v1:172.21.15.8:6819/1802966829] [v2:172.21.15.8:6820/1802966829,v1:172.21.15.8:6821/1802966829] exists,up 32d2dab9-6944-40d1-ada9-4f941821b063 2023-08-11T12:24:01.727 INFO:teuthology.orchestra.run.smithi008.stdout:osd.7 up in weight 1 up_from 51 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.45:6816/3715737148,v1:172.21.15.45:6817/3715737148] [v2:172.21.15.45:6818/3715737148,v1:172.21.15.45:6819/3715737148] exists,up 086aff58-1554-49fe-92ff-5166b115aeef 2023-08-11T12:24:01.727 INFO:teuthology.orchestra.run.smithi008.stdout:osd.8 up in weight 1 up_from 58 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6816/57497127,v1:172.21.15.194:6817/57497127] [v2:172.21.15.194:6818/57497127,v1:172.21.15.194:6819/57497127] exists,up 7fff5e95-2453-4ea6-a5c1-3bba6a1f6400 2023-08-11T12:24:01.728 INFO:teuthology.orchestra.run.smithi008.stdout:osd.9 up in weight 1 up_from 66 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.8:6826/434661930,v1:172.21.15.8:6827/434661930] [v2:172.21.15.8:6828/434661930,v1:172.21.15.8:6829/434661930] exists,up 31ab0121-4c92-42ec-9f19-e672062e8814 2023-08-11T12:24:01.728 INFO:teuthology.orchestra.run.smithi008.stdout:osd.10 up in weight 1 up_from 71 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.45:6824/3281212184,v1:172.21.15.45:6825/3281212184] [v2:172.21.15.45:6826/3281212184,v1:172.21.15.45:6827/3281212184] exists,up 62c632e4-94f6-4630-9d94-8d28fccacf45 2023-08-11T12:24:01.728 INFO:teuthology.orchestra.run.smithi008.stdout:osd.11 up in weight 1 up_from 78 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6824/1637875895,v1:172.21.15.194:6825/1637875895] [v2:172.21.15.194:6826/1637875895,v1:172.21.15.194:6827/1637875895] exists,up 8ca4a80d-cd75-4230-b46d-aef6fdc03e6f 2023-08-11T12:24:01.728 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 2.4 [2,11] 2023-08-11T12:24:01.728 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 2.b [8,11] 2023-08-11T12:24:01.728 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 3.e [5,9] 2023-08-11T12:24:01.728 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 3.1e [3,9] 2023-08-11T12:24:01.729 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 3.31 [4,8] 2023-08-11T12:24:01.729 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 3.34 [4,9] 2023-08-11T12:24:01.729 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 4.11 [5,8] 2023-08-11T12:24:01.729 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 4.12 [9,10] 2023-08-11T12:24:01.729 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 4.13 [9,8] 2023-08-11T12:24:01.729 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 4.19 [9,8] 2023-08-11T12:24:01.729 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/2000592056 expires 2023-08-12T12:15:30.423754+0000 2023-08-11T12:24:01.730 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/2102228072 expires 2023-08-12T12:15:30.423754+0000 2023-08-11T12:24:01.730 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:6801/2832004641 expires 2023-08-12T12:15:30.423754+0000 2023-08-11T12:24:01.730 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:6800/2832004641 expires 2023-08-12T12:15:30.423754+0000 2023-08-11T12:24:01.730 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:6800/2108474030 expires 2023-08-12T12:15:02.528403+0000 2023-08-11T12:24:01.730 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/2374527928 expires 2023-08-12T12:15:02.528403+0000 2023-08-11T12:24:01.730 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/2928221278 expires 2023-08-12T12:15:02.528403+0000 2023-08-11T12:24:01.730 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/2744750874 expires 2023-08-12T12:15:30.423754+0000 2023-08-11T12:24:01.730 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:6801/2108474030 expires 2023-08-12T12:15:02.528403+0000 2023-08-11T12:24:01.731 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/3681755887 expires 2023-08-12T12:15:02.528403+0000 2023-08-11T12:24:01.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.724+0000 7fe21e8df700 1 -- 172.21.15.8:0/2295258916 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe20009ff50 msgr2=0x7fe2000a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:01.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.724+0000 7fe21e8df700 1 --2- 172.21.15.8:0/2295258916 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe20009ff50 0x7fe2000a2410 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe208009990 tx=0x7fe208005fb0 comp rx=0 tx=0).stop 2023-08-11T12:24:01.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.724+0000 7fe21e8df700 1 -- 172.21.15.8:0/2295258916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe218101bb0 msgr2=0x7fe218072d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:01.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.724+0000 7fe21e8df700 1 --2- 172.21.15.8:0/2295258916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe218101bb0 0x7fe218072d10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe20c00e9a0 tx=0x7fe20c00ecb0 comp rx=0 tx=0).stop 2023-08-11T12:24:01.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.724+0000 7fe21e8df700 1 -- 172.21.15.8:0/2295258916 shutdown_connections 2023-08-11T12:24:01.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.724+0000 7fe21e8df700 1 --2- 172.21.15.8:0/2295258916 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe20009ff50 0x7fe2000a2410 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:01.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.724+0000 7fe21e8df700 1 --2- 172.21.15.8:0/2295258916 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2181009b0 0x7fe2180746c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:01.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.724+0000 7fe21e8df700 1 --2- 172.21.15.8:0/2295258916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe218102550 0x7fe218073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:01.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.724+0000 7fe21e8df700 1 --2- 172.21.15.8:0/2295258916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe218101bb0 0x7fe218072d10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:01.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.724+0000 7fe21e8df700 1 -- 172.21.15.8:0/2295258916 >> 172.21.15.8:0/2295258916 conn(0x7fe2180fbf10 msgr2=0x7fe218105110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:01.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.724+0000 7fe21e8df700 1 -- 172.21.15.8:0/2295258916 shutdown_connections 2023-08-11T12:24:01.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:01.724+0000 7fe21e8df700 1 -- 172.21.15.8:0/2295258916 wait complete. 2023-08-11T12:24:02.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:01 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2295258916' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-08-11T12:24:02.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:01 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2295258916' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-08-11T12:24:02.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:01 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2295258916' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-08-11T12:24:02.272 INFO:teuthology.run_tasks:Running task fs.ready... 2023-08-11T12:24:02.283 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-11T12:24:02.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.489+0000 7f4f0e9ff700 1 -- 172.21.15.8:0/2283660135 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f08102580 msgr2=0x7f4f08108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:02.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.489+0000 7f4f0e9ff700 1 --2- 172.21.15.8:0/2283660135 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f08102580 0x7f4f08108e30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4f0000b0d0 tx=0x7f4f0000b3e0 comp rx=0 tx=0).stop 2023-08-11T12:24:02.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.489+0000 7f4f0e9ff700 1 -- 172.21.15.8:0/2283660135 shutdown_connections 2023-08-11T12:24:02.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.489+0000 7f4f0e9ff700 1 --2- 172.21.15.8:0/2283660135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f081009f0 0x7f4f08100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:02.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.489+0000 7f4f0e9ff700 1 --2- 172.21.15.8:0/2283660135 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f08102580 0x7f4f08108e30 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:02.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.489+0000 7f4f0e9ff700 1 --2- 172.21.15.8:0/2283660135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f08101be0 0x7f4f08102040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:02.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.489+0000 7f4f0e9ff700 1 -- 172.21.15.8:0/2283660135 >> 172.21.15.8:0/2283660135 conn(0x7f4f080fbf80 msgr2=0x7f4f080fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:02.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.490+0000 7f4f0e9ff700 1 -- 172.21.15.8:0/2283660135 shutdown_connections 2023-08-11T12:24:02.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.490+0000 7f4f0e9ff700 1 -- 172.21.15.8:0/2283660135 wait complete. 2023-08-11T12:24:02.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.491+0000 7f4f0e9ff700 1 Processor -- start 2023-08-11T12:24:02.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.491+0000 7f4f0e9ff700 1 -- start start 2023-08-11T12:24:02.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.492+0000 7f4f0e9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f081009f0 0x7f4f081967e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:02.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.492+0000 7f4f0e9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f08101be0 0x7f4f08196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:02.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.492+0000 7f4f0e9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f08102580 0x7f4f0819dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:02.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.492+0000 7f4f0e9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0819e360 con 0x7f4f08101be0 2023-08-11T12:24:02.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.492+0000 7f4f0e9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0819e4a0 con 0x7f4f081009f0 2023-08-11T12:24:02.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.492+0000 7f4f0e9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0819e630 con 0x7f4f08102580 2023-08-11T12:24:02.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.492+0000 7f4f077fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f08101be0 0x7f4f08196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:02.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.492+0000 7f4f077fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f08101be0 0x7f4f08196d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53548/0 (socket says 172.21.15.8:53548) 2023-08-11T12:24:02.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.492+0000 7f4f077fe700 1 -- 172.21.15.8:0/1244289469 learned_addr learned my addr 172.21.15.8:0/1244289469 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:02.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.492+0000 7f4f07fff700 1 --2- 172.21.15.8:0/1244289469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f081009f0 0x7f4f081967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:02.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.492+0000 7f4f0cf9c700 1 --2- 172.21.15.8:0/1244289469 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f08102580 0x7f4f0819dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:02.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.492+0000 7f4f077fe700 1 -- 172.21.15.8:0/1244289469 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f08102580 msgr2=0x7f4f0819dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:02.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.492+0000 7f4f077fe700 1 --2- 172.21.15.8:0/1244289469 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f08102580 0x7f4f0819dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:02.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.492+0000 7f4f077fe700 1 -- 172.21.15.8:0/1244289469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f081009f0 msgr2=0x7f4f081967e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:02.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.492+0000 7f4f077fe700 1 --2- 172.21.15.8:0/1244289469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f081009f0 0x7f4f081967e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:02.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.492+0000 7f4f077fe700 1 -- 172.21.15.8:0/1244289469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f00009d00 con 0x7f4f08101be0 2023-08-11T12:24:02.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.493+0000 7f4f077fe700 1 --2- 172.21.15.8:0/1244289469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f08101be0 0x7f4f08196d20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00e9a0 tx=0x7f4efc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:02.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.493+0000 7f4f057fa700 1 -- 172.21.15.8:0/1244289469 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc009790 con 0x7f4f08101be0 2023-08-11T12:24:02.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.493+0000 7f4f0e9ff700 1 -- 172.21.15.8:0/1244289469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0819e910 con 0x7f4f08101be0 2023-08-11T12:24:02.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.493+0000 7f4f057fa700 1 -- 172.21.15.8:0/1244289469 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4efc010430 con 0x7f4f08101be0 2023-08-11T12:24:02.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.493+0000 7f4f057fa700 1 -- 172.21.15.8:0/1244289469 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc018680 con 0x7f4f08101be0 2023-08-11T12:24:02.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.493+0000 7f4f0e9ff700 1 -- 172.21.15.8:0/1244289469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0819ee70 con 0x7f4f08101be0 2023-08-11T12:24:02.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.494+0000 7f4f0e9ff700 1 -- 172.21.15.8:0/1244289469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0810c260 con 0x7f4f08101be0 2023-08-11T12:24:02.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.496+0000 7f4f057fa700 1 -- 172.21.15.8:0/1244289469 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f4efc0105a0 con 0x7f4f08101be0 2023-08-11T12:24:02.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.497+0000 7f4f057fa700 1 --2- 172.21.15.8:0/1244289469 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f4ef009ff50 0x7f4ef00a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:02.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.498+0000 7f4f057fa700 1 -- 172.21.15.8:0/1244289469 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f4efc014070 con 0x7f4f08101be0 2023-08-11T12:24:02.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.498+0000 7f4f07fff700 1 --2- 172.21.15.8:0/1244289469 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f4ef009ff50 0x7f4ef00a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:02.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.498+0000 7f4f07fff700 1 --2- 172.21.15.8:0/1244289469 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f4ef009ff50 0x7f4ef00a2410 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4f08101a40 tx=0x7f4ef8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:02.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.501+0000 7f4f057fa700 1 -- 172.21.15.8:0/1244289469 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f4efc051c30 con 0x7f4f08101be0 2023-08-11T12:24:02.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.713+0000 7f4f0e9ff700 1 -- 172.21.15.8:0/1244289469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f0810c450 con 0x7f4f08101be0 2023-08-11T12:24:02.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.714+0000 7f4f057fa700 1 -- 172.21.15.8:0/1244289469 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24348 (secure 0 0 0) 0x7f4efc095180 con 0x7f4f08101be0 2023-08-11T12:24:02.717 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:02.717 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":89,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","created":"2023-08-11T12:14:28.341113+0000","modified":"2023-08-11T12:22:31.713248+0000","last_up_change":"2023-08-11T12:21:14.913735+0000","last_in_change":"2023-08-11T12:20:57.476558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-11T12:17:49.040758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-11T12:22:01.383296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-11T12:22:02.816329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-11T12:22:06.369375+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f903e393-7894-42d6-8b11-737ceef1f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6803","nonce":664104961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6805","nonce":664104961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6809","nonce":664104961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6807","nonce":664104961}]},"public_addr":"172.21.15.8:6803/664104961","cluster_addr":"172.21.15.8:6805/664104961","heartbeat_back_addr":"172.21.15.8:6809/664104961","heartbeat_front_addr":"172.21.15.8:6807/664104961","state":["exists","up"]},{"osd":1,"uuid":"1e988e5c-e78c-46d5-80a5-dff7ac38cbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6801","nonce":4187350703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6803","nonce":4187350703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6807","nonce":4187350703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6805","nonce":4187350703}]},"public_addr":"172.21.15.45:6801/4187350703","cluster_addr":"172.21.15.45:6803/4187350703","heartbeat_back_addr":"172.21.15.45:6807/4187350703","heartbeat_front_addr":"172.21.15.45:6805/4187350703","state":["exists","up"]},{"osd":2,"uuid":"1835217c-a93c-4181-b8b8-cc410bab1a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6801","nonce":2547818140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6803","nonce":2547818140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6807","nonce":2547818140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6805","nonce":2547818140}]},"public_addr":"172.21.15.194:6801/2547818140","cluster_addr":"172.21.15.194:6803/2547818140","heartbeat_back_addr":"172.21.15.194:6807/2547818140","heartbeat_front_addr":"172.21.15.194:6805/2547818140","state":["exists","up"]},{"osd":3,"uuid":"b55ae61a-731c-4312-a998-661122b84788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6811","nonce":187418883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6813","nonce":187418883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6817","nonce":187418883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6815","nonce":187418883}]},"public_addr":"172.21.15.8:6811/187418883","cluster_addr":"172.21.15.8:6813/187418883","heartbeat_back_addr":"172.21.15.8:6817/187418883","heartbeat_front_addr":"172.21.15.8:6815/187418883","state":["exists","up"]},{"osd":4,"uuid":"2c28acbb-e807-4559-8aa2-a35ca84b5d43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6809","nonce":3099704571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6811","nonce":3099704571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6815","nonce":3099704571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6813","nonce":3099704571}]},"public_addr":"172.21.15.45:6809/3099704571","cluster_addr":"172.21.15.45:6811/3099704571","heartbeat_back_addr":"172.21.15.45:6815/3099704571","heartbeat_front_addr":"172.21.15.45:6813/3099704571","state":["exists","up"]},{"osd":5,"uuid":"37032289-8016-4730-9b69-f7985e058ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6809","nonce":263803874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6811","nonce":263803874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6815","nonce":263803874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6813","nonce":263803874}]},"public_addr":"172.21.15.194:6809/263803874","cluster_addr":"172.21.15.194:6811/263803874","heartbeat_back_addr":"172.21.15.194:6815/263803874","heartbeat_front_addr":"172.21.15.194:6813/263803874","state":["exists","up"]},{"osd":6,"uuid":"32d2dab9-6944-40d1-ada9-4f941821b063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6819","nonce":1802966829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6821","nonce":1802966829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6825","nonce":1802966829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6823","nonce":1802966829}]},"public_addr":"172.21.15.8:6819/1802966829","cluster_addr":"172.21.15.8:6821/1802966829","heartbeat_back_addr":"172.21.15.8:6825/1802966829","heartbeat_front_addr":"172.21.15.8:6823/1802966829","state":["exists","up"]},{"osd":7,"uuid":"086aff58-1554-49fe-92ff-5166b115aeef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6817","nonce":3715737148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6819","nonce":3715737148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6823","nonce":3715737148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6821","nonce":3715737148}]},"public_addr":"172.21.15.45:6817/3715737148","cluster_addr":"172.21.15.45:6819/3715737148","heartbeat_back_addr":"172.21.15.45:6823/3715737148","heartbeat_front_addr":"172.21.15.45:6821/3715737148","state":["exists","up"]},{"osd":8,"uuid":"7fff5e95-2453-4ea6-a5c1-3bba6a1f6400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6817","nonce":57497127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6819","nonce":57497127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6823","nonce":57497127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6821","nonce":57497127}]},"public_addr":"172.21.15.194:6817/57497127","cluster_addr":"172.21.15.194:6819/57497127","heartbeat_back_addr":"172.21.15.194:6823/57497127","heartbeat_front_addr":"172.21.15.194:6821/57497127","state":["exists","up"]},{"osd":9,"uuid":"31ab0121-4c92-42ec-9f19-e672062e8814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6827","nonce":434661930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6829","nonce":434661930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6833","nonce":434661930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6831","nonce":434661930}]},"public_addr":"172.21.15.8:6827/434661930","cluster_addr":"172.21.15.8:6829/434661930","heartbeat_back_addr":"172.21.15.8:6833/434661930","heartbeat_front_addr":"172.21.15.8:6831/434661930","state":["exists","up"]},{"osd":10,"uuid":"62c632e4-94f6-4630-9d94-8d28fccacf45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6825","nonce":3281212184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6827","nonce":3281212184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6831","nonce":3281212184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6829","nonce":3281212184}]},"public_addr":"172.21.15.45:6825/3281212184","cluster_addr":"172.21.15.45:6827/3281212184","heartbeat_back_addr":"172.21.15.45:6831/3281212184","heartbeat_front_addr":"172.21.15.45:6829/3281212184","state":["exists","up"]},{"osd":11,"uuid":"8ca4a80d-cd75-4230-b46d-aef6fdc03e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6825","nonce":1637875895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6827","nonce":1637875895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6831","nonce":1637875895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6829","nonce":1637875895}]},"public_addr":"172.21.15.194:6825/1637875895","cluster_addr":"172.21.15.194:6827/1637875895","heartbeat_back_addr":"172.21.15.194:6831/1637875895","heartbeat_front_addr":"172.21.15.194:6829/1637875895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:04.255616+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:26.243863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:46.630365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:12.926291+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:35.747049+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:55.793767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:21.685725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:43.703215+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:04.043674+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:30.320026+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:52.751974+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:21:13.230024+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/2000592056":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2102228072":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2374527928":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2928221278":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2744750874":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/3681755887":"2023-08-12T12:15:02.528403+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-11T12:24:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.717+0000 7f4f0e9ff700 1 -- 172.21.15.8:0/1244289469 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f4ef009ff50 msgr2=0x7f4ef00a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.717+0000 7f4f0e9ff700 1 --2- 172.21.15.8:0/1244289469 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f4ef009ff50 0x7f4ef00a2410 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4f08101a40 tx=0x7f4ef8009260 comp rx=0 tx=0).stop 2023-08-11T12:24:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.717+0000 7f4f0e9ff700 1 -- 172.21.15.8:0/1244289469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f08101be0 msgr2=0x7f4f08196d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.717+0000 7f4f0e9ff700 1 --2- 172.21.15.8:0/1244289469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f08101be0 0x7f4f08196d20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00e9a0 tx=0x7f4efc00ecb0 comp rx=0 tx=0).stop 2023-08-11T12:24:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.717+0000 7f4f0e9ff700 1 -- 172.21.15.8:0/1244289469 shutdown_connections 2023-08-11T12:24:02.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.717+0000 7f4f0e9ff700 1 --2- 172.21.15.8:0/1244289469 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f4ef009ff50 0x7f4ef00a2410 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:02.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.717+0000 7f4f0e9ff700 1 --2- 172.21.15.8:0/1244289469 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f08102580 0x7f4f0819dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:02.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.717+0000 7f4f0e9ff700 1 --2- 172.21.15.8:0/1244289469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f081009f0 0x7f4f081967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:02.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.717+0000 7f4f0e9ff700 1 --2- 172.21.15.8:0/1244289469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f08101be0 0x7f4f08196d20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:02.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.717+0000 7f4f0e9ff700 1 -- 172.21.15.8:0/1244289469 >> 172.21.15.8:0/1244289469 conn(0x7f4f080fbf80 msgr2=0x7f4f080fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:02.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.717+0000 7f4f0e9ff700 1 -- 172.21.15.8:0/1244289469 shutdown_connections 2023-08-11T12:24:02.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.717+0000 7f4f0e9ff700 1 -- 172.21.15.8:0/1244289469 wait complete. 2023-08-11T12:24:02.738 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-11T12:17:49.040758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-11T12:22:01.383296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-11T12:22:02.816329+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-11T12:22:06.369375+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-11T12:24:02.739 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-11T12:24:02.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.948+0000 7fec04dff700 1 -- 172.21.15.8:0/1775944919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec00101c00 msgr2=0x7fec00102060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:02.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.948+0000 7fec04dff700 1 --2- 172.21.15.8:0/1775944919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec00101c00 0x7fec00102060 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7febe80099c0 tx=0x7febe8009cd0 comp rx=0 tx=0).stop 2023-08-11T12:24:02.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.948+0000 7fec04dff700 1 -- 172.21.15.8:0/1775944919 shutdown_connections 2023-08-11T12:24:02.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.948+0000 7fec04dff700 1 --2- 172.21.15.8:0/1775944919 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec00100a10 0x7fec00100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:02.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.948+0000 7fec04dff700 1 --2- 172.21.15.8:0/1775944919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec001025a0 0x7fec00108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:02.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.948+0000 7fec04dff700 1 --2- 172.21.15.8:0/1775944919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec00101c00 0x7fec00102060 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:02.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.948+0000 7fec04dff700 1 -- 172.21.15.8:0/1775944919 >> 172.21.15.8:0/1775944919 conn(0x7fec000fbf80 msgr2=0x7fec000fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:02.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.948+0000 7fec04dff700 1 -- 172.21.15.8:0/1775944919 shutdown_connections 2023-08-11T12:24:02.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.948+0000 7fec04dff700 1 -- 172.21.15.8:0/1775944919 wait complete. 2023-08-11T12:24:02.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.949+0000 7fec04dff700 1 Processor -- start 2023-08-11T12:24:02.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.949+0000 7fec04dff700 1 -- start start 2023-08-11T12:24:02.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.949+0000 7fec04dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec00100a10 0x7fec001988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:02.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.949+0000 7fec04dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec00101c00 0x7fec00198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:02.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.949+0000 7fec04dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec001025a0 0x7fec0019fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:02.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.949+0000 7fec04dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec001a0470 con 0x7fec001025a0 2023-08-11T12:24:02.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.949+0000 7fec04dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec001a05b0 con 0x7fec00101c00 2023-08-11T12:24:02.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.949+0000 7fec04dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec001a0740 con 0x7fec00100a10 2023-08-11T12:24:02.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.950+0000 7febfed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec001025a0 0x7fec0019fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:02.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.950+0000 7febfe59c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec00100a10 0x7fec001988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:02.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.950+0000 7febf7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec00101c00 0x7fec00198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:02.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.950+0000 7febfed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec001025a0 0x7fec0019fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53560/0 (socket says 172.21.15.8:53560) 2023-08-11T12:24:02.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.950+0000 7febfed9d700 1 -- 172.21.15.8:0/2599349734 learned_addr learned my addr 172.21.15.8:0/2599349734 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:02.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.950+0000 7febfe59c700 1 --2- 172.21.15.8:0/2599349734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec00100a10 0x7fec001988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:44108/0 (socket says 172.21.15.8:44108) 2023-08-11T12:24:02.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.950+0000 7febfed9d700 1 -- 172.21.15.8:0/2599349734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec00100a10 msgr2=0x7fec001988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:02.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.950+0000 7febfed9d700 1 --2- 172.21.15.8:0/2599349734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec00100a10 0x7fec001988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:02.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.950+0000 7febfed9d700 1 -- 172.21.15.8:0/2599349734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec00101c00 msgr2=0x7fec00198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:02.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.950+0000 7febfed9d700 1 --2- 172.21.15.8:0/2599349734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec00101c00 0x7fec00198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:02.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.950+0000 7febfed9d700 1 -- 172.21.15.8:0/2599349734 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe80095f0 con 0x7fec001025a0 2023-08-11T12:24:02.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.950+0000 7febfed9d700 1 --2- 172.21.15.8:0/2599349734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec001025a0 0x7fec0019fea0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7febf800ef30 tx=0x7febf800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:02.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.951+0000 7febf77fe700 1 -- 172.21.15.8:0/2599349734 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf8018070 con 0x7fec001025a0 2023-08-11T12:24:02.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.951+0000 7fec04dff700 1 -- 172.21.15.8:0/2599349734 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec001a09c0 con 0x7fec001025a0 2023-08-11T12:24:02.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.951+0000 7febf77fe700 1 -- 172.21.15.8:0/2599349734 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7febf800f040 con 0x7fec001025a0 2023-08-11T12:24:02.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.951+0000 7febf77fe700 1 -- 172.21.15.8:0/2599349734 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf800cd00 con 0x7fec001025a0 2023-08-11T12:24:02.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.951+0000 7fec04dff700 1 -- 172.21.15.8:0/2599349734 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec001a0ed0 con 0x7fec001025a0 2023-08-11T12:24:02.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.952+0000 7fec04dff700 1 -- 172.21.15.8:0/2599349734 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec00193060 con 0x7fec001025a0 2023-08-11T12:24:02.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.954+0000 7febf77fe700 1 -- 172.21.15.8:0/2599349734 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7febf8003a00 con 0x7fec001025a0 2023-08-11T12:24:02.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.955+0000 7febf77fe700 1 --2- 172.21.15.8:0/2599349734 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7febec09ffd0 0x7febec0a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:02.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.955+0000 7febf77fe700 1 -- 172.21.15.8:0/2599349734 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7febf80caff0 con 0x7fec001025a0 2023-08-11T12:24:02.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.955+0000 7febfe59c700 1 --2- 172.21.15.8:0/2599349734 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7febec09ffd0 0x7febec0a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:02.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.956+0000 7febfe59c700 1 --2- 172.21.15.8:0/2599349734 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7febec09ffd0 0x7febec0a2490 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fec00101a60 tx=0x7febf0007400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:02.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:02.959+0000 7febf77fe700 1 -- 172.21.15.8:0/2599349734 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7febf80fdc30 con 0x7fec001025a0 2023-08-11T12:24:03.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:02 smithi008 ceph-mon[97158]: pgmap v335: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-11T12:24:03.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:02 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1244289469' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:24:03.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:02 smithi194 ceph-mon[130905]: pgmap v335: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-11T12:24:03.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:02 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1244289469' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:24:03.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:02 smithi045 ceph-mon[130284]: pgmap v335: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-11T12:24:03.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:02 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1244289469' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:24:03.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.171+0000 7fec04dff700 1 -- 172.21.15.8:0/2599349734 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fec0010c450 con 0x7fec001025a0 2023-08-11T12:24:03.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.172+0000 7febf77fe700 1 -- 172.21.15.8:0/2599349734 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7febf8094ae0 con 0x7fec001025a0 2023-08-11T12:24:03.174 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-08-11T12:24:03.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.174+0000 7fec04dff700 1 -- 172.21.15.8:0/2599349734 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7febec09ffd0 msgr2=0x7febec0a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:03.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.174+0000 7fec04dff700 1 --2- 172.21.15.8:0/2599349734 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7febec09ffd0 0x7febec0a2490 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fec00101a60 tx=0x7febf0007400 comp rx=0 tx=0).stop 2023-08-11T12:24:03.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.174+0000 7fec04dff700 1 -- 172.21.15.8:0/2599349734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec001025a0 msgr2=0x7fec0019fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:03.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.174+0000 7fec04dff700 1 --2- 172.21.15.8:0/2599349734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec001025a0 0x7fec0019fea0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7febf800ef30 tx=0x7febf800c3a0 comp rx=0 tx=0).stop 2023-08-11T12:24:03.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.174+0000 7fec04dff700 1 -- 172.21.15.8:0/2599349734 shutdown_connections 2023-08-11T12:24:03.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.174+0000 7fec04dff700 1 --2- 172.21.15.8:0/2599349734 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7febec09ffd0 0x7febec0a2490 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:03.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.174+0000 7fec04dff700 1 --2- 172.21.15.8:0/2599349734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec00100a10 0x7fec001988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:03.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.174+0000 7fec04dff700 1 --2- 172.21.15.8:0/2599349734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec001025a0 0x7fec0019fea0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:03.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.174+0000 7fec04dff700 1 --2- 172.21.15.8:0/2599349734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec00101c00 0x7fec00198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:03.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.174+0000 7fec04dff700 1 -- 172.21.15.8:0/2599349734 >> 172.21.15.8:0/2599349734 conn(0x7fec000fbf80 msgr2=0x7fec001074e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:03.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.174+0000 7fec04dff700 1 -- 172.21.15.8:0/2599349734 shutdown_connections 2023-08-11T12:24:03.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.174+0000 7fec04dff700 1 -- 172.21.15.8:0/2599349734 wait complete. 2023-08-11T12:24:03.195 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-11T12:24:03.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.400+0000 7f8f4a3ff700 1 -- 172.21.15.8:0/4031120009 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f44101bf0 msgr2=0x7f8f44102050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:03.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.400+0000 7f8f4a3ff700 1 --2- 172.21.15.8:0/4031120009 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f44101bf0 0x7f8f44102050 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8f380099c0 tx=0x7f8f38009cd0 comp rx=0 tx=0).stop 2023-08-11T12:24:03.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.400+0000 7f8f4a3ff700 1 -- 172.21.15.8:0/4031120009 shutdown_connections 2023-08-11T12:24:03.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.400+0000 7f8f4a3ff700 1 --2- 172.21.15.8:0/4031120009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f44100a00 0x7f8f44100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:03.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.400+0000 7f8f4a3ff700 1 --2- 172.21.15.8:0/4031120009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f44102590 0x7f8f44108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:03.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.400+0000 7f8f4a3ff700 1 --2- 172.21.15.8:0/4031120009 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f44101bf0 0x7f8f44102050 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:03.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.400+0000 7f8f4a3ff700 1 -- 172.21.15.8:0/4031120009 >> 172.21.15.8:0/4031120009 conn(0x7f8f440fbf70 msgr2=0x7f8f440fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:03.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.400+0000 7f8f4a3ff700 1 -- 172.21.15.8:0/4031120009 shutdown_connections 2023-08-11T12:24:03.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.400+0000 7f8f4a3ff700 1 -- 172.21.15.8:0/4031120009 wait complete. 2023-08-11T12:24:03.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.401+0000 7f8f4a3ff700 1 Processor -- start 2023-08-11T12:24:03.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.402+0000 7f8f4a3ff700 1 -- start start 2023-08-11T12:24:03.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.402+0000 7f8f4a3ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f44100a00 0x7f8f44198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:03.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.402+0000 7f8f4a3ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f44101bf0 0x7f8f44198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:03.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.402+0000 7f8f4a3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f44102590 0x7f8f4419fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:03.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.402+0000 7f8f4a3ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f441a0490 con 0x7f8f44101bf0 2023-08-11T12:24:03.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.402+0000 7f8f4a3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f441a05d0 con 0x7f8f44102590 2023-08-11T12:24:03.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.402+0000 7f8f4a3ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f441a0760 con 0x7f8f44100a00 2023-08-11T12:24:03.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.402+0000 7f8f437fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f44101bf0 0x7f8f44198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:03.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.402+0000 7f8f43fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f44100a00 0x7f8f44198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:03.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.402+0000 7f8f437fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f44101bf0 0x7f8f44198e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53576/0 (socket says 172.21.15.8:53576) 2023-08-11T12:24:03.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.402+0000 7f8f437fe700 1 -- 172.21.15.8:0/4037999769 learned_addr learned my addr 172.21.15.8:0/4037999769 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:03.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.402+0000 7f8f4899c700 1 --2- 172.21.15.8:0/4037999769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f44102590 0x7f8f4419fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:03.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.402+0000 7f8f437fe700 1 -- 172.21.15.8:0/4037999769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f44100a00 msgr2=0x7f8f44198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:03.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.402+0000 7f8f437fe700 1 --2- 172.21.15.8:0/4037999769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f44100a00 0x7f8f44198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:03.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.402+0000 7f8f437fe700 1 -- 172.21.15.8:0/4037999769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f44102590 msgr2=0x7f8f4419fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:03.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.402+0000 7f8f437fe700 1 --2- 172.21.15.8:0/4037999769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f44102590 0x7f8f4419fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.403+0000 7f8f437fe700 1 -- 172.21.15.8:0/4037999769 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f380095f0 con 0x7f8f44101bf0 2023-08-11T12:24:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.403+0000 7f8f4899c700 1 --2- 172.21.15.8:0/4037999769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f44102590 0x7f8f4419fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:24:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.403+0000 7f8f437fe700 1 --2- 172.21.15.8:0/4037999769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f44101bf0 0x7f8f44198e50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8f38009fd0 tx=0x7f8f3800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.403+0000 7f8f417fa700 1 -- 172.21.15.8:0/4037999769 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3801d070 con 0x7f8f44101bf0 2023-08-11T12:24:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.403+0000 7f8f417fa700 1 -- 172.21.15.8:0/4037999769 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f38005510 con 0x7f8f44101bf0 2023-08-11T12:24:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.403+0000 7f8f417fa700 1 -- 172.21.15.8:0/4037999769 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f38004ae0 con 0x7f8f44101bf0 2023-08-11T12:24:03.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.403+0000 7f8f4a3ff700 1 -- 172.21.15.8:0/4037999769 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f441a09e0 con 0x7f8f44101bf0 2023-08-11T12:24:03.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.403+0000 7f8f4a3ff700 1 -- 172.21.15.8:0/4037999769 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f441a0db0 con 0x7f8f44101bf0 2023-08-11T12:24:03.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.404+0000 7f8f4a3ff700 1 -- 172.21.15.8:0/4037999769 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f4410c260 con 0x7f8f44101bf0 2023-08-11T12:24:03.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.406+0000 7f8f417fa700 1 -- 172.21.15.8:0/4037999769 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f8f38004cc0 con 0x7f8f44101bf0 2023-08-11T12:24:03.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.407+0000 7f8f417fa700 1 --2- 172.21.15.8:0/4037999769 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8f2c09ff50 0x7f8f2c0a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:03.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.408+0000 7f8f417fa700 1 -- 172.21.15.8:0/4037999769 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f8f380cc460 con 0x7f8f44101bf0 2023-08-11T12:24:03.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.408+0000 7f8f43fff700 1 --2- 172.21.15.8:0/4037999769 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8f2c09ff50 0x7f8f2c0a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:03.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.408+0000 7f8f43fff700 1 --2- 172.21.15.8:0/4037999769 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8f2c09ff50 0x7f8f2c0a2410 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8f44101a50 tx=0x7f8f34009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:03.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.411+0000 7f8f417fa700 1 -- 172.21.15.8:0/4037999769 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f8f38095f10 con 0x7f8f44101bf0 2023-08-11T12:24:03.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.620+0000 7f8f4a3ff700 1 -- 172.21.15.8:0/4037999769 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8f441a1090 con 0x7f8f44101bf0 2023-08-11T12:24:03.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.620+0000 7f8f417fa700 1 -- 172.21.15.8:0/4037999769 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8f38099530 con 0x7f8f44101bf0 2023-08-11T12:24:03.623 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-08-11T12:24:03.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.622+0000 7f8f4a3ff700 1 -- 172.21.15.8:0/4037999769 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8f2c09ff50 msgr2=0x7f8f2c0a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:03.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.622+0000 7f8f4a3ff700 1 --2- 172.21.15.8:0/4037999769 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8f2c09ff50 0x7f8f2c0a2410 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8f44101a50 tx=0x7f8f34009260 comp rx=0 tx=0).stop 2023-08-11T12:24:03.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.623+0000 7f8f4a3ff700 1 -- 172.21.15.8:0/4037999769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f44101bf0 msgr2=0x7f8f44198e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:03.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.623+0000 7f8f4a3ff700 1 --2- 172.21.15.8:0/4037999769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f44101bf0 0x7f8f44198e50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8f38009fd0 tx=0x7f8f3800f690 comp rx=0 tx=0).stop 2023-08-11T12:24:03.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.623+0000 7f8f4a3ff700 1 -- 172.21.15.8:0/4037999769 shutdown_connections 2023-08-11T12:24:03.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.623+0000 7f8f4a3ff700 1 --2- 172.21.15.8:0/4037999769 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f8f2c09ff50 0x7f8f2c0a2410 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:03.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.623+0000 7f8f4a3ff700 1 --2- 172.21.15.8:0/4037999769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f44100a00 0x7f8f44198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:03.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.623+0000 7f8f4a3ff700 1 --2- 172.21.15.8:0/4037999769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f44102590 0x7f8f4419fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:03.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.623+0000 7f8f4a3ff700 1 --2- 172.21.15.8:0/4037999769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f44101bf0 0x7f8f44198e50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:03.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.623+0000 7f8f4a3ff700 1 -- 172.21.15.8:0/4037999769 >> 172.21.15.8:0/4037999769 conn(0x7f8f440fbf70 msgr2=0x7f8f440fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:03.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.623+0000 7f8f4a3ff700 1 -- 172.21.15.8:0/4037999769 shutdown_connections 2023-08-11T12:24:03.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.623+0000 7f8f4a3ff700 1 -- 172.21.15.8:0/4037999769 wait complete. 2023-08-11T12:24:03.644 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-11T12:24:03.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.853+0000 7f6a2bdff700 1 -- 172.21.15.8:0/311762335 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a241025a0 msgr2=0x7f6a24108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:03.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.853+0000 7f6a2bdff700 1 --2- 172.21.15.8:0/311762335 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a241025a0 0x7f6a24108e50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c00b0a0 tx=0x7f6a1c00b3b0 comp rx=0 tx=0).stop 2023-08-11T12:24:03.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.854+0000 7f6a2bdff700 1 -- 172.21.15.8:0/311762335 shutdown_connections 2023-08-11T12:24:03.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.854+0000 7f6a2bdff700 1 --2- 172.21.15.8:0/311762335 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a241025a0 0x7f6a24108e50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:03.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.854+0000 7f6a2bdff700 1 --2- 172.21.15.8:0/311762335 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a24100a10 0x7f6a24100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:03.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.854+0000 7f6a2bdff700 1 --2- 172.21.15.8:0/311762335 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a24101c00 0x7f6a24102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:03.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.854+0000 7f6a2bdff700 1 -- 172.21.15.8:0/311762335 >> 172.21.15.8:0/311762335 conn(0x7f6a240fbf80 msgr2=0x7f6a240fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:03.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.854+0000 7f6a2bdff700 1 -- 172.21.15.8:0/311762335 shutdown_connections 2023-08-11T12:24:03.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.854+0000 7f6a2bdff700 1 -- 172.21.15.8:0/311762335 wait complete. 2023-08-11T12:24:03.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.855+0000 7f6a2bdff700 1 Processor -- start 2023-08-11T12:24:03.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.855+0000 7f6a2bdff700 1 -- start start 2023-08-11T12:24:03.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.855+0000 7f6a2bdff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a24100a10 0x7f6a241989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:03.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.855+0000 7f6a2bdff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a24101c00 0x7f6a24198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:03.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.855+0000 7f6a2bdff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a241025a0 0x7f6a2419ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:03.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.855+0000 7f6a2bdff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a241a0560 con 0x7f6a24101c00 2023-08-11T12:24:03.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.855+0000 7f6a2bdff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a241a06a0 con 0x7f6a241025a0 2023-08-11T12:24:03.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.855+0000 7f6a2bdff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a241a0830 con 0x7f6a24100a10 2023-08-11T12:24:03.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.856+0000 7f6a2939a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a24101c00 0x7f6a24198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:03.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.856+0000 7f6a29b9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a24100a10 0x7f6a241989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:03.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.856+0000 7f6a29b9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a24100a10 0x7f6a241989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:44136/0 (socket says 172.21.15.8:44136) 2023-08-11T12:24:03.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.856+0000 7f6a29b9b700 1 -- 172.21.15.8:0/112354098 learned_addr learned my addr 172.21.15.8:0/112354098 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:03.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.856+0000 7f6a2a39c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a241025a0 0x7f6a2419ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:03.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.856+0000 7f6a29b9b700 1 -- 172.21.15.8:0/112354098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a241025a0 msgr2=0x7f6a2419ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:03.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.856+0000 7f6a29b9b700 1 --2- 172.21.15.8:0/112354098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a241025a0 0x7f6a2419ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:03.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.856+0000 7f6a29b9b700 1 -- 172.21.15.8:0/112354098 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a24101c00 msgr2=0x7f6a24198f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:03.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.856+0000 7f6a29b9b700 1 --2- 172.21.15.8:0/112354098 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a24101c00 0x7f6a24198f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:03.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.856+0000 7f6a29b9b700 1 -- 172.21.15.8:0/112354098 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1c009d00 con 0x7f6a24100a10 2023-08-11T12:24:03.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.856+0000 7f6a29b9b700 1 --2- 172.21.15.8:0/112354098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a24100a10 0x7f6a241989e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000e970 tx=0x7f6a2000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:03.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.857+0000 7f6a1affd700 1 -- 172.21.15.8:0/112354098 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a20009790 con 0x7f6a24100a10 2023-08-11T12:24:03.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.857+0000 7f6a2bdff700 1 -- 172.21.15.8:0/112354098 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a241a0b10 con 0x7f6a24100a10 2023-08-11T12:24:03.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.857+0000 7f6a1affd700 1 -- 172.21.15.8:0/112354098 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a2000c7e0 con 0x7f6a24100a10 2023-08-11T12:24:03.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.857+0000 7f6a1affd700 1 -- 172.21.15.8:0/112354098 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a20003c70 con 0x7f6a24100a10 2023-08-11T12:24:03.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.857+0000 7f6a2bdff700 1 -- 172.21.15.8:0/112354098 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a241a1020 con 0x7f6a24100a10 2023-08-11T12:24:03.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.858+0000 7f6a2bdff700 1 -- 172.21.15.8:0/112354098 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2410c280 con 0x7f6a24100a10 2023-08-11T12:24:03.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.860+0000 7f6a1affd700 1 -- 172.21.15.8:0/112354098 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f6a2000cc50 con 0x7f6a24100a10 2023-08-11T12:24:03.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.861+0000 7f6a1affd700 1 --2- 172.21.15.8:0/112354098 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6a1009ff50 0x7f6a100a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:03.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.861+0000 7f6a1affd700 1 -- 172.21.15.8:0/112354098 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f6a20014070 con 0x7f6a24100a10 2023-08-11T12:24:03.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.862+0000 7f6a2939a700 1 --2- 172.21.15.8:0/112354098 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6a1009ff50 0x7f6a100a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:03.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.862+0000 7f6a2939a700 1 --2- 172.21.15.8:0/112354098 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6a1009ff50 0x7f6a100a2410 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6a14009c60 tx=0x7f6a14009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:03.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:03.863+0000 7f6a1affd700 1 -- 172.21.15.8:0/112354098 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f6a20095310 con 0x7f6a24100a10 2023-08-11T12:24:04.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:03 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2599349734' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:24:04.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:03 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/4037999769' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:24:04.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.074+0000 7f6a2bdff700 1 -- 172.21.15.8:0/112354098 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6a241a1210 con 0x7f6a24100a10 2023-08-11T12:24:04.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.075+0000 7f6a1affd700 1 -- 172.21.15.8:0/112354098 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6a20098930 con 0x7f6a24100a10 2023-08-11T12:24:04.078 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-08-11T12:24:04.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.077+0000 7f6a2bdff700 1 -- 172.21.15.8:0/112354098 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6a1009ff50 msgr2=0x7f6a100a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:04.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.077+0000 7f6a2bdff700 1 --2- 172.21.15.8:0/112354098 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6a1009ff50 0x7f6a100a2410 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6a14009c60 tx=0x7f6a14009260 comp rx=0 tx=0).stop 2023-08-11T12:24:04.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.078+0000 7f6a2bdff700 1 -- 172.21.15.8:0/112354098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a24100a10 msgr2=0x7f6a241989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:04.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.078+0000 7f6a2bdff700 1 --2- 172.21.15.8:0/112354098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a24100a10 0x7f6a241989e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000e970 tx=0x7f6a2000ec80 comp rx=0 tx=0).stop 2023-08-11T12:24:04.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.078+0000 7f6a2bdff700 1 -- 172.21.15.8:0/112354098 shutdown_connections 2023-08-11T12:24:04.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.078+0000 7f6a2bdff700 1 --2- 172.21.15.8:0/112354098 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6a1009ff50 0x7f6a100a2410 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:04.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.078+0000 7f6a2bdff700 1 --2- 172.21.15.8:0/112354098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a24100a10 0x7f6a241989e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:04.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.078+0000 7f6a2bdff700 1 --2- 172.21.15.8:0/112354098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a241025a0 0x7f6a2419ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:04.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.078+0000 7f6a2bdff700 1 --2- 172.21.15.8:0/112354098 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a24101c00 0x7f6a24198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:04.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.078+0000 7f6a2bdff700 1 -- 172.21.15.8:0/112354098 >> 172.21.15.8:0/112354098 conn(0x7f6a240fbf80 msgr2=0x7f6a24107460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:04.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.078+0000 7f6a2bdff700 1 -- 172.21.15.8:0/112354098 shutdown_connections 2023-08-11T12:24:04.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.078+0000 7f6a2bdff700 1 -- 172.21.15.8:0/112354098 wait complete. 2023-08-11T12:24:04.098 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-11T12:24:04.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:03 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2599349734' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:24:04.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:03 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/4037999769' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:24:04.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:03 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2599349734' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:24:04.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:03 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/4037999769' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:24:04.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.303+0000 7fa19b5ff700 1 -- 172.21.15.8:0/1455118182 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa194101bf0 msgr2=0x7fa194102050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:04.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.303+0000 7fa19b5ff700 1 --2- 172.21.15.8:0/1455118182 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa194101bf0 0x7fa194102050 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa1840099c0 tx=0x7fa184009cd0 comp rx=0 tx=0).stop 2023-08-11T12:24:04.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.303+0000 7fa19b5ff700 1 -- 172.21.15.8:0/1455118182 shutdown_connections 2023-08-11T12:24:04.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.303+0000 7fa19b5ff700 1 --2- 172.21.15.8:0/1455118182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa194100a00 0x7fa194100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:04.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.303+0000 7fa19b5ff700 1 --2- 172.21.15.8:0/1455118182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa194102590 0x7fa194108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:04.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.303+0000 7fa19b5ff700 1 --2- 172.21.15.8:0/1455118182 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa194101bf0 0x7fa194102050 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:04.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.303+0000 7fa19b5ff700 1 -- 172.21.15.8:0/1455118182 >> 172.21.15.8:0/1455118182 conn(0x7fa1940fbf70 msgr2=0x7fa1940fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:04.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.303+0000 7fa19b5ff700 1 -- 172.21.15.8:0/1455118182 shutdown_connections 2023-08-11T12:24:04.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.303+0000 7fa19b5ff700 1 -- 172.21.15.8:0/1455118182 wait complete. 2023-08-11T12:24:04.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.304+0000 7fa19b5ff700 1 Processor -- start 2023-08-11T12:24:04.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.304+0000 7fa19b5ff700 1 -- start start 2023-08-11T12:24:04.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.304+0000 7fa19b5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa194100a00 0x7fa194198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:04.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.304+0000 7fa19b5ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa194101bf0 0x7fa194198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:04.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.304+0000 7fa19b5ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa194102590 0x7fa19419fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:04.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.304+0000 7fa19b5ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1941a0490 con 0x7fa194101bf0 2023-08-11T12:24:04.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.304+0000 7fa19b5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1941a05d0 con 0x7fa194100a00 2023-08-11T12:24:04.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.304+0000 7fa19b5ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1941a0760 con 0x7fa194102590 2023-08-11T12:24:04.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.305+0000 7fa198b9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa194101bf0 0x7fa194198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:04.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.305+0000 7fa199b9c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa194102590 0x7fa19419fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:04.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.305+0000 7fa198b9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa194101bf0 0x7fa194198e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53618/0 (socket says 172.21.15.8:53618) 2023-08-11T12:24:04.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.305+0000 7fa198b9a700 1 -- 172.21.15.8:0/295177916 learned_addr learned my addr 172.21.15.8:0/295177916 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:04.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.305+0000 7fa199b9c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa194102590 0x7fa19419fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:44148/0 (socket says 172.21.15.8:44148) 2023-08-11T12:24:04.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.305+0000 7fa19939b700 1 --2- 172.21.15.8:0/295177916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa194100a00 0x7fa194198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:04.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.305+0000 7fa198b9a700 1 -- 172.21.15.8:0/295177916 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa194102590 msgr2=0x7fa19419fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:04.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.305+0000 7fa198b9a700 1 --2- 172.21.15.8:0/295177916 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa194102590 0x7fa19419fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:04.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.305+0000 7fa198b9a700 1 -- 172.21.15.8:0/295177916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa194100a00 msgr2=0x7fa194198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:04.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.305+0000 7fa198b9a700 1 --2- 172.21.15.8:0/295177916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa194100a00 0x7fa194198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:04.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.305+0000 7fa198b9a700 1 -- 172.21.15.8:0/295177916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1840095f0 con 0x7fa194101bf0 2023-08-11T12:24:04.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.305+0000 7fa19939b700 1 --2- 172.21.15.8:0/295177916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa194100a00 0x7fa194198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:24:04.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.305+0000 7fa198b9a700 1 --2- 172.21.15.8:0/295177916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa194101bf0 0x7fa194198e50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa184009990 tx=0x7fa18400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:04.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.305+0000 7fa18a7fc700 1 -- 172.21.15.8:0/295177916 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18401d070 con 0x7fa194101bf0 2023-08-11T12:24:04.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.306+0000 7fa19b5ff700 1 -- 172.21.15.8:0/295177916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1941a09e0 con 0x7fa194101bf0 2023-08-11T12:24:04.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.306+0000 7fa18a7fc700 1 -- 172.21.15.8:0/295177916 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa1840054f0 con 0x7fa194101bf0 2023-08-11T12:24:04.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.306+0000 7fa18a7fc700 1 -- 172.21.15.8:0/295177916 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa184004bd0 con 0x7fa194101bf0 2023-08-11T12:24:04.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.306+0000 7fa19b5ff700 1 -- 172.21.15.8:0/295177916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1941a0e00 con 0x7fa194101bf0 2023-08-11T12:24:04.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.307+0000 7fa19b5ff700 1 -- 172.21.15.8:0/295177916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa19410c260 con 0x7fa194101bf0 2023-08-11T12:24:04.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.309+0000 7fa18a7fc700 1 -- 172.21.15.8:0/295177916 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fa18400fb80 con 0x7fa194101bf0 2023-08-11T12:24:04.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.310+0000 7fa18a7fc700 1 --2- 172.21.15.8:0/295177916 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa18009ff50 0x7fa1800a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:04.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.310+0000 7fa18a7fc700 1 -- 172.21.15.8:0/295177916 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fa1840cc430 con 0x7fa194101bf0 2023-08-11T12:24:04.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.310+0000 7fa19939b700 1 --2- 172.21.15.8:0/295177916 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa18009ff50 0x7fa1800a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:04.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.311+0000 7fa19939b700 1 --2- 172.21.15.8:0/295177916 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa18009ff50 0x7fa1800a2410 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa194101a50 tx=0x7fa190009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:04.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.314+0000 7fa18a7fc700 1 -- 172.21.15.8:0/295177916 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fa184095ee0 con 0x7fa194101bf0 2023-08-11T12:24:04.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.521+0000 7fa19b5ff700 1 -- 172.21.15.8:0/295177916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa1941a0f90 con 0x7fa194101bf0 2023-08-11T12:24:04.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.522+0000 7fa18a7fc700 1 -- 172.21.15.8:0/295177916 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa184099500 con 0x7fa194101bf0 2023-08-11T12:24:04.525 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-08-11T12:24:04.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.524+0000 7fa19b5ff700 1 -- 172.21.15.8:0/295177916 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa18009ff50 msgr2=0x7fa1800a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:04.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.524+0000 7fa19b5ff700 1 --2- 172.21.15.8:0/295177916 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa18009ff50 0x7fa1800a2410 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa194101a50 tx=0x7fa190009260 comp rx=0 tx=0).stop 2023-08-11T12:24:04.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.524+0000 7fa19b5ff700 1 -- 172.21.15.8:0/295177916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa194101bf0 msgr2=0x7fa194198e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:04.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.524+0000 7fa19b5ff700 1 --2- 172.21.15.8:0/295177916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa194101bf0 0x7fa194198e50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa184009990 tx=0x7fa18400f690 comp rx=0 tx=0).stop 2023-08-11T12:24:04.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.525+0000 7fa19b5ff700 1 -- 172.21.15.8:0/295177916 shutdown_connections 2023-08-11T12:24:04.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.525+0000 7fa19b5ff700 1 --2- 172.21.15.8:0/295177916 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa18009ff50 0x7fa1800a2410 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:04.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.525+0000 7fa19b5ff700 1 --2- 172.21.15.8:0/295177916 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa194102590 0x7fa19419fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:04.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.525+0000 7fa19b5ff700 1 --2- 172.21.15.8:0/295177916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa194100a00 0x7fa194198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:04.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.525+0000 7fa19b5ff700 1 --2- 172.21.15.8:0/295177916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa194101bf0 0x7fa194198e50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:04.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.525+0000 7fa19b5ff700 1 -- 172.21.15.8:0/295177916 >> 172.21.15.8:0/295177916 conn(0x7fa1940fbf70 msgr2=0x7fa1940fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:04.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.525+0000 7fa19b5ff700 1 -- 172.21.15.8:0/295177916 shutdown_connections 2023-08-11T12:24:04.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.525+0000 7fa19b5ff700 1 -- 172.21.15.8:0/295177916 wait complete. 2023-08-11T12:24:04.546 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-11T12:24:04.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.751+0000 7fd6c47ff700 1 -- 172.21.15.8:0/1478860714 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6bc102570 msgr2=0x7fd6bc108e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:04.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.751+0000 7fd6c47ff700 1 --2- 172.21.15.8:0/1478860714 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6bc102570 0x7fd6bc108e20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd6b400b0d0 tx=0x7fd6b400b3e0 comp rx=0 tx=0).stop 2023-08-11T12:24:04.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.751+0000 7fd6c47ff700 1 -- 172.21.15.8:0/1478860714 shutdown_connections 2023-08-11T12:24:04.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.751+0000 7fd6c47ff700 1 --2- 172.21.15.8:0/1478860714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6bc1009e0 0x7fd6bc100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:04.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.751+0000 7fd6c47ff700 1 --2- 172.21.15.8:0/1478860714 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6bc102570 0x7fd6bc108e20 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:04.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.751+0000 7fd6c47ff700 1 --2- 172.21.15.8:0/1478860714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6bc101bd0 0x7fd6bc102030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:04.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.751+0000 7fd6c47ff700 1 -- 172.21.15.8:0/1478860714 >> 172.21.15.8:0/1478860714 conn(0x7fd6bc0fbf50 msgr2=0x7fd6bc0fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:04.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.751+0000 7fd6c47ff700 1 -- 172.21.15.8:0/1478860714 shutdown_connections 2023-08-11T12:24:04.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.751+0000 7fd6c47ff700 1 -- 172.21.15.8:0/1478860714 wait complete. 2023-08-11T12:24:04.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.752+0000 7fd6c47ff700 1 Processor -- start 2023-08-11T12:24:04.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.753+0000 7fd6c47ff700 1 -- start start 2023-08-11T12:24:04.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.753+0000 7fd6c47ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6bc1009e0 0x7fd6bc1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:04.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.753+0000 7fd6c47ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6bc101bd0 0x7fd6bc198f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:04.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.753+0000 7fd6c47ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6bc102570 0x7fd6bc19ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:04.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.753+0000 7fd6c47ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc1a0550 con 0x7fd6bc1009e0 2023-08-11T12:24:04.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.753+0000 7fd6c47ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc1a0690 con 0x7fd6bc101bd0 2023-08-11T12:24:04.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.753+0000 7fd6c47ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc1a0820 con 0x7fd6bc102570 2023-08-11T12:24:04.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.753+0000 7fd6c259b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6bc1009e0 0x7fd6bc1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:04.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.753+0000 7fd6c259b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6bc1009e0 0x7fd6bc1989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53624/0 (socket says 172.21.15.8:53624) 2023-08-11T12:24:04.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.753+0000 7fd6c259b700 1 -- 172.21.15.8:0/1610430102 learned_addr learned my addr 172.21.15.8:0/1610430102 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:04.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.753+0000 7fd6c1d9a700 1 --2- 172.21.15.8:0/1610430102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6bc101bd0 0x7fd6bc198f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:04.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.753+0000 7fd6c2d9c700 1 --2- 172.21.15.8:0/1610430102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6bc102570 0x7fd6bc19ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:04.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.753+0000 7fd6c259b700 1 -- 172.21.15.8:0/1610430102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6bc102570 msgr2=0x7fd6bc19ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:04.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.753+0000 7fd6c259b700 1 --2- 172.21.15.8:0/1610430102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6bc102570 0x7fd6bc19ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:04.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.753+0000 7fd6c259b700 1 -- 172.21.15.8:0/1610430102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6bc101bd0 msgr2=0x7fd6bc198f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:04.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.753+0000 7fd6c259b700 1 --2- 172.21.15.8:0/1610430102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6bc101bd0 0x7fd6bc198f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:04.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.753+0000 7fd6c259b700 1 -- 172.21.15.8:0/1610430102 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b4009d00 con 0x7fd6bc1009e0 2023-08-11T12:24:04.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.754+0000 7fd6c259b700 1 --2- 172.21.15.8:0/1610430102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6bc1009e0 0x7fd6bc1989d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd6b800e970 tx=0x7fd6b800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:04.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.754+0000 7fd6b37fe700 1 -- 172.21.15.8:0/1610430102 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8009790 con 0x7fd6bc1009e0 2023-08-11T12:24:04.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.754+0000 7fd6b37fe700 1 -- 172.21.15.8:0/1610430102 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6b800c7e0 con 0x7fd6bc1009e0 2023-08-11T12:24:04.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.754+0000 7fd6c47ff700 1 -- 172.21.15.8:0/1610430102 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6bc1a0b00 con 0x7fd6bc1009e0 2023-08-11T12:24:04.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.754+0000 7fd6b37fe700 1 -- 172.21.15.8:0/1610430102 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8003c70 con 0x7fd6bc1009e0 2023-08-11T12:24:04.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.754+0000 7fd6c47ff700 1 -- 172.21.15.8:0/1610430102 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6bc1a1010 con 0x7fd6bc1009e0 2023-08-11T12:24:04.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.755+0000 7fd6c47ff700 1 -- 172.21.15.8:0/1610430102 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6bc10c250 con 0x7fd6bc1009e0 2023-08-11T12:24:04.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.757+0000 7fd6b37fe700 1 -- 172.21.15.8:0/1610430102 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fd6b800cc50 con 0x7fd6bc1009e0 2023-08-11T12:24:04.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.759+0000 7fd6b37fe700 1 --2- 172.21.15.8:0/1610430102 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd6a809ff50 0x7fd6a80a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:04.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.759+0000 7fd6b37fe700 1 -- 172.21.15.8:0/1610430102 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fd6b8014070 con 0x7fd6bc1009e0 2023-08-11T12:24:04.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.759+0000 7fd6c1d9a700 1 --2- 172.21.15.8:0/1610430102 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd6a809ff50 0x7fd6a80a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:04.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.760+0000 7fd6c1d9a700 1 --2- 172.21.15.8:0/1610430102 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd6a809ff50 0x7fd6a80a2410 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac009c60 tx=0x7fd6ac009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:04.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:04.763+0000 7fd6b37fe700 1 -- 172.21.15.8:0/1610430102 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fd6b8095170 con 0x7fd6bc1009e0 2023-08-11T12:24:04.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:04 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/112354098' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:24:04.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:04 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/295177916' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:24:04.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:04 smithi008 ceph-mon[97158]: pgmap v336: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:24:05.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.022+0000 7fd6c47ff700 1 -- 172.21.15.8:0/1610430102 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6bc10c490 con 0x7fd6bc1009e0 2023-08-11T12:24:05.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.023+0000 7fd6b37fe700 1 -- 172.21.15.8:0/1610430102 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11351 (secure 0 0 0) 0x7fd6b8003dd0 con 0x7fd6bc1009e0 2023-08-11T12:24:05.026 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:05.026 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14469,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2854286216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2854286216},{"type":"v1","addr":"172.21.15.8:6835","nonce":2854286216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/805368621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":805368621},{"type":"v1","addr":"172.21.15.8:6837","nonce":805368621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-11T12:22:03.398475+0000","modified":"2023-08-11T12:22:32.690553+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24575,"mds_1":24550,"mds_2":24517,"mds_3":24500,"mds_4":24464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14526":{"gid":14526,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/2990530720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":2990530720},{"type":"v1","addr":"172.21.15.8:6839","nonce":2990530720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14538":{"gid":14538,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6841/3589272762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":3589272762},{"type":"v1","addr":"172.21.15.8:6841","nonce":3589272762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6833/2043443402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2043443402},{"type":"v1","addr":"172.21.15.194:6833","nonce":2043443402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24464":{"gid":24464,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.45:6833/1208864615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1208864615},{"type":"v1","addr":"172.21.15.45:6833","nonce":1208864615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24500":{"gid":24500,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.45:6835/1776075470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1776075470},{"type":"v1","addr":"172.21.15.45:6835","nonce":1776075470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24517":{"gid":24517,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.194:6835/2457430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2457430285},{"type":"v1","addr":"172.21.15.194:6835","nonce":2457430285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24529":{"gid":24529,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/3072808560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":3072808560},{"type":"v1","addr":"172.21.15.194:6837","nonce":3072808560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/641549061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":641549061},{"type":"v1","addr":"172.21.15.45:6837","nonce":641549061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.194:6839/2174476491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":2174476491},{"type":"v1","addr":"172.21.15.194:6839","nonce":2174476491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6839/119684732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":119684732},{"type":"v1","addr":"172.21.15.45:6839","nonce":119684732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-11T12:24:05.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.026+0000 7fd6c47ff700 1 -- 172.21.15.8:0/1610430102 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd6a809ff50 msgr2=0x7fd6a80a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:05.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.026+0000 7fd6c47ff700 1 --2- 172.21.15.8:0/1610430102 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd6a809ff50 0x7fd6a80a2410 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac009c60 tx=0x7fd6ac009260 comp rx=0 tx=0).stop 2023-08-11T12:24:05.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.026+0000 7fd6c47ff700 1 -- 172.21.15.8:0/1610430102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6bc1009e0 msgr2=0x7fd6bc1989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:05.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.026+0000 7fd6c47ff700 1 --2- 172.21.15.8:0/1610430102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6bc1009e0 0x7fd6bc1989d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd6b800e970 tx=0x7fd6b800ec80 comp rx=0 tx=0).stop 2023-08-11T12:24:05.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.026+0000 7fd6c47ff700 1 -- 172.21.15.8:0/1610430102 shutdown_connections 2023-08-11T12:24:05.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.026+0000 7fd6c47ff700 1 --2- 172.21.15.8:0/1610430102 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd6a809ff50 0x7fd6a80a2410 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:05.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.026+0000 7fd6c47ff700 1 --2- 172.21.15.8:0/1610430102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6bc102570 0x7fd6bc19ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:05.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.026+0000 7fd6c47ff700 1 --2- 172.21.15.8:0/1610430102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6bc1009e0 0x7fd6bc1989d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:05.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.026+0000 7fd6c47ff700 1 --2- 172.21.15.8:0/1610430102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6bc101bd0 0x7fd6bc198f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:05.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.026+0000 7fd6c47ff700 1 -- 172.21.15.8:0/1610430102 >> 172.21.15.8:0/1610430102 conn(0x7fd6bc0fbf50 msgr2=0x7fd6bc0fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:05.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.026+0000 7fd6c47ff700 1 -- 172.21.15.8:0/1610430102 shutdown_connections 2023-08-11T12:24:05.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.026+0000 7fd6c47ff700 1 -- 172.21.15.8:0/1610430102 wait complete. 2023-08-11T12:24:05.030 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 27 2023-08-11T12:24:05.047 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-11T12:24:05.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:04 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/112354098' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:24:05.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:04 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/295177916' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:24:05.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:04 smithi194 ceph-mon[130905]: pgmap v336: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:24:05.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:04 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/112354098' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:24:05.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:04 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/295177916' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:24:05.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:04 smithi045 ceph-mon[130284]: pgmap v336: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:24:05.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.250+0000 7f6caebff700 1 -- 172.21.15.8:0/2573558390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca8100a00 msgr2=0x7f6ca8100e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:05.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.250+0000 7f6caebff700 1 --2- 172.21.15.8:0/2573558390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca8100a00 0x7f6ca8100e20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c0099c0 tx=0x7f6c9c009cd0 comp rx=0 tx=0).stop 2023-08-11T12:24:05.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.250+0000 7f6caebff700 1 -- 172.21.15.8:0/2573558390 shutdown_connections 2023-08-11T12:24:05.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.250+0000 7f6caebff700 1 --2- 172.21.15.8:0/2573558390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ca8102590 0x7f6ca8108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:05.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.250+0000 7f6caebff700 1 --2- 172.21.15.8:0/2573558390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca8100a00 0x7f6ca8100e20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:05.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.250+0000 7f6caebff700 1 --2- 172.21.15.8:0/2573558390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ca8101bf0 0x7f6ca8102050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:05.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.250+0000 7f6caebff700 1 -- 172.21.15.8:0/2573558390 >> 172.21.15.8:0/2573558390 conn(0x7f6ca80fbf70 msgr2=0x7f6ca80fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:05.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.250+0000 7f6caebff700 1 -- 172.21.15.8:0/2573558390 shutdown_connections 2023-08-11T12:24:05.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.250+0000 7f6caebff700 1 -- 172.21.15.8:0/2573558390 wait complete. 2023-08-11T12:24:05.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.251+0000 7f6caebff700 1 Processor -- start 2023-08-11T12:24:05.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.251+0000 7f6caebff700 1 -- start start 2023-08-11T12:24:05.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.252+0000 7f6caebff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ca8100a00 0x7f6ca81966f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:05.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.252+0000 7f6caebff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca8101bf0 0x7f6ca8196c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:05.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.252+0000 7f6caebff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ca8102590 0x7f6ca819dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:05.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.252+0000 7f6caebff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca819e270 con 0x7f6ca8101bf0 2023-08-11T12:24:05.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.252+0000 7f6caebff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca819e3b0 con 0x7f6ca8100a00 2023-08-11T12:24:05.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.252+0000 7f6caebff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca819e540 con 0x7f6ca8102590 2023-08-11T12:24:05.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.252+0000 7f6ca7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca8101bf0 0x7f6ca8196c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:05.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.252+0000 7f6ca7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca8101bf0 0x7f6ca8196c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53640/0 (socket says 172.21.15.8:53640) 2023-08-11T12:24:05.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.252+0000 7f6ca7fff700 1 -- 172.21.15.8:0/1930094683 learned_addr learned my addr 172.21.15.8:0/1930094683 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:05.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.252+0000 7f6cac99b700 1 --2- 172.21.15.8:0/1930094683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ca8100a00 0x7f6ca81966f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:05.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.252+0000 7f6cad19c700 1 --2- 172.21.15.8:0/1930094683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ca8102590 0x7f6ca819dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:05.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.252+0000 7f6ca7fff700 1 -- 172.21.15.8:0/1930094683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ca8102590 msgr2=0x7f6ca819dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:05.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.252+0000 7f6ca7fff700 1 --2- 172.21.15.8:0/1930094683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ca8102590 0x7f6ca819dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:05.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.252+0000 7f6ca7fff700 1 -- 172.21.15.8:0/1930094683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ca8100a00 msgr2=0x7f6ca81966f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:05.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.252+0000 7f6ca7fff700 1 --2- 172.21.15.8:0/1930094683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ca8100a00 0x7f6ca81966f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:05.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.252+0000 7f6ca7fff700 1 -- 172.21.15.8:0/1930094683 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9c0095f0 con 0x7f6ca8101bf0 2023-08-11T12:24:05.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.253+0000 7f6ca7fff700 1 --2- 172.21.15.8:0/1930094683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca8101bf0 0x7f6ca8196c30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400e9a0 tx=0x7f6c9400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:05.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.253+0000 7f6ca5ffb700 1 -- 172.21.15.8:0/1930094683 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c94009790 con 0x7f6ca8101bf0 2023-08-11T12:24:05.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.253+0000 7f6ca5ffb700 1 -- 172.21.15.8:0/1930094683 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c94010430 con 0x7f6ca8101bf0 2023-08-11T12:24:05.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.253+0000 7f6caebff700 1 -- 172.21.15.8:0/1930094683 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca819e820 con 0x7f6ca8101bf0 2023-08-11T12:24:05.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.253+0000 7f6ca5ffb700 1 -- 172.21.15.8:0/1930094683 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c94018680 con 0x7f6ca8101bf0 2023-08-11T12:24:05.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.253+0000 7f6caebff700 1 -- 172.21.15.8:0/1930094683 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca819ed30 con 0x7f6ca8101bf0 2023-08-11T12:24:05.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.254+0000 7f6caebff700 1 -- 172.21.15.8:0/1930094683 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca8107930 con 0x7f6ca8101bf0 2023-08-11T12:24:05.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.256+0000 7f6ca5ffb700 1 -- 172.21.15.8:0/1930094683 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f6c940105a0 con 0x7f6ca8101bf0 2023-08-11T12:24:05.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.257+0000 7f6ca5ffb700 1 --2- 172.21.15.8:0/1930094683 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6c9809ff50 0x7f6c980a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:05.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.258+0000 7f6ca5ffb700 1 -- 172.21.15.8:0/1930094683 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f6c94014070 con 0x7f6ca8101bf0 2023-08-11T12:24:05.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.258+0000 7f6cac99b700 1 --2- 172.21.15.8:0/1930094683 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6c9809ff50 0x7f6c980a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:05.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.258+0000 7f6cac99b700 1 --2- 172.21.15.8:0/1930094683 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6c9809ff50 0x7f6c980a2410 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009990 tx=0x7f6c9c005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:05.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.261+0000 7f6ca5ffb700 1 -- 172.21.15.8:0/1930094683 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f6c94051c30 con 0x7f6ca8101bf0 2023-08-11T12:24:05.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.472+0000 7f6caebff700 1 -- 172.21.15.8:0/1930094683 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ca810c480 con 0x7f6ca8101bf0 2023-08-11T12:24:05.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.474+0000 7f6ca5ffb700 1 -- 172.21.15.8:0/1930094683 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24348 (secure 0 0 0) 0x7f6c94095180 con 0x7f6ca8101bf0 2023-08-11T12:24:05.476 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:05.476 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":89,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","created":"2023-08-11T12:14:28.341113+0000","modified":"2023-08-11T12:22:31.713248+0000","last_up_change":"2023-08-11T12:21:14.913735+0000","last_in_change":"2023-08-11T12:20:57.476558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-11T12:17:49.040758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-11T12:22:01.383296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-11T12:22:02.816329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-11T12:22:06.369375+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f903e393-7894-42d6-8b11-737ceef1f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6803","nonce":664104961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6805","nonce":664104961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6809","nonce":664104961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6807","nonce":664104961}]},"public_addr":"172.21.15.8:6803/664104961","cluster_addr":"172.21.15.8:6805/664104961","heartbeat_back_addr":"172.21.15.8:6809/664104961","heartbeat_front_addr":"172.21.15.8:6807/664104961","state":["exists","up"]},{"osd":1,"uuid":"1e988e5c-e78c-46d5-80a5-dff7ac38cbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6801","nonce":4187350703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6803","nonce":4187350703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6807","nonce":4187350703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6805","nonce":4187350703}]},"public_addr":"172.21.15.45:6801/4187350703","cluster_addr":"172.21.15.45:6803/4187350703","heartbeat_back_addr":"172.21.15.45:6807/4187350703","heartbeat_front_addr":"172.21.15.45:6805/4187350703","state":["exists","up"]},{"osd":2,"uuid":"1835217c-a93c-4181-b8b8-cc410bab1a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6801","nonce":2547818140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6803","nonce":2547818140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6807","nonce":2547818140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6805","nonce":2547818140}]},"public_addr":"172.21.15.194:6801/2547818140","cluster_addr":"172.21.15.194:6803/2547818140","heartbeat_back_addr":"172.21.15.194:6807/2547818140","heartbeat_front_addr":"172.21.15.194:6805/2547818140","state":["exists","up"]},{"osd":3,"uuid":"b55ae61a-731c-4312-a998-661122b84788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6811","nonce":187418883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6813","nonce":187418883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6817","nonce":187418883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6815","nonce":187418883}]},"public_addr":"172.21.15.8:6811/187418883","cluster_addr":"172.21.15.8:6813/187418883","heartbeat_back_addr":"172.21.15.8:6817/187418883","heartbeat_front_addr":"172.21.15.8:6815/187418883","state":["exists","up"]},{"osd":4,"uuid":"2c28acbb-e807-4559-8aa2-a35ca84b5d43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6809","nonce":3099704571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6811","nonce":3099704571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6815","nonce":3099704571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6813","nonce":3099704571}]},"public_addr":"172.21.15.45:6809/3099704571","cluster_addr":"172.21.15.45:6811/3099704571","heartbeat_back_addr":"172.21.15.45:6815/3099704571","heartbeat_front_addr":"172.21.15.45:6813/3099704571","state":["exists","up"]},{"osd":5,"uuid":"37032289-8016-4730-9b69-f7985e058ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6809","nonce":263803874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6811","nonce":263803874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6815","nonce":263803874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6813","nonce":263803874}]},"public_addr":"172.21.15.194:6809/263803874","cluster_addr":"172.21.15.194:6811/263803874","heartbeat_back_addr":"172.21.15.194:6815/263803874","heartbeat_front_addr":"172.21.15.194:6813/263803874","state":["exists","up"]},{"osd":6,"uuid":"32d2dab9-6944-40d1-ada9-4f941821b063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6819","nonce":1802966829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6821","nonce":1802966829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6825","nonce":1802966829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6823","nonce":1802966829}]},"public_addr":"172.21.15.8:6819/1802966829","cluster_addr":"172.21.15.8:6821/1802966829","heartbeat_back_addr":"172.21.15.8:6825/1802966829","heartbeat_front_addr":"172.21.15.8:6823/1802966829","state":["exists","up"]},{"osd":7,"uuid":"086aff58-1554-49fe-92ff-5166b115aeef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6817","nonce":3715737148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6819","nonce":3715737148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6823","nonce":3715737148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6821","nonce":3715737148}]},"public_addr":"172.21.15.45:6817/3715737148","cluster_addr":"172.21.15.45:6819/3715737148","heartbeat_back_addr":"172.21.15.45:6823/3715737148","heartbeat_front_addr":"172.21.15.45:6821/3715737148","state":["exists","up"]},{"osd":8,"uuid":"7fff5e95-2453-4ea6-a5c1-3bba6a1f6400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6817","nonce":57497127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6819","nonce":57497127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6823","nonce":57497127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6821","nonce":57497127}]},"public_addr":"172.21.15.194:6817/57497127","cluster_addr":"172.21.15.194:6819/57497127","heartbeat_back_addr":"172.21.15.194:6823/57497127","heartbeat_front_addr":"172.21.15.194:6821/57497127","state":["exists","up"]},{"osd":9,"uuid":"31ab0121-4c92-42ec-9f19-e672062e8814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6827","nonce":434661930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6829","nonce":434661930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6833","nonce":434661930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6831","nonce":434661930}]},"public_addr":"172.21.15.8:6827/434661930","cluster_addr":"172.21.15.8:6829/434661930","heartbeat_back_addr":"172.21.15.8:6833/434661930","heartbeat_front_addr":"172.21.15.8:6831/434661930","state":["exists","up"]},{"osd":10,"uuid":"62c632e4-94f6-4630-9d94-8d28fccacf45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6825","nonce":3281212184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6827","nonce":3281212184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6831","nonce":3281212184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6829","nonce":3281212184}]},"public_addr":"172.21.15.45:6825/3281212184","cluster_addr":"172.21.15.45:6827/3281212184","heartbeat_back_addr":"172.21.15.45:6831/3281212184","heartbeat_front_addr":"172.21.15.45:6829/3281212184","state":["exists","up"]},{"osd":11,"uuid":"8ca4a80d-cd75-4230-b46d-aef6fdc03e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6825","nonce":1637875895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6827","nonce":1637875895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6831","nonce":1637875895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6829","nonce":1637875895}]},"public_addr":"172.21.15.194:6825/1637875895","cluster_addr":"172.21.15.194:6827/1637875895","heartbeat_back_addr":"172.21.15.194:6831/1637875895","heartbeat_front_addr":"172.21.15.194:6829/1637875895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:04.255616+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:26.243863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:46.630365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:12.926291+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:35.747049+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:55.793767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:21.685725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:43.703215+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:04.043674+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:30.320026+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:52.751974+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:21:13.230024+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/2000592056":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2102228072":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2374527928":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2928221278":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2744750874":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/3681755887":"2023-08-12T12:15:02.528403+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-11T12:24:05.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.476+0000 7f6caebff700 1 -- 172.21.15.8:0/1930094683 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6c9809ff50 msgr2=0x7f6c980a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:05.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.476+0000 7f6caebff700 1 --2- 172.21.15.8:0/1930094683 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6c9809ff50 0x7f6c980a2410 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009990 tx=0x7f6c9c005fb0 comp rx=0 tx=0).stop 2023-08-11T12:24:05.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.476+0000 7f6caebff700 1 -- 172.21.15.8:0/1930094683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca8101bf0 msgr2=0x7f6ca8196c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:05.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.476+0000 7f6caebff700 1 --2- 172.21.15.8:0/1930094683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca8101bf0 0x7f6ca8196c30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400e9a0 tx=0x7f6c9400ecb0 comp rx=0 tx=0).stop 2023-08-11T12:24:05.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.476+0000 7f6caebff700 1 -- 172.21.15.8:0/1930094683 shutdown_connections 2023-08-11T12:24:05.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.476+0000 7f6caebff700 1 --2- 172.21.15.8:0/1930094683 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6c9809ff50 0x7f6c980a2410 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:05.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.476+0000 7f6caebff700 1 --2- 172.21.15.8:0/1930094683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ca8102590 0x7f6ca819dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:05.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.476+0000 7f6caebff700 1 --2- 172.21.15.8:0/1930094683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ca8100a00 0x7f6ca81966f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:05.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.476+0000 7f6caebff700 1 --2- 172.21.15.8:0/1930094683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca8101bf0 0x7f6ca8196c30 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:05.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.476+0000 7f6caebff700 1 -- 172.21.15.8:0/1930094683 >> 172.21.15.8:0/1930094683 conn(0x7f6ca80fbf70 msgr2=0x7f6ca80fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:05.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.476+0000 7f6caebff700 1 -- 172.21.15.8:0/1930094683 shutdown_connections 2023-08-11T12:24:05.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.476+0000 7f6caebff700 1 -- 172.21.15.8:0/1930094683 wait complete. 2023-08-11T12:24:05.498 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-11T12:17:49.040758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-11T12:22:01.383296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-11T12:22:02.816329+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-11T12:22:06.369375+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-11T12:24:05.499 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-11T12:24:05.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.704+0000 7fca945ff700 1 -- 172.21.15.8:0/2277197693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca8c101bf0 msgr2=0x7fca8c102050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:05.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.704+0000 7fca945ff700 1 --2- 172.21.15.8:0/2277197693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca8c101bf0 0x7fca8c102050 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0099c0 tx=0x7fca7c009cd0 comp rx=0 tx=0).stop 2023-08-11T12:24:05.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.704+0000 7fca945ff700 1 -- 172.21.15.8:0/2277197693 shutdown_connections 2023-08-11T12:24:05.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.704+0000 7fca945ff700 1 --2- 172.21.15.8:0/2277197693 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca8c102590 0x7fca8c108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:05.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.704+0000 7fca945ff700 1 --2- 172.21.15.8:0/2277197693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca8c100a00 0x7fca8c100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:05.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.704+0000 7fca945ff700 1 --2- 172.21.15.8:0/2277197693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca8c101bf0 0x7fca8c102050 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:05.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.704+0000 7fca945ff700 1 -- 172.21.15.8:0/2277197693 >> 172.21.15.8:0/2277197693 conn(0x7fca8c0fbf70 msgr2=0x7fca8c0fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:05.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.704+0000 7fca945ff700 1 -- 172.21.15.8:0/2277197693 shutdown_connections 2023-08-11T12:24:05.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.704+0000 7fca945ff700 1 -- 172.21.15.8:0/2277197693 wait complete. 2023-08-11T12:24:05.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.705+0000 7fca945ff700 1 Processor -- start 2023-08-11T12:24:05.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.705+0000 7fca945ff700 1 -- start start 2023-08-11T12:24:05.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.705+0000 7fca945ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca8c100a00 0x7fca8c0746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:05.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.705+0000 7fca945ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca8c101bf0 0x7fca8c072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:05.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.705+0000 7fca945ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca8c102590 0x7fca8c073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:05.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.705+0000 7fca945ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c0739f0 con 0x7fca8c100a00 2023-08-11T12:24:05.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.705+0000 7fca945ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c073b60 con 0x7fca8c101bf0 2023-08-11T12:24:05.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.705+0000 7fca945ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c1a0750 con 0x7fca8c102590 2023-08-11T12:24:05.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.706+0000 7fca9239b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca8c100a00 0x7fca8c0746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:05.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.706+0000 7fca9239b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca8c100a00 0x7fca8c0746d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53668/0 (socket says 172.21.15.8:53668) 2023-08-11T12:24:05.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.706+0000 7fca9239b700 1 -- 172.21.15.8:0/4219801386 learned_addr learned my addr 172.21.15.8:0/4219801386 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:05.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.706+0000 7fca92b9c700 1 --2- 172.21.15.8:0/4219801386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca8c102590 0x7fca8c073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:05.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.706+0000 7fca91b9a700 1 --2- 172.21.15.8:0/4219801386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca8c101bf0 0x7fca8c072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:05.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.706+0000 7fca9239b700 1 -- 172.21.15.8:0/4219801386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca8c102590 msgr2=0x7fca8c073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:05.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.706+0000 7fca9239b700 1 --2- 172.21.15.8:0/4219801386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca8c102590 0x7fca8c073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:05.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.706+0000 7fca9239b700 1 -- 172.21.15.8:0/4219801386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca8c101bf0 msgr2=0x7fca8c072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:05.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.706+0000 7fca9239b700 1 --2- 172.21.15.8:0/4219801386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca8c101bf0 0x7fca8c072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:05.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.706+0000 7fca9239b700 1 -- 172.21.15.8:0/4219801386 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c0095f0 con 0x7fca8c100a00 2023-08-11T12:24:05.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.706+0000 7fca92b9c700 1 --2- 172.21.15.8:0/4219801386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca8c102590 0x7fca8c073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:24:05.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.706+0000 7fca9239b700 1 --2- 172.21.15.8:0/4219801386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca8c100a00 0x7fca8c0746d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fca8800e970 tx=0x7fca8800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:05.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.706+0000 7fca837fe700 1 -- 172.21.15.8:0/4219801386 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88009790 con 0x7fca8c100a00 2023-08-11T12:24:05.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.707+0000 7fca945ff700 1 -- 172.21.15.8:0/4219801386 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca8c1a0a30 con 0x7fca8c100a00 2023-08-11T12:24:05.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.707+0000 7fca837fe700 1 -- 172.21.15.8:0/4219801386 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca8800eec0 con 0x7fca8c100a00 2023-08-11T12:24:05.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.707+0000 7fca837fe700 1 -- 172.21.15.8:0/4219801386 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88003cf0 con 0x7fca8c100a00 2023-08-11T12:24:05.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.707+0000 7fca945ff700 1 -- 172.21.15.8:0/4219801386 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca8c1a0f40 con 0x7fca8c100a00 2023-08-11T12:24:05.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.708+0000 7fca945ff700 1 -- 172.21.15.8:0/4219801386 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca8c107fe0 con 0x7fca8c100a00 2023-08-11T12:24:05.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.710+0000 7fca837fe700 1 -- 172.21.15.8:0/4219801386 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fca8800ccd0 con 0x7fca8c100a00 2023-08-11T12:24:05.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.711+0000 7fca837fe700 1 --2- 172.21.15.8:0/4219801386 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fca7809ff50 0x7fca780a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:05.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.711+0000 7fca837fe700 1 -- 172.21.15.8:0/4219801386 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fca88014070 con 0x7fca8c100a00 2023-08-11T12:24:05.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.711+0000 7fca91b9a700 1 --2- 172.21.15.8:0/4219801386 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fca7809ff50 0x7fca780a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:05.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.712+0000 7fca91b9a700 1 --2- 172.21.15.8:0/4219801386 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fca7809ff50 0x7fca780a2410 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00b580 tx=0x7fca7c005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:05.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.713+0000 7fca837fe700 1 -- 172.21.15.8:0/4219801386 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fca88095380 con 0x7fca8c100a00 2023-08-11T12:24:05.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.930+0000 7fca945ff700 1 -- 172.21.15.8:0/4219801386 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fca8c10c4d0 con 0x7fca8c100a00 2023-08-11T12:24:05.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.930+0000 7fca837fe700 1 -- 172.21.15.8:0/4219801386 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7fca880989a0 con 0x7fca8c100a00 2023-08-11T12:24:05.933 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-08-11T12:24:05.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.933+0000 7fca945ff700 1 -- 172.21.15.8:0/4219801386 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fca7809ff50 msgr2=0x7fca780a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:05.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.933+0000 7fca945ff700 1 --2- 172.21.15.8:0/4219801386 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fca7809ff50 0x7fca780a2410 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00b580 tx=0x7fca7c005fb0 comp rx=0 tx=0).stop 2023-08-11T12:24:05.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.933+0000 7fca945ff700 1 -- 172.21.15.8:0/4219801386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca8c100a00 msgr2=0x7fca8c0746d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:05.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.933+0000 7fca945ff700 1 --2- 172.21.15.8:0/4219801386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca8c100a00 0x7fca8c0746d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fca8800e970 tx=0x7fca8800ec80 comp rx=0 tx=0).stop 2023-08-11T12:24:05.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.933+0000 7fca945ff700 1 -- 172.21.15.8:0/4219801386 shutdown_connections 2023-08-11T12:24:05.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.933+0000 7fca945ff700 1 --2- 172.21.15.8:0/4219801386 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fca7809ff50 0x7fca780a2410 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:05.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.933+0000 7fca945ff700 1 --2- 172.21.15.8:0/4219801386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca8c102590 0x7fca8c073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:05.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.933+0000 7fca945ff700 1 --2- 172.21.15.8:0/4219801386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca8c100a00 0x7fca8c0746d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:05.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.933+0000 7fca945ff700 1 --2- 172.21.15.8:0/4219801386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca8c101bf0 0x7fca8c072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:05.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.933+0000 7fca945ff700 1 -- 172.21.15.8:0/4219801386 >> 172.21.15.8:0/4219801386 conn(0x7fca8c0fbf70 msgr2=0x7fca8c105120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:05.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.933+0000 7fca945ff700 1 -- 172.21.15.8:0/4219801386 shutdown_connections 2023-08-11T12:24:05.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:05.933+0000 7fca945ff700 1 -- 172.21.15.8:0/4219801386 wait complete. 2023-08-11T12:24:05.954 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-11T12:24:06.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:05 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1610430102' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:24:06.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:05 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1930094683' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:24:06.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:05 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1610430102' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:24:06.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:05 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1930094683' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:24:06.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:05 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1610430102' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:24:06.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:05 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1930094683' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:24:06.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.159+0000 7f5c1adff700 1 -- 172.21.15.8:0/1984627142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c141088c0 msgr2=0x7f5c1410ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:06.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.159+0000 7f5c1adff700 1 --2- 172.21.15.8:0/1984627142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c141088c0 0x7f5c1410ad50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00b0a0 tx=0x7f5c0c00b3b0 comp rx=0 tx=0).stop 2023-08-11T12:24:06.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.159+0000 7f5c1adff700 1 -- 172.21.15.8:0/1984627142 shutdown_connections 2023-08-11T12:24:06.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.159+0000 7f5c1adff700 1 --2- 172.21.15.8:0/1984627142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c14074960 0x7f5c14072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:06.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.159+0000 7f5c1adff700 1 --2- 172.21.15.8:0/1984627142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c141088c0 0x7f5c1410ad50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:06.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.159+0000 7f5c1adff700 1 --2- 172.21.15.8:0/1984627142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c14073380 0x7f5c14073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:06.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.159+0000 7f5c1adff700 1 -- 172.21.15.8:0/1984627142 >> 172.21.15.8:0/1984627142 conn(0x7f5c140fbf70 msgr2=0x7f5c140fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:06.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.159+0000 7f5c1adff700 1 -- 172.21.15.8:0/1984627142 shutdown_connections 2023-08-11T12:24:06.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.159+0000 7f5c1adff700 1 -- 172.21.15.8:0/1984627142 wait complete. 2023-08-11T12:24:06.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.160+0000 7f5c1adff700 1 Processor -- start 2023-08-11T12:24:06.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.160+0000 7f5c1adff700 1 -- start start 2023-08-11T12:24:06.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.160+0000 7f5c1adff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c14073380 0x7f5c141989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:06.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.160+0000 7f5c1adff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c14074960 0x7f5c14198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:06.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.160+0000 7f5c1adff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c141088c0 0x7f5c1419ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:06.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.160+0000 7f5c1adff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c141a0560 con 0x7f5c14074960 2023-08-11T12:24:06.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.160+0000 7f5c1adff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c141a06a0 con 0x7f5c14073380 2023-08-11T12:24:06.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.160+0000 7f5c1adff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c141a0830 con 0x7f5c141088c0 2023-08-11T12:24:06.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.161+0000 7f5c13fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c14074960 0x7f5c14198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:06.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.161+0000 7f5c13fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c14074960 0x7f5c14198f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53692/0 (socket says 172.21.15.8:53692) 2023-08-11T12:24:06.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.161+0000 7f5c18b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c14073380 0x7f5c141989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:06.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.161+0000 7f5c1939c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c141088c0 0x7f5c1419ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:06.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.161+0000 7f5c13fff700 1 -- 172.21.15.8:0/1147370519 learned_addr learned my addr 172.21.15.8:0/1147370519 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:06.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.161+0000 7f5c13fff700 1 -- 172.21.15.8:0/1147370519 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c141088c0 msgr2=0x7f5c1419ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:06.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.161+0000 7f5c13fff700 1 --2- 172.21.15.8:0/1147370519 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c141088c0 0x7f5c1419ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:06.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.161+0000 7f5c13fff700 1 -- 172.21.15.8:0/1147370519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c14073380 msgr2=0x7f5c141989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:06.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.161+0000 7f5c13fff700 1 --2- 172.21.15.8:0/1147370519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c14073380 0x7f5c141989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:06.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.161+0000 7f5c13fff700 1 -- 172.21.15.8:0/1147370519 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0c009d00 con 0x7f5c14074960 2023-08-11T12:24:06.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.161+0000 7f5c18b9b700 1 --2- 172.21.15.8:0/1147370519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c14073380 0x7f5c141989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:06.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.162+0000 7f5c13fff700 1 --2- 172.21.15.8:0/1147370519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c14074960 0x7f5c14198f20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5c0000e970 tx=0x7f5c0000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:06.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.162+0000 7f5c11ffb700 1 -- 172.21.15.8:0/1147370519 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c00009790 con 0x7f5c14074960 2023-08-11T12:24:06.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.162+0000 7f5c11ffb700 1 -- 172.21.15.8:0/1147370519 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5c0000c7e0 con 0x7f5c14074960 2023-08-11T12:24:06.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.162+0000 7f5c1adff700 1 -- 172.21.15.8:0/1147370519 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c141a0b10 con 0x7f5c14074960 2023-08-11T12:24:06.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.162+0000 7f5c11ffb700 1 -- 172.21.15.8:0/1147370519 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c00003c70 con 0x7f5c14074960 2023-08-11T12:24:06.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.162+0000 7f5c1adff700 1 -- 172.21.15.8:0/1147370519 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c141a1070 con 0x7f5c14074960 2023-08-11T12:24:06.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.163+0000 7f5c1adff700 1 -- 172.21.15.8:0/1147370519 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c14106f70 con 0x7f5c14074960 2023-08-11T12:24:06.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.165+0000 7f5c11ffb700 1 -- 172.21.15.8:0/1147370519 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f5c0000cc50 con 0x7f5c14074960 2023-08-11T12:24:06.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.166+0000 7f5c11ffb700 1 --2- 172.21.15.8:0/1147370519 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5c0409ffd0 0x7f5c040a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:06.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.166+0000 7f5c11ffb700 1 -- 172.21.15.8:0/1147370519 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f5c00014070 con 0x7f5c14074960 2023-08-11T12:24:06.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.167+0000 7f5c18b9b700 1 --2- 172.21.15.8:0/1147370519 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5c0409ffd0 0x7f5c040a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:06.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.167+0000 7f5c18b9b700 1 --2- 172.21.15.8:0/1147370519 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5c0409ffd0 0x7f5c040a2490 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5c08011490 tx=0x7f5c08009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:06.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.170+0000 7f5c11ffb700 1 -- 172.21.15.8:0/1147370519 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f5c00095100 con 0x7f5c14074960 2023-08-11T12:24:06.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.379+0000 7f5c1adff700 1 -- 172.21.15.8:0/1147370519 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5c1402cdc0 con 0x7f5c14074960 2023-08-11T12:24:06.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.380+0000 7f5c11ffb700 1 -- 172.21.15.8:0/1147370519 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5c00003dd0 con 0x7f5c14074960 2023-08-11T12:24:06.383 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-08-11T12:24:06.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.382+0000 7f5c1adff700 1 -- 172.21.15.8:0/1147370519 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5c0409ffd0 msgr2=0x7f5c040a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:06.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.382+0000 7f5c1adff700 1 --2- 172.21.15.8:0/1147370519 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5c0409ffd0 0x7f5c040a2490 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5c08011490 tx=0x7f5c08009260 comp rx=0 tx=0).stop 2023-08-11T12:24:06.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.382+0000 7f5c1adff700 1 -- 172.21.15.8:0/1147370519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c14074960 msgr2=0x7f5c14198f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:06.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.382+0000 7f5c1adff700 1 --2- 172.21.15.8:0/1147370519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c14074960 0x7f5c14198f20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5c0000e970 tx=0x7f5c0000ec80 comp rx=0 tx=0).stop 2023-08-11T12:24:06.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.382+0000 7f5c1adff700 1 -- 172.21.15.8:0/1147370519 shutdown_connections 2023-08-11T12:24:06.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.382+0000 7f5c1adff700 1 --2- 172.21.15.8:0/1147370519 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5c0409ffd0 0x7f5c040a2490 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:06.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.382+0000 7f5c1adff700 1 --2- 172.21.15.8:0/1147370519 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c141088c0 0x7f5c1419ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:06.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.382+0000 7f5c1adff700 1 --2- 172.21.15.8:0/1147370519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c14073380 0x7f5c141989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:06.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.382+0000 7f5c1adff700 1 --2- 172.21.15.8:0/1147370519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c14074960 0x7f5c14198f20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:06.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.382+0000 7f5c1adff700 1 -- 172.21.15.8:0/1147370519 >> 172.21.15.8:0/1147370519 conn(0x7f5c140fbf70 msgr2=0x7f5c140fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:06.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.383+0000 7f5c1adff700 1 -- 172.21.15.8:0/1147370519 shutdown_connections 2023-08-11T12:24:06.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.383+0000 7f5c1adff700 1 -- 172.21.15.8:0/1147370519 wait complete. 2023-08-11T12:24:06.404 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-11T12:24:06.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.609+0000 7f3579fff700 1 -- 172.21.15.8:0/1155926628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3574073380 msgr2=0x7f3574073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:06.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.609+0000 7f3579fff700 1 --2- 172.21.15.8:0/1155926628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3574073380 0x7f3574073800 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3568009990 tx=0x7f3568009ca0 comp rx=0 tx=0).stop 2023-08-11T12:24:06.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.609+0000 7f3579fff700 1 -- 172.21.15.8:0/1155926628 shutdown_connections 2023-08-11T12:24:06.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.609+0000 7f3579fff700 1 --2- 172.21.15.8:0/1155926628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35741088c0 0x7f357410ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:06.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.609+0000 7f3579fff700 1 --2- 172.21.15.8:0/1155926628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3574074960 0x7f3574072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:06.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.609+0000 7f3579fff700 1 --2- 172.21.15.8:0/1155926628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3574073380 0x7f3574073800 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:06.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.609+0000 7f3579fff700 1 -- 172.21.15.8:0/1155926628 >> 172.21.15.8:0/1155926628 conn(0x7f35740fbf70 msgr2=0x7f35740fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:06.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.609+0000 7f3579fff700 1 -- 172.21.15.8:0/1155926628 shutdown_connections 2023-08-11T12:24:06.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.609+0000 7f3579fff700 1 -- 172.21.15.8:0/1155926628 wait complete. 2023-08-11T12:24:06.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.610+0000 7f3579fff700 1 Processor -- start 2023-08-11T12:24:06.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.610+0000 7f3579fff700 1 -- start start 2023-08-11T12:24:06.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.611+0000 7f3579fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3574073380 0x7f3574198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:06.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.611+0000 7f3579fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3574074960 0x7f3574198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:06.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.611+0000 7f3579fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35741088c0 0x7f357419fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:06.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.611+0000 7f3579fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35741a0490 con 0x7f3574073380 2023-08-11T12:24:06.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.611+0000 7f3579fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35741a05d0 con 0x7f35741088c0 2023-08-11T12:24:06.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.611+0000 7f3579fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35741a0760 con 0x7f3574074960 2023-08-11T12:24:06.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.611+0000 7f35737fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3574073380 0x7f3574198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:06.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.611+0000 7f35737fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3574073380 0x7f3574198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53712/0 (socket says 172.21.15.8:53712) 2023-08-11T12:24:06.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.611+0000 7f35737fe700 1 -- 172.21.15.8:0/4116602356 learned_addr learned my addr 172.21.15.8:0/4116602356 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:06.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.611+0000 7f3573fff700 1 --2- 172.21.15.8:0/4116602356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35741088c0 0x7f357419fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:06.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.611+0000 7f3572ffd700 1 --2- 172.21.15.8:0/4116602356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3574074960 0x7f3574198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:06.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.611+0000 7f35737fe700 1 -- 172.21.15.8:0/4116602356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3574074960 msgr2=0x7f3574198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:06.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.611+0000 7f35737fe700 1 --2- 172.21.15.8:0/4116602356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3574074960 0x7f3574198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:06.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.611+0000 7f35737fe700 1 -- 172.21.15.8:0/4116602356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35741088c0 msgr2=0x7f357419fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:06.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.611+0000 7f35737fe700 1 --2- 172.21.15.8:0/4116602356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35741088c0 0x7f357419fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:06.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.612+0000 7f35737fe700 1 -- 172.21.15.8:0/4116602356 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35680095f0 con 0x7f3574073380 2023-08-11T12:24:06.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.612+0000 7f35737fe700 1 --2- 172.21.15.8:0/4116602356 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3574073380 0x7f3574198910 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f356400e9a0 tx=0x7f356400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:06.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.612+0000 7f3570ff9700 1 -- 172.21.15.8:0/4116602356 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3564009790 con 0x7f3574073380 2023-08-11T12:24:06.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.612+0000 7f3579fff700 1 -- 172.21.15.8:0/4116602356 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35741a0a40 con 0x7f3574073380 2023-08-11T12:24:06.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.612+0000 7f3570ff9700 1 -- 172.21.15.8:0/4116602356 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3564010430 con 0x7f3574073380 2023-08-11T12:24:06.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.612+0000 7f3570ff9700 1 -- 172.21.15.8:0/4116602356 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3564018680 con 0x7f3574073380 2023-08-11T12:24:06.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.612+0000 7f3579fff700 1 -- 172.21.15.8:0/4116602356 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35741a0f50 con 0x7f3574073380 2023-08-11T12:24:06.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.613+0000 7f3579fff700 1 -- 172.21.15.8:0/4116602356 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3574106f70 con 0x7f3574073380 2023-08-11T12:24:06.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.615+0000 7f3570ff9700 1 -- 172.21.15.8:0/4116602356 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f35640105a0 con 0x7f3574073380 2023-08-11T12:24:06.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.617+0000 7f3570ff9700 1 --2- 172.21.15.8:0/4116602356 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f355c09ff50 0x7f355c0a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:06.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.618+0000 7f3570ff9700 1 -- 172.21.15.8:0/4116602356 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f3564014070 con 0x7f3574073380 2023-08-11T12:24:06.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.618+0000 7f3572ffd700 1 --2- 172.21.15.8:0/4116602356 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f355c09ff50 0x7f355c0a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:06.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.618+0000 7f3572ffd700 1 --2- 172.21.15.8:0/4116602356 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f355c09ff50 0x7f355c0a2410 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f356800b2e0 tx=0x7f3568005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:06.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.621+0000 7f3570ff9700 1 -- 172.21.15.8:0/4116602356 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f3564051c30 con 0x7f3574073380 2023-08-11T12:24:06.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.832+0000 7f3579fff700 1 -- 172.21.15.8:0/4116602356 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f357410e630 con 0x7f3574073380 2023-08-11T12:24:06.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.832+0000 7f3570ff9700 1 -- 172.21.15.8:0/4116602356 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3564095180 con 0x7f3574073380 2023-08-11T12:24:06.834 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-08-11T12:24:06.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.834+0000 7f3579fff700 1 -- 172.21.15.8:0/4116602356 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f355c09ff50 msgr2=0x7f355c0a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:06.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.834+0000 7f3579fff700 1 --2- 172.21.15.8:0/4116602356 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f355c09ff50 0x7f355c0a2410 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f356800b2e0 tx=0x7f3568005fb0 comp rx=0 tx=0).stop 2023-08-11T12:24:06.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.834+0000 7f3579fff700 1 -- 172.21.15.8:0/4116602356 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3574073380 msgr2=0x7f3574198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:06.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.834+0000 7f3579fff700 1 --2- 172.21.15.8:0/4116602356 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3574073380 0x7f3574198910 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f356400e9a0 tx=0x7f356400ecb0 comp rx=0 tx=0).stop 2023-08-11T12:24:06.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.835+0000 7f3579fff700 1 -- 172.21.15.8:0/4116602356 shutdown_connections 2023-08-11T12:24:06.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.835+0000 7f3579fff700 1 --2- 172.21.15.8:0/4116602356 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f355c09ff50 0x7f355c0a2410 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:06.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.835+0000 7f3579fff700 1 --2- 172.21.15.8:0/4116602356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35741088c0 0x7f357419fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:06.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.835+0000 7f3579fff700 1 --2- 172.21.15.8:0/4116602356 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3574073380 0x7f3574198910 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:06.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.835+0000 7f3579fff700 1 --2- 172.21.15.8:0/4116602356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3574074960 0x7f3574198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:06.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.835+0000 7f3579fff700 1 -- 172.21.15.8:0/4116602356 >> 172.21.15.8:0/4116602356 conn(0x7f35740fbf70 msgr2=0x7f35740fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:06.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.835+0000 7f3579fff700 1 -- 172.21.15.8:0/4116602356 shutdown_connections 2023-08-11T12:24:06.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:06.835+0000 7f3579fff700 1 -- 172.21.15.8:0/4116602356 wait complete. 2023-08-11T12:24:06.855 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-11T12:24:07.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:06 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/4219801386' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:24:07.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:06 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1147370519' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:24:07.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:06 smithi008 ceph-mon[97158]: pgmap v337: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-08-11T12:24:07.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.059+0000 7f5ce51ff700 1 -- 172.21.15.8:0/54675388 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ce01025a0 msgr2=0x7f5ce0108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:07.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.059+0000 7f5ce51ff700 1 --2- 172.21.15.8:0/54675388 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ce01025a0 0x7f5ce0108e50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5cd800b0d0 tx=0x7f5cd800b3e0 comp rx=0 tx=0).stop 2023-08-11T12:24:07.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.059+0000 7f5ce51ff700 1 -- 172.21.15.8:0/54675388 shutdown_connections 2023-08-11T12:24:07.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.059+0000 7f5ce51ff700 1 --2- 172.21.15.8:0/54675388 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ce0100a10 0x7f5ce0100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:07.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.059+0000 7f5ce51ff700 1 --2- 172.21.15.8:0/54675388 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ce01025a0 0x7f5ce0108e50 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:07.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.059+0000 7f5ce51ff700 1 --2- 172.21.15.8:0/54675388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ce0101c00 0x7f5ce0102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:07.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.059+0000 7f5ce51ff700 1 -- 172.21.15.8:0/54675388 >> 172.21.15.8:0/54675388 conn(0x7f5ce00fbf80 msgr2=0x7f5ce00fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:07.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.059+0000 7f5ce51ff700 1 -- 172.21.15.8:0/54675388 shutdown_connections 2023-08-11T12:24:07.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.059+0000 7f5ce51ff700 1 -- 172.21.15.8:0/54675388 wait complete. 2023-08-11T12:24:07.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.060+0000 7f5ce51ff700 1 Processor -- start 2023-08-11T12:24:07.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.060+0000 7f5ce51ff700 1 -- start start 2023-08-11T12:24:07.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.061+0000 7f5ce51ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ce0100a10 0x7f5ce00746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:07.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.061+0000 7f5ce51ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ce0101c00 0x7f5ce0072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:07.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.061+0000 7f5ce51ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ce01025a0 0x7f5ce0073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:07.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.061+0000 7f5ce51ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce00739f0 con 0x7f5ce0101c00 2023-08-11T12:24:07.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.061+0000 7f5ce51ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce0073b60 con 0x7f5ce01025a0 2023-08-11T12:24:07.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.061+0000 7f5ce51ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce01a0830 con 0x7f5ce0100a10 2023-08-11T12:24:07.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.061+0000 7f5cde59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ce0101c00 0x7f5ce0072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:07.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.061+0000 7f5cde59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ce0101c00 0x7f5ce0072d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53728/0 (socket says 172.21.15.8:53728) 2023-08-11T12:24:07.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.061+0000 7f5cde59c700 1 -- 172.21.15.8:0/879641608 learned_addr learned my addr 172.21.15.8:0/879641608 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:07.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.061+0000 7f5cdf59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ce01025a0 0x7f5ce0073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:07.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.061+0000 7f5cded9d700 1 --2- 172.21.15.8:0/879641608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ce0100a10 0x7f5ce00746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:07.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.061+0000 7f5cdf59e700 1 -- 172.21.15.8:0/879641608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ce0100a10 msgr2=0x7f5ce00746d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:07.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.061+0000 7f5cdf59e700 1 --2- 172.21.15.8:0/879641608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ce0100a10 0x7f5ce00746d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:07.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.061+0000 7f5cdf59e700 1 -- 172.21.15.8:0/879641608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ce0101c00 msgr2=0x7f5ce0072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:07.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.061+0000 7f5cdf59e700 1 --2- 172.21.15.8:0/879641608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ce0101c00 0x7f5ce0072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:07.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.061+0000 7f5cdf59e700 1 -- 172.21.15.8:0/879641608 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd8009d00 con 0x7f5ce01025a0 2023-08-11T12:24:07.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.061+0000 7f5cde59c700 1 --2- 172.21.15.8:0/879641608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ce0101c00 0x7f5ce0072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:07.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.062+0000 7f5cdf59e700 1 --2- 172.21.15.8:0/879641608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ce01025a0 0x7f5ce0073250 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8007a30 tx=0x7f5cd8008eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:07.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.062+0000 7f5cc7fff700 1 -- 172.21.15.8:0/879641608 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd800e040 con 0x7f5ce01025a0 2023-08-11T12:24:07.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.062+0000 7f5ce51ff700 1 -- 172.21.15.8:0/879641608 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce01a0ab0 con 0x7f5ce01025a0 2023-08-11T12:24:07.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.062+0000 7f5cc7fff700 1 -- 172.21.15.8:0/879641608 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5cd800bd30 con 0x7f5ce01025a0 2023-08-11T12:24:07.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.062+0000 7f5cc7fff700 1 -- 172.21.15.8:0/879641608 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd801d470 con 0x7f5ce01025a0 2023-08-11T12:24:07.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.062+0000 7f5ce51ff700 1 -- 172.21.15.8:0/879641608 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce01a0f80 con 0x7f5ce01025a0 2023-08-11T12:24:07.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.063+0000 7f5ce51ff700 1 -- 172.21.15.8:0/879641608 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce0107f20 con 0x7f5ce01025a0 2023-08-11T12:24:07.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.065+0000 7f5cc7fff700 1 -- 172.21.15.8:0/879641608 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f5cd8005020 con 0x7f5ce01025a0 2023-08-11T12:24:07.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.067+0000 7f5cc7fff700 1 --2- 172.21.15.8:0/879641608 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5cc809ff50 0x7f5cc80a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:07.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.067+0000 7f5cc7fff700 1 -- 172.21.15.8:0/879641608 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f5cd80cc700 con 0x7f5ce01025a0 2023-08-11T12:24:07.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.067+0000 7f5cded9d700 1 --2- 172.21.15.8:0/879641608 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5cc809ff50 0x7f5cc80a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:07.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.067+0000 7f5cded9d700 1 --2- 172.21.15.8:0/879641608 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5cc809ff50 0x7f5cc80a2410 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0101a60 tx=0x7f5cd0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:07.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.069+0000 7f5cc7fff700 1 -- 172.21.15.8:0/879641608 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f5cd80961b0 con 0x7f5ce01025a0 2023-08-11T12:24:07.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:06 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/4219801386' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:24:07.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:06 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1147370519' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:24:07.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:06 smithi194 ceph-mon[130905]: pgmap v337: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-08-11T12:24:07.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:06 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/4219801386' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:24:07.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:06 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1147370519' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:24:07.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:06 smithi045 ceph-mon[130284]: pgmap v337: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-08-11T12:24:07.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.277+0000 7f5ce51ff700 1 -- 172.21.15.8:0/879641608 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5ce010c280 con 0x7f5ce01025a0 2023-08-11T12:24:07.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.277+0000 7f5cc7fff700 1 -- 172.21.15.8:0/879641608 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5cd80997d0 con 0x7f5ce01025a0 2023-08-11T12:24:07.279 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-08-11T12:24:07.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.279+0000 7f5ce51ff700 1 -- 172.21.15.8:0/879641608 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5cc809ff50 msgr2=0x7f5cc80a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:07.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.279+0000 7f5ce51ff700 1 --2- 172.21.15.8:0/879641608 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5cc809ff50 0x7f5cc80a2410 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0101a60 tx=0x7f5cd0009260 comp rx=0 tx=0).stop 2023-08-11T12:24:07.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.279+0000 7f5ce51ff700 1 -- 172.21.15.8:0/879641608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ce01025a0 msgr2=0x7f5ce0073250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:07.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.279+0000 7f5ce51ff700 1 --2- 172.21.15.8:0/879641608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ce01025a0 0x7f5ce0073250 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8007a30 tx=0x7f5cd8008eb0 comp rx=0 tx=0).stop 2023-08-11T12:24:07.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.280+0000 7f5ce51ff700 1 -- 172.21.15.8:0/879641608 shutdown_connections 2023-08-11T12:24:07.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.280+0000 7f5ce51ff700 1 --2- 172.21.15.8:0/879641608 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5cc809ff50 0x7f5cc80a2410 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:07.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.280+0000 7f5ce51ff700 1 --2- 172.21.15.8:0/879641608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ce0100a10 0x7f5ce00746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:07.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.280+0000 7f5ce51ff700 1 --2- 172.21.15.8:0/879641608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ce01025a0 0x7f5ce0073250 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:07.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.280+0000 7f5ce51ff700 1 --2- 172.21.15.8:0/879641608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ce0101c00 0x7f5ce0072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:07.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.280+0000 7f5ce51ff700 1 -- 172.21.15.8:0/879641608 >> 172.21.15.8:0/879641608 conn(0x7f5ce00fbf80 msgr2=0x7f5ce0105060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:07.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.280+0000 7f5ce51ff700 1 -- 172.21.15.8:0/879641608 shutdown_connections 2023-08-11T12:24:07.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.280+0000 7f5ce51ff700 1 -- 172.21.15.8:0/879641608 wait complete. 2023-08-11T12:24:07.300 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-11T12:24:07.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.503+0000 7f1e9c3ff700 1 -- 172.21.15.8:0/140314206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e941009e0 msgr2=0x7f1e94100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:07.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.503+0000 7f1e9c3ff700 1 --2- 172.21.15.8:0/140314206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e941009e0 0x7f1e94100e00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1e900099c0 tx=0x7f1e90009cd0 comp rx=0 tx=0).stop 2023-08-11T12:24:07.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.503+0000 7f1e9c3ff700 1 -- 172.21.15.8:0/140314206 shutdown_connections 2023-08-11T12:24:07.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.503+0000 7f1e9c3ff700 1 --2- 172.21.15.8:0/140314206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e94102570 0x7f1e94108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:07.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.503+0000 7f1e9c3ff700 1 --2- 172.21.15.8:0/140314206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e941009e0 0x7f1e94100e00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:07.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.503+0000 7f1e9c3ff700 1 --2- 172.21.15.8:0/140314206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e94101bd0 0x7f1e94102030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:07.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.503+0000 7f1e9c3ff700 1 -- 172.21.15.8:0/140314206 >> 172.21.15.8:0/140314206 conn(0x7f1e940fbf50 msgr2=0x7f1e940fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:07.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.503+0000 7f1e9c3ff700 1 -- 172.21.15.8:0/140314206 shutdown_connections 2023-08-11T12:24:07.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.503+0000 7f1e9c3ff700 1 -- 172.21.15.8:0/140314206 wait complete. 2023-08-11T12:24:07.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.504+0000 7f1e9c3ff700 1 Processor -- start 2023-08-11T12:24:07.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.505+0000 7f1e9c3ff700 1 -- start start 2023-08-11T12:24:07.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.505+0000 7f1e9c3ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e941009e0 0x7f1e94198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:07.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.505+0000 7f1e9c3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e94101bd0 0x7f1e94198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:07.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.505+0000 7f1e9c3ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e94102570 0x7f1e9419fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:07.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.505+0000 7f1e9c3ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e941a04b0 con 0x7f1e941009e0 2023-08-11T12:24:07.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.505+0000 7f1e9c3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e941a05f0 con 0x7f1e94101bd0 2023-08-11T12:24:07.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.505+0000 7f1e9c3ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e941a0780 con 0x7f1e94102570 2023-08-11T12:24:07.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.505+0000 7f1e9a19b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e941009e0 0x7f1e94198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:07.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.505+0000 7f1e9a19b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e941009e0 0x7f1e94198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53742/0 (socket says 172.21.15.8:53742) 2023-08-11T12:24:07.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.505+0000 7f1e9a19b700 1 -- 172.21.15.8:0/2838886668 learned_addr learned my addr 172.21.15.8:0/2838886668 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:07.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.505+0000 7f1e9999a700 1 --2- 172.21.15.8:0/2838886668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e94101bd0 0x7f1e94198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:07.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.505+0000 7f1e9a99c700 1 --2- 172.21.15.8:0/2838886668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e94102570 0x7f1e9419fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:07.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.506+0000 7f1e9a19b700 1 -- 172.21.15.8:0/2838886668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e94102570 msgr2=0x7f1e9419fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:07.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.506+0000 7f1e9a19b700 1 --2- 172.21.15.8:0/2838886668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e94102570 0x7f1e9419fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:07.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.506+0000 7f1e9a19b700 1 -- 172.21.15.8:0/2838886668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e94101bd0 msgr2=0x7f1e94198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:07.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.506+0000 7f1e9a19b700 1 --2- 172.21.15.8:0/2838886668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e94101bd0 0x7f1e94198e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:07.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.506+0000 7f1e9a19b700 1 -- 172.21.15.8:0/2838886668 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e900095f0 con 0x7f1e941009e0 2023-08-11T12:24:07.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.506+0000 7f1e9a19b700 1 --2- 172.21.15.8:0/2838886668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e941009e0 0x7f1e94198930 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1e90009fd0 tx=0x7f1e9000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:07.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.506+0000 7f1e8b7fe700 1 -- 172.21.15.8:0/2838886668 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9001d070 con 0x7f1e941009e0 2023-08-11T12:24:07.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.506+0000 7f1e9c3ff700 1 -- 172.21.15.8:0/2838886668 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e941a0a00 con 0x7f1e941009e0 2023-08-11T12:24:07.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.506+0000 7f1e8b7fe700 1 -- 172.21.15.8:0/2838886668 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1e90005050 con 0x7f1e941009e0 2023-08-11T12:24:07.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.506+0000 7f1e8b7fe700 1 -- 172.21.15.8:0/2838886668 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e90004a70 con 0x7f1e941009e0 2023-08-11T12:24:07.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.506+0000 7f1e9c3ff700 1 -- 172.21.15.8:0/2838886668 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e941a0e80 con 0x7f1e941009e0 2023-08-11T12:24:07.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.507+0000 7f1e9c3ff700 1 -- 172.21.15.8:0/2838886668 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e9410c240 con 0x7f1e941009e0 2023-08-11T12:24:07.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.509+0000 7f1e8b7fe700 1 -- 172.21.15.8:0/2838886668 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f1e90005450 con 0x7f1e941009e0 2023-08-11T12:24:07.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.511+0000 7f1e8b7fe700 1 --2- 172.21.15.8:0/2838886668 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f1e8009ff50 0x7f1e800a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:07.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.511+0000 7f1e8b7fe700 1 -- 172.21.15.8:0/2838886668 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f1e900cc330 con 0x7f1e941009e0 2023-08-11T12:24:07.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.511+0000 7f1e9999a700 1 --2- 172.21.15.8:0/2838886668 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f1e8009ff50 0x7f1e800a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:07.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.512+0000 7f1e9999a700 1 --2- 172.21.15.8:0/2838886668 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f1e8009ff50 0x7f1e800a2410 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1e84009c60 tx=0x7f1e84009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:07.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.514+0000 7f1e8b7fe700 1 -- 172.21.15.8:0/2838886668 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f1e90095de0 con 0x7f1e941009e0 2023-08-11T12:24:07.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.770+0000 7f1e9c3ff700 1 -- 172.21.15.8:0/2838886668 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e941a1010 con 0x7f1e941009e0 2023-08-11T12:24:07.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.771+0000 7f1e8b7fe700 1 -- 172.21.15.8:0/2838886668 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11351 (secure 0 0 0) 0x7f1e90099400 con 0x7f1e941009e0 2023-08-11T12:24:07.773 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:07.773 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14469,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2854286216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2854286216},{"type":"v1","addr":"172.21.15.8:6835","nonce":2854286216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/805368621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":805368621},{"type":"v1","addr":"172.21.15.8:6837","nonce":805368621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-11T12:22:03.398475+0000","modified":"2023-08-11T12:22:32.690553+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24575,"mds_1":24550,"mds_2":24517,"mds_3":24500,"mds_4":24464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14526":{"gid":14526,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/2990530720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":2990530720},{"type":"v1","addr":"172.21.15.8:6839","nonce":2990530720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14538":{"gid":14538,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6841/3589272762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":3589272762},{"type":"v1","addr":"172.21.15.8:6841","nonce":3589272762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6833/2043443402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2043443402},{"type":"v1","addr":"172.21.15.194:6833","nonce":2043443402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24464":{"gid":24464,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.45:6833/1208864615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1208864615},{"type":"v1","addr":"172.21.15.45:6833","nonce":1208864615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24500":{"gid":24500,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.45:6835/1776075470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1776075470},{"type":"v1","addr":"172.21.15.45:6835","nonce":1776075470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24517":{"gid":24517,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.194:6835/2457430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2457430285},{"type":"v1","addr":"172.21.15.194:6835","nonce":2457430285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24529":{"gid":24529,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/3072808560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":3072808560},{"type":"v1","addr":"172.21.15.194:6837","nonce":3072808560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/641549061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":641549061},{"type":"v1","addr":"172.21.15.45:6837","nonce":641549061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.194:6839/2174476491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":2174476491},{"type":"v1","addr":"172.21.15.194:6839","nonce":2174476491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6839/119684732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":119684732},{"type":"v1","addr":"172.21.15.45:6839","nonce":119684732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-11T12:24:07.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.773+0000 7f1e9c3ff700 1 -- 172.21.15.8:0/2838886668 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f1e8009ff50 msgr2=0x7f1e800a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:07.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.773+0000 7f1e9c3ff700 1 --2- 172.21.15.8:0/2838886668 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f1e8009ff50 0x7f1e800a2410 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1e84009c60 tx=0x7f1e84009260 comp rx=0 tx=0).stop 2023-08-11T12:24:07.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.773+0000 7f1e9c3ff700 1 -- 172.21.15.8:0/2838886668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e941009e0 msgr2=0x7f1e94198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:07.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.773+0000 7f1e9c3ff700 1 --2- 172.21.15.8:0/2838886668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e941009e0 0x7f1e94198930 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1e90009fd0 tx=0x7f1e9000f690 comp rx=0 tx=0).stop 2023-08-11T12:24:07.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.773+0000 7f1e9c3ff700 1 -- 172.21.15.8:0/2838886668 shutdown_connections 2023-08-11T12:24:07.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.773+0000 7f1e9c3ff700 1 --2- 172.21.15.8:0/2838886668 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f1e8009ff50 0x7f1e800a2410 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:07.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.773+0000 7f1e9c3ff700 1 --2- 172.21.15.8:0/2838886668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e94102570 0x7f1e9419fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:07.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.773+0000 7f1e9c3ff700 1 --2- 172.21.15.8:0/2838886668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e941009e0 0x7f1e94198930 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:07.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.773+0000 7f1e9c3ff700 1 --2- 172.21.15.8:0/2838886668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e94101bd0 0x7f1e94198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:07.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.773+0000 7f1e9c3ff700 1 -- 172.21.15.8:0/2838886668 >> 172.21.15.8:0/2838886668 conn(0x7f1e940fbf50 msgr2=0x7f1e940fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:07.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.773+0000 7f1e9c3ff700 1 -- 172.21.15.8:0/2838886668 shutdown_connections 2023-08-11T12:24:07.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.773+0000 7f1e9c3ff700 1 -- 172.21.15.8:0/2838886668 wait complete. 2023-08-11T12:24:07.777 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 27 2023-08-11T12:24:07.794 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-11T12:24:08.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.999+0000 7f75207ff700 1 -- 172.21.15.8:0/1633964946 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75181009f0 msgr2=0x7f7518100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:08.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.999+0000 7f75207ff700 1 --2- 172.21.15.8:0/1633964946 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75181009f0 0x7f7518100e10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f75140099c0 tx=0x7f7514009cd0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.999+0000 7f75207ff700 1 -- 172.21.15.8:0/1633964946 shutdown_connections 2023-08-11T12:24:08.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.999+0000 7f75207ff700 1 --2- 172.21.15.8:0/1633964946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7518102580 0x7f7518108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.999+0000 7f75207ff700 1 --2- 172.21.15.8:0/1633964946 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75181009f0 0x7f7518100e10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.999+0000 7f75207ff700 1 --2- 172.21.15.8:0/1633964946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7518101be0 0x7f7518102040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.999+0000 7f75207ff700 1 -- 172.21.15.8:0/1633964946 >> 172.21.15.8:0/1633964946 conn(0x7f75180fbf80 msgr2=0x7f75180fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:08.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.999+0000 7f75207ff700 1 -- 172.21.15.8:0/1633964946 shutdown_connections 2023-08-11T12:24:08.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:07.999+0000 7f75207ff700 1 -- 172.21.15.8:0/1633964946 wait complete. 2023-08-11T12:24:08.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.000+0000 7f75207ff700 1 Processor -- start 2023-08-11T12:24:08.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.000+0000 7f75207ff700 1 -- start start 2023-08-11T12:24:08.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.001+0000 7f75207ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75181009f0 0x7f7518196690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.001+0000 7f75207ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7518101be0 0x7f7518196bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.001+0000 7f75207ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7518102580 0x7f751819dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.001+0000 7f75207ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751819e210 con 0x7f7518101be0 2023-08-11T12:24:08.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.001+0000 7f75207ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751819e350 con 0x7f75181009f0 2023-08-11T12:24:08.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.001+0000 7f75207ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751819e4e0 con 0x7f7518102580 2023-08-11T12:24:08.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.001+0000 7f751dd9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7518101be0 0x7f7518196bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.001+0000 7f751e59b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75181009f0 0x7f7518196690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.001+0000 7f751dd9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7518101be0 0x7f7518196bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39362/0 (socket says 172.21.15.8:39362) 2023-08-11T12:24:08.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.001+0000 7f751dd9a700 1 -- 172.21.15.8:0/1979264484 learned_addr learned my addr 172.21.15.8:0/1979264484 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:08.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.001+0000 7f751ed9c700 1 --2- 172.21.15.8:0/1979264484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7518102580 0x7f751819dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.001+0000 7f751dd9a700 1 -- 172.21.15.8:0/1979264484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7518102580 msgr2=0x7f751819dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:08.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.001+0000 7f751dd9a700 1 --2- 172.21.15.8:0/1979264484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7518102580 0x7f751819dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.001+0000 7f751dd9a700 1 -- 172.21.15.8:0/1979264484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75181009f0 msgr2=0x7f7518196690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:08.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.001+0000 7f751dd9a700 1 --2- 172.21.15.8:0/1979264484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75181009f0 0x7f7518196690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.001+0000 7f751dd9a700 1 -- 172.21.15.8:0/1979264484 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75140095f0 con 0x7f7518101be0 2023-08-11T12:24:08.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.001+0000 7f751e59b700 1 --2- 172.21.15.8:0/1979264484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75181009f0 0x7f7518196690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:08.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.001+0000 7f751ed9c700 1 --2- 172.21.15.8:0/1979264484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7518102580 0x7f751819dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:24:08.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.002+0000 7f751dd9a700 1 --2- 172.21.15.8:0/1979264484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7518101be0 0x7f7518196bd0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f750800e9a0 tx=0x7f750800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:08.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.002+0000 7f750f7fe700 1 -- 172.21.15.8:0/1979264484 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7508009790 con 0x7f7518101be0 2023-08-11T12:24:08.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.002+0000 7f75207ff700 1 -- 172.21.15.8:0/1979264484 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f751819e7c0 con 0x7f7518101be0 2023-08-11T12:24:08.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.002+0000 7f750f7fe700 1 -- 172.21.15.8:0/1979264484 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f750800cbd0 con 0x7f7518101be0 2023-08-11T12:24:08.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.002+0000 7f750f7fe700 1 -- 172.21.15.8:0/1979264484 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7508018680 con 0x7f7518101be0 2023-08-11T12:24:08.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.002+0000 7f75207ff700 1 -- 172.21.15.8:0/1979264484 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f751819ecd0 con 0x7f7518101be0 2023-08-11T12:24:08.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.003+0000 7f75207ff700 1 -- 172.21.15.8:0/1979264484 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f751810c200 con 0x7f7518101be0 2023-08-11T12:24:08.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.005+0000 7f750f7fe700 1 -- 172.21.15.8:0/1979264484 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f750800cd40 con 0x7f7518101be0 2023-08-11T12:24:08.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.007+0000 7f750f7fe700 1 --2- 172.21.15.8:0/1979264484 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f750409ff50 0x7f75040a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.007+0000 7f750f7fe700 1 -- 172.21.15.8:0/1979264484 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f7508014070 con 0x7f7518101be0 2023-08-11T12:24:08.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.007+0000 7f751e59b700 1 --2- 172.21.15.8:0/1979264484 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f750409ff50 0x7f75040a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.008+0000 7f751e59b700 1 --2- 172.21.15.8:0/1979264484 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f750409ff50 0x7f75040a2410 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7514009fd0 tx=0x7f7514005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:08.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.010+0000 7f750f7fe700 1 -- 172.21.15.8:0/1979264484 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f7508051c30 con 0x7f7518101be0 2023-08-11T12:24:08.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:07 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/4116602356' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:24:08.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:07 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/879641608' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:24:08.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:07 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2838886668' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:24:08.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:07 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/4116602356' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:24:08.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:07 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/879641608' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:24:08.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:07 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2838886668' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:24:08.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:07 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/4116602356' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:24:08.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:07 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/879641608' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:24:08.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:07 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2838886668' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:24:08.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.224+0000 7f75207ff700 1 -- 172.21.15.8:0/1979264484 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f751810c410 con 0x7f7518101be0 2023-08-11T12:24:08.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.225+0000 7f750f7fe700 1 -- 172.21.15.8:0/1979264484 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24348 (secure 0 0 0) 0x7f7508095270 con 0x7f7518101be0 2023-08-11T12:24:08.228 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:08.228 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":89,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","created":"2023-08-11T12:14:28.341113+0000","modified":"2023-08-11T12:22:31.713248+0000","last_up_change":"2023-08-11T12:21:14.913735+0000","last_in_change":"2023-08-11T12:20:57.476558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-11T12:17:49.040758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-11T12:22:01.383296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-11T12:22:02.816329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-11T12:22:06.369375+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f903e393-7894-42d6-8b11-737ceef1f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6803","nonce":664104961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6805","nonce":664104961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6809","nonce":664104961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6807","nonce":664104961}]},"public_addr":"172.21.15.8:6803/664104961","cluster_addr":"172.21.15.8:6805/664104961","heartbeat_back_addr":"172.21.15.8:6809/664104961","heartbeat_front_addr":"172.21.15.8:6807/664104961","state":["exists","up"]},{"osd":1,"uuid":"1e988e5c-e78c-46d5-80a5-dff7ac38cbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6801","nonce":4187350703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6803","nonce":4187350703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6807","nonce":4187350703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6805","nonce":4187350703}]},"public_addr":"172.21.15.45:6801/4187350703","cluster_addr":"172.21.15.45:6803/4187350703","heartbeat_back_addr":"172.21.15.45:6807/4187350703","heartbeat_front_addr":"172.21.15.45:6805/4187350703","state":["exists","up"]},{"osd":2,"uuid":"1835217c-a93c-4181-b8b8-cc410bab1a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6801","nonce":2547818140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6803","nonce":2547818140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6807","nonce":2547818140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6805","nonce":2547818140}]},"public_addr":"172.21.15.194:6801/2547818140","cluster_addr":"172.21.15.194:6803/2547818140","heartbeat_back_addr":"172.21.15.194:6807/2547818140","heartbeat_front_addr":"172.21.15.194:6805/2547818140","state":["exists","up"]},{"osd":3,"uuid":"b55ae61a-731c-4312-a998-661122b84788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6811","nonce":187418883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6813","nonce":187418883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6817","nonce":187418883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6815","nonce":187418883}]},"public_addr":"172.21.15.8:6811/187418883","cluster_addr":"172.21.15.8:6813/187418883","heartbeat_back_addr":"172.21.15.8:6817/187418883","heartbeat_front_addr":"172.21.15.8:6815/187418883","state":["exists","up"]},{"osd":4,"uuid":"2c28acbb-e807-4559-8aa2-a35ca84b5d43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6809","nonce":3099704571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6811","nonce":3099704571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6815","nonce":3099704571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6813","nonce":3099704571}]},"public_addr":"172.21.15.45:6809/3099704571","cluster_addr":"172.21.15.45:6811/3099704571","heartbeat_back_addr":"172.21.15.45:6815/3099704571","heartbeat_front_addr":"172.21.15.45:6813/3099704571","state":["exists","up"]},{"osd":5,"uuid":"37032289-8016-4730-9b69-f7985e058ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6809","nonce":263803874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6811","nonce":263803874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6815","nonce":263803874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6813","nonce":263803874}]},"public_addr":"172.21.15.194:6809/263803874","cluster_addr":"172.21.15.194:6811/263803874","heartbeat_back_addr":"172.21.15.194:6815/263803874","heartbeat_front_addr":"172.21.15.194:6813/263803874","state":["exists","up"]},{"osd":6,"uuid":"32d2dab9-6944-40d1-ada9-4f941821b063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6819","nonce":1802966829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6821","nonce":1802966829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6825","nonce":1802966829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6823","nonce":1802966829}]},"public_addr":"172.21.15.8:6819/1802966829","cluster_addr":"172.21.15.8:6821/1802966829","heartbeat_back_addr":"172.21.15.8:6825/1802966829","heartbeat_front_addr":"172.21.15.8:6823/1802966829","state":["exists","up"]},{"osd":7,"uuid":"086aff58-1554-49fe-92ff-5166b115aeef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6817","nonce":3715737148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6819","nonce":3715737148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6823","nonce":3715737148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6821","nonce":3715737148}]},"public_addr":"172.21.15.45:6817/3715737148","cluster_addr":"172.21.15.45:6819/3715737148","heartbeat_back_addr":"172.21.15.45:6823/3715737148","heartbeat_front_addr":"172.21.15.45:6821/3715737148","state":["exists","up"]},{"osd":8,"uuid":"7fff5e95-2453-4ea6-a5c1-3bba6a1f6400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6817","nonce":57497127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6819","nonce":57497127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6823","nonce":57497127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6821","nonce":57497127}]},"public_addr":"172.21.15.194:6817/57497127","cluster_addr":"172.21.15.194:6819/57497127","heartbeat_back_addr":"172.21.15.194:6823/57497127","heartbeat_front_addr":"172.21.15.194:6821/57497127","state":["exists","up"]},{"osd":9,"uuid":"31ab0121-4c92-42ec-9f19-e672062e8814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6827","nonce":434661930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6829","nonce":434661930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6833","nonce":434661930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6831","nonce":434661930}]},"public_addr":"172.21.15.8:6827/434661930","cluster_addr":"172.21.15.8:6829/434661930","heartbeat_back_addr":"172.21.15.8:6833/434661930","heartbeat_front_addr":"172.21.15.8:6831/434661930","state":["exists","up"]},{"osd":10,"uuid":"62c632e4-94f6-4630-9d94-8d28fccacf45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6825","nonce":3281212184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6827","nonce":3281212184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6831","nonce":3281212184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6829","nonce":3281212184}]},"public_addr":"172.21.15.45:6825/3281212184","cluster_addr":"172.21.15.45:6827/3281212184","heartbeat_back_addr":"172.21.15.45:6831/3281212184","heartbeat_front_addr":"172.21.15.45:6829/3281212184","state":["exists","up"]},{"osd":11,"uuid":"8ca4a80d-cd75-4230-b46d-aef6fdc03e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6825","nonce":1637875895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6827","nonce":1637875895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6831","nonce":1637875895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6829","nonce":1637875895}]},"public_addr":"172.21.15.194:6825/1637875895","cluster_addr":"172.21.15.194:6827/1637875895","heartbeat_back_addr":"172.21.15.194:6831/1637875895","heartbeat_front_addr":"172.21.15.194:6829/1637875895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:04.255616+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:26.243863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:46.630365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:12.926291+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:35.747049+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:55.793767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:21.685725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:43.703215+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:04.043674+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:30.320026+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:52.751974+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:21:13.230024+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/2000592056":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2102228072":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2374527928":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2928221278":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2744750874":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/3681755887":"2023-08-12T12:15:02.528403+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-11T12:24:08.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.228+0000 7f75207ff700 1 -- 172.21.15.8:0/1979264484 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f750409ff50 msgr2=0x7f75040a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:08.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.228+0000 7f75207ff700 1 --2- 172.21.15.8:0/1979264484 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f750409ff50 0x7f75040a2410 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7514009fd0 tx=0x7f7514005fb0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.228+0000 7f75207ff700 1 -- 172.21.15.8:0/1979264484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7518101be0 msgr2=0x7f7518196bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:08.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.228+0000 7f75207ff700 1 --2- 172.21.15.8:0/1979264484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7518101be0 0x7f7518196bd0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f750800e9a0 tx=0x7f750800ecb0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.228+0000 7f75207ff700 1 -- 172.21.15.8:0/1979264484 shutdown_connections 2023-08-11T12:24:08.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.228+0000 7f75207ff700 1 --2- 172.21.15.8:0/1979264484 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f750409ff50 0x7f75040a2410 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.228+0000 7f75207ff700 1 --2- 172.21.15.8:0/1979264484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7518102580 0x7f751819dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.228+0000 7f75207ff700 1 --2- 172.21.15.8:0/1979264484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75181009f0 0x7f7518196690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.228+0000 7f75207ff700 1 --2- 172.21.15.8:0/1979264484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7518101be0 0x7f7518196bd0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.228+0000 7f75207ff700 1 -- 172.21.15.8:0/1979264484 >> 172.21.15.8:0/1979264484 conn(0x7f75180fbf80 msgr2=0x7f75180fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:08.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.228+0000 7f75207ff700 1 -- 172.21.15.8:0/1979264484 shutdown_connections 2023-08-11T12:24:08.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.228+0000 7f75207ff700 1 -- 172.21.15.8:0/1979264484 wait complete. 2023-08-11T12:24:08.251 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-08-11T12:22:03.398475+0000', 'modified': '2023-08-11T12:22:32.690553+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24575, 'mds_1': 24550, 'mds_2': 24517, 'mds_3': 24500, 'mds_4': 24464}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14526': {'gid': 14526, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.8:6839/2990530720', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6838', 'nonce': 2990530720}, {'type': 'v1', 'addr': '172.21.15.8:6839', 'nonce': 2990530720}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14538': {'gid': 14538, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.8:6841/3589272762', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6840', 'nonce': 3589272762}, {'type': 'v1', 'addr': '172.21.15.8:6841', 'nonce': 3589272762}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24457': {'gid': 24457, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.194:6833/2043443402', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6832', 'nonce': 2043443402}, {'type': 'v1', 'addr': '172.21.15.194:6833', 'nonce': 2043443402}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24464': {'gid': 24464, 'name': 'k', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.45:6833/1208864615', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6832', 'nonce': 1208864615}, {'type': 'v1', 'addr': '172.21.15.45:6833', 'nonce': 1208864615}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24500': {'gid': 24500, 'name': 'e', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.45:6835/1776075470', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6834', 'nonce': 1776075470}, {'type': 'v1', 'addr': '172.21.15.45:6835', 'nonce': 1776075470}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24517': {'gid': 24517, 'name': 'f', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.194:6835/2457430285', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6834', 'nonce': 2457430285}, {'type': 'v1', 'addr': '172.21.15.194:6835', 'nonce': 2457430285}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24529': {'gid': 24529, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.194:6837/3072808560', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6836', 'nonce': 3072808560}, {'type': 'v1', 'addr': '172.21.15.194:6837', 'nonce': 3072808560}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24533': {'gid': 24533, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.45:6837/641549061', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6836', 'nonce': 641549061}, {'type': 'v1', 'addr': '172.21.15.45:6837', 'nonce': 641549061}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24550': {'gid': 24550, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.194:6839/2174476491', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6838', 'nonce': 2174476491}, {'type': 'v1', 'addr': '172.21.15.194:6839', 'nonce': 2174476491}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24575': {'gid': 24575, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6839/119684732', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6838', 'nonce': 119684732}, {'type': 'v1', 'addr': '172.21.15.45:6839', 'nonce': 119684732}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-11T12:24:08.251 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-08-11T12:24:08.252 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.k status 2023-08-11T12:24:08.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.455+0000 7f09a2dff700 1 -- 172.21.15.8:0/1305137695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f099c100a00 msgr2=0x7f099c100e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:08.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.455+0000 7f09a2dff700 1 --2- 172.21.15.8:0/1305137695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f099c100a00 0x7f099c100e20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f09900098f0 tx=0x7f0990009c00 comp rx=0 tx=0).stop 2023-08-11T12:24:08.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.455+0000 7f09a2dff700 1 -- 172.21.15.8:0/1305137695 shutdown_connections 2023-08-11T12:24:08.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.455+0000 7f09a2dff700 1 --2- 172.21.15.8:0/1305137695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f099c100a00 0x7f099c100e20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.455+0000 7f09a2dff700 1 --2- 172.21.15.8:0/1305137695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f099c102590 0x7f099c108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.455+0000 7f09a2dff700 1 --2- 172.21.15.8:0/1305137695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f099c101bf0 0x7f099c102050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.455+0000 7f09a2dff700 1 -- 172.21.15.8:0/1305137695 >> 172.21.15.8:0/1305137695 conn(0x7f099c0fbf70 msgr2=0x7f099c0fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:08.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.455+0000 7f09a2dff700 1 -- 172.21.15.8:0/1305137695 shutdown_connections 2023-08-11T12:24:08.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.455+0000 7f09a2dff700 1 -- 172.21.15.8:0/1305137695 wait complete. 2023-08-11T12:24:08.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.456+0000 7f09a2dff700 1 Processor -- start 2023-08-11T12:24:08.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.456+0000 7f09a2dff700 1 -- start start 2023-08-11T12:24:08.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.457+0000 7f09a2dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f099c100a00 0x7f099c198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.457+0000 7f09a2dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f099c101bf0 0x7f099c198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.457+0000 7f09a2dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f099c102590 0x7f099c19fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.457+0000 7f09a2dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099c1a04a0 con 0x7f099c100a00 2023-08-11T12:24:08.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.457+0000 7f09a2dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099c1a05e0 con 0x7f099c102590 2023-08-11T12:24:08.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.457+0000 7f09a2dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099c1a0770 con 0x7f099c101bf0 2023-08-11T12:24:08.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.457+0000 7f09a0b9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f099c100a00 0x7f099c198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.457+0000 7f09a0b9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f099c100a00 0x7f099c198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39384/0 (socket says 172.21.15.8:39384) 2023-08-11T12:24:08.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.457+0000 7f09a0b9b700 1 -- 172.21.15.8:0/3686131669 learned_addr learned my addr 172.21.15.8:0/3686131669 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:08.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.457+0000 7f099bfff700 1 --2- 172.21.15.8:0/3686131669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f099c101bf0 0x7f099c198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.457+0000 7f09a139c700 1 --2- 172.21.15.8:0/3686131669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f099c102590 0x7f099c19fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.457+0000 7f09a0b9b700 1 -- 172.21.15.8:0/3686131669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f099c101bf0 msgr2=0x7f099c198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:08.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.457+0000 7f09a0b9b700 1 --2- 172.21.15.8:0/3686131669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f099c101bf0 0x7f099c198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.457+0000 7f09a0b9b700 1 -- 172.21.15.8:0/3686131669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f099c102590 msgr2=0x7f099c19fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:08.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.457+0000 7f09a0b9b700 1 --2- 172.21.15.8:0/3686131669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f099c102590 0x7f099c19fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.457+0000 7f09a0b9b700 1 -- 172.21.15.8:0/3686131669 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09880095f0 con 0x7f099c100a00 2023-08-11T12:24:08.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.457+0000 7f09a139c700 1 --2- 172.21.15.8:0/3686131669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f099c102590 0x7f099c19fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:24:08.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.458+0000 7f09a0b9b700 1 --2- 172.21.15.8:0/3686131669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f099c100a00 0x7f099c198920 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0990000c00 tx=0x7f099000b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:08.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.458+0000 7f0999ffb700 1 -- 172.21.15.8:0/3686131669 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099001c070 con 0x7f099c100a00 2023-08-11T12:24:08.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.458+0000 7f09a2dff700 1 -- 172.21.15.8:0/3686131669 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0994009c40 con 0x7f099c100a00 2023-08-11T12:24:08.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.458+0000 7f0999ffb700 1 -- 172.21.15.8:0/3686131669 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0990005040 con 0x7f099c100a00 2023-08-11T12:24:08.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.458+0000 7f0999ffb700 1 -- 172.21.15.8:0/3686131669 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0990003a60 con 0x7f099c100a00 2023-08-11T12:24:08.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.458+0000 7f09a2dff700 1 -- 172.21.15.8:0/3686131669 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0990009520 con 0x7f099c100a00 2023-08-11T12:24:08.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.461+0000 7f0999ffb700 1 -- 172.21.15.8:0/3686131669 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f0990020030 con 0x7f099c100a00 2023-08-11T12:24:08.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.462+0000 7f09b6766b80 1 Processor -- start 2023-08-11T12:24:08.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.462+0000 7f09b6766b80 1 -- start start 2023-08-11T12:24:08.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.462+0000 7f0999ffb700 1 --2- 172.21.15.8:0/3686131669 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f098c09ff50 0x7f098c0a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.463+0000 7f0999ffb700 1 -- 172.21.15.8:0/3686131669 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f09900cc5c0 con 0x7f099c100a00 2023-08-11T12:24:08.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.463+0000 7f09b6766b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563becc79a80 0x563becc79ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.463+0000 7f09b6766b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563becc7a3e0 0x563becc7a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.463+0000 7f09b6766b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563becc7ada0 0x563becc7b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.463+0000 7f09b6766b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563becbd25e0 con 0x563becc7ada0 2023-08-11T12:24:08.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.463+0000 7f09b6766b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563becbcff00 con 0x563becc7a3e0 2023-08-11T12:24:08.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.463+0000 7f09b6766b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x563becbcb7f0 con 0x563becc79a80 2023-08-11T12:24:08.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.463+0000 7f09a139c700 1 --2- 172.21.15.8:0/3686131669 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f098c09ff50 0x7f098c0a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.463+0000 7f099bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563becc7a3e0 0x563becc7a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.463+0000 7f09a139c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563becc7ada0 0x563becc7b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.463+0000 7f09a0b9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563becc79a80 0x563becc79ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.463+0000 7f099bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563becc7a3e0 0x563becc7a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:34464/0 (socket says 172.21.15.8:34464) 2023-08-11T12:24:08.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.463+0000 7f099bfff700 1 -- 172.21.15.8:0/2199342604 learned_addr learned my addr 172.21.15.8:0/2199342604 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:08.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.464+0000 7f099bfff700 1 -- 172.21.15.8:0/2199342604 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563becc79a80 msgr2=0x563becc79ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:08.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.464+0000 7f099bfff700 1 --2- 172.21.15.8:0/2199342604 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563becc79a80 0x563becc79ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.464+0000 7f099bfff700 1 -- 172.21.15.8:0/2199342604 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563becc7ada0 msgr2=0x563becc7b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:08.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.464+0000 7f099bfff700 1 --2- 172.21.15.8:0/2199342604 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563becc7ada0 0x563becc7b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.464+0000 7f099bfff700 1 -- 172.21.15.8:0/2199342604 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563beca4b5e0 con 0x563becc7a3e0 2023-08-11T12:24:08.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.464+0000 7f099bfff700 1 --2- 172.21.15.8:0/2199342604 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563becc7a3e0 0x563becc7a860 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0988009fc0 tx=0x7f0988011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f47a378e35c5c79a server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:08.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.464+0000 7f09a139c700 1 --2- 172.21.15.8:0/3686131669 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f098c09ff50 0x7f098c0a2410 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0994009fd0 tx=0x7f0994009480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:08.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.464+0000 7f0986ffd700 1 -- 172.21.15.8:0/2199342604 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098800e670 con 0x563becc7a3e0 2023-08-11T12:24:08.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.464+0000 7f0986ffd700 1 -- 172.21.15.8:0/2199342604 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f098800ec90 con 0x563becc7a3e0 2023-08-11T12:24:08.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.464+0000 7f0986ffd700 1 -- 172.21.15.8:0/2199342604 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0988019c30 con 0x563becc7a3e0 2023-08-11T12:24:08.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.465+0000 7f09b6766b80 1 -- 172.21.15.8:0/2199342604 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563becc7a3e0 msgr2=0x563becc7a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:08.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.465+0000 7f09b6766b80 1 --2- 172.21.15.8:0/2199342604 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563becc7a3e0 0x563becc7a860 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0988009fc0 tx=0x7f0988011720 comp rx=0 tx=0).stop 2023-08-11T12:24:08.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.465+0000 7f09b6766b80 1 -- 172.21.15.8:0/2199342604 shutdown_connections 2023-08-11T12:24:08.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.465+0000 7f09b6766b80 1 --2- 172.21.15.8:0/2199342604 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563becc79a80 0x563becc79ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.465+0000 7f09b6766b80 1 --2- 172.21.15.8:0/2199342604 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563becc7ada0 0x563becc7b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.465+0000 7f09b6766b80 1 --2- 172.21.15.8:0/2199342604 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563becc7a3e0 0x563becc7a860 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.465+0000 7f09b6766b80 1 -- 172.21.15.8:0/2199342604 >> 172.21.15.8:0/2199342604 conn(0x563becba6900 msgr2=0x563becc743d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:08.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.465+0000 7f09b6766b80 1 -- 172.21.15.8:0/2199342604 shutdown_connections 2023-08-11T12:24:08.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.465+0000 7f09b6766b80 1 -- 172.21.15.8:0/2199342604 wait complete. 2023-08-11T12:24:08.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.466+0000 7f09b6766b80 1 -- start start 2023-08-11T12:24:08.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.466+0000 7f09b6766b80 1 Processor -- start 2023-08-11T12:24:08.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.466+0000 7f09b6766b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563becc79a80 0x563becc83100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.466+0000 7f09b6766b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563becc7a3e0 0x563becc83640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.466+0000 7f09b6766b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563becc7ada0 0x563becc8a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.466+0000 7f09b6766b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563becb69a70 con 0x563becc7a3e0 2023-08-11T12:24:08.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.466+0000 7f09b6766b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563becb69770 con 0x563becc79a80 2023-08-11T12:24:08.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.466+0000 7f09b6766b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x563beca4d8d0 con 0x563becc7ada0 2023-08-11T12:24:08.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.467+0000 7f09b6766b80 10 client.0 _ll_register_callbacks cb 0x563becb6ca60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:08.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.467+0000 7f099bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563becc7a3e0 0x563becc83640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.467+0000 7f09a139c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563becc7ada0 0x563becc8a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.467+0000 7f099bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563becc7a3e0 0x563becc83640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39392/0 (socket says 172.21.15.8:39392) 2023-08-11T12:24:08.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.467+0000 7f099bfff700 1 -- 172.21.15.8:0/1338840357 learned_addr learned my addr 172.21.15.8:0/1338840357 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:08.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.467+0000 7f09a0b9b700 1 --2- 172.21.15.8:0/1338840357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563becc79a80 0x563becc83100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.467+0000 7f099bfff700 1 -- 172.21.15.8:0/1338840357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563becc7ada0 msgr2=0x563becc8a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:08.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.467+0000 7f099bfff700 1 --2- 172.21.15.8:0/1338840357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563becc7ada0 0x563becc8a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.467+0000 7f099bfff700 1 -- 172.21.15.8:0/1338840357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563becc79a80 msgr2=0x563becc83100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:08.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.467+0000 7f099bfff700 1 --2- 172.21.15.8:0/1338840357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563becc79a80 0x563becc83100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.467+0000 7f099bfff700 1 -- 172.21.15.8:0/1338840357 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0988009c20 con 0x563becc7a3e0 2023-08-11T12:24:08.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.467+0000 7f09a0b9b700 1 --2- 172.21.15.8:0/1338840357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563becc79a80 0x563becc83100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:08.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.467+0000 7f099bfff700 1 --2- 172.21.15.8:0/1338840357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563becc7a3e0 0x563becc83640 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f098801c040 tx=0x7f098801abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f292ebe64d32ef16 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:08.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.467+0000 7f097bfff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:24:08.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.468+0000 7f097bfff700 1 -- 172.21.15.8:0/1338840357 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098801ae90 con 0x563becc7a3e0 2023-08-11T12:24:08.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.468+0000 7f09b6766b80 1 -- 172.21.15.8:0/1338840357 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563becc6ca40 con 0x563becc7a3e0 2023-08-11T12:24:08.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.468+0000 7f097bfff700 1 -- 172.21.15.8:0/1338840357 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f098800ee00 con 0x563becc7a3e0 2023-08-11T12:24:08.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.468+0000 7f097bfff700 1 -- 172.21.15.8:0/1338840357 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f098800e680 con 0x563becc7a3e0 2023-08-11T12:24:08.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.468+0000 7f09b6766b80 10 client.15315 fetch_fsmap learned FSMap version 27 2023-08-11T12:24:08.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.468+0000 7f09b6766b80 1 -- 172.21.15.8:0/1338840357 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x563bec9f7d90 con 0x563becc7a3e0 2023-08-11T12:24:08.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.468+0000 7f097bfff700 1 -- 172.21.15.8:0/1338840357 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563becc6ca40 con 0x563becc7a3e0 2023-08-11T12:24:08.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.468+0000 7f097bfff700 1 -- 172.21.15.8:0/1338840357 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f09880047e0 con 0x563becc7a3e0 2023-08-11T12:24:08.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.469+0000 7f09b6766b80 10 client.15315 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:24:08.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.469+0000 7f09b6766b80 10 client.15315 resolve_mds: resolved name 'k' to daemon mds.k 2023-08-11T12:24:08.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.469+0000 7f09b6766b80 20 client.15315 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:08.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.469+0000 7f09b6766b80 1 --2- 172.21.15.8:0/1338840357 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x563becc8ec10 0x563becc8d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.469+0000 7f09b6766b80 4 client.15315 mds_command: new command op to 24464 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:24:08.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.469+0000 7f09b6766b80 1 -- 172.21.15.8:0/1338840357 --> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563becc48490 con 0x563becc8ec10 2023-08-11T12:24:08.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.469+0000 7f09a0b9b700 1 --2- 172.21.15.8:0/1338840357 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x563becc8ec10 0x563becc8d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.470+0000 7f097bfff700 10 client.15315 ms_handle_connect on v2:172.21.15.45:6832/1208864615 2023-08-11T12:24:08.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.470+0000 7f09a0b9b700 1 --2- 172.21.15.8:0/1338840357 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x563becc8ec10 0x563becc8d6d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c93fcb7b51942179 server_cookie=db2e51ea8f521e99 in_seq=0 out_seq=0 2023-08-11T12:24:08.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.470+0000 7f097bfff700 1 -- 172.21.15.8:0/1338840357 <== mds.4 v2:172.21.15.45:6832/1208864615 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x563becc48490 con 0x563becc8ec10 2023-08-11T12:24:08.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.470+0000 7f097bfff700 10 client.15315 handle_command_reply: tid=0 2023-08-11T12:24:08.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.470+0000 7f09b6766b80 1 client.15315 shutdown 2023-08-11T12:24:08.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.471+0000 7f09b6766b80 1 -- 172.21.15.8:0/1338840357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563becc7a3e0 msgr2=0x563becc83640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:08.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.471+0000 7f09b6766b80 1 --2- 172.21.15.8:0/1338840357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563becc7a3e0 0x563becc83640 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f098801c040 tx=0x7f098801abf0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.471+0000 7f09b6766b80 1 -- 172.21.15.8:0/1338840357 shutdown_connections 2023-08-11T12:24:08.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.471+0000 7f09b6766b80 1 --2- 172.21.15.8:0/1338840357 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x563becc8ec10 0x563becc8d6d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.471+0000 7f09b6766b80 1 --2- 172.21.15.8:0/1338840357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563becc7ada0 0x563becc8a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.471+0000 7f09b6766b80 1 --2- 172.21.15.8:0/1338840357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563becc79a80 0x563becc83100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.471+0000 7f09b6766b80 1 --2- 172.21.15.8:0/1338840357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563becc7a3e0 0x563becc83640 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.471+0000 7f097bfff700 0 client.15315 ms_handle_reset on v2:172.21.15.45:6832/1208864615 2023-08-11T12:24:08.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.471+0000 7f09b6766b80 1 -- 172.21.15.8:0/1338840357 >> 172.21.15.8:0/1338840357 conn(0x563becba6900 msgr2=0x563becc6ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:08.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.471+0000 7f09b6766b80 1 -- 172.21.15.8:0/1338840357 shutdown_connections 2023-08-11T12:24:08.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.471+0000 7f09b6766b80 1 -- 172.21.15.8:0/1338840357 wait complete. 2023-08-11T12:24:08.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.471+0000 7f09b6766b80 20 client.15315 trim_cache size 0 max 16384 2023-08-11T12:24:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.489+0000 7f09b6766b80 1 Processor -- start 2023-08-11T12:24:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.490+0000 7f09b6766b80 1 -- start start 2023-08-11T12:24:08.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.490+0000 7f09b6766b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563becc79a80 0x563becc7dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.490+0000 7f09b6766b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563becc7a3e0 0x563becc8a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.490+0000 7f09b6766b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563becc7ada0 0x563becc7e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.490+0000 7f09b6766b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563becb94ef0 con 0x563becc79a80 2023-08-11T12:24:08.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.490+0000 7f09b6766b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563becb88480 con 0x563becc7ada0 2023-08-11T12:24:08.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.490+0000 7f09b6766b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x563becb95c30 con 0x563becc7a3e0 2023-08-11T12:24:08.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.490+0000 7f09a0b9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563becc79a80 0x563becc7dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.490+0000 7f09a0b9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563becc79a80 0x563becc7dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39404/0 (socket says 172.21.15.8:39404) 2023-08-11T12:24:08.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.490+0000 7f09a0b9b700 1 -- 172.21.15.8:0/3212268579 learned_addr learned my addr 172.21.15.8:0/3212268579 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:08.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.490+0000 7f09a139c700 1 --2- 172.21.15.8:0/3212268579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563becc7ada0 0x563becc7e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.490+0000 7f099bfff700 1 --2- 172.21.15.8:0/3212268579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563becc7a3e0 0x563becc8a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.491+0000 7f09a0b9b700 1 -- 172.21.15.8:0/3212268579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563becc7a3e0 msgr2=0x563becc8a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:08.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.491+0000 7f09a0b9b700 1 --2- 172.21.15.8:0/3212268579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563becc7a3e0 0x563becc8a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.491+0000 7f09a0b9b700 1 -- 172.21.15.8:0/3212268579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563becc7ada0 msgr2=0x563becc7e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:08.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.491+0000 7f09a0b9b700 1 --2- 172.21.15.8:0/3212268579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563becc7ada0 0x563becc7e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.491+0000 7f09a0b9b700 1 -- 172.21.15.8:0/3212268579 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563bec9e0c10 con 0x563becc79a80 2023-08-11T12:24:08.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.491+0000 7f09a139c700 1 --2- 172.21.15.8:0/3212268579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563becc7ada0 0x563becc7e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:24:08.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.491+0000 7f09a0b9b700 1 --2- 172.21.15.8:0/3212268579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563becc79a80 0x563becc7dc60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0990009340 tx=0x7f099009c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe32b7756e8dff58 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:08.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.491+0000 7f09877fe700 1 -- 172.21.15.8:0/3212268579 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099009db60 con 0x563becc79a80 2023-08-11T12:24:08.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.491+0000 7f09877fe700 1 -- 172.21.15.8:0/3212268579 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f09900a1ab0 con 0x563becc79a80 2023-08-11T12:24:08.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.491+0000 7f09877fe700 1 -- 172.21.15.8:0/3212268579 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09900051b0 con 0x563becc79a80 2023-08-11T12:24:08.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.492+0000 7f09b6766b80 1 -- 172.21.15.8:0/3212268579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563becc79a80 msgr2=0x563becc7dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:08.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.492+0000 7f09b6766b80 1 --2- 172.21.15.8:0/3212268579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563becc79a80 0x563becc7dc60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0990009340 tx=0x7f099009c040 comp rx=0 tx=0).stop 2023-08-11T12:24:08.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.492+0000 7f09b6766b80 1 -- 172.21.15.8:0/3212268579 shutdown_connections 2023-08-11T12:24:08.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.492+0000 7f09b6766b80 1 --2- 172.21.15.8:0/3212268579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563becc7ada0 0x563becc7e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.492+0000 7f09b6766b80 1 --2- 172.21.15.8:0/3212268579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563becc79a80 0x563becc7dc60 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.492+0000 7f09b6766b80 1 --2- 172.21.15.8:0/3212268579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563becc7a3e0 0x563becc8a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.492+0000 7f09b6766b80 1 -- 172.21.15.8:0/3212268579 >> 172.21.15.8:0/3212268579 conn(0x563becba6900 msgr2=0x563becc81eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:08.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.492+0000 7f09b6766b80 1 -- 172.21.15.8:0/3212268579 shutdown_connections 2023-08-11T12:24:08.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.492+0000 7f09b6766b80 1 -- 172.21.15.8:0/3212268579 wait complete. 2023-08-11T12:24:08.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.492+0000 7f09b6766b80 1 -- start start 2023-08-11T12:24:08.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.492+0000 7f09b6766b80 1 Processor -- start 2023-08-11T12:24:08.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.493+0000 7f09b6766b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563becc79a80 0x563becc6e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.493+0000 7f09b6766b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563becc7a3e0 0x563becc6eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.493+0000 7f09b6766b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563becc7ada0 0x563becc89d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.493+0000 7f09b6766b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563becc8a280 con 0x563becc7ada0 2023-08-11T12:24:08.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.493+0000 7f09b6766b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563becc8a3f0 con 0x563becc7a3e0 2023-08-11T12:24:08.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.493+0000 7f09b6766b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x563becc8a5b0 con 0x563becc79a80 2023-08-11T12:24:08.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.493+0000 7f09b6766b80 10 client.0 _ll_register_callbacks cb 0x7f09940079e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:08.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.493+0000 7f09a139c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563becc7ada0 0x563becc89d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.493+0000 7f09a139c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563becc7ada0 0x563becc89d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39410/0 (socket says 172.21.15.8:39410) 2023-08-11T12:24:08.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.493+0000 7f09a0b9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563becc79a80 0x563becc6e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.493+0000 7f09a139c700 1 -- 172.21.15.8:0/2279430944 learned_addr learned my addr 172.21.15.8:0/2279430944 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:08.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.493+0000 7f099bfff700 1 --2- 172.21.15.8:0/2279430944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563becc7a3e0 0x563becc6eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.494+0000 7f09a139c700 1 -- 172.21.15.8:0/2279430944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563becc79a80 msgr2=0x563becc6e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:08.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.494+0000 7f09a139c700 1 --2- 172.21.15.8:0/2279430944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563becc79a80 0x563becc6e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.494+0000 7f09a139c700 1 -- 172.21.15.8:0/2279430944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563becc7a3e0 msgr2=0x563becc6eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:08.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.494+0000 7f09a139c700 1 --2- 172.21.15.8:0/2279430944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563becc7a3e0 0x563becc6eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.494+0000 7f09a139c700 1 -- 172.21.15.8:0/2279430944 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0990009520 con 0x563becc7ada0 2023-08-11T12:24:08.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.494+0000 7f099bfff700 1 --2- 172.21.15.8:0/2279430944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563becc7a3e0 0x563becc6eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:08.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.494+0000 7f09a139c700 1 --2- 172.21.15.8:0/2279430944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563becc7ada0 0x563becc89d40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f099401b730 tx=0x7f0994004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f225025eeeed16fa server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:08.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.494+0000 7f097bfff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:24:08.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.494+0000 7f097bfff700 1 -- 172.21.15.8:0/2279430944 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0994007760 con 0x563becc7ada0 2023-08-11T12:24:08.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.494+0000 7f09b6766b80 1 -- 172.21.15.8:0/2279430944 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f098800ec90 con 0x563becc7ada0 2023-08-11T12:24:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.494+0000 7f097bfff700 1 -- 172.21.15.8:0/2279430944 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f0994021040 con 0x563becc7ada0 2023-08-11T12:24:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.494+0000 7f097bfff700 1 -- 172.21.15.8:0/2279430944 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0994027680 con 0x563becc7ada0 2023-08-11T12:24:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.494+0000 7f09b6766b80 10 client.15321 fetch_fsmap learned FSMap version 27 2023-08-11T12:24:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.494+0000 7f09b6766b80 1 -- 172.21.15.8:0/2279430944 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x563beca1e200 con 0x563becc7ada0 2023-08-11T12:24:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.495+0000 7f097bfff700 1 -- 172.21.15.8:0/2279430944 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f098800ec90 con 0x563becc7ada0 2023-08-11T12:24:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.495+0000 7f097bfff700 1 -- 172.21.15.8:0/2279430944 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f099401a640 con 0x563becc7ada0 2023-08-11T12:24:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.495+0000 7f09b6766b80 10 client.15321 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:24:08.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.495+0000 7f09b6766b80 10 client.15321 resolve_mds: resolved name 'k' to daemon mds.k 2023-08-11T12:24:08.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.495+0000 7f09b6766b80 20 client.15321 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:08.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.495+0000 7f09b6766b80 1 --2- 172.21.15.8:0/2279430944 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x563becce70e0 0x563becce3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.495+0000 7f09b6766b80 4 client.15321 mds_command: new command op to 24464 tid=0[{"prefix": "status"}] 2023-08-11T12:24:08.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.495+0000 7f09b6766b80 1 -- 172.21.15.8:0/2279430944 --> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563becbc47d0 con 0x563becce70e0 2023-08-11T12:24:08.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.495+0000 7f09a0b9b700 1 --2- 172.21.15.8:0/2279430944 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x563becce70e0 0x563becce3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.496+0000 7f097bfff700 10 client.15321 ms_handle_connect on v2:172.21.15.45:6832/1208864615 2023-08-11T12:24:08.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.496+0000 7f09a0b9b700 1 --2- 172.21.15.8:0/2279430944 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x563becce70e0 0x563becce3580 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9e5d4ce185520bab server_cookie=f1221fa42a11dae2 in_seq=0 out_seq=0 2023-08-11T12:24:08.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.496+0000 7f097bfff700 1 -- 172.21.15.8:0/2279430944 <== mds.4 v2:172.21.15.45:6832/1208864615 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x563becbc47d0 con 0x563becce70e0 2023-08-11T12:24:08.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.496+0000 7f097bfff700 10 client.15321 handle_command_reply: tid=0 2023-08-11T12:24:08.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.496+0000 7f09b6766b80 1 client.15321 shutdown 2023-08-11T12:24:08.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.496+0000 7f09b6766b80 1 -- 172.21.15.8:0/2279430944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563becc7ada0 msgr2=0x563becc89d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:08.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.496+0000 7f09b6766b80 1 --2- 172.21.15.8:0/2279430944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563becc7ada0 0x563becc89d40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f099401b730 tx=0x7f0994004b40 comp rx=0 tx=0).stop 2023-08-11T12:24:08.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.496+0000 7f09b6766b80 1 -- 172.21.15.8:0/2279430944 shutdown_connections 2023-08-11T12:24:08.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.496+0000 7f09b6766b80 1 --2- 172.21.15.8:0/2279430944 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x563becce70e0 0x563becce3580 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.497+0000 7f09b6766b80 1 --2- 172.21.15.8:0/2279430944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563becc79a80 0x563becc6e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.497+0000 7f09b6766b80 1 --2- 172.21.15.8:0/2279430944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563becc7ada0 0x563becc89d40 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.497+0000 7f09b6766b80 1 --2- 172.21.15.8:0/2279430944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563becc7a3e0 0x563becc6eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.497+0000 7f09b6766b80 1 -- 172.21.15.8:0/2279430944 >> 172.21.15.8:0/2279430944 conn(0x563becba6900 msgr2=0x563becc7dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:08.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.497+0000 7f097bfff700 0 client.15321 ms_handle_reset on v2:172.21.15.45:6832/1208864615 2023-08-11T12:24:08.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.497+0000 7f09b6766b80 1 -- 172.21.15.8:0/2279430944 shutdown_connections 2023-08-11T12:24:08.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.497+0000 7f09b6766b80 1 -- 172.21.15.8:0/2279430944 wait complete. 2023-08-11T12:24:08.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.497+0000 7f09b6766b80 20 client.15321 trim_cache size 0 max 16384 2023-08-11T12:24:08.508 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:24:08.508 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "815f94ae-3840-11ee-9b37-001a4aab830c", 2023-08-11T12:24:08.508 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 4, 2023-08-11T12:24:08.508 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24464, 2023-08-11T12:24:08.509 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-08-11T12:24:08.509 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-08-11T12:24:08.509 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-08-11T12:24:08.509 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 96.810014612000003, 2023-08-11T12:24:08.509 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 27, 2023-08-11T12:24:08.509 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 89, 2023-08-11T12:24:08.509 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 89, 2023-08-11T12:24:08.510 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 157.301705728 2023-08-11T12:24:08.510 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:24:08.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.497+0000 7f09a2dff700 1 -- 172.21.15.8:0/3686131669 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f098c09ff50 msgr2=0x7f098c0a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:08.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.497+0000 7f09a2dff700 1 --2- 172.21.15.8:0/3686131669 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f098c09ff50 0x7f098c0a2410 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0994009fd0 tx=0x7f0994009480 comp rx=0 tx=0).stop 2023-08-11T12:24:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.497+0000 7f09a2dff700 1 -- 172.21.15.8:0/3686131669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f099c100a00 msgr2=0x7f099c198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.497+0000 7f09a2dff700 1 --2- 172.21.15.8:0/3686131669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f099c100a00 0x7f099c198920 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0990000c00 tx=0x7f099000b560 comp rx=0 tx=0).stop 2023-08-11T12:24:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.497+0000 7f09a2dff700 1 -- 172.21.15.8:0/3686131669 shutdown_connections 2023-08-11T12:24:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.497+0000 7f09a2dff700 1 --2- 172.21.15.8:0/3686131669 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f098c09ff50 0x7f098c0a2410 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.497+0000 7f09a2dff700 1 --2- 172.21.15.8:0/3686131669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f099c102590 0x7f099c19fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.497+0000 7f09a2dff700 1 --2- 172.21.15.8:0/3686131669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f099c100a00 0x7f099c198920 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.497+0000 7f09a2dff700 1 --2- 172.21.15.8:0/3686131669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f099c101bf0 0x7f099c198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.497+0000 7f09a2dff700 1 -- 172.21.15.8:0/3686131669 >> 172.21.15.8:0/3686131669 conn(0x7f099c0fbf70 msgr2=0x7f099c107570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:08.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.498+0000 7f09a2dff700 1 -- 172.21.15.8:0/3686131669 shutdown_connections 2023-08-11T12:24:08.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.498+0000 7f09a2dff700 1 -- 172.21.15.8:0/3686131669 wait complete. 2023-08-11T12:24:08.517 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-08-11T12:24:08.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.720+0000 7f49697ff700 1 -- 172.21.15.8:0/447379890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4964101c00 msgr2=0x7f4964102060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:08.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.720+0000 7f49697ff700 1 --2- 172.21.15.8:0/447379890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4964101c00 0x7f4964102060 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f494c0099c0 tx=0x7f494c009cd0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.720+0000 7f49697ff700 1 -- 172.21.15.8:0/447379890 shutdown_connections 2023-08-11T12:24:08.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.720+0000 7f49697ff700 1 --2- 172.21.15.8:0/447379890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49641025a0 0x7f4964108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.720+0000 7f49697ff700 1 --2- 172.21.15.8:0/447379890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4964100a10 0x7f4964100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.720+0000 7f49697ff700 1 --2- 172.21.15.8:0/447379890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4964101c00 0x7f4964102060 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.720+0000 7f49697ff700 1 -- 172.21.15.8:0/447379890 >> 172.21.15.8:0/447379890 conn(0x7f49640fbf80 msgr2=0x7f49640fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:08.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.720+0000 7f49697ff700 1 -- 172.21.15.8:0/447379890 shutdown_connections 2023-08-11T12:24:08.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.720+0000 7f49697ff700 1 -- 172.21.15.8:0/447379890 wait complete. 2023-08-11T12:24:08.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.721+0000 7f49697ff700 1 Processor -- start 2023-08-11T12:24:08.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.721+0000 7f49697ff700 1 -- start start 2023-08-11T12:24:08.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.722+0000 7f49697ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4964100a10 0x7f49641988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.722+0000 7f49697ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4964101c00 0x7f4964198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.722+0000 7f49697ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49641025a0 0x7f496419fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.722+0000 7f49697ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49641a0470 con 0x7f4964100a10 2023-08-11T12:24:08.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.722+0000 7f49697ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49641a05b0 con 0x7f4964101c00 2023-08-11T12:24:08.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.722+0000 7f49697ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49641a0740 con 0x7f49641025a0 2023-08-11T12:24:08.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.722+0000 7f4962ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4964100a10 0x7f49641988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.722+0000 7f4962ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4964100a10 0x7f49641988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39416/0 (socket says 172.21.15.8:39416) 2023-08-11T12:24:08.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.722+0000 7f4962ffd700 1 -- 172.21.15.8:0/796663407 learned_addr learned my addr 172.21.15.8:0/796663407 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:08.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.722+0000 7f495bfff700 1 --2- 172.21.15.8:0/796663407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4964101c00 0x7f4964198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.722+0000 7f49637fe700 1 --2- 172.21.15.8:0/796663407 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49641025a0 0x7f496419fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.722+0000 7f4962ffd700 1 -- 172.21.15.8:0/796663407 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49641025a0 msgr2=0x7f496419fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:08.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.722+0000 7f4962ffd700 1 --2- 172.21.15.8:0/796663407 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49641025a0 0x7f496419fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.722+0000 7f4962ffd700 1 -- 172.21.15.8:0/796663407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4964101c00 msgr2=0x7f4964198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:08.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.722+0000 7f4962ffd700 1 --2- 172.21.15.8:0/796663407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4964101c00 0x7f4964198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.722+0000 7f4962ffd700 1 -- 172.21.15.8:0/796663407 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494c0095f0 con 0x7f4964100a10 2023-08-11T12:24:08.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.723+0000 7f4962ffd700 1 --2- 172.21.15.8:0/796663407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4964100a10 0x7f49641988f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f495400e970 tx=0x7f495400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:08.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.723+0000 7f4960ff9700 1 -- 172.21.15.8:0/796663407 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4954009790 con 0x7f4964100a10 2023-08-11T12:24:08.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.723+0000 7f49697ff700 1 -- 172.21.15.8:0/796663407 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49641a0a20 con 0x7f4964100a10 2023-08-11T12:24:08.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.723+0000 7f4960ff9700 1 -- 172.21.15.8:0/796663407 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f495400c7e0 con 0x7f4964100a10 2023-08-11T12:24:08.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.723+0000 7f4960ff9700 1 -- 172.21.15.8:0/796663407 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4954003c70 con 0x7f4964100a10 2023-08-11T12:24:08.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.723+0000 7f49697ff700 1 -- 172.21.15.8:0/796663407 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49641a0f30 con 0x7f4964100a10 2023-08-11T12:24:08.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.728+0000 7f4960ff9700 1 -- 172.21.15.8:0/796663407 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f495400cc50 con 0x7f4964100a10 2023-08-11T12:24:08.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.729+0000 7f497d17cb80 1 Processor -- start 2023-08-11T12:24:08.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.729+0000 7f497d17cb80 1 -- start start 2023-08-11T12:24:08.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.729+0000 7f497d17cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf11a80 0x55b76cf11ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.729+0000 7f497d17cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b76cf123e0 0x55b76cf12860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.729+0000 7f497d17cb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b76cf12da0 0x55b76cf13220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.729+0000 7f497d17cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b76ce6a5e0 con 0x55b76cf123e0 2023-08-11T12:24:08.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.729+0000 7f497d17cb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b76ce67f00 con 0x55b76cf12da0 2023-08-11T12:24:08.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.729+0000 7f497d17cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b76ce637f0 con 0x55b76cf11a80 2023-08-11T12:24:08.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.729+0000 7f4962ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b76cf123e0 0x55b76cf12860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.730+0000 7f49637fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf11a80 0x55b76cf11ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.730+0000 7f4962ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b76cf123e0 0x55b76cf12860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39428/0 (socket says 172.21.15.8:39428) 2023-08-11T12:24:08.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.730+0000 7f495bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b76cf12da0 0x55b76cf13220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.730+0000 7f4960ff9700 1 --2- 172.21.15.8:0/796663407 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f495009ff50 0x7f49500a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.730+0000 7f4962ffd700 1 -- 172.21.15.8:0/3588860180 learned_addr learned my addr 172.21.15.8:0/3588860180 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:08.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.730+0000 7f4960ff9700 1 -- 172.21.15.8:0/796663407 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f4954014070 con 0x7f4964100a10 2023-08-11T12:24:08.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.730+0000 7f49637fe700 1 --2- 172.21.15.8:0/796663407 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f495009ff50 0x7f49500a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.730+0000 7f495bfff700 1 -- 172.21.15.8:0/3588860180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf11a80 msgr2=0x55b76cf11ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:08.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.730+0000 7f495bfff700 1 --2- 172.21.15.8:0/3588860180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf11a80 0x55b76cf11ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.730+0000 7f495bfff700 1 -- 172.21.15.8:0/3588860180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b76cf123e0 msgr2=0x55b76cf12860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:08.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.730+0000 7f495bfff700 1 --2- 172.21.15.8:0/3588860180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b76cf123e0 0x55b76cf12860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.730+0000 7f495bfff700 1 -- 172.21.15.8:0/3588860180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b76cce35e0 con 0x55b76cf12da0 2023-08-11T12:24:08.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.730+0000 7f495bfff700 1 --2- 172.21.15.8:0/3588860180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b76cf12da0 0x55b76cf13220 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f494c009fd0 tx=0x7f494c005c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78542ca2db2e13ca server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:08.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.731+0000 7f49637fe700 1 --2- 172.21.15.8:0/796663407 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f495009ff50 0x7f49500a2410 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f495c003fd0 tx=0x7f495c004b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:08.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.731+0000 7f49597fa700 1 -- 172.21.15.8:0/3588860180 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c00bb50 con 0x55b76cf12da0 2023-08-11T12:24:08.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.731+0000 7f49597fa700 1 -- 172.21.15.8:0/3588860180 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f494c01e040 con 0x55b76cf12da0 2023-08-11T12:24:08.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.731+0000 7f49597fa700 1 -- 172.21.15.8:0/3588860180 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c003b10 con 0x55b76cf12da0 2023-08-11T12:24:08.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.731+0000 7f497d17cb80 1 -- 172.21.15.8:0/3588860180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b76cf12da0 msgr2=0x55b76cf13220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:08.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.732+0000 7f497d17cb80 1 --2- 172.21.15.8:0/3588860180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b76cf12da0 0x55b76cf13220 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f494c009fd0 tx=0x7f494c005c70 comp rx=0 tx=0).stop 2023-08-11T12:24:08.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.732+0000 7f497d17cb80 1 -- 172.21.15.8:0/3588860180 shutdown_connections 2023-08-11T12:24:08.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.732+0000 7f497d17cb80 1 --2- 172.21.15.8:0/3588860180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf11a80 0x55b76cf11ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.732+0000 7f497d17cb80 1 --2- 172.21.15.8:0/3588860180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b76cf12da0 0x55b76cf13220 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.732+0000 7f497d17cb80 1 --2- 172.21.15.8:0/3588860180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b76cf123e0 0x55b76cf12860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.732+0000 7f497d17cb80 1 -- 172.21.15.8:0/3588860180 >> 172.21.15.8:0/3588860180 conn(0x55b76ce3e900 msgr2=0x55b76cf0c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:08.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.732+0000 7f497d17cb80 1 -- 172.21.15.8:0/3588860180 shutdown_connections 2023-08-11T12:24:08.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.732+0000 7f497d17cb80 1 -- 172.21.15.8:0/3588860180 wait complete. 2023-08-11T12:24:08.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.732+0000 7f497d17cb80 1 -- start start 2023-08-11T12:24:08.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.732+0000 7f497d17cb80 1 Processor -- start 2023-08-11T12:24:08.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.733+0000 7f497d17cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b76cf11a80 0x55b76cf1b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.733+0000 7f497d17cb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b76cf123e0 0x55b76cf1b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.733+0000 7f497d17cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf12da0 0x55b76cf22650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.733+0000 7f497d17cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b76ce01a70 con 0x55b76cf11a80 2023-08-11T12:24:08.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.733+0000 7f497d17cb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b76ce01770 con 0x55b76cf123e0 2023-08-11T12:24:08.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.733+0000 7f497d17cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b76cce58d0 con 0x55b76cf12da0 2023-08-11T12:24:08.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.733+0000 7f497d17cb80 10 client.0 _ll_register_callbacks cb 0x55b76ce04a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:08.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.733+0000 7f4962ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b76cf11a80 0x55b76cf1b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.733+0000 7f4962ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b76cf11a80 0x55b76cf1b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39438/0 (socket says 172.21.15.8:39438) 2023-08-11T12:24:08.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.733+0000 7f4962ffd700 1 -- 172.21.15.8:0/2288727357 learned_addr learned my addr 172.21.15.8:0/2288727357 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:08.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.733+0000 7f495bfff700 1 --2- 172.21.15.8:0/2288727357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b76cf123e0 0x55b76cf1b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.734+0000 7f49637fe700 1 --2- 172.21.15.8:0/2288727357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf12da0 0x55b76cf22650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.734+0000 7f4962ffd700 1 -- 172.21.15.8:0/2288727357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf12da0 msgr2=0x55b76cf22650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:08.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.734+0000 7f4962ffd700 1 --2- 172.21.15.8:0/2288727357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf12da0 0x55b76cf22650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.734+0000 7f4962ffd700 1 -- 172.21.15.8:0/2288727357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b76cf123e0 msgr2=0x55b76cf1b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:08.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.734+0000 7f4962ffd700 1 --2- 172.21.15.8:0/2288727357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b76cf123e0 0x55b76cf1b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.734+0000 7f4962ffd700 1 -- 172.21.15.8:0/2288727357 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49641097a0 con 0x55b76cf11a80 2023-08-11T12:24:08.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.734+0000 7f4962ffd700 1 --2- 172.21.15.8:0/2288727357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b76cf11a80 0x55b76cf1b0d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f49540a0710 tx=0x7f4954098970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cddc043717dd5ed server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:08.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.734+0000 7f494a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:24:08.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.734+0000 7f494a7fc700 1 -- 172.21.15.8:0/2288727357 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4954003dd0 con 0x55b76cf11a80 2023-08-11T12:24:08.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.734+0000 7f494a7fc700 1 -- 172.21.15.8:0/2288727357 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f4954099e40 con 0x55b76cf11a80 2023-08-11T12:24:08.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.734+0000 7f497d17cb80 1 -- 172.21.15.8:0/2288727357 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b76cf04a40 con 0x55b76cf11a80 2023-08-11T12:24:08.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.734+0000 7f494a7fc700 1 -- 172.21.15.8:0/2288727357 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4954099530 con 0x55b76cf11a80 2023-08-11T12:24:08.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.734+0000 7f497d17cb80 10 client.15333 fetch_fsmap learned FSMap version 27 2023-08-11T12:24:08.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.734+0000 7f497d17cb80 1 -- 172.21.15.8:0/2288727357 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b76cc8fd90 con 0x55b76cf11a80 2023-08-11T12:24:08.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.735+0000 7f494a7fc700 1 -- 172.21.15.8:0/2288727357 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b76cf04a40 con 0x55b76cf11a80 2023-08-11T12:24:08.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.735+0000 7f494a7fc700 1 -- 172.21.15.8:0/2288727357 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f49540b80d0 con 0x55b76cf11a80 2023-08-11T12:24:08.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.735+0000 7f497d17cb80 10 client.15333 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:24:08.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.735+0000 7f497d17cb80 10 client.15333 resolve_mds: resolved name 'e' to daemon mds.e 2023-08-11T12:24:08.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.735+0000 7f497d17cb80 20 client.15333 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:08.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.735+0000 7f497d17cb80 1 --2- 172.21.15.8:0/2288727357 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x55b76cf26c10 0x55b76cf25700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.735+0000 7f497d17cb80 4 client.15333 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:24:08.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.735+0000 7f497d17cb80 1 -- 172.21.15.8:0/2288727357 --> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b76cee0490 con 0x55b76cf26c10 2023-08-11T12:24:08.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.735+0000 7f495bfff700 1 --2- 172.21.15.8:0/2288727357 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x55b76cf26c10 0x55b76cf25700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.736+0000 7f495bfff700 1 --2- 172.21.15.8:0/2288727357 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x55b76cf26c10 0x55b76cf25700 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3001abacbb5599e7 server_cookie=e6747bc0b90305ab in_seq=0 out_seq=0 2023-08-11T12:24:08.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.736+0000 7f494a7fc700 10 client.15333 ms_handle_connect on v2:172.21.15.45:6834/1776075470 2023-08-11T12:24:08.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.737+0000 7f494a7fc700 1 -- 172.21.15.8:0/2288727357 <== mds.3 v2:172.21.15.45:6834/1776075470 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55b76cee0490 con 0x55b76cf26c10 2023-08-11T12:24:08.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.737+0000 7f494a7fc700 10 client.15333 handle_command_reply: tid=0 2023-08-11T12:24:08.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.737+0000 7f497d17cb80 1 client.15333 shutdown 2023-08-11T12:24:08.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.737+0000 7f497d17cb80 1 -- 172.21.15.8:0/2288727357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b76cf11a80 msgr2=0x55b76cf1b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:08.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.737+0000 7f497d17cb80 1 --2- 172.21.15.8:0/2288727357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b76cf11a80 0x55b76cf1b0d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f49540a0710 tx=0x7f4954098970 comp rx=0 tx=0).stop 2023-08-11T12:24:08.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.737+0000 7f497d17cb80 1 -- 172.21.15.8:0/2288727357 shutdown_connections 2023-08-11T12:24:08.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.737+0000 7f497d17cb80 1 --2- 172.21.15.8:0/2288727357 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x55b76cf26c10 0x55b76cf25700 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.737+0000 7f497d17cb80 1 --2- 172.21.15.8:0/2288727357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf12da0 0x55b76cf22650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.737+0000 7f497d17cb80 1 --2- 172.21.15.8:0/2288727357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b76cf11a80 0x55b76cf1b0d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.737+0000 7f494a7fc700 0 client.15333 ms_handle_reset on v2:172.21.15.45:6834/1776075470 2023-08-11T12:24:08.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.737+0000 7f497d17cb80 1 --2- 172.21.15.8:0/2288727357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b76cf123e0 0x55b76cf1b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.737+0000 7f497d17cb80 1 -- 172.21.15.8:0/2288727357 >> 172.21.15.8:0/2288727357 conn(0x55b76ce3e900 msgr2=0x55b76cf06c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:08.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.737+0000 7f497d17cb80 1 -- 172.21.15.8:0/2288727357 shutdown_connections 2023-08-11T12:24:08.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.737+0000 7f497d17cb80 1 -- 172.21.15.8:0/2288727357 wait complete. 2023-08-11T12:24:08.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.738+0000 7f497d17cb80 20 client.15333 trim_cache size 0 max 16384 2023-08-11T12:24:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.756+0000 7f497d17cb80 1 Processor -- start 2023-08-11T12:24:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.756+0000 7f497d17cb80 1 -- start start 2023-08-11T12:24:08.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.756+0000 7f497d17cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf11a80 0x55b76cf19150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.756+0000 7f497d17cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b76cf123e0 0x55b76cf225e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.756+0000 7f497d17cb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b76cf12da0 0x55b76cf15d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.756+0000 7f497d17cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b76ccf1de0 con 0x55b76cf123e0 2023-08-11T12:24:08.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.756+0000 7f497d17cb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b76cdfdd50 con 0x55b76cf12da0 2023-08-11T12:24:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.756+0000 7f497d17cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b76ce2cef0 con 0x55b76cf11a80 2023-08-11T12:24:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.756+0000 7f495bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b76cf123e0 0x55b76cf225e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.757+0000 7f495bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b76cf123e0 0x55b76cf225e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39444/0 (socket says 172.21.15.8:39444) 2023-08-11T12:24:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.757+0000 7f495bfff700 1 -- 172.21.15.8:0/3583059301 learned_addr learned my addr 172.21.15.8:0/3583059301 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.757+0000 7f4962ffd700 1 --2- 172.21.15.8:0/3583059301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf11a80 0x55b76cf19150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.757+0000 7f49637fe700 1 --2- 172.21.15.8:0/3583059301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b76cf12da0 0x55b76cf15d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.757+0000 7f495bfff700 1 -- 172.21.15.8:0/3583059301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf11a80 msgr2=0x55b76cf19150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:08.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.757+0000 7f495bfff700 1 --2- 172.21.15.8:0/3583059301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf11a80 0x55b76cf19150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.757+0000 7f495bfff700 1 -- 172.21.15.8:0/3583059301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b76cf12da0 msgr2=0x55b76cf15d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:08.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.757+0000 7f495bfff700 1 --2- 172.21.15.8:0/3583059301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b76cf12da0 0x55b76cf15d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.757+0000 7f495bfff700 1 -- 172.21.15.8:0/3583059301 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b76cc78c10 con 0x55b76cf123e0 2023-08-11T12:24:08.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.757+0000 7f495bfff700 1 --2- 172.21.15.8:0/3583059301 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b76cf123e0 0x55b76cf225e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55b76cf0d3b0 tx=0x7f494c00b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c41f5fb4bf42f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:08.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.757+0000 7f4959ffb700 1 -- 172.21.15.8:0/3583059301 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c00baf0 con 0x55b76cf123e0 2023-08-11T12:24:08.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.757+0000 7f4959ffb700 1 -- 172.21.15.8:0/3583059301 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f494c02f9a0 con 0x55b76cf123e0 2023-08-11T12:24:08.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.757+0000 7f4959ffb700 1 -- 172.21.15.8:0/3583059301 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c0055a0 con 0x55b76cf123e0 2023-08-11T12:24:08.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.758+0000 7f497d17cb80 1 -- 172.21.15.8:0/3583059301 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b76cf123e0 msgr2=0x55b76cf225e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:08.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.758+0000 7f497d17cb80 1 --2- 172.21.15.8:0/3583059301 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b76cf123e0 0x55b76cf225e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55b76cf0d3b0 tx=0x7f494c00b540 comp rx=0 tx=0).stop 2023-08-11T12:24:08.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.758+0000 7f497d17cb80 1 -- 172.21.15.8:0/3583059301 shutdown_connections 2023-08-11T12:24:08.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.758+0000 7f497d17cb80 1 --2- 172.21.15.8:0/3583059301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf11a80 0x55b76cf19150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.758+0000 7f497d17cb80 1 --2- 172.21.15.8:0/3583059301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b76cf12da0 0x55b76cf15d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.758+0000 7f497d17cb80 1 --2- 172.21.15.8:0/3583059301 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b76cf123e0 0x55b76cf225e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.758+0000 7f497d17cb80 1 -- 172.21.15.8:0/3583059301 >> 172.21.15.8:0/3583059301 conn(0x55b76ce3e900 msgr2=0x55b76cf19e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:08.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.758+0000 7f497d17cb80 1 -- 172.21.15.8:0/3583059301 shutdown_connections 2023-08-11T12:24:08.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.758+0000 7f497d17cb80 1 -- 172.21.15.8:0/3583059301 wait complete. 2023-08-11T12:24:08.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.758+0000 7f497d17cb80 1 -- start start 2023-08-11T12:24:08.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.759+0000 7f497d17cb80 1 Processor -- start 2023-08-11T12:24:08.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.759+0000 7f497d17cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf11a80 0x55b76cf184a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.759+0000 7f497d17cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b76cf123e0 0x55b76cf225e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.759+0000 7f497d17cb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b76cf12da0 0x55b76cf16c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.759+0000 7f497d17cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b76cf17200 con 0x55b76cf123e0 2023-08-11T12:24:08.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.759+0000 7f497d17cb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b76cf17370 con 0x55b76cf12da0 2023-08-11T12:24:08.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.759+0000 7f497d17cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b76cf17530 con 0x55b76cf11a80 2023-08-11T12:24:08.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.759+0000 7f497d17cb80 10 client.0 _ll_register_callbacks cb 0x55b76ce04a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:08.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.759+0000 7f495bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b76cf123e0 0x55b76cf225e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.759+0000 7f495bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b76cf123e0 0x55b76cf225e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39454/0 (socket says 172.21.15.8:39454) 2023-08-11T12:24:08.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.759+0000 7f495bfff700 1 -- 172.21.15.8:0/1140685262 learned_addr learned my addr 172.21.15.8:0/1140685262 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:08.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.759+0000 7f49637fe700 1 --2- 172.21.15.8:0/1140685262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b76cf12da0 0x55b76cf16c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.759+0000 7f4962ffd700 1 --2- 172.21.15.8:0/1140685262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf11a80 0x55b76cf184a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.760+0000 7f495bfff700 1 -- 172.21.15.8:0/1140685262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf11a80 msgr2=0x55b76cf184a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:08.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.760+0000 7f495bfff700 1 --2- 172.21.15.8:0/1140685262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf11a80 0x55b76cf184a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.760+0000 7f495bfff700 1 -- 172.21.15.8:0/1140685262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b76cf12da0 msgr2=0x55b76cf16c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:08.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.760+0000 7f495bfff700 1 --2- 172.21.15.8:0/1140685262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b76cf12da0 0x55b76cf16c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.760+0000 7f495bfff700 1 -- 172.21.15.8:0/1140685262 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b76cce35e0 con 0x55b76cf123e0 2023-08-11T12:24:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.760+0000 7f495bfff700 1 --2- 172.21.15.8:0/1140685262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b76cf123e0 0x55b76cf225e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f494c0098e0 tx=0x7f494c005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f34682e167d165 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.760+0000 7f494a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:24:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.760+0000 7f494a7fc700 1 -- 172.21.15.8:0/1140685262 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c005320 con 0x55b76cf123e0 2023-08-11T12:24:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.760+0000 7f497d17cb80 1 -- 172.21.15.8:0/1140685262 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f494c01e040 con 0x55b76cf123e0 2023-08-11T12:24:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.760+0000 7f494a7fc700 1 -- 172.21.15.8:0/1140685262 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f494c005480 con 0x55b76cf123e0 2023-08-11T12:24:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.761+0000 7f494a7fc700 1 -- 172.21.15.8:0/1140685262 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f494c005640 con 0x55b76cf123e0 2023-08-11T12:24:08.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.761+0000 7f497d17cb80 10 client.15339 fetch_fsmap learned FSMap version 27 2023-08-11T12:24:08.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.761+0000 7f497d17cb80 1 -- 172.21.15.8:0/1140685262 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b76ccb6200 con 0x55b76cf123e0 2023-08-11T12:24:08.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.761+0000 7f494a7fc700 1 -- 172.21.15.8:0/1140685262 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f494c01e040 con 0x55b76cf123e0 2023-08-11T12:24:08.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.761+0000 7f494a7fc700 1 -- 172.21.15.8:0/1140685262 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f494c042070 con 0x55b76cf123e0 2023-08-11T12:24:08.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.761+0000 7f497d17cb80 10 client.15339 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:24:08.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.761+0000 7f497d17cb80 10 client.15339 resolve_mds: resolved name 'e' to daemon mds.e 2023-08-11T12:24:08.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.761+0000 7f497d17cb80 20 client.15339 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:08.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.761+0000 7f497d17cb80 1 --2- 172.21.15.8:0/1140685262 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x55b76cf7ead0 0x55b76cf7afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.761+0000 7f497d17cb80 4 client.15339 mds_command: new command op to 24500 tid=0[{"prefix": "status"}] 2023-08-11T12:24:08.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.761+0000 7f497d17cb80 1 -- 172.21.15.8:0/1140685262 --> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b76ce5c7d0 con 0x55b76cf7ead0 2023-08-11T12:24:08.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.762+0000 7f4962ffd700 1 --2- 172.21.15.8:0/1140685262 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x55b76cf7ead0 0x55b76cf7afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.762+0000 7f4962ffd700 1 --2- 172.21.15.8:0/1140685262 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x55b76cf7ead0 0x55b76cf7afe0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=84bbfeaa91ab307b server_cookie=4492016588eca4c6 in_seq=0 out_seq=0 2023-08-11T12:24:08.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.762+0000 7f494a7fc700 10 client.15339 ms_handle_connect on v2:172.21.15.45:6834/1776075470 2023-08-11T12:24:08.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.762+0000 7f494a7fc700 1 -- 172.21.15.8:0/1140685262 <== mds.3 v2:172.21.15.45:6834/1776075470 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55b76ce5c7d0 con 0x55b76cf7ead0 2023-08-11T12:24:08.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.762+0000 7f494a7fc700 10 client.15339 handle_command_reply: tid=0 2023-08-11T12:24:08.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.762+0000 7f497d17cb80 1 client.15339 shutdown 2023-08-11T12:24:08.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.763+0000 7f497d17cb80 1 -- 172.21.15.8:0/1140685262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b76cf123e0 msgr2=0x55b76cf225e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:08.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.763+0000 7f497d17cb80 1 --2- 172.21.15.8:0/1140685262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b76cf123e0 0x55b76cf225e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f494c0098e0 tx=0x7f494c005f10 comp rx=0 tx=0).stop 2023-08-11T12:24:08.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.763+0000 7f497d17cb80 1 -- 172.21.15.8:0/1140685262 shutdown_connections 2023-08-11T12:24:08.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.763+0000 7f497d17cb80 1 --2- 172.21.15.8:0/1140685262 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x55b76cf7ead0 0x55b76cf7afe0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.763+0000 7f497d17cb80 1 --2- 172.21.15.8:0/1140685262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf11a80 0x55b76cf184a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.763+0000 7f497d17cb80 1 --2- 172.21.15.8:0/1140685262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b76cf12da0 0x55b76cf16c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.763+0000 7f494a7fc700 0 client.15339 ms_handle_reset on v2:172.21.15.45:6834/1776075470 2023-08-11T12:24:08.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.763+0000 7f497d17cb80 1 --2- 172.21.15.8:0/1140685262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b76cf123e0 0x55b76cf225e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.763+0000 7f497d17cb80 1 -- 172.21.15.8:0/1140685262 >> 172.21.15.8:0/1140685262 conn(0x55b76ce3e900 msgr2=0x55b76cf15d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:08.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.763+0000 7f497d17cb80 1 -- 172.21.15.8:0/1140685262 shutdown_connections 2023-08-11T12:24:08.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.763+0000 7f497d17cb80 1 -- 172.21.15.8:0/1140685262 wait complete. 2023-08-11T12:24:08.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.763+0000 7f497d17cb80 20 client.15339 trim_cache size 0 max 16384 2023-08-11T12:24:08.775 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:24:08.775 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "815f94ae-3840-11ee-9b37-001a4aab830c", 2023-08-11T12:24:08.775 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 3, 2023-08-11T12:24:08.776 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24500, 2023-08-11T12:24:08.776 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-08-11T12:24:08.776 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-08-11T12:24:08.776 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-08-11T12:24:08.776 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 98.082762693999996, 2023-08-11T12:24:08.776 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 27, 2023-08-11T12:24:08.777 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 89, 2023-08-11T12:24:08.777 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 89, 2023-08-11T12:24:08.777 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 148.776392956 2023-08-11T12:24:08.777 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:24:08.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.763+0000 7f49697ff700 1 -- 172.21.15.8:0/796663407 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f495009ff50 msgr2=0x7f49500a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:08.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.763+0000 7f49697ff700 1 --2- 172.21.15.8:0/796663407 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f495009ff50 0x7f49500a2410 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f495c003fd0 tx=0x7f495c004b40 comp rx=0 tx=0).stop 2023-08-11T12:24:08.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.763+0000 7f49697ff700 1 -- 172.21.15.8:0/796663407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4964100a10 msgr2=0x7f49641988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:08.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.763+0000 7f49697ff700 1 --2- 172.21.15.8:0/796663407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4964100a10 0x7f49641988f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f495400e970 tx=0x7f495400ec80 comp rx=0 tx=0).stop 2023-08-11T12:24:08.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.764+0000 7f49697ff700 1 -- 172.21.15.8:0/796663407 shutdown_connections 2023-08-11T12:24:08.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.764+0000 7f49697ff700 1 --2- 172.21.15.8:0/796663407 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f495009ff50 0x7f49500a2410 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.764+0000 7f49697ff700 1 --2- 172.21.15.8:0/796663407 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49641025a0 0x7f496419fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.764+0000 7f49697ff700 1 --2- 172.21.15.8:0/796663407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4964100a10 0x7f49641988f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.764+0000 7f49697ff700 1 --2- 172.21.15.8:0/796663407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4964101c00 0x7f4964198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.764+0000 7f49697ff700 1 -- 172.21.15.8:0/796663407 >> 172.21.15.8:0/796663407 conn(0x7f49640fbf80 msgr2=0x7f49641074e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:08.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.764+0000 7f49697ff700 1 -- 172.21.15.8:0/796663407 shutdown_connections 2023-08-11T12:24:08.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.764+0000 7f49697ff700 1 -- 172.21.15.8:0/796663407 wait complete. 2023-08-11T12:24:08.784 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-08-11T12:24:08.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.988+0000 7f5fb8dff700 1 -- 172.21.15.8:0/4253082413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fb4100a00 msgr2=0x7f5fb4100e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:08.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.988+0000 7f5fb8dff700 1 --2- 172.21.15.8:0/4253082413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fb4100a00 0x7f5fb4100e20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5fa40099c0 tx=0x7f5fa4009cd0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.988+0000 7f5fb8dff700 1 -- 172.21.15.8:0/4253082413 shutdown_connections 2023-08-11T12:24:08.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.988+0000 7f5fb8dff700 1 --2- 172.21.15.8:0/4253082413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fb4102590 0x7f5fb4108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.988+0000 7f5fb8dff700 1 --2- 172.21.15.8:0/4253082413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fb4100a00 0x7f5fb4100e20 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.988+0000 7f5fb8dff700 1 --2- 172.21.15.8:0/4253082413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb4101bf0 0x7f5fb4102050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.988+0000 7f5fb8dff700 1 -- 172.21.15.8:0/4253082413 >> 172.21.15.8:0/4253082413 conn(0x7f5fb40fbf70 msgr2=0x7f5fb40fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:08.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.988+0000 7f5fb8dff700 1 -- 172.21.15.8:0/4253082413 shutdown_connections 2023-08-11T12:24:08.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.988+0000 7f5fb8dff700 1 -- 172.21.15.8:0/4253082413 wait complete. 2023-08-11T12:24:08.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.990+0000 7f5fb8dff700 1 Processor -- start 2023-08-11T12:24:08.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.990+0000 7f5fb8dff700 1 -- start start 2023-08-11T12:24:08.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.990+0000 7f5fb8dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fb4100a00 0x7f5fb41988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.990+0000 7f5fb8dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fb4101bf0 0x7f5fb4198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.990+0000 7f5fb8dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb4102590 0x7f5fb419fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:08.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.990+0000 7f5fb8dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb41a0470 con 0x7f5fb4101bf0 2023-08-11T12:24:08.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.990+0000 7f5fb8dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb41a05b0 con 0x7f5fb4102590 2023-08-11T12:24:08.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.990+0000 7f5fb8dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb41a0740 con 0x7f5fb4100a00 2023-08-11T12:24:08.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.991+0000 7f5fabfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fb4101bf0 0x7f5fb4198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.991+0000 7f5fb259c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fb4100a00 0x7f5fb41988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.991+0000 7f5fb259c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fb4100a00 0x7f5fb41988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:42844/0 (socket says 172.21.15.8:42844) 2023-08-11T12:24:08.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.991+0000 7f5fabfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fb4101bf0 0x7f5fb4198e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39484/0 (socket says 172.21.15.8:39484) 2023-08-11T12:24:08.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.991+0000 7f5fb259c700 1 -- 172.21.15.8:0/1423383392 learned_addr learned my addr 172.21.15.8:0/1423383392 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:08.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.991+0000 7f5fb2d9d700 1 --2- 172.21.15.8:0/1423383392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb4102590 0x7f5fb419fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:08.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.991+0000 7f5fabfff700 1 -- 172.21.15.8:0/1423383392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fb4100a00 msgr2=0x7f5fb41988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:08.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.991+0000 7f5fabfff700 1 --2- 172.21.15.8:0/1423383392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fb4100a00 0x7f5fb41988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.991+0000 7f5fabfff700 1 -- 172.21.15.8:0/1423383392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb4102590 msgr2=0x7f5fb419fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:08.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.991+0000 7f5fabfff700 1 --2- 172.21.15.8:0/1423383392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb4102590 0x7f5fb419fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:08.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.991+0000 7f5fabfff700 1 -- 172.21.15.8:0/1423383392 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa40095f0 con 0x7f5fb4101bf0 2023-08-11T12:24:08.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.991+0000 7f5fb259c700 1 --2- 172.21.15.8:0/1423383392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fb4100a00 0x7f5fb41988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:08.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.991+0000 7f5fabfff700 1 --2- 172.21.15.8:0/1423383392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fb4101bf0 0x7f5fb4198e30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c00d750 tx=0x7f5f9c00da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:08.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.992+0000 7f5fab7fe700 1 -- 172.21.15.8:0/1423383392 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c004020 con 0x7f5fb4101bf0 2023-08-11T12:24:08.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.992+0000 7f5fab7fe700 1 -- 172.21.15.8:0/1423383392 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f9c004830 con 0x7f5fb4101bf0 2023-08-11T12:24:08.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.992+0000 7f5fb8dff700 1 -- 172.21.15.8:0/1423383392 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb41a0a20 con 0x7f5fb4101bf0 2023-08-11T12:24:08.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.992+0000 7f5fab7fe700 1 -- 172.21.15.8:0/1423383392 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c0054c0 con 0x7f5fb4101bf0 2023-08-11T12:24:08.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.992+0000 7f5fb8dff700 1 -- 172.21.15.8:0/1423383392 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb41a0f30 con 0x7f5fb4101bf0 2023-08-11T12:24:08.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.995+0000 7f5fab7fe700 1 -- 172.21.15.8:0/1423383392 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f5f9c0049a0 con 0x7f5fb4101bf0 2023-08-11T12:24:08.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.997+0000 7f5fcc7e5b80 1 Processor -- start 2023-08-11T12:24:08.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.997+0000 7f5fcc7e5b80 1 -- start start 2023-08-11T12:24:08.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.997+0000 7f5fab7fe700 1 --2- 172.21.15.8:0/1423383392 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5fa009ff50 0x7f5fa00a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.997+0000 7f5fcc7e5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bff997da80 0x55bff997dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.998+0000 7f5fcc7e5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bff997e3e0 0x55bff997e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.998+0000 7f5fcc7e5b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bff997eda0 0x55bff997f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.998+0000 7f5fcc7e5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bff98d65e0 con 0x55bff997da80 2023-08-11T12:24:09.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.998+0000 7f5fcc7e5b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bff98d3f00 con 0x55bff997eda0 2023-08-11T12:24:09.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.998+0000 7f5fcc7e5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bff98cf7f0 con 0x55bff997e3e0 2023-08-11T12:24:09.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.998+0000 7f5fab7fe700 1 -- 172.21.15.8:0/1423383392 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f5f9c0caef0 con 0x7f5fb4101bf0 2023-08-11T12:24:09.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.998+0000 7f5fb2d9d700 1 --2- 172.21.15.8:0/1423383392 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5fa009ff50 0x7f5fa00a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.998+0000 7f5fb259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bff997da80 0x55bff997dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.998+0000 7f5fb259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bff997da80 0x55bff997dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39496/0 (socket says 172.21.15.8:39496) 2023-08-11T12:24:09.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.998+0000 7f5fb259c700 1 -- 172.21.15.8:0/144594598 learned_addr learned my addr 172.21.15.8:0/144594598 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:09.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.998+0000 7f5fabfff700 1 --2- 172.21.15.8:0/144594598 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bff997e3e0 0x55bff997e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.998+0000 7f5fb2d9d700 1 --2- 172.21.15.8:0/144594598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bff997eda0 0x55bff997f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.998+0000 7f5fb259c700 1 -- 172.21.15.8:0/144594598 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bff997e3e0 msgr2=0x55bff997e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:09.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.998+0000 7f5fb259c700 1 --2- 172.21.15.8:0/144594598 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bff997e3e0 0x55bff997e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.998+0000 7f5fb259c700 1 -- 172.21.15.8:0/144594598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bff997eda0 msgr2=0x55bff997f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:09.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.998+0000 7f5fb259c700 1 --2- 172.21.15.8:0/144594598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bff997eda0 0x55bff997f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.998+0000 7f5fb259c700 1 -- 172.21.15.8:0/144594598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bff974f5e0 con 0x55bff997da80 2023-08-11T12:24:09.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.999+0000 7f5fb259c700 1 --2- 172.21.15.8:0/144594598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bff997da80 0x55bff997dea0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400bbf0 tx=0x7f5fa4005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f42ec98086b31c6 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:09.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.999+0000 7f5fb2d9d700 1 --2- 172.21.15.8:0/1423383392 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5fa009ff50 0x7f5fa00a2410 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00adf0 tx=0x7f5fac00a410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:09.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.999+0000 7f5fa8ff9700 1 -- 172.21.15.8:0/144594598 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa401d070 con 0x55bff997da80 2023-08-11T12:24:09.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.999+0000 7f5fa8ff9700 1 -- 172.21.15.8:0/144594598 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5fa401e040 con 0x55bff997da80 2023-08-11T12:24:09.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:08.999+0000 7f5fa8ff9700 1 -- 172.21.15.8:0/144594598 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4003ea0 con 0x55bff997da80 2023-08-11T12:24:09.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.000+0000 7f5fcc7e5b80 1 -- 172.21.15.8:0/144594598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bff997da80 msgr2=0x55bff997dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:09.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.000+0000 7f5fcc7e5b80 1 --2- 172.21.15.8:0/144594598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bff997da80 0x55bff997dea0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400bbf0 tx=0x7f5fa4005c90 comp rx=0 tx=0).stop 2023-08-11T12:24:09.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.000+0000 7f5fcc7e5b80 1 -- 172.21.15.8:0/144594598 shutdown_connections 2023-08-11T12:24:09.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.000+0000 7f5fcc7e5b80 1 --2- 172.21.15.8:0/144594598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bff997eda0 0x55bff997f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.000+0000 7f5fcc7e5b80 1 --2- 172.21.15.8:0/144594598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bff997da80 0x55bff997dea0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.000+0000 7f5fcc7e5b80 1 --2- 172.21.15.8:0/144594598 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bff997e3e0 0x55bff997e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.000+0000 7f5fcc7e5b80 1 -- 172.21.15.8:0/144594598 >> 172.21.15.8:0/144594598 conn(0x55bff98aa900 msgr2=0x55bff99783d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:09.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.000+0000 7f5fcc7e5b80 1 -- 172.21.15.8:0/144594598 shutdown_connections 2023-08-11T12:24:09.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.000+0000 7f5fcc7e5b80 1 -- 172.21.15.8:0/144594598 wait complete. 2023-08-11T12:24:09.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.000+0000 7f5fcc7e5b80 1 -- start start 2023-08-11T12:24:09.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.001+0000 7f5fcc7e5b80 1 Processor -- start 2023-08-11T12:24:09.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.001+0000 7f5fcc7e5b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bff997da80 0x55bff9986fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.001+0000 7f5fcc7e5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bff997e3e0 0x55bff9987510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.001+0000 7f5fcc7e5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bff997eda0 0x55bff998e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.001+0000 7f5fcc7e5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bff986da70 con 0x55bff997eda0 2023-08-11T12:24:09.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.001+0000 7f5fcc7e5b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bff986d770 con 0x55bff997da80 2023-08-11T12:24:09.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.001+0000 7f5fcc7e5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bff97518d0 con 0x55bff997e3e0 2023-08-11T12:24:09.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.001+0000 7f5fcc7e5b80 10 client.0 _ll_register_callbacks cb 0x55bff9870a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:09.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.001+0000 7f5fb2d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bff997eda0 0x55bff998e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.001+0000 7f5fb2d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bff997eda0 0x55bff998e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39510/0 (socket says 172.21.15.8:39510) 2023-08-11T12:24:09.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.001+0000 7f5fb2d9d700 1 -- 172.21.15.8:0/115633374 learned_addr learned my addr 172.21.15.8:0/115633374 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:09.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.001+0000 7f5fb259c700 1 --2- 172.21.15.8:0/115633374 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bff997da80 0x55bff9986fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.001+0000 7f5fabfff700 1 --2- 172.21.15.8:0/115633374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bff997e3e0 0x55bff9987510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.002+0000 7f5fb2d9d700 1 -- 172.21.15.8:0/115633374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bff997e3e0 msgr2=0x55bff9987510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:09.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.002+0000 7f5fb2d9d700 1 --2- 172.21.15.8:0/115633374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bff997e3e0 0x55bff9987510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.002+0000 7f5fb2d9d700 1 -- 172.21.15.8:0/115633374 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bff997da80 msgr2=0x55bff9986fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:09.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.002+0000 7f5fb2d9d700 1 --2- 172.21.15.8:0/115633374 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bff997da80 0x55bff9986fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.002+0000 7f5fb2d9d700 1 -- 172.21.15.8:0/115633374 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb4109790 con 0x55bff997eda0 2023-08-11T12:24:09.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.002+0000 7f5fb2d9d700 1 --2- 172.21.15.8:0/115633374 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bff997eda0 0x55bff998e550 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5fac01b9f0 tx=0x7f5fac004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d1dd0652c5a66b server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:09.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.002+0000 7f5f99ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:24:09.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.002+0000 7f5f99ffb700 1 -- 172.21.15.8:0/115633374 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac00f040 con 0x55bff997eda0 2023-08-11T12:24:09.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.002+0000 7f5fcc7e5b80 1 -- 172.21.15.8:0/115633374 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bff9970a40 con 0x55bff997eda0 2023-08-11T12:24:09.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.002+0000 7f5f99ffb700 1 -- 172.21.15.8:0/115633374 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f5fac00a740 con 0x55bff997eda0 2023-08-11T12:24:09.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.003+0000 7f5f99ffb700 1 -- 172.21.15.8:0/115633374 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fac018eb0 con 0x55bff997eda0 2023-08-11T12:24:09.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.003+0000 7f5fcc7e5b80 10 client.15351 fetch_fsmap learned FSMap version 27 2023-08-11T12:24:09.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.003+0000 7f5fcc7e5b80 1 -- 172.21.15.8:0/115633374 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55bff96fbd90 con 0x55bff997eda0 2023-08-11T12:24:09.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.003+0000 7f5f99ffb700 1 -- 172.21.15.8:0/115633374 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bff9970a40 con 0x55bff997eda0 2023-08-11T12:24:09.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.003+0000 7f5f99ffb700 1 -- 172.21.15.8:0/115633374 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5fac028850 con 0x55bff997eda0 2023-08-11T12:24:09.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.003+0000 7f5fcc7e5b80 10 client.15351 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:24:09.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.003+0000 7f5fcc7e5b80 10 client.15351 resolve_mds: resolved name 'f' to daemon mds.f 2023-08-11T12:24:09.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.003+0000 7f5fcc7e5b80 20 client.15351 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:09.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.003+0000 7f5fcc7e5b80 1 --2- 172.21.15.8:0/115633374 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x55bff9992c80 0x55bff99916a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.003+0000 7f5fcc7e5b80 4 client.15351 mds_command: new command op to 24517 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:24:09.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.003+0000 7f5fcc7e5b80 1 -- 172.21.15.8:0/115633374 --> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bff994c490 con 0x55bff9992c80 2023-08-11T12:24:09.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.004+0000 7f5fb259c700 1 --2- 172.21.15.8:0/115633374 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x55bff9992c80 0x55bff99916a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.004+0000 7f5f99ffb700 10 client.15351 ms_handle_connect on v2:172.21.15.194:6834/2457430285 2023-08-11T12:24:09.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.004+0000 7f5fb259c700 1 --2- 172.21.15.8:0/115633374 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x55bff9992c80 0x55bff99916a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cd3695eb4081f9ea server_cookie=65e99ae1ffca1c1c in_seq=0 out_seq=0 2023-08-11T12:24:09.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.005+0000 7f5f99ffb700 1 -- 172.21.15.8:0/115633374 <== mds.2 v2:172.21.15.194:6834/2457430285 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55bff994c490 con 0x55bff9992c80 2023-08-11T12:24:09.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.005+0000 7f5f99ffb700 10 client.15351 handle_command_reply: tid=0 2023-08-11T12:24:09.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.005+0000 7f5fcc7e5b80 1 client.15351 shutdown 2023-08-11T12:24:09.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.005+0000 7f5fcc7e5b80 1 -- 172.21.15.8:0/115633374 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bff997eda0 msgr2=0x55bff998e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:09.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.005+0000 7f5fcc7e5b80 1 --2- 172.21.15.8:0/115633374 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bff997eda0 0x55bff998e550 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5fac01b9f0 tx=0x7f5fac004b40 comp rx=0 tx=0).stop 2023-08-11T12:24:09.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.005+0000 7f5fcc7e5b80 1 -- 172.21.15.8:0/115633374 shutdown_connections 2023-08-11T12:24:09.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.005+0000 7f5fcc7e5b80 1 --2- 172.21.15.8:0/115633374 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x55bff9992c80 0x55bff99916a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.005+0000 7f5fcc7e5b80 1 --2- 172.21.15.8:0/115633374 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bff997eda0 0x55bff998e550 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.005+0000 7f5fcc7e5b80 1 --2- 172.21.15.8:0/115633374 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bff997da80 0x55bff9986fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.005+0000 7f5fcc7e5b80 1 --2- 172.21.15.8:0/115633374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bff997e3e0 0x55bff9987510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.005+0000 7f5f99ffb700 0 client.15351 ms_handle_reset on v2:172.21.15.194:6834/2457430285 2023-08-11T12:24:09.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.005+0000 7f5fcc7e5b80 1 -- 172.21.15.8:0/115633374 >> 172.21.15.8:0/115633374 conn(0x55bff98aa900 msgr2=0x55bff9972c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:09.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.006+0000 7f5fcc7e5b80 1 -- 172.21.15.8:0/115633374 shutdown_connections 2023-08-11T12:24:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.006+0000 7f5fcc7e5b80 1 -- 172.21.15.8:0/115633374 wait complete. 2023-08-11T12:24:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.006+0000 7f5fcc7e5b80 20 client.15351 trim_cache size 0 max 16384 2023-08-11T12:24:09.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.024+0000 7f5fcc7e5b80 1 Processor -- start 2023-08-11T12:24:09.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.024+0000 7f5fcc7e5b80 1 -- start start 2023-08-11T12:24:09.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.024+0000 7f5fcc7e5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bff997da80 0x55bff9971cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.024+0000 7f5fcc7e5b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bff997e3e0 0x55bff999b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.024+0000 7f5fcc7e5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bff997eda0 0x55bff9978230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.024+0000 7f5fcc7e5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bff9898f20 con 0x55bff997da80 2023-08-11T12:24:09.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.024+0000 7f5fcc7e5b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bff988c4b0 con 0x55bff997e3e0 2023-08-11T12:24:09.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.024+0000 7f5fcc7e5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bff9970a20 con 0x55bff997eda0 2023-08-11T12:24:09.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.025+0000 7f5fb259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bff997da80 0x55bff9971cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.025+0000 7f5fb259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bff997da80 0x55bff9971cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39516/0 (socket says 172.21.15.8:39516) 2023-08-11T12:24:09.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.025+0000 7f5fb259c700 1 -- 172.21.15.8:0/2805812228 learned_addr learned my addr 172.21.15.8:0/2805812228 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:09.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.025+0000 7f5fabfff700 1 --2- 172.21.15.8:0/2805812228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bff997e3e0 0x55bff999b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.025+0000 7f5fb2d9d700 1 --2- 172.21.15.8:0/2805812228 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bff997eda0 0x55bff9978230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.025+0000 7f5fb259c700 1 -- 172.21.15.8:0/2805812228 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bff997eda0 msgr2=0x55bff9978230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.025+0000 7f5fb259c700 1 --2- 172.21.15.8:0/2805812228 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bff997eda0 0x55bff9978230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.025+0000 7f5fb259c700 1 -- 172.21.15.8:0/2805812228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bff997e3e0 msgr2=0x55bff999b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.025+0000 7f5fb259c700 1 --2- 172.21.15.8:0/2805812228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bff997e3e0 0x55bff999b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.025+0000 7f5fb259c700 1 -- 172.21.15.8:0/2805812228 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bff96e4c10 con 0x55bff997da80 2023-08-11T12:24:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.025+0000 7f5fb259c700 1 --2- 172.21.15.8:0/2805812228 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bff997da80 0x55bff9971cb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400b580 tx=0x7f5fa401a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=991b5b96c1c9273e server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.026+0000 7f5fa97fa700 1 -- 172.21.15.8:0/2805812228 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa401d040 con 0x55bff997da80 2023-08-11T12:24:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.026+0000 7f5fa97fa700 1 -- 172.21.15.8:0/2805812228 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5fa4005510 con 0x55bff997da80 2023-08-11T12:24:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.026+0000 7f5fa97fa700 1 -- 172.21.15.8:0/2805812228 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4003ee0 con 0x55bff997da80 2023-08-11T12:24:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.026+0000 7f5fcc7e5b80 1 -- 172.21.15.8:0/2805812228 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bff997da80 msgr2=0x55bff9971cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.026+0000 7f5fcc7e5b80 1 --2- 172.21.15.8:0/2805812228 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bff997da80 0x55bff9971cb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400b580 tx=0x7f5fa401a040 comp rx=0 tx=0).stop 2023-08-11T12:24:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.026+0000 7f5fcc7e5b80 1 -- 172.21.15.8:0/2805812228 shutdown_connections 2023-08-11T12:24:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.026+0000 7f5fcc7e5b80 1 --2- 172.21.15.8:0/2805812228 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bff997eda0 0x55bff9978230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.026+0000 7f5fcc7e5b80 1 --2- 172.21.15.8:0/2805812228 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bff997da80 0x55bff9971cb0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.026+0000 7f5fcc7e5b80 1 --2- 172.21.15.8:0/2805812228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bff997e3e0 0x55bff999b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.026+0000 7f5fcc7e5b80 1 -- 172.21.15.8:0/2805812228 >> 172.21.15.8:0/2805812228 conn(0x55bff98aa900 msgr2=0x55bff9981d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.026+0000 7f5fcc7e5b80 1 -- 172.21.15.8:0/2805812228 shutdown_connections 2023-08-11T12:24:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.026+0000 7f5fcc7e5b80 1 -- 172.21.15.8:0/2805812228 wait complete. 2023-08-11T12:24:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.027+0000 7f5fcc7e5b80 1 -- start start 2023-08-11T12:24:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.027+0000 7f5fcc7e5b80 1 Processor -- start 2023-08-11T12:24:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.027+0000 7f5fcc7e5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bff997da80 0x55bff9983000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.027+0000 7f5fcc7e5b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bff997e3e0 0x55bff999b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.027+0000 7f5fcc7e5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bff997eda0 0x55bff9983540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.027+0000 7f5fcc7e5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bff9983a80 con 0x55bff997eda0 2023-08-11T12:24:09.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.027+0000 7f5fcc7e5b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bff9983bf0 con 0x55bff997e3e0 2023-08-11T12:24:09.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.027+0000 7f5fcc7e5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bff9983db0 con 0x55bff997da80 2023-08-11T12:24:09.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.028+0000 7f5fcc7e5b80 10 client.0 _ll_register_callbacks cb 0x7f5fac018e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:09.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.028+0000 7f5fb2d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bff997eda0 0x55bff9983540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.028+0000 7f5fb259c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bff997da80 0x55bff9983000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.028+0000 7f5fb2d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bff997eda0 0x55bff9983540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39522/0 (socket says 172.21.15.8:39522) 2023-08-11T12:24:09.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.028+0000 7f5fb2d9d700 1 -- 172.21.15.8:0/2245179963 learned_addr learned my addr 172.21.15.8:0/2245179963 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:09.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.028+0000 7f5fabfff700 1 --2- 172.21.15.8:0/2245179963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bff997e3e0 0x55bff999b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.028+0000 7f5fb2d9d700 1 -- 172.21.15.8:0/2245179963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bff997da80 msgr2=0x55bff9983000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:09.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.028+0000 7f5fb2d9d700 1 --2- 172.21.15.8:0/2245179963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bff997da80 0x55bff9983000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.028+0000 7f5fb2d9d700 1 -- 172.21.15.8:0/2245179963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bff997e3e0 msgr2=0x55bff999b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:09.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.028+0000 7f5fb2d9d700 1 --2- 172.21.15.8:0/2245179963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bff997e3e0 0x55bff999b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.028+0000 7f5fb2d9d700 1 -- 172.21.15.8:0/2245179963 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bff974f5e0 con 0x55bff997eda0 2023-08-11T12:24:09.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.028+0000 7f5fb259c700 1 --2- 172.21.15.8:0/2245179963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bff997da80 0x55bff9983000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:09.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.029+0000 7f5fb2d9d700 1 --2- 172.21.15.8:0/2245179963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bff997eda0 0x55bff9983540 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5fac018960 tx=0x7f5fac0286e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561f991b107c71be server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:09.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.029+0000 7f5f99ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:24:09.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.029+0000 7f5f99ffb700 1 -- 172.21.15.8:0/2245179963 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac00f040 con 0x55bff997eda0 2023-08-11T12:24:09.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.029+0000 7f5fcc7e5b80 1 -- 172.21.15.8:0/2245179963 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5fa401e040 con 0x55bff997eda0 2023-08-11T12:24:09.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.029+0000 7f5f99ffb700 1 -- 172.21.15.8:0/2245179963 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f5fac00aaf0 con 0x55bff997eda0 2023-08-11T12:24:09.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.029+0000 7f5f99ffb700 1 -- 172.21.15.8:0/2245179963 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fac018eb0 con 0x55bff997eda0 2023-08-11T12:24:09.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.029+0000 7f5fcc7e5b80 10 client.15357 fetch_fsmap learned FSMap version 27 2023-08-11T12:24:09.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.029+0000 7f5fcc7e5b80 1 -- 172.21.15.8:0/2245179963 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55bff9722200 con 0x55bff997eda0 2023-08-11T12:24:09.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.029+0000 7f5f99ffb700 1 -- 172.21.15.8:0/2245179963 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5fa401e040 con 0x55bff997eda0 2023-08-11T12:24:09.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.029+0000 7f5f99ffb700 1 -- 172.21.15.8:0/2245179963 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5fac01aa70 con 0x55bff997eda0 2023-08-11T12:24:09.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.029+0000 7f5fcc7e5b80 10 client.15357 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:24:09.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.030+0000 7f5fcc7e5b80 10 client.15357 resolve_mds: resolved name 'f' to daemon mds.f 2023-08-11T12:24:09.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.030+0000 7f5fcc7e5b80 20 client.15357 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:09.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.030+0000 7f5fcc7e5b80 1 --2- 172.21.15.8:0/2245179963 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x55bff99eb360 0x55bff99e77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.030+0000 7f5fcc7e5b80 4 client.15357 mds_command: new command op to 24517 tid=0[{"prefix": "status"}] 2023-08-11T12:24:09.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.030+0000 7f5fcc7e5b80 1 -- 172.21.15.8:0/2245179963 --> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bff98c87d0 con 0x55bff99eb360 2023-08-11T12:24:09.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.030+0000 7f5fb259c700 1 --2- 172.21.15.8:0/2245179963 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x55bff99eb360 0x55bff99e77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.030+0000 7f5fb259c700 1 --2- 172.21.15.8:0/2245179963 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x55bff99eb360 0x55bff99e77b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d68650b13e219459 server_cookie=cd6ec370100a3196 in_seq=0 out_seq=0 2023-08-11T12:24:09.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.030+0000 7f5f99ffb700 10 client.15357 ms_handle_connect on v2:172.21.15.194:6834/2457430285 2023-08-11T12:24:09.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.031+0000 7f5f99ffb700 1 -- 172.21.15.8:0/2245179963 <== mds.2 v2:172.21.15.194:6834/2457430285 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55bff98c87d0 con 0x55bff99eb360 2023-08-11T12:24:09.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.031+0000 7f5f99ffb700 10 client.15357 handle_command_reply: tid=0 2023-08-11T12:24:09.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.031+0000 7f5fcc7e5b80 1 client.15357 shutdown 2023-08-11T12:24:09.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.031+0000 7f5fcc7e5b80 1 -- 172.21.15.8:0/2245179963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bff997eda0 msgr2=0x55bff9983540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:09.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.031+0000 7f5fcc7e5b80 1 --2- 172.21.15.8:0/2245179963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bff997eda0 0x55bff9983540 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5fac018960 tx=0x7f5fac0286e0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.031+0000 7f5fcc7e5b80 1 -- 172.21.15.8:0/2245179963 shutdown_connections 2023-08-11T12:24:09.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.031+0000 7f5fcc7e5b80 1 --2- 172.21.15.8:0/2245179963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bff997da80 0x55bff9983000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.031+0000 7f5fcc7e5b80 1 --2- 172.21.15.8:0/2245179963 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x55bff99eb360 0x55bff99e77b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.031+0000 7f5fcc7e5b80 1 --2- 172.21.15.8:0/2245179963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bff997eda0 0x55bff9983540 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.031+0000 7f5fcc7e5b80 1 --2- 172.21.15.8:0/2245179963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bff997e3e0 0x55bff999b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.031+0000 7f5f99ffb700 0 client.15357 ms_handle_reset on v2:172.21.15.194:6834/2457430285 2023-08-11T12:24:09.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.031+0000 7f5fcc7e5b80 1 -- 172.21.15.8:0/2245179963 >> 172.21.15.8:0/2245179963 conn(0x55bff98aa900 msgr2=0x55bff9978230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:09.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.031+0000 7f5fcc7e5b80 1 -- 172.21.15.8:0/2245179963 shutdown_connections 2023-08-11T12:24:09.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.031+0000 7f5fcc7e5b80 1 -- 172.21.15.8:0/2245179963 wait complete. 2023-08-11T12:24:09.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.031+0000 7f5fcc7e5b80 20 client.15357 trim_cache size 0 max 16384 2023-08-11T12:24:09.043 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:24:09.043 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "815f94ae-3840-11ee-9b37-001a4aab830c", 2023-08-11T12:24:09.043 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 2, 2023-08-11T12:24:09.043 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24517, 2023-08-11T12:24:09.043 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-08-11T12:24:09.043 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-08-11T12:24:09.044 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-08-11T12:24:09.044 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 99.357296262000006, 2023-08-11T12:24:09.044 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 27, 2023-08-11T12:24:09.044 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 89, 2023-08-11T12:24:09.044 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 89, 2023-08-11T12:24:09.044 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 147.00757296099999 2023-08-11T12:24:09.044 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:24:09.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.032+0000 7f5fb8dff700 1 -- 172.21.15.8:0/1423383392 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5fa009ff50 msgr2=0x7f5fa00a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:09.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.032+0000 7f5fb8dff700 1 --2- 172.21.15.8:0/1423383392 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5fa009ff50 0x7f5fa00a2410 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00adf0 tx=0x7f5fac00a410 comp rx=0 tx=0).stop 2023-08-11T12:24:09.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.032+0000 7f5fb8dff700 1 -- 172.21.15.8:0/1423383392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fb4101bf0 msgr2=0x7f5fb4198e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:09.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.032+0000 7f5fb8dff700 1 --2- 172.21.15.8:0/1423383392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fb4101bf0 0x7f5fb4198e30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c00d750 tx=0x7f5f9c00da60 comp rx=0 tx=0).stop 2023-08-11T12:24:09.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.032+0000 7f5fb8dff700 1 -- 172.21.15.8:0/1423383392 shutdown_connections 2023-08-11T12:24:09.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.032+0000 7f5fb8dff700 1 --2- 172.21.15.8:0/1423383392 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5fa009ff50 0x7f5fa00a2410 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.032+0000 7f5fb8dff700 1 --2- 172.21.15.8:0/1423383392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fb4100a00 0x7f5fb41988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.032+0000 7f5fb8dff700 1 --2- 172.21.15.8:0/1423383392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb4102590 0x7f5fb419fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.032+0000 7f5fb8dff700 1 --2- 172.21.15.8:0/1423383392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fb4101bf0 0x7f5fb4198e30 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.032+0000 7f5fb8dff700 1 -- 172.21.15.8:0/1423383392 >> 172.21.15.8:0/1423383392 conn(0x7f5fb40fbf70 msgr2=0x7f5fb4107530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:09.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.032+0000 7f5fb8dff700 1 -- 172.21.15.8:0/1423383392 shutdown_connections 2023-08-11T12:24:09.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.032+0000 7f5fb8dff700 1 -- 172.21.15.8:0/1423383392 wait complete. 2023-08-11T12:24:09.050 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:08 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1979264484' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:24:09.050 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:08 smithi008 ceph-mon[97158]: pgmap v338: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:24:09.052 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-08-11T12:24:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:08 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1979264484' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:24:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:08 smithi194 ceph-mon[130905]: pgmap v338: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:24:09.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:08 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1979264484' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:24:09.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:08 smithi045 ceph-mon[130284]: pgmap v338: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:24:09.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.254+0000 7fe3521ff700 1 -- 172.21.15.8:0/2583909061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe34c100a10 msgr2=0x7fe34c100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:09.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.254+0000 7fe3521ff700 1 --2- 172.21.15.8:0/2583909061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe34c100a10 0x7fe34c100e30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe33c009990 tx=0x7fe33c009ca0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.255+0000 7fe3521ff700 1 -- 172.21.15.8:0/2583909061 shutdown_connections 2023-08-11T12:24:09.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.255+0000 7fe3521ff700 1 --2- 172.21.15.8:0/2583909061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe34c100a10 0x7fe34c100e30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.255+0000 7fe3521ff700 1 --2- 172.21.15.8:0/2583909061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe34c1025a0 0x7fe34c108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.255+0000 7fe3521ff700 1 --2- 172.21.15.8:0/2583909061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe34c101c00 0x7fe34c102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.255+0000 7fe3521ff700 1 -- 172.21.15.8:0/2583909061 >> 172.21.15.8:0/2583909061 conn(0x7fe34c0fbf80 msgr2=0x7fe34c0fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:09.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.255+0000 7fe3521ff700 1 -- 172.21.15.8:0/2583909061 shutdown_connections 2023-08-11T12:24:09.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.255+0000 7fe3521ff700 1 -- 172.21.15.8:0/2583909061 wait complete. 2023-08-11T12:24:09.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.256+0000 7fe3521ff700 1 Processor -- start 2023-08-11T12:24:09.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.256+0000 7fe3521ff700 1 -- start start 2023-08-11T12:24:09.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.256+0000 7fe3521ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe34c100a10 0x7fe34c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.256+0000 7fe3521ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe34c101c00 0x7fe34c198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.256+0000 7fe3521ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe34c1025a0 0x7fe34c19fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.256+0000 7fe3521ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c1a0490 con 0x7fe34c101c00 2023-08-11T12:24:09.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.256+0000 7fe3521ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c1a05d0 con 0x7fe34c100a10 2023-08-11T12:24:09.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.256+0000 7fe3521ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c1a0760 con 0x7fe34c1025a0 2023-08-11T12:24:09.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.256+0000 7fe34affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe34c101c00 0x7fe34c198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.256+0000 7fe34affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe34c101c00 0x7fe34c198e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39540/0 (socket says 172.21.15.8:39540) 2023-08-11T12:24:09.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.256+0000 7fe34affd700 1 -- 172.21.15.8:0/55703222 learned_addr learned my addr 172.21.15.8:0/55703222 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:09.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.257+0000 7fe34bfff700 1 --2- 172.21.15.8:0/55703222 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe34c1025a0 0x7fe34c19fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.257+0000 7fe34b7fe700 1 --2- 172.21.15.8:0/55703222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe34c100a10 0x7fe34c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.257+0000 7fe34affd700 1 -- 172.21.15.8:0/55703222 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe34c1025a0 msgr2=0x7fe34c19fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:09.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.257+0000 7fe34affd700 1 --2- 172.21.15.8:0/55703222 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe34c1025a0 0x7fe34c19fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.257+0000 7fe34affd700 1 -- 172.21.15.8:0/55703222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe34c100a10 msgr2=0x7fe34c198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:09.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.257+0000 7fe34affd700 1 --2- 172.21.15.8:0/55703222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe34c100a10 0x7fe34c198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.257+0000 7fe34affd700 1 -- 172.21.15.8:0/55703222 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe344009c40 con 0x7fe34c101c00 2023-08-11T12:24:09.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.257+0000 7fe34affd700 1 --2- 172.21.15.8:0/55703222 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe34c101c00 0x7fe34c198e50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe34000e9a0 tx=0x7fe34000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:09.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.257+0000 7fe348ff9700 1 -- 172.21.15.8:0/55703222 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe340009790 con 0x7fe34c101c00 2023-08-11T12:24:09.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.257+0000 7fe3521ff700 1 -- 172.21.15.8:0/55703222 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe33c0095f0 con 0x7fe34c101c00 2023-08-11T12:24:09.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.257+0000 7fe348ff9700 1 -- 172.21.15.8:0/55703222 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe34000ce80 con 0x7fe34c101c00 2023-08-11T12:24:09.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.257+0000 7fe348ff9700 1 -- 172.21.15.8:0/55703222 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe340018680 con 0x7fe34c101c00 2023-08-11T12:24:09.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.258+0000 7fe3521ff700 1 -- 172.21.15.8:0/55703222 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe34c1a0dc0 con 0x7fe34c101c00 2023-08-11T12:24:09.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.261+0000 7fe348ff9700 1 -- 172.21.15.8:0/55703222 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fe340010430 con 0x7fe34c101c00 2023-08-11T12:24:09.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.262+0000 7fe365be2b80 1 Processor -- start 2023-08-11T12:24:09.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.262+0000 7fe348ff9700 1 --2- 172.21.15.8:0/55703222 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe33409ff50 0x7fe3340a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.262+0000 7fe365be2b80 1 -- start start 2023-08-11T12:24:09.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.262+0000 7fe348ff9700 1 -- 172.21.15.8:0/55703222 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fe340014070 con 0x7fe34c101c00 2023-08-11T12:24:09.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.263+0000 7fe34bfff700 1 --2- 172.21.15.8:0/55703222 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe33409ff50 0x7fe3340a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.263+0000 7fe365be2b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601ce5cca80 0x5601ce5ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.263+0000 7fe365be2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5601ce5cd3e0 0x5601ce5cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.263+0000 7fe365be2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601ce5cdda0 0x5601ce5ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.263+0000 7fe365be2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601ce5255e0 con 0x5601ce5cdda0 2023-08-11T12:24:09.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.263+0000 7fe365be2b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601ce522f00 con 0x5601ce5cca80 2023-08-11T12:24:09.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.263+0000 7fe365be2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601ce51e7f0 con 0x5601ce5cd3e0 2023-08-11T12:24:09.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.263+0000 7fe34b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601ce5cca80 0x5601ce5ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.263+0000 7fe34b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601ce5cca80 0x5601ce5ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:34606/0 (socket says 172.21.15.8:34606) 2023-08-11T12:24:09.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.263+0000 7fe34b7fe700 1 -- 172.21.15.8:0/2976978586 learned_addr learned my addr 172.21.15.8:0/2976978586 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:09.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.263+0000 7fe34bfff700 1 --2- 172.21.15.8:0/2976978586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601ce5cdda0 0x5601ce5ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.263+0000 7fe34affd700 1 --2- 172.21.15.8:0/2976978586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5601ce5cd3e0 0x5601ce5cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.263+0000 7fe34b7fe700 1 -- 172.21.15.8:0/2976978586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5601ce5cd3e0 msgr2=0x5601ce5cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:09.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.263+0000 7fe34b7fe700 1 --2- 172.21.15.8:0/2976978586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5601ce5cd3e0 0x5601ce5cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.263+0000 7fe34b7fe700 1 -- 172.21.15.8:0/2976978586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601ce5cdda0 msgr2=0x5601ce5ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:09.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.263+0000 7fe34b7fe700 1 --2- 172.21.15.8:0/2976978586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601ce5cdda0 0x5601ce5ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.263+0000 7fe34b7fe700 1 -- 172.21.15.8:0/2976978586 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601ce39e5e0 con 0x5601ce5cca80 2023-08-11T12:24:09.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.264+0000 7fe34bfff700 1 --2- 172.21.15.8:0/55703222 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe33409ff50 0x7fe3340a2410 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe344009fd0 tx=0x7fe34400fdd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:09.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.264+0000 7fe34b7fe700 1 --2- 172.21.15.8:0/2976978586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601ce5cca80 0x5601ce5ccea0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe33c009990 tx=0x7fe33c005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53e3ce0b524ace79 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:09.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.264+0000 7fe331ffb700 1 -- 172.21.15.8:0/2976978586 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c01d070 con 0x5601ce5cca80 2023-08-11T12:24:09.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.264+0000 7fe331ffb700 1 -- 172.21.15.8:0/2976978586 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe33c01e040 con 0x5601ce5cca80 2023-08-11T12:24:09.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.264+0000 7fe331ffb700 1 -- 172.21.15.8:0/2976978586 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c004820 con 0x5601ce5cca80 2023-08-11T12:24:09.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.265+0000 7fe365be2b80 1 -- 172.21.15.8:0/2976978586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601ce5cca80 msgr2=0x5601ce5ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:09.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.265+0000 7fe365be2b80 1 --2- 172.21.15.8:0/2976978586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601ce5cca80 0x5601ce5ccea0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe33c009990 tx=0x7fe33c005c00 comp rx=0 tx=0).stop 2023-08-11T12:24:09.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.265+0000 7fe365be2b80 1 -- 172.21.15.8:0/2976978586 shutdown_connections 2023-08-11T12:24:09.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.265+0000 7fe365be2b80 1 --2- 172.21.15.8:0/2976978586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601ce5cdda0 0x5601ce5ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.265+0000 7fe365be2b80 1 --2- 172.21.15.8:0/2976978586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601ce5cca80 0x5601ce5ccea0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.265+0000 7fe365be2b80 1 --2- 172.21.15.8:0/2976978586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5601ce5cd3e0 0x5601ce5cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.265+0000 7fe365be2b80 1 -- 172.21.15.8:0/2976978586 >> 172.21.15.8:0/2976978586 conn(0x5601ce4f9900 msgr2=0x5601ce5c73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:09.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.265+0000 7fe365be2b80 1 -- 172.21.15.8:0/2976978586 shutdown_connections 2023-08-11T12:24:09.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.265+0000 7fe365be2b80 1 -- 172.21.15.8:0/2976978586 wait complete. 2023-08-11T12:24:09.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.266+0000 7fe365be2b80 1 -- start start 2023-08-11T12:24:09.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.266+0000 7fe365be2b80 1 Processor -- start 2023-08-11T12:24:09.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.266+0000 7fe365be2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5601ce5cca80 0x5601ce5d6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.266+0000 7fe365be2b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601ce5cd3e0 0x5601ce5d6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.266+0000 7fe365be2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601ce5cdda0 0x5601ce5dd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.266+0000 7fe365be2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601ce4bca70 con 0x5601ce5cdda0 2023-08-11T12:24:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.266+0000 7fe365be2b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601ce4bc770 con 0x5601ce5cd3e0 2023-08-11T12:24:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.266+0000 7fe365be2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601ce3a08d0 con 0x5601ce5cca80 2023-08-11T12:24:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.266+0000 7fe365be2b80 10 client.0 _ll_register_callbacks cb 0x5601ce4bfa60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.267+0000 7fe34b7fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5601ce5cca80 0x5601ce5d6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.267+0000 7fe34b7fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5601ce5cca80 0x5601ce5d6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:42906/0 (socket says 172.21.15.8:42906) 2023-08-11T12:24:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.267+0000 7fe34bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601ce5cdda0 0x5601ce5dd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.267+0000 7fe34b7fe700 1 -- 172.21.15.8:0/511028559 learned_addr learned my addr 172.21.15.8:0/511028559 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:09.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.267+0000 7fe34affd700 1 --2- 172.21.15.8:0/511028559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601ce5cd3e0 0x5601ce5d6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.267+0000 7fe34b7fe700 1 -- 172.21.15.8:0/511028559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601ce5cd3e0 msgr2=0x5601ce5d6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:09.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.267+0000 7fe34b7fe700 1 --2- 172.21.15.8:0/511028559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601ce5cd3e0 0x5601ce5d6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.267+0000 7fe34b7fe700 1 -- 172.21.15.8:0/511028559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601ce5cdda0 msgr2=0x5601ce5dd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:09.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.267+0000 7fe34b7fe700 1 --2- 172.21.15.8:0/511028559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601ce5cdda0 0x5601ce5dd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.267+0000 7fe34b7fe700 1 -- 172.21.15.8:0/511028559 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe34c1097a0 con 0x5601ce5cca80 2023-08-11T12:24:09.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.267+0000 7fe34bfff700 1 --2- 172.21.15.8:0/511028559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601ce5cdda0 0x5601ce5dd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:09.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.267+0000 7fe34affd700 1 --2- 172.21.15.8:0/511028559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601ce5cd3e0 0x5601ce5d6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:24:09.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.267+0000 7fe34b7fe700 1 --2- 172.21.15.8:0/511028559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5601ce5cca80 0x5601ce5d6050 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe33c00b680 tx=0x7fe33c00b480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a04c784d77acdedf server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:09.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.267+0000 7fe32affd700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:24:09.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.268+0000 7fe32affd700 1 -- 172.21.15.8:0/511028559 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c01d040 con 0x5601ce5cca80 2023-08-11T12:24:09.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.268+0000 7fe365be2b80 1 -- 172.21.15.8:0/511028559 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5601ce5bfa40 con 0x5601ce5cca80 2023-08-11T12:24:09.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.268+0000 7fe32affd700 1 -- 172.21.15.8:0/511028559 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fe33c005460 con 0x5601ce5cca80 2023-08-11T12:24:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.268+0000 7fe32affd700 1 -- 172.21.15.8:0/511028559 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe33c00f980 con 0x5601ce5cca80 2023-08-11T12:24:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.268+0000 7fe365be2b80 10 client.25399 fetch_fsmap learned FSMap version 27 2023-08-11T12:24:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.268+0000 7fe365be2b80 1 -- 172.21.15.8:0/511028559 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5601ce34ad90 con 0x5601ce5cca80 2023-08-11T12:24:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.268+0000 7fe32affd700 1 -- 172.21.15.8:0/511028559 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5601ce5bfa40 con 0x5601ce5cca80 2023-08-11T12:24:09.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.268+0000 7fe32affd700 1 -- 172.21.15.8:0/511028559 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe33c022400 con 0x5601ce5cca80 2023-08-11T12:24:09.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.269+0000 7fe365be2b80 10 client.25399 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:24:09.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.269+0000 7fe365be2b80 10 client.25399 resolve_mds: resolved name 'i' to daemon mds.i 2023-08-11T12:24:09.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.269+0000 7fe365be2b80 20 client.25399 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:09.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.269+0000 7fe365be2b80 1 --2- 172.21.15.8:0/511028559 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x5601ce5e17e0 0x5601ce5e0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.269+0000 7fe365be2b80 4 client.25399 mds_command: new command op to 24550 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:24:09.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.269+0000 7fe365be2b80 1 -- 172.21.15.8:0/511028559 --> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5601ce59b490 con 0x5601ce5e17e0 2023-08-11T12:24:09.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.269+0000 7fe34affd700 1 --2- 172.21.15.8:0/511028559 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x5601ce5e17e0 0x5601ce5e0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.270+0000 7fe34affd700 1 --2- 172.21.15.8:0/511028559 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x5601ce5e17e0 0x5601ce5e0500 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=45dd9d14997233b0 server_cookie=199af82233c5bd64 in_seq=0 out_seq=0 2023-08-11T12:24:09.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.270+0000 7fe32affd700 10 client.25399 ms_handle_connect on v2:172.21.15.194:6838/2174476491 2023-08-11T12:24:09.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.270+0000 7fe32affd700 1 -- 172.21.15.8:0/511028559 <== mds.1 v2:172.21.15.194:6838/2174476491 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5601ce59b490 con 0x5601ce5e17e0 2023-08-11T12:24:09.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.270+0000 7fe32affd700 10 client.25399 handle_command_reply: tid=0 2023-08-11T12:24:09.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.270+0000 7fe365be2b80 1 client.25399 shutdown 2023-08-11T12:24:09.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.271+0000 7fe365be2b80 1 -- 172.21.15.8:0/511028559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5601ce5cca80 msgr2=0x5601ce5d6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:09.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.271+0000 7fe365be2b80 1 --2- 172.21.15.8:0/511028559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5601ce5cca80 0x5601ce5d6050 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe33c00b680 tx=0x7fe33c00b480 comp rx=0 tx=0).stop 2023-08-11T12:24:09.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.271+0000 7fe365be2b80 1 -- 172.21.15.8:0/511028559 shutdown_connections 2023-08-11T12:24:09.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.271+0000 7fe365be2b80 1 --2- 172.21.15.8:0/511028559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5601ce5cca80 0x5601ce5d6050 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.271+0000 7fe365be2b80 1 --2- 172.21.15.8:0/511028559 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x5601ce5e17e0 0x5601ce5e0500 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.271+0000 7fe365be2b80 1 --2- 172.21.15.8:0/511028559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601ce5cdda0 0x5601ce5dd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.271+0000 7fe365be2b80 1 --2- 172.21.15.8:0/511028559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601ce5cd3e0 0x5601ce5d6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.271+0000 7fe32affd700 0 client.25399 ms_handle_reset on v2:172.21.15.194:6838/2174476491 2023-08-11T12:24:09.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.271+0000 7fe365be2b80 1 -- 172.21.15.8:0/511028559 >> 172.21.15.8:0/511028559 conn(0x5601ce4f9900 msgr2=0x5601ce5c1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:09.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.271+0000 7fe365be2b80 1 -- 172.21.15.8:0/511028559 shutdown_connections 2023-08-11T12:24:09.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.271+0000 7fe365be2b80 1 -- 172.21.15.8:0/511028559 wait complete. 2023-08-11T12:24:09.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.271+0000 7fe365be2b80 20 client.25399 trim_cache size 0 max 16384 2023-08-11T12:24:09.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.289+0000 7fe365be2b80 1 Processor -- start 2023-08-11T12:24:09.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.289+0000 7fe365be2b80 1 -- start start 2023-08-11T12:24:09.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.290+0000 7fe365be2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5601ce5cca80 0x5601ce5d0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.290+0000 7fe365be2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601ce5cd3e0 0x5601ce5d11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.290+0000 7fe365be2b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601ce5cdda0 0x5601ce5ea140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.290+0000 7fe365be2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601ce5e2570 con 0x5601ce5cd3e0 2023-08-11T12:24:09.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.290+0000 7fe365be2b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601ce4e8c30 con 0x5601ce5cdda0 2023-08-11T12:24:09.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.290+0000 7fe365be2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601ce3acde0 con 0x5601ce5cca80 2023-08-11T12:24:09.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.290+0000 7fe34affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601ce5cd3e0 0x5601ce5d11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.290+0000 7fe34b7fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5601ce5cca80 0x5601ce5d0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.290+0000 7fe34affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601ce5cd3e0 0x5601ce5d11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39576/0 (socket says 172.21.15.8:39576) 2023-08-11T12:24:09.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.290+0000 7fe34b7fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5601ce5cca80 0x5601ce5d0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:42908/0 (socket says 172.21.15.8:42908) 2023-08-11T12:24:09.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.290+0000 7fe34b7fe700 1 -- 172.21.15.8:0/945808956 learned_addr learned my addr 172.21.15.8:0/945808956 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:09.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.290+0000 7fe34bfff700 1 --2- 172.21.15.8:0/945808956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601ce5cdda0 0x5601ce5ea140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.291+0000 7fe34affd700 1 -- 172.21.15.8:0/945808956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5601ce5cca80 msgr2=0x5601ce5d0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:09.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.291+0000 7fe34affd700 1 --2- 172.21.15.8:0/945808956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5601ce5cca80 0x5601ce5d0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.291+0000 7fe34affd700 1 -- 172.21.15.8:0/945808956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601ce5cdda0 msgr2=0x5601ce5ea140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:09.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.291+0000 7fe34affd700 1 --2- 172.21.15.8:0/945808956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601ce5cdda0 0x5601ce5ea140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.291+0000 7fe34affd700 1 -- 172.21.15.8:0/945808956 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601ce333c10 con 0x5601ce5cd3e0 2023-08-11T12:24:09.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.291+0000 7fe34b7fe700 1 --2- 172.21.15.8:0/945808956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5601ce5cca80 0x5601ce5d0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:09.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.291+0000 7fe34affd700 1 --2- 172.21.15.8:0/945808956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601ce5cd3e0 0x5601ce5d11a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe34000c5b0 tx=0x7fe3400c8e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53542817a6d8f95d server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:09.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.291+0000 7fe3327fc700 1 -- 172.21.15.8:0/945808956 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe340098ec0 con 0x5601ce5cd3e0 2023-08-11T12:24:09.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.291+0000 7fe3327fc700 1 -- 172.21.15.8:0/945808956 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe34009ccf0 con 0x5601ce5cd3e0 2023-08-11T12:24:09.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.291+0000 7fe3327fc700 1 -- 172.21.15.8:0/945808956 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3400983b0 con 0x5601ce5cd3e0 2023-08-11T12:24:09.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.292+0000 7fe365be2b80 1 -- 172.21.15.8:0/945808956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601ce5cd3e0 msgr2=0x5601ce5d11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:09.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.292+0000 7fe365be2b80 1 --2- 172.21.15.8:0/945808956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601ce5cd3e0 0x5601ce5d11a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe34000c5b0 tx=0x7fe3400c8e40 comp rx=0 tx=0).stop 2023-08-11T12:24:09.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.292+0000 7fe365be2b80 1 -- 172.21.15.8:0/945808956 shutdown_connections 2023-08-11T12:24:09.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.292+0000 7fe365be2b80 1 --2- 172.21.15.8:0/945808956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5601ce5cca80 0x5601ce5d0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.292+0000 7fe365be2b80 1 --2- 172.21.15.8:0/945808956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601ce5cdda0 0x5601ce5ea140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.292+0000 7fe365be2b80 1 --2- 172.21.15.8:0/945808956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601ce5cd3e0 0x5601ce5d11a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.292+0000 7fe365be2b80 1 -- 172.21.15.8:0/945808956 >> 172.21.15.8:0/945808956 conn(0x5601ce4f9900 msgr2=0x5601ce5c73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:09.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.292+0000 7fe365be2b80 1 -- 172.21.15.8:0/945808956 shutdown_connections 2023-08-11T12:24:09.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.292+0000 7fe365be2b80 1 -- 172.21.15.8:0/945808956 wait complete. 2023-08-11T12:24:09.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.292+0000 7fe365be2b80 1 -- start start 2023-08-11T12:24:09.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.292+0000 7fe365be2b80 1 Processor -- start 2023-08-11T12:24:09.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.293+0000 7fe365be2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5601ce5cca80 0x5601ce5e4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.293+0000 7fe365be2b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601ce5cd3e0 0x5601ce5e4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.293+0000 7fe365be2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601ce5cdda0 0x5601ce5e9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.293+0000 7fe365be2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601ce5e9fa0 con 0x5601ce5cdda0 2023-08-11T12:24:09.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.293+0000 7fe365be2b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601ce5ea110 con 0x5601ce5cd3e0 2023-08-11T12:24:09.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.293+0000 7fe365be2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601ce5ea2d0 con 0x5601ce5cca80 2023-08-11T12:24:09.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.293+0000 7fe365be2b80 10 client.0 _ll_register_callbacks cb 0x7fe34401e050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:09.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.293+0000 7fe34bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601ce5cdda0 0x5601ce5e9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.293+0000 7fe34bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601ce5cdda0 0x5601ce5e9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39590/0 (socket says 172.21.15.8:39590) 2023-08-11T12:24:09.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.293+0000 7fe34bfff700 1 -- 172.21.15.8:0/333507206 learned_addr learned my addr 172.21.15.8:0/333507206 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:09.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.293+0000 7fe34affd700 1 --2- 172.21.15.8:0/333507206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601ce5cd3e0 0x5601ce5e4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.293+0000 7fe34b7fe700 1 --2- 172.21.15.8:0/333507206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5601ce5cca80 0x5601ce5e4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.294+0000 7fe34bfff700 1 -- 172.21.15.8:0/333507206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5601ce5cca80 msgr2=0x5601ce5e4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:09.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.294+0000 7fe34bfff700 1 --2- 172.21.15.8:0/333507206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5601ce5cca80 0x5601ce5e4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.294+0000 7fe34bfff700 1 -- 172.21.15.8:0/333507206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601ce5cd3e0 msgr2=0x5601ce5e4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:09.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.294+0000 7fe34bfff700 1 --2- 172.21.15.8:0/333507206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601ce5cd3e0 0x5601ce5e4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.294+0000 7fe34bfff700 1 -- 172.21.15.8:0/333507206 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5601ce34ad90 con 0x5601ce5cdda0 2023-08-11T12:24:09.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.294+0000 7fe34bfff700 1 --2- 172.21.15.8:0/333507206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601ce5cdda0 0x5601ce5e9a60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe344018f60 tx=0x7fe344004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0adc75d5f6e822 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:09.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.294+0000 7fe32affd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:24:09.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.294+0000 7fe32affd700 1 -- 172.21.15.8:0/333507206 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34400e040 con 0x5601ce5cdda0 2023-08-11T12:24:09.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.294+0000 7fe365be2b80 1 -- 172.21.15.8:0/333507206 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe33c01e040 con 0x5601ce5cdda0 2023-08-11T12:24:09.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.294+0000 7fe32affd700 1 -- 172.21.15.8:0/333507206 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fe3440044d0 con 0x5601ce5cdda0 2023-08-11T12:24:09.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.294+0000 7fe32affd700 1 -- 172.21.15.8:0/333507206 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe344004690 con 0x5601ce5cdda0 2023-08-11T12:24:09.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.294+0000 7fe365be2b80 10 client.15375 fetch_fsmap learned FSMap version 27 2023-08-11T12:24:09.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.294+0000 7fe365be2b80 1 -- 172.21.15.8:0/333507206 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fe34c1a0dc0 con 0x5601ce5cdda0 2023-08-11T12:24:09.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.295+0000 7fe32affd700 1 -- 172.21.15.8:0/333507206 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe33c01e040 con 0x5601ce5cdda0 2023-08-11T12:24:09.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.295+0000 7fe32affd700 1 -- 172.21.15.8:0/333507206 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe34402f470 con 0x5601ce5cdda0 2023-08-11T12:24:09.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.295+0000 7fe365be2b80 10 client.15375 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:24:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.295+0000 7fe365be2b80 10 client.15375 resolve_mds: resolved name 'i' to daemon mds.i 2023-08-11T12:24:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.295+0000 7fe365be2b80 20 client.15375 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.295+0000 7fe365be2b80 1 --2- 172.21.15.8:0/333507206 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x5601ce639fa0 0x5601ce636420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.295+0000 7fe365be2b80 4 client.15375 mds_command: new command op to 24550 tid=0[{"prefix": "status"}] 2023-08-11T12:24:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.295+0000 7fe365be2b80 1 -- 172.21.15.8:0/333507206 --> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5601ce5177d0 con 0x5601ce639fa0 2023-08-11T12:24:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.295+0000 7fe34b7fe700 1 --2- 172.21.15.8:0/333507206 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x5601ce639fa0 0x5601ce636420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.296+0000 7fe34b7fe700 1 --2- 172.21.15.8:0/333507206 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x5601ce639fa0 0x5601ce636420 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8ee860b538aaf173 server_cookie=6771d1e4a5504be7 in_seq=0 out_seq=0 2023-08-11T12:24:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.296+0000 7fe32affd700 10 client.15375 ms_handle_connect on v2:172.21.15.194:6838/2174476491 2023-08-11T12:24:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.296+0000 7fe32affd700 1 -- 172.21.15.8:0/333507206 <== mds.1 v2:172.21.15.194:6838/2174476491 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x5601ce5177d0 con 0x5601ce639fa0 2023-08-11T12:24:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.296+0000 7fe32affd700 10 client.15375 handle_command_reply: tid=0 2023-08-11T12:24:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.296+0000 7fe365be2b80 1 client.15375 shutdown 2023-08-11T12:24:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.296+0000 7fe365be2b80 1 -- 172.21.15.8:0/333507206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601ce5cdda0 msgr2=0x5601ce5e9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.296+0000 7fe365be2b80 1 --2- 172.21.15.8:0/333507206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601ce5cdda0 0x5601ce5e9a60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe344018f60 tx=0x7fe344004b40 comp rx=0 tx=0).stop 2023-08-11T12:24:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.296+0000 7fe365be2b80 1 -- 172.21.15.8:0/333507206 shutdown_connections 2023-08-11T12:24:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.296+0000 7fe365be2b80 1 --2- 172.21.15.8:0/333507206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5601ce5cca80 0x5601ce5e4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.296+0000 7fe365be2b80 1 --2- 172.21.15.8:0/333507206 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x5601ce639fa0 0x5601ce636420 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.296+0000 7fe365be2b80 1 --2- 172.21.15.8:0/333507206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601ce5cdda0 0x5601ce5e9a60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.296+0000 7fe365be2b80 1 --2- 172.21.15.8:0/333507206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601ce5cd3e0 0x5601ce5e4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.296+0000 7fe32affd700 0 client.15375 ms_handle_reset on v2:172.21.15.194:6838/2174476491 2023-08-11T12:24:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.296+0000 7fe365be2b80 1 -- 172.21.15.8:0/333507206 >> 172.21.15.8:0/333507206 conn(0x5601ce4f9900 msgr2=0x5601ce5e0500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:09.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.296+0000 7fe365be2b80 1 -- 172.21.15.8:0/333507206 shutdown_connections 2023-08-11T12:24:09.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.296+0000 7fe365be2b80 1 -- 172.21.15.8:0/333507206 wait complete. 2023-08-11T12:24:09.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.297+0000 7fe365be2b80 20 client.15375 trim_cache size 0 max 16384 2023-08-11T12:24:09.309 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:24:09.309 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "815f94ae-3840-11ee-9b37-001a4aab830c", 2023-08-11T12:24:09.310 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 1, 2023-08-11T12:24:09.310 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24550, 2023-08-11T12:24:09.310 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-08-11T12:24:09.310 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-08-11T12:24:09.310 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-08-11T12:24:09.310 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 100.58324313, 2023-08-11T12:24:09.311 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 27, 2023-08-11T12:24:09.311 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 89, 2023-08-11T12:24:09.311 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 89, 2023-08-11T12:24:09.311 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 140.50364989600001 2023-08-11T12:24:09.311 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:24:09.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.297+0000 7fe3521ff700 1 -- 172.21.15.8:0/55703222 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe33409ff50 msgr2=0x7fe3340a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:09.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.297+0000 7fe3521ff700 1 --2- 172.21.15.8:0/55703222 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe33409ff50 0x7fe3340a2410 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe344009fd0 tx=0x7fe34400fdd0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.297+0000 7fe3521ff700 1 -- 172.21.15.8:0/55703222 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe34c101c00 msgr2=0x7fe34c198e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:09.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.297+0000 7fe3521ff700 1 --2- 172.21.15.8:0/55703222 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe34c101c00 0x7fe34c198e50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe34000e9a0 tx=0x7fe34000ecb0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.297+0000 7fe3521ff700 1 -- 172.21.15.8:0/55703222 shutdown_connections 2023-08-11T12:24:09.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.297+0000 7fe3521ff700 1 --2- 172.21.15.8:0/55703222 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe33409ff50 0x7fe3340a2410 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.297+0000 7fe3521ff700 1 --2- 172.21.15.8:0/55703222 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe34c1025a0 0x7fe34c19fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.297+0000 7fe3521ff700 1 --2- 172.21.15.8:0/55703222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe34c100a10 0x7fe34c198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.297+0000 7fe3521ff700 1 --2- 172.21.15.8:0/55703222 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe34c101c00 0x7fe34c198e50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.297+0000 7fe3521ff700 1 -- 172.21.15.8:0/55703222 >> 172.21.15.8:0/55703222 conn(0x7fe34c0fbf80 msgr2=0x7fe34c1074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:09.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.297+0000 7fe3521ff700 1 -- 172.21.15.8:0/55703222 shutdown_connections 2023-08-11T12:24:09.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.297+0000 7fe3521ff700 1 -- 172.21.15.8:0/55703222 wait complete. 2023-08-11T12:24:09.317 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-08-11T12:24:09.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.520+0000 7f3e9d9ff700 1 -- 172.21.15.8:0/3123745523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e98101bf0 msgr2=0x7f3e98102050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:09.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.520+0000 7f3e9d9ff700 1 --2- 172.21.15.8:0/3123745523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e98101bf0 0x7f3e98102050 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c0099c0 tx=0x7f3e8c009cd0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.520+0000 7f3e9d9ff700 1 -- 172.21.15.8:0/3123745523 shutdown_connections 2023-08-11T12:24:09.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.520+0000 7f3e9d9ff700 1 --2- 172.21.15.8:0/3123745523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e98102590 0x7f3e98108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.520+0000 7f3e9d9ff700 1 --2- 172.21.15.8:0/3123745523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e98100a00 0x7f3e98100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.520+0000 7f3e9d9ff700 1 --2- 172.21.15.8:0/3123745523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e98101bf0 0x7f3e98102050 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.520+0000 7f3e9d9ff700 1 -- 172.21.15.8:0/3123745523 >> 172.21.15.8:0/3123745523 conn(0x7f3e980fbf70 msgr2=0x7f3e980fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:09.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.520+0000 7f3e9d9ff700 1 -- 172.21.15.8:0/3123745523 shutdown_connections 2023-08-11T12:24:09.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.520+0000 7f3e9d9ff700 1 -- 172.21.15.8:0/3123745523 wait complete. 2023-08-11T12:24:09.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.521+0000 7f3e9d9ff700 1 Processor -- start 2023-08-11T12:24:09.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.521+0000 7f3e9d9ff700 1 -- start start 2023-08-11T12:24:09.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.522+0000 7f3e9d9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e98100a00 0x7f3e981988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.522+0000 7f3e9d9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e98101bf0 0x7f3e98198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.522+0000 7f3e9d9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e98102590 0x7f3e9819fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.522+0000 7f3e9d9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e981a0460 con 0x7f3e98101bf0 2023-08-11T12:24:09.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.522+0000 7f3e9d9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e981a05a0 con 0x7f3e98102590 2023-08-11T12:24:09.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.522+0000 7f3e9d9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e981a0730 con 0x7f3e98100a00 2023-08-11T12:24:09.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.522+0000 7f3e967fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e98101bf0 0x7f3e98198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.522+0000 7f3e967fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e98101bf0 0x7f3e98198e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39610/0 (socket says 172.21.15.8:39610) 2023-08-11T12:24:09.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.522+0000 7f3e967fc700 1 -- 172.21.15.8:0/59330132 learned_addr learned my addr 172.21.15.8:0/59330132 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:09.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.522+0000 7f3e977fe700 1 --2- 172.21.15.8:0/59330132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e98102590 0x7f3e9819fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.522+0000 7f3e96ffd700 1 --2- 172.21.15.8:0/59330132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e98100a00 0x7f3e981988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.522+0000 7f3e967fc700 1 -- 172.21.15.8:0/59330132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e98100a00 msgr2=0x7f3e981988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:09.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.522+0000 7f3e967fc700 1 --2- 172.21.15.8:0/59330132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e98100a00 0x7f3e981988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.522+0000 7f3e967fc700 1 -- 172.21.15.8:0/59330132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e98102590 msgr2=0x7f3e9819fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:09.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.522+0000 7f3e967fc700 1 --2- 172.21.15.8:0/59330132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e98102590 0x7f3e9819fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.522+0000 7f3e967fc700 1 -- 172.21.15.8:0/59330132 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e88009520 con 0x7f3e98101bf0 2023-08-11T12:24:09.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.522+0000 7f3e96ffd700 1 --2- 172.21.15.8:0/59330132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e98100a00 0x7f3e981988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:24:09.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.523+0000 7f3e967fc700 1 --2- 172.21.15.8:0/59330132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e98101bf0 0x7f3e98198e20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c00bf40 tx=0x7f3e8c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:09.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.523+0000 7f3e9c9fd700 1 -- 172.21.15.8:0/59330132 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c01d070 con 0x7f3e98101bf0 2023-08-11T12:24:09.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.523+0000 7f3e9c9fd700 1 -- 172.21.15.8:0/59330132 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e8c005510 con 0x7f3e98101bf0 2023-08-11T12:24:09.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.523+0000 7f3e9c9fd700 1 -- 172.21.15.8:0/59330132 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c004c00 con 0x7f3e98101bf0 2023-08-11T12:24:09.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.523+0000 7f3e9d9ff700 1 -- 172.21.15.8:0/59330132 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e8c0095f0 con 0x7f3e98101bf0 2023-08-11T12:24:09.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.523+0000 7f3e9d9ff700 1 -- 172.21.15.8:0/59330132 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e981a0bf0 con 0x7f3e98101bf0 2023-08-11T12:24:09.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.526+0000 7f3e9c9fd700 1 -- 172.21.15.8:0/59330132 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f3e8c00fb80 con 0x7f3e98101bf0 2023-08-11T12:24:09.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.527+0000 7f3eb1249b80 1 Processor -- start 2023-08-11T12:24:09.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.528+0000 7f3eb1249b80 1 -- start start 2023-08-11T12:24:09.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.528+0000 7f3e9c9fd700 1 --2- 172.21.15.8:0/59330132 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3e8009ff50 0x7f3e800a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.528+0000 7f3eb1249b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf5672a80 0x562cf5672ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.528+0000 7f3eb1249b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cf56733e0 0x562cf5673860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.528+0000 7f3eb1249b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf5673da0 0x562cf5674220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.528+0000 7f3eb1249b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf55cb5e0 con 0x562cf5673da0 2023-08-11T12:24:09.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.528+0000 7f3e9c9fd700 1 -- 172.21.15.8:0/59330132 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f3e8c0cc530 con 0x7f3e98101bf0 2023-08-11T12:24:09.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.528+0000 7f3eb1249b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf55c8f00 con 0x562cf5672a80 2023-08-11T12:24:09.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.528+0000 7f3eb1249b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf55c47f0 con 0x562cf56733e0 2023-08-11T12:24:09.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.528+0000 7f3e977fe700 1 --2- 172.21.15.8:0/59330132 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3e8009ff50 0x7f3e800a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.528+0000 7f3e977fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf5673da0 0x562cf5674220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.528+0000 7f3e96ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf5672a80 0x562cf5672ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.528+0000 7f3e977fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf5673da0 0x562cf5674220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39626/0 (socket says 172.21.15.8:39626) 2023-08-11T12:24:09.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.528+0000 7f3e977fe700 1 -- 172.21.15.8:0/4070792522 learned_addr learned my addr 172.21.15.8:0/4070792522 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:09.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.528+0000 7f3e967fc700 1 --2- 172.21.15.8:0/4070792522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cf56733e0 0x562cf5673860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.529+0000 7f3e977fe700 1 -- 172.21.15.8:0/4070792522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cf56733e0 msgr2=0x562cf5673860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:09.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.529+0000 7f3e977fe700 1 --2- 172.21.15.8:0/4070792522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cf56733e0 0x562cf5673860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.529+0000 7f3e977fe700 1 -- 172.21.15.8:0/4070792522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf5672a80 msgr2=0x562cf5672ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:09.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.529+0000 7f3e977fe700 1 --2- 172.21.15.8:0/4070792522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf5672a80 0x562cf5672ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.529+0000 7f3e977fe700 1 -- 172.21.15.8:0/4070792522 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562cf54445e0 con 0x562cf5673da0 2023-08-11T12:24:09.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.529+0000 7f3e977fe700 1 --2- 172.21.15.8:0/59330132 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3e8009ff50 0x7f3e800a2410 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009fd0 tx=0x7f3e90009d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:09.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.529+0000 7f3e977fe700 1 --2- 172.21.15.8:0/4070792522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf5673da0 0x562cf5674220 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3e900076b0 tx=0x7f3e9001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2ad8effb663701 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:09.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.529+0000 7f3e7dffb700 1 -- 172.21.15.8:0/4070792522 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e90027070 con 0x562cf5673da0 2023-08-11T12:24:09.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.529+0000 7f3e7dffb700 1 -- 172.21.15.8:0/4070792522 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e90009460 con 0x562cf5673da0 2023-08-11T12:24:09.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.529+0000 7f3e7dffb700 1 -- 172.21.15.8:0/4070792522 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e90004bb0 con 0x562cf5673da0 2023-08-11T12:24:09.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.530+0000 7f3eb1249b80 1 -- 172.21.15.8:0/4070792522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf5673da0 msgr2=0x562cf5674220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:09.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.530+0000 7f3eb1249b80 1 --2- 172.21.15.8:0/4070792522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf5673da0 0x562cf5674220 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3e900076b0 tx=0x7f3e9001c000 comp rx=0 tx=0).stop 2023-08-11T12:24:09.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.530+0000 7f3eb1249b80 1 -- 172.21.15.8:0/4070792522 shutdown_connections 2023-08-11T12:24:09.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.530+0000 7f3eb1249b80 1 --2- 172.21.15.8:0/4070792522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf5673da0 0x562cf5674220 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.530+0000 7f3eb1249b80 1 --2- 172.21.15.8:0/4070792522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf5672a80 0x562cf5672ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.530+0000 7f3eb1249b80 1 --2- 172.21.15.8:0/4070792522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cf56733e0 0x562cf5673860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.530+0000 7f3eb1249b80 1 -- 172.21.15.8:0/4070792522 >> 172.21.15.8:0/4070792522 conn(0x562cf559f900 msgr2=0x562cf566d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:09.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.530+0000 7f3eb1249b80 1 -- 172.21.15.8:0/4070792522 shutdown_connections 2023-08-11T12:24:09.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.530+0000 7f3eb1249b80 1 -- 172.21.15.8:0/4070792522 wait complete. 2023-08-11T12:24:09.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.531+0000 7f3eb1249b80 1 -- start start 2023-08-11T12:24:09.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.531+0000 7f3eb1249b80 1 Processor -- start 2023-08-11T12:24:09.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.531+0000 7f3eb1249b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cf5672a80 0x562cf567c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.531+0000 7f3eb1249b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf56733e0 0x562cf567c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.531+0000 7f3eb1249b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf5673da0 0x562cf56836b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.531+0000 7f3eb1249b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf5562a70 con 0x562cf56733e0 2023-08-11T12:24:09.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.531+0000 7f3eb1249b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf5562770 con 0x562cf5673da0 2023-08-11T12:24:09.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.531+0000 7f3eb1249b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf54468d0 con 0x562cf5672a80 2023-08-11T12:24:09.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.532+0000 7f3eb1249b80 10 client.0 _ll_register_callbacks cb 0x562cf5565a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:09.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.532+0000 7f3e967fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf56733e0 0x562cf567c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.532+0000 7f3e96ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cf5672a80 0x562cf567c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.532+0000 7f3e967fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf56733e0 0x562cf567c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39636/0 (socket says 172.21.15.8:39636) 2023-08-11T12:24:09.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.532+0000 7f3e967fc700 1 -- 172.21.15.8:0/4001370520 learned_addr learned my addr 172.21.15.8:0/4001370520 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:09.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.532+0000 7f3e977fe700 1 --2- 172.21.15.8:0/4001370520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf5673da0 0x562cf56836b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.532+0000 7f3e967fc700 1 -- 172.21.15.8:0/4001370520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cf5672a80 msgr2=0x562cf567c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:09.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.532+0000 7f3e967fc700 1 --2- 172.21.15.8:0/4001370520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cf5672a80 0x562cf567c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.532+0000 7f3e967fc700 1 -- 172.21.15.8:0/4001370520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf5673da0 msgr2=0x562cf56836b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:09.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.532+0000 7f3e967fc700 1 --2- 172.21.15.8:0/4001370520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf5673da0 0x562cf56836b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.532+0000 7f3e967fc700 1 -- 172.21.15.8:0/4001370520 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e90011040 con 0x562cf56733e0 2023-08-11T12:24:09.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.532+0000 7f3e967fc700 1 --2- 172.21.15.8:0/4001370520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf56733e0 0x562cf567c670 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c0095c0 tx=0x7f3e8c09a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c93adf204b353e26 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:09.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.532+0000 7f3e76ffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:24:09.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.533+0000 7f3e76ffd700 1 -- 172.21.15.8:0/4001370520 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c09a3a0 con 0x562cf56733e0 2023-08-11T12:24:09.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.533+0000 7f3eb1249b80 1 -- 172.21.15.8:0/4001370520 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562cf5641490 con 0x562cf56733e0 2023-08-11T12:24:09.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.533+0000 7f3e76ffd700 1 -- 172.21.15.8:0/4001370520 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f3e8c099ca0 con 0x562cf56733e0 2023-08-11T12:24:09.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.533+0000 7f3e76ffd700 1 -- 172.21.15.8:0/4001370520 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e8c09dad0 con 0x562cf56733e0 2023-08-11T12:24:09.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.533+0000 7f3eb1249b80 10 client.15387 fetch_fsmap learned FSMap version 27 2023-08-11T12:24:09.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.533+0000 7f3eb1249b80 1 -- 172.21.15.8:0/4001370520 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x562cf53f0d90 con 0x562cf56733e0 2023-08-11T12:24:09.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.533+0000 7f3e76ffd700 1 -- 172.21.15.8:0/4001370520 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562cf5641490 con 0x562cf56733e0 2023-08-11T12:24:09.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.533+0000 7f3e76ffd700 1 -- 172.21.15.8:0/4001370520 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3e8c098c00 con 0x562cf56733e0 2023-08-11T12:24:09.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.533+0000 7f3eb1249b80 10 client.15387 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:24:09.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.533+0000 7f3eb1249b80 10 client.15387 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-11T12:24:09.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.533+0000 7f3eb1249b80 20 client.15387 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:09.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.534+0000 7f3eb1249b80 1 --2- 172.21.15.8:0/4001370520 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x562cf56878f0 0x562cf56865e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.534+0000 7f3eb1249b80 4 client.15387 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:24:09.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.534+0000 7f3eb1249b80 1 -- 172.21.15.8:0/4001370520 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562cf55bd7d0 con 0x562cf56878f0 2023-08-11T12:24:09.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.534+0000 7f3e96ffd700 1 --2- 172.21.15.8:0/4001370520 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x562cf56878f0 0x562cf56865e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.535+0000 7f3e96ffd700 1 --2- 172.21.15.8:0/4001370520 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x562cf56878f0 0x562cf56865e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73f86e4ea643cd64 server_cookie=e60ef39926fd7358 in_seq=0 out_seq=0 2023-08-11T12:24:09.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.535+0000 7f3e76ffd700 10 client.15387 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:24:09.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.535+0000 7f3e76ffd700 1 -- 172.21.15.8:0/4001370520 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x562cf55bd7d0 con 0x562cf56878f0 2023-08-11T12:24:09.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.535+0000 7f3e76ffd700 10 client.15387 handle_command_reply: tid=0 2023-08-11T12:24:09.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.535+0000 7f3eb1249b80 1 client.15387 shutdown 2023-08-11T12:24:09.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.536+0000 7f3eb1249b80 1 -- 172.21.15.8:0/4001370520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf56733e0 msgr2=0x562cf567c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:09.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.536+0000 7f3eb1249b80 1 --2- 172.21.15.8:0/4001370520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf56733e0 0x562cf567c670 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c0095c0 tx=0x7f3e8c09a1e0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.536+0000 7f3eb1249b80 1 -- 172.21.15.8:0/4001370520 shutdown_connections 2023-08-11T12:24:09.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.536+0000 7f3eb1249b80 1 --2- 172.21.15.8:0/4001370520 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x562cf56878f0 0x562cf56865e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.536+0000 7f3eb1249b80 1 --2- 172.21.15.8:0/4001370520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cf5672a80 0x562cf567c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.536+0000 7f3eb1249b80 1 --2- 172.21.15.8:0/4001370520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf5673da0 0x562cf56836b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.536+0000 7f3eb1249b80 1 --2- 172.21.15.8:0/4001370520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf56733e0 0x562cf567c670 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.536+0000 7f3e76ffd700 0 client.15387 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:24:09.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.536+0000 7f3eb1249b80 1 -- 172.21.15.8:0/4001370520 >> 172.21.15.8:0/4001370520 conn(0x562cf559f900 msgr2=0x562cf5667c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:09.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.536+0000 7f3eb1249b80 1 -- 172.21.15.8:0/4001370520 shutdown_connections 2023-08-11T12:24:09.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.536+0000 7f3eb1249b80 1 -- 172.21.15.8:0/4001370520 wait complete. 2023-08-11T12:24:09.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.536+0000 7f3eb1249b80 20 client.15387 trim_cache size 0 max 16384 2023-08-11T12:24:09.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.554+0000 7f3eb1249b80 1 Processor -- start 2023-08-11T12:24:09.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.554+0000 7f3eb1249b80 1 -- start start 2023-08-11T12:24:09.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.554+0000 7f3eb1249b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf5672a80 0x562cf5676ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.554+0000 7f3eb1249b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf56733e0 0x562cf5683670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.554+0000 7f3eb1249b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cf5673da0 0x562cf56771e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.555+0000 7f3eb1249b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf566e200 con 0x562cf56733e0 2023-08-11T12:24:09.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.555+0000 7f3eb1249b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf55bd7d0 con 0x562cf5672a80 2023-08-11T12:24:09.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.555+0000 7f3eb1249b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf567d320 con 0x562cf5673da0 2023-08-11T12:24:09.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.555+0000 7f3e967fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf56733e0 0x562cf5683670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.555+0000 7f3e967fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf56733e0 0x562cf5683670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39646/0 (socket says 172.21.15.8:39646) 2023-08-11T12:24:09.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.555+0000 7f3e967fc700 1 -- 172.21.15.8:0/4121115145 learned_addr learned my addr 172.21.15.8:0/4121115145 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:09.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.555+0000 7f3e977fe700 1 --2- 172.21.15.8:0/4121115145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cf5673da0 0x562cf56771e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.555+0000 7f3e96ffd700 1 --2- 172.21.15.8:0/4121115145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf5672a80 0x562cf5676ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.555+0000 7f3e967fc700 1 -- 172.21.15.8:0/4121115145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cf5673da0 msgr2=0x562cf56771e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:09.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.555+0000 7f3e967fc700 1 --2- 172.21.15.8:0/4121115145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cf5673da0 0x562cf56771e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.555+0000 7f3e967fc700 1 -- 172.21.15.8:0/4121115145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf5672a80 msgr2=0x562cf5676ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:09.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.555+0000 7f3e967fc700 1 --2- 172.21.15.8:0/4121115145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf5672a80 0x562cf5676ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.555+0000 7f3e967fc700 1 -- 172.21.15.8:0/4121115145 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562cf53d9c10 con 0x562cf56733e0 2023-08-11T12:24:09.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.555+0000 7f3e967fc700 1 --2- 172.21.15.8:0/4121115145 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf56733e0 0x562cf5683670 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c0961a0 tx=0x7f3e8c099470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14fc47c729a7ebb3 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:09.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.556+0000 7f3e7e7fc700 1 -- 172.21.15.8:0/4121115145 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c09a3a0 con 0x562cf56733e0 2023-08-11T12:24:09.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.556+0000 7f3e7e7fc700 1 -- 172.21.15.8:0/4121115145 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e8c099ca0 con 0x562cf56733e0 2023-08-11T12:24:09.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.556+0000 7f3e7e7fc700 1 -- 172.21.15.8:0/4121115145 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c0a17f0 con 0x562cf56733e0 2023-08-11T12:24:09.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.556+0000 7f3eb1249b80 1 -- 172.21.15.8:0/4121115145 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf56733e0 msgr2=0x562cf5683670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:09.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.556+0000 7f3eb1249b80 1 --2- 172.21.15.8:0/4121115145 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf56733e0 0x562cf5683670 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c0961a0 tx=0x7f3e8c099470 comp rx=0 tx=0).stop 2023-08-11T12:24:09.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.556+0000 7f3eb1249b80 1 -- 172.21.15.8:0/4121115145 shutdown_connections 2023-08-11T12:24:09.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.556+0000 7f3eb1249b80 1 --2- 172.21.15.8:0/4121115145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cf5673da0 0x562cf56771e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.556+0000 7f3eb1249b80 1 --2- 172.21.15.8:0/4121115145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf5672a80 0x562cf5676ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.556+0000 7f3eb1249b80 1 --2- 172.21.15.8:0/4121115145 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf56733e0 0x562cf5683670 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.556+0000 7f3eb1249b80 1 -- 172.21.15.8:0/4121115145 >> 172.21.15.8:0/4121115145 conn(0x562cf559f900 msgr2=0x562cf56865e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:09.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.556+0000 7f3eb1249b80 1 -- 172.21.15.8:0/4121115145 shutdown_connections 2023-08-11T12:24:09.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.556+0000 7f3eb1249b80 1 -- 172.21.15.8:0/4121115145 wait complete. 2023-08-11T12:24:09.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.557+0000 7f3eb1249b80 1 -- start start 2023-08-11T12:24:09.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.557+0000 7f3eb1249b80 1 Processor -- start 2023-08-11T12:24:09.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.558+0000 7f3eb1249b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf5672a80 0x562cf5680600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.558+0000 7f3eb1249b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf56733e0 0x562cf5682b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.558+0000 7f3eb1249b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cf5673da0 0x562cf5683090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.558+0000 7f3eb1249b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf5683770 con 0x562cf5672a80 2023-08-11T12:24:09.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.558+0000 7f3eb1249b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf56838e0 con 0x562cf56733e0 2023-08-11T12:24:09.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.558+0000 7f3eb1249b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf56e3970 con 0x562cf5673da0 2023-08-11T12:24:09.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.558+0000 7f3eb1249b80 10 client.0 _ll_register_callbacks cb 0x7f3e8c0997e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:09.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.558+0000 7f3e96ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf5672a80 0x562cf5680600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.558+0000 7f3e96ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf5672a80 0x562cf5680600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39660/0 (socket says 172.21.15.8:39660) 2023-08-11T12:24:09.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.558+0000 7f3e96ffd700 1 -- 172.21.15.8:0/3498030829 learned_addr learned my addr 172.21.15.8:0/3498030829 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:09.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.558+0000 7f3e967fc700 1 --2- 172.21.15.8:0/3498030829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf56733e0 0x562cf5682b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.558+0000 7f3e977fe700 1 --2- 172.21.15.8:0/3498030829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cf5673da0 0x562cf5683090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.558+0000 7f3e96ffd700 1 -- 172.21.15.8:0/3498030829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cf5673da0 msgr2=0x562cf5683090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:09.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.559+0000 7f3e96ffd700 1 --2- 172.21.15.8:0/3498030829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cf5673da0 0x562cf5683090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.559+0000 7f3e96ffd700 1 -- 172.21.15.8:0/3498030829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf56733e0 msgr2=0x562cf5682b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:09.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.559+0000 7f3e96ffd700 1 --2- 172.21.15.8:0/3498030829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf56733e0 0x562cf5682b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.559+0000 7f3e96ffd700 1 -- 172.21.15.8:0/3498030829 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562cf53f0d90 con 0x562cf5672a80 2023-08-11T12:24:09.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.559+0000 7f3e967fc700 1 --2- 172.21.15.8:0/3498030829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf56733e0 0x562cf5682b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:09.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.559+0000 7f3e96ffd700 1 --2- 172.21.15.8:0/3498030829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf5672a80 0x562cf5680600 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3e88000c00 tx=0x7f3e88020cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b351b74226688434 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:09.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.559+0000 7f3e76ffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:24:09.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.559+0000 7f3e76ffd700 1 -- 172.21.15.8:0/3498030829 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e88017050 con 0x562cf5672a80 2023-08-11T12:24:09.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.559+0000 7f3eb1249b80 1 -- 172.21.15.8:0/3498030829 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562cf5665a40 con 0x562cf5672a80 2023-08-11T12:24:09.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.559+0000 7f3e76ffd700 1 -- 172.21.15.8:0/3498030829 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f3e88012910 con 0x562cf5672a80 2023-08-11T12:24:09.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.560+0000 7f3e76ffd700 1 -- 172.21.15.8:0/3498030829 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e880204c0 con 0x562cf5672a80 2023-08-11T12:24:09.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.560+0000 7f3eb1249b80 10 client.15393 fetch_fsmap learned FSMap version 27 2023-08-11T12:24:09.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.560+0000 7f3eb1249b80 1 -- 172.21.15.8:0/3498030829 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x562cf5417200 con 0x562cf5672a80 2023-08-11T12:24:09.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.560+0000 7f3e76ffd700 1 -- 172.21.15.8:0/3498030829 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562cf5665a40 con 0x562cf5672a80 2023-08-11T12:24:09.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.560+0000 7f3e76ffd700 1 -- 172.21.15.8:0/3498030829 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3e8801ec30 con 0x562cf5672a80 2023-08-11T12:24:09.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.560+0000 7f3eb1249b80 10 client.15393 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:24:09.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.560+0000 7f3eb1249b80 10 client.15393 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-11T12:24:09.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.560+0000 7f3eb1249b80 20 client.15393 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:09.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.560+0000 7f3eb1249b80 1 --2- 172.21.15.8:0/3498030829 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x562cf56e8be0 0x562cf56e5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:09.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.560+0000 7f3eb1249b80 4 client.15393 mds_command: new command op to 24575 tid=0[{"prefix": "status"}] 2023-08-11T12:24:09.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.560+0000 7f3eb1249b80 1 -- 172.21.15.8:0/3498030829 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562cf557e000 con 0x562cf56e8be0 2023-08-11T12:24:09.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.561+0000 7f3e967fc700 1 --2- 172.21.15.8:0/3498030829 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x562cf56e8be0 0x562cf56e5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:09.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.561+0000 7f3e967fc700 1 --2- 172.21.15.8:0/3498030829 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x562cf56e8be0 0x562cf56e5040 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f7d463ff529d2ec server_cookie=927dd6183cf0ce64 in_seq=0 out_seq=0 2023-08-11T12:24:09.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.561+0000 7f3e76ffd700 10 client.15393 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:24:09.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.562+0000 7f3e76ffd700 1 -- 172.21.15.8:0/3498030829 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x562cf557e000 con 0x562cf56e8be0 2023-08-11T12:24:09.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.562+0000 7f3e76ffd700 10 client.15393 handle_command_reply: tid=0 2023-08-11T12:24:09.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.562+0000 7f3eb1249b80 1 client.15393 shutdown 2023-08-11T12:24:09.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.562+0000 7f3eb1249b80 1 -- 172.21.15.8:0/3498030829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf5672a80 msgr2=0x562cf5680600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:09.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.562+0000 7f3eb1249b80 1 --2- 172.21.15.8:0/3498030829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf5672a80 0x562cf5680600 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3e88000c00 tx=0x7f3e88020cd0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.562+0000 7f3eb1249b80 1 -- 172.21.15.8:0/3498030829 shutdown_connections 2023-08-11T12:24:09.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.562+0000 7f3eb1249b80 1 --2- 172.21.15.8:0/3498030829 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x562cf56e8be0 0x562cf56e5040 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.562+0000 7f3eb1249b80 1 --2- 172.21.15.8:0/3498030829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cf5673da0 0x562cf5683090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.562+0000 7f3eb1249b80 1 --2- 172.21.15.8:0/3498030829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf5672a80 0x562cf5680600 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.562+0000 7f3eb1249b80 1 --2- 172.21.15.8:0/3498030829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf56733e0 0x562cf5682b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.562+0000 7f3e76ffd700 0 client.15393 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:24:09.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.562+0000 7f3eb1249b80 1 -- 172.21.15.8:0/3498030829 >> 172.21.15.8:0/3498030829 conn(0x562cf559f900 msgr2=0x562cf56865e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:09.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.562+0000 7f3eb1249b80 1 -- 172.21.15.8:0/3498030829 shutdown_connections 2023-08-11T12:24:09.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.562+0000 7f3eb1249b80 1 -- 172.21.15.8:0/3498030829 wait complete. 2023-08-11T12:24:09.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.562+0000 7f3eb1249b80 20 client.15393 trim_cache size 0 max 16384 2023-08-11T12:24:09.574 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:24:09.574 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "815f94ae-3840-11ee-9b37-001a4aab830c", 2023-08-11T12:24:09.575 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2023-08-11T12:24:09.575 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24575, 2023-08-11T12:24:09.575 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-08-11T12:24:09.575 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-08-11T12:24:09.575 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-08-11T12:24:09.575 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 125.709789762, 2023-08-11T12:24:09.575 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 27, 2023-08-11T12:24:09.575 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 89, 2023-08-11T12:24:09.576 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 89, 2023-08-11T12:24:09.576 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 131.92115422399999 2023-08-11T12:24:09.576 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:24:09.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.563+0000 7f3e9d9ff700 1 -- 172.21.15.8:0/59330132 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3e8009ff50 msgr2=0x7f3e800a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:09.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.563+0000 7f3e9d9ff700 1 --2- 172.21.15.8:0/59330132 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3e8009ff50 0x7f3e800a2410 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009fd0 tx=0x7f3e90009d80 comp rx=0 tx=0).stop 2023-08-11T12:24:09.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.563+0000 7f3e9d9ff700 1 -- 172.21.15.8:0/59330132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e98101bf0 msgr2=0x7f3e98198e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:09.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.563+0000 7f3e9d9ff700 1 --2- 172.21.15.8:0/59330132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e98101bf0 0x7f3e98198e20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c00bf40 tx=0x7f3e8c00f690 comp rx=0 tx=0).stop 2023-08-11T12:24:09.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.563+0000 7f3e9d9ff700 1 -- 172.21.15.8:0/59330132 shutdown_connections 2023-08-11T12:24:09.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.563+0000 7f3e9d9ff700 1 --2- 172.21.15.8:0/59330132 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3e8009ff50 0x7f3e800a2410 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.563+0000 7f3e9d9ff700 1 --2- 172.21.15.8:0/59330132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e98100a00 0x7f3e981988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.563+0000 7f3e9d9ff700 1 --2- 172.21.15.8:0/59330132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e98102590 0x7f3e9819fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.563+0000 7f3e9d9ff700 1 --2- 172.21.15.8:0/59330132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e98101bf0 0x7f3e98198e20 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:09.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.563+0000 7f3e9d9ff700 1 -- 172.21.15.8:0/59330132 >> 172.21.15.8:0/59330132 conn(0x7f3e980fbf70 msgr2=0x7f3e981074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:09.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.563+0000 7f3e9d9ff700 1 -- 172.21.15.8:0/59330132 shutdown_connections 2023-08-11T12:24:09.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:09.563+0000 7f3e9d9ff700 1 -- 172.21.15.8:0/59330132 wait complete. 2023-08-11T12:24:09.583 INFO:teuthology.run_tasks:Running task kclient... 2023-08-11T12:24:09.597 INFO:tasks.kclient:Mounting kernel clients... 2023-08-11T12:24:09.598 INFO:tasks.kclient:config is {'client.0': {}} 2023-08-11T12:24:09.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:24:09.598 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-08-11T12:24:09.642 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-08-11T12:24:09.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:24:09.643 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-08-11T12:24:09.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:24:09.754 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link delete ceph-brx 2023-08-11T12:24:09.879 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync', 'context=system_u:object_r:postgresql_db_t:s0'], 'syntax': 'v2', 'mountpoint': '/tmp/cephfs'} 2023-08-11T12:24:09.879 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-11T12:24:09.880 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2023-08-11T12:24:09.880 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2023-08-11T12:24:09.880 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph fs ls 2023-08-11T12:24:10.616 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:24:10.964 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:10 smithi008 ceph-mon[97158]: pgmap v339: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-11T12:24:11.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:10 smithi194 ceph-mon[130905]: pgmap v339: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-11T12:24:11.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:10 smithi045 ceph-mon[130284]: pgmap v339: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-11T12:24:12.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.277+0000 7efe56108700 1 -- 172.21.15.8:0/616729766 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe50101300 msgr2=0x7efe5010d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.277+0000 7efe56108700 1 --2- 172.21.15.8:0/616729766 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe50101300 0x7efe5010d810 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efe4800b0a0 tx=0x7efe4800b3b0 comp rx=0 tx=0).stop 2023-08-11T12:24:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.278+0000 7efe56108700 1 -- 172.21.15.8:0/616729766 shutdown_connections 2023-08-11T12:24:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.278+0000 7efe56108700 1 --2- 172.21.15.8:0/616729766 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe50101300 0x7efe5010d810 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.278+0000 7efe56108700 1 --2- 172.21.15.8:0/616729766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe50106940 0x7efe50106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.278+0000 7efe56108700 1 --2- 172.21.15.8:0/616729766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe50100940 0x7efe50100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.278+0000 7efe56108700 1 -- 172.21.15.8:0/616729766 >> 172.21.15.8:0/616729766 conn(0x7efe500fc410 msgr2=0x7efe500fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:12.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.278+0000 7efe56108700 1 -- 172.21.15.8:0/616729766 shutdown_connections 2023-08-11T12:24:12.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.278+0000 7efe56108700 1 -- 172.21.15.8:0/616729766 wait complete. 2023-08-11T12:24:12.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.279+0000 7efe56108700 1 Processor -- start 2023-08-11T12:24:12.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.279+0000 7efe56108700 1 -- start start 2023-08-11T12:24:12.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.279+0000 7efe56108700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe50100940 0x7efe50198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:12.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.279+0000 7efe56108700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe50101300 0x7efe50199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:12.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.279+0000 7efe56108700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe50106940 0x7efe5019d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:12.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.279+0000 7efe56108700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5019dcf0 con 0x7efe50101300 2023-08-11T12:24:12.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.279+0000 7efe56108700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5019de60 con 0x7efe50100940 2023-08-11T12:24:12.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.279+0000 7efe56108700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5019e020 con 0x7efe50106940 2023-08-11T12:24:12.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.280+0000 7efe4effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe50101300 0x7efe50199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:12.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.280+0000 7efe4effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe50101300 0x7efe50199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39668/0 (socket says 172.21.15.8:39668) 2023-08-11T12:24:12.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.280+0000 7efe4effd700 1 -- 172.21.15.8:0/2367547508 learned_addr learned my addr 172.21.15.8:0/2367547508 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:12.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.280+0000 7efe4f7fe700 1 --2- 172.21.15.8:0/2367547508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe50100940 0x7efe50198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:12.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.280+0000 7efe4ffff700 1 --2- 172.21.15.8:0/2367547508 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe50106940 0x7efe5019d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:12.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.280+0000 7efe4effd700 1 -- 172.21.15.8:0/2367547508 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe50106940 msgr2=0x7efe5019d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:12.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.280+0000 7efe4effd700 1 --2- 172.21.15.8:0/2367547508 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe50106940 0x7efe5019d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:12.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.280+0000 7efe4effd700 1 -- 172.21.15.8:0/2367547508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe50100940 msgr2=0x7efe50198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:12.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.280+0000 7efe4effd700 1 --2- 172.21.15.8:0/2367547508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe50100940 0x7efe50198d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:12.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.280+0000 7efe4effd700 1 -- 172.21.15.8:0/2367547508 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe48009d00 con 0x7efe50101300 2023-08-11T12:24:12.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.280+0000 7efe4effd700 1 --2- 172.21.15.8:0/2367547508 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe50101300 0x7efe50199270 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7efe4400e9a0 tx=0x7efe4400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:12.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.281+0000 7efe4cff9700 1 -- 172.21.15.8:0/2367547508 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe44009790 con 0x7efe50101300 2023-08-11T12:24:12.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.281+0000 7efe4cff9700 1 -- 172.21.15.8:0/2367547508 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe4400cbd0 con 0x7efe50101300 2023-08-11T12:24:12.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.281+0000 7efe4cff9700 1 -- 172.21.15.8:0/2367547508 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe44018680 con 0x7efe50101300 2023-08-11T12:24:12.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.281+0000 7efe56108700 1 -- 172.21.15.8:0/2367547508 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5019e300 con 0x7efe50101300 2023-08-11T12:24:12.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.281+0000 7efe56108700 1 -- 172.21.15.8:0/2367547508 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe501a5b60 con 0x7efe50101300 2023-08-11T12:24:12.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.282+0000 7efe56108700 1 -- 172.21.15.8:0/2367547508 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe5004e620 con 0x7efe50101300 2023-08-11T12:24:12.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.284+0000 7efe4cff9700 1 -- 172.21.15.8:0/2367547508 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7efe4400cd40 con 0x7efe50101300 2023-08-11T12:24:12.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.285+0000 7efe4cff9700 1 --2- 172.21.15.8:0/2367547508 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7efe3809ffd0 0x7efe380a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:12.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.285+0000 7efe4cff9700 1 -- 172.21.15.8:0/2367547508 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7efe44014070 con 0x7efe50101300 2023-08-11T12:24:12.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.286+0000 7efe4f7fe700 1 --2- 172.21.15.8:0/2367547508 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7efe3809ffd0 0x7efe380a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:12.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.286+0000 7efe4f7fe700 1 --2- 172.21.15.8:0/2367547508 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7efe3809ffd0 0x7efe380a2490 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7efe40009be0 tx=0x7efe40009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:12.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.289+0000 7efe4cff9700 1 -- 172.21.15.8:0/2367547508 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7efe440952d0 con 0x7efe50101300 2023-08-11T12:24:12.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.544+0000 7efe56108700 1 -- 172.21.15.8:0/2367547508 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efe5019a090 con 0x7efe50101300 2023-08-11T12:24:12.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.545+0000 7efe4cff9700 1 -- 172.21.15.8:0/2367547508 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+88 (secure 0 0 0) 0x7efe440988f0 con 0x7efe50101300 2023-08-11T12:24:12.547 INFO:teuthology.orchestra.run.smithi008.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-11T12:24:12.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.547+0000 7efe56108700 1 -- 172.21.15.8:0/2367547508 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7efe3809ffd0 msgr2=0x7efe380a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:12.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.547+0000 7efe56108700 1 --2- 172.21.15.8:0/2367547508 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7efe3809ffd0 0x7efe380a2490 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7efe40009be0 tx=0x7efe40009260 comp rx=0 tx=0).stop 2023-08-11T12:24:12.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.547+0000 7efe56108700 1 -- 172.21.15.8:0/2367547508 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe50101300 msgr2=0x7efe50199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:12.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.547+0000 7efe56108700 1 --2- 172.21.15.8:0/2367547508 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe50101300 0x7efe50199270 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7efe4400e9a0 tx=0x7efe4400ecb0 comp rx=0 tx=0).stop 2023-08-11T12:24:12.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.547+0000 7efe56108700 1 -- 172.21.15.8:0/2367547508 shutdown_connections 2023-08-11T12:24:12.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.547+0000 7efe56108700 1 --2- 172.21.15.8:0/2367547508 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7efe3809ffd0 0x7efe380a2490 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:12.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.547+0000 7efe56108700 1 --2- 172.21.15.8:0/2367547508 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe50106940 0x7efe5019d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:12.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.547+0000 7efe56108700 1 --2- 172.21.15.8:0/2367547508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe50100940 0x7efe50198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:12.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.547+0000 7efe56108700 1 --2- 172.21.15.8:0/2367547508 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe50101300 0x7efe50199270 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:12.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.547+0000 7efe56108700 1 -- 172.21.15.8:0/2367547508 >> 172.21.15.8:0/2367547508 conn(0x7efe500fc410 msgr2=0x7efe5010bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:12.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.547+0000 7efe56108700 1 -- 172.21.15.8:0/2367547508 shutdown_connections 2023-08-11T12:24:12.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:12.547+0000 7efe56108700 1 -- 172.21.15.8:0/2367547508 wait complete. 2023-08-11T12:24:12.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:12 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2367547508' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-08-11T12:24:12.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:12 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2367547508' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-08-11T12:24:12.999 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:12 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2367547508' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-08-11T12:24:13.001 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-11T12:24:13.001 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-11T12:24:13.002 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi008.front.sepia.ceph.com 2023-08-11T12:24:13.002 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-11T12:24:13.002 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2023-08-11T12:24:13.002 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-11T12:24:13.003 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-11T12:24:13.003 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-11T12:24:13.003 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2023-08-11T12:24:13.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:24:13.004 DEBUG:teuthology.orchestra.run.smithi008:> ip addr 2023-08-11T12:24:13.050 INFO:teuthology.orchestra.run.smithi008.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-11T12:24:13.051 INFO:teuthology.orchestra.run.smithi008.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-11T12:24:13.051 INFO:teuthology.orchestra.run.smithi008.stdout: inet 127.0.0.1/8 scope host lo 2023-08-11T12:24:13.051 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-08-11T12:24:13.051 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 ::1/128 scope host 2023-08-11T12:24:13.051 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-08-11T12:24:13.051 INFO:teuthology.orchestra.run.smithi008.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-11T12:24:13.051 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2e brd ff:ff:ff:ff:ff:ff 2023-08-11T12:24:13.052 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f0 2023-08-11T12:24:13.052 INFO:teuthology.orchestra.run.smithi008.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-11T12:24:13.052 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2f brd ff:ff:ff:ff:ff:ff 2023-08-11T12:24:13.052 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f1 2023-08-11T12:24:13.052 INFO:teuthology.orchestra.run.smithi008.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-11T12:24:13.052 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:fe brd ff:ff:ff:ff:ff:ff 2023-08-11T12:24:13.052 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f0 2023-08-11T12:24:13.053 INFO:teuthology.orchestra.run.smithi008.stdout: inet 172.21.15.8/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-11T12:24:13.053 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft 41552sec preferred_lft 41552sec 2023-08-11T12:24:13.053 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::ae1f:6bff:fef8:25fe/64 scope link 2023-08-11T12:24:13.053 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-08-11T12:24:13.053 INFO:teuthology.orchestra.run.smithi008.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-11T12:24:13.053 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:ff brd ff:ff:ff:ff:ff:ff 2023-08-11T12:24:13.053 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f1 2023-08-11T12:24:13.054 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-11T12:24:13.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:24:13.055 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-08-11T12:24:13.055 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-08-11T12:24:13.056 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add name ceph-brx type bridge 2023-08-11T12:24:13.056 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip addr flush dev ceph-brx 2023-08-11T12:24:13.056 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set ceph-brx up 2023-08-11T12:24:13.056 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-11T12:24:13.057 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-08-11T12:24:13.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:24:13.309 DEBUG:teuthology.orchestra.run.smithi008:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-11T12:24:13.384 INFO:teuthology.orchestra.run.smithi008.stdout:1 2023-08-11T12:24:13.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:24:13.387 DEBUG:teuthology.orchestra.run.smithi008:> route 2023-08-11T12:24:13.434 INFO:teuthology.orchestra.run.smithi008.stdout:Kernel IP routing table 2023-08-11T12:24:13.434 INFO:teuthology.orchestra.run.smithi008.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-11T12:24:13.434 INFO:teuthology.orchestra.run.smithi008.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-11T12:24:13.434 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-11T12:24:13.434 INFO:teuthology.orchestra.run.smithi008.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-11T12:24:13.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:24:13.436 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-08-11T12:24:13.436 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-08-11T12:24:13.436 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-11T12:24:13.437 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-11T12:24:13.437 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-11T12:24:13.437 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-08-11T12:24:13.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:24:13.653 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-08-11T12:24:13.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:24:13.698 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list-id 2023-08-11T12:24:13.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:24:13.782 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-08-11T12:24:13.782 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-08-11T12:24:13.782 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns add ceph-ns--tmp-cephfs 2023-08-11T12:24:13.783 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns set ceph-ns--tmp-cephfs 0 2023-08-11T12:24:13.783 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-08-11T12:24:13.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:13 smithi194 ceph-mon[130905]: pgmap v340: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-11T12:24:13.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:13 smithi045 ceph-mon[130284]: pgmap v340: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-11T12:24:13.924 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:13 smithi008 ceph-mon[97158]: pgmap v340: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-11T12:24:13.967 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2023-08-11T12:24:13.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:24:13.968 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-08-11T12:24:13.968 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-08-11T12:24:13.968 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2023-08-11T12:24:13.969 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-11T12:24:13.969 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2023-08-11T12:24:13.969 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2023-08-11T12:24:13.969 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2023-08-11T12:24:13.970 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-08-11T12:24:14.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:24:14.225 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-08-11T12:24:14.225 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-08-11T12:24:14.225 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set brx.0 up 2023-08-11T12:24:14.226 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set dev brx.0 master ceph-brx 2023-08-11T12:24:14.226 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-08-11T12:24:14.404 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-11T12:24:14.405 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -v /tmp/cephfs 2023-08-11T12:24:14.449 INFO:teuthology.orchestra.run.smithi008.stdout:mkdir: created directory '/tmp/cephfs' 2023-08-11T12:24:14.450 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-11T12:24:14.450 DEBUG:teuthology.orchestra.run.smithi008:> chmod 0000 /tmp/cephfs 2023-08-11T12:24:14.533 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-11T12:24:14.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:24:14.534 DEBUG:teuthology.orchestra.run.smithi008:> sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /tmp/cephfs -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,context=system_u:object_r:postgresql_db_t:s0,nofallback 2023-08-11T12:24:14.682 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0",nofallback 2023-08-11T12:24:14.682 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0"". 2023-08-11T12:24:15.163 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0",nofallback 2023-08-11T12:24:15.163 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0"". 2023-08-11T12:24:15.164 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.45:3300,172.21.15.194:3300" 2023-08-11T12:24:15.164 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: trying mount with new device syntax: 0@815f94ae-3840-11ee-9b37-001a4aab830c.cephfs=/ 2023-08-11T12:24:15.164 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0",name=0,key=0,mon_addr=172.21.15.8:3300/172.21.15.45:3300/172.21.15.194:3300" will pass to kernel 2023-08-11T12:24:15.169 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-11T12:24:15.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:24:15.169 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 1777 /tmp/cephfs 2023-08-11T12:24:15.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:24:15.240 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/cephfs && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-11T12:24:15.327 INFO:teuthology.orchestra.run.smithi008.stdout:client25424 2023-08-11T12:24:15.327 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-11T12:24:15.327 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-11T12:24:15.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:24:15.373 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/cephfs && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-11T12:24:15.499 INFO:teuthology.orchestra.run.smithi008.stdout:client25424 2023-08-11T12:24:15.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:24:15.500 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/cephfs && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-11T12:24:15.587 INFO:teuthology.orchestra.run.smithi008.stdout:client25424 2023-08-11T12:24:15.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:24:15.588 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/cephfs && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/815f94ae-3840-11ee-9b37-001a4aab830c.client25424/status') 2023-08-11T12:24:15.698 INFO:teuthology.orchestra.run.smithi008.stdout:instance: client.25424 (3)172.21.15.8:0/2142256816 2023-08-11T12:24:15.698 INFO:teuthology.orchestra.run.smithi008.stdout:blocklisted: false 2023-08-11T12:24:15.698 INFO:teuthology.orchestra.run.smithi008.stderr:0+1 records in 2023-08-11T12:24:15.699 INFO:teuthology.orchestra.run.smithi008.stderr:0+1 records out 2023-08-11T12:24:15.699 INFO:teuthology.orchestra.run.smithi008.stderr:70 bytes copied, 7.0122e-05 s, 998 kB/s 2023-08-11T12:24:15.701 INFO:teuthology.run_tasks:Running task check-counter... 2023-08-11T12:24:15.713 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-08-11T12:24:15.733 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-11T12:24:15.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:15 smithi194 ceph-mon[130905]: pgmap v341: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:24:15.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:15 smithi045 ceph-mon[130284]: pgmap v341: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:24:15.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.939+0000 7fec23dff700 1 -- 172.21.15.8:0/731822125 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec1c101bd0 msgr2=0x7fec1c102030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:15.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.939+0000 7fec23dff700 1 --2- 172.21.15.8:0/731822125 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec1c101bd0 0x7fec1c102030 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0099c0 tx=0x7fec0c009cd0 comp rx=0 tx=0).stop 2023-08-11T12:24:15.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.939+0000 7fec23dff700 1 -- 172.21.15.8:0/731822125 shutdown_connections 2023-08-11T12:24:15.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.939+0000 7fec23dff700 1 --2- 172.21.15.8:0/731822125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec1c1009e0 0x7fec1c100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:15.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.939+0000 7fec23dff700 1 --2- 172.21.15.8:0/731822125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec1c102570 0x7fec1c108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:15.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.939+0000 7fec23dff700 1 --2- 172.21.15.8:0/731822125 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec1c101bd0 0x7fec1c102030 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:15.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.939+0000 7fec23dff700 1 -- 172.21.15.8:0/731822125 >> 172.21.15.8:0/731822125 conn(0x7fec1c0fbf50 msgr2=0x7fec1c0fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:15.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.939+0000 7fec23dff700 1 -- 172.21.15.8:0/731822125 shutdown_connections 2023-08-11T12:24:15.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.939+0000 7fec23dff700 1 -- 172.21.15.8:0/731822125 wait complete. 2023-08-11T12:24:15.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.940+0000 7fec23dff700 1 Processor -- start 2023-08-11T12:24:15.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.940+0000 7fec23dff700 1 -- start start 2023-08-11T12:24:15.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.940+0000 7fec23dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec1c1009e0 0x7fec1c1966e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:15.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.940+0000 7fec23dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec1c101bd0 0x7fec1c196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:15.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.940+0000 7fec23dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec1c102570 0x7fec1c19dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:15.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.940+0000 7fec23dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c19e260 con 0x7fec1c101bd0 2023-08-11T12:24:15.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.940+0000 7fec23dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c19e3a0 con 0x7fec1c102570 2023-08-11T12:24:15.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.940+0000 7fec23dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c19e530 con 0x7fec1c1009e0 2023-08-11T12:24:15.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.941+0000 7fec2139a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec1c101bd0 0x7fec1c196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:15.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.941+0000 7fec2139a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec1c101bd0 0x7fec1c196c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39674/0 (socket says 172.21.15.8:39674) 2023-08-11T12:24:15.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.941+0000 7fec2139a700 1 -- 172.21.15.8:0/83468907 learned_addr learned my addr 172.21.15.8:0/83468907 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:15.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.941+0000 7fec21b9b700 1 --2- 172.21.15.8:0/83468907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec1c1009e0 0x7fec1c1966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:15.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.941+0000 7fec2239c700 1 --2- 172.21.15.8:0/83468907 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec1c102570 0x7fec1c19dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:15.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.941+0000 7fec2139a700 1 -- 172.21.15.8:0/83468907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec1c1009e0 msgr2=0x7fec1c1966e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:15.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.941+0000 7fec2139a700 1 --2- 172.21.15.8:0/83468907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec1c1009e0 0x7fec1c1966e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:15.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.941+0000 7fec2139a700 1 -- 172.21.15.8:0/83468907 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec1c102570 msgr2=0x7fec1c19dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:15.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.941+0000 7fec2139a700 1 --2- 172.21.15.8:0/83468907 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec1c102570 0x7fec1c19dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:15.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.941+0000 7fec2139a700 1 -- 172.21.15.8:0/83468907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c0095f0 con 0x7fec1c101bd0 2023-08-11T12:24:15.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.941+0000 7fec2139a700 1 --2- 172.21.15.8:0/83468907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec1c101bd0 0x7fec1c196c20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fec0c009990 tx=0x7fec0c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:15.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.941+0000 7fec12ffd700 1 -- 172.21.15.8:0/83468907 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c01d070 con 0x7fec1c101bd0 2023-08-11T12:24:15.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.942+0000 7fec12ffd700 1 -- 172.21.15.8:0/83468907 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec0c0054f0 con 0x7fec1c101bd0 2023-08-11T12:24:15.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.942+0000 7fec23dff700 1 -- 172.21.15.8:0/83468907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec1c19e7b0 con 0x7fec1c101bd0 2023-08-11T12:24:15.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.942+0000 7fec12ffd700 1 -- 172.21.15.8:0/83468907 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c004b00 con 0x7fec1c101bd0 2023-08-11T12:24:15.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.942+0000 7fec23dff700 1 -- 172.21.15.8:0/83468907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1c19ec30 con 0x7fec1c101bd0 2023-08-11T12:24:15.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.943+0000 7fec23dff700 1 -- 172.21.15.8:0/83468907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec1c107960 con 0x7fec1c101bd0 2023-08-11T12:24:15.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.945+0000 7fec12ffd700 1 -- 172.21.15.8:0/83468907 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fec0c00fb80 con 0x7fec1c101bd0 2023-08-11T12:24:15.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.946+0000 7fec12ffd700 1 --2- 172.21.15.8:0/83468907 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fec0809ffd0 0x7fec080a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:15.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.946+0000 7fec12ffd700 1 -- 172.21.15.8:0/83468907 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fec0c0cc300 con 0x7fec1c101bd0 2023-08-11T12:24:15.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.946+0000 7fec21b9b700 1 --2- 172.21.15.8:0/83468907 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fec0809ffd0 0x7fec080a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:15.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.947+0000 7fec21b9b700 1 --2- 172.21.15.8:0/83468907 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fec0809ffd0 0x7fec080a2490 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fec1c101a30 tx=0x7fec18009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:15.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:15.950+0000 7fec12ffd700 1 -- 172.21.15.8:0/83468907 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fec0c095db0 con 0x7fec1c101bd0 2023-08-11T12:24:16.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:15 smithi008 ceph-mon[97158]: pgmap v341: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-08-11T12:24:16.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.164+0000 7fec23dff700 1 -- 172.21.15.8:0/83468907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec1c10c240 con 0x7fec1c101bd0 2023-08-11T12:24:16.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.166+0000 7fec12ffd700 1 -- 172.21.15.8:0/83468907 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24348 (secure 0 0 0) 0x7fec0c0993d0 con 0x7fec1c101bd0 2023-08-11T12:24:16.168 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:16.168 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":89,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","created":"2023-08-11T12:14:28.341113+0000","modified":"2023-08-11T12:22:31.713248+0000","last_up_change":"2023-08-11T12:21:14.913735+0000","last_in_change":"2023-08-11T12:20:57.476558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-11T12:17:49.040758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-11T12:22:01.383296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-11T12:22:02.816329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-11T12:22:06.369375+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f903e393-7894-42d6-8b11-737ceef1f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6803","nonce":664104961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6805","nonce":664104961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6809","nonce":664104961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6807","nonce":664104961}]},"public_addr":"172.21.15.8:6803/664104961","cluster_addr":"172.21.15.8:6805/664104961","heartbeat_back_addr":"172.21.15.8:6809/664104961","heartbeat_front_addr":"172.21.15.8:6807/664104961","state":["exists","up"]},{"osd":1,"uuid":"1e988e5c-e78c-46d5-80a5-dff7ac38cbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6801","nonce":4187350703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6803","nonce":4187350703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6807","nonce":4187350703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6805","nonce":4187350703}]},"public_addr":"172.21.15.45:6801/4187350703","cluster_addr":"172.21.15.45:6803/4187350703","heartbeat_back_addr":"172.21.15.45:6807/4187350703","heartbeat_front_addr":"172.21.15.45:6805/4187350703","state":["exists","up"]},{"osd":2,"uuid":"1835217c-a93c-4181-b8b8-cc410bab1a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6801","nonce":2547818140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6803","nonce":2547818140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6807","nonce":2547818140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6805","nonce":2547818140}]},"public_addr":"172.21.15.194:6801/2547818140","cluster_addr":"172.21.15.194:6803/2547818140","heartbeat_back_addr":"172.21.15.194:6807/2547818140","heartbeat_front_addr":"172.21.15.194:6805/2547818140","state":["exists","up"]},{"osd":3,"uuid":"b55ae61a-731c-4312-a998-661122b84788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6811","nonce":187418883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6813","nonce":187418883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6817","nonce":187418883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6815","nonce":187418883}]},"public_addr":"172.21.15.8:6811/187418883","cluster_addr":"172.21.15.8:6813/187418883","heartbeat_back_addr":"172.21.15.8:6817/187418883","heartbeat_front_addr":"172.21.15.8:6815/187418883","state":["exists","up"]},{"osd":4,"uuid":"2c28acbb-e807-4559-8aa2-a35ca84b5d43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6809","nonce":3099704571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6811","nonce":3099704571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6815","nonce":3099704571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6813","nonce":3099704571}]},"public_addr":"172.21.15.45:6809/3099704571","cluster_addr":"172.21.15.45:6811/3099704571","heartbeat_back_addr":"172.21.15.45:6815/3099704571","heartbeat_front_addr":"172.21.15.45:6813/3099704571","state":["exists","up"]},{"osd":5,"uuid":"37032289-8016-4730-9b69-f7985e058ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6809","nonce":263803874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6811","nonce":263803874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6815","nonce":263803874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6813","nonce":263803874}]},"public_addr":"172.21.15.194:6809/263803874","cluster_addr":"172.21.15.194:6811/263803874","heartbeat_back_addr":"172.21.15.194:6815/263803874","heartbeat_front_addr":"172.21.15.194:6813/263803874","state":["exists","up"]},{"osd":6,"uuid":"32d2dab9-6944-40d1-ada9-4f941821b063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6819","nonce":1802966829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6821","nonce":1802966829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6825","nonce":1802966829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6823","nonce":1802966829}]},"public_addr":"172.21.15.8:6819/1802966829","cluster_addr":"172.21.15.8:6821/1802966829","heartbeat_back_addr":"172.21.15.8:6825/1802966829","heartbeat_front_addr":"172.21.15.8:6823/1802966829","state":["exists","up"]},{"osd":7,"uuid":"086aff58-1554-49fe-92ff-5166b115aeef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6817","nonce":3715737148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6819","nonce":3715737148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6823","nonce":3715737148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6821","nonce":3715737148}]},"public_addr":"172.21.15.45:6817/3715737148","cluster_addr":"172.21.15.45:6819/3715737148","heartbeat_back_addr":"172.21.15.45:6823/3715737148","heartbeat_front_addr":"172.21.15.45:6821/3715737148","state":["exists","up"]},{"osd":8,"uuid":"7fff5e95-2453-4ea6-a5c1-3bba6a1f6400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6817","nonce":57497127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6819","nonce":57497127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6823","nonce":57497127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6821","nonce":57497127}]},"public_addr":"172.21.15.194:6817/57497127","cluster_addr":"172.21.15.194:6819/57497127","heartbeat_back_addr":"172.21.15.194:6823/57497127","heartbeat_front_addr":"172.21.15.194:6821/57497127","state":["exists","up"]},{"osd":9,"uuid":"31ab0121-4c92-42ec-9f19-e672062e8814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6827","nonce":434661930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6829","nonce":434661930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6833","nonce":434661930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6831","nonce":434661930}]},"public_addr":"172.21.15.8:6827/434661930","cluster_addr":"172.21.15.8:6829/434661930","heartbeat_back_addr":"172.21.15.8:6833/434661930","heartbeat_front_addr":"172.21.15.8:6831/434661930","state":["exists","up"]},{"osd":10,"uuid":"62c632e4-94f6-4630-9d94-8d28fccacf45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6825","nonce":3281212184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6827","nonce":3281212184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6831","nonce":3281212184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6829","nonce":3281212184}]},"public_addr":"172.21.15.45:6825/3281212184","cluster_addr":"172.21.15.45:6827/3281212184","heartbeat_back_addr":"172.21.15.45:6831/3281212184","heartbeat_front_addr":"172.21.15.45:6829/3281212184","state":["exists","up"]},{"osd":11,"uuid":"8ca4a80d-cd75-4230-b46d-aef6fdc03e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6825","nonce":1637875895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6827","nonce":1637875895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6831","nonce":1637875895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6829","nonce":1637875895}]},"public_addr":"172.21.15.194:6825/1637875895","cluster_addr":"172.21.15.194:6827/1637875895","heartbeat_back_addr":"172.21.15.194:6831/1637875895","heartbeat_front_addr":"172.21.15.194:6829/1637875895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:04.255616+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:26.243863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:46.630365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:12.926291+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:35.747049+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:55.793767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:21.685725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:43.703215+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:04.043674+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:30.320026+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:52.751974+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:21:13.230024+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/2000592056":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2102228072":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2374527928":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2928221278":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2744750874":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/3681755887":"2023-08-12T12:15:02.528403+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-11T12:24:16.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.168+0000 7fec23dff700 1 -- 172.21.15.8:0/83468907 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fec0809ffd0 msgr2=0x7fec080a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:16.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.168+0000 7fec23dff700 1 --2- 172.21.15.8:0/83468907 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fec0809ffd0 0x7fec080a2490 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fec1c101a30 tx=0x7fec18009260 comp rx=0 tx=0).stop 2023-08-11T12:24:16.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.168+0000 7fec23dff700 1 -- 172.21.15.8:0/83468907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec1c101bd0 msgr2=0x7fec1c196c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:16.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.168+0000 7fec23dff700 1 --2- 172.21.15.8:0/83468907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec1c101bd0 0x7fec1c196c20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fec0c009990 tx=0x7fec0c00f690 comp rx=0 tx=0).stop 2023-08-11T12:24:16.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.168+0000 7fec23dff700 1 -- 172.21.15.8:0/83468907 shutdown_connections 2023-08-11T12:24:16.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.168+0000 7fec23dff700 1 --2- 172.21.15.8:0/83468907 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fec0809ffd0 0x7fec080a2490 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:16.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.168+0000 7fec23dff700 1 --2- 172.21.15.8:0/83468907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec1c1009e0 0x7fec1c1966e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:16.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.168+0000 7fec23dff700 1 --2- 172.21.15.8:0/83468907 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec1c102570 0x7fec1c19dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:16.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.168+0000 7fec23dff700 1 --2- 172.21.15.8:0/83468907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec1c101bd0 0x7fec1c196c20 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:16.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.168+0000 7fec23dff700 1 -- 172.21.15.8:0/83468907 >> 172.21.15.8:0/83468907 conn(0x7fec1c0fbf50 msgr2=0x7fec1c0fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:16.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.168+0000 7fec23dff700 1 -- 172.21.15.8:0/83468907 shutdown_connections 2023-08-11T12:24:16.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.168+0000 7fec23dff700 1 -- 172.21.15.8:0/83468907 wait complete. 2023-08-11T12:24:16.189 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-11T12:17:49.040758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-11T12:22:01.383296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-11T12:22:02.816329+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-11T12:22:06.369375+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-11T12:24:16.190 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-11T12:24:16.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.394+0000 7fb8137ff700 1 -- 172.21.15.8:0/2456061295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb80c101bf0 msgr2=0x7fb80c102050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:16.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.394+0000 7fb8137ff700 1 --2- 172.21.15.8:0/2456061295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb80c101bf0 0x7fb80c102050 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc009920 tx=0x7fb7fc009c30 comp rx=0 tx=0).stop 2023-08-11T12:24:16.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.394+0000 7fb8137ff700 1 -- 172.21.15.8:0/2456061295 shutdown_connections 2023-08-11T12:24:16.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.394+0000 7fb8137ff700 1 --2- 172.21.15.8:0/2456061295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb80c102590 0x7fb80c108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:16.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.394+0000 7fb8137ff700 1 --2- 172.21.15.8:0/2456061295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80c100a00 0x7fb80c100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:16.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.394+0000 7fb8137ff700 1 --2- 172.21.15.8:0/2456061295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb80c101bf0 0x7fb80c102050 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:16.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.394+0000 7fb8137ff700 1 -- 172.21.15.8:0/2456061295 >> 172.21.15.8:0/2456061295 conn(0x7fb80c0fbf70 msgr2=0x7fb80c0fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:16.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.394+0000 7fb8137ff700 1 -- 172.21.15.8:0/2456061295 shutdown_connections 2023-08-11T12:24:16.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.394+0000 7fb8137ff700 1 -- 172.21.15.8:0/2456061295 wait complete. 2023-08-11T12:24:16.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.395+0000 7fb8137ff700 1 Processor -- start 2023-08-11T12:24:16.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.395+0000 7fb8137ff700 1 -- start start 2023-08-11T12:24:16.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.395+0000 7fb8137ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb80c100a00 0x7fb80c0746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:16.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.395+0000 7fb8137ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80c101bf0 0x7fb80c072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:16.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.395+0000 7fb8137ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb80c102590 0x7fb80c073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:16.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.395+0000 7fb8137ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c0739f0 con 0x7fb80c102590 2023-08-11T12:24:16.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.395+0000 7fb8137ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c073b60 con 0x7fb80c101bf0 2023-08-11T12:24:16.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.395+0000 7fb8137ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c1a0800 con 0x7fb80c100a00 2023-08-11T12:24:16.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.396+0000 7fb81159b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb80c100a00 0x7fb80c0746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:16.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.396+0000 7fb81159b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb80c100a00 0x7fb80c0746d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:43048/0 (socket says 172.21.15.8:43048) 2023-08-11T12:24:16.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.396+0000 7fb81159b700 1 -- 172.21.15.8:0/3496135395 learned_addr learned my addr 172.21.15.8:0/3496135395 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:16.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.396+0000 7fb811d9c700 1 --2- 172.21.15.8:0/3496135395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb80c102590 0x7fb80c073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:16.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.396+0000 7fb810d9a700 1 --2- 172.21.15.8:0/3496135395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80c101bf0 0x7fb80c072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:16.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.396+0000 7fb81159b700 1 -- 172.21.15.8:0/3496135395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80c101bf0 msgr2=0x7fb80c072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:16.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.396+0000 7fb81159b700 1 --2- 172.21.15.8:0/3496135395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80c101bf0 0x7fb80c072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:16.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.396+0000 7fb81159b700 1 -- 172.21.15.8:0/3496135395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb80c102590 msgr2=0x7fb80c073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:16.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.396+0000 7fb81159b700 1 --2- 172.21.15.8:0/3496135395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb80c102590 0x7fb80c073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:16.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.396+0000 7fb81159b700 1 -- 172.21.15.8:0/3496135395 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8080095f0 con 0x7fb80c100a00 2023-08-11T12:24:16.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.396+0000 7fb81159b700 1 --2- 172.21.15.8:0/3496135395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb80c100a00 0x7fb80c0746d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb80800ebf0 tx=0x7fb80800ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:16.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.397+0000 7fb8027fc700 1 -- 172.21.15.8:0/3496135395 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb808009a10 con 0x7fb80c100a00 2023-08-11T12:24:16.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.397+0000 7fb8137ff700 1 -- 172.21.15.8:0/3496135395 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7fc009520 con 0x7fb80c100a00 2023-08-11T12:24:16.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.397+0000 7fb8027fc700 1 -- 172.21.15.8:0/3496135395 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb80800cc90 con 0x7fb80c100a00 2023-08-11T12:24:16.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.397+0000 7fb8027fc700 1 -- 172.21.15.8:0/3496135395 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb808018750 con 0x7fb80c100a00 2023-08-11T12:24:16.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.397+0000 7fb8137ff700 1 -- 172.21.15.8:0/3496135395 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb80c1a0e60 con 0x7fb80c100a00 2023-08-11T12:24:16.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.398+0000 7fb8137ff700 1 -- 172.21.15.8:0/3496135395 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb80c10c260 con 0x7fb80c100a00 2023-08-11T12:24:16.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.400+0000 7fb8027fc700 1 -- 172.21.15.8:0/3496135395 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fb8080188b0 con 0x7fb80c100a00 2023-08-11T12:24:16.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.402+0000 7fb8027fc700 1 --2- 172.21.15.8:0/3496135395 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb7f809ff50 0x7fb7f80a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:16.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.402+0000 7fb8027fc700 1 -- 172.21.15.8:0/3496135395 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb808014070 con 0x7fb80c100a00 2023-08-11T12:24:16.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.402+0000 7fb810d9a700 1 --2- 172.21.15.8:0/3496135395 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb7f809ff50 0x7fb7f80a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:16.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.402+0000 7fb810d9a700 1 --2- 172.21.15.8:0/3496135395 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb7f809ff50 0x7fb7f80a2410 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00fa40 tx=0x7fb7fc019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:16.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.404+0000 7fb8027fc700 1 -- 172.21.15.8:0/3496135395 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fb808095d00 con 0x7fb80c100a00 2023-08-11T12:24:16.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.616+0000 7fb8137ff700 1 -- 172.21.15.8:0/3496135395 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb80c1a1050 con 0x7fb80c100a00 2023-08-11T12:24:16.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.617+0000 7fb8027fc700 1 -- 172.21.15.8:0/3496135395 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb808099320 con 0x7fb80c100a00 2023-08-11T12:24:16.619 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-08-11T12:24:16.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.620+0000 7fb8137ff700 1 -- 172.21.15.8:0/3496135395 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb7f809ff50 msgr2=0x7fb7f80a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:16.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.620+0000 7fb8137ff700 1 --2- 172.21.15.8:0/3496135395 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb7f809ff50 0x7fb7f80a2410 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00fa40 tx=0x7fb7fc019040 comp rx=0 tx=0).stop 2023-08-11T12:24:16.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.620+0000 7fb8137ff700 1 -- 172.21.15.8:0/3496135395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb80c100a00 msgr2=0x7fb80c0746d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:16.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.620+0000 7fb8137ff700 1 --2- 172.21.15.8:0/3496135395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb80c100a00 0x7fb80c0746d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb80800ebf0 tx=0x7fb80800ef00 comp rx=0 tx=0).stop 2023-08-11T12:24:16.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.620+0000 7fb8137ff700 1 -- 172.21.15.8:0/3496135395 shutdown_connections 2023-08-11T12:24:16.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.620+0000 7fb8137ff700 1 --2- 172.21.15.8:0/3496135395 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb7f809ff50 0x7fb7f80a2410 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:16.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.620+0000 7fb8137ff700 1 --2- 172.21.15.8:0/3496135395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb80c100a00 0x7fb80c0746d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:16.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.620+0000 7fb8137ff700 1 --2- 172.21.15.8:0/3496135395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb80c102590 0x7fb80c073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:16.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.620+0000 7fb8137ff700 1 --2- 172.21.15.8:0/3496135395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80c101bf0 0x7fb80c072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:16.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.620+0000 7fb8137ff700 1 -- 172.21.15.8:0/3496135395 >> 172.21.15.8:0/3496135395 conn(0x7fb80c0fbf70 msgr2=0x7fb80c0fe210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:16.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.620+0000 7fb8137ff700 1 -- 172.21.15.8:0/3496135395 shutdown_connections 2023-08-11T12:24:16.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.620+0000 7fb8137ff700 1 -- 172.21.15.8:0/3496135395 wait complete. 2023-08-11T12:24:16.641 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-11T12:24:16.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.846+0000 7f6a83fff700 1 -- 172.21.15.8:0/753448269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a7c074960 msgr2=0x7f6a7c072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:16.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.846+0000 7f6a83fff700 1 --2- 172.21.15.8:0/753448269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a7c074960 0x7f6a7c072db0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6a78009990 tx=0x7f6a78009ca0 comp rx=0 tx=0).stop 2023-08-11T12:24:16.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.846+0000 7f6a83fff700 1 -- 172.21.15.8:0/753448269 shutdown_connections 2023-08-11T12:24:16.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.846+0000 7f6a83fff700 1 --2- 172.21.15.8:0/753448269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a7c1088d0 0x7f6a7c10ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:16.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.846+0000 7f6a83fff700 1 --2- 172.21.15.8:0/753448269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a7c074960 0x7f6a7c072db0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:16.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.846+0000 7f6a83fff700 1 --2- 172.21.15.8:0/753448269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a7c073380 0x7f6a7c073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:16.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.846+0000 7f6a83fff700 1 -- 172.21.15.8:0/753448269 >> 172.21.15.8:0/753448269 conn(0x7f6a7c0fbf80 msgr2=0x7f6a7c0fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:16.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.846+0000 7f6a83fff700 1 -- 172.21.15.8:0/753448269 shutdown_connections 2023-08-11T12:24:16.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.847+0000 7f6a83fff700 1 -- 172.21.15.8:0/753448269 wait complete. 2023-08-11T12:24:16.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.847+0000 7f6a83fff700 1 Processor -- start 2023-08-11T12:24:16.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.848+0000 7f6a83fff700 1 -- start start 2023-08-11T12:24:16.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.848+0000 7f6a83fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a7c073380 0x7f6a7c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:16.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.848+0000 7f6a83fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a7c074960 0x7f6a7c198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:16.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.848+0000 7f6a83fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a7c1088d0 0x7f6a7c19fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:16.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.848+0000 7f6a83fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c1a0490 con 0x7f6a7c074960 2023-08-11T12:24:16.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.848+0000 7f6a83fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c1a05d0 con 0x7f6a7c073380 2023-08-11T12:24:16.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.848+0000 7f6a83fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c1a0760 con 0x7f6a7c1088d0 2023-08-11T12:24:16.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.848+0000 7f6a8159a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a7c074960 0x7f6a7c198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:16.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.848+0000 7f6a81d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a7c073380 0x7f6a7c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:16.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.848+0000 7f6a8159a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a7c074960 0x7f6a7c198e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39708/0 (socket says 172.21.15.8:39708) 2023-08-11T12:24:16.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.848+0000 7f6a8159a700 1 -- 172.21.15.8:0/1119704711 learned_addr learned my addr 172.21.15.8:0/1119704711 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:16.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.849+0000 7f6a8259c700 1 --2- 172.21.15.8:0/1119704711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a7c1088d0 0x7f6a7c19fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:16.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.849+0000 7f6a8159a700 1 -- 172.21.15.8:0/1119704711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a7c1088d0 msgr2=0x7f6a7c19fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:16.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.849+0000 7f6a8159a700 1 --2- 172.21.15.8:0/1119704711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a7c1088d0 0x7f6a7c19fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:16.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.849+0000 7f6a8159a700 1 -- 172.21.15.8:0/1119704711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a7c073380 msgr2=0x7f6a7c198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:16.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.849+0000 7f6a8159a700 1 --2- 172.21.15.8:0/1119704711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a7c073380 0x7f6a7c198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:16.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.849+0000 7f6a8159a700 1 -- 172.21.15.8:0/1119704711 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a780095f0 con 0x7f6a7c074960 2023-08-11T12:24:16.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.849+0000 7f6a8259c700 1 --2- 172.21.15.8:0/1119704711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a7c1088d0 0x7f6a7c19fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:24:16.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.849+0000 7f6a8159a700 1 --2- 172.21.15.8:0/1119704711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a7c074960 0x7f6a7c198e50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00e970 tx=0x7f6a6c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:16.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.849+0000 7f6a72ffd700 1 -- 172.21.15.8:0/1119704711 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c009790 con 0x7f6a7c074960 2023-08-11T12:24:16.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.849+0000 7f6a83fff700 1 -- 172.21.15.8:0/1119704711 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7c1a0a40 con 0x7f6a7c074960 2023-08-11T12:24:16.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.849+0000 7f6a72ffd700 1 -- 172.21.15.8:0/1119704711 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a6c00eec0 con 0x7f6a7c074960 2023-08-11T12:24:16.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.849+0000 7f6a72ffd700 1 -- 172.21.15.8:0/1119704711 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c003cf0 con 0x7f6a7c074960 2023-08-11T12:24:16.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.849+0000 7f6a83fff700 1 -- 172.21.15.8:0/1119704711 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a7c1a0f50 con 0x7f6a7c074960 2023-08-11T12:24:16.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.850+0000 7f6a83fff700 1 -- 172.21.15.8:0/1119704711 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a7c106f80 con 0x7f6a7c074960 2023-08-11T12:24:16.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.852+0000 7f6a72ffd700 1 -- 172.21.15.8:0/1119704711 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f6a6c00ccd0 con 0x7f6a7c074960 2023-08-11T12:24:16.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.854+0000 7f6a72ffd700 1 --2- 172.21.15.8:0/1119704711 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6a6809ff50 0x7f6a680a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:16.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.854+0000 7f6a72ffd700 1 -- 172.21.15.8:0/1119704711 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f6a6c014070 con 0x7f6a7c074960 2023-08-11T12:24:16.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.854+0000 7f6a81d9b700 1 --2- 172.21.15.8:0/1119704711 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6a6809ff50 0x7f6a680a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:16.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.855+0000 7f6a81d9b700 1 --2- 172.21.15.8:0/1119704711 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6a6809ff50 0x7f6a680a2410 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6a7800b2e0 tx=0x7f6a78005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:16.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:16.857+0000 7f6a72ffd700 1 -- 172.21.15.8:0/1119704711 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f6a6c095210 con 0x7f6a7c074960 2023-08-11T12:24:16.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:16 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/83468907' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:24:16.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:16 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/83468907' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:24:17.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:16 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/83468907' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:24:17.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.069+0000 7f6a83fff700 1 -- 172.21.15.8:0/1119704711 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6a7c1a0bd0 con 0x7f6a7c074960 2023-08-11T12:24:17.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.069+0000 7f6a72ffd700 1 -- 172.21.15.8:0/1119704711 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6a7c1a0bd0 con 0x7f6a7c074960 2023-08-11T12:24:17.072 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-08-11T12:24:17.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.072+0000 7f6a83fff700 1 -- 172.21.15.8:0/1119704711 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6a6809ff50 msgr2=0x7f6a680a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:17.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.072+0000 7f6a83fff700 1 --2- 172.21.15.8:0/1119704711 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6a6809ff50 0x7f6a680a2410 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6a7800b2e0 tx=0x7f6a78005fb0 comp rx=0 tx=0).stop 2023-08-11T12:24:17.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.072+0000 7f6a83fff700 1 -- 172.21.15.8:0/1119704711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a7c074960 msgr2=0x7f6a7c198e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:17.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.072+0000 7f6a83fff700 1 --2- 172.21.15.8:0/1119704711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a7c074960 0x7f6a7c198e50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00e970 tx=0x7f6a6c00ec80 comp rx=0 tx=0).stop 2023-08-11T12:24:17.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.072+0000 7f6a83fff700 1 -- 172.21.15.8:0/1119704711 shutdown_connections 2023-08-11T12:24:17.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.072+0000 7f6a83fff700 1 --2- 172.21.15.8:0/1119704711 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f6a6809ff50 0x7f6a680a2410 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:17.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.072+0000 7f6a83fff700 1 --2- 172.21.15.8:0/1119704711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a7c1088d0 0x7f6a7c19fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:17.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.072+0000 7f6a83fff700 1 --2- 172.21.15.8:0/1119704711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a7c073380 0x7f6a7c198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:17.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.072+0000 7f6a83fff700 1 --2- 172.21.15.8:0/1119704711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a7c074960 0x7f6a7c198e50 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:17.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.072+0000 7f6a83fff700 1 -- 172.21.15.8:0/1119704711 >> 172.21.15.8:0/1119704711 conn(0x7f6a7c0fbf80 msgr2=0x7f6a7c0fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:17.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.072+0000 7f6a83fff700 1 -- 172.21.15.8:0/1119704711 shutdown_connections 2023-08-11T12:24:17.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.072+0000 7f6a83fff700 1 -- 172.21.15.8:0/1119704711 wait complete. 2023-08-11T12:24:17.093 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-11T12:24:17.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.298+0000 7f307c5ff700 1 -- 172.21.15.8:0/2156918608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3074100a00 msgr2=0x7f3074100e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:17.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.298+0000 7f307c5ff700 1 --2- 172.21.15.8:0/2156918608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3074100a00 0x7f3074100e20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3070009920 tx=0x7f3070009c30 comp rx=0 tx=0).stop 2023-08-11T12:24:17.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.298+0000 7f307c5ff700 1 -- 172.21.15.8:0/2156918608 shutdown_connections 2023-08-11T12:24:17.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.298+0000 7f307c5ff700 1 --2- 172.21.15.8:0/2156918608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3074102590 0x7f3074108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:17.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.298+0000 7f307c5ff700 1 --2- 172.21.15.8:0/2156918608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3074100a00 0x7f3074100e20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:17.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.298+0000 7f307c5ff700 1 --2- 172.21.15.8:0/2156918608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3074101bf0 0x7f3074102050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:17.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.298+0000 7f307c5ff700 1 -- 172.21.15.8:0/2156918608 >> 172.21.15.8:0/2156918608 conn(0x7f30740fbf70 msgr2=0x7f30740fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:17.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.298+0000 7f307c5ff700 1 -- 172.21.15.8:0/2156918608 shutdown_connections 2023-08-11T12:24:17.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.298+0000 7f307c5ff700 1 -- 172.21.15.8:0/2156918608 wait complete. 2023-08-11T12:24:17.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.299+0000 7f307c5ff700 1 Processor -- start 2023-08-11T12:24:17.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.299+0000 7f307c5ff700 1 -- start start 2023-08-11T12:24:17.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.300+0000 7f307c5ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3074100a00 0x7f30740746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:17.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.300+0000 7f307c5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3074101bf0 0x7f3074072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:17.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.300+0000 7f307c5ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3074102590 0x7f3074073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:17.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.300+0000 7f307c5ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30740739f0 con 0x7f3074102590 2023-08-11T12:24:17.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.300+0000 7f307c5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3074073b60 con 0x7f3074101bf0 2023-08-11T12:24:17.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.300+0000 7f307c5ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30741a0800 con 0x7f3074100a00 2023-08-11T12:24:17.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.300+0000 7f307a39b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3074100a00 0x7f30740746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:17.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.300+0000 7f3079b9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3074101bf0 0x7f3074072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:17.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.300+0000 7f307a39b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3074100a00 0x7f30740746d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:43074/0 (socket says 172.21.15.8:43074) 2023-08-11T12:24:17.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.300+0000 7f307a39b700 1 -- 172.21.15.8:0/456706723 learned_addr learned my addr 172.21.15.8:0/456706723 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:17.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.300+0000 7f307ab9c700 1 --2- 172.21.15.8:0/456706723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3074102590 0x7f3074073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:17.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.300+0000 7f307a39b700 1 -- 172.21.15.8:0/456706723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3074101bf0 msgr2=0x7f3074072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:17.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.300+0000 7f307a39b700 1 --2- 172.21.15.8:0/456706723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3074101bf0 0x7f3074072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:17.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.300+0000 7f307a39b700 1 -- 172.21.15.8:0/456706723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3074102590 msgr2=0x7f3074073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:17.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.300+0000 7f307a39b700 1 --2- 172.21.15.8:0/456706723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3074102590 0x7f3074073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:17.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.300+0000 7f307a39b700 1 -- 172.21.15.8:0/456706723 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30640095f0 con 0x7f3074100a00 2023-08-11T12:24:17.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.300+0000 7f307ab9c700 1 --2- 172.21.15.8:0/456706723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3074102590 0x7f3074073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:17.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.300+0000 7f3079b9a700 1 --2- 172.21.15.8:0/456706723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3074101bf0 0x7f3074072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:17.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.301+0000 7f307a39b700 1 --2- 172.21.15.8:0/456706723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3074100a00 0x7f30740746d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3070009230 tx=0x7f307000b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:17.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.301+0000 7f306b7fe700 1 -- 172.21.15.8:0/456706723 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307001c070 con 0x7f3074100a00 2023-08-11T12:24:17.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.301+0000 7f307c5ff700 1 -- 172.21.15.8:0/456706723 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3070009520 con 0x7f3074100a00 2023-08-11T12:24:17.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.301+0000 7f307c5ff700 1 -- 172.21.15.8:0/456706723 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30741a0d10 con 0x7f3074100a00 2023-08-11T12:24:17.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.301+0000 7f306b7fe700 1 -- 172.21.15.8:0/456706723 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f307000f7d0 con 0x7f3074100a00 2023-08-11T12:24:17.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.301+0000 7f306b7fe700 1 -- 172.21.15.8:0/456706723 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3070004a00 con 0x7f3074100a00 2023-08-11T12:24:17.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.302+0000 7f307c5ff700 1 -- 172.21.15.8:0/456706723 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30741079b0 con 0x7f3074100a00 2023-08-11T12:24:17.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.305+0000 7f306b7fe700 1 -- 172.21.15.8:0/456706723 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f3070020070 con 0x7f3074100a00 2023-08-11T12:24:17.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.306+0000 7f306b7fe700 1 --2- 172.21.15.8:0/456706723 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f306009ffd0 0x7f30600a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:17.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.306+0000 7f306b7fe700 1 -- 172.21.15.8:0/456706723 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f30700cc330 con 0x7f3074100a00 2023-08-11T12:24:17.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.306+0000 7f3079b9a700 1 --2- 172.21.15.8:0/456706723 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f306009ffd0 0x7f30600a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:17.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.307+0000 7f3079b9a700 1 --2- 172.21.15.8:0/456706723 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f306009ffd0 0x7f30600a2490 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3064005fd0 tx=0x7f3064009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:17.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.308+0000 7f306b7fe700 1 -- 172.21.15.8:0/456706723 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f3070095de0 con 0x7f3074100a00 2023-08-11T12:24:17.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.518+0000 7f307c5ff700 1 -- 172.21.15.8:0/456706723 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f307410c4d0 con 0x7f3074100a00 2023-08-11T12:24:17.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.519+0000 7f306b7fe700 1 -- 172.21.15.8:0/456706723 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3070099400 con 0x7f3074100a00 2023-08-11T12:24:17.521 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-08-11T12:24:17.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.521+0000 7f307c5ff700 1 -- 172.21.15.8:0/456706723 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f306009ffd0 msgr2=0x7f30600a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:17.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.521+0000 7f307c5ff700 1 --2- 172.21.15.8:0/456706723 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f306009ffd0 0x7f30600a2490 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3064005fd0 tx=0x7f3064009310 comp rx=0 tx=0).stop 2023-08-11T12:24:17.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.521+0000 7f307c5ff700 1 -- 172.21.15.8:0/456706723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3074100a00 msgr2=0x7f30740746d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:17.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.521+0000 7f307c5ff700 1 --2- 172.21.15.8:0/456706723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3074100a00 0x7f30740746d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3070009230 tx=0x7f307000b790 comp rx=0 tx=0).stop 2023-08-11T12:24:17.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.522+0000 7f307c5ff700 1 -- 172.21.15.8:0/456706723 shutdown_connections 2023-08-11T12:24:17.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.522+0000 7f307c5ff700 1 --2- 172.21.15.8:0/456706723 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f306009ffd0 0x7f30600a2490 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:17.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.522+0000 7f307c5ff700 1 --2- 172.21.15.8:0/456706723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3074100a00 0x7f30740746d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:17.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.522+0000 7f307c5ff700 1 --2- 172.21.15.8:0/456706723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3074102590 0x7f3074073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:17.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.522+0000 7f307c5ff700 1 --2- 172.21.15.8:0/456706723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3074101bf0 0x7f3074072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:17.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.522+0000 7f307c5ff700 1 -- 172.21.15.8:0/456706723 >> 172.21.15.8:0/456706723 conn(0x7f30740fbf70 msgr2=0x7f30740fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:17.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.522+0000 7f307c5ff700 1 -- 172.21.15.8:0/456706723 shutdown_connections 2023-08-11T12:24:17.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.522+0000 7f307c5ff700 1 -- 172.21.15.8:0/456706723 wait complete. 2023-08-11T12:24:17.542 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-11T12:24:17.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.749+0000 7f414adff700 1 -- 172.21.15.8:0/3562766504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4144101bf0 msgr2=0x7f4144102050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:17.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.749+0000 7f414adff700 1 --2- 172.21.15.8:0/3562766504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4144101bf0 0x7f4144102050 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f41300099c0 tx=0x7f4130009cd0 comp rx=0 tx=0).stop 2023-08-11T12:24:17.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.749+0000 7f414adff700 1 -- 172.21.15.8:0/3562766504 shutdown_connections 2023-08-11T12:24:17.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.749+0000 7f414adff700 1 --2- 172.21.15.8:0/3562766504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4144100a00 0x7f4144100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:17.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.749+0000 7f414adff700 1 --2- 172.21.15.8:0/3562766504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4144102590 0x7f4144108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:17.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.749+0000 7f414adff700 1 --2- 172.21.15.8:0/3562766504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4144101bf0 0x7f4144102050 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:17.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.749+0000 7f414adff700 1 -- 172.21.15.8:0/3562766504 >> 172.21.15.8:0/3562766504 conn(0x7f41440fbf70 msgr2=0x7f41440fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:17.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.749+0000 7f414adff700 1 -- 172.21.15.8:0/3562766504 shutdown_connections 2023-08-11T12:24:17.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.749+0000 7f414adff700 1 -- 172.21.15.8:0/3562766504 wait complete. 2023-08-11T12:24:17.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.750+0000 7f414adff700 1 Processor -- start 2023-08-11T12:24:17.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.750+0000 7f414adff700 1 -- start start 2023-08-11T12:24:17.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.751+0000 7f414adff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4144100a00 0x7f4144198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:17.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.751+0000 7f414adff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4144101bf0 0x7f4144198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:17.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.751+0000 7f414adff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4144102590 0x7f414419feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:17.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.751+0000 7f414adff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41441a0480 con 0x7f4144100a00 2023-08-11T12:24:17.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.751+0000 7f414adff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41441a05c0 con 0x7f4144102590 2023-08-11T12:24:17.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.751+0000 7f414adff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41441a0750 con 0x7f4144101bf0 2023-08-11T12:24:17.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.751+0000 7f4148b9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4144100a00 0x7f4144198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:17.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.751+0000 7f4148b9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4144100a00 0x7f4144198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39748/0 (socket says 172.21.15.8:39748) 2023-08-11T12:24:17.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.751+0000 7f4148b9b700 1 -- 172.21.15.8:0/1919369725 learned_addr learned my addr 172.21.15.8:0/1919369725 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:17.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.751+0000 7f4143fff700 1 --2- 172.21.15.8:0/1919369725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4144101bf0 0x7f4144198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:17.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.751+0000 7f414939c700 1 --2- 172.21.15.8:0/1919369725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4144102590 0x7f414419feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:17.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.751+0000 7f4148b9b700 1 -- 172.21.15.8:0/1919369725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4144101bf0 msgr2=0x7f4144198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:17.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.751+0000 7f4148b9b700 1 --2- 172.21.15.8:0/1919369725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4144101bf0 0x7f4144198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:17.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.751+0000 7f4148b9b700 1 -- 172.21.15.8:0/1919369725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4144102590 msgr2=0x7f414419feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:17.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.751+0000 7f4148b9b700 1 --2- 172.21.15.8:0/1919369725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4144102590 0x7f414419feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:17.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.751+0000 7f4148b9b700 1 -- 172.21.15.8:0/1919369725 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41300095f0 con 0x7f4144100a00 2023-08-11T12:24:17.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.752+0000 7f4148b9b700 1 --2- 172.21.15.8:0/1919369725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4144100a00 0x7f4144198900 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f413800d980 tx=0x7f413800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:17.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.752+0000 7f4141ffb700 1 -- 172.21.15.8:0/1919369725 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413800f890 con 0x7f4144100a00 2023-08-11T12:24:17.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.752+0000 7f4141ffb700 1 -- 172.21.15.8:0/1919369725 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4138010460 con 0x7f4144100a00 2023-08-11T12:24:17.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.752+0000 7f414adff700 1 -- 172.21.15.8:0/1919369725 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41441a0a30 con 0x7f4144100a00 2023-08-11T12:24:17.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.752+0000 7f4141ffb700 1 -- 172.21.15.8:0/1919369725 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41380195c0 con 0x7f4144100a00 2023-08-11T12:24:17.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.752+0000 7f414adff700 1 -- 172.21.15.8:0/1919369725 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41441a0f90 con 0x7f4144100a00 2023-08-11T12:24:17.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.753+0000 7f414adff700 1 -- 172.21.15.8:0/1919369725 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f414410c260 con 0x7f4144100a00 2023-08-11T12:24:17.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.755+0000 7f4141ffb700 1 -- 172.21.15.8:0/1919369725 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f41380105d0 con 0x7f4144100a00 2023-08-11T12:24:17.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.758+0000 7f4141ffb700 1 --2- 172.21.15.8:0/1919369725 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f413409ffd0 0x7f41340a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:17.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.758+0000 7f4141ffb700 1 -- 172.21.15.8:0/1919369725 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f41380cb280 con 0x7f4144100a00 2023-08-11T12:24:17.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.758+0000 7f4143fff700 1 --2- 172.21.15.8:0/1919369725 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f413409ffd0 0x7f41340a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:17.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.758+0000 7f4143fff700 1 --2- 172.21.15.8:0/1919369725 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f413409ffd0 0x7f41340a2490 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f413000b580 tx=0x7f4130005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:17.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.762+0000 7f4141ffb700 1 -- 172.21.15.8:0/1919369725 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f4138094ca0 con 0x7f4144100a00 2023-08-11T12:24:17.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:17 smithi008 ceph-mon[97158]: pgmap v342: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2023-08-11T12:24:17.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:17 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3496135395' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:24:17.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:17 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1119704711' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:24:17.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:17 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/456706723' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:24:17.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:17 smithi194 ceph-mon[130905]: pgmap v342: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2023-08-11T12:24:17.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:17 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3496135395' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:24:17.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:17 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1119704711' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:24:17.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:17 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/456706723' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:24:17.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:17 smithi045 ceph-mon[130284]: pgmap v342: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2023-08-11T12:24:17.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:17 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3496135395' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:24:17.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:17 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1119704711' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:24:17.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:17 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/456706723' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:24:17.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.974+0000 7f414adff700 1 -- 172.21.15.8:0/1919369725 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f41441a11e0 con 0x7f4144100a00 2023-08-11T12:24:17.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.974+0000 7f4141ffb700 1 -- 172.21.15.8:0/1919369725 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) v1 ==== 103+0+11 (secure 0 0 0) 0x7f41380982c0 con 0x7f4144100a00 2023-08-11T12:24:17.977 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-08-11T12:24:17.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.976+0000 7f414adff700 1 -- 172.21.15.8:0/1919369725 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f413409ffd0 msgr2=0x7f41340a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:17.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.976+0000 7f414adff700 1 --2- 172.21.15.8:0/1919369725 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f413409ffd0 0x7f41340a2490 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f413000b580 tx=0x7f4130005fb0 comp rx=0 tx=0).stop 2023-08-11T12:24:17.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.976+0000 7f414adff700 1 -- 172.21.15.8:0/1919369725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4144100a00 msgr2=0x7f4144198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:17.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.976+0000 7f414adff700 1 --2- 172.21.15.8:0/1919369725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4144100a00 0x7f4144198900 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f413800d980 tx=0x7f413800dc90 comp rx=0 tx=0).stop 2023-08-11T12:24:17.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.977+0000 7f414adff700 1 -- 172.21.15.8:0/1919369725 shutdown_connections 2023-08-11T12:24:17.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.977+0000 7f414adff700 1 --2- 172.21.15.8:0/1919369725 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f413409ffd0 0x7f41340a2490 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:17.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.977+0000 7f414adff700 1 --2- 172.21.15.8:0/1919369725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4144102590 0x7f414419feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:17.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.977+0000 7f414adff700 1 --2- 172.21.15.8:0/1919369725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4144100a00 0x7f4144198900 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:17.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.977+0000 7f414adff700 1 --2- 172.21.15.8:0/1919369725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4144101bf0 0x7f4144198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:17.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.977+0000 7f414adff700 1 -- 172.21.15.8:0/1919369725 >> 172.21.15.8:0/1919369725 conn(0x7f41440fbf70 msgr2=0x7f41440fe210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:17.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.977+0000 7f414adff700 1 -- 172.21.15.8:0/1919369725 shutdown_connections 2023-08-11T12:24:17.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:17.977+0000 7f414adff700 1 -- 172.21.15.8:0/1919369725 wait complete. 2023-08-11T12:24:17.998 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-11T12:24:18.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.201+0000 7f7324dff700 1 -- 172.21.15.8:0/642820040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7320073380 msgr2=0x7f7320073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:18.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.201+0000 7f7324dff700 1 --2- 172.21.15.8:0/642820040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7320073380 0x7f7320073800 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7308009990 tx=0x7f7308009ca0 comp rx=0 tx=0).stop 2023-08-11T12:24:18.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.201+0000 7f7324dff700 1 -- 172.21.15.8:0/642820040 shutdown_connections 2023-08-11T12:24:18.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.201+0000 7f7324dff700 1 --2- 172.21.15.8:0/642820040 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73201088b0 0x7f732010ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:18.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.201+0000 7f7324dff700 1 --2- 172.21.15.8:0/642820040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7320074960 0x7f7320072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:18.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.201+0000 7f7324dff700 1 --2- 172.21.15.8:0/642820040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7320073380 0x7f7320073800 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:18.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.201+0000 7f7324dff700 1 -- 172.21.15.8:0/642820040 >> 172.21.15.8:0/642820040 conn(0x7f73200fbf80 msgr2=0x7f73200fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:18.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.201+0000 7f7324dff700 1 -- 172.21.15.8:0/642820040 shutdown_connections 2023-08-11T12:24:18.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.201+0000 7f7324dff700 1 -- 172.21.15.8:0/642820040 wait complete. 2023-08-11T12:24:18.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.202+0000 7f7324dff700 1 Processor -- start 2023-08-11T12:24:18.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.202+0000 7f7324dff700 1 -- start start 2023-08-11T12:24:18.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.203+0000 7f7324dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7320073380 0x7f7320198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:18.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.203+0000 7f7324dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7320074960 0x7f7320198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:18.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.203+0000 7f7324dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73201088b0 0x7f732019feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:18.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.203+0000 7f7324dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73201a0480 con 0x7f7320073380 2023-08-11T12:24:18.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.203+0000 7f7324dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73201a05c0 con 0x7f7320074960 2023-08-11T12:24:18.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.203+0000 7f7324dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73201a0750 con 0x7f73201088b0 2023-08-11T12:24:18.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.203+0000 7f731e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7320073380 0x7f7320198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:18.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.203+0000 7f7317fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7320074960 0x7f7320198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:18.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.203+0000 7f731e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7320073380 0x7f7320198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46618/0 (socket says 172.21.15.8:46618) 2023-08-11T12:24:18.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.203+0000 7f731e59c700 1 -- 172.21.15.8:0/429805821 learned_addr learned my addr 172.21.15.8:0/429805821 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:18.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.203+0000 7f731ed9d700 1 --2- 172.21.15.8:0/429805821 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73201088b0 0x7f732019feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:18.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.203+0000 7f731e59c700 1 -- 172.21.15.8:0/429805821 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73201088b0 msgr2=0x7f732019feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:18.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.203+0000 7f731e59c700 1 --2- 172.21.15.8:0/429805821 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73201088b0 0x7f732019feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:18.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.203+0000 7f731e59c700 1 -- 172.21.15.8:0/429805821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7320074960 msgr2=0x7f7320198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:18.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.203+0000 7f731e59c700 1 --2- 172.21.15.8:0/429805821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7320074960 0x7f7320198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:18.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.203+0000 7f731e59c700 1 -- 172.21.15.8:0/429805821 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73080095f0 con 0x7f7320073380 2023-08-11T12:24:18.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.203+0000 7f7317fff700 1 --2- 172.21.15.8:0/429805821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7320074960 0x7f7320198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:18.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.204+0000 7f731e59c700 1 --2- 172.21.15.8:0/429805821 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7320073380 0x7f7320198900 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f731000e9a0 tx=0x7f731000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:18.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.204+0000 7f73177fe700 1 -- 172.21.15.8:0/429805821 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7310009790 con 0x7f7320073380 2023-08-11T12:24:18.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.204+0000 7f73177fe700 1 -- 172.21.15.8:0/429805821 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7310010430 con 0x7f7320073380 2023-08-11T12:24:18.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.204+0000 7f7324dff700 1 -- 172.21.15.8:0/429805821 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73201a0a30 con 0x7f7320073380 2023-08-11T12:24:18.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.204+0000 7f73177fe700 1 -- 172.21.15.8:0/429805821 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7310018680 con 0x7f7320073380 2023-08-11T12:24:18.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.204+0000 7f7324dff700 1 -- 172.21.15.8:0/429805821 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73201a0f90 con 0x7f7320073380 2023-08-11T12:24:18.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.205+0000 7f7324dff700 1 -- 172.21.15.8:0/429805821 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7320106f60 con 0x7f7320073380 2023-08-11T12:24:18.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.207+0000 7f73177fe700 1 -- 172.21.15.8:0/429805821 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f73100105a0 con 0x7f7320073380 2023-08-11T12:24:18.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.208+0000 7f73177fe700 1 --2- 172.21.15.8:0/429805821 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f730c09ffd0 0x7f730c0a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:18.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.208+0000 7f73177fe700 1 -- 172.21.15.8:0/429805821 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f7310014070 con 0x7f7320073380 2023-08-11T12:24:18.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.208+0000 7f7317fff700 1 --2- 172.21.15.8:0/429805821 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f730c09ffd0 0x7f730c0a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:18.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.209+0000 7f7317fff700 1 --2- 172.21.15.8:0/429805821 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f730c09ffd0 0x7f730c0a2490 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f730800b2e0 tx=0x7f7308005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:18.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.212+0000 7f73177fe700 1 -- 172.21.15.8:0/429805821 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f7310051c30 con 0x7f7320073380 2023-08-11T12:24:18.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.425+0000 7f7324dff700 1 -- 172.21.15.8:0/429805821 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f732010e650 con 0x7f7320073380 2023-08-11T12:24:18.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.427+0000 7f73177fe700 1 -- 172.21.15.8:0/429805821 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24348 (secure 0 0 0) 0x7f7310095100 con 0x7f7320073380 2023-08-11T12:24:18.429 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:18.429 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":89,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","created":"2023-08-11T12:14:28.341113+0000","modified":"2023-08-11T12:22:31.713248+0000","last_up_change":"2023-08-11T12:21:14.913735+0000","last_in_change":"2023-08-11T12:20:57.476558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-11T12:17:49.040758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-11T12:22:01.383296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-11T12:22:02.816329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-11T12:22:06.369375+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f903e393-7894-42d6-8b11-737ceef1f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6803","nonce":664104961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6805","nonce":664104961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6809","nonce":664104961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6807","nonce":664104961}]},"public_addr":"172.21.15.8:6803/664104961","cluster_addr":"172.21.15.8:6805/664104961","heartbeat_back_addr":"172.21.15.8:6809/664104961","heartbeat_front_addr":"172.21.15.8:6807/664104961","state":["exists","up"]},{"osd":1,"uuid":"1e988e5c-e78c-46d5-80a5-dff7ac38cbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6801","nonce":4187350703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6803","nonce":4187350703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6807","nonce":4187350703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6805","nonce":4187350703}]},"public_addr":"172.21.15.45:6801/4187350703","cluster_addr":"172.21.15.45:6803/4187350703","heartbeat_back_addr":"172.21.15.45:6807/4187350703","heartbeat_front_addr":"172.21.15.45:6805/4187350703","state":["exists","up"]},{"osd":2,"uuid":"1835217c-a93c-4181-b8b8-cc410bab1a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6801","nonce":2547818140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6803","nonce":2547818140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6807","nonce":2547818140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6805","nonce":2547818140}]},"public_addr":"172.21.15.194:6801/2547818140","cluster_addr":"172.21.15.194:6803/2547818140","heartbeat_back_addr":"172.21.15.194:6807/2547818140","heartbeat_front_addr":"172.21.15.194:6805/2547818140","state":["exists","up"]},{"osd":3,"uuid":"b55ae61a-731c-4312-a998-661122b84788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6811","nonce":187418883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6813","nonce":187418883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6817","nonce":187418883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6815","nonce":187418883}]},"public_addr":"172.21.15.8:6811/187418883","cluster_addr":"172.21.15.8:6813/187418883","heartbeat_back_addr":"172.21.15.8:6817/187418883","heartbeat_front_addr":"172.21.15.8:6815/187418883","state":["exists","up"]},{"osd":4,"uuid":"2c28acbb-e807-4559-8aa2-a35ca84b5d43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6809","nonce":3099704571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6811","nonce":3099704571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6815","nonce":3099704571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6813","nonce":3099704571}]},"public_addr":"172.21.15.45:6809/3099704571","cluster_addr":"172.21.15.45:6811/3099704571","heartbeat_back_addr":"172.21.15.45:6815/3099704571","heartbeat_front_addr":"172.21.15.45:6813/3099704571","state":["exists","up"]},{"osd":5,"uuid":"37032289-8016-4730-9b69-f7985e058ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6809","nonce":263803874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6811","nonce":263803874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6815","nonce":263803874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6813","nonce":263803874}]},"public_addr":"172.21.15.194:6809/263803874","cluster_addr":"172.21.15.194:6811/263803874","heartbeat_back_addr":"172.21.15.194:6815/263803874","heartbeat_front_addr":"172.21.15.194:6813/263803874","state":["exists","up"]},{"osd":6,"uuid":"32d2dab9-6944-40d1-ada9-4f941821b063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6819","nonce":1802966829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6821","nonce":1802966829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6825","nonce":1802966829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6823","nonce":1802966829}]},"public_addr":"172.21.15.8:6819/1802966829","cluster_addr":"172.21.15.8:6821/1802966829","heartbeat_back_addr":"172.21.15.8:6825/1802966829","heartbeat_front_addr":"172.21.15.8:6823/1802966829","state":["exists","up"]},{"osd":7,"uuid":"086aff58-1554-49fe-92ff-5166b115aeef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6817","nonce":3715737148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6819","nonce":3715737148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6823","nonce":3715737148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6821","nonce":3715737148}]},"public_addr":"172.21.15.45:6817/3715737148","cluster_addr":"172.21.15.45:6819/3715737148","heartbeat_back_addr":"172.21.15.45:6823/3715737148","heartbeat_front_addr":"172.21.15.45:6821/3715737148","state":["exists","up"]},{"osd":8,"uuid":"7fff5e95-2453-4ea6-a5c1-3bba6a1f6400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6817","nonce":57497127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6819","nonce":57497127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6823","nonce":57497127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6821","nonce":57497127}]},"public_addr":"172.21.15.194:6817/57497127","cluster_addr":"172.21.15.194:6819/57497127","heartbeat_back_addr":"172.21.15.194:6823/57497127","heartbeat_front_addr":"172.21.15.194:6821/57497127","state":["exists","up"]},{"osd":9,"uuid":"31ab0121-4c92-42ec-9f19-e672062e8814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6827","nonce":434661930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6829","nonce":434661930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6833","nonce":434661930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6831","nonce":434661930}]},"public_addr":"172.21.15.8:6827/434661930","cluster_addr":"172.21.15.8:6829/434661930","heartbeat_back_addr":"172.21.15.8:6833/434661930","heartbeat_front_addr":"172.21.15.8:6831/434661930","state":["exists","up"]},{"osd":10,"uuid":"62c632e4-94f6-4630-9d94-8d28fccacf45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6825","nonce":3281212184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6827","nonce":3281212184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6831","nonce":3281212184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6829","nonce":3281212184}]},"public_addr":"172.21.15.45:6825/3281212184","cluster_addr":"172.21.15.45:6827/3281212184","heartbeat_back_addr":"172.21.15.45:6831/3281212184","heartbeat_front_addr":"172.21.15.45:6829/3281212184","state":["exists","up"]},{"osd":11,"uuid":"8ca4a80d-cd75-4230-b46d-aef6fdc03e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6825","nonce":1637875895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6827","nonce":1637875895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6831","nonce":1637875895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6829","nonce":1637875895}]},"public_addr":"172.21.15.194:6825/1637875895","cluster_addr":"172.21.15.194:6827/1637875895","heartbeat_back_addr":"172.21.15.194:6831/1637875895","heartbeat_front_addr":"172.21.15.194:6829/1637875895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:04.255616+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:26.243863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:46.630365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:12.926291+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:35.747049+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:55.793767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:21.685725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:43.703215+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:04.043674+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:30.320026+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:52.751974+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:21:13.230024+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/2000592056":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2102228072":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2374527928":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2928221278":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2744750874":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/3681755887":"2023-08-12T12:15:02.528403+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-11T12:24:18.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.429+0000 7f7324dff700 1 -- 172.21.15.8:0/429805821 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f730c09ffd0 msgr2=0x7f730c0a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:18.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.429+0000 7f7324dff700 1 --2- 172.21.15.8:0/429805821 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f730c09ffd0 0x7f730c0a2490 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f730800b2e0 tx=0x7f7308005fb0 comp rx=0 tx=0).stop 2023-08-11T12:24:18.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.429+0000 7f7324dff700 1 -- 172.21.15.8:0/429805821 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7320073380 msgr2=0x7f7320198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:18.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.429+0000 7f7324dff700 1 --2- 172.21.15.8:0/429805821 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7320073380 0x7f7320198900 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f731000e9a0 tx=0x7f731000ecb0 comp rx=0 tx=0).stop 2023-08-11T12:24:18.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.430+0000 7f7324dff700 1 -- 172.21.15.8:0/429805821 shutdown_connections 2023-08-11T12:24:18.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.430+0000 7f7324dff700 1 --2- 172.21.15.8:0/429805821 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f730c09ffd0 0x7f730c0a2490 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:18.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.430+0000 7f7324dff700 1 --2- 172.21.15.8:0/429805821 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73201088b0 0x7f732019feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:18.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.430+0000 7f7324dff700 1 --2- 172.21.15.8:0/429805821 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7320073380 0x7f7320198900 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:18.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.430+0000 7f7324dff700 1 --2- 172.21.15.8:0/429805821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7320074960 0x7f7320198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:18.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.430+0000 7f7324dff700 1 -- 172.21.15.8:0/429805821 >> 172.21.15.8:0/429805821 conn(0x7f73200fbf80 msgr2=0x7f73200fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:18.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.430+0000 7f7324dff700 1 -- 172.21.15.8:0/429805821 shutdown_connections 2023-08-11T12:24:18.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.430+0000 7f7324dff700 1 -- 172.21.15.8:0/429805821 wait complete. 2023-08-11T12:24:18.451 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-11T12:17:49.040758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-11T12:22:01.383296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-11T12:22:02.816329+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-11T12:22:06.369375+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-11T12:24:18.452 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-11T12:24:18.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.659+0000 7f83305ff700 1 -- 172.21.15.8:0/2284264898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8328101bf0 msgr2=0x7f8328102050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:18.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.659+0000 7f83305ff700 1 --2- 172.21.15.8:0/2284264898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8328101bf0 0x7f8328102050 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f83180099c0 tx=0x7f8318009cd0 comp rx=0 tx=0).stop 2023-08-11T12:24:18.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.659+0000 7f83305ff700 1 -- 172.21.15.8:0/2284264898 shutdown_connections 2023-08-11T12:24:18.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.659+0000 7f83305ff700 1 --2- 172.21.15.8:0/2284264898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8328100a00 0x7f8328100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:18.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.659+0000 7f83305ff700 1 --2- 172.21.15.8:0/2284264898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8328102590 0x7f8328108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:18.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.659+0000 7f83305ff700 1 --2- 172.21.15.8:0/2284264898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8328101bf0 0x7f8328102050 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:18.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.659+0000 7f83305ff700 1 -- 172.21.15.8:0/2284264898 >> 172.21.15.8:0/2284264898 conn(0x7f83280fbf70 msgr2=0x7f83280fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:18.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.659+0000 7f83305ff700 1 -- 172.21.15.8:0/2284264898 shutdown_connections 2023-08-11T12:24:18.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.659+0000 7f83305ff700 1 -- 172.21.15.8:0/2284264898 wait complete. 2023-08-11T12:24:18.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.660+0000 7f83305ff700 1 Processor -- start 2023-08-11T12:24:18.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.660+0000 7f83305ff700 1 -- start start 2023-08-11T12:24:18.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.660+0000 7f83305ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8328100a00 0x7f83280746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:18.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.660+0000 7f83305ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8328101bf0 0x7f8328072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:18.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.661+0000 7f83305ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8328102590 0x7f8328073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:18.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.661+0000 7f83305ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83280739f0 con 0x7f8328102590 2023-08-11T12:24:18.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.661+0000 7f83305ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8328073b60 con 0x7f8328101bf0 2023-08-11T12:24:18.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.661+0000 7f83305ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83281a0760 con 0x7f8328100a00 2023-08-11T12:24:18.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.661+0000 7f832e39b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8328100a00 0x7f83280746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:18.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.661+0000 7f832eb9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8328102590 0x7f8328073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:18.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.661+0000 7f832e39b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8328100a00 0x7f83280746d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:52524/0 (socket says 172.21.15.8:52524) 2023-08-11T12:24:18.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.661+0000 7f832e39b700 1 -- 172.21.15.8:0/1548086750 learned_addr learned my addr 172.21.15.8:0/1548086750 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:18.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.661+0000 7f832db9a700 1 --2- 172.21.15.8:0/1548086750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8328101bf0 0x7f8328072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:18.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.661+0000 7f832e39b700 1 -- 172.21.15.8:0/1548086750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8328101bf0 msgr2=0x7f8328072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:18.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.661+0000 7f832e39b700 1 --2- 172.21.15.8:0/1548086750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8328101bf0 0x7f8328072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:18.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.661+0000 7f832e39b700 1 -- 172.21.15.8:0/1548086750 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8328102590 msgr2=0x7f8328073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:18.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.661+0000 7f832e39b700 1 --2- 172.21.15.8:0/1548086750 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8328102590 0x7f8328073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:18.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.661+0000 7f832e39b700 1 -- 172.21.15.8:0/1548086750 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83180095f0 con 0x7f8328100a00 2023-08-11T12:24:18.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.662+0000 7f832e39b700 1 --2- 172.21.15.8:0/1548086750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8328100a00 0x7f83280746d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f832400e970 tx=0x7f832400ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:18.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.662+0000 7f831f7fe700 1 -- 172.21.15.8:0/1548086750 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8324009790 con 0x7f8328100a00 2023-08-11T12:24:18.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.662+0000 7f83305ff700 1 -- 172.21.15.8:0/1548086750 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83281a0a40 con 0x7f8328100a00 2023-08-11T12:24:18.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.662+0000 7f831f7fe700 1 -- 172.21.15.8:0/1548086750 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f832400c7e0 con 0x7f8328100a00 2023-08-11T12:24:18.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.662+0000 7f831f7fe700 1 -- 172.21.15.8:0/1548086750 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8324003c70 con 0x7f8328100a00 2023-08-11T12:24:18.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.662+0000 7f83305ff700 1 -- 172.21.15.8:0/1548086750 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83281a0fa0 con 0x7f8328100a00 2023-08-11T12:24:18.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.663+0000 7f83305ff700 1 -- 172.21.15.8:0/1548086750 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8328107980 con 0x7f8328100a00 2023-08-11T12:24:18.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.665+0000 7f831f7fe700 1 -- 172.21.15.8:0/1548086750 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f832400cc50 con 0x7f8328100a00 2023-08-11T12:24:18.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.666+0000 7f831f7fe700 1 --2- 172.21.15.8:0/1548086750 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f831409ff50 0x7f83140a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:18.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.667+0000 7f831f7fe700 1 -- 172.21.15.8:0/1548086750 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f8324014070 con 0x7f8328100a00 2023-08-11T12:24:18.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.667+0000 7f832db9a700 1 --2- 172.21.15.8:0/1548086750 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f831409ff50 0x7f83140a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:18.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.667+0000 7f832db9a700 1 --2- 172.21.15.8:0/1548086750 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f831409ff50 0x7f83140a2410 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f831800b580 tx=0x7f8318005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:18.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.668+0000 7f831f7fe700 1 -- 172.21.15.8:0/1548086750 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f8324095310 con 0x7f8328100a00 2023-08-11T12:24:18.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:18 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1919369725' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:24:18.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:18 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/429805821' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:24:18.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.883+0000 7f83305ff700 1 -- 172.21.15.8:0/1548086750 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f83281a0bd0 con 0x7f8328100a00 2023-08-11T12:24:18.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.884+0000 7f831f7fe700 1 -- 172.21.15.8:0/1548086750 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7f83281a0bd0 con 0x7f8328100a00 2023-08-11T12:24:18.886 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-08-11T12:24:18.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.886+0000 7f83305ff700 1 -- 172.21.15.8:0/1548086750 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f831409ff50 msgr2=0x7f83140a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:18.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.886+0000 7f83305ff700 1 --2- 172.21.15.8:0/1548086750 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f831409ff50 0x7f83140a2410 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f831800b580 tx=0x7f8318005fb0 comp rx=0 tx=0).stop 2023-08-11T12:24:18.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.886+0000 7f83305ff700 1 -- 172.21.15.8:0/1548086750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8328100a00 msgr2=0x7f83280746d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:18.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.886+0000 7f83305ff700 1 --2- 172.21.15.8:0/1548086750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8328100a00 0x7f83280746d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f832400e970 tx=0x7f832400ec80 comp rx=0 tx=0).stop 2023-08-11T12:24:18.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.887+0000 7f83305ff700 1 -- 172.21.15.8:0/1548086750 shutdown_connections 2023-08-11T12:24:18.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.887+0000 7f83305ff700 1 --2- 172.21.15.8:0/1548086750 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f831409ff50 0x7f83140a2410 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:18.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.887+0000 7f83305ff700 1 --2- 172.21.15.8:0/1548086750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8328100a00 0x7f83280746d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:18.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.887+0000 7f83305ff700 1 --2- 172.21.15.8:0/1548086750 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8328102590 0x7f8328073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:18.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.887+0000 7f83305ff700 1 --2- 172.21.15.8:0/1548086750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8328101bf0 0x7f8328072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:18.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.887+0000 7f83305ff700 1 -- 172.21.15.8:0/1548086750 >> 172.21.15.8:0/1548086750 conn(0x7f83280fbf70 msgr2=0x7f83280fe210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:18.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.887+0000 7f83305ff700 1 -- 172.21.15.8:0/1548086750 shutdown_connections 2023-08-11T12:24:18.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:18.887+0000 7f83305ff700 1 -- 172.21.15.8:0/1548086750 wait complete. 2023-08-11T12:24:18.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:18 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1919369725' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:24:18.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:18 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/429805821' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:24:18.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:18 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1919369725' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:24:18.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:18 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/429805821' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:24:18.908 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-11T12:24:19.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.112+0000 7f29a0fff700 1 -- 172.21.15.8:0/531721221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f299c073380 msgr2=0x7f299c073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:19.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.112+0000 7f29a0fff700 1 --2- 172.21.15.8:0/531721221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f299c073380 0x7f299c073800 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2990009990 tx=0x7f2990009ca0 comp rx=0 tx=0).stop 2023-08-11T12:24:19.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.112+0000 7f29a0fff700 1 -- 172.21.15.8:0/531721221 shutdown_connections 2023-08-11T12:24:19.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.112+0000 7f29a0fff700 1 --2- 172.21.15.8:0/531721221 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f299c1088c0 0x7f299c10ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:19.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.112+0000 7f29a0fff700 1 --2- 172.21.15.8:0/531721221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f299c074960 0x7f299c072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:19.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.112+0000 7f29a0fff700 1 --2- 172.21.15.8:0/531721221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f299c073380 0x7f299c073800 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:19.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.112+0000 7f29a0fff700 1 -- 172.21.15.8:0/531721221 >> 172.21.15.8:0/531721221 conn(0x7f299c0fbf70 msgr2=0x7f299c0fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:19.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.112+0000 7f29a0fff700 1 -- 172.21.15.8:0/531721221 shutdown_connections 2023-08-11T12:24:19.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.112+0000 7f29a0fff700 1 -- 172.21.15.8:0/531721221 wait complete. 2023-08-11T12:24:19.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.113+0000 7f29a0fff700 1 Processor -- start 2023-08-11T12:24:19.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.114+0000 7f29a0fff700 1 -- start start 2023-08-11T12:24:19.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.114+0000 7f29a0fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f299c073380 0x7f299c1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:19.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.114+0000 7f29a0fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f299c074960 0x7f299c198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:19.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.114+0000 7f29a0fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f299c1088c0 0x7f299c19fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:19.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.114+0000 7f29a0fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c1a0470 con 0x7f299c1088c0 2023-08-11T12:24:19.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.114+0000 7f29a0fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c1a05b0 con 0x7f299c073380 2023-08-11T12:24:19.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.114+0000 7f29a0fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c1a0740 con 0x7f299c074960 2023-08-11T12:24:19.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.114+0000 7f299ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f299c1088c0 0x7f299c19fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:19.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.114+0000 7f299a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f299c073380 0x7f299c1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:19.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.114+0000 7f299a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f299c073380 0x7f299c1988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:36934/0 (socket says 172.21.15.8:36934) 2023-08-11T12:24:19.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.114+0000 7f299a59c700 1 -- 172.21.15.8:0/1479127212 learned_addr learned my addr 172.21.15.8:0/1479127212 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:19.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.114+0000 7f2999d9b700 1 --2- 172.21.15.8:0/1479127212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f299c074960 0x7f299c198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:19.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.115+0000 7f299ad9d700 1 -- 172.21.15.8:0/1479127212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f299c074960 msgr2=0x7f299c198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:19.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.115+0000 7f299ad9d700 1 --2- 172.21.15.8:0/1479127212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f299c074960 0x7f299c198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:19.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.115+0000 7f299ad9d700 1 -- 172.21.15.8:0/1479127212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f299c073380 msgr2=0x7f299c1988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:19.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.115+0000 7f299ad9d700 1 --2- 172.21.15.8:0/1479127212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f299c073380 0x7f299c1988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:19.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.115+0000 7f299ad9d700 1 -- 172.21.15.8:0/1479127212 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29900095f0 con 0x7f299c1088c0 2023-08-11T12:24:19.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.115+0000 7f299a59c700 1 --2- 172.21.15.8:0/1479127212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f299c073380 0x7f299c1988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:19.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.115+0000 7f299ad9d700 1 --2- 172.21.15.8:0/1479127212 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f299c1088c0 0x7f299c19fea0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f299400e970 tx=0x7f299400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:19.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.115+0000 7f298b7fe700 1 -- 172.21.15.8:0/1479127212 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2994004220 con 0x7f299c1088c0 2023-08-11T12:24:19.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.115+0000 7f29a0fff700 1 -- 172.21.15.8:0/1479127212 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299c1a0a20 con 0x7f299c1088c0 2023-08-11T12:24:19.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.115+0000 7f298b7fe700 1 -- 172.21.15.8:0/1479127212 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2994004cf0 con 0x7f299c1088c0 2023-08-11T12:24:19.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.115+0000 7f298b7fe700 1 -- 172.21.15.8:0/1479127212 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2994005660 con 0x7f299c1088c0 2023-08-11T12:24:19.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.115+0000 7f29a0fff700 1 -- 172.21.15.8:0/1479127212 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299c1a0ee0 con 0x7f299c1088c0 2023-08-11T12:24:19.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.116+0000 7f29a0fff700 1 -- 172.21.15.8:0/1479127212 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299c106f70 con 0x7f299c1088c0 2023-08-11T12:24:19.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.118+0000 7f298b7fe700 1 -- 172.21.15.8:0/1479127212 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f2994004750 con 0x7f299c1088c0 2023-08-11T12:24:19.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.120+0000 7f298b7fe700 1 --2- 172.21.15.8:0/1479127212 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f298409ff50 0x7f29840a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:19.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.120+0000 7f298b7fe700 1 -- 172.21.15.8:0/1479127212 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f2994014070 con 0x7f299c1088c0 2023-08-11T12:24:19.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.120+0000 7f299a59c700 1 --2- 172.21.15.8:0/1479127212 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f298409ff50 0x7f29840a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:19.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.121+0000 7f299a59c700 1 --2- 172.21.15.8:0/1479127212 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f298409ff50 0x7f29840a2410 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f298c009c10 tx=0x7f298c00b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:19.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.123+0000 7f298b7fe700 1 -- 172.21.15.8:0/1479127212 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f2994094d00 con 0x7f299c1088c0 2023-08-11T12:24:19.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.332+0000 7f29a0fff700 1 -- 172.21.15.8:0/1479127212 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f299c02ccf0 con 0x7f299c1088c0 2023-08-11T12:24:19.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.333+0000 7f298b7fe700 1 -- 172.21.15.8:0/1479127212 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2994004e60 con 0x7f299c1088c0 2023-08-11T12:24:19.335 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-08-11T12:24:19.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.335+0000 7f29a0fff700 1 -- 172.21.15.8:0/1479127212 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f298409ff50 msgr2=0x7f29840a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:19.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.335+0000 7f29a0fff700 1 --2- 172.21.15.8:0/1479127212 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f298409ff50 0x7f29840a2410 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f298c009c10 tx=0x7f298c00b040 comp rx=0 tx=0).stop 2023-08-11T12:24:19.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.335+0000 7f29a0fff700 1 -- 172.21.15.8:0/1479127212 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f299c1088c0 msgr2=0x7f299c19fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:19.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.335+0000 7f29a0fff700 1 --2- 172.21.15.8:0/1479127212 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f299c1088c0 0x7f299c19fea0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f299400e970 tx=0x7f299400ec80 comp rx=0 tx=0).stop 2023-08-11T12:24:19.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.335+0000 7f29a0fff700 1 -- 172.21.15.8:0/1479127212 shutdown_connections 2023-08-11T12:24:19.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.335+0000 7f29a0fff700 1 --2- 172.21.15.8:0/1479127212 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f298409ff50 0x7f29840a2410 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:19.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.335+0000 7f29a0fff700 1 --2- 172.21.15.8:0/1479127212 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f299c1088c0 0x7f299c19fea0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:19.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.335+0000 7f29a0fff700 1 --2- 172.21.15.8:0/1479127212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f299c073380 0x7f299c1988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:19.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.335+0000 7f29a0fff700 1 --2- 172.21.15.8:0/1479127212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f299c074960 0x7f299c198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:19.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.335+0000 7f29a0fff700 1 -- 172.21.15.8:0/1479127212 >> 172.21.15.8:0/1479127212 conn(0x7f299c0fbf70 msgr2=0x7f299c0fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:19.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.336+0000 7f29a0fff700 1 -- 172.21.15.8:0/1479127212 shutdown_connections 2023-08-11T12:24:19.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.336+0000 7f29a0fff700 1 -- 172.21.15.8:0/1479127212 wait complete. 2023-08-11T12:24:19.356 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-11T12:24:19.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.561+0000 7f89fb7ff700 1 -- 172.21.15.8:0/2725502536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89f4100a00 msgr2=0x7f89f4100e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:19.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.561+0000 7f89fb7ff700 1 --2- 172.21.15.8:0/2725502536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89f4100a00 0x7f89f4100e20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f89f00099c0 tx=0x7f89f0009cd0 comp rx=0 tx=0).stop 2023-08-11T12:24:19.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.561+0000 7f89fb7ff700 1 -- 172.21.15.8:0/2725502536 shutdown_connections 2023-08-11T12:24:19.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.561+0000 7f89fb7ff700 1 --2- 172.21.15.8:0/2725502536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89f4102590 0x7f89f4108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:19.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.561+0000 7f89fb7ff700 1 --2- 172.21.15.8:0/2725502536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89f4100a00 0x7f89f4100e20 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:19.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.561+0000 7f89fb7ff700 1 --2- 172.21.15.8:0/2725502536 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89f4101bf0 0x7f89f4102050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:19.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.561+0000 7f89fb7ff700 1 -- 172.21.15.8:0/2725502536 >> 172.21.15.8:0/2725502536 conn(0x7f89f40fbf70 msgr2=0x7f89f40fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:19.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.561+0000 7f89fb7ff700 1 -- 172.21.15.8:0/2725502536 shutdown_connections 2023-08-11T12:24:19.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.561+0000 7f89fb7ff700 1 -- 172.21.15.8:0/2725502536 wait complete. 2023-08-11T12:24:19.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.562+0000 7f89fb7ff700 1 Processor -- start 2023-08-11T12:24:19.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.562+0000 7f89fb7ff700 1 -- start start 2023-08-11T12:24:19.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.562+0000 7f89fb7ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89f4100a00 0x7f89f40746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:19.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.563+0000 7f89fb7ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89f4101bf0 0x7f89f4072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:19.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.563+0000 7f89fb7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89f4102590 0x7f89f4073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:19.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.563+0000 7f89fb7ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f40739f0 con 0x7f89f4101bf0 2023-08-11T12:24:19.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.563+0000 7f89fb7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f4073b60 con 0x7f89f4102590 2023-08-11T12:24:19.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.563+0000 7f89fb7ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f41a0760 con 0x7f89f4100a00 2023-08-11T12:24:19.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.563+0000 7f89f8d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89f4101bf0 0x7f89f4072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:19.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.563+0000 7f89f8d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89f4101bf0 0x7f89f4072d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46680/0 (socket says 172.21.15.8:46680) 2023-08-11T12:24:19.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.563+0000 7f89f8d9a700 1 -- 172.21.15.8:0/2891478296 learned_addr learned my addr 172.21.15.8:0/2891478296 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:19.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.563+0000 7f89f959b700 1 --2- 172.21.15.8:0/2891478296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89f4100a00 0x7f89f40746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:19.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.563+0000 7f89f9d9c700 1 --2- 172.21.15.8:0/2891478296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89f4102590 0x7f89f4073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:19.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.563+0000 7f89f8d9a700 1 -- 172.21.15.8:0/2891478296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89f4100a00 msgr2=0x7f89f40746d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:19.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.563+0000 7f89f8d9a700 1 --2- 172.21.15.8:0/2891478296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89f4100a00 0x7f89f40746d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:19.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.563+0000 7f89f8d9a700 1 -- 172.21.15.8:0/2891478296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89f4102590 msgr2=0x7f89f4073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:19.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.563+0000 7f89f8d9a700 1 --2- 172.21.15.8:0/2891478296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89f4102590 0x7f89f4073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:19.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.563+0000 7f89f8d9a700 1 -- 172.21.15.8:0/2891478296 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f00095f0 con 0x7f89f4101bf0 2023-08-11T12:24:19.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.563+0000 7f89f9d9c700 1 --2- 172.21.15.8:0/2891478296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89f4102590 0x7f89f4073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:24:19.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.563+0000 7f89f8d9a700 1 --2- 172.21.15.8:0/2891478296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89f4101bf0 0x7f89f4072d10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f89e400e9a0 tx=0x7f89e400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:19.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.564+0000 7f89ea7fc700 1 -- 172.21.15.8:0/2891478296 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e4009790 con 0x7f89f4101bf0 2023-08-11T12:24:19.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.564+0000 7f89ea7fc700 1 -- 172.21.15.8:0/2891478296 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f89e400cbd0 con 0x7f89f4101bf0 2023-08-11T12:24:19.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.564+0000 7f89ea7fc700 1 -- 172.21.15.8:0/2891478296 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e4018680 con 0x7f89f4101bf0 2023-08-11T12:24:19.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.564+0000 7f89fb7ff700 1 -- 172.21.15.8:0/2891478296 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f41a0a40 con 0x7f89f4101bf0 2023-08-11T12:24:19.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.564+0000 7f89fb7ff700 1 -- 172.21.15.8:0/2891478296 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f41a0f00 con 0x7f89f4101bf0 2023-08-11T12:24:19.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.565+0000 7f89fb7ff700 1 -- 172.21.15.8:0/2891478296 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f4107980 con 0x7f89f4101bf0 2023-08-11T12:24:19.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.567+0000 7f89ea7fc700 1 -- 172.21.15.8:0/2891478296 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f89e400cd40 con 0x7f89f4101bf0 2023-08-11T12:24:19.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.568+0000 7f89ea7fc700 1 --2- 172.21.15.8:0/2891478296 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89e009ffd0 0x7f89e00a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:19.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.568+0000 7f89ea7fc700 1 -- 172.21.15.8:0/2891478296 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f89e4014070 con 0x7f89f4101bf0 2023-08-11T12:24:19.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.568+0000 7f89f959b700 1 --2- 172.21.15.8:0/2891478296 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89e009ffd0 0x7f89e00a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:19.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.569+0000 7f89f959b700 1 --2- 172.21.15.8:0/2891478296 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89e009ffd0 0x7f89e00a2490 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f89f0009990 tx=0x7f89f0005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:19.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.572+0000 7f89ea7fc700 1 -- 172.21.15.8:0/2891478296 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f89e4051c30 con 0x7f89f4101bf0 2023-08-11T12:24:19.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.785+0000 7f89fb7ff700 1 -- 172.21.15.8:0/2891478296 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f89f402cd30 con 0x7f89f4101bf0 2023-08-11T12:24:19.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.785+0000 7f89ea7fc700 1 -- 172.21.15.8:0/2891478296 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f89e40951f0 con 0x7f89f4101bf0 2023-08-11T12:24:19.789 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-08-11T12:24:19.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.787+0000 7f89fb7ff700 1 -- 172.21.15.8:0/2891478296 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89e009ffd0 msgr2=0x7f89e00a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:19.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.787+0000 7f89fb7ff700 1 --2- 172.21.15.8:0/2891478296 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89e009ffd0 0x7f89e00a2490 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f89f0009990 tx=0x7f89f0005fb0 comp rx=0 tx=0).stop 2023-08-11T12:24:19.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.787+0000 7f89fb7ff700 1 -- 172.21.15.8:0/2891478296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89f4101bf0 msgr2=0x7f89f4072d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:19.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.787+0000 7f89fb7ff700 1 --2- 172.21.15.8:0/2891478296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89f4101bf0 0x7f89f4072d10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f89e400e9a0 tx=0x7f89e400ecb0 comp rx=0 tx=0).stop 2023-08-11T12:24:19.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.788+0000 7f89fb7ff700 1 -- 172.21.15.8:0/2891478296 shutdown_connections 2023-08-11T12:24:19.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.788+0000 7f89fb7ff700 1 --2- 172.21.15.8:0/2891478296 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89e009ffd0 0x7f89e00a2490 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:19.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.788+0000 7f89fb7ff700 1 --2- 172.21.15.8:0/2891478296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89f4100a00 0x7f89f40746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:19.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.788+0000 7f89fb7ff700 1 --2- 172.21.15.8:0/2891478296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89f4102590 0x7f89f4073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:19.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.788+0000 7f89fb7ff700 1 --2- 172.21.15.8:0/2891478296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89f4101bf0 0x7f89f4072d10 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:19.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.788+0000 7f89fb7ff700 1 -- 172.21.15.8:0/2891478296 >> 172.21.15.8:0/2891478296 conn(0x7f89f40fbf70 msgr2=0x7f89f40fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:19.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.788+0000 7f89fb7ff700 1 -- 172.21.15.8:0/2891478296 shutdown_connections 2023-08-11T12:24:19.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:19.788+0000 7f89fb7ff700 1 -- 172.21.15.8:0/2891478296 wait complete. 2023-08-11T12:24:19.809 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-11T12:24:19.873 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:19 smithi008 ceph-mon[97158]: pgmap v343: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2023-08-11T12:24:19.874 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:19 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1548086750' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:24:19.874 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:19 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1479127212' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:24:19.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:19 smithi194 ceph-mon[130905]: pgmap v343: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2023-08-11T12:24:19.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:19 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1548086750' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:24:19.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:19 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1479127212' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:24:19.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:19 smithi045 ceph-mon[130284]: pgmap v343: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2023-08-11T12:24:19.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:19 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1548086750' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:24:19.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:19 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1479127212' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:24:20.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.018+0000 7f71fbfff700 1 -- 172.21.15.8:0/121521839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71f4101bf0 msgr2=0x7f71f4102050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:20.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.018+0000 7f71fbfff700 1 --2- 172.21.15.8:0/121521839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71f4101bf0 0x7f71f4102050 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f71e40099c0 tx=0x7f71e4009cd0 comp rx=0 tx=0).stop 2023-08-11T12:24:20.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.018+0000 7f71fbfff700 1 -- 172.21.15.8:0/121521839 shutdown_connections 2023-08-11T12:24:20.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.018+0000 7f71fbfff700 1 --2- 172.21.15.8:0/121521839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71f4100a00 0x7f71f4100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:20.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.018+0000 7f71fbfff700 1 --2- 172.21.15.8:0/121521839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71f4102590 0x7f71f4108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:20.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.018+0000 7f71fbfff700 1 --2- 172.21.15.8:0/121521839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71f4101bf0 0x7f71f4102050 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:20.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.018+0000 7f71fbfff700 1 -- 172.21.15.8:0/121521839 >> 172.21.15.8:0/121521839 conn(0x7f71f40fbf70 msgr2=0x7f71f40fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:20.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.018+0000 7f71fbfff700 1 -- 172.21.15.8:0/121521839 shutdown_connections 2023-08-11T12:24:20.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.018+0000 7f71fbfff700 1 -- 172.21.15.8:0/121521839 wait complete. 2023-08-11T12:24:20.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.019+0000 7f71fbfff700 1 Processor -- start 2023-08-11T12:24:20.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.019+0000 7f71fbfff700 1 -- start start 2023-08-11T12:24:20.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.019+0000 7f71fbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71f4100a00 0x7f71f4198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:20.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.019+0000 7f71fbfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71f4101bf0 0x7f71f4198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:20.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.020+0000 7f71fbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71f4102590 0x7f71f419fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:20.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.020+0000 7f71fbfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f41a0490 con 0x7f71f4102590 2023-08-11T12:24:20.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.020+0000 7f71fbfff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f41a05d0 con 0x7f71f4100a00 2023-08-11T12:24:20.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.020+0000 7f71fbfff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f41a0760 con 0x7f71f4101bf0 2023-08-11T12:24:20.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.020+0000 7f71fa59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71f4102590 0x7f71f419fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:20.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.020+0000 7f71f9d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71f4100a00 0x7f71f4198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:20.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.020+0000 7f71f959a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71f4101bf0 0x7f71f4198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:20.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.020+0000 7f71fa59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71f4102590 0x7f71f419fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46696/0 (socket says 172.21.15.8:46696) 2023-08-11T12:24:20.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.020+0000 7f71fa59c700 1 -- 172.21.15.8:0/3196440861 learned_addr learned my addr 172.21.15.8:0/3196440861 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:20.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.020+0000 7f71f9d9b700 1 -- 172.21.15.8:0/3196440861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71f4101bf0 msgr2=0x7f71f4198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:20.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.020+0000 7f71f9d9b700 1 --2- 172.21.15.8:0/3196440861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71f4101bf0 0x7f71f4198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:20.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.020+0000 7f71f9d9b700 1 -- 172.21.15.8:0/3196440861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71f4102590 msgr2=0x7f71f419fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:20.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.020+0000 7f71f9d9b700 1 --2- 172.21.15.8:0/3196440861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71f4102590 0x7f71f419fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:20.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.020+0000 7f71f9d9b700 1 -- 172.21.15.8:0/3196440861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e40095f0 con 0x7f71f4100a00 2023-08-11T12:24:20.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.020+0000 7f71fa59c700 1 --2- 172.21.15.8:0/3196440861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71f4102590 0x7f71f419fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:20.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.021+0000 7f71f9d9b700 1 --2- 172.21.15.8:0/3196440861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71f4100a00 0x7f71f4198910 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f71f000d720 tx=0x7f71f000da30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:20.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.021+0000 7f71eaffd700 1 -- 172.21.15.8:0/3196440861 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f000f690 con 0x7f71f4100a00 2023-08-11T12:24:20.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.021+0000 7f71fbfff700 1 -- 172.21.15.8:0/3196440861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f41a0a40 con 0x7f71f4100a00 2023-08-11T12:24:20.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.021+0000 7f71eaffd700 1 -- 172.21.15.8:0/3196440861 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71f000fcb0 con 0x7f71f4100a00 2023-08-11T12:24:20.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.021+0000 7f71eaffd700 1 -- 172.21.15.8:0/3196440861 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f0010e00 con 0x7f71f4100a00 2023-08-11T12:24:20.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.021+0000 7f71fbfff700 1 -- 172.21.15.8:0/3196440861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f41a0fa0 con 0x7f71f4100a00 2023-08-11T12:24:20.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.022+0000 7f71fbfff700 1 -- 172.21.15.8:0/3196440861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f410c260 con 0x7f71f4100a00 2023-08-11T12:24:20.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.024+0000 7f71eaffd700 1 -- 172.21.15.8:0/3196440861 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f71f00104f0 con 0x7f71f4100a00 2023-08-11T12:24:20.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.026+0000 7f71eaffd700 1 --2- 172.21.15.8:0/3196440861 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f71e009ff50 0x7f71e00a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:20.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.026+0000 7f71eaffd700 1 -- 172.21.15.8:0/3196440861 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f71f00cb1d0 con 0x7f71f4100a00 2023-08-11T12:24:20.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.026+0000 7f71f959a700 1 --2- 172.21.15.8:0/3196440861 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f71e009ff50 0x7f71e00a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:20.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.027+0000 7f71f959a700 1 --2- 172.21.15.8:0/3196440861 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f71e009ff50 0x7f71e00a2410 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f71e400b580 tx=0x7f71e4005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:20.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.028+0000 7f71eaffd700 1 -- 172.21.15.8:0/3196440861 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f71f0094bf0 con 0x7f71f4100a00 2023-08-11T12:24:20.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.242+0000 7f71fbfff700 1 -- 172.21.15.8:0/3196440861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f71f41a1190 con 0x7f71f4100a00 2023-08-11T12:24:20.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.243+0000 7f71eaffd700 1 -- 172.21.15.8:0/3196440861 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) v1 ==== 103+0+11 (secure 0 0 0) 0x7f71f001e0a0 con 0x7f71f4100a00 2023-08-11T12:24:20.245 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-08-11T12:24:20.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.246+0000 7f71fbfff700 1 -- 172.21.15.8:0/3196440861 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f71e009ff50 msgr2=0x7f71e00a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:20.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.246+0000 7f71fbfff700 1 --2- 172.21.15.8:0/3196440861 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f71e009ff50 0x7f71e00a2410 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f71e400b580 tx=0x7f71e4005fb0 comp rx=0 tx=0).stop 2023-08-11T12:24:20.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.246+0000 7f71fbfff700 1 -- 172.21.15.8:0/3196440861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71f4100a00 msgr2=0x7f71f4198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:20.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.246+0000 7f71fbfff700 1 --2- 172.21.15.8:0/3196440861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71f4100a00 0x7f71f4198910 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f71f000d720 tx=0x7f71f000da30 comp rx=0 tx=0).stop 2023-08-11T12:24:20.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.246+0000 7f71fbfff700 1 -- 172.21.15.8:0/3196440861 shutdown_connections 2023-08-11T12:24:20.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.246+0000 7f71fbfff700 1 --2- 172.21.15.8:0/3196440861 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f71e009ff50 0x7f71e00a2410 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:20.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.246+0000 7f71fbfff700 1 --2- 172.21.15.8:0/3196440861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71f4102590 0x7f71f419fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:20.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.246+0000 7f71fbfff700 1 --2- 172.21.15.8:0/3196440861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71f4100a00 0x7f71f4198910 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:20.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.246+0000 7f71fbfff700 1 --2- 172.21.15.8:0/3196440861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71f4101bf0 0x7f71f4198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:20.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.246+0000 7f71fbfff700 1 -- 172.21.15.8:0/3196440861 >> 172.21.15.8:0/3196440861 conn(0x7f71f40fbf70 msgr2=0x7f71f40fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:20.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.246+0000 7f71fbfff700 1 -- 172.21.15.8:0/3196440861 shutdown_connections 2023-08-11T12:24:20.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.246+0000 7f71fbfff700 1 -- 172.21.15.8:0/3196440861 wait complete. 2023-08-11T12:24:20.267 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-08-11T12:24:20.268 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-11T12:24:20.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.470+0000 7f7e1c9ff700 1 -- 172.21.15.8:0/1923605226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e18101bd0 msgr2=0x7f7e18102030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:20.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.470+0000 7f7e1c9ff700 1 --2- 172.21.15.8:0/1923605226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e18101bd0 0x7f7e18102030 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0099c0 tx=0x7f7e0c009cd0 comp rx=0 tx=0).stop 2023-08-11T12:24:20.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.470+0000 7f7e1c9ff700 1 -- 172.21.15.8:0/1923605226 shutdown_connections 2023-08-11T12:24:20.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.470+0000 7f7e1c9ff700 1 --2- 172.21.15.8:0/1923605226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e181009e0 0x7f7e18100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:20.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.470+0000 7f7e1c9ff700 1 --2- 172.21.15.8:0/1923605226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e18102570 0x7f7e18108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:20.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.470+0000 7f7e1c9ff700 1 --2- 172.21.15.8:0/1923605226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e18101bd0 0x7f7e18102030 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:20.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.470+0000 7f7e1c9ff700 1 -- 172.21.15.8:0/1923605226 >> 172.21.15.8:0/1923605226 conn(0x7f7e180fbf50 msgr2=0x7f7e180fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:20.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.470+0000 7f7e1c9ff700 1 -- 172.21.15.8:0/1923605226 shutdown_connections 2023-08-11T12:24:20.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.470+0000 7f7e1c9ff700 1 -- 172.21.15.8:0/1923605226 wait complete. 2023-08-11T12:24:20.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.471+0000 7f7e1c9ff700 1 Processor -- start 2023-08-11T12:24:20.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.471+0000 7f7e1c9ff700 1 -- start start 2023-08-11T12:24:20.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.471+0000 7f7e1c9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e181009e0 0x7f7e181988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:20.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.471+0000 7f7e1c9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e18101bd0 0x7f7e18198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:20.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.471+0000 7f7e1c9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e18102570 0x7f7e1819fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:20.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.471+0000 7f7e1c9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e181a0460 con 0x7f7e18101bd0 2023-08-11T12:24:20.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.471+0000 7f7e1c9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e181a05a0 con 0x7f7e18102570 2023-08-11T12:24:20.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.471+0000 7f7e1c9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e181a0730 con 0x7f7e181009e0 2023-08-11T12:24:20.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.472+0000 7f7e1659c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e181009e0 0x7f7e181988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:20.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.472+0000 7f7e15d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e18101bd0 0x7f7e18198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:20.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.472+0000 7f7e1659c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e181009e0 0x7f7e181988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:52602/0 (socket says 172.21.15.8:52602) 2023-08-11T12:24:20.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.472+0000 7f7e1659c700 1 -- 172.21.15.8:0/25182436 learned_addr learned my addr 172.21.15.8:0/25182436 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:20.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.472+0000 7f7e16d9d700 1 --2- 172.21.15.8:0/25182436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e18102570 0x7f7e1819fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:20.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.472+0000 7f7e15d9b700 1 -- 172.21.15.8:0/25182436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e181009e0 msgr2=0x7f7e181988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:20.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.472+0000 7f7e15d9b700 1 --2- 172.21.15.8:0/25182436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e181009e0 0x7f7e181988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:20.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.472+0000 7f7e15d9b700 1 -- 172.21.15.8:0/25182436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e18102570 msgr2=0x7f7e1819fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:20.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.472+0000 7f7e15d9b700 1 --2- 172.21.15.8:0/25182436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e18102570 0x7f7e1819fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:20.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.472+0000 7f7e15d9b700 1 -- 172.21.15.8:0/25182436 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c0095f0 con 0x7f7e18101bd0 2023-08-11T12:24:20.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.472+0000 7f7e15d9b700 1 --2- 172.21.15.8:0/25182436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e18101bd0 0x7f7e18198e20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0098e0 tx=0x7f7e0c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:20.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.473+0000 7f7e077fe700 1 -- 172.21.15.8:0/25182436 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c01d070 con 0x7f7e18101bd0 2023-08-11T12:24:20.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.473+0000 7f7e077fe700 1 -- 172.21.15.8:0/25182436 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e0c0054e0 con 0x7f7e18101bd0 2023-08-11T12:24:20.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.473+0000 7f7e1c9ff700 1 -- 172.21.15.8:0/25182436 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e181a09b0 con 0x7f7e18101bd0 2023-08-11T12:24:20.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.473+0000 7f7e077fe700 1 -- 172.21.15.8:0/25182436 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c004b30 con 0x7f7e18101bd0 2023-08-11T12:24:20.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.473+0000 7f7e1c9ff700 1 -- 172.21.15.8:0/25182436 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e181a0d70 con 0x7f7e18101bd0 2023-08-11T12:24:20.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.474+0000 7f7e1c9ff700 1 -- 172.21.15.8:0/25182436 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e18193030 con 0x7f7e18101bd0 2023-08-11T12:24:20.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.476+0000 7f7e077fe700 1 -- 172.21.15.8:0/25182436 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f7e0c00fb80 con 0x7f7e18101bd0 2023-08-11T12:24:20.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.477+0000 7f7e077fe700 1 --2- 172.21.15.8:0/25182436 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f7e0009ff50 0x7f7e000a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:20.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.477+0000 7f7e077fe700 1 -- 172.21.15.8:0/25182436 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f7e0c0cc160 con 0x7f7e18101bd0 2023-08-11T12:24:20.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.477+0000 7f7e1659c700 1 --2- 172.21.15.8:0/25182436 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f7e0009ff50 0x7f7e000a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:20.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.478+0000 7f7e1659c700 1 --2- 172.21.15.8:0/25182436 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f7e0009ff50 0x7f7e000a2410 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7e08005950 tx=0x7f7e08009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:20.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.481+0000 7f7e077fe700 1 -- 172.21.15.8:0/25182436 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f7e0c095c10 con 0x7f7e18101bd0 2023-08-11T12:24:20.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.739+0000 7f7e1c9ff700 1 -- 172.21.15.8:0/25182436 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e1810c240 con 0x7f7e18101bd0 2023-08-11T12:24:20.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.739+0000 7f7e077fe700 1 -- 172.21.15.8:0/25182436 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11351 (secure 0 0 0) 0x7f7e0c099230 con 0x7f7e18101bd0 2023-08-11T12:24:20.742 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:20.742 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14469,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2854286216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2854286216},{"type":"v1","addr":"172.21.15.8:6835","nonce":2854286216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/805368621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":805368621},{"type":"v1","addr":"172.21.15.8:6837","nonce":805368621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-11T12:22:03.398475+0000","modified":"2023-08-11T12:22:32.690553+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24575,"mds_1":24550,"mds_2":24517,"mds_3":24500,"mds_4":24464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14526":{"gid":14526,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/2990530720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":2990530720},{"type":"v1","addr":"172.21.15.8:6839","nonce":2990530720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14538":{"gid":14538,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6841/3589272762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":3589272762},{"type":"v1","addr":"172.21.15.8:6841","nonce":3589272762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6833/2043443402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2043443402},{"type":"v1","addr":"172.21.15.194:6833","nonce":2043443402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24464":{"gid":24464,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.45:6833/1208864615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1208864615},{"type":"v1","addr":"172.21.15.45:6833","nonce":1208864615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24500":{"gid":24500,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.45:6835/1776075470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1776075470},{"type":"v1","addr":"172.21.15.45:6835","nonce":1776075470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24517":{"gid":24517,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.194:6835/2457430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2457430285},{"type":"v1","addr":"172.21.15.194:6835","nonce":2457430285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24529":{"gid":24529,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/3072808560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":3072808560},{"type":"v1","addr":"172.21.15.194:6837","nonce":3072808560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/641549061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":641549061},{"type":"v1","addr":"172.21.15.45:6837","nonce":641549061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.194:6839/2174476491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":2174476491},{"type":"v1","addr":"172.21.15.194:6839","nonce":2174476491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6839/119684732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":119684732},{"type":"v1","addr":"172.21.15.45:6839","nonce":119684732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-11T12:24:20.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.742+0000 7f7e1c9ff700 1 -- 172.21.15.8:0/25182436 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f7e0009ff50 msgr2=0x7f7e000a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:20.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.742+0000 7f7e1c9ff700 1 --2- 172.21.15.8:0/25182436 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f7e0009ff50 0x7f7e000a2410 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7e08005950 tx=0x7f7e08009260 comp rx=0 tx=0).stop 2023-08-11T12:24:20.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.742+0000 7f7e1c9ff700 1 -- 172.21.15.8:0/25182436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e18101bd0 msgr2=0x7f7e18198e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:20.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.742+0000 7f7e1c9ff700 1 --2- 172.21.15.8:0/25182436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e18101bd0 0x7f7e18198e20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0098e0 tx=0x7f7e0c00f690 comp rx=0 tx=0).stop 2023-08-11T12:24:20.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.742+0000 7f7e1c9ff700 1 -- 172.21.15.8:0/25182436 shutdown_connections 2023-08-11T12:24:20.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.742+0000 7f7e1c9ff700 1 --2- 172.21.15.8:0/25182436 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f7e0009ff50 0x7f7e000a2410 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:20.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.742+0000 7f7e1c9ff700 1 --2- 172.21.15.8:0/25182436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e181009e0 0x7f7e181988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:20.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.742+0000 7f7e1c9ff700 1 --2- 172.21.15.8:0/25182436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e18102570 0x7f7e1819fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:20.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.742+0000 7f7e1c9ff700 1 --2- 172.21.15.8:0/25182436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e18101bd0 0x7f7e18198e20 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:20.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.742+0000 7f7e1c9ff700 1 -- 172.21.15.8:0/25182436 >> 172.21.15.8:0/25182436 conn(0x7f7e180fbf50 msgr2=0x7f7e181074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:20.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.742+0000 7f7e1c9ff700 1 -- 172.21.15.8:0/25182436 shutdown_connections 2023-08-11T12:24:20.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.742+0000 7f7e1c9ff700 1 -- 172.21.15.8:0/25182436 wait complete. 2023-08-11T12:24:20.746 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 27 2023-08-11T12:24:20.762 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-08-11T12:24:20.763 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-08-11T12:24:20.763 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-11T12:24:20.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.965+0000 7fa0053ff700 1 -- 172.21.15.8:0/379973843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa000074920 msgr2=0x7fa000072d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:20.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.965+0000 7fa0053ff700 1 --2- 172.21.15.8:0/379973843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa000074920 0x7fa000072d70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0009990 tx=0x7f9ff0009ca0 comp rx=0 tx=0).stop 2023-08-11T12:24:20.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.965+0000 7fa0053ff700 1 -- 172.21.15.8:0/379973843 shutdown_connections 2023-08-11T12:24:20.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.965+0000 7fa0053ff700 1 --2- 172.21.15.8:0/379973843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa000108890 0x7fa00010ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:20.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.965+0000 7fa0053ff700 1 --2- 172.21.15.8:0/379973843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa000074920 0x7fa000072d70 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:20.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.965+0000 7fa0053ff700 1 --2- 172.21.15.8:0/379973843 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa000073340 0x7fa0000737a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:20.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.965+0000 7fa0053ff700 1 -- 172.21.15.8:0/379973843 >> 172.21.15.8:0/379973843 conn(0x7fa0000fbf30 msgr2=0x7fa0000fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:20.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.965+0000 7fa0053ff700 1 -- 172.21.15.8:0/379973843 shutdown_connections 2023-08-11T12:24:20.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.965+0000 7fa0053ff700 1 -- 172.21.15.8:0/379973843 wait complete. 2023-08-11T12:24:20.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.966+0000 7fa0053ff700 1 Processor -- start 2023-08-11T12:24:20.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.966+0000 7fa0053ff700 1 -- start start 2023-08-11T12:24:20.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.966+0000 7fa0053ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa000073340 0x7fa0001988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:20.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.966+0000 7fa0053ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa000074920 0x7fa000198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:20.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.966+0000 7fa0053ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa000108890 0x7fa00019fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:20.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.966+0000 7fa0053ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0001a0430 con 0x7fa000074920 2023-08-11T12:24:20.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.966+0000 7fa0053ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0001a0570 con 0x7fa000073340 2023-08-11T12:24:20.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.966+0000 7fa0053ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0001a0700 con 0x7fa000108890 2023-08-11T12:24:20.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.967+0000 7f9ffe7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa000074920 0x7fa000198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:20.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.967+0000 7f9ffe7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa000074920 0x7fa000198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46736/0 (socket says 172.21.15.8:46736) 2023-08-11T12:24:20.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.967+0000 7f9ffe7fc700 1 -- 172.21.15.8:0/2717108148 learned_addr learned my addr 172.21.15.8:0/2717108148 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:20.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.967+0000 7f9ffeffd700 1 --2- 172.21.15.8:0/2717108148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa000073340 0x7fa0001988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:20.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.967+0000 7f9fff7fe700 1 --2- 172.21.15.8:0/2717108148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa000108890 0x7fa00019fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:20.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.967+0000 7f9ffe7fc700 1 -- 172.21.15.8:0/2717108148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa000108890 msgr2=0x7fa00019fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:20.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.967+0000 7f9ffe7fc700 1 --2- 172.21.15.8:0/2717108148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa000108890 0x7fa00019fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:20.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.967+0000 7f9ffe7fc700 1 -- 172.21.15.8:0/2717108148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa000073340 msgr2=0x7fa0001988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:20.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.967+0000 7f9ffe7fc700 1 --2- 172.21.15.8:0/2717108148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa000073340 0x7fa0001988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:20.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.967+0000 7f9ffe7fc700 1 -- 172.21.15.8:0/2717108148 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff00095f0 con 0x7fa000074920 2023-08-11T12:24:20.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.967+0000 7f9ffe7fc700 1 --2- 172.21.15.8:0/2717108148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa000074920 0x7fa000198df0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400e9a0 tx=0x7f9ff400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:20.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.968+0000 7f9fe7fff700 1 -- 172.21.15.8:0/2717108148 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4009790 con 0x7fa000074920 2023-08-11T12:24:20.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.968+0000 7f9fe7fff700 1 -- 172.21.15.8:0/2717108148 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ff4010430 con 0x7fa000074920 2023-08-11T12:24:20.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.968+0000 7fa0053ff700 1 -- 172.21.15.8:0/2717108148 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0001a09e0 con 0x7fa000074920 2023-08-11T12:24:20.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.968+0000 7f9fe7fff700 1 -- 172.21.15.8:0/2717108148 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4018680 con 0x7fa000074920 2023-08-11T12:24:20.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.968+0000 7fa0053ff700 1 -- 172.21.15.8:0/2717108148 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0001a0f40 con 0x7fa000074920 2023-08-11T12:24:20.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.969+0000 7fa0053ff700 1 -- 172.21.15.8:0/2717108148 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa000106f90 con 0x7fa000074920 2023-08-11T12:24:20.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.971+0000 7f9fe7fff700 1 -- 172.21.15.8:0/2717108148 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f9ff40105a0 con 0x7fa000074920 2023-08-11T12:24:20.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.973+0000 7f9fe7fff700 1 --2- 172.21.15.8:0/2717108148 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9fe809ffd0 0x7f9fe80a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:20.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.973+0000 7f9fe7fff700 1 -- 172.21.15.8:0/2717108148 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f9ff4014070 con 0x7fa000074920 2023-08-11T12:24:20.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.973+0000 7f9ffeffd700 1 --2- 172.21.15.8:0/2717108148 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9fe809ffd0 0x7f9fe80a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:20.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.974+0000 7f9ffeffd700 1 --2- 172.21.15.8:0/2717108148 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9fe809ffd0 0x7f9fe80a2490 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9ff000b2e0 tx=0x7f9ff0005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:20.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:20.977+0000 7f9fe7fff700 1 -- 172.21.15.8:0/2717108148 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f9ff4051c30 con 0x7fa000074920 2023-08-11T12:24:21.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:20 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2891478296' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:24:21.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:20 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3196440861' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:24:21.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:20 smithi008 ceph-mon[97158]: pgmap v344: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2023-08-11T12:24:21.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:20 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2891478296' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:24:21.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:20 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3196440861' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:24:21.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:20 smithi194 ceph-mon[130905]: pgmap v344: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2023-08-11T12:24:21.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:20 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2891478296' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:24:21.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:20 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3196440861' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:24:21.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:20 smithi045 ceph-mon[130284]: pgmap v344: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2023-08-11T12:24:21.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.182+0000 7fa0053ff700 1 -- 172.21.15.8:0/2717108148 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa00002cdf0 con 0x7f9fe809ffd0 2023-08-11T12:24:21.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.196+0000 7f9fe7fff700 1 -- 172.21.15.8:0/2717108148 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426663 (secure 0 0 0) 0x7fa00002cdf0 con 0x7f9fe809ffd0 2023-08-11T12:24:21.203 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:21.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.201+0000 7fa0053ff700 1 -- 172.21.15.8:0/2717108148 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9fe809ffd0 msgr2=0x7f9fe80a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:21.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.201+0000 7fa0053ff700 1 --2- 172.21.15.8:0/2717108148 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9fe809ffd0 0x7f9fe80a2490 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9ff000b2e0 tx=0x7f9ff0005fb0 comp rx=0 tx=0).stop 2023-08-11T12:24:21.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.201+0000 7fa0053ff700 1 -- 172.21.15.8:0/2717108148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa000074920 msgr2=0x7fa000198df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:21.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.201+0000 7fa0053ff700 1 --2- 172.21.15.8:0/2717108148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa000074920 0x7fa000198df0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400e9a0 tx=0x7f9ff400ecb0 comp rx=0 tx=0).stop 2023-08-11T12:24:21.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.201+0000 7fa0053ff700 1 -- 172.21.15.8:0/2717108148 shutdown_connections 2023-08-11T12:24:21.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.201+0000 7fa0053ff700 1 --2- 172.21.15.8:0/2717108148 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9fe809ffd0 0x7f9fe80a2490 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:21.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.201+0000 7fa0053ff700 1 --2- 172.21.15.8:0/2717108148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa000108890 0x7fa00019fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:21.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.201+0000 7fa0053ff700 1 --2- 172.21.15.8:0/2717108148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa000073340 0x7fa0001988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:21.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.201+0000 7fa0053ff700 1 --2- 172.21.15.8:0/2717108148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa000074920 0x7fa000198df0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:21.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.201+0000 7fa0053ff700 1 -- 172.21.15.8:0/2717108148 >> 172.21.15.8:0/2717108148 conn(0x7fa0000fbf30 msgr2=0x7fa0000fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:21.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.201+0000 7fa0053ff700 1 -- 172.21.15.8:0/2717108148 shutdown_connections 2023-08-11T12:24:21.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.201+0000 7fa0053ff700 1 -- 172.21.15.8:0/2717108148 wait complete. 2023-08-11T12:24:21.207 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-08-11T12:24:21.222 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":344,"stamp":"2023-08-11T12:24:20.542967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600890,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1249,"num_read_kb":695,"num_write":392,"num_write_kb":3007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":322,"ondisk_log_size":322,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336040,"kb_used_data":11796,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124605784,"statfs":{"total":1151940427776,"available":1151596322816,"internally_reserved":0,"allocated":12079104,"data_stored":7599223,"data_compressed":318882,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":258,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":71,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003088"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720975+0000","last_change":"2023-08-11T12:22:03.850538+0000","last_active":"2023-08-11T12:22:31.720975+0000","last_peered":"2023-08-11T12:22:31.720975+0000","last_clean":"2023-08-11T12:22:31.720975+0000","last_became_active":"2023-08-11T12:22:03.850220+0000","last_became_peered":"2023-08-11T12:22:03.850220+0000","last_unstale":"2023-08-11T12:22:31.720975+0000","last_undegraded":"2023-08-11T12:22:31.720975+0000","last_fullsized":"2023-08-11T12:22:31.720975+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:10:46.194341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720154+0000","last_change":"2023-08-11T12:22:03.843779+0000","last_active":"2023-08-11T12:22:31.720154+0000","last_peered":"2023-08-11T12:22:31.720154+0000","last_clean":"2023-08-11T12:22:31.720154+0000","last_became_active":"2023-08-11T12:22:03.843441+0000","last_became_peered":"2023-08-11T12:22:03.843441+0000","last_unstale":"2023-08-11T12:22:31.720154+0000","last_undegraded":"2023-08-11T12:22:31.720154+0000","last_fullsized":"2023-08-11T12:22:31.720154+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:51:42.363862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719149+0000","last_change":"2023-08-11T12:22:03.851996+0000","last_active":"2023-08-11T12:22:31.719149+0000","last_peered":"2023-08-11T12:22:31.719149+0000","last_clean":"2023-08-11T12:22:31.719149+0000","last_became_active":"2023-08-11T12:22:03.850821+0000","last_became_peered":"2023-08-11T12:22:03.850821+0000","last_unstale":"2023-08-11T12:22:31.719149+0000","last_undegraded":"2023-08-11T12:22:31.719149+0000","last_fullsized":"2023-08-11T12:22:31.719149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:54:54.152911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722124+0000","last_change":"2023-08-11T12:22:03.842025+0000","last_active":"2023-08-11T12:22:31.722124+0000","last_peered":"2023-08-11T12:22:31.722124+0000","last_clean":"2023-08-11T12:22:31.722124+0000","last_became_active":"2023-08-11T12:22:03.841700+0000","last_became_peered":"2023-08-11T12:22:03.841700+0000","last_unstale":"2023-08-11T12:22:31.722124+0000","last_undegraded":"2023-08-11T12:22:31.722124+0000","last_fullsized":"2023-08-11T12:22:31.722124+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:13:45.519007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723174+0000","last_change":"2023-08-11T12:22:03.844908+0000","last_active":"2023-08-11T12:22:31.723174+0000","last_peered":"2023-08-11T12:22:31.723174+0000","last_clean":"2023-08-11T12:22:31.723174+0000","last_became_active":"2023-08-11T12:22:03.844674+0000","last_became_peered":"2023-08-11T12:22:03.844674+0000","last_unstale":"2023-08-11T12:22:31.723174+0000","last_undegraded":"2023-08-11T12:22:31.723174+0000","last_fullsized":"2023-08-11T12:22:31.723174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:10:22.657255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721437+0000","last_change":"2023-08-11T12:22:03.839915+0000","last_active":"2023-08-11T12:22:31.721437+0000","last_peered":"2023-08-11T12:22:31.721437+0000","last_clean":"2023-08-11T12:22:31.721437+0000","last_became_active":"2023-08-11T12:22:03.839099+0000","last_became_peered":"2023-08-11T12:22:03.839099+0000","last_unstale":"2023-08-11T12:22:31.721437+0000","last_undegraded":"2023-08-11T12:22:31.721437+0000","last_fullsized":"2023-08-11T12:22:31.721437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:51:17.642383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717754+0000","last_change":"2023-08-11T12:22:03.841591+0000","last_active":"2023-08-11T12:22:31.717754+0000","last_peered":"2023-08-11T12:22:31.717754+0000","last_clean":"2023-08-11T12:22:31.717754+0000","last_became_active":"2023-08-11T12:22:03.841232+0000","last_became_peered":"2023-08-11T12:22:03.841232+0000","last_unstale":"2023-08-11T12:22:31.717754+0000","last_undegraded":"2023-08-11T12:22:31.717754+0000","last_fullsized":"2023-08-11T12:22:31.717754+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:12:40.032896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720595+0000","last_change":"2023-08-11T12:22:03.839516+0000","last_active":"2023-08-11T12:22:31.720595+0000","last_peered":"2023-08-11T12:22:31.720595+0000","last_clean":"2023-08-11T12:22:31.720595+0000","last_became_active":"2023-08-11T12:22:03.839058+0000","last_became_peered":"2023-08-11T12:22:03.839058+0000","last_unstale":"2023-08-11T12:22:31.720595+0000","last_undegraded":"2023-08-11T12:22:31.720595+0000","last_fullsized":"2023-08-11T12:22:31.720595+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:01:10.744970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774871+0000","last_change":"2023-08-11T12:22:03.841033+0000","last_active":"2023-08-11T12:22:31.774871+0000","last_peered":"2023-08-11T12:22:31.774871+0000","last_clean":"2023-08-11T12:22:31.774871+0000","last_became_active":"2023-08-11T12:22:03.840665+0000","last_became_peered":"2023-08-11T12:22:03.840665+0000","last_unstale":"2023-08-11T12:22:31.774871+0000","last_undegraded":"2023-08-11T12:22:31.774871+0000","last_fullsized":"2023-08-11T12:22:31.774871+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:08:51.628782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721119+0000","last_change":"2023-08-11T12:22:03.839663+0000","last_active":"2023-08-11T12:22:31.721119+0000","last_peered":"2023-08-11T12:22:31.721119+0000","last_clean":"2023-08-11T12:22:31.721119+0000","last_became_active":"2023-08-11T12:22:03.838840+0000","last_became_peered":"2023-08-11T12:22:03.838840+0000","last_unstale":"2023-08-11T12:22:31.721119+0000","last_undegraded":"2023-08-11T12:22:31.721119+0000","last_fullsized":"2023-08-11T12:22:31.721119+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:28:57.495510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717811+0000","last_change":"2023-08-11T12:22:03.846288+0000","last_active":"2023-08-11T12:22:31.717811+0000","last_peered":"2023-08-11T12:22:31.717811+0000","last_clean":"2023-08-11T12:22:31.717811+0000","last_became_active":"2023-08-11T12:22:03.845962+0000","last_became_peered":"2023-08-11T12:22:03.845962+0000","last_unstale":"2023-08-11T12:22:31.717811+0000","last_undegraded":"2023-08-11T12:22:31.717811+0000","last_fullsized":"2023-08-11T12:22:31.717811+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:42:37.154687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.728022+0000","last_change":"2023-08-11T12:22:31.726774+0000","last_active":"2023-08-11T12:22:31.728022+0000","last_peered":"2023-08-11T12:22:31.728022+0000","last_clean":"2023-08-11T12:22:31.728022+0000","last_became_active":"2023-08-11T12:22:31.726437+0000","last_became_peered":"2023-08-11T12:22:31.726437+0000","last_unstale":"2023-08-11T12:22:31.728022+0000","last_undegraded":"2023-08-11T12:22:31.728022+0000","last_fullsized":"2023-08-11T12:22:31.728022+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:33:56.005318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717500+0000","last_change":"2023-08-11T12:22:03.842249+0000","last_active":"2023-08-11T12:22:31.717500+0000","last_peered":"2023-08-11T12:22:31.717500+0000","last_clean":"2023-08-11T12:22:31.717500+0000","last_became_active":"2023-08-11T12:22:03.841887+0000","last_became_peered":"2023-08-11T12:22:03.841887+0000","last_unstale":"2023-08-11T12:22:31.717500+0000","last_undegraded":"2023-08-11T12:22:31.717500+0000","last_fullsized":"2023-08-11T12:22:31.717500+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:24:16.685728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718746+0000","last_change":"2023-08-11T12:22:03.843859+0000","last_active":"2023-08-11T12:22:31.718746+0000","last_peered":"2023-08-11T12:22:31.718746+0000","last_clean":"2023-08-11T12:22:31.718746+0000","last_became_active":"2023-08-11T12:22:03.843383+0000","last_became_peered":"2023-08-11T12:22:03.843383+0000","last_unstale":"2023-08-11T12:22:31.718746+0000","last_undegraded":"2023-08-11T12:22:31.718746+0000","last_fullsized":"2023-08-11T12:22:31.718746+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:19:55.006972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.726241+0000","last_change":"2023-08-11T12:22:31.726241+0000","last_active":"2023-08-11T12:22:31.726241+0000","last_peered":"2023-08-11T12:22:31.726241+0000","last_clean":"2023-08-11T12:22:31.726241+0000","last_became_active":"2023-08-11T12:22:31.725852+0000","last_became_peered":"2023-08-11T12:22:31.725852+0000","last_unstale":"2023-08-11T12:22:31.726241+0000","last_undegraded":"2023-08-11T12:22:31.726241+0000","last_fullsized":"2023-08-11T12:22:31.726241+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:37:58.350171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774047+0000","last_change":"2023-08-11T12:22:03.850397+0000","last_active":"2023-08-11T12:22:31.774047+0000","last_peered":"2023-08-11T12:22:31.774047+0000","last_clean":"2023-08-11T12:22:31.774047+0000","last_became_active":"2023-08-11T12:22:03.850143+0000","last_became_peered":"2023-08-11T12:22:03.850143+0000","last_unstale":"2023-08-11T12:22:31.774047+0000","last_undegraded":"2023-08-11T12:22:31.774047+0000","last_fullsized":"2023-08-11T12:22:31.774047+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:13:22.558148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721002+0000","last_change":"2023-08-11T12:22:03.850496+0000","last_active":"2023-08-11T12:22:31.721002+0000","last_peered":"2023-08-11T12:22:31.721002+0000","last_clean":"2023-08-11T12:22:31.721002+0000","last_became_active":"2023-08-11T12:22:03.850192+0000","last_became_peered":"2023-08-11T12:22:03.850192+0000","last_unstale":"2023-08-11T12:22:31.721002+0000","last_undegraded":"2023-08-11T12:22:31.721002+0000","last_fullsized":"2023-08-11T12:22:31.721002+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:54:50.626326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722136+0000","last_change":"2023-08-11T12:22:03.841706+0000","last_active":"2023-08-11T12:22:31.722136+0000","last_peered":"2023-08-11T12:22:31.722136+0000","last_clean":"2023-08-11T12:22:31.722136+0000","last_became_active":"2023-08-11T12:22:03.841341+0000","last_became_peered":"2023-08-11T12:22:03.841341+0000","last_unstale":"2023-08-11T12:22:31.722136+0000","last_undegraded":"2023-08-11T12:22:31.722136+0000","last_fullsized":"2023-08-11T12:22:31.722136+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:36:20.093373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.724897+0000","last_change":"2023-08-11T12:22:03.834450+0000","last_active":"2023-08-11T12:22:31.724897+0000","last_peered":"2023-08-11T12:22:31.724897+0000","last_clean":"2023-08-11T12:22:31.724897+0000","last_became_active":"2023-08-11T12:22:03.834154+0000","last_became_peered":"2023-08-11T12:22:03.834154+0000","last_unstale":"2023-08-11T12:22:31.724897+0000","last_undegraded":"2023-08-11T12:22:31.724897+0000","last_fullsized":"2023-08-11T12:22:31.724897+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:08:49.920575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.727577+0000","last_change":"2023-08-11T12:22:31.727577+0000","last_active":"2023-08-11T12:22:31.727577+0000","last_peered":"2023-08-11T12:22:31.727577+0000","last_clean":"2023-08-11T12:22:31.727577+0000","last_became_active":"2023-08-11T12:22:31.727034+0000","last_became_peered":"2023-08-11T12:22:31.727034+0000","last_unstale":"2023-08-11T12:22:31.727577+0000","last_undegraded":"2023-08-11T12:22:31.727577+0000","last_fullsized":"2023-08-11T12:22:31.727577+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:14:44.681877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":146,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:24:15.861425+0000","last_change":"2023-08-11T12:22:02.841759+0000","last_active":"2023-08-11T12:24:15.861425+0000","last_peered":"2023-08-11T12:24:15.861425+0000","last_clean":"2023-08-11T12:24:15.861425+0000","last_became_active":"2023-08-11T12:22:02.841326+0000","last_became_peered":"2023-08-11T12:22:02.841326+0000","last_unstale":"2023-08-11T12:24:15.861425+0000","last_undegraded":"2023-08-11T12:24:15.861425+0000","last_fullsized":"2023-08-11T12:24:15.861425+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:09:30.085287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.802211+0000","last_change":"2023-08-11T12:22:31.801910+0000","last_active":"2023-08-11T12:22:31.802211+0000","last_peered":"2023-08-11T12:22:31.802211+0000","last_clean":"2023-08-11T12:22:31.802211+0000","last_became_active":"2023-08-11T12:22:31.801479+0000","last_became_peered":"2023-08-11T12:22:31.801479+0000","last_unstale":"2023-08-11T12:22:31.802211+0000","last_undegraded":"2023-08-11T12:22:31.802211+0000","last_fullsized":"2023-08-11T12:22:31.802211+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:52:21.489431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720477+0000","last_change":"2023-08-11T12:22:07.875010+0000","last_active":"2023-08-11T12:22:31.720477+0000","last_peered":"2023-08-11T12:22:31.720477+0000","last_clean":"2023-08-11T12:22:31.720477+0000","last_became_active":"2023-08-11T12:22:07.874474+0000","last_became_peered":"2023-08-11T12:22:07.874474+0000","last_unstale":"2023-08-11T12:22:31.720477+0000","last_undegraded":"2023-08-11T12:22:31.720477+0000","last_fullsized":"2023-08-11T12:22:31.720477+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:41:20.795124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721193+0000","last_change":"2023-08-11T12:22:02.848299+0000","last_active":"2023-08-11T12:22:31.721193+0000","last_peered":"2023-08-11T12:22:31.721193+0000","last_clean":"2023-08-11T12:22:31.721193+0000","last_became_active":"2023-08-11T12:22:02.847869+0000","last_became_peered":"2023-08-11T12:22:02.847869+0000","last_unstale":"2023-08-11T12:22:31.721193+0000","last_undegraded":"2023-08-11T12:22:31.721193+0000","last_fullsized":"2023-08-11T12:22:31.721193+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:09:15.600582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719871+0000","last_change":"2023-08-11T12:22:03.841173+0000","last_active":"2023-08-11T12:22:31.719871+0000","last_peered":"2023-08-11T12:22:31.719871+0000","last_clean":"2023-08-11T12:22:31.719871+0000","last_became_active":"2023-08-11T12:22:03.840882+0000","last_became_peered":"2023-08-11T12:22:03.840882+0000","last_unstale":"2023-08-11T12:22:31.719871+0000","last_undegraded":"2023-08-11T12:22:31.719871+0000","last_fullsized":"2023-08-11T12:22:31.719871+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:50:28.937358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721470+0000","last_change":"2023-08-11T12:22:07.880756+0000","last_active":"2023-08-11T12:22:31.721470+0000","last_peered":"2023-08-11T12:22:31.721470+0000","last_clean":"2023-08-11T12:22:31.721470+0000","last_became_active":"2023-08-11T12:22:07.878866+0000","last_became_peered":"2023-08-11T12:22:07.878866+0000","last_unstale":"2023-08-11T12:22:31.721470+0000","last_undegraded":"2023-08-11T12:22:31.721470+0000","last_fullsized":"2023-08-11T12:22:31.721470+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:30:28.617039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:32.698559+0000","last_change":"2023-08-11T12:22:02.848543+0000","last_active":"2023-08-11T12:22:32.698559+0000","last_peered":"2023-08-11T12:22:32.698559+0000","last_clean":"2023-08-11T12:22:32.698559+0000","last_became_active":"2023-08-11T12:22:02.848008+0000","last_became_peered":"2023-08-11T12:22:02.848008+0000","last_unstale":"2023-08-11T12:22:32.698559+0000","last_undegraded":"2023-08-11T12:22:32.698559+0000","last_fullsized":"2023-08-11T12:22:32.698559+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:57:46.484932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774382+0000","last_change":"2023-08-11T12:22:03.843651+0000","last_active":"2023-08-11T12:22:31.774382+0000","last_peered":"2023-08-11T12:22:31.774382+0000","last_clean":"2023-08-11T12:22:31.774382+0000","last_became_active":"2023-08-11T12:22:03.843392+0000","last_became_peered":"2023-08-11T12:22:03.843392+0000","last_unstale":"2023-08-11T12:22:31.774382+0000","last_undegraded":"2023-08-11T12:22:31.774382+0000","last_fullsized":"2023-08-11T12:22:31.774382+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:27:25.825805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721058+0000","last_change":"2023-08-11T12:22:07.879373+0000","last_active":"2023-08-11T12:22:31.721058+0000","last_peered":"2023-08-11T12:22:31.721058+0000","last_clean":"2023-08-11T12:22:31.721058+0000","last_became_active":"2023-08-11T12:22:07.878929+0000","last_became_peered":"2023-08-11T12:22:07.878929+0000","last_unstale":"2023-08-11T12:22:31.721058+0000","last_undegraded":"2023-08-11T12:22:31.721058+0000","last_fullsized":"2023-08-11T12:22:31.721058+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:37:29.598815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723705+0000","last_change":"2023-08-11T12:22:02.841984+0000","last_active":"2023-08-11T12:22:31.723705+0000","last_peered":"2023-08-11T12:22:31.723705+0000","last_clean":"2023-08-11T12:22:31.723705+0000","last_became_active":"2023-08-11T12:22:02.841585+0000","last_became_peered":"2023-08-11T12:22:02.841585+0000","last_unstale":"2023-08-11T12:22:31.723705+0000","last_undegraded":"2023-08-11T12:22:31.723705+0000","last_fullsized":"2023-08-11T12:22:31.723705+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:18:28.740155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800688+0000","last_change":"2023-08-11T12:22:03.839381+0000","last_active":"2023-08-11T12:22:31.800688+0000","last_peered":"2023-08-11T12:22:31.800688+0000","last_clean":"2023-08-11T12:22:31.800688+0000","last_became_active":"2023-08-11T12:22:03.839091+0000","last_became_peered":"2023-08-11T12:22:03.839091+0000","last_unstale":"2023-08-11T12:22:31.800688+0000","last_undegraded":"2023-08-11T12:22:31.800688+0000","last_fullsized":"2023-08-11T12:22:31.800688+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:45:52.205138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722725+0000","last_change":"2023-08-11T12:22:07.881758+0000","last_active":"2023-08-11T12:22:31.722725+0000","last_peered":"2023-08-11T12:22:31.722725+0000","last_clean":"2023-08-11T12:22:31.722725+0000","last_became_active":"2023-08-11T12:22:07.881305+0000","last_became_peered":"2023-08-11T12:22:07.881305+0000","last_unstale":"2023-08-11T12:22:31.722725+0000","last_undegraded":"2023-08-11T12:22:31.722725+0000","last_fullsized":"2023-08-11T12:22:31.722725+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:25:48.595182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":143,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:24:15.836803+0000","last_change":"2023-08-11T12:22:02.844138+0000","last_active":"2023-08-11T12:24:15.836803+0000","last_peered":"2023-08-11T12:24:15.836803+0000","last_clean":"2023-08-11T12:24:15.836803+0000","last_became_active":"2023-08-11T12:22:02.843234+0000","last_became_peered":"2023-08-11T12:22:02.843234+0000","last_unstale":"2023-08-11T12:24:15.836803+0000","last_undegraded":"2023-08-11T12:24:15.836803+0000","last_fullsized":"2023-08-11T12:24:15.836803+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:53:48.033181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723640+0000","last_change":"2023-08-11T12:22:03.845450+0000","last_active":"2023-08-11T12:22:31.723640+0000","last_peered":"2023-08-11T12:22:31.723640+0000","last_clean":"2023-08-11T12:22:31.723640+0000","last_became_active":"2023-08-11T12:22:03.845170+0000","last_became_peered":"2023-08-11T12:22:03.845170+0000","last_unstale":"2023-08-11T12:22:31.723640+0000","last_undegraded":"2023-08-11T12:22:31.723640+0000","last_fullsized":"2023-08-11T12:22:31.723640+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:35:09.789210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722268+0000","last_change":"2023-08-11T12:22:07.880663+0000","last_active":"2023-08-11T12:22:31.722268+0000","last_peered":"2023-08-11T12:22:31.722268+0000","last_clean":"2023-08-11T12:22:31.722268+0000","last_became_active":"2023-08-11T12:22:07.880282+0000","last_became_peered":"2023-08-11T12:22:07.880282+0000","last_unstale":"2023-08-11T12:22:31.722268+0000","last_undegraded":"2023-08-11T12:22:31.722268+0000","last_fullsized":"2023-08-11T12:22:31.722268+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:36:05.356885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"87'7","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721289+0000","last_change":"2023-08-11T12:22:02.842206+0000","last_active":"2023-08-11T12:22:31.721289+0000","last_peered":"2023-08-11T12:22:31.721289+0000","last_clean":"2023-08-11T12:22:31.721289+0000","last_became_active":"2023-08-11T12:22:02.841815+0000","last_became_peered":"2023-08-11T12:22:02.841815+0000","last_unstale":"2023-08-11T12:22:31.721289+0000","last_undegraded":"2023-08-11T12:22:31.721289+0000","last_fullsized":"2023-08-11T12:22:31.721289+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:15:01.305404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800934+0000","last_change":"2023-08-11T12:22:03.825886+0000","last_active":"2023-08-11T12:22:31.800934+0000","last_peered":"2023-08-11T12:22:31.800934+0000","last_clean":"2023-08-11T12:22:31.800934+0000","last_became_active":"2023-08-11T12:22:03.825645+0000","last_became_peered":"2023-08-11T12:22:03.825645+0000","last_unstale":"2023-08-11T12:22:31.800934+0000","last_undegraded":"2023-08-11T12:22:31.800934+0000","last_fullsized":"2023-08-11T12:22:31.800934+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:03:34.650801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720482+0000","last_change":"2023-08-11T12:22:07.890216+0000","last_active":"2023-08-11T12:22:31.720482+0000","last_peered":"2023-08-11T12:22:31.720482+0000","last_clean":"2023-08-11T12:22:31.720482+0000","last_became_active":"2023-08-11T12:22:07.889860+0000","last_became_peered":"2023-08-11T12:22:07.889860+0000","last_unstale":"2023-08-11T12:22:31.720482+0000","last_undegraded":"2023-08-11T12:22:31.720482+0000","last_fullsized":"2023-08-11T12:22:31.720482+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:03:54.952887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.716962+0000","last_change":"2023-08-11T12:22:02.835703+0000","last_active":"2023-08-11T12:22:31.716962+0000","last_peered":"2023-08-11T12:22:31.716962+0000","last_clean":"2023-08-11T12:22:31.716962+0000","last_became_active":"2023-08-11T12:22:02.835300+0000","last_became_peered":"2023-08-11T12:22:02.835300+0000","last_unstale":"2023-08-11T12:22:31.716962+0000","last_undegraded":"2023-08-11T12:22:31.716962+0000","last_fullsized":"2023-08-11T12:22:31.716962+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:55:13.953193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720447+0000","last_change":"2023-08-11T12:22:03.835619+0000","last_active":"2023-08-11T12:22:31.720447+0000","last_peered":"2023-08-11T12:22:31.720447+0000","last_clean":"2023-08-11T12:22:31.720447+0000","last_became_active":"2023-08-11T12:22:03.835365+0000","last_became_peered":"2023-08-11T12:22:03.835365+0000","last_unstale":"2023-08-11T12:22:31.720447+0000","last_undegraded":"2023-08-11T12:22:31.720447+0000","last_fullsized":"2023-08-11T12:22:31.720447+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:36:40.129412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719415+0000","last_change":"2023-08-11T12:22:07.893736+0000","last_active":"2023-08-11T12:22:31.719415+0000","last_peered":"2023-08-11T12:22:31.719415+0000","last_clean":"2023-08-11T12:22:31.719415+0000","last_became_active":"2023-08-11T12:22:07.893160+0000","last_became_peered":"2023-08-11T12:22:07.893160+0000","last_unstale":"2023-08-11T12:22:31.719415+0000","last_undegraded":"2023-08-11T12:22:31.719415+0000","last_fullsized":"2023-08-11T12:22:31.719415+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:55:46.234346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800174+0000","last_change":"2023-08-11T12:22:02.843819+0000","last_active":"2023-08-11T12:22:31.800174+0000","last_peered":"2023-08-11T12:22:31.800174+0000","last_clean":"2023-08-11T12:22:31.800174+0000","last_became_active":"2023-08-11T12:22:02.843062+0000","last_became_peered":"2023-08-11T12:22:02.843062+0000","last_unstale":"2023-08-11T12:22:31.800174+0000","last_undegraded":"2023-08-11T12:22:31.800174+0000","last_fullsized":"2023-08-11T12:22:31.800174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:59:34.378593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722599+0000","last_change":"2023-08-11T12:22:03.845985+0000","last_active":"2023-08-11T12:22:31.722599+0000","last_peered":"2023-08-11T12:22:31.722599+0000","last_clean":"2023-08-11T12:22:31.722599+0000","last_became_active":"2023-08-11T12:22:03.845274+0000","last_became_peered":"2023-08-11T12:22:03.845274+0000","last_unstale":"2023-08-11T12:22:31.722599+0000","last_undegraded":"2023-08-11T12:22:31.722599+0000","last_fullsized":"2023-08-11T12:22:31.722599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:51:23.239546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.775632+0000","last_change":"2023-08-11T12:22:31.775632+0000","last_active":"2023-08-11T12:22:31.775632+0000","last_peered":"2023-08-11T12:22:31.775632+0000","last_clean":"2023-08-11T12:22:31.775632+0000","last_became_active":"2023-08-11T12:22:31.775282+0000","last_became_peered":"2023-08-11T12:22:31.775282+0000","last_unstale":"2023-08-11T12:22:31.775632+0000","last_undegraded":"2023-08-11T12:22:31.775632+0000","last_fullsized":"2023-08-11T12:22:31.775632+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:59:53.378227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,8],"acting":[3,7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"89'5","reported_seq":250,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:24:19.841628+0000","last_change":"2023-08-11T12:22:02.836591+0000","last_active":"2023-08-11T12:24:19.841628+0000","last_peered":"2023-08-11T12:24:19.841628+0000","last_clean":"2023-08-11T12:24:19.841628+0000","last_became_active":"2023-08-11T12:22:02.836223+0000","last_became_peered":"2023-08-11T12:22:02.836223+0000","last_unstale":"2023-08-11T12:24:19.841628+0000","last_undegraded":"2023-08-11T12:24:19.841628+0000","last_fullsized":"2023-08-11T12:24:19.841628+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:30:37.183588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":219,"num_read_kb":219,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774757+0000","last_change":"2023-08-11T12:22:03.841719+0000","last_active":"2023-08-11T12:22:31.774757+0000","last_peered":"2023-08-11T12:22:31.774757+0000","last_clean":"2023-08-11T12:22:31.774757+0000","last_became_active":"2023-08-11T12:22:03.841381+0000","last_became_peered":"2023-08-11T12:22:03.841381+0000","last_unstale":"2023-08-11T12:22:31.774757+0000","last_undegraded":"2023-08-11T12:22:31.774757+0000","last_fullsized":"2023-08-11T12:22:31.774757+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:29:35.108655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721200+0000","last_change":"2023-08-11T12:22:07.889103+0000","last_active":"2023-08-11T12:22:31.721200+0000","last_peered":"2023-08-11T12:22:31.721200+0000","last_clean":"2023-08-11T12:22:31.721200+0000","last_became_active":"2023-08-11T12:22:07.888668+0000","last_became_peered":"2023-08-11T12:22:07.888668+0000","last_unstale":"2023-08-11T12:22:31.721200+0000","last_undegraded":"2023-08-11T12:22:31.721200+0000","last_fullsized":"2023-08-11T12:22:31.721200+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:55:40.004921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717773+0000","last_change":"2023-08-11T12:22:02.841934+0000","last_active":"2023-08-11T12:22:31.717773+0000","last_peered":"2023-08-11T12:22:31.717773+0000","last_clean":"2023-08-11T12:22:31.717773+0000","last_became_active":"2023-08-11T12:22:02.841598+0000","last_became_peered":"2023-08-11T12:22:02.841598+0000","last_unstale":"2023-08-11T12:22:31.717773+0000","last_undegraded":"2023-08-11T12:22:31.717773+0000","last_fullsized":"2023-08-11T12:22:31.717773+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:20:04.206298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719796+0000","last_change":"2023-08-11T12:22:03.848901+0000","last_active":"2023-08-11T12:22:31.719796+0000","last_peered":"2023-08-11T12:22:31.719796+0000","last_clean":"2023-08-11T12:22:31.719796+0000","last_became_active":"2023-08-11T12:22:03.848518+0000","last_became_peered":"2023-08-11T12:22:03.848518+0000","last_unstale":"2023-08-11T12:22:31.719796+0000","last_undegraded":"2023-08-11T12:22:31.719796+0000","last_fullsized":"2023-08-11T12:22:31.719796+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:20:08.007934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.775821+0000","last_change":"2023-08-11T12:22:31.775821+0000","last_active":"2023-08-11T12:22:31.775821+0000","last_peered":"2023-08-11T12:22:31.775821+0000","last_clean":"2023-08-11T12:22:31.775821+0000","last_became_active":"2023-08-11T12:22:31.775264+0000","last_became_peered":"2023-08-11T12:22:31.775264+0000","last_unstale":"2023-08-11T12:22:31.775821+0000","last_undegraded":"2023-08-11T12:22:31.775821+0000","last_fullsized":"2023-08-11T12:22:31.775821+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:28:22.561726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"87'5","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800805+0000","last_change":"2023-08-11T12:22:02.846492+0000","last_active":"2023-08-11T12:22:31.800805+0000","last_peered":"2023-08-11T12:22:31.800805+0000","last_clean":"2023-08-11T12:22:31.800805+0000","last_became_active":"2023-08-11T12:22:02.846174+0000","last_became_peered":"2023-08-11T12:22:02.846174+0000","last_unstale":"2023-08-11T12:22:31.800805+0000","last_undegraded":"2023-08-11T12:22:31.800805+0000","last_fullsized":"2023-08-11T12:22:31.800805+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:09:18.245164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774783+0000","last_change":"2023-08-11T12:22:03.840054+0000","last_active":"2023-08-11T12:22:31.774783+0000","last_peered":"2023-08-11T12:22:31.774783+0000","last_clean":"2023-08-11T12:22:31.774783+0000","last_became_active":"2023-08-11T12:22:03.839707+0000","last_became_peered":"2023-08-11T12:22:03.839707+0000","last_unstale":"2023-08-11T12:22:31.774783+0000","last_undegraded":"2023-08-11T12:22:31.774783+0000","last_fullsized":"2023-08-11T12:22:31.774783+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:47:30.898127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.802304+0000","last_change":"2023-08-11T12:22:31.801931+0000","last_active":"2023-08-11T12:22:31.802304+0000","last_peered":"2023-08-11T12:22:31.802304+0000","last_clean":"2023-08-11T12:22:31.802304+0000","last_became_active":"2023-08-11T12:22:31.801522+0000","last_became_peered":"2023-08-11T12:22:31.801522+0000","last_unstale":"2023-08-11T12:22:31.802304+0000","last_undegraded":"2023-08-11T12:22:31.802304+0000","last_fullsized":"2023-08-11T12:22:31.802304+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:03:22.570814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.14","version":"88'14","reported_seq":264,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:24:19.841126+0000","last_change":"2023-08-11T12:22:02.836520+0000","last_active":"2023-08-11T12:24:19.841126+0000","last_peered":"2023-08-11T12:24:19.841126+0000","last_clean":"2023-08-11T12:24:19.841126+0000","last_became_active":"2023-08-11T12:22:02.836201+0000","last_became_peered":"2023-08-11T12:22:02.836201+0000","last_unstale":"2023-08-11T12:24:19.841126+0000","last_undegraded":"2023-08-11T12:24:19.841126+0000","last_fullsized":"2023-08-11T12:24:19.841126+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:58:37.750229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":224,"num_read_kb":116,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723852+0000","last_change":"2023-08-11T12:22:03.848104+0000","last_active":"2023-08-11T12:22:31.723852+0000","last_peered":"2023-08-11T12:22:31.723852+0000","last_clean":"2023-08-11T12:22:31.723852+0000","last_became_active":"2023-08-11T12:22:03.847801+0000","last_became_peered":"2023-08-11T12:22:03.847801+0000","last_unstale":"2023-08-11T12:22:31.723852+0000","last_undegraded":"2023-08-11T12:22:31.723852+0000","last_fullsized":"2023-08-11T12:22:31.723852+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:56:47.846229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.801121+0000","last_change":"2023-08-11T12:22:07.893710+0000","last_active":"2023-08-11T12:22:31.801121+0000","last_peered":"2023-08-11T12:22:31.801121+0000","last_clean":"2023-08-11T12:22:31.801121+0000","last_became_active":"2023-08-11T12:22:07.893239+0000","last_became_peered":"2023-08-11T12:22:07.893239+0000","last_unstale":"2023-08-11T12:22:31.801121+0000","last_undegraded":"2023-08-11T12:22:31.801121+0000","last_fullsized":"2023-08-11T12:22:31.801121+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:24:55.563178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.724184+0000","last_change":"2023-08-11T12:22:02.849060+0000","last_active":"2023-08-11T12:22:31.724184+0000","last_peered":"2023-08-11T12:22:31.724184+0000","last_clean":"2023-08-11T12:22:31.724184+0000","last_became_active":"2023-08-11T12:22:02.848417+0000","last_became_peered":"2023-08-11T12:22:02.848417+0000","last_unstale":"2023-08-11T12:22:31.724184+0000","last_undegraded":"2023-08-11T12:22:31.724184+0000","last_fullsized":"2023-08-11T12:22:31.724184+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:48:47.925134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717206+0000","last_change":"2023-08-11T12:22:03.848532+0000","last_active":"2023-08-11T12:22:31.717206+0000","last_peered":"2023-08-11T12:22:31.717206+0000","last_clean":"2023-08-11T12:22:31.717206+0000","last_became_active":"2023-08-11T12:22:03.848190+0000","last_became_peered":"2023-08-11T12:22:03.848190+0000","last_unstale":"2023-08-11T12:22:31.717206+0000","last_undegraded":"2023-08-11T12:22:31.717206+0000","last_fullsized":"2023-08-11T12:22:31.717206+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:24:49.898432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720024+0000","last_change":"2023-08-11T12:22:07.882785+0000","last_active":"2023-08-11T12:22:31.720024+0000","last_peered":"2023-08-11T12:22:31.720024+0000","last_clean":"2023-08-11T12:22:31.720024+0000","last_became_active":"2023-08-11T12:22:07.880643+0000","last_became_peered":"2023-08-11T12:22:07.880643+0000","last_unstale":"2023-08-11T12:22:31.720024+0000","last_undegraded":"2023-08-11T12:22:31.720024+0000","last_fullsized":"2023-08-11T12:22:31.720024+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:40:21.114572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800547+0000","last_change":"2023-08-11T12:22:02.851416+0000","last_active":"2023-08-11T12:22:31.800547+0000","last_peered":"2023-08-11T12:22:31.800547+0000","last_clean":"2023-08-11T12:22:31.800547+0000","last_became_active":"2023-08-11T12:22:02.851114+0000","last_became_peered":"2023-08-11T12:22:02.851114+0000","last_unstale":"2023-08-11T12:22:31.800547+0000","last_undegraded":"2023-08-11T12:22:31.800547+0000","last_fullsized":"2023-08-11T12:22:31.800547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:27:37.565292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717994+0000","last_change":"2023-08-11T12:22:03.849367+0000","last_active":"2023-08-11T12:22:31.717994+0000","last_peered":"2023-08-11T12:22:31.717994+0000","last_clean":"2023-08-11T12:22:31.717994+0000","last_became_active":"2023-08-11T12:22:03.849050+0000","last_became_peered":"2023-08-11T12:22:03.849050+0000","last_unstale":"2023-08-11T12:22:31.717994+0000","last_undegraded":"2023-08-11T12:22:31.717994+0000","last_fullsized":"2023-08-11T12:22:31.717994+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:54:43.936124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722616+0000","last_change":"2023-08-11T12:22:07.890992+0000","last_active":"2023-08-11T12:22:31.722616+0000","last_peered":"2023-08-11T12:22:31.722616+0000","last_clean":"2023-08-11T12:22:31.722616+0000","last_became_active":"2023-08-11T12:22:07.890384+0000","last_became_peered":"2023-08-11T12:22:07.890384+0000","last_unstale":"2023-08-11T12:22:31.722616+0000","last_undegraded":"2023-08-11T12:22:31.722616+0000","last_fullsized":"2023-08-11T12:22:31.722616+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:00:55.230221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"87'5","reported_seq":139,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:24:16.885885+0000","last_change":"2023-08-11T12:22:02.843045+0000","last_active":"2023-08-11T12:24:16.885885+0000","last_peered":"2023-08-11T12:24:16.885885+0000","last_clean":"2023-08-11T12:24:16.885885+0000","last_became_active":"2023-08-11T12:22:02.842628+0000","last_became_peered":"2023-08-11T12:22:02.842628+0000","last_unstale":"2023-08-11T12:24:16.885885+0000","last_undegraded":"2023-08-11T12:24:16.885885+0000","last_fullsized":"2023-08-11T12:24:16.885885+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:45:36.283695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717456+0000","last_change":"2023-08-11T12:22:03.842526+0000","last_active":"2023-08-11T12:22:31.717456+0000","last_peered":"2023-08-11T12:22:31.717456+0000","last_clean":"2023-08-11T12:22:31.717456+0000","last_became_active":"2023-08-11T12:22:03.842183+0000","last_became_peered":"2023-08-11T12:22:03.842183+0000","last_unstale":"2023-08-11T12:22:31.717456+0000","last_undegraded":"2023-08-11T12:22:31.717456+0000","last_fullsized":"2023-08-11T12:22:31.717456+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:20:56.195693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717389+0000","last_change":"2023-08-11T12:22:07.880768+0000","last_active":"2023-08-11T12:22:31.717389+0000","last_peered":"2023-08-11T12:22:31.717389+0000","last_clean":"2023-08-11T12:22:31.717389+0000","last_became_active":"2023-08-11T12:22:07.880335+0000","last_became_peered":"2023-08-11T12:22:07.880335+0000","last_unstale":"2023-08-11T12:22:31.717389+0000","last_undegraded":"2023-08-11T12:22:31.717389+0000","last_fullsized":"2023-08-11T12:22:31.717389+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:35:51.736025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721841+0000","last_change":"2023-08-11T12:22:02.847271+0000","last_active":"2023-08-11T12:22:31.721841+0000","last_peered":"2023-08-11T12:22:31.721841+0000","last_clean":"2023-08-11T12:22:31.721841+0000","last_became_active":"2023-08-11T12:22:02.846974+0000","last_became_peered":"2023-08-11T12:22:02.846974+0000","last_unstale":"2023-08-11T12:22:31.721841+0000","last_undegraded":"2023-08-11T12:22:31.721841+0000","last_fullsized":"2023-08-11T12:22:31.721841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:43:35.198876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800817+0000","last_change":"2023-08-11T12:22:03.838944+0000","last_active":"2023-08-11T12:22:31.800817+0000","last_peered":"2023-08-11T12:22:31.800817+0000","last_clean":"2023-08-11T12:22:31.800817+0000","last_became_active":"2023-08-11T12:22:03.838610+0000","last_became_peered":"2023-08-11T12:22:03.838610+0000","last_unstale":"2023-08-11T12:22:31.800817+0000","last_undegraded":"2023-08-11T12:22:31.800817+0000","last_fullsized":"2023-08-11T12:22:31.800817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:10:20.371629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800744+0000","last_change":"2023-08-11T12:22:07.888812+0000","last_active":"2023-08-11T12:22:31.800744+0000","last_peered":"2023-08-11T12:22:31.800744+0000","last_clean":"2023-08-11T12:22:31.800744+0000","last_became_active":"2023-08-11T12:22:07.888423+0000","last_became_peered":"2023-08-11T12:22:07.888423+0000","last_unstale":"2023-08-11T12:22:31.800744+0000","last_undegraded":"2023-08-11T12:22:31.800744+0000","last_fullsized":"2023-08-11T12:22:31.800744+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:07:17.536681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:32.028490+0000","last_change":"2023-08-11T12:22:02.842591+0000","last_active":"2023-08-11T12:22:32.028490+0000","last_peered":"2023-08-11T12:22:32.028490+0000","last_clean":"2023-08-11T12:22:32.028490+0000","last_became_active":"2023-08-11T12:22:02.842249+0000","last_became_peered":"2023-08-11T12:22:02.842249+0000","last_unstale":"2023-08-11T12:22:32.028490+0000","last_undegraded":"2023-08-11T12:22:32.028490+0000","last_fullsized":"2023-08-11T12:22:32.028490+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:28:10.930413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.725791+0000","last_change":"2023-08-11T12:22:31.725791+0000","last_active":"2023-08-11T12:22:31.725791+0000","last_peered":"2023-08-11T12:22:31.725791+0000","last_clean":"2023-08-11T12:22:31.725791+0000","last_became_active":"2023-08-11T12:22:31.724950+0000","last_became_peered":"2023-08-11T12:22:31.724950+0000","last_unstale":"2023-08-11T12:22:31.725791+0000","last_undegraded":"2023-08-11T12:22:31.725791+0000","last_fullsized":"2023-08-11T12:22:31.725791+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:59:37.392626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723541+0000","last_change":"2023-08-11T12:22:08.068485+0000","last_active":"2023-08-11T12:22:31.723541+0000","last_peered":"2023-08-11T12:22:31.723541+0000","last_clean":"2023-08-11T12:22:31.723541+0000","last_became_active":"2023-08-11T12:22:08.068071+0000","last_became_peered":"2023-08-11T12:22:08.068071+0000","last_unstale":"2023-08-11T12:22:31.723541+0000","last_undegraded":"2023-08-11T12:22:31.723541+0000","last_fullsized":"2023-08-11T12:22:31.723541+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:35:49.958958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"87'1","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.728607+0000","last_change":"2023-08-11T12:22:31.727900+0000","last_active":"2023-08-11T12:22:31.728607+0000","last_peered":"2023-08-11T12:22:31.728607+0000","last_clean":"2023-08-11T12:22:31.728607+0000","last_became_active":"2023-08-11T12:22:31.727346+0000","last_became_peered":"2023-08-11T12:22:31.727346+0000","last_unstale":"2023-08-11T12:22:31.728607+0000","last_undegraded":"2023-08-11T12:22:31.728607+0000","last_fullsized":"2023-08-11T12:22:31.728607+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:12:21.170378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722974+0000","last_change":"2023-08-11T12:22:03.843434+0000","last_active":"2023-08-11T12:22:31.722974+0000","last_peered":"2023-08-11T12:22:31.722974+0000","last_clean":"2023-08-11T12:22:31.722974+0000","last_became_active":"2023-08-11T12:22:03.843117+0000","last_became_peered":"2023-08-11T12:22:03.843117+0000","last_unstale":"2023-08-11T12:22:31.722974+0000","last_undegraded":"2023-08-11T12:22:31.722974+0000","last_fullsized":"2023-08-11T12:22:31.722974+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:30:45.835632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717439+0000","last_change":"2023-08-11T12:22:07.889740+0000","last_active":"2023-08-11T12:22:31.717439+0000","last_peered":"2023-08-11T12:22:31.717439+0000","last_clean":"2023-08-11T12:22:31.717439+0000","last_became_active":"2023-08-11T12:22:07.889272+0000","last_became_peered":"2023-08-11T12:22:07.889272+0000","last_unstale":"2023-08-11T12:22:31.717439+0000","last_undegraded":"2023-08-11T12:22:31.717439+0000","last_fullsized":"2023-08-11T12:22:31.717439+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:48:06.207915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":141,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:24:18.866178+0000","last_change":"2023-08-11T12:22:02.846661+0000","last_active":"2023-08-11T12:24:18.866178+0000","last_peered":"2023-08-11T12:24:18.866178+0000","last_clean":"2023-08-11T12:24:18.866178+0000","last_became_active":"2023-08-11T12:22:02.846269+0000","last_became_peered":"2023-08-11T12:22:02.846269+0000","last_unstale":"2023-08-11T12:24:18.866178+0000","last_undegraded":"2023-08-11T12:24:18.866178+0000","last_fullsized":"2023-08-11T12:24:18.866178+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:06:18.229850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721164+0000","last_change":"2023-08-11T12:22:03.849653+0000","last_active":"2023-08-11T12:22:31.721164+0000","last_peered":"2023-08-11T12:22:31.721164+0000","last_clean":"2023-08-11T12:22:31.721164+0000","last_became_active":"2023-08-11T12:22:03.849303+0000","last_became_peered":"2023-08-11T12:22:03.849303+0000","last_unstale":"2023-08-11T12:22:31.721164+0000","last_undegraded":"2023-08-11T12:22:31.721164+0000","last_fullsized":"2023-08-11T12:22:31.721164+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:06:11.551259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717073+0000","last_change":"2023-08-11T12:22:08.068395+0000","last_active":"2023-08-11T12:22:31.717073+0000","last_peered":"2023-08-11T12:22:31.717073+0000","last_clean":"2023-08-11T12:22:31.717073+0000","last_became_active":"2023-08-11T12:22:08.067572+0000","last_became_peered":"2023-08-11T12:22:08.067572+0000","last_unstale":"2023-08-11T12:22:31.717073+0000","last_undegraded":"2023-08-11T12:22:31.717073+0000","last_fullsized":"2023-08-11T12:22:31.717073+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:17:59.273227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800465+0000","last_change":"2023-08-11T12:22:03.828971+0000","last_active":"2023-08-11T12:22:31.800465+0000","last_peered":"2023-08-11T12:22:31.800465+0000","last_clean":"2023-08-11T12:22:31.800465+0000","last_became_active":"2023-08-11T12:22:03.828653+0000","last_became_peered":"2023-08-11T12:22:03.828653+0000","last_unstale":"2023-08-11T12:22:31.800465+0000","last_undegraded":"2023-08-11T12:22:31.800465+0000","last_fullsized":"2023-08-11T12:22:31.800465+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:03:54.904360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":140,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:24:17.886789+0000","last_change":"2023-08-11T12:22:02.842419+0000","last_active":"2023-08-11T12:24:17.886789+0000","last_peered":"2023-08-11T12:24:17.886789+0000","last_clean":"2023-08-11T12:24:17.886789+0000","last_became_active":"2023-08-11T12:22:02.842105+0000","last_became_peered":"2023-08-11T12:22:02.842105+0000","last_unstale":"2023-08-11T12:24:17.886789+0000","last_undegraded":"2023-08-11T12:24:17.886789+0000","last_fullsized":"2023-08-11T12:24:17.886789+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:32:13.063912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717706+0000","last_change":"2023-08-11T12:22:07.880762+0000","last_active":"2023-08-11T12:22:31.717706+0000","last_peered":"2023-08-11T12:22:31.717706+0000","last_clean":"2023-08-11T12:22:31.717706+0000","last_became_active":"2023-08-11T12:22:07.880373+0000","last_became_peered":"2023-08-11T12:22:07.880373+0000","last_unstale":"2023-08-11T12:22:31.717706+0000","last_undegraded":"2023-08-11T12:22:31.717706+0000","last_fullsized":"2023-08-11T12:22:31.717706+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:07:06.457583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720351+0000","last_change":"2023-08-11T12:22:03.838555+0000","last_active":"2023-08-11T12:22:31.720351+0000","last_peered":"2023-08-11T12:22:31.720351+0000","last_clean":"2023-08-11T12:22:31.720351+0000","last_became_active":"2023-08-11T12:22:03.838135+0000","last_became_peered":"2023-08-11T12:22:03.838135+0000","last_unstale":"2023-08-11T12:22:31.720351+0000","last_undegraded":"2023-08-11T12:22:31.720351+0000","last_fullsized":"2023-08-11T12:22:31.720351+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:36:24.934863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:32.698817+0000","last_change":"2023-08-11T12:22:02.835093+0000","last_active":"2023-08-11T12:22:32.698817+0000","last_peered":"2023-08-11T12:22:32.698817+0000","last_clean":"2023-08-11T12:22:32.698817+0000","last_became_active":"2023-08-11T12:22:02.834545+0000","last_became_peered":"2023-08-11T12:22:02.834545+0000","last_unstale":"2023-08-11T12:22:32.698817+0000","last_undegraded":"2023-08-11T12:22:32.698817+0000","last_fullsized":"2023-08-11T12:22:32.698817+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:21:54.371599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":355,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717340+0000","last_change":"2023-08-11T12:20:57.484190+0000","last_active":"2023-08-11T12:22:31.717340+0000","last_peered":"2023-08-11T12:22:31.717340+0000","last_clean":"2023-08-11T12:22:31.717340+0000","last_became_active":"2023-08-11T12:20:57.483655+0000","last_became_peered":"2023-08-11T12:20:57.483655+0000","last_unstale":"2023-08-11T12:22:31.717340+0000","last_undegraded":"2023-08-11T12:22:31.717340+0000","last_fullsized":"2023-08-11T12:22:31.717340+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:17:49.245488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:17:49.245488+0000","last_clean_scrub_stamp":"2023-08-11T12:17:49.245488+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:25:33.880946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800922+0000","last_change":"2023-08-11T12:22:08.068762+0000","last_active":"2023-08-11T12:22:31.800922+0000","last_peered":"2023-08-11T12:22:31.800922+0000","last_clean":"2023-08-11T12:22:31.800922+0000","last_became_active":"2023-08-11T12:22:08.068205+0000","last_became_peered":"2023-08-11T12:22:08.068205+0000","last_unstale":"2023-08-11T12:22:31.800922+0000","last_undegraded":"2023-08-11T12:22:31.800922+0000","last_fullsized":"2023-08-11T12:22:31.800922+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:55:06.744751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.716814+0000","last_change":"2023-08-11T12:22:03.837843+0000","last_active":"2023-08-11T12:22:31.716814+0000","last_peered":"2023-08-11T12:22:31.716814+0000","last_clean":"2023-08-11T12:22:31.716814+0000","last_became_active":"2023-08-11T12:22:03.837537+0000","last_became_peered":"2023-08-11T12:22:03.837537+0000","last_unstale":"2023-08-11T12:22:31.716814+0000","last_undegraded":"2023-08-11T12:22:31.716814+0000","last_fullsized":"2023-08-11T12:22:31.716814+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:17:41.517052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717406+0000","last_change":"2023-08-11T12:22:02.843150+0000","last_active":"2023-08-11T12:22:31.717406+0000","last_peered":"2023-08-11T12:22:31.717406+0000","last_clean":"2023-08-11T12:22:31.717406+0000","last_became_active":"2023-08-11T12:22:02.842829+0000","last_became_peered":"2023-08-11T12:22:02.842829+0000","last_unstale":"2023-08-11T12:22:31.717406+0000","last_undegraded":"2023-08-11T12:22:31.717406+0000","last_fullsized":"2023-08-11T12:22:31.717406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:09:48.420755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720746+0000","last_change":"2023-08-11T12:22:07.883050+0000","last_active":"2023-08-11T12:22:31.720746+0000","last_peered":"2023-08-11T12:22:31.720746+0000","last_clean":"2023-08-11T12:22:31.720746+0000","last_became_active":"2023-08-11T12:22:07.882423+0000","last_became_peered":"2023-08-11T12:22:07.882423+0000","last_unstale":"2023-08-11T12:22:31.720746+0000","last_undegraded":"2023-08-11T12:22:31.720746+0000","last_fullsized":"2023-08-11T12:22:31.720746+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:14:51.848070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.724046+0000","last_change":"2023-08-11T12:22:02.850632+0000","last_active":"2023-08-11T12:22:31.724046+0000","last_peered":"2023-08-11T12:22:31.724046+0000","last_clean":"2023-08-11T12:22:31.724046+0000","last_became_active":"2023-08-11T12:22:02.850312+0000","last_became_peered":"2023-08-11T12:22:02.850312+0000","last_unstale":"2023-08-11T12:22:31.724046+0000","last_undegraded":"2023-08-11T12:22:31.724046+0000","last_fullsized":"2023-08-11T12:22:31.724046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:54:50.288288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717673+0000","last_change":"2023-08-11T12:22:03.839869+0000","last_active":"2023-08-11T12:22:31.717673+0000","last_peered":"2023-08-11T12:22:31.717673+0000","last_clean":"2023-08-11T12:22:31.717673+0000","last_became_active":"2023-08-11T12:22:03.839486+0000","last_became_peered":"2023-08-11T12:22:03.839486+0000","last_unstale":"2023-08-11T12:22:31.717673+0000","last_undegraded":"2023-08-11T12:22:31.717673+0000","last_fullsized":"2023-08-11T12:22:31.717673+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:23:04.341624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720353+0000","last_change":"2023-08-11T12:22:08.066877+0000","last_active":"2023-08-11T12:22:31.720353+0000","last_peered":"2023-08-11T12:22:31.720353+0000","last_clean":"2023-08-11T12:22:31.720353+0000","last_became_active":"2023-08-11T12:22:08.066418+0000","last_became_peered":"2023-08-11T12:22:08.066418+0000","last_unstale":"2023-08-11T12:22:31.720353+0000","last_undegraded":"2023-08-11T12:22:31.720353+0000","last_fullsized":"2023-08-11T12:22:31.720353+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:12:43.228455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'7","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722342+0000","last_change":"2023-08-11T12:22:02.850505+0000","last_active":"2023-08-11T12:22:31.722342+0000","last_peered":"2023-08-11T12:22:31.722342+0000","last_clean":"2023-08-11T12:22:31.722342+0000","last_became_active":"2023-08-11T12:22:02.850104+0000","last_became_peered":"2023-08-11T12:22:02.850104+0000","last_unstale":"2023-08-11T12:22:31.722342+0000","last_undegraded":"2023-08-11T12:22:31.722342+0000","last_fullsized":"2023-08-11T12:22:31.722342+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:33:50.319404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721634+0000","last_change":"2023-08-11T12:22:03.837580+0000","last_active":"2023-08-11T12:22:31.721634+0000","last_peered":"2023-08-11T12:22:31.721634+0000","last_clean":"2023-08-11T12:22:31.721634+0000","last_became_active":"2023-08-11T12:22:03.837256+0000","last_became_peered":"2023-08-11T12:22:03.837256+0000","last_unstale":"2023-08-11T12:22:31.721634+0000","last_undegraded":"2023-08-11T12:22:31.721634+0000","last_fullsized":"2023-08-11T12:22:31.721634+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:07:44.899244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722738+0000","last_change":"2023-08-11T12:22:07.873613+0000","last_active":"2023-08-11T12:22:31.722738+0000","last_peered":"2023-08-11T12:22:31.722738+0000","last_clean":"2023-08-11T12:22:31.722738+0000","last_became_active":"2023-08-11T12:22:07.873149+0000","last_became_peered":"2023-08-11T12:22:07.873149+0000","last_unstale":"2023-08-11T12:22:31.722738+0000","last_undegraded":"2023-08-11T12:22:31.722738+0000","last_fullsized":"2023-08-11T12:22:31.722738+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:38:35.678888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:32.698437+0000","last_change":"2023-08-11T12:22:02.843146+0000","last_active":"2023-08-11T12:22:32.698437+0000","last_peered":"2023-08-11T12:22:32.698437+0000","last_clean":"2023-08-11T12:22:32.698437+0000","last_became_active":"2023-08-11T12:22:02.842663+0000","last_became_peered":"2023-08-11T12:22:02.842663+0000","last_unstale":"2023-08-11T12:22:32.698437+0000","last_undegraded":"2023-08-11T12:22:32.698437+0000","last_fullsized":"2023-08-11T12:22:32.698437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:32:13.084100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719561+0000","last_change":"2023-08-11T12:22:03.847351+0000","last_active":"2023-08-11T12:22:31.719561+0000","last_peered":"2023-08-11T12:22:31.719561+0000","last_clean":"2023-08-11T12:22:31.719561+0000","last_became_active":"2023-08-11T12:22:03.847044+0000","last_became_peered":"2023-08-11T12:22:03.847044+0000","last_unstale":"2023-08-11T12:22:31.719561+0000","last_undegraded":"2023-08-11T12:22:31.719561+0000","last_fullsized":"2023-08-11T12:22:31.719561+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:17:19.004762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721751+0000","last_change":"2023-08-11T12:22:08.068459+0000","last_active":"2023-08-11T12:22:31.721751+0000","last_peered":"2023-08-11T12:22:31.721751+0000","last_clean":"2023-08-11T12:22:31.721751+0000","last_became_active":"2023-08-11T12:22:08.067857+0000","last_became_peered":"2023-08-11T12:22:08.067857+0000","last_unstale":"2023-08-11T12:22:31.721751+0000","last_undegraded":"2023-08-11T12:22:31.721751+0000","last_fullsized":"2023-08-11T12:22:31.721751+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:15:05.931547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774199+0000","last_change":"2023-08-11T12:22:02.846441+0000","last_active":"2023-08-11T12:22:31.774199+0000","last_peered":"2023-08-11T12:22:31.774199+0000","last_clean":"2023-08-11T12:22:31.774199+0000","last_became_active":"2023-08-11T12:22:02.846153+0000","last_became_peered":"2023-08-11T12:22:02.846153+0000","last_unstale":"2023-08-11T12:22:31.774199+0000","last_undegraded":"2023-08-11T12:22:31.774199+0000","last_fullsized":"2023-08-11T12:22:31.774199+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:00:55.631058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723390+0000","last_change":"2023-08-11T12:22:03.841932+0000","last_active":"2023-08-11T12:22:31.723390+0000","last_peered":"2023-08-11T12:22:31.723390+0000","last_clean":"2023-08-11T12:22:31.723390+0000","last_became_active":"2023-08-11T12:22:03.841635+0000","last_became_peered":"2023-08-11T12:22:03.841635+0000","last_unstale":"2023-08-11T12:22:31.723390+0000","last_undegraded":"2023-08-11T12:22:31.723390+0000","last_fullsized":"2023-08-11T12:22:31.723390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:01:57.888877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722748+0000","last_change":"2023-08-11T12:22:07.886160+0000","last_active":"2023-08-11T12:22:31.722748+0000","last_peered":"2023-08-11T12:22:31.722748+0000","last_clean":"2023-08-11T12:22:31.722748+0000","last_became_active":"2023-08-11T12:22:07.885703+0000","last_became_peered":"2023-08-11T12:22:07.885703+0000","last_unstale":"2023-08-11T12:22:31.722748+0000","last_undegraded":"2023-08-11T12:22:31.722748+0000","last_fullsized":"2023-08-11T12:22:31.722748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:50:20.362829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720571+0000","last_change":"2023-08-11T12:22:02.849360+0000","last_active":"2023-08-11T12:22:31.720571+0000","last_peered":"2023-08-11T12:22:31.720571+0000","last_clean":"2023-08-11T12:22:31.720571+0000","last_became_active":"2023-08-11T12:22:02.849028+0000","last_became_peered":"2023-08-11T12:22:02.849028+0000","last_unstale":"2023-08-11T12:22:31.720571+0000","last_undegraded":"2023-08-11T12:22:31.720571+0000","last_fullsized":"2023-08-11T12:22:31.720571+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:55:24.114464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719877+0000","last_change":"2023-08-11T12:22:03.850285+0000","last_active":"2023-08-11T12:22:31.719877+0000","last_peered":"2023-08-11T12:22:31.719877+0000","last_clean":"2023-08-11T12:22:31.719877+0000","last_became_active":"2023-08-11T12:22:03.849978+0000","last_became_peered":"2023-08-11T12:22:03.849978+0000","last_unstale":"2023-08-11T12:22:31.719877+0000","last_undegraded":"2023-08-11T12:22:31.719877+0000","last_fullsized":"2023-08-11T12:22:31.719877+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:29:51.679282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721058+0000","last_change":"2023-08-11T12:22:07.881578+0000","last_active":"2023-08-11T12:22:31.721058+0000","last_peered":"2023-08-11T12:22:31.721058+0000","last_clean":"2023-08-11T12:22:31.721058+0000","last_became_active":"2023-08-11T12:22:07.881145+0000","last_became_peered":"2023-08-11T12:22:07.881145+0000","last_unstale":"2023-08-11T12:22:31.721058+0000","last_undegraded":"2023-08-11T12:22:31.721058+0000","last_fullsized":"2023-08-11T12:22:31.721058+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:32:16.462208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:34.992478+0000","last_change":"2023-08-11T12:22:02.848875+0000","last_active":"2023-08-11T12:22:34.992478+0000","last_peered":"2023-08-11T12:22:34.992478+0000","last_clean":"2023-08-11T12:22:34.992478+0000","last_became_active":"2023-08-11T12:22:02.848578+0000","last_became_peered":"2023-08-11T12:22:02.848578+0000","last_unstale":"2023-08-11T12:22:34.992478+0000","last_undegraded":"2023-08-11T12:22:34.992478+0000","last_fullsized":"2023-08-11T12:22:34.992478+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:29:40.949795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721093+0000","last_change":"2023-08-11T12:22:03.849865+0000","last_active":"2023-08-11T12:22:31.721093+0000","last_peered":"2023-08-11T12:22:31.721093+0000","last_clean":"2023-08-11T12:22:31.721093+0000","last_became_active":"2023-08-11T12:22:03.849557+0000","last_became_peered":"2023-08-11T12:22:03.849557+0000","last_unstale":"2023-08-11T12:22:31.721093+0000","last_undegraded":"2023-08-11T12:22:31.721093+0000","last_fullsized":"2023-08-11T12:22:31.721093+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:49:27.142464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721537+0000","last_change":"2023-08-11T12:22:08.067009+0000","last_active":"2023-08-11T12:22:31.721537+0000","last_peered":"2023-08-11T12:22:31.721537+0000","last_clean":"2023-08-11T12:22:31.721537+0000","last_became_active":"2023-08-11T12:22:08.066477+0000","last_became_peered":"2023-08-11T12:22:08.066477+0000","last_unstale":"2023-08-11T12:22:31.721537+0000","last_undegraded":"2023-08-11T12:22:31.721537+0000","last_fullsized":"2023-08-11T12:22:31.721537+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:07:02.380225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.731106+0000","last_change":"2023-08-11T12:22:31.731106+0000","last_active":"2023-08-11T12:22:31.731106+0000","last_peered":"2023-08-11T12:22:31.731106+0000","last_clean":"2023-08-11T12:22:31.731106+0000","last_became_active":"2023-08-11T12:22:31.724944+0000","last_became_peered":"2023-08-11T12:22:31.724944+0000","last_unstale":"2023-08-11T12:22:31.731106+0000","last_undegraded":"2023-08-11T12:22:31.731106+0000","last_fullsized":"2023-08-11T12:22:31.731106+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:56:41.188015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718094+0000","last_change":"2023-08-11T12:22:03.848715+0000","last_active":"2023-08-11T12:22:31.718094+0000","last_peered":"2023-08-11T12:22:31.718094+0000","last_clean":"2023-08-11T12:22:31.718094+0000","last_became_active":"2023-08-11T12:22:03.848311+0000","last_became_peered":"2023-08-11T12:22:03.848311+0000","last_unstale":"2023-08-11T12:22:31.718094+0000","last_undegraded":"2023-08-11T12:22:31.718094+0000","last_fullsized":"2023-08-11T12:22:31.718094+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:45:14.152855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774158+0000","last_change":"2023-08-11T12:22:07.882566+0000","last_active":"2023-08-11T12:22:31.774158+0000","last_peered":"2023-08-11T12:22:31.774158+0000","last_clean":"2023-08-11T12:22:31.774158+0000","last_became_active":"2023-08-11T12:22:07.882198+0000","last_became_peered":"2023-08-11T12:22:07.882198+0000","last_unstale":"2023-08-11T12:22:31.774158+0000","last_undegraded":"2023-08-11T12:22:31.774158+0000","last_fullsized":"2023-08-11T12:22:31.774158+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:21:03.227408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"87'5","reported_seq":141,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:24:18.897561+0000","last_change":"2023-08-11T12:22:02.846424+0000","last_active":"2023-08-11T12:24:18.897561+0000","last_peered":"2023-08-11T12:24:18.897561+0000","last_clean":"2023-08-11T12:24:18.897561+0000","last_became_active":"2023-08-11T12:22:02.846063+0000","last_became_peered":"2023-08-11T12:22:02.846063+0000","last_unstale":"2023-08-11T12:24:18.897561+0000","last_undegraded":"2023-08-11T12:24:18.897561+0000","last_fullsized":"2023-08-11T12:24:18.897561+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:28:14.946971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717900+0000","last_change":"2023-08-11T12:22:03.845616+0000","last_active":"2023-08-11T12:22:31.717900+0000","last_peered":"2023-08-11T12:22:31.717900+0000","last_clean":"2023-08-11T12:22:31.717900+0000","last_became_active":"2023-08-11T12:22:03.845293+0000","last_became_peered":"2023-08-11T12:22:03.845293+0000","last_unstale":"2023-08-11T12:22:31.717900+0000","last_undegraded":"2023-08-11T12:22:31.717900+0000","last_fullsized":"2023-08-11T12:22:31.717900+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:28:30.374044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718737+0000","last_change":"2023-08-11T12:22:07.888963+0000","last_active":"2023-08-11T12:22:31.718737+0000","last_peered":"2023-08-11T12:22:31.718737+0000","last_clean":"2023-08-11T12:22:31.718737+0000","last_became_active":"2023-08-11T12:22:07.888513+0000","last_became_peered":"2023-08-11T12:22:07.888513+0000","last_unstale":"2023-08-11T12:22:31.718737+0000","last_undegraded":"2023-08-11T12:22:31.718737+0000","last_fullsized":"2023-08-11T12:22:31.718737+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:44:29.823122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.801009+0000","last_change":"2023-08-11T12:22:02.850739+0000","last_active":"2023-08-11T12:22:31.801009+0000","last_peered":"2023-08-11T12:22:31.801009+0000","last_clean":"2023-08-11T12:22:31.801009+0000","last_became_active":"2023-08-11T12:22:02.850455+0000","last_became_peered":"2023-08-11T12:22:02.850455+0000","last_unstale":"2023-08-11T12:22:31.801009+0000","last_undegraded":"2023-08-11T12:22:31.801009+0000","last_fullsized":"2023-08-11T12:22:31.801009+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:37:48.954343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718168+0000","last_change":"2023-08-11T12:22:03.838834+0000","last_active":"2023-08-11T12:22:31.718168+0000","last_peered":"2023-08-11T12:22:31.718168+0000","last_clean":"2023-08-11T12:22:31.718168+0000","last_became_active":"2023-08-11T12:22:03.838435+0000","last_became_peered":"2023-08-11T12:22:03.838435+0000","last_unstale":"2023-08-11T12:22:31.718168+0000","last_undegraded":"2023-08-11T12:22:31.718168+0000","last_fullsized":"2023-08-11T12:22:31.718168+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:42:39.127547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.799965+0000","last_change":"2023-08-11T12:22:07.884481+0000","last_active":"2023-08-11T12:22:31.799965+0000","last_peered":"2023-08-11T12:22:31.799965+0000","last_clean":"2023-08-11T12:22:31.799965+0000","last_became_active":"2023-08-11T12:22:07.884084+0000","last_became_peered":"2023-08-11T12:22:07.884084+0000","last_unstale":"2023-08-11T12:22:31.799965+0000","last_undegraded":"2023-08-11T12:22:31.799965+0000","last_fullsized":"2023-08-11T12:22:31.799965+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:06:29.852022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717429+0000","last_change":"2023-08-11T12:22:02.849339+0000","last_active":"2023-08-11T12:22:31.717429+0000","last_peered":"2023-08-11T12:22:31.717429+0000","last_clean":"2023-08-11T12:22:31.717429+0000","last_became_active":"2023-08-11T12:22:02.848986+0000","last_became_peered":"2023-08-11T12:22:02.848986+0000","last_unstale":"2023-08-11T12:22:31.717429+0000","last_undegraded":"2023-08-11T12:22:31.717429+0000","last_fullsized":"2023-08-11T12:22:31.717429+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:00:28.458884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718065+0000","last_change":"2023-08-11T12:22:03.846301+0000","last_active":"2023-08-11T12:22:31.718065+0000","last_peered":"2023-08-11T12:22:31.718065+0000","last_clean":"2023-08-11T12:22:31.718065+0000","last_became_active":"2023-08-11T12:22:03.845990+0000","last_became_peered":"2023-08-11T12:22:03.845990+0000","last_unstale":"2023-08-11T12:22:31.718065+0000","last_undegraded":"2023-08-11T12:22:31.718065+0000","last_fullsized":"2023-08-11T12:22:31.718065+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:30:23.134555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719765+0000","last_change":"2023-08-11T12:22:03.836652+0000","last_active":"2023-08-11T12:22:31.719765+0000","last_peered":"2023-08-11T12:22:31.719765+0000","last_clean":"2023-08-11T12:22:31.719765+0000","last_became_active":"2023-08-11T12:22:03.836236+0000","last_became_peered":"2023-08-11T12:22:03.836236+0000","last_unstale":"2023-08-11T12:22:31.719765+0000","last_undegraded":"2023-08-11T12:22:31.719765+0000","last_fullsized":"2023-08-11T12:22:31.719765+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:15:43.477085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722700+0000","last_change":"2023-08-11T12:22:03.831318+0000","last_active":"2023-08-11T12:22:31.722700+0000","last_peered":"2023-08-11T12:22:31.722700+0000","last_clean":"2023-08-11T12:22:31.722700+0000","last_became_active":"2023-08-11T12:22:03.830670+0000","last_became_peered":"2023-08-11T12:22:03.830670+0000","last_unstale":"2023-08-11T12:22:31.722700+0000","last_undegraded":"2023-08-11T12:22:31.722700+0000","last_fullsized":"2023-08-11T12:22:31.722700+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:27:54.407934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722513+0000","last_change":"2023-08-11T12:22:03.841396+0000","last_active":"2023-08-11T12:22:31.722513+0000","last_peered":"2023-08-11T12:22:31.722513+0000","last_clean":"2023-08-11T12:22:31.722513+0000","last_became_active":"2023-08-11T12:22:03.841076+0000","last_became_peered":"2023-08-11T12:22:03.841076+0000","last_unstale":"2023-08-11T12:22:31.722513+0000","last_undegraded":"2023-08-11T12:22:31.722513+0000","last_fullsized":"2023-08-11T12:22:31.722513+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:14:14.365513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719695+0000","last_change":"2023-08-11T12:22:03.847266+0000","last_active":"2023-08-11T12:22:31.719695+0000","last_peered":"2023-08-11T12:22:31.719695+0000","last_clean":"2023-08-11T12:22:31.719695+0000","last_became_active":"2023-08-11T12:22:03.846898+0000","last_became_peered":"2023-08-11T12:22:03.846898+0000","last_unstale":"2023-08-11T12:22:31.719695+0000","last_undegraded":"2023-08-11T12:22:31.719695+0000","last_fullsized":"2023-08-11T12:22:31.719695+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:05:00.055352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717774+0000","last_change":"2023-08-11T12:22:03.843491+0000","last_active":"2023-08-11T12:22:31.717774+0000","last_peered":"2023-08-11T12:22:31.717774+0000","last_clean":"2023-08-11T12:22:31.717774+0000","last_became_active":"2023-08-11T12:22:03.843099+0000","last_became_peered":"2023-08-11T12:22:03.843099+0000","last_unstale":"2023-08-11T12:22:31.717774+0000","last_undegraded":"2023-08-11T12:22:31.717774+0000","last_fullsized":"2023-08-11T12:22:31.717774+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:24:27.850492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720396+0000","last_change":"2023-08-11T12:22:03.840508+0000","last_active":"2023-08-11T12:22:31.720396+0000","last_peered":"2023-08-11T12:22:31.720396+0000","last_clean":"2023-08-11T12:22:31.720396+0000","last_became_active":"2023-08-11T12:22:03.840160+0000","last_became_peered":"2023-08-11T12:22:03.840160+0000","last_unstale":"2023-08-11T12:22:31.720396+0000","last_undegraded":"2023-08-11T12:22:31.720396+0000","last_fullsized":"2023-08-11T12:22:31.720396+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:09:11.925192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723642+0000","last_change":"2023-08-11T12:22:03.843724+0000","last_active":"2023-08-11T12:22:31.723642+0000","last_peered":"2023-08-11T12:22:31.723642+0000","last_clean":"2023-08-11T12:22:31.723642+0000","last_became_active":"2023-08-11T12:22:03.843431+0000","last_became_peered":"2023-08-11T12:22:03.843431+0000","last_unstale":"2023-08-11T12:22:31.723642+0000","last_undegraded":"2023-08-11T12:22:31.723642+0000","last_fullsized":"2023-08-11T12:22:31.723642+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:02:15.971280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721811+0000","last_change":"2023-08-11T12:22:03.831268+0000","last_active":"2023-08-11T12:22:31.721811+0000","last_peered":"2023-08-11T12:22:31.721811+0000","last_clean":"2023-08-11T12:22:31.721811+0000","last_became_active":"2023-08-11T12:22:03.830839+0000","last_became_peered":"2023-08-11T12:22:03.830839+0000","last_unstale":"2023-08-11T12:22:31.721811+0000","last_undegraded":"2023-08-11T12:22:31.721811+0000","last_fullsized":"2023-08-11T12:22:31.721811+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:25:09.422026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800309+0000","last_change":"2023-08-11T12:22:03.839227+0000","last_active":"2023-08-11T12:22:31.800309+0000","last_peered":"2023-08-11T12:22:31.800309+0000","last_clean":"2023-08-11T12:22:31.800309+0000","last_became_active":"2023-08-11T12:22:03.838526+0000","last_became_peered":"2023-08-11T12:22:03.838526+0000","last_unstale":"2023-08-11T12:22:31.800309+0000","last_undegraded":"2023-08-11T12:22:31.800309+0000","last_fullsized":"2023-08-11T12:22:31.800309+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:56:06.609931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720714+0000","last_change":"2023-08-11T12:22:03.834614+0000","last_active":"2023-08-11T12:22:31.720714+0000","last_peered":"2023-08-11T12:22:31.720714+0000","last_clean":"2023-08-11T12:22:31.720714+0000","last_became_active":"2023-08-11T12:22:03.834267+0000","last_became_peered":"2023-08-11T12:22:03.834267+0000","last_unstale":"2023-08-11T12:22:31.720714+0000","last_undegraded":"2023-08-11T12:22:31.720714+0000","last_fullsized":"2023-08-11T12:22:31.720714+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:05:00.003830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774493+0000","last_change":"2023-08-11T12:22:03.846504+0000","last_active":"2023-08-11T12:22:31.774493+0000","last_peered":"2023-08-11T12:22:31.774493+0000","last_clean":"2023-08-11T12:22:31.774493+0000","last_became_active":"2023-08-11T12:22:03.846156+0000","last_became_peered":"2023-08-11T12:22:03.846156+0000","last_unstale":"2023-08-11T12:22:31.774493+0000","last_undegraded":"2023-08-11T12:22:31.774493+0000","last_fullsized":"2023-08-11T12:22:31.774493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:54:38.654858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717340+0000","last_change":"2023-08-11T12:22:03.849854+0000","last_active":"2023-08-11T12:22:31.717340+0000","last_peered":"2023-08-11T12:22:31.717340+0000","last_clean":"2023-08-11T12:22:31.717340+0000","last_became_active":"2023-08-11T12:22:03.849553+0000","last_became_peered":"2023-08-11T12:22:03.849553+0000","last_unstale":"2023-08-11T12:22:31.717340+0000","last_undegraded":"2023-08-11T12:22:31.717340+0000","last_fullsized":"2023-08-11T12:22:31.717340+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:14:27.485150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720171+0000","last_change":"2023-08-11T12:22:03.843511+0000","last_active":"2023-08-11T12:22:31.720171+0000","last_peered":"2023-08-11T12:22:31.720171+0000","last_clean":"2023-08-11T12:22:31.720171+0000","last_became_active":"2023-08-11T12:22:03.843206+0000","last_became_peered":"2023-08-11T12:22:03.843206+0000","last_unstale":"2023-08-11T12:22:31.720171+0000","last_undegraded":"2023-08-11T12:22:31.720171+0000","last_fullsized":"2023-08-11T12:22:31.720171+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:19:44.978907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":248338,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10522,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1113,"num_read_kb":576,"num_write":211,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":31566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":185,"ondisk_log_size":185,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449128,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":484340,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.443,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.48999999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.51000000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.41499999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77800000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.501}]},{"osd":2,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.52500000000000002,"15min":0.53200000000000003},"min":{"1min":0.35599999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70899999999999996,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.33200000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79100000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":4,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.69899999999999995,"15min":0.69599999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89700000000000002,"5min":1.032,"15min":1.032},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.60999999999999999},"min":{"1min":0.46000000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.78100000000000003,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.63200000000000001}]},{"osd":5,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.64900000000000002,"15min":0.66100000000000003},"min":{"1min":0.34799999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77500000000000002,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65900000000000003,"15min":0.65700000000000003},"min":{"1min":0.437,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.81200000000000006}]},{"osd":6,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.68400000000000005,"15min":0.69099999999999995},"min":{"1min":0.46500000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86499999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.98299999999999998,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.79300000000000004}]},{"osd":7,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.79100000000000004,"15min":0.78700000000000003},"min":{"1min":0.55100000000000005,"5min":0.503,"15min":0.503},"max":{"1min":1.0229999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.56100000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.873,"5min":1.302,"15min":1.302},"last":0.66400000000000003}]},{"osd":8,"last update":"Fri Aug 11 12:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.71999999999999997,"15min":0.71499999999999997},"min":{"1min":0.58599999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.753},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.79100000000000004,"15min":0.78700000000000003},"min":{"1min":0.62,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96599999999999997,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.84099999999999997}]},{"osd":9,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.61899999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.81100000000000005,"15min":0.80500000000000005},"min":{"1min":0.59999999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.071,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.88600000000000001}]},{"osd":10,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.61299999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93000000000000005,"5min":1.341,"15min":1.341},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.82199999999999995,"15min":0.82399999999999995},"min":{"1min":0.59099999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.95099999999999996,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.82699999999999996}]}]},{"osd":10,"up_from":71,"seq":304942678059,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1064960,"data_stored":1078813,"data_compressed":53533,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.67600000000000005,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.51700000000000002}]},{"osd":1,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48499999999999999,"15min":0.48299999999999998},"min":{"1min":0.29799999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.63100000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80400000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.61899999999999999}]},{"osd":2,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.65100000000000002,"15min":0.64000000000000001},"min":{"1min":0.46500000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.90200000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.69599999999999995}]},{"osd":3,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.65900000000000003,"15min":0.68100000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81100000000000005,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.72099999999999997,"15min":0.72299999999999998},"min":{"1min":0.52800000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89900000000000002,"5min":1.528,"15min":1.528},"last":0.70899999999999996}]},{"osd":4,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63300000000000001,"15min":0.623},"min":{"1min":0.40400000000000003,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.88400000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.35399999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.873,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.58799999999999997}]},{"osd":5,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72299999999999998,"15min":0.72099999999999997},"min":{"1min":0.501,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95099999999999996,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.752,"15min":0.74399999999999999},"min":{"1min":0.51000000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.99099999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.65800000000000003}]},{"osd":6,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.79500000000000004,"15min":0.80700000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.82299999999999995,"15min":0.81899999999999995},"min":{"1min":0.64700000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98799999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.78700000000000003}]},{"osd":7,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.59099999999999997}]},{"osd":8,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84399999999999997,"15min":0.83699999999999997},"min":{"1min":0.57099999999999995,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0469999999999999,"5min":1.296,"15min":1.296},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.84299999999999997,"15min":0.85199999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1100000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.73199999999999998}]},{"osd":9,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.88800000000000001,"15min":0.88100000000000001},"min":{"1min":0.69599999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1459999999999999,"5min":1.21,"15min":1.21},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.84799999999999998,"15min":0.86099999999999999},"min":{"1min":0.54700000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.157,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.64300000000000002}]},{"osd":11,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.86099999999999999,"15min":0.86499999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0900000000000001,"5min":1.323,"15min":1.323},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.86499999999999999,"15min":0.85899999999999999},"min":{"1min":0.61099999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0549999999999999,"5min":1.341,"15min":1.341},"last":0.93899999999999995}]}]},{"osd":9,"up_from":66,"seq":283467841583,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":484270,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54900000000000004,"15min":0.56499999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.55600000000000005,"15min":0.56599999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.755,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.44900000000000001}]},{"osd":1,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.72899999999999998,"15min":0.747},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.65600000000000003,"15min":0.64200000000000002},"min":{"1min":0.41599999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.65600000000000003}]},{"osd":2,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.76100000000000001,"15min":0.78200000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97999999999999998,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73999999999999999,"15min":0.75700000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.57799999999999996}]},{"osd":3,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.67900000000000005,"15min":0.72899999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82299999999999995,"5min":1.355,"15min":1.355},"last":0.5},{"interface":"front","average":{"1min":0.626,"5min":0.72399999999999998,"15min":0.77800000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.92800000000000005,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.67400000000000004}]},{"osd":4,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.754,"15min":0.754},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.53600000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.64100000000000001}]},{"osd":5,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.86399999999999999,"15min":0.91200000000000003},"min":{"1min":0.51900000000000002,"5min":0.495,"15min":0.495},"max":{"1min":1.0720000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.86299999999999999,"15min":0.91400000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1200000000000001,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.48199999999999998}]},{"osd":6,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.91200000000000003,"15min":0.94899999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.141,"5min":1.163,"15min":1.163},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.93500000000000005,"15min":0.995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.083,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.56100000000000005}]},{"osd":8,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.92800000000000005,"15min":0.96899999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.93799999999999994,"15min":0.98799999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.0509999999999999,"5min":1.272,"15min":1.272},"last":0.60199999999999998}]},{"osd":10,"last update":"Fri Aug 11 12:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.92200000000000004,"15min":0.96299999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.629},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.89700000000000002,"15min":0.91300000000000003},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.107,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.94799999999999995}]},{"osd":11,"last update":"Fri Aug 11 12:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.88500000000000001,"15min":0.89200000000000002},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2010000000000001,"5min":1.869,"15min":1.869},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.85399999999999998,"15min":0.85599999999999998},"min":{"1min":0.69999999999999996,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.006,"5min":1.095,"15min":1.095},"last":0.73199999999999998}]}]},{"osd":8,"up_from":58,"seq":249108103222,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":484648,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.71799999999999997,"15min":0.59399999999999997},"min":{"1min":0.38900000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72199999999999998,"5min":12.307,"15min":12.307},"last":0.501},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.57499999999999996,"15min":0.59199999999999997},"min":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.626,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.45200000000000001}]},{"osd":1,"last update":"Fri Aug 11 12:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.63700000000000001,"15min":0.60799999999999998},"min":{"1min":0.496,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63200000000000001,"15min":0.60999999999999999},"min":{"1min":0.52500000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.85099999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.57999999999999996}]},{"osd":2,"last update":"Fri Aug 11 12:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.46899999999999997,"15min":0.437},"min":{"1min":0.35299999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.61699999999999999,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.48599999999999999,"15min":0.45100000000000001},"min":{"1min":0.376,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71399999999999997,"5min":0.878,"15min":0.878},"last":0.62}]},{"osd":3,"last update":"Fri Aug 11 12:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68300000000000005,"15min":0.65400000000000003},"min":{"1min":0.51700000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77600000000000002,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.70099999999999996,"15min":0.63700000000000001},"min":{"1min":0.50600000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0700000000000001,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":0.73299999999999998}]},{"osd":4,"last update":"Fri Aug 11 12:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.66900000000000004,"15min":0.629},"min":{"1min":0.499,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88500000000000001,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.69699999999999995,"15min":0.66300000000000003},"min":{"1min":0.56799999999999995,"5min":0.432,"15min":0.432},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.63800000000000001}]},{"osd":5,"last update":"Fri Aug 11 12:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.59999999999999998,"15min":0.54800000000000004},"min":{"1min":0.38,"5min":0.309,"15min":0.309},"max":{"1min":0.85599999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.63200000000000001,"15min":0.58099999999999996},"min":{"1min":0.42099999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.88100000000000001,"5min":1.177,"15min":1.177},"last":0.76000000000000001}]},{"osd":6,"last update":"Fri Aug 11 12:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.77200000000000002,"15min":0.70999999999999996},"min":{"1min":0.628,"5min":0.441,"15min":0.441},"max":{"1min":1.157,"5min":3.1709999999999998,"15min":3.1709999999999998},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.79700000000000004,"15min":0.73899999999999999},"min":{"1min":0.48699999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97399999999999998,"5min":4.1180000000000003,"15min":4.1180000000000003},"last":0.85599999999999998}]},{"osd":7,"last update":"Fri Aug 11 12:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.75900000000000001,"15min":0.70799999999999996},"min":{"1min":0.60599999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0069999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.76800000000000002,"15min":0.72799999999999998},"min":{"1min":0.66600000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0189999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.81100000000000005}]},{"osd":9,"last update":"Fri Aug 11 12:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.79900000000000004,"15min":0.77300000000000002},"min":{"1min":0.71499999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1,"5min":1.375,"15min":1.375},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81200000000000006,"15min":0.79200000000000004},"min":{"1min":0.67400000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0620000000000001,"5min":1.252,"15min":1.252},"last":0.89900000000000002}]},{"osd":10,"last update":"Fri Aug 11 12:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.80200000000000005,"15min":0.77100000000000002},"min":{"1min":0.64000000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.048,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.82299999999999995,"15min":0.79100000000000004},"min":{"1min":0.65700000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.262,"5min":1.304,"15min":1.304},"last":0.91400000000000003}]},{"osd":11,"last update":"Fri Aug 11 12:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.85299999999999998,"15min":0.85499999999999998},"min":{"1min":0.68600000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":0.94399999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.69799999999999995,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.236,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.88}]}]},{"osd":7,"up_from":51,"seq":219043332153,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1040384,"data_stored":1076643,"data_compressed":53533,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.61399999999999999,"15min":0.60599999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.55200000000000005,"15min":0.53700000000000003},"min":{"1min":0.46999999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.65700000000000003}]},{"osd":1,"last update":"Fri Aug 11 12:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.439,"15min":0.40999999999999998},"min":{"1min":0.34699999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.60799999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.502,"5min":0.48099999999999998,"15min":0.45200000000000001},"min":{"1min":0.35099999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68100000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53300000000000003}]},{"osd":2,"last update":"Fri Aug 11 12:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.623,"15min":0.60899999999999999},"min":{"1min":0.48299999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77900000000000003,"5min":0.879,"15min":0.879},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.63200000000000001,"15min":0.59399999999999997},"min":{"1min":0.52000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78300000000000003,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.70899999999999996}]},{"osd":3,"last update":"Fri Aug 11 12:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65100000000000002,"15min":0.61899999999999999},"min":{"1min":0.441,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0549999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73099999999999998,"15min":0.65700000000000003},"min":{"1min":0.46500000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.139,"5min":5.8419999999999996,"15min":5.8419999999999996},"last":0.67300000000000004}]},{"osd":4,"last update":"Fri Aug 11 12:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56899999999999995,"15min":0.54400000000000004},"min":{"1min":0.36599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.85599999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.34699999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82799999999999996,"5min":1.105,"15min":1.105},"last":0.73799999999999999}]},{"osd":5,"last update":"Fri Aug 11 12:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.68400000000000005,"15min":0.66300000000000003},"min":{"1min":0.48399999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.70499999999999996,"15min":0.67000000000000004},"min":{"1min":0.57999999999999996,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.004,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.80300000000000005}]},{"osd":6,"last update":"Fri Aug 11 12:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.81200000000000006,"15min":0.74299999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0980000000000001,"5min":5.7199999999999998,"15min":5.7199999999999998},"last":0.872},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.749,"15min":0.70099999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.111,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.81299999999999994}]},{"osd":8,"last update":"Fri Aug 11 12:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76000000000000001,"15min":0.70299999999999996},"min":{"1min":0.56299999999999994,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.97299999999999998,"5min":1.206,"15min":1.206},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.751,"15min":0.69899999999999995},"min":{"1min":0.623,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.90300000000000002}]},{"osd":9,"last update":"Fri Aug 11 12:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.85299999999999998,"15min":0.84799999999999998},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.083,"5min":0.88600000000000001,"15min":0.85999999999999999},"min":{"1min":0.59999999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":4.8570000000000002,"5min":4.8570000000000002,"15min":4.8570000000000002},"last":0.82799999999999996}]},{"osd":10,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.81799999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0249999999999999,"5min":1.139,"15min":1.139},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.79000000000000004,"15min":0.76800000000000002},"min":{"1min":0.48899999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.92400000000000004}]},{"osd":11,"last update":"Fri Aug 11 12:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89400000000000002,"15min":0.89500000000000002},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.90500000000000003,"15min":0.90100000000000002},"min":{"1min":0.68500000000000005,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.85899999999999999}]}]},{"osd":6,"up_from":46,"seq":197568495679,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":483870,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.50600000000000001,"15min":0.47299999999999998},"min":{"1min":0.39700000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.52900000000000003,"15min":0.51200000000000001},"min":{"1min":0.41799999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.53100000000000003}]},{"osd":1,"last update":"Fri Aug 11 12:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.67200000000000004,"15min":0.63600000000000001},"min":{"1min":0.503,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.202,"5min":1.327,"15min":1.327},"last":0.505},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.71499999999999997,"15min":0.68300000000000005},"min":{"1min":0.60199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90100000000000002,"5min":1.206,"15min":1.206},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Aug 11 12:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.69899999999999995,"15min":0.69099999999999995},"min":{"1min":0.56399999999999995,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.099,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.72899999999999998,"15min":0.70099999999999996},"min":{"1min":0.51300000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.94299999999999995}]},{"osd":3,"last update":"Fri Aug 11 12:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.61899999999999999,"15min":0.57899999999999996},"min":{"1min":0.443,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.752},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.70699999999999996,"15min":0.67300000000000004},"min":{"1min":0.53000000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.60599999999999998}]},{"osd":4,"last update":"Fri Aug 11 12:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.71599999999999997,"15min":0.70199999999999996},"min":{"1min":0.495,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.77000000000000002,"15min":0.747},"min":{"1min":0.57399999999999995,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.69499999999999995}]},{"osd":5,"last update":"Fri Aug 11 12:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.81399999999999995,"15min":0.78000000000000003},"min":{"1min":0.69099999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.82099999999999995,"15min":0.81000000000000005},"min":{"1min":0.65500000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.68300000000000005}]},{"osd":7,"last update":"Fri Aug 11 12:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.84599999999999997,"15min":0.81399999999999995},"min":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.83499999999999996,"15min":0.81799999999999995},"min":{"1min":0.59899999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.63200000000000001}]},{"osd":8,"last update":"Fri Aug 11 12:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.85499999999999998,"15min":0.84499999999999997},"min":{"1min":0.623,"5min":0.498,"15min":0.498},"max":{"1min":1.216,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.90300000000000002,"15min":0.89300000000000002},"min":{"1min":0.74299999999999999,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1599999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.95699999999999996}]},{"osd":9,"last update":"Fri Aug 11 12:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.90400000000000003,"15min":0.91000000000000003},"min":{"1min":0.55000000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.04,"5min":0.94199999999999995,"15min":0.92900000000000005},"min":{"1min":0.82699999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.873}]},{"osd":10,"last update":"Fri Aug 11 12:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.90400000000000003,"15min":0.89800000000000002},"min":{"1min":0.76900000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2110000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.745},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.94799999999999995,"15min":0.94499999999999995},"min":{"1min":0.746,"5min":0.62,"15min":0.62},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.98699999999999999}]},{"osd":11,"last update":"Fri Aug 11 12:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.96599999999999997,"15min":0.96199999999999997},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.2869999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.016,"5min":1.0269999999999999,"15min":1.0289999999999999},"min":{"1min":0.88300000000000001,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.2290000000000001,"5min":1.611,"15min":1.611},"last":1.0089999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":488742,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56100000000000005,"15min":0.52100000000000002},"min":{"1min":0.40000000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.38200000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.01,"5min":1.01,"15min":1.4430000000000001},"last":0.45700000000000002}]},{"osd":2,"last update":"Fri Aug 11 12:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.621,"15min":0.55300000000000005},"min":{"1min":0.41799999999999998,"5min":0.315,"15min":0.315},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.59799999999999998,"15min":0.53100000000000003},"min":{"1min":0.44800000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.93200000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Aug 11 12:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63700000000000001,"15min":0.61899999999999999},"min":{"1min":0.52200000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86699999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.68899999999999995,"15min":0.64300000000000002},"min":{"1min":0.64200000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0289999999999999,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.73099999999999998}]},{"osd":4,"last update":"Fri Aug 11 12:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.51800000000000002,"15min":0.46400000000000002},"min":{"1min":0.36499999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.88700000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.51200000000000001,"15min":0.48399999999999999},"min":{"1min":0.33200000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.748,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.51400000000000001}]},{"osd":5,"last update":"Fri Aug 11 12:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.72799999999999998,"15min":0.64100000000000001},"min":{"1min":0.52200000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.875},{"interface":"front","average":{"1min":0.748,"5min":0.67000000000000004,"15min":0.622},"min":{"1min":0.46999999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.78200000000000003}]},{"osd":6,"last update":"Fri Aug 11 12:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73899999999999999,"15min":0.73799999999999999},"min":{"1min":0.45000000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.81999999999999995,"15min":0.79600000000000004},"min":{"1min":0.69799999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.98299999999999998}]},{"osd":7,"last update":"Fri Aug 11 12:23:53 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.72199999999999998,"15min":0.68999999999999995},"min":{"1min":0.39000000000000001,"5min":0.31,"15min":0.31},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.75,"5min":0.71199999999999997,"15min":0.68899999999999995},"min":{"1min":0.52100000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.016,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.80600000000000005}]},{"osd":8,"last update":"Fri Aug 11 12:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.79500000000000004,"15min":0.745},"min":{"1min":0.53500000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.089,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.83599999999999997,"15min":0.76200000000000001},"min":{"1min":0.66300000000000003,"5min":0.436,"15min":0.436},"max":{"1min":1.1339999999999999,"5min":1.294,"15min":1.294},"last":1.0680000000000001}]},{"osd":9,"last update":"Fri Aug 11 12:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.76700000000000002,"15min":0.755},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.98399999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.83899999999999997,"15min":0.81699999999999995},"min":{"1min":0.73899999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.141,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.85199999999999998}]},{"osd":10,"last update":"Fri Aug 11 12:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.85699999999999998,"15min":0.81100000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1339999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":1.026},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.79800000000000004,"15min":0.78000000000000003},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.90800000000000003}]},{"osd":11,"last update":"Fri Aug 11 12:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.0389999999999999,"15min":1.0469999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.173,"5min":1.329,"15min":1.329},"last":1.109},{"interface":"front","average":{"1min":0.878,"5min":0.94199999999999995,"15min":0.95199999999999996},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.056,"5min":1.131,"15min":1.131},"last":0.95799999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":485326,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.64800000000000002,"15min":0.55200000000000005},"min":{"1min":0.36599999999999999,"5min":0.314,"15min":0.314},"max":{"1min":1.3859999999999999,"5min":1.782,"15min":1.782},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.65900000000000003,"15min":0.56200000000000006},"min":{"1min":0.45900000000000002,"5min":0.36599999999999999,"15min":0.36499999999999999},"max":{"1min":1.1419999999999999,"5min":2.7749999999999999,"15min":2.7749999999999999},"last":0.748}]},{"osd":2,"last update":"Fri Aug 11 12:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.65600000000000003,"15min":0.57399999999999995},"min":{"1min":0.42099999999999999,"5min":0.40799999999999997,"15min":0.36199999999999999},"max":{"1min":0.875,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.71299999999999997,"15min":0.60499999999999998},"min":{"1min":0.48399999999999999,"5min":0.39100000000000001,"15min":0.33000000000000002},"max":{"1min":1.456,"5min":1.879,"15min":1.879},"last":1.004}]},{"osd":3,"last update":"Fri Aug 11 12:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.56899999999999995,"15min":0.55200000000000005},"min":{"1min":0.47099999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.39300000000000002}]},{"osd":4,"last update":"Fri Aug 11 12:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.71599999999999997,"15min":0.63},"min":{"1min":0.39300000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.639,"5min":1.849,"15min":1.849},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.73599999999999999,"15min":0.65000000000000002},"min":{"1min":0.52800000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1950000000000001,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Aug 11 12:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.77400000000000002,"15min":0.70799999999999996},"min":{"1min":0.56999999999999995,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0369999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77100000000000002,"15min":0.72699999999999998},"min":{"1min":0.61699999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.026,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.78900000000000003}]},{"osd":6,"last update":"Fri Aug 11 12:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.75700000000000001,"15min":0.76100000000000001},"min":{"1min":0.47199999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.411,"5min":2.8839999999999999,"15min":2.8839999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.70799999999999996,"15min":0.71499999999999997},"min":{"1min":0.39100000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.083,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.83299999999999996}]},{"osd":7,"last update":"Fri Aug 11 12:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84799999999999998,"15min":0.84899999999999998},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.0649999999999999,"5min":1.262,"15min":1.262},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.80700000000000005,"15min":0.80600000000000005},"min":{"1min":0.629,"5min":0.44,"15min":0.44},"max":{"1min":1.012,"5min":1.429,"15min":1.429},"last":0.76900000000000002}]},{"osd":8,"last update":"Fri Aug 11 12:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.82599999999999996,"15min":0.84299999999999997},"min":{"1min":0.69799999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.109,"5min":1.262,"15min":1.262},"last":1.109},{"interface":"front","average":{"1min":1.2949999999999999,"5min":0.97499999999999998,"15min":0.95499999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":6.4260000000000002,"5min":6.4260000000000002,"15min":6.4260000000000002},"last":1.075}]},{"osd":9,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.84699999999999998,"15min":0.86599999999999999},"min":{"1min":0.53900000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.099,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.3140000000000001},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.93100000000000005,"15min":0.95599999999999996},"min":{"1min":0.59999999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.3260000000000001}]},{"osd":10,"last update":"Fri Aug 11 12:23:59 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.95799999999999996,"15min":0.95199999999999996},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.161},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.90400000000000003,"15min":0.90000000000000002},"min":{"1min":0.67800000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.296,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.90700000000000003}]},{"osd":11,"last update":"Fri Aug 11 12:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.876,"15min":0.876},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1399999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":1.264},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.94999999999999996,"15min":0.94499999999999995},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.288}]}]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":488551,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.64000000000000001,"15min":0.55400000000000005},"min":{"1min":0.36599999999999999,"5min":0.316,"15min":0.316},"max":{"1min":1.1180000000000001,"5min":5.968,"15min":5.968},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.372,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83299999999999996,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.46600000000000003}]},{"osd":1,"last update":"Fri Aug 11 12:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59799999999999998,"15min":0.52700000000000002},"min":{"1min":0.41099999999999998,"5min":0.376,"15min":0.36399999999999999},"max":{"1min":0.83399999999999996,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.54400000000000004},"min":{"1min":0.41099999999999998,"5min":0.373,"15min":0.34399999999999997},"max":{"1min":0.84999999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.68799999999999994}]},{"osd":3,"last update":"Fri Aug 11 12:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.63200000000000001,"15min":0.60299999999999998},"min":{"1min":0.45500000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88900000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.64800000000000002,"15min":0.60699999999999998},"min":{"1min":0.47999999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86199999999999999,"5min":1.306,"15min":1.306},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri Aug 11 12:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.68400000000000005},"min":{"1min":0.48699999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.876,"5min":1.179,"15min":1.179},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Aug 11 12:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.499,"15min":0.44700000000000001},"min":{"1min":0.36899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78100000000000003,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.50600000000000001,"15min":0.46100000000000002},"min":{"1min":0.34899999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84699999999999998,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.57899999999999996}]},{"osd":6,"last update":"Fri Aug 11 12:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65700000000000003,"15min":0.629},"min":{"1min":0.45300000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89400000000000002,"5min":1.429,"15min":1.429},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.68999999999999995,"15min":0.63600000000000001},"min":{"1min":0.55400000000000005,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.94499999999999995,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.629}]},{"osd":7,"last update":"Fri Aug 11 12:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.73899999999999999,"15min":0.73399999999999999},"min":{"1min":0.59699999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.79400000000000004,"15min":0.79300000000000004},"min":{"1min":0.64100000000000001,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.75900000000000001}]},{"osd":8,"last update":"Fri Aug 11 12:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.65500000000000003,"15min":0.60699999999999998},"min":{"1min":0.432,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.94999999999999996,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.495},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.625,"15min":0.57699999999999996},"min":{"1min":0.501,"5min":0.439,"15min":0.439},"max":{"1min":0.89900000000000002,"5min":1.325,"15min":1.325},"last":0.66400000000000003}]},{"osd":9,"last update":"Fri Aug 11 12:23:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.76000000000000001,"15min":0.73699999999999999},"min":{"1min":0.61099999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2809999999999999,"5min":1.387,"15min":1.387},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.879,"5min":0.81899999999999995,"15min":0.80600000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.81200000000000006}]},{"osd":10,"last update":"Fri Aug 11 12:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.80300000000000005,"15min":0.78700000000000003},"min":{"1min":0.70999999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.036,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.84799999999999998,"15min":0.83199999999999996},"min":{"1min":0.73699999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0920000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.88200000000000001}]},{"osd":11,"last update":"Fri Aug 11 12:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.78300000000000003,"15min":0.77600000000000002},"min":{"1min":0.59199999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.80700000000000005,"15min":0.80300000000000005},"min":{"1min":0.67700000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.012,"5min":1.409,"15min":1.409},"last":0.94999999999999996}]}]},{"osd":3,"up_from":25,"seq":107374182476,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":483578,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.48099999999999998,"15min":0.40200000000000002},"min":{"1min":0.42299999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.50700000000000001,"15min":0.45000000000000001},"min":{"1min":0.39600000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.42099999999999999}]},{"osd":1,"last update":"Fri Aug 11 12:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.68999999999999995,"15min":0.58999999999999997},"min":{"1min":0.433,"5min":0.372,"15min":0.372},"max":{"1min":1.0209999999999999,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.65400000000000003,"15min":0.59999999999999998},"min":{"1min":0.51700000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.84799999999999998,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.78500000000000003}]},{"osd":2,"last update":"Fri Aug 11 12:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.70499999999999996,"15min":0.63700000000000001},"min":{"1min":0.55300000000000005,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":3.0289999999999999,"5min":3.0289999999999999,"15min":3.0289999999999999},"last":0.755},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.749,"15min":0.64700000000000002},"min":{"1min":0.71999999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.82599999999999996}]},{"osd":4,"last update":"Fri Aug 11 12:23:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.68600000000000005,"15min":0.624},"min":{"1min":0.53500000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0429999999999999,"5min":1.242,"15min":1.242},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.76200000000000001,"15min":0.66200000000000003},"min":{"1min":0.56200000000000006,"5min":0.435,"15min":0.435},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Aug 11 12:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.72899999999999998,"15min":0.66500000000000004},"min":{"1min":0.57299999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.747,"15min":0.68100000000000005},"min":{"1min":0.48899999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.71399999999999997}]},{"osd":6,"last update":"Fri Aug 11 12:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.81000000000000005,"15min":0.77200000000000002},"min":{"1min":0.59999999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.874},{"interface":"front","average":{"1min":0.88,"5min":0.75800000000000001,"15min":0.72499999999999998},"min":{"1min":0.56200000000000006,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Aug 11 12:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79800000000000004,"15min":0.76900000000000002},"min":{"1min":0.53600000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.89900000000000002,"15min":0.88500000000000001},"min":{"1min":0.64900000000000002,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.321,"5min":1.361,"15min":1.361},"last":0.73199999999999998}]},{"osd":8,"last update":"Fri Aug 11 12:23:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":3.052,"5min":3.052,"15min":3.052},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.83999999999999997}]},{"osd":9,"last update":"Fri Aug 11 12:23:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":0.98199999999999998,"15min":0.996},"min":{"1min":0.83799999999999997,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.298,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.91900000000000004,"15min":0.94099999999999995},"min":{"1min":0.628,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.91200000000000003}]},{"osd":10,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.95599999999999996,"15min":0.98799999999999999},"min":{"1min":0.68600000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2809999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.94499999999999995,"15min":0.97199999999999998},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":0.80900000000000005}]},{"osd":11,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.98699999999999999,"15min":0.98599999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.3320000000000001,"5min":1.341,"15min":1.341},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.127,"5min":1.028,"15min":1.012},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":3.0990000000000002,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":0.92700000000000005}]}]},{"osd":4,"up_from":33,"seq":141733920840,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":483848,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.39900000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.81599999999999995,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.41399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80900000000000005,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.72099999999999997}]},{"osd":1,"last update":"Fri Aug 11 12:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.44400000000000001,"15min":0.40899999999999997},"min":{"1min":0.30199999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.68000000000000005,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.312},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.45200000000000001,"15min":0.39400000000000002},"min":{"1min":0.34599999999999997,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.82899999999999996,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.33900000000000002}]},{"osd":2,"last update":"Fri Aug 11 12:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.66900000000000004,"15min":0.59699999999999998},"min":{"1min":0.52500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64600000000000002,"15min":0.57899999999999996},"min":{"1min":0.42899999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.98499999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.72099999999999997}]},{"osd":3,"last update":"Fri Aug 11 12:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.64700000000000002,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.379,"15min":0.379},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.628},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58299999999999996,"15min":0.56299999999999994},"min":{"1min":0.42999999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.95099999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.53100000000000003}]},{"osd":5,"last update":"Fri Aug 11 12:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.66300000000000003,"15min":0.58899999999999997},"min":{"1min":0.51600000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.70699999999999996,"15min":0.60899999999999999},"min":{"1min":0.57199999999999995,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0229999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Fri Aug 11 12:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.73399999999999999,"15min":0.70199999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.65500000000000003,"15min":0.625},"min":{"1min":0.48799999999999999,"5min":0.433,"15min":0.433},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.5}]},{"osd":7,"last update":"Fri Aug 11 12:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.64400000000000002,"15min":0.58999999999999997},"min":{"1min":0.38100000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.99299999999999999,"5min":1.125,"15min":1.125},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70899999999999996,"15min":0.65000000000000002},"min":{"1min":0.42299999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0449999999999999,"5min":1.151,"15min":1.151},"last":0.39500000000000002}]},{"osd":8,"last update":"Fri Aug 11 12:24:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67600000000000005,"15min":0.64400000000000002},"min":{"1min":0.46000000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.98399999999999999,"5min":1.016,"15min":1.016},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.87,"5min":0.82699999999999996,"15min":0.77100000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.85399999999999998}]},{"osd":9,"last update":"Fri Aug 11 12:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.88,"15min":0.84999999999999998},"min":{"1min":0.66700000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.75},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.85199999999999998,"15min":0.83399999999999996},"min":{"1min":0.67300000000000004,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.76600000000000001}]},{"osd":10,"last update":"Fri Aug 11 12:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83599999999999997,"15min":0.83999999999999997},"min":{"1min":0.57599999999999996,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.74199999999999999,"15min":0.748},"min":{"1min":0.53100000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.032,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.44600000000000001}]},{"osd":11,"last update":"Fri Aug 11 12:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.85499999999999998,"15min":0.86199999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.0800000000000001,"5min":1.165,"15min":1.165},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.873,"15min":0.875},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.123,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.79200000000000004}]}]},{"osd":5,"up_from":38,"seq":163208757315,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":1076594,"data_compressed":53533,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:24:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53400000000000003,"15min":0.52300000000000002},"min":{"1min":0.374,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77200000000000002,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.374},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.54100000000000004},"min":{"1min":0.40699999999999997,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0980000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Aug 11 12:24:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.58299999999999996,"15min":0.55300000000000005},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.626,"15min":0.57699999999999996},"min":{"1min":0.51300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.93600000000000005,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.57299999999999995}]},{"osd":2,"last update":"Fri Aug 11 12:24:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.42999999999999999,"15min":0.40600000000000003},"min":{"1min":0.30099999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.433},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.46200000000000002,"15min":0.41399999999999998},"min":{"1min":0.28399999999999997,"5min":0.248,"15min":0.248},"max":{"1min":0.71799999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.50800000000000001}]},{"osd":3,"last update":"Fri Aug 11 12:24:15 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.39800000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.88400000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.60299999999999998,"15min":0.59399999999999997},"min":{"1min":0.46700000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.78200000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.67900000000000005}]},{"osd":4,"last update":"Fri Aug 11 12:24:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.66500000000000004,"15min":0.60999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.63500000000000001,"15min":0.61099999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.85499999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.59399999999999997}]},{"osd":6,"last update":"Fri Aug 11 12:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.66600000000000004,"15min":0.626},"min":{"1min":0.45600000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":3.0659999999999998,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.878,"5min":0.73899999999999999,"15min":0.68700000000000006},"min":{"1min":0.51800000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":3.081,"5min":3.081,"15min":3.081},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Aug 11 12:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.71699999999999997,"15min":0.68400000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97899999999999998,"5min":1.048,"15min":1.048},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.69799999999999995,"15min":0.67300000000000004},"min":{"1min":0.48499999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.72199999999999998}]},{"osd":8,"last update":"Fri Aug 11 12:24:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.65400000000000003,"15min":0.60999999999999999},"min":{"1min":0.36699999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93200000000000005,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.60299999999999998,"15min":0.57099999999999995},"min":{"1min":0.42399999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.66400000000000003}]},{"osd":9,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.74199999999999999,"15min":0.73499999999999999},"min":{"1min":0.504,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.83699999999999997,"15min":0.81299999999999994},"min":{"1min":0.629,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.984,"5min":2.984,"15min":2.984},"last":0.77000000000000002}]},{"osd":10,"last update":"Fri Aug 11 12:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.82999999999999996,"15min":0.82099999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77000000000000002,"15min":0.76200000000000001},"min":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.75700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34304,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34304,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":6072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":5578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-11T12:24:21.232 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-11T12:24:21.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.464+0000 7f89b71ff700 1 -- 172.21.15.8:0/2003508810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89b0101bd0 msgr2=0x7f89b0102030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:21.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.464+0000 7f89b71ff700 1 --2- 172.21.15.8:0/2003508810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89b0101bd0 0x7f89b0102030 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f899c0098f0 tx=0x7f899c009c00 comp rx=0 tx=0).stop 2023-08-11T12:24:21.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.464+0000 7f89b71ff700 1 -- 172.21.15.8:0/2003508810 shutdown_connections 2023-08-11T12:24:21.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.464+0000 7f89b71ff700 1 --2- 172.21.15.8:0/2003508810 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89b0102570 0x7f89b0108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:21.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.464+0000 7f89b71ff700 1 --2- 172.21.15.8:0/2003508810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89b01009e0 0x7f89b0100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:21.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.464+0000 7f89b71ff700 1 --2- 172.21.15.8:0/2003508810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89b0101bd0 0x7f89b0102030 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:21.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.464+0000 7f89b71ff700 1 -- 172.21.15.8:0/2003508810 >> 172.21.15.8:0/2003508810 conn(0x7f89b00fbf50 msgr2=0x7f89b00fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:21.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.464+0000 7f89b71ff700 1 -- 172.21.15.8:0/2003508810 shutdown_connections 2023-08-11T12:24:21.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.464+0000 7f89b71ff700 1 -- 172.21.15.8:0/2003508810 wait complete. 2023-08-11T12:24:21.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.465+0000 7f89b71ff700 1 Processor -- start 2023-08-11T12:24:21.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.466+0000 7f89b71ff700 1 -- start start 2023-08-11T12:24:21.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.466+0000 7f89b71ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89b01009e0 0x7f89b01967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:21.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.466+0000 7f89b71ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89b0101bd0 0x7f89b0196ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:21.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.466+0000 7f89b71ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89b0102570 0x7f89b019dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:21.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.466+0000 7f89b71ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b019e320 con 0x7f89b01009e0 2023-08-11T12:24:21.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.466+0000 7f89b71ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b019e460 con 0x7f89b0101bd0 2023-08-11T12:24:21.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.466+0000 7f89b71ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b019e5f0 con 0x7f89b0102570 2023-08-11T12:24:21.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.466+0000 7f89b4f9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89b01009e0 0x7f89b01967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:21.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.466+0000 7f89b4f9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89b01009e0 0x7f89b01967a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46756/0 (socket says 172.21.15.8:46756) 2023-08-11T12:24:21.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.466+0000 7f89b4f9b700 1 -- 172.21.15.8:0/3412306564 learned_addr learned my addr 172.21.15.8:0/3412306564 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:21.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.466+0000 7f89affff700 1 --2- 172.21.15.8:0/3412306564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89b0101bd0 0x7f89b0196ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:21.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.466+0000 7f89b579c700 1 --2- 172.21.15.8:0/3412306564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89b0102570 0x7f89b019dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:21.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.467+0000 7f89b4f9b700 1 -- 172.21.15.8:0/3412306564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89b0102570 msgr2=0x7f89b019dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:21.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.467+0000 7f89b4f9b700 1 --2- 172.21.15.8:0/3412306564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89b0102570 0x7f89b019dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:21.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.467+0000 7f89b4f9b700 1 -- 172.21.15.8:0/3412306564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89b0101bd0 msgr2=0x7f89b0196ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:21.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.467+0000 7f89b4f9b700 1 --2- 172.21.15.8:0/3412306564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89b0101bd0 0x7f89b0196ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:21.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.467+0000 7f89b4f9b700 1 -- 172.21.15.8:0/3412306564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a8009c40 con 0x7f89b01009e0 2023-08-11T12:24:21.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.467+0000 7f89b4f9b700 1 --2- 172.21.15.8:0/3412306564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89b01009e0 0x7f89b01967a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f89a400e9f0 tx=0x7f89a400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:21.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.467+0000 7f89adffb700 1 -- 172.21.15.8:0/3412306564 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a4004220 con 0x7f89b01009e0 2023-08-11T12:24:21.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.467+0000 7f89b71ff700 1 -- 172.21.15.8:0/3412306564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f899c009520 con 0x7f89b01009e0 2023-08-11T12:24:21.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.467+0000 7f89adffb700 1 -- 172.21.15.8:0/3412306564 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f89a4004380 con 0x7f89b01009e0 2023-08-11T12:24:21.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.467+0000 7f89adffb700 1 -- 172.21.15.8:0/3412306564 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a4003b40 con 0x7f89b01009e0 2023-08-11T12:24:21.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.467+0000 7f89b71ff700 1 -- 172.21.15.8:0/3412306564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b0072f30 con 0x7f89b01009e0 2023-08-11T12:24:21.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.468+0000 7f89b71ff700 1 -- 172.21.15.8:0/3412306564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b0108070 con 0x7f89b01009e0 2023-08-11T12:24:21.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.470+0000 7f89adffb700 1 -- 172.21.15.8:0/3412306564 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f89a400c7c0 con 0x7f89b01009e0 2023-08-11T12:24:21.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.472+0000 7f89adffb700 1 --2- 172.21.15.8:0/3412306564 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89a009ff50 0x7f89a00a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:21.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.472+0000 7f89adffb700 1 -- 172.21.15.8:0/3412306564 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f89a4014070 con 0x7f89b01009e0 2023-08-11T12:24:21.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.472+0000 7f89affff700 1 --2- 172.21.15.8:0/3412306564 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89a009ff50 0x7f89a00a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:21.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.472+0000 7f89affff700 1 --2- 172.21.15.8:0/3412306564 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89a009ff50 0x7f89a00a2410 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f899c005e90 tx=0x7f899c019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:21.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.475+0000 7f89adffb700 1 -- 172.21.15.8:0/3412306564 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f89a4095280 con 0x7f89b01009e0 2023-08-11T12:24:21.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.681+0000 7f89b71ff700 1 -- 172.21.15.8:0/3412306564 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89b002cce0 con 0x7f89a009ff50 2023-08-11T12:24:21.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.694+0000 7f89adffb700 1 -- 172.21.15.8:0/3412306564 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426663 (secure 0 0 0) 0x7f89b002cce0 con 0x7f89a009ff50 2023-08-11T12:24:21.700 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:21.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.699+0000 7f89b71ff700 1 -- 172.21.15.8:0/3412306564 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89a009ff50 msgr2=0x7f89a00a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:21.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.699+0000 7f89b71ff700 1 --2- 172.21.15.8:0/3412306564 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89a009ff50 0x7f89a00a2410 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f899c005e90 tx=0x7f899c019040 comp rx=0 tx=0).stop 2023-08-11T12:24:21.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.699+0000 7f89b71ff700 1 -- 172.21.15.8:0/3412306564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89b01009e0 msgr2=0x7f89b01967a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:21.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.699+0000 7f89b71ff700 1 --2- 172.21.15.8:0/3412306564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89b01009e0 0x7f89b01967a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f89a400e9f0 tx=0x7f89a400ed00 comp rx=0 tx=0).stop 2023-08-11T12:24:21.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.699+0000 7f89b71ff700 1 -- 172.21.15.8:0/3412306564 shutdown_connections 2023-08-11T12:24:21.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.699+0000 7f89b71ff700 1 --2- 172.21.15.8:0/3412306564 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f89a009ff50 0x7f89a00a2410 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:21.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.699+0000 7f89b71ff700 1 --2- 172.21.15.8:0/3412306564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89b0102570 0x7f89b019dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:21.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.699+0000 7f89b71ff700 1 --2- 172.21.15.8:0/3412306564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89b01009e0 0x7f89b01967a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:21.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.699+0000 7f89b71ff700 1 --2- 172.21.15.8:0/3412306564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89b0101bd0 0x7f89b0196ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:21.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.699+0000 7f89b71ff700 1 -- 172.21.15.8:0/3412306564 >> 172.21.15.8:0/3412306564 conn(0x7f89b00fbf50 msgr2=0x7f89b01051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:21.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.699+0000 7f89b71ff700 1 -- 172.21.15.8:0/3412306564 shutdown_connections 2023-08-11T12:24:21.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.699+0000 7f89b71ff700 1 -- 172.21.15.8:0/3412306564 wait complete. 2023-08-11T12:24:21.705 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-08-11T12:24:21.721 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":344,"stamp":"2023-08-11T12:24:20.542967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600890,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1249,"num_read_kb":695,"num_write":392,"num_write_kb":3007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":322,"ondisk_log_size":322,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336040,"kb_used_data":11796,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124605784,"statfs":{"total":1151940427776,"available":1151596322816,"internally_reserved":0,"allocated":12079104,"data_stored":7599223,"data_compressed":318882,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":258,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":71,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003088"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720975+0000","last_change":"2023-08-11T12:22:03.850538+0000","last_active":"2023-08-11T12:22:31.720975+0000","last_peered":"2023-08-11T12:22:31.720975+0000","last_clean":"2023-08-11T12:22:31.720975+0000","last_became_active":"2023-08-11T12:22:03.850220+0000","last_became_peered":"2023-08-11T12:22:03.850220+0000","last_unstale":"2023-08-11T12:22:31.720975+0000","last_undegraded":"2023-08-11T12:22:31.720975+0000","last_fullsized":"2023-08-11T12:22:31.720975+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:10:46.194341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720154+0000","last_change":"2023-08-11T12:22:03.843779+0000","last_active":"2023-08-11T12:22:31.720154+0000","last_peered":"2023-08-11T12:22:31.720154+0000","last_clean":"2023-08-11T12:22:31.720154+0000","last_became_active":"2023-08-11T12:22:03.843441+0000","last_became_peered":"2023-08-11T12:22:03.843441+0000","last_unstale":"2023-08-11T12:22:31.720154+0000","last_undegraded":"2023-08-11T12:22:31.720154+0000","last_fullsized":"2023-08-11T12:22:31.720154+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:51:42.363862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719149+0000","last_change":"2023-08-11T12:22:03.851996+0000","last_active":"2023-08-11T12:22:31.719149+0000","last_peered":"2023-08-11T12:22:31.719149+0000","last_clean":"2023-08-11T12:22:31.719149+0000","last_became_active":"2023-08-11T12:22:03.850821+0000","last_became_peered":"2023-08-11T12:22:03.850821+0000","last_unstale":"2023-08-11T12:22:31.719149+0000","last_undegraded":"2023-08-11T12:22:31.719149+0000","last_fullsized":"2023-08-11T12:22:31.719149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:54:54.152911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722124+0000","last_change":"2023-08-11T12:22:03.842025+0000","last_active":"2023-08-11T12:22:31.722124+0000","last_peered":"2023-08-11T12:22:31.722124+0000","last_clean":"2023-08-11T12:22:31.722124+0000","last_became_active":"2023-08-11T12:22:03.841700+0000","last_became_peered":"2023-08-11T12:22:03.841700+0000","last_unstale":"2023-08-11T12:22:31.722124+0000","last_undegraded":"2023-08-11T12:22:31.722124+0000","last_fullsized":"2023-08-11T12:22:31.722124+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:13:45.519007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723174+0000","last_change":"2023-08-11T12:22:03.844908+0000","last_active":"2023-08-11T12:22:31.723174+0000","last_peered":"2023-08-11T12:22:31.723174+0000","last_clean":"2023-08-11T12:22:31.723174+0000","last_became_active":"2023-08-11T12:22:03.844674+0000","last_became_peered":"2023-08-11T12:22:03.844674+0000","last_unstale":"2023-08-11T12:22:31.723174+0000","last_undegraded":"2023-08-11T12:22:31.723174+0000","last_fullsized":"2023-08-11T12:22:31.723174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:10:22.657255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721437+0000","last_change":"2023-08-11T12:22:03.839915+0000","last_active":"2023-08-11T12:22:31.721437+0000","last_peered":"2023-08-11T12:22:31.721437+0000","last_clean":"2023-08-11T12:22:31.721437+0000","last_became_active":"2023-08-11T12:22:03.839099+0000","last_became_peered":"2023-08-11T12:22:03.839099+0000","last_unstale":"2023-08-11T12:22:31.721437+0000","last_undegraded":"2023-08-11T12:22:31.721437+0000","last_fullsized":"2023-08-11T12:22:31.721437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:51:17.642383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717754+0000","last_change":"2023-08-11T12:22:03.841591+0000","last_active":"2023-08-11T12:22:31.717754+0000","last_peered":"2023-08-11T12:22:31.717754+0000","last_clean":"2023-08-11T12:22:31.717754+0000","last_became_active":"2023-08-11T12:22:03.841232+0000","last_became_peered":"2023-08-11T12:22:03.841232+0000","last_unstale":"2023-08-11T12:22:31.717754+0000","last_undegraded":"2023-08-11T12:22:31.717754+0000","last_fullsized":"2023-08-11T12:22:31.717754+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:12:40.032896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720595+0000","last_change":"2023-08-11T12:22:03.839516+0000","last_active":"2023-08-11T12:22:31.720595+0000","last_peered":"2023-08-11T12:22:31.720595+0000","last_clean":"2023-08-11T12:22:31.720595+0000","last_became_active":"2023-08-11T12:22:03.839058+0000","last_became_peered":"2023-08-11T12:22:03.839058+0000","last_unstale":"2023-08-11T12:22:31.720595+0000","last_undegraded":"2023-08-11T12:22:31.720595+0000","last_fullsized":"2023-08-11T12:22:31.720595+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:01:10.744970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774871+0000","last_change":"2023-08-11T12:22:03.841033+0000","last_active":"2023-08-11T12:22:31.774871+0000","last_peered":"2023-08-11T12:22:31.774871+0000","last_clean":"2023-08-11T12:22:31.774871+0000","last_became_active":"2023-08-11T12:22:03.840665+0000","last_became_peered":"2023-08-11T12:22:03.840665+0000","last_unstale":"2023-08-11T12:22:31.774871+0000","last_undegraded":"2023-08-11T12:22:31.774871+0000","last_fullsized":"2023-08-11T12:22:31.774871+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:08:51.628782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721119+0000","last_change":"2023-08-11T12:22:03.839663+0000","last_active":"2023-08-11T12:22:31.721119+0000","last_peered":"2023-08-11T12:22:31.721119+0000","last_clean":"2023-08-11T12:22:31.721119+0000","last_became_active":"2023-08-11T12:22:03.838840+0000","last_became_peered":"2023-08-11T12:22:03.838840+0000","last_unstale":"2023-08-11T12:22:31.721119+0000","last_undegraded":"2023-08-11T12:22:31.721119+0000","last_fullsized":"2023-08-11T12:22:31.721119+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:28:57.495510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717811+0000","last_change":"2023-08-11T12:22:03.846288+0000","last_active":"2023-08-11T12:22:31.717811+0000","last_peered":"2023-08-11T12:22:31.717811+0000","last_clean":"2023-08-11T12:22:31.717811+0000","last_became_active":"2023-08-11T12:22:03.845962+0000","last_became_peered":"2023-08-11T12:22:03.845962+0000","last_unstale":"2023-08-11T12:22:31.717811+0000","last_undegraded":"2023-08-11T12:22:31.717811+0000","last_fullsized":"2023-08-11T12:22:31.717811+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:42:37.154687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.728022+0000","last_change":"2023-08-11T12:22:31.726774+0000","last_active":"2023-08-11T12:22:31.728022+0000","last_peered":"2023-08-11T12:22:31.728022+0000","last_clean":"2023-08-11T12:22:31.728022+0000","last_became_active":"2023-08-11T12:22:31.726437+0000","last_became_peered":"2023-08-11T12:22:31.726437+0000","last_unstale":"2023-08-11T12:22:31.728022+0000","last_undegraded":"2023-08-11T12:22:31.728022+0000","last_fullsized":"2023-08-11T12:22:31.728022+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:33:56.005318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717500+0000","last_change":"2023-08-11T12:22:03.842249+0000","last_active":"2023-08-11T12:22:31.717500+0000","last_peered":"2023-08-11T12:22:31.717500+0000","last_clean":"2023-08-11T12:22:31.717500+0000","last_became_active":"2023-08-11T12:22:03.841887+0000","last_became_peered":"2023-08-11T12:22:03.841887+0000","last_unstale":"2023-08-11T12:22:31.717500+0000","last_undegraded":"2023-08-11T12:22:31.717500+0000","last_fullsized":"2023-08-11T12:22:31.717500+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:24:16.685728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718746+0000","last_change":"2023-08-11T12:22:03.843859+0000","last_active":"2023-08-11T12:22:31.718746+0000","last_peered":"2023-08-11T12:22:31.718746+0000","last_clean":"2023-08-11T12:22:31.718746+0000","last_became_active":"2023-08-11T12:22:03.843383+0000","last_became_peered":"2023-08-11T12:22:03.843383+0000","last_unstale":"2023-08-11T12:22:31.718746+0000","last_undegraded":"2023-08-11T12:22:31.718746+0000","last_fullsized":"2023-08-11T12:22:31.718746+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:19:55.006972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.726241+0000","last_change":"2023-08-11T12:22:31.726241+0000","last_active":"2023-08-11T12:22:31.726241+0000","last_peered":"2023-08-11T12:22:31.726241+0000","last_clean":"2023-08-11T12:22:31.726241+0000","last_became_active":"2023-08-11T12:22:31.725852+0000","last_became_peered":"2023-08-11T12:22:31.725852+0000","last_unstale":"2023-08-11T12:22:31.726241+0000","last_undegraded":"2023-08-11T12:22:31.726241+0000","last_fullsized":"2023-08-11T12:22:31.726241+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:37:58.350171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774047+0000","last_change":"2023-08-11T12:22:03.850397+0000","last_active":"2023-08-11T12:22:31.774047+0000","last_peered":"2023-08-11T12:22:31.774047+0000","last_clean":"2023-08-11T12:22:31.774047+0000","last_became_active":"2023-08-11T12:22:03.850143+0000","last_became_peered":"2023-08-11T12:22:03.850143+0000","last_unstale":"2023-08-11T12:22:31.774047+0000","last_undegraded":"2023-08-11T12:22:31.774047+0000","last_fullsized":"2023-08-11T12:22:31.774047+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:13:22.558148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721002+0000","last_change":"2023-08-11T12:22:03.850496+0000","last_active":"2023-08-11T12:22:31.721002+0000","last_peered":"2023-08-11T12:22:31.721002+0000","last_clean":"2023-08-11T12:22:31.721002+0000","last_became_active":"2023-08-11T12:22:03.850192+0000","last_became_peered":"2023-08-11T12:22:03.850192+0000","last_unstale":"2023-08-11T12:22:31.721002+0000","last_undegraded":"2023-08-11T12:22:31.721002+0000","last_fullsized":"2023-08-11T12:22:31.721002+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:54:50.626326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722136+0000","last_change":"2023-08-11T12:22:03.841706+0000","last_active":"2023-08-11T12:22:31.722136+0000","last_peered":"2023-08-11T12:22:31.722136+0000","last_clean":"2023-08-11T12:22:31.722136+0000","last_became_active":"2023-08-11T12:22:03.841341+0000","last_became_peered":"2023-08-11T12:22:03.841341+0000","last_unstale":"2023-08-11T12:22:31.722136+0000","last_undegraded":"2023-08-11T12:22:31.722136+0000","last_fullsized":"2023-08-11T12:22:31.722136+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:36:20.093373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.724897+0000","last_change":"2023-08-11T12:22:03.834450+0000","last_active":"2023-08-11T12:22:31.724897+0000","last_peered":"2023-08-11T12:22:31.724897+0000","last_clean":"2023-08-11T12:22:31.724897+0000","last_became_active":"2023-08-11T12:22:03.834154+0000","last_became_peered":"2023-08-11T12:22:03.834154+0000","last_unstale":"2023-08-11T12:22:31.724897+0000","last_undegraded":"2023-08-11T12:22:31.724897+0000","last_fullsized":"2023-08-11T12:22:31.724897+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:08:49.920575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.727577+0000","last_change":"2023-08-11T12:22:31.727577+0000","last_active":"2023-08-11T12:22:31.727577+0000","last_peered":"2023-08-11T12:22:31.727577+0000","last_clean":"2023-08-11T12:22:31.727577+0000","last_became_active":"2023-08-11T12:22:31.727034+0000","last_became_peered":"2023-08-11T12:22:31.727034+0000","last_unstale":"2023-08-11T12:22:31.727577+0000","last_undegraded":"2023-08-11T12:22:31.727577+0000","last_fullsized":"2023-08-11T12:22:31.727577+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:14:44.681877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":146,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:24:15.861425+0000","last_change":"2023-08-11T12:22:02.841759+0000","last_active":"2023-08-11T12:24:15.861425+0000","last_peered":"2023-08-11T12:24:15.861425+0000","last_clean":"2023-08-11T12:24:15.861425+0000","last_became_active":"2023-08-11T12:22:02.841326+0000","last_became_peered":"2023-08-11T12:22:02.841326+0000","last_unstale":"2023-08-11T12:24:15.861425+0000","last_undegraded":"2023-08-11T12:24:15.861425+0000","last_fullsized":"2023-08-11T12:24:15.861425+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:09:30.085287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.802211+0000","last_change":"2023-08-11T12:22:31.801910+0000","last_active":"2023-08-11T12:22:31.802211+0000","last_peered":"2023-08-11T12:22:31.802211+0000","last_clean":"2023-08-11T12:22:31.802211+0000","last_became_active":"2023-08-11T12:22:31.801479+0000","last_became_peered":"2023-08-11T12:22:31.801479+0000","last_unstale":"2023-08-11T12:22:31.802211+0000","last_undegraded":"2023-08-11T12:22:31.802211+0000","last_fullsized":"2023-08-11T12:22:31.802211+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:52:21.489431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720477+0000","last_change":"2023-08-11T12:22:07.875010+0000","last_active":"2023-08-11T12:22:31.720477+0000","last_peered":"2023-08-11T12:22:31.720477+0000","last_clean":"2023-08-11T12:22:31.720477+0000","last_became_active":"2023-08-11T12:22:07.874474+0000","last_became_peered":"2023-08-11T12:22:07.874474+0000","last_unstale":"2023-08-11T12:22:31.720477+0000","last_undegraded":"2023-08-11T12:22:31.720477+0000","last_fullsized":"2023-08-11T12:22:31.720477+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:41:20.795124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721193+0000","last_change":"2023-08-11T12:22:02.848299+0000","last_active":"2023-08-11T12:22:31.721193+0000","last_peered":"2023-08-11T12:22:31.721193+0000","last_clean":"2023-08-11T12:22:31.721193+0000","last_became_active":"2023-08-11T12:22:02.847869+0000","last_became_peered":"2023-08-11T12:22:02.847869+0000","last_unstale":"2023-08-11T12:22:31.721193+0000","last_undegraded":"2023-08-11T12:22:31.721193+0000","last_fullsized":"2023-08-11T12:22:31.721193+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:09:15.600582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719871+0000","last_change":"2023-08-11T12:22:03.841173+0000","last_active":"2023-08-11T12:22:31.719871+0000","last_peered":"2023-08-11T12:22:31.719871+0000","last_clean":"2023-08-11T12:22:31.719871+0000","last_became_active":"2023-08-11T12:22:03.840882+0000","last_became_peered":"2023-08-11T12:22:03.840882+0000","last_unstale":"2023-08-11T12:22:31.719871+0000","last_undegraded":"2023-08-11T12:22:31.719871+0000","last_fullsized":"2023-08-11T12:22:31.719871+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:50:28.937358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721470+0000","last_change":"2023-08-11T12:22:07.880756+0000","last_active":"2023-08-11T12:22:31.721470+0000","last_peered":"2023-08-11T12:22:31.721470+0000","last_clean":"2023-08-11T12:22:31.721470+0000","last_became_active":"2023-08-11T12:22:07.878866+0000","last_became_peered":"2023-08-11T12:22:07.878866+0000","last_unstale":"2023-08-11T12:22:31.721470+0000","last_undegraded":"2023-08-11T12:22:31.721470+0000","last_fullsized":"2023-08-11T12:22:31.721470+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:30:28.617039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:32.698559+0000","last_change":"2023-08-11T12:22:02.848543+0000","last_active":"2023-08-11T12:22:32.698559+0000","last_peered":"2023-08-11T12:22:32.698559+0000","last_clean":"2023-08-11T12:22:32.698559+0000","last_became_active":"2023-08-11T12:22:02.848008+0000","last_became_peered":"2023-08-11T12:22:02.848008+0000","last_unstale":"2023-08-11T12:22:32.698559+0000","last_undegraded":"2023-08-11T12:22:32.698559+0000","last_fullsized":"2023-08-11T12:22:32.698559+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:57:46.484932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774382+0000","last_change":"2023-08-11T12:22:03.843651+0000","last_active":"2023-08-11T12:22:31.774382+0000","last_peered":"2023-08-11T12:22:31.774382+0000","last_clean":"2023-08-11T12:22:31.774382+0000","last_became_active":"2023-08-11T12:22:03.843392+0000","last_became_peered":"2023-08-11T12:22:03.843392+0000","last_unstale":"2023-08-11T12:22:31.774382+0000","last_undegraded":"2023-08-11T12:22:31.774382+0000","last_fullsized":"2023-08-11T12:22:31.774382+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:27:25.825805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721058+0000","last_change":"2023-08-11T12:22:07.879373+0000","last_active":"2023-08-11T12:22:31.721058+0000","last_peered":"2023-08-11T12:22:31.721058+0000","last_clean":"2023-08-11T12:22:31.721058+0000","last_became_active":"2023-08-11T12:22:07.878929+0000","last_became_peered":"2023-08-11T12:22:07.878929+0000","last_unstale":"2023-08-11T12:22:31.721058+0000","last_undegraded":"2023-08-11T12:22:31.721058+0000","last_fullsized":"2023-08-11T12:22:31.721058+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:37:29.598815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723705+0000","last_change":"2023-08-11T12:22:02.841984+0000","last_active":"2023-08-11T12:22:31.723705+0000","last_peered":"2023-08-11T12:22:31.723705+0000","last_clean":"2023-08-11T12:22:31.723705+0000","last_became_active":"2023-08-11T12:22:02.841585+0000","last_became_peered":"2023-08-11T12:22:02.841585+0000","last_unstale":"2023-08-11T12:22:31.723705+0000","last_undegraded":"2023-08-11T12:22:31.723705+0000","last_fullsized":"2023-08-11T12:22:31.723705+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:18:28.740155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800688+0000","last_change":"2023-08-11T12:22:03.839381+0000","last_active":"2023-08-11T12:22:31.800688+0000","last_peered":"2023-08-11T12:22:31.800688+0000","last_clean":"2023-08-11T12:22:31.800688+0000","last_became_active":"2023-08-11T12:22:03.839091+0000","last_became_peered":"2023-08-11T12:22:03.839091+0000","last_unstale":"2023-08-11T12:22:31.800688+0000","last_undegraded":"2023-08-11T12:22:31.800688+0000","last_fullsized":"2023-08-11T12:22:31.800688+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:45:52.205138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722725+0000","last_change":"2023-08-11T12:22:07.881758+0000","last_active":"2023-08-11T12:22:31.722725+0000","last_peered":"2023-08-11T12:22:31.722725+0000","last_clean":"2023-08-11T12:22:31.722725+0000","last_became_active":"2023-08-11T12:22:07.881305+0000","last_became_peered":"2023-08-11T12:22:07.881305+0000","last_unstale":"2023-08-11T12:22:31.722725+0000","last_undegraded":"2023-08-11T12:22:31.722725+0000","last_fullsized":"2023-08-11T12:22:31.722725+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:25:48.595182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":143,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:24:15.836803+0000","last_change":"2023-08-11T12:22:02.844138+0000","last_active":"2023-08-11T12:24:15.836803+0000","last_peered":"2023-08-11T12:24:15.836803+0000","last_clean":"2023-08-11T12:24:15.836803+0000","last_became_active":"2023-08-11T12:22:02.843234+0000","last_became_peered":"2023-08-11T12:22:02.843234+0000","last_unstale":"2023-08-11T12:24:15.836803+0000","last_undegraded":"2023-08-11T12:24:15.836803+0000","last_fullsized":"2023-08-11T12:24:15.836803+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:53:48.033181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723640+0000","last_change":"2023-08-11T12:22:03.845450+0000","last_active":"2023-08-11T12:22:31.723640+0000","last_peered":"2023-08-11T12:22:31.723640+0000","last_clean":"2023-08-11T12:22:31.723640+0000","last_became_active":"2023-08-11T12:22:03.845170+0000","last_became_peered":"2023-08-11T12:22:03.845170+0000","last_unstale":"2023-08-11T12:22:31.723640+0000","last_undegraded":"2023-08-11T12:22:31.723640+0000","last_fullsized":"2023-08-11T12:22:31.723640+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:35:09.789210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722268+0000","last_change":"2023-08-11T12:22:07.880663+0000","last_active":"2023-08-11T12:22:31.722268+0000","last_peered":"2023-08-11T12:22:31.722268+0000","last_clean":"2023-08-11T12:22:31.722268+0000","last_became_active":"2023-08-11T12:22:07.880282+0000","last_became_peered":"2023-08-11T12:22:07.880282+0000","last_unstale":"2023-08-11T12:22:31.722268+0000","last_undegraded":"2023-08-11T12:22:31.722268+0000","last_fullsized":"2023-08-11T12:22:31.722268+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:36:05.356885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"87'7","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721289+0000","last_change":"2023-08-11T12:22:02.842206+0000","last_active":"2023-08-11T12:22:31.721289+0000","last_peered":"2023-08-11T12:22:31.721289+0000","last_clean":"2023-08-11T12:22:31.721289+0000","last_became_active":"2023-08-11T12:22:02.841815+0000","last_became_peered":"2023-08-11T12:22:02.841815+0000","last_unstale":"2023-08-11T12:22:31.721289+0000","last_undegraded":"2023-08-11T12:22:31.721289+0000","last_fullsized":"2023-08-11T12:22:31.721289+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:15:01.305404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800934+0000","last_change":"2023-08-11T12:22:03.825886+0000","last_active":"2023-08-11T12:22:31.800934+0000","last_peered":"2023-08-11T12:22:31.800934+0000","last_clean":"2023-08-11T12:22:31.800934+0000","last_became_active":"2023-08-11T12:22:03.825645+0000","last_became_peered":"2023-08-11T12:22:03.825645+0000","last_unstale":"2023-08-11T12:22:31.800934+0000","last_undegraded":"2023-08-11T12:22:31.800934+0000","last_fullsized":"2023-08-11T12:22:31.800934+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:03:34.650801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720482+0000","last_change":"2023-08-11T12:22:07.890216+0000","last_active":"2023-08-11T12:22:31.720482+0000","last_peered":"2023-08-11T12:22:31.720482+0000","last_clean":"2023-08-11T12:22:31.720482+0000","last_became_active":"2023-08-11T12:22:07.889860+0000","last_became_peered":"2023-08-11T12:22:07.889860+0000","last_unstale":"2023-08-11T12:22:31.720482+0000","last_undegraded":"2023-08-11T12:22:31.720482+0000","last_fullsized":"2023-08-11T12:22:31.720482+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:03:54.952887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.716962+0000","last_change":"2023-08-11T12:22:02.835703+0000","last_active":"2023-08-11T12:22:31.716962+0000","last_peered":"2023-08-11T12:22:31.716962+0000","last_clean":"2023-08-11T12:22:31.716962+0000","last_became_active":"2023-08-11T12:22:02.835300+0000","last_became_peered":"2023-08-11T12:22:02.835300+0000","last_unstale":"2023-08-11T12:22:31.716962+0000","last_undegraded":"2023-08-11T12:22:31.716962+0000","last_fullsized":"2023-08-11T12:22:31.716962+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:55:13.953193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720447+0000","last_change":"2023-08-11T12:22:03.835619+0000","last_active":"2023-08-11T12:22:31.720447+0000","last_peered":"2023-08-11T12:22:31.720447+0000","last_clean":"2023-08-11T12:22:31.720447+0000","last_became_active":"2023-08-11T12:22:03.835365+0000","last_became_peered":"2023-08-11T12:22:03.835365+0000","last_unstale":"2023-08-11T12:22:31.720447+0000","last_undegraded":"2023-08-11T12:22:31.720447+0000","last_fullsized":"2023-08-11T12:22:31.720447+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:36:40.129412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719415+0000","last_change":"2023-08-11T12:22:07.893736+0000","last_active":"2023-08-11T12:22:31.719415+0000","last_peered":"2023-08-11T12:22:31.719415+0000","last_clean":"2023-08-11T12:22:31.719415+0000","last_became_active":"2023-08-11T12:22:07.893160+0000","last_became_peered":"2023-08-11T12:22:07.893160+0000","last_unstale":"2023-08-11T12:22:31.719415+0000","last_undegraded":"2023-08-11T12:22:31.719415+0000","last_fullsized":"2023-08-11T12:22:31.719415+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:55:46.234346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800174+0000","last_change":"2023-08-11T12:22:02.843819+0000","last_active":"2023-08-11T12:22:31.800174+0000","last_peered":"2023-08-11T12:22:31.800174+0000","last_clean":"2023-08-11T12:22:31.800174+0000","last_became_active":"2023-08-11T12:22:02.843062+0000","last_became_peered":"2023-08-11T12:22:02.843062+0000","last_unstale":"2023-08-11T12:22:31.800174+0000","last_undegraded":"2023-08-11T12:22:31.800174+0000","last_fullsized":"2023-08-11T12:22:31.800174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:59:34.378593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722599+0000","last_change":"2023-08-11T12:22:03.845985+0000","last_active":"2023-08-11T12:22:31.722599+0000","last_peered":"2023-08-11T12:22:31.722599+0000","last_clean":"2023-08-11T12:22:31.722599+0000","last_became_active":"2023-08-11T12:22:03.845274+0000","last_became_peered":"2023-08-11T12:22:03.845274+0000","last_unstale":"2023-08-11T12:22:31.722599+0000","last_undegraded":"2023-08-11T12:22:31.722599+0000","last_fullsized":"2023-08-11T12:22:31.722599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:51:23.239546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.775632+0000","last_change":"2023-08-11T12:22:31.775632+0000","last_active":"2023-08-11T12:22:31.775632+0000","last_peered":"2023-08-11T12:22:31.775632+0000","last_clean":"2023-08-11T12:22:31.775632+0000","last_became_active":"2023-08-11T12:22:31.775282+0000","last_became_peered":"2023-08-11T12:22:31.775282+0000","last_unstale":"2023-08-11T12:22:31.775632+0000","last_undegraded":"2023-08-11T12:22:31.775632+0000","last_fullsized":"2023-08-11T12:22:31.775632+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:59:53.378227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,8],"acting":[3,7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"89'5","reported_seq":250,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:24:19.841628+0000","last_change":"2023-08-11T12:22:02.836591+0000","last_active":"2023-08-11T12:24:19.841628+0000","last_peered":"2023-08-11T12:24:19.841628+0000","last_clean":"2023-08-11T12:24:19.841628+0000","last_became_active":"2023-08-11T12:22:02.836223+0000","last_became_peered":"2023-08-11T12:22:02.836223+0000","last_unstale":"2023-08-11T12:24:19.841628+0000","last_undegraded":"2023-08-11T12:24:19.841628+0000","last_fullsized":"2023-08-11T12:24:19.841628+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:30:37.183588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":219,"num_read_kb":219,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774757+0000","last_change":"2023-08-11T12:22:03.841719+0000","last_active":"2023-08-11T12:22:31.774757+0000","last_peered":"2023-08-11T12:22:31.774757+0000","last_clean":"2023-08-11T12:22:31.774757+0000","last_became_active":"2023-08-11T12:22:03.841381+0000","last_became_peered":"2023-08-11T12:22:03.841381+0000","last_unstale":"2023-08-11T12:22:31.774757+0000","last_undegraded":"2023-08-11T12:22:31.774757+0000","last_fullsized":"2023-08-11T12:22:31.774757+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:29:35.108655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721200+0000","last_change":"2023-08-11T12:22:07.889103+0000","last_active":"2023-08-11T12:22:31.721200+0000","last_peered":"2023-08-11T12:22:31.721200+0000","last_clean":"2023-08-11T12:22:31.721200+0000","last_became_active":"2023-08-11T12:22:07.888668+0000","last_became_peered":"2023-08-11T12:22:07.888668+0000","last_unstale":"2023-08-11T12:22:31.721200+0000","last_undegraded":"2023-08-11T12:22:31.721200+0000","last_fullsized":"2023-08-11T12:22:31.721200+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:55:40.004921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717773+0000","last_change":"2023-08-11T12:22:02.841934+0000","last_active":"2023-08-11T12:22:31.717773+0000","last_peered":"2023-08-11T12:22:31.717773+0000","last_clean":"2023-08-11T12:22:31.717773+0000","last_became_active":"2023-08-11T12:22:02.841598+0000","last_became_peered":"2023-08-11T12:22:02.841598+0000","last_unstale":"2023-08-11T12:22:31.717773+0000","last_undegraded":"2023-08-11T12:22:31.717773+0000","last_fullsized":"2023-08-11T12:22:31.717773+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:20:04.206298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719796+0000","last_change":"2023-08-11T12:22:03.848901+0000","last_active":"2023-08-11T12:22:31.719796+0000","last_peered":"2023-08-11T12:22:31.719796+0000","last_clean":"2023-08-11T12:22:31.719796+0000","last_became_active":"2023-08-11T12:22:03.848518+0000","last_became_peered":"2023-08-11T12:22:03.848518+0000","last_unstale":"2023-08-11T12:22:31.719796+0000","last_undegraded":"2023-08-11T12:22:31.719796+0000","last_fullsized":"2023-08-11T12:22:31.719796+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:20:08.007934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.775821+0000","last_change":"2023-08-11T12:22:31.775821+0000","last_active":"2023-08-11T12:22:31.775821+0000","last_peered":"2023-08-11T12:22:31.775821+0000","last_clean":"2023-08-11T12:22:31.775821+0000","last_became_active":"2023-08-11T12:22:31.775264+0000","last_became_peered":"2023-08-11T12:22:31.775264+0000","last_unstale":"2023-08-11T12:22:31.775821+0000","last_undegraded":"2023-08-11T12:22:31.775821+0000","last_fullsized":"2023-08-11T12:22:31.775821+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:28:22.561726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"87'5","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800805+0000","last_change":"2023-08-11T12:22:02.846492+0000","last_active":"2023-08-11T12:22:31.800805+0000","last_peered":"2023-08-11T12:22:31.800805+0000","last_clean":"2023-08-11T12:22:31.800805+0000","last_became_active":"2023-08-11T12:22:02.846174+0000","last_became_peered":"2023-08-11T12:22:02.846174+0000","last_unstale":"2023-08-11T12:22:31.800805+0000","last_undegraded":"2023-08-11T12:22:31.800805+0000","last_fullsized":"2023-08-11T12:22:31.800805+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:09:18.245164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774783+0000","last_change":"2023-08-11T12:22:03.840054+0000","last_active":"2023-08-11T12:22:31.774783+0000","last_peered":"2023-08-11T12:22:31.774783+0000","last_clean":"2023-08-11T12:22:31.774783+0000","last_became_active":"2023-08-11T12:22:03.839707+0000","last_became_peered":"2023-08-11T12:22:03.839707+0000","last_unstale":"2023-08-11T12:22:31.774783+0000","last_undegraded":"2023-08-11T12:22:31.774783+0000","last_fullsized":"2023-08-11T12:22:31.774783+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:47:30.898127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.802304+0000","last_change":"2023-08-11T12:22:31.801931+0000","last_active":"2023-08-11T12:22:31.802304+0000","last_peered":"2023-08-11T12:22:31.802304+0000","last_clean":"2023-08-11T12:22:31.802304+0000","last_became_active":"2023-08-11T12:22:31.801522+0000","last_became_peered":"2023-08-11T12:22:31.801522+0000","last_unstale":"2023-08-11T12:22:31.802304+0000","last_undegraded":"2023-08-11T12:22:31.802304+0000","last_fullsized":"2023-08-11T12:22:31.802304+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:03:22.570814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.14","version":"88'14","reported_seq":264,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:24:19.841126+0000","last_change":"2023-08-11T12:22:02.836520+0000","last_active":"2023-08-11T12:24:19.841126+0000","last_peered":"2023-08-11T12:24:19.841126+0000","last_clean":"2023-08-11T12:24:19.841126+0000","last_became_active":"2023-08-11T12:22:02.836201+0000","last_became_peered":"2023-08-11T12:22:02.836201+0000","last_unstale":"2023-08-11T12:24:19.841126+0000","last_undegraded":"2023-08-11T12:24:19.841126+0000","last_fullsized":"2023-08-11T12:24:19.841126+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:58:37.750229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":224,"num_read_kb":116,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723852+0000","last_change":"2023-08-11T12:22:03.848104+0000","last_active":"2023-08-11T12:22:31.723852+0000","last_peered":"2023-08-11T12:22:31.723852+0000","last_clean":"2023-08-11T12:22:31.723852+0000","last_became_active":"2023-08-11T12:22:03.847801+0000","last_became_peered":"2023-08-11T12:22:03.847801+0000","last_unstale":"2023-08-11T12:22:31.723852+0000","last_undegraded":"2023-08-11T12:22:31.723852+0000","last_fullsized":"2023-08-11T12:22:31.723852+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:56:47.846229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.801121+0000","last_change":"2023-08-11T12:22:07.893710+0000","last_active":"2023-08-11T12:22:31.801121+0000","last_peered":"2023-08-11T12:22:31.801121+0000","last_clean":"2023-08-11T12:22:31.801121+0000","last_became_active":"2023-08-11T12:22:07.893239+0000","last_became_peered":"2023-08-11T12:22:07.893239+0000","last_unstale":"2023-08-11T12:22:31.801121+0000","last_undegraded":"2023-08-11T12:22:31.801121+0000","last_fullsized":"2023-08-11T12:22:31.801121+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:24:55.563178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.724184+0000","last_change":"2023-08-11T12:22:02.849060+0000","last_active":"2023-08-11T12:22:31.724184+0000","last_peered":"2023-08-11T12:22:31.724184+0000","last_clean":"2023-08-11T12:22:31.724184+0000","last_became_active":"2023-08-11T12:22:02.848417+0000","last_became_peered":"2023-08-11T12:22:02.848417+0000","last_unstale":"2023-08-11T12:22:31.724184+0000","last_undegraded":"2023-08-11T12:22:31.724184+0000","last_fullsized":"2023-08-11T12:22:31.724184+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:48:47.925134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717206+0000","last_change":"2023-08-11T12:22:03.848532+0000","last_active":"2023-08-11T12:22:31.717206+0000","last_peered":"2023-08-11T12:22:31.717206+0000","last_clean":"2023-08-11T12:22:31.717206+0000","last_became_active":"2023-08-11T12:22:03.848190+0000","last_became_peered":"2023-08-11T12:22:03.848190+0000","last_unstale":"2023-08-11T12:22:31.717206+0000","last_undegraded":"2023-08-11T12:22:31.717206+0000","last_fullsized":"2023-08-11T12:22:31.717206+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:24:49.898432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720024+0000","last_change":"2023-08-11T12:22:07.882785+0000","last_active":"2023-08-11T12:22:31.720024+0000","last_peered":"2023-08-11T12:22:31.720024+0000","last_clean":"2023-08-11T12:22:31.720024+0000","last_became_active":"2023-08-11T12:22:07.880643+0000","last_became_peered":"2023-08-11T12:22:07.880643+0000","last_unstale":"2023-08-11T12:22:31.720024+0000","last_undegraded":"2023-08-11T12:22:31.720024+0000","last_fullsized":"2023-08-11T12:22:31.720024+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:40:21.114572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800547+0000","last_change":"2023-08-11T12:22:02.851416+0000","last_active":"2023-08-11T12:22:31.800547+0000","last_peered":"2023-08-11T12:22:31.800547+0000","last_clean":"2023-08-11T12:22:31.800547+0000","last_became_active":"2023-08-11T12:22:02.851114+0000","last_became_peered":"2023-08-11T12:22:02.851114+0000","last_unstale":"2023-08-11T12:22:31.800547+0000","last_undegraded":"2023-08-11T12:22:31.800547+0000","last_fullsized":"2023-08-11T12:22:31.800547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:27:37.565292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717994+0000","last_change":"2023-08-11T12:22:03.849367+0000","last_active":"2023-08-11T12:22:31.717994+0000","last_peered":"2023-08-11T12:22:31.717994+0000","last_clean":"2023-08-11T12:22:31.717994+0000","last_became_active":"2023-08-11T12:22:03.849050+0000","last_became_peered":"2023-08-11T12:22:03.849050+0000","last_unstale":"2023-08-11T12:22:31.717994+0000","last_undegraded":"2023-08-11T12:22:31.717994+0000","last_fullsized":"2023-08-11T12:22:31.717994+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:54:43.936124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722616+0000","last_change":"2023-08-11T12:22:07.890992+0000","last_active":"2023-08-11T12:22:31.722616+0000","last_peered":"2023-08-11T12:22:31.722616+0000","last_clean":"2023-08-11T12:22:31.722616+0000","last_became_active":"2023-08-11T12:22:07.890384+0000","last_became_peered":"2023-08-11T12:22:07.890384+0000","last_unstale":"2023-08-11T12:22:31.722616+0000","last_undegraded":"2023-08-11T12:22:31.722616+0000","last_fullsized":"2023-08-11T12:22:31.722616+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:00:55.230221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"87'5","reported_seq":139,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:24:16.885885+0000","last_change":"2023-08-11T12:22:02.843045+0000","last_active":"2023-08-11T12:24:16.885885+0000","last_peered":"2023-08-11T12:24:16.885885+0000","last_clean":"2023-08-11T12:24:16.885885+0000","last_became_active":"2023-08-11T12:22:02.842628+0000","last_became_peered":"2023-08-11T12:22:02.842628+0000","last_unstale":"2023-08-11T12:24:16.885885+0000","last_undegraded":"2023-08-11T12:24:16.885885+0000","last_fullsized":"2023-08-11T12:24:16.885885+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:45:36.283695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717456+0000","last_change":"2023-08-11T12:22:03.842526+0000","last_active":"2023-08-11T12:22:31.717456+0000","last_peered":"2023-08-11T12:22:31.717456+0000","last_clean":"2023-08-11T12:22:31.717456+0000","last_became_active":"2023-08-11T12:22:03.842183+0000","last_became_peered":"2023-08-11T12:22:03.842183+0000","last_unstale":"2023-08-11T12:22:31.717456+0000","last_undegraded":"2023-08-11T12:22:31.717456+0000","last_fullsized":"2023-08-11T12:22:31.717456+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:20:56.195693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717389+0000","last_change":"2023-08-11T12:22:07.880768+0000","last_active":"2023-08-11T12:22:31.717389+0000","last_peered":"2023-08-11T12:22:31.717389+0000","last_clean":"2023-08-11T12:22:31.717389+0000","last_became_active":"2023-08-11T12:22:07.880335+0000","last_became_peered":"2023-08-11T12:22:07.880335+0000","last_unstale":"2023-08-11T12:22:31.717389+0000","last_undegraded":"2023-08-11T12:22:31.717389+0000","last_fullsized":"2023-08-11T12:22:31.717389+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:35:51.736025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721841+0000","last_change":"2023-08-11T12:22:02.847271+0000","last_active":"2023-08-11T12:22:31.721841+0000","last_peered":"2023-08-11T12:22:31.721841+0000","last_clean":"2023-08-11T12:22:31.721841+0000","last_became_active":"2023-08-11T12:22:02.846974+0000","last_became_peered":"2023-08-11T12:22:02.846974+0000","last_unstale":"2023-08-11T12:22:31.721841+0000","last_undegraded":"2023-08-11T12:22:31.721841+0000","last_fullsized":"2023-08-11T12:22:31.721841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:43:35.198876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800817+0000","last_change":"2023-08-11T12:22:03.838944+0000","last_active":"2023-08-11T12:22:31.800817+0000","last_peered":"2023-08-11T12:22:31.800817+0000","last_clean":"2023-08-11T12:22:31.800817+0000","last_became_active":"2023-08-11T12:22:03.838610+0000","last_became_peered":"2023-08-11T12:22:03.838610+0000","last_unstale":"2023-08-11T12:22:31.800817+0000","last_undegraded":"2023-08-11T12:22:31.800817+0000","last_fullsized":"2023-08-11T12:22:31.800817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:10:20.371629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800744+0000","last_change":"2023-08-11T12:22:07.888812+0000","last_active":"2023-08-11T12:22:31.800744+0000","last_peered":"2023-08-11T12:22:31.800744+0000","last_clean":"2023-08-11T12:22:31.800744+0000","last_became_active":"2023-08-11T12:22:07.888423+0000","last_became_peered":"2023-08-11T12:22:07.888423+0000","last_unstale":"2023-08-11T12:22:31.800744+0000","last_undegraded":"2023-08-11T12:22:31.800744+0000","last_fullsized":"2023-08-11T12:22:31.800744+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:07:17.536681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:32.028490+0000","last_change":"2023-08-11T12:22:02.842591+0000","last_active":"2023-08-11T12:22:32.028490+0000","last_peered":"2023-08-11T12:22:32.028490+0000","last_clean":"2023-08-11T12:22:32.028490+0000","last_became_active":"2023-08-11T12:22:02.842249+0000","last_became_peered":"2023-08-11T12:22:02.842249+0000","last_unstale":"2023-08-11T12:22:32.028490+0000","last_undegraded":"2023-08-11T12:22:32.028490+0000","last_fullsized":"2023-08-11T12:22:32.028490+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:28:10.930413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.725791+0000","last_change":"2023-08-11T12:22:31.725791+0000","last_active":"2023-08-11T12:22:31.725791+0000","last_peered":"2023-08-11T12:22:31.725791+0000","last_clean":"2023-08-11T12:22:31.725791+0000","last_became_active":"2023-08-11T12:22:31.724950+0000","last_became_peered":"2023-08-11T12:22:31.724950+0000","last_unstale":"2023-08-11T12:22:31.725791+0000","last_undegraded":"2023-08-11T12:22:31.725791+0000","last_fullsized":"2023-08-11T12:22:31.725791+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:59:37.392626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723541+0000","last_change":"2023-08-11T12:22:08.068485+0000","last_active":"2023-08-11T12:22:31.723541+0000","last_peered":"2023-08-11T12:22:31.723541+0000","last_clean":"2023-08-11T12:22:31.723541+0000","last_became_active":"2023-08-11T12:22:08.068071+0000","last_became_peered":"2023-08-11T12:22:08.068071+0000","last_unstale":"2023-08-11T12:22:31.723541+0000","last_undegraded":"2023-08-11T12:22:31.723541+0000","last_fullsized":"2023-08-11T12:22:31.723541+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:35:49.958958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"87'1","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.728607+0000","last_change":"2023-08-11T12:22:31.727900+0000","last_active":"2023-08-11T12:22:31.728607+0000","last_peered":"2023-08-11T12:22:31.728607+0000","last_clean":"2023-08-11T12:22:31.728607+0000","last_became_active":"2023-08-11T12:22:31.727346+0000","last_became_peered":"2023-08-11T12:22:31.727346+0000","last_unstale":"2023-08-11T12:22:31.728607+0000","last_undegraded":"2023-08-11T12:22:31.728607+0000","last_fullsized":"2023-08-11T12:22:31.728607+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:12:21.170378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722974+0000","last_change":"2023-08-11T12:22:03.843434+0000","last_active":"2023-08-11T12:22:31.722974+0000","last_peered":"2023-08-11T12:22:31.722974+0000","last_clean":"2023-08-11T12:22:31.722974+0000","last_became_active":"2023-08-11T12:22:03.843117+0000","last_became_peered":"2023-08-11T12:22:03.843117+0000","last_unstale":"2023-08-11T12:22:31.722974+0000","last_undegraded":"2023-08-11T12:22:31.722974+0000","last_fullsized":"2023-08-11T12:22:31.722974+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:30:45.835632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717439+0000","last_change":"2023-08-11T12:22:07.889740+0000","last_active":"2023-08-11T12:22:31.717439+0000","last_peered":"2023-08-11T12:22:31.717439+0000","last_clean":"2023-08-11T12:22:31.717439+0000","last_became_active":"2023-08-11T12:22:07.889272+0000","last_became_peered":"2023-08-11T12:22:07.889272+0000","last_unstale":"2023-08-11T12:22:31.717439+0000","last_undegraded":"2023-08-11T12:22:31.717439+0000","last_fullsized":"2023-08-11T12:22:31.717439+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:48:06.207915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":141,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:24:18.866178+0000","last_change":"2023-08-11T12:22:02.846661+0000","last_active":"2023-08-11T12:24:18.866178+0000","last_peered":"2023-08-11T12:24:18.866178+0000","last_clean":"2023-08-11T12:24:18.866178+0000","last_became_active":"2023-08-11T12:22:02.846269+0000","last_became_peered":"2023-08-11T12:22:02.846269+0000","last_unstale":"2023-08-11T12:24:18.866178+0000","last_undegraded":"2023-08-11T12:24:18.866178+0000","last_fullsized":"2023-08-11T12:24:18.866178+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:06:18.229850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721164+0000","last_change":"2023-08-11T12:22:03.849653+0000","last_active":"2023-08-11T12:22:31.721164+0000","last_peered":"2023-08-11T12:22:31.721164+0000","last_clean":"2023-08-11T12:22:31.721164+0000","last_became_active":"2023-08-11T12:22:03.849303+0000","last_became_peered":"2023-08-11T12:22:03.849303+0000","last_unstale":"2023-08-11T12:22:31.721164+0000","last_undegraded":"2023-08-11T12:22:31.721164+0000","last_fullsized":"2023-08-11T12:22:31.721164+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:06:11.551259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717073+0000","last_change":"2023-08-11T12:22:08.068395+0000","last_active":"2023-08-11T12:22:31.717073+0000","last_peered":"2023-08-11T12:22:31.717073+0000","last_clean":"2023-08-11T12:22:31.717073+0000","last_became_active":"2023-08-11T12:22:08.067572+0000","last_became_peered":"2023-08-11T12:22:08.067572+0000","last_unstale":"2023-08-11T12:22:31.717073+0000","last_undegraded":"2023-08-11T12:22:31.717073+0000","last_fullsized":"2023-08-11T12:22:31.717073+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:17:59.273227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800465+0000","last_change":"2023-08-11T12:22:03.828971+0000","last_active":"2023-08-11T12:22:31.800465+0000","last_peered":"2023-08-11T12:22:31.800465+0000","last_clean":"2023-08-11T12:22:31.800465+0000","last_became_active":"2023-08-11T12:22:03.828653+0000","last_became_peered":"2023-08-11T12:22:03.828653+0000","last_unstale":"2023-08-11T12:22:31.800465+0000","last_undegraded":"2023-08-11T12:22:31.800465+0000","last_fullsized":"2023-08-11T12:22:31.800465+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:03:54.904360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":140,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:24:17.886789+0000","last_change":"2023-08-11T12:22:02.842419+0000","last_active":"2023-08-11T12:24:17.886789+0000","last_peered":"2023-08-11T12:24:17.886789+0000","last_clean":"2023-08-11T12:24:17.886789+0000","last_became_active":"2023-08-11T12:22:02.842105+0000","last_became_peered":"2023-08-11T12:22:02.842105+0000","last_unstale":"2023-08-11T12:24:17.886789+0000","last_undegraded":"2023-08-11T12:24:17.886789+0000","last_fullsized":"2023-08-11T12:24:17.886789+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:32:13.063912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717706+0000","last_change":"2023-08-11T12:22:07.880762+0000","last_active":"2023-08-11T12:22:31.717706+0000","last_peered":"2023-08-11T12:22:31.717706+0000","last_clean":"2023-08-11T12:22:31.717706+0000","last_became_active":"2023-08-11T12:22:07.880373+0000","last_became_peered":"2023-08-11T12:22:07.880373+0000","last_unstale":"2023-08-11T12:22:31.717706+0000","last_undegraded":"2023-08-11T12:22:31.717706+0000","last_fullsized":"2023-08-11T12:22:31.717706+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:07:06.457583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720351+0000","last_change":"2023-08-11T12:22:03.838555+0000","last_active":"2023-08-11T12:22:31.720351+0000","last_peered":"2023-08-11T12:22:31.720351+0000","last_clean":"2023-08-11T12:22:31.720351+0000","last_became_active":"2023-08-11T12:22:03.838135+0000","last_became_peered":"2023-08-11T12:22:03.838135+0000","last_unstale":"2023-08-11T12:22:31.720351+0000","last_undegraded":"2023-08-11T12:22:31.720351+0000","last_fullsized":"2023-08-11T12:22:31.720351+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:36:24.934863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:32.698817+0000","last_change":"2023-08-11T12:22:02.835093+0000","last_active":"2023-08-11T12:22:32.698817+0000","last_peered":"2023-08-11T12:22:32.698817+0000","last_clean":"2023-08-11T12:22:32.698817+0000","last_became_active":"2023-08-11T12:22:02.834545+0000","last_became_peered":"2023-08-11T12:22:02.834545+0000","last_unstale":"2023-08-11T12:22:32.698817+0000","last_undegraded":"2023-08-11T12:22:32.698817+0000","last_fullsized":"2023-08-11T12:22:32.698817+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:21:54.371599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":355,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717340+0000","last_change":"2023-08-11T12:20:57.484190+0000","last_active":"2023-08-11T12:22:31.717340+0000","last_peered":"2023-08-11T12:22:31.717340+0000","last_clean":"2023-08-11T12:22:31.717340+0000","last_became_active":"2023-08-11T12:20:57.483655+0000","last_became_peered":"2023-08-11T12:20:57.483655+0000","last_unstale":"2023-08-11T12:22:31.717340+0000","last_undegraded":"2023-08-11T12:22:31.717340+0000","last_fullsized":"2023-08-11T12:22:31.717340+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:17:49.245488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:17:49.245488+0000","last_clean_scrub_stamp":"2023-08-11T12:17:49.245488+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:25:33.880946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800922+0000","last_change":"2023-08-11T12:22:08.068762+0000","last_active":"2023-08-11T12:22:31.800922+0000","last_peered":"2023-08-11T12:22:31.800922+0000","last_clean":"2023-08-11T12:22:31.800922+0000","last_became_active":"2023-08-11T12:22:08.068205+0000","last_became_peered":"2023-08-11T12:22:08.068205+0000","last_unstale":"2023-08-11T12:22:31.800922+0000","last_undegraded":"2023-08-11T12:22:31.800922+0000","last_fullsized":"2023-08-11T12:22:31.800922+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:55:06.744751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.716814+0000","last_change":"2023-08-11T12:22:03.837843+0000","last_active":"2023-08-11T12:22:31.716814+0000","last_peered":"2023-08-11T12:22:31.716814+0000","last_clean":"2023-08-11T12:22:31.716814+0000","last_became_active":"2023-08-11T12:22:03.837537+0000","last_became_peered":"2023-08-11T12:22:03.837537+0000","last_unstale":"2023-08-11T12:22:31.716814+0000","last_undegraded":"2023-08-11T12:22:31.716814+0000","last_fullsized":"2023-08-11T12:22:31.716814+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:17:41.517052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717406+0000","last_change":"2023-08-11T12:22:02.843150+0000","last_active":"2023-08-11T12:22:31.717406+0000","last_peered":"2023-08-11T12:22:31.717406+0000","last_clean":"2023-08-11T12:22:31.717406+0000","last_became_active":"2023-08-11T12:22:02.842829+0000","last_became_peered":"2023-08-11T12:22:02.842829+0000","last_unstale":"2023-08-11T12:22:31.717406+0000","last_undegraded":"2023-08-11T12:22:31.717406+0000","last_fullsized":"2023-08-11T12:22:31.717406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:09:48.420755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720746+0000","last_change":"2023-08-11T12:22:07.883050+0000","last_active":"2023-08-11T12:22:31.720746+0000","last_peered":"2023-08-11T12:22:31.720746+0000","last_clean":"2023-08-11T12:22:31.720746+0000","last_became_active":"2023-08-11T12:22:07.882423+0000","last_became_peered":"2023-08-11T12:22:07.882423+0000","last_unstale":"2023-08-11T12:22:31.720746+0000","last_undegraded":"2023-08-11T12:22:31.720746+0000","last_fullsized":"2023-08-11T12:22:31.720746+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:14:51.848070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.724046+0000","last_change":"2023-08-11T12:22:02.850632+0000","last_active":"2023-08-11T12:22:31.724046+0000","last_peered":"2023-08-11T12:22:31.724046+0000","last_clean":"2023-08-11T12:22:31.724046+0000","last_became_active":"2023-08-11T12:22:02.850312+0000","last_became_peered":"2023-08-11T12:22:02.850312+0000","last_unstale":"2023-08-11T12:22:31.724046+0000","last_undegraded":"2023-08-11T12:22:31.724046+0000","last_fullsized":"2023-08-11T12:22:31.724046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:54:50.288288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717673+0000","last_change":"2023-08-11T12:22:03.839869+0000","last_active":"2023-08-11T12:22:31.717673+0000","last_peered":"2023-08-11T12:22:31.717673+0000","last_clean":"2023-08-11T12:22:31.717673+0000","last_became_active":"2023-08-11T12:22:03.839486+0000","last_became_peered":"2023-08-11T12:22:03.839486+0000","last_unstale":"2023-08-11T12:22:31.717673+0000","last_undegraded":"2023-08-11T12:22:31.717673+0000","last_fullsized":"2023-08-11T12:22:31.717673+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:23:04.341624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720353+0000","last_change":"2023-08-11T12:22:08.066877+0000","last_active":"2023-08-11T12:22:31.720353+0000","last_peered":"2023-08-11T12:22:31.720353+0000","last_clean":"2023-08-11T12:22:31.720353+0000","last_became_active":"2023-08-11T12:22:08.066418+0000","last_became_peered":"2023-08-11T12:22:08.066418+0000","last_unstale":"2023-08-11T12:22:31.720353+0000","last_undegraded":"2023-08-11T12:22:31.720353+0000","last_fullsized":"2023-08-11T12:22:31.720353+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:12:43.228455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'7","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722342+0000","last_change":"2023-08-11T12:22:02.850505+0000","last_active":"2023-08-11T12:22:31.722342+0000","last_peered":"2023-08-11T12:22:31.722342+0000","last_clean":"2023-08-11T12:22:31.722342+0000","last_became_active":"2023-08-11T12:22:02.850104+0000","last_became_peered":"2023-08-11T12:22:02.850104+0000","last_unstale":"2023-08-11T12:22:31.722342+0000","last_undegraded":"2023-08-11T12:22:31.722342+0000","last_fullsized":"2023-08-11T12:22:31.722342+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:33:50.319404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721634+0000","last_change":"2023-08-11T12:22:03.837580+0000","last_active":"2023-08-11T12:22:31.721634+0000","last_peered":"2023-08-11T12:22:31.721634+0000","last_clean":"2023-08-11T12:22:31.721634+0000","last_became_active":"2023-08-11T12:22:03.837256+0000","last_became_peered":"2023-08-11T12:22:03.837256+0000","last_unstale":"2023-08-11T12:22:31.721634+0000","last_undegraded":"2023-08-11T12:22:31.721634+0000","last_fullsized":"2023-08-11T12:22:31.721634+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:07:44.899244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722738+0000","last_change":"2023-08-11T12:22:07.873613+0000","last_active":"2023-08-11T12:22:31.722738+0000","last_peered":"2023-08-11T12:22:31.722738+0000","last_clean":"2023-08-11T12:22:31.722738+0000","last_became_active":"2023-08-11T12:22:07.873149+0000","last_became_peered":"2023-08-11T12:22:07.873149+0000","last_unstale":"2023-08-11T12:22:31.722738+0000","last_undegraded":"2023-08-11T12:22:31.722738+0000","last_fullsized":"2023-08-11T12:22:31.722738+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:38:35.678888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:32.698437+0000","last_change":"2023-08-11T12:22:02.843146+0000","last_active":"2023-08-11T12:22:32.698437+0000","last_peered":"2023-08-11T12:22:32.698437+0000","last_clean":"2023-08-11T12:22:32.698437+0000","last_became_active":"2023-08-11T12:22:02.842663+0000","last_became_peered":"2023-08-11T12:22:02.842663+0000","last_unstale":"2023-08-11T12:22:32.698437+0000","last_undegraded":"2023-08-11T12:22:32.698437+0000","last_fullsized":"2023-08-11T12:22:32.698437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:32:13.084100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719561+0000","last_change":"2023-08-11T12:22:03.847351+0000","last_active":"2023-08-11T12:22:31.719561+0000","last_peered":"2023-08-11T12:22:31.719561+0000","last_clean":"2023-08-11T12:22:31.719561+0000","last_became_active":"2023-08-11T12:22:03.847044+0000","last_became_peered":"2023-08-11T12:22:03.847044+0000","last_unstale":"2023-08-11T12:22:31.719561+0000","last_undegraded":"2023-08-11T12:22:31.719561+0000","last_fullsized":"2023-08-11T12:22:31.719561+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:17:19.004762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721751+0000","last_change":"2023-08-11T12:22:08.068459+0000","last_active":"2023-08-11T12:22:31.721751+0000","last_peered":"2023-08-11T12:22:31.721751+0000","last_clean":"2023-08-11T12:22:31.721751+0000","last_became_active":"2023-08-11T12:22:08.067857+0000","last_became_peered":"2023-08-11T12:22:08.067857+0000","last_unstale":"2023-08-11T12:22:31.721751+0000","last_undegraded":"2023-08-11T12:22:31.721751+0000","last_fullsized":"2023-08-11T12:22:31.721751+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:15:05.931547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774199+0000","last_change":"2023-08-11T12:22:02.846441+0000","last_active":"2023-08-11T12:22:31.774199+0000","last_peered":"2023-08-11T12:22:31.774199+0000","last_clean":"2023-08-11T12:22:31.774199+0000","last_became_active":"2023-08-11T12:22:02.846153+0000","last_became_peered":"2023-08-11T12:22:02.846153+0000","last_unstale":"2023-08-11T12:22:31.774199+0000","last_undegraded":"2023-08-11T12:22:31.774199+0000","last_fullsized":"2023-08-11T12:22:31.774199+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:00:55.631058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723390+0000","last_change":"2023-08-11T12:22:03.841932+0000","last_active":"2023-08-11T12:22:31.723390+0000","last_peered":"2023-08-11T12:22:31.723390+0000","last_clean":"2023-08-11T12:22:31.723390+0000","last_became_active":"2023-08-11T12:22:03.841635+0000","last_became_peered":"2023-08-11T12:22:03.841635+0000","last_unstale":"2023-08-11T12:22:31.723390+0000","last_undegraded":"2023-08-11T12:22:31.723390+0000","last_fullsized":"2023-08-11T12:22:31.723390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:01:57.888877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722748+0000","last_change":"2023-08-11T12:22:07.886160+0000","last_active":"2023-08-11T12:22:31.722748+0000","last_peered":"2023-08-11T12:22:31.722748+0000","last_clean":"2023-08-11T12:22:31.722748+0000","last_became_active":"2023-08-11T12:22:07.885703+0000","last_became_peered":"2023-08-11T12:22:07.885703+0000","last_unstale":"2023-08-11T12:22:31.722748+0000","last_undegraded":"2023-08-11T12:22:31.722748+0000","last_fullsized":"2023-08-11T12:22:31.722748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:50:20.362829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720571+0000","last_change":"2023-08-11T12:22:02.849360+0000","last_active":"2023-08-11T12:22:31.720571+0000","last_peered":"2023-08-11T12:22:31.720571+0000","last_clean":"2023-08-11T12:22:31.720571+0000","last_became_active":"2023-08-11T12:22:02.849028+0000","last_became_peered":"2023-08-11T12:22:02.849028+0000","last_unstale":"2023-08-11T12:22:31.720571+0000","last_undegraded":"2023-08-11T12:22:31.720571+0000","last_fullsized":"2023-08-11T12:22:31.720571+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:55:24.114464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719877+0000","last_change":"2023-08-11T12:22:03.850285+0000","last_active":"2023-08-11T12:22:31.719877+0000","last_peered":"2023-08-11T12:22:31.719877+0000","last_clean":"2023-08-11T12:22:31.719877+0000","last_became_active":"2023-08-11T12:22:03.849978+0000","last_became_peered":"2023-08-11T12:22:03.849978+0000","last_unstale":"2023-08-11T12:22:31.719877+0000","last_undegraded":"2023-08-11T12:22:31.719877+0000","last_fullsized":"2023-08-11T12:22:31.719877+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:29:51.679282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721058+0000","last_change":"2023-08-11T12:22:07.881578+0000","last_active":"2023-08-11T12:22:31.721058+0000","last_peered":"2023-08-11T12:22:31.721058+0000","last_clean":"2023-08-11T12:22:31.721058+0000","last_became_active":"2023-08-11T12:22:07.881145+0000","last_became_peered":"2023-08-11T12:22:07.881145+0000","last_unstale":"2023-08-11T12:22:31.721058+0000","last_undegraded":"2023-08-11T12:22:31.721058+0000","last_fullsized":"2023-08-11T12:22:31.721058+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:32:16.462208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:34.992478+0000","last_change":"2023-08-11T12:22:02.848875+0000","last_active":"2023-08-11T12:22:34.992478+0000","last_peered":"2023-08-11T12:22:34.992478+0000","last_clean":"2023-08-11T12:22:34.992478+0000","last_became_active":"2023-08-11T12:22:02.848578+0000","last_became_peered":"2023-08-11T12:22:02.848578+0000","last_unstale":"2023-08-11T12:22:34.992478+0000","last_undegraded":"2023-08-11T12:22:34.992478+0000","last_fullsized":"2023-08-11T12:22:34.992478+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:29:40.949795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721093+0000","last_change":"2023-08-11T12:22:03.849865+0000","last_active":"2023-08-11T12:22:31.721093+0000","last_peered":"2023-08-11T12:22:31.721093+0000","last_clean":"2023-08-11T12:22:31.721093+0000","last_became_active":"2023-08-11T12:22:03.849557+0000","last_became_peered":"2023-08-11T12:22:03.849557+0000","last_unstale":"2023-08-11T12:22:31.721093+0000","last_undegraded":"2023-08-11T12:22:31.721093+0000","last_fullsized":"2023-08-11T12:22:31.721093+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:49:27.142464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721537+0000","last_change":"2023-08-11T12:22:08.067009+0000","last_active":"2023-08-11T12:22:31.721537+0000","last_peered":"2023-08-11T12:22:31.721537+0000","last_clean":"2023-08-11T12:22:31.721537+0000","last_became_active":"2023-08-11T12:22:08.066477+0000","last_became_peered":"2023-08-11T12:22:08.066477+0000","last_unstale":"2023-08-11T12:22:31.721537+0000","last_undegraded":"2023-08-11T12:22:31.721537+0000","last_fullsized":"2023-08-11T12:22:31.721537+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:07:02.380225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.731106+0000","last_change":"2023-08-11T12:22:31.731106+0000","last_active":"2023-08-11T12:22:31.731106+0000","last_peered":"2023-08-11T12:22:31.731106+0000","last_clean":"2023-08-11T12:22:31.731106+0000","last_became_active":"2023-08-11T12:22:31.724944+0000","last_became_peered":"2023-08-11T12:22:31.724944+0000","last_unstale":"2023-08-11T12:22:31.731106+0000","last_undegraded":"2023-08-11T12:22:31.731106+0000","last_fullsized":"2023-08-11T12:22:31.731106+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:56:41.188015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718094+0000","last_change":"2023-08-11T12:22:03.848715+0000","last_active":"2023-08-11T12:22:31.718094+0000","last_peered":"2023-08-11T12:22:31.718094+0000","last_clean":"2023-08-11T12:22:31.718094+0000","last_became_active":"2023-08-11T12:22:03.848311+0000","last_became_peered":"2023-08-11T12:22:03.848311+0000","last_unstale":"2023-08-11T12:22:31.718094+0000","last_undegraded":"2023-08-11T12:22:31.718094+0000","last_fullsized":"2023-08-11T12:22:31.718094+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:45:14.152855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774158+0000","last_change":"2023-08-11T12:22:07.882566+0000","last_active":"2023-08-11T12:22:31.774158+0000","last_peered":"2023-08-11T12:22:31.774158+0000","last_clean":"2023-08-11T12:22:31.774158+0000","last_became_active":"2023-08-11T12:22:07.882198+0000","last_became_peered":"2023-08-11T12:22:07.882198+0000","last_unstale":"2023-08-11T12:22:31.774158+0000","last_undegraded":"2023-08-11T12:22:31.774158+0000","last_fullsized":"2023-08-11T12:22:31.774158+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:21:03.227408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"87'5","reported_seq":141,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:24:18.897561+0000","last_change":"2023-08-11T12:22:02.846424+0000","last_active":"2023-08-11T12:24:18.897561+0000","last_peered":"2023-08-11T12:24:18.897561+0000","last_clean":"2023-08-11T12:24:18.897561+0000","last_became_active":"2023-08-11T12:22:02.846063+0000","last_became_peered":"2023-08-11T12:22:02.846063+0000","last_unstale":"2023-08-11T12:24:18.897561+0000","last_undegraded":"2023-08-11T12:24:18.897561+0000","last_fullsized":"2023-08-11T12:24:18.897561+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:28:14.946971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717900+0000","last_change":"2023-08-11T12:22:03.845616+0000","last_active":"2023-08-11T12:22:31.717900+0000","last_peered":"2023-08-11T12:22:31.717900+0000","last_clean":"2023-08-11T12:22:31.717900+0000","last_became_active":"2023-08-11T12:22:03.845293+0000","last_became_peered":"2023-08-11T12:22:03.845293+0000","last_unstale":"2023-08-11T12:22:31.717900+0000","last_undegraded":"2023-08-11T12:22:31.717900+0000","last_fullsized":"2023-08-11T12:22:31.717900+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:28:30.374044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718737+0000","last_change":"2023-08-11T12:22:07.888963+0000","last_active":"2023-08-11T12:22:31.718737+0000","last_peered":"2023-08-11T12:22:31.718737+0000","last_clean":"2023-08-11T12:22:31.718737+0000","last_became_active":"2023-08-11T12:22:07.888513+0000","last_became_peered":"2023-08-11T12:22:07.888513+0000","last_unstale":"2023-08-11T12:22:31.718737+0000","last_undegraded":"2023-08-11T12:22:31.718737+0000","last_fullsized":"2023-08-11T12:22:31.718737+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:44:29.823122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.801009+0000","last_change":"2023-08-11T12:22:02.850739+0000","last_active":"2023-08-11T12:22:31.801009+0000","last_peered":"2023-08-11T12:22:31.801009+0000","last_clean":"2023-08-11T12:22:31.801009+0000","last_became_active":"2023-08-11T12:22:02.850455+0000","last_became_peered":"2023-08-11T12:22:02.850455+0000","last_unstale":"2023-08-11T12:22:31.801009+0000","last_undegraded":"2023-08-11T12:22:31.801009+0000","last_fullsized":"2023-08-11T12:22:31.801009+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:37:48.954343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718168+0000","last_change":"2023-08-11T12:22:03.838834+0000","last_active":"2023-08-11T12:22:31.718168+0000","last_peered":"2023-08-11T12:22:31.718168+0000","last_clean":"2023-08-11T12:22:31.718168+0000","last_became_active":"2023-08-11T12:22:03.838435+0000","last_became_peered":"2023-08-11T12:22:03.838435+0000","last_unstale":"2023-08-11T12:22:31.718168+0000","last_undegraded":"2023-08-11T12:22:31.718168+0000","last_fullsized":"2023-08-11T12:22:31.718168+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:42:39.127547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.799965+0000","last_change":"2023-08-11T12:22:07.884481+0000","last_active":"2023-08-11T12:22:31.799965+0000","last_peered":"2023-08-11T12:22:31.799965+0000","last_clean":"2023-08-11T12:22:31.799965+0000","last_became_active":"2023-08-11T12:22:07.884084+0000","last_became_peered":"2023-08-11T12:22:07.884084+0000","last_unstale":"2023-08-11T12:22:31.799965+0000","last_undegraded":"2023-08-11T12:22:31.799965+0000","last_fullsized":"2023-08-11T12:22:31.799965+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:06:29.852022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717429+0000","last_change":"2023-08-11T12:22:02.849339+0000","last_active":"2023-08-11T12:22:31.717429+0000","last_peered":"2023-08-11T12:22:31.717429+0000","last_clean":"2023-08-11T12:22:31.717429+0000","last_became_active":"2023-08-11T12:22:02.848986+0000","last_became_peered":"2023-08-11T12:22:02.848986+0000","last_unstale":"2023-08-11T12:22:31.717429+0000","last_undegraded":"2023-08-11T12:22:31.717429+0000","last_fullsized":"2023-08-11T12:22:31.717429+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:00:28.458884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718065+0000","last_change":"2023-08-11T12:22:03.846301+0000","last_active":"2023-08-11T12:22:31.718065+0000","last_peered":"2023-08-11T12:22:31.718065+0000","last_clean":"2023-08-11T12:22:31.718065+0000","last_became_active":"2023-08-11T12:22:03.845990+0000","last_became_peered":"2023-08-11T12:22:03.845990+0000","last_unstale":"2023-08-11T12:22:31.718065+0000","last_undegraded":"2023-08-11T12:22:31.718065+0000","last_fullsized":"2023-08-11T12:22:31.718065+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:30:23.134555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719765+0000","last_change":"2023-08-11T12:22:03.836652+0000","last_active":"2023-08-11T12:22:31.719765+0000","last_peered":"2023-08-11T12:22:31.719765+0000","last_clean":"2023-08-11T12:22:31.719765+0000","last_became_active":"2023-08-11T12:22:03.836236+0000","last_became_peered":"2023-08-11T12:22:03.836236+0000","last_unstale":"2023-08-11T12:22:31.719765+0000","last_undegraded":"2023-08-11T12:22:31.719765+0000","last_fullsized":"2023-08-11T12:22:31.719765+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:15:43.477085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722700+0000","last_change":"2023-08-11T12:22:03.831318+0000","last_active":"2023-08-11T12:22:31.722700+0000","last_peered":"2023-08-11T12:22:31.722700+0000","last_clean":"2023-08-11T12:22:31.722700+0000","last_became_active":"2023-08-11T12:22:03.830670+0000","last_became_peered":"2023-08-11T12:22:03.830670+0000","last_unstale":"2023-08-11T12:22:31.722700+0000","last_undegraded":"2023-08-11T12:22:31.722700+0000","last_fullsized":"2023-08-11T12:22:31.722700+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:27:54.407934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722513+0000","last_change":"2023-08-11T12:22:03.841396+0000","last_active":"2023-08-11T12:22:31.722513+0000","last_peered":"2023-08-11T12:22:31.722513+0000","last_clean":"2023-08-11T12:22:31.722513+0000","last_became_active":"2023-08-11T12:22:03.841076+0000","last_became_peered":"2023-08-11T12:22:03.841076+0000","last_unstale":"2023-08-11T12:22:31.722513+0000","last_undegraded":"2023-08-11T12:22:31.722513+0000","last_fullsized":"2023-08-11T12:22:31.722513+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:14:14.365513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719695+0000","last_change":"2023-08-11T12:22:03.847266+0000","last_active":"2023-08-11T12:22:31.719695+0000","last_peered":"2023-08-11T12:22:31.719695+0000","last_clean":"2023-08-11T12:22:31.719695+0000","last_became_active":"2023-08-11T12:22:03.846898+0000","last_became_peered":"2023-08-11T12:22:03.846898+0000","last_unstale":"2023-08-11T12:22:31.719695+0000","last_undegraded":"2023-08-11T12:22:31.719695+0000","last_fullsized":"2023-08-11T12:22:31.719695+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:05:00.055352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717774+0000","last_change":"2023-08-11T12:22:03.843491+0000","last_active":"2023-08-11T12:22:31.717774+0000","last_peered":"2023-08-11T12:22:31.717774+0000","last_clean":"2023-08-11T12:22:31.717774+0000","last_became_active":"2023-08-11T12:22:03.843099+0000","last_became_peered":"2023-08-11T12:22:03.843099+0000","last_unstale":"2023-08-11T12:22:31.717774+0000","last_undegraded":"2023-08-11T12:22:31.717774+0000","last_fullsized":"2023-08-11T12:22:31.717774+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:24:27.850492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720396+0000","last_change":"2023-08-11T12:22:03.840508+0000","last_active":"2023-08-11T12:22:31.720396+0000","last_peered":"2023-08-11T12:22:31.720396+0000","last_clean":"2023-08-11T12:22:31.720396+0000","last_became_active":"2023-08-11T12:22:03.840160+0000","last_became_peered":"2023-08-11T12:22:03.840160+0000","last_unstale":"2023-08-11T12:22:31.720396+0000","last_undegraded":"2023-08-11T12:22:31.720396+0000","last_fullsized":"2023-08-11T12:22:31.720396+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:09:11.925192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723642+0000","last_change":"2023-08-11T12:22:03.843724+0000","last_active":"2023-08-11T12:22:31.723642+0000","last_peered":"2023-08-11T12:22:31.723642+0000","last_clean":"2023-08-11T12:22:31.723642+0000","last_became_active":"2023-08-11T12:22:03.843431+0000","last_became_peered":"2023-08-11T12:22:03.843431+0000","last_unstale":"2023-08-11T12:22:31.723642+0000","last_undegraded":"2023-08-11T12:22:31.723642+0000","last_fullsized":"2023-08-11T12:22:31.723642+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:02:15.971280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721811+0000","last_change":"2023-08-11T12:22:03.831268+0000","last_active":"2023-08-11T12:22:31.721811+0000","last_peered":"2023-08-11T12:22:31.721811+0000","last_clean":"2023-08-11T12:22:31.721811+0000","last_became_active":"2023-08-11T12:22:03.830839+0000","last_became_peered":"2023-08-11T12:22:03.830839+0000","last_unstale":"2023-08-11T12:22:31.721811+0000","last_undegraded":"2023-08-11T12:22:31.721811+0000","last_fullsized":"2023-08-11T12:22:31.721811+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:25:09.422026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800309+0000","last_change":"2023-08-11T12:22:03.839227+0000","last_active":"2023-08-11T12:22:31.800309+0000","last_peered":"2023-08-11T12:22:31.800309+0000","last_clean":"2023-08-11T12:22:31.800309+0000","last_became_active":"2023-08-11T12:22:03.838526+0000","last_became_peered":"2023-08-11T12:22:03.838526+0000","last_unstale":"2023-08-11T12:22:31.800309+0000","last_undegraded":"2023-08-11T12:22:31.800309+0000","last_fullsized":"2023-08-11T12:22:31.800309+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:56:06.609931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720714+0000","last_change":"2023-08-11T12:22:03.834614+0000","last_active":"2023-08-11T12:22:31.720714+0000","last_peered":"2023-08-11T12:22:31.720714+0000","last_clean":"2023-08-11T12:22:31.720714+0000","last_became_active":"2023-08-11T12:22:03.834267+0000","last_became_peered":"2023-08-11T12:22:03.834267+0000","last_unstale":"2023-08-11T12:22:31.720714+0000","last_undegraded":"2023-08-11T12:22:31.720714+0000","last_fullsized":"2023-08-11T12:22:31.720714+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:05:00.003830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774493+0000","last_change":"2023-08-11T12:22:03.846504+0000","last_active":"2023-08-11T12:22:31.774493+0000","last_peered":"2023-08-11T12:22:31.774493+0000","last_clean":"2023-08-11T12:22:31.774493+0000","last_became_active":"2023-08-11T12:22:03.846156+0000","last_became_peered":"2023-08-11T12:22:03.846156+0000","last_unstale":"2023-08-11T12:22:31.774493+0000","last_undegraded":"2023-08-11T12:22:31.774493+0000","last_fullsized":"2023-08-11T12:22:31.774493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:54:38.654858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717340+0000","last_change":"2023-08-11T12:22:03.849854+0000","last_active":"2023-08-11T12:22:31.717340+0000","last_peered":"2023-08-11T12:22:31.717340+0000","last_clean":"2023-08-11T12:22:31.717340+0000","last_became_active":"2023-08-11T12:22:03.849553+0000","last_became_peered":"2023-08-11T12:22:03.849553+0000","last_unstale":"2023-08-11T12:22:31.717340+0000","last_undegraded":"2023-08-11T12:22:31.717340+0000","last_fullsized":"2023-08-11T12:22:31.717340+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:14:27.485150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720171+0000","last_change":"2023-08-11T12:22:03.843511+0000","last_active":"2023-08-11T12:22:31.720171+0000","last_peered":"2023-08-11T12:22:31.720171+0000","last_clean":"2023-08-11T12:22:31.720171+0000","last_became_active":"2023-08-11T12:22:03.843206+0000","last_became_peered":"2023-08-11T12:22:03.843206+0000","last_unstale":"2023-08-11T12:22:31.720171+0000","last_undegraded":"2023-08-11T12:22:31.720171+0000","last_fullsized":"2023-08-11T12:22:31.720171+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:19:44.978907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":248338,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10522,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1113,"num_read_kb":576,"num_write":211,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":31566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":185,"ondisk_log_size":185,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449128,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":484340,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.443,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.48999999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.51000000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.41499999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77800000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.501}]},{"osd":2,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.52500000000000002,"15min":0.53200000000000003},"min":{"1min":0.35599999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70899999999999996,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.33200000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79100000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":4,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.69899999999999995,"15min":0.69599999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89700000000000002,"5min":1.032,"15min":1.032},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.60999999999999999},"min":{"1min":0.46000000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.78100000000000003,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.63200000000000001}]},{"osd":5,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.64900000000000002,"15min":0.66100000000000003},"min":{"1min":0.34799999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77500000000000002,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65900000000000003,"15min":0.65700000000000003},"min":{"1min":0.437,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.81200000000000006}]},{"osd":6,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.68400000000000005,"15min":0.69099999999999995},"min":{"1min":0.46500000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86499999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.98299999999999998,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.79300000000000004}]},{"osd":7,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.79100000000000004,"15min":0.78700000000000003},"min":{"1min":0.55100000000000005,"5min":0.503,"15min":0.503},"max":{"1min":1.0229999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.56100000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.873,"5min":1.302,"15min":1.302},"last":0.66400000000000003}]},{"osd":8,"last update":"Fri Aug 11 12:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.71999999999999997,"15min":0.71499999999999997},"min":{"1min":0.58599999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.753},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.79100000000000004,"15min":0.78700000000000003},"min":{"1min":0.62,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96599999999999997,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.84099999999999997}]},{"osd":9,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.61899999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.81100000000000005,"15min":0.80500000000000005},"min":{"1min":0.59999999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.071,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.88600000000000001}]},{"osd":10,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.61299999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93000000000000005,"5min":1.341,"15min":1.341},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.82199999999999995,"15min":0.82399999999999995},"min":{"1min":0.59099999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.95099999999999996,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.82699999999999996}]}]},{"osd":10,"up_from":71,"seq":304942678059,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1064960,"data_stored":1078813,"data_compressed":53533,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.67600000000000005,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.51700000000000002}]},{"osd":1,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48499999999999999,"15min":0.48299999999999998},"min":{"1min":0.29799999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.63100000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80400000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.61899999999999999}]},{"osd":2,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.65100000000000002,"15min":0.64000000000000001},"min":{"1min":0.46500000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.90200000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.69599999999999995}]},{"osd":3,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.65900000000000003,"15min":0.68100000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81100000000000005,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.72099999999999997,"15min":0.72299999999999998},"min":{"1min":0.52800000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89900000000000002,"5min":1.528,"15min":1.528},"last":0.70899999999999996}]},{"osd":4,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63300000000000001,"15min":0.623},"min":{"1min":0.40400000000000003,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.88400000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.35399999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.873,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.58799999999999997}]},{"osd":5,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72299999999999998,"15min":0.72099999999999997},"min":{"1min":0.501,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95099999999999996,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.752,"15min":0.74399999999999999},"min":{"1min":0.51000000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.99099999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.65800000000000003}]},{"osd":6,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.79500000000000004,"15min":0.80700000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.82299999999999995,"15min":0.81899999999999995},"min":{"1min":0.64700000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98799999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.78700000000000003}]},{"osd":7,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.59099999999999997}]},{"osd":8,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84399999999999997,"15min":0.83699999999999997},"min":{"1min":0.57099999999999995,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0469999999999999,"5min":1.296,"15min":1.296},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.84299999999999997,"15min":0.85199999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1100000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.73199999999999998}]},{"osd":9,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.88800000000000001,"15min":0.88100000000000001},"min":{"1min":0.69599999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1459999999999999,"5min":1.21,"15min":1.21},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.84799999999999998,"15min":0.86099999999999999},"min":{"1min":0.54700000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.157,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.64300000000000002}]},{"osd":11,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.86099999999999999,"15min":0.86499999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0900000000000001,"5min":1.323,"15min":1.323},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.86499999999999999,"15min":0.85899999999999999},"min":{"1min":0.61099999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0549999999999999,"5min":1.341,"15min":1.341},"last":0.93899999999999995}]}]},{"osd":9,"up_from":66,"seq":283467841583,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":484270,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54900000000000004,"15min":0.56499999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.55600000000000005,"15min":0.56599999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.755,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.44900000000000001}]},{"osd":1,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.72899999999999998,"15min":0.747},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.65600000000000003,"15min":0.64200000000000002},"min":{"1min":0.41599999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.65600000000000003}]},{"osd":2,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.76100000000000001,"15min":0.78200000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97999999999999998,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73999999999999999,"15min":0.75700000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.57799999999999996}]},{"osd":3,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.67900000000000005,"15min":0.72899999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82299999999999995,"5min":1.355,"15min":1.355},"last":0.5},{"interface":"front","average":{"1min":0.626,"5min":0.72399999999999998,"15min":0.77800000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.92800000000000005,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.67400000000000004}]},{"osd":4,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.754,"15min":0.754},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.53600000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.64100000000000001}]},{"osd":5,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.86399999999999999,"15min":0.91200000000000003},"min":{"1min":0.51900000000000002,"5min":0.495,"15min":0.495},"max":{"1min":1.0720000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.86299999999999999,"15min":0.91400000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1200000000000001,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.48199999999999998}]},{"osd":6,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.91200000000000003,"15min":0.94899999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.141,"5min":1.163,"15min":1.163},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.93500000000000005,"15min":0.995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.083,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.56100000000000005}]},{"osd":8,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.92800000000000005,"15min":0.96899999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.93799999999999994,"15min":0.98799999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.0509999999999999,"5min":1.272,"15min":1.272},"last":0.60199999999999998}]},{"osd":10,"last update":"Fri Aug 11 12:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.92200000000000004,"15min":0.96299999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.629},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.89700000000000002,"15min":0.91300000000000003},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.107,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.94799999999999995}]},{"osd":11,"last update":"Fri Aug 11 12:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.88500000000000001,"15min":0.89200000000000002},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2010000000000001,"5min":1.869,"15min":1.869},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.85399999999999998,"15min":0.85599999999999998},"min":{"1min":0.69999999999999996,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.006,"5min":1.095,"15min":1.095},"last":0.73199999999999998}]}]},{"osd":8,"up_from":58,"seq":249108103222,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":484648,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.71799999999999997,"15min":0.59399999999999997},"min":{"1min":0.38900000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72199999999999998,"5min":12.307,"15min":12.307},"last":0.501},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.57499999999999996,"15min":0.59199999999999997},"min":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.626,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.45200000000000001}]},{"osd":1,"last update":"Fri Aug 11 12:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.63700000000000001,"15min":0.60799999999999998},"min":{"1min":0.496,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63200000000000001,"15min":0.60999999999999999},"min":{"1min":0.52500000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.85099999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.57999999999999996}]},{"osd":2,"last update":"Fri Aug 11 12:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.46899999999999997,"15min":0.437},"min":{"1min":0.35299999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.61699999999999999,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.48599999999999999,"15min":0.45100000000000001},"min":{"1min":0.376,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71399999999999997,"5min":0.878,"15min":0.878},"last":0.62}]},{"osd":3,"last update":"Fri Aug 11 12:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68300000000000005,"15min":0.65400000000000003},"min":{"1min":0.51700000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77600000000000002,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.70099999999999996,"15min":0.63700000000000001},"min":{"1min":0.50600000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0700000000000001,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":0.73299999999999998}]},{"osd":4,"last update":"Fri Aug 11 12:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.66900000000000004,"15min":0.629},"min":{"1min":0.499,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88500000000000001,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.69699999999999995,"15min":0.66300000000000003},"min":{"1min":0.56799999999999995,"5min":0.432,"15min":0.432},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.63800000000000001}]},{"osd":5,"last update":"Fri Aug 11 12:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.59999999999999998,"15min":0.54800000000000004},"min":{"1min":0.38,"5min":0.309,"15min":0.309},"max":{"1min":0.85599999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.63200000000000001,"15min":0.58099999999999996},"min":{"1min":0.42099999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.88100000000000001,"5min":1.177,"15min":1.177},"last":0.76000000000000001}]},{"osd":6,"last update":"Fri Aug 11 12:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.77200000000000002,"15min":0.70999999999999996},"min":{"1min":0.628,"5min":0.441,"15min":0.441},"max":{"1min":1.157,"5min":3.1709999999999998,"15min":3.1709999999999998},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.79700000000000004,"15min":0.73899999999999999},"min":{"1min":0.48699999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97399999999999998,"5min":4.1180000000000003,"15min":4.1180000000000003},"last":0.85599999999999998}]},{"osd":7,"last update":"Fri Aug 11 12:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.75900000000000001,"15min":0.70799999999999996},"min":{"1min":0.60599999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0069999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.76800000000000002,"15min":0.72799999999999998},"min":{"1min":0.66600000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0189999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.81100000000000005}]},{"osd":9,"last update":"Fri Aug 11 12:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.79900000000000004,"15min":0.77300000000000002},"min":{"1min":0.71499999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1,"5min":1.375,"15min":1.375},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81200000000000006,"15min":0.79200000000000004},"min":{"1min":0.67400000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0620000000000001,"5min":1.252,"15min":1.252},"last":0.89900000000000002}]},{"osd":10,"last update":"Fri Aug 11 12:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.80200000000000005,"15min":0.77100000000000002},"min":{"1min":0.64000000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.048,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.82299999999999995,"15min":0.79100000000000004},"min":{"1min":0.65700000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.262,"5min":1.304,"15min":1.304},"last":0.91400000000000003}]},{"osd":11,"last update":"Fri Aug 11 12:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.85299999999999998,"15min":0.85499999999999998},"min":{"1min":0.68600000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":0.94399999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.69799999999999995,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.236,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.88}]}]},{"osd":7,"up_from":51,"seq":219043332153,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1040384,"data_stored":1076643,"data_compressed":53533,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.61399999999999999,"15min":0.60599999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.55200000000000005,"15min":0.53700000000000003},"min":{"1min":0.46999999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.65700000000000003}]},{"osd":1,"last update":"Fri Aug 11 12:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.439,"15min":0.40999999999999998},"min":{"1min":0.34699999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.60799999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.502,"5min":0.48099999999999998,"15min":0.45200000000000001},"min":{"1min":0.35099999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68100000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53300000000000003}]},{"osd":2,"last update":"Fri Aug 11 12:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.623,"15min":0.60899999999999999},"min":{"1min":0.48299999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77900000000000003,"5min":0.879,"15min":0.879},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.63200000000000001,"15min":0.59399999999999997},"min":{"1min":0.52000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78300000000000003,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.70899999999999996}]},{"osd":3,"last update":"Fri Aug 11 12:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65100000000000002,"15min":0.61899999999999999},"min":{"1min":0.441,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0549999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73099999999999998,"15min":0.65700000000000003},"min":{"1min":0.46500000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.139,"5min":5.8419999999999996,"15min":5.8419999999999996},"last":0.67300000000000004}]},{"osd":4,"last update":"Fri Aug 11 12:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56899999999999995,"15min":0.54400000000000004},"min":{"1min":0.36599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.85599999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.34699999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82799999999999996,"5min":1.105,"15min":1.105},"last":0.73799999999999999}]},{"osd":5,"last update":"Fri Aug 11 12:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.68400000000000005,"15min":0.66300000000000003},"min":{"1min":0.48399999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.70499999999999996,"15min":0.67000000000000004},"min":{"1min":0.57999999999999996,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.004,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.80300000000000005}]},{"osd":6,"last update":"Fri Aug 11 12:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.81200000000000006,"15min":0.74299999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0980000000000001,"5min":5.7199999999999998,"15min":5.7199999999999998},"last":0.872},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.749,"15min":0.70099999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.111,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.81299999999999994}]},{"osd":8,"last update":"Fri Aug 11 12:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76000000000000001,"15min":0.70299999999999996},"min":{"1min":0.56299999999999994,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.97299999999999998,"5min":1.206,"15min":1.206},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.751,"15min":0.69899999999999995},"min":{"1min":0.623,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.90300000000000002}]},{"osd":9,"last update":"Fri Aug 11 12:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.85299999999999998,"15min":0.84799999999999998},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.083,"5min":0.88600000000000001,"15min":0.85999999999999999},"min":{"1min":0.59999999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":4.8570000000000002,"5min":4.8570000000000002,"15min":4.8570000000000002},"last":0.82799999999999996}]},{"osd":10,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.81799999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0249999999999999,"5min":1.139,"15min":1.139},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.79000000000000004,"15min":0.76800000000000002},"min":{"1min":0.48899999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.92400000000000004}]},{"osd":11,"last update":"Fri Aug 11 12:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89400000000000002,"15min":0.89500000000000002},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.90500000000000003,"15min":0.90100000000000002},"min":{"1min":0.68500000000000005,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.85899999999999999}]}]},{"osd":6,"up_from":46,"seq":197568495679,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":483870,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.50600000000000001,"15min":0.47299999999999998},"min":{"1min":0.39700000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.52900000000000003,"15min":0.51200000000000001},"min":{"1min":0.41799999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.53100000000000003}]},{"osd":1,"last update":"Fri Aug 11 12:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.67200000000000004,"15min":0.63600000000000001},"min":{"1min":0.503,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.202,"5min":1.327,"15min":1.327},"last":0.505},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.71499999999999997,"15min":0.68300000000000005},"min":{"1min":0.60199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90100000000000002,"5min":1.206,"15min":1.206},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Aug 11 12:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.69899999999999995,"15min":0.69099999999999995},"min":{"1min":0.56399999999999995,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.099,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.72899999999999998,"15min":0.70099999999999996},"min":{"1min":0.51300000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.94299999999999995}]},{"osd":3,"last update":"Fri Aug 11 12:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.61899999999999999,"15min":0.57899999999999996},"min":{"1min":0.443,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.752},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.70699999999999996,"15min":0.67300000000000004},"min":{"1min":0.53000000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.60599999999999998}]},{"osd":4,"last update":"Fri Aug 11 12:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.71599999999999997,"15min":0.70199999999999996},"min":{"1min":0.495,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.77000000000000002,"15min":0.747},"min":{"1min":0.57399999999999995,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.69499999999999995}]},{"osd":5,"last update":"Fri Aug 11 12:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.81399999999999995,"15min":0.78000000000000003},"min":{"1min":0.69099999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.82099999999999995,"15min":0.81000000000000005},"min":{"1min":0.65500000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.68300000000000005}]},{"osd":7,"last update":"Fri Aug 11 12:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.84599999999999997,"15min":0.81399999999999995},"min":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.83499999999999996,"15min":0.81799999999999995},"min":{"1min":0.59899999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.63200000000000001}]},{"osd":8,"last update":"Fri Aug 11 12:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.85499999999999998,"15min":0.84499999999999997},"min":{"1min":0.623,"5min":0.498,"15min":0.498},"max":{"1min":1.216,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.90300000000000002,"15min":0.89300000000000002},"min":{"1min":0.74299999999999999,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1599999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.95699999999999996}]},{"osd":9,"last update":"Fri Aug 11 12:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.90400000000000003,"15min":0.91000000000000003},"min":{"1min":0.55000000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.04,"5min":0.94199999999999995,"15min":0.92900000000000005},"min":{"1min":0.82699999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.873}]},{"osd":10,"last update":"Fri Aug 11 12:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.90400000000000003,"15min":0.89800000000000002},"min":{"1min":0.76900000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2110000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.745},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.94799999999999995,"15min":0.94499999999999995},"min":{"1min":0.746,"5min":0.62,"15min":0.62},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.98699999999999999}]},{"osd":11,"last update":"Fri Aug 11 12:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.96599999999999997,"15min":0.96199999999999997},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.2869999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.016,"5min":1.0269999999999999,"15min":1.0289999999999999},"min":{"1min":0.88300000000000001,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.2290000000000001,"5min":1.611,"15min":1.611},"last":1.0089999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":488742,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56100000000000005,"15min":0.52100000000000002},"min":{"1min":0.40000000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.38200000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.01,"5min":1.01,"15min":1.4430000000000001},"last":0.45700000000000002}]},{"osd":2,"last update":"Fri Aug 11 12:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.621,"15min":0.55300000000000005},"min":{"1min":0.41799999999999998,"5min":0.315,"15min":0.315},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.59799999999999998,"15min":0.53100000000000003},"min":{"1min":0.44800000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.93200000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Aug 11 12:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63700000000000001,"15min":0.61899999999999999},"min":{"1min":0.52200000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86699999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.68899999999999995,"15min":0.64300000000000002},"min":{"1min":0.64200000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0289999999999999,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.73099999999999998}]},{"osd":4,"last update":"Fri Aug 11 12:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.51800000000000002,"15min":0.46400000000000002},"min":{"1min":0.36499999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.88700000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.51200000000000001,"15min":0.48399999999999999},"min":{"1min":0.33200000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.748,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.51400000000000001}]},{"osd":5,"last update":"Fri Aug 11 12:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.72799999999999998,"15min":0.64100000000000001},"min":{"1min":0.52200000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.875},{"interface":"front","average":{"1min":0.748,"5min":0.67000000000000004,"15min":0.622},"min":{"1min":0.46999999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.78200000000000003}]},{"osd":6,"last update":"Fri Aug 11 12:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73899999999999999,"15min":0.73799999999999999},"min":{"1min":0.45000000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.81999999999999995,"15min":0.79600000000000004},"min":{"1min":0.69799999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.98299999999999998}]},{"osd":7,"last update":"Fri Aug 11 12:23:53 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.72199999999999998,"15min":0.68999999999999995},"min":{"1min":0.39000000000000001,"5min":0.31,"15min":0.31},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.75,"5min":0.71199999999999997,"15min":0.68899999999999995},"min":{"1min":0.52100000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.016,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.80600000000000005}]},{"osd":8,"last update":"Fri Aug 11 12:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.79500000000000004,"15min":0.745},"min":{"1min":0.53500000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.089,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.83599999999999997,"15min":0.76200000000000001},"min":{"1min":0.66300000000000003,"5min":0.436,"15min":0.436},"max":{"1min":1.1339999999999999,"5min":1.294,"15min":1.294},"last":1.0680000000000001}]},{"osd":9,"last update":"Fri Aug 11 12:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.76700000000000002,"15min":0.755},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.98399999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.83899999999999997,"15min":0.81699999999999995},"min":{"1min":0.73899999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.141,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.85199999999999998}]},{"osd":10,"last update":"Fri Aug 11 12:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.85699999999999998,"15min":0.81100000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1339999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":1.026},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.79800000000000004,"15min":0.78000000000000003},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.90800000000000003}]},{"osd":11,"last update":"Fri Aug 11 12:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.0389999999999999,"15min":1.0469999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.173,"5min":1.329,"15min":1.329},"last":1.109},{"interface":"front","average":{"1min":0.878,"5min":0.94199999999999995,"15min":0.95199999999999996},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.056,"5min":1.131,"15min":1.131},"last":0.95799999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":485326,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.64800000000000002,"15min":0.55200000000000005},"min":{"1min":0.36599999999999999,"5min":0.314,"15min":0.314},"max":{"1min":1.3859999999999999,"5min":1.782,"15min":1.782},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.65900000000000003,"15min":0.56200000000000006},"min":{"1min":0.45900000000000002,"5min":0.36599999999999999,"15min":0.36499999999999999},"max":{"1min":1.1419999999999999,"5min":2.7749999999999999,"15min":2.7749999999999999},"last":0.748}]},{"osd":2,"last update":"Fri Aug 11 12:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.65600000000000003,"15min":0.57399999999999995},"min":{"1min":0.42099999999999999,"5min":0.40799999999999997,"15min":0.36199999999999999},"max":{"1min":0.875,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.71299999999999997,"15min":0.60499999999999998},"min":{"1min":0.48399999999999999,"5min":0.39100000000000001,"15min":0.33000000000000002},"max":{"1min":1.456,"5min":1.879,"15min":1.879},"last":1.004}]},{"osd":3,"last update":"Fri Aug 11 12:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.56899999999999995,"15min":0.55200000000000005},"min":{"1min":0.47099999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.39300000000000002}]},{"osd":4,"last update":"Fri Aug 11 12:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.71599999999999997,"15min":0.63},"min":{"1min":0.39300000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.639,"5min":1.849,"15min":1.849},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.73599999999999999,"15min":0.65000000000000002},"min":{"1min":0.52800000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1950000000000001,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Aug 11 12:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.77400000000000002,"15min":0.70799999999999996},"min":{"1min":0.56999999999999995,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0369999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77100000000000002,"15min":0.72699999999999998},"min":{"1min":0.61699999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.026,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.78900000000000003}]},{"osd":6,"last update":"Fri Aug 11 12:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.75700000000000001,"15min":0.76100000000000001},"min":{"1min":0.47199999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.411,"5min":2.8839999999999999,"15min":2.8839999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.70799999999999996,"15min":0.71499999999999997},"min":{"1min":0.39100000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.083,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.83299999999999996}]},{"osd":7,"last update":"Fri Aug 11 12:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84799999999999998,"15min":0.84899999999999998},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.0649999999999999,"5min":1.262,"15min":1.262},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.80700000000000005,"15min":0.80600000000000005},"min":{"1min":0.629,"5min":0.44,"15min":0.44},"max":{"1min":1.012,"5min":1.429,"15min":1.429},"last":0.76900000000000002}]},{"osd":8,"last update":"Fri Aug 11 12:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.82599999999999996,"15min":0.84299999999999997},"min":{"1min":0.69799999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.109,"5min":1.262,"15min":1.262},"last":1.109},{"interface":"front","average":{"1min":1.2949999999999999,"5min":0.97499999999999998,"15min":0.95499999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":6.4260000000000002,"5min":6.4260000000000002,"15min":6.4260000000000002},"last":1.075}]},{"osd":9,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.84699999999999998,"15min":0.86599999999999999},"min":{"1min":0.53900000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.099,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.3140000000000001},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.93100000000000005,"15min":0.95599999999999996},"min":{"1min":0.59999999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.3260000000000001}]},{"osd":10,"last update":"Fri Aug 11 12:23:59 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.95799999999999996,"15min":0.95199999999999996},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.161},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.90400000000000003,"15min":0.90000000000000002},"min":{"1min":0.67800000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.296,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.90700000000000003}]},{"osd":11,"last update":"Fri Aug 11 12:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.876,"15min":0.876},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1399999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":1.264},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.94999999999999996,"15min":0.94499999999999995},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.288}]}]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":488551,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.64000000000000001,"15min":0.55400000000000005},"min":{"1min":0.36599999999999999,"5min":0.316,"15min":0.316},"max":{"1min":1.1180000000000001,"5min":5.968,"15min":5.968},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.372,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83299999999999996,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.46600000000000003}]},{"osd":1,"last update":"Fri Aug 11 12:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59799999999999998,"15min":0.52700000000000002},"min":{"1min":0.41099999999999998,"5min":0.376,"15min":0.36399999999999999},"max":{"1min":0.83399999999999996,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.54400000000000004},"min":{"1min":0.41099999999999998,"5min":0.373,"15min":0.34399999999999997},"max":{"1min":0.84999999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.68799999999999994}]},{"osd":3,"last update":"Fri Aug 11 12:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.63200000000000001,"15min":0.60299999999999998},"min":{"1min":0.45500000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88900000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.64800000000000002,"15min":0.60699999999999998},"min":{"1min":0.47999999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86199999999999999,"5min":1.306,"15min":1.306},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri Aug 11 12:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.68400000000000005},"min":{"1min":0.48699999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.876,"5min":1.179,"15min":1.179},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Aug 11 12:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.499,"15min":0.44700000000000001},"min":{"1min":0.36899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78100000000000003,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.50600000000000001,"15min":0.46100000000000002},"min":{"1min":0.34899999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84699999999999998,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.57899999999999996}]},{"osd":6,"last update":"Fri Aug 11 12:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65700000000000003,"15min":0.629},"min":{"1min":0.45300000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89400000000000002,"5min":1.429,"15min":1.429},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.68999999999999995,"15min":0.63600000000000001},"min":{"1min":0.55400000000000005,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.94499999999999995,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.629}]},{"osd":7,"last update":"Fri Aug 11 12:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.73899999999999999,"15min":0.73399999999999999},"min":{"1min":0.59699999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.79400000000000004,"15min":0.79300000000000004},"min":{"1min":0.64100000000000001,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.75900000000000001}]},{"osd":8,"last update":"Fri Aug 11 12:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.65500000000000003,"15min":0.60699999999999998},"min":{"1min":0.432,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.94999999999999996,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.495},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.625,"15min":0.57699999999999996},"min":{"1min":0.501,"5min":0.439,"15min":0.439},"max":{"1min":0.89900000000000002,"5min":1.325,"15min":1.325},"last":0.66400000000000003}]},{"osd":9,"last update":"Fri Aug 11 12:23:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.76000000000000001,"15min":0.73699999999999999},"min":{"1min":0.61099999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2809999999999999,"5min":1.387,"15min":1.387},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.879,"5min":0.81899999999999995,"15min":0.80600000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.81200000000000006}]},{"osd":10,"last update":"Fri Aug 11 12:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.80300000000000005,"15min":0.78700000000000003},"min":{"1min":0.70999999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.036,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.84799999999999998,"15min":0.83199999999999996},"min":{"1min":0.73699999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0920000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.88200000000000001}]},{"osd":11,"last update":"Fri Aug 11 12:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.78300000000000003,"15min":0.77600000000000002},"min":{"1min":0.59199999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.80700000000000005,"15min":0.80300000000000005},"min":{"1min":0.67700000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.012,"5min":1.409,"15min":1.409},"last":0.94999999999999996}]}]},{"osd":3,"up_from":25,"seq":107374182476,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":483578,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.48099999999999998,"15min":0.40200000000000002},"min":{"1min":0.42299999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.50700000000000001,"15min":0.45000000000000001},"min":{"1min":0.39600000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.42099999999999999}]},{"osd":1,"last update":"Fri Aug 11 12:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.68999999999999995,"15min":0.58999999999999997},"min":{"1min":0.433,"5min":0.372,"15min":0.372},"max":{"1min":1.0209999999999999,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.65400000000000003,"15min":0.59999999999999998},"min":{"1min":0.51700000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.84799999999999998,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.78500000000000003}]},{"osd":2,"last update":"Fri Aug 11 12:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.70499999999999996,"15min":0.63700000000000001},"min":{"1min":0.55300000000000005,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":3.0289999999999999,"5min":3.0289999999999999,"15min":3.0289999999999999},"last":0.755},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.749,"15min":0.64700000000000002},"min":{"1min":0.71999999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.82599999999999996}]},{"osd":4,"last update":"Fri Aug 11 12:23:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.68600000000000005,"15min":0.624},"min":{"1min":0.53500000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0429999999999999,"5min":1.242,"15min":1.242},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.76200000000000001,"15min":0.66200000000000003},"min":{"1min":0.56200000000000006,"5min":0.435,"15min":0.435},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Aug 11 12:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.72899999999999998,"15min":0.66500000000000004},"min":{"1min":0.57299999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.747,"15min":0.68100000000000005},"min":{"1min":0.48899999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.71399999999999997}]},{"osd":6,"last update":"Fri Aug 11 12:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.81000000000000005,"15min":0.77200000000000002},"min":{"1min":0.59999999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.874},{"interface":"front","average":{"1min":0.88,"5min":0.75800000000000001,"15min":0.72499999999999998},"min":{"1min":0.56200000000000006,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Aug 11 12:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79800000000000004,"15min":0.76900000000000002},"min":{"1min":0.53600000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.89900000000000002,"15min":0.88500000000000001},"min":{"1min":0.64900000000000002,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.321,"5min":1.361,"15min":1.361},"last":0.73199999999999998}]},{"osd":8,"last update":"Fri Aug 11 12:23:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":3.052,"5min":3.052,"15min":3.052},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.83999999999999997}]},{"osd":9,"last update":"Fri Aug 11 12:23:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":0.98199999999999998,"15min":0.996},"min":{"1min":0.83799999999999997,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.298,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.91900000000000004,"15min":0.94099999999999995},"min":{"1min":0.628,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.91200000000000003}]},{"osd":10,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.95599999999999996,"15min":0.98799999999999999},"min":{"1min":0.68600000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2809999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.94499999999999995,"15min":0.97199999999999998},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":0.80900000000000005}]},{"osd":11,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.98699999999999999,"15min":0.98599999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.3320000000000001,"5min":1.341,"15min":1.341},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.127,"5min":1.028,"15min":1.012},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":3.0990000000000002,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":0.92700000000000005}]}]},{"osd":4,"up_from":33,"seq":141733920840,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":483848,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.39900000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.81599999999999995,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.41399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80900000000000005,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.72099999999999997}]},{"osd":1,"last update":"Fri Aug 11 12:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.44400000000000001,"15min":0.40899999999999997},"min":{"1min":0.30199999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.68000000000000005,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.312},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.45200000000000001,"15min":0.39400000000000002},"min":{"1min":0.34599999999999997,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.82899999999999996,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.33900000000000002}]},{"osd":2,"last update":"Fri Aug 11 12:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.66900000000000004,"15min":0.59699999999999998},"min":{"1min":0.52500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64600000000000002,"15min":0.57899999999999996},"min":{"1min":0.42899999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.98499999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.72099999999999997}]},{"osd":3,"last update":"Fri Aug 11 12:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.64700000000000002,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.379,"15min":0.379},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.628},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58299999999999996,"15min":0.56299999999999994},"min":{"1min":0.42999999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.95099999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.53100000000000003}]},{"osd":5,"last update":"Fri Aug 11 12:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.66300000000000003,"15min":0.58899999999999997},"min":{"1min":0.51600000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.70699999999999996,"15min":0.60899999999999999},"min":{"1min":0.57199999999999995,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0229999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Fri Aug 11 12:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.73399999999999999,"15min":0.70199999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.65500000000000003,"15min":0.625},"min":{"1min":0.48799999999999999,"5min":0.433,"15min":0.433},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.5}]},{"osd":7,"last update":"Fri Aug 11 12:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.64400000000000002,"15min":0.58999999999999997},"min":{"1min":0.38100000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.99299999999999999,"5min":1.125,"15min":1.125},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70899999999999996,"15min":0.65000000000000002},"min":{"1min":0.42299999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0449999999999999,"5min":1.151,"15min":1.151},"last":0.39500000000000002}]},{"osd":8,"last update":"Fri Aug 11 12:24:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67600000000000005,"15min":0.64400000000000002},"min":{"1min":0.46000000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.98399999999999999,"5min":1.016,"15min":1.016},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.87,"5min":0.82699999999999996,"15min":0.77100000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.85399999999999998}]},{"osd":9,"last update":"Fri Aug 11 12:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.88,"15min":0.84999999999999998},"min":{"1min":0.66700000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.75},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.85199999999999998,"15min":0.83399999999999996},"min":{"1min":0.67300000000000004,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.76600000000000001}]},{"osd":10,"last update":"Fri Aug 11 12:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83599999999999997,"15min":0.83999999999999997},"min":{"1min":0.57599999999999996,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.74199999999999999,"15min":0.748},"min":{"1min":0.53100000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.032,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.44600000000000001}]},{"osd":11,"last update":"Fri Aug 11 12:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.85499999999999998,"15min":0.86199999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.0800000000000001,"5min":1.165,"15min":1.165},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.873,"15min":0.875},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.123,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.79200000000000004}]}]},{"osd":5,"up_from":38,"seq":163208757315,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":1076594,"data_compressed":53533,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:24:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53400000000000003,"15min":0.52300000000000002},"min":{"1min":0.374,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77200000000000002,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.374},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.54100000000000004},"min":{"1min":0.40699999999999997,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0980000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Aug 11 12:24:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.58299999999999996,"15min":0.55300000000000005},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.626,"15min":0.57699999999999996},"min":{"1min":0.51300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.93600000000000005,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.57299999999999995}]},{"osd":2,"last update":"Fri Aug 11 12:24:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.42999999999999999,"15min":0.40600000000000003},"min":{"1min":0.30099999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.433},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.46200000000000002,"15min":0.41399999999999998},"min":{"1min":0.28399999999999997,"5min":0.248,"15min":0.248},"max":{"1min":0.71799999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.50800000000000001}]},{"osd":3,"last update":"Fri Aug 11 12:24:15 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.39800000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.88400000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.60299999999999998,"15min":0.59399999999999997},"min":{"1min":0.46700000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.78200000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.67900000000000005}]},{"osd":4,"last update":"Fri Aug 11 12:24:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.66500000000000004,"15min":0.60999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.63500000000000001,"15min":0.61099999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.85499999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.59399999999999997}]},{"osd":6,"last update":"Fri Aug 11 12:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.66600000000000004,"15min":0.626},"min":{"1min":0.45600000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":3.0659999999999998,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.878,"5min":0.73899999999999999,"15min":0.68700000000000006},"min":{"1min":0.51800000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":3.081,"5min":3.081,"15min":3.081},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Aug 11 12:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.71699999999999997,"15min":0.68400000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97899999999999998,"5min":1.048,"15min":1.048},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.69799999999999995,"15min":0.67300000000000004},"min":{"1min":0.48499999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.72199999999999998}]},{"osd":8,"last update":"Fri Aug 11 12:24:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.65400000000000003,"15min":0.60999999999999999},"min":{"1min":0.36699999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93200000000000005,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.60299999999999998,"15min":0.57099999999999995},"min":{"1min":0.42399999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.66400000000000003}]},{"osd":9,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.74199999999999999,"15min":0.73499999999999999},"min":{"1min":0.504,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.83699999999999997,"15min":0.81299999999999994},"min":{"1min":0.629,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.984,"5min":2.984,"15min":2.984},"last":0.77000000000000002}]},{"osd":10,"last update":"Fri Aug 11 12:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.82999999999999996,"15min":0.82099999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77000000000000002,"15min":0.76200000000000001},"min":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.75700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34304,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34304,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":6072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":5578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-11T12:24:21.731 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-08-11T12:24:21.731 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-11T12:24:21.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.963+0000 7f2037bff700 1 -- 172.21.15.8:0/1898877636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20301009e0 msgr2=0x7f2030100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:21.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.963+0000 7f2037bff700 1 --2- 172.21.15.8:0/1898877636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20301009e0 0x7f2030100e00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f202c009990 tx=0x7f202c009ca0 comp rx=0 tx=0).stop 2023-08-11T12:24:21.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.963+0000 7f2037bff700 1 -- 172.21.15.8:0/1898877636 shutdown_connections 2023-08-11T12:24:21.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.963+0000 7f2037bff700 1 --2- 172.21.15.8:0/1898877636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20301009e0 0x7f2030100e00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:21.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.963+0000 7f2037bff700 1 --2- 172.21.15.8:0/1898877636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2030102570 0x7f2030108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:21.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.963+0000 7f2037bff700 1 --2- 172.21.15.8:0/1898877636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2030101bd0 0x7f2030102030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:21.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.963+0000 7f2037bff700 1 -- 172.21.15.8:0/1898877636 >> 172.21.15.8:0/1898877636 conn(0x7f20300fbf50 msgr2=0x7f20300fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:21.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.963+0000 7f2037bff700 1 -- 172.21.15.8:0/1898877636 shutdown_connections 2023-08-11T12:24:21.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.963+0000 7f2037bff700 1 -- 172.21.15.8:0/1898877636 wait complete. 2023-08-11T12:24:21.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.965+0000 7f2037bff700 1 Processor -- start 2023-08-11T12:24:21.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.965+0000 7f2037bff700 1 -- start start 2023-08-11T12:24:21.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.965+0000 7f2037bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20301009e0 0x7f2030198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:21.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.965+0000 7f2037bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2030101bd0 0x7f2030198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:21.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.965+0000 7f2037bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2030102570 0x7f203019ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:21.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.965+0000 7f2037bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20301a04d0 con 0x7f20301009e0 2023-08-11T12:24:21.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.965+0000 7f2037bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20301a0610 con 0x7f2030101bd0 2023-08-11T12:24:21.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.965+0000 7f2037bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20301a07a0 con 0x7f2030102570 2023-08-11T12:24:21.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.966+0000 7f203599b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20301009e0 0x7f2030198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:21.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.966+0000 7f203599b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20301009e0 0x7f2030198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46774/0 (socket says 172.21.15.8:46774) 2023-08-11T12:24:21.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.966+0000 7f203599b700 1 -- 172.21.15.8:0/816577476 learned_addr learned my addr 172.21.15.8:0/816577476 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:21.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.966+0000 7f203519a700 1 --2- 172.21.15.8:0/816577476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2030101bd0 0x7f2030198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:21.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.966+0000 7f203619c700 1 --2- 172.21.15.8:0/816577476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2030102570 0x7f203019ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:21.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.966+0000 7f203599b700 1 -- 172.21.15.8:0/816577476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2030102570 msgr2=0x7f203019ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:21.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.966+0000 7f203599b700 1 --2- 172.21.15.8:0/816577476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2030102570 0x7f203019ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:21.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.966+0000 7f203599b700 1 -- 172.21.15.8:0/816577476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2030101bd0 msgr2=0x7f2030198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:21.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.966+0000 7f203599b700 1 --2- 172.21.15.8:0/816577476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2030101bd0 0x7f2030198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:21.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.966+0000 7f203599b700 1 -- 172.21.15.8:0/816577476 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2028009c40 con 0x7f20301009e0 2023-08-11T12:24:21.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.966+0000 7f203599b700 1 --2- 172.21.15.8:0/816577476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20301009e0 0x7f2030198950 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f202c005720 tx=0x7f202c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:21.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.967+0000 7f2026ffd700 1 -- 172.21.15.8:0/816577476 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202c01d070 con 0x7f20301009e0 2023-08-11T12:24:21.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.967+0000 7f2037bff700 1 -- 172.21.15.8:0/816577476 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202c0095f0 con 0x7f20301009e0 2023-08-11T12:24:21.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.967+0000 7f2026ffd700 1 -- 172.21.15.8:0/816577476 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f202c021410 con 0x7f20301009e0 2023-08-11T12:24:21.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.967+0000 7f2026ffd700 1 -- 172.21.15.8:0/816577476 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202c017650 con 0x7f20301009e0 2023-08-11T12:24:21.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.967+0000 7f2037bff700 1 -- 172.21.15.8:0/816577476 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20301a0d10 con 0x7f20301009e0 2023-08-11T12:24:21.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.968+0000 7f2037bff700 1 -- 172.21.15.8:0/816577476 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f203010c240 con 0x7f20301009e0 2023-08-11T12:24:21.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.972+0000 7f2026ffd700 1 -- 172.21.15.8:0/816577476 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f202c021580 con 0x7f20301009e0 2023-08-11T12:24:21.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.973+0000 7f2026ffd700 1 --2- 172.21.15.8:0/816577476 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f201c09ff50 0x7f201c0a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:21.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.973+0000 7f2026ffd700 1 -- 172.21.15.8:0/816577476 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f202c0ccb20 con 0x7f20301009e0 2023-08-11T12:24:21.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.973+0000 7f203519a700 1 --2- 172.21.15.8:0/816577476 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f201c09ff50 0x7f201c0a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:21.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.974+0000 7f203519a700 1 --2- 172.21.15.8:0/816577476 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f201c09ff50 0x7f201c0a2410 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2020009c60 tx=0x7f2020009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:21.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:21.975+0000 7f2026ffd700 1 -- 172.21.15.8:0/816577476 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f202c0965d0 con 0x7f20301009e0 2023-08-11T12:24:22.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:21 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/25182436' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:24:22.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:21 smithi008 ceph-mon[97158]: from='client.15471 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:24:22.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:21 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/25182436' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:24:22.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:21 smithi194 ceph-mon[130905]: from='client.15471 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:24:22.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:21 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/25182436' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:24:22.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:21 smithi045 ceph-mon[130284]: from='client.15471 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:24:22.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.184+0000 7f2037bff700 1 -- 172.21.15.8:0/816577476 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2030108560 con 0x7f201c09ff50 2023-08-11T12:24:22.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.197+0000 7f2026ffd700 1 -- 172.21.15.8:0/816577476 <== mgr.14150 v2:172.21.15.8:6800/2041276411 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426663 (secure 0 0 0) 0x7f2030108560 con 0x7f201c09ff50 2023-08-11T12:24:22.203 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:22.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.202+0000 7f2037bff700 1 -- 172.21.15.8:0/816577476 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f201c09ff50 msgr2=0x7f201c0a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:22.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.202+0000 7f2037bff700 1 --2- 172.21.15.8:0/816577476 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f201c09ff50 0x7f201c0a2410 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2020009c60 tx=0x7f2020009260 comp rx=0 tx=0).stop 2023-08-11T12:24:22.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.202+0000 7f2037bff700 1 -- 172.21.15.8:0/816577476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20301009e0 msgr2=0x7f2030198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:22.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.202+0000 7f2037bff700 1 --2- 172.21.15.8:0/816577476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20301009e0 0x7f2030198950 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f202c005720 tx=0x7f202c009580 comp rx=0 tx=0).stop 2023-08-11T12:24:22.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.202+0000 7f2037bff700 1 -- 172.21.15.8:0/816577476 shutdown_connections 2023-08-11T12:24:22.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.202+0000 7f2037bff700 1 --2- 172.21.15.8:0/816577476 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f201c09ff50 0x7f201c0a2410 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:22.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.202+0000 7f2037bff700 1 --2- 172.21.15.8:0/816577476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2030102570 0x7f203019ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:22.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.202+0000 7f2037bff700 1 --2- 172.21.15.8:0/816577476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20301009e0 0x7f2030198950 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:22.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.202+0000 7f2037bff700 1 --2- 172.21.15.8:0/816577476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2030101bd0 0x7f2030198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:22.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.202+0000 7f2037bff700 1 -- 172.21.15.8:0/816577476 >> 172.21.15.8:0/816577476 conn(0x7f20300fbf50 msgr2=0x7f20300fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:22.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.202+0000 7f2037bff700 1 -- 172.21.15.8:0/816577476 shutdown_connections 2023-08-11T12:24:22.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.202+0000 7f2037bff700 1 -- 172.21.15.8:0/816577476 wait complete. 2023-08-11T12:24:22.207 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-08-11T12:24:22.223 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":344,"stamp":"2023-08-11T12:24:20.542967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600890,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1249,"num_read_kb":695,"num_write":392,"num_write_kb":3007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":322,"ondisk_log_size":322,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336040,"kb_used_data":11796,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124605784,"statfs":{"total":1151940427776,"available":1151596322816,"internally_reserved":0,"allocated":12079104,"data_stored":7599223,"data_compressed":318882,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":258,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":71,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003088"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720975+0000","last_change":"2023-08-11T12:22:03.850538+0000","last_active":"2023-08-11T12:22:31.720975+0000","last_peered":"2023-08-11T12:22:31.720975+0000","last_clean":"2023-08-11T12:22:31.720975+0000","last_became_active":"2023-08-11T12:22:03.850220+0000","last_became_peered":"2023-08-11T12:22:03.850220+0000","last_unstale":"2023-08-11T12:22:31.720975+0000","last_undegraded":"2023-08-11T12:22:31.720975+0000","last_fullsized":"2023-08-11T12:22:31.720975+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:10:46.194341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720154+0000","last_change":"2023-08-11T12:22:03.843779+0000","last_active":"2023-08-11T12:22:31.720154+0000","last_peered":"2023-08-11T12:22:31.720154+0000","last_clean":"2023-08-11T12:22:31.720154+0000","last_became_active":"2023-08-11T12:22:03.843441+0000","last_became_peered":"2023-08-11T12:22:03.843441+0000","last_unstale":"2023-08-11T12:22:31.720154+0000","last_undegraded":"2023-08-11T12:22:31.720154+0000","last_fullsized":"2023-08-11T12:22:31.720154+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:51:42.363862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719149+0000","last_change":"2023-08-11T12:22:03.851996+0000","last_active":"2023-08-11T12:22:31.719149+0000","last_peered":"2023-08-11T12:22:31.719149+0000","last_clean":"2023-08-11T12:22:31.719149+0000","last_became_active":"2023-08-11T12:22:03.850821+0000","last_became_peered":"2023-08-11T12:22:03.850821+0000","last_unstale":"2023-08-11T12:22:31.719149+0000","last_undegraded":"2023-08-11T12:22:31.719149+0000","last_fullsized":"2023-08-11T12:22:31.719149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:54:54.152911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722124+0000","last_change":"2023-08-11T12:22:03.842025+0000","last_active":"2023-08-11T12:22:31.722124+0000","last_peered":"2023-08-11T12:22:31.722124+0000","last_clean":"2023-08-11T12:22:31.722124+0000","last_became_active":"2023-08-11T12:22:03.841700+0000","last_became_peered":"2023-08-11T12:22:03.841700+0000","last_unstale":"2023-08-11T12:22:31.722124+0000","last_undegraded":"2023-08-11T12:22:31.722124+0000","last_fullsized":"2023-08-11T12:22:31.722124+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:13:45.519007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723174+0000","last_change":"2023-08-11T12:22:03.844908+0000","last_active":"2023-08-11T12:22:31.723174+0000","last_peered":"2023-08-11T12:22:31.723174+0000","last_clean":"2023-08-11T12:22:31.723174+0000","last_became_active":"2023-08-11T12:22:03.844674+0000","last_became_peered":"2023-08-11T12:22:03.844674+0000","last_unstale":"2023-08-11T12:22:31.723174+0000","last_undegraded":"2023-08-11T12:22:31.723174+0000","last_fullsized":"2023-08-11T12:22:31.723174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:10:22.657255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721437+0000","last_change":"2023-08-11T12:22:03.839915+0000","last_active":"2023-08-11T12:22:31.721437+0000","last_peered":"2023-08-11T12:22:31.721437+0000","last_clean":"2023-08-11T12:22:31.721437+0000","last_became_active":"2023-08-11T12:22:03.839099+0000","last_became_peered":"2023-08-11T12:22:03.839099+0000","last_unstale":"2023-08-11T12:22:31.721437+0000","last_undegraded":"2023-08-11T12:22:31.721437+0000","last_fullsized":"2023-08-11T12:22:31.721437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:51:17.642383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717754+0000","last_change":"2023-08-11T12:22:03.841591+0000","last_active":"2023-08-11T12:22:31.717754+0000","last_peered":"2023-08-11T12:22:31.717754+0000","last_clean":"2023-08-11T12:22:31.717754+0000","last_became_active":"2023-08-11T12:22:03.841232+0000","last_became_peered":"2023-08-11T12:22:03.841232+0000","last_unstale":"2023-08-11T12:22:31.717754+0000","last_undegraded":"2023-08-11T12:22:31.717754+0000","last_fullsized":"2023-08-11T12:22:31.717754+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:12:40.032896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720595+0000","last_change":"2023-08-11T12:22:03.839516+0000","last_active":"2023-08-11T12:22:31.720595+0000","last_peered":"2023-08-11T12:22:31.720595+0000","last_clean":"2023-08-11T12:22:31.720595+0000","last_became_active":"2023-08-11T12:22:03.839058+0000","last_became_peered":"2023-08-11T12:22:03.839058+0000","last_unstale":"2023-08-11T12:22:31.720595+0000","last_undegraded":"2023-08-11T12:22:31.720595+0000","last_fullsized":"2023-08-11T12:22:31.720595+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:01:10.744970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774871+0000","last_change":"2023-08-11T12:22:03.841033+0000","last_active":"2023-08-11T12:22:31.774871+0000","last_peered":"2023-08-11T12:22:31.774871+0000","last_clean":"2023-08-11T12:22:31.774871+0000","last_became_active":"2023-08-11T12:22:03.840665+0000","last_became_peered":"2023-08-11T12:22:03.840665+0000","last_unstale":"2023-08-11T12:22:31.774871+0000","last_undegraded":"2023-08-11T12:22:31.774871+0000","last_fullsized":"2023-08-11T12:22:31.774871+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:08:51.628782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721119+0000","last_change":"2023-08-11T12:22:03.839663+0000","last_active":"2023-08-11T12:22:31.721119+0000","last_peered":"2023-08-11T12:22:31.721119+0000","last_clean":"2023-08-11T12:22:31.721119+0000","last_became_active":"2023-08-11T12:22:03.838840+0000","last_became_peered":"2023-08-11T12:22:03.838840+0000","last_unstale":"2023-08-11T12:22:31.721119+0000","last_undegraded":"2023-08-11T12:22:31.721119+0000","last_fullsized":"2023-08-11T12:22:31.721119+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:28:57.495510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717811+0000","last_change":"2023-08-11T12:22:03.846288+0000","last_active":"2023-08-11T12:22:31.717811+0000","last_peered":"2023-08-11T12:22:31.717811+0000","last_clean":"2023-08-11T12:22:31.717811+0000","last_became_active":"2023-08-11T12:22:03.845962+0000","last_became_peered":"2023-08-11T12:22:03.845962+0000","last_unstale":"2023-08-11T12:22:31.717811+0000","last_undegraded":"2023-08-11T12:22:31.717811+0000","last_fullsized":"2023-08-11T12:22:31.717811+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:42:37.154687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.728022+0000","last_change":"2023-08-11T12:22:31.726774+0000","last_active":"2023-08-11T12:22:31.728022+0000","last_peered":"2023-08-11T12:22:31.728022+0000","last_clean":"2023-08-11T12:22:31.728022+0000","last_became_active":"2023-08-11T12:22:31.726437+0000","last_became_peered":"2023-08-11T12:22:31.726437+0000","last_unstale":"2023-08-11T12:22:31.728022+0000","last_undegraded":"2023-08-11T12:22:31.728022+0000","last_fullsized":"2023-08-11T12:22:31.728022+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:33:56.005318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717500+0000","last_change":"2023-08-11T12:22:03.842249+0000","last_active":"2023-08-11T12:22:31.717500+0000","last_peered":"2023-08-11T12:22:31.717500+0000","last_clean":"2023-08-11T12:22:31.717500+0000","last_became_active":"2023-08-11T12:22:03.841887+0000","last_became_peered":"2023-08-11T12:22:03.841887+0000","last_unstale":"2023-08-11T12:22:31.717500+0000","last_undegraded":"2023-08-11T12:22:31.717500+0000","last_fullsized":"2023-08-11T12:22:31.717500+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:24:16.685728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718746+0000","last_change":"2023-08-11T12:22:03.843859+0000","last_active":"2023-08-11T12:22:31.718746+0000","last_peered":"2023-08-11T12:22:31.718746+0000","last_clean":"2023-08-11T12:22:31.718746+0000","last_became_active":"2023-08-11T12:22:03.843383+0000","last_became_peered":"2023-08-11T12:22:03.843383+0000","last_unstale":"2023-08-11T12:22:31.718746+0000","last_undegraded":"2023-08-11T12:22:31.718746+0000","last_fullsized":"2023-08-11T12:22:31.718746+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:19:55.006972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.726241+0000","last_change":"2023-08-11T12:22:31.726241+0000","last_active":"2023-08-11T12:22:31.726241+0000","last_peered":"2023-08-11T12:22:31.726241+0000","last_clean":"2023-08-11T12:22:31.726241+0000","last_became_active":"2023-08-11T12:22:31.725852+0000","last_became_peered":"2023-08-11T12:22:31.725852+0000","last_unstale":"2023-08-11T12:22:31.726241+0000","last_undegraded":"2023-08-11T12:22:31.726241+0000","last_fullsized":"2023-08-11T12:22:31.726241+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:37:58.350171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774047+0000","last_change":"2023-08-11T12:22:03.850397+0000","last_active":"2023-08-11T12:22:31.774047+0000","last_peered":"2023-08-11T12:22:31.774047+0000","last_clean":"2023-08-11T12:22:31.774047+0000","last_became_active":"2023-08-11T12:22:03.850143+0000","last_became_peered":"2023-08-11T12:22:03.850143+0000","last_unstale":"2023-08-11T12:22:31.774047+0000","last_undegraded":"2023-08-11T12:22:31.774047+0000","last_fullsized":"2023-08-11T12:22:31.774047+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:13:22.558148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721002+0000","last_change":"2023-08-11T12:22:03.850496+0000","last_active":"2023-08-11T12:22:31.721002+0000","last_peered":"2023-08-11T12:22:31.721002+0000","last_clean":"2023-08-11T12:22:31.721002+0000","last_became_active":"2023-08-11T12:22:03.850192+0000","last_became_peered":"2023-08-11T12:22:03.850192+0000","last_unstale":"2023-08-11T12:22:31.721002+0000","last_undegraded":"2023-08-11T12:22:31.721002+0000","last_fullsized":"2023-08-11T12:22:31.721002+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:54:50.626326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722136+0000","last_change":"2023-08-11T12:22:03.841706+0000","last_active":"2023-08-11T12:22:31.722136+0000","last_peered":"2023-08-11T12:22:31.722136+0000","last_clean":"2023-08-11T12:22:31.722136+0000","last_became_active":"2023-08-11T12:22:03.841341+0000","last_became_peered":"2023-08-11T12:22:03.841341+0000","last_unstale":"2023-08-11T12:22:31.722136+0000","last_undegraded":"2023-08-11T12:22:31.722136+0000","last_fullsized":"2023-08-11T12:22:31.722136+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:36:20.093373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.724897+0000","last_change":"2023-08-11T12:22:03.834450+0000","last_active":"2023-08-11T12:22:31.724897+0000","last_peered":"2023-08-11T12:22:31.724897+0000","last_clean":"2023-08-11T12:22:31.724897+0000","last_became_active":"2023-08-11T12:22:03.834154+0000","last_became_peered":"2023-08-11T12:22:03.834154+0000","last_unstale":"2023-08-11T12:22:31.724897+0000","last_undegraded":"2023-08-11T12:22:31.724897+0000","last_fullsized":"2023-08-11T12:22:31.724897+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:08:49.920575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.727577+0000","last_change":"2023-08-11T12:22:31.727577+0000","last_active":"2023-08-11T12:22:31.727577+0000","last_peered":"2023-08-11T12:22:31.727577+0000","last_clean":"2023-08-11T12:22:31.727577+0000","last_became_active":"2023-08-11T12:22:31.727034+0000","last_became_peered":"2023-08-11T12:22:31.727034+0000","last_unstale":"2023-08-11T12:22:31.727577+0000","last_undegraded":"2023-08-11T12:22:31.727577+0000","last_fullsized":"2023-08-11T12:22:31.727577+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:14:44.681877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":146,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:24:15.861425+0000","last_change":"2023-08-11T12:22:02.841759+0000","last_active":"2023-08-11T12:24:15.861425+0000","last_peered":"2023-08-11T12:24:15.861425+0000","last_clean":"2023-08-11T12:24:15.861425+0000","last_became_active":"2023-08-11T12:22:02.841326+0000","last_became_peered":"2023-08-11T12:22:02.841326+0000","last_unstale":"2023-08-11T12:24:15.861425+0000","last_undegraded":"2023-08-11T12:24:15.861425+0000","last_fullsized":"2023-08-11T12:24:15.861425+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:09:30.085287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.802211+0000","last_change":"2023-08-11T12:22:31.801910+0000","last_active":"2023-08-11T12:22:31.802211+0000","last_peered":"2023-08-11T12:22:31.802211+0000","last_clean":"2023-08-11T12:22:31.802211+0000","last_became_active":"2023-08-11T12:22:31.801479+0000","last_became_peered":"2023-08-11T12:22:31.801479+0000","last_unstale":"2023-08-11T12:22:31.802211+0000","last_undegraded":"2023-08-11T12:22:31.802211+0000","last_fullsized":"2023-08-11T12:22:31.802211+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:52:21.489431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720477+0000","last_change":"2023-08-11T12:22:07.875010+0000","last_active":"2023-08-11T12:22:31.720477+0000","last_peered":"2023-08-11T12:22:31.720477+0000","last_clean":"2023-08-11T12:22:31.720477+0000","last_became_active":"2023-08-11T12:22:07.874474+0000","last_became_peered":"2023-08-11T12:22:07.874474+0000","last_unstale":"2023-08-11T12:22:31.720477+0000","last_undegraded":"2023-08-11T12:22:31.720477+0000","last_fullsized":"2023-08-11T12:22:31.720477+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:41:20.795124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721193+0000","last_change":"2023-08-11T12:22:02.848299+0000","last_active":"2023-08-11T12:22:31.721193+0000","last_peered":"2023-08-11T12:22:31.721193+0000","last_clean":"2023-08-11T12:22:31.721193+0000","last_became_active":"2023-08-11T12:22:02.847869+0000","last_became_peered":"2023-08-11T12:22:02.847869+0000","last_unstale":"2023-08-11T12:22:31.721193+0000","last_undegraded":"2023-08-11T12:22:31.721193+0000","last_fullsized":"2023-08-11T12:22:31.721193+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:09:15.600582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719871+0000","last_change":"2023-08-11T12:22:03.841173+0000","last_active":"2023-08-11T12:22:31.719871+0000","last_peered":"2023-08-11T12:22:31.719871+0000","last_clean":"2023-08-11T12:22:31.719871+0000","last_became_active":"2023-08-11T12:22:03.840882+0000","last_became_peered":"2023-08-11T12:22:03.840882+0000","last_unstale":"2023-08-11T12:22:31.719871+0000","last_undegraded":"2023-08-11T12:22:31.719871+0000","last_fullsized":"2023-08-11T12:22:31.719871+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:50:28.937358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721470+0000","last_change":"2023-08-11T12:22:07.880756+0000","last_active":"2023-08-11T12:22:31.721470+0000","last_peered":"2023-08-11T12:22:31.721470+0000","last_clean":"2023-08-11T12:22:31.721470+0000","last_became_active":"2023-08-11T12:22:07.878866+0000","last_became_peered":"2023-08-11T12:22:07.878866+0000","last_unstale":"2023-08-11T12:22:31.721470+0000","last_undegraded":"2023-08-11T12:22:31.721470+0000","last_fullsized":"2023-08-11T12:22:31.721470+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:30:28.617039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:32.698559+0000","last_change":"2023-08-11T12:22:02.848543+0000","last_active":"2023-08-11T12:22:32.698559+0000","last_peered":"2023-08-11T12:22:32.698559+0000","last_clean":"2023-08-11T12:22:32.698559+0000","last_became_active":"2023-08-11T12:22:02.848008+0000","last_became_peered":"2023-08-11T12:22:02.848008+0000","last_unstale":"2023-08-11T12:22:32.698559+0000","last_undegraded":"2023-08-11T12:22:32.698559+0000","last_fullsized":"2023-08-11T12:22:32.698559+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:57:46.484932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774382+0000","last_change":"2023-08-11T12:22:03.843651+0000","last_active":"2023-08-11T12:22:31.774382+0000","last_peered":"2023-08-11T12:22:31.774382+0000","last_clean":"2023-08-11T12:22:31.774382+0000","last_became_active":"2023-08-11T12:22:03.843392+0000","last_became_peered":"2023-08-11T12:22:03.843392+0000","last_unstale":"2023-08-11T12:22:31.774382+0000","last_undegraded":"2023-08-11T12:22:31.774382+0000","last_fullsized":"2023-08-11T12:22:31.774382+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:27:25.825805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721058+0000","last_change":"2023-08-11T12:22:07.879373+0000","last_active":"2023-08-11T12:22:31.721058+0000","last_peered":"2023-08-11T12:22:31.721058+0000","last_clean":"2023-08-11T12:22:31.721058+0000","last_became_active":"2023-08-11T12:22:07.878929+0000","last_became_peered":"2023-08-11T12:22:07.878929+0000","last_unstale":"2023-08-11T12:22:31.721058+0000","last_undegraded":"2023-08-11T12:22:31.721058+0000","last_fullsized":"2023-08-11T12:22:31.721058+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:37:29.598815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723705+0000","last_change":"2023-08-11T12:22:02.841984+0000","last_active":"2023-08-11T12:22:31.723705+0000","last_peered":"2023-08-11T12:22:31.723705+0000","last_clean":"2023-08-11T12:22:31.723705+0000","last_became_active":"2023-08-11T12:22:02.841585+0000","last_became_peered":"2023-08-11T12:22:02.841585+0000","last_unstale":"2023-08-11T12:22:31.723705+0000","last_undegraded":"2023-08-11T12:22:31.723705+0000","last_fullsized":"2023-08-11T12:22:31.723705+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:18:28.740155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800688+0000","last_change":"2023-08-11T12:22:03.839381+0000","last_active":"2023-08-11T12:22:31.800688+0000","last_peered":"2023-08-11T12:22:31.800688+0000","last_clean":"2023-08-11T12:22:31.800688+0000","last_became_active":"2023-08-11T12:22:03.839091+0000","last_became_peered":"2023-08-11T12:22:03.839091+0000","last_unstale":"2023-08-11T12:22:31.800688+0000","last_undegraded":"2023-08-11T12:22:31.800688+0000","last_fullsized":"2023-08-11T12:22:31.800688+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:45:52.205138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722725+0000","last_change":"2023-08-11T12:22:07.881758+0000","last_active":"2023-08-11T12:22:31.722725+0000","last_peered":"2023-08-11T12:22:31.722725+0000","last_clean":"2023-08-11T12:22:31.722725+0000","last_became_active":"2023-08-11T12:22:07.881305+0000","last_became_peered":"2023-08-11T12:22:07.881305+0000","last_unstale":"2023-08-11T12:22:31.722725+0000","last_undegraded":"2023-08-11T12:22:31.722725+0000","last_fullsized":"2023-08-11T12:22:31.722725+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:25:48.595182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":143,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:24:15.836803+0000","last_change":"2023-08-11T12:22:02.844138+0000","last_active":"2023-08-11T12:24:15.836803+0000","last_peered":"2023-08-11T12:24:15.836803+0000","last_clean":"2023-08-11T12:24:15.836803+0000","last_became_active":"2023-08-11T12:22:02.843234+0000","last_became_peered":"2023-08-11T12:22:02.843234+0000","last_unstale":"2023-08-11T12:24:15.836803+0000","last_undegraded":"2023-08-11T12:24:15.836803+0000","last_fullsized":"2023-08-11T12:24:15.836803+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:53:48.033181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723640+0000","last_change":"2023-08-11T12:22:03.845450+0000","last_active":"2023-08-11T12:22:31.723640+0000","last_peered":"2023-08-11T12:22:31.723640+0000","last_clean":"2023-08-11T12:22:31.723640+0000","last_became_active":"2023-08-11T12:22:03.845170+0000","last_became_peered":"2023-08-11T12:22:03.845170+0000","last_unstale":"2023-08-11T12:22:31.723640+0000","last_undegraded":"2023-08-11T12:22:31.723640+0000","last_fullsized":"2023-08-11T12:22:31.723640+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:35:09.789210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722268+0000","last_change":"2023-08-11T12:22:07.880663+0000","last_active":"2023-08-11T12:22:31.722268+0000","last_peered":"2023-08-11T12:22:31.722268+0000","last_clean":"2023-08-11T12:22:31.722268+0000","last_became_active":"2023-08-11T12:22:07.880282+0000","last_became_peered":"2023-08-11T12:22:07.880282+0000","last_unstale":"2023-08-11T12:22:31.722268+0000","last_undegraded":"2023-08-11T12:22:31.722268+0000","last_fullsized":"2023-08-11T12:22:31.722268+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:36:05.356885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"87'7","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721289+0000","last_change":"2023-08-11T12:22:02.842206+0000","last_active":"2023-08-11T12:22:31.721289+0000","last_peered":"2023-08-11T12:22:31.721289+0000","last_clean":"2023-08-11T12:22:31.721289+0000","last_became_active":"2023-08-11T12:22:02.841815+0000","last_became_peered":"2023-08-11T12:22:02.841815+0000","last_unstale":"2023-08-11T12:22:31.721289+0000","last_undegraded":"2023-08-11T12:22:31.721289+0000","last_fullsized":"2023-08-11T12:22:31.721289+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:15:01.305404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800934+0000","last_change":"2023-08-11T12:22:03.825886+0000","last_active":"2023-08-11T12:22:31.800934+0000","last_peered":"2023-08-11T12:22:31.800934+0000","last_clean":"2023-08-11T12:22:31.800934+0000","last_became_active":"2023-08-11T12:22:03.825645+0000","last_became_peered":"2023-08-11T12:22:03.825645+0000","last_unstale":"2023-08-11T12:22:31.800934+0000","last_undegraded":"2023-08-11T12:22:31.800934+0000","last_fullsized":"2023-08-11T12:22:31.800934+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-13T00:03:34.650801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720482+0000","last_change":"2023-08-11T12:22:07.890216+0000","last_active":"2023-08-11T12:22:31.720482+0000","last_peered":"2023-08-11T12:22:31.720482+0000","last_clean":"2023-08-11T12:22:31.720482+0000","last_became_active":"2023-08-11T12:22:07.889860+0000","last_became_peered":"2023-08-11T12:22:07.889860+0000","last_unstale":"2023-08-11T12:22:31.720482+0000","last_undegraded":"2023-08-11T12:22:31.720482+0000","last_fullsized":"2023-08-11T12:22:31.720482+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:03:54.952887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.716962+0000","last_change":"2023-08-11T12:22:02.835703+0000","last_active":"2023-08-11T12:22:31.716962+0000","last_peered":"2023-08-11T12:22:31.716962+0000","last_clean":"2023-08-11T12:22:31.716962+0000","last_became_active":"2023-08-11T12:22:02.835300+0000","last_became_peered":"2023-08-11T12:22:02.835300+0000","last_unstale":"2023-08-11T12:22:31.716962+0000","last_undegraded":"2023-08-11T12:22:31.716962+0000","last_fullsized":"2023-08-11T12:22:31.716962+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:55:13.953193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720447+0000","last_change":"2023-08-11T12:22:03.835619+0000","last_active":"2023-08-11T12:22:31.720447+0000","last_peered":"2023-08-11T12:22:31.720447+0000","last_clean":"2023-08-11T12:22:31.720447+0000","last_became_active":"2023-08-11T12:22:03.835365+0000","last_became_peered":"2023-08-11T12:22:03.835365+0000","last_unstale":"2023-08-11T12:22:31.720447+0000","last_undegraded":"2023-08-11T12:22:31.720447+0000","last_fullsized":"2023-08-11T12:22:31.720447+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:36:40.129412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719415+0000","last_change":"2023-08-11T12:22:07.893736+0000","last_active":"2023-08-11T12:22:31.719415+0000","last_peered":"2023-08-11T12:22:31.719415+0000","last_clean":"2023-08-11T12:22:31.719415+0000","last_became_active":"2023-08-11T12:22:07.893160+0000","last_became_peered":"2023-08-11T12:22:07.893160+0000","last_unstale":"2023-08-11T12:22:31.719415+0000","last_undegraded":"2023-08-11T12:22:31.719415+0000","last_fullsized":"2023-08-11T12:22:31.719415+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:55:46.234346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800174+0000","last_change":"2023-08-11T12:22:02.843819+0000","last_active":"2023-08-11T12:22:31.800174+0000","last_peered":"2023-08-11T12:22:31.800174+0000","last_clean":"2023-08-11T12:22:31.800174+0000","last_became_active":"2023-08-11T12:22:02.843062+0000","last_became_peered":"2023-08-11T12:22:02.843062+0000","last_unstale":"2023-08-11T12:22:31.800174+0000","last_undegraded":"2023-08-11T12:22:31.800174+0000","last_fullsized":"2023-08-11T12:22:31.800174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:59:34.378593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722599+0000","last_change":"2023-08-11T12:22:03.845985+0000","last_active":"2023-08-11T12:22:31.722599+0000","last_peered":"2023-08-11T12:22:31.722599+0000","last_clean":"2023-08-11T12:22:31.722599+0000","last_became_active":"2023-08-11T12:22:03.845274+0000","last_became_peered":"2023-08-11T12:22:03.845274+0000","last_unstale":"2023-08-11T12:22:31.722599+0000","last_undegraded":"2023-08-11T12:22:31.722599+0000","last_fullsized":"2023-08-11T12:22:31.722599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:51:23.239546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.775632+0000","last_change":"2023-08-11T12:22:31.775632+0000","last_active":"2023-08-11T12:22:31.775632+0000","last_peered":"2023-08-11T12:22:31.775632+0000","last_clean":"2023-08-11T12:22:31.775632+0000","last_became_active":"2023-08-11T12:22:31.775282+0000","last_became_peered":"2023-08-11T12:22:31.775282+0000","last_unstale":"2023-08-11T12:22:31.775632+0000","last_undegraded":"2023-08-11T12:22:31.775632+0000","last_fullsized":"2023-08-11T12:22:31.775632+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:59:53.378227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,8],"acting":[3,7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"89'5","reported_seq":250,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:24:19.841628+0000","last_change":"2023-08-11T12:22:02.836591+0000","last_active":"2023-08-11T12:24:19.841628+0000","last_peered":"2023-08-11T12:24:19.841628+0000","last_clean":"2023-08-11T12:24:19.841628+0000","last_became_active":"2023-08-11T12:22:02.836223+0000","last_became_peered":"2023-08-11T12:22:02.836223+0000","last_unstale":"2023-08-11T12:24:19.841628+0000","last_undegraded":"2023-08-11T12:24:19.841628+0000","last_fullsized":"2023-08-11T12:24:19.841628+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:30:37.183588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":219,"num_read_kb":219,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774757+0000","last_change":"2023-08-11T12:22:03.841719+0000","last_active":"2023-08-11T12:22:31.774757+0000","last_peered":"2023-08-11T12:22:31.774757+0000","last_clean":"2023-08-11T12:22:31.774757+0000","last_became_active":"2023-08-11T12:22:03.841381+0000","last_became_peered":"2023-08-11T12:22:03.841381+0000","last_unstale":"2023-08-11T12:22:31.774757+0000","last_undegraded":"2023-08-11T12:22:31.774757+0000","last_fullsized":"2023-08-11T12:22:31.774757+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:29:35.108655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721200+0000","last_change":"2023-08-11T12:22:07.889103+0000","last_active":"2023-08-11T12:22:31.721200+0000","last_peered":"2023-08-11T12:22:31.721200+0000","last_clean":"2023-08-11T12:22:31.721200+0000","last_became_active":"2023-08-11T12:22:07.888668+0000","last_became_peered":"2023-08-11T12:22:07.888668+0000","last_unstale":"2023-08-11T12:22:31.721200+0000","last_undegraded":"2023-08-11T12:22:31.721200+0000","last_fullsized":"2023-08-11T12:22:31.721200+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:55:40.004921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717773+0000","last_change":"2023-08-11T12:22:02.841934+0000","last_active":"2023-08-11T12:22:31.717773+0000","last_peered":"2023-08-11T12:22:31.717773+0000","last_clean":"2023-08-11T12:22:31.717773+0000","last_became_active":"2023-08-11T12:22:02.841598+0000","last_became_peered":"2023-08-11T12:22:02.841598+0000","last_unstale":"2023-08-11T12:22:31.717773+0000","last_undegraded":"2023-08-11T12:22:31.717773+0000","last_fullsized":"2023-08-11T12:22:31.717773+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:20:04.206298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719796+0000","last_change":"2023-08-11T12:22:03.848901+0000","last_active":"2023-08-11T12:22:31.719796+0000","last_peered":"2023-08-11T12:22:31.719796+0000","last_clean":"2023-08-11T12:22:31.719796+0000","last_became_active":"2023-08-11T12:22:03.848518+0000","last_became_peered":"2023-08-11T12:22:03.848518+0000","last_unstale":"2023-08-11T12:22:31.719796+0000","last_undegraded":"2023-08-11T12:22:31.719796+0000","last_fullsized":"2023-08-11T12:22:31.719796+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:20:08.007934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.775821+0000","last_change":"2023-08-11T12:22:31.775821+0000","last_active":"2023-08-11T12:22:31.775821+0000","last_peered":"2023-08-11T12:22:31.775821+0000","last_clean":"2023-08-11T12:22:31.775821+0000","last_became_active":"2023-08-11T12:22:31.775264+0000","last_became_peered":"2023-08-11T12:22:31.775264+0000","last_unstale":"2023-08-11T12:22:31.775821+0000","last_undegraded":"2023-08-11T12:22:31.775821+0000","last_fullsized":"2023-08-11T12:22:31.775821+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:28:22.561726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"87'5","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800805+0000","last_change":"2023-08-11T12:22:02.846492+0000","last_active":"2023-08-11T12:22:31.800805+0000","last_peered":"2023-08-11T12:22:31.800805+0000","last_clean":"2023-08-11T12:22:31.800805+0000","last_became_active":"2023-08-11T12:22:02.846174+0000","last_became_peered":"2023-08-11T12:22:02.846174+0000","last_unstale":"2023-08-11T12:22:31.800805+0000","last_undegraded":"2023-08-11T12:22:31.800805+0000","last_fullsized":"2023-08-11T12:22:31.800805+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:09:18.245164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774783+0000","last_change":"2023-08-11T12:22:03.840054+0000","last_active":"2023-08-11T12:22:31.774783+0000","last_peered":"2023-08-11T12:22:31.774783+0000","last_clean":"2023-08-11T12:22:31.774783+0000","last_became_active":"2023-08-11T12:22:03.839707+0000","last_became_peered":"2023-08-11T12:22:03.839707+0000","last_unstale":"2023-08-11T12:22:31.774783+0000","last_undegraded":"2023-08-11T12:22:31.774783+0000","last_fullsized":"2023-08-11T12:22:31.774783+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:47:30.898127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.802304+0000","last_change":"2023-08-11T12:22:31.801931+0000","last_active":"2023-08-11T12:22:31.802304+0000","last_peered":"2023-08-11T12:22:31.802304+0000","last_clean":"2023-08-11T12:22:31.802304+0000","last_became_active":"2023-08-11T12:22:31.801522+0000","last_became_peered":"2023-08-11T12:22:31.801522+0000","last_unstale":"2023-08-11T12:22:31.802304+0000","last_undegraded":"2023-08-11T12:22:31.802304+0000","last_fullsized":"2023-08-11T12:22:31.802304+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:03:22.570814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.14","version":"88'14","reported_seq":264,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:24:19.841126+0000","last_change":"2023-08-11T12:22:02.836520+0000","last_active":"2023-08-11T12:24:19.841126+0000","last_peered":"2023-08-11T12:24:19.841126+0000","last_clean":"2023-08-11T12:24:19.841126+0000","last_became_active":"2023-08-11T12:22:02.836201+0000","last_became_peered":"2023-08-11T12:22:02.836201+0000","last_unstale":"2023-08-11T12:24:19.841126+0000","last_undegraded":"2023-08-11T12:24:19.841126+0000","last_fullsized":"2023-08-11T12:24:19.841126+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:58:37.750229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":224,"num_read_kb":116,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723852+0000","last_change":"2023-08-11T12:22:03.848104+0000","last_active":"2023-08-11T12:22:31.723852+0000","last_peered":"2023-08-11T12:22:31.723852+0000","last_clean":"2023-08-11T12:22:31.723852+0000","last_became_active":"2023-08-11T12:22:03.847801+0000","last_became_peered":"2023-08-11T12:22:03.847801+0000","last_unstale":"2023-08-11T12:22:31.723852+0000","last_undegraded":"2023-08-11T12:22:31.723852+0000","last_fullsized":"2023-08-11T12:22:31.723852+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:56:47.846229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.801121+0000","last_change":"2023-08-11T12:22:07.893710+0000","last_active":"2023-08-11T12:22:31.801121+0000","last_peered":"2023-08-11T12:22:31.801121+0000","last_clean":"2023-08-11T12:22:31.801121+0000","last_became_active":"2023-08-11T12:22:07.893239+0000","last_became_peered":"2023-08-11T12:22:07.893239+0000","last_unstale":"2023-08-11T12:22:31.801121+0000","last_undegraded":"2023-08-11T12:22:31.801121+0000","last_fullsized":"2023-08-11T12:22:31.801121+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:24:55.563178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.724184+0000","last_change":"2023-08-11T12:22:02.849060+0000","last_active":"2023-08-11T12:22:31.724184+0000","last_peered":"2023-08-11T12:22:31.724184+0000","last_clean":"2023-08-11T12:22:31.724184+0000","last_became_active":"2023-08-11T12:22:02.848417+0000","last_became_peered":"2023-08-11T12:22:02.848417+0000","last_unstale":"2023-08-11T12:22:31.724184+0000","last_undegraded":"2023-08-11T12:22:31.724184+0000","last_fullsized":"2023-08-11T12:22:31.724184+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:48:47.925134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717206+0000","last_change":"2023-08-11T12:22:03.848532+0000","last_active":"2023-08-11T12:22:31.717206+0000","last_peered":"2023-08-11T12:22:31.717206+0000","last_clean":"2023-08-11T12:22:31.717206+0000","last_became_active":"2023-08-11T12:22:03.848190+0000","last_became_peered":"2023-08-11T12:22:03.848190+0000","last_unstale":"2023-08-11T12:22:31.717206+0000","last_undegraded":"2023-08-11T12:22:31.717206+0000","last_fullsized":"2023-08-11T12:22:31.717206+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:24:49.898432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720024+0000","last_change":"2023-08-11T12:22:07.882785+0000","last_active":"2023-08-11T12:22:31.720024+0000","last_peered":"2023-08-11T12:22:31.720024+0000","last_clean":"2023-08-11T12:22:31.720024+0000","last_became_active":"2023-08-11T12:22:07.880643+0000","last_became_peered":"2023-08-11T12:22:07.880643+0000","last_unstale":"2023-08-11T12:22:31.720024+0000","last_undegraded":"2023-08-11T12:22:31.720024+0000","last_fullsized":"2023-08-11T12:22:31.720024+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:40:21.114572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800547+0000","last_change":"2023-08-11T12:22:02.851416+0000","last_active":"2023-08-11T12:22:31.800547+0000","last_peered":"2023-08-11T12:22:31.800547+0000","last_clean":"2023-08-11T12:22:31.800547+0000","last_became_active":"2023-08-11T12:22:02.851114+0000","last_became_peered":"2023-08-11T12:22:02.851114+0000","last_unstale":"2023-08-11T12:22:31.800547+0000","last_undegraded":"2023-08-11T12:22:31.800547+0000","last_fullsized":"2023-08-11T12:22:31.800547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:27:37.565292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717994+0000","last_change":"2023-08-11T12:22:03.849367+0000","last_active":"2023-08-11T12:22:31.717994+0000","last_peered":"2023-08-11T12:22:31.717994+0000","last_clean":"2023-08-11T12:22:31.717994+0000","last_became_active":"2023-08-11T12:22:03.849050+0000","last_became_peered":"2023-08-11T12:22:03.849050+0000","last_unstale":"2023-08-11T12:22:31.717994+0000","last_undegraded":"2023-08-11T12:22:31.717994+0000","last_fullsized":"2023-08-11T12:22:31.717994+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:54:43.936124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722616+0000","last_change":"2023-08-11T12:22:07.890992+0000","last_active":"2023-08-11T12:22:31.722616+0000","last_peered":"2023-08-11T12:22:31.722616+0000","last_clean":"2023-08-11T12:22:31.722616+0000","last_became_active":"2023-08-11T12:22:07.890384+0000","last_became_peered":"2023-08-11T12:22:07.890384+0000","last_unstale":"2023-08-11T12:22:31.722616+0000","last_undegraded":"2023-08-11T12:22:31.722616+0000","last_fullsized":"2023-08-11T12:22:31.722616+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:00:55.230221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"87'5","reported_seq":139,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:24:16.885885+0000","last_change":"2023-08-11T12:22:02.843045+0000","last_active":"2023-08-11T12:24:16.885885+0000","last_peered":"2023-08-11T12:24:16.885885+0000","last_clean":"2023-08-11T12:24:16.885885+0000","last_became_active":"2023-08-11T12:22:02.842628+0000","last_became_peered":"2023-08-11T12:22:02.842628+0000","last_unstale":"2023-08-11T12:24:16.885885+0000","last_undegraded":"2023-08-11T12:24:16.885885+0000","last_fullsized":"2023-08-11T12:24:16.885885+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:45:36.283695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717456+0000","last_change":"2023-08-11T12:22:03.842526+0000","last_active":"2023-08-11T12:22:31.717456+0000","last_peered":"2023-08-11T12:22:31.717456+0000","last_clean":"2023-08-11T12:22:31.717456+0000","last_became_active":"2023-08-11T12:22:03.842183+0000","last_became_peered":"2023-08-11T12:22:03.842183+0000","last_unstale":"2023-08-11T12:22:31.717456+0000","last_undegraded":"2023-08-11T12:22:31.717456+0000","last_fullsized":"2023-08-11T12:22:31.717456+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:20:56.195693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717389+0000","last_change":"2023-08-11T12:22:07.880768+0000","last_active":"2023-08-11T12:22:31.717389+0000","last_peered":"2023-08-11T12:22:31.717389+0000","last_clean":"2023-08-11T12:22:31.717389+0000","last_became_active":"2023-08-11T12:22:07.880335+0000","last_became_peered":"2023-08-11T12:22:07.880335+0000","last_unstale":"2023-08-11T12:22:31.717389+0000","last_undegraded":"2023-08-11T12:22:31.717389+0000","last_fullsized":"2023-08-11T12:22:31.717389+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:35:51.736025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721841+0000","last_change":"2023-08-11T12:22:02.847271+0000","last_active":"2023-08-11T12:22:31.721841+0000","last_peered":"2023-08-11T12:22:31.721841+0000","last_clean":"2023-08-11T12:22:31.721841+0000","last_became_active":"2023-08-11T12:22:02.846974+0000","last_became_peered":"2023-08-11T12:22:02.846974+0000","last_unstale":"2023-08-11T12:22:31.721841+0000","last_undegraded":"2023-08-11T12:22:31.721841+0000","last_fullsized":"2023-08-11T12:22:31.721841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:43:35.198876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800817+0000","last_change":"2023-08-11T12:22:03.838944+0000","last_active":"2023-08-11T12:22:31.800817+0000","last_peered":"2023-08-11T12:22:31.800817+0000","last_clean":"2023-08-11T12:22:31.800817+0000","last_became_active":"2023-08-11T12:22:03.838610+0000","last_became_peered":"2023-08-11T12:22:03.838610+0000","last_unstale":"2023-08-11T12:22:31.800817+0000","last_undegraded":"2023-08-11T12:22:31.800817+0000","last_fullsized":"2023-08-11T12:22:31.800817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:10:20.371629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800744+0000","last_change":"2023-08-11T12:22:07.888812+0000","last_active":"2023-08-11T12:22:31.800744+0000","last_peered":"2023-08-11T12:22:31.800744+0000","last_clean":"2023-08-11T12:22:31.800744+0000","last_became_active":"2023-08-11T12:22:07.888423+0000","last_became_peered":"2023-08-11T12:22:07.888423+0000","last_unstale":"2023-08-11T12:22:31.800744+0000","last_undegraded":"2023-08-11T12:22:31.800744+0000","last_fullsized":"2023-08-11T12:22:31.800744+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:07:17.536681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:32.028490+0000","last_change":"2023-08-11T12:22:02.842591+0000","last_active":"2023-08-11T12:22:32.028490+0000","last_peered":"2023-08-11T12:22:32.028490+0000","last_clean":"2023-08-11T12:22:32.028490+0000","last_became_active":"2023-08-11T12:22:02.842249+0000","last_became_peered":"2023-08-11T12:22:02.842249+0000","last_unstale":"2023-08-11T12:22:32.028490+0000","last_undegraded":"2023-08-11T12:22:32.028490+0000","last_fullsized":"2023-08-11T12:22:32.028490+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:28:10.930413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.725791+0000","last_change":"2023-08-11T12:22:31.725791+0000","last_active":"2023-08-11T12:22:31.725791+0000","last_peered":"2023-08-11T12:22:31.725791+0000","last_clean":"2023-08-11T12:22:31.725791+0000","last_became_active":"2023-08-11T12:22:31.724950+0000","last_became_peered":"2023-08-11T12:22:31.724950+0000","last_unstale":"2023-08-11T12:22:31.725791+0000","last_undegraded":"2023-08-11T12:22:31.725791+0000","last_fullsized":"2023-08-11T12:22:31.725791+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:59:37.392626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723541+0000","last_change":"2023-08-11T12:22:08.068485+0000","last_active":"2023-08-11T12:22:31.723541+0000","last_peered":"2023-08-11T12:22:31.723541+0000","last_clean":"2023-08-11T12:22:31.723541+0000","last_became_active":"2023-08-11T12:22:08.068071+0000","last_became_peered":"2023-08-11T12:22:08.068071+0000","last_unstale":"2023-08-11T12:22:31.723541+0000","last_undegraded":"2023-08-11T12:22:31.723541+0000","last_fullsized":"2023-08-11T12:22:31.723541+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:35:49.958958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"87'1","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.728607+0000","last_change":"2023-08-11T12:22:31.727900+0000","last_active":"2023-08-11T12:22:31.728607+0000","last_peered":"2023-08-11T12:22:31.728607+0000","last_clean":"2023-08-11T12:22:31.728607+0000","last_became_active":"2023-08-11T12:22:31.727346+0000","last_became_peered":"2023-08-11T12:22:31.727346+0000","last_unstale":"2023-08-11T12:22:31.728607+0000","last_undegraded":"2023-08-11T12:22:31.728607+0000","last_fullsized":"2023-08-11T12:22:31.728607+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:12:21.170378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722974+0000","last_change":"2023-08-11T12:22:03.843434+0000","last_active":"2023-08-11T12:22:31.722974+0000","last_peered":"2023-08-11T12:22:31.722974+0000","last_clean":"2023-08-11T12:22:31.722974+0000","last_became_active":"2023-08-11T12:22:03.843117+0000","last_became_peered":"2023-08-11T12:22:03.843117+0000","last_unstale":"2023-08-11T12:22:31.722974+0000","last_undegraded":"2023-08-11T12:22:31.722974+0000","last_fullsized":"2023-08-11T12:22:31.722974+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:30:45.835632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717439+0000","last_change":"2023-08-11T12:22:07.889740+0000","last_active":"2023-08-11T12:22:31.717439+0000","last_peered":"2023-08-11T12:22:31.717439+0000","last_clean":"2023-08-11T12:22:31.717439+0000","last_became_active":"2023-08-11T12:22:07.889272+0000","last_became_peered":"2023-08-11T12:22:07.889272+0000","last_unstale":"2023-08-11T12:22:31.717439+0000","last_undegraded":"2023-08-11T12:22:31.717439+0000","last_fullsized":"2023-08-11T12:22:31.717439+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:48:06.207915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":141,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:24:18.866178+0000","last_change":"2023-08-11T12:22:02.846661+0000","last_active":"2023-08-11T12:24:18.866178+0000","last_peered":"2023-08-11T12:24:18.866178+0000","last_clean":"2023-08-11T12:24:18.866178+0000","last_became_active":"2023-08-11T12:22:02.846269+0000","last_became_peered":"2023-08-11T12:22:02.846269+0000","last_unstale":"2023-08-11T12:24:18.866178+0000","last_undegraded":"2023-08-11T12:24:18.866178+0000","last_fullsized":"2023-08-11T12:24:18.866178+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:06:18.229850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721164+0000","last_change":"2023-08-11T12:22:03.849653+0000","last_active":"2023-08-11T12:22:31.721164+0000","last_peered":"2023-08-11T12:22:31.721164+0000","last_clean":"2023-08-11T12:22:31.721164+0000","last_became_active":"2023-08-11T12:22:03.849303+0000","last_became_peered":"2023-08-11T12:22:03.849303+0000","last_unstale":"2023-08-11T12:22:31.721164+0000","last_undegraded":"2023-08-11T12:22:31.721164+0000","last_fullsized":"2023-08-11T12:22:31.721164+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:06:11.551259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717073+0000","last_change":"2023-08-11T12:22:08.068395+0000","last_active":"2023-08-11T12:22:31.717073+0000","last_peered":"2023-08-11T12:22:31.717073+0000","last_clean":"2023-08-11T12:22:31.717073+0000","last_became_active":"2023-08-11T12:22:08.067572+0000","last_became_peered":"2023-08-11T12:22:08.067572+0000","last_unstale":"2023-08-11T12:22:31.717073+0000","last_undegraded":"2023-08-11T12:22:31.717073+0000","last_fullsized":"2023-08-11T12:22:31.717073+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:17:59.273227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800465+0000","last_change":"2023-08-11T12:22:03.828971+0000","last_active":"2023-08-11T12:22:31.800465+0000","last_peered":"2023-08-11T12:22:31.800465+0000","last_clean":"2023-08-11T12:22:31.800465+0000","last_became_active":"2023-08-11T12:22:03.828653+0000","last_became_peered":"2023-08-11T12:22:03.828653+0000","last_unstale":"2023-08-11T12:22:31.800465+0000","last_undegraded":"2023-08-11T12:22:31.800465+0000","last_fullsized":"2023-08-11T12:22:31.800465+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:03:54.904360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":140,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:24:17.886789+0000","last_change":"2023-08-11T12:22:02.842419+0000","last_active":"2023-08-11T12:24:17.886789+0000","last_peered":"2023-08-11T12:24:17.886789+0000","last_clean":"2023-08-11T12:24:17.886789+0000","last_became_active":"2023-08-11T12:22:02.842105+0000","last_became_peered":"2023-08-11T12:22:02.842105+0000","last_unstale":"2023-08-11T12:24:17.886789+0000","last_undegraded":"2023-08-11T12:24:17.886789+0000","last_fullsized":"2023-08-11T12:24:17.886789+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:32:13.063912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717706+0000","last_change":"2023-08-11T12:22:07.880762+0000","last_active":"2023-08-11T12:22:31.717706+0000","last_peered":"2023-08-11T12:22:31.717706+0000","last_clean":"2023-08-11T12:22:31.717706+0000","last_became_active":"2023-08-11T12:22:07.880373+0000","last_became_peered":"2023-08-11T12:22:07.880373+0000","last_unstale":"2023-08-11T12:22:31.717706+0000","last_undegraded":"2023-08-11T12:22:31.717706+0000","last_fullsized":"2023-08-11T12:22:31.717706+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:07:06.457583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720351+0000","last_change":"2023-08-11T12:22:03.838555+0000","last_active":"2023-08-11T12:22:31.720351+0000","last_peered":"2023-08-11T12:22:31.720351+0000","last_clean":"2023-08-11T12:22:31.720351+0000","last_became_active":"2023-08-11T12:22:03.838135+0000","last_became_peered":"2023-08-11T12:22:03.838135+0000","last_unstale":"2023-08-11T12:22:31.720351+0000","last_undegraded":"2023-08-11T12:22:31.720351+0000","last_fullsized":"2023-08-11T12:22:31.720351+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:36:24.934863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:32.698817+0000","last_change":"2023-08-11T12:22:02.835093+0000","last_active":"2023-08-11T12:22:32.698817+0000","last_peered":"2023-08-11T12:22:32.698817+0000","last_clean":"2023-08-11T12:22:32.698817+0000","last_became_active":"2023-08-11T12:22:02.834545+0000","last_became_peered":"2023-08-11T12:22:02.834545+0000","last_unstale":"2023-08-11T12:22:32.698817+0000","last_undegraded":"2023-08-11T12:22:32.698817+0000","last_fullsized":"2023-08-11T12:22:32.698817+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T13:21:54.371599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":355,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717340+0000","last_change":"2023-08-11T12:20:57.484190+0000","last_active":"2023-08-11T12:22:31.717340+0000","last_peered":"2023-08-11T12:22:31.717340+0000","last_clean":"2023-08-11T12:22:31.717340+0000","last_became_active":"2023-08-11T12:20:57.483655+0000","last_became_peered":"2023-08-11T12:20:57.483655+0000","last_unstale":"2023-08-11T12:22:31.717340+0000","last_undegraded":"2023-08-11T12:22:31.717340+0000","last_fullsized":"2023-08-11T12:22:31.717340+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:17:49.245488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:17:49.245488+0000","last_clean_scrub_stamp":"2023-08-11T12:17:49.245488+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:25:33.880946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800922+0000","last_change":"2023-08-11T12:22:08.068762+0000","last_active":"2023-08-11T12:22:31.800922+0000","last_peered":"2023-08-11T12:22:31.800922+0000","last_clean":"2023-08-11T12:22:31.800922+0000","last_became_active":"2023-08-11T12:22:08.068205+0000","last_became_peered":"2023-08-11T12:22:08.068205+0000","last_unstale":"2023-08-11T12:22:31.800922+0000","last_undegraded":"2023-08-11T12:22:31.800922+0000","last_fullsized":"2023-08-11T12:22:31.800922+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:55:06.744751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.716814+0000","last_change":"2023-08-11T12:22:03.837843+0000","last_active":"2023-08-11T12:22:31.716814+0000","last_peered":"2023-08-11T12:22:31.716814+0000","last_clean":"2023-08-11T12:22:31.716814+0000","last_became_active":"2023-08-11T12:22:03.837537+0000","last_became_peered":"2023-08-11T12:22:03.837537+0000","last_unstale":"2023-08-11T12:22:31.716814+0000","last_undegraded":"2023-08-11T12:22:31.716814+0000","last_fullsized":"2023-08-11T12:22:31.716814+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:17:41.517052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717406+0000","last_change":"2023-08-11T12:22:02.843150+0000","last_active":"2023-08-11T12:22:31.717406+0000","last_peered":"2023-08-11T12:22:31.717406+0000","last_clean":"2023-08-11T12:22:31.717406+0000","last_became_active":"2023-08-11T12:22:02.842829+0000","last_became_peered":"2023-08-11T12:22:02.842829+0000","last_unstale":"2023-08-11T12:22:31.717406+0000","last_undegraded":"2023-08-11T12:22:31.717406+0000","last_fullsized":"2023-08-11T12:22:31.717406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:09:48.420755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720746+0000","last_change":"2023-08-11T12:22:07.883050+0000","last_active":"2023-08-11T12:22:31.720746+0000","last_peered":"2023-08-11T12:22:31.720746+0000","last_clean":"2023-08-11T12:22:31.720746+0000","last_became_active":"2023-08-11T12:22:07.882423+0000","last_became_peered":"2023-08-11T12:22:07.882423+0000","last_unstale":"2023-08-11T12:22:31.720746+0000","last_undegraded":"2023-08-11T12:22:31.720746+0000","last_fullsized":"2023-08-11T12:22:31.720746+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:14:51.848070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.724046+0000","last_change":"2023-08-11T12:22:02.850632+0000","last_active":"2023-08-11T12:22:31.724046+0000","last_peered":"2023-08-11T12:22:31.724046+0000","last_clean":"2023-08-11T12:22:31.724046+0000","last_became_active":"2023-08-11T12:22:02.850312+0000","last_became_peered":"2023-08-11T12:22:02.850312+0000","last_unstale":"2023-08-11T12:22:31.724046+0000","last_undegraded":"2023-08-11T12:22:31.724046+0000","last_fullsized":"2023-08-11T12:22:31.724046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:54:50.288288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717673+0000","last_change":"2023-08-11T12:22:03.839869+0000","last_active":"2023-08-11T12:22:31.717673+0000","last_peered":"2023-08-11T12:22:31.717673+0000","last_clean":"2023-08-11T12:22:31.717673+0000","last_became_active":"2023-08-11T12:22:03.839486+0000","last_became_peered":"2023-08-11T12:22:03.839486+0000","last_unstale":"2023-08-11T12:22:31.717673+0000","last_undegraded":"2023-08-11T12:22:31.717673+0000","last_fullsized":"2023-08-11T12:22:31.717673+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:23:04.341624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720353+0000","last_change":"2023-08-11T12:22:08.066877+0000","last_active":"2023-08-11T12:22:31.720353+0000","last_peered":"2023-08-11T12:22:31.720353+0000","last_clean":"2023-08-11T12:22:31.720353+0000","last_became_active":"2023-08-11T12:22:08.066418+0000","last_became_peered":"2023-08-11T12:22:08.066418+0000","last_unstale":"2023-08-11T12:22:31.720353+0000","last_undegraded":"2023-08-11T12:22:31.720353+0000","last_fullsized":"2023-08-11T12:22:31.720353+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:12:43.228455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'7","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722342+0000","last_change":"2023-08-11T12:22:02.850505+0000","last_active":"2023-08-11T12:22:31.722342+0000","last_peered":"2023-08-11T12:22:31.722342+0000","last_clean":"2023-08-11T12:22:31.722342+0000","last_became_active":"2023-08-11T12:22:02.850104+0000","last_became_peered":"2023-08-11T12:22:02.850104+0000","last_unstale":"2023-08-11T12:22:31.722342+0000","last_undegraded":"2023-08-11T12:22:31.722342+0000","last_fullsized":"2023-08-11T12:22:31.722342+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:33:50.319404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721634+0000","last_change":"2023-08-11T12:22:03.837580+0000","last_active":"2023-08-11T12:22:31.721634+0000","last_peered":"2023-08-11T12:22:31.721634+0000","last_clean":"2023-08-11T12:22:31.721634+0000","last_became_active":"2023-08-11T12:22:03.837256+0000","last_became_peered":"2023-08-11T12:22:03.837256+0000","last_unstale":"2023-08-11T12:22:31.721634+0000","last_undegraded":"2023-08-11T12:22:31.721634+0000","last_fullsized":"2023-08-11T12:22:31.721634+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:07:44.899244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722738+0000","last_change":"2023-08-11T12:22:07.873613+0000","last_active":"2023-08-11T12:22:31.722738+0000","last_peered":"2023-08-11T12:22:31.722738+0000","last_clean":"2023-08-11T12:22:31.722738+0000","last_became_active":"2023-08-11T12:22:07.873149+0000","last_became_peered":"2023-08-11T12:22:07.873149+0000","last_unstale":"2023-08-11T12:22:31.722738+0000","last_undegraded":"2023-08-11T12:22:31.722738+0000","last_fullsized":"2023-08-11T12:22:31.722738+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:38:35.678888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:32.698437+0000","last_change":"2023-08-11T12:22:02.843146+0000","last_active":"2023-08-11T12:22:32.698437+0000","last_peered":"2023-08-11T12:22:32.698437+0000","last_clean":"2023-08-11T12:22:32.698437+0000","last_became_active":"2023-08-11T12:22:02.842663+0000","last_became_peered":"2023-08-11T12:22:02.842663+0000","last_unstale":"2023-08-11T12:22:32.698437+0000","last_undegraded":"2023-08-11T12:22:32.698437+0000","last_fullsized":"2023-08-11T12:22:32.698437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:32:13.084100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719561+0000","last_change":"2023-08-11T12:22:03.847351+0000","last_active":"2023-08-11T12:22:31.719561+0000","last_peered":"2023-08-11T12:22:31.719561+0000","last_clean":"2023-08-11T12:22:31.719561+0000","last_became_active":"2023-08-11T12:22:03.847044+0000","last_became_peered":"2023-08-11T12:22:03.847044+0000","last_unstale":"2023-08-11T12:22:31.719561+0000","last_undegraded":"2023-08-11T12:22:31.719561+0000","last_fullsized":"2023-08-11T12:22:31.719561+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:17:19.004762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721751+0000","last_change":"2023-08-11T12:22:08.068459+0000","last_active":"2023-08-11T12:22:31.721751+0000","last_peered":"2023-08-11T12:22:31.721751+0000","last_clean":"2023-08-11T12:22:31.721751+0000","last_became_active":"2023-08-11T12:22:08.067857+0000","last_became_peered":"2023-08-11T12:22:08.067857+0000","last_unstale":"2023-08-11T12:22:31.721751+0000","last_undegraded":"2023-08-11T12:22:31.721751+0000","last_fullsized":"2023-08-11T12:22:31.721751+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:15:05.931547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774199+0000","last_change":"2023-08-11T12:22:02.846441+0000","last_active":"2023-08-11T12:22:31.774199+0000","last_peered":"2023-08-11T12:22:31.774199+0000","last_clean":"2023-08-11T12:22:31.774199+0000","last_became_active":"2023-08-11T12:22:02.846153+0000","last_became_peered":"2023-08-11T12:22:02.846153+0000","last_unstale":"2023-08-11T12:22:31.774199+0000","last_undegraded":"2023-08-11T12:22:31.774199+0000","last_fullsized":"2023-08-11T12:22:31.774199+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:00:55.631058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723390+0000","last_change":"2023-08-11T12:22:03.841932+0000","last_active":"2023-08-11T12:22:31.723390+0000","last_peered":"2023-08-11T12:22:31.723390+0000","last_clean":"2023-08-11T12:22:31.723390+0000","last_became_active":"2023-08-11T12:22:03.841635+0000","last_became_peered":"2023-08-11T12:22:03.841635+0000","last_unstale":"2023-08-11T12:22:31.723390+0000","last_undegraded":"2023-08-11T12:22:31.723390+0000","last_fullsized":"2023-08-11T12:22:31.723390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:01:57.888877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722748+0000","last_change":"2023-08-11T12:22:07.886160+0000","last_active":"2023-08-11T12:22:31.722748+0000","last_peered":"2023-08-11T12:22:31.722748+0000","last_clean":"2023-08-11T12:22:31.722748+0000","last_became_active":"2023-08-11T12:22:07.885703+0000","last_became_peered":"2023-08-11T12:22:07.885703+0000","last_unstale":"2023-08-11T12:22:31.722748+0000","last_undegraded":"2023-08-11T12:22:31.722748+0000","last_fullsized":"2023-08-11T12:22:31.722748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:50:20.362829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720571+0000","last_change":"2023-08-11T12:22:02.849360+0000","last_active":"2023-08-11T12:22:31.720571+0000","last_peered":"2023-08-11T12:22:31.720571+0000","last_clean":"2023-08-11T12:22:31.720571+0000","last_became_active":"2023-08-11T12:22:02.849028+0000","last_became_peered":"2023-08-11T12:22:02.849028+0000","last_unstale":"2023-08-11T12:22:31.720571+0000","last_undegraded":"2023-08-11T12:22:31.720571+0000","last_fullsized":"2023-08-11T12:22:31.720571+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:55:24.114464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719877+0000","last_change":"2023-08-11T12:22:03.850285+0000","last_active":"2023-08-11T12:22:31.719877+0000","last_peered":"2023-08-11T12:22:31.719877+0000","last_clean":"2023-08-11T12:22:31.719877+0000","last_became_active":"2023-08-11T12:22:03.849978+0000","last_became_peered":"2023-08-11T12:22:03.849978+0000","last_unstale":"2023-08-11T12:22:31.719877+0000","last_undegraded":"2023-08-11T12:22:31.719877+0000","last_fullsized":"2023-08-11T12:22:31.719877+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:29:51.679282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721058+0000","last_change":"2023-08-11T12:22:07.881578+0000","last_active":"2023-08-11T12:22:31.721058+0000","last_peered":"2023-08-11T12:22:31.721058+0000","last_clean":"2023-08-11T12:22:31.721058+0000","last_became_active":"2023-08-11T12:22:07.881145+0000","last_became_peered":"2023-08-11T12:22:07.881145+0000","last_unstale":"2023-08-11T12:22:31.721058+0000","last_undegraded":"2023-08-11T12:22:31.721058+0000","last_fullsized":"2023-08-11T12:22:31.721058+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:32:16.462208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:34.992478+0000","last_change":"2023-08-11T12:22:02.848875+0000","last_active":"2023-08-11T12:22:34.992478+0000","last_peered":"2023-08-11T12:22:34.992478+0000","last_clean":"2023-08-11T12:22:34.992478+0000","last_became_active":"2023-08-11T12:22:02.848578+0000","last_became_peered":"2023-08-11T12:22:02.848578+0000","last_unstale":"2023-08-11T12:22:34.992478+0000","last_undegraded":"2023-08-11T12:22:34.992478+0000","last_fullsized":"2023-08-11T12:22:34.992478+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:29:40.949795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721093+0000","last_change":"2023-08-11T12:22:03.849865+0000","last_active":"2023-08-11T12:22:31.721093+0000","last_peered":"2023-08-11T12:22:31.721093+0000","last_clean":"2023-08-11T12:22:31.721093+0000","last_became_active":"2023-08-11T12:22:03.849557+0000","last_became_peered":"2023-08-11T12:22:03.849557+0000","last_unstale":"2023-08-11T12:22:31.721093+0000","last_undegraded":"2023-08-11T12:22:31.721093+0000","last_fullsized":"2023-08-11T12:22:31.721093+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:49:27.142464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721537+0000","last_change":"2023-08-11T12:22:08.067009+0000","last_active":"2023-08-11T12:22:31.721537+0000","last_peered":"2023-08-11T12:22:31.721537+0000","last_clean":"2023-08-11T12:22:31.721537+0000","last_became_active":"2023-08-11T12:22:08.066477+0000","last_became_peered":"2023-08-11T12:22:08.066477+0000","last_unstale":"2023-08-11T12:22:31.721537+0000","last_undegraded":"2023-08-11T12:22:31.721537+0000","last_fullsized":"2023-08-11T12:22:31.721537+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T20:07:02.380225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.731106+0000","last_change":"2023-08-11T12:22:31.731106+0000","last_active":"2023-08-11T12:22:31.731106+0000","last_peered":"2023-08-11T12:22:31.731106+0000","last_clean":"2023-08-11T12:22:31.731106+0000","last_became_active":"2023-08-11T12:22:31.724944+0000","last_became_peered":"2023-08-11T12:22:31.724944+0000","last_unstale":"2023-08-11T12:22:31.731106+0000","last_undegraded":"2023-08-11T12:22:31.731106+0000","last_fullsized":"2023-08-11T12:22:31.731106+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:56:41.188015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718094+0000","last_change":"2023-08-11T12:22:03.848715+0000","last_active":"2023-08-11T12:22:31.718094+0000","last_peered":"2023-08-11T12:22:31.718094+0000","last_clean":"2023-08-11T12:22:31.718094+0000","last_became_active":"2023-08-11T12:22:03.848311+0000","last_became_peered":"2023-08-11T12:22:03.848311+0000","last_unstale":"2023-08-11T12:22:31.718094+0000","last_undegraded":"2023-08-11T12:22:31.718094+0000","last_fullsized":"2023-08-11T12:22:31.718094+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:45:14.152855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774158+0000","last_change":"2023-08-11T12:22:07.882566+0000","last_active":"2023-08-11T12:22:31.774158+0000","last_peered":"2023-08-11T12:22:31.774158+0000","last_clean":"2023-08-11T12:22:31.774158+0000","last_became_active":"2023-08-11T12:22:07.882198+0000","last_became_peered":"2023-08-11T12:22:07.882198+0000","last_unstale":"2023-08-11T12:22:31.774158+0000","last_undegraded":"2023-08-11T12:22:31.774158+0000","last_fullsized":"2023-08-11T12:22:31.774158+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:21:03.227408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"87'5","reported_seq":141,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:24:18.897561+0000","last_change":"2023-08-11T12:22:02.846424+0000","last_active":"2023-08-11T12:24:18.897561+0000","last_peered":"2023-08-11T12:24:18.897561+0000","last_clean":"2023-08-11T12:24:18.897561+0000","last_became_active":"2023-08-11T12:22:02.846063+0000","last_became_peered":"2023-08-11T12:22:02.846063+0000","last_unstale":"2023-08-11T12:24:18.897561+0000","last_undegraded":"2023-08-11T12:24:18.897561+0000","last_fullsized":"2023-08-11T12:24:18.897561+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:28:14.946971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717900+0000","last_change":"2023-08-11T12:22:03.845616+0000","last_active":"2023-08-11T12:22:31.717900+0000","last_peered":"2023-08-11T12:22:31.717900+0000","last_clean":"2023-08-11T12:22:31.717900+0000","last_became_active":"2023-08-11T12:22:03.845293+0000","last_became_peered":"2023-08-11T12:22:03.845293+0000","last_unstale":"2023-08-11T12:22:31.717900+0000","last_undegraded":"2023-08-11T12:22:31.717900+0000","last_fullsized":"2023-08-11T12:22:31.717900+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:28:30.374044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718737+0000","last_change":"2023-08-11T12:22:07.888963+0000","last_active":"2023-08-11T12:22:31.718737+0000","last_peered":"2023-08-11T12:22:31.718737+0000","last_clean":"2023-08-11T12:22:31.718737+0000","last_became_active":"2023-08-11T12:22:07.888513+0000","last_became_peered":"2023-08-11T12:22:07.888513+0000","last_unstale":"2023-08-11T12:22:31.718737+0000","last_undegraded":"2023-08-11T12:22:31.718737+0000","last_fullsized":"2023-08-11T12:22:31.718737+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:44:29.823122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.801009+0000","last_change":"2023-08-11T12:22:02.850739+0000","last_active":"2023-08-11T12:22:31.801009+0000","last_peered":"2023-08-11T12:22:31.801009+0000","last_clean":"2023-08-11T12:22:31.801009+0000","last_became_active":"2023-08-11T12:22:02.850455+0000","last_became_peered":"2023-08-11T12:22:02.850455+0000","last_unstale":"2023-08-11T12:22:31.801009+0000","last_undegraded":"2023-08-11T12:22:31.801009+0000","last_fullsized":"2023-08-11T12:22:31.801009+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T12:37:48.954343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718168+0000","last_change":"2023-08-11T12:22:03.838834+0000","last_active":"2023-08-11T12:22:31.718168+0000","last_peered":"2023-08-11T12:22:31.718168+0000","last_clean":"2023-08-11T12:22:31.718168+0000","last_became_active":"2023-08-11T12:22:03.838435+0000","last_became_peered":"2023-08-11T12:22:03.838435+0000","last_unstale":"2023-08-11T12:22:31.718168+0000","last_undegraded":"2023-08-11T12:22:31.718168+0000","last_fullsized":"2023-08-11T12:22:31.718168+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:42:39.127547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.799965+0000","last_change":"2023-08-11T12:22:07.884481+0000","last_active":"2023-08-11T12:22:31.799965+0000","last_peered":"2023-08-11T12:22:31.799965+0000","last_clean":"2023-08-11T12:22:31.799965+0000","last_became_active":"2023-08-11T12:22:07.884084+0000","last_became_peered":"2023-08-11T12:22:07.884084+0000","last_unstale":"2023-08-11T12:22:31.799965+0000","last_undegraded":"2023-08-11T12:22:31.799965+0000","last_fullsized":"2023-08-11T12:22:31.799965+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:06.853285+0000","last_clean_scrub_stamp":"2023-08-11T12:22:06.853285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T23:06:29.852022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717429+0000","last_change":"2023-08-11T12:22:02.849339+0000","last_active":"2023-08-11T12:22:31.717429+0000","last_peered":"2023-08-11T12:22:31.717429+0000","last_clean":"2023-08-11T12:22:31.717429+0000","last_became_active":"2023-08-11T12:22:02.848986+0000","last_became_peered":"2023-08-11T12:22:02.848986+0000","last_unstale":"2023-08-11T12:22:31.717429+0000","last_undegraded":"2023-08-11T12:22:31.717429+0000","last_fullsized":"2023-08-11T12:22:31.717429+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:01.810315+0000","last_clean_scrub_stamp":"2023-08-11T12:22:01.810315+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:00:28.458884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.718065+0000","last_change":"2023-08-11T12:22:03.846301+0000","last_active":"2023-08-11T12:22:31.718065+0000","last_peered":"2023-08-11T12:22:31.718065+0000","last_clean":"2023-08-11T12:22:31.718065+0000","last_became_active":"2023-08-11T12:22:03.845990+0000","last_became_peered":"2023-08-11T12:22:03.845990+0000","last_unstale":"2023-08-11T12:22:31.718065+0000","last_undegraded":"2023-08-11T12:22:31.718065+0000","last_fullsized":"2023-08-11T12:22:31.718065+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:30:23.134555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719765+0000","last_change":"2023-08-11T12:22:03.836652+0000","last_active":"2023-08-11T12:22:31.719765+0000","last_peered":"2023-08-11T12:22:31.719765+0000","last_clean":"2023-08-11T12:22:31.719765+0000","last_became_active":"2023-08-11T12:22:03.836236+0000","last_became_peered":"2023-08-11T12:22:03.836236+0000","last_unstale":"2023-08-11T12:22:31.719765+0000","last_undegraded":"2023-08-11T12:22:31.719765+0000","last_fullsized":"2023-08-11T12:22:31.719765+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:15:43.477085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722700+0000","last_change":"2023-08-11T12:22:03.831318+0000","last_active":"2023-08-11T12:22:31.722700+0000","last_peered":"2023-08-11T12:22:31.722700+0000","last_clean":"2023-08-11T12:22:31.722700+0000","last_became_active":"2023-08-11T12:22:03.830670+0000","last_became_peered":"2023-08-11T12:22:03.830670+0000","last_unstale":"2023-08-11T12:22:31.722700+0000","last_undegraded":"2023-08-11T12:22:31.722700+0000","last_fullsized":"2023-08-11T12:22:31.722700+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:27:54.407934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.722513+0000","last_change":"2023-08-11T12:22:03.841396+0000","last_active":"2023-08-11T12:22:31.722513+0000","last_peered":"2023-08-11T12:22:31.722513+0000","last_clean":"2023-08-11T12:22:31.722513+0000","last_became_active":"2023-08-11T12:22:03.841076+0000","last_became_peered":"2023-08-11T12:22:03.841076+0000","last_unstale":"2023-08-11T12:22:31.722513+0000","last_undegraded":"2023-08-11T12:22:31.722513+0000","last_fullsized":"2023-08-11T12:22:31.722513+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:14:14.365513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.719695+0000","last_change":"2023-08-11T12:22:03.847266+0000","last_active":"2023-08-11T12:22:31.719695+0000","last_peered":"2023-08-11T12:22:31.719695+0000","last_clean":"2023-08-11T12:22:31.719695+0000","last_became_active":"2023-08-11T12:22:03.846898+0000","last_became_peered":"2023-08-11T12:22:03.846898+0000","last_unstale":"2023-08-11T12:22:31.719695+0000","last_undegraded":"2023-08-11T12:22:31.719695+0000","last_fullsized":"2023-08-11T12:22:31.719695+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T15:05:00.055352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717774+0000","last_change":"2023-08-11T12:22:03.843491+0000","last_active":"2023-08-11T12:22:31.717774+0000","last_peered":"2023-08-11T12:22:31.717774+0000","last_clean":"2023-08-11T12:22:31.717774+0000","last_became_active":"2023-08-11T12:22:03.843099+0000","last_became_peered":"2023-08-11T12:22:03.843099+0000","last_unstale":"2023-08-11T12:22:31.717774+0000","last_undegraded":"2023-08-11T12:22:31.717774+0000","last_fullsized":"2023-08-11T12:22:31.717774+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:24:27.850492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720396+0000","last_change":"2023-08-11T12:22:03.840508+0000","last_active":"2023-08-11T12:22:31.720396+0000","last_peered":"2023-08-11T12:22:31.720396+0000","last_clean":"2023-08-11T12:22:31.720396+0000","last_became_active":"2023-08-11T12:22:03.840160+0000","last_became_peered":"2023-08-11T12:22:03.840160+0000","last_unstale":"2023-08-11T12:22:31.720396+0000","last_undegraded":"2023-08-11T12:22:31.720396+0000","last_fullsized":"2023-08-11T12:22:31.720396+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T19:09:11.925192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.723642+0000","last_change":"2023-08-11T12:22:03.843724+0000","last_active":"2023-08-11T12:22:31.723642+0000","last_peered":"2023-08-11T12:22:31.723642+0000","last_clean":"2023-08-11T12:22:31.723642+0000","last_became_active":"2023-08-11T12:22:03.843431+0000","last_became_peered":"2023-08-11T12:22:03.843431+0000","last_unstale":"2023-08-11T12:22:31.723642+0000","last_undegraded":"2023-08-11T12:22:31.723642+0000","last_fullsized":"2023-08-11T12:22:31.723642+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T14:02:15.971280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.721811+0000","last_change":"2023-08-11T12:22:03.831268+0000","last_active":"2023-08-11T12:22:31.721811+0000","last_peered":"2023-08-11T12:22:31.721811+0000","last_clean":"2023-08-11T12:22:31.721811+0000","last_became_active":"2023-08-11T12:22:03.830839+0000","last_became_peered":"2023-08-11T12:22:03.830839+0000","last_unstale":"2023-08-11T12:22:31.721811+0000","last_undegraded":"2023-08-11T12:22:31.721811+0000","last_fullsized":"2023-08-11T12:22:31.721811+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T16:25:09.422026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.800309+0000","last_change":"2023-08-11T12:22:03.839227+0000","last_active":"2023-08-11T12:22:31.800309+0000","last_peered":"2023-08-11T12:22:31.800309+0000","last_clean":"2023-08-11T12:22:31.800309+0000","last_became_active":"2023-08-11T12:22:03.838526+0000","last_became_peered":"2023-08-11T12:22:03.838526+0000","last_unstale":"2023-08-11T12:22:31.800309+0000","last_undegraded":"2023-08-11T12:22:31.800309+0000","last_fullsized":"2023-08-11T12:22:31.800309+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T22:56:06.609931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720714+0000","last_change":"2023-08-11T12:22:03.834614+0000","last_active":"2023-08-11T12:22:31.720714+0000","last_peered":"2023-08-11T12:22:31.720714+0000","last_clean":"2023-08-11T12:22:31.720714+0000","last_became_active":"2023-08-11T12:22:03.834267+0000","last_became_peered":"2023-08-11T12:22:03.834267+0000","last_unstale":"2023-08-11T12:22:31.720714+0000","last_undegraded":"2023-08-11T12:22:31.720714+0000","last_fullsized":"2023-08-11T12:22:31.720714+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T17:05:00.003830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.774493+0000","last_change":"2023-08-11T12:22:03.846504+0000","last_active":"2023-08-11T12:22:31.774493+0000","last_peered":"2023-08-11T12:22:31.774493+0000","last_clean":"2023-08-11T12:22:31.774493+0000","last_became_active":"2023-08-11T12:22:03.846156+0000","last_became_peered":"2023-08-11T12:22:03.846156+0000","last_unstale":"2023-08-11T12:22:31.774493+0000","last_undegraded":"2023-08-11T12:22:31.774493+0000","last_fullsized":"2023-08-11T12:22:31.774493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:54:38.654858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.717340+0000","last_change":"2023-08-11T12:22:03.849854+0000","last_active":"2023-08-11T12:22:31.717340+0000","last_peered":"2023-08-11T12:22:31.717340+0000","last_clean":"2023-08-11T12:22:31.717340+0000","last_became_active":"2023-08-11T12:22:03.849553+0000","last_became_peered":"2023-08-11T12:22:03.849553+0000","last_unstale":"2023-08-11T12:22:31.717340+0000","last_undegraded":"2023-08-11T12:22:31.717340+0000","last_fullsized":"2023-08-11T12:22:31.717340+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T18:14:27.485150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-11T12:22:31.720171+0000","last_change":"2023-08-11T12:22:03.843511+0000","last_active":"2023-08-11T12:22:31.720171+0000","last_peered":"2023-08-11T12:22:31.720171+0000","last_clean":"2023-08-11T12:22:31.720171+0000","last_became_active":"2023-08-11T12:22:03.843206+0000","last_became_peered":"2023-08-11T12:22:03.843206+0000","last_unstale":"2023-08-11T12:22:31.720171+0000","last_undegraded":"2023-08-11T12:22:31.720171+0000","last_fullsized":"2023-08-11T12:22:31.720171+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-11T12:22:02.817170+0000","last_clean_scrub_stamp":"2023-08-11T12:22:02.817170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-12T21:19:44.978907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":248338,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10522,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1113,"num_read_kb":576,"num_write":211,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":31566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":185,"ondisk_log_size":185,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449128,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":484340,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.443,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.48999999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.51000000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.41499999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77800000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.501}]},{"osd":2,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.52500000000000002,"15min":0.53200000000000003},"min":{"1min":0.35599999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70899999999999996,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.33200000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79100000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":4,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.69899999999999995,"15min":0.69599999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89700000000000002,"5min":1.032,"15min":1.032},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.60999999999999999},"min":{"1min":0.46000000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.78100000000000003,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.63200000000000001}]},{"osd":5,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.64900000000000002,"15min":0.66100000000000003},"min":{"1min":0.34799999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77500000000000002,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65900000000000003,"15min":0.65700000000000003},"min":{"1min":0.437,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.81200000000000006}]},{"osd":6,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.68400000000000005,"15min":0.69099999999999995},"min":{"1min":0.46500000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86499999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.98299999999999998,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.79300000000000004}]},{"osd":7,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.79100000000000004,"15min":0.78700000000000003},"min":{"1min":0.55100000000000005,"5min":0.503,"15min":0.503},"max":{"1min":1.0229999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.56100000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.873,"5min":1.302,"15min":1.302},"last":0.66400000000000003}]},{"osd":8,"last update":"Fri Aug 11 12:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.71999999999999997,"15min":0.71499999999999997},"min":{"1min":0.58599999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.753},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.79100000000000004,"15min":0.78700000000000003},"min":{"1min":0.62,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96599999999999997,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.84099999999999997}]},{"osd":9,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.61899999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.81100000000000005,"15min":0.80500000000000005},"min":{"1min":0.59999999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.071,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.88600000000000001}]},{"osd":10,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.61299999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93000000000000005,"5min":1.341,"15min":1.341},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.82199999999999995,"15min":0.82399999999999995},"min":{"1min":0.59099999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.95099999999999996,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.82699999999999996}]}]},{"osd":10,"up_from":71,"seq":304942678059,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1064960,"data_stored":1078813,"data_compressed":53533,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.67600000000000005,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.51700000000000002}]},{"osd":1,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48499999999999999,"15min":0.48299999999999998},"min":{"1min":0.29799999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.63100000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80400000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.61899999999999999}]},{"osd":2,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.65100000000000002,"15min":0.64000000000000001},"min":{"1min":0.46500000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.90200000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.69599999999999995}]},{"osd":3,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.65900000000000003,"15min":0.68100000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81100000000000005,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.72099999999999997,"15min":0.72299999999999998},"min":{"1min":0.52800000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89900000000000002,"5min":1.528,"15min":1.528},"last":0.70899999999999996}]},{"osd":4,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63300000000000001,"15min":0.623},"min":{"1min":0.40400000000000003,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.88400000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.35399999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.873,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.58799999999999997}]},{"osd":5,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72299999999999998,"15min":0.72099999999999997},"min":{"1min":0.501,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95099999999999996,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.752,"15min":0.74399999999999999},"min":{"1min":0.51000000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.99099999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.65800000000000003}]},{"osd":6,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.79500000000000004,"15min":0.80700000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.82299999999999995,"15min":0.81899999999999995},"min":{"1min":0.64700000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98799999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.78700000000000003}]},{"osd":7,"last update":"Fri Aug 11 12:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.59099999999999997}]},{"osd":8,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84399999999999997,"15min":0.83699999999999997},"min":{"1min":0.57099999999999995,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0469999999999999,"5min":1.296,"15min":1.296},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.84299999999999997,"15min":0.85199999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1100000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.73199999999999998}]},{"osd":9,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.88800000000000001,"15min":0.88100000000000001},"min":{"1min":0.69599999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1459999999999999,"5min":1.21,"15min":1.21},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.84799999999999998,"15min":0.86099999999999999},"min":{"1min":0.54700000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.157,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.64300000000000002}]},{"osd":11,"last update":"Fri Aug 11 12:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.86099999999999999,"15min":0.86499999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0900000000000001,"5min":1.323,"15min":1.323},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.86499999999999999,"15min":0.85899999999999999},"min":{"1min":0.61099999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0549999999999999,"5min":1.341,"15min":1.341},"last":0.93899999999999995}]}]},{"osd":9,"up_from":66,"seq":283467841583,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":484270,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54900000000000004,"15min":0.56499999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.55600000000000005,"15min":0.56599999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.755,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.44900000000000001}]},{"osd":1,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.72899999999999998,"15min":0.747},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.65600000000000003,"15min":0.64200000000000002},"min":{"1min":0.41599999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.65600000000000003}]},{"osd":2,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.76100000000000001,"15min":0.78200000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97999999999999998,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73999999999999999,"15min":0.75700000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.57799999999999996}]},{"osd":3,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.67900000000000005,"15min":0.72899999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82299999999999995,"5min":1.355,"15min":1.355},"last":0.5},{"interface":"front","average":{"1min":0.626,"5min":0.72399999999999998,"15min":0.77800000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.92800000000000005,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.67400000000000004}]},{"osd":4,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.754,"15min":0.754},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.53600000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.64100000000000001}]},{"osd":5,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.86399999999999999,"15min":0.91200000000000003},"min":{"1min":0.51900000000000002,"5min":0.495,"15min":0.495},"max":{"1min":1.0720000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.86299999999999999,"15min":0.91400000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1200000000000001,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.48199999999999998}]},{"osd":6,"last update":"Fri Aug 11 12:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.91200000000000003,"15min":0.94899999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.141,"5min":1.163,"15min":1.163},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.93500000000000005,"15min":0.995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.083,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.56100000000000005}]},{"osd":8,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.92800000000000005,"15min":0.96899999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.93799999999999994,"15min":0.98799999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.0509999999999999,"5min":1.272,"15min":1.272},"last":0.60199999999999998}]},{"osd":10,"last update":"Fri Aug 11 12:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.92200000000000004,"15min":0.96299999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.629},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.89700000000000002,"15min":0.91300000000000003},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.107,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.94799999999999995}]},{"osd":11,"last update":"Fri Aug 11 12:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.88500000000000001,"15min":0.89200000000000002},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2010000000000001,"5min":1.869,"15min":1.869},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.85399999999999998,"15min":0.85599999999999998},"min":{"1min":0.69999999999999996,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.006,"5min":1.095,"15min":1.095},"last":0.73199999999999998}]}]},{"osd":8,"up_from":58,"seq":249108103222,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":484648,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.71799999999999997,"15min":0.59399999999999997},"min":{"1min":0.38900000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72199999999999998,"5min":12.307,"15min":12.307},"last":0.501},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.57499999999999996,"15min":0.59199999999999997},"min":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.626,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.45200000000000001}]},{"osd":1,"last update":"Fri Aug 11 12:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.63700000000000001,"15min":0.60799999999999998},"min":{"1min":0.496,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63200000000000001,"15min":0.60999999999999999},"min":{"1min":0.52500000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.85099999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.57999999999999996}]},{"osd":2,"last update":"Fri Aug 11 12:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.46899999999999997,"15min":0.437},"min":{"1min":0.35299999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.61699999999999999,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.48599999999999999,"15min":0.45100000000000001},"min":{"1min":0.376,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71399999999999997,"5min":0.878,"15min":0.878},"last":0.62}]},{"osd":3,"last update":"Fri Aug 11 12:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68300000000000005,"15min":0.65400000000000003},"min":{"1min":0.51700000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77600000000000002,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.70099999999999996,"15min":0.63700000000000001},"min":{"1min":0.50600000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0700000000000001,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":0.73299999999999998}]},{"osd":4,"last update":"Fri Aug 11 12:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.66900000000000004,"15min":0.629},"min":{"1min":0.499,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88500000000000001,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.69699999999999995,"15min":0.66300000000000003},"min":{"1min":0.56799999999999995,"5min":0.432,"15min":0.432},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.63800000000000001}]},{"osd":5,"last update":"Fri Aug 11 12:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.59999999999999998,"15min":0.54800000000000004},"min":{"1min":0.38,"5min":0.309,"15min":0.309},"max":{"1min":0.85599999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.63200000000000001,"15min":0.58099999999999996},"min":{"1min":0.42099999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.88100000000000001,"5min":1.177,"15min":1.177},"last":0.76000000000000001}]},{"osd":6,"last update":"Fri Aug 11 12:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.77200000000000002,"15min":0.70999999999999996},"min":{"1min":0.628,"5min":0.441,"15min":0.441},"max":{"1min":1.157,"5min":3.1709999999999998,"15min":3.1709999999999998},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.79700000000000004,"15min":0.73899999999999999},"min":{"1min":0.48699999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97399999999999998,"5min":4.1180000000000003,"15min":4.1180000000000003},"last":0.85599999999999998}]},{"osd":7,"last update":"Fri Aug 11 12:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.75900000000000001,"15min":0.70799999999999996},"min":{"1min":0.60599999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0069999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.76800000000000002,"15min":0.72799999999999998},"min":{"1min":0.66600000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0189999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.81100000000000005}]},{"osd":9,"last update":"Fri Aug 11 12:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.79900000000000004,"15min":0.77300000000000002},"min":{"1min":0.71499999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1,"5min":1.375,"15min":1.375},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81200000000000006,"15min":0.79200000000000004},"min":{"1min":0.67400000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0620000000000001,"5min":1.252,"15min":1.252},"last":0.89900000000000002}]},{"osd":10,"last update":"Fri Aug 11 12:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.80200000000000005,"15min":0.77100000000000002},"min":{"1min":0.64000000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.048,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.82299999999999995,"15min":0.79100000000000004},"min":{"1min":0.65700000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.262,"5min":1.304,"15min":1.304},"last":0.91400000000000003}]},{"osd":11,"last update":"Fri Aug 11 12:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.85299999999999998,"15min":0.85499999999999998},"min":{"1min":0.68600000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":0.94399999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.69799999999999995,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.236,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.88}]}]},{"osd":7,"up_from":51,"seq":219043332153,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1040384,"data_stored":1076643,"data_compressed":53533,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.61399999999999999,"15min":0.60599999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.55200000000000005,"15min":0.53700000000000003},"min":{"1min":0.46999999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.65700000000000003}]},{"osd":1,"last update":"Fri Aug 11 12:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.439,"15min":0.40999999999999998},"min":{"1min":0.34699999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.60799999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.502,"5min":0.48099999999999998,"15min":0.45200000000000001},"min":{"1min":0.35099999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68100000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53300000000000003}]},{"osd":2,"last update":"Fri Aug 11 12:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.623,"15min":0.60899999999999999},"min":{"1min":0.48299999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77900000000000003,"5min":0.879,"15min":0.879},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.63200000000000001,"15min":0.59399999999999997},"min":{"1min":0.52000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78300000000000003,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.70899999999999996}]},{"osd":3,"last update":"Fri Aug 11 12:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65100000000000002,"15min":0.61899999999999999},"min":{"1min":0.441,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0549999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73099999999999998,"15min":0.65700000000000003},"min":{"1min":0.46500000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.139,"5min":5.8419999999999996,"15min":5.8419999999999996},"last":0.67300000000000004}]},{"osd":4,"last update":"Fri Aug 11 12:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56899999999999995,"15min":0.54400000000000004},"min":{"1min":0.36599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.85599999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.34699999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82799999999999996,"5min":1.105,"15min":1.105},"last":0.73799999999999999}]},{"osd":5,"last update":"Fri Aug 11 12:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.68400000000000005,"15min":0.66300000000000003},"min":{"1min":0.48399999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.70499999999999996,"15min":0.67000000000000004},"min":{"1min":0.57999999999999996,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.004,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.80300000000000005}]},{"osd":6,"last update":"Fri Aug 11 12:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.81200000000000006,"15min":0.74299999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0980000000000001,"5min":5.7199999999999998,"15min":5.7199999999999998},"last":0.872},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.749,"15min":0.70099999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.111,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.81299999999999994}]},{"osd":8,"last update":"Fri Aug 11 12:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76000000000000001,"15min":0.70299999999999996},"min":{"1min":0.56299999999999994,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.97299999999999998,"5min":1.206,"15min":1.206},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.751,"15min":0.69899999999999995},"min":{"1min":0.623,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.90300000000000002}]},{"osd":9,"last update":"Fri Aug 11 12:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.85299999999999998,"15min":0.84799999999999998},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.083,"5min":0.88600000000000001,"15min":0.85999999999999999},"min":{"1min":0.59999999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":4.8570000000000002,"5min":4.8570000000000002,"15min":4.8570000000000002},"last":0.82799999999999996}]},{"osd":10,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.81799999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0249999999999999,"5min":1.139,"15min":1.139},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.79000000000000004,"15min":0.76800000000000002},"min":{"1min":0.48899999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.92400000000000004}]},{"osd":11,"last update":"Fri Aug 11 12:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89400000000000002,"15min":0.89500000000000002},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.90500000000000003,"15min":0.90100000000000002},"min":{"1min":0.68500000000000005,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.85899999999999999}]}]},{"osd":6,"up_from":46,"seq":197568495679,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":483870,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.50600000000000001,"15min":0.47299999999999998},"min":{"1min":0.39700000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.52900000000000003,"15min":0.51200000000000001},"min":{"1min":0.41799999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.53100000000000003}]},{"osd":1,"last update":"Fri Aug 11 12:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.67200000000000004,"15min":0.63600000000000001},"min":{"1min":0.503,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.202,"5min":1.327,"15min":1.327},"last":0.505},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.71499999999999997,"15min":0.68300000000000005},"min":{"1min":0.60199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90100000000000002,"5min":1.206,"15min":1.206},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Aug 11 12:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.69899999999999995,"15min":0.69099999999999995},"min":{"1min":0.56399999999999995,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.099,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.72899999999999998,"15min":0.70099999999999996},"min":{"1min":0.51300000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.94299999999999995}]},{"osd":3,"last update":"Fri Aug 11 12:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.61899999999999999,"15min":0.57899999999999996},"min":{"1min":0.443,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.752},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.70699999999999996,"15min":0.67300000000000004},"min":{"1min":0.53000000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.60599999999999998}]},{"osd":4,"last update":"Fri Aug 11 12:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.71599999999999997,"15min":0.70199999999999996},"min":{"1min":0.495,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.77000000000000002,"15min":0.747},"min":{"1min":0.57399999999999995,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.69499999999999995}]},{"osd":5,"last update":"Fri Aug 11 12:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.81399999999999995,"15min":0.78000000000000003},"min":{"1min":0.69099999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.82099999999999995,"15min":0.81000000000000005},"min":{"1min":0.65500000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.68300000000000005}]},{"osd":7,"last update":"Fri Aug 11 12:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.84599999999999997,"15min":0.81399999999999995},"min":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.83499999999999996,"15min":0.81799999999999995},"min":{"1min":0.59899999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.63200000000000001}]},{"osd":8,"last update":"Fri Aug 11 12:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.85499999999999998,"15min":0.84499999999999997},"min":{"1min":0.623,"5min":0.498,"15min":0.498},"max":{"1min":1.216,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.90300000000000002,"15min":0.89300000000000002},"min":{"1min":0.74299999999999999,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1599999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.95699999999999996}]},{"osd":9,"last update":"Fri Aug 11 12:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.90400000000000003,"15min":0.91000000000000003},"min":{"1min":0.55000000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.04,"5min":0.94199999999999995,"15min":0.92900000000000005},"min":{"1min":0.82699999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.873}]},{"osd":10,"last update":"Fri Aug 11 12:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.90400000000000003,"15min":0.89800000000000002},"min":{"1min":0.76900000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2110000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.745},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.94799999999999995,"15min":0.94499999999999995},"min":{"1min":0.746,"5min":0.62,"15min":0.62},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.98699999999999999}]},{"osd":11,"last update":"Fri Aug 11 12:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.96599999999999997,"15min":0.96199999999999997},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.2869999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.016,"5min":1.0269999999999999,"15min":1.0289999999999999},"min":{"1min":0.88300000000000001,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.2290000000000001,"5min":1.611,"15min":1.611},"last":1.0089999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":488742,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56100000000000005,"15min":0.52100000000000002},"min":{"1min":0.40000000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.38200000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.01,"5min":1.01,"15min":1.4430000000000001},"last":0.45700000000000002}]},{"osd":2,"last update":"Fri Aug 11 12:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.621,"15min":0.55300000000000005},"min":{"1min":0.41799999999999998,"5min":0.315,"15min":0.315},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.59799999999999998,"15min":0.53100000000000003},"min":{"1min":0.44800000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.93200000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Aug 11 12:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63700000000000001,"15min":0.61899999999999999},"min":{"1min":0.52200000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86699999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.68899999999999995,"15min":0.64300000000000002},"min":{"1min":0.64200000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0289999999999999,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.73099999999999998}]},{"osd":4,"last update":"Fri Aug 11 12:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.51800000000000002,"15min":0.46400000000000002},"min":{"1min":0.36499999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.88700000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.51200000000000001,"15min":0.48399999999999999},"min":{"1min":0.33200000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.748,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.51400000000000001}]},{"osd":5,"last update":"Fri Aug 11 12:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.72799999999999998,"15min":0.64100000000000001},"min":{"1min":0.52200000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.875},{"interface":"front","average":{"1min":0.748,"5min":0.67000000000000004,"15min":0.622},"min":{"1min":0.46999999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.78200000000000003}]},{"osd":6,"last update":"Fri Aug 11 12:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73899999999999999,"15min":0.73799999999999999},"min":{"1min":0.45000000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.81999999999999995,"15min":0.79600000000000004},"min":{"1min":0.69799999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.98299999999999998}]},{"osd":7,"last update":"Fri Aug 11 12:23:53 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.72199999999999998,"15min":0.68999999999999995},"min":{"1min":0.39000000000000001,"5min":0.31,"15min":0.31},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.75,"5min":0.71199999999999997,"15min":0.68899999999999995},"min":{"1min":0.52100000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.016,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.80600000000000005}]},{"osd":8,"last update":"Fri Aug 11 12:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.79500000000000004,"15min":0.745},"min":{"1min":0.53500000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.089,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.83599999999999997,"15min":0.76200000000000001},"min":{"1min":0.66300000000000003,"5min":0.436,"15min":0.436},"max":{"1min":1.1339999999999999,"5min":1.294,"15min":1.294},"last":1.0680000000000001}]},{"osd":9,"last update":"Fri Aug 11 12:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.76700000000000002,"15min":0.755},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.98399999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.83899999999999997,"15min":0.81699999999999995},"min":{"1min":0.73899999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.141,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.85199999999999998}]},{"osd":10,"last update":"Fri Aug 11 12:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.85699999999999998,"15min":0.81100000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1339999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":1.026},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.79800000000000004,"15min":0.78000000000000003},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.90800000000000003}]},{"osd":11,"last update":"Fri Aug 11 12:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.0389999999999999,"15min":1.0469999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.173,"5min":1.329,"15min":1.329},"last":1.109},{"interface":"front","average":{"1min":0.878,"5min":0.94199999999999995,"15min":0.95199999999999996},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.056,"5min":1.131,"15min":1.131},"last":0.95799999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":485326,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.64800000000000002,"15min":0.55200000000000005},"min":{"1min":0.36599999999999999,"5min":0.314,"15min":0.314},"max":{"1min":1.3859999999999999,"5min":1.782,"15min":1.782},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.65900000000000003,"15min":0.56200000000000006},"min":{"1min":0.45900000000000002,"5min":0.36599999999999999,"15min":0.36499999999999999},"max":{"1min":1.1419999999999999,"5min":2.7749999999999999,"15min":2.7749999999999999},"last":0.748}]},{"osd":2,"last update":"Fri Aug 11 12:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.65600000000000003,"15min":0.57399999999999995},"min":{"1min":0.42099999999999999,"5min":0.40799999999999997,"15min":0.36199999999999999},"max":{"1min":0.875,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.71299999999999997,"15min":0.60499999999999998},"min":{"1min":0.48399999999999999,"5min":0.39100000000000001,"15min":0.33000000000000002},"max":{"1min":1.456,"5min":1.879,"15min":1.879},"last":1.004}]},{"osd":3,"last update":"Fri Aug 11 12:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.56899999999999995,"15min":0.55200000000000005},"min":{"1min":0.47099999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.39300000000000002}]},{"osd":4,"last update":"Fri Aug 11 12:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.71599999999999997,"15min":0.63},"min":{"1min":0.39300000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.639,"5min":1.849,"15min":1.849},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.73599999999999999,"15min":0.65000000000000002},"min":{"1min":0.52800000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1950000000000001,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Aug 11 12:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.77400000000000002,"15min":0.70799999999999996},"min":{"1min":0.56999999999999995,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0369999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77100000000000002,"15min":0.72699999999999998},"min":{"1min":0.61699999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.026,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.78900000000000003}]},{"osd":6,"last update":"Fri Aug 11 12:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.75700000000000001,"15min":0.76100000000000001},"min":{"1min":0.47199999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.411,"5min":2.8839999999999999,"15min":2.8839999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.70799999999999996,"15min":0.71499999999999997},"min":{"1min":0.39100000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.083,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.83299999999999996}]},{"osd":7,"last update":"Fri Aug 11 12:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84799999999999998,"15min":0.84899999999999998},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.0649999999999999,"5min":1.262,"15min":1.262},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.80700000000000005,"15min":0.80600000000000005},"min":{"1min":0.629,"5min":0.44,"15min":0.44},"max":{"1min":1.012,"5min":1.429,"15min":1.429},"last":0.76900000000000002}]},{"osd":8,"last update":"Fri Aug 11 12:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.82599999999999996,"15min":0.84299999999999997},"min":{"1min":0.69799999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.109,"5min":1.262,"15min":1.262},"last":1.109},{"interface":"front","average":{"1min":1.2949999999999999,"5min":0.97499999999999998,"15min":0.95499999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":6.4260000000000002,"5min":6.4260000000000002,"15min":6.4260000000000002},"last":1.075}]},{"osd":9,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.84699999999999998,"15min":0.86599999999999999},"min":{"1min":0.53900000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.099,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.3140000000000001},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.93100000000000005,"15min":0.95599999999999996},"min":{"1min":0.59999999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.3260000000000001}]},{"osd":10,"last update":"Fri Aug 11 12:23:59 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.95799999999999996,"15min":0.95199999999999996},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.161},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.90400000000000003,"15min":0.90000000000000002},"min":{"1min":0.67800000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.296,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.90700000000000003}]},{"osd":11,"last update":"Fri Aug 11 12:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.876,"15min":0.876},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1399999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":1.264},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.94999999999999996,"15min":0.94499999999999995},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.288}]}]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":488551,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.64000000000000001,"15min":0.55400000000000005},"min":{"1min":0.36599999999999999,"5min":0.316,"15min":0.316},"max":{"1min":1.1180000000000001,"5min":5.968,"15min":5.968},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.372,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83299999999999996,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.46600000000000003}]},{"osd":1,"last update":"Fri Aug 11 12:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59799999999999998,"15min":0.52700000000000002},"min":{"1min":0.41099999999999998,"5min":0.376,"15min":0.36399999999999999},"max":{"1min":0.83399999999999996,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.54400000000000004},"min":{"1min":0.41099999999999998,"5min":0.373,"15min":0.34399999999999997},"max":{"1min":0.84999999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.68799999999999994}]},{"osd":3,"last update":"Fri Aug 11 12:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.63200000000000001,"15min":0.60299999999999998},"min":{"1min":0.45500000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88900000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.64800000000000002,"15min":0.60699999999999998},"min":{"1min":0.47999999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86199999999999999,"5min":1.306,"15min":1.306},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri Aug 11 12:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.68400000000000005},"min":{"1min":0.48699999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.876,"5min":1.179,"15min":1.179},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Aug 11 12:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.499,"15min":0.44700000000000001},"min":{"1min":0.36899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78100000000000003,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.50600000000000001,"15min":0.46100000000000002},"min":{"1min":0.34899999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84699999999999998,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.57899999999999996}]},{"osd":6,"last update":"Fri Aug 11 12:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65700000000000003,"15min":0.629},"min":{"1min":0.45300000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89400000000000002,"5min":1.429,"15min":1.429},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.68999999999999995,"15min":0.63600000000000001},"min":{"1min":0.55400000000000005,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.94499999999999995,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.629}]},{"osd":7,"last update":"Fri Aug 11 12:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.73899999999999999,"15min":0.73399999999999999},"min":{"1min":0.59699999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.79400000000000004,"15min":0.79300000000000004},"min":{"1min":0.64100000000000001,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.75900000000000001}]},{"osd":8,"last update":"Fri Aug 11 12:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.65500000000000003,"15min":0.60699999999999998},"min":{"1min":0.432,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.94999999999999996,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.495},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.625,"15min":0.57699999999999996},"min":{"1min":0.501,"5min":0.439,"15min":0.439},"max":{"1min":0.89900000000000002,"5min":1.325,"15min":1.325},"last":0.66400000000000003}]},{"osd":9,"last update":"Fri Aug 11 12:23:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.76000000000000001,"15min":0.73699999999999999},"min":{"1min":0.61099999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2809999999999999,"5min":1.387,"15min":1.387},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.879,"5min":0.81899999999999995,"15min":0.80600000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.81200000000000006}]},{"osd":10,"last update":"Fri Aug 11 12:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.80300000000000005,"15min":0.78700000000000003},"min":{"1min":0.70999999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.036,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.84799999999999998,"15min":0.83199999999999996},"min":{"1min":0.73699999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0920000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.88200000000000001}]},{"osd":11,"last update":"Fri Aug 11 12:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.78300000000000003,"15min":0.77600000000000002},"min":{"1min":0.59199999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.80700000000000005,"15min":0.80300000000000005},"min":{"1min":0.67700000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.012,"5min":1.409,"15min":1.409},"last":0.94999999999999996}]}]},{"osd":3,"up_from":25,"seq":107374182476,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":483578,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.48099999999999998,"15min":0.40200000000000002},"min":{"1min":0.42299999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.50700000000000001,"15min":0.45000000000000001},"min":{"1min":0.39600000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.42099999999999999}]},{"osd":1,"last update":"Fri Aug 11 12:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.68999999999999995,"15min":0.58999999999999997},"min":{"1min":0.433,"5min":0.372,"15min":0.372},"max":{"1min":1.0209999999999999,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.65400000000000003,"15min":0.59999999999999998},"min":{"1min":0.51700000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.84799999999999998,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.78500000000000003}]},{"osd":2,"last update":"Fri Aug 11 12:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.70499999999999996,"15min":0.63700000000000001},"min":{"1min":0.55300000000000005,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":3.0289999999999999,"5min":3.0289999999999999,"15min":3.0289999999999999},"last":0.755},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.749,"15min":0.64700000000000002},"min":{"1min":0.71999999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.82599999999999996}]},{"osd":4,"last update":"Fri Aug 11 12:23:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.68600000000000005,"15min":0.624},"min":{"1min":0.53500000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0429999999999999,"5min":1.242,"15min":1.242},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.76200000000000001,"15min":0.66200000000000003},"min":{"1min":0.56200000000000006,"5min":0.435,"15min":0.435},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Aug 11 12:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.72899999999999998,"15min":0.66500000000000004},"min":{"1min":0.57299999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.747,"15min":0.68100000000000005},"min":{"1min":0.48899999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.71399999999999997}]},{"osd":6,"last update":"Fri Aug 11 12:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.81000000000000005,"15min":0.77200000000000002},"min":{"1min":0.59999999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.874},{"interface":"front","average":{"1min":0.88,"5min":0.75800000000000001,"15min":0.72499999999999998},"min":{"1min":0.56200000000000006,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Aug 11 12:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79800000000000004,"15min":0.76900000000000002},"min":{"1min":0.53600000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.89900000000000002,"15min":0.88500000000000001},"min":{"1min":0.64900000000000002,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.321,"5min":1.361,"15min":1.361},"last":0.73199999999999998}]},{"osd":8,"last update":"Fri Aug 11 12:23:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":3.052,"5min":3.052,"15min":3.052},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.83999999999999997}]},{"osd":9,"last update":"Fri Aug 11 12:23:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":0.98199999999999998,"15min":0.996},"min":{"1min":0.83799999999999997,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.298,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.91900000000000004,"15min":0.94099999999999995},"min":{"1min":0.628,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.91200000000000003}]},{"osd":10,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.95599999999999996,"15min":0.98799999999999999},"min":{"1min":0.68600000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2809999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.94499999999999995,"15min":0.97199999999999998},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":0.80900000000000005}]},{"osd":11,"last update":"Fri Aug 11 12:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.98699999999999999,"15min":0.98599999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.3320000000000001,"5min":1.341,"15min":1.341},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.127,"5min":1.028,"15min":1.012},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":3.0990000000000002,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":0.92700000000000005}]}]},{"osd":4,"up_from":33,"seq":141733920840,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":483848,"data_compressed":17587,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.39900000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.81599999999999995,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.41399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80900000000000005,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.72099999999999997}]},{"osd":1,"last update":"Fri Aug 11 12:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.44400000000000001,"15min":0.40899999999999997},"min":{"1min":0.30199999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.68000000000000005,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.312},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.45200000000000001,"15min":0.39400000000000002},"min":{"1min":0.34599999999999997,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.82899999999999996,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.33900000000000002}]},{"osd":2,"last update":"Fri Aug 11 12:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.66900000000000004,"15min":0.59699999999999998},"min":{"1min":0.52500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64600000000000002,"15min":0.57899999999999996},"min":{"1min":0.42899999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.98499999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.72099999999999997}]},{"osd":3,"last update":"Fri Aug 11 12:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.64700000000000002,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.379,"15min":0.379},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.628},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58299999999999996,"15min":0.56299999999999994},"min":{"1min":0.42999999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.95099999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.53100000000000003}]},{"osd":5,"last update":"Fri Aug 11 12:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.66300000000000003,"15min":0.58899999999999997},"min":{"1min":0.51600000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.70699999999999996,"15min":0.60899999999999999},"min":{"1min":0.57199999999999995,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0229999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Fri Aug 11 12:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.73399999999999999,"15min":0.70199999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.65500000000000003,"15min":0.625},"min":{"1min":0.48799999999999999,"5min":0.433,"15min":0.433},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.5}]},{"osd":7,"last update":"Fri Aug 11 12:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.64400000000000002,"15min":0.58999999999999997},"min":{"1min":0.38100000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.99299999999999999,"5min":1.125,"15min":1.125},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70899999999999996,"15min":0.65000000000000002},"min":{"1min":0.42299999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0449999999999999,"5min":1.151,"15min":1.151},"last":0.39500000000000002}]},{"osd":8,"last update":"Fri Aug 11 12:24:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67600000000000005,"15min":0.64400000000000002},"min":{"1min":0.46000000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.98399999999999999,"5min":1.016,"15min":1.016},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.87,"5min":0.82699999999999996,"15min":0.77100000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.85399999999999998}]},{"osd":9,"last update":"Fri Aug 11 12:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.88,"15min":0.84999999999999998},"min":{"1min":0.66700000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.75},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.85199999999999998,"15min":0.83399999999999996},"min":{"1min":0.67300000000000004,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.76600000000000001}]},{"osd":10,"last update":"Fri Aug 11 12:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83599999999999997,"15min":0.83999999999999997},"min":{"1min":0.57599999999999996,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.74199999999999999,"15min":0.748},"min":{"1min":0.53100000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.032,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.44600000000000001}]},{"osd":11,"last update":"Fri Aug 11 12:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.85499999999999998,"15min":0.86199999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.0800000000000001,"5min":1.165,"15min":1.165},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.873,"15min":0.875},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.123,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.79200000000000004}]}]},{"osd":5,"up_from":38,"seq":163208757315,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":1076594,"data_compressed":53533,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 11 12:24:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53400000000000003,"15min":0.52300000000000002},"min":{"1min":0.374,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77200000000000002,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.374},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.54100000000000004},"min":{"1min":0.40699999999999997,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0980000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Aug 11 12:24:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.58299999999999996,"15min":0.55300000000000005},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.626,"15min":0.57699999999999996},"min":{"1min":0.51300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.93600000000000005,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.57299999999999995}]},{"osd":2,"last update":"Fri Aug 11 12:24:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.42999999999999999,"15min":0.40600000000000003},"min":{"1min":0.30099999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.433},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.46200000000000002,"15min":0.41399999999999998},"min":{"1min":0.28399999999999997,"5min":0.248,"15min":0.248},"max":{"1min":0.71799999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.50800000000000001}]},{"osd":3,"last update":"Fri Aug 11 12:24:15 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.39800000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.88400000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.60299999999999998,"15min":0.59399999999999997},"min":{"1min":0.46700000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.78200000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.67900000000000005}]},{"osd":4,"last update":"Fri Aug 11 12:24:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.66500000000000004,"15min":0.60999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.63500000000000001,"15min":0.61099999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.85499999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.59399999999999997}]},{"osd":6,"last update":"Fri Aug 11 12:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.66600000000000004,"15min":0.626},"min":{"1min":0.45600000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":3.0659999999999998,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.878,"5min":0.73899999999999999,"15min":0.68700000000000006},"min":{"1min":0.51800000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":3.081,"5min":3.081,"15min":3.081},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Aug 11 12:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.71699999999999997,"15min":0.68400000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97899999999999998,"5min":1.048,"15min":1.048},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.69799999999999995,"15min":0.67300000000000004},"min":{"1min":0.48499999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.72199999999999998}]},{"osd":8,"last update":"Fri Aug 11 12:24:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.65400000000000003,"15min":0.60999999999999999},"min":{"1min":0.36699999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93200000000000005,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.60299999999999998,"15min":0.57099999999999995},"min":{"1min":0.42399999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.66400000000000003}]},{"osd":9,"last update":"Fri Aug 11 12:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.74199999999999999,"15min":0.73499999999999999},"min":{"1min":0.504,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.83699999999999997,"15min":0.81299999999999994},"min":{"1min":0.629,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.984,"5min":2.984,"15min":2.984},"last":0.77000000000000002}]},{"osd":10,"last update":"Fri Aug 11 12:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.82999999999999996,"15min":0.82099999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77000000000000002,"15min":0.76200000000000001},"min":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.75700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34304,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34304,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35946,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":6072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":5578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-11T12:24:22.233 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-11T12:24:22.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.466+0000 7fd5281ff700 1 -- 172.21.15.8:0/754934380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd520102570 msgr2=0x7fd520108e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:22.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.466+0000 7fd5281ff700 1 --2- 172.21.15.8:0/754934380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd520102570 0x7fd520108e20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd518009f90 tx=0x7fd51800b330 comp rx=0 tx=0).stop 2023-08-11T12:24:22.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.466+0000 7fd5281ff700 1 -- 172.21.15.8:0/754934380 shutdown_connections 2023-08-11T12:24:22.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.466+0000 7fd5281ff700 1 --2- 172.21.15.8:0/754934380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd520102570 0x7fd520108e20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:22.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.466+0000 7fd5281ff700 1 --2- 172.21.15.8:0/754934380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5201009e0 0x7fd520100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:22.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.466+0000 7fd5281ff700 1 --2- 172.21.15.8:0/754934380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd520101bd0 0x7fd520102030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:22.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.466+0000 7fd5281ff700 1 -- 172.21.15.8:0/754934380 >> 172.21.15.8:0/754934380 conn(0x7fd5200fbf50 msgr2=0x7fd5200fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:22.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.466+0000 7fd5281ff700 1 -- 172.21.15.8:0/754934380 shutdown_connections 2023-08-11T12:24:22.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.466+0000 7fd5281ff700 1 -- 172.21.15.8:0/754934380 wait complete. 2023-08-11T12:24:22.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.467+0000 7fd5281ff700 1 Processor -- start 2023-08-11T12:24:22.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.468+0000 7fd5281ff700 1 -- start start 2023-08-11T12:24:22.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.468+0000 7fd5281ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5201009e0 0x7fd5201967f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:22.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.468+0000 7fd5281ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd520101bd0 0x7fd520196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:22.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.468+0000 7fd5281ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd520102570 0x7fd52019dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:22.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.468+0000 7fd5281ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52019e370 con 0x7fd520102570 2023-08-11T12:24:22.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.468+0000 7fd5281ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52019e4b0 con 0x7fd520101bd0 2023-08-11T12:24:22.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.468+0000 7fd5281ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52019e640 con 0x7fd5201009e0 2023-08-11T12:24:22.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.468+0000 7fd52679c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd520102570 0x7fd52019dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:22.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.468+0000 7fd52579a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd520101bd0 0x7fd520196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:22.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.468+0000 7fd52679c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd520102570 0x7fd52019dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46780/0 (socket says 172.21.15.8:46780) 2023-08-11T12:24:22.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.468+0000 7fd52679c700 1 -- 172.21.15.8:0/3989022044 learned_addr learned my addr 172.21.15.8:0/3989022044 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:22.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.468+0000 7fd525f9b700 1 --2- 172.21.15.8:0/3989022044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5201009e0 0x7fd5201967f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:22.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.469+0000 7fd52579a700 1 -- 172.21.15.8:0/3989022044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5201009e0 msgr2=0x7fd5201967f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:22.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.469+0000 7fd52579a700 1 --2- 172.21.15.8:0/3989022044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5201009e0 0x7fd5201967f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:22.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.469+0000 7fd52579a700 1 -- 172.21.15.8:0/3989022044 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd520102570 msgr2=0x7fd52019dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:22.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.469+0000 7fd52579a700 1 --2- 172.21.15.8:0/3989022044 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd520102570 0x7fd52019dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:22.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.469+0000 7fd52579a700 1 -- 172.21.15.8:0/3989022044 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd518009c40 con 0x7fd520101bd0 2023-08-11T12:24:22.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.469+0000 7fd52579a700 1 --2- 172.21.15.8:0/3989022044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd520101bd0 0x7fd520196d30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd51000e9c0 tx=0x7fd51000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:22.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.469+0000 7fd516ffd700 1 -- 172.21.15.8:0/3989022044 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51000c9c0 con 0x7fd520101bd0 2023-08-11T12:24:22.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.469+0000 7fd5281ff700 1 -- 172.21.15.8:0/3989022044 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd52019e920 con 0x7fd520101bd0 2023-08-11T12:24:22.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.469+0000 7fd516ffd700 1 -- 172.21.15.8:0/3989022044 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd510010430 con 0x7fd520101bd0 2023-08-11T12:24:22.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.469+0000 7fd516ffd700 1 -- 172.21.15.8:0/3989022044 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd510018680 con 0x7fd520101bd0 2023-08-11T12:24:22.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.469+0000 7fd5281ff700 1 -- 172.21.15.8:0/3989022044 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd52019ee80 con 0x7fd520101bd0 2023-08-11T12:24:22.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.470+0000 7fd5281ff700 1 -- 172.21.15.8:0/3989022044 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd520107f30 con 0x7fd520101bd0 2023-08-11T12:24:22.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.473+0000 7fd516ffd700 1 -- 172.21.15.8:0/3989022044 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fd510010860 con 0x7fd520101bd0 2023-08-11T12:24:22.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.474+0000 7fd516ffd700 1 --2- 172.21.15.8:0/3989022044 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd50c09ff50 0x7fd50c0a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:22.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.474+0000 7fd516ffd700 1 -- 172.21.15.8:0/3989022044 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fd510014070 con 0x7fd520101bd0 2023-08-11T12:24:22.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.474+0000 7fd525f9b700 1 --2- 172.21.15.8:0/3989022044 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd50c09ff50 0x7fd50c0a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:22.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.475+0000 7fd525f9b700 1 --2- 172.21.15.8:0/3989022044 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd50c09ff50 0x7fd50c0a2410 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd520101a30 tx=0x7fd51c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:22.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.476+0000 7fd516ffd700 1 -- 172.21.15.8:0/3989022044 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fd510095220 con 0x7fd520101bd0 2023-08-11T12:24:22.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.689+0000 7fd5281ff700 1 -- 172.21.15.8:0/3989022044 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd52010c340 con 0x7fd520101bd0 2023-08-11T12:24:22.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.691+0000 7fd516ffd700 1 -- 172.21.15.8:0/3989022044 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24348 (secure 0 0 0) 0x7fd510098840 con 0x7fd520101bd0 2023-08-11T12:24:22.693 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:22.693 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":89,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","created":"2023-08-11T12:14:28.341113+0000","modified":"2023-08-11T12:22:31.713248+0000","last_up_change":"2023-08-11T12:21:14.913735+0000","last_in_change":"2023-08-11T12:20:57.476558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-11T12:17:49.040758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-11T12:22:01.383296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-11T12:22:02.816329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-11T12:22:06.369375+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f903e393-7894-42d6-8b11-737ceef1f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6803","nonce":664104961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6805","nonce":664104961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6809","nonce":664104961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6807","nonce":664104961}]},"public_addr":"172.21.15.8:6803/664104961","cluster_addr":"172.21.15.8:6805/664104961","heartbeat_back_addr":"172.21.15.8:6809/664104961","heartbeat_front_addr":"172.21.15.8:6807/664104961","state":["exists","up"]},{"osd":1,"uuid":"1e988e5c-e78c-46d5-80a5-dff7ac38cbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6801","nonce":4187350703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6803","nonce":4187350703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6807","nonce":4187350703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6805","nonce":4187350703}]},"public_addr":"172.21.15.45:6801/4187350703","cluster_addr":"172.21.15.45:6803/4187350703","heartbeat_back_addr":"172.21.15.45:6807/4187350703","heartbeat_front_addr":"172.21.15.45:6805/4187350703","state":["exists","up"]},{"osd":2,"uuid":"1835217c-a93c-4181-b8b8-cc410bab1a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6801","nonce":2547818140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6803","nonce":2547818140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6807","nonce":2547818140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6805","nonce":2547818140}]},"public_addr":"172.21.15.194:6801/2547818140","cluster_addr":"172.21.15.194:6803/2547818140","heartbeat_back_addr":"172.21.15.194:6807/2547818140","heartbeat_front_addr":"172.21.15.194:6805/2547818140","state":["exists","up"]},{"osd":3,"uuid":"b55ae61a-731c-4312-a998-661122b84788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6811","nonce":187418883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6813","nonce":187418883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6817","nonce":187418883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6815","nonce":187418883}]},"public_addr":"172.21.15.8:6811/187418883","cluster_addr":"172.21.15.8:6813/187418883","heartbeat_back_addr":"172.21.15.8:6817/187418883","heartbeat_front_addr":"172.21.15.8:6815/187418883","state":["exists","up"]},{"osd":4,"uuid":"2c28acbb-e807-4559-8aa2-a35ca84b5d43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6809","nonce":3099704571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6811","nonce":3099704571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6815","nonce":3099704571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6813","nonce":3099704571}]},"public_addr":"172.21.15.45:6809/3099704571","cluster_addr":"172.21.15.45:6811/3099704571","heartbeat_back_addr":"172.21.15.45:6815/3099704571","heartbeat_front_addr":"172.21.15.45:6813/3099704571","state":["exists","up"]},{"osd":5,"uuid":"37032289-8016-4730-9b69-f7985e058ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6809","nonce":263803874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6811","nonce":263803874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6815","nonce":263803874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6813","nonce":263803874}]},"public_addr":"172.21.15.194:6809/263803874","cluster_addr":"172.21.15.194:6811/263803874","heartbeat_back_addr":"172.21.15.194:6815/263803874","heartbeat_front_addr":"172.21.15.194:6813/263803874","state":["exists","up"]},{"osd":6,"uuid":"32d2dab9-6944-40d1-ada9-4f941821b063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6819","nonce":1802966829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6821","nonce":1802966829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6825","nonce":1802966829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6823","nonce":1802966829}]},"public_addr":"172.21.15.8:6819/1802966829","cluster_addr":"172.21.15.8:6821/1802966829","heartbeat_back_addr":"172.21.15.8:6825/1802966829","heartbeat_front_addr":"172.21.15.8:6823/1802966829","state":["exists","up"]},{"osd":7,"uuid":"086aff58-1554-49fe-92ff-5166b115aeef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6817","nonce":3715737148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6819","nonce":3715737148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6823","nonce":3715737148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6821","nonce":3715737148}]},"public_addr":"172.21.15.45:6817/3715737148","cluster_addr":"172.21.15.45:6819/3715737148","heartbeat_back_addr":"172.21.15.45:6823/3715737148","heartbeat_front_addr":"172.21.15.45:6821/3715737148","state":["exists","up"]},{"osd":8,"uuid":"7fff5e95-2453-4ea6-a5c1-3bba6a1f6400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6817","nonce":57497127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6819","nonce":57497127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6823","nonce":57497127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6821","nonce":57497127}]},"public_addr":"172.21.15.194:6817/57497127","cluster_addr":"172.21.15.194:6819/57497127","heartbeat_back_addr":"172.21.15.194:6823/57497127","heartbeat_front_addr":"172.21.15.194:6821/57497127","state":["exists","up"]},{"osd":9,"uuid":"31ab0121-4c92-42ec-9f19-e672062e8814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6827","nonce":434661930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6829","nonce":434661930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6833","nonce":434661930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6831","nonce":434661930}]},"public_addr":"172.21.15.8:6827/434661930","cluster_addr":"172.21.15.8:6829/434661930","heartbeat_back_addr":"172.21.15.8:6833/434661930","heartbeat_front_addr":"172.21.15.8:6831/434661930","state":["exists","up"]},{"osd":10,"uuid":"62c632e4-94f6-4630-9d94-8d28fccacf45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6825","nonce":3281212184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6827","nonce":3281212184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6831","nonce":3281212184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6829","nonce":3281212184}]},"public_addr":"172.21.15.45:6825/3281212184","cluster_addr":"172.21.15.45:6827/3281212184","heartbeat_back_addr":"172.21.15.45:6831/3281212184","heartbeat_front_addr":"172.21.15.45:6829/3281212184","state":["exists","up"]},{"osd":11,"uuid":"8ca4a80d-cd75-4230-b46d-aef6fdc03e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6825","nonce":1637875895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6827","nonce":1637875895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6831","nonce":1637875895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6829","nonce":1637875895}]},"public_addr":"172.21.15.194:6825/1637875895","cluster_addr":"172.21.15.194:6827/1637875895","heartbeat_back_addr":"172.21.15.194:6831/1637875895","heartbeat_front_addr":"172.21.15.194:6829/1637875895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:04.255616+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:26.243863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:46.630365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:12.926291+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:35.747049+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:55.793767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:21.685725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:43.703215+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:04.043674+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:30.320026+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:52.751974+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:21:13.230024+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/2000592056":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2102228072":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2374527928":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2928221278":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2744750874":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/3681755887":"2023-08-12T12:15:02.528403+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-11T12:24:22.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.693+0000 7fd5281ff700 1 -- 172.21.15.8:0/3989022044 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd50c09ff50 msgr2=0x7fd50c0a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:22.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.693+0000 7fd5281ff700 1 --2- 172.21.15.8:0/3989022044 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd50c09ff50 0x7fd50c0a2410 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd520101a30 tx=0x7fd51c009260 comp rx=0 tx=0).stop 2023-08-11T12:24:22.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.693+0000 7fd5281ff700 1 -- 172.21.15.8:0/3989022044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd520101bd0 msgr2=0x7fd520196d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:22.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.693+0000 7fd5281ff700 1 --2- 172.21.15.8:0/3989022044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd520101bd0 0x7fd520196d30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd51000e9c0 tx=0x7fd51000ecd0 comp rx=0 tx=0).stop 2023-08-11T12:24:22.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.693+0000 7fd5281ff700 1 -- 172.21.15.8:0/3989022044 shutdown_connections 2023-08-11T12:24:22.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.693+0000 7fd5281ff700 1 --2- 172.21.15.8:0/3989022044 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fd50c09ff50 0x7fd50c0a2410 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:22.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.693+0000 7fd5281ff700 1 --2- 172.21.15.8:0/3989022044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5201009e0 0x7fd5201967f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:22.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.693+0000 7fd5281ff700 1 --2- 172.21.15.8:0/3989022044 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd520102570 0x7fd52019dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:22.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.693+0000 7fd5281ff700 1 --2- 172.21.15.8:0/3989022044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd520101bd0 0x7fd520196d30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:22.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.693+0000 7fd5281ff700 1 -- 172.21.15.8:0/3989022044 >> 172.21.15.8:0/3989022044 conn(0x7fd5200fbf50 msgr2=0x7fd520105070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:22.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.693+0000 7fd5281ff700 1 -- 172.21.15.8:0/3989022044 shutdown_connections 2023-08-11T12:24:22.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.693+0000 7fd5281ff700 1 -- 172.21.15.8:0/3989022044 wait complete. 2023-08-11T12:24:22.716 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-11T12:17:49.040758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-11T12:22:01.383296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-11T12:22:02.816329+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-11T12:22:06.369375+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-11T12:24:22.717 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-11T12:24:22.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.923+0000 7f5467dff700 1 -- 172.21.15.8:0/4208973461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5460102590 msgr2=0x7f5460108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:22.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.923+0000 7f5467dff700 1 --2- 172.21.15.8:0/4208973461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5460102590 0x7f5460108e40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5458009fc0 tx=0x7f545800b330 comp rx=0 tx=0).stop 2023-08-11T12:24:22.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.923+0000 7f5467dff700 1 -- 172.21.15.8:0/4208973461 shutdown_connections 2023-08-11T12:24:22.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.923+0000 7f5467dff700 1 --2- 172.21.15.8:0/4208973461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5460102590 0x7f5460108e40 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:22.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.923+0000 7f5467dff700 1 --2- 172.21.15.8:0/4208973461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5460100a00 0x7f5460100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:22.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.923+0000 7f5467dff700 1 --2- 172.21.15.8:0/4208973461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5460101bf0 0x7f5460102050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:22.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.923+0000 7f5467dff700 1 -- 172.21.15.8:0/4208973461 >> 172.21.15.8:0/4208973461 conn(0x7f54600fbf70 msgr2=0x7f54600fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:22.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.923+0000 7f5467dff700 1 -- 172.21.15.8:0/4208973461 shutdown_connections 2023-08-11T12:24:22.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.924+0000 7f5467dff700 1 -- 172.21.15.8:0/4208973461 wait complete. 2023-08-11T12:24:22.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.924+0000 7f5467dff700 1 Processor -- start 2023-08-11T12:24:22.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.925+0000 7f5467dff700 1 -- start start 2023-08-11T12:24:22.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.925+0000 7f5467dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5460100a00 0x7f54601989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:22.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.925+0000 7f5467dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5460101bf0 0x7f5460198f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:22.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.925+0000 7f5467dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5460102590 0x7f546019ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:22.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.925+0000 7f5467dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54601a0550 con 0x7f5460101bf0 2023-08-11T12:24:22.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.925+0000 7f5467dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54601a0690 con 0x7f5460100a00 2023-08-11T12:24:22.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.925+0000 7f5467dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54601a0820 con 0x7f5460102590 2023-08-11T12:24:22.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.925+0000 7f546539a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5460101bf0 0x7f5460198f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:22.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.925+0000 7f546539a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5460101bf0 0x7f5460198f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46790/0 (socket says 172.21.15.8:46790) 2023-08-11T12:24:22.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.925+0000 7f546539a700 1 -- 172.21.15.8:0/3860296376 learned_addr learned my addr 172.21.15.8:0/3860296376 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:22.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.925+0000 7f5465b9b700 1 --2- 172.21.15.8:0/3860296376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5460100a00 0x7f54601989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:22.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.925+0000 7f546639c700 1 --2- 172.21.15.8:0/3860296376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5460102590 0x7f546019ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:22.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.926+0000 7f546539a700 1 -- 172.21.15.8:0/3860296376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5460102590 msgr2=0x7f546019ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:22.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.926+0000 7f546539a700 1 --2- 172.21.15.8:0/3860296376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5460102590 0x7f546019ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:22.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.926+0000 7f546539a700 1 -- 172.21.15.8:0/3860296376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5460100a00 msgr2=0x7f54601989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:22.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.926+0000 7f546539a700 1 --2- 172.21.15.8:0/3860296376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5460100a00 0x7f54601989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:22.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.926+0000 7f546539a700 1 -- 172.21.15.8:0/3860296376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5458009c40 con 0x7f5460101bf0 2023-08-11T12:24:22.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.926+0000 7f546539a700 1 --2- 172.21.15.8:0/3860296376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5460101bf0 0x7f5460198f10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f545000e9c0 tx=0x7f545000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:22.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.926+0000 7f5456ffd700 1 -- 172.21.15.8:0/3860296376 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5450004a30 con 0x7f5460101bf0 2023-08-11T12:24:22.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.926+0000 7f5456ffd700 1 -- 172.21.15.8:0/3860296376 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f545000cc80 con 0x7f5460101bf0 2023-08-11T12:24:22.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.926+0000 7f5467dff700 1 -- 172.21.15.8:0/3860296376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54601a0b00 con 0x7f5460101bf0 2023-08-11T12:24:22.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.926+0000 7f5456ffd700 1 -- 172.21.15.8:0/3860296376 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54500054e0 con 0x7f5460101bf0 2023-08-11T12:24:22.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.926+0000 7f5467dff700 1 -- 172.21.15.8:0/3860296376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54601a1010 con 0x7f5460101bf0 2023-08-11T12:24:22.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.927+0000 7f5467dff700 1 -- 172.21.15.8:0/3860296376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f546010c270 con 0x7f5460101bf0 2023-08-11T12:24:22.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.929+0000 7f5456ffd700 1 -- 172.21.15.8:0/3860296376 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f5450004b90 con 0x7f5460101bf0 2023-08-11T12:24:22.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.931+0000 7f5456ffd700 1 --2- 172.21.15.8:0/3860296376 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f544c09ff50 0x7f544c0a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:22.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.931+0000 7f5456ffd700 1 -- 172.21.15.8:0/3860296376 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f5450014070 con 0x7f5460101bf0 2023-08-11T12:24:22.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.931+0000 7f5465b9b700 1 --2- 172.21.15.8:0/3860296376 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f544c09ff50 0x7f544c0a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:22.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.932+0000 7f5465b9b700 1 --2- 172.21.15.8:0/3860296376 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f544c09ff50 0x7f544c0a2410 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5460101a50 tx=0x7f545c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:22.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:22.935+0000 7f5456ffd700 1 -- 172.21.15.8:0/3860296376 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f5450095080 con 0x7f5460101bf0 2023-08-11T12:24:23.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:22 smithi008 ceph-mon[97158]: from='client.15477 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:24:23.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:22 smithi008 ceph-mon[97158]: from='client.15483 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:24:23.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:22 smithi008 ceph-mon[97158]: pgmap v345: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 8 op/s 2023-08-11T12:24:23.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:22 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3989022044' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:24:23.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:22 smithi194 ceph-mon[130905]: from='client.15477 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:24:23.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:22 smithi194 ceph-mon[130905]: from='client.15483 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:24:23.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:22 smithi194 ceph-mon[130905]: pgmap v345: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 8 op/s 2023-08-11T12:24:23.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:22 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3989022044' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:24:23.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:22 smithi045 ceph-mon[130284]: from='client.15477 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:24:23.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:22 smithi045 ceph-mon[130284]: from='client.15483 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-11T12:24:23.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:22 smithi045 ceph-mon[130284]: pgmap v345: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 8 op/s 2023-08-11T12:24:23.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:22 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3989022044' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:24:23.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.145+0000 7f5467dff700 1 -- 172.21.15.8:0/3860296376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f54601a11a0 con 0x7f5460101bf0 2023-08-11T12:24:23.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.146+0000 7f5456ffd700 1 -- 172.21.15.8:0/3860296376 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7f54500986a0 con 0x7f5460101bf0 2023-08-11T12:24:23.148 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-08-11T12:24:23.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.148+0000 7f5467dff700 1 -- 172.21.15.8:0/3860296376 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f544c09ff50 msgr2=0x7f544c0a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:23.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.148+0000 7f5467dff700 1 --2- 172.21.15.8:0/3860296376 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f544c09ff50 0x7f544c0a2410 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5460101a50 tx=0x7f545c009260 comp rx=0 tx=0).stop 2023-08-11T12:24:23.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.148+0000 7f5467dff700 1 -- 172.21.15.8:0/3860296376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5460101bf0 msgr2=0x7f5460198f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:23.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.148+0000 7f5467dff700 1 --2- 172.21.15.8:0/3860296376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5460101bf0 0x7f5460198f10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f545000e9c0 tx=0x7f545000ecd0 comp rx=0 tx=0).stop 2023-08-11T12:24:23.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.148+0000 7f5467dff700 1 -- 172.21.15.8:0/3860296376 shutdown_connections 2023-08-11T12:24:23.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.148+0000 7f5467dff700 1 --2- 172.21.15.8:0/3860296376 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f544c09ff50 0x7f544c0a2410 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:23.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.148+0000 7f5467dff700 1 --2- 172.21.15.8:0/3860296376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5460102590 0x7f546019ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:23.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.148+0000 7f5467dff700 1 --2- 172.21.15.8:0/3860296376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5460100a00 0x7f54601989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:23.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.148+0000 7f5467dff700 1 --2- 172.21.15.8:0/3860296376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5460101bf0 0x7f5460198f10 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:23.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.148+0000 7f5467dff700 1 -- 172.21.15.8:0/3860296376 >> 172.21.15.8:0/3860296376 conn(0x7f54600fbf70 msgr2=0x7f5460107440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:23.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.148+0000 7f5467dff700 1 -- 172.21.15.8:0/3860296376 shutdown_connections 2023-08-11T12:24:23.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.148+0000 7f5467dff700 1 -- 172.21.15.8:0/3860296376 wait complete. 2023-08-11T12:24:23.169 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-11T12:24:23.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.375+0000 7f3b5ddff700 1 -- 172.21.15.8:0/3096177921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b58100a00 msgr2=0x7f3b58100e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:23.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.375+0000 7f3b5ddff700 1 --2- 172.21.15.8:0/3096177921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b58100a00 0x7f3b58100e20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3b480098f0 tx=0x7f3b48009c00 comp rx=0 tx=0).stop 2023-08-11T12:24:23.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.375+0000 7f3b5ddff700 1 -- 172.21.15.8:0/3096177921 shutdown_connections 2023-08-11T12:24:23.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.375+0000 7f3b5ddff700 1 --2- 172.21.15.8:0/3096177921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b58100a00 0x7f3b58100e20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:23.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.375+0000 7f3b5ddff700 1 --2- 172.21.15.8:0/3096177921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b58102590 0x7f3b58108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:23.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.375+0000 7f3b5ddff700 1 --2- 172.21.15.8:0/3096177921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b58101bf0 0x7f3b58102050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:23.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.375+0000 7f3b5ddff700 1 -- 172.21.15.8:0/3096177921 >> 172.21.15.8:0/3096177921 conn(0x7f3b580fbf70 msgr2=0x7f3b580fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:23.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.375+0000 7f3b5ddff700 1 -- 172.21.15.8:0/3096177921 shutdown_connections 2023-08-11T12:24:23.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.375+0000 7f3b5ddff700 1 -- 172.21.15.8:0/3096177921 wait complete. 2023-08-11T12:24:23.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.376+0000 7f3b5ddff700 1 Processor -- start 2023-08-11T12:24:23.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.376+0000 7f3b5ddff700 1 -- start start 2023-08-11T12:24:23.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.377+0000 7f3b5ddff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b58100a00 0x7f3b58198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:23.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.377+0000 7f3b5ddff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b58101bf0 0x7f3b58198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:23.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.377+0000 7f3b5ddff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b58102590 0x7f3b5819ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:23.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.377+0000 7f3b5ddff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b581a04f0 con 0x7f3b58102590 2023-08-11T12:24:23.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.377+0000 7f3b5ddff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b581a0630 con 0x7f3b58101bf0 2023-08-11T12:24:23.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.377+0000 7f3b5ddff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b581a07c0 con 0x7f3b58100a00 2023-08-11T12:24:23.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.377+0000 7f3b577fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b58100a00 0x7f3b58198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:23.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.377+0000 7f3b57fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b58102590 0x7f3b5819ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:23.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.377+0000 7f3b577fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b58100a00 0x7f3b58198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:52708/0 (socket says 172.21.15.8:52708) 2023-08-11T12:24:23.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.377+0000 7f3b577fe700 1 -- 172.21.15.8:0/78858192 learned_addr learned my addr 172.21.15.8:0/78858192 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:23.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.377+0000 7f3b56ffd700 1 --2- 172.21.15.8:0/78858192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b58101bf0 0x7f3b58198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:23.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.377+0000 7f3b577fe700 1 -- 172.21.15.8:0/78858192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b58101bf0 msgr2=0x7f3b58198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:23.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.377+0000 7f3b577fe700 1 --2- 172.21.15.8:0/78858192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b58101bf0 0x7f3b58198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:23.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.377+0000 7f3b577fe700 1 -- 172.21.15.8:0/78858192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b58102590 msgr2=0x7f3b5819ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:23.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.377+0000 7f3b577fe700 1 --2- 172.21.15.8:0/78858192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b58102590 0x7f3b5819ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:23.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.377+0000 7f3b577fe700 1 -- 172.21.15.8:0/78858192 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b48009520 con 0x7f3b58100a00 2023-08-11T12:24:23.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.377+0000 7f3b57fff700 1 --2- 172.21.15.8:0/78858192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b58102590 0x7f3b5819ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:23.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.378+0000 7f3b577fe700 1 --2- 172.21.15.8:0/78858192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b58100a00 0x7f3b58198970 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3b48009fd0 tx=0x7f3b4800b560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:23.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.378+0000 7f3b54ff9700 1 -- 172.21.15.8:0/78858192 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4801c070 con 0x7f3b58100a00 2023-08-11T12:24:23.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.378+0000 7f3b5ddff700 1 -- 172.21.15.8:0/78858192 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b581a0a40 con 0x7f3b58100a00 2023-08-11T12:24:23.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.378+0000 7f3b54ff9700 1 -- 172.21.15.8:0/78858192 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b48005040 con 0x7f3b58100a00 2023-08-11T12:24:23.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.378+0000 7f3b5ddff700 1 -- 172.21.15.8:0/78858192 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b581a0ec0 con 0x7f3b58100a00 2023-08-11T12:24:23.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.378+0000 7f3b54ff9700 1 -- 172.21.15.8:0/78858192 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b480038e0 con 0x7f3b58100a00 2023-08-11T12:24:23.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.379+0000 7f3b5ddff700 1 -- 172.21.15.8:0/78858192 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b58193050 con 0x7f3b58100a00 2023-08-11T12:24:23.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.381+0000 7f3b54ff9700 1 -- 172.21.15.8:0/78858192 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f3b48020030 con 0x7f3b58100a00 2023-08-11T12:24:23.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.383+0000 7f3b54ff9700 1 --2- 172.21.15.8:0/78858192 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3b4009ffd0 0x7f3b400a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:23.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.383+0000 7f3b54ff9700 1 -- 172.21.15.8:0/78858192 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f3b480cc990 con 0x7f3b58100a00 2023-08-11T12:24:23.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.383+0000 7f3b56ffd700 1 --2- 172.21.15.8:0/78858192 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3b4009ffd0 0x7f3b400a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:23.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.384+0000 7f3b56ffd700 1 --2- 172.21.15.8:0/78858192 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3b4009ffd0 0x7f3b400a2490 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c005fd0 tx=0x7f3b4c009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:23.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.384+0000 7f3b54ff9700 1 -- 172.21.15.8:0/78858192 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f3b48096440 con 0x7f3b58100a00 2023-08-11T12:24:23.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.599+0000 7f3b5ddff700 1 -- 172.21.15.8:0/78858192 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3b5810c3f0 con 0x7f3b58100a00 2023-08-11T12:24:23.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.600+0000 7f3b54ff9700 1 -- 172.21.15.8:0/78858192 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3b48099a60 con 0x7f3b58100a00 2023-08-11T12:24:23.602 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-08-11T12:24:23.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.602+0000 7f3b5ddff700 1 -- 172.21.15.8:0/78858192 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3b4009ffd0 msgr2=0x7f3b400a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:23.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.602+0000 7f3b5ddff700 1 --2- 172.21.15.8:0/78858192 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3b4009ffd0 0x7f3b400a2490 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c005fd0 tx=0x7f3b4c009310 comp rx=0 tx=0).stop 2023-08-11T12:24:23.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.602+0000 7f3b5ddff700 1 -- 172.21.15.8:0/78858192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b58100a00 msgr2=0x7f3b58198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:23.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.602+0000 7f3b5ddff700 1 --2- 172.21.15.8:0/78858192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b58100a00 0x7f3b58198970 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3b48009fd0 tx=0x7f3b4800b560 comp rx=0 tx=0).stop 2023-08-11T12:24:23.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.602+0000 7f3b5ddff700 1 -- 172.21.15.8:0/78858192 shutdown_connections 2023-08-11T12:24:23.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.602+0000 7f3b5ddff700 1 --2- 172.21.15.8:0/78858192 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f3b4009ffd0 0x7f3b400a2490 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:23.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.602+0000 7f3b5ddff700 1 --2- 172.21.15.8:0/78858192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b58100a00 0x7f3b58198970 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:23.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.602+0000 7f3b5ddff700 1 --2- 172.21.15.8:0/78858192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b58102590 0x7f3b5819ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:23.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.602+0000 7f3b5ddff700 1 --2- 172.21.15.8:0/78858192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b58101bf0 0x7f3b58198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:23.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.602+0000 7f3b5ddff700 1 -- 172.21.15.8:0/78858192 >> 172.21.15.8:0/78858192 conn(0x7f3b580fbf70 msgr2=0x7f3b58107570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:23.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.602+0000 7f3b5ddff700 1 -- 172.21.15.8:0/78858192 shutdown_connections 2023-08-11T12:24:23.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.602+0000 7f3b5ddff700 1 -- 172.21.15.8:0/78858192 wait complete. 2023-08-11T12:24:23.624 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-11T12:24:23.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.831+0000 7f40bf5ff700 1 -- 172.21.15.8:0/422856794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40b8100a00 msgr2=0x7f40b8100e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:23.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.831+0000 7f40bf5ff700 1 --2- 172.21.15.8:0/422856794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40b8100a00 0x7f40b8100e20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f40b40099c0 tx=0x7f40b4009cd0 comp rx=0 tx=0).stop 2023-08-11T12:24:23.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.831+0000 7f40bf5ff700 1 -- 172.21.15.8:0/422856794 shutdown_connections 2023-08-11T12:24:23.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.832+0000 7f40bf5ff700 1 --2- 172.21.15.8:0/422856794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40b8102590 0x7f40b8108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:23.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.832+0000 7f40bf5ff700 1 --2- 172.21.15.8:0/422856794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40b8100a00 0x7f40b8100e20 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:23.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.832+0000 7f40bf5ff700 1 --2- 172.21.15.8:0/422856794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40b8101bf0 0x7f40b8102050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:23.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.832+0000 7f40bf5ff700 1 -- 172.21.15.8:0/422856794 >> 172.21.15.8:0/422856794 conn(0x7f40b80fbf70 msgr2=0x7f40b80fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:23.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.832+0000 7f40bf5ff700 1 -- 172.21.15.8:0/422856794 shutdown_connections 2023-08-11T12:24:23.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.832+0000 7f40bf5ff700 1 -- 172.21.15.8:0/422856794 wait complete. 2023-08-11T12:24:23.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.833+0000 7f40bf5ff700 1 Processor -- start 2023-08-11T12:24:23.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.833+0000 7f40bf5ff700 1 -- start start 2023-08-11T12:24:23.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.833+0000 7f40bf5ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40b8100a00 0x7f40b80746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:23.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.833+0000 7f40bf5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40b8101bf0 0x7f40b8072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:23.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.833+0000 7f40bf5ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40b8102590 0x7f40b8073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:23.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.833+0000 7f40bf5ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b80739f0 con 0x7f40b8102590 2023-08-11T12:24:23.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.833+0000 7f40bf5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b8073b60 con 0x7f40b8101bf0 2023-08-11T12:24:23.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.833+0000 7f40bf5ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b81a0760 con 0x7f40b8100a00 2023-08-11T12:24:23.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.834+0000 7f40bd39b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40b8100a00 0x7f40b80746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:23.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.834+0000 7f40bdb9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40b8102590 0x7f40b8073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:23.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.834+0000 7f40bd39b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40b8100a00 0x7f40b80746d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:52718/0 (socket says 172.21.15.8:52718) 2023-08-11T12:24:23.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.834+0000 7f40bd39b700 1 -- 172.21.15.8:0/636751558 learned_addr learned my addr 172.21.15.8:0/636751558 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:23.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.834+0000 7f40bcb9a700 1 --2- 172.21.15.8:0/636751558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40b8101bf0 0x7f40b8072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:23.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.834+0000 7f40bd39b700 1 -- 172.21.15.8:0/636751558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40b8101bf0 msgr2=0x7f40b8072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:23.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.834+0000 7f40bd39b700 1 --2- 172.21.15.8:0/636751558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40b8101bf0 0x7f40b8072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:23.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.834+0000 7f40bd39b700 1 -- 172.21.15.8:0/636751558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40b8102590 msgr2=0x7f40b8073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:23.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.834+0000 7f40bd39b700 1 --2- 172.21.15.8:0/636751558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40b8102590 0x7f40b8073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:23.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.834+0000 7f40bd39b700 1 -- 172.21.15.8:0/636751558 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b40095f0 con 0x7f40b8100a00 2023-08-11T12:24:23.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.834+0000 7f40bd39b700 1 --2- 172.21.15.8:0/636751558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40b8100a00 0x7f40b80746d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f40b4009990 tx=0x7f40b400f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:23.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.834+0000 7f40ae7fc700 1 -- 172.21.15.8:0/636751558 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b401d070 con 0x7f40b8100a00 2023-08-11T12:24:23.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.835+0000 7f40bf5ff700 1 -- 172.21.15.8:0/636751558 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b81a09e0 con 0x7f40b8100a00 2023-08-11T12:24:23.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.835+0000 7f40ae7fc700 1 -- 172.21.15.8:0/636751558 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f40b40054f0 con 0x7f40b8100a00 2023-08-11T12:24:23.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.835+0000 7f40ae7fc700 1 -- 172.21.15.8:0/636751558 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b4004bd0 con 0x7f40b8100a00 2023-08-11T12:24:23.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.835+0000 7f40bf5ff700 1 -- 172.21.15.8:0/636751558 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b81a0e00 con 0x7f40b8100a00 2023-08-11T12:24:23.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.836+0000 7f40bf5ff700 1 -- 172.21.15.8:0/636751558 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b8107fc0 con 0x7f40b8100a00 2023-08-11T12:24:23.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.838+0000 7f40ae7fc700 1 -- 172.21.15.8:0/636751558 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f40b400fb80 con 0x7f40b8100a00 2023-08-11T12:24:23.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.839+0000 7f40ae7fc700 1 --2- 172.21.15.8:0/636751558 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f40a409ff50 0x7f40a40a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:23.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.839+0000 7f40ae7fc700 1 -- 172.21.15.8:0/636751558 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f40b40cc830 con 0x7f40b8100a00 2023-08-11T12:24:23.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.839+0000 7f40bcb9a700 1 --2- 172.21.15.8:0/636751558 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f40a409ff50 0x7f40a40a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:23.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.840+0000 7f40bcb9a700 1 --2- 172.21.15.8:0/636751558 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f40a409ff50 0x7f40a40a2410 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f40a8009bf0 tx=0x7f40a8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:23.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:23.841+0000 7f40ae7fc700 1 -- 172.21.15.8:0/636751558 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f40b40962e0 con 0x7f40b8100a00 2023-08-11T12:24:24.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:23 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3860296376' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:24:24.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:23 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/78858192' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:24:24.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.053+0000 7f40bf5ff700 1 -- 172.21.15.8:0/636751558 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f40b810c4b0 con 0x7f40b8100a00 2023-08-11T12:24:24.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.054+0000 7f40ae7fc700 1 -- 172.21.15.8:0/636751558 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f40b4099900 con 0x7f40b8100a00 2023-08-11T12:24:24.056 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-08-11T12:24:24.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.056+0000 7f40bf5ff700 1 -- 172.21.15.8:0/636751558 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f40a409ff50 msgr2=0x7f40a40a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:24.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.056+0000 7f40bf5ff700 1 --2- 172.21.15.8:0/636751558 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f40a409ff50 0x7f40a40a2410 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f40a8009bf0 tx=0x7f40a8009260 comp rx=0 tx=0).stop 2023-08-11T12:24:24.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.056+0000 7f40bf5ff700 1 -- 172.21.15.8:0/636751558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40b8100a00 msgr2=0x7f40b80746d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:24.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.056+0000 7f40bf5ff700 1 --2- 172.21.15.8:0/636751558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40b8100a00 0x7f40b80746d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f40b4009990 tx=0x7f40b400f690 comp rx=0 tx=0).stop 2023-08-11T12:24:24.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.056+0000 7f40bf5ff700 1 -- 172.21.15.8:0/636751558 shutdown_connections 2023-08-11T12:24:24.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.056+0000 7f40bf5ff700 1 --2- 172.21.15.8:0/636751558 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f40a409ff50 0x7f40a40a2410 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:24.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.056+0000 7f40bf5ff700 1 --2- 172.21.15.8:0/636751558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40b8100a00 0x7f40b80746d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:24.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.056+0000 7f40bf5ff700 1 --2- 172.21.15.8:0/636751558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40b8102590 0x7f40b8073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:24.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.056+0000 7f40bf5ff700 1 --2- 172.21.15.8:0/636751558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40b8101bf0 0x7f40b8072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:24.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.056+0000 7f40bf5ff700 1 -- 172.21.15.8:0/636751558 >> 172.21.15.8:0/636751558 conn(0x7f40b80fbf70 msgr2=0x7f40b8105100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.056+0000 7f40bf5ff700 1 -- 172.21.15.8:0/636751558 shutdown_connections 2023-08-11T12:24:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.057+0000 7f40bf5ff700 1 -- 172.21.15.8:0/636751558 wait complete. 2023-08-11T12:24:24.078 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-11T12:24:24.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:23 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3860296376' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:24:24.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:23 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/78858192' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:24:24.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:23 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3860296376' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:24:24.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:23 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/78858192' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:24:24.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.287+0000 7f2b59dff700 1 -- 172.21.15.8:0/705333717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b54103d60 msgr2=0x7f2b54106150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:24.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.287+0000 7f2b59dff700 1 --2- 172.21.15.8:0/705333717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b54103d60 0x7f2b54106150 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2b480098f0 tx=0x7f2b48009c00 comp rx=0 tx=0).stop 2023-08-11T12:24:24.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.287+0000 7f2b59dff700 1 -- 172.21.15.8:0/705333717 shutdown_connections 2023-08-11T12:24:24.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.287+0000 7f2b59dff700 1 --2- 172.21.15.8:0/705333717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b54106690 0x7f2b54108b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:24.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.287+0000 7f2b59dff700 1 --2- 172.21.15.8:0/705333717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b54101430 0x7f2b54103820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:24.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.287+0000 7f2b59dff700 1 --2- 172.21.15.8:0/705333717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b54103d60 0x7f2b54106150 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:24.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.287+0000 7f2b59dff700 1 -- 172.21.15.8:0/705333717 >> 172.21.15.8:0/705333717 conn(0x7f2b540fae20 msgr2=0x7f2b540fd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:24.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.287+0000 7f2b59dff700 1 -- 172.21.15.8:0/705333717 shutdown_connections 2023-08-11T12:24:24.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.288+0000 7f2b59dff700 1 -- 172.21.15.8:0/705333717 wait complete. 2023-08-11T12:24:24.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.289+0000 7f2b59dff700 1 Processor -- start 2023-08-11T12:24:24.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.289+0000 7f2b59dff700 1 -- start start 2023-08-11T12:24:24.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.290+0000 7f2b59dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b54101430 0x7f2b54196730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:24.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.290+0000 7f2b59dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b54103d60 0x7f2b54196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:24.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.290+0000 7f2b59dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b54106690 0x7f2b5419dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:24.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.290+0000 7f2b59dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5419e2b0 con 0x7f2b54106690 2023-08-11T12:24:24.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.290+0000 7f2b59dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5419e3f0 con 0x7f2b54103d60 2023-08-11T12:24:24.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.290+0000 7f2b59dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5419e580 con 0x7f2b54101430 2023-08-11T12:24:24.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.290+0000 7f2b537fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b54101430 0x7f2b54196730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:24.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.290+0000 7f2b52ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b54103d60 0x7f2b54196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:24.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.290+0000 7f2b537fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b54101430 0x7f2b54196730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:52730/0 (socket says 172.21.15.8:52730) 2023-08-11T12:24:24.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.290+0000 7f2b537fe700 1 -- 172.21.15.8:0/1478236445 learned_addr learned my addr 172.21.15.8:0/1478236445 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:24.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.290+0000 7f2b53fff700 1 --2- 172.21.15.8:0/1478236445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b54106690 0x7f2b5419dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:24.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.291+0000 7f2b537fe700 1 -- 172.21.15.8:0/1478236445 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b54103d60 msgr2=0x7f2b54196c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:24.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.291+0000 7f2b537fe700 1 --2- 172.21.15.8:0/1478236445 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b54103d60 0x7f2b54196c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:24.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.291+0000 7f2b537fe700 1 -- 172.21.15.8:0/1478236445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b54106690 msgr2=0x7f2b5419dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:24.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.291+0000 7f2b537fe700 1 --2- 172.21.15.8:0/1478236445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b54106690 0x7f2b5419dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:24.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.291+0000 7f2b537fe700 1 -- 172.21.15.8:0/1478236445 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b48009520 con 0x7f2b54101430 2023-08-11T12:24:24.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.291+0000 7f2b52ffd700 1 --2- 172.21.15.8:0/1478236445 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b54103d60 0x7f2b54196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:24.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.291+0000 7f2b537fe700 1 --2- 172.21.15.8:0/1478236445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b54101430 0x7f2b54196730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2b4400e9c0 tx=0x7f2b4400ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:24.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.291+0000 7f2b50ff9700 1 -- 172.21.15.8:0/1478236445 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b44004a30 con 0x7f2b54101430 2023-08-11T12:24:24.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.291+0000 7f2b50ff9700 1 -- 172.21.15.8:0/1478236445 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b4400cc80 con 0x7f2b54101430 2023-08-11T12:24:24.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.291+0000 7f2b50ff9700 1 -- 172.21.15.8:0/1478236445 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b440054e0 con 0x7f2b54101430 2023-08-11T12:24:24.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.291+0000 7f2b59dff700 1 -- 172.21.15.8:0/1478236445 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b540ff280 con 0x7f2b54101430 2023-08-11T12:24:24.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.292+0000 7f2b59dff700 1 -- 172.21.15.8:0/1478236445 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b540ff790 con 0x7f2b54101430 2023-08-11T12:24:24.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.293+0000 7f2b59dff700 1 -- 172.21.15.8:0/1478236445 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b540fc9a0 con 0x7f2b54101430 2023-08-11T12:24:24.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.296+0000 7f2b50ff9700 1 -- 172.21.15.8:0/1478236445 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f2b44004b90 con 0x7f2b54101430 2023-08-11T12:24:24.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.297+0000 7f2b50ff9700 1 --2- 172.21.15.8:0/1478236445 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f2b3c09ffd0 0x7f2b3c0a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:24.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.297+0000 7f2b50ff9700 1 -- 172.21.15.8:0/1478236445 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f2b44014070 con 0x7f2b54101430 2023-08-11T12:24:24.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.297+0000 7f2b52ffd700 1 --2- 172.21.15.8:0/1478236445 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f2b3c09ffd0 0x7f2b3c0a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:24.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.298+0000 7f2b52ffd700 1 --2- 172.21.15.8:0/1478236445 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f2b3c09ffd0 0x7f2b3c0a2490 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2b48005e90 tx=0x7f2b4801d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:24.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.298+0000 7f2b50ff9700 1 -- 172.21.15.8:0/1478236445 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f2b44095130 con 0x7f2b54101430 2023-08-11T12:24:24.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.515+0000 7f2b59dff700 1 -- 172.21.15.8:0/1478236445 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2b5410c380 con 0x7f2b54101430 2023-08-11T12:24:24.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.516+0000 7f2b50ff9700 1 -- 172.21.15.8:0/1478236445 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2b44098750 con 0x7f2b54101430 2023-08-11T12:24:24.518 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-08-11T12:24:24.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.518+0000 7f2b59dff700 1 -- 172.21.15.8:0/1478236445 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f2b3c09ffd0 msgr2=0x7f2b3c0a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:24.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.518+0000 7f2b59dff700 1 --2- 172.21.15.8:0/1478236445 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f2b3c09ffd0 0x7f2b3c0a2490 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2b48005e90 tx=0x7f2b4801d040 comp rx=0 tx=0).stop 2023-08-11T12:24:24.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.518+0000 7f2b59dff700 1 -- 172.21.15.8:0/1478236445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b54101430 msgr2=0x7f2b54196730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:24.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.518+0000 7f2b59dff700 1 --2- 172.21.15.8:0/1478236445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b54101430 0x7f2b54196730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2b4400e9c0 tx=0x7f2b4400ecd0 comp rx=0 tx=0).stop 2023-08-11T12:24:24.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.518+0000 7f2b59dff700 1 -- 172.21.15.8:0/1478236445 shutdown_connections 2023-08-11T12:24:24.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.518+0000 7f2b59dff700 1 --2- 172.21.15.8:0/1478236445 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f2b3c09ffd0 0x7f2b3c0a2490 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:24.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.518+0000 7f2b59dff700 1 --2- 172.21.15.8:0/1478236445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b54101430 0x7f2b54196730 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:24.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.518+0000 7f2b59dff700 1 --2- 172.21.15.8:0/1478236445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b54106690 0x7f2b5419dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:24.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.518+0000 7f2b59dff700 1 --2- 172.21.15.8:0/1478236445 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b54103d60 0x7f2b54196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:24.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.518+0000 7f2b59dff700 1 -- 172.21.15.8:0/1478236445 >> 172.21.15.8:0/1478236445 conn(0x7f2b540fae20 msgr2=0x7f2b541020a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:24.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.518+0000 7f2b59dff700 1 -- 172.21.15.8:0/1478236445 shutdown_connections 2023-08-11T12:24:24.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.518+0000 7f2b59dff700 1 -- 172.21.15.8:0/1478236445 wait complete. 2023-08-11T12:24:24.540 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-11T12:24:24.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.756+0000 7fb17cbff700 1 -- 172.21.15.8:0/1835971709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb178101490 msgr2=0x7fb178103880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:24.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.756+0000 7fb17cbff700 1 --2- 172.21.15.8:0/1835971709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb178101490 0x7fb178103880 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb168009990 tx=0x7fb168009ca0 comp rx=0 tx=0).stop 2023-08-11T12:24:24.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.756+0000 7fb17cbff700 1 -- 172.21.15.8:0/1835971709 shutdown_connections 2023-08-11T12:24:24.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.756+0000 7fb17cbff700 1 --2- 172.21.15.8:0/1835971709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1781066f0 0x7fb178108b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:24.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.756+0000 7fb17cbff700 1 --2- 172.21.15.8:0/1835971709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb178101490 0x7fb178103880 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:24.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.756+0000 7fb17cbff700 1 --2- 172.21.15.8:0/1835971709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb178103dc0 0x7fb1781061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:24.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.756+0000 7fb17cbff700 1 -- 172.21.15.8:0/1835971709 >> 172.21.15.8:0/1835971709 conn(0x7fb1780fae20 msgr2=0x7fb1780fd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:24.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.756+0000 7fb17cbff700 1 -- 172.21.15.8:0/1835971709 shutdown_connections 2023-08-11T12:24:24.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.756+0000 7fb17cbff700 1 -- 172.21.15.8:0/1835971709 wait complete. 2023-08-11T12:24:24.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.757+0000 7fb17cbff700 1 Processor -- start 2023-08-11T12:24:24.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.757+0000 7fb17cbff700 1 -- start start 2023-08-11T12:24:24.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.758+0000 7fb17cbff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb178101490 0x7fb1781966c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:24.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.758+0000 7fb17cbff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb178103dc0 0x7fb178196c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:24.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.758+0000 7fb17cbff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1781066f0 0x7fb17819dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:24.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.758+0000 7fb17cbff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17819e240 con 0x7fb1781066f0 2023-08-11T12:24:24.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.758+0000 7fb17cbff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17819e380 con 0x7fb178101490 2023-08-11T12:24:24.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.758+0000 7fb17cbff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17819e510 con 0x7fb178103dc0 2023-08-11T12:24:24.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.758+0000 7fb17659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb178101490 0x7fb1781966c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:24.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.758+0000 7fb176d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1781066f0 0x7fb17819dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:24.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.758+0000 7fb17659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb178101490 0x7fb1781966c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:37116/0 (socket says 172.21.15.8:37116) 2023-08-11T12:24:24.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.758+0000 7fb17659c700 1 -- 172.21.15.8:0/4218313875 learned_addr learned my addr 172.21.15.8:0/4218313875 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:24.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.758+0000 7fb175d9b700 1 --2- 172.21.15.8:0/4218313875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb178103dc0 0x7fb178196c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:24.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.758+0000 7fb17659c700 1 -- 172.21.15.8:0/4218313875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb178103dc0 msgr2=0x7fb178196c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:24.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.758+0000 7fb17659c700 1 --2- 172.21.15.8:0/4218313875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb178103dc0 0x7fb178196c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:24.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.758+0000 7fb17659c700 1 -- 172.21.15.8:0/4218313875 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1781066f0 msgr2=0x7fb17819dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:24.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.758+0000 7fb17659c700 1 --2- 172.21.15.8:0/4218313875 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1781066f0 0x7fb17819dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:24.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.758+0000 7fb17659c700 1 -- 172.21.15.8:0/4218313875 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1680095f0 con 0x7fb178101490 2023-08-11T12:24:24.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.759+0000 7fb175d9b700 1 --2- 172.21.15.8:0/4218313875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb178103dc0 0x7fb178196c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:24:24.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.759+0000 7fb176d9d700 1 --2- 172.21.15.8:0/4218313875 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1781066f0 0x7fb17819dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:24.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.759+0000 7fb17659c700 1 --2- 172.21.15.8:0/4218313875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb178101490 0x7fb1781966c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb16800b680 tx=0x7fb168005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:24.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.759+0000 7fb1677fe700 1 -- 172.21.15.8:0/4218313875 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16801d070 con 0x7fb178101490 2023-08-11T12:24:24.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.759+0000 7fb1677fe700 1 -- 172.21.15.8:0/4218313875 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb168022470 con 0x7fb178101490 2023-08-11T12:24:24.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.759+0000 7fb1677fe700 1 -- 172.21.15.8:0/4218313875 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb168017650 con 0x7fb178101490 2023-08-11T12:24:24.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.760+0000 7fb17cbff700 1 -- 172.21.15.8:0/4218313875 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17819e790 con 0x7fb178101490 2023-08-11T12:24:24.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.760+0000 7fb17cbff700 1 -- 172.21.15.8:0/4218313875 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17819eb60 con 0x7fb178101490 2023-08-11T12:24:24.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.761+0000 7fb17cbff700 1 -- 172.21.15.8:0/4218313875 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1780fc9a0 con 0x7fb178101490 2023-08-11T12:24:24.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.763+0000 7fb1677fe700 1 -- 172.21.15.8:0/4218313875 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fb1680225e0 con 0x7fb178101490 2023-08-11T12:24:24.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.765+0000 7fb1677fe700 1 --2- 172.21.15.8:0/4218313875 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb16009ffd0 0x7fb1600a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:24.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.765+0000 7fb1677fe700 1 -- 172.21.15.8:0/4218313875 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb1680ccb70 con 0x7fb178101490 2023-08-11T12:24:24.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.765+0000 7fb175d9b700 1 --2- 172.21.15.8:0/4218313875 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb16009ffd0 0x7fb1600a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:24.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.766+0000 7fb175d9b700 1 --2- 172.21.15.8:0/4218313875 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb16009ffd0 0x7fb1600a2490 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb16c009cb0 tx=0x7fb16c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:24.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:24.766+0000 7fb1677fe700 1 -- 172.21.15.8:0/4218313875 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fb168096620 con 0x7fb178101490 2023-08-11T12:24:24.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:24 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/636751558' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:24:24.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:24 smithi008 ceph-mon[97158]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:24:24.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:24 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1478236445' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:24:24.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:24 smithi008 ceph-mon[97158]: pgmap v346: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2023-08-11T12:24:25.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.062+0000 7fb17cbff700 1 -- 172.21.15.8:0/4218313875 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb17810c1e0 con 0x7fb178101490 2023-08-11T12:24:25.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.063+0000 7fb1677fe700 1 -- 172.21.15.8:0/4218313875 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11351 (secure 0 0 0) 0x7fb168099c40 con 0x7fb178101490 2023-08-11T12:24:25.065 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:25.065 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14469,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2854286216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2854286216},{"type":"v1","addr":"172.21.15.8:6835","nonce":2854286216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/805368621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":805368621},{"type":"v1","addr":"172.21.15.8:6837","nonce":805368621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-11T12:22:03.398475+0000","modified":"2023-08-11T12:22:32.690553+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24575,"mds_1":24550,"mds_2":24517,"mds_3":24500,"mds_4":24464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14526":{"gid":14526,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/2990530720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":2990530720},{"type":"v1","addr":"172.21.15.8:6839","nonce":2990530720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14538":{"gid":14538,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6841/3589272762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":3589272762},{"type":"v1","addr":"172.21.15.8:6841","nonce":3589272762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6833/2043443402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2043443402},{"type":"v1","addr":"172.21.15.194:6833","nonce":2043443402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24464":{"gid":24464,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.45:6833/1208864615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1208864615},{"type":"v1","addr":"172.21.15.45:6833","nonce":1208864615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24500":{"gid":24500,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.45:6835/1776075470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1776075470},{"type":"v1","addr":"172.21.15.45:6835","nonce":1776075470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24517":{"gid":24517,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.194:6835/2457430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2457430285},{"type":"v1","addr":"172.21.15.194:6835","nonce":2457430285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24529":{"gid":24529,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/3072808560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":3072808560},{"type":"v1","addr":"172.21.15.194:6837","nonce":3072808560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/641549061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":641549061},{"type":"v1","addr":"172.21.15.45:6837","nonce":641549061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.194:6839/2174476491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":2174476491},{"type":"v1","addr":"172.21.15.194:6839","nonce":2174476491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6839/119684732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":119684732},{"type":"v1","addr":"172.21.15.45:6839","nonce":119684732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-11T12:24:25.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.065+0000 7fb17cbff700 1 -- 172.21.15.8:0/4218313875 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb16009ffd0 msgr2=0x7fb1600a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:25.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.065+0000 7fb17cbff700 1 --2- 172.21.15.8:0/4218313875 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb16009ffd0 0x7fb1600a2490 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb16c009cb0 tx=0x7fb16c009260 comp rx=0 tx=0).stop 2023-08-11T12:24:25.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.065+0000 7fb17cbff700 1 -- 172.21.15.8:0/4218313875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb178101490 msgr2=0x7fb1781966c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:25.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.065+0000 7fb17cbff700 1 --2- 172.21.15.8:0/4218313875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb178101490 0x7fb1781966c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb16800b680 tx=0x7fb168005740 comp rx=0 tx=0).stop 2023-08-11T12:24:25.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.066+0000 7fb17cbff700 1 -- 172.21.15.8:0/4218313875 shutdown_connections 2023-08-11T12:24:25.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.066+0000 7fb17cbff700 1 --2- 172.21.15.8:0/4218313875 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fb16009ffd0 0x7fb1600a2490 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.066+0000 7fb17cbff700 1 --2- 172.21.15.8:0/4218313875 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1781066f0 0x7fb17819dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.066+0000 7fb17cbff700 1 --2- 172.21.15.8:0/4218313875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb178101490 0x7fb1781966c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.066+0000 7fb17cbff700 1 --2- 172.21.15.8:0/4218313875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb178103dc0 0x7fb178196c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.066+0000 7fb17cbff700 1 -- 172.21.15.8:0/4218313875 >> 172.21.15.8:0/4218313875 conn(0x7fb1780fae20 msgr2=0x7fb178102100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:25.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.066+0000 7fb17cbff700 1 -- 172.21.15.8:0/4218313875 shutdown_connections 2023-08-11T12:24:25.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.066+0000 7fb17cbff700 1 -- 172.21.15.8:0/4218313875 wait complete. 2023-08-11T12:24:25.069 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 27 2023-08-11T12:24:25.090 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-11T12:24:25.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:24 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/636751558' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:24:25.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:24 smithi194 ceph-mon[130905]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:24:25.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:24 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1478236445' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:24:25.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:24 smithi194 ceph-mon[130905]: pgmap v346: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2023-08-11T12:24:25.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:24 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/636751558' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:24:25.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:24 smithi045 ceph-mon[130284]: from='mgr.14150 172.21.15.8:0/2194035076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:24:25.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:24 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1478236445' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:24:25.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:24 smithi045 ceph-mon[130284]: pgmap v346: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2023-08-11T12:24:25.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.301+0000 7fc780dff700 1 -- 172.21.15.8:0/717756960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc77c074960 msgr2=0x7fc77c072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:25.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.301+0000 7fc780dff700 1 --2- 172.21.15.8:0/717756960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc77c074960 0x7fc77c072db0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009990 tx=0x7fc76c009ca0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.301+0000 7fc780dff700 1 -- 172.21.15.8:0/717756960 shutdown_connections 2023-08-11T12:24:25.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.301+0000 7fc780dff700 1 --2- 172.21.15.8:0/717756960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc77c10cfc0 0x7fc77c10f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.301+0000 7fc780dff700 1 --2- 172.21.15.8:0/717756960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc77c074960 0x7fc77c072db0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.301+0000 7fc780dff700 1 --2- 172.21.15.8:0/717756960 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc77c073380 0x7fc77c073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.301+0000 7fc780dff700 1 -- 172.21.15.8:0/717756960 >> 172.21.15.8:0/717756960 conn(0x7fc77c0fbf80 msgr2=0x7fc77c0fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:25.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.301+0000 7fc780dff700 1 -- 172.21.15.8:0/717756960 shutdown_connections 2023-08-11T12:24:25.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.301+0000 7fc780dff700 1 -- 172.21.15.8:0/717756960 wait complete. 2023-08-11T12:24:25.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.303+0000 7fc780dff700 1 Processor -- start 2023-08-11T12:24:25.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.303+0000 7fc780dff700 1 -- start start 2023-08-11T12:24:25.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.303+0000 7fc780dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc77c073380 0x7fc77c19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:25.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.304+0000 7fc780dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc77c074960 0x7fc77c19d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:25.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.304+0000 7fc780dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc77c10cfc0 0x7fc77c1a4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:25.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.304+0000 7fc780dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c1a48d0 con 0x7fc77c074960 2023-08-11T12:24:25.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.304+0000 7fc780dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c1a4a10 con 0x7fc77c073380 2023-08-11T12:24:25.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.304+0000 7fc780dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c1a4ba0 con 0x7fc77c10cfc0 2023-08-11T12:24:25.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.304+0000 7fc77a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc77c073380 0x7fc77c19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:25.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.304+0000 7fc77a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc77c073380 0x7fc77c19cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:37130/0 (socket says 172.21.15.8:37130) 2023-08-11T12:24:25.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.304+0000 7fc77a59c700 1 -- 172.21.15.8:0/2567656850 learned_addr learned my addr 172.21.15.8:0/2567656850 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:25.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.304+0000 7fc779d9b700 1 --2- 172.21.15.8:0/2567656850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc77c074960 0x7fc77c19d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:25.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.304+0000 7fc77ad9d700 1 --2- 172.21.15.8:0/2567656850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc77c10cfc0 0x7fc77c1a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:25.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.304+0000 7fc77a59c700 1 -- 172.21.15.8:0/2567656850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc77c10cfc0 msgr2=0x7fc77c1a4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:25.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.304+0000 7fc77a59c700 1 --2- 172.21.15.8:0/2567656850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc77c10cfc0 0x7fc77c1a4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.304+0000 7fc77a59c700 1 -- 172.21.15.8:0/2567656850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc77c074960 msgr2=0x7fc77c19d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:25.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.304+0000 7fc77a59c700 1 --2- 172.21.15.8:0/2567656850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc77c074960 0x7fc77c19d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.304+0000 7fc77a59c700 1 -- 172.21.15.8:0/2567656850 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc774009c40 con 0x7fc77c073380 2023-08-11T12:24:25.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.305+0000 7fc77a59c700 1 --2- 172.21.15.8:0/2567656850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc77c073380 0x7fc77c19cd50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc76c00b680 tx=0x7fc76c005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:25.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.305+0000 7fc76b7fe700 1 -- 172.21.15.8:0/2567656850 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c01d070 con 0x7fc77c073380 2023-08-11T12:24:25.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.305+0000 7fc76b7fe700 1 -- 172.21.15.8:0/2567656850 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc76c022470 con 0x7fc77c073380 2023-08-11T12:24:25.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.305+0000 7fc780dff700 1 -- 172.21.15.8:0/2567656850 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc76c0095f0 con 0x7fc77c073380 2023-08-11T12:24:25.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.305+0000 7fc76b7fe700 1 -- 172.21.15.8:0/2567656850 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c017650 con 0x7fc77c073380 2023-08-11T12:24:25.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.305+0000 7fc780dff700 1 -- 172.21.15.8:0/2567656850 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc77c1a5110 con 0x7fc77c073380 2023-08-11T12:24:25.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.306+0000 7fc780dff700 1 -- 172.21.15.8:0/2567656850 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc77c102b10 con 0x7fc77c073380 2023-08-11T12:24:25.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.308+0000 7fc76b7fe700 1 -- 172.21.15.8:0/2567656850 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fc76c0225e0 con 0x7fc77c073380 2023-08-11T12:24:25.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.309+0000 7fc76b7fe700 1 --2- 172.21.15.8:0/2567656850 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc76409ffd0 0x7fc7640a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:25.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.310+0000 7fc76b7fe700 1 -- 172.21.15.8:0/2567656850 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc76c0cc960 con 0x7fc77c073380 2023-08-11T12:24:25.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.310+0000 7fc779d9b700 1 --2- 172.21.15.8:0/2567656850 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc76409ffd0 0x7fc7640a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:25.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.310+0000 7fc779d9b700 1 --2- 172.21.15.8:0/2567656850 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc76409ffd0 0x7fc7640a2490 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc77c074680 tx=0x7fc770009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:25.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.313+0000 7fc76b7fe700 1 -- 172.21.15.8:0/2567656850 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fc76c096410 con 0x7fc77c073380 2023-08-11T12:24:25.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.532+0000 7fc780dff700 1 -- 172.21.15.8:0/2567656850 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc77c112830 con 0x7fc77c073380 2023-08-11T12:24:25.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.534+0000 7fc76b7fe700 1 -- 172.21.15.8:0/2567656850 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24348 (secure 0 0 0) 0x7fc76c027020 con 0x7fc77c073380 2023-08-11T12:24:25.536 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:25.536 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":89,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","created":"2023-08-11T12:14:28.341113+0000","modified":"2023-08-11T12:22:31.713248+0000","last_up_change":"2023-08-11T12:21:14.913735+0000","last_in_change":"2023-08-11T12:20:57.476558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-11T12:17:49.040758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-11T12:22:01.383296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-11T12:22:02.816329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-11T12:22:06.369375+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f903e393-7894-42d6-8b11-737ceef1f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6803","nonce":664104961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6805","nonce":664104961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6809","nonce":664104961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6807","nonce":664104961}]},"public_addr":"172.21.15.8:6803/664104961","cluster_addr":"172.21.15.8:6805/664104961","heartbeat_back_addr":"172.21.15.8:6809/664104961","heartbeat_front_addr":"172.21.15.8:6807/664104961","state":["exists","up"]},{"osd":1,"uuid":"1e988e5c-e78c-46d5-80a5-dff7ac38cbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6801","nonce":4187350703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6803","nonce":4187350703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6807","nonce":4187350703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6805","nonce":4187350703}]},"public_addr":"172.21.15.45:6801/4187350703","cluster_addr":"172.21.15.45:6803/4187350703","heartbeat_back_addr":"172.21.15.45:6807/4187350703","heartbeat_front_addr":"172.21.15.45:6805/4187350703","state":["exists","up"]},{"osd":2,"uuid":"1835217c-a93c-4181-b8b8-cc410bab1a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6801","nonce":2547818140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6803","nonce":2547818140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6807","nonce":2547818140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6805","nonce":2547818140}]},"public_addr":"172.21.15.194:6801/2547818140","cluster_addr":"172.21.15.194:6803/2547818140","heartbeat_back_addr":"172.21.15.194:6807/2547818140","heartbeat_front_addr":"172.21.15.194:6805/2547818140","state":["exists","up"]},{"osd":3,"uuid":"b55ae61a-731c-4312-a998-661122b84788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6811","nonce":187418883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6813","nonce":187418883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6817","nonce":187418883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6815","nonce":187418883}]},"public_addr":"172.21.15.8:6811/187418883","cluster_addr":"172.21.15.8:6813/187418883","heartbeat_back_addr":"172.21.15.8:6817/187418883","heartbeat_front_addr":"172.21.15.8:6815/187418883","state":["exists","up"]},{"osd":4,"uuid":"2c28acbb-e807-4559-8aa2-a35ca84b5d43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6809","nonce":3099704571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6811","nonce":3099704571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6815","nonce":3099704571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6813","nonce":3099704571}]},"public_addr":"172.21.15.45:6809/3099704571","cluster_addr":"172.21.15.45:6811/3099704571","heartbeat_back_addr":"172.21.15.45:6815/3099704571","heartbeat_front_addr":"172.21.15.45:6813/3099704571","state":["exists","up"]},{"osd":5,"uuid":"37032289-8016-4730-9b69-f7985e058ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6809","nonce":263803874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6811","nonce":263803874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6815","nonce":263803874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6813","nonce":263803874}]},"public_addr":"172.21.15.194:6809/263803874","cluster_addr":"172.21.15.194:6811/263803874","heartbeat_back_addr":"172.21.15.194:6815/263803874","heartbeat_front_addr":"172.21.15.194:6813/263803874","state":["exists","up"]},{"osd":6,"uuid":"32d2dab9-6944-40d1-ada9-4f941821b063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6819","nonce":1802966829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6821","nonce":1802966829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6825","nonce":1802966829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6823","nonce":1802966829}]},"public_addr":"172.21.15.8:6819/1802966829","cluster_addr":"172.21.15.8:6821/1802966829","heartbeat_back_addr":"172.21.15.8:6825/1802966829","heartbeat_front_addr":"172.21.15.8:6823/1802966829","state":["exists","up"]},{"osd":7,"uuid":"086aff58-1554-49fe-92ff-5166b115aeef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6817","nonce":3715737148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6819","nonce":3715737148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6823","nonce":3715737148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6821","nonce":3715737148}]},"public_addr":"172.21.15.45:6817/3715737148","cluster_addr":"172.21.15.45:6819/3715737148","heartbeat_back_addr":"172.21.15.45:6823/3715737148","heartbeat_front_addr":"172.21.15.45:6821/3715737148","state":["exists","up"]},{"osd":8,"uuid":"7fff5e95-2453-4ea6-a5c1-3bba6a1f6400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6817","nonce":57497127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6819","nonce":57497127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6823","nonce":57497127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6821","nonce":57497127}]},"public_addr":"172.21.15.194:6817/57497127","cluster_addr":"172.21.15.194:6819/57497127","heartbeat_back_addr":"172.21.15.194:6823/57497127","heartbeat_front_addr":"172.21.15.194:6821/57497127","state":["exists","up"]},{"osd":9,"uuid":"31ab0121-4c92-42ec-9f19-e672062e8814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6827","nonce":434661930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6829","nonce":434661930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6833","nonce":434661930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6831","nonce":434661930}]},"public_addr":"172.21.15.8:6827/434661930","cluster_addr":"172.21.15.8:6829/434661930","heartbeat_back_addr":"172.21.15.8:6833/434661930","heartbeat_front_addr":"172.21.15.8:6831/434661930","state":["exists","up"]},{"osd":10,"uuid":"62c632e4-94f6-4630-9d94-8d28fccacf45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6825","nonce":3281212184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6827","nonce":3281212184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6831","nonce":3281212184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6829","nonce":3281212184}]},"public_addr":"172.21.15.45:6825/3281212184","cluster_addr":"172.21.15.45:6827/3281212184","heartbeat_back_addr":"172.21.15.45:6831/3281212184","heartbeat_front_addr":"172.21.15.45:6829/3281212184","state":["exists","up"]},{"osd":11,"uuid":"8ca4a80d-cd75-4230-b46d-aef6fdc03e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6825","nonce":1637875895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6827","nonce":1637875895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6831","nonce":1637875895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6829","nonce":1637875895}]},"public_addr":"172.21.15.194:6825/1637875895","cluster_addr":"172.21.15.194:6827/1637875895","heartbeat_back_addr":"172.21.15.194:6831/1637875895","heartbeat_front_addr":"172.21.15.194:6829/1637875895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:04.255616+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:26.243863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:46.630365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:12.926291+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:35.747049+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:55.793767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:21.685725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:43.703215+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:04.043674+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:30.320026+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:52.751974+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:21:13.230024+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/2000592056":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2102228072":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2374527928":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2928221278":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2744750874":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/3681755887":"2023-08-12T12:15:02.528403+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-11T12:24:25.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.536+0000 7fc780dff700 1 -- 172.21.15.8:0/2567656850 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc76409ffd0 msgr2=0x7fc7640a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:25.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.536+0000 7fc780dff700 1 --2- 172.21.15.8:0/2567656850 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc76409ffd0 0x7fc7640a2490 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc77c074680 tx=0x7fc770009260 comp rx=0 tx=0).stop 2023-08-11T12:24:25.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.536+0000 7fc780dff700 1 -- 172.21.15.8:0/2567656850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc77c073380 msgr2=0x7fc77c19cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:25.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.536+0000 7fc780dff700 1 --2- 172.21.15.8:0/2567656850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc77c073380 0x7fc77c19cd50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc76c00b680 tx=0x7fc76c005740 comp rx=0 tx=0).stop 2023-08-11T12:24:25.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.536+0000 7fc780dff700 1 -- 172.21.15.8:0/2567656850 shutdown_connections 2023-08-11T12:24:25.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.536+0000 7fc780dff700 1 --2- 172.21.15.8:0/2567656850 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fc76409ffd0 0x7fc7640a2490 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.536+0000 7fc780dff700 1 --2- 172.21.15.8:0/2567656850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc77c10cfc0 0x7fc77c1a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.536+0000 7fc780dff700 1 --2- 172.21.15.8:0/2567656850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc77c073380 0x7fc77c19cd50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.536+0000 7fc780dff700 1 --2- 172.21.15.8:0/2567656850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc77c074960 0x7fc77c19d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.536+0000 7fc780dff700 1 -- 172.21.15.8:0/2567656850 >> 172.21.15.8:0/2567656850 conn(0x7fc77c0fbf80 msgr2=0x7fc77c0fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:25.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.536+0000 7fc780dff700 1 -- 172.21.15.8:0/2567656850 shutdown_connections 2023-08-11T12:24:25.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.536+0000 7fc780dff700 1 -- 172.21.15.8:0/2567656850 wait complete. 2023-08-11T12:24:25.558 DEBUG:tasks.fwd_scrub:Yielding 2023-08-11T12:24:25.558 INFO:teuthology.run_tasks:Running task exec... 2023-08-11T12:24:25.570 INFO:teuthology.task.exec:Executing custom commands... 2023-08-11T12:24:25.571 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi008.front.sepia.ceph.com 2023-08-11T12:24:25.571 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2023-08-11T12:24:25.571 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-08-11T12:24:25.572 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-08-11T12:24:25.572 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-08-11T12:24:25.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.785+0000 7f9e6b3ff700 1 -- 172.21.15.8:0/1490638678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e64103cf0 msgr2=0x7f9e641060e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:25.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.785+0000 7f9e6b3ff700 1 --2- 172.21.15.8:0/1490638678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e64103cf0 0x7f9e641060e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9e54009990 tx=0x7f9e54009ca0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.786+0000 7f9e6b3ff700 1 -- 172.21.15.8:0/1490638678 shutdown_connections 2023-08-11T12:24:25.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.786+0000 7f9e6b3ff700 1 --2- 172.21.15.8:0/1490638678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e64106620 0x7f9e64108a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.786+0000 7f9e6b3ff700 1 --2- 172.21.15.8:0/1490638678 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e641013c0 0x7f9e641037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.786+0000 7f9e6b3ff700 1 --2- 172.21.15.8:0/1490638678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e64103cf0 0x7f9e641060e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.786+0000 7f9e6b3ff700 1 -- 172.21.15.8:0/1490638678 >> 172.21.15.8:0/1490638678 conn(0x7f9e640fadb0 msgr2=0x7f9e640fd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:25.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.786+0000 7f9e6b3ff700 1 -- 172.21.15.8:0/1490638678 shutdown_connections 2023-08-11T12:24:25.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.786+0000 7f9e6b3ff700 1 -- 172.21.15.8:0/1490638678 wait complete. 2023-08-11T12:24:25.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.787+0000 7f9e6b3ff700 1 Processor -- start 2023-08-11T12:24:25.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.787+0000 7f9e6b3ff700 1 -- start start 2023-08-11T12:24:25.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.787+0000 7f9e6b3ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e641013c0 0x7f9e64196660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:25.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.787+0000 7f9e6b3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e64103cf0 0x7f9e64196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:25.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.787+0000 7f9e6b3ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e64106620 0x7f9e6419dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:25.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.787+0000 7f9e6b3ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6419e1e0 con 0x7f9e64106620 2023-08-11T12:24:25.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.787+0000 7f9e6b3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6419e320 con 0x7f9e64103cf0 2023-08-11T12:24:25.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.787+0000 7f9e6b3ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6419e4b0 con 0x7f9e641013c0 2023-08-11T12:24:25.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.788+0000 7f9e6919b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e641013c0 0x7f9e64196660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:25.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.788+0000 7f9e6919b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e641013c0 0x7f9e64196660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:52776/0 (socket says 172.21.15.8:52776) 2023-08-11T12:24:25.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.788+0000 7f9e6919b700 1 -- 172.21.15.8:0/2266363507 learned_addr learned my addr 172.21.15.8:0/2266363507 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:25.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.788+0000 7f9e6899a700 1 --2- 172.21.15.8:0/2266363507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e64103cf0 0x7f9e64196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:25.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.788+0000 7f9e6999c700 1 --2- 172.21.15.8:0/2266363507 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e64106620 0x7f9e6419dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:25.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.788+0000 7f9e6919b700 1 -- 172.21.15.8:0/2266363507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e64103cf0 msgr2=0x7f9e64196ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:25.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.788+0000 7f9e6919b700 1 --2- 172.21.15.8:0/2266363507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e64103cf0 0x7f9e64196ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.788+0000 7f9e6919b700 1 -- 172.21.15.8:0/2266363507 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e64106620 msgr2=0x7f9e6419dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:25.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.788+0000 7f9e6919b700 1 --2- 172.21.15.8:0/2266363507 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e64106620 0x7f9e6419dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.788+0000 7f9e6919b700 1 -- 172.21.15.8:0/2266363507 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e60009520 con 0x7f9e641013c0 2023-08-11T12:24:25.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.788+0000 7f9e6899a700 1 --2- 172.21.15.8:0/2266363507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e64103cf0 0x7f9e64196ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:25.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.788+0000 7f9e6919b700 1 --2- 172.21.15.8:0/2266363507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e641013c0 0x7f9e64196660 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9e6000eb30 tx=0x7f9e6000ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:25.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.789+0000 7f9e5a7fc700 1 -- 172.21.15.8:0/2266363507 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e60009880 con 0x7f9e641013c0 2023-08-11T12:24:25.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.789+0000 7f9e5a7fc700 1 -- 172.21.15.8:0/2266363507 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9e600044e0 con 0x7f9e641013c0 2023-08-11T12:24:25.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.789+0000 7f9e6b3ff700 1 -- 172.21.15.8:0/2266363507 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e5c009c40 con 0x7f9e641013c0 2023-08-11T12:24:25.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.789+0000 7f9e5a7fc700 1 -- 172.21.15.8:0/2266363507 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e60003d80 con 0x7f9e641013c0 2023-08-11T12:24:25.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.789+0000 7f9e6b3ff700 1 -- 172.21.15.8:0/2266363507 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e540095f0 con 0x7f9e641013c0 2023-08-11T12:24:25.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.790+0000 7f9e6b3ff700 1 -- 172.21.15.8:0/2266363507 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e640fc930 con 0x7f9e641013c0 2023-08-11T12:24:25.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.792+0000 7f9e5a7fc700 1 -- 172.21.15.8:0/2266363507 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f9e60003ee0 con 0x7f9e641013c0 2023-08-11T12:24:25.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.794+0000 7f9e5a7fc700 1 --2- 172.21.15.8:0/2266363507 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9e5009ffd0 0x7f9e500a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:25.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.794+0000 7f9e5a7fc700 1 -- 172.21.15.8:0/2266363507 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f9e60014070 con 0x7f9e641013c0 2023-08-11T12:24:25.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.794+0000 7f9e6899a700 1 --2- 172.21.15.8:0/2266363507 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9e5009ffd0 0x7f9e500a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:25.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.795+0000 7f9e6899a700 1 --2- 172.21.15.8:0/2266363507 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9e5009ffd0 0x7f9e500a2490 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400b2e0 tx=0x7f9e54020040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:25.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.797+0000 7f9e5a7fc700 1 -- 172.21.15.8:0/2266363507 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f9e60095390 con 0x7f9e641013c0 2023-08-11T12:24:25.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.798+0000 7fa364fff700 1 -- 172.21.15.8:0/1154933592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3601066d0 msgr2=0x7fa360108b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:25.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.798+0000 7fa364fff700 1 --2- 172.21.15.8:0/1154933592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3601066d0 0x7fa360108b40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa358009f90 tx=0x7fa35800b330 comp rx=0 tx=0).stop 2023-08-11T12:24:25.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.798+0000 7fa364fff700 1 -- 172.21.15.8:0/1154933592 shutdown_connections 2023-08-11T12:24:25.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.798+0000 7fa364fff700 1 --2- 172.21.15.8:0/1154933592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3601066d0 0x7fa360108b40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.798+0000 7fa364fff700 1 --2- 172.21.15.8:0/1154933592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa360101470 0x7fa360103860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.798+0000 7fa364fff700 1 --2- 172.21.15.8:0/1154933592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa360103da0 0x7fa360106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.798+0000 7fa364fff700 1 -- 172.21.15.8:0/1154933592 >> 172.21.15.8:0/1154933592 conn(0x7fa3600faea0 msgr2=0x7fa3600fd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:25.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.798+0000 7fa364fff700 1 -- 172.21.15.8:0/1154933592 shutdown_connections 2023-08-11T12:24:25.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.798+0000 7fa364fff700 1 -- 172.21.15.8:0/1154933592 wait complete. 2023-08-11T12:24:25.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.799+0000 7fa364fff700 1 Processor -- start 2023-08-11T12:24:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.799+0000 7fa364fff700 1 -- start start 2023-08-11T12:24:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.800+0000 7fa364fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa360101470 0x7fa3601989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.800+0000 7fa364fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa360103da0 0x7fa360198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.800+0000 7fa364fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3601066d0 0x7fa36019ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.800+0000 7fa364fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3601a0540 con 0x7fa360101470 2023-08-11T12:24:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.800+0000 7fa364fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3601a0680 con 0x7fa360103da0 2023-08-11T12:24:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.800+0000 7fa364fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3601a0810 con 0x7fa3601066d0 2023-08-11T12:24:25.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.800+0000 7fa35e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa360101470 0x7fa3601989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:25.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.800+0000 7fa35ed9d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3601066d0 0x7fa36019ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:25.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.800+0000 7fa35e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa360101470 0x7fa3601989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46910/0 (socket says 172.21.15.8:46910) 2023-08-11T12:24:25.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.800+0000 7fa35dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa360103da0 0x7fa360198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:25.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.800+0000 7fa35ed9d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3601066d0 0x7fa36019ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:52784/0 (socket says 172.21.15.8:52784) 2023-08-11T12:24:25.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.800+0000 7fa35e59c700 1 -- 172.21.15.8:0/207402151 learned_addr learned my addr 172.21.15.8:0/207402151 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:25.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.801+0000 7fa35ed9d700 1 -- 172.21.15.8:0/207402151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa360103da0 msgr2=0x7fa360198f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:25.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.801+0000 7fa35ed9d700 1 --2- 172.21.15.8:0/207402151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa360103da0 0x7fa360198f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.801+0000 7fa35ed9d700 1 -- 172.21.15.8:0/207402151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa360101470 msgr2=0x7fa3601989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:25.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.801+0000 7fa35ed9d700 1 --2- 172.21.15.8:0/207402151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa360101470 0x7fa3601989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.801+0000 7fa35ed9d700 1 -- 172.21.15.8:0/207402151 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa358009c40 con 0x7fa3601066d0 2023-08-11T12:24:25.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.801+0000 7fa35ed9d700 1 --2- 172.21.15.8:0/207402151 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3601066d0 0x7fa36019ff70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa35800b6c0 tx=0x7fa358004c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:25.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.801+0000 7fa34f7fe700 1 -- 172.21.15.8:0/207402151 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35800e040 con 0x7fa3601066d0 2023-08-11T12:24:25.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.801+0000 7fa34f7fe700 1 -- 172.21.15.8:0/207402151 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa35800be00 con 0x7fa3601066d0 2023-08-11T12:24:25.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.801+0000 7fa34f7fe700 1 -- 172.21.15.8:0/207402151 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3580052a0 con 0x7fa3601066d0 2023-08-11T12:24:25.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.801+0000 7fa364fff700 1 -- 172.21.15.8:0/207402151 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3601a0a90 con 0x7fa3601066d0 2023-08-11T12:24:25.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.801+0000 7fa364fff700 1 -- 172.21.15.8:0/207402151 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3601a0f10 con 0x7fa3601066d0 2023-08-11T12:24:25.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.805+0000 7fa34f7fe700 1 -- 172.21.15.8:0/207402151 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7fa35801d470 con 0x7fa3601066d0 2023-08-11T12:24:25.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.806+0000 7fa34f7fe700 1 --2- 172.21.15.8:0/207402151 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa34809ffd0 0x7fa3480a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:25.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.806+0000 7fa34f7fe700 1 -- 172.21.15.8:0/207402151 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fa3580cc920 con 0x7fa3601066d0 2023-08-11T12:24:25.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.807+0000 7fa35e59c700 1 --2- 172.21.15.8:0/207402151 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa34809ffd0 0x7fa3480a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:25.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.807+0000 7fa35e59c700 1 --2- 172.21.15.8:0/207402151 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa34809ffd0 0x7fa3480a2490 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa350005950 tx=0x7fa35000b500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:25.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.809+0000 7fa3788fab80 1 Processor -- start 2023-08-11T12:24:25.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.809+0000 7fa3788fab80 1 -- start start 2023-08-11T12:24:25.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.809+0000 7fa3788fab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d9e20eb50 0x558d9e20ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:25.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.809+0000 7fa3788fab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d9e20f4b0 0x558d9e20f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:25.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.809+0000 7fa3788fab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d9e20fe70 0x558d9e2102f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:25.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.809+0000 7fa3788fab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d9e1676b0 con 0x558d9e20eb50 2023-08-11T12:24:25.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.809+0000 7fa3788fab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d9e164fd0 con 0x558d9e20fe70 2023-08-11T12:24:25.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.809+0000 7fa3788fab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d9e1608c0 con 0x558d9e20f4b0 2023-08-11T12:24:25.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.810+0000 7fa35dd9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d9e20f4b0 0x558d9e20f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:25.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.810+0000 7fa35e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d9e20eb50 0x558d9e20ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:25.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.810+0000 7fa35dd9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d9e20f4b0 0x558d9e20f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:52800/0 (socket says 172.21.15.8:52800) 2023-08-11T12:24:25.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.810+0000 7fa35dd9b700 1 -- 172.21.15.8:0/3778781162 learned_addr learned my addr 172.21.15.8:0/3778781162 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:25.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.810+0000 7fa35ed9d700 1 --2- 172.21.15.8:0/3778781162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d9e20fe70 0x558d9e2102f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:25.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.810+0000 7fa35dd9b700 1 -- 172.21.15.8:0/3778781162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d9e20fe70 msgr2=0x558d9e2102f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:25.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.810+0000 7fa35dd9b700 1 --2- 172.21.15.8:0/3778781162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d9e20fe70 0x558d9e2102f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.810+0000 7fa35dd9b700 1 -- 172.21.15.8:0/3778781162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d9e20eb50 msgr2=0x558d9e20ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:25.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.810+0000 7fa35dd9b700 1 --2- 172.21.15.8:0/3778781162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d9e20eb50 0x558d9e20ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.810+0000 7fa35dd9b700 1 -- 172.21.15.8:0/3778781162 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d9dfe06b0 con 0x558d9e20f4b0 2023-08-11T12:24:25.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.810+0000 7fa35dd9b700 1 --2- 172.21.15.8:0/3778781162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d9e20f4b0 0x558d9e20f930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa354009d60 tx=0x7fa354011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce16bd3535683434 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:25.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.811+0000 7fa34cff9700 1 -- 172.21.15.8:0/3778781162 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa354019630 con 0x558d9e20f4b0 2023-08-11T12:24:25.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.811+0000 7fa34cff9700 1 -- 172.21.15.8:0/3778781162 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa354019c50 con 0x558d9e20f4b0 2023-08-11T12:24:25.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.811+0000 7fa34cff9700 1 -- 172.21.15.8:0/3778781162 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35400ec10 con 0x558d9e20f4b0 2023-08-11T12:24:25.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.811+0000 7fa3788fab80 1 -- 172.21.15.8:0/3778781162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d9e20f4b0 msgr2=0x558d9e20f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:25.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.811+0000 7fa3788fab80 1 --2- 172.21.15.8:0/3778781162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d9e20f4b0 0x558d9e20f930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa354009d60 tx=0x7fa354011720 comp rx=0 tx=0).stop 2023-08-11T12:24:25.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.811+0000 7fa3788fab80 1 -- 172.21.15.8:0/3778781162 shutdown_connections 2023-08-11T12:24:25.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.811+0000 7fa3788fab80 1 --2- 172.21.15.8:0/3778781162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d9e20fe70 0x558d9e2102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.811+0000 7fa3788fab80 1 --2- 172.21.15.8:0/3778781162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d9e20eb50 0x558d9e20ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.811+0000 7fa3788fab80 1 --2- 172.21.15.8:0/3778781162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d9e20f4b0 0x558d9e20f930 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.811+0000 7fa3788fab80 1 -- 172.21.15.8:0/3778781162 >> 172.21.15.8:0/3778781162 conn(0x558d9e13b9d0 msgr2=0x558d9e2094a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:25.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.812+0000 7fa3788fab80 1 -- 172.21.15.8:0/3778781162 shutdown_connections 2023-08-11T12:24:25.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.812+0000 7fa3788fab80 1 -- 172.21.15.8:0/3778781162 wait complete. 2023-08-11T12:24:25.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.812+0000 7fa3788fab80 1 -- start start 2023-08-11T12:24:25.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.812+0000 7fa3788fab80 1 Processor -- start 2023-08-11T12:24:25.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.813+0000 7fa3788fab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d9e20eb50 0x558d9e218160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:25.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.813+0000 7fa3788fab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d9e20f4b0 0x558d9e2186a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:25.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.813+0000 7fa3788fab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d9e20fe70 0x558d9e21f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:25.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.813+0000 7fa3788fab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d9e0feb40 con 0x558d9e20fe70 2023-08-11T12:24:25.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.813+0000 7fa3788fab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d9e0fe840 con 0x558d9e20eb50 2023-08-11T12:24:25.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.813+0000 7fa3788fab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d9dfe29a0 con 0x558d9e20f4b0 2023-08-11T12:24:25.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.813+0000 7fa3788fab80 10 client.0 _ll_register_callbacks cb 0x558d9e101b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:25.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.813+0000 7fa35dd9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d9e20f4b0 0x558d9e2186a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:25.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.813+0000 7fa35dd9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d9e20f4b0 0x558d9e2186a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:52804/0 (socket says 172.21.15.8:52804) 2023-08-11T12:24:25.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.813+0000 7fa35e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d9e20eb50 0x558d9e218160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:25.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.813+0000 7fa35dd9b700 1 -- 172.21.15.8:0/4006313214 learned_addr learned my addr 172.21.15.8:0/4006313214 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:25.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.813+0000 7fa35ed9d700 1 --2- 172.21.15.8:0/4006313214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d9e20fe70 0x558d9e21f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:25.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.814+0000 7fa35e59c700 1 -- 172.21.15.8:0/4006313214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d9e20f4b0 msgr2=0x558d9e2186a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:25.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.814+0000 7fa35e59c700 1 --2- 172.21.15.8:0/4006313214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d9e20f4b0 0x558d9e2186a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.814+0000 7fa35e59c700 1 -- 172.21.15.8:0/4006313214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d9e20fe70 msgr2=0x558d9e21f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:25.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.814+0000 7fa35e59c700 1 --2- 172.21.15.8:0/4006313214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d9e20fe70 0x558d9e21f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.814+0000 7fa35e59c700 1 -- 172.21.15.8:0/4006313214 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3540099c0 con 0x558d9e20eb50 2023-08-11T12:24:25.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.814+0000 7fa35e59c700 1 --2- 172.21.15.8:0/4006313214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d9e20eb50 0x558d9e218160 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa35000c010 tx=0x7fa3500047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=609e1241d10a76c8 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:25.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.814+0000 7fa345ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:24:25.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.814+0000 7fa345ffb700 1 -- 172.21.15.8:0/4006313214 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa350004500 con 0x558d9e20eb50 2023-08-11T12:24:25.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.814+0000 7fa345ffb700 1 -- 172.21.15.8:0/4006313214 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fa350017070 con 0x558d9e20eb50 2023-08-11T12:24:25.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.814+0000 7fa3788fab80 1 -- 172.21.15.8:0/4006313214 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558d9e201b10 con 0x558d9e20eb50 2023-08-11T12:24:25.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.815+0000 7fa345ffb700 1 -- 172.21.15.8:0/4006313214 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3500118a0 con 0x558d9e20eb50 2023-08-11T12:24:25.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.815+0000 7fa3788fab80 10 client.25568 fetch_fsmap learned FSMap version 27 2023-08-11T12:24:25.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.815+0000 7fa3788fab80 1 -- 172.21.15.8:0/4006313214 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x558d9df8ce60 con 0x558d9e20eb50 2023-08-11T12:24:25.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.815+0000 7fa345ffb700 1 -- 172.21.15.8:0/4006313214 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558d9e201b10 con 0x558d9e20eb50 2023-08-11T12:24:25.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.815+0000 7fa345ffb700 1 -- 172.21.15.8:0/4006313214 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa35002f440 con 0x558d9e20eb50 2023-08-11T12:24:25.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.816+0000 7fa3788fab80 10 client.25568 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:24:25.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.816+0000 7fa3788fab80 10 client.25568 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:24:25.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.816+0000 7fa3788fab80 20 client.25568 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:25.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.816+0000 7fa3788fab80 1 --2- 172.21.15.8:0/4006313214 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x558d9e224010 0x558d9e226430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:25.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.816+0000 7fa3788fab80 4 client.25568 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:24:25.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.816+0000 7fa3788fab80 1 -- 172.21.15.8:0/4006313214 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558d9e1dd560 con 0x558d9e224010 2023-08-11T12:24:25.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.816+0000 7fa35dd9b700 1 --2- 172.21.15.8:0/4006313214 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x558d9e224010 0x558d9e226430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:25.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.817+0000 7fa35dd9b700 1 --2- 172.21.15.8:0/4006313214 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x558d9e224010 0x558d9e226430 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5400d5723578a75d server_cookie=d15c7e21594b016d in_seq=0 out_seq=0 2023-08-11T12:24:25.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.817+0000 7fa345ffb700 10 client.25568 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:24:25.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.817+0000 7fa345ffb700 1 -- 172.21.15.8:0/4006313214 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x558d9e1dd560 con 0x558d9e224010 2023-08-11T12:24:25.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.817+0000 7fa345ffb700 10 client.25568 handle_command_reply: tid=0 2023-08-11T12:24:25.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.817+0000 7fa3788fab80 1 client.25568 shutdown 2023-08-11T12:24:25.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.818+0000 7fa3788fab80 1 -- 172.21.15.8:0/4006313214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d9e20eb50 msgr2=0x558d9e218160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:25.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.818+0000 7fa3788fab80 1 --2- 172.21.15.8:0/4006313214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d9e20eb50 0x558d9e218160 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa35000c010 tx=0x7fa3500047c0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.818+0000 7fa3788fab80 1 -- 172.21.15.8:0/4006313214 shutdown_connections 2023-08-11T12:24:25.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.818+0000 7fa3788fab80 1 --2- 172.21.15.8:0/4006313214 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x558d9e224010 0x558d9e226430 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.818+0000 7fa3788fab80 1 --2- 172.21.15.8:0/4006313214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d9e20fe70 0x558d9e21f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.818+0000 7fa3788fab80 1 --2- 172.21.15.8:0/4006313214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d9e20eb50 0x558d9e218160 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.818+0000 7fa345ffb700 0 client.25568 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:24:25.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.818+0000 7fa3788fab80 1 --2- 172.21.15.8:0/4006313214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d9e20f4b0 0x558d9e2186a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.818+0000 7fa3788fab80 1 -- 172.21.15.8:0/4006313214 >> 172.21.15.8:0/4006313214 conn(0x558d9e13b9d0 msgr2=0x558d9e203d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:25.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.818+0000 7fa3788fab80 1 -- 172.21.15.8:0/4006313214 shutdown_connections 2023-08-11T12:24:25.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.818+0000 7fa3788fab80 1 -- 172.21.15.8:0/4006313214 wait complete. 2023-08-11T12:24:25.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.818+0000 7fa3788fab80 20 client.25568 trim_cache size 0 max 16384 2023-08-11T12:24:25.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.839+0000 7fa3788fab80 1 Processor -- start 2023-08-11T12:24:25.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.839+0000 7fa3788fab80 1 -- start start 2023-08-11T12:24:25.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.840+0000 7fa3788fab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d9e20eb50 0x558d9e2034a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:25.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.840+0000 7fa3788fab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d9e20f4b0 0x558d9e21f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:25.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.840+0000 7fa3788fab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d9e20fe70 0x558d9e2039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:25.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.840+0000 7fa3788fab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d9e216cb0 con 0x558d9e20fe70 2023-08-11T12:24:25.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.840+0000 7fa3788fab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d9e215ff0 con 0x558d9e20f4b0 2023-08-11T12:24:25.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.840+0000 7fa3788fab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d9e2138e0 con 0x558d9e20eb50 2023-08-11T12:24:25.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.840+0000 7fa35e59c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d9e20eb50 0x558d9e2034a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:25.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.840+0000 7fa35dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d9e20f4b0 0x558d9e21f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:25.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.840+0000 7fa35dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d9e20f4b0 0x558d9e21f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:37204/0 (socket says 172.21.15.8:37204) 2023-08-11T12:24:25.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.840+0000 7fa35e59c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d9e20eb50 0x558d9e2034a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:52806/0 (socket says 172.21.15.8:52806) 2023-08-11T12:24:25.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.840+0000 7fa35dd9b700 1 -- 172.21.15.8:0/3505438494 learned_addr learned my addr 172.21.15.8:0/3505438494 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:25.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.840+0000 7fa35ed9d700 1 --2- 172.21.15.8:0/3505438494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d9e20fe70 0x558d9e2039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:25.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.840+0000 7fa35dd9b700 1 -- 172.21.15.8:0/3505438494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d9e20eb50 msgr2=0x558d9e2034a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:25.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.840+0000 7fa35dd9b700 1 --2- 172.21.15.8:0/3505438494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d9e20eb50 0x558d9e2034a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.840+0000 7fa35dd9b700 1 -- 172.21.15.8:0/3505438494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d9e20fe70 msgr2=0x558d9e2039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:25.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.840+0000 7fa35dd9b700 1 --2- 172.21.15.8:0/3505438494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d9e20fe70 0x558d9e2039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.840+0000 7fa35dd9b700 1 -- 172.21.15.8:0/3505438494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d9df75ce0 con 0x558d9e20f4b0 2023-08-11T12:24:25.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.840+0000 7fa35ed9d700 1 --2- 172.21.15.8:0/3505438494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d9e20fe70 0x558d9e2039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:24:25.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.840+0000 7fa35e59c700 1 --2- 172.21.15.8:0/3505438494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d9e20eb50 0x558d9e2034a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:25.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.841+0000 7fa35dd9b700 1 --2- 172.21.15.8:0/3505438494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d9e20f4b0 0x558d9e21f670 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa35400e920 tx=0x7fa3540058e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d92418d03d2cbcd server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:25.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.841+0000 7fa34d7fa700 1 -- 172.21.15.8:0/3505438494 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35402a2a0 con 0x558d9e20f4b0 2023-08-11T12:24:25.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.841+0000 7fa34d7fa700 1 -- 172.21.15.8:0/3505438494 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa35402a400 con 0x558d9e20f4b0 2023-08-11T12:24:25.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.841+0000 7fa34d7fa700 1 -- 172.21.15.8:0/3505438494 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa354019900 con 0x558d9e20f4b0 2023-08-11T12:24:25.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.842+0000 7fa3788fab80 1 -- 172.21.15.8:0/3505438494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d9e20f4b0 msgr2=0x558d9e21f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:25.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.842+0000 7fa3788fab80 1 --2- 172.21.15.8:0/3505438494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d9e20f4b0 0x558d9e21f670 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa35400e920 tx=0x7fa3540058e0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.842+0000 7fa3788fab80 1 -- 172.21.15.8:0/3505438494 shutdown_connections 2023-08-11T12:24:25.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.842+0000 7fa3788fab80 1 --2- 172.21.15.8:0/3505438494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d9e20eb50 0x558d9e2034a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.842+0000 7fa3788fab80 1 --2- 172.21.15.8:0/3505438494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d9e20fe70 0x558d9e2039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.842+0000 7fa3788fab80 1 --2- 172.21.15.8:0/3505438494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d9e20f4b0 0x558d9e21f670 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.842+0000 7fa3788fab80 1 -- 172.21.15.8:0/3505438494 >> 172.21.15.8:0/3505438494 conn(0x558d9e13b9d0 msgr2=0x558d9e212dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:25.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.842+0000 7fa3788fab80 1 -- 172.21.15.8:0/3505438494 shutdown_connections 2023-08-11T12:24:25.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.842+0000 7fa3788fab80 1 -- 172.21.15.8:0/3505438494 wait complete. 2023-08-11T12:24:25.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.842+0000 7fa3788fab80 1 -- start start 2023-08-11T12:24:25.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.843+0000 7fa3788fab80 1 Processor -- start 2023-08-11T12:24:25.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.843+0000 7fa3788fab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d9e20eb50 0x558d9e21c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:25.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.843+0000 7fa3788fab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d9e20f4b0 0x558d9e21c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:25.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.843+0000 7fa3788fab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d9e20fe70 0x558d9e277cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:25.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.843+0000 7fa3788fab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d9e21f690 con 0x558d9e20fe70 2023-08-11T12:24:25.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.843+0000 7fa3788fab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d9e21f800 con 0x558d9e20f4b0 2023-08-11T12:24:25.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.843+0000 7fa3788fab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d9e21f9c0 con 0x558d9e20eb50 2023-08-11T12:24:25.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.843+0000 7fa3788fab80 10 client.0 _ll_register_callbacks cb 0x7fa350010e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:25.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.843+0000 7fa35e59c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d9e20eb50 0x558d9e21c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:25.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.843+0000 7fa35e59c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d9e20eb50 0x558d9e21c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:52818/0 (socket says 172.21.15.8:52818) 2023-08-11T12:24:25.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.843+0000 7fa35dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d9e20f4b0 0x558d9e21c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:25.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.843+0000 7fa35e59c700 1 -- 172.21.15.8:0/2627256253 learned_addr learned my addr 172.21.15.8:0/2627256253 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:25.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.844+0000 7fa35e59c700 1 -- 172.21.15.8:0/2627256253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d9e20f4b0 msgr2=0x558d9e21c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:25.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.844+0000 7fa35e59c700 1 --2- 172.21.15.8:0/2627256253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d9e20f4b0 0x558d9e21c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.844+0000 7fa35e59c700 1 -- 172.21.15.8:0/2627256253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d9e20fe70 msgr2=0x558d9e277cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:25.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.844+0000 7fa35e59c700 1 --2- 172.21.15.8:0/2627256253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d9e20fe70 0x558d9e277cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.844+0000 7fa35e59c700 1 -- 172.21.15.8:0/2627256253 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa350034040 con 0x558d9e20eb50 2023-08-11T12:24:25.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.844+0000 7fa35e59c700 1 --2- 172.21.15.8:0/2627256253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d9e20eb50 0x558d9e21c130 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa350010a40 tx=0x7fa35000bc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bee707cfe7ca8322 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:25.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.844+0000 7fa345ffb700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:24:25.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.844+0000 7fa345ffb700 1 -- 172.21.15.8:0/2627256253 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35002f5c0 con 0x558d9e20eb50 2023-08-11T12:24:25.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.844+0000 7fa345ffb700 1 -- 172.21.15.8:0/2627256253 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fa350017040 con 0x558d9e20eb50 2023-08-11T12:24:25.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.844+0000 7fa3788fab80 1 -- 172.21.15.8:0/2627256253 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa354019c50 con 0x558d9e20eb50 2023-08-11T12:24:25.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.845+0000 7fa345ffb700 1 -- 172.21.15.8:0/2627256253 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa350004300 con 0x558d9e20eb50 2023-08-11T12:24:25.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.845+0000 7fa3788fab80 10 client.25579 fetch_fsmap learned FSMap version 27 2023-08-11T12:24:25.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.845+0000 7fa3788fab80 1 -- 172.21.15.8:0/2627256253 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x558d9dfe06b0 con 0x558d9e20eb50 2023-08-11T12:24:25.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.845+0000 7fa345ffb700 1 -- 172.21.15.8:0/2627256253 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa354019c50 con 0x558d9e20eb50 2023-08-11T12:24:25.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.845+0000 7fa345ffb700 1 -- 172.21.15.8:0/2627256253 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa350003680 con 0x558d9e20eb50 2023-08-11T12:24:25.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.845+0000 7fa3788fab80 10 client.25579 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:24:25.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.845+0000 7fa3788fab80 10 client.25579 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:24:25.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.845+0000 7fa3788fab80 20 client.25579 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:25.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.845+0000 7fa3788fab80 1 --2- 172.21.15.8:0/2627256253 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x558d9e279a40 0x558d9e27be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:25.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.846+0000 7fa3788fab80 4 client.25579 mds_command: new command op to 24575 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-08-11T12:24:25.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.846+0000 7fa3788fab80 1 -- 172.21.15.8:0/2627256253 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x558d9e1598a0 con 0x558d9e279a40 2023-08-11T12:24:25.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.846+0000 7fa35dd9b700 1 --2- 172.21.15.8:0/2627256253 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x558d9e279a40 0x558d9e27be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:25.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.847+0000 7fa345ffb700 10 client.25579 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:24:25.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.847+0000 7fa35dd9b700 1 --2- 172.21.15.8:0/2627256253 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x558d9e279a40 0x558d9e27be60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d260d820de9ac4d3 server_cookie=17e018339329b387 in_seq=0 out_seq=0 2023-08-11T12:24:25.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.847+0000 7fa345ffb700 1 -- 172.21.15.8:0/2627256253 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x558d9e1598a0 con 0x558d9e279a40 2023-08-11T12:24:25.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.847+0000 7fa345ffb700 10 client.25579 handle_command_reply: tid=0 2023-08-11T12:24:25.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.847+0000 7fa3788fab80 1 client.25579 shutdown 2023-08-11T12:24:25.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.847+0000 7fa3788fab80 1 -- 172.21.15.8:0/2627256253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d9e20eb50 msgr2=0x558d9e21c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:25.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.847+0000 7fa3788fab80 1 --2- 172.21.15.8:0/2627256253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d9e20eb50 0x558d9e21c130 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa350010a40 tx=0x7fa35000bc50 comp rx=0 tx=0).stop 2023-08-11T12:24:25.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.848+0000 7fa3788fab80 1 -- 172.21.15.8:0/2627256253 shutdown_connections 2023-08-11T12:24:25.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.848+0000 7fa3788fab80 1 --2- 172.21.15.8:0/2627256253 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x558d9e279a40 0x558d9e27be60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.848+0000 7fa3788fab80 1 --2- 172.21.15.8:0/2627256253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d9e20eb50 0x558d9e21c130 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.848+0000 7fa3788fab80 1 --2- 172.21.15.8:0/2627256253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d9e20fe70 0x558d9e277cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.848+0000 7fa345ffb700 0 client.25579 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:24:25.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.848+0000 7fa3788fab80 1 --2- 172.21.15.8:0/2627256253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d9e20f4b0 0x558d9e21c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.848+0000 7fa3788fab80 1 -- 172.21.15.8:0/2627256253 >> 172.21.15.8:0/2627256253 conn(0x558d9e13b9d0 msgr2=0x558d9e20d950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:25.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.848+0000 7fa3788fab80 1 -- 172.21.15.8:0/2627256253 shutdown_connections 2023-08-11T12:24:25.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.848+0000 7fa3788fab80 1 -- 172.21.15.8:0/2627256253 wait complete. 2023-08-11T12:24:25.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.848+0000 7fa3788fab80 20 client.25579 trim_cache size 0 max 16384 2023-08-11T12:24:25.857 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:24:25.857 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2023-08-11T12:24:25.857 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "fe1dfb4c-68fe-4dca-a6fc-a370ddfcec9a", 2023-08-11T12:24:25.858 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2023-08-11T12:24:25.858 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:24:25.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.849+0000 7fa364fff700 1 -- 172.21.15.8:0/207402151 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa34809ffd0 msgr2=0x7fa3480a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:25.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.849+0000 7fa364fff700 1 --2- 172.21.15.8:0/207402151 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa34809ffd0 0x7fa3480a2490 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa350005950 tx=0x7fa35000b500 comp rx=0 tx=0).stop 2023-08-11T12:24:25.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.849+0000 7fa364fff700 1 -- 172.21.15.8:0/207402151 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3601066d0 msgr2=0x7fa36019ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:25.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.849+0000 7fa364fff700 1 --2- 172.21.15.8:0/207402151 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3601066d0 0x7fa36019ff70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa35800b6c0 tx=0x7fa358004c60 comp rx=0 tx=0).stop 2023-08-11T12:24:25.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.849+0000 7fa364fff700 1 -- 172.21.15.8:0/207402151 shutdown_connections 2023-08-11T12:24:25.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.849+0000 7fa364fff700 1 --2- 172.21.15.8:0/207402151 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fa34809ffd0 0x7fa3480a2490 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.849+0000 7fa364fff700 1 --2- 172.21.15.8:0/207402151 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3601066d0 0x7fa36019ff70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.849+0000 7fa364fff700 1 --2- 172.21.15.8:0/207402151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa360101470 0x7fa3601989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.849+0000 7fa364fff700 1 --2- 172.21.15.8:0/207402151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa360103da0 0x7fa360198f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:25.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.849+0000 7fa364fff700 1 -- 172.21.15.8:0/207402151 >> 172.21.15.8:0/207402151 conn(0x7fa3600faea0 msgr2=0x7fa3600ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:25.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.849+0000 7fa364fff700 1 -- 172.21.15.8:0/207402151 shutdown_connections 2023-08-11T12:24:25.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:25.849+0000 7fa364fff700 1 -- 172.21.15.8:0/207402151 wait complete. 2023-08-11T12:24:25.875 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:25 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/4218313875' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:24:25.875 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:25 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2567656850' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:24:25.877 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:24:26.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.107+0000 7f9e6b3ff700 1 -- 172.21.15.8:0/2266363507 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f9e6402cc40 con 0x7f9e641013c0 2023-08-11T12:24:26.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.112+0000 7f936cbff700 1 -- 172.21.15.8:0/541078562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9368100a10 msgr2=0x7f9368100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:26.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.112+0000 7f936cbff700 1 --2- 172.21.15.8:0/541078562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9368100a10 0x7f9368100e30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f93580099c0 tx=0x7f9358009cd0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.112+0000 7f936cbff700 1 -- 172.21.15.8:0/541078562 shutdown_connections 2023-08-11T12:24:26.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.112+0000 7f936cbff700 1 --2- 172.21.15.8:0/541078562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93681025a0 0x7f9368108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.112+0000 7f936cbff700 1 --2- 172.21.15.8:0/541078562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9368100a10 0x7f9368100e30 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.112+0000 7f936cbff700 1 --2- 172.21.15.8:0/541078562 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9368101c00 0x7f9368102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.112+0000 7f936cbff700 1 -- 172.21.15.8:0/541078562 >> 172.21.15.8:0/541078562 conn(0x7f93680fbf80 msgr2=0x7f93680fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:26.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.112+0000 7f936cbff700 1 -- 172.21.15.8:0/541078562 shutdown_connections 2023-08-11T12:24:26.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.113+0000 7f936cbff700 1 -- 172.21.15.8:0/541078562 wait complete. 2023-08-11T12:24:26.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.113+0000 7f936cbff700 1 Processor -- start 2023-08-11T12:24:26.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.114+0000 7f936cbff700 1 -- start start 2023-08-11T12:24:26.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.114+0000 7f936cbff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9368100a10 0x7f9368198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:26.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.114+0000 7f936cbff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9368101c00 0x7f9368198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:26.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.114+0000 7f936cbff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93681025a0 0x7f936819fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:26.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.114+0000 7f936cbff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93681a0410 con 0x7f93681025a0 2023-08-11T12:24:26.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.114+0000 7f936cbff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93681a0550 con 0x7f9368101c00 2023-08-11T12:24:26.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.114+0000 7f936cbff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93681a06e0 con 0x7f9368100a10 2023-08-11T12:24:26.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.114+0000 7f9365d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9368101c00 0x7f9368198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:26.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.114+0000 7f9365d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9368101c00 0x7f9368198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:37226/0 (socket says 172.21.15.8:37226) 2023-08-11T12:24:26.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.114+0000 7f9365d9b700 1 -- 172.21.15.8:0/895994475 learned_addr learned my addr 172.21.15.8:0/895994475 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:26.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.114+0000 7f936659c700 1 --2- 172.21.15.8:0/895994475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9368100a10 0x7f9368198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:26.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.114+0000 7f9366d9d700 1 --2- 172.21.15.8:0/895994475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93681025a0 0x7f936819fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:26.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.115+0000 7f9365d9b700 1 -- 172.21.15.8:0/895994475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9368100a10 msgr2=0x7f9368198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:26.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.115+0000 7f9365d9b700 1 --2- 172.21.15.8:0/895994475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9368100a10 0x7f9368198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.115+0000 7f9365d9b700 1 -- 172.21.15.8:0/895994475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93681025a0 msgr2=0x7f936819fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:26.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.115+0000 7f9365d9b700 1 --2- 172.21.15.8:0/895994475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93681025a0 0x7f936819fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.115+0000 7f9365d9b700 1 -- 172.21.15.8:0/895994475 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93580095f0 con 0x7f9368101c00 2023-08-11T12:24:26.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.115+0000 7f9365d9b700 1 --2- 172.21.15.8:0/895994475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9368101c00 0x7f9368198dd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f935c00e9a0 tx=0x7f935c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:26.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.115+0000 7f93577fe700 1 -- 172.21.15.8:0/895994475 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c009790 con 0x7f9368101c00 2023-08-11T12:24:26.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.115+0000 7f936cbff700 1 -- 172.21.15.8:0/895994475 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93681a09c0 con 0x7f9368101c00 2023-08-11T12:24:26.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.115+0000 7f93577fe700 1 -- 172.21.15.8:0/895994475 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f935c010430 con 0x7f9368101c00 2023-08-11T12:24:26.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.115+0000 7f93577fe700 1 -- 172.21.15.8:0/895994475 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c018680 con 0x7f9368101c00 2023-08-11T12:24:26.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.115+0000 7f936cbff700 1 -- 172.21.15.8:0/895994475 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93681a0f20 con 0x7f9368101c00 2023-08-11T12:24:26.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.118+0000 7f93577fe700 1 -- 172.21.15.8:0/895994475 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 134670+0+0 (secure 0 0 0) 0x7f935c0105a0 con 0x7f9368101c00 2023-08-11T12:24:26.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.120+0000 7f9380608b80 1 Processor -- start 2023-08-11T12:24:26.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.120+0000 7f9380608b80 1 -- start start 2023-08-11T12:24:26.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.120+0000 7f9380608b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a007764ad0 0x55a007764ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:26.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.120+0000 7f9380608b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a007765430 0x55a0077658b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:26.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.120+0000 7f9380608b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a007765df0 0x55a007766270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:26.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.120+0000 7f9380608b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0076bd630 con 0x55a007765430 2023-08-11T12:24:26.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.120+0000 7f9380608b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0076baf50 con 0x55a007765df0 2023-08-11T12:24:26.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.120+0000 7f9380608b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0076b6840 con 0x55a007764ad0 2023-08-11T12:24:26.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.120+0000 7f93577fe700 1 --2- 172.21.15.8:0/895994475 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f935009ffd0 0x7f93500a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:26.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.120+0000 7f93577fe700 1 -- 172.21.15.8:0/895994475 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f935c014070 con 0x7f9368101c00 2023-08-11T12:24:26.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.120+0000 7f936659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a007765430 0x55a0077658b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:26.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.120+0000 7f9365d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a007765df0 0x55a007766270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:26.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.120+0000 7f9365d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a007765df0 0x55a007766270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:37240/0 (socket says 172.21.15.8:37240) 2023-08-11T12:24:26.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.120+0000 7f9366d9d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a007764ad0 0x55a007764ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:26.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.120+0000 7f9365d9b700 1 -- 172.21.15.8:0/304016326 learned_addr learned my addr 172.21.15.8:0/304016326 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:26.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.121+0000 7f9366d9d700 1 --2- 172.21.15.8:0/895994475 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f935009ffd0 0x7f93500a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:26.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.121+0000 7f936659c700 1 -- 172.21.15.8:0/304016326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a007764ad0 msgr2=0x55a007764ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:26.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.121+0000 7f936659c700 1 --2- 172.21.15.8:0/304016326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a007764ad0 0x55a007764ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.121+0000 7f936659c700 1 -- 172.21.15.8:0/304016326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a007765df0 msgr2=0x55a007766270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:26.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.121+0000 7f936659c700 1 --2- 172.21.15.8:0/304016326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a007765df0 0x55a007766270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.121+0000 7f936659c700 1 -- 172.21.15.8:0/304016326 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a007536630 con 0x55a007765430 2023-08-11T12:24:26.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.121+0000 7f9365d9b700 1 --2- 172.21.15.8:0/304016326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a007765df0 0x55a007766270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:26.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.121+0000 7f936659c700 1 --2- 172.21.15.8:0/304016326 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a007765430 0x55a0077658b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f93580058e0 tx=0x7f9358005ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cc9c581f2945d5 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:26.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.121+0000 7f9366d9d700 1 --2- 172.21.15.8:0/895994475 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f935009ffd0 0x7f93500a2490 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9360009ec0 tx=0x7f936000b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:26.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.121+0000 7f9354ff9700 1 -- 172.21.15.8:0/304016326 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935800ba10 con 0x55a007765430 2023-08-11T12:24:26.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.121+0000 7f9354ff9700 1 -- 172.21.15.8:0/304016326 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f935801e040 con 0x55a007765430 2023-08-11T12:24:26.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.121+0000 7f9354ff9700 1 -- 172.21.15.8:0/304016326 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93580039f0 con 0x55a007765430 2023-08-11T12:24:26.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.122+0000 7f9380608b80 1 -- 172.21.15.8:0/304016326 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a007765430 msgr2=0x55a0077658b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:26.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.122+0000 7f9380608b80 1 --2- 172.21.15.8:0/304016326 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a007765430 0x55a0077658b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f93580058e0 tx=0x7f9358005ec0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.122+0000 7f9380608b80 1 -- 172.21.15.8:0/304016326 shutdown_connections 2023-08-11T12:24:26.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.122+0000 7f9380608b80 1 --2- 172.21.15.8:0/304016326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a007764ad0 0x55a007764ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.122+0000 7f9380608b80 1 --2- 172.21.15.8:0/304016326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a007765df0 0x55a007766270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.122+0000 7f9380608b80 1 --2- 172.21.15.8:0/304016326 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a007765430 0x55a0077658b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.122+0000 7f9380608b80 1 -- 172.21.15.8:0/304016326 >> 172.21.15.8:0/304016326 conn(0x55a007691950 msgr2=0x55a00775f420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:26.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.122+0000 7f9380608b80 1 -- 172.21.15.8:0/304016326 shutdown_connections 2023-08-11T12:24:26.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.122+0000 7f9380608b80 1 -- 172.21.15.8:0/304016326 wait complete. 2023-08-11T12:24:26.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.123+0000 7f9380608b80 1 -- start start 2023-08-11T12:24:26.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.123+0000 7f9380608b80 1 Processor -- start 2023-08-11T12:24:26.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.123+0000 7f9380608b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a007764ad0 0x55a00776e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:26.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.123+0000 7f9380608b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a007765430 0x55a00776e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:26.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.123+0000 7f9380608b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a007765df0 0x55a007775670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:26.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.123+0000 7f9380608b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a007654ac0 con 0x55a007765df0 2023-08-11T12:24:26.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.123+0000 7f9380608b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0076547c0 con 0x55a007765430 2023-08-11T12:24:26.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.123+0000 7f9380608b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a007538920 con 0x55a007764ad0 2023-08-11T12:24:26.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.124+0000 7f9380608b80 10 client.0 _ll_register_callbacks cb 0x55a007657ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:26.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.124+0000 7f9366d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a007765df0 0x55a007775670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:26.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.124+0000 7f9366d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a007765df0 0x55a007775670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46994/0 (socket says 172.21.15.8:46994) 2023-08-11T12:24:26.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.124+0000 7f9366d9d700 1 -- 172.21.15.8:0/2585945983 learned_addr learned my addr 172.21.15.8:0/2585945983 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:26.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.124+0000 7f936659c700 1 --2- 172.21.15.8:0/2585945983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a007764ad0 0x55a00776e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:26.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.124+0000 7f9365d9b700 1 --2- 172.21.15.8:0/2585945983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a007765430 0x55a00776e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:26.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.124+0000 7f9366d9d700 1 -- 172.21.15.8:0/2585945983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a007764ad0 msgr2=0x55a00776e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:26.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.124+0000 7f9366d9d700 1 --2- 172.21.15.8:0/2585945983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a007764ad0 0x55a00776e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.124+0000 7f9366d9d700 1 -- 172.21.15.8:0/2585945983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a007765430 msgr2=0x55a00776e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:26.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.124+0000 7f9366d9d700 1 --2- 172.21.15.8:0/2585945983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a007765430 0x55a00776e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.124+0000 7f9366d9d700 1 -- 172.21.15.8:0/2585945983 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93681a0f20 con 0x55a007765df0 2023-08-11T12:24:26.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.124+0000 7f9365d9b700 1 --2- 172.21.15.8:0/2585945983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a007765430 0x55a00776e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:26.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.124+0000 7f936659c700 1 --2- 172.21.15.8:0/2585945983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a007764ad0 0x55a00776e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:26.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.125+0000 7f9366d9d700 1 --2- 172.21.15.8:0/2585945983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a007765df0 0x55a007775670 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f936001ae00 tx=0x7f9360004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aae29ceb5be1464 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:26.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.125+0000 7f934dffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:24:26.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.125+0000 7f934dffb700 1 -- 172.21.15.8:0/2585945983 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9360022070 con 0x55a007765df0 2023-08-11T12:24:26.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.125+0000 7f9380608b80 1 -- 172.21.15.8:0/2585945983 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a007757a90 con 0x55a007765df0 2023-08-11T12:24:26.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.125+0000 7f934dffb700 1 -- 172.21.15.8:0/2585945983 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f9360003d90 con 0x55a007765df0 2023-08-11T12:24:26.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.125+0000 7f934dffb700 1 -- 172.21.15.8:0/2585945983 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f936000e070 con 0x55a007765df0 2023-08-11T12:24:26.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.125+0000 7f9380608b80 10 client.15558 fetch_fsmap learned FSMap version 27 2023-08-11T12:24:26.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.125+0000 7f9380608b80 1 -- 172.21.15.8:0/2585945983 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f93681097a0 con 0x55a007765df0 2023-08-11T12:24:26.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.126+0000 7f934dffb700 1 -- 172.21.15.8:0/2585945983 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a007757a90 con 0x55a007765df0 2023-08-11T12:24:26.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.126+0000 7f934dffb700 1 -- 172.21.15.8:0/2585945983 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9360007590 con 0x55a007765df0 2023-08-11T12:24:26.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.126+0000 7f9380608b80 10 client.15558 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:24:26.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.126+0000 7f9380608b80 10 client.15558 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:24:26.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.126+0000 7f9380608b80 20 client.15558 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:26.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.126+0000 7f9380608b80 1 --2- 172.21.15.8:0/2585945983 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55a007779ff0 0x55a00777c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:26.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.126+0000 7f9380608b80 4 client.15558 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:24:26.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.126+0000 7f9380608b80 1 -- 172.21.15.8:0/2585945983 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a0077334e0 con 0x55a007779ff0 2023-08-11T12:24:26.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.126+0000 7f936659c700 1 --2- 172.21.15.8:0/2585945983 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55a007779ff0 0x55a00777c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:26.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.127+0000 7f936659c700 1 --2- 172.21.15.8:0/2585945983 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55a007779ff0 0x55a00777c410 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbb509cb665bcba6 server_cookie=8fc5c942c52bd563 in_seq=0 out_seq=0 2023-08-11T12:24:26.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.127+0000 7f934dffb700 10 client.15558 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:24:26.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.127+0000 7f934dffb700 1 -- 172.21.15.8:0/2585945983 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55a0077334e0 con 0x55a007779ff0 2023-08-11T12:24:26.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.128+0000 7f934dffb700 10 client.15558 handle_command_reply: tid=0 2023-08-11T12:24:26.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.128+0000 7f9380608b80 1 client.15558 shutdown 2023-08-11T12:24:26.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.128+0000 7f9380608b80 1 -- 172.21.15.8:0/2585945983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a007765df0 msgr2=0x55a007775670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:26.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.128+0000 7f9380608b80 1 --2- 172.21.15.8:0/2585945983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a007765df0 0x55a007775670 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f936001ae00 tx=0x7f9360004b40 comp rx=0 tx=0).stop 2023-08-11T12:24:26.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.128+0000 7f9380608b80 1 -- 172.21.15.8:0/2585945983 shutdown_connections 2023-08-11T12:24:26.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.128+0000 7f9380608b80 1 --2- 172.21.15.8:0/2585945983 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55a007779ff0 0x55a00777c410 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.128+0000 7f9380608b80 1 --2- 172.21.15.8:0/2585945983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a007764ad0 0x55a00776e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.128+0000 7f9380608b80 1 --2- 172.21.15.8:0/2585945983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a007765df0 0x55a007775670 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.128+0000 7f9380608b80 1 --2- 172.21.15.8:0/2585945983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a007765430 0x55a00776e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.128+0000 7f9380608b80 1 -- 172.21.15.8:0/2585945983 >> 172.21.15.8:0/2585945983 conn(0x55a007691950 msgr2=0x55a007759cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:26.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.128+0000 7f934dffb700 0 client.15558 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:24:26.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.128+0000 7f9380608b80 1 -- 172.21.15.8:0/2585945983 shutdown_connections 2023-08-11T12:24:26.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.128+0000 7f9380608b80 1 -- 172.21.15.8:0/2585945983 wait complete. 2023-08-11T12:24:26.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.128+0000 7f9380608b80 20 client.15558 trim_cache size 0 max 16384 2023-08-11T12:24:26.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:25 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/4218313875' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:24:26.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:25 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2567656850' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:24:26.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:25 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/4218313875' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:24:26.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:25 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2567656850' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:24:26.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.145+0000 7f9380608b80 1 Processor -- start 2023-08-11T12:24:26.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.146+0000 7f9380608b80 1 -- start start 2023-08-11T12:24:26.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.146+0000 7f9380608b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a007764ad0 0x55a007768cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:26.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.146+0000 7f9380608b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a007765430 0x55a0077691f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:26.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.146+0000 7f9380608b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a007765df0 0x55a007775630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:26.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.146+0000 7f9380608b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a00776d670 con 0x55a007765430 2023-08-11T12:24:26.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.146+0000 7f9380608b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a00777c7d0 con 0x55a007765df0 2023-08-11T12:24:26.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.146+0000 7f9380608b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a00775be60 con 0x55a007764ad0 2023-08-11T12:24:26.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.146+0000 7f9365d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a007765430 0x55a0077691f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:26.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.146+0000 7f9365d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a007765430 0x55a0077691f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47004/0 (socket says 172.21.15.8:47004) 2023-08-11T12:24:26.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.146+0000 7f9365d9b700 1 -- 172.21.15.8:0/847121828 learned_addr learned my addr 172.21.15.8:0/847121828 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:26.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.146+0000 7f9366d9d700 1 --2- 172.21.15.8:0/847121828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a007765df0 0x55a007775630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:26.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.146+0000 7f936659c700 1 --2- 172.21.15.8:0/847121828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a007764ad0 0x55a007768cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:26.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.146+0000 7f9365d9b700 1 -- 172.21.15.8:0/847121828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a007764ad0 msgr2=0x55a007768cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:26.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.146+0000 7f9365d9b700 1 --2- 172.21.15.8:0/847121828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a007764ad0 0x55a007768cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.146+0000 7f9365d9b700 1 -- 172.21.15.8:0/847121828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a007765df0 msgr2=0x55a007775630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:26.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.147+0000 7f9365d9b700 1 --2- 172.21.15.8:0/847121828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a007765df0 0x55a007775630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.147+0000 7f9365d9b700 1 -- 172.21.15.8:0/847121828 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0074e2de0 con 0x55a007765430 2023-08-11T12:24:26.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.147+0000 7f9366d9d700 1 --2- 172.21.15.8:0/847121828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a007765df0 0x55a007775630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:26.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.147+0000 7f9365d9b700 1 --2- 172.21.15.8:0/847121828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a007765430 0x55a0077691f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f935c009230 tx=0x7f935c0a7040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3e3ba538855920 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:26.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.147+0000 7f93557fa700 1 -- 172.21.15.8:0/847121828 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c0994c0 con 0x55a007765430 2023-08-11T12:24:26.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.147+0000 7f93557fa700 1 -- 172.21.15.8:0/847121828 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f935c098dc0 con 0x55a007765430 2023-08-11T12:24:26.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.147+0000 7f93557fa700 1 -- 172.21.15.8:0/847121828 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c010880 con 0x55a007765430 2023-08-11T12:24:26.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.148+0000 7f9380608b80 1 -- 172.21.15.8:0/847121828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a007765430 msgr2=0x55a0077691f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:26.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.148+0000 7f9380608b80 1 --2- 172.21.15.8:0/847121828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a007765430 0x55a0077691f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f935c009230 tx=0x7f935c0a7040 comp rx=0 tx=0).stop 2023-08-11T12:24:26.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.148+0000 7f9380608b80 1 -- 172.21.15.8:0/847121828 shutdown_connections 2023-08-11T12:24:26.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.148+0000 7f9380608b80 1 --2- 172.21.15.8:0/847121828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a007764ad0 0x55a007768cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.148+0000 7f9380608b80 1 --2- 172.21.15.8:0/847121828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a007765df0 0x55a007775630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.148+0000 7f9380608b80 1 --2- 172.21.15.8:0/847121828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a007765430 0x55a0077691f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.148+0000 7f9380608b80 1 -- 172.21.15.8:0/847121828 >> 172.21.15.8:0/847121828 conn(0x55a007691950 msgr2=0x55a00776c170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:26.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.148+0000 7f9380608b80 1 -- 172.21.15.8:0/847121828 shutdown_connections 2023-08-11T12:24:26.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.148+0000 7f9380608b80 1 -- 172.21.15.8:0/847121828 wait complete. 2023-08-11T12:24:26.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.148+0000 7f9380608b80 1 -- start start 2023-08-11T12:24:26.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.148+0000 7f9380608b80 1 Processor -- start 2023-08-11T12:24:26.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.149+0000 7f9380608b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a007764ad0 0x55a0077751b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:26.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.149+0000 7f9380608b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a007765430 0x55a0077756f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:26.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.149+0000 7f9380608b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a007765df0 0x55a007771d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:26.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.149+0000 7f9380608b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a007772420 con 0x55a007764ad0 2023-08-11T12:24:26.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.149+0000 7f9380608b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a007772590 con 0x55a007765df0 2023-08-11T12:24:26.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.149+0000 7f9380608b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a007772750 con 0x55a007765430 2023-08-11T12:24:26.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.149+0000 7f9380608b80 10 client.0 _ll_register_callbacks cb 0x7f9360008d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:26.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.149+0000 7f936659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a007764ad0 0x55a0077751b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:26.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.149+0000 7f9366d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a007765df0 0x55a007771d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:26.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.149+0000 7f9366d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a007765df0 0x55a007771d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:37280/0 (socket says 172.21.15.8:37280) 2023-08-11T12:24:26.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.149+0000 7f9366d9d700 1 -- 172.21.15.8:0/2637823538 learned_addr learned my addr 172.21.15.8:0/2637823538 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:26.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.149+0000 7f9365d9b700 1 --2- 172.21.15.8:0/2637823538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a007765430 0x55a0077756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:26.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.149+0000 7f936659c700 1 -- 172.21.15.8:0/2637823538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a007765430 msgr2=0x55a0077756f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:26.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.149+0000 7f936659c700 1 --2- 172.21.15.8:0/2637823538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a007765430 0x55a0077756f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.149+0000 7f936659c700 1 -- 172.21.15.8:0/2637823538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a007765df0 msgr2=0x55a007771d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:26.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.149+0000 7f936659c700 1 --2- 172.21.15.8:0/2637823538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a007765df0 0x55a007771d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.149+0000 7f936659c700 1 -- 172.21.15.8:0/2637823538 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93681097a0 con 0x55a007764ad0 2023-08-11T12:24:26.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.149+0000 7f9366d9d700 1 --2- 172.21.15.8:0/2637823538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a007765df0 0x55a007771d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:26.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.149+0000 7f9365d9b700 1 --2- 172.21.15.8:0/2637823538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a007765430 0x55a0077756f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:26.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.150+0000 7f936659c700 1 --2- 172.21.15.8:0/2637823538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a007764ad0 0x55a0077751b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9358000c00 tx=0x7f9358005940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8dc9ed0d50f71d server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:26.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.150+0000 7f934dffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:24:26.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.150+0000 7f934dffb700 1 -- 172.21.15.8:0/2637823538 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9358031e90 con 0x55a007764ad0 2023-08-11T12:24:26.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.150+0000 7f934dffb700 1 -- 172.21.15.8:0/2637823538 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f93580310c0 con 0x55a007764ad0 2023-08-11T12:24:26.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.150+0000 7f9380608b80 1 -- 172.21.15.8:0/2637823538 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f935801e040 con 0x55a007764ad0 2023-08-11T12:24:26.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.150+0000 7f934dffb700 1 -- 172.21.15.8:0/2637823538 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93580312a0 con 0x55a007764ad0 2023-08-11T12:24:26.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.150+0000 7f9380608b80 10 client.15564 fetch_fsmap learned FSMap version 27 2023-08-11T12:24:26.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.150+0000 7f9380608b80 1 -- 172.21.15.8:0/2637823538 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f93681a09c0 con 0x55a007764ad0 2023-08-11T12:24:26.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.150+0000 7f934dffb700 1 -- 172.21.15.8:0/2637823538 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f935801e040 con 0x55a007764ad0 2023-08-11T12:24:26.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.151+0000 7f934dffb700 1 -- 172.21.15.8:0/2637823538 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9358003bb0 con 0x55a007764ad0 2023-08-11T12:24:26.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.151+0000 7f9380608b80 10 client.15564 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:24:26.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.151+0000 7f9380608b80 10 client.15564 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:24:26.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.151+0000 7f9380608b80 20 client.15564 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:26.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.151+0000 7f9380608b80 1 --2- 172.21.15.8:0/2637823538 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55a0077cf000 0x55a0077d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:26.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.151+0000 7f9380608b80 4 client.15564 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:24:26.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.151+0000 7f9380608b80 1 -- 172.21.15.8:0/2637823538 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a0076af820 con 0x55a0077cf000 2023-08-11T12:24:26.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.151+0000 7f9365d9b700 1 --2- 172.21.15.8:0/2637823538 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55a0077cf000 0x55a0077d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:26.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.152+0000 7f9365d9b700 1 --2- 172.21.15.8:0/2637823538 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55a0077cf000 0x55a0077d1420 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c568bc332897dab9 server_cookie=bfeb209dcbab19b9 in_seq=0 out_seq=0 2023-08-11T12:24:26.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.152+0000 7f934dffb700 10 client.15564 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:24:26.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.152+0000 7f934dffb700 1 -- 172.21.15.8:0/2637823538 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55a0076af820 con 0x55a0077cf000 2023-08-11T12:24:26.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.152+0000 7f934dffb700 10 client.15564 handle_command_reply: tid=0 2023-08-11T12:24:26.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.152+0000 7f9380608b80 1 client.15564 shutdown 2023-08-11T12:24:26.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.152+0000 7f9380608b80 1 -- 172.21.15.8:0/2637823538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a007764ad0 msgr2=0x55a0077751b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:26.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.152+0000 7f9380608b80 1 --2- 172.21.15.8:0/2637823538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a007764ad0 0x55a0077751b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9358000c00 tx=0x7f9358005940 comp rx=0 tx=0).stop 2023-08-11T12:24:26.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.152+0000 7f9380608b80 1 -- 172.21.15.8:0/2637823538 shutdown_connections 2023-08-11T12:24:26.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.152+0000 7f9380608b80 1 --2- 172.21.15.8:0/2637823538 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55a0077cf000 0x55a0077d1420 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.152+0000 7f9380608b80 1 --2- 172.21.15.8:0/2637823538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a007765df0 0x55a007771d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.152+0000 7f9380608b80 1 --2- 172.21.15.8:0/2637823538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a007764ad0 0x55a0077751b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.152+0000 7f9380608b80 1 --2- 172.21.15.8:0/2637823538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a007765430 0x55a0077756f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.152+0000 7f934dffb700 0 client.15564 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:24:26.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.152+0000 7f9380608b80 1 -- 172.21.15.8:0/2637823538 >> 172.21.15.8:0/2637823538 conn(0x55a007691950 msgr2=0x55a00776c170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:26.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.152+0000 7f9380608b80 1 -- 172.21.15.8:0/2637823538 shutdown_connections 2023-08-11T12:24:26.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.152+0000 7f9380608b80 1 -- 172.21.15.8:0/2637823538 wait complete. 2023-08-11T12:24:26.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.152+0000 7f9380608b80 20 client.15564 trim_cache size 0 max 16384 2023-08-11T12:24:26.163 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:24:26.164 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-11T12:24:26.164 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:24:26.164 INFO:teuthology.orchestra.run.smithi008.stdout: "fe1dfb4c-68fe-4dca-a6fc-a370ddfcec9a": { 2023-08-11T12:24:26.164 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:24:26.164 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "fe1dfb4c-68fe-4dca-a6fc-a370ddfcec9a", 2023-08-11T12:24:26.164 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:24:26.164 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:24:26.164 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:24:26.165 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:24:26.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.153+0000 7f936cbff700 1 -- 172.21.15.8:0/895994475 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f935009ffd0 msgr2=0x7f93500a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:26.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.153+0000 7f936cbff700 1 --2- 172.21.15.8:0/895994475 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f935009ffd0 0x7f93500a2490 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9360009ec0 tx=0x7f936000b040 comp rx=0 tx=0).stop 2023-08-11T12:24:26.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.153+0000 7f936cbff700 1 -- 172.21.15.8:0/895994475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9368101c00 msgr2=0x7f9368198dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:26.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.153+0000 7f936cbff700 1 --2- 172.21.15.8:0/895994475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9368101c00 0x7f9368198dd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f935c00e9a0 tx=0x7f935c00ecb0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.153+0000 7f936cbff700 1 -- 172.21.15.8:0/895994475 shutdown_connections 2023-08-11T12:24:26.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.153+0000 7f936cbff700 1 --2- 172.21.15.8:0/895994475 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f935009ffd0 0x7f93500a2490 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.153+0000 7f936cbff700 1 --2- 172.21.15.8:0/895994475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9368100a10 0x7f9368198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.153+0000 7f936cbff700 1 --2- 172.21.15.8:0/895994475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93681025a0 0x7f936819fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.153+0000 7f936cbff700 1 --2- 172.21.15.8:0/895994475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9368101c00 0x7f9368198dd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.153+0000 7f936cbff700 1 -- 172.21.15.8:0/895994475 >> 172.21.15.8:0/895994475 conn(0x7f93680fbf80 msgr2=0x7f93681074e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:26.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.153+0000 7f936cbff700 1 -- 172.21.15.8:0/895994475 shutdown_connections 2023-08-11T12:24:26.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.153+0000 7f936cbff700 1 -- 172.21.15.8:0/895994475 wait complete. 2023-08-11T12:24:26.172 INFO:tasks.cephfs.filesystem:scrub status for tag:fe1dfb4c-68fe-4dca-a6fc-a370ddfcec9a - {'path': '/', 'tag': 'fe1dfb4c-68fe-4dca-a6fc-a370ddfcec9a', 'options': 'recursive,force'} 2023-08-11T12:24:26.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.744+0000 7f9e5a7fc700 1 -- 172.21.15.8:0/2266363507 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mgrmap(e 17) v1 ==== 134687+0+0 (secure 0 0 0) 0x7f9e60095760 con 0x7f9e641013c0 2023-08-11T12:24:26.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.745+0000 7f9e5a7fc700 1 -- 172.21.15.8:0/2266363507 <== mon.1 v2:172.21.15.194:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v17) v1 ==== 92+0+0 (secure 0 0 0) 0x7f9e60062260 con 0x7f9e641013c0 2023-08-11T12:24:26.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.747+0000 7f9e6b3ff700 1 -- 172.21.15.8:0/2266363507 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9e5009ffd0 msgr2=0x7f9e500a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:26.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.747+0000 7f9e6b3ff700 1 --2- 172.21.15.8:0/2266363507 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9e5009ffd0 0x7f9e500a2490 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400b2e0 tx=0x7f9e54020040 comp rx=0 tx=0).stop 2023-08-11T12:24:26.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.747+0000 7f9e6b3ff700 1 -- 172.21.15.8:0/2266363507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e641013c0 msgr2=0x7f9e64196660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:26.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.747+0000 7f9e6b3ff700 1 --2- 172.21.15.8:0/2266363507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e641013c0 0x7f9e64196660 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9e6000eb30 tx=0x7f9e6000ee40 comp rx=0 tx=0).stop 2023-08-11T12:24:26.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.747+0000 7f9e6b3ff700 1 -- 172.21.15.8:0/2266363507 shutdown_connections 2023-08-11T12:24:26.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.747+0000 7f9e6b3ff700 1 --2- 172.21.15.8:0/2266363507 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f9e5009ffd0 0x7f9e500a2490 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.747+0000 7f9e6b3ff700 1 --2- 172.21.15.8:0/2266363507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e641013c0 0x7f9e64196660 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.747+0000 7f9e6b3ff700 1 --2- 172.21.15.8:0/2266363507 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e64106620 0x7f9e6419dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.747+0000 7f9e6b3ff700 1 --2- 172.21.15.8:0/2266363507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e64103cf0 0x7f9e64196ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.747+0000 7f9e6b3ff700 1 -- 172.21.15.8:0/2266363507 >> 172.21.15.8:0/2266363507 conn(0x7f9e640fadb0 msgr2=0x7f9e641020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:26.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.747+0000 7f9e6b3ff700 1 -- 172.21.15.8:0/2266363507 shutdown_connections 2023-08-11T12:24:26.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.747+0000 7f9e6b3ff700 1 -- 172.21.15.8:0/2266363507 wait complete. 2023-08-11T12:24:26.769 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2023-08-11T12:24:26.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.989+0000 7fe3f0dff700 1 -- 172.21.15.8:0/3642392332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3ec074960 msgr2=0x7fe3ec072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:26.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.989+0000 7fe3f0dff700 1 --2- 172.21.15.8:0/3642392332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3ec074960 0x7fe3ec072db0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc0098f0 tx=0x7fe3dc009c00 comp rx=0 tx=0).stop 2023-08-11T12:24:26.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.989+0000 7fe3f0dff700 1 -- 172.21.15.8:0/3642392332 shutdown_connections 2023-08-11T12:24:26.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.989+0000 7fe3f0dff700 1 --2- 172.21.15.8:0/3642392332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3ec074960 0x7fe3ec072db0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.989+0000 7fe3f0dff700 1 --2- 172.21.15.8:0/3642392332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3ec10cf20 0x7fe3ec10f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.989+0000 7fe3f0dff700 1 --2- 172.21.15.8:0/3642392332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3ec073380 0x7fe3ec073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.989+0000 7fe3f0dff700 1 -- 172.21.15.8:0/3642392332 >> 172.21.15.8:0/3642392332 conn(0x7fe3ec0fbea0 msgr2=0x7fe3ec0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:26.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.989+0000 7fe3f0dff700 1 -- 172.21.15.8:0/3642392332 shutdown_connections 2023-08-11T12:24:26.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.989+0000 7fe3f0dff700 1 -- 172.21.15.8:0/3642392332 wait complete. 2023-08-11T12:24:26.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.990+0000 7fe3f0dff700 1 Processor -- start 2023-08-11T12:24:26.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.990+0000 7fe3f0dff700 1 -- start start 2023-08-11T12:24:26.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.990+0000 7fe3f0dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3ec073380 0x7fe3ec19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:26.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.990+0000 7fe3f0dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3ec074960 0x7fe3ec19d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:26.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.990+0000 7fe3f0dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3ec10cf20 0x7fe3ec1a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:26.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.990+0000 7fe3f0dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ec1a4810 con 0x7fe3ec10cf20 2023-08-11T12:24:26.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.990+0000 7fe3f0dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ec1a4980 con 0x7fe3ec074960 2023-08-11T12:24:26.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.990+0000 7fe3f0dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ec1a4b40 con 0x7fe3ec073380 2023-08-11T12:24:26.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.991+0000 7fe3ea59c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3ec073380 0x7fe3ec19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:26.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.991+0000 7fe3e9d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3ec074960 0x7fe3ec19d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:26.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.991+0000 7fe3ea59c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3ec073380 0x7fe3ec19cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:52900/0 (socket says 172.21.15.8:52900) 2023-08-11T12:24:26.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.991+0000 7fe3ea59c700 1 -- 172.21.15.8:0/531499214 learned_addr learned my addr 172.21.15.8:0/531499214 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:26.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.991+0000 7fe3ead9d700 1 --2- 172.21.15.8:0/531499214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3ec10cf20 0x7fe3ec1a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:26.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.991+0000 7fe3ea59c700 1 -- 172.21.15.8:0/531499214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3ec074960 msgr2=0x7fe3ec19d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:26.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.991+0000 7fe3ea59c700 1 --2- 172.21.15.8:0/531499214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3ec074960 0x7fe3ec19d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.991+0000 7fe3ea59c700 1 -- 172.21.15.8:0/531499214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3ec10cf20 msgr2=0x7fe3ec1a4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:26.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.991+0000 7fe3ea59c700 1 --2- 172.21.15.8:0/531499214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3ec10cf20 0x7fe3ec1a4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:26.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.991+0000 7fe3ea59c700 1 -- 172.21.15.8:0/531499214 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3dc009520 con 0x7fe3ec073380 2023-08-11T12:24:26.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.991+0000 7fe3ead9d700 1 --2- 172.21.15.8:0/531499214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3ec10cf20 0x7fe3ec1a4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:24:26.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.991+0000 7fe3ea59c700 1 --2- 172.21.15.8:0/531499214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3ec073380 0x7fe3ec19cca0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009fd0 tx=0x7fe3dc00b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:26.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.991+0000 7fe3db7fe700 1 -- 172.21.15.8:0/531499214 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc01c070 con 0x7fe3ec073380 2023-08-11T12:24:26.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.992+0000 7fe3db7fe700 1 -- 172.21.15.8:0/531499214 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe3dc00f7d0 con 0x7fe3ec073380 2023-08-11T12:24:26.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.992+0000 7fe3f0dff700 1 -- 172.21.15.8:0/531499214 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3ec1a4dc0 con 0x7fe3ec073380 2023-08-11T12:24:26.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.992+0000 7fe3db7fe700 1 -- 172.21.15.8:0/531499214 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc004b10 con 0x7fe3ec073380 2023-08-11T12:24:26.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.992+0000 7fe3f0dff700 1 -- 172.21.15.8:0/531499214 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3ec1a5190 con 0x7fe3ec073380 2023-08-11T12:24:26.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.993+0000 7fe3f0dff700 1 -- 172.21.15.8:0/531499214 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3ec102a70 con 0x7fe3ec073380 2023-08-11T12:24:26.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.995+0000 7fe3db7fe700 1 -- 172.21.15.8:0/531499214 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 17) v1 ==== 134687+0+0 (secure 0 0 0) 0x7fe3dc020070 con 0x7fe3ec073380 2023-08-11T12:24:26.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.996+0000 7fe3db7fe700 1 --2- 172.21.15.8:0/531499214 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe3d40a0020 0x7fe3d40a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:26.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.996+0000 7fe3db7fe700 1 -- 172.21.15.8:0/531499214 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fe3dc0cc1f0 con 0x7fe3ec073380 2023-08-11T12:24:26.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.996+0000 7fe3e9d9b700 1 -- 172.21.15.8:0/531499214 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe3d40a0020 msgr2=0x7fe3d40a24e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2041276411 2023-08-11T12:24:26.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:26.996+0000 7fe3e9d9b700 1 --2- 172.21.15.8:0/531499214 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe3d40a0020 0x7fe3d40a24e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-11T12:24:27.000 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:26 smithi194 ceph-mon[130905]: scrub queued for path: / 2023-08-11T12:24:27.000 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:26 smithi194 ceph-mon[130905]: scrub summary: idle+waiting paths [/] 2023-08-11T12:24:27.000 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:26 smithi194 ceph-mon[130905]: scrub summary: active paths [/] 2023-08-11T12:24:27.000 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:26 smithi194 ceph-mon[130905]: scrub summary: idle+waiting paths [/] 2023-08-11T12:24:27.001 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:26 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2266363507' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-08-11T12:24:27.001 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:26 smithi194 ceph-mon[130905]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-08-11T12:24:27.001 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:26 smithi194 ceph-mon[130905]: pgmap v347: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 10 op/s 2023-08-11T12:24:27.001 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:24:26 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: ignoring --setuser ceph since I am not root 2023-08-11T12:24:27.002 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:24:26 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: ignoring --setgroup ceph since I am not root 2023-08-11T12:24:27.002 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:24:26 smithi194 ceph-mgr[132851]: -- 172.21.15.194:0/633196880 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b9f13691e0 con 0x55b9f133ec00 2023-08-11T12:24:27.002 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:24:26 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:24:26.915+0000 7f6e83e2f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-11T12:24:27.002 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:24:26 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:24:26.997+0000 7f6e83e2f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-11T12:24:27.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.001+0000 7fe3db7fe700 1 -- 172.21.15.8:0/531499214 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fe3dc05cc30 con 0x7fe3ec073380 2023-08-11T12:24:27.042 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:24:26 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: ignoring --setuser ceph since I am not root 2023-08-11T12:24:27.043 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:24:26 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: ignoring --setgroup ceph since I am not root 2023-08-11T12:24:27.043 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:24:26 smithi045 ceph-mgr[131769]: -- 172.21.15.45:0/1757945322 <== mon.2 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55cfde35b1e0 con 0x55cfde330c00 2023-08-11T12:24:27.043 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:24:26 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:24:26.942+0000 7ffa04bd6200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-11T12:24:27.043 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:24:27 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:24:27.040+0000 7ffa04bd6200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-11T12:24:27.044 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:26 smithi045 ceph-mon[130284]: scrub queued for path: / 2023-08-11T12:24:27.044 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:26 smithi045 ceph-mon[130284]: scrub summary: idle+waiting paths [/] 2023-08-11T12:24:27.044 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:26 smithi045 ceph-mon[130284]: scrub summary: active paths [/] 2023-08-11T12:24:27.044 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:26 smithi045 ceph-mon[130284]: scrub summary: idle+waiting paths [/] 2023-08-11T12:24:27.044 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:26 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2266363507' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-08-11T12:24:27.044 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:26 smithi045 ceph-mon[130284]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-08-11T12:24:27.045 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:26 smithi045 ceph-mon[130284]: pgmap v347: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 10 op/s 2023-08-11T12:24:27.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:26 smithi008 ceph-mon[97158]: scrub queued for path: / 2023-08-11T12:24:27.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:26 smithi008 ceph-mon[97158]: scrub summary: idle+waiting paths [/] 2023-08-11T12:24:27.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:26 smithi008 ceph-mon[97158]: scrub summary: active paths [/] 2023-08-11T12:24:27.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:26 smithi008 ceph-mon[97158]: scrub summary: idle+waiting paths [/] 2023-08-11T12:24:27.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:26 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2266363507' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-08-11T12:24:27.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:26 smithi008 ceph-mon[97158]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-08-11T12:24:27.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:26 smithi008 ceph-mon[97158]: pgmap v347: 129 pgs: 129 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 10 op/s 2023-08-11T12:24:27.054 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:26 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: ignoring --setuser ceph since I am not root 2023-08-11T12:24:27.055 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:26 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: ignoring --setgroup ceph since I am not root 2023-08-11T12:24:27.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.197+0000 7fe3e9d9b700 1 -- 172.21.15.8:0/531499214 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe3d40a0020 msgr2=0x7fe3d40a24e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2041276411 2023-08-11T12:24:27.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.197+0000 7fe3e9d9b700 1 --2- 172.21.15.8:0/531499214 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe3d40a0020 0x7fe3d40a24e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-11T12:24:27.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.241+0000 7fe3f0dff700 1 -- 172.21.15.8:0/531499214 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fe3ec112790 con 0x7fe3ec073380 2023-08-11T12:24:27.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.246+0000 7fe3db7fe700 1 -- 172.21.15.8:0/531499214 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe3dc095ca0 con 0x7fe3ec073380 2023-08-11T12:24:27.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.249+0000 7fe3f0dff700 1 -- 172.21.15.8:0/531499214 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe3d40a0020 msgr2=0x7fe3d40a24e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-11T12:24:27.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.249+0000 7fe3f0dff700 1 --2- 172.21.15.8:0/531499214 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe3d40a0020 0x7fe3d40a24e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:27.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.249+0000 7fe3f0dff700 1 -- 172.21.15.8:0/531499214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3ec073380 msgr2=0x7fe3ec19cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:27.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.249+0000 7fe3f0dff700 1 --2- 172.21.15.8:0/531499214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3ec073380 0x7fe3ec19cca0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009fd0 tx=0x7fe3dc00b840 comp rx=0 tx=0).stop 2023-08-11T12:24:27.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.249+0000 7fe3f0dff700 1 -- 172.21.15.8:0/531499214 shutdown_connections 2023-08-11T12:24:27.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.249+0000 7fe3f0dff700 1 --2- 172.21.15.8:0/531499214 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7fe3d40a0020 0x7fe3d40a24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:27.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.249+0000 7fe3f0dff700 1 --2- 172.21.15.8:0/531499214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3ec073380 0x7fe3ec19cca0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:27.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.249+0000 7fe3f0dff700 1 --2- 172.21.15.8:0/531499214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3ec10cf20 0x7fe3ec1a4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:27.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.249+0000 7fe3f0dff700 1 --2- 172.21.15.8:0/531499214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3ec074960 0x7fe3ec19d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:27.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.249+0000 7fe3f0dff700 1 -- 172.21.15.8:0/531499214 >> 172.21.15.8:0/531499214 conn(0x7fe3ec0fbea0 msgr2=0x7fe3ec0fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:27.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.249+0000 7fe3f0dff700 1 -- 172.21.15.8:0/531499214 shutdown_connections 2023-08-11T12:24:27.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.249+0000 7fe3f0dff700 1 -- 172.21.15.8:0/531499214 wait complete. 2023-08-11T12:24:27.271 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2023-08-11T12:24:27.343 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:27 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:27.055+0000 7fed6c8cf200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-11T12:24:27.343 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:27 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:27.168+0000 7fed6c8cf200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-11T12:24:27.344 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:27 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:27.297+0000 7fed6c8cf200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-11T12:24:27.353 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:24:27 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:24:27.088+0000 7f6e83e2f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-11T12:24:27.354 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:24:27 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:24:27.181+0000 7f6e83e2f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-11T12:24:27.354 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:24:27 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:24:27.351+0000 7f6e83e2f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-11T12:24:27.395 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:24:27 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:24:27.149+0000 7ffa04bd6200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-11T12:24:27.395 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:24:27 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:24:27.265+0000 7ffa04bd6200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-11T12:24:27.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.489+0000 7f14e0bff700 1 -- 172.21.15.8:0/4080427765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14dc0ff840 msgr2=0x7f14dc0ffc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:27.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.489+0000 7f14e0bff700 1 --2- 172.21.15.8:0/4080427765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14dc0ff840 0x7f14dc0ffc60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f14cc009990 tx=0x7f14cc009ca0 comp rx=0 tx=0).stop 2023-08-11T12:24:27.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.489+0000 7f14e0bff700 1 -- 172.21.15.8:0/4080427765 shutdown_connections 2023-08-11T12:24:27.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.489+0000 7f14e0bff700 1 --2- 172.21.15.8:0/4080427765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14dc0ff840 0x7f14dc0ffc60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:27.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.489+0000 7f14e0bff700 1 --2- 172.21.15.8:0/4080427765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14dc1013d0 0x7f14dc107c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:27.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.489+0000 7f14e0bff700 1 --2- 172.21.15.8:0/4080427765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14dc100a30 0x7f14dc100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:27.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.489+0000 7f14e0bff700 1 -- 172.21.15.8:0/4080427765 >> 172.21.15.8:0/4080427765 conn(0x7f14dc0fadb0 msgr2=0x7f14dc0fd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:27.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.489+0000 7f14e0bff700 1 -- 172.21.15.8:0/4080427765 shutdown_connections 2023-08-11T12:24:27.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.490+0000 7f14e0bff700 1 -- 172.21.15.8:0/4080427765 wait complete. 2023-08-11T12:24:27.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.491+0000 7f14e0bff700 1 Processor -- start 2023-08-11T12:24:27.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.491+0000 7f14e0bff700 1 -- start start 2023-08-11T12:24:27.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.492+0000 7f14e0bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14dc0ff840 0x7f14dc196660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:27.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.492+0000 7f14e0bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14dc100a30 0x7f14dc196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:27.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.492+0000 7f14e0bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14dc1013d0 0x7f14dc19dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:27.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.492+0000 7f14e0bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc19e1e0 con 0x7f14dc1013d0 2023-08-11T12:24:27.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.492+0000 7f14e0bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc19e320 con 0x7f14dc100a30 2023-08-11T12:24:27.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.492+0000 7f14e0bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc19e4b0 con 0x7f14dc0ff840 2023-08-11T12:24:27.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.492+0000 7f14da59c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14dc0ff840 0x7f14dc196660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:27.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.492+0000 7f14da59c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14dc0ff840 0x7f14dc196660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:52908/0 (socket says 172.21.15.8:52908) 2023-08-11T12:24:27.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.492+0000 7f14da59c700 1 -- 172.21.15.8:0/1572611936 learned_addr learned my addr 172.21.15.8:0/1572611936 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:27.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.492+0000 7f14d9d9b700 1 --2- 172.21.15.8:0/1572611936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14dc100a30 0x7f14dc196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:27.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.492+0000 7f14dad9d700 1 --2- 172.21.15.8:0/1572611936 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14dc1013d0 0x7f14dc19dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:27.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.492+0000 7f14da59c700 1 -- 172.21.15.8:0/1572611936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14dc100a30 msgr2=0x7f14dc196ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:27.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.492+0000 7f14da59c700 1 --2- 172.21.15.8:0/1572611936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14dc100a30 0x7f14dc196ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:27.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.492+0000 7f14da59c700 1 -- 172.21.15.8:0/1572611936 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14dc1013d0 msgr2=0x7f14dc19dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:27.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.492+0000 7f14da59c700 1 --2- 172.21.15.8:0/1572611936 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14dc1013d0 0x7f14dc19dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:27.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.493+0000 7f14da59c700 1 -- 172.21.15.8:0/1572611936 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d0009520 con 0x7f14dc0ff840 2023-08-11T12:24:27.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.493+0000 7f14da59c700 1 --2- 172.21.15.8:0/1572611936 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14dc0ff840 0x7f14dc196660 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f14cc004710 tx=0x7f14cc009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:27.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.493+0000 7f14cb7fe700 1 -- 172.21.15.8:0/1572611936 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc01d070 con 0x7f14dc0ff840 2023-08-11T12:24:27.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.493+0000 7f14cb7fe700 1 -- 172.21.15.8:0/1572611936 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14cc021410 con 0x7f14dc0ff840 2023-08-11T12:24:27.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.493+0000 7f14cb7fe700 1 -- 172.21.15.8:0/1572611936 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc017650 con 0x7f14dc0ff840 2023-08-11T12:24:27.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.493+0000 7f14e0bff700 1 -- 172.21.15.8:0/1572611936 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14cc0095f0 con 0x7f14dc0ff840 2023-08-11T12:24:27.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.493+0000 7f14e0bff700 1 -- 172.21.15.8:0/1572611936 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14dc108860 con 0x7f14dc0ff840 2023-08-11T12:24:27.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.494+0000 7f14e0bff700 1 -- 172.21.15.8:0/1572611936 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14dc106dd0 con 0x7f14dc0ff840 2023-08-11T12:24:27.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.496+0000 7f14cb7fe700 1 -- 172.21.15.8:0/1572611936 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 17) v1 ==== 134687+0+0 (secure 0 0 0) 0x7f14cc021580 con 0x7f14dc0ff840 2023-08-11T12:24:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.497+0000 7f14cb7fe700 1 --2- 172.21.15.8:0/1572611936 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f14c40a0020 0x7f14c40a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.498+0000 7f14cb7fe700 1 -- 172.21.15.8:0/1572611936 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f14cc0cc970 con 0x7f14dc0ff840 2023-08-11T12:24:27.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.498+0000 7f14d9d9b700 1 -- 172.21.15.8:0/1572611936 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f14c40a0020 msgr2=0x7f14c40a24e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2041276411 2023-08-11T12:24:27.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.498+0000 7f14d9d9b700 1 --2- 172.21.15.8:0/1572611936 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f14c40a0020 0x7f14c40a24e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-11T12:24:27.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.501+0000 7f14cb7fe700 1 -- 172.21.15.8:0/1572611936 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f14cc096420 con 0x7f14dc0ff840 2023-08-11T12:24:27.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.699+0000 7f14d9d9b700 1 -- 172.21.15.8:0/1572611936 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f14c40a0020 msgr2=0x7f14c40a24e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2041276411 2023-08-11T12:24:27.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.699+0000 7f14d9d9b700 1 --2- 172.21.15.8:0/1572611936 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f14c40a0020 0x7f14c40a24e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-11T12:24:27.702 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:27 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:27.440+0000 7fed6c8cf200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-11T12:24:27.702 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:27 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:27.700+0000 7fed6c8cf200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-11T12:24:27.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.720+0000 7f14e0bff700 1 -- 172.21.15.8:0/1572611936 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f14dc10c220 con 0x7f14dc0ff840 2023-08-11T12:24:27.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.725+0000 7f14cb7fe700 1 -- 172.21.15.8:0/1572611936 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v24)=0 v24) v1 ==== 133+0+0 (secure 0 0 0) 0x7f14cc099a40 con 0x7f14dc0ff840 2023-08-11T12:24:27.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.728+0000 7f14e0bff700 1 -- 172.21.15.8:0/1572611936 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f14c40a0020 msgr2=0x7f14c40a24e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-11T12:24:27.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.728+0000 7f14e0bff700 1 --2- 172.21.15.8:0/1572611936 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f14c40a0020 0x7f14c40a24e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:27.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.728+0000 7f14e0bff700 1 -- 172.21.15.8:0/1572611936 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14dc0ff840 msgr2=0x7f14dc196660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:27.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.728+0000 7f14e0bff700 1 --2- 172.21.15.8:0/1572611936 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14dc0ff840 0x7f14dc196660 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f14cc004710 tx=0x7f14cc009580 comp rx=0 tx=0).stop 2023-08-11T12:24:27.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.728+0000 7f14e0bff700 1 -- 172.21.15.8:0/1572611936 shutdown_connections 2023-08-11T12:24:27.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.728+0000 7f14e0bff700 1 --2- 172.21.15.8:0/1572611936 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f14c40a0020 0x7f14c40a24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:27.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.728+0000 7f14e0bff700 1 --2- 172.21.15.8:0/1572611936 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14dc0ff840 0x7f14dc196660 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:27.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.728+0000 7f14e0bff700 1 --2- 172.21.15.8:0/1572611936 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14dc1013d0 0x7f14dc19dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:27.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.728+0000 7f14e0bff700 1 --2- 172.21.15.8:0/1572611936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14dc100a30 0x7f14dc196ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:27.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.728+0000 7f14e0bff700 1 -- 172.21.15.8:0/1572611936 >> 172.21.15.8:0/1572611936 conn(0x7f14dc0fadb0 msgr2=0x7f14dc103f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:27.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.728+0000 7f14e0bff700 1 -- 172.21.15.8:0/1572611936 shutdown_connections 2023-08-11T12:24:27.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.728+0000 7f14e0bff700 1 -- 172.21.15.8:0/1572611936 wait complete. 2023-08-11T12:24:27.737 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:24:27 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:24:27.473+0000 7ffa04bd6200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-11T12:24:27.754 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1M' 2023-08-11T12:24:27.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.968+0000 7f5e40dff700 1 -- 172.21.15.8:0/2657742241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e3c10cf20 msgr2=0x7f5e3c10f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:27.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.968+0000 7f5e40dff700 1 --2- 172.21.15.8:0/2657742241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e3c10cf20 0x7f5e3c10f310 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400b0a0 tx=0x7f5e3400b3b0 comp rx=0 tx=0).stop 2023-08-11T12:24:27.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.969+0000 7f5e40dff700 1 -- 172.21.15.8:0/2657742241 shutdown_connections 2023-08-11T12:24:27.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.969+0000 7f5e40dff700 1 --2- 172.21.15.8:0/2657742241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e3c10cf20 0x7f5e3c10f310 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:27.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.969+0000 7f5e40dff700 1 --2- 172.21.15.8:0/2657742241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e3c074960 0x7f5e3c072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:27.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.969+0000 7f5e40dff700 1 --2- 172.21.15.8:0/2657742241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e3c073380 0x7f5e3c073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:27.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.969+0000 7f5e40dff700 1 -- 172.21.15.8:0/2657742241 >> 172.21.15.8:0/2657742241 conn(0x7f5e3c0fbee0 msgr2=0x7f5e3c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:27.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.969+0000 7f5e40dff700 1 -- 172.21.15.8:0/2657742241 shutdown_connections 2023-08-11T12:24:27.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.969+0000 7f5e40dff700 1 -- 172.21.15.8:0/2657742241 wait complete. 2023-08-11T12:24:27.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.970+0000 7f5e40dff700 1 Processor -- start 2023-08-11T12:24:27.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.970+0000 7f5e40dff700 1 -- start start 2023-08-11T12:24:27.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.971+0000 7f5e40dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e3c073380 0x7f5e3c19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:27.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.971+0000 7f5e40dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e3c074960 0x7f5e3c19d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:27.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.971+0000 7f5e40dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e3c10cf20 0x7f5e3c1a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:27.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.971+0000 7f5e40dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c1a4890 con 0x7f5e3c074960 2023-08-11T12:24:27.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.971+0000 7f5e40dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c1a4a00 con 0x7f5e3c073380 2023-08-11T12:24:27.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.971+0000 7f5e40dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c1a4bc0 con 0x7f5e3c10cf20 2023-08-11T12:24:27.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.971+0000 7f5e3a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e3c073380 0x7f5e3c19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:27.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.971+0000 7f5e3a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e3c073380 0x7f5e3c19cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:55084/0 (socket says 172.21.15.8:55084) 2023-08-11T12:24:27.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.971+0000 7f5e3a59c700 1 -- 172.21.15.8:0/3888972648 learned_addr learned my addr 172.21.15.8:0/3888972648 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:27.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.971+0000 7f5e39d9b700 1 --2- 172.21.15.8:0/3888972648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e3c074960 0x7f5e3c19d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:27.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.971+0000 7f5e3ad9d700 1 --2- 172.21.15.8:0/3888972648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e3c10cf20 0x7f5e3c1a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:27.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.971+0000 7f5e3a59c700 1 -- 172.21.15.8:0/3888972648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e3c10cf20 msgr2=0x7f5e3c1a42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:27.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.971+0000 7f5e3a59c700 1 --2- 172.21.15.8:0/3888972648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e3c10cf20 0x7f5e3c1a42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:27.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.971+0000 7f5e3a59c700 1 -- 172.21.15.8:0/3888972648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e3c074960 msgr2=0x7f5e3c19d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:27.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.971+0000 7f5e3a59c700 1 --2- 172.21.15.8:0/3888972648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e3c074960 0x7f5e3c19d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:27.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.971+0000 7f5e3a59c700 1 -- 172.21.15.8:0/3888972648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e30009520 con 0x7f5e3c073380 2023-08-11T12:24:27.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.971+0000 7f5e3ad9d700 1 --2- 172.21.15.8:0/3888972648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e3c10cf20 0x7f5e3c1a42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:27.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.972+0000 7f5e3a59c700 1 --2- 172.21.15.8:0/3888972648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e3c073380 0x7f5e3c19cd50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00e9a0 tx=0x7f5e2c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:27.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.972+0000 7f5e2b7fe700 1 -- 172.21.15.8:0/3888972648 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c009790 con 0x7f5e3c073380 2023-08-11T12:24:27.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.972+0000 7f5e40dff700 1 -- 172.21.15.8:0/3888972648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e34009d00 con 0x7f5e3c073380 2023-08-11T12:24:27.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.972+0000 7f5e2b7fe700 1 -- 172.21.15.8:0/3888972648 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e2c010430 con 0x7f5e3c073380 2023-08-11T12:24:27.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.972+0000 7f5e2b7fe700 1 -- 172.21.15.8:0/3888972648 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c018680 con 0x7f5e3c073380 2023-08-11T12:24:27.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.972+0000 7f5e40dff700 1 -- 172.21.15.8:0/3888972648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e3c1a51c0 con 0x7f5e3c073380 2023-08-11T12:24:27.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.973+0000 7f5e40dff700 1 -- 172.21.15.8:0/3888972648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e3c102a70 con 0x7f5e3c073380 2023-08-11T12:24:27.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.977+0000 7f5e2b7fe700 1 -- 172.21.15.8:0/3888972648 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 134687+0+0 (secure 0 0 0) 0x7f5e2c0105a0 con 0x7f5e3c073380 2023-08-11T12:24:27.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.978+0000 7f5e2b7fe700 1 --2- 172.21.15.8:0/3888972648 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5e2409ffa0 0x7f5e240a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:27.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.978+0000 7f5e2b7fe700 1 -- 172.21.15.8:0/3888972648 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f5e2c014070 con 0x7f5e3c073380 2023-08-11T12:24:27.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.978+0000 7f5e39d9b700 1 -- 172.21.15.8:0/3888972648 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5e2409ffa0 msgr2=0x7f5e240a2460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2041276411 2023-08-11T12:24:27.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.978+0000 7f5e39d9b700 1 --2- 172.21.15.8:0/3888972648 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5e2409ffa0 0x7f5e240a2460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-11T12:24:27.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:27.982+0000 7f5e2b7fe700 1 -- 172.21.15.8:0/3888972648 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f5e2c051c30 con 0x7f5e3c073380 2023-08-11T12:24:28.039 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:27 smithi194 ceph-mon[130905]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-08-11T12:24:28.039 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:27 smithi194 ceph-mon[130905]: mgrmap e17: x(active, since 8m), standbys: z, y 2023-08-11T12:24:28.039 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:27 smithi194 ceph-mon[130905]: from='client.? ' entity='client.admin' 2023-08-11T12:24:28.040 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:27 smithi194 ceph-mon[130905]: from='client.? ' entity='client.admin' 2023-08-11T12:24:28.040 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:24:27 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:24:27.715+0000 7f6e83e2f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-11T12:24:28.040 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:24:27 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:24:27.851+0000 7f6e83e2f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-11T12:24:28.040 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:24:27 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:24:27.941+0000 7f6e83e2f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-11T12:24:28.040 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:24:28 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:24:28.037+0000 7f6e83e2f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-11T12:24:28.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:27 smithi008 ceph-mon[97158]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-08-11T12:24:28.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:27 smithi008 ceph-mon[97158]: mgrmap e17: x(active, since 8m), standbys: z, y 2023-08-11T12:24:28.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:27 smithi008 ceph-mon[97158]: from='client.? ' entity='client.admin' 2023-08-11T12:24:28.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:27 smithi008 ceph-mon[97158]: from='client.? ' entity='client.admin' 2023-08-11T12:24:28.108 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:24:27 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:24:27.950+0000 7ffa04bd6200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-11T12:24:28.108 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:27 smithi045 ceph-mon[130284]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-08-11T12:24:28.108 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:27 smithi045 ceph-mon[130284]: mgrmap e17: x(active, since 8m), standbys: z, y 2023-08-11T12:24:28.108 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:27 smithi045 ceph-mon[130284]: from='client.? ' entity='client.admin' 2023-08-11T12:24:28.109 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:27 smithi045 ceph-mon[130284]: from='client.? ' entity='client.admin' 2023-08-11T12:24:28.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:28.179+0000 7f5e39d9b700 1 -- 172.21.15.8:0/3888972648 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5e2409ffa0 msgr2=0x7f5e240a2460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2041276411 2023-08-11T12:24:28.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:28.179+0000 7f5e39d9b700 1 --2- 172.21.15.8:0/3888972648 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5e2409ffa0 0x7f5e240a2460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-11T12:24:28.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:28.220+0000 7f5e40dff700 1 -- 172.21.15.8:0/3888972648 --> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e3c0008d0 con 0x7f5e2409ffa0 2023-08-11T12:24:28.395 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:24:28 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:24:28.105+0000 7ffa04bd6200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-11T12:24:28.395 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:24:28 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:24:28.214+0000 7ffa04bd6200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-11T12:24:28.395 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:24:28 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:24:28.331+0000 7ffa04bd6200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-11T12:24:28.497 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:28 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:28.207+0000 7fed6c8cf200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-11T12:24:28.497 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:28 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:28.374+0000 7fed6c8cf200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-11T12:24:28.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:28.580+0000 7f5e39d9b700 1 -- 172.21.15.8:0/3888972648 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5e2409ffa0 msgr2=0x7f5e240a2460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2041276411 2023-08-11T12:24:28.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:28.580+0000 7f5e39d9b700 1 --2- 172.21.15.8:0/3888972648 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5e2409ffa0 0x7f5e240a2460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-08-11T12:24:28.803 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:28 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:28.494+0000 7fed6c8cf200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-11T12:24:28.803 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:28 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:28.624+0000 7fed6c8cf200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-11T12:24:28.893 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:24:28 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:24:28.457+0000 7f6e83e2f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-11T12:24:29.145 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:24:28 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:24:28.845+0000 7ffa04bd6200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-11T12:24:29.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:29.381+0000 7f5e39d9b700 1 -- 172.21.15.8:0/3888972648 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5e2409ffa0 msgr2=0x7f5e240a2460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2041276411 2023-08-11T12:24:29.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:29.381+0000 7f5e39d9b700 1 --2- 172.21.15.8:0/3888972648 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5e2409ffa0 0x7f5e240a2460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-08-11T12:24:29.393 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:24:29 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:24:29.113+0000 7f6e83e2f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-11T12:24:29.393 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:24:29 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:24:29.195+0000 7f6e83e2f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-11T12:24:29.553 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:29 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:29.187+0000 7fed6c8cf200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-11T12:24:29.895 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:24:29 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:24:29.629+0000 7ffa04bd6200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-11T12:24:29.895 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:24:29 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:24:29.728+0000 7ffa04bd6200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-11T12:24:30.233 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:24:29 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:24:29.968+0000 7f6e83e2f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-11T12:24:30.234 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:24:30 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:24:30.060+0000 7f6e83e2f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-11T12:24:30.513 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:24:30 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:24:30.231+0000 7f6e83e2f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-11T12:24:30.553 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:30 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:30.072+0000 7fed6c8cf200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-11T12:24:30.554 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:30 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:30.183+0000 7fed6c8cf200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-11T12:24:30.890 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:24:30 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:24:30.511+0000 7f6e83e2f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-11T12:24:30.890 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:24:30 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:24:30.739+0000 7f6e83e2f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-11T12:24:30.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:30.983+0000 7f5e39d9b700 1 -- 172.21.15.8:0/3888972648 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5e2409ffa0 msgr2=0x7f5e240a2460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2041276411 2023-08-11T12:24:30.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:30.983+0000 7f5e39d9b700 1 --2- 172.21.15.8:0/3888972648 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5e2409ffa0 0x7f5e240a2460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-08-11T12:24:31.041 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:24:30 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:24:30.704+0000 7ffa04bd6200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-11T12:24:31.041 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:24:30 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:24:30.816+0000 7ffa04bd6200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-11T12:24:31.143 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:24:30 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:24:30.888+0000 7f6e83e2f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-11T12:24:31.392 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:24:31 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:24:31.038+0000 7ffa04bd6200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-11T12:24:31.539 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:31 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:31.177+0000 7fed6c8cf200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-11T12:24:31.539 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:31 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:31.301+0000 7fed6c8cf200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-11T12:24:31.643 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:24:31 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:24:31.153+0000 7f6e83e2f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-11T12:24:31.645 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:24:31 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:24:31.389+0000 7ffa04bd6200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-11T12:24:31.803 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:31 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:31.536+0000 7fed6c8cf200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-11T12:24:32.143 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:24:31 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:24:31.857+0000 7f6e83e2f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-11T12:24:32.144 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:24:31 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:24:31.990+0000 7f6e83e2f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-11T12:24:32.145 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:24:31 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:24:31.643+0000 7ffa04bd6200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-11T12:24:32.145 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:24:31 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:24:31.828+0000 7ffa04bd6200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-11T12:24:32.203 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:31 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:31.918+0000 7fed6c8cf200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-11T12:24:32.518 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:24:32 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:24:32.184+0000 7f6e83e2f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-11T12:24:32.518 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:24:32 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:24:32.297+0000 7f6e83e2f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-11T12:24:32.553 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:32 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:32.200+0000 7fed6c8cf200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-11T12:24:32.553 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:32 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:32.403+0000 7fed6c8cf200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-11T12:24:32.645 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:24:32 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:24:32.161+0000 7ffa04bd6200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-11T12:24:32.893 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:24:32 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:24:32.516+0000 7f6e83e2f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-11T12:24:33.053 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:32 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:32.765+0000 7fed6c8cf200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-11T12:24:33.394 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:24:32 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:24:32.988+0000 7ffa04bd6200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-11T12:24:33.395 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:24:33 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:24:33.144+0000 7ffa04bd6200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-11T12:24:33.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:33.455+0000 7f5e2b7fe700 1 -- 172.21.15.8:0/3888972648 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mgrmap(e 18) v1 ==== 134687+0+0 (secure 0 0 0) 0x7f5e2c010880 con 0x7f5e3c073380 2023-08-11T12:24:33.643 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:24:33 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z[132768]: 2023-08-11T12:24:33.378+0000 7f6e83e2f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-11T12:24:33.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:33 smithi194 ceph-mon[130905]: Standby manager daemon z restarted 2023-08-11T12:24:33.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:33 smithi194 ceph-mon[130905]: Standby manager daemon z started 2023-08-11T12:24:33.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:33 smithi194 ceph-mon[130905]: from='mgr.? 172.21.15.194:0/4034043126' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-08-11T12:24:33.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:33 smithi194 ceph-mon[130905]: from='mgr.? 172.21.15.194:0/4034043126' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-11T12:24:33.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:33 smithi194 ceph-mon[130905]: from='mgr.? 172.21.15.194:0/4034043126' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-08-11T12:24:33.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:33 smithi194 ceph-mon[130905]: from='mgr.? 172.21.15.194:0/4034043126' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-11T12:24:33.645 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:24:33 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:24:33.390+0000 7ffa04bd6200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-11T12:24:33.645 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:24:33 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:24:33.532+0000 7ffa04bd6200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-11T12:24:33.645 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:33 smithi045 ceph-mon[130284]: Standby manager daemon z restarted 2023-08-11T12:24:33.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:33 smithi045 ceph-mon[130284]: Standby manager daemon z started 2023-08-11T12:24:33.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:33 smithi045 ceph-mon[130284]: from='mgr.? 172.21.15.194:0/4034043126' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-08-11T12:24:33.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:33 smithi045 ceph-mon[130284]: from='mgr.? 172.21.15.194:0/4034043126' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-11T12:24:33.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:33 smithi045 ceph-mon[130284]: from='mgr.? 172.21.15.194:0/4034043126' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-08-11T12:24:33.646 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:33 smithi045 ceph-mon[130284]: from='mgr.? 172.21.15.194:0/4034043126' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-11T12:24:33.737 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:33 smithi008 ceph-mon[97158]: Standby manager daemon z restarted 2023-08-11T12:24:33.738 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:33 smithi008 ceph-mon[97158]: Standby manager daemon z started 2023-08-11T12:24:33.738 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:33 smithi008 ceph-mon[97158]: from='mgr.? 172.21.15.194:0/4034043126' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-08-11T12:24:33.738 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:33 smithi008 ceph-mon[97158]: from='mgr.? 172.21.15.194:0/4034043126' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-11T12:24:33.738 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:33 smithi008 ceph-mon[97158]: from='mgr.? 172.21.15.194:0/4034043126' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-08-11T12:24:33.738 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:33 smithi008 ceph-mon[97158]: from='mgr.? 172.21.15.194:0/4034043126' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-11T12:24:34.053 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:33 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:33.735+0000 7fed6c8cf200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-11T12:24:34.053 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:33 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:33.917+0000 7fed6c8cf200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-11T12:24:34.145 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:24:33 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:24:33.806+0000 7ffa04bd6200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-11T12:24:34.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:34.186+0000 7f5e39d9b700 1 -- 172.21.15.8:0/3888972648 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5e2409ffa0 msgr2=0x7f5e240a2460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2041276411 2023-08-11T12:24:34.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:34.186+0000 7f5e39d9b700 1 --2- 172.21.15.8:0/3888972648 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5e2409ffa0 0x7f5e240a2460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-08-11T12:24:34.458 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:34 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:34.177+0000 7fed6c8cf200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-11T12:24:34.754 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:34 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:34.330+0000 7fed6c8cf200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-11T12:24:34.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:34 smithi008 ceph-mon[97158]: mgrmap e18: x(active, since 9m), standbys: y, z 2023-08-11T12:24:34.804 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:34 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:34.622+0000 7fed6c8cf200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-11T12:24:34.854 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:34 smithi045 ceph-mon[130284]: mgrmap e18: x(active, since 9m), standbys: y, z 2023-08-11T12:24:34.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:34 smithi194 ceph-mon[130905]: mgrmap e18: x(active, since 9m), standbys: y, z 2023-08-11T12:24:35.145 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:24:34 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y[131745]: 2023-08-11T12:24:34.851+0000 7ffa04bd6200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-11T12:24:35.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:35.721+0000 7f5e2b7fe700 1 -- 172.21.15.8:0/3888972648 <== mon.2 v2:172.21.15.45:3300/0 8 ==== mgrmap(e 19) v1 ==== 134687+0+0 (secure 0 0 0) 0x7f5e2c0c8f80 con 0x7f5e3c073380 2023-08-11T12:24:35.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:35.758+0000 7f5e2b7fe700 1 -- 172.21.15.8:0/3888972648 <== mon.2 v2:172.21.15.45:3300/0 9 ==== mgrmap(e 20) v1 ==== 134356+0+0 (secure 0 0 0) 0x7f5e2c095560 con 0x7f5e3c073380 2023-08-11T12:24:35.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:35.758+0000 7f5e2b7fe700 1 -- 172.21.15.8:0/3888972648 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5e2409ffa0 msgr2=0x7f5e240a2460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-11T12:24:35.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:35.758+0000 7f5e2b7fe700 1 --2- 172.21.15.8:0/3888972648 >> [v2:172.21.15.8:6800/2041276411,v1:172.21.15.8:6801/2041276411] conn(0x7f5e2409ffa0 0x7f5e240a2460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:35.975 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:35 smithi008 ceph-mon[97158]: Standby manager daemon y restarted 2023-08-11T12:24:35.975 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:35 smithi008 ceph-mon[97158]: Standby manager daemon y started 2023-08-11T12:24:35.976 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:35 smithi008 ceph-mon[97158]: from='mgr.? 172.21.15.45:0/1975364537' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-08-11T12:24:35.976 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:35 smithi008 ceph-mon[97158]: from='mgr.? 172.21.15.45:0/1975364537' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-11T12:24:35.976 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:35 smithi008 ceph-mon[97158]: from='mgr.? 172.21.15.45:0/1975364537' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-08-11T12:24:35.976 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:35 smithi008 ceph-mon[97158]: from='mgr.? 172.21.15.45:0/1975364537' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-11T12:24:35.976 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:35 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:35.740+0000 7fed6c8cf200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-11T12:24:35.977 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:35 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:35.972+0000 7feccc285700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-11T12:24:35.977 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:35 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:35.972+0000 7feccc285700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-11T12:24:35.977 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:35 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:35.972+0000 7feccc285700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-11T12:24:35.977 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:35 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:35.972+0000 7feccc285700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-11T12:24:35.977 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:35 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:35.972+0000 7feccc285700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-11T12:24:36.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:35 smithi194 ceph-mon[130905]: Standby manager daemon y restarted 2023-08-11T12:24:36.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:35 smithi194 ceph-mon[130905]: Standby manager daemon y started 2023-08-11T12:24:36.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:35 smithi194 ceph-mon[130905]: from='mgr.? 172.21.15.45:0/1975364537' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-08-11T12:24:36.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:35 smithi194 ceph-mon[130905]: from='mgr.? 172.21.15.45:0/1975364537' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-11T12:24:36.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:35 smithi194 ceph-mon[130905]: from='mgr.? 172.21.15.45:0/1975364537' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-08-11T12:24:36.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:35 smithi194 ceph-mon[130905]: from='mgr.? 172.21.15.45:0/1975364537' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-11T12:24:36.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:35 smithi045 ceph-mon[130284]: Standby manager daemon y restarted 2023-08-11T12:24:36.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:35 smithi045 ceph-mon[130284]: Standby manager daemon y started 2023-08-11T12:24:36.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:35 smithi045 ceph-mon[130284]: from='mgr.? 172.21.15.45:0/1975364537' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-08-11T12:24:36.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:35 smithi045 ceph-mon[130284]: from='mgr.? 172.21.15.45:0/1975364537' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-11T12:24:36.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:35 smithi045 ceph-mon[130284]: from='mgr.? 172.21.15.45:0/1975364537' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-08-11T12:24:36.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:35 smithi045 ceph-mon[130284]: from='mgr.? 172.21.15.45:0/1975364537' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-11T12:24:36.303 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:35 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:35.974+0000 7feccea8a700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-11T12:24:36.304 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:35 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:35.974+0000 7feccea8a700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-11T12:24:36.304 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:35 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:35.974+0000 7feccea8a700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-11T12:24:36.304 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:35 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:35.974+0000 7feccea8a700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-11T12:24:36.304 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:24:35 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:24:35.974+0000 7feccea8a700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-11T12:24:36.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:36.763+0000 7f5e2b7fe700 1 -- 172.21.15.8:0/3888972648 <== mon.2 v2:172.21.15.45:3300/0 10 ==== mgrmap(e 21) v1 ==== 134483+0+0 (secure 0 0 0) 0x7f5e2c095e30 con 0x7f5e3c073380 2023-08-11T12:24:36.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:36.764+0000 7f5e2b7fe700 1 --2- 172.21.15.8:0/3888972648 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f5e24065ae0 0x7f5e24065ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:36.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:36.764+0000 7f5e2b7fe700 1 -- 172.21.15.8:0/3888972648 --> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e3c0008d0 con 0x7f5e24065ae0 2023-08-11T12:24:36.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:36.768+0000 7f5e39d9b700 1 --2- 172.21.15.8:0/3888972648 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f5e24065ae0 0x7f5e24065ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:36.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:36.774+0000 7f5e39d9b700 1 --2- 172.21.15.8:0/3888972648 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f5e24065ae0 0x7f5e24065ec0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c074680 tx=0x7f5e30009260 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:36.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:36.841+0000 7f5e2b7fe700 1 -- 172.21.15.8:0/3888972648 <== mgr.25601 v2:172.21.15.8:6800/3843802949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f5e3c0008d0 con 0x7f5e24065ae0 2023-08-11T12:24:36.843 INFO:teuthology.orchestra.run.smithi008.stdout:Schedule set for path / 2023-08-11T12:24:36.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:36.843+0000 7f5e40dff700 1 -- 172.21.15.8:0/3888972648 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f5e24065ae0 msgr2=0x7f5e24065ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:36.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:36.843+0000 7f5e40dff700 1 --2- 172.21.15.8:0/3888972648 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f5e24065ae0 0x7f5e24065ec0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c074680 tx=0x7f5e30009260 comp rx=0 tx=0).stop 2023-08-11T12:24:36.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:36.843+0000 7f5e40dff700 1 -- 172.21.15.8:0/3888972648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e3c073380 msgr2=0x7f5e3c19cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:36.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:36.843+0000 7f5e40dff700 1 --2- 172.21.15.8:0/3888972648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e3c073380 0x7f5e3c19cd50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00e9a0 tx=0x7f5e2c00ecb0 comp rx=0 tx=0).stop 2023-08-11T12:24:36.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:36.843+0000 7f5e3ad9d700 1 -- 172.21.15.8:0/3888972648 reap_dead start 2023-08-11T12:24:36.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:36.843+0000 7f5e40dff700 1 -- 172.21.15.8:0/3888972648 shutdown_connections 2023-08-11T12:24:36.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:36.843+0000 7f5e40dff700 1 -- 172.21.15.8:0/3888972648 >> 172.21.15.8:0/3888972648 conn(0x7f5e3c0fbee0 msgr2=0x7f5e3c0fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:36.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:36.843+0000 7f5e40dff700 1 -- 172.21.15.8:0/3888972648 shutdown_connections 2023-08-11T12:24:36.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:36.843+0000 7f5e40dff700 1 -- 172.21.15.8:0/3888972648 wait complete. 2023-08-11T12:24:36.865 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6M3h' 2023-08-11T12:24:37.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: mgrmap e19: x(active, since 9m), standbys: y, z 2023-08-11T12:24:37.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: Active manager daemon x restarted 2023-08-11T12:24:37.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: Activating manager daemon x 2023-08-11T12:24:37.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: osdmap e90: 12 total, 12 up, 12 in 2023-08-11T12:24:37.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: mgrmap e20: x(active, starting, since 0.012165s), standbys: y, z 2023-08-11T12:24:37.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-11T12:24:37.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:24:37.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:24:37.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-08-11T12:24:37.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-08-11T12:24:37.056 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-08-11T12:24:37.056 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-08-11T12:24:37.056 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-08-11T12:24:37.056 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-08-11T12:24:37.056 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-08-11T12:24:37.056 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-08-11T12:24:37.057 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-08-11T12:24:37.057 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-08-11T12:24:37.057 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-08-11T12:24:37.057 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-08-11T12:24:37.058 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-08-11T12:24:37.058 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-08-11T12:24:37.058 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-08-11T12:24:37.058 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-11T12:24:37.058 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-11T12:24:37.058 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-11T12:24:37.058 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-11T12:24:37.059 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-11T12:24:37.059 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-11T12:24:37.059 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-11T12:24:37.059 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-11T12:24:37.059 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-11T12:24:37.059 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-11T12:24:37.059 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-11T12:24:37.060 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-11T12:24:37.060 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-08-11T12:24:37.060 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-08-11T12:24:37.060 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-08-11T12:24:37.060 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: Manager daemon x is now available 2023-08-11T12:24:37.060 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:24:37.060 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:24:37.061 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-08-11T12:24:37.061 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-08-11T12:24:37.061 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-08-11T12:24:37.061 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:36 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-08-11T12:24:37.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.074+0000 7fb3e33ff700 1 -- 172.21.15.8:0/897213709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3dc1024e0 msgr2=0x7fb3dc108d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:37.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.074+0000 7fb3e33ff700 1 --2- 172.21.15.8:0/897213709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3dc1024e0 0x7fb3dc108d90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb3d400b0d0 tx=0x7fb3d400b3e0 comp rx=0 tx=0).stop 2023-08-11T12:24:37.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.074+0000 7fb3e33ff700 1 -- 172.21.15.8:0/897213709 shutdown_connections 2023-08-11T12:24:37.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.074+0000 7fb3e33ff700 1 --2- 172.21.15.8:0/897213709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3dc100950 0x7fb3dc100d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:37.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.074+0000 7fb3e33ff700 1 --2- 172.21.15.8:0/897213709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3dc1024e0 0x7fb3dc108d90 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:37.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.074+0000 7fb3e33ff700 1 --2- 172.21.15.8:0/897213709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3dc101b40 0x7fb3dc101fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:37.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.074+0000 7fb3e33ff700 1 -- 172.21.15.8:0/897213709 >> 172.21.15.8:0/897213709 conn(0x7fb3dc0fbea0 msgr2=0x7fb3dc0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:37.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.074+0000 7fb3e33ff700 1 -- 172.21.15.8:0/897213709 shutdown_connections 2023-08-11T12:24:37.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.074+0000 7fb3e33ff700 1 -- 172.21.15.8:0/897213709 wait complete. 2023-08-11T12:24:37.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.075+0000 7fb3e33ff700 1 Processor -- start 2023-08-11T12:24:37.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.075+0000 7fb3e33ff700 1 -- start start 2023-08-11T12:24:37.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.076+0000 7fb3e33ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3dc100950 0x7fb3dc198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:37.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.076+0000 7fb3e33ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3dc101b40 0x7fb3dc198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:37.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.076+0000 7fb3e33ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3dc1024e0 0x7fb3dc19fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:37.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.076+0000 7fb3e33ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc1a04a0 con 0x7fb3dc1024e0 2023-08-11T12:24:37.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.076+0000 7fb3e33ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc1a05e0 con 0x7fb3dc100950 2023-08-11T12:24:37.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.076+0000 7fb3e33ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc1a0770 con 0x7fb3dc101b40 2023-08-11T12:24:37.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.076+0000 7fb3e199c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3dc1024e0 0x7fb3dc19fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:37.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.076+0000 7fb3e119b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3dc100950 0x7fb3dc198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:37.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.076+0000 7fb3e119b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3dc100950 0x7fb3dc198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:55232/0 (socket says 172.21.15.8:55232) 2023-08-11T12:24:37.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.076+0000 7fb3e119b700 1 -- 172.21.15.8:0/2910027689 learned_addr learned my addr 172.21.15.8:0/2910027689 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:37.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.076+0000 7fb3e099a700 1 --2- 172.21.15.8:0/2910027689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3dc101b40 0x7fb3dc198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:37.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.077+0000 7fb3e119b700 1 -- 172.21.15.8:0/2910027689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3dc101b40 msgr2=0x7fb3dc198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:37.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.077+0000 7fb3e119b700 1 --2- 172.21.15.8:0/2910027689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3dc101b40 0x7fb3dc198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:37.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.077+0000 7fb3e119b700 1 -- 172.21.15.8:0/2910027689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3dc1024e0 msgr2=0x7fb3dc19fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:37.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.077+0000 7fb3e119b700 1 --2- 172.21.15.8:0/2910027689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3dc1024e0 0x7fb3dc19fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:37.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.077+0000 7fb3e119b700 1 -- 172.21.15.8:0/2910027689 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d4009d00 con 0x7fb3dc100950 2023-08-11T12:24:37.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.077+0000 7fb3e119b700 1 --2- 172.21.15.8:0/2910027689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3dc100950 0x7fb3dc198920 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb3d800e970 tx=0x7fb3d800ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:37.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.077+0000 7fb3d27fc700 1 -- 172.21.15.8:0/2910027689 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8009790 con 0x7fb3dc100950 2023-08-11T12:24:37.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.077+0000 7fb3e33ff700 1 -- 172.21.15.8:0/2910027689 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3dc1a0a50 con 0x7fb3dc100950 2023-08-11T12:24:37.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.077+0000 7fb3d27fc700 1 -- 172.21.15.8:0/2910027689 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb3d800c7e0 con 0x7fb3dc100950 2023-08-11T12:24:37.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.077+0000 7fb3d27fc700 1 -- 172.21.15.8:0/2910027689 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8003c70 con 0x7fb3dc100950 2023-08-11T12:24:37.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.077+0000 7fb3e33ff700 1 -- 172.21.15.8:0/2910027689 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3dc1a0fb0 con 0x7fb3dc100950 2023-08-11T12:24:37.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.078+0000 7fb3e33ff700 1 -- 172.21.15.8:0/2910027689 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3dc10c170 con 0x7fb3dc100950 2023-08-11T12:24:37.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.080+0000 7fb3d27fc700 1 -- 172.21.15.8:0/2910027689 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 21) v1 ==== 134483+0+0 (secure 0 0 0) 0x7fb3d800cc50 con 0x7fb3dc100950 2023-08-11T12:24:37.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.082+0000 7fb3d27fc700 1 --2- 172.21.15.8:0/2910027689 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb3c809fd50 0x7fb3c80a2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:37.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.082+0000 7fb3d27fc700 1 -- 172.21.15.8:0/2910027689 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fb3d8014070 con 0x7fb3dc100950 2023-08-11T12:24:37.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.082+0000 7fb3e099a700 1 --2- 172.21.15.8:0/2910027689 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb3c809fd50 0x7fb3c80a2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:37.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.082+0000 7fb3e099a700 1 --2- 172.21.15.8:0/2910027689 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb3c809fd50 0x7fb3c80a2210 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009c60 tx=0x7fb3cc009260 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:37.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.086+0000 7fb3d27fc700 1 -- 172.21.15.8:0/2910027689 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fb3d8095090 con 0x7fb3dc100950 2023-08-11T12:24:37.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: mgrmap e19: x(active, since 9m), standbys: y, z 2023-08-11T12:24:37.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: Active manager daemon x restarted 2023-08-11T12:24:37.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: Activating manager daemon x 2023-08-11T12:24:37.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: osdmap e90: 12 total, 12 up, 12 in 2023-08-11T12:24:37.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: mgrmap e20: x(active, starting, since 0.012165s), standbys: y, z 2023-08-11T12:24:37.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-11T12:24:37.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:24:37.146 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:24:37.146 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-08-11T12:24:37.146 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-08-11T12:24:37.147 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-08-11T12:24:37.147 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-08-11T12:24:37.147 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-08-11T12:24:37.147 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-08-11T12:24:37.148 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-08-11T12:24:37.148 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-08-11T12:24:37.148 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-08-11T12:24:37.149 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-08-11T12:24:37.149 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-08-11T12:24:37.150 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-08-11T12:24:37.150 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-08-11T12:24:37.150 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-08-11T12:24:37.151 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-08-11T12:24:37.151 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-11T12:24:37.151 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-11T12:24:37.152 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-11T12:24:37.152 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-11T12:24:37.153 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-11T12:24:37.153 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-11T12:24:37.154 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-11T12:24:37.154 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-11T12:24:37.154 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-11T12:24:37.154 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-11T12:24:37.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-11T12:24:37.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-11T12:24:37.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-08-11T12:24:37.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-08-11T12:24:37.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-08-11T12:24:37.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: Manager daemon x is now available 2023-08-11T12:24:37.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:24:37.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:24:37.157 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-08-11T12:24:37.157 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-08-11T12:24:37.157 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-08-11T12:24:37.157 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:36 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-08-11T12:24:37.159 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: mgrmap e19: x(active, since 9m), standbys: y, z 2023-08-11T12:24:37.159 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: Active manager daemon x restarted 2023-08-11T12:24:37.159 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: Activating manager daemon x 2023-08-11T12:24:37.160 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: osdmap e90: 12 total, 12 up, 12 in 2023-08-11T12:24:37.160 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: mgrmap e20: x(active, starting, since 0.012165s), standbys: y, z 2023-08-11T12:24:37.160 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-11T12:24:37.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-11T12:24:37.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-11T12:24:37.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-08-11T12:24:37.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-08-11T12:24:37.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-08-11T12:24:37.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-08-11T12:24:37.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-08-11T12:24:37.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-08-11T12:24:37.163 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-08-11T12:24:37.163 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-08-11T12:24:37.163 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-08-11T12:24:37.164 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-08-11T12:24:37.164 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-08-11T12:24:37.164 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-08-11T12:24:37.165 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-08-11T12:24:37.165 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-08-11T12:24:37.165 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-08-11T12:24:37.165 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-11T12:24:37.166 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-11T12:24:37.166 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-11T12:24:37.166 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-11T12:24:37.166 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-11T12:24:37.166 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-11T12:24:37.166 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-11T12:24:37.167 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-11T12:24:37.167 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-11T12:24:37.167 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-11T12:24:37.167 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-11T12:24:37.167 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-11T12:24:37.168 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-08-11T12:24:37.168 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-08-11T12:24:37.168 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-08-11T12:24:37.168 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: Manager daemon x is now available 2023-08-11T12:24:37.168 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:24:37.168 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:24:37.169 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-08-11T12:24:37.169 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-08-11T12:24:37.169 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-08-11T12:24:37.169 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:36 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-08-11T12:24:37.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.342+0000 7fb3e33ff700 1 -- 172.21.15.8:0/2910027689 --> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3dc1083f0 con 0x7fb3c809fd50 2023-08-11T12:24:37.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.401+0000 7fb3d27fc700 1 -- 172.21.15.8:0/2910027689 <== mgr.25601 v2:172.21.15.8:6800/3843802949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fb3dc1083f0 con 0x7fb3c809fd50 2023-08-11T12:24:37.403 INFO:teuthology.orchestra.run.smithi008.stdout:Retention added to path / 2023-08-11T12:24:37.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.403+0000 7fb3e33ff700 1 -- 172.21.15.8:0/2910027689 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb3c809fd50 msgr2=0x7fb3c80a2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:37.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.403+0000 7fb3e33ff700 1 --2- 172.21.15.8:0/2910027689 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb3c809fd50 0x7fb3c80a2210 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009c60 tx=0x7fb3cc009260 comp rx=0 tx=0).stop 2023-08-11T12:24:37.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.403+0000 7fb3e33ff700 1 -- 172.21.15.8:0/2910027689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3dc100950 msgr2=0x7fb3dc198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:37.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.403+0000 7fb3e33ff700 1 --2- 172.21.15.8:0/2910027689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3dc100950 0x7fb3dc198920 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb3d800e970 tx=0x7fb3d800ec80 comp rx=0 tx=0).stop 2023-08-11T12:24:37.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.403+0000 7fb3e33ff700 1 -- 172.21.15.8:0/2910027689 shutdown_connections 2023-08-11T12:24:37.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.403+0000 7fb3e33ff700 1 --2- 172.21.15.8:0/2910027689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3dc1024e0 0x7fb3dc19fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:37.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.403+0000 7fb3e33ff700 1 --2- 172.21.15.8:0/2910027689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3dc100950 0x7fb3dc198920 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:37.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.403+0000 7fb3e33ff700 1 --2- 172.21.15.8:0/2910027689 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb3c809fd50 0x7fb3c80a2210 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:37.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.403+0000 7fb3e33ff700 1 --2- 172.21.15.8:0/2910027689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3dc101b40 0x7fb3dc198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:37.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.403+0000 7fb3e33ff700 1 -- 172.21.15.8:0/2910027689 >> 172.21.15.8:0/2910027689 conn(0x7fb3dc0fbea0 msgr2=0x7fb3dc0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:37.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.403+0000 7fb3e33ff700 1 -- 172.21.15.8:0/2910027689 shutdown_connections 2023-08-11T12:24:37.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.403+0000 7fb3e33ff700 1 -- 172.21.15.8:0/2910027689 wait complete. 2023-08-11T12:24:37.425 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-08-11T12:24:37.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.630+0000 7fb971dff700 1 -- 172.21.15.8:0/3416763796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb96c074960 msgr2=0x7fb96c072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:37.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.630+0000 7fb971dff700 1 --2- 172.21.15.8:0/3416763796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb96c074960 0x7fb96c072db0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009990 tx=0x7fb95c009ca0 comp rx=0 tx=0).stop 2023-08-11T12:24:37.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.630+0000 7fb971dff700 1 -- 172.21.15.8:0/3416763796 shutdown_connections 2023-08-11T12:24:37.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.630+0000 7fb971dff700 1 --2- 172.21.15.8:0/3416763796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb96c108810 0x7fb96c10aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:37.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.630+0000 7fb971dff700 1 --2- 172.21.15.8:0/3416763796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb96c074960 0x7fb96c072db0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:37.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.630+0000 7fb971dff700 1 --2- 172.21.15.8:0/3416763796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb96c073380 0x7fb96c073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:37.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.631+0000 7fb971dff700 1 -- 172.21.15.8:0/3416763796 >> 172.21.15.8:0/3416763796 conn(0x7fb96c0fbee0 msgr2=0x7fb96c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:37.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.631+0000 7fb971dff700 1 -- 172.21.15.8:0/3416763796 shutdown_connections 2023-08-11T12:24:37.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.631+0000 7fb971dff700 1 -- 172.21.15.8:0/3416763796 wait complete. 2023-08-11T12:24:37.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.632+0000 7fb971dff700 1 Processor -- start 2023-08-11T12:24:37.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.632+0000 7fb971dff700 1 -- start start 2023-08-11T12:24:37.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.632+0000 7fb971dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb96c073380 0x7fb96c198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:37.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.632+0000 7fb971dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb96c074960 0x7fb96c198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:37.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.632+0000 7fb971dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb96c108810 0x7fb96c19fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:37.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.632+0000 7fb971dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c1a0390 con 0x7fb96c074960 2023-08-11T12:24:37.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.632+0000 7fb971dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c1a04d0 con 0x7fb96c073380 2023-08-11T12:24:37.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.632+0000 7fb971dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c1a0660 con 0x7fb96c108810 2023-08-11T12:24:37.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.633+0000 7fb96affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb96c074960 0x7fb96c198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:37.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.633+0000 7fb96bfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb96c108810 0x7fb96c19fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:37.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.633+0000 7fb96bfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb96c108810 0x7fb96c19fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:58202/0 (socket says 172.21.15.8:58202) 2023-08-11T12:24:37.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.633+0000 7fb96affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb96c074960 0x7fb96c198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40820/0 (socket says 172.21.15.8:40820) 2023-08-11T12:24:37.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.633+0000 7fb96bfff700 1 -- 172.21.15.8:0/3450630307 learned_addr learned my addr 172.21.15.8:0/3450630307 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:37.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.633+0000 7fb96bfff700 1 -- 172.21.15.8:0/3450630307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb96c073380 msgr2=0x7fb96c198810 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-11T12:24:37.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.633+0000 7fb96bfff700 1 --2- 172.21.15.8:0/3450630307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb96c073380 0x7fb96c198810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:37.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.633+0000 7fb96bfff700 1 -- 172.21.15.8:0/3450630307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb96c074960 msgr2=0x7fb96c198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:37.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.633+0000 7fb96bfff700 1 --2- 172.21.15.8:0/3450630307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb96c074960 0x7fb96c198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:37.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.633+0000 7fb96bfff700 1 -- 172.21.15.8:0/3450630307 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95c0095f0 con 0x7fb96c108810 2023-08-11T12:24:37.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.633+0000 7fb96affd700 1 --2- 172.21.15.8:0/3450630307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb96c074960 0x7fb96c198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:37.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.633+0000 7fb96bfff700 1 --2- 172.21.15.8:0/3450630307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb96c108810 0x7fb96c19fdc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb96400ef30 tx=0x7fb96400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:37.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.634+0000 7fb968ff9700 1 -- 172.21.15.8:0/3450630307 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb964018070 con 0x7fb96c108810 2023-08-11T12:24:37.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.634+0000 7fb968ff9700 1 -- 172.21.15.8:0/3450630307 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb96400f040 con 0x7fb96c108810 2023-08-11T12:24:37.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.634+0000 7fb971dff700 1 -- 172.21.15.8:0/3450630307 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb96c1a08e0 con 0x7fb96c108810 2023-08-11T12:24:37.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.634+0000 7fb968ff9700 1 -- 172.21.15.8:0/3450630307 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96400cdb0 con 0x7fb96c108810 2023-08-11T12:24:37.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.634+0000 7fb971dff700 1 -- 172.21.15.8:0/3450630307 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb96c1a0da0 con 0x7fb96c108810 2023-08-11T12:24:37.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.635+0000 7fb971dff700 1 -- 172.21.15.8:0/3450630307 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb96c106ec0 con 0x7fb96c108810 2023-08-11T12:24:37.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.637+0000 7fb968ff9700 1 -- 172.21.15.8:0/3450630307 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 21) v1 ==== 134483+0+0 (secure 0 0 0) 0x7fb964003a00 con 0x7fb96c108810 2023-08-11T12:24:37.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.638+0000 7fb968ff9700 1 --2- 172.21.15.8:0/3450630307 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb95409fd50 0x7fb9540a2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:37.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.638+0000 7fb968ff9700 1 -- 172.21.15.8:0/3450630307 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fb9640caed0 con 0x7fb96c108810 2023-08-11T12:24:37.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.638+0000 7fb96b7fe700 1 --2- 172.21.15.8:0/3450630307 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb95409fd50 0x7fb9540a2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:37.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.639+0000 7fb96b7fe700 1 --2- 172.21.15.8:0/3450630307 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb95409fd50 0x7fb9540a2210 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb95c0098e0 tx=0x7fb95c000bc0 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:37.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.642+0000 7fb968ff9700 1 -- 172.21.15.8:0/3450630307 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fb964094b90 con 0x7fb96c108810 2023-08-11T12:24:37.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.770+0000 7fb968ff9700 1 -- 172.21.15.8:0/3450630307 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mgrmap(e 22) v1 ==== 134790+0+0 (secure 0 0 0) 0x7fb964003cb0 con 0x7fb96c108810 2023-08-11T12:24:37.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.927+0000 7fb971dff700 1 -- 172.21.15.8:0/3450630307 --> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7fb96c02ce80 con 0x7fb95409fd50 2023-08-11T12:24:37.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.936+0000 7fb968ff9700 1 -- 172.21.15.8:0/3450630307 <== mgr.25601 v2:172.21.15.8:6800/3843802949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+283 (secure 0 0 0) 0x7fb96c02ce80 con 0x7fb95409fd50 2023-08-11T12:24:37.938 INFO:teuthology.orchestra.run.smithi008.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1M", "retention": {"h": 3, "M": 6}, "start": "2023-08-11T00:00:00", "created": "2023-08-11T12:24:36", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2023-08-11T12:24:37.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.938+0000 7fb971dff700 1 -- 172.21.15.8:0/3450630307 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb95409fd50 msgr2=0x7fb9540a2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:37.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.938+0000 7fb971dff700 1 --2- 172.21.15.8:0/3450630307 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb95409fd50 0x7fb9540a2210 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb95c0098e0 tx=0x7fb95c000bc0 comp rx=0 tx=0).stop 2023-08-11T12:24:37.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.938+0000 7fb971dff700 1 -- 172.21.15.8:0/3450630307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb96c108810 msgr2=0x7fb96c19fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:37.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.938+0000 7fb971dff700 1 --2- 172.21.15.8:0/3450630307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb96c108810 0x7fb96c19fdc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb96400ef30 tx=0x7fb96400c3a0 comp rx=0 tx=0).stop 2023-08-11T12:24:37.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.938+0000 7fb971dff700 1 -- 172.21.15.8:0/3450630307 shutdown_connections 2023-08-11T12:24:37.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.938+0000 7fb971dff700 1 --2- 172.21.15.8:0/3450630307 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb95409fd50 0x7fb9540a2210 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:37.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.938+0000 7fb971dff700 1 --2- 172.21.15.8:0/3450630307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb96c108810 0x7fb96c19fdc0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:37.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.938+0000 7fb971dff700 1 --2- 172.21.15.8:0/3450630307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb96c073380 0x7fb96c198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:37.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.938+0000 7fb971dff700 1 --2- 172.21.15.8:0/3450630307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb96c074960 0x7fb96c198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:37.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.938+0000 7fb971dff700 1 -- 172.21.15.8:0/3450630307 >> 172.21.15.8:0/3450630307 conn(0x7fb96c0fbee0 msgr2=0x7fb96c0fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:37.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.939+0000 7fb971dff700 1 -- 172.21.15.8:0/3450630307 shutdown_connections 2023-08-11T12:24:37.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:37.939+0000 7fb971dff700 1 -- 172.21.15.8:0/3450630307 wait complete. 2023-08-11T12:24:37.959 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-08-11T12:24:38.026 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:37 smithi008 ceph-mon[97158]: [11/Aug/2023:12:24:36] ENGINE Bus STARTING 2023-08-11T12:24:38.026 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:37 smithi008 ceph-mon[97158]: [11/Aug/2023:12:24:36] ENGINE Serving on http://172.21.15.8:8765 2023-08-11T12:24:38.026 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:37 smithi008 ceph-mon[97158]: [11/Aug/2023:12:24:36] ENGINE Serving on https://172.21.15.8:7150 2023-08-11T12:24:38.026 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:37 smithi008 ceph-mon[97158]: [11/Aug/2023:12:24:36] ENGINE Bus STARTED 2023-08-11T12:24:38.027 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:37 smithi008 ceph-mon[97158]: mgrmap e21: x(active, since 1.02123s), standbys: y, z 2023-08-11T12:24:38.027 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:37 smithi008 ceph-mon[97158]: from='client.25619 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:24:38.027 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:37 smithi008 ceph-mon[97158]: pgmap v3: 129 pgs: 129 active+clean; 974 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:24:38.027 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:37 smithi008 ceph-mon[97158]: scrub summary: idle 2023-08-11T12:24:38.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:37 smithi194 ceph-mon[130905]: [11/Aug/2023:12:24:36] ENGINE Bus STARTING 2023-08-11T12:24:38.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:37 smithi194 ceph-mon[130905]: [11/Aug/2023:12:24:36] ENGINE Serving on http://172.21.15.8:8765 2023-08-11T12:24:38.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:37 smithi194 ceph-mon[130905]: [11/Aug/2023:12:24:36] ENGINE Serving on https://172.21.15.8:7150 2023-08-11T12:24:38.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:37 smithi194 ceph-mon[130905]: [11/Aug/2023:12:24:36] ENGINE Bus STARTED 2023-08-11T12:24:38.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:37 smithi194 ceph-mon[130905]: mgrmap e21: x(active, since 1.02123s), standbys: y, z 2023-08-11T12:24:38.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:37 smithi194 ceph-mon[130905]: from='client.25619 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:24:38.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:37 smithi194 ceph-mon[130905]: pgmap v3: 129 pgs: 129 active+clean; 974 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:24:38.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:37 smithi194 ceph-mon[130905]: scrub summary: idle 2023-08-11T12:24:38.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:37 smithi045 ceph-mon[130284]: [11/Aug/2023:12:24:36] ENGINE Bus STARTING 2023-08-11T12:24:38.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:37 smithi045 ceph-mon[130284]: [11/Aug/2023:12:24:36] ENGINE Serving on http://172.21.15.8:8765 2023-08-11T12:24:38.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:37 smithi045 ceph-mon[130284]: [11/Aug/2023:12:24:36] ENGINE Serving on https://172.21.15.8:7150 2023-08-11T12:24:38.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:37 smithi045 ceph-mon[130284]: [11/Aug/2023:12:24:36] ENGINE Bus STARTED 2023-08-11T12:24:38.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:37 smithi045 ceph-mon[130284]: mgrmap e21: x(active, since 1.02123s), standbys: y, z 2023-08-11T12:24:38.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:37 smithi045 ceph-mon[130284]: from='client.25619 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:24:38.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:37 smithi045 ceph-mon[130284]: pgmap v3: 129 pgs: 129 active+clean; 974 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:24:38.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:37 smithi045 ceph-mon[130284]: scrub summary: idle 2023-08-11T12:24:38.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.175+0000 7fc76d1ff700 1 -- 172.21.15.8:0/2867603963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc768074960 msgr2=0x7fc768072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:38.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.175+0000 7fc76d1ff700 1 --2- 172.21.15.8:0/2867603963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc768074960 0x7fc768072db0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc758009990 tx=0x7fc758009ca0 comp rx=0 tx=0).stop 2023-08-11T12:24:38.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.175+0000 7fc76d1ff700 1 -- 172.21.15.8:0/2867603963 shutdown_connections 2023-08-11T12:24:38.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.175+0000 7fc76d1ff700 1 --2- 172.21.15.8:0/2867603963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc768108810 0x7fc76810aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:38.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.175+0000 7fc76d1ff700 1 --2- 172.21.15.8:0/2867603963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc768074960 0x7fc768072db0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:38.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.175+0000 7fc76d1ff700 1 --2- 172.21.15.8:0/2867603963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc768073380 0x7fc768073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:38.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.175+0000 7fc76d1ff700 1 -- 172.21.15.8:0/2867603963 >> 172.21.15.8:0/2867603963 conn(0x7fc7680fbea0 msgr2=0x7fc7680fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:38.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.175+0000 7fc76d1ff700 1 -- 172.21.15.8:0/2867603963 shutdown_connections 2023-08-11T12:24:38.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.176+0000 7fc76d1ff700 1 -- 172.21.15.8:0/2867603963 wait complete. 2023-08-11T12:24:38.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.177+0000 7fc76d1ff700 1 Processor -- start 2023-08-11T12:24:38.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.177+0000 7fc76d1ff700 1 -- start start 2023-08-11T12:24:38.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.177+0000 7fc76d1ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc768073380 0x7fc768198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:38.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.177+0000 7fc76d1ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc768074960 0x7fc768198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:38.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.177+0000 7fc76d1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc768108810 0x7fc76819fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:38.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.177+0000 7fc76d1ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7681a03b0 con 0x7fc768074960 2023-08-11T12:24:38.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.177+0000 7fc76d1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7681a04f0 con 0x7fc768108810 2023-08-11T12:24:38.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.177+0000 7fc76d1ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7681a0680 con 0x7fc768073380 2023-08-11T12:24:38.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.177+0000 7fc76659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc768074960 0x7fc768198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:38.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.177+0000 7fc76659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc768074960 0x7fc768198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56052/0 (socket says 172.21.15.8:56052) 2023-08-11T12:24:38.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.177+0000 7fc76659c700 1 -- 172.21.15.8:0/3891014101 learned_addr learned my addr 172.21.15.8:0/3891014101 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:38.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.177+0000 7fc76759e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc768108810 0x7fc76819fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:38.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.177+0000 7fc766d9d700 1 --2- 172.21.15.8:0/3891014101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc768073380 0x7fc768198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:38.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.178+0000 7fc76759e700 1 -- 172.21.15.8:0/3891014101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc768073380 msgr2=0x7fc768198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:38.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.178+0000 7fc76759e700 1 --2- 172.21.15.8:0/3891014101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc768073380 0x7fc768198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:38.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.178+0000 7fc76759e700 1 -- 172.21.15.8:0/3891014101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc768074960 msgr2=0x7fc768198d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:38.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.178+0000 7fc76759e700 1 --2- 172.21.15.8:0/3891014101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc768074960 0x7fc768198d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:38.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.178+0000 7fc76759e700 1 -- 172.21.15.8:0/3891014101 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7580095f0 con 0x7fc768108810 2023-08-11T12:24:38.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.178+0000 7fc766d9d700 1 --2- 172.21.15.8:0/3891014101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc768073380 0x7fc768198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:38.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.178+0000 7fc76759e700 1 --2- 172.21.15.8:0/3891014101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc768108810 0x7fc76819fde0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc76000efc0 tx=0x7fc76000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:38.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.178+0000 7fc74ffff700 1 -- 172.21.15.8:0/3891014101 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc760018070 con 0x7fc768108810 2023-08-11T12:24:38.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.179+0000 7fc74ffff700 1 -- 172.21.15.8:0/3891014101 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc76000f040 con 0x7fc768108810 2023-08-11T12:24:38.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.179+0000 7fc74ffff700 1 -- 172.21.15.8:0/3891014101 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76000cd40 con 0x7fc768108810 2023-08-11T12:24:38.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.179+0000 7fc76d1ff700 1 -- 172.21.15.8:0/3891014101 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7681a0900 con 0x7fc768108810 2023-08-11T12:24:38.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.179+0000 7fc76d1ff700 1 -- 172.21.15.8:0/3891014101 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7681a0dc0 con 0x7fc768108810 2023-08-11T12:24:38.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.180+0000 7fc76d1ff700 1 -- 172.21.15.8:0/3891014101 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc768106ec0 con 0x7fc768108810 2023-08-11T12:24:38.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.184+0000 7fc74ffff700 1 -- 172.21.15.8:0/3891014101 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 22) v1 ==== 134790+0+0 (secure 0 0 0) 0x7fc760003a00 con 0x7fc768108810 2023-08-11T12:24:38.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.185+0000 7fc74ffff700 1 --2- 172.21.15.8:0/3891014101 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fc7500a00c0 0x7fc7500a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:38.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.185+0000 7fc74ffff700 1 -- 172.21.15.8:0/3891014101 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fc7600cbb30 con 0x7fc768108810 2023-08-11T12:24:38.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.186+0000 7fc74ffff700 1 -- 172.21.15.8:0/3891014101 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fc7600f7cd0 con 0x7fc768108810 2023-08-11T12:24:38.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.186+0000 7fc766d9d700 1 --2- 172.21.15.8:0/3891014101 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fc7500a00c0 0x7fc7500a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:38.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.187+0000 7fc766d9d700 1 --2- 172.21.15.8:0/3891014101 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fc7500a00c0 0x7fc7500a2580 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc75800b2e0 tx=0x7fc758005fb0 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:38.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.435+0000 7fc76d1ff700 1 -- 172.21.15.8:0/3891014101 --> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fc76802ce10 con 0x7fc7500a00c0 2023-08-11T12:24:38.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.444+0000 7fc74ffff700 1 -- 172.21.15.8:0/3891014101 <== mgr.25601 v2:172.21.15.8:6800/3843802949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7fc76802ce10 con 0x7fc7500a00c0 2023-08-11T12:24:38.449 INFO:teuthology.orchestra.run.smithi008.stdout:/ 1M 6M3h 2023-08-11T12:24:38.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.446+0000 7fc76d1ff700 1 -- 172.21.15.8:0/3891014101 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fc7500a00c0 msgr2=0x7fc7500a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:38.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.446+0000 7fc76d1ff700 1 --2- 172.21.15.8:0/3891014101 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fc7500a00c0 0x7fc7500a2580 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc75800b2e0 tx=0x7fc758005fb0 comp rx=0 tx=0).stop 2023-08-11T12:24:38.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.446+0000 7fc76d1ff700 1 -- 172.21.15.8:0/3891014101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc768108810 msgr2=0x7fc76819fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:38.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.446+0000 7fc76d1ff700 1 --2- 172.21.15.8:0/3891014101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc768108810 0x7fc76819fde0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc76000efc0 tx=0x7fc76000c3a0 comp rx=0 tx=0).stop 2023-08-11T12:24:38.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.447+0000 7fc76d1ff700 1 -- 172.21.15.8:0/3891014101 shutdown_connections 2023-08-11T12:24:38.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.447+0000 7fc76d1ff700 1 --2- 172.21.15.8:0/3891014101 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fc7500a00c0 0x7fc7500a2580 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:38.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.447+0000 7fc76d1ff700 1 --2- 172.21.15.8:0/3891014101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc768073380 0x7fc768198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:38.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.447+0000 7fc76d1ff700 1 --2- 172.21.15.8:0/3891014101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc768108810 0x7fc76819fde0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:38.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.447+0000 7fc76d1ff700 1 --2- 172.21.15.8:0/3891014101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc768074960 0x7fc768198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:38.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.447+0000 7fc76d1ff700 1 -- 172.21.15.8:0/3891014101 >> 172.21.15.8:0/3891014101 conn(0x7fc7680fbea0 msgr2=0x7fc7680fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:38.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.447+0000 7fc76d1ff700 1 -- 172.21.15.8:0/3891014101 shutdown_connections 2023-08-11T12:24:38.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:38.447+0000 7fc76d1ff700 1 -- 172.21.15.8:0/3891014101 wait complete. 2023-08-11T12:24:38.468 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2023-08-11T12:24:38.546 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2023-08-11T12:24:38.559 INFO:teuthology.run_tasks:Running task background_exec... 2023-08-11T12:24:38.577 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi008.front.sepia.ceph.com 2023-08-11T12:24:38.577 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2023-08-11T12:24:38.582 INFO:teuthology.run_tasks:Running task exec... 2023-08-11T12:24:38.593 INFO:teuthology.task.exec:Executing custom commands... 2023-08-11T12:24:38.593 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi008.front.sepia.ceph.com 2023-08-11T12:24:38.593 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2023-08-11T12:24:38.705 INFO:teuthology.orchestra.run.smithi008.stdout:total 0 2023-08-11T12:24:38.761 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem Size Used Avail Use% Mounted on 2023-08-11T12:24:38.761 INFO:teuthology.orchestra.run.smithi008.stdout:0@815f94ae-3840-11ee-9b37-001a4aab830c.cephfs=/ 1.1T 332M 1.1T 1% /tmp/cephfs 2023-08-11T12:24:38.767 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2023-08-11T12:24:38.919 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2023-08-11T12:24:39.010 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:38 smithi008 ceph-mon[97158]: from='client.25655 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:24:39.010 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:38 smithi008 ceph-mon[97158]: pgmap v4: 129 pgs: 129 active+clean; 974 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:24:39.011 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:38 smithi008 ceph-mon[97158]: mgrmap e22: x(active, since 2s), standbys: y, z 2023-08-11T12:24:39.026 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2023-08-11T12:24:39.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:38 smithi194 ceph-mon[130905]: from='client.25655 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:24:39.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:38 smithi194 ceph-mon[130905]: pgmap v4: 129 pgs: 129 active+clean; 974 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:24:39.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:38 smithi194 ceph-mon[130905]: mgrmap e22: x(active, since 2s), standbys: y, z 2023-08-11T12:24:39.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:38 smithi045 ceph-mon[130284]: from='client.25655 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:24:39.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:38 smithi045 ceph-mon[130284]: pgmap v4: 129 pgs: 129 active+clean; 974 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:24:39.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:38 smithi045 ceph-mon[130284]: mgrmap e22: x(active, since 2s), standbys: y, z 2023-08-11T12:24:40.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:39 smithi194 ceph-mon[130905]: from='client.25672 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:24:40.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:39 smithi194 ceph-mon[130905]: from='client.25670 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:24:40.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:39 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:40.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:39 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:40.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:39 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:40.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:39 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:40.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:39 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:40.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:39 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:40.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:39 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:39 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:39 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:39 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:39 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:39 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:39 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.146 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:39 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.146 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:39 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:40.146 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:39 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:40.146 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:39 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.146 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:39 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.146 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:39 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.146 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:39 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.146 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:39 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.147 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:39 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.147 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:39 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.147 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:39 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.148 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:39 smithi045 ceph-mon[130284]: from='client.25672 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:24:40.148 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:39 smithi045 ceph-mon[130284]: from='client.25670 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:24:40.148 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:39 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:40.148 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:39 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:40.148 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:39 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:40.148 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:39 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:40.149 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:39 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:40.149 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:39 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:40.149 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:39 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.149 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:39 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.149 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:39 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.149 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:39 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.149 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:39 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.150 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:39 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.150 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:39 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.150 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:39 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.150 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:39 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:40.150 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:39 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:40.150 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:39 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.150 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:39 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.151 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:39 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.151 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:39 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.151 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:39 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.151 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:39 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.151 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:39 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.151 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:39 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:39 smithi008 ceph-mon[97158]: from='client.25672 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:24:40.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:39 smithi008 ceph-mon[97158]: from='client.25670 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:24:40.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:39 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:40.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:39 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:40.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:39 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:40.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:39 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:40.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:39 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:40.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:39 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:40.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:39 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:39 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:39 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:39 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:39 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:39 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.307 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:39 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.307 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:39 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.307 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:39 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:40.307 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:39 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:40.307 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:39 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.307 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:39 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.307 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:39 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.308 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:39 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.308 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:39 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.308 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:39 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.308 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:39 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:40.308 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:39 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:41.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:40 smithi194 ceph-mon[130905]: Adjusting osd_memory_target on smithi194 to 196.2M 2023-08-11T12:24:41.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:40 smithi194 ceph-mon[130905]: Unable to set osd_memory_target on smithi194 to 205773926: error parsing value: Value '205773926' is below minimum 939524096 2023-08-11T12:24:41.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:40 smithi194 ceph-mon[130905]: pgmap v5: 129 pgs: 129 active+clean; 974 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:24:41.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:40 smithi194 ceph-mon[130905]: Adjusting osd_memory_target on smithi045 to 197.2M 2023-08-11T12:24:41.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:40 smithi194 ceph-mon[130905]: Unable to set osd_memory_target on smithi045 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-08-11T12:24:41.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:40 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:41.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:40 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:41.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:40 smithi194 ceph-mon[130905]: mgrmap e23: x(active, since 5s), standbys: y, z 2023-08-11T12:24:41.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:40 smithi045 ceph-mon[130284]: Adjusting osd_memory_target on smithi194 to 196.2M 2023-08-11T12:24:41.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:40 smithi045 ceph-mon[130284]: Unable to set osd_memory_target on smithi194 to 205773926: error parsing value: Value '205773926' is below minimum 939524096 2023-08-11T12:24:41.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:40 smithi045 ceph-mon[130284]: pgmap v5: 129 pgs: 129 active+clean; 974 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:24:41.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:40 smithi045 ceph-mon[130284]: Adjusting osd_memory_target on smithi045 to 197.2M 2023-08-11T12:24:41.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:40 smithi045 ceph-mon[130284]: Unable to set osd_memory_target on smithi045 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-08-11T12:24:41.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:40 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:41.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:40 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:41.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:40 smithi045 ceph-mon[130284]: mgrmap e23: x(active, since 5s), standbys: y, z 2023-08-11T12:24:41.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:40 smithi008 ceph-mon[97158]: Adjusting osd_memory_target on smithi194 to 196.2M 2023-08-11T12:24:41.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:40 smithi008 ceph-mon[97158]: Unable to set osd_memory_target on smithi194 to 205773926: error parsing value: Value '205773926' is below minimum 939524096 2023-08-11T12:24:41.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:40 smithi008 ceph-mon[97158]: pgmap v5: 129 pgs: 129 active+clean; 974 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:24:41.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:40 smithi008 ceph-mon[97158]: Adjusting osd_memory_target on smithi045 to 197.2M 2023-08-11T12:24:41.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:40 smithi008 ceph-mon[97158]: Unable to set osd_memory_target on smithi045 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-08-11T12:24:41.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:40 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:41.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:40 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:41.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:40 smithi008 ceph-mon[97158]: mgrmap e23: x(active, since 5s), standbys: y, z 2023-08-11T12:24:42.488 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:42 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:42.488 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:42 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:42.489 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:42 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:42.489 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:42 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:42.489 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:42 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:42.489 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:42 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:42.490 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:42 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:42.490 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:42 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:42.490 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:42 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:42.491 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:42 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:42.491 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:42 smithi008 ceph-mon[97158]: Adjusting osd_memory_target on smithi008 to 222.0M 2023-08-11T12:24:42.491 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:42 smithi008 ceph-mon[97158]: Unable to set osd_memory_target on smithi008 to 232785100: error parsing value: Value '232785100' is below minimum 939524096 2023-08-11T12:24:42.491 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:42 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:24:42.492 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:42 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:24:42.492 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:42 smithi008 ceph-mon[97158]: Updating smithi008:/etc/ceph/ceph.conf 2023-08-11T12:24:42.492 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:42 smithi008 ceph-mon[97158]: Updating smithi045:/etc/ceph/ceph.conf 2023-08-11T12:24:42.492 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:42 smithi008 ceph-mon[97158]: Updating smithi194:/etc/ceph/ceph.conf 2023-08-11T12:24:42.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:42 smithi008 ceph-mon[97158]: Updating smithi045:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-11T12:24:42.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:42 smithi008 ceph-mon[97158]: Updating smithi194:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-11T12:24:42.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:42 smithi008 ceph-mon[97158]: pgmap v6: 129 pgs: 129 active+clean; 974 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:24:42.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:42 smithi008 ceph-mon[97158]: Updating smithi045:/etc/ceph/ceph.client.admin.keyring 2023-08-11T12:24:42.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:42 smithi008 ceph-mon[97158]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2023-08-11T12:24:42.495 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2023-08-11T12:24:42.602 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2023-08-11T12:24:42.608 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2023-08-11T12:24:42.643 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:42 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:42.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:42 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:42.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:42 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:42.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:42 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:42.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:42 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:42.644 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:42 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:42.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:42 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:42.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:42 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:42.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:42 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:42.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:42 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:42.646 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:42 smithi194 ceph-mon[130905]: Adjusting osd_memory_target on smithi008 to 222.0M 2023-08-11T12:24:42.646 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:42 smithi194 ceph-mon[130905]: Unable to set osd_memory_target on smithi008 to 232785100: error parsing value: Value '232785100' is below minimum 939524096 2023-08-11T12:24:42.646 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:42 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:24:42.646 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:42 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:24:42.646 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:42 smithi194 ceph-mon[130905]: Updating smithi008:/etc/ceph/ceph.conf 2023-08-11T12:24:42.646 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:42 smithi194 ceph-mon[130905]: Updating smithi045:/etc/ceph/ceph.conf 2023-08-11T12:24:42.646 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:42 smithi194 ceph-mon[130905]: Updating smithi194:/etc/ceph/ceph.conf 2023-08-11T12:24:42.647 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:42 smithi194 ceph-mon[130905]: Updating smithi045:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-11T12:24:42.647 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:42 smithi194 ceph-mon[130905]: Updating smithi194:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-11T12:24:42.647 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:42 smithi194 ceph-mon[130905]: pgmap v6: 129 pgs: 129 active+clean; 974 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:24:42.647 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:42 smithi194 ceph-mon[130905]: Updating smithi045:/etc/ceph/ceph.client.admin.keyring 2023-08-11T12:24:42.647 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:42 smithi194 ceph-mon[130905]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2023-08-11T12:24:42.648 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:42 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:42.648 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:42 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:42.648 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:42 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:42.648 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:42 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:42.649 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:42 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:42.649 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:42 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:42.649 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:42 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:42.650 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:42 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:42.650 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:42 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:42.650 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:42 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:24:42.650 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:42 smithi045 ceph-mon[130284]: Adjusting osd_memory_target on smithi008 to 222.0M 2023-08-11T12:24:42.650 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:42 smithi045 ceph-mon[130284]: Unable to set osd_memory_target on smithi008 to 232785100: error parsing value: Value '232785100' is below minimum 939524096 2023-08-11T12:24:42.650 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:42 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:24:42.650 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:42 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:24:42.651 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:42 smithi045 ceph-mon[130284]: Updating smithi008:/etc/ceph/ceph.conf 2023-08-11T12:24:42.651 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:42 smithi045 ceph-mon[130284]: Updating smithi045:/etc/ceph/ceph.conf 2023-08-11T12:24:42.651 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:42 smithi045 ceph-mon[130284]: Updating smithi194:/etc/ceph/ceph.conf 2023-08-11T12:24:42.651 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:42 smithi045 ceph-mon[130284]: Updating smithi045:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-11T12:24:42.652 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:42 smithi045 ceph-mon[130284]: Updating smithi194:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-11T12:24:42.652 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:42 smithi045 ceph-mon[130284]: pgmap v6: 129 pgs: 129 active+clean; 974 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-11T12:24:42.652 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:42 smithi045 ceph-mon[130284]: Updating smithi045:/etc/ceph/ceph.client.admin.keyring 2023-08-11T12:24:42.653 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:42 smithi045 ceph-mon[130284]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2023-08-11T12:24:42.721 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-08-11T12:24:42.824 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/: 2023-08-11T12:24:42.824 INFO:teuthology.orchestra.run.smithi008.stdout:total 0 2023-08-11T12:24:42.824 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 11 12:24 . 2023-08-11T12:24:42.825 INFO:teuthology.orchestra.run.smithi008.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Aug 11 12:24 .. 2023-08-11T12:24:42.825 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 data 2023-08-11T12:24:42.825 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:42.825 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data: 2023-08-11T12:24:42.825 INFO:teuthology.orchestra.run.smithi008.stdout:total 0 2023-08-11T12:24:42.825 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 . 2023-08-11T12:24:42.825 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 11 12:24 .. 2023-08-11T12:24:42.830 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2023-08-11T12:24:42.967 INFO:teuthology.orchestra.run.smithi008.stdout:[Service] 2023-08-11T12:24:42.967 INFO:teuthology.orchestra.run.smithi008.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2023-08-11T12:24:42.967 INFO:teuthology.orchestra.run.smithi008.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2023-08-11T12:24:42.972 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2023-08-11T12:24:43.198 INFO:teuthology.orchestra.run.smithi008.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2023-08-11T12:24:43.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:43 smithi008 ceph-mon[97158]: Updating smithi008:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-11T12:24:43.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:43 smithi008 ceph-mon[97158]: Updating smithi045:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-11T12:24:43.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:43 smithi008 ceph-mon[97158]: Updating smithi194:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-11T12:24:43.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:43 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:43.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:43 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:43.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:43 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:43.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:43 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:43.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:43 smithi008 ceph-mon[97158]: Updating smithi008:/etc/ceph/ceph.client.admin.keyring 2023-08-11T12:24:43.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:43 smithi194 ceph-mon[130905]: Updating smithi008:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-11T12:24:43.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:43 smithi194 ceph-mon[130905]: Updating smithi045:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-11T12:24:43.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:43 smithi194 ceph-mon[130905]: Updating smithi194:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-11T12:24:43.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:43 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:43.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:43 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:43.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:43 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:43.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:43 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:43.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:43 smithi194 ceph-mon[130905]: Updating smithi008:/etc/ceph/ceph.client.admin.keyring 2023-08-11T12:24:43.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:43 smithi045 ceph-mon[130284]: Updating smithi008:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-11T12:24:43.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:43 smithi045 ceph-mon[130284]: Updating smithi045:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-11T12:24:43.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:43 smithi045 ceph-mon[130284]: Updating smithi194:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-11T12:24:43.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:43 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:43.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:43 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:43.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:43 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:43.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:43 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:43.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:43 smithi045 ceph-mon[130284]: Updating smithi008:/etc/ceph/ceph.client.admin.keyring 2023-08-11T12:24:44.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:44 smithi194 ceph-mon[130905]: Updating smithi008:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-11T12:24:44.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:44 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:44.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:44 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:44.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:44 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:44.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:44 smithi194 ceph-mon[130905]: pgmap v7: 129 pgs: 129 active+clean; 1.2 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 132 KiB/s wr, 71 op/s 2023-08-11T12:24:44.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:44 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:24:44.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:44 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:24:44.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:44 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:24:44.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:44 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:44.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:44 smithi045 ceph-mon[130284]: Updating smithi008:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-11T12:24:44.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:44 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:44.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:44 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:44.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:44 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:44.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:44 smithi045 ceph-mon[130284]: pgmap v7: 129 pgs: 129 active+clean; 1.2 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 132 KiB/s wr, 71 op/s 2023-08-11T12:24:44.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:44 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:24:44.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:44 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:24:44.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:44 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:24:44.897 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:44 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:45.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:44 smithi008 ceph-mon[97158]: Updating smithi008:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-11T12:24:45.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:44 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:45.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:44 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:45.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:44 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:45.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:44 smithi008 ceph-mon[97158]: pgmap v7: 129 pgs: 129 active+clean; 1.2 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 132 KiB/s wr, 71 op/s 2023-08-11T12:24:45.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:44 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:24:45.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:44 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:24:45.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:44 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:24:45.055 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:44 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:24:47.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:46 smithi194 ceph-mon[130905]: pgmap v8: 129 pgs: 129 active+clean; 1.2 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 102 KiB/s wr, 55 op/s 2023-08-11T12:24:47.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:46 smithi045 ceph-mon[130284]: pgmap v8: 129 pgs: 129 active+clean; 1.2 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 102 KiB/s wr, 55 op/s 2023-08-11T12:24:47.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:46 smithi008 ceph-mon[97158]: pgmap v8: 129 pgs: 129 active+clean; 1.2 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 102 KiB/s wr, 55 op/s 2023-08-11T12:24:49.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:48 smithi194 ceph-mon[130905]: pgmap v9: 129 pgs: 129 active+clean; 5.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 491 KiB/s wr, 135 op/s 2023-08-11T12:24:49.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:48 smithi045 ceph-mon[130284]: pgmap v9: 129 pgs: 129 active+clean; 5.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 491 KiB/s wr, 135 op/s 2023-08-11T12:24:49.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:48 smithi008 ceph-mon[97158]: pgmap v9: 129 pgs: 129 active+clean; 5.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 491 KiB/s wr, 135 op/s 2023-08-11T12:24:51.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:50 smithi008 ceph-mon[97158]: pgmap v10: 129 pgs: 129 active+clean; 5.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 449 KiB/s wr, 123 op/s 2023-08-11T12:24:51.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:50 smithi194 ceph-mon[130905]: pgmap v10: 129 pgs: 129 active+clean; 5.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 449 KiB/s wr, 123 op/s 2023-08-11T12:24:51.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:50 smithi045 ceph-mon[130284]: pgmap v10: 129 pgs: 129 active+clean; 5.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 449 KiB/s wr, 123 op/s 2023-08-11T12:24:51.851 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.848+0000 7f43b3fff700 1 -- 172.21.15.8:0/1170875449 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43ac068450 msgr2=0x7f43ac0688d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:51.851 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.848+0000 7f43b3fff700 1 --2- 172.21.15.8:0/1170875449 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43ac068450 0x7f43ac0688d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f439c0098f0 tx=0x7f439c009c00 comp rx=0 tx=0).stop 2023-08-11T12:24:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.848+0000 7f43b3fff700 1 -- 172.21.15.8:0/1170875449 shutdown_connections 2023-08-11T12:24:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.848+0000 7f43b3fff700 1 --2- 172.21.15.8:0/1170875449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43ac10d130 0x7f43ac10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.848+0000 7f43b3fff700 1 --2- 172.21.15.8:0/1170875449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43ac1017b0 0x7f43ac067e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.848+0000 7f43b3fff700 1 --2- 172.21.15.8:0/1170875449 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43ac068450 0x7f43ac0688d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.848+0000 7f43b3fff700 1 -- 172.21.15.8:0/1170875449 >> 172.21.15.8:0/1170875449 conn(0x7f43ac075300 msgr2=0x7f43ac075710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.848+0000 7f43b3fff700 1 -- 172.21.15.8:0/1170875449 shutdown_connections 2023-08-11T12:24:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.848+0000 7f43b3fff700 1 -- 172.21.15.8:0/1170875449 wait complete. 2023-08-11T12:24:51.853 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.850+0000 7f43b3fff700 1 Processor -- start 2023-08-11T12:24:51.853 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.850+0000 7f43b3fff700 1 -- start start 2023-08-11T12:24:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.851+0000 7f43b3fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43ac068450 0x7f43ac101c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.851+0000 7f43b3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43ac10d130 0x7f43ac1021b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.851+0000 7f43b3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43ac1026f0 0x7f43ac1a9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.851+0000 7f43b3fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac1a9760 con 0x7f43ac1026f0 2023-08-11T12:24:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.851+0000 7f43b3fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac1a98a0 con 0x7f43ac10d130 2023-08-11T12:24:51.855 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.851+0000 7f43b3fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac1a99e0 con 0x7f43ac068450 2023-08-11T12:24:51.855 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.851+0000 7f43b1d9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43ac068450 0x7f43ac101c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:51.855 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.851+0000 7f43b1d9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43ac068450 0x7f43ac101c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:60928/0 (socket says 172.21.15.8:60928) 2023-08-11T12:24:51.855 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.851+0000 7f43b1d9b700 1 -- 172.21.15.8:0/2916856741 learned_addr learned my addr 172.21.15.8:0/2916856741 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:51.855 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.851+0000 7f43b159a700 1 --2- 172.21.15.8:0/2916856741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43ac10d130 0x7f43ac1021b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:51.855 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.851+0000 7f43b259c700 1 --2- 172.21.15.8:0/2916856741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43ac1026f0 0x7f43ac1a9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:51.856 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.851+0000 7f43b1d9b700 1 -- 172.21.15.8:0/2916856741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43ac10d130 msgr2=0x7f43ac1021b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:51.856 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.851+0000 7f43b1d9b700 1 --2- 172.21.15.8:0/2916856741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43ac10d130 0x7f43ac1021b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:51.856 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.851+0000 7f43b1d9b700 1 -- 172.21.15.8:0/2916856741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43ac1026f0 msgr2=0x7f43ac1a9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:51.856 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.851+0000 7f43b1d9b700 1 --2- 172.21.15.8:0/2916856741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43ac1026f0 0x7f43ac1a9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.851+0000 7f43b1d9b700 1 -- 172.21.15.8:0/2916856741 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439c009520 con 0x7f43ac068450 2023-08-11T12:24:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.851+0000 7f43b259c700 1 --2- 172.21.15.8:0/2916856741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43ac1026f0 0x7f43ac1a9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:24:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.852+0000 7f43b1d9b700 1 --2- 172.21.15.8:0/2916856741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43ac068450 0x7f43ac101c70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f43a800e9c0 tx=0x7f43a800ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.852+0000 7f43a2ffd700 1 -- 172.21.15.8:0/2916856741 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a800cbd0 con 0x7f43ac068450 2023-08-11T12:24:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.852+0000 7f43a2ffd700 1 -- 172.21.15.8:0/2916856741 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43a800cd30 con 0x7f43ac068450 2023-08-11T12:24:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.852+0000 7f43a2ffd700 1 -- 172.21.15.8:0/2916856741 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a8005580 con 0x7f43ac068450 2023-08-11T12:24:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.852+0000 7f43b3fff700 1 -- 172.21.15.8:0/2916856741 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ac1a9c70 con 0x7f43ac068450 2023-08-11T12:24:51.858 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.853+0000 7f43b3fff700 1 -- 172.21.15.8:0/2916856741 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ac1aa130 con 0x7f43ac068450 2023-08-11T12:24:51.859 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.856+0000 7f43a2ffd700 1 -- 172.21.15.8:0/2916856741 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 23) v1 ==== 134846+0+0 (secure 0 0 0) 0x7f43a8004750 con 0x7f43ac068450 2023-08-11T12:24:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.857+0000 7f43c78fcb80 1 Processor -- start 2023-08-11T12:24:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.857+0000 7f43a2ffd700 1 --2- 172.21.15.8:0/2916856741 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f43980a0150 0x7f43980a2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.857+0000 7f43c78fcb80 1 -- start start 2023-08-11T12:24:51.862 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.857+0000 7f43a2ffd700 1 -- 172.21.15.8:0/2916856741 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f43a8014070 con 0x7f43ac068450 2023-08-11T12:24:51.862 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.858+0000 7f43c78fcb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558966908e80 0x558966909260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:51.862 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.858+0000 7f43c78fcb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558966903630 0x558966903ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:51.862 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.858+0000 7f43b259c700 1 --2- 172.21.15.8:0/2916856741 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f43980a0150 0x7f43980a2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:51.862 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.858+0000 7f43c78fcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558966903ff0 0x55896690fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:51.862 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.858+0000 7f43c78fcb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896685c5d0 con 0x558966908e80 2023-08-11T12:24:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.858+0000 7f43c78fcb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558966859ef0 con 0x558966903630 2023-08-11T12:24:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.858+0000 7f43c78fcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589668557e0 con 0x558966903ff0 2023-08-11T12:24:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.858+0000 7f43b1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558966908e80 0x558966909260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.858+0000 7f43b1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558966908e80 0x558966909260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54174/0 (socket says 172.21.15.8:54174) 2023-08-11T12:24:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.858+0000 7f43b1d9b700 1 -- 172.21.15.8:0/2291301742 learned_addr learned my addr 172.21.15.8:0/2291301742 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.858+0000 7f43b159a700 1 --2- 172.21.15.8:0/2291301742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558966903630 0x558966903ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.858+0000 7f43b259c700 1 --2- 172.21.15.8:0/2291301742 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558966903ff0 0x55896690fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.858+0000 7f43b1d9b700 1 -- 172.21.15.8:0/2291301742 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558966903ff0 msgr2=0x55896690fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.858+0000 7f43b1d9b700 1 --2- 172.21.15.8:0/2291301742 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558966903ff0 0x55896690fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.858+0000 7f43b1d9b700 1 -- 172.21.15.8:0/2291301742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558966903630 msgr2=0x558966903ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.858+0000 7f43b1d9b700 1 --2- 172.21.15.8:0/2291301742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558966903630 0x558966903ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.858+0000 7f43b1d9b700 1 -- 172.21.15.8:0/2291301742 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589666d55d0 con 0x558966908e80 2023-08-11T12:24:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.858+0000 7f43b259c700 1 --2- 172.21.15.8:0/2291301742 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558966903ff0 0x55896690fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:24:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.859+0000 7f43b259c700 1 --2- 172.21.15.8:0/2916856741 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f43980a0150 0x7f43980a2610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f43ac068e60 tx=0x7f43a4007890 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.859+0000 7f43b1d9b700 1 --2- 172.21.15.8:0/2291301742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558966908e80 0x558966909260 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f43a8095530 tx=0x7f43a8098a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e0c5d5f835c432c server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.859+0000 7f4397fff700 1 -- 172.21.15.8:0/2291301742 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a80b0070 con 0x558966908e80 2023-08-11T12:24:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.859+0000 7f4397fff700 1 -- 172.21.15.8:0/2291301742 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43a8099030 con 0x558966908e80 2023-08-11T12:24:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.859+0000 7f4397fff700 1 -- 172.21.15.8:0/2291301742 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a80c9630 con 0x558966908e80 2023-08-11T12:24:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.860+0000 7f43c78fcb80 1 -- 172.21.15.8:0/2291301742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558966908e80 msgr2=0x558966909260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.860+0000 7f43c78fcb80 1 --2- 172.21.15.8:0/2291301742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558966908e80 0x558966909260 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f43a8095530 tx=0x7f43a8098a10 comp rx=0 tx=0).stop 2023-08-11T12:24:51.868 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.860+0000 7f43c78fcb80 1 -- 172.21.15.8:0/2291301742 shutdown_connections 2023-08-11T12:24:51.868 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.860+0000 7f43c78fcb80 1 --2- 172.21.15.8:0/2291301742 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558966903ff0 0x55896690fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:51.868 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.860+0000 7f43c78fcb80 1 --2- 172.21.15.8:0/2291301742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558966908e80 0x558966909260 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:51.868 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.860+0000 7f43c78fcb80 1 --2- 172.21.15.8:0/2291301742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558966903630 0x558966903ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:51.868 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.860+0000 7f43c78fcb80 1 -- 172.21.15.8:0/2291301742 >> 172.21.15.8:0/2291301742 conn(0x5589668308f0 msgr2=0x5589668fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:51.868 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.860+0000 7f43c78fcb80 1 -- 172.21.15.8:0/2291301742 shutdown_connections 2023-08-11T12:24:51.868 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.860+0000 7f43c78fcb80 1 -- 172.21.15.8:0/2291301742 wait complete. 2023-08-11T12:24:51.869 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.860+0000 7f43c78fcb80 1 -- start start 2023-08-11T12:24:51.869 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.861+0000 7f43c78fcb80 1 Processor -- start 2023-08-11T12:24:51.869 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.861+0000 7f43c78fcb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558966903630 0x558966912ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:51.869 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.861+0000 7f43c78fcb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558966903ff0 0x558966913000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:51.869 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.861+0000 7f43c78fcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558966908e80 0x55896690cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:51.869 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.861+0000 7f43c78fcb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589667f3a60 con 0x558966903630 2023-08-11T12:24:51.869 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.861+0000 7f43c78fcb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589667f3760 con 0x558966903ff0 2023-08-11T12:24:51.870 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.861+0000 7f43c78fcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589666d78c0 con 0x558966908e80 2023-08-11T12:24:51.870 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.861+0000 7f43c78fcb80 10 client.0 _ll_register_callbacks cb 0x5589667f6a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:51.870 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.861+0000 7f43b1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558966903630 0x558966912ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:51.870 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.862+0000 7f43b1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558966903630 0x558966912ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54188/0 (socket says 172.21.15.8:54188) 2023-08-11T12:24:51.870 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.862+0000 7f43b259c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558966908e80 0x55896690cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:51.870 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.862+0000 7f43b1d9b700 1 -- 172.21.15.8:0/1317539952 learned_addr learned my addr 172.21.15.8:0/1317539952 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:51.870 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.862+0000 7f43b159a700 1 --2- 172.21.15.8:0/1317539952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558966903ff0 0x558966913000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:51.870 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.862+0000 7f43b1d9b700 1 -- 172.21.15.8:0/1317539952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558966908e80 msgr2=0x55896690cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.862+0000 7f43b1d9b700 1 --2- 172.21.15.8:0/1317539952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558966908e80 0x55896690cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.862+0000 7f43b1d9b700 1 -- 172.21.15.8:0/1317539952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558966903ff0 msgr2=0x558966913000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.862+0000 7f43b1d9b700 1 --2- 172.21.15.8:0/1317539952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558966903ff0 0x558966913000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.862+0000 7f43b1d9b700 1 -- 172.21.15.8:0/1317539952 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ac1aa130 con 0x558966903630 2023-08-11T12:24:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.862+0000 7f43b1d9b700 1 --2- 172.21.15.8:0/1317539952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558966903630 0x558966912ac0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f43a800c5b0 tx=0x7f43a8095370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700eb8ea6ce32e79 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.862+0000 7f43957fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:24:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.862+0000 7f43957fa700 1 -- 172.21.15.8:0/1317539952 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a80b0040 con 0x558966903630 2023-08-11T12:24:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.862+0000 7f43957fa700 1 -- 172.21.15.8:0/1317539952 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f43a80a0e40 con 0x558966903630 2023-08-11T12:24:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.862+0000 7f43c78fcb80 1 -- 172.21.15.8:0/1317539952 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5589668f67e0 con 0x558966903630 2023-08-11T12:24:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.863+0000 7f43957fa700 1 -- 172.21.15.8:0/1317539952 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43a80b1210 con 0x558966903630 2023-08-11T12:24:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.863+0000 7f43c78fcb80 10 client.15663 fetch_fsmap learned FSMap version 27 2023-08-11T12:24:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.863+0000 7f43c78fcb80 1 -- 172.21.15.8:0/1317539952 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x558966681d80 con 0x558966903630 2023-08-11T12:24:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.863+0000 7f43957fa700 1 -- 172.21.15.8:0/1317539952 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5589668f67e0 con 0x558966903630 2023-08-11T12:24:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.863+0000 7f43957fa700 1 -- 172.21.15.8:0/1317539952 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f43a8094e20 con 0x558966903630 2023-08-11T12:24:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.863+0000 7f43c78fcb80 10 client.15663 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:24:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.863+0000 7f43c78fcb80 10 client.15663 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-11T12:24:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.863+0000 7f43c78fcb80 20 client.15663 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.863+0000 7f43c78fcb80 1 --2- 172.21.15.8:0/1317539952 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55896691cb80 0x55896691ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.863+0000 7f43c78fcb80 4 client.15663 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:24:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.863+0000 7f43c78fcb80 1 -- 172.21.15.8:0/1317539952 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5589668d2480 con 0x55896691cb80 2023-08-11T12:24:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.864+0000 7f43b159a700 1 --2- 172.21.15.8:0/1317539952 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55896691cb80 0x55896691ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.864+0000 7f43957fa700 10 client.15663 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:24:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.864+0000 7f43b159a700 1 --2- 172.21.15.8:0/1317539952 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55896691cb80 0x55896691ef70 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fda6b1741f01bf7f server_cookie=502ee8562e7483b4 in_seq=0 out_seq=0 2023-08-11T12:24:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.865+0000 7f43957fa700 1 -- 172.21.15.8:0/1317539952 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5589668d2480 con 0x55896691cb80 2023-08-11T12:24:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.865+0000 7f43957fa700 10 client.15663 handle_command_reply: tid=0 2023-08-11T12:24:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.865+0000 7f43c78fcb80 1 client.15663 shutdown 2023-08-11T12:24:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.865+0000 7f43c78fcb80 1 -- 172.21.15.8:0/1317539952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558966903630 msgr2=0x558966912ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.865+0000 7f43c78fcb80 1 --2- 172.21.15.8:0/1317539952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558966903630 0x558966912ac0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f43a800c5b0 tx=0x7f43a8095370 comp rx=0 tx=0).stop 2023-08-11T12:24:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.865+0000 7f43c78fcb80 1 -- 172.21.15.8:0/1317539952 shutdown_connections 2023-08-11T12:24:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.865+0000 7f43c78fcb80 1 --2- 172.21.15.8:0/1317539952 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55896691cb80 0x55896691ef70 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.865+0000 7f43c78fcb80 1 --2- 172.21.15.8:0/1317539952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558966908e80 0x55896690cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.865+0000 7f43c78fcb80 1 --2- 172.21.15.8:0/1317539952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558966903630 0x558966912ac0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.865+0000 7f43957fa700 0 client.15663 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:24:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.865+0000 7f43c78fcb80 1 --2- 172.21.15.8:0/1317539952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558966903ff0 0x558966913000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.865+0000 7f43c78fcb80 1 -- 172.21.15.8:0/1317539952 >> 172.21.15.8:0/1317539952 conn(0x5589668308f0 msgr2=0x5589668fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.865+0000 7f43c78fcb80 1 -- 172.21.15.8:0/1317539952 shutdown_connections 2023-08-11T12:24:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.865+0000 7f43c78fcb80 1 -- 172.21.15.8:0/1317539952 wait complete. 2023-08-11T12:24:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.866+0000 7f43c78fcb80 20 client.15663 trim_cache size 0 max 16384 2023-08-11T12:24:51.883 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.881+0000 7f43c78fcb80 1 Processor -- start 2023-08-11T12:24:51.884 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.881+0000 7f43c78fcb80 1 -- start start 2023-08-11T12:24:51.885 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.881+0000 7f43c78fcb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558966903630 0x55896690a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:51.885 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.881+0000 7f43c78fcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558966903ff0 0x5589669238a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:51.885 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.881+0000 7f43c78fcb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558966908e80 0x558966912620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:51.885 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.881+0000 7f43c78fcb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589668ffdb0 con 0x558966908e80 2023-08-11T12:24:51.885 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.881+0000 7f43c78fcb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589668fe840 con 0x558966903630 2023-08-11T12:24:51.885 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.881+0000 7f43c78fcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589668f6570 con 0x558966903ff0 2023-08-11T12:24:51.885 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.881+0000 7f43b259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558966908e80 0x558966912620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:51.886 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.881+0000 7f43b159a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558966903ff0 0x5589669238a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:51.886 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.881+0000 7f43b1d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558966903630 0x55896690a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:51.886 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.881+0000 7f43b259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558966908e80 0x558966912620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54200/0 (socket says 172.21.15.8:54200) 2023-08-11T12:24:51.886 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.881+0000 7f43b259c700 1 -- 172.21.15.8:0/767326205 learned_addr learned my addr 172.21.15.8:0/767326205 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:51.886 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.882+0000 7f43b259c700 1 -- 172.21.15.8:0/767326205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558966903ff0 msgr2=0x5589669238a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:51.886 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.882+0000 7f43b259c700 1 --2- 172.21.15.8:0/767326205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558966903ff0 0x5589669238a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:51.886 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.882+0000 7f43b259c700 1 -- 172.21.15.8:0/767326205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558966903630 msgr2=0x55896690a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:51.887 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.882+0000 7f43b259c700 1 --2- 172.21.15.8:0/767326205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558966903630 0x55896690a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:51.887 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.882+0000 7f43b259c700 1 -- 172.21.15.8:0/767326205 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55896666ac00 con 0x558966908e80 2023-08-11T12:24:51.887 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.882+0000 7f43b259c700 1 --2- 172.21.15.8:0/767326205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558966908e80 0x558966912620 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f43a40187a0 tx=0x7f43a401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac9226e6ac652d2 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:51.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.882+0000 7f43a0ff9700 1 -- 172.21.15.8:0/767326205 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a400e050 con 0x558966908e80 2023-08-11T12:24:51.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.882+0000 7f43a0ff9700 1 -- 172.21.15.8:0/767326205 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43a400f040 con 0x558966908e80 2023-08-11T12:24:51.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.882+0000 7f43a0ff9700 1 -- 172.21.15.8:0/767326205 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a4017840 con 0x558966908e80 2023-08-11T12:24:51.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.883+0000 7f43c78fcb80 1 -- 172.21.15.8:0/767326205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558966908e80 msgr2=0x558966912620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.883+0000 7f43c78fcb80 1 --2- 172.21.15.8:0/767326205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558966908e80 0x558966912620 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f43a40187a0 tx=0x7f43a401a000 comp rx=0 tx=0).stop 2023-08-11T12:24:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.883+0000 7f43c78fcb80 1 -- 172.21.15.8:0/767326205 shutdown_connections 2023-08-11T12:24:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.883+0000 7f43c78fcb80 1 --2- 172.21.15.8:0/767326205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558966908e80 0x558966912620 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.883+0000 7f43c78fcb80 1 --2- 172.21.15.8:0/767326205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558966903630 0x55896690a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.883+0000 7f43c78fcb80 1 --2- 172.21.15.8:0/767326205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558966903ff0 0x5589669238a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.883+0000 7f43c78fcb80 1 -- 172.21.15.8:0/767326205 >> 172.21.15.8:0/767326205 conn(0x5589668308f0 msgr2=0x558966907070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.883+0000 7f43c78fcb80 1 -- 172.21.15.8:0/767326205 shutdown_connections 2023-08-11T12:24:51.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.883+0000 7f43c78fcb80 1 -- 172.21.15.8:0/767326205 wait complete. 2023-08-11T12:24:51.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.883+0000 7f43c78fcb80 1 -- start start 2023-08-11T12:24:51.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.884+0000 7f43c78fcb80 1 Processor -- start 2023-08-11T12:24:51.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.884+0000 7f43c78fcb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558966903630 0x558966964950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:51.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.884+0000 7f43c78fcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558966903ff0 0x558966964e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:51.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.884+0000 7f43c78fcb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558966908e80 0x558966969820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:51.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.884+0000 7f43c78fcb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558966969d90 con 0x558966903630 2023-08-11T12:24:51.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.884+0000 7f43c78fcb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558966969f00 con 0x558966908e80 2023-08-11T12:24:51.892 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.884+0000 7f43c78fcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896696a0c0 con 0x558966903ff0 2023-08-11T12:24:51.892 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.884+0000 7f43c78fcb80 10 client.0 _ll_register_callbacks cb 0x7f43a80091e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:51.892 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.884+0000 7f43b1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558966903630 0x558966964950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:51.892 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.885+0000 7f43b1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558966903630 0x558966964950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54208/0 (socket says 172.21.15.8:54208) 2023-08-11T12:24:51.892 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.885+0000 7f43b1d9b700 1 -- 172.21.15.8:0/1673410753 learned_addr learned my addr 172.21.15.8:0/1673410753 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:51.892 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.885+0000 7f43b259c700 1 --2- 172.21.15.8:0/1673410753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558966908e80 0x558966969820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:51.892 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.885+0000 7f43b159a700 1 --2- 172.21.15.8:0/1673410753 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558966903ff0 0x558966964e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:51.893 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.885+0000 7f43b1d9b700 1 -- 172.21.15.8:0/1673410753 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558966903ff0 msgr2=0x558966964e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:51.893 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.885+0000 7f43b1d9b700 1 --2- 172.21.15.8:0/1673410753 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558966903ff0 0x558966964e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:51.893 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.885+0000 7f43b1d9b700 1 -- 172.21.15.8:0/1673410753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558966908e80 msgr2=0x558966969820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:51.893 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.885+0000 7f43b1d9b700 1 --2- 172.21.15.8:0/1673410753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558966908e80 0x558966969820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:51.893 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.885+0000 7f43b1d9b700 1 -- 172.21.15.8:0/1673410753 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a4018450 con 0x558966903630 2023-08-11T12:24:51.893 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.885+0000 7f43b1d9b700 1 --2- 172.21.15.8:0/1673410753 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558966903630 0x558966964950 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f43a8005950 tx=0x7f43a80952d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae3b2988a366949 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:51.893 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.885+0000 7f43957fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:24:51.893 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.885+0000 7f43957fa700 1 -- 172.21.15.8:0/1673410753 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a80b0070 con 0x558966903630 2023-08-11T12:24:51.894 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.885+0000 7f43957fa700 1 -- 172.21.15.8:0/1673410753 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f43a8098310 con 0x558966903630 2023-08-11T12:24:51.894 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.885+0000 7f43c78fcb80 1 -- 172.21.15.8:0/1673410753 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f43a8099030 con 0x558966903630 2023-08-11T12:24:51.894 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.886+0000 7f43957fa700 1 -- 172.21.15.8:0/1673410753 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43a80b1210 con 0x558966903630 2023-08-11T12:24:51.894 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.886+0000 7f43c78fcb80 10 client.15669 fetch_fsmap learned FSMap version 27 2023-08-11T12:24:51.894 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.886+0000 7f43c78fcb80 1 -- 172.21.15.8:0/1673410753 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5589666a81f0 con 0x558966903630 2023-08-11T12:24:51.894 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.886+0000 7f43957fa700 1 -- 172.21.15.8:0/1673410753 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43a8099030 con 0x558966903630 2023-08-11T12:24:51.894 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.886+0000 7f43957fa700 1 -- 172.21.15.8:0/1673410753 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f43a80a0a40 con 0x558966903630 2023-08-11T12:24:51.895 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.886+0000 7f43c78fcb80 10 client.15669 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:24:51.895 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.886+0000 7f43c78fcb80 10 client.15669 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-11T12:24:51.895 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.886+0000 7f43c78fcb80 20 client.15669 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:51.895 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.886+0000 7f43c78fcb80 1 --2- 172.21.15.8:0/1673410753 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5589669713c0 0x5589669737b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:51.895 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.886+0000 7f43c78fcb80 4 client.15669 mds_command: new command op to 24575 tid=0[{"prefix": "flush journal"}] 2023-08-11T12:24:51.895 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.886+0000 7f43c78fcb80 1 -- 172.21.15.8:0/1673410753 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55896684e7c0 con 0x5589669713c0 2023-08-11T12:24:51.895 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.886+0000 7f43b159a700 1 --2- 172.21.15.8:0/1673410753 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5589669713c0 0x5589669737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:51.896 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.887+0000 7f43b159a700 1 --2- 172.21.15.8:0/1673410753 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5589669713c0 0x5589669737b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc51c0438507907e server_cookie=8f5c502d2db8929a in_seq=0 out_seq=0 2023-08-11T12:24:51.896 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:51.887+0000 7f43957fa700 10 client.15669 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:24:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:52.201+0000 7f43957fa700 1 -- 172.21.15.8:0/1673410753 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55896684e7c0 con 0x5589669713c0 2023-08-11T12:24:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:52.201+0000 7f43957fa700 10 client.15669 handle_command_reply: tid=0 2023-08-11T12:24:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:52.201+0000 7f43c78fcb80 1 client.15669 shutdown 2023-08-11T12:24:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:52.201+0000 7f43c78fcb80 1 -- 172.21.15.8:0/1673410753 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558966903630 msgr2=0x558966964950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:52.201+0000 7f43c78fcb80 1 --2- 172.21.15.8:0/1673410753 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558966903630 0x558966964950 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f43a8005950 tx=0x7f43a80952d0 comp rx=0 tx=0).stop 2023-08-11T12:24:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:52.201+0000 7f43c78fcb80 1 -- 172.21.15.8:0/1673410753 shutdown_connections 2023-08-11T12:24:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:52.201+0000 7f43c78fcb80 1 --2- 172.21.15.8:0/1673410753 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5589669713c0 0x5589669737b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:52.201+0000 7f43c78fcb80 1 --2- 172.21.15.8:0/1673410753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558966908e80 0x558966969820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:52.201+0000 7f43c78fcb80 1 --2- 172.21.15.8:0/1673410753 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558966903630 0x558966964950 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:52.201+0000 7f43c78fcb80 1 --2- 172.21.15.8:0/1673410753 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558966903ff0 0x558966964e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:52.201+0000 7f43957fa700 0 client.15669 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:24:52.208 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:52.201+0000 7f43c78fcb80 1 -- 172.21.15.8:0/1673410753 >> 172.21.15.8:0/1673410753 conn(0x5589668308f0 msgr2=0x55896690c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:52.208 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:52.201+0000 7f43c78fcb80 1 -- 172.21.15.8:0/1673410753 shutdown_connections 2023-08-11T12:24:52.208 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:52.201+0000 7f43c78fcb80 1 -- 172.21.15.8:0/1673410753 wait complete. 2023-08-11T12:24:52.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:52.202+0000 7f43c78fcb80 20 client.15669 trim_cache size 0 max 16384 2023-08-11T12:24:52.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-08-11T12:24:52.210 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-08-11T12:24:52.210 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-08-11T12:24:52.210 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-08-11T12:24:52.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:52.202+0000 7f43b3fff700 1 -- 172.21.15.8:0/2916856741 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f43980a0150 msgr2=0x7f43980a2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:52.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:52.202+0000 7f43b3fff700 1 --2- 172.21.15.8:0/2916856741 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f43980a0150 0x7f43980a2610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f43ac068e60 tx=0x7f43a4007890 comp rx=0 tx=0).stop 2023-08-11T12:24:52.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:52.202+0000 7f43b3fff700 1 -- 172.21.15.8:0/2916856741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43ac068450 msgr2=0x7f43ac101c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:52.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:52.202+0000 7f43b3fff700 1 --2- 172.21.15.8:0/2916856741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43ac068450 0x7f43ac101c70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f43a800e9c0 tx=0x7f43a800ed80 comp rx=0 tx=0).stop 2023-08-11T12:24:52.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:52.202+0000 7f43b3fff700 1 -- 172.21.15.8:0/2916856741 shutdown_connections 2023-08-11T12:24:52.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:52.202+0000 7f43b3fff700 1 --2- 172.21.15.8:0/2916856741 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f43980a0150 0x7f43980a2610 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:52.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:52.202+0000 7f43b3fff700 1 --2- 172.21.15.8:0/2916856741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43ac068450 0x7f43ac101c70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:52.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:52.202+0000 7f43b3fff700 1 --2- 172.21.15.8:0/2916856741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43ac1026f0 0x7f43ac1a9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:52.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:52.202+0000 7f43b3fff700 1 --2- 172.21.15.8:0/2916856741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43ac10d130 0x7f43ac1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:52.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:52.202+0000 7f43b3fff700 1 -- 172.21.15.8:0/2916856741 >> 172.21.15.8:0/2916856741 conn(0x7f43ac075300 msgr2=0x7f43ac0fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:52.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:52.202+0000 7f43b3fff700 1 -- 172.21.15.8:0/2916856741 shutdown_connections 2023-08-11T12:24:52.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:24:52.202+0000 7f43b3fff700 1 -- 172.21.15.8:0/2916856741 wait complete. 2023-08-11T12:24:53.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:52 smithi194 ceph-mon[130905]: pgmap v11: 129 pgs: 129 active+clean; 5.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 449 KiB/s wr, 123 op/s 2023-08-11T12:24:53.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:52 smithi045 ceph-mon[130284]: pgmap v11: 129 pgs: 129 active+clean; 5.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 449 KiB/s wr, 123 op/s 2023-08-11T12:24:53.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:52 smithi008 ceph-mon[97158]: pgmap v11: 129 pgs: 129 active+clean; 5.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 449 KiB/s wr, 123 op/s 2023-08-11T12:24:54.342 INFO:teuthology.orchestra.run.smithi008.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2023-08-11T12:24:54.348 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-08-11T12:24:54.464 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/: 2023-08-11T12:24:54.464 INFO:teuthology.orchestra.run.smithi008.stdout:total 0 2023-08-11T12:24:54.465 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 11 12:24 . 2023-08-11T12:24:54.465 INFO:teuthology.orchestra.run.smithi008.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Aug 11 12:24 .. 2023-08-11T12:24:54.465 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 11 12:24 data 2023-08-11T12:24:54.465 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:54.465 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data: 2023-08-11T12:24:54.465 INFO:teuthology.orchestra.run.smithi008.stdout:total 30 2023-08-11T12:24:54.466 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 11 12:24 . 2023-08-11T12:24:54.466 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 11 12:24 .. 2023-08-11T12:24:54.466 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 11 12:24 base 2023-08-11T12:24:54.466 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Aug 11 12:24 global 2023-08-11T12:24:54.466 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 log 2023-08-11T12:24:54.467 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 pg_commit_ts 2023-08-11T12:24:54.467 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 pg_dynshmem 2023-08-11T12:24:54.467 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4269 Aug 11 12:24 pg_hba.conf 2023-08-11T12:24:54.467 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Aug 11 12:24 pg_ident.conf 2023-08-11T12:24:54.467 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 11 12:24 pg_logical 2023-08-11T12:24:54.467 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 11 12:24 pg_multixact 2023-08-11T12:24:54.468 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 11 12:24 pg_notify 2023-08-11T12:24:54.468 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 pg_replslot 2023-08-11T12:24:54.468 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 pg_serial 2023-08-11T12:24:54.469 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 pg_snapshots 2023-08-11T12:24:54.469 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 pg_stat 2023-08-11T12:24:54.469 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 pg_stat_tmp 2023-08-11T12:24:54.469 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 11 12:24 pg_subtrans 2023-08-11T12:24:54.470 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 pg_tblspc 2023-08-11T12:24:54.470 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 pg_twophase 2023-08-11T12:24:54.470 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 11 12:24 PG_VERSION 2023-08-11T12:24:54.470 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 11 12:24 pg_wal 2023-08-11T12:24:54.471 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 11 12:24 pg_xact 2023-08-11T12:24:54.471 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Aug 11 12:24 postgresql.auto.conf 2023-08-11T12:24:54.471 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 22989 Aug 11 12:24 postgresql.conf 2023-08-11T12:24:54.472 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:54.472 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/base: 2023-08-11T12:24:54.472 INFO:teuthology.orchestra.run.smithi008.stdout:total 0 2023-08-11T12:24:54.472 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 11 12:24 . 2023-08-11T12:24:54.473 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 11 12:24 .. 2023-08-11T12:24:54.473 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Aug 11 12:24 1 2023-08-11T12:24:54.473 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Aug 11 12:24 12346 2023-08-11T12:24:54.473 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Aug 11 12:24 12347 2023-08-11T12:24:54.474 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:54.474 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/base/1: 2023-08-11T12:24:54.474 INFO:teuthology.orchestra.run.smithi008.stdout:total 7217 2023-08-11T12:24:54.474 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Aug 11 12:24 . 2023-08-11T12:24:54.474 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 11 12:24 .. 2023-08-11T12:24:54.474 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 112 2023-08-11T12:24:54.475 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 113 2023-08-11T12:24:54.475 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Aug 11 12:24 12182 2023-08-11T12:24:54.475 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 12182_fsm 2023-08-11T12:24:54.475 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12182_vm 2023-08-11T12:24:54.475 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 12184 2023-08-11T12:24:54.475 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12186 2023-08-11T12:24:54.475 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12187 2023-08-11T12:24:54.475 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 12187_fsm 2023-08-11T12:24:54.476 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12187_vm 2023-08-11T12:24:54.476 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 12189 2023-08-11T12:24:54.476 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12191 2023-08-11T12:24:54.476 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12192 2023-08-11T12:24:54.476 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 12192_fsm 2023-08-11T12:24:54.476 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12192_vm 2023-08-11T12:24:54.476 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 12194 2023-08-11T12:24:54.477 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12196 2023-08-11T12:24:54.477 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12197 2023-08-11T12:24:54.477 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 12197_fsm 2023-08-11T12:24:54.477 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12197_vm 2023-08-11T12:24:54.477 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 12199 2023-08-11T12:24:54.477 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12201 2023-08-11T12:24:54.478 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12202 2023-08-11T12:24:54.478 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 12202_fsm 2023-08-11T12:24:54.478 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12202_vm 2023-08-11T12:24:54.478 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 12204 2023-08-11T12:24:54.478 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12206 2023-08-11T12:24:54.478 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12207 2023-08-11T12:24:54.478 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 12207_fsm 2023-08-11T12:24:54.478 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12207_vm 2023-08-11T12:24:54.479 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 12209 2023-08-11T12:24:54.479 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12211 2023-08-11T12:24:54.479 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 12212 2023-08-11T12:24:54.479 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 12214 2023-08-11T12:24:54.479 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12216 2023-08-11T12:24:54.479 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Aug 11 12:24 1247 2023-08-11T12:24:54.480 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 1247_fsm 2023-08-11T12:24:54.480 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 1247_vm 2023-08-11T12:24:54.480 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Aug 11 12:24 1249 2023-08-11T12:24:54.480 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 1249_fsm 2023-08-11T12:24:54.480 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 1249_vm 2023-08-11T12:24:54.480 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Aug 11 12:24 1255 2023-08-11T12:24:54.480 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 1255_fsm 2023-08-11T12:24:54.481 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 1255_vm 2023-08-11T12:24:54.481 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Aug 11 12:24 1259 2023-08-11T12:24:54.481 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 1259_fsm 2023-08-11T12:24:54.481 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 1259_vm 2023-08-11T12:24:54.481 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 1417 2023-08-11T12:24:54.481 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 1417_vm 2023-08-11T12:24:54.481 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 1418 2023-08-11T12:24:54.481 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 1418_vm 2023-08-11T12:24:54.482 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 174 2023-08-11T12:24:54.482 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 175 2023-08-11T12:24:54.482 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2187 2023-08-11T12:24:54.482 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2224 2023-08-11T12:24:54.482 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2224_vm 2023-08-11T12:24:54.482 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2328 2023-08-11T12:24:54.482 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2328_vm 2023-08-11T12:24:54.482 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2336 2023-08-11T12:24:54.483 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2336_vm 2023-08-11T12:24:54.483 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2337 2023-08-11T12:24:54.483 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2600 2023-08-11T12:24:54.483 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2600_fsm 2023-08-11T12:24:54.483 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2600_vm 2023-08-11T12:24:54.483 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2601 2023-08-11T12:24:54.483 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2601_fsm 2023-08-11T12:24:54.484 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2601_vm 2023-08-11T12:24:54.484 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 11 12:24 2602 2023-08-11T12:24:54.484 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2602_fsm 2023-08-11T12:24:54.484 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2602_vm 2023-08-11T12:24:54.484 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 11 12:24 2603 2023-08-11T12:24:54.484 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2603_fsm 2023-08-11T12:24:54.484 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2603_vm 2023-08-11T12:24:54.484 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2604 2023-08-11T12:24:54.485 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2604_vm 2023-08-11T12:24:54.485 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2605 2023-08-11T12:24:54.485 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2605_fsm 2023-08-11T12:24:54.485 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2605_vm 2023-08-11T12:24:54.485 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2606 2023-08-11T12:24:54.485 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2606_fsm 2023-08-11T12:24:54.485 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2606_vm 2023-08-11T12:24:54.486 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2607 2023-08-11T12:24:54.486 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2607_fsm 2023-08-11T12:24:54.486 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2607_vm 2023-08-11T12:24:54.486 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Aug 11 12:24 2608 2023-08-11T12:24:54.486 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2608_fsm 2023-08-11T12:24:54.486 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2608_vm 2023-08-11T12:24:54.486 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Aug 11 12:24 2609 2023-08-11T12:24:54.486 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2609_fsm 2023-08-11T12:24:54.487 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2609_vm 2023-08-11T12:24:54.487 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2610 2023-08-11T12:24:54.487 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2610_fsm 2023-08-11T12:24:54.487 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2610_vm 2023-08-11T12:24:54.487 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2611 2023-08-11T12:24:54.487 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2611_vm 2023-08-11T12:24:54.488 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2612 2023-08-11T12:24:54.488 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2612_fsm 2023-08-11T12:24:54.488 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2612_vm 2023-08-11T12:24:54.488 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2613 2023-08-11T12:24:54.488 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2613_vm 2023-08-11T12:24:54.488 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2615 2023-08-11T12:24:54.489 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2615_fsm 2023-08-11T12:24:54.489 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2615_vm 2023-08-11T12:24:54.489 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2616 2023-08-11T12:24:54.489 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2616_fsm 2023-08-11T12:24:54.489 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2616_vm 2023-08-11T12:24:54.490 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Aug 11 12:24 2617 2023-08-11T12:24:54.490 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2617_fsm 2023-08-11T12:24:54.490 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2617_vm 2023-08-11T12:24:54.490 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Aug 11 12:24 2618 2023-08-11T12:24:54.490 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2618_fsm 2023-08-11T12:24:54.490 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2618_vm 2023-08-11T12:24:54.490 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Aug 11 12:24 2619 2023-08-11T12:24:54.490 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2619_fsm 2023-08-11T12:24:54.491 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2619_vm 2023-08-11T12:24:54.491 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2620 2023-08-11T12:24:54.491 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2620_vm 2023-08-11T12:24:54.491 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2650 2023-08-11T12:24:54.491 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2651 2023-08-11T12:24:54.491 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2652 2023-08-11T12:24:54.491 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 11 12:24 2653 2023-08-11T12:24:54.491 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 11 12:24 2654 2023-08-11T12:24:54.492 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 11 12:24 2655 2023-08-11T12:24:54.492 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2656 2023-08-11T12:24:54.492 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2657 2023-08-11T12:24:54.492 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Aug 11 12:24 2658 2023-08-11T12:24:54.492 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 11 12:24 2659 2023-08-11T12:24:54.492 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2660 2023-08-11T12:24:54.492 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2661 2023-08-11T12:24:54.493 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 11 12:24 2662 2023-08-11T12:24:54.493 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 11 12:24 2663 2023-08-11T12:24:54.493 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2664 2023-08-11T12:24:54.493 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2665 2023-08-11T12:24:54.493 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2666 2023-08-11T12:24:54.493 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2667 2023-08-11T12:24:54.493 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2668 2023-08-11T12:24:54.493 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2669 2023-08-11T12:24:54.494 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2670 2023-08-11T12:24:54.494 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Aug 11 12:24 2673 2023-08-11T12:24:54.494 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 385024 Aug 11 12:24 2674 2023-08-11T12:24:54.494 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Aug 11 12:24 2675 2023-08-11T12:24:54.495 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2678 2023-08-11T12:24:54.495 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2679 2023-08-11T12:24:54.495 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2680 2023-08-11T12:24:54.495 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2681 2023-08-11T12:24:54.495 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2682 2023-08-11T12:24:54.495 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2683 2023-08-11T12:24:54.495 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2684 2023-08-11T12:24:54.495 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2685 2023-08-11T12:24:54.496 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2686 2023-08-11T12:24:54.496 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2687 2023-08-11T12:24:54.496 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 11 12:24 2688 2023-08-11T12:24:54.496 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 11 12:24 2689 2023-08-11T12:24:54.496 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 11 12:24 2690 2023-08-11T12:24:54.496 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Aug 11 12:24 2691 2023-08-11T12:24:54.496 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2692 2023-08-11T12:24:54.497 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2693 2023-08-11T12:24:54.497 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2696 2023-08-11T12:24:54.497 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2699 2023-08-11T12:24:54.497 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2701 2023-08-11T12:24:54.497 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2702 2023-08-11T12:24:54.497 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2703 2023-08-11T12:24:54.497 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 11 12:24 2704 2023-08-11T12:24:54.497 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2753 2023-08-11T12:24:54.498 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2753_fsm 2023-08-11T12:24:54.498 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2753_vm 2023-08-11T12:24:54.498 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2754 2023-08-11T12:24:54.498 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2755 2023-08-11T12:24:54.498 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 11 12:24 2756 2023-08-11T12:24:54.498 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 11 12:24 2757 2023-08-11T12:24:54.499 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2830 2023-08-11T12:24:54.499 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2830_vm 2023-08-11T12:24:54.499 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2831 2023-08-11T12:24:54.499 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2832 2023-08-11T12:24:54.499 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2832_vm 2023-08-11T12:24:54.499 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2833 2023-08-11T12:24:54.499 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2834 2023-08-11T12:24:54.500 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2834_vm 2023-08-11T12:24:54.500 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2835 2023-08-11T12:24:54.500 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2836 2023-08-11T12:24:54.500 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2836_vm 2023-08-11T12:24:54.500 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2837 2023-08-11T12:24:54.500 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Aug 11 12:24 2838 2023-08-11T12:24:54.500 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2838_fsm 2023-08-11T12:24:54.501 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2838_vm 2023-08-11T12:24:54.501 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2839 2023-08-11T12:24:54.501 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2840 2023-08-11T12:24:54.501 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2840_fsm 2023-08-11T12:24:54.501 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2840_vm 2023-08-11T12:24:54.501 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2841 2023-08-11T12:24:54.501 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2995 2023-08-11T12:24:54.502 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2995_vm 2023-08-11T12:24:54.502 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2996 2023-08-11T12:24:54.502 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3079 2023-08-11T12:24:54.502 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 3079_fsm 2023-08-11T12:24:54.502 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3079_vm 2023-08-11T12:24:54.502 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3080 2023-08-11T12:24:54.503 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3081 2023-08-11T12:24:54.503 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3085 2023-08-11T12:24:54.503 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3118 2023-08-11T12:24:54.503 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3118_vm 2023-08-11T12:24:54.503 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3119 2023-08-11T12:24:54.503 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3164 2023-08-11T12:24:54.503 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3256 2023-08-11T12:24:54.503 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3256_vm 2023-08-11T12:24:54.504 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3257 2023-08-11T12:24:54.504 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3258 2023-08-11T12:24:54.504 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3350 2023-08-11T12:24:54.504 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3350_vm 2023-08-11T12:24:54.504 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3351 2023-08-11T12:24:54.504 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3379 2023-08-11T12:24:54.504 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3380 2023-08-11T12:24:54.504 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3381 2023-08-11T12:24:54.505 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3381_vm 2023-08-11T12:24:54.505 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3394 2023-08-11T12:24:54.505 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 3394_fsm 2023-08-11T12:24:54.505 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3394_vm 2023-08-11T12:24:54.505 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3395 2023-08-11T12:24:54.505 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3439 2023-08-11T12:24:54.505 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3439_vm 2023-08-11T12:24:54.506 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3440 2023-08-11T12:24:54.506 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 11 12:24 3455 2023-08-11T12:24:54.506 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3456 2023-08-11T12:24:54.506 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 3456_fsm 2023-08-11T12:24:54.506 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3456_vm 2023-08-11T12:24:54.506 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3466 2023-08-11T12:24:54.506 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3466_vm 2023-08-11T12:24:54.507 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3467 2023-08-11T12:24:54.507 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3468 2023-08-11T12:24:54.507 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3501 2023-08-11T12:24:54.507 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3501_vm 2023-08-11T12:24:54.507 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3502 2023-08-11T12:24:54.507 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3503 2023-08-11T12:24:54.507 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3534 2023-08-11T12:24:54.507 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3541 2023-08-11T12:24:54.508 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 3541_fsm 2023-08-11T12:24:54.508 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3541_vm 2023-08-11T12:24:54.508 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3542 2023-08-11T12:24:54.508 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3574 2023-08-11T12:24:54.508 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3575 2023-08-11T12:24:54.508 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3576 2023-08-11T12:24:54.509 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3576_vm 2023-08-11T12:24:54.509 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3596 2023-08-11T12:24:54.509 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3596_vm 2023-08-11T12:24:54.509 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3597 2023-08-11T12:24:54.509 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3598 2023-08-11T12:24:54.509 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3598_vm 2023-08-11T12:24:54.510 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3599 2023-08-11T12:24:54.510 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3600 2023-08-11T12:24:54.510 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 3600_fsm 2023-08-11T12:24:54.510 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3600_vm 2023-08-11T12:24:54.510 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3601 2023-08-11T12:24:54.510 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 3601_fsm 2023-08-11T12:24:54.510 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3601_vm 2023-08-11T12:24:54.510 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3602 2023-08-11T12:24:54.511 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 3602_fsm 2023-08-11T12:24:54.511 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3602_vm 2023-08-11T12:24:54.511 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3603 2023-08-11T12:24:54.511 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 3603_fsm 2023-08-11T12:24:54.511 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3603_vm 2023-08-11T12:24:54.511 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3604 2023-08-11T12:24:54.511 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3605 2023-08-11T12:24:54.512 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3606 2023-08-11T12:24:54.514 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3607 2023-08-11T12:24:54.514 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3608 2023-08-11T12:24:54.514 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 11 12:24 3609 2023-08-11T12:24:54.515 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3712 2023-08-11T12:24:54.515 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3764 2023-08-11T12:24:54.515 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 3764_fsm 2023-08-11T12:24:54.515 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3764_vm 2023-08-11T12:24:54.515 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3766 2023-08-11T12:24:54.515 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3767 2023-08-11T12:24:54.515 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3997 2023-08-11T12:24:54.516 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 5002 2023-08-11T12:24:54.516 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 548 2023-08-11T12:24:54.516 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 549 2023-08-11T12:24:54.516 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 6102 2023-08-11T12:24:54.516 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 6102_vm 2023-08-11T12:24:54.516 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 6104 2023-08-11T12:24:54.517 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 6104_vm 2023-08-11T12:24:54.517 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 6106 2023-08-11T12:24:54.517 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 6106_vm 2023-08-11T12:24:54.517 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 6110 2023-08-11T12:24:54.517 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 6111 2023-08-11T12:24:54.517 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 6112 2023-08-11T12:24:54.517 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 6113 2023-08-11T12:24:54.517 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 6117 2023-08-11T12:24:54.518 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 826 2023-08-11T12:24:54.518 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 826_vm 2023-08-11T12:24:54.518 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 827 2023-08-11T12:24:54.518 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 828 2023-08-11T12:24:54.518 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Aug 11 12:24 pg_filenode.map 2023-08-11T12:24:54.518 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 11 12:24 PG_VERSION 2023-08-11T12:24:54.518 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:54.519 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/base/12346: 2023-08-11T12:24:54.519 INFO:teuthology.orchestra.run.smithi008.stdout:total 7217 2023-08-11T12:24:54.519 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Aug 11 12:24 . 2023-08-11T12:24:54.519 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 11 12:24 .. 2023-08-11T12:24:54.519 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 112 2023-08-11T12:24:54.519 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 113 2023-08-11T12:24:54.520 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Aug 11 12:24 12182 2023-08-11T12:24:54.520 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 12182_fsm 2023-08-11T12:24:54.520 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12182_vm 2023-08-11T12:24:54.520 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 12184 2023-08-11T12:24:54.520 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12186 2023-08-11T12:24:54.520 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12187 2023-08-11T12:24:54.521 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 12187_fsm 2023-08-11T12:24:54.521 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12187_vm 2023-08-11T12:24:54.521 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 12189 2023-08-11T12:24:54.521 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12191 2023-08-11T12:24:54.521 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12192 2023-08-11T12:24:54.521 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 12192_fsm 2023-08-11T12:24:54.521 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12192_vm 2023-08-11T12:24:54.522 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 12194 2023-08-11T12:24:54.522 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12196 2023-08-11T12:24:54.522 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12197 2023-08-11T12:24:54.522 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 12197_fsm 2023-08-11T12:24:54.522 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12197_vm 2023-08-11T12:24:54.522 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 12199 2023-08-11T12:24:54.522 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12201 2023-08-11T12:24:54.522 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12202 2023-08-11T12:24:54.523 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 12202_fsm 2023-08-11T12:24:54.523 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12202_vm 2023-08-11T12:24:54.523 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 12204 2023-08-11T12:24:54.523 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12206 2023-08-11T12:24:54.523 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12207 2023-08-11T12:24:54.523 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 12207_fsm 2023-08-11T12:24:54.523 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12207_vm 2023-08-11T12:24:54.523 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 12209 2023-08-11T12:24:54.524 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12211 2023-08-11T12:24:54.524 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 12212 2023-08-11T12:24:54.524 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 12214 2023-08-11T12:24:54.524 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12216 2023-08-11T12:24:54.524 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Aug 11 12:24 1247 2023-08-11T12:24:54.524 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 1247_fsm 2023-08-11T12:24:54.524 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 1247_vm 2023-08-11T12:24:54.525 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Aug 11 12:24 1249 2023-08-11T12:24:54.525 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 1249_fsm 2023-08-11T12:24:54.525 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 1249_vm 2023-08-11T12:24:54.525 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Aug 11 12:24 1255 2023-08-11T12:24:54.525 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 1255_fsm 2023-08-11T12:24:54.525 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 1255_vm 2023-08-11T12:24:54.525 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Aug 11 12:24 1259 2023-08-11T12:24:54.525 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 1259_fsm 2023-08-11T12:24:54.526 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 1259_vm 2023-08-11T12:24:54.526 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 1417 2023-08-11T12:24:54.526 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 1417_vm 2023-08-11T12:24:54.526 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 1418 2023-08-11T12:24:54.526 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 1418_vm 2023-08-11T12:24:54.526 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 174 2023-08-11T12:24:54.527 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 175 2023-08-11T12:24:54.527 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2187 2023-08-11T12:24:54.527 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2224 2023-08-11T12:24:54.527 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2224_vm 2023-08-11T12:24:54.527 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2328 2023-08-11T12:24:54.528 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2328_vm 2023-08-11T12:24:54.528 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2336 2023-08-11T12:24:54.528 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2336_vm 2023-08-11T12:24:54.528 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2337 2023-08-11T12:24:54.528 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2600 2023-08-11T12:24:54.528 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2600_fsm 2023-08-11T12:24:54.528 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2600_vm 2023-08-11T12:24:54.529 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2601 2023-08-11T12:24:54.529 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2601_fsm 2023-08-11T12:24:54.529 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2601_vm 2023-08-11T12:24:54.529 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 11 12:24 2602 2023-08-11T12:24:54.529 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2602_fsm 2023-08-11T12:24:54.529 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2602_vm 2023-08-11T12:24:54.529 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 11 12:24 2603 2023-08-11T12:24:54.529 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2603_fsm 2023-08-11T12:24:54.530 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2603_vm 2023-08-11T12:24:54.530 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2604 2023-08-11T12:24:54.530 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2604_vm 2023-08-11T12:24:54.530 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2605 2023-08-11T12:24:54.530 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2605_fsm 2023-08-11T12:24:54.530 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2605_vm 2023-08-11T12:24:54.531 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2606 2023-08-11T12:24:54.531 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2606_fsm 2023-08-11T12:24:54.531 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2606_vm 2023-08-11T12:24:54.531 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2607 2023-08-11T12:24:54.531 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2607_fsm 2023-08-11T12:24:54.531 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2607_vm 2023-08-11T12:24:54.532 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Aug 11 12:24 2608 2023-08-11T12:24:54.532 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2608_fsm 2023-08-11T12:24:54.532 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2608_vm 2023-08-11T12:24:54.532 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Aug 11 12:24 2609 2023-08-11T12:24:54.532 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2609_fsm 2023-08-11T12:24:54.532 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2609_vm 2023-08-11T12:24:54.533 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2610 2023-08-11T12:24:54.533 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2610_fsm 2023-08-11T12:24:54.533 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2610_vm 2023-08-11T12:24:54.533 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2611 2023-08-11T12:24:54.533 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2611_vm 2023-08-11T12:24:54.533 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2612 2023-08-11T12:24:54.534 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2612_fsm 2023-08-11T12:24:54.534 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2612_vm 2023-08-11T12:24:54.534 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2613 2023-08-11T12:24:54.534 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2613_vm 2023-08-11T12:24:54.534 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2615 2023-08-11T12:24:54.534 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2615_fsm 2023-08-11T12:24:54.534 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2615_vm 2023-08-11T12:24:54.534 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2616 2023-08-11T12:24:54.535 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2616_fsm 2023-08-11T12:24:54.535 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2616_vm 2023-08-11T12:24:54.535 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Aug 11 12:24 2617 2023-08-11T12:24:54.535 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2617_fsm 2023-08-11T12:24:54.535 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2617_vm 2023-08-11T12:24:54.535 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Aug 11 12:24 2618 2023-08-11T12:24:54.536 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2618_fsm 2023-08-11T12:24:54.536 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2618_vm 2023-08-11T12:24:54.536 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Aug 11 12:24 2619 2023-08-11T12:24:54.536 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2619_fsm 2023-08-11T12:24:54.536 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2619_vm 2023-08-11T12:24:54.536 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2620 2023-08-11T12:24:54.537 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2620_vm 2023-08-11T12:24:54.537 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2650 2023-08-11T12:24:54.537 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2651 2023-08-11T12:24:54.537 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2652 2023-08-11T12:24:54.537 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 11 12:24 2653 2023-08-11T12:24:54.537 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 11 12:24 2654 2023-08-11T12:24:54.537 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 11 12:24 2655 2023-08-11T12:24:54.538 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2656 2023-08-11T12:24:54.538 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2657 2023-08-11T12:24:54.538 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Aug 11 12:24 2658 2023-08-11T12:24:54.538 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 11 12:24 2659 2023-08-11T12:24:54.538 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2660 2023-08-11T12:24:54.538 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2661 2023-08-11T12:24:54.538 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 11 12:24 2662 2023-08-11T12:24:54.538 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 11 12:24 2663 2023-08-11T12:24:54.539 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2664 2023-08-11T12:24:54.539 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2665 2023-08-11T12:24:54.539 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2666 2023-08-11T12:24:54.539 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2667 2023-08-11T12:24:54.539 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2668 2023-08-11T12:24:54.539 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2669 2023-08-11T12:24:54.539 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2670 2023-08-11T12:24:54.539 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Aug 11 12:24 2673 2023-08-11T12:24:54.540 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 385024 Aug 11 12:24 2674 2023-08-11T12:24:54.540 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Aug 11 12:24 2675 2023-08-11T12:24:54.540 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2678 2023-08-11T12:24:54.540 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2679 2023-08-11T12:24:54.540 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2680 2023-08-11T12:24:54.540 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2681 2023-08-11T12:24:54.540 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2682 2023-08-11T12:24:54.541 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2683 2023-08-11T12:24:54.541 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2684 2023-08-11T12:24:54.541 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2685 2023-08-11T12:24:54.541 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2686 2023-08-11T12:24:54.541 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2687 2023-08-11T12:24:54.541 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 11 12:24 2688 2023-08-11T12:24:54.541 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 11 12:24 2689 2023-08-11T12:24:54.541 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 11 12:24 2690 2023-08-11T12:24:54.542 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Aug 11 12:24 2691 2023-08-11T12:24:54.542 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2692 2023-08-11T12:24:54.542 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2693 2023-08-11T12:24:54.542 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2696 2023-08-11T12:24:54.542 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2699 2023-08-11T12:24:54.542 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2701 2023-08-11T12:24:54.542 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2702 2023-08-11T12:24:54.542 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2703 2023-08-11T12:24:54.543 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 11 12:24 2704 2023-08-11T12:24:54.543 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2753 2023-08-11T12:24:54.543 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2753_fsm 2023-08-11T12:24:54.543 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2753_vm 2023-08-11T12:24:54.543 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2754 2023-08-11T12:24:54.543 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2755 2023-08-11T12:24:54.543 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 11 12:24 2756 2023-08-11T12:24:54.543 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 11 12:24 2757 2023-08-11T12:24:54.544 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2830 2023-08-11T12:24:54.544 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2830_vm 2023-08-11T12:24:54.544 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2831 2023-08-11T12:24:54.544 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2832 2023-08-11T12:24:54.544 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2832_vm 2023-08-11T12:24:54.544 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2833 2023-08-11T12:24:54.544 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2834 2023-08-11T12:24:54.545 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2834_vm 2023-08-11T12:24:54.545 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2835 2023-08-11T12:24:54.545 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2836 2023-08-11T12:24:54.545 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2836_vm 2023-08-11T12:24:54.545 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2837 2023-08-11T12:24:54.545 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Aug 11 12:24 2838 2023-08-11T12:24:54.545 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2838_fsm 2023-08-11T12:24:54.545 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2838_vm 2023-08-11T12:24:54.546 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2839 2023-08-11T12:24:54.546 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2840 2023-08-11T12:24:54.546 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2840_fsm 2023-08-11T12:24:54.546 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2840_vm 2023-08-11T12:24:54.546 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2841 2023-08-11T12:24:54.546 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2995 2023-08-11T12:24:54.546 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2995_vm 2023-08-11T12:24:54.546 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2996 2023-08-11T12:24:54.547 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3079 2023-08-11T12:24:54.547 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 3079_fsm 2023-08-11T12:24:54.547 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3079_vm 2023-08-11T12:24:54.547 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3080 2023-08-11T12:24:54.547 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3081 2023-08-11T12:24:54.547 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3085 2023-08-11T12:24:54.547 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3118 2023-08-11T12:24:54.547 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3118_vm 2023-08-11T12:24:54.548 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3119 2023-08-11T12:24:54.548 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3164 2023-08-11T12:24:54.548 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3256 2023-08-11T12:24:54.548 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3256_vm 2023-08-11T12:24:54.548 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3257 2023-08-11T12:24:54.548 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3258 2023-08-11T12:24:54.548 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3350 2023-08-11T12:24:54.548 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3350_vm 2023-08-11T12:24:54.549 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3351 2023-08-11T12:24:54.549 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3379 2023-08-11T12:24:54.549 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3380 2023-08-11T12:24:54.549 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3381 2023-08-11T12:24:54.549 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3381_vm 2023-08-11T12:24:54.549 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3394 2023-08-11T12:24:54.549 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 3394_fsm 2023-08-11T12:24:54.549 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3394_vm 2023-08-11T12:24:54.550 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3395 2023-08-11T12:24:54.550 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3439 2023-08-11T12:24:54.550 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3439_vm 2023-08-11T12:24:54.550 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3440 2023-08-11T12:24:54.550 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 11 12:24 3455 2023-08-11T12:24:54.550 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3456 2023-08-11T12:24:54.550 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 3456_fsm 2023-08-11T12:24:54.551 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3456_vm 2023-08-11T12:24:54.551 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3466 2023-08-11T12:24:54.551 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3466_vm 2023-08-11T12:24:54.551 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3467 2023-08-11T12:24:54.551 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3468 2023-08-11T12:24:54.551 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3501 2023-08-11T12:24:54.551 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3501_vm 2023-08-11T12:24:54.551 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3502 2023-08-11T12:24:54.552 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3503 2023-08-11T12:24:54.552 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3534 2023-08-11T12:24:54.552 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3541 2023-08-11T12:24:54.552 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 3541_fsm 2023-08-11T12:24:54.552 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3541_vm 2023-08-11T12:24:54.552 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3542 2023-08-11T12:24:54.552 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3574 2023-08-11T12:24:54.552 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3575 2023-08-11T12:24:54.553 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3576 2023-08-11T12:24:54.553 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3576_vm 2023-08-11T12:24:54.553 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3596 2023-08-11T12:24:54.553 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3596_vm 2023-08-11T12:24:54.553 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3597 2023-08-11T12:24:54.553 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3598 2023-08-11T12:24:54.553 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3598_vm 2023-08-11T12:24:54.553 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3599 2023-08-11T12:24:54.554 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3600 2023-08-11T12:24:54.554 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 3600_fsm 2023-08-11T12:24:54.554 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3600_vm 2023-08-11T12:24:54.554 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3601 2023-08-11T12:24:54.554 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 3601_fsm 2023-08-11T12:24:54.554 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3601_vm 2023-08-11T12:24:54.554 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3602 2023-08-11T12:24:54.554 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 3602_fsm 2023-08-11T12:24:54.555 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3602_vm 2023-08-11T12:24:54.555 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3603 2023-08-11T12:24:54.555 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 3603_fsm 2023-08-11T12:24:54.555 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3603_vm 2023-08-11T12:24:54.555 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3604 2023-08-11T12:24:54.555 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3605 2023-08-11T12:24:54.555 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3606 2023-08-11T12:24:54.555 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3607 2023-08-11T12:24:54.556 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3608 2023-08-11T12:24:54.556 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 11 12:24 3609 2023-08-11T12:24:54.556 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3712 2023-08-11T12:24:54.556 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3764 2023-08-11T12:24:54.556 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 3764_fsm 2023-08-11T12:24:54.556 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3764_vm 2023-08-11T12:24:54.556 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3766 2023-08-11T12:24:54.556 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3767 2023-08-11T12:24:54.557 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3997 2023-08-11T12:24:54.557 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 5002 2023-08-11T12:24:54.557 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 548 2023-08-11T12:24:54.557 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 549 2023-08-11T12:24:54.557 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 6102 2023-08-11T12:24:54.557 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 6102_vm 2023-08-11T12:24:54.557 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 6104 2023-08-11T12:24:54.558 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 6104_vm 2023-08-11T12:24:54.558 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 6106 2023-08-11T12:24:54.558 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 6106_vm 2023-08-11T12:24:54.558 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 6110 2023-08-11T12:24:54.558 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 6111 2023-08-11T12:24:54.558 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 6112 2023-08-11T12:24:54.558 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 6113 2023-08-11T12:24:54.558 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 6117 2023-08-11T12:24:54.559 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 826 2023-08-11T12:24:54.559 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 826_vm 2023-08-11T12:24:54.559 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 827 2023-08-11T12:24:54.559 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 828 2023-08-11T12:24:54.559 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Aug 11 12:24 pg_filenode.map 2023-08-11T12:24:54.559 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 11 12:24 PG_VERSION 2023-08-11T12:24:54.559 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:54.559 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/base/12347: 2023-08-11T12:24:54.560 INFO:teuthology.orchestra.run.smithi008.stdout:total 7217 2023-08-11T12:24:54.560 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Aug 11 12:24 . 2023-08-11T12:24:54.560 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 11 12:24 .. 2023-08-11T12:24:54.560 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 112 2023-08-11T12:24:54.560 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 113 2023-08-11T12:24:54.560 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Aug 11 12:24 12182 2023-08-11T12:24:54.560 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 12182_fsm 2023-08-11T12:24:54.560 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12182_vm 2023-08-11T12:24:54.561 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 12184 2023-08-11T12:24:54.561 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12186 2023-08-11T12:24:54.561 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12187 2023-08-11T12:24:54.561 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 12187_fsm 2023-08-11T12:24:54.561 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12187_vm 2023-08-11T12:24:54.561 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 12189 2023-08-11T12:24:54.561 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12191 2023-08-11T12:24:54.561 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12192 2023-08-11T12:24:54.562 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 12192_fsm 2023-08-11T12:24:54.562 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12192_vm 2023-08-11T12:24:54.562 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 12194 2023-08-11T12:24:54.562 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12196 2023-08-11T12:24:54.562 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12197 2023-08-11T12:24:54.562 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 12197_fsm 2023-08-11T12:24:54.562 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12197_vm 2023-08-11T12:24:54.562 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 12199 2023-08-11T12:24:54.563 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12201 2023-08-11T12:24:54.563 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12202 2023-08-11T12:24:54.563 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 12202_fsm 2023-08-11T12:24:54.563 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12202_vm 2023-08-11T12:24:54.563 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 12204 2023-08-11T12:24:54.563 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12206 2023-08-11T12:24:54.563 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12207 2023-08-11T12:24:54.563 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 12207_fsm 2023-08-11T12:24:54.564 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12207_vm 2023-08-11T12:24:54.564 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 12209 2023-08-11T12:24:54.564 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12211 2023-08-11T12:24:54.564 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 12212 2023-08-11T12:24:54.564 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 12214 2023-08-11T12:24:54.564 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 12216 2023-08-11T12:24:54.564 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Aug 11 12:24 1247 2023-08-11T12:24:54.565 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 1247_fsm 2023-08-11T12:24:54.565 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 1247_vm 2023-08-11T12:24:54.565 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Aug 11 12:24 1249 2023-08-11T12:24:54.565 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 1249_fsm 2023-08-11T12:24:54.565 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 1249_vm 2023-08-11T12:24:54.565 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Aug 11 12:24 1255 2023-08-11T12:24:54.565 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 1255_fsm 2023-08-11T12:24:54.565 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 1255_vm 2023-08-11T12:24:54.566 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Aug 11 12:24 1259 2023-08-11T12:24:54.566 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 1259_fsm 2023-08-11T12:24:54.566 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 1259_vm 2023-08-11T12:24:54.566 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 1417 2023-08-11T12:24:54.566 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 1417_vm 2023-08-11T12:24:54.566 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 1418 2023-08-11T12:24:54.566 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 1418_vm 2023-08-11T12:24:54.566 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 174 2023-08-11T12:24:54.567 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 175 2023-08-11T12:24:54.567 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2187 2023-08-11T12:24:54.567 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2224 2023-08-11T12:24:54.567 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2224_vm 2023-08-11T12:24:54.567 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2328 2023-08-11T12:24:54.567 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2328_vm 2023-08-11T12:24:54.567 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2336 2023-08-11T12:24:54.567 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2336_vm 2023-08-11T12:24:54.568 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2337 2023-08-11T12:24:54.568 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2600 2023-08-11T12:24:54.568 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2600_fsm 2023-08-11T12:24:54.568 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2600_vm 2023-08-11T12:24:54.568 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2601 2023-08-11T12:24:54.568 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2601_fsm 2023-08-11T12:24:54.568 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2601_vm 2023-08-11T12:24:54.568 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 11 12:24 2602 2023-08-11T12:24:54.569 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2602_fsm 2023-08-11T12:24:54.569 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2602_vm 2023-08-11T12:24:54.569 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 11 12:24 2603 2023-08-11T12:24:54.569 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2603_fsm 2023-08-11T12:24:54.569 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2603_vm 2023-08-11T12:24:54.569 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2604 2023-08-11T12:24:54.569 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2604_vm 2023-08-11T12:24:54.569 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2605 2023-08-11T12:24:54.570 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2605_fsm 2023-08-11T12:24:54.570 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2605_vm 2023-08-11T12:24:54.570 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2606 2023-08-11T12:24:54.570 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2606_fsm 2023-08-11T12:24:54.570 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2606_vm 2023-08-11T12:24:54.570 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2607 2023-08-11T12:24:54.570 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2607_fsm 2023-08-11T12:24:54.570 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2607_vm 2023-08-11T12:24:54.571 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Aug 11 12:24 2608 2023-08-11T12:24:54.571 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2608_fsm 2023-08-11T12:24:54.571 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2608_vm 2023-08-11T12:24:54.571 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Aug 11 12:24 2609 2023-08-11T12:24:54.571 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2609_fsm 2023-08-11T12:24:54.571 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2609_vm 2023-08-11T12:24:54.571 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2610 2023-08-11T12:24:54.571 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2610_fsm 2023-08-11T12:24:54.572 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2610_vm 2023-08-11T12:24:54.572 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2611 2023-08-11T12:24:54.572 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2611_vm 2023-08-11T12:24:54.572 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2612 2023-08-11T12:24:54.572 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2612_fsm 2023-08-11T12:24:54.572 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2612_vm 2023-08-11T12:24:54.572 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2613 2023-08-11T12:24:54.573 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2613_vm 2023-08-11T12:24:54.573 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2615 2023-08-11T12:24:54.573 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2615_fsm 2023-08-11T12:24:54.573 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2615_vm 2023-08-11T12:24:54.573 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2616 2023-08-11T12:24:54.573 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2616_fsm 2023-08-11T12:24:54.573 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2616_vm 2023-08-11T12:24:54.573 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Aug 11 12:24 2617 2023-08-11T12:24:54.574 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2617_fsm 2023-08-11T12:24:54.574 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2617_vm 2023-08-11T12:24:54.574 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Aug 11 12:24 2618 2023-08-11T12:24:54.574 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2618_fsm 2023-08-11T12:24:54.574 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2618_vm 2023-08-11T12:24:54.574 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Aug 11 12:24 2619 2023-08-11T12:24:54.574 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2619_fsm 2023-08-11T12:24:54.574 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2619_vm 2023-08-11T12:24:54.575 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2620 2023-08-11T12:24:54.575 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2620_vm 2023-08-11T12:24:54.575 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2650 2023-08-11T12:24:54.575 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2651 2023-08-11T12:24:54.575 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2652 2023-08-11T12:24:54.575 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 11 12:24 2653 2023-08-11T12:24:54.575 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 11 12:24 2654 2023-08-11T12:24:54.575 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 11 12:24 2655 2023-08-11T12:24:54.576 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2656 2023-08-11T12:24:54.576 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2657 2023-08-11T12:24:54.576 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Aug 11 12:24 2658 2023-08-11T12:24:54.576 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 11 12:24 2659 2023-08-11T12:24:54.576 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2660 2023-08-11T12:24:54.576 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2661 2023-08-11T12:24:54.576 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 11 12:24 2662 2023-08-11T12:24:54.576 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 11 12:24 2663 2023-08-11T12:24:54.577 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2664 2023-08-11T12:24:54.577 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2665 2023-08-11T12:24:54.577 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2666 2023-08-11T12:24:54.577 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2667 2023-08-11T12:24:54.577 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2668 2023-08-11T12:24:54.577 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2669 2023-08-11T12:24:54.577 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2670 2023-08-11T12:24:54.577 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Aug 11 12:24 2673 2023-08-11T12:24:54.578 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 385024 Aug 11 12:24 2674 2023-08-11T12:24:54.578 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Aug 11 12:24 2675 2023-08-11T12:24:54.578 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2678 2023-08-11T12:24:54.578 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2679 2023-08-11T12:24:54.578 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2680 2023-08-11T12:24:54.578 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2681 2023-08-11T12:24:54.578 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2682 2023-08-11T12:24:54.579 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2683 2023-08-11T12:24:54.579 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2684 2023-08-11T12:24:54.579 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2685 2023-08-11T12:24:54.579 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2686 2023-08-11T12:24:54.579 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2687 2023-08-11T12:24:54.579 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 11 12:24 2688 2023-08-11T12:24:54.579 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 11 12:24 2689 2023-08-11T12:24:54.579 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 11 12:24 2690 2023-08-11T12:24:54.580 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Aug 11 12:24 2691 2023-08-11T12:24:54.580 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2692 2023-08-11T12:24:54.580 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2693 2023-08-11T12:24:54.580 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2696 2023-08-11T12:24:54.580 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2699 2023-08-11T12:24:54.580 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2701 2023-08-11T12:24:54.580 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2702 2023-08-11T12:24:54.580 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2703 2023-08-11T12:24:54.581 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 11 12:24 2704 2023-08-11T12:24:54.581 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2753 2023-08-11T12:24:54.581 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2753_fsm 2023-08-11T12:24:54.581 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2753_vm 2023-08-11T12:24:54.581 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2754 2023-08-11T12:24:54.581 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2755 2023-08-11T12:24:54.581 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 11 12:24 2756 2023-08-11T12:24:54.581 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 11 12:24 2757 2023-08-11T12:24:54.582 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2830 2023-08-11T12:24:54.582 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2830_vm 2023-08-11T12:24:54.582 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2831 2023-08-11T12:24:54.582 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2832 2023-08-11T12:24:54.582 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2832_vm 2023-08-11T12:24:54.582 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2833 2023-08-11T12:24:54.582 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2834 2023-08-11T12:24:54.582 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2834_vm 2023-08-11T12:24:54.583 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2835 2023-08-11T12:24:54.583 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2836 2023-08-11T12:24:54.583 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2836_vm 2023-08-11T12:24:54.583 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2837 2023-08-11T12:24:54.583 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Aug 11 12:24 2838 2023-08-11T12:24:54.583 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2838_fsm 2023-08-11T12:24:54.583 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2838_vm 2023-08-11T12:24:54.583 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2839 2023-08-11T12:24:54.584 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2840 2023-08-11T12:24:54.584 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2840_fsm 2023-08-11T12:24:54.584 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2840_vm 2023-08-11T12:24:54.584 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2841 2023-08-11T12:24:54.584 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2995 2023-08-11T12:24:54.584 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2995_vm 2023-08-11T12:24:54.584 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2996 2023-08-11T12:24:54.585 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3079 2023-08-11T12:24:54.585 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 3079_fsm 2023-08-11T12:24:54.585 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3079_vm 2023-08-11T12:24:54.585 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3080 2023-08-11T12:24:54.585 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3081 2023-08-11T12:24:54.585 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3085 2023-08-11T12:24:54.585 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3118 2023-08-11T12:24:54.585 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3118_vm 2023-08-11T12:24:54.586 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3119 2023-08-11T12:24:54.586 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3164 2023-08-11T12:24:54.586 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3256 2023-08-11T12:24:54.586 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3256_vm 2023-08-11T12:24:54.586 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3257 2023-08-11T12:24:54.586 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3258 2023-08-11T12:24:54.586 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3350 2023-08-11T12:24:54.586 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3350_vm 2023-08-11T12:24:54.587 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3351 2023-08-11T12:24:54.587 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3379 2023-08-11T12:24:54.587 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3380 2023-08-11T12:24:54.587 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3381 2023-08-11T12:24:54.587 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3381_vm 2023-08-11T12:24:54.587 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3394 2023-08-11T12:24:54.587 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 3394_fsm 2023-08-11T12:24:54.587 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3394_vm 2023-08-11T12:24:54.588 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3395 2023-08-11T12:24:54.588 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3439 2023-08-11T12:24:54.588 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3439_vm 2023-08-11T12:24:54.588 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3440 2023-08-11T12:24:54.588 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 11 12:24 3455 2023-08-11T12:24:54.588 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3456 2023-08-11T12:24:54.588 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 3456_fsm 2023-08-11T12:24:54.588 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3456_vm 2023-08-11T12:24:54.589 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3466 2023-08-11T12:24:54.589 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3466_vm 2023-08-11T12:24:54.589 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3467 2023-08-11T12:24:54.589 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3468 2023-08-11T12:24:54.589 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3501 2023-08-11T12:24:54.589 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3501_vm 2023-08-11T12:24:54.589 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3502 2023-08-11T12:24:54.589 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3503 2023-08-11T12:24:54.590 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3534 2023-08-11T12:24:54.590 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3541 2023-08-11T12:24:54.590 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 3541_fsm 2023-08-11T12:24:54.590 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3541_vm 2023-08-11T12:24:54.590 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3542 2023-08-11T12:24:54.590 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3574 2023-08-11T12:24:54.590 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3575 2023-08-11T12:24:54.590 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3576 2023-08-11T12:24:54.591 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3576_vm 2023-08-11T12:24:54.591 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3596 2023-08-11T12:24:54.591 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3596_vm 2023-08-11T12:24:54.591 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3597 2023-08-11T12:24:54.591 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3598 2023-08-11T12:24:54.591 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3598_vm 2023-08-11T12:24:54.591 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3599 2023-08-11T12:24:54.592 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3600 2023-08-11T12:24:54.592 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 3600_fsm 2023-08-11T12:24:54.592 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3600_vm 2023-08-11T12:24:54.592 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3601 2023-08-11T12:24:54.592 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 3601_fsm 2023-08-11T12:24:54.592 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3601_vm 2023-08-11T12:24:54.592 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3602 2023-08-11T12:24:54.593 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 3602_fsm 2023-08-11T12:24:54.593 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3602_vm 2023-08-11T12:24:54.593 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3603 2023-08-11T12:24:54.593 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 3603_fsm 2023-08-11T12:24:54.593 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3603_vm 2023-08-11T12:24:54.593 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3604 2023-08-11T12:24:54.593 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3605 2023-08-11T12:24:54.593 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3606 2023-08-11T12:24:54.594 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3607 2023-08-11T12:24:54.594 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3608 2023-08-11T12:24:54.594 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 11 12:24 3609 2023-08-11T12:24:54.594 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3712 2023-08-11T12:24:54.594 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3764 2023-08-11T12:24:54.594 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 3764_fsm 2023-08-11T12:24:54.594 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3764_vm 2023-08-11T12:24:54.595 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3766 2023-08-11T12:24:54.595 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 3767 2023-08-11T12:24:54.595 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3997 2023-08-11T12:24:54.595 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 5002 2023-08-11T12:24:54.595 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 548 2023-08-11T12:24:54.595 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 549 2023-08-11T12:24:54.595 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 6102 2023-08-11T12:24:54.596 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 6102_vm 2023-08-11T12:24:54.596 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 6104 2023-08-11T12:24:54.596 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 6104_vm 2023-08-11T12:24:54.596 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 6106 2023-08-11T12:24:54.596 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 6106_vm 2023-08-11T12:24:54.596 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 6110 2023-08-11T12:24:54.596 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 6111 2023-08-11T12:24:54.597 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 6112 2023-08-11T12:24:54.597 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 6113 2023-08-11T12:24:54.597 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 6117 2023-08-11T12:24:54.597 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 826 2023-08-11T12:24:54.597 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 826_vm 2023-08-11T12:24:54.597 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 827 2023-08-11T12:24:54.597 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 828 2023-08-11T12:24:54.598 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Aug 11 12:24 pg_filenode.map 2023-08-11T12:24:54.598 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 11 12:24 PG_VERSION 2023-08-11T12:24:54.598 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:54.598 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/global: 2023-08-11T12:24:54.598 INFO:teuthology.orchestra.run.smithi008.stdout:total 553 2023-08-11T12:24:54.598 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Aug 11 12:24 . 2023-08-11T12:24:54.598 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 11 12:24 .. 2023-08-11T12:24:54.599 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 1136 2023-08-11T12:24:54.599 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 1136_fsm 2023-08-11T12:24:54.599 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 1136_vm 2023-08-11T12:24:54.599 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 1137 2023-08-11T12:24:54.599 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 1213 2023-08-11T12:24:54.599 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 1213_fsm 2023-08-11T12:24:54.599 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 1213_vm 2023-08-11T12:24:54.600 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 1214 2023-08-11T12:24:54.600 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 1214_fsm 2023-08-11T12:24:54.600 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 1214_vm 2023-08-11T12:24:54.600 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 1232 2023-08-11T12:24:54.600 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 1233 2023-08-11T12:24:54.600 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 1260 2023-08-11T12:24:54.600 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 1260_fsm 2023-08-11T12:24:54.601 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 1260_vm 2023-08-11T12:24:54.601 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 1261 2023-08-11T12:24:54.601 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 1261_fsm 2023-08-11T12:24:54.601 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 1261_vm 2023-08-11T12:24:54.601 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 1262 2023-08-11T12:24:54.601 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 1262_fsm 2023-08-11T12:24:54.601 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 1262_vm 2023-08-11T12:24:54.602 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2396 2023-08-11T12:24:54.602 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 11 12:24 2396_fsm 2023-08-11T12:24:54.602 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2396_vm 2023-08-11T12:24:54.602 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2397 2023-08-11T12:24:54.602 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2671 2023-08-11T12:24:54.602 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2672 2023-08-11T12:24:54.602 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2676 2023-08-11T12:24:54.603 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2677 2023-08-11T12:24:54.603 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2694 2023-08-11T12:24:54.603 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2695 2023-08-11T12:24:54.603 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2697 2023-08-11T12:24:54.603 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 11 12:24 2698 2023-08-11T12:24:54.603 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2846 2023-08-11T12:24:54.603 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2846_vm 2023-08-11T12:24:54.603 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2847 2023-08-11T12:24:54.604 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2964 2023-08-11T12:24:54.604 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2964_vm 2023-08-11T12:24:54.604 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2965 2023-08-11T12:24:54.604 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2966 2023-08-11T12:24:54.604 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 2966_vm 2023-08-11T12:24:54.604 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 2967 2023-08-11T12:24:54.604 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3592 2023-08-11T12:24:54.605 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 3592_vm 2023-08-11T12:24:54.605 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 3593 2023-08-11T12:24:54.605 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 4060 2023-08-11T12:24:54.605 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 4060_vm 2023-08-11T12:24:54.605 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 4061 2023-08-11T12:24:54.605 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 6000 2023-08-11T12:24:54.605 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 6000_vm 2023-08-11T12:24:54.605 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 6001 2023-08-11T12:24:54.606 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 6002 2023-08-11T12:24:54.606 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 6100 2023-08-11T12:24:54.606 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 6100_vm 2023-08-11T12:24:54.606 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 6114 2023-08-11T12:24:54.606 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 6115 2023-08-11T12:24:54.606 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 pg_control 2023-08-11T12:24:54.606 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Aug 11 12:24 pg_filenode.map 2023-08-11T12:24:54.607 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:54.607 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/log: 2023-08-11T12:24:54.607 INFO:teuthology.orchestra.run.smithi008.stdout:total 0 2023-08-11T12:24:54.607 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 . 2023-08-11T12:24:54.607 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 11 12:24 .. 2023-08-11T12:24:54.607 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:54.607 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2023-08-11T12:24:54.607 INFO:teuthology.orchestra.run.smithi008.stdout:total 0 2023-08-11T12:24:54.608 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 . 2023-08-11T12:24:54.608 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 11 12:24 .. 2023-08-11T12:24:54.608 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:54.608 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2023-08-11T12:24:54.608 INFO:teuthology.orchestra.run.smithi008.stdout:total 0 2023-08-11T12:24:54.608 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 . 2023-08-11T12:24:54.608 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 11 12:24 .. 2023-08-11T12:24:54.609 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:54.609 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_logical: 2023-08-11T12:24:54.609 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-08-11T12:24:54.609 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 11 12:24 . 2023-08-11T12:24:54.609 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 11 12:24 .. 2023-08-11T12:24:54.609 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 mappings 2023-08-11T12:24:54.609 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Aug 11 12:24 replorigin_checkpoint 2023-08-11T12:24:54.609 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 snapshots 2023-08-11T12:24:54.610 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:54.610 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2023-08-11T12:24:54.610 INFO:teuthology.orchestra.run.smithi008.stdout:total 0 2023-08-11T12:24:54.610 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 . 2023-08-11T12:24:54.610 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 11 12:24 .. 2023-08-11T12:24:54.610 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:54.610 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2023-08-11T12:24:54.611 INFO:teuthology.orchestra.run.smithi008.stdout:total 0 2023-08-11T12:24:54.611 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 . 2023-08-11T12:24:54.611 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 11 12:24 .. 2023-08-11T12:24:54.611 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:54.611 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2023-08-11T12:24:54.611 INFO:teuthology.orchestra.run.smithi008.stdout:total 0 2023-08-11T12:24:54.611 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 11 12:24 . 2023-08-11T12:24:54.611 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 11 12:24 .. 2023-08-11T12:24:54.612 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 11 12:24 members 2023-08-11T12:24:54.612 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 11 12:24 offsets 2023-08-11T12:24:54.612 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:54.612 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2023-08-11T12:24:54.612 INFO:teuthology.orchestra.run.smithi008.stdout:total 8 2023-08-11T12:24:54.612 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 11 12:24 . 2023-08-11T12:24:54.612 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 11 12:24 .. 2023-08-11T12:24:54.612 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 0000 2023-08-11T12:24:54.613 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:54.613 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2023-08-11T12:24:54.613 INFO:teuthology.orchestra.run.smithi008.stdout:total 8 2023-08-11T12:24:54.613 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 11 12:24 . 2023-08-11T12:24:54.613 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 11 12:24 .. 2023-08-11T12:24:54.613 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 0000 2023-08-11T12:24:54.613 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:54.613 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_notify: 2023-08-11T12:24:54.614 INFO:teuthology.orchestra.run.smithi008.stdout:total 8 2023-08-11T12:24:54.614 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 11 12:24 . 2023-08-11T12:24:54.614 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 11 12:24 .. 2023-08-11T12:24:54.614 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 0000 2023-08-11T12:24:54.614 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:54.614 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2023-08-11T12:24:54.614 INFO:teuthology.orchestra.run.smithi008.stdout:total 0 2023-08-11T12:24:54.614 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 . 2023-08-11T12:24:54.615 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 11 12:24 .. 2023-08-11T12:24:54.615 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:54.615 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_serial: 2023-08-11T12:24:54.615 INFO:teuthology.orchestra.run.smithi008.stdout:total 0 2023-08-11T12:24:54.615 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 . 2023-08-11T12:24:54.615 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 11 12:24 .. 2023-08-11T12:24:54.615 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:54.616 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2023-08-11T12:24:54.616 INFO:teuthology.orchestra.run.smithi008.stdout:total 0 2023-08-11T12:24:54.616 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 . 2023-08-11T12:24:54.616 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 11 12:24 .. 2023-08-11T12:24:54.616 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:54.616 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_stat: 2023-08-11T12:24:54.616 INFO:teuthology.orchestra.run.smithi008.stdout:total 0 2023-08-11T12:24:54.616 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 . 2023-08-11T12:24:54.617 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 11 12:24 .. 2023-08-11T12:24:54.617 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:54.617 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2023-08-11T12:24:54.617 INFO:teuthology.orchestra.run.smithi008.stdout:total 0 2023-08-11T12:24:54.617 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 . 2023-08-11T12:24:54.617 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 11 12:24 .. 2023-08-11T12:24:54.617 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:54.617 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2023-08-11T12:24:54.618 INFO:teuthology.orchestra.run.smithi008.stdout:total 8 2023-08-11T12:24:54.618 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 11 12:24 . 2023-08-11T12:24:54.618 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 11 12:24 .. 2023-08-11T12:24:54.618 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 0000 2023-08-11T12:24:54.618 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:54.618 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2023-08-11T12:24:54.618 INFO:teuthology.orchestra.run.smithi008.stdout:total 0 2023-08-11T12:24:54.619 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 . 2023-08-11T12:24:54.619 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 11 12:24 .. 2023-08-11T12:24:54.619 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:54.619 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2023-08-11T12:24:54.619 INFO:teuthology.orchestra.run.smithi008.stdout:total 0 2023-08-11T12:24:54.619 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 . 2023-08-11T12:24:54.619 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 11 12:24 .. 2023-08-11T12:24:54.619 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:54.620 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_wal: 2023-08-11T12:24:54.620 INFO:teuthology.orchestra.run.smithi008.stdout:total 16384 2023-08-11T12:24:54.620 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 11 12:24 . 2023-08-11T12:24:54.620 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 11 12:24 .. 2023-08-11T12:24:54.620 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 11 12:24 000000010000000000000001 2023-08-11T12:24:54.620 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 archive_status 2023-08-11T12:24:54.620 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:54.620 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2023-08-11T12:24:54.621 INFO:teuthology.orchestra.run.smithi008.stdout:total 0 2023-08-11T12:24:54.621 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 11 12:24 . 2023-08-11T12:24:54.621 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 11 12:24 .. 2023-08-11T12:24:54.621 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:54.621 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_xact: 2023-08-11T12:24:54.621 INFO:teuthology.orchestra.run.smithi008.stdout:total 8 2023-08-11T12:24:54.621 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 11 12:24 . 2023-08-11T12:24:54.621 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 11 12:24 .. 2023-08-11T12:24:54.622 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 11 12:24 0000 2023-08-11T12:24:54.622 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2023-08-11T12:24:54.859 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 500 -i' 2023-08-11T12:24:54.948 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:54 smithi008 ceph-mon[97158]: pgmap v12: 129 pgs: 129 active+clean; 7.9 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 660 KiB/s wr, 177 op/s 2023-08-11T12:24:54.976 INFO:teuthology.orchestra.run.smithi008.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2023-08-11T12:24:54.986 INFO:teuthology.orchestra.run.smithi008.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2023-08-11T12:24:54.991 INFO:teuthology.orchestra.run.smithi008.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2023-08-11T12:24:54.997 INFO:teuthology.orchestra.run.smithi008.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2023-08-11T12:24:55.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:54 smithi194 ceph-mon[130905]: pgmap v12: 129 pgs: 129 active+clean; 7.9 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 660 KiB/s wr, 177 op/s 2023-08-11T12:24:55.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:54 smithi045 ceph-mon[130284]: pgmap v12: 129 pgs: 129 active+clean; 7.9 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 660 KiB/s wr, 177 op/s 2023-08-11T12:24:55.310 INFO:teuthology.orchestra.run.smithi008.stderr:creating tables... 2023-08-11T12:24:55.418 INFO:teuthology.orchestra.run.smithi008.stderr:100000 of 50000000 tuples (0%) done (elapsed 0.11 s, remaining 52.76 s) 2023-08-11T12:24:55.779 INFO:teuthology.orchestra.run.smithi008.stderr:200000 of 50000000 tuples (0%) done (elapsed 0.47 s, remaining 115.99 s) 2023-08-11T12:24:56.173 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:24:56.192 INFO:teuthology.orchestra.run.smithi008.stderr:300000 of 50000000 tuples (0%) done (elapsed 0.88 s, remaining 145.65 s) 2023-08-11T12:24:56.300 INFO:teuthology.orchestra.run.smithi008.stderr:400000 of 50000000 tuples (0%) done (elapsed 0.99 s, remaining 122.38 s) 2023-08-11T12:24:56.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.403+0000 7f12aa1ff700 1 -- 172.21.15.8:0/3511591300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12a4072cc0 msgr2=0x7f12a40730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:56.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.403+0000 7f12aa1ff700 1 --2- 172.21.15.8:0/3511591300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12a4072cc0 0x7f12a40730a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1294009990 tx=0x7f1294009ca0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.404+0000 7f12aa1ff700 1 -- 172.21.15.8:0/3511591300 shutdown_connections 2023-08-11T12:24:56.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.404+0000 7f12aa1ff700 1 --2- 172.21.15.8:0/3511591300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12a4072cc0 0x7f12a40730a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.404+0000 7f12aa1ff700 1 --2- 172.21.15.8:0/3511591300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12a4111970 0x7f12a4113d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.404+0000 7f12aa1ff700 1 --2- 172.21.15.8:0/3511591300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12a40735e0 0x7f12a4111430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.404+0000 7f12aa1ff700 1 -- 172.21.15.8:0/3511591300 >> 172.21.15.8:0/3511591300 conn(0x7f12a40fc490 msgr2=0x7f12a40fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:56.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.404+0000 7f12aa1ff700 1 -- 172.21.15.8:0/3511591300 shutdown_connections 2023-08-11T12:24:56.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.404+0000 7f12aa1ff700 1 -- 172.21.15.8:0/3511591300 wait complete. 2023-08-11T12:24:56.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.405+0000 7f12aa1ff700 1 Processor -- start 2023-08-11T12:24:56.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.405+0000 7f12aa1ff700 1 -- start start 2023-08-11T12:24:56.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.405+0000 7f12aa1ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12a4072cc0 0x7f12a419d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:56.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.405+0000 7f12aa1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12a40735e0 0x7f12a419d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:56.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.405+0000 7f12aa1ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12a4111970 0x7f12a41a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:56.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.405+0000 7f12aa1ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a41a2080 con 0x7f12a4072cc0 2023-08-11T12:24:56.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.405+0000 7f12aa1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a41a21f0 con 0x7f12a40735e0 2023-08-11T12:24:56.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.405+0000 7f12aa1ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a41a23b0 con 0x7f12a4111970 2023-08-11T12:24:56.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.406+0000 7f12a2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12a40735e0 0x7f12a419d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:56.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.406+0000 7f12a3fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12a4111970 0x7f12a41a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:56.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.406+0000 7f12a2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12a40735e0 0x7f12a419d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:41378/0 (socket says 172.21.15.8:41378) 2023-08-11T12:24:56.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.406+0000 7f12a2ffd700 1 -- 172.21.15.8:0/1211374986 learned_addr learned my addr 172.21.15.8:0/1211374986 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:56.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.406+0000 7f12a37fe700 1 --2- 172.21.15.8:0/1211374986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12a4072cc0 0x7f12a419d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:56.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.406+0000 7f12a2ffd700 1 -- 172.21.15.8:0/1211374986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12a4111970 msgr2=0x7f12a41a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:56.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.406+0000 7f12a2ffd700 1 --2- 172.21.15.8:0/1211374986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12a4111970 0x7f12a41a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.406+0000 7f12a2ffd700 1 -- 172.21.15.8:0/1211374986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12a4072cc0 msgr2=0x7f12a419d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:56.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.406+0000 7f12a2ffd700 1 --2- 172.21.15.8:0/1211374986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12a4072cc0 0x7f12a419d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.406+0000 7f12a2ffd700 1 -- 172.21.15.8:0/1211374986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12940095f0 con 0x7f12a40735e0 2023-08-11T12:24:56.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.406+0000 7f12a3fff700 1 --2- 172.21.15.8:0/1211374986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12a4111970 0x7f12a41a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:56.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.406+0000 7f12a2ffd700 1 --2- 172.21.15.8:0/1211374986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12a40735e0 0x7f12a419d5e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f129800e9a0 tx=0x7f129800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:56.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.407+0000 7f12a0ff9700 1 -- 172.21.15.8:0/1211374986 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298009790 con 0x7f12a40735e0 2023-08-11T12:24:56.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.407+0000 7f12aa1ff700 1 -- 172.21.15.8:0/1211374986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a41a2690 con 0x7f12a40735e0 2023-08-11T12:24:56.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.407+0000 7f12a0ff9700 1 -- 172.21.15.8:0/1211374986 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1298010430 con 0x7f12a40735e0 2023-08-11T12:24:56.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.407+0000 7f12a0ff9700 1 -- 172.21.15.8:0/1211374986 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298018680 con 0x7f12a40735e0 2023-08-11T12:24:56.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.407+0000 7f12aa1ff700 1 -- 172.21.15.8:0/1211374986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a41a9ed0 con 0x7f12a40735e0 2023-08-11T12:24:56.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.412+0000 7f12a0ff9700 1 -- 172.21.15.8:0/1211374986 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) v1 ==== 134846+0+0 (secure 0 0 0) 0x7f12980105a0 con 0x7f12a40735e0 2023-08-11T12:24:56.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.413+0000 7f12bdabdb80 1 Processor -- start 2023-08-11T12:24:56.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.413+0000 7f12bdabdb80 1 -- start start 2023-08-11T12:24:56.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.413+0000 7f12bdabdb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a87338310 0x558a873386f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:56.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.413+0000 7f12bdabdb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a87338c30 0x558a873328e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:56.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.413+0000 7f12bdabdb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a87332e20 0x558a87333260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:56.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.413+0000 7f12bdabdb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8728b630 con 0x558a87338c30 2023-08-11T12:24:56.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.413+0000 7f12bdabdb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a87288f50 con 0x558a87332e20 2023-08-11T12:24:56.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.413+0000 7f12bdabdb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a87284840 con 0x558a87338310 2023-08-11T12:24:56.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.414+0000 7f12a3fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a87338310 0x558a873386f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:56.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.414+0000 7f12a3fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a87338310 0x558a873386f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:60978/0 (socket says 172.21.15.8:60978) 2023-08-11T12:24:56.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.414+0000 7f12a3fff700 1 -- 172.21.15.8:0/2670933925 learned_addr learned my addr 172.21.15.8:0/2670933925 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:56.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.414+0000 7f12a37fe700 1 --2- 172.21.15.8:0/2670933925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a87338c30 0x558a873328e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:56.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.414+0000 7f12a2ffd700 1 --2- 172.21.15.8:0/2670933925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a87332e20 0x558a87333260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:56.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.414+0000 7f12a3fff700 1 -- 172.21.15.8:0/2670933925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a87332e20 msgr2=0x558a87333260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:56.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.414+0000 7f12a3fff700 1 --2- 172.21.15.8:0/2670933925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a87332e20 0x558a87333260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.414+0000 7f12a3fff700 1 -- 172.21.15.8:0/2670933925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a87338c30 msgr2=0x558a873328e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.414+0000 7f12a3fff700 1 --2- 172.21.15.8:0/2670933925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a87338c30 0x558a873328e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.414+0000 7f12a3fff700 1 -- 172.21.15.8:0/2670933925 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a87104630 con 0x558a87338310 2023-08-11T12:24:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.414+0000 7f12a37fe700 1 --2- 172.21.15.8:0/2670933925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a87338c30 0x558a873328e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:24:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.414+0000 7f12a0ff9700 1 --2- 172.21.15.8:0/1211374986 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f128c0a01d0 0x7f128c0a2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.414+0000 7f12a3fff700 1 --2- 172.21.15.8:0/2670933925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a87338310 0x558a873386f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f129c003e40 tx=0x7f129c009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f238bb610c5dc7 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.414+0000 7f12a0ff9700 1 -- 172.21.15.8:0/1211374986 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f1298014070 con 0x7f12a40735e0 2023-08-11T12:24:56.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.415+0000 7f12a37fe700 1 --2- 172.21.15.8:0/1211374986 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f128c0a01d0 0x7f128c0a2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:56.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.415+0000 7f1289ffb700 1 -- 172.21.15.8:0/2670933925 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c0092d0 con 0x558a87338310 2023-08-11T12:24:56.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.415+0000 7f1289ffb700 1 -- 172.21.15.8:0/2670933925 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f129c00f040 con 0x558a87338310 2023-08-11T12:24:56.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.415+0000 7f1289ffb700 1 -- 172.21.15.8:0/2670933925 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c00e8b0 con 0x558a87338310 2023-08-11T12:24:56.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.415+0000 7f12bdabdb80 1 -- 172.21.15.8:0/2670933925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a87338310 msgr2=0x558a873386f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:56.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.415+0000 7f12bdabdb80 1 --2- 172.21.15.8:0/2670933925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a87338310 0x558a873386f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f129c003e40 tx=0x7f129c009920 comp rx=0 tx=0).stop 2023-08-11T12:24:56.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.415+0000 7f12a37fe700 1 --2- 172.21.15.8:0/1211374986 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f128c0a01d0 0x7f128c0a2690 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x558a8732f0a0 tx=0x7f1294005fb0 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:56.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.415+0000 7f12bdabdb80 1 -- 172.21.15.8:0/2670933925 shutdown_connections 2023-08-11T12:24:56.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.415+0000 7f12bdabdb80 1 --2- 172.21.15.8:0/2670933925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a87338310 0x558a873386f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.415+0000 7f12bdabdb80 1 --2- 172.21.15.8:0/2670933925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a87332e20 0x558a87333260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.415+0000 7f12bdabdb80 1 --2- 172.21.15.8:0/2670933925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a87338c30 0x558a873328e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.415+0000 7f12bdabdb80 1 -- 172.21.15.8:0/2670933925 >> 172.21.15.8:0/2670933925 conn(0x558a8725f950 msgr2=0x558a8732d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:56.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.416+0000 7f12bdabdb80 1 -- 172.21.15.8:0/2670933925 shutdown_connections 2023-08-11T12:24:56.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.416+0000 7f12bdabdb80 1 -- 172.21.15.8:0/2670933925 wait complete. 2023-08-11T12:24:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.416+0000 7f12bdabdb80 1 -- start start 2023-08-11T12:24:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.416+0000 7f12bdabdb80 1 Processor -- start 2023-08-11T12:24:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.417+0000 7f12bdabdb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a87332e20 0x558a8733eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:56.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.417+0000 7f12bdabdb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a87338310 0x558a8733be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:56.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.417+0000 7f12bdabdb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a87338c30 0x558a8733c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:56.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.417+0000 7f12bdabdb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a87222ac0 con 0x558a87332e20 2023-08-11T12:24:56.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.417+0000 7f12bdabdb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a872227c0 con 0x558a87338310 2023-08-11T12:24:56.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.417+0000 7f12bdabdb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a87106920 con 0x558a87338c30 2023-08-11T12:24:56.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.417+0000 7f12bdabdb80 10 client.0 _ll_register_callbacks cb 0x558a87225ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:56.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.417+0000 7f12a2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a87338310 0x558a8733be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:56.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.418+0000 7f12a2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a87338310 0x558a8733be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:41396/0 (socket says 172.21.15.8:41396) 2023-08-11T12:24:56.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.418+0000 7f12a2ffd700 1 -- 172.21.15.8:0/2006587824 learned_addr learned my addr 172.21.15.8:0/2006587824 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:56.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.418+0000 7f12a3fff700 1 --2- 172.21.15.8:0/2006587824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a87338c30 0x558a8733c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:56.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.418+0000 7f12a37fe700 1 --2- 172.21.15.8:0/2006587824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a87332e20 0x558a8733eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:56.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.418+0000 7f12a3fff700 1 -- 172.21.15.8:0/2006587824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a87338310 msgr2=0x558a8733be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:56.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.418+0000 7f12a3fff700 1 --2- 172.21.15.8:0/2006587824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a87338310 0x558a8733be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.418+0000 7f12a3fff700 1 -- 172.21.15.8:0/2006587824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a87332e20 msgr2=0x558a8733eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:56.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.418+0000 7f12a3fff700 1 --2- 172.21.15.8:0/2006587824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a87332e20 0x558a8733eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.418+0000 7f12a3fff700 1 -- 172.21.15.8:0/2006587824 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f129c003b20 con 0x558a87338c30 2023-08-11T12:24:56.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.418+0000 7f12a2ffd700 1 --2- 172.21.15.8:0/2006587824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a87338310 0x558a8733be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:56.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.418+0000 7f12a37fe700 1 --2- 172.21.15.8:0/2006587824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a87332e20 0x558a8733eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:24:56.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.419+0000 7f12a3fff700 1 --2- 172.21.15.8:0/2006587824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a87338c30 0x558a8733c4b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f129c004010 tx=0x7f129c007710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79063db02d60eae8 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:56.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.419+0000 7f1282ffd700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:24:56.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.419+0000 7f1282ffd700 1 -- 172.21.15.8:0/2006587824 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c007c70 con 0x558a87338c30 2023-08-11T12:24:56.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.419+0000 7f12bdabdb80 1 -- 172.21.15.8:0/2006587824 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a87325a90 con 0x558a87338c30 2023-08-11T12:24:56.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.419+0000 7f1282ffd700 1 -- 172.21.15.8:0/2006587824 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f129c00e4f0 con 0x558a87338c30 2023-08-11T12:24:56.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.419+0000 7f1282ffd700 1 -- 172.21.15.8:0/2006587824 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f129c00e6b0 con 0x558a87338c30 2023-08-11T12:24:56.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.419+0000 7f12bdabdb80 10 client.25711 fetch_fsmap learned FSMap version 27 2023-08-11T12:24:56.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.419+0000 7f12bdabdb80 1 -- 172.21.15.8:0/2006587824 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x558a870b0de0 con 0x558a87338c30 2023-08-11T12:24:56.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.419+0000 7f1282ffd700 1 -- 172.21.15.8:0/2006587824 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558a87325a90 con 0x558a87338c30 2023-08-11T12:24:56.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.420+0000 7f1282ffd700 1 -- 172.21.15.8:0/2006587824 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f129c01e8e0 con 0x558a87338c30 2023-08-11T12:24:56.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.420+0000 7f12bdabdb80 10 client.25711 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:24:56.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.420+0000 7f12bdabdb80 10 client.25711 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:24:56.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.420+0000 7f12bdabdb80 20 client.25711 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:56.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.420+0000 7f12bdabdb80 1 --2- 172.21.15.8:0/2006587824 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x558a8734c310 0x558a8734e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:56.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.420+0000 7f12bdabdb80 4 client.25711 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:24:56.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.420+0000 7f12bdabdb80 1 -- 172.21.15.8:0/2006587824 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558a873014e0 con 0x558a8734c310 2023-08-11T12:24:56.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.420+0000 7f12a37fe700 1 --2- 172.21.15.8:0/2006587824 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x558a8734c310 0x558a8734e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:56.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.421+0000 7f12a37fe700 1 --2- 172.21.15.8:0/2006587824 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x558a8734c310 0x558a8734e730 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=683c0735590be77b server_cookie=3a1f02d1ab69059f in_seq=0 out_seq=0 2023-08-11T12:24:56.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.421+0000 7f1282ffd700 10 client.25711 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:24:56.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.421+0000 7f1282ffd700 1 -- 172.21.15.8:0/2006587824 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x558a873014e0 con 0x558a8734c310 2023-08-11T12:24:56.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.421+0000 7f1282ffd700 10 client.25711 handle_command_reply: tid=0 2023-08-11T12:24:56.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.422+0000 7f12bdabdb80 1 client.25711 shutdown 2023-08-11T12:24:56.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.422+0000 7f12bdabdb80 1 -- 172.21.15.8:0/2006587824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a87338c30 msgr2=0x558a8733c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:56.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.422+0000 7f12bdabdb80 1 --2- 172.21.15.8:0/2006587824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a87338c30 0x558a8733c4b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f129c004010 tx=0x7f129c007710 comp rx=0 tx=0).stop 2023-08-11T12:24:56.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.422+0000 7f12bdabdb80 1 -- 172.21.15.8:0/2006587824 shutdown_connections 2023-08-11T12:24:56.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.422+0000 7f12bdabdb80 1 --2- 172.21.15.8:0/2006587824 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x558a8734c310 0x558a8734e730 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.422+0000 7f12bdabdb80 1 --2- 172.21.15.8:0/2006587824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a87338c30 0x558a8733c4b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.422+0000 7f12bdabdb80 1 --2- 172.21.15.8:0/2006587824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a87332e20 0x558a8733eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.422+0000 7f12bdabdb80 1 --2- 172.21.15.8:0/2006587824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a87338310 0x558a8733be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.422+0000 7f1282ffd700 0 client.25711 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:24:56.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.422+0000 7f12bdabdb80 1 -- 172.21.15.8:0/2006587824 >> 172.21.15.8:0/2006587824 conn(0x558a8725f950 msgr2=0x558a87327cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:56.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.422+0000 7f12bdabdb80 1 -- 172.21.15.8:0/2006587824 shutdown_connections 2023-08-11T12:24:56.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.422+0000 7f12bdabdb80 1 -- 172.21.15.8:0/2006587824 wait complete. 2023-08-11T12:24:56.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.422+0000 7f12bdabdb80 20 client.25711 trim_cache size 0 max 16384 2023-08-11T12:24:56.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.446+0000 7f12bdabdb80 1 Processor -- start 2023-08-11T12:24:56.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.446+0000 7f12bdabdb80 1 -- start start 2023-08-11T12:24:56.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.446+0000 7f12bdabdb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a87332e20 0x558a87343590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:56.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.446+0000 7f12bdabdb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a87338310 0x558a87337030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:56.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.446+0000 7f12bdabdb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a87338c30 0x558a87337570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:56.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.446+0000 7f12bdabdb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a873336a0 con 0x558a87338310 2023-08-11T12:24:56.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.446+0000 7f12bdabdb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8732d960 con 0x558a87338c30 2023-08-11T12:24:56.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.446+0000 7f12bdabdb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a873484b0 con 0x558a87332e20 2023-08-11T12:24:56.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.447+0000 7f12a3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a87338c30 0x558a87337570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:56.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.447+0000 7f12a3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a87338c30 0x558a87337570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:41408/0 (socket says 172.21.15.8:41408) 2023-08-11T12:24:56.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.447+0000 7f12a3fff700 1 -- 172.21.15.8:0/1573071926 learned_addr learned my addr 172.21.15.8:0/1573071926 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:56.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.447+0000 7f12a37fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a87332e20 0x558a87343590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:56.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.447+0000 7f12a2ffd700 1 --2- 172.21.15.8:0/1573071926 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a87338310 0x558a87337030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:56.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.447+0000 7f12a3fff700 1 -- 172.21.15.8:0/1573071926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a87332e20 msgr2=0x558a87343590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:56.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.447+0000 7f12a3fff700 1 --2- 172.21.15.8:0/1573071926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a87332e20 0x558a87343590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.447+0000 7f12a3fff700 1 -- 172.21.15.8:0/1573071926 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a87338310 msgr2=0x558a87337030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:56.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.447+0000 7f12a3fff700 1 --2- 172.21.15.8:0/1573071926 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a87338310 0x558a87337030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.447+0000 7f12a3fff700 1 -- 172.21.15.8:0/1573071926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a87099c60 con 0x558a87338c30 2023-08-11T12:24:56.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.447+0000 7f12a3fff700 1 --2- 172.21.15.8:0/1573071926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a87338c30 0x558a87337570 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f129c009e50 tx=0x7f129c009e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e1c7a7c86e9e07f server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:56.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.448+0000 7f128a7fc700 1 -- 172.21.15.8:0/1573071926 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c007c70 con 0x558a87338c30 2023-08-11T12:24:56.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.448+0000 7f128a7fc700 1 -- 172.21.15.8:0/1573071926 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f129c023070 con 0x558a87338c30 2023-08-11T12:24:56.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.448+0000 7f128a7fc700 1 -- 172.21.15.8:0/1573071926 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c01e7d0 con 0x558a87338c30 2023-08-11T12:24:56.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.448+0000 7f12bdabdb80 1 -- 172.21.15.8:0/1573071926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a87338c30 msgr2=0x558a87337570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:56.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.448+0000 7f12bdabdb80 1 --2- 172.21.15.8:0/1573071926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a87338c30 0x558a87337570 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f129c009e50 tx=0x7f129c009e80 comp rx=0 tx=0).stop 2023-08-11T12:24:56.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.448+0000 7f12bdabdb80 1 -- 172.21.15.8:0/1573071926 shutdown_connections 2023-08-11T12:24:56.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.448+0000 7f12bdabdb80 1 --2- 172.21.15.8:0/1573071926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a87332e20 0x558a87343590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.448+0000 7f12bdabdb80 1 --2- 172.21.15.8:0/1573071926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a87338c30 0x558a87337570 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.448+0000 7f12bdabdb80 1 --2- 172.21.15.8:0/1573071926 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a87338310 0x558a87337030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.448+0000 7f12bdabdb80 1 -- 172.21.15.8:0/1573071926 >> 172.21.15.8:0/1573071926 conn(0x558a8725f950 msgr2=0x558a87336140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:56.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.449+0000 7f12bdabdb80 1 -- 172.21.15.8:0/1573071926 shutdown_connections 2023-08-11T12:24:56.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.449+0000 7f12bdabdb80 1 -- 172.21.15.8:0/1573071926 wait complete. 2023-08-11T12:24:56.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.449+0000 7f12bdabdb80 1 -- start start 2023-08-11T12:24:56.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.449+0000 7f12bdabdb80 1 Processor -- start 2023-08-11T12:24:56.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.450+0000 7f12bdabdb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a87332e20 0x558a873983b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:56.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.450+0000 7f12bdabdb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a87338310 0x558a873988f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:56.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.450+0000 7f12bdabdb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a87338c30 0x558a87393f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:56.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.450+0000 7f12bdabdb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a87394620 con 0x558a87338310 2023-08-11T12:24:56.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.450+0000 7f12bdabdb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a87394790 con 0x558a87338c30 2023-08-11T12:24:56.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.450+0000 7f12bdabdb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a87394950 con 0x558a87332e20 2023-08-11T12:24:56.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.450+0000 7f12bdabdb80 10 client.0 _ll_register_callbacks cb 0x7f129c003d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:56.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.451+0000 7f12a3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a87338c30 0x558a87393f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:56.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.451+0000 7f12a3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a87338c30 0x558a87393f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:41414/0 (socket says 172.21.15.8:41414) 2023-08-11T12:24:56.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.451+0000 7f12a3fff700 1 -- 172.21.15.8:0/1986719262 learned_addr learned my addr 172.21.15.8:0/1986719262 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:56.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.451+0000 7f12a2ffd700 1 --2- 172.21.15.8:0/1986719262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a87338310 0x558a873988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:56.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.451+0000 7f12a3fff700 1 -- 172.21.15.8:0/1986719262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a87332e20 msgr2=0x558a873983b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-11T12:24:56.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.451+0000 7f12a37fe700 1 --2- 172.21.15.8:0/1986719262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a87332e20 0x558a873983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:56.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.451+0000 7f12a3fff700 1 --2- 172.21.15.8:0/1986719262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a87332e20 0x558a873983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.451+0000 7f12a3fff700 1 -- 172.21.15.8:0/1986719262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a87338310 msgr2=0x558a873988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:56.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.451+0000 7f12a3fff700 1 --2- 172.21.15.8:0/1986719262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a87338310 0x558a873988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.451+0000 7f12a3fff700 1 -- 172.21.15.8:0/1986719262 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558a870b0de0 con 0x558a87338c30 2023-08-11T12:24:56.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.451+0000 7f12a2ffd700 1 --2- 172.21.15.8:0/1986719262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a87338310 0x558a873988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:24:56.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.451+0000 7f12a37fe700 1 --2- 172.21.15.8:0/1986719262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a87332e20 0x558a873983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:24:56.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.452+0000 7f12a3fff700 1 --2- 172.21.15.8:0/1986719262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a87338c30 0x558a87393f10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f129c004780 tx=0x7f129c004d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d191f53644c80ca server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:56.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.452+0000 7f1282ffd700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:24:56.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.452+0000 7f1282ffd700 1 -- 172.21.15.8:0/1986719262 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c007e80 con 0x558a87338c30 2023-08-11T12:24:56.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.452+0000 7f12bdabdb80 1 -- 172.21.15.8:0/1986719262 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f129c00f040 con 0x558a87338c30 2023-08-11T12:24:56.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.452+0000 7f1282ffd700 1 -- 172.21.15.8:0/1986719262 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f129c01e450 con 0x558a87338c30 2023-08-11T12:24:56.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.452+0000 7f1282ffd700 1 -- 172.21.15.8:0/1986719262 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f129c01e610 con 0x558a87338c30 2023-08-11T12:24:56.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.452+0000 7f12bdabdb80 10 client.25706 fetch_fsmap learned FSMap version 27 2023-08-11T12:24:56.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.452+0000 7f12bdabdb80 1 -- 172.21.15.8:0/1986719262 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x558a870d7250 con 0x558a87338c30 2023-08-11T12:24:56.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.453+0000 7f1282ffd700 1 -- 172.21.15.8:0/1986719262 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f129c00f040 con 0x558a87338c30 2023-08-11T12:24:56.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.453+0000 7f1282ffd700 1 -- 172.21.15.8:0/1986719262 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f129c00e4f0 con 0x558a87338c30 2023-08-11T12:24:56.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.453+0000 7f12bdabdb80 10 client.25706 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:24:56.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.453+0000 7f12bdabdb80 10 client.25706 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:24:56.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.453+0000 7f12bdabdb80 20 client.25706 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:56.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.453+0000 7f12bdabdb80 1 --2- 172.21.15.8:0/1986719262 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x558a873a0e80 0x558a873a3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:56.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.453+0000 7f12bdabdb80 4 client.25706 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:24:56.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.453+0000 7f12bdabdb80 1 -- 172.21.15.8:0/1986719262 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558a8727d820 con 0x558a873a0e80 2023-08-11T12:24:56.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.454+0000 7f12a37fe700 1 --2- 172.21.15.8:0/1986719262 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x558a873a0e80 0x558a873a3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:56.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.454+0000 7f12a37fe700 1 --2- 172.21.15.8:0/1986719262 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x558a873a0e80 0x558a873a3270 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e12a9ce2e49cfa12 server_cookie=6aeed1c89e63f363 in_seq=0 out_seq=0 2023-08-11T12:24:56.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.454+0000 7f1282ffd700 10 client.25706 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:24:56.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.454+0000 7f1282ffd700 1 -- 172.21.15.8:0/1986719262 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x558a8727d820 con 0x558a873a0e80 2023-08-11T12:24:56.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.454+0000 7f1282ffd700 10 client.25706 handle_command_reply: tid=0 2023-08-11T12:24:56.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.455+0000 7f12bdabdb80 1 client.25706 shutdown 2023-08-11T12:24:56.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.455+0000 7f12bdabdb80 1 -- 172.21.15.8:0/1986719262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a87338c30 msgr2=0x558a87393f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:56.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.455+0000 7f12bdabdb80 1 --2- 172.21.15.8:0/1986719262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a87338c30 0x558a87393f10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f129c004780 tx=0x7f129c004d30 comp rx=0 tx=0).stop 2023-08-11T12:24:56.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.455+0000 7f12bdabdb80 1 -- 172.21.15.8:0/1986719262 shutdown_connections 2023-08-11T12:24:56.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.455+0000 7f12bdabdb80 1 --2- 172.21.15.8:0/1986719262 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x558a873a0e80 0x558a873a3270 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.455+0000 7f12bdabdb80 1 --2- 172.21.15.8:0/1986719262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a87332e20 0x558a873983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.455+0000 7f1282ffd700 0 client.25706 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:24:56.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.455+0000 7f12bdabdb80 1 --2- 172.21.15.8:0/1986719262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a87338c30 0x558a87393f10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.455+0000 7f12bdabdb80 1 --2- 172.21.15.8:0/1986719262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a87338310 0x558a873988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.455+0000 7f12bdabdb80 1 -- 172.21.15.8:0/1986719262 >> 172.21.15.8:0/1986719262 conn(0x558a8725f950 msgr2=0x558a87327420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:56.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.455+0000 7f12bdabdb80 1 -- 172.21.15.8:0/1986719262 shutdown_connections 2023-08-11T12:24:56.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.455+0000 7f12bdabdb80 1 -- 172.21.15.8:0/1986719262 wait complete. 2023-08-11T12:24:56.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.456+0000 7f12bdabdb80 20 client.25706 trim_cache size 0 max 16384 2023-08-11T12:24:56.467 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:24:56.467 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2023-08-11T12:24:56.467 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2023-08-11T12:24:56.467 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:24:56.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.456+0000 7f12aa1ff700 1 -- 172.21.15.8:0/1211374986 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f128c0a01d0 msgr2=0x7f128c0a2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:56.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.456+0000 7f12aa1ff700 1 --2- 172.21.15.8:0/1211374986 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f128c0a01d0 0x7f128c0a2690 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x558a8732f0a0 tx=0x7f1294005fb0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.456+0000 7f12aa1ff700 1 -- 172.21.15.8:0/1211374986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12a40735e0 msgr2=0x7f12a419d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:56.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.456+0000 7f12aa1ff700 1 --2- 172.21.15.8:0/1211374986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12a40735e0 0x7f12a419d5e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f129800e9a0 tx=0x7f129800ecb0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.456+0000 7f12aa1ff700 1 -- 172.21.15.8:0/1211374986 shutdown_connections 2023-08-11T12:24:56.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.456+0000 7f12aa1ff700 1 --2- 172.21.15.8:0/1211374986 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f128c0a01d0 0x7f128c0a2690 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.456+0000 7f12aa1ff700 1 --2- 172.21.15.8:0/1211374986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12a4111970 0x7f12a41a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.456+0000 7f12aa1ff700 1 --2- 172.21.15.8:0/1211374986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12a4072cc0 0x7f12a419d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.456+0000 7f12aa1ff700 1 --2- 172.21.15.8:0/1211374986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12a40735e0 0x7f12a419d5e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.456+0000 7f12aa1ff700 1 -- 172.21.15.8:0/1211374986 >> 172.21.15.8:0/1211374986 conn(0x7f12a40fc490 msgr2=0x7f12a40fd100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:56.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.457+0000 7f12aa1ff700 1 -- 172.21.15.8:0/1211374986 shutdown_connections 2023-08-11T12:24:56.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.457+0000 7f12aa1ff700 1 -- 172.21.15.8:0/1211374986 wait complete. 2023-08-11T12:24:56.490 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-08-11T12:24:56.490 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-11T12:24:56.612 INFO:teuthology.orchestra.run.smithi008.stderr:500000 of 50000000 tuples (1%) done (elapsed 1.30 s, remaining 128.63 s) 2023-08-11T12:24:56.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.749+0000 7ff3a39ff700 1 -- 172.21.15.8:0/808181710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff39c107f30 msgr2=0x7ff39c10fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:56.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.749+0000 7ff3a39ff700 1 --2- 172.21.15.8:0/808181710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff39c107f30 0x7ff39c10fab0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff394009f90 tx=0x7ff39400b330 comp rx=0 tx=0).stop 2023-08-11T12:24:56.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.749+0000 7ff3a39ff700 1 -- 172.21.15.8:0/808181710 shutdown_connections 2023-08-11T12:24:56.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.749+0000 7ff3a39ff700 1 --2- 172.21.15.8:0/808181710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff39c107f30 0x7ff39c10fab0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.749+0000 7ff3a39ff700 1 --2- 172.21.15.8:0/808181710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff39c102e10 0x7ff39c1031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.749+0000 7ff3a39ff700 1 --2- 172.21.15.8:0/808181710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff39c1037c0 0x7ff39c107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.749+0000 7ff3a39ff700 1 -- 172.21.15.8:0/808181710 >> 172.21.15.8:0/808181710 conn(0x7ff39c0fe650 msgr2=0x7ff39c100a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:56.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.749+0000 7ff3a39ff700 1 -- 172.21.15.8:0/808181710 shutdown_connections 2023-08-11T12:24:56.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.749+0000 7ff3a39ff700 1 -- 172.21.15.8:0/808181710 wait complete. 2023-08-11T12:24:56.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.751+0000 7ff3a39ff700 1 Processor -- start 2023-08-11T12:24:56.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.751+0000 7ff3a39ff700 1 -- start start 2023-08-11T12:24:56.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.752+0000 7ff3a39ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff39c102e10 0x7ff39c198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:56.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.752+0000 7ff3a39ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff39c107f30 0x7ff39c1993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:56.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.752+0000 7ff3a39ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff39c19d810 0x7ff39c19dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:56.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.752+0000 7ff3a39ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c19e290 con 0x7ff39c19d810 2023-08-11T12:24:56.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.752+0000 7ff3a39ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c19e400 con 0x7ff39c107f30 2023-08-11T12:24:56.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.752+0000 7ff3a39ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c19e5c0 con 0x7ff39c102e10 2023-08-11T12:24:56.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.752+0000 7ff3a1f9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff39c19d810 0x7ff39c19dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:56.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.752+0000 7ff3a0f9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff39c107f30 0x7ff39c1993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:56.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.752+0000 7ff3a0f9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff39c107f30 0x7ff39c1993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:41432/0 (socket says 172.21.15.8:41432) 2023-08-11T12:24:56.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.752+0000 7ff3a0f9a700 1 -- 172.21.15.8:0/400700698 learned_addr learned my addr 172.21.15.8:0/400700698 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:56.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.753+0000 7ff3a1f9c700 1 -- 172.21.15.8:0/400700698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff39c102e10 msgr2=0x7ff39c198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:56.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.753+0000 7ff3a1f9c700 1 --2- 172.21.15.8:0/400700698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff39c102e10 0x7ff39c198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.753+0000 7ff3a1f9c700 1 -- 172.21.15.8:0/400700698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff39c107f30 msgr2=0x7ff39c1993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:56.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.753+0000 7ff3a1f9c700 1 --2- 172.21.15.8:0/400700698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff39c107f30 0x7ff39c1993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:56.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.753+0000 7ff3a1f9c700 1 -- 172.21.15.8:0/400700698 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff394009c40 con 0x7ff39c19d810 2023-08-11T12:24:56.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.753+0000 7ff3a0f9a700 1 --2- 172.21.15.8:0/400700698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff39c107f30 0x7ff39c1993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:56.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.753+0000 7ff3a1f9c700 1 --2- 172.21.15.8:0/400700698 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff39c19d810 0x7ff39c19dc90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff39400b6c0 tx=0x7ff394004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:56.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.753+0000 7ff3927fc700 1 -- 172.21.15.8:0/400700698 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39400e040 con 0x7ff39c19d810 2023-08-11T12:24:56.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.753+0000 7ff3927fc700 1 -- 172.21.15.8:0/400700698 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff394008e80 con 0x7ff39c19d810 2023-08-11T12:24:56.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.753+0000 7ff3a39ff700 1 -- 172.21.15.8:0/400700698 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff39c1a5ac0 con 0x7ff39c19d810 2023-08-11T12:24:56.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.754+0000 7ff3927fc700 1 -- 172.21.15.8:0/400700698 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3940052a0 con 0x7ff39c19d810 2023-08-11T12:24:56.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.754+0000 7ff3a39ff700 1 -- 172.21.15.8:0/400700698 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39c1a5f40 con 0x7ff39c19d810 2023-08-11T12:24:56.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.756+0000 7ff3a39ff700 1 -- 172.21.15.8:0/400700698 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff39c0677a0 con 0x7ff39c19d810 2023-08-11T12:24:56.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.758+0000 7ff3927fc700 1 -- 172.21.15.8:0/400700698 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 134846+0+0 (secure 0 0 0) 0x7ff39401d470 con 0x7ff39c19d810 2023-08-11T12:24:56.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.760+0000 7ff3927fc700 1 --2- 172.21.15.8:0/400700698 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff3880a0150 0x7ff3880a2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:56.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.761+0000 7ff3927fc700 1 -- 172.21.15.8:0/400700698 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7ff3940cce60 con 0x7ff39c19d810 2023-08-11T12:24:56.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.761+0000 7ff3a179b700 1 --2- 172.21.15.8:0/400700698 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff3880a0150 0x7ff3880a2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:56.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.761+0000 7ff3a179b700 1 --2- 172.21.15.8:0/400700698 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff3880a0150 0x7ff3880a2610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff398005950 tx=0x7ff3980058e0 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:56.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:56.764+0000 7ff3927fc700 1 -- 172.21.15.8:0/400700698 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7ff394096480 con 0x7ff39c19d810 2023-08-11T12:24:56.815 INFO:teuthology.orchestra.run.smithi008.stderr:600000 of 50000000 tuples (1%) done (elapsed 1.50 s, remaining 123.67 s) 2023-08-11T12:24:57.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.037+0000 7ff3a39ff700 1 -- 172.21.15.8:0/400700698 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff39c1037c0 con 0x7ff39c19d810 2023-08-11T12:24:57.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.038+0000 7ff3927fc700 1 -- 172.21.15.8:0/400700698 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11351 (secure 0 0 0) 0x7ff394099aa0 con 0x7ff39c19d810 2023-08-11T12:24:57.041 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:24:57.041 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14469,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2854286216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2854286216},{"type":"v1","addr":"172.21.15.8:6835","nonce":2854286216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/805368621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":805368621},{"type":"v1","addr":"172.21.15.8:6837","nonce":805368621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-11T12:22:03.398475+0000","modified":"2023-08-11T12:22:32.690553+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24575,"mds_1":24550,"mds_2":24517,"mds_3":24500,"mds_4":24464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14526":{"gid":14526,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/2990530720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":2990530720},{"type":"v1","addr":"172.21.15.8:6839","nonce":2990530720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14538":{"gid":14538,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6841/3589272762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":3589272762},{"type":"v1","addr":"172.21.15.8:6841","nonce":3589272762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6833/2043443402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2043443402},{"type":"v1","addr":"172.21.15.194:6833","nonce":2043443402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24464":{"gid":24464,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.45:6833/1208864615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1208864615},{"type":"v1","addr":"172.21.15.45:6833","nonce":1208864615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24500":{"gid":24500,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.45:6835/1776075470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1776075470},{"type":"v1","addr":"172.21.15.45:6835","nonce":1776075470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24517":{"gid":24517,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.194:6835/2457430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2457430285},{"type":"v1","addr":"172.21.15.194:6835","nonce":2457430285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24529":{"gid":24529,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/3072808560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":3072808560},{"type":"v1","addr":"172.21.15.194:6837","nonce":3072808560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/641549061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":641549061},{"type":"v1","addr":"172.21.15.45:6837","nonce":641549061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.194:6839/2174476491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":2174476491},{"type":"v1","addr":"172.21.15.194:6839","nonce":2174476491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6839/119684732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":119684732},{"type":"v1","addr":"172.21.15.45:6839","nonce":119684732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-11T12:24:57.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.040+0000 7ff3a39ff700 1 -- 172.21.15.8:0/400700698 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff3880a0150 msgr2=0x7ff3880a2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.040+0000 7ff3a39ff700 1 --2- 172.21.15.8:0/400700698 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff3880a0150 0x7ff3880a2610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff398005950 tx=0x7ff3980058e0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.040+0000 7ff3a39ff700 1 -- 172.21.15.8:0/400700698 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff39c19d810 msgr2=0x7ff39c19dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.040+0000 7ff3a39ff700 1 --2- 172.21.15.8:0/400700698 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff39c19d810 0x7ff39c19dc90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff39400b6c0 tx=0x7ff394004d30 comp rx=0 tx=0).stop 2023-08-11T12:24:57.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.040+0000 7ff3a39ff700 1 -- 172.21.15.8:0/400700698 shutdown_connections 2023-08-11T12:24:57.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.040+0000 7ff3a39ff700 1 --2- 172.21.15.8:0/400700698 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff3880a0150 0x7ff3880a2610 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.040+0000 7ff3a39ff700 1 --2- 172.21.15.8:0/400700698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff39c102e10 0x7ff39c198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.040+0000 7ff3a39ff700 1 --2- 172.21.15.8:0/400700698 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff39c19d810 0x7ff39c19dc90 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.040+0000 7ff3a39ff700 1 --2- 172.21.15.8:0/400700698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff39c107f30 0x7ff39c1993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.040+0000 7ff3a39ff700 1 -- 172.21.15.8:0/400700698 >> 172.21.15.8:0/400700698 conn(0x7ff39c0fe650 msgr2=0x7ff39c0ff0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:57.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.041+0000 7ff3a39ff700 1 -- 172.21.15.8:0/400700698 shutdown_connections 2023-08-11T12:24:57.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.041+0000 7ff3a39ff700 1 -- 172.21.15.8:0/400700698 wait complete. 2023-08-11T12:24:57.045 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 27 2023-08-11T12:24:57.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:56 smithi008 ceph-mon[97158]: pgmap v13: 129 pgs: 129 active+clean; 7.9 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 583 KiB/s wr, 135 op/s 2023-08-11T12:24:57.064 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-08-11T12:24:57.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:56 smithi194 ceph-mon[130905]: pgmap v13: 129 pgs: 129 active+clean; 7.9 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 583 KiB/s wr, 135 op/s 2023-08-11T12:24:57.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:56 smithi045 ceph-mon[130284]: pgmap v13: 129 pgs: 129 active+clean; 7.9 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 583 KiB/s wr, 135 op/s 2023-08-11T12:24:57.160 INFO:teuthology.orchestra.run.smithi008.stderr:700000 of 50000000 tuples (1%) done (elapsed 1.85 s, remaining 130.12 s) 2023-08-11T12:24:57.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.280+0000 7feffadff700 1 -- 172.21.15.8:0/3710021698 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff4100960 msgr2=0x7feff4100de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.280+0000 7feffadff700 1 --2- 172.21.15.8:0/3710021698 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff4100960 0x7feff4100de0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fefe0009990 tx=0x7fefe0009ca0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.281+0000 7feffadff700 1 -- 172.21.15.8:0/3710021698 shutdown_connections 2023-08-11T12:24:57.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.281+0000 7feffadff700 1 --2- 172.21.15.8:0/3710021698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feff4106970 0x7feff4106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.281+0000 7feffadff700 1 --2- 172.21.15.8:0/3710021698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feff4101320 0x7feff410d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.281+0000 7feffadff700 1 --2- 172.21.15.8:0/3710021698 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff4100960 0x7feff4100de0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.281+0000 7feffadff700 1 -- 172.21.15.8:0/3710021698 >> 172.21.15.8:0/3710021698 conn(0x7feff40fc490 msgr2=0x7feff40fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:57.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.281+0000 7feffadff700 1 -- 172.21.15.8:0/3710021698 shutdown_connections 2023-08-11T12:24:57.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.281+0000 7feffadff700 1 -- 172.21.15.8:0/3710021698 wait complete. 2023-08-11T12:24:57.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.282+0000 7feffadff700 1 Processor -- start 2023-08-11T12:24:57.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.282+0000 7feffadff700 1 -- start start 2023-08-11T12:24:57.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.282+0000 7feffadff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff4100960 0x7feff4072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.282+0000 7feffadff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feff4101320 0x7feff4073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.282+0000 7feffadff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feff4106970 0x7feff40736a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.282+0000 7feffadff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff41a4ee0 con 0x7feff4100960 2023-08-11T12:24:57.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.282+0000 7feffadff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff41a5050 con 0x7feff4106970 2023-08-11T12:24:57.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.282+0000 7feffadff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff41a5210 con 0x7feff4101320 2023-08-11T12:24:57.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.283+0000 7feff8b9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff4100960 0x7feff4072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.283+0000 7feff8b9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff4100960 0x7feff4072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54286/0 (socket says 172.21.15.8:54286) 2023-08-11T12:24:57.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.283+0000 7feff8b9b700 1 -- 172.21.15.8:0/383577104 learned_addr learned my addr 172.21.15.8:0/383577104 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:57.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.283+0000 7feff3fff700 1 --2- 172.21.15.8:0/383577104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feff4101320 0x7feff4073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.283+0000 7feff939c700 1 --2- 172.21.15.8:0/383577104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feff4106970 0x7feff40736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.283+0000 7feff8b9b700 1 -- 172.21.15.8:0/383577104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feff4101320 msgr2=0x7feff4073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.283+0000 7feff8b9b700 1 --2- 172.21.15.8:0/383577104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feff4101320 0x7feff4073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.283+0000 7feff8b9b700 1 -- 172.21.15.8:0/383577104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feff4106970 msgr2=0x7feff40736a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.283+0000 7feff8b9b700 1 --2- 172.21.15.8:0/383577104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feff4106970 0x7feff40736a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.283+0000 7feff8b9b700 1 -- 172.21.15.8:0/383577104 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefec009c40 con 0x7feff4100960 2023-08-11T12:24:57.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.283+0000 7feff939c700 1 --2- 172.21.15.8:0/383577104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feff4106970 0x7feff40736a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:24:57.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.283+0000 7feff8b9b700 1 --2- 172.21.15.8:0/383577104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff4100960 0x7feff4072c20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fefe800d950 tx=0x7fefe800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:57.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.284+0000 7feff1ffb700 1 -- 172.21.15.8:0/383577104 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe8009b40 con 0x7feff4100960 2023-08-11T12:24:57.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.284+0000 7feff1ffb700 1 -- 172.21.15.8:0/383577104 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefe8009ca0 con 0x7feff4100960 2023-08-11T12:24:57.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.284+0000 7feffadff700 1 -- 172.21.15.8:0/383577104 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe00095f0 con 0x7feff4100960 2023-08-11T12:24:57.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.284+0000 7feff1ffb700 1 -- 172.21.15.8:0/383577104 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe800f620 con 0x7feff4100960 2023-08-11T12:24:57.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.284+0000 7feffadff700 1 -- 172.21.15.8:0/383577104 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff41a58c0 con 0x7feff4100960 2023-08-11T12:24:57.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.288+0000 7feff1ffb700 1 -- 172.21.15.8:0/383577104 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 134846+0+0 (secure 0 0 0) 0x7fefe8010460 con 0x7feff4100960 2023-08-11T12:24:57.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.290+0000 7ff00e7b0b80 1 Processor -- start 2023-08-11T12:24:57.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.290+0000 7ff00e7b0b80 1 -- start start 2023-08-11T12:24:57.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.290+0000 7ff00e7b0b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b167321310 0x55b1673216f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.290+0000 7ff00e7b0b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b167321c30 0x55b16731b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.290+0000 7ff00e7b0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b16731be20 0x55b16731c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.290+0000 7ff00e7b0b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b167274630 con 0x55b167321310 2023-08-11T12:24:57.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.290+0000 7ff00e7b0b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b167271f50 con 0x55b167321c30 2023-08-11T12:24:57.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.290+0000 7ff00e7b0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b16726d840 con 0x55b16731be20 2023-08-11T12:24:57.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.290+0000 7feff939c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b167321310 0x55b1673216f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.291+0000 7feff939c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b167321310 0x55b1673216f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54296/0 (socket says 172.21.15.8:54296) 2023-08-11T12:24:57.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.291+0000 7feff939c700 1 -- 172.21.15.8:0/2653079814 learned_addr learned my addr 172.21.15.8:0/2653079814 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:57.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.291+0000 7feff3fff700 1 --2- 172.21.15.8:0/2653079814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b16731be20 0x55b16731c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.291+0000 7feff8b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b167321c30 0x55b16731b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.291+0000 7feff1ffb700 1 --2- 172.21.15.8:0/383577104 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fefe40a01d0 0x7fefe40a2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.291+0000 7feff3fff700 1 -- 172.21.15.8:0/2653079814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b167321c30 msgr2=0x55b16731b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:57.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.291+0000 7feff3fff700 1 --2- 172.21.15.8:0/2653079814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b167321c30 0x55b16731b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.291+0000 7feff3fff700 1 -- 172.21.15.8:0/2653079814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b167321310 msgr2=0x55b1673216f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:57.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.291+0000 7feff1ffb700 1 -- 172.21.15.8:0/383577104 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fefe80cbde0 con 0x7feff4100960 2023-08-11T12:24:57.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.291+0000 7feff3fff700 1 --2- 172.21.15.8:0/2653079814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b167321310 0x55b1673216f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.291+0000 7feff3fff700 1 -- 172.21.15.8:0/2653079814 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1670ed630 con 0x55b16731be20 2023-08-11T12:24:57.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.291+0000 7feff8b9b700 1 --2- 172.21.15.8:0/2653079814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b167321c30 0x55b16731b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:57.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.291+0000 7feff939c700 1 --2- 172.21.15.8:0/2653079814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b167321310 0x55b1673216f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:57.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.291+0000 7feff939c700 1 --2- 172.21.15.8:0/383577104 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fefe40a01d0 0x7fefe40a2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.292+0000 7feff3fff700 1 --2- 172.21.15.8:0/2653079814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b16731be20 0x55b16731c260 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7feff40743c0 tx=0x7fefe0005e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34615158f0c2c7c1 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:57.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.292+0000 7fefdeffd700 1 -- 172.21.15.8:0/2653079814 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe000beb0 con 0x55b16731be20 2023-08-11T12:24:57.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.292+0000 7fefdeffd700 1 -- 172.21.15.8:0/2653079814 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefe001e040 con 0x55b16731be20 2023-08-11T12:24:57.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.292+0000 7fefdeffd700 1 -- 172.21.15.8:0/2653079814 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe0004a30 con 0x55b16731be20 2023-08-11T12:24:57.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.293+0000 7ff00e7b0b80 1 -- 172.21.15.8:0/2653079814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b16731be20 msgr2=0x55b16731c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.293+0000 7feff939c700 1 --2- 172.21.15.8:0/383577104 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fefe40a01d0 0x7fefe40a2690 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fefec0078e0 tx=0x7fefec004ad0 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:57.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.293+0000 7ff00e7b0b80 1 --2- 172.21.15.8:0/2653079814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b16731be20 0x55b16731c260 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7feff40743c0 tx=0x7fefe0005e80 comp rx=0 tx=0).stop 2023-08-11T12:24:57.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.293+0000 7ff00e7b0b80 1 -- 172.21.15.8:0/2653079814 shutdown_connections 2023-08-11T12:24:57.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.293+0000 7ff00e7b0b80 1 --2- 172.21.15.8:0/2653079814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b16731be20 0x55b16731c260 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.293+0000 7ff00e7b0b80 1 --2- 172.21.15.8:0/2653079814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b167321310 0x55b1673216f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.293+0000 7ff00e7b0b80 1 --2- 172.21.15.8:0/2653079814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b167321c30 0x55b16731b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.293+0000 7ff00e7b0b80 1 -- 172.21.15.8:0/2653079814 >> 172.21.15.8:0/2653079814 conn(0x55b167248950 msgr2=0x55b1673163d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:57.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.293+0000 7ff00e7b0b80 1 -- 172.21.15.8:0/2653079814 shutdown_connections 2023-08-11T12:24:57.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.293+0000 7ff00e7b0b80 1 -- 172.21.15.8:0/2653079814 wait complete. 2023-08-11T12:24:57.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.293+0000 7ff00e7b0b80 1 -- start start 2023-08-11T12:24:57.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.294+0000 7ff00e7b0b80 1 Processor -- start 2023-08-11T12:24:57.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.294+0000 7ff00e7b0b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b16731be20 0x55b167327b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.294+0000 7ff00e7b0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b167321310 0x55b167324dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.294+0000 7ff00e7b0b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b167321c30 0x55b1673253d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.294+0000 7ff00e7b0b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b16720bac0 con 0x55b167321c30 2023-08-11T12:24:57.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.294+0000 7ff00e7b0b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b16720b7c0 con 0x55b16731be20 2023-08-11T12:24:57.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.294+0000 7ff00e7b0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1670ef920 con 0x55b167321310 2023-08-11T12:24:57.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.295+0000 7ff00e7b0b80 10 client.0 _ll_register_callbacks cb 0x55b16720eab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:57.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.295+0000 7feff8b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b16731be20 0x55b167327b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.295+0000 7feff939c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b167321c30 0x55b1673253d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.295+0000 7feff3fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b167321310 0x55b167324dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.295+0000 7feff8b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b16731be20 0x55b167327b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:41468/0 (socket says 172.21.15.8:41468) 2023-08-11T12:24:57.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.295+0000 7feff8b9b700 1 -- 172.21.15.8:0/2384900009 learned_addr learned my addr 172.21.15.8:0/2384900009 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:57.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.295+0000 7feff8b9b700 1 -- 172.21.15.8:0/2384900009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b167321310 msgr2=0x55b167324dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:57.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.295+0000 7feff8b9b700 1 --2- 172.21.15.8:0/2384900009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b167321310 0x55b167324dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.295+0000 7feff8b9b700 1 -- 172.21.15.8:0/2384900009 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b167321c30 msgr2=0x55b1673253d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:57.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.295+0000 7feff8b9b700 1 --2- 172.21.15.8:0/2384900009 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b167321c30 0x55b1673253d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.295+0000 7feff8b9b700 1 -- 172.21.15.8:0/2384900009 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff41a58c0 con 0x55b16731be20 2023-08-11T12:24:57.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.295+0000 7feff3fff700 1 --2- 172.21.15.8:0/2384900009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b167321310 0x55b167324dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:57.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.296+0000 7feff8b9b700 1 --2- 172.21.15.8:0/2384900009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b16731be20 0x55b167327b10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fefe80c91b0 tx=0x7fefe8005dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65eb404b57e8a777 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:57.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.296+0000 7fefd3fff700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:24:57.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.296+0000 7fefd3fff700 1 -- 172.21.15.8:0/2384900009 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe8095370 con 0x55b16731be20 2023-08-11T12:24:57.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.296+0000 7fefd3fff700 1 -- 172.21.15.8:0/2384900009 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fefe80cd070 con 0x55b16731be20 2023-08-11T12:24:57.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.296+0000 7ff00e7b0b80 1 -- 172.21.15.8:0/2384900009 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b16730ea90 con 0x55b16731be20 2023-08-11T12:24:57.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.296+0000 7fefd3fff700 1 -- 172.21.15.8:0/2384900009 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefe8098e00 con 0x55b16731be20 2023-08-11T12:24:57.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.296+0000 7ff00e7b0b80 10 client.25721 fetch_fsmap learned FSMap version 27 2023-08-11T12:24:57.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.296+0000 7ff00e7b0b80 1 -- 172.21.15.8:0/2384900009 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7feff410e130 con 0x55b16731be20 2023-08-11T12:24:57.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.296+0000 7fefd3fff700 1 -- 172.21.15.8:0/2384900009 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefe80b0030 con 0x55b16731be20 2023-08-11T12:24:57.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.296+0000 7fefd3fff700 1 -- 172.21.15.8:0/2384900009 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fefe8099290 con 0x55b16731be20 2023-08-11T12:24:57.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.296+0000 7ff00e7b0b80 10 client.25721 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:24:57.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.296+0000 7ff00e7b0b80 10 client.25721 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2023-08-11T12:24:57.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.296+0000 7ff00e7b0b80 20 client.25721 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:57.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.296+0000 7ff00e7b0b80 1 --2- 172.21.15.8:0/2384900009 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x55b167335460 0x55b167337880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.297+0000 7ff00e7b0b80 4 client.25721 mds_command: new command op to 24464 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:24:57.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.297+0000 7ff00e7b0b80 1 -- 172.21.15.8:0/2384900009 --> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b1672ea4e0 con 0x55b167335460 2023-08-11T12:24:57.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.297+0000 7feff3fff700 1 --2- 172.21.15.8:0/2384900009 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x55b167335460 0x55b167337880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.297+0000 7feff3fff700 1 --2- 172.21.15.8:0/2384900009 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x55b167335460 0x55b167337880 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=16e24a326961a339 server_cookie=76dca7324558ee44 in_seq=0 out_seq=0 2023-08-11T12:24:57.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.297+0000 7fefd3fff700 10 client.25721 ms_handle_connect on v2:172.21.15.45:6832/1208864615 2023-08-11T12:24:57.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.298+0000 7fefd3fff700 1 -- 172.21.15.8:0/2384900009 <== mds.4 v2:172.21.15.45:6832/1208864615 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55b1672ea4e0 con 0x55b167335460 2023-08-11T12:24:57.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.298+0000 7fefd3fff700 10 client.25721 handle_command_reply: tid=0 2023-08-11T12:24:57.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.298+0000 7ff00e7b0b80 1 client.25721 shutdown 2023-08-11T12:24:57.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.298+0000 7ff00e7b0b80 1 -- 172.21.15.8:0/2384900009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b16731be20 msgr2=0x55b167327b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.298+0000 7ff00e7b0b80 1 --2- 172.21.15.8:0/2384900009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b16731be20 0x55b167327b10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fefe80c91b0 tx=0x7fefe8005dc0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.299+0000 7ff00e7b0b80 1 -- 172.21.15.8:0/2384900009 shutdown_connections 2023-08-11T12:24:57.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.299+0000 7ff00e7b0b80 1 --2- 172.21.15.8:0/2384900009 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x55b167335460 0x55b167337880 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.299+0000 7ff00e7b0b80 1 --2- 172.21.15.8:0/2384900009 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b167321c30 0x55b1673253d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.299+0000 7fefd3fff700 0 client.25721 ms_handle_reset on v2:172.21.15.45:6832/1208864615 2023-08-11T12:24:57.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.299+0000 7ff00e7b0b80 1 --2- 172.21.15.8:0/2384900009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b16731be20 0x55b167327b10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.299+0000 7ff00e7b0b80 1 --2- 172.21.15.8:0/2384900009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b167321310 0x55b167324dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.299+0000 7ff00e7b0b80 1 -- 172.21.15.8:0/2384900009 >> 172.21.15.8:0/2384900009 conn(0x55b167248950 msgr2=0x55b167310cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:57.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.299+0000 7ff00e7b0b80 1 -- 172.21.15.8:0/2384900009 shutdown_connections 2023-08-11T12:24:57.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.299+0000 7ff00e7b0b80 1 -- 172.21.15.8:0/2384900009 wait complete. 2023-08-11T12:24:57.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.299+0000 7ff00e7b0b80 20 client.25721 trim_cache size 0 max 16384 2023-08-11T12:24:57.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.323+0000 7ff00e7b0b80 1 Processor -- start 2023-08-11T12:24:57.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.323+0000 7ff00e7b0b80 1 -- start start 2023-08-11T12:24:57.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.323+0000 7ff00e7b0b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b16731be20 0x55b16731b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.323+0000 7ff00e7b0b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b167321310 0x55b16732c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.323+0000 7ff00e7b0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b167321c30 0x55b167322720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.323+0000 7ff00e7b0b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b167316f00 con 0x55b167321310 2023-08-11T12:24:57.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.323+0000 7ff00e7b0b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b16730e8d0 con 0x55b16731be20 2023-08-11T12:24:57.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.323+0000 7ff00e7b0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b167320f50 con 0x55b167321c30 2023-08-11T12:24:57.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.324+0000 7feff3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b167321310 0x55b16732c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.324+0000 7feff939c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b167321c30 0x55b167322720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.324+0000 7feff3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b167321310 0x55b16732c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54322/0 (socket says 172.21.15.8:54322) 2023-08-11T12:24:57.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.324+0000 7feff3fff700 1 -- 172.21.15.8:0/2463871172 learned_addr learned my addr 172.21.15.8:0/2463871172 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:57.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.324+0000 7feff8b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b16731be20 0x55b16731b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.324+0000 7feff3fff700 1 -- 172.21.15.8:0/2463871172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b167321c30 msgr2=0x55b167322720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:57.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.324+0000 7feff3fff700 1 --2- 172.21.15.8:0/2463871172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b167321c30 0x55b167322720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.324+0000 7feff3fff700 1 -- 172.21.15.8:0/2463871172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b16731be20 msgr2=0x55b16731b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:57.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.324+0000 7feff3fff700 1 --2- 172.21.15.8:0/2463871172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b16731be20 0x55b16731b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.324+0000 7feff3fff700 1 -- 172.21.15.8:0/2463871172 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b167099de0 con 0x55b167321310 2023-08-11T12:24:57.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.324+0000 7feff8b9b700 1 --2- 172.21.15.8:0/2463871172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b16731be20 0x55b16731b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:57.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.324+0000 7feff3fff700 1 --2- 172.21.15.8:0/2463871172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b167321310 0x55b16732c580 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fefe0006010 tx=0x7fefe0004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2e1fc4cb9a7ea5 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:57.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.325+0000 7fefdf7fe700 1 -- 172.21.15.8:0/2463871172 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe0032070 con 0x55b167321310 2023-08-11T12:24:57.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.325+0000 7fefdf7fe700 1 -- 172.21.15.8:0/2463871172 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefe00054e0 con 0x55b167321310 2023-08-11T12:24:57.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.325+0000 7fefdf7fe700 1 -- 172.21.15.8:0/2463871172 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe000f460 con 0x55b167321310 2023-08-11T12:24:57.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.326+0000 7ff00e7b0b80 1 -- 172.21.15.8:0/2463871172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b167321310 msgr2=0x55b16732c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.326+0000 7ff00e7b0b80 1 --2- 172.21.15.8:0/2463871172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b167321310 0x55b16732c580 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fefe0006010 tx=0x7fefe0004610 comp rx=0 tx=0).stop 2023-08-11T12:24:57.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.326+0000 7ff00e7b0b80 1 -- 172.21.15.8:0/2463871172 shutdown_connections 2023-08-11T12:24:57.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.326+0000 7ff00e7b0b80 1 --2- 172.21.15.8:0/2463871172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b167321c30 0x55b167322720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.326+0000 7ff00e7b0b80 1 --2- 172.21.15.8:0/2463871172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b16731be20 0x55b16731b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.326+0000 7ff00e7b0b80 1 --2- 172.21.15.8:0/2463871172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b167321310 0x55b16732c580 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.326+0000 7ff00e7b0b80 1 -- 172.21.15.8:0/2463871172 >> 172.21.15.8:0/2463871172 conn(0x55b167248950 msgr2=0x55b167322010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:57.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.326+0000 7ff00e7b0b80 1 -- 172.21.15.8:0/2463871172 shutdown_connections 2023-08-11T12:24:57.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.326+0000 7ff00e7b0b80 1 -- 172.21.15.8:0/2463871172 wait complete. 2023-08-11T12:24:57.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.326+0000 7ff00e7b0b80 1 -- start start 2023-08-11T12:24:57.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.327+0000 7ff00e7b0b80 1 Processor -- start 2023-08-11T12:24:57.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.327+0000 7ff00e7b0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b16731be20 0x55b16732a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.327+0000 7ff00e7b0b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b167321310 0x55b16732aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.327+0000 7ff00e7b0b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b167321c30 0x55b167388110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.327+0000 7ff00e7b0b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b16732b440 con 0x55b167321c30 2023-08-11T12:24:57.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.327+0000 7ff00e7b0b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b167388680 con 0x55b167321310 2023-08-11T12:24:57.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.327+0000 7ff00e7b0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b167388840 con 0x55b16731be20 2023-08-11T12:24:57.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.328+0000 7ff00e7b0b80 10 client.0 _ll_register_callbacks cb 0x7fefe800def0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:57.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.328+0000 7feff3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b167321310 0x55b16732aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.328+0000 7feff3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b167321310 0x55b16732aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:41492/0 (socket says 172.21.15.8:41492) 2023-08-11T12:24:57.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.328+0000 7feff3fff700 1 -- 172.21.15.8:0/2694884729 learned_addr learned my addr 172.21.15.8:0/2694884729 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:57.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.328+0000 7feff8b9b700 1 --2- 172.21.15.8:0/2694884729 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b16731be20 0x55b16732a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.328+0000 7feff939c700 1 --2- 172.21.15.8:0/2694884729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b167321c30 0x55b167388110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.328+0000 7feff8b9b700 1 -- 172.21.15.8:0/2694884729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b167321310 msgr2=0x55b16732aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:57.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.328+0000 7feff8b9b700 1 --2- 172.21.15.8:0/2694884729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b167321310 0x55b16732aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.328+0000 7feff8b9b700 1 -- 172.21.15.8:0/2694884729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b167321c30 msgr2=0x55b167388110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:57.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.328+0000 7feff8b9b700 1 --2- 172.21.15.8:0/2694884729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b167321c30 0x55b167388110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.328+0000 7feff8b9b700 1 -- 172.21.15.8:0/2694884729 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff410e130 con 0x55b16731be20 2023-08-11T12:24:57.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.328+0000 7feff3fff700 1 --2- 172.21.15.8:0/2694884729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b167321310 0x55b16732aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:57.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.328+0000 7feff8b9b700 1 --2- 172.21.15.8:0/2694884729 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b16731be20 0x55b16732a760 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fefe8098d30 tx=0x7fefe80cf490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f51b3e89cae47f72 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:57.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.328+0000 7fefd3fff700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:24:57.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.329+0000 7fefd3fff700 1 -- 172.21.15.8:0/2694884729 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe8014070 con 0x55b16731be20 2023-08-11T12:24:57.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.329+0000 7fefd3fff700 1 -- 172.21.15.8:0/2694884729 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fefe8099730 con 0x55b16731be20 2023-08-11T12:24:57.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.329+0000 7ff00e7b0b80 1 -- 172.21.15.8:0/2694884729 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fefe001e040 con 0x55b16731be20 2023-08-11T12:24:57.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.329+0000 7fefd3fff700 1 -- 172.21.15.8:0/2694884729 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefe80cf620 con 0x55b16731be20 2023-08-11T12:24:57.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.329+0000 7ff00e7b0b80 10 client.25735 fetch_fsmap learned FSMap version 27 2023-08-11T12:24:57.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.329+0000 7ff00e7b0b80 1 -- 172.21.15.8:0/2694884729 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b1670ed630 con 0x55b16731be20 2023-08-11T12:24:57.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.329+0000 7fefd3fff700 1 -- 172.21.15.8:0/2694884729 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefe001e040 con 0x55b16731be20 2023-08-11T12:24:57.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.329+0000 7fefd3fff700 1 -- 172.21.15.8:0/2694884729 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fefe80c93d0 con 0x55b16731be20 2023-08-11T12:24:57.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.329+0000 7ff00e7b0b80 10 client.25735 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:24:57.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.329+0000 7ff00e7b0b80 10 client.25735 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2023-08-11T12:24:57.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.329+0000 7ff00e7b0b80 20 client.25735 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:57.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.329+0000 7ff00e7b0b80 1 --2- 172.21.15.8:0/2694884729 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x55b167389b90 0x55b16738bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.329+0000 7ff00e7b0b80 4 client.25735 mds_command: new command op to 24464 tid=0[{"prefix": "damage ls"}] 2023-08-11T12:24:57.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.329+0000 7ff00e7b0b80 1 -- 172.21.15.8:0/2694884729 --> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b167266820 con 0x55b167389b90 2023-08-11T12:24:57.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.330+0000 7feff3fff700 1 --2- 172.21.15.8:0/2694884729 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x55b167389b90 0x55b16738bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.330+0000 7feff3fff700 1 --2- 172.21.15.8:0/2694884729 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x55b167389b90 0x55b16738bfb0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c6a9ac424034ed58 server_cookie=214654e09bc7655 in_seq=0 out_seq=0 2023-08-11T12:24:57.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.330+0000 7fefd3fff700 10 client.25735 ms_handle_connect on v2:172.21.15.45:6832/1208864615 2023-08-11T12:24:57.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.331+0000 7fefd3fff700 1 -- 172.21.15.8:0/2694884729 <== mds.4 v2:172.21.15.45:6832/1208864615 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b167266820 con 0x55b167389b90 2023-08-11T12:24:57.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.331+0000 7fefd3fff700 10 client.25735 handle_command_reply: tid=0 2023-08-11T12:24:57.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.331+0000 7ff00e7b0b80 1 client.25735 shutdown 2023-08-11T12:24:57.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.331+0000 7ff00e7b0b80 1 -- 172.21.15.8:0/2694884729 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b16731be20 msgr2=0x55b16732a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.331+0000 7ff00e7b0b80 1 --2- 172.21.15.8:0/2694884729 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b16731be20 0x55b16732a760 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fefe8098d30 tx=0x7fefe80cf490 comp rx=0 tx=0).stop 2023-08-11T12:24:57.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.331+0000 7ff00e7b0b80 1 -- 172.21.15.8:0/2694884729 shutdown_connections 2023-08-11T12:24:57.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.331+0000 7ff00e7b0b80 1 --2- 172.21.15.8:0/2694884729 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x55b167389b90 0x55b16738bfb0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.331+0000 7ff00e7b0b80 1 --2- 172.21.15.8:0/2694884729 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b16731be20 0x55b16732a760 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.331+0000 7ff00e7b0b80 1 --2- 172.21.15.8:0/2694884729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b167321c30 0x55b167388110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.331+0000 7fefd3fff700 0 client.25735 ms_handle_reset on v2:172.21.15.45:6832/1208864615 2023-08-11T12:24:57.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.331+0000 7ff00e7b0b80 1 --2- 172.21.15.8:0/2694884729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b167321310 0x55b16732aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.331+0000 7ff00e7b0b80 1 -- 172.21.15.8:0/2694884729 >> 172.21.15.8:0/2694884729 conn(0x55b167248950 msgr2=0x55b1673207d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:57.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.331+0000 7ff00e7b0b80 1 -- 172.21.15.8:0/2694884729 shutdown_connections 2023-08-11T12:24:57.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.331+0000 7ff00e7b0b80 1 -- 172.21.15.8:0/2694884729 wait complete. 2023-08-11T12:24:57.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.331+0000 7ff00e7b0b80 20 client.25735 trim_cache size 0 max 16384 2023-08-11T12:24:57.343 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-08-11T12:24:57.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.332+0000 7feffadff700 1 -- 172.21.15.8:0/383577104 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fefe40a01d0 msgr2=0x7fefe40a2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.332+0000 7feffadff700 1 --2- 172.21.15.8:0/383577104 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fefe40a01d0 0x7fefe40a2690 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fefec0078e0 tx=0x7fefec004ad0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.332+0000 7feffadff700 1 -- 172.21.15.8:0/383577104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff4100960 msgr2=0x7feff4072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.332+0000 7feffadff700 1 --2- 172.21.15.8:0/383577104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff4100960 0x7feff4072c20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fefe800d950 tx=0x7fefe800dd10 comp rx=0 tx=0).stop 2023-08-11T12:24:57.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.332+0000 7feffadff700 1 -- 172.21.15.8:0/383577104 shutdown_connections 2023-08-11T12:24:57.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.332+0000 7feffadff700 1 --2- 172.21.15.8:0/383577104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feff4106970 0x7feff40736a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.332+0000 7feffadff700 1 --2- 172.21.15.8:0/383577104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feff4100960 0x7feff4072c20 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.332+0000 7feffadff700 1 --2- 172.21.15.8:0/383577104 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fefe40a01d0 0x7fefe40a2690 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.332+0000 7feffadff700 1 --2- 172.21.15.8:0/383577104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feff4101320 0x7feff4073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.332+0000 7feffadff700 1 -- 172.21.15.8:0/383577104 >> 172.21.15.8:0/383577104 conn(0x7feff40fc490 msgr2=0x7feff4104470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:57.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.332+0000 7feffadff700 1 -- 172.21.15.8:0/383577104 shutdown_connections 2023-08-11T12:24:57.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.332+0000 7feffadff700 1 -- 172.21.15.8:0/383577104 wait complete. 2023-08-11T12:24:57.354 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-08-11T12:24:57.550 INFO:teuthology.orchestra.run.smithi008.stderr:800000 of 50000000 tuples (1%) done (elapsed 2.24 s, remaining 137.60 s) 2023-08-11T12:24:57.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.578+0000 7ff8fefff700 1 -- 172.21.15.8:0/3534754689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8f8101bc0 msgr2=0x7ff8f8101fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.578+0000 7ff8fefff700 1 --2- 172.21.15.8:0/3534754689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8f8101bc0 0x7ff8f8101fa0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec009990 tx=0x7ff8ec009ca0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.578+0000 7ff8fefff700 1 -- 172.21.15.8:0/3534754689 shutdown_connections 2023-08-11T12:24:57.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.578+0000 7ff8fefff700 1 --2- 172.21.15.8:0/3534754689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8f8101bc0 0x7ff8f8101fa0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.578+0000 7ff8fefff700 1 --2- 172.21.15.8:0/3534754689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8f810af90 0x7ff8f810d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.578+0000 7ff8fefff700 1 --2- 172.21.15.8:0/3534754689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8f81024e0 0x7ff8f810a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.578+0000 7ff8fefff700 1 -- 172.21.15.8:0/3534754689 >> 172.21.15.8:0/3534754689 conn(0x7ff8f8076a30 msgr2=0x7ff8f8076e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:57.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.578+0000 7ff8fefff700 1 -- 172.21.15.8:0/3534754689 shutdown_connections 2023-08-11T12:24:57.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.578+0000 7ff8fefff700 1 -- 172.21.15.8:0/3534754689 wait complete. 2023-08-11T12:24:57.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.579+0000 7ff8fefff700 1 Processor -- start 2023-08-11T12:24:57.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.580+0000 7ff8fefff700 1 -- start start 2023-08-11T12:24:57.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.580+0000 7ff8fefff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8f8101bc0 0x7ff8f819c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.580+0000 7ff8fefff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8f81024e0 0x7ff8f819cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.580+0000 7ff8fefff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8f810af90 0x7ff8f81968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.580+0000 7ff8fefff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f8196f30 con 0x7ff8f8101bc0 2023-08-11T12:24:57.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.580+0000 7ff8fefff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f81970a0 con 0x7ff8f81024e0 2023-08-11T12:24:57.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.580+0000 7ff8fefff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f8197260 con 0x7ff8f810af90 2023-08-11T12:24:57.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.581+0000 7ff8fcd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8f8101bc0 0x7ff8f819c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.581+0000 7ff8fcd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8f8101bc0 0x7ff8f819c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54346/0 (socket says 172.21.15.8:54346) 2023-08-11T12:24:57.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.581+0000 7ff8fcd9b700 1 -- 172.21.15.8:0/2471837075 learned_addr learned my addr 172.21.15.8:0/2471837075 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:57.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.581+0000 7ff8fd59c700 1 --2- 172.21.15.8:0/2471837075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8f810af90 0x7ff8f81968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.581+0000 7ff8f7fff700 1 --2- 172.21.15.8:0/2471837075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8f81024e0 0x7ff8f819cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.581+0000 7ff8fcd9b700 1 -- 172.21.15.8:0/2471837075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8f810af90 msgr2=0x7ff8f81968c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.581+0000 7ff8fcd9b700 1 --2- 172.21.15.8:0/2471837075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8f810af90 0x7ff8f81968c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.581+0000 7ff8fcd9b700 1 -- 172.21.15.8:0/2471837075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8f81024e0 msgr2=0x7ff8f819cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.581+0000 7ff8fcd9b700 1 --2- 172.21.15.8:0/2471837075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8f81024e0 0x7ff8f819cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.581+0000 7ff8fcd9b700 1 -- 172.21.15.8:0/2471837075 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ec0095f0 con 0x7ff8f8101bc0 2023-08-11T12:24:57.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.581+0000 7ff8fd59c700 1 --2- 172.21.15.8:0/2471837075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8f810af90 0x7ff8f81968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:57.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.581+0000 7ff8f7fff700 1 --2- 172.21.15.8:0/2471837075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8f81024e0 0x7ff8f819cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:24:57.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.581+0000 7ff8fcd9b700 1 --2- 172.21.15.8:0/2471837075 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8f8101bc0 0x7ff8f819c850 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec005910 tx=0x7ff8ec004710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:57.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.582+0000 7ff8f5ffb700 1 -- 172.21.15.8:0/2471837075 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec01d070 con 0x7ff8f8101bc0 2023-08-11T12:24:57.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.582+0000 7ff8fefff700 1 -- 172.21.15.8:0/2471837075 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f81974e0 con 0x7ff8f8101bc0 2023-08-11T12:24:57.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.582+0000 7ff8f5ffb700 1 -- 172.21.15.8:0/2471837075 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff8ec022470 con 0x7ff8f8101bc0 2023-08-11T12:24:57.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.582+0000 7ff8f5ffb700 1 -- 172.21.15.8:0/2471837075 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec017650 con 0x7ff8f8101bc0 2023-08-11T12:24:57.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.582+0000 7ff8fefff700 1 -- 172.21.15.8:0/2471837075 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f81a3840 con 0x7ff8f8101bc0 2023-08-11T12:24:57.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.586+0000 7ff8f5ffb700 1 -- 172.21.15.8:0/2471837075 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 134846+0+0 (secure 0 0 0) 0x7ff8ec0225e0 con 0x7ff8f8101bc0 2023-08-11T12:24:57.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.587+0000 7ff912880b80 1 Processor -- start 2023-08-11T12:24:57.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.587+0000 7ff912880b80 1 -- start start 2023-08-11T12:24:57.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.587+0000 7ff912880b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7a880cee0 0x55f7a880d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.587+0000 7ff912880b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7a880d800 0x55f7a8811300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.588+0000 7ff912880b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a8811840 0x55f7a8811ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.588+0000 7ff8f5ffb700 1 --2- 172.21.15.8:0/2471837075 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff8e80a0150 0x7ff8e80a2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.588+0000 7ff912880b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a8761630 con 0x55f7a8811840 2023-08-11T12:24:57.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.588+0000 7ff912880b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a875ef50 con 0x55f7a880cee0 2023-08-11T12:24:57.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.588+0000 7ff912880b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a875a840 con 0x55f7a880d800 2023-08-11T12:24:57.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.588+0000 7ff8f5ffb700 1 -- 172.21.15.8:0/2471837075 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7ff8ec0cce60 con 0x7ff8f8101bc0 2023-08-11T12:24:57.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.588+0000 7ff8fcd9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7a880d800 0x55f7a8811300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.588+0000 7ff8fd59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7a880cee0 0x55f7a880d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.588+0000 7ff8fcd9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7a880d800 0x55f7a8811300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:32874/0 (socket says 172.21.15.8:32874) 2023-08-11T12:24:57.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.588+0000 7ff8fcd9b700 1 -- 172.21.15.8:0/2317345008 learned_addr learned my addr 172.21.15.8:0/2317345008 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:57.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.588+0000 7ff8fd59c700 1 --2- 172.21.15.8:0/2471837075 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff8e80a0150 0x7ff8e80a2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.588+0000 7ff8f7fff700 1 --2- 172.21.15.8:0/2317345008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a8811840 0x55f7a8811ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.588+0000 7ff8fcd9b700 1 -- 172.21.15.8:0/2317345008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7a880cee0 msgr2=0x55f7a880d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:57.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.588+0000 7ff8fcd9b700 1 --2- 172.21.15.8:0/2317345008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7a880cee0 0x55f7a880d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.588+0000 7ff8fcd9b700 1 -- 172.21.15.8:0/2317345008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a8811840 msgr2=0x55f7a8811ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:57.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.588+0000 7ff8fcd9b700 1 --2- 172.21.15.8:0/2317345008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a8811840 0x55f7a8811ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.588+0000 7ff8fcd9b700 1 -- 172.21.15.8:0/2317345008 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7a85da630 con 0x55f7a880d800 2023-08-11T12:24:57.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.589+0000 7ff8fcd9b700 1 --2- 172.21.15.8:0/2317345008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7a880d800 0x55f7a8811300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec099e40 tx=0x7ff8ec099f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fdfd97802ff51bf server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:57.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.589+0000 7ff8fd59c700 1 --2- 172.21.15.8:0/2471837075 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff8e80a0150 0x7ff8e80a2610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff8f00060b0 tx=0x7ff8f000b040 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:57.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.589+0000 7ff8e2ffd700 1 -- 172.21.15.8:0/2317345008 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec09a840 con 0x55f7a880d800 2023-08-11T12:24:57.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.589+0000 7ff8e2ffd700 1 -- 172.21.15.8:0/2317345008 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff8ec09a140 con 0x55f7a880d800 2023-08-11T12:24:57.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.589+0000 7ff8e2ffd700 1 -- 172.21.15.8:0/2317345008 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec09a3a0 con 0x55f7a880d800 2023-08-11T12:24:57.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.590+0000 7ff912880b80 1 -- 172.21.15.8:0/2317345008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7a880d800 msgr2=0x55f7a8811300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.590+0000 7ff912880b80 1 --2- 172.21.15.8:0/2317345008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7a880d800 0x55f7a8811300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec099e40 tx=0x7ff8ec099f10 comp rx=0 tx=0).stop 2023-08-11T12:24:57.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.590+0000 7ff912880b80 1 -- 172.21.15.8:0/2317345008 shutdown_connections 2023-08-11T12:24:57.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.590+0000 7ff912880b80 1 --2- 172.21.15.8:0/2317345008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a8811840 0x55f7a8811ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.590+0000 7ff912880b80 1 --2- 172.21.15.8:0/2317345008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7a880cee0 0x55f7a880d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.590+0000 7ff912880b80 1 --2- 172.21.15.8:0/2317345008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7a880d800 0x55f7a8811300 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.590+0000 7ff912880b80 1 -- 172.21.15.8:0/2317345008 >> 172.21.15.8:0/2317345008 conn(0x55f7a8735950 msgr2=0x55f7a88033d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:57.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.590+0000 7ff912880b80 1 -- 172.21.15.8:0/2317345008 shutdown_connections 2023-08-11T12:24:57.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.590+0000 7ff912880b80 1 -- 172.21.15.8:0/2317345008 wait complete. 2023-08-11T12:24:57.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.590+0000 7ff912880b80 1 -- start start 2023-08-11T12:24:57.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.591+0000 7ff912880b80 1 Processor -- start 2023-08-11T12:24:57.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.591+0000 7ff912880b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7a880cee0 0x55f7a880c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.591+0000 7ff912880b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a880d800 0x55f7a880c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.591+0000 7ff912880b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7a8811840 0x55f7a8805960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.591+0000 7ff912880b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a86f8ac0 con 0x55f7a880d800 2023-08-11T12:24:57.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.591+0000 7ff912880b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a86f87c0 con 0x55f7a8811840 2023-08-11T12:24:57.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.591+0000 7ff912880b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a85dc920 con 0x55f7a880cee0 2023-08-11T12:24:57.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.591+0000 7ff912880b80 10 client.0 _ll_register_callbacks cb 0x55f7a86fbab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:57.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.591+0000 7ff8fcd9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7a880cee0 0x55f7a880c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.591+0000 7ff8fcd9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7a880cee0 0x55f7a880c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:32888/0 (socket says 172.21.15.8:32888) 2023-08-11T12:24:57.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.591+0000 7ff8fcd9b700 1 -- 172.21.15.8:0/1779012699 learned_addr learned my addr 172.21.15.8:0/1779012699 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:57.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.592+0000 7ff8fd59c700 1 --2- 172.21.15.8:0/1779012699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7a8811840 0x55f7a8805960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.592+0000 7ff8f7fff700 1 --2- 172.21.15.8:0/1779012699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a880d800 0x55f7a880c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.592+0000 7ff8fcd9b700 1 -- 172.21.15.8:0/1779012699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7a8811840 msgr2=0x55f7a8805960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:57.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.592+0000 7ff8fcd9b700 1 --2- 172.21.15.8:0/1779012699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7a8811840 0x55f7a8805960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.592+0000 7ff8fcd9b700 1 -- 172.21.15.8:0/1779012699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a880d800 msgr2=0x55f7a880c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:57.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.592+0000 7ff8fcd9b700 1 --2- 172.21.15.8:0/1779012699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a880d800 0x55f7a880c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.592+0000 7ff8fcd9b700 1 -- 172.21.15.8:0/1779012699 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f81a3840 con 0x55f7a880cee0 2023-08-11T12:24:57.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.592+0000 7ff8fcd9b700 1 --2- 172.21.15.8:0/1779012699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7a880cee0 0x55f7a880c110 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0c33c0 tx=0x7ff8ec009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ef676b931ffaff2 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:57.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.592+0000 7ff8d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:24:57.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.592+0000 7ff8d7fff700 1 -- 172.21.15.8:0/1779012699 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec0a1ec0 con 0x55f7a880cee0 2023-08-11T12:24:57.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.592+0000 7ff8d7fff700 1 -- 172.21.15.8:0/1779012699 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7ff8ec09df70 con 0x55f7a880cee0 2023-08-11T12:24:57.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.592+0000 7ff912880b80 1 -- 172.21.15.8:0/1779012699 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f7a87fba90 con 0x55f7a880cee0 2023-08-11T12:24:57.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.592+0000 7ff8d7fff700 1 -- 172.21.15.8:0/1779012699 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8ec0b2260 con 0x55f7a880cee0 2023-08-11T12:24:57.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.592+0000 7ff912880b80 10 client.25747 fetch_fsmap learned FSMap version 27 2023-08-11T12:24:57.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.592+0000 7ff912880b80 1 -- 172.21.15.8:0/1779012699 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f7a8586de0 con 0x55f7a880cee0 2023-08-11T12:24:57.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.593+0000 7ff8d7fff700 1 -- 172.21.15.8:0/1779012699 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f7a87fba90 con 0x55f7a880cee0 2023-08-11T12:24:57.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.593+0000 7ff8d7fff700 1 -- 172.21.15.8:0/1779012699 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff8ec0ca450 con 0x55f7a880cee0 2023-08-11T12:24:57.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.593+0000 7ff912880b80 10 client.25747 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:24:57.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.593+0000 7ff912880b80 10 client.25747 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-08-11T12:24:57.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.593+0000 7ff912880b80 20 client.25747 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:57.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.593+0000 7ff912880b80 1 --2- 172.21.15.8:0/1779012699 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x55f7a8821b60 0x55f7a8823f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.593+0000 7ff912880b80 4 client.25747 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:24:57.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.593+0000 7ff912880b80 1 -- 172.21.15.8:0/1779012699 --> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f7a87d74e0 con 0x55f7a8821b60 2023-08-11T12:24:57.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.593+0000 7ff8f7fff700 1 --2- 172.21.15.8:0/1779012699 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x55f7a8821b60 0x55f7a8823f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.594+0000 7ff8f7fff700 1 --2- 172.21.15.8:0/1779012699 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x55f7a8821b60 0x55f7a8823f50 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=dcc0d1db7b236ee0 server_cookie=7d81211c5b46f0b8 in_seq=0 out_seq=0 2023-08-11T12:24:57.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.594+0000 7ff8d7fff700 10 client.25747 ms_handle_connect on v2:172.21.15.45:6834/1776075470 2023-08-11T12:24:57.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.594+0000 7ff8d7fff700 1 -- 172.21.15.8:0/1779012699 <== mds.3 v2:172.21.15.45:6834/1776075470 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55f7a87d74e0 con 0x55f7a8821b60 2023-08-11T12:24:57.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.594+0000 7ff8d7fff700 10 client.25747 handle_command_reply: tid=0 2023-08-11T12:24:57.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.595+0000 7ff912880b80 1 client.25747 shutdown 2023-08-11T12:24:57.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.595+0000 7ff912880b80 1 -- 172.21.15.8:0/1779012699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7a880cee0 msgr2=0x55f7a880c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.595+0000 7ff912880b80 1 --2- 172.21.15.8:0/1779012699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7a880cee0 0x55f7a880c110 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0c33c0 tx=0x7ff8ec009ca0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.595+0000 7ff912880b80 1 -- 172.21.15.8:0/1779012699 shutdown_connections 2023-08-11T12:24:57.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.595+0000 7ff912880b80 1 --2- 172.21.15.8:0/1779012699 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x55f7a8821b60 0x55f7a8823f50 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.595+0000 7ff912880b80 1 --2- 172.21.15.8:0/1779012699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7a880cee0 0x55f7a880c110 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.595+0000 7ff912880b80 1 --2- 172.21.15.8:0/1779012699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7a8811840 0x55f7a8805960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.595+0000 7ff912880b80 1 --2- 172.21.15.8:0/1779012699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a880d800 0x55f7a880c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.595+0000 7ff8d7fff700 0 client.25747 ms_handle_reset on v2:172.21.15.45:6834/1776075470 2023-08-11T12:24:57.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.595+0000 7ff912880b80 1 -- 172.21.15.8:0/1779012699 >> 172.21.15.8:0/1779012699 conn(0x55f7a8735950 msgr2=0x55f7a8812cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:57.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.595+0000 7ff912880b80 1 -- 172.21.15.8:0/1779012699 shutdown_connections 2023-08-11T12:24:57.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.595+0000 7ff912880b80 1 -- 172.21.15.8:0/1779012699 wait complete. 2023-08-11T12:24:57.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.595+0000 7ff912880b80 20 client.25747 trim_cache size 0 max 16384 2023-08-11T12:24:57.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.609+0000 7ff912880b80 1 Processor -- start 2023-08-11T12:24:57.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.609+0000 7ff912880b80 1 -- start start 2023-08-11T12:24:57.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.609+0000 7ff912880b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7a880cee0 0x55f7a8804fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.609+0000 7ff912880b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7a880d800 0x55f7a8818990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.609+0000 7ff912880b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a8811840 0x55f7a8803280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.609+0000 7ff912880b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a8804d60 con 0x55f7a8811840 2023-08-11T12:24:57.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.609+0000 7ff912880b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a8804280 con 0x55f7a880d800 2023-08-11T12:24:57.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.609+0000 7ff912880b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a8814f60 con 0x55f7a880cee0 2023-08-11T12:24:57.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.610+0000 7ff8fcd9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7a880cee0 0x55f7a8804fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.610+0000 7ff8fd59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a8811840 0x55f7a8803280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.610+0000 7ff8f7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7a880d800 0x55f7a8818990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.610+0000 7ff8fcd9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7a880cee0 0x55f7a8804fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:32902/0 (socket says 172.21.15.8:32902) 2023-08-11T12:24:57.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.610+0000 7ff8fcd9b700 1 -- 172.21.15.8:0/2851242848 learned_addr learned my addr 172.21.15.8:0/2851242848 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:57.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.610+0000 7ff8f7fff700 1 -- 172.21.15.8:0/2851242848 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7a880cee0 msgr2=0x55f7a8804fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:57.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.610+0000 7ff8f7fff700 1 --2- 172.21.15.8:0/2851242848 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7a880cee0 0x55f7a8804fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.610+0000 7ff8f7fff700 1 -- 172.21.15.8:0/2851242848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a8811840 msgr2=0x55f7a8803280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:57.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.610+0000 7ff8f7fff700 1 --2- 172.21.15.8:0/2851242848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a8811840 0x55f7a8803280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.610+0000 7ff8f7fff700 1 -- 172.21.15.8:0/2851242848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7a856fc60 con 0x55f7a880d800 2023-08-11T12:24:57.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.610+0000 7ff8f7fff700 1 --2- 172.21.15.8:0/2851242848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7a880d800 0x55f7a8818990 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55f7a8824800 tx=0x7ff8e4004320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d603071969a71de server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:57.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.611+0000 7ff8e37fe700 1 -- 172.21.15.8:0/2851242848 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4017040 con 0x55f7a880d800 2023-08-11T12:24:57.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.611+0000 7ff8e37fe700 1 -- 172.21.15.8:0/2851242848 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff8e4020070 con 0x55f7a880d800 2023-08-11T12:24:57.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.611+0000 7ff8e37fe700 1 -- 172.21.15.8:0/2851242848 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4003d80 con 0x55f7a880d800 2023-08-11T12:24:57.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.612+0000 7ff912880b80 1 -- 172.21.15.8:0/2851242848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7a880d800 msgr2=0x55f7a8818990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.612+0000 7ff912880b80 1 --2- 172.21.15.8:0/2851242848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7a880d800 0x55f7a8818990 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55f7a8824800 tx=0x7ff8e4004320 comp rx=0 tx=0).stop 2023-08-11T12:24:57.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.612+0000 7ff912880b80 1 -- 172.21.15.8:0/2851242848 shutdown_connections 2023-08-11T12:24:57.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.612+0000 7ff912880b80 1 --2- 172.21.15.8:0/2851242848 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7a880cee0 0x55f7a8804fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.612+0000 7ff912880b80 1 --2- 172.21.15.8:0/2851242848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a8811840 0x55f7a8803280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.612+0000 7ff912880b80 1 --2- 172.21.15.8:0/2851242848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7a880d800 0x55f7a8818990 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.612+0000 7ff912880b80 1 -- 172.21.15.8:0/2851242848 >> 172.21.15.8:0/2851242848 conn(0x55f7a8735950 msgr2=0x55f7a87fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:57.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.612+0000 7ff912880b80 1 -- 172.21.15.8:0/2851242848 shutdown_connections 2023-08-11T12:24:57.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.612+0000 7ff912880b80 1 -- 172.21.15.8:0/2851242848 wait complete. 2023-08-11T12:24:57.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.613+0000 7ff912880b80 1 -- start start 2023-08-11T12:24:57.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.613+0000 7ff912880b80 1 Processor -- start 2023-08-11T12:24:57.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.614+0000 7ff912880b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7a880cee0 0x55f7a881ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.614+0000 7ff912880b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7a880d800 0x55f7a881ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.614+0000 7ff912880b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a8811840 0x55f7a881b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.614+0000 7ff912880b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a881bd80 con 0x55f7a8811840 2023-08-11T12:24:57.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.614+0000 7ff912880b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a881bef0 con 0x55f7a880cee0 2023-08-11T12:24:57.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.614+0000 7ff912880b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a881c0b0 con 0x55f7a880d800 2023-08-11T12:24:57.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.614+0000 7ff912880b80 10 client.0 _ll_register_callbacks cb 0x7ff8f000e810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:57.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.614+0000 7ff8fcd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7a880cee0 0x55f7a881ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.614+0000 7ff8fcd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7a880cee0 0x55f7a881ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:41540/0 (socket says 172.21.15.8:41540) 2023-08-11T12:24:57.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.614+0000 7ff8fd59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a8811840 0x55f7a881b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.614+0000 7ff8fcd9b700 1 -- 172.21.15.8:0/3237687241 learned_addr learned my addr 172.21.15.8:0/3237687241 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:57.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.614+0000 7ff8f7fff700 1 --2- 172.21.15.8:0/3237687241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7a880d800 0x55f7a881ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.614+0000 7ff8fcd9b700 1 -- 172.21.15.8:0/3237687241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7a880d800 msgr2=0x55f7a881ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:57.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.614+0000 7ff8fcd9b700 1 --2- 172.21.15.8:0/3237687241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7a880d800 0x55f7a881ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.614+0000 7ff8fcd9b700 1 -- 172.21.15.8:0/3237687241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a8811840 msgr2=0x55f7a881b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:57.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.614+0000 7ff8fcd9b700 1 --2- 172.21.15.8:0/3237687241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a8811840 0x55f7a881b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.614+0000 7ff8fcd9b700 1 -- 172.21.15.8:0/3237687241 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f7a85ad250 con 0x55f7a880cee0 2023-08-11T12:24:57.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.615+0000 7ff8fcd9b700 1 --2- 172.21.15.8:0/3237687241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7a880cee0 0x55f7a881ea40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec09a0d0 tx=0x7ff8ec0094b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58c209acf30bb4a6 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:57.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.615+0000 7ff8d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:24:57.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.615+0000 7ff8d7fff700 1 -- 172.21.15.8:0/3237687241 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec09a840 con 0x55f7a880cee0 2023-08-11T12:24:57.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.615+0000 7ff8d7fff700 1 -- 172.21.15.8:0/3237687241 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7ff8ec09df70 con 0x55f7a880cee0 2023-08-11T12:24:57.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.615+0000 7ff912880b80 1 -- 172.21.15.8:0/3237687241 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff8ec09a140 con 0x55f7a880cee0 2023-08-11T12:24:57.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.615+0000 7ff8d7fff700 1 -- 172.21.15.8:0/3237687241 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8ec0a1ec0 con 0x55f7a880cee0 2023-08-11T12:24:57.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.615+0000 7ff912880b80 10 client.25745 fetch_fsmap learned FSMap version 27 2023-08-11T12:24:57.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.615+0000 7ff912880b80 1 -- 172.21.15.8:0/3237687241 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f7a85852b0 con 0x55f7a880cee0 2023-08-11T12:24:57.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.615+0000 7ff8d7fff700 1 -- 172.21.15.8:0/3237687241 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff8ec09a140 con 0x55f7a880cee0 2023-08-11T12:24:57.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.615+0000 7ff8d7fff700 1 -- 172.21.15.8:0/3237687241 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff8ec0a1b50 con 0x55f7a880cee0 2023-08-11T12:24:57.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.615+0000 7ff912880b80 10 client.25745 fetch_fsmap finished waiting for FSMap version 27 2023-08-11T12:24:57.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.615+0000 7ff912880b80 10 client.25745 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-08-11T12:24:57.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.615+0000 7ff912880b80 20 client.25745 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:57.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.615+0000 7ff912880b80 1 --2- 172.21.15.8:0/3237687241 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x55f7a88763d0 0x55f7a88787c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.615+0000 7ff912880b80 4 client.25745 mds_command: new command op to 24500 tid=0[{"prefix": "damage ls"}] 2023-08-11T12:24:57.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.615+0000 7ff912880b80 1 -- 172.21.15.8:0/3237687241 --> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f7a8753820 con 0x55f7a88763d0 2023-08-11T12:24:57.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.616+0000 7ff8f7fff700 1 --2- 172.21.15.8:0/3237687241 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x55f7a88763d0 0x55f7a88787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.616+0000 7ff8f7fff700 1 --2- 172.21.15.8:0/3237687241 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x55f7a88763d0 0x55f7a88787c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=adc6cabff5399af1 server_cookie=50b3d833dba07469 in_seq=0 out_seq=0 2023-08-11T12:24:57.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.616+0000 7ff8d7fff700 10 client.25745 ms_handle_connect on v2:172.21.15.45:6834/1776075470 2023-08-11T12:24:57.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.616+0000 7ff8d7fff700 1 -- 172.21.15.8:0/3237687241 <== mds.3 v2:172.21.15.45:6834/1776075470 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f7a8753820 con 0x55f7a88763d0 2023-08-11T12:24:57.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.616+0000 7ff8d7fff700 10 client.25745 handle_command_reply: tid=0 2023-08-11T12:24:57.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.616+0000 7ff912880b80 1 client.25745 shutdown 2023-08-11T12:24:57.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.617+0000 7ff912880b80 1 -- 172.21.15.8:0/3237687241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7a880cee0 msgr2=0x55f7a881ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.617+0000 7ff912880b80 1 --2- 172.21.15.8:0/3237687241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7a880cee0 0x55f7a881ea40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec09a0d0 tx=0x7ff8ec0094b0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.617+0000 7ff912880b80 1 -- 172.21.15.8:0/3237687241 shutdown_connections 2023-08-11T12:24:57.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.617+0000 7ff912880b80 1 --2- 172.21.15.8:0/3237687241 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x55f7a88763d0 0x55f7a88787c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.617+0000 7ff912880b80 1 --2- 172.21.15.8:0/3237687241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a8811840 0x55f7a881b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.617+0000 7ff912880b80 1 --2- 172.21.15.8:0/3237687241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7a880cee0 0x55f7a881ea40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.617+0000 7ff8d7fff700 0 client.25745 ms_handle_reset on v2:172.21.15.45:6834/1776075470 2023-08-11T12:24:57.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.617+0000 7ff912880b80 1 --2- 172.21.15.8:0/3237687241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7a880d800 0x55f7a881ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.617+0000 7ff912880b80 1 -- 172.21.15.8:0/3237687241 >> 172.21.15.8:0/3237687241 conn(0x55f7a8735950 msgr2=0x55f7a87fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:57.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.617+0000 7ff912880b80 1 -- 172.21.15.8:0/3237687241 shutdown_connections 2023-08-11T12:24:57.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.617+0000 7ff912880b80 1 -- 172.21.15.8:0/3237687241 wait complete. 2023-08-11T12:24:57.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.617+0000 7ff912880b80 20 client.25745 trim_cache size 0 max 16384 2023-08-11T12:24:57.632 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-08-11T12:24:57.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.618+0000 7ff8fefff700 1 -- 172.21.15.8:0/2471837075 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff8e80a0150 msgr2=0x7ff8e80a2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.618+0000 7ff8fefff700 1 --2- 172.21.15.8:0/2471837075 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff8e80a0150 0x7ff8e80a2610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff8f00060b0 tx=0x7ff8f000b040 comp rx=0 tx=0).stop 2023-08-11T12:24:57.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.618+0000 7ff8fefff700 1 -- 172.21.15.8:0/2471837075 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8f8101bc0 msgr2=0x7ff8f819c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.618+0000 7ff8fefff700 1 --2- 172.21.15.8:0/2471837075 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8f8101bc0 0x7ff8f819c850 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec005910 tx=0x7ff8ec004710 comp rx=0 tx=0).stop 2023-08-11T12:24:57.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.618+0000 7ff8fefff700 1 -- 172.21.15.8:0/2471837075 shutdown_connections 2023-08-11T12:24:57.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.618+0000 7ff8fefff700 1 --2- 172.21.15.8:0/2471837075 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff8e80a0150 0x7ff8e80a2610 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.618+0000 7ff8fefff700 1 --2- 172.21.15.8:0/2471837075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8f810af90 0x7ff8f81968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.618+0000 7ff8fefff700 1 --2- 172.21.15.8:0/2471837075 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8f8101bc0 0x7ff8f819c850 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.618+0000 7ff8fefff700 1 --2- 172.21.15.8:0/2471837075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8f81024e0 0x7ff8f819cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.618+0000 7ff8fefff700 1 -- 172.21.15.8:0/2471837075 >> 172.21.15.8:0/2471837075 conn(0x7ff8f8076a30 msgr2=0x7ff8f81028c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:57.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.618+0000 7ff8fefff700 1 -- 172.21.15.8:0/2471837075 shutdown_connections 2023-08-11T12:24:57.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.618+0000 7ff8fefff700 1 -- 172.21.15.8:0/2471837075 wait complete. 2023-08-11T12:24:57.641 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-08-11T12:24:57.747 INFO:teuthology.orchestra.run.smithi008.stderr:900000 of 50000000 tuples (1%) done (elapsed 2.43 s, remaining 132.81 s) 2023-08-11T12:24:57.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.870+0000 7fe7e99ff700 1 -- 172.21.15.8:0/1486920947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7e4101bc0 msgr2=0x7fe7e4101fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.870+0000 7fe7e99ff700 1 --2- 172.21.15.8:0/1486920947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7e4101bc0 0x7fe7e4101fa0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe7d400b0a0 tx=0x7fe7d400b3b0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.870+0000 7fe7e99ff700 1 -- 172.21.15.8:0/1486920947 shutdown_connections 2023-08-11T12:24:57.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.870+0000 7fe7e99ff700 1 --2- 172.21.15.8:0/1486920947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7e410af90 0x7fe7e410d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.870+0000 7fe7e99ff700 1 --2- 172.21.15.8:0/1486920947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7e4101bc0 0x7fe7e4101fa0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.870+0000 7fe7e99ff700 1 --2- 172.21.15.8:0/1486920947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7e41024e0 0x7fe7e410a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.870+0000 7fe7e99ff700 1 -- 172.21.15.8:0/1486920947 >> 172.21.15.8:0/1486920947 conn(0x7fe7e4076a30 msgr2=0x7fe7e4076e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:57.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.870+0000 7fe7e99ff700 1 -- 172.21.15.8:0/1486920947 shutdown_connections 2023-08-11T12:24:57.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.870+0000 7fe7e99ff700 1 -- 172.21.15.8:0/1486920947 wait complete. 2023-08-11T12:24:57.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.871+0000 7fe7e99ff700 1 Processor -- start 2023-08-11T12:24:57.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.871+0000 7fe7e99ff700 1 -- start start 2023-08-11T12:24:57.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.872+0000 7fe7e99ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7e4101bc0 0x7fe7e419ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.872+0000 7fe7e99ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7e41024e0 0x7fe7e419cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.872+0000 7fe7e99ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7e410af90 0x7fe7e4196ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.872+0000 7fe7e99ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e4197140 con 0x7fe7e41024e0 2023-08-11T12:24:57.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.872+0000 7fe7e99ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e41972b0 con 0x7fe7e410af90 2023-08-11T12:24:57.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.872+0000 7fe7e99ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e4197470 con 0x7fe7e4101bc0 2023-08-11T12:24:57.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.873+0000 7fe7e27fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7e41024e0 0x7fe7e419cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.873+0000 7fe7e27fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7e41024e0 0x7fe7e419cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52208/0 (socket says 172.21.15.8:52208) 2023-08-11T12:24:57.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.873+0000 7fe7e27fc700 1 -- 172.21.15.8:0/888220159 learned_addr learned my addr 172.21.15.8:0/888220159 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:57.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.873+0000 7fe7e37fe700 1 --2- 172.21.15.8:0/888220159 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7e410af90 0x7fe7e4196ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.873+0000 7fe7e2ffd700 1 --2- 172.21.15.8:0/888220159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7e4101bc0 0x7fe7e419ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.873+0000 7fe7e27fc700 1 -- 172.21.15.8:0/888220159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7e4101bc0 msgr2=0x7fe7e419ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.873+0000 7fe7e27fc700 1 --2- 172.21.15.8:0/888220159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7e4101bc0 0x7fe7e419ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.873+0000 7fe7e27fc700 1 -- 172.21.15.8:0/888220159 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7e410af90 msgr2=0x7fe7e4196ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.873+0000 7fe7e27fc700 1 --2- 172.21.15.8:0/888220159 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7e410af90 0x7fe7e4196ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.873+0000 7fe7e27fc700 1 -- 172.21.15.8:0/888220159 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d8009520 con 0x7fe7e41024e0 2023-08-11T12:24:57.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.874+0000 7fe7e27fc700 1 --2- 172.21.15.8:0/888220159 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7e41024e0 0x7fe7e419cfa0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe7d800eb30 tx=0x7fe7d800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:57.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.874+0000 7fe7e89fd700 1 -- 172.21.15.8:0/888220159 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d8009880 con 0x7fe7e41024e0 2023-08-11T12:24:57.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.874+0000 7fe7e99ff700 1 -- 172.21.15.8:0/888220159 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d4009d00 con 0x7fe7e41024e0 2023-08-11T12:24:57.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.874+0000 7fe7e89fd700 1 -- 172.21.15.8:0/888220159 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7d80044e0 con 0x7fe7e41024e0 2023-08-11T12:24:57.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.874+0000 7fe7e89fd700 1 -- 172.21.15.8:0/888220159 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d8003d80 con 0x7fe7e41024e0 2023-08-11T12:24:57.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.874+0000 7fe7e99ff700 1 -- 172.21.15.8:0/888220159 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e40ff920 con 0x7fe7e41024e0 2023-08-11T12:24:57.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.881+0000 7fe7e89fd700 1 -- 172.21.15.8:0/888220159 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 134846+0+0 (secure 0 0 0) 0x7fe7d8003f20 con 0x7fe7e41024e0 2023-08-11T12:24:57.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.881+0000 7fe7fd2c7b80 1 Processor -- start 2023-08-11T12:24:57.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.882+0000 7fe7fd2c7b80 1 -- start start 2023-08-11T12:24:57.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.882+0000 7fe7fd2c7b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56266a392310 0x56266a3926f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.882+0000 7fe7fd2c7b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56266a392c30 0x56266a38c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.882+0000 7fe7fd2c7b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56266a38ce20 0x56266a38d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.882+0000 7fe7fd2c7b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56266a2e5630 con 0x56266a392c30 2023-08-11T12:24:57.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.882+0000 7fe7fd2c7b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56266a2e2f50 con 0x56266a38ce20 2023-08-11T12:24:57.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.882+0000 7fe7fd2c7b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56266a2de840 con 0x56266a392310 2023-08-11T12:24:57.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.883+0000 7fe7e2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56266a392c30 0x56266a38c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.883+0000 7fe7e2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56266a392c30 0x56266a38c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52222/0 (socket says 172.21.15.8:52222) 2023-08-11T12:24:57.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.883+0000 7fe7e2ffd700 1 -- 172.21.15.8:0/1191835289 learned_addr learned my addr 172.21.15.8:0/1191835289 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:57.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.884+0000 7fe7e37fe700 1 --2- 172.21.15.8:0/1191835289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56266a392310 0x56266a3926f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.884+0000 7fe7e2ffd700 1 -- 172.21.15.8:0/1191835289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56266a392310 msgr2=0x56266a3926f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:57.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.884+0000 7fe7e2ffd700 1 --2- 172.21.15.8:0/1191835289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56266a392310 0x56266a3926f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.884+0000 7fe7e2ffd700 1 -- 172.21.15.8:0/1191835289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56266a38ce20 msgr2=0x56266a38d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:57.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.884+0000 7fe7e27fc700 1 --2- 172.21.15.8:0/1191835289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56266a38ce20 0x56266a38d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.884+0000 7fe7e2ffd700 1 --2- 172.21.15.8:0/1191835289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56266a38ce20 0x56266a38d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.884+0000 7fe7e2ffd700 1 -- 172.21.15.8:0/1191835289 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56266a15e630 con 0x56266a392c30 2023-08-11T12:24:57.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.884+0000 7fe7e89fd700 1 --2- 172.21.15.8:0/888220159 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe7cc0a0150 0x7fe7cc0a2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.884+0000 7fe7e27fc700 1 --2- 172.21.15.8:0/1191835289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56266a38ce20 0x56266a38d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:24:57.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.885+0000 7fe7e89fd700 1 -- 172.21.15.8:0/888220159 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fe7d80ce070 con 0x7fe7e41024e0 2023-08-11T12:24:57.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.885+0000 7fe7e2ffd700 1 --2- 172.21.15.8:0/1191835289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56266a392c30 0x56266a38c8e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe7d400b0a0 tx=0x7fe7d4009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1641efcf2cc6d8f7 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:57.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.885+0000 7fe7e37fe700 1 --2- 172.21.15.8:0/888220159 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe7cc0a0150 0x7fe7cc0a2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.886+0000 7fe7c9ffb700 1 -- 172.21.15.8:0/1191835289 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d400e040 con 0x56266a392c30 2023-08-11T12:24:57.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.886+0000 7fe7c9ffb700 1 -- 172.21.15.8:0/1191835289 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7d400bcb0 con 0x56266a392c30 2023-08-11T12:24:57.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.886+0000 7fe7c9ffb700 1 -- 172.21.15.8:0/1191835289 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d401c680 con 0x56266a392c30 2023-08-11T12:24:57.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.886+0000 7fe7e37fe700 1 --2- 172.21.15.8:0/888220159 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe7cc0a0150 0x7fe7cc0a2610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe7e419d760 tx=0x7fe7dc009260 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:57.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.887+0000 7fe7fd2c7b80 1 -- 172.21.15.8:0/1191835289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56266a392c30 msgr2=0x56266a38c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.887+0000 7fe7fd2c7b80 1 --2- 172.21.15.8:0/1191835289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56266a392c30 0x56266a38c8e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe7d400b0a0 tx=0x7fe7d4009340 comp rx=0 tx=0).stop 2023-08-11T12:24:57.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.887+0000 7fe7fd2c7b80 1 -- 172.21.15.8:0/1191835289 shutdown_connections 2023-08-11T12:24:57.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.887+0000 7fe7fd2c7b80 1 --2- 172.21.15.8:0/1191835289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56266a392310 0x56266a3926f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.887+0000 7fe7fd2c7b80 1 --2- 172.21.15.8:0/1191835289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56266a38ce20 0x56266a38d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.887+0000 7fe7fd2c7b80 1 --2- 172.21.15.8:0/1191835289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56266a392c30 0x56266a38c8e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.887+0000 7fe7fd2c7b80 1 -- 172.21.15.8:0/1191835289 >> 172.21.15.8:0/1191835289 conn(0x56266a2b9950 msgr2=0x56266a3873d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:57.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.887+0000 7fe7fd2c7b80 1 -- 172.21.15.8:0/1191835289 shutdown_connections 2023-08-11T12:24:57.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.887+0000 7fe7fd2c7b80 1 -- 172.21.15.8:0/1191835289 wait complete. 2023-08-11T12:24:57.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.888+0000 7fe7fd2c7b80 1 -- start start 2023-08-11T12:24:57.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.888+0000 7fe7fd2c7b80 1 Processor -- start 2023-08-11T12:24:57.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.889+0000 7fe7fd2c7b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56266a38ce20 0x56266a398b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.889+0000 7fe7fd2c7b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56266a392310 0x56266a395e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.889+0000 7fe7fd2c7b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56266a392c30 0x56266a396580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.889+0000 7fe7fd2c7b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56266a27cac0 con 0x56266a38ce20 2023-08-11T12:24:57.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.889+0000 7fe7fd2c7b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56266a27c7c0 con 0x56266a392310 2023-08-11T12:24:57.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.889+0000 7fe7fd2c7b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56266a160920 con 0x56266a392c30 2023-08-11T12:24:57.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.889+0000 7fe7fd2c7b80 10 client.0 _ll_register_callbacks cb 0x56266a27fab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:57.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.889+0000 7fe7e27fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56266a392310 0x56266a395e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.889+0000 7fe7e27fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56266a392310 0x56266a395e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:59662/0 (socket says 172.21.15.8:59662) 2023-08-11T12:24:57.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.889+0000 7fe7e27fc700 1 -- 172.21.15.8:0/655690852 learned_addr learned my addr 172.21.15.8:0/655690852 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:57.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.889+0000 7fe7e2ffd700 1 --2- 172.21.15.8:0/655690852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56266a38ce20 0x56266a398b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.889+0000 7fe7e37fe700 1 --2- 172.21.15.8:0/655690852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56266a392c30 0x56266a396580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.890+0000 7fe7e27fc700 1 -- 172.21.15.8:0/655690852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56266a392c30 msgr2=0x56266a396580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:57.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.890+0000 7fe7e27fc700 1 --2- 172.21.15.8:0/655690852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56266a392c30 0x56266a396580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.890+0000 7fe7e27fc700 1 -- 172.21.15.8:0/655690852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56266a38ce20 msgr2=0x56266a398b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:57.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.890+0000 7fe7e27fc700 1 --2- 172.21.15.8:0/655690852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56266a38ce20 0x56266a398b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.890+0000 7fe7e27fc700 1 -- 172.21.15.8:0/655690852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e410e0d0 con 0x56266a392310 2023-08-11T12:24:57.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.890+0000 7fe7e27fc700 1 --2- 172.21.15.8:0/655690852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56266a392310 0x56266a395e40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe7d80987f0 tx=0x7fe7d8098720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4960f169d1c3a24 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:57.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.890+0000 7fe7c2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:24:57.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.890+0000 7fe7c2ffd700 1 -- 172.21.15.8:0/655690852 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d80cd030 con 0x56266a392310 2023-08-11T12:24:57.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.890+0000 7fe7fd2c7b80 1 -- 172.21.15.8:0/655690852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56266a37fa90 con 0x56266a392310 2023-08-11T12:24:57.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.890+0000 7fe7c2ffd700 1 -- 172.21.15.8:0/655690852 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fe7d8014070 con 0x56266a392310 2023-08-11T12:24:57.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.890+0000 7fe7c2ffd700 1 -- 172.21.15.8:0/655690852 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7d800cbd0 con 0x56266a392310 2023-08-11T12:24:57.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.890+0000 7fe7fd2c7b80 10 client.25754 fetch_fsmap learned FSMap version 28 2023-08-11T12:24:57.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.891+0000 7fe7fd2c7b80 1 -- 172.21.15.8:0/655690852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x56266a10ade0 con 0x56266a392310 2023-08-11T12:24:57.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.891+0000 7fe7c2ffd700 1 -- 172.21.15.8:0/655690852 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56266a37fa90 con 0x56266a392310 2023-08-11T12:24:57.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.891+0000 7fe7c2ffd700 1 -- 172.21.15.8:0/655690852 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fe7d8097d50 con 0x56266a392310 2023-08-11T12:24:57.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.891+0000 7fe7fd2c7b80 10 client.25754 fetch_fsmap finished waiting for FSMap version 28 2023-08-11T12:24:57.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.891+0000 7fe7fd2c7b80 10 client.25754 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-08-11T12:24:57.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.891+0000 7fe7fd2c7b80 20 client.25754 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:57.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.891+0000 7fe7fd2c7b80 1 --2- 172.21.15.8:0/655690852 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x56266a3a6310 0x56266a3a8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.891+0000 7fe7fd2c7b80 4 client.25754 mds_command: new command op to 24517 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:24:57.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.891+0000 7fe7fd2c7b80 1 -- 172.21.15.8:0/655690852 --> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56266a35b4e0 con 0x56266a3a6310 2023-08-11T12:24:57.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.891+0000 7fe7e2ffd700 1 --2- 172.21.15.8:0/655690852 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x56266a3a6310 0x56266a3a8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.892+0000 7fe7c2ffd700 10 client.25754 ms_handle_connect on v2:172.21.15.194:6834/2457430285 2023-08-11T12:24:57.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.892+0000 7fe7e2ffd700 1 --2- 172.21.15.8:0/655690852 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x56266a3a6310 0x56266a3a8730 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ad7a18129f9f2bfb server_cookie=deb39075c2d79909 in_seq=0 out_seq=0 2023-08-11T12:24:57.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.893+0000 7fe7c2ffd700 1 -- 172.21.15.8:0/655690852 <== mds.2 v2:172.21.15.194:6834/2457430285 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x56266a35b4e0 con 0x56266a3a6310 2023-08-11T12:24:57.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.893+0000 7fe7c2ffd700 10 client.25754 handle_command_reply: tid=0 2023-08-11T12:24:57.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.893+0000 7fe7fd2c7b80 1 client.25754 shutdown 2023-08-11T12:24:57.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.893+0000 7fe7fd2c7b80 1 -- 172.21.15.8:0/655690852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56266a392310 msgr2=0x56266a395e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.893+0000 7fe7fd2c7b80 1 --2- 172.21.15.8:0/655690852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56266a392310 0x56266a395e40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe7d80987f0 tx=0x7fe7d8098720 comp rx=0 tx=0).stop 2023-08-11T12:24:57.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.893+0000 7fe7fd2c7b80 1 -- 172.21.15.8:0/655690852 shutdown_connections 2023-08-11T12:24:57.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.893+0000 7fe7fd2c7b80 1 --2- 172.21.15.8:0/655690852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56266a392c30 0x56266a396580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.893+0000 7fe7fd2c7b80 1 --2- 172.21.15.8:0/655690852 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x56266a3a6310 0x56266a3a8730 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.893+0000 7fe7fd2c7b80 1 --2- 172.21.15.8:0/655690852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56266a38ce20 0x56266a398b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.893+0000 7fe7fd2c7b80 1 --2- 172.21.15.8:0/655690852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56266a392310 0x56266a395e40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.893+0000 7fe7fd2c7b80 1 -- 172.21.15.8:0/655690852 >> 172.21.15.8:0/655690852 conn(0x56266a2b9950 msgr2=0x56266a381cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:57.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.893+0000 7fe7c2ffd700 0 client.25754 ms_handle_reset on v2:172.21.15.194:6834/2457430285 2023-08-11T12:24:57.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.893+0000 7fe7fd2c7b80 1 -- 172.21.15.8:0/655690852 shutdown_connections 2023-08-11T12:24:57.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.894+0000 7fe7fd2c7b80 1 -- 172.21.15.8:0/655690852 wait complete. 2023-08-11T12:24:57.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.894+0000 7fe7fd2c7b80 20 client.25754 trim_cache size 0 max 16384 2023-08-11T12:24:57.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.907+0000 7fe7fd2c7b80 1 Processor -- start 2023-08-11T12:24:57.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.907+0000 7fe7fd2c7b80 1 -- start start 2023-08-11T12:24:57.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.908+0000 7fe7fd2c7b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56266a38ce20 0x56266a38c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.908+0000 7fe7fd2c7b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56266a392310 0x56266a398650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.908+0000 7fe7fd2c7b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56266a392c30 0x56266a398b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.908+0000 7fe7fd2c7b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56266a392ad0 con 0x56266a38ce20 2023-08-11T12:24:57.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.908+0000 7fe7fd2c7b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56266a399310 con 0x56266a392310 2023-08-11T12:24:57.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.908+0000 7fe7fd2c7b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56266a35b4e0 con 0x56266a392c30 2023-08-11T12:24:57.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.908+0000 7fe7e2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56266a38ce20 0x56266a38c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.908+0000 7fe7e2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56266a38ce20 0x56266a38c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52240/0 (socket says 172.21.15.8:52240) 2023-08-11T12:24:57.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.908+0000 7fe7e2ffd700 1 -- 172.21.15.8:0/1423624168 learned_addr learned my addr 172.21.15.8:0/1423624168 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:57.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.908+0000 7fe7e27fc700 1 --2- 172.21.15.8:0/1423624168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56266a392310 0x56266a398650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.909+0000 7fe7e37fe700 1 --2- 172.21.15.8:0/1423624168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56266a392c30 0x56266a398b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.909+0000 7fe7e2ffd700 1 -- 172.21.15.8:0/1423624168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56266a392c30 msgr2=0x56266a398b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:57.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.909+0000 7fe7e2ffd700 1 --2- 172.21.15.8:0/1423624168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56266a392c30 0x56266a398b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.909+0000 7fe7e2ffd700 1 -- 172.21.15.8:0/1423624168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56266a392310 msgr2=0x56266a398650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:57.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.909+0000 7fe7e2ffd700 1 --2- 172.21.15.8:0/1423624168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56266a392310 0x56266a398650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.909+0000 7fe7e2ffd700 1 -- 172.21.15.8:0/1423624168 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56266a0f3c60 con 0x56266a38ce20 2023-08-11T12:24:57.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.909+0000 7fe7e2ffd700 1 --2- 172.21.15.8:0/1423624168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56266a38ce20 0x56266a38c8e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe7d400d010 tx=0x7fe7d40078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c68fa120e5136a6 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:57.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.911+0000 7fe7ca7fc700 1 -- 172.21.15.8:0/1423624168 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d4029040 con 0x56266a38ce20 2023-08-11T12:24:57.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.911+0000 7fe7ca7fc700 1 -- 172.21.15.8:0/1423624168 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7d4007910 con 0x56266a38ce20 2023-08-11T12:24:57.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.911+0000 7fe7ca7fc700 1 -- 172.21.15.8:0/1423624168 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d400e040 con 0x56266a38ce20 2023-08-11T12:24:57.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.911+0000 7fe7fd2c7b80 1 -- 172.21.15.8:0/1423624168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56266a38ce20 msgr2=0x56266a38c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.911+0000 7fe7fd2c7b80 1 --2- 172.21.15.8:0/1423624168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56266a38ce20 0x56266a38c8e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe7d400d010 tx=0x7fe7d40078a0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.911+0000 7fe7fd2c7b80 1 -- 172.21.15.8:0/1423624168 shutdown_connections 2023-08-11T12:24:57.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.911+0000 7fe7fd2c7b80 1 --2- 172.21.15.8:0/1423624168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56266a392c30 0x56266a398b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.912+0000 7fe7fd2c7b80 1 --2- 172.21.15.8:0/1423624168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56266a38ce20 0x56266a38c8e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.912+0000 7fe7fd2c7b80 1 --2- 172.21.15.8:0/1423624168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56266a392310 0x56266a398650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.912+0000 7fe7fd2c7b80 1 -- 172.21.15.8:0/1423624168 >> 172.21.15.8:0/1423624168 conn(0x56266a2b9950 msgr2=0x56266a3a2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:57.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.912+0000 7fe7fd2c7b80 1 -- 172.21.15.8:0/1423624168 shutdown_connections 2023-08-11T12:24:57.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.912+0000 7fe7fd2c7b80 1 -- 172.21.15.8:0/1423624168 wait complete. 2023-08-11T12:24:57.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.912+0000 7fe7fd2c7b80 1 -- start start 2023-08-11T12:24:57.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.913+0000 7fe7fd2c7b80 1 Processor -- start 2023-08-11T12:24:57.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.913+0000 7fe7fd2c7b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56266a38ce20 0x56266a39cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.913+0000 7fe7fd2c7b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56266a392310 0x56266a39d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.913+0000 7fe7fd2c7b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56266a392c30 0x56266a39b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.913+0000 7fe7fd2c7b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56266a39bb30 con 0x56266a392c30 2023-08-11T12:24:57.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.913+0000 7fe7fd2c7b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56266a39bca0 con 0x56266a38ce20 2023-08-11T12:24:57.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.913+0000 7fe7fd2c7b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56266a39be60 con 0x56266a392310 2023-08-11T12:24:57.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.913+0000 7fe7fd2c7b80 10 client.0 _ll_register_callbacks cb 0x7fe7d8094ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:57.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.913+0000 7fe7e27fc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56266a392310 0x56266a39d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.913+0000 7fe7e27fc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56266a392310 0x56266a39d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:37960/0 (socket says 172.21.15.8:37960) 2023-08-11T12:24:57.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.913+0000 7fe7e27fc700 1 -- 172.21.15.8:0/3414977655 learned_addr learned my addr 172.21.15.8:0/3414977655 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:57.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.913+0000 7fe7e2ffd700 1 --2- 172.21.15.8:0/3414977655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56266a38ce20 0x56266a39cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.914+0000 7fe7e37fe700 1 --2- 172.21.15.8:0/3414977655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56266a392c30 0x56266a39b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.914+0000 7fe7e27fc700 1 -- 172.21.15.8:0/3414977655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56266a38ce20 msgr2=0x56266a39cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:57.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.914+0000 7fe7e27fc700 1 --2- 172.21.15.8:0/3414977655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56266a38ce20 0x56266a39cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.914+0000 7fe7e27fc700 1 -- 172.21.15.8:0/3414977655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56266a392c30 msgr2=0x56266a39b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:57.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.914+0000 7fe7e27fc700 1 --2- 172.21.15.8:0/3414977655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56266a392c30 0x56266a39b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.914+0000 7fe7e27fc700 1 -- 172.21.15.8:0/3414977655 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56266a15e630 con 0x56266a392310 2023-08-11T12:24:57.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.914+0000 7fe7e37fe700 1 --2- 172.21.15.8:0/3414977655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56266a392c30 0x56266a39b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:24:57.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.914+0000 7fe7e27fc700 1 --2- 172.21.15.8:0/3414977655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56266a392310 0x56266a39d300 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8098d10 tx=0x7fe7d80ce2b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed52723c4a4d7ee9 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:57.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.914+0000 7fe7c2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:24:57.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.914+0000 7fe7c2ffd700 1 -- 172.21.15.8:0/3414977655 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d80cd070 con 0x56266a392310 2023-08-11T12:24:57.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.914+0000 7fe7fd2c7b80 1 -- 172.21.15.8:0/3414977655 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe7d400bcb0 con 0x56266a392310 2023-08-11T12:24:57.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.914+0000 7fe7c2ffd700 1 -- 172.21.15.8:0/3414977655 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fe7d8014040 con 0x56266a392310 2023-08-11T12:24:57.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.914+0000 7fe7c2ffd700 1 -- 172.21.15.8:0/3414977655 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7d80c4ea0 con 0x56266a392310 2023-08-11T12:24:57.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.915+0000 7fe7fd2c7b80 10 client.25771 fetch_fsmap learned FSMap version 28 2023-08-11T12:24:57.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.915+0000 7fe7fd2c7b80 1 -- 172.21.15.8:0/3414977655 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x56266a131250 con 0x56266a392310 2023-08-11T12:24:57.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.915+0000 7fe7c2ffd700 1 -- 172.21.15.8:0/3414977655 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7d400bcb0 con 0x56266a392310 2023-08-11T12:24:57.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.915+0000 7fe7c2ffd700 1 -- 172.21.15.8:0/3414977655 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 28) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fe7d8094650 con 0x56266a392310 2023-08-11T12:24:57.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.915+0000 7fe7fd2c7b80 10 client.25771 fetch_fsmap finished waiting for FSMap version 28 2023-08-11T12:24:57.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.915+0000 7fe7fd2c7b80 10 client.25771 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-08-11T12:24:57.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.915+0000 7fe7fd2c7b80 20 client.25771 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:57.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.915+0000 7fe7fd2c7b80 1 --2- 172.21.15.8:0/3414977655 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x56266a3fad10 0x56266a3fd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:57.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.915+0000 7fe7fd2c7b80 4 client.25771 mds_command: new command op to 24517 tid=0[{"prefix": "damage ls"}] 2023-08-11T12:24:57.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.915+0000 7fe7fd2c7b80 1 -- 172.21.15.8:0/3414977655 --> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56266a2d7820 con 0x56266a3fad10 2023-08-11T12:24:57.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.915+0000 7fe7e2ffd700 1 --2- 172.21.15.8:0/3414977655 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x56266a3fad10 0x56266a3fd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:57.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.916+0000 7fe7e2ffd700 1 --2- 172.21.15.8:0/3414977655 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x56266a3fad10 0x56266a3fd130 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=61e1dd205f72f7e5 server_cookie=fb7b5a0c50c04135 in_seq=0 out_seq=0 2023-08-11T12:24:57.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.916+0000 7fe7c2ffd700 10 client.25771 ms_handle_connect on v2:172.21.15.194:6834/2457430285 2023-08-11T12:24:57.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.916+0000 7fe7c2ffd700 1 -- 172.21.15.8:0/3414977655 <== mds.2 v2:172.21.15.194:6834/2457430285 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56266a2d7820 con 0x56266a3fad10 2023-08-11T12:24:57.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.916+0000 7fe7c2ffd700 10 client.25771 handle_command_reply: tid=0 2023-08-11T12:24:57.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.916+0000 7fe7fd2c7b80 1 client.25771 shutdown 2023-08-11T12:24:57.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.917+0000 7fe7fd2c7b80 1 -- 172.21.15.8:0/3414977655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56266a392310 msgr2=0x56266a39d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.917+0000 7fe7fd2c7b80 1 --2- 172.21.15.8:0/3414977655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56266a392310 0x56266a39d300 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8098d10 tx=0x7fe7d80ce2b0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.917+0000 7fe7fd2c7b80 1 -- 172.21.15.8:0/3414977655 shutdown_connections 2023-08-11T12:24:57.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.917+0000 7fe7fd2c7b80 1 --2- 172.21.15.8:0/3414977655 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x56266a3fad10 0x56266a3fd130 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.917+0000 7fe7fd2c7b80 1 --2- 172.21.15.8:0/3414977655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56266a392c30 0x56266a39b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.917+0000 7fe7fd2c7b80 1 --2- 172.21.15.8:0/3414977655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56266a38ce20 0x56266a39cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.917+0000 7fe7c2ffd700 0 client.25771 ms_handle_reset on v2:172.21.15.194:6834/2457430285 2023-08-11T12:24:57.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.917+0000 7fe7fd2c7b80 1 --2- 172.21.15.8:0/3414977655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56266a392310 0x56266a39d300 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.917+0000 7fe7fd2c7b80 1 -- 172.21.15.8:0/3414977655 >> 172.21.15.8:0/3414977655 conn(0x56266a2b9950 msgr2=0x56266a3956e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:57.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.917+0000 7fe7fd2c7b80 1 -- 172.21.15.8:0/3414977655 shutdown_connections 2023-08-11T12:24:57.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.917+0000 7fe7fd2c7b80 1 -- 172.21.15.8:0/3414977655 wait complete. 2023-08-11T12:24:57.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.918+0000 7fe7fd2c7b80 20 client.25771 trim_cache size 0 max 16384 2023-08-11T12:24:57.928 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-08-11T12:24:57.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.919+0000 7fe7e99ff700 1 -- 172.21.15.8:0/888220159 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe7cc0a0150 msgr2=0x7fe7cc0a2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.919+0000 7fe7e99ff700 1 --2- 172.21.15.8:0/888220159 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe7cc0a0150 0x7fe7cc0a2610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe7e419d760 tx=0x7fe7dc009260 comp rx=0 tx=0).stop 2023-08-11T12:24:57.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.919+0000 7fe7e99ff700 1 -- 172.21.15.8:0/888220159 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7e41024e0 msgr2=0x7fe7e419cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:57.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.919+0000 7fe7e99ff700 1 --2- 172.21.15.8:0/888220159 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7e41024e0 0x7fe7e419cfa0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe7d800eb30 tx=0x7fe7d800ee40 comp rx=0 tx=0).stop 2023-08-11T12:24:57.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.920+0000 7fe7e99ff700 1 -- 172.21.15.8:0/888220159 shutdown_connections 2023-08-11T12:24:57.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.920+0000 7fe7e99ff700 1 --2- 172.21.15.8:0/888220159 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe7cc0a0150 0x7fe7cc0a2610 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.920+0000 7fe7e99ff700 1 --2- 172.21.15.8:0/888220159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7e4101bc0 0x7fe7e419ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.920+0000 7fe7e99ff700 1 --2- 172.21.15.8:0/888220159 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7e410af90 0x7fe7e4196ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.920+0000 7fe7e99ff700 1 --2- 172.21.15.8:0/888220159 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7e41024e0 0x7fe7e419cfa0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:57.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.920+0000 7fe7e99ff700 1 -- 172.21.15.8:0/888220159 >> 172.21.15.8:0/888220159 conn(0x7fe7e4076a30 msgr2=0x7fe7e40fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:57.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.921+0000 7fe7e99ff700 1 -- 172.21.15.8:0/888220159 shutdown_connections 2023-08-11T12:24:57.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:57.921+0000 7fe7e99ff700 1 -- 172.21.15.8:0/888220159 wait complete. 2023-08-11T12:24:57.941 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:57 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/400700698' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:24:57.943 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-08-11T12:24:58.083 INFO:teuthology.orchestra.run.smithi008.stderr:1000000 of 50000000 tuples (2%) done (elapsed 2.77 s, remaining 135.73 s) 2023-08-11T12:24:58.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:57 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/400700698' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:24:58.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:57 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/400700698' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:24:58.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.154+0000 7f7275bff700 1 -- 172.21.15.8:0/2706850075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72701000f0 msgr2=0x7f727010cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:58.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.154+0000 7f7275bff700 1 --2- 172.21.15.8:0/2706850075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72701000f0 0x7f727010cdb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f72640098f0 tx=0x7f7264009c00 comp rx=0 tx=0).stop 2023-08-11T12:24:58.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.154+0000 7f7275bff700 1 -- 172.21.15.8:0/2706850075 shutdown_connections 2023-08-11T12:24:58.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.154+0000 7f7275bff700 1 --2- 172.21.15.8:0/2706850075 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f727010d2f0 0x7f727010f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.154+0000 7f7275bff700 1 --2- 172.21.15.8:0/2706850075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72700ff740 0x7f72700ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.154+0000 7f7275bff700 1 --2- 172.21.15.8:0/2706850075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72701000f0 0x7f727010cdb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.154+0000 7f7275bff700 1 -- 172.21.15.8:0/2706850075 >> 172.21.15.8:0/2706850075 conn(0x7f7270076a30 msgr2=0x7f7270076e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:58.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.154+0000 7f7275bff700 1 -- 172.21.15.8:0/2706850075 shutdown_connections 2023-08-11T12:24:58.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.154+0000 7f7275bff700 1 -- 172.21.15.8:0/2706850075 wait complete. 2023-08-11T12:24:58.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.156+0000 7f7275bff700 1 Processor -- start 2023-08-11T12:24:58.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.156+0000 7f7275bff700 1 -- start start 2023-08-11T12:24:58.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.157+0000 7f7275bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72700ff740 0x7f7270198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.157+0000 7f7275bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72701000f0 0x7f7270199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.157+0000 7f7275bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f727010d2f0 0x7f727019d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.157+0000 7f7275bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727019ddb0 con 0x7f72700ff740 2023-08-11T12:24:58.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.157+0000 7f7275bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727019df20 con 0x7f727010d2f0 2023-08-11T12:24:58.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.157+0000 7f7275bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727019e0e0 con 0x7f72701000f0 2023-08-11T12:24:58.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.157+0000 7f726f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72700ff740 0x7f7270198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.157+0000 7f726effd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72701000f0 0x7f7270199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.157+0000 7f726f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72700ff740 0x7f7270198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52256/0 (socket says 172.21.15.8:52256) 2023-08-11T12:24:58.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.157+0000 7f726ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f727010d2f0 0x7f727019d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.157+0000 7f726f7fe700 1 -- 172.21.15.8:0/1546070176 learned_addr learned my addr 172.21.15.8:0/1546070176 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:58.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.157+0000 7f726effd700 1 -- 172.21.15.8:0/1546070176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f727010d2f0 msgr2=0x7f727019d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:58.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.157+0000 7f726effd700 1 --2- 172.21.15.8:0/1546070176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f727010d2f0 0x7f727019d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.157+0000 7f726effd700 1 -- 172.21.15.8:0/1546070176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72700ff740 msgr2=0x7f7270198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:58.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.157+0000 7f726effd700 1 --2- 172.21.15.8:0/1546070176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72700ff740 0x7f7270198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.157+0000 7f726effd700 1 -- 172.21.15.8:0/1546070176 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7264009520 con 0x7f72701000f0 2023-08-11T12:24:58.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.158+0000 7f726effd700 1 --2- 172.21.15.8:0/1546070176 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72701000f0 0x7f7270199310 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7264009810 tx=0x7f726400fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:58.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.158+0000 7f726cff9700 1 -- 172.21.15.8:0/1546070176 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726401c070 con 0x7f72701000f0 2023-08-11T12:24:58.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.158+0000 7f726cff9700 1 -- 172.21.15.8:0/1546070176 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f726400bba0 con 0x7f72701000f0 2023-08-11T12:24:58.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.158+0000 7f726cff9700 1 -- 172.21.15.8:0/1546070176 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7264003970 con 0x7f72701000f0 2023-08-11T12:24:58.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.158+0000 7f7275bff700 1 -- 172.21.15.8:0/1546070176 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f727019e360 con 0x7f72701000f0 2023-08-11T12:24:58.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.158+0000 7f7275bff700 1 -- 172.21.15.8:0/1546070176 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f727019e5b0 con 0x7f72701000f0 2023-08-11T12:24:58.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.161+0000 7f726cff9700 1 -- 172.21.15.8:0/1546070176 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 23) v1 ==== 134846+0+0 (secure 0 0 0) 0x7f7264020030 con 0x7f72701000f0 2023-08-11T12:24:58.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.163+0000 7f7289521b80 1 Processor -- start 2023-08-11T12:24:58.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.163+0000 7f7289521b80 1 -- start start 2023-08-11T12:24:58.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.163+0000 7f726cff9700 1 --2- 172.21.15.8:0/1546070176 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f72580a0150 0x7f72580a2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.163+0000 7f7289521b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55705a1ad310 0x55705a1ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.163+0000 7f7289521b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55705a1adc30 0x55705a1a78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.163+0000 7f7289521b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55705a1a7e20 0x55705a1a8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.163+0000 7f7289521b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55705a100630 con 0x55705a1a7e20 2023-08-11T12:24:58.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.163+0000 7f7289521b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55705a0fdf50 con 0x55705a1adc30 2023-08-11T12:24:58.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.163+0000 7f7289521b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55705a0f9840 con 0x55705a1ad310 2023-08-11T12:24:58.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.163+0000 7f726cff9700 1 -- 172.21.15.8:0/1546070176 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f72640cc8b0 con 0x7f72701000f0 2023-08-11T12:24:58.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.164+0000 7f726f7fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55705a1ad310 0x55705a1ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.164+0000 7f726f7fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55705a1ad310 0x55705a1ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:37994/0 (socket says 172.21.15.8:37994) 2023-08-11T12:24:58.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.164+0000 7f726f7fe700 1 -- 172.21.15.8:0/840538290 learned_addr learned my addr 172.21.15.8:0/840538290 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:58.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.164+0000 7f726effd700 1 --2- 172.21.15.8:0/840538290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55705a1adc30 0x55705a1a78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.164+0000 7f726ffff700 1 --2- 172.21.15.8:0/840538290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55705a1a7e20 0x55705a1a8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.164+0000 7f726ffff700 1 --2- 172.21.15.8:0/1546070176 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f72580a0150 0x7f72580a2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.164+0000 7f726effd700 1 -- 172.21.15.8:0/840538290 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55705a1ad310 msgr2=0x55705a1ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:58.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.164+0000 7f726effd700 1 --2- 172.21.15.8:0/840538290 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55705a1ad310 0x55705a1ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.164+0000 7f726effd700 1 -- 172.21.15.8:0/840538290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55705a1a7e20 msgr2=0x55705a1a8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:58.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.164+0000 7f726effd700 1 --2- 172.21.15.8:0/840538290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55705a1a7e20 0x55705a1a8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.164+0000 7f726effd700 1 -- 172.21.15.8:0/840538290 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557059f79630 con 0x55705a1adc30 2023-08-11T12:24:58.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.165+0000 7f726effd700 1 --2- 172.21.15.8:0/840538290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55705a1adc30 0x55705a1a78e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f72640c9bf0 tx=0x7f7264005600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5505da3e92606f60 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:58.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.165+0000 7f7255ffb700 1 -- 172.21.15.8:0/840538290 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726409a290 con 0x55705a1adc30 2023-08-11T12:24:58.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.165+0000 7f7255ffb700 1 -- 172.21.15.8:0/840538290 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7264099b90 con 0x55705a1adc30 2023-08-11T12:24:58.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.165+0000 7f7255ffb700 1 -- 172.21.15.8:0/840538290 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7264096430 con 0x55705a1adc30 2023-08-11T12:24:58.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.165+0000 7f726ffff700 1 --2- 172.21.15.8:0/1546070176 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f72580a0150 0x7f72580a2610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7268009fd0 tx=0x7f726800b040 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:58.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.166+0000 7f7289521b80 1 -- 172.21.15.8:0/840538290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55705a1adc30 msgr2=0x55705a1a78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.166+0000 7f7289521b80 1 --2- 172.21.15.8:0/840538290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55705a1adc30 0x55705a1a78e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f72640c9bf0 tx=0x7f7264005600 comp rx=0 tx=0).stop 2023-08-11T12:24:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.166+0000 7f7289521b80 1 -- 172.21.15.8:0/840538290 shutdown_connections 2023-08-11T12:24:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.166+0000 7f7289521b80 1 --2- 172.21.15.8:0/840538290 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55705a1ad310 0x55705a1ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.166+0000 7f7289521b80 1 --2- 172.21.15.8:0/840538290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55705a1a7e20 0x55705a1a8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.166+0000 7f7289521b80 1 --2- 172.21.15.8:0/840538290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55705a1adc30 0x55705a1a78e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.166+0000 7f7289521b80 1 -- 172.21.15.8:0/840538290 >> 172.21.15.8:0/840538290 conn(0x55705a0d4950 msgr2=0x55705a1a23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.166+0000 7f7289521b80 1 -- 172.21.15.8:0/840538290 shutdown_connections 2023-08-11T12:24:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.166+0000 7f7289521b80 1 -- 172.21.15.8:0/840538290 wait complete. 2023-08-11T12:24:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.166+0000 7f7289521b80 1 -- start start 2023-08-11T12:24:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.166+0000 7f7289521b80 1 Processor -- start 2023-08-11T12:24:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.167+0000 7f7289521b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55705a1a7e20 0x55705a1b3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.167+0000 7f7289521b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55705a1ad310 0x55705a1b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.167+0000 7f7289521b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55705a1adc30 0x55705a1b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.167+0000 7f7289521b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55705a097ac0 con 0x55705a1a7e20 2023-08-11T12:24:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.167+0000 7f7289521b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55705a0977c0 con 0x55705a1adc30 2023-08-11T12:24:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.167+0000 7f7289521b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x557059f7b920 con 0x55705a1ad310 2023-08-11T12:24:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.167+0000 7f7289521b80 10 client.0 _ll_register_callbacks cb 0x55705a09aab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.167+0000 7f726f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55705a1a7e20 0x55705a1b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.167+0000 7f726f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55705a1a7e20 0x55705a1b3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52278/0 (socket says 172.21.15.8:52278) 2023-08-11T12:24:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.167+0000 7f726f7fe700 1 -- 172.21.15.8:0/804826122 learned_addr learned my addr 172.21.15.8:0/804826122 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.167+0000 7f726effd700 1 --2- 172.21.15.8:0/804826122 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55705a1ad310 0x55705a1b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.167+0000 7f726ffff700 1 --2- 172.21.15.8:0/804826122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55705a1adc30 0x55705a1b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.168+0000 7f726effd700 1 -- 172.21.15.8:0/804826122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55705a1adc30 msgr2=0x55705a1b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:58.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.168+0000 7f726effd700 1 --2- 172.21.15.8:0/804826122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55705a1adc30 0x55705a1b11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.168+0000 7f726effd700 1 -- 172.21.15.8:0/804826122 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55705a1a7e20 msgr2=0x55705a1b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:58.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.168+0000 7f726effd700 1 --2- 172.21.15.8:0/804826122 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55705a1a7e20 0x55705a1b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.168+0000 7f726effd700 1 -- 172.21.15.8:0/804826122 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f727019e5b0 con 0x55705a1ad310 2023-08-11T12:24:58.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.168+0000 7f726ffff700 1 --2- 172.21.15.8:0/804826122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55705a1adc30 0x55705a1b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:24:58.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.168+0000 7f726f7fe700 1 --2- 172.21.15.8:0/804826122 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55705a1a7e20 0x55705a1b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.168+0000 7f726effd700 1 --2- 172.21.15.8:0/804826122 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55705a1ad310 0x55705a1b0ca0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f72640a1ad0 tx=0x7f726409a290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e68e44b3f24bb6a9 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.168+0000 7f724effd700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:24:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.168+0000 7f724effd700 1 -- 172.21.15.8:0/804826122 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72640b1ea0 con 0x55705a1ad310 2023-08-11T12:24:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.168+0000 7f7289521b80 1 -- 172.21.15.8:0/804826122 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55705a19aa90 con 0x55705a1ad310 2023-08-11T12:24:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.168+0000 7f724effd700 1 -- 172.21.15.8:0/804826122 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f7264005260 con 0x55705a1ad310 2023-08-11T12:24:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.168+0000 7f724effd700 1 -- 172.21.15.8:0/804826122 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7264005420 con 0x55705a1ad310 2023-08-11T12:24:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.168+0000 7f7289521b80 10 client.25783 fetch_fsmap learned FSMap version 28 2023-08-11T12:24:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.168+0000 7f7289521b80 1 -- 172.21.15.8:0/804826122 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x557059f25de0 con 0x55705a1ad310 2023-08-11T12:24:58.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.169+0000 7f724effd700 1 -- 172.21.15.8:0/804826122 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55705a19aa90 con 0x55705a1ad310 2023-08-11T12:24:58.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.169+0000 7f724effd700 1 -- 172.21.15.8:0/804826122 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 28) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f7264099080 con 0x55705a1ad310 2023-08-11T12:24:58.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.169+0000 7f7289521b80 10 client.25783 fetch_fsmap finished waiting for FSMap version 28 2023-08-11T12:24:58.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.169+0000 7f7289521b80 10 client.25783 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-08-11T12:24:58.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.169+0000 7f7289521b80 20 client.25783 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:58.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.169+0000 7f7289521b80 1 --2- 172.21.15.8:0/804826122 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x55705a1c0b60 0x55705a1c2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.169+0000 7f7289521b80 4 client.25783 mds_command: new command op to 24550 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:24:58.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.169+0000 7f7289521b80 1 -- 172.21.15.8:0/804826122 --> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55705a1764e0 con 0x55705a1c0b60 2023-08-11T12:24:58.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.169+0000 7f726f7fe700 1 --2- 172.21.15.8:0/804826122 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x55705a1c0b60 0x55705a1c2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.170+0000 7f726f7fe700 1 --2- 172.21.15.8:0/804826122 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x55705a1c0b60 0x55705a1c2f50 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b593a20c889c048e server_cookie=12018b78fed19019 in_seq=0 out_seq=0 2023-08-11T12:24:58.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.170+0000 7f724effd700 10 client.25783 ms_handle_connect on v2:172.21.15.194:6838/2174476491 2023-08-11T12:24:58.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.170+0000 7f724effd700 1 -- 172.21.15.8:0/804826122 <== mds.1 v2:172.21.15.194:6838/2174476491 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55705a1764e0 con 0x55705a1c0b60 2023-08-11T12:24:58.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.170+0000 7f724effd700 10 client.25783 handle_command_reply: tid=0 2023-08-11T12:24:58.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.170+0000 7f7289521b80 1 client.25783 shutdown 2023-08-11T12:24:58.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.171+0000 7f7289521b80 1 -- 172.21.15.8:0/804826122 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55705a1ad310 msgr2=0x55705a1b0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:58.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.171+0000 7f7289521b80 1 --2- 172.21.15.8:0/804826122 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55705a1ad310 0x55705a1b0ca0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f72640a1ad0 tx=0x7f726409a290 comp rx=0 tx=0).stop 2023-08-11T12:24:58.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.171+0000 7f7289521b80 1 -- 172.21.15.8:0/804826122 shutdown_connections 2023-08-11T12:24:58.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.171+0000 7f7289521b80 1 --2- 172.21.15.8:0/804826122 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x55705a1c0b60 0x55705a1c2f50 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.171+0000 7f7289521b80 1 --2- 172.21.15.8:0/804826122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55705a1adc30 0x55705a1b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.171+0000 7f7289521b80 1 --2- 172.21.15.8:0/804826122 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55705a1a7e20 0x55705a1b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.171+0000 7f724effd700 0 client.25783 ms_handle_reset on v2:172.21.15.194:6838/2174476491 2023-08-11T12:24:58.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.171+0000 7f7289521b80 1 --2- 172.21.15.8:0/804826122 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55705a1ad310 0x55705a1b0ca0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.171+0000 7f7289521b80 1 -- 172.21.15.8:0/804826122 >> 172.21.15.8:0/804826122 conn(0x55705a0d4950 msgr2=0x55705a19ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:58.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.171+0000 7f7289521b80 1 -- 172.21.15.8:0/804826122 shutdown_connections 2023-08-11T12:24:58.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.171+0000 7f7289521b80 1 -- 172.21.15.8:0/804826122 wait complete. 2023-08-11T12:24:58.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.171+0000 7f7289521b80 20 client.25783 trim_cache size 0 max 16384 2023-08-11T12:24:58.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.184+0000 7f7289521b80 1 Processor -- start 2023-08-11T12:24:58.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.185+0000 7f7289521b80 1 -- start start 2023-08-11T12:24:58.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.185+0000 7f7289521b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55705a1a7e20 0x55705a1a78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.185+0000 7f7289521b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55705a1ad310 0x55705a1b8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.185+0000 7f7289521b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55705a1adc30 0x55705a1ae720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.185+0000 7f7289521b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55705a19aa90 con 0x55705a1adc30 2023-08-11T12:24:58.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.185+0000 7f7289521b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55705a1adaa0 con 0x55705a1a7e20 2023-08-11T12:24:58.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.185+0000 7f7289521b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55705a1bda40 con 0x55705a1ad310 2023-08-11T12:24:58.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.185+0000 7f726f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55705a1a7e20 0x55705a1a78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.185+0000 7f726effd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55705a1ad310 0x55705a1b8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.185+0000 7f726f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55705a1a7e20 0x55705a1a78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:59712/0 (socket says 172.21.15.8:59712) 2023-08-11T12:24:58.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.185+0000 7f726f7fe700 1 -- 172.21.15.8:0/3155048187 learned_addr learned my addr 172.21.15.8:0/3155048187 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:58.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.185+0000 7f726ffff700 1 --2- 172.21.15.8:0/3155048187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55705a1adc30 0x55705a1ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.186+0000 7f726f7fe700 1 -- 172.21.15.8:0/3155048187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55705a1ad310 msgr2=0x55705a1b8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:58.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.186+0000 7f726f7fe700 1 --2- 172.21.15.8:0/3155048187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55705a1ad310 0x55705a1b8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.186+0000 7f726f7fe700 1 -- 172.21.15.8:0/3155048187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55705a1adc30 msgr2=0x55705a1ae720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:58.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.186+0000 7f726f7fe700 1 --2- 172.21.15.8:0/3155048187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55705a1adc30 0x55705a1ae720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.186+0000 7f726f7fe700 1 -- 172.21.15.8:0/3155048187 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55705a1a84d0 con 0x55705a1a7e20 2023-08-11T12:24:58.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.186+0000 7f726effd700 1 --2- 172.21.15.8:0/3155048187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55705a1ad310 0x55705a1b8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:58.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.186+0000 7f726ffff700 1 --2- 172.21.15.8:0/3155048187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55705a1adc30 0x55705a1ae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:24:58.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.186+0000 7f726f7fe700 1 --2- 172.21.15.8:0/3155048187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55705a1a7e20 0x55705a1a78e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7260004690 tx=0x7f726001fc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d833fa0917fc4fdc server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:58.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.186+0000 7f72567fc700 1 -- 172.21.15.8:0/3155048187 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260009840 con 0x55705a1a7e20 2023-08-11T12:24:58.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.186+0000 7f72567fc700 1 -- 172.21.15.8:0/3155048187 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7260023070 con 0x55705a1a7e20 2023-08-11T12:24:58.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.186+0000 7f72567fc700 1 -- 172.21.15.8:0/3155048187 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726001ea20 con 0x55705a1a7e20 2023-08-11T12:24:58.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.187+0000 7f7289521b80 1 -- 172.21.15.8:0/3155048187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55705a1a7e20 msgr2=0x55705a1a78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:58.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.187+0000 7f7289521b80 1 --2- 172.21.15.8:0/3155048187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55705a1a7e20 0x55705a1a78e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7260004690 tx=0x7f726001fc10 comp rx=0 tx=0).stop 2023-08-11T12:24:58.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.187+0000 7f7289521b80 1 -- 172.21.15.8:0/3155048187 shutdown_connections 2023-08-11T12:24:58.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.187+0000 7f7289521b80 1 --2- 172.21.15.8:0/3155048187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55705a1adc30 0x55705a1ae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.187+0000 7f7289521b80 1 --2- 172.21.15.8:0/3155048187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55705a1a7e20 0x55705a1a78e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.187+0000 7f7289521b80 1 --2- 172.21.15.8:0/3155048187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55705a1ad310 0x55705a1b8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.187+0000 7f7289521b80 1 -- 172.21.15.8:0/3155048187 >> 172.21.15.8:0/3155048187 conn(0x55705a0d4950 msgr2=0x55705a1ae010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:58.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.187+0000 7f7289521b80 1 -- 172.21.15.8:0/3155048187 shutdown_connections 2023-08-11T12:24:58.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.187+0000 7f7289521b80 1 -- 172.21.15.8:0/3155048187 wait complete. 2023-08-11T12:24:58.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.187+0000 7f7289521b80 1 -- start start 2023-08-11T12:24:58.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.188+0000 7f7289521b80 1 Processor -- start 2023-08-11T12:24:58.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.188+0000 7f7289521b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55705a1a7e20 0x55705a1b6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.188+0000 7f7289521b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55705a1ad310 0x55705a1b68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.188+0000 7f7289521b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55705a1adc30 0x55705a213630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.188+0000 7f7289521b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55705a1b70c0 con 0x55705a1adc30 2023-08-11T12:24:58.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.188+0000 7f7289521b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55705a1b7230 con 0x55705a1ad310 2023-08-11T12:24:58.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.188+0000 7f7289521b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55705a213bf0 con 0x55705a1a7e20 2023-08-11T12:24:58.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.188+0000 7f7289521b80 10 client.0 _ll_register_callbacks cb 0x7f7264099960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:58.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.188+0000 7f726ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55705a1adc30 0x55705a213630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.188+0000 7f726f7fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55705a1a7e20 0x55705a1b6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.189+0000 7f726f7fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55705a1a7e20 0x55705a1b6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:38014/0 (socket says 172.21.15.8:38014) 2023-08-11T12:24:58.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.189+0000 7f726effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55705a1ad310 0x55705a1b68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.189+0000 7f726f7fe700 1 -- 172.21.15.8:0/3413968985 learned_addr learned my addr 172.21.15.8:0/3413968985 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:58.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.189+0000 7f726effd700 1 -- 172.21.15.8:0/3413968985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55705a1a7e20 msgr2=0x55705a1b6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:58.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.189+0000 7f726effd700 1 --2- 172.21.15.8:0/3413968985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55705a1a7e20 0x55705a1b6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.189+0000 7f726effd700 1 -- 172.21.15.8:0/3413968985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55705a1adc30 msgr2=0x55705a213630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:58.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.189+0000 7f726effd700 1 --2- 172.21.15.8:0/3413968985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55705a1adc30 0x55705a213630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.189+0000 7f726effd700 1 -- 172.21.15.8:0/3413968985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7264063070 con 0x55705a1ad310 2023-08-11T12:24:58.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.189+0000 7f726f7fe700 1 --2- 172.21.15.8:0/3413968985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55705a1a7e20 0x55705a1b6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:58.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.189+0000 7f726effd700 1 --2- 172.21.15.8:0/3413968985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55705a1ad310 0x55705a1b68c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7264096090 tx=0x7f7264099290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df8c286ad735e5b9 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:58.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.189+0000 7f724effd700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:24:58.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.189+0000 7f724effd700 1 -- 172.21.15.8:0/3413968985 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72640b1ea0 con 0x55705a1ad310 2023-08-11T12:24:58.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.189+0000 7f7289521b80 1 -- 172.21.15.8:0/3413968985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7264099b90 con 0x55705a1ad310 2023-08-11T12:24:58.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.189+0000 7f724effd700 1 -- 172.21.15.8:0/3413968985 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f72640a1910 con 0x55705a1ad310 2023-08-11T12:24:58.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.190+0000 7f724effd700 1 -- 172.21.15.8:0/3413968985 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7264005470 con 0x55705a1ad310 2023-08-11T12:24:58.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.190+0000 7f7289521b80 10 client.25778 fetch_fsmap learned FSMap version 28 2023-08-11T12:24:58.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.190+0000 7f7289521b80 1 -- 172.21.15.8:0/3413968985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f72600105b0 con 0x55705a1ad310 2023-08-11T12:24:58.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.190+0000 7f724effd700 1 -- 172.21.15.8:0/3413968985 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7264099b90 con 0x55705a1ad310 2023-08-11T12:24:58.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.190+0000 7f724effd700 1 -- 172.21.15.8:0/3413968985 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f72640c9ea0 con 0x55705a1ad310 2023-08-11T12:24:58.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.190+0000 7f7289521b80 10 client.25778 fetch_fsmap finished waiting for FSMap version 28 2023-08-11T12:24:58.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.190+0000 7f7289521b80 10 client.25778 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-08-11T12:24:58.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.190+0000 7f7289521b80 20 client.25778 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:58.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.190+0000 7f7289521b80 1 --2- 172.21.15.8:0/3413968985 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x55705a214ea0 0x55705a2172c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.190+0000 7f7289521b80 4 client.25778 mds_command: new command op to 24550 tid=0[{"prefix": "damage ls"}] 2023-08-11T12:24:58.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.190+0000 7f7289521b80 1 -- 172.21.15.8:0/3413968985 --> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55705a0f2820 con 0x55705a214ea0 2023-08-11T12:24:58.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.191+0000 7f726f7fe700 1 --2- 172.21.15.8:0/3413968985 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x55705a214ea0 0x55705a2172c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.191+0000 7f726f7fe700 1 --2- 172.21.15.8:0/3413968985 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x55705a214ea0 0x55705a2172c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ca861c3d2b3dd4b server_cookie=c155fead64317bcf in_seq=0 out_seq=0 2023-08-11T12:24:58.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.191+0000 7f724effd700 10 client.25778 ms_handle_connect on v2:172.21.15.194:6838/2174476491 2023-08-11T12:24:58.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.191+0000 7f724effd700 1 -- 172.21.15.8:0/3413968985 <== mds.1 v2:172.21.15.194:6838/2174476491 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55705a0f2820 con 0x55705a214ea0 2023-08-11T12:24:58.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.191+0000 7f724effd700 10 client.25778 handle_command_reply: tid=0 2023-08-11T12:24:58.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.191+0000 7f7289521b80 1 client.25778 shutdown 2023-08-11T12:24:58.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.192+0000 7f7289521b80 1 -- 172.21.15.8:0/3413968985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55705a1ad310 msgr2=0x55705a1b68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:58.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.192+0000 7f7289521b80 1 --2- 172.21.15.8:0/3413968985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55705a1ad310 0x55705a1b68c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7264096090 tx=0x7f7264099290 comp rx=0 tx=0).stop 2023-08-11T12:24:58.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.192+0000 7f7289521b80 1 -- 172.21.15.8:0/3413968985 shutdown_connections 2023-08-11T12:24:58.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.192+0000 7f7289521b80 1 --2- 172.21.15.8:0/3413968985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55705a1a7e20 0x55705a1b6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.192+0000 7f7289521b80 1 --2- 172.21.15.8:0/3413968985 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x55705a214ea0 0x55705a2172c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.192+0000 7f7289521b80 1 --2- 172.21.15.8:0/3413968985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55705a1adc30 0x55705a213630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.192+0000 7f7289521b80 1 --2- 172.21.15.8:0/3413968985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55705a1ad310 0x55705a1b68c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.192+0000 7f724effd700 0 client.25778 ms_handle_reset on v2:172.21.15.194:6838/2174476491 2023-08-11T12:24:58.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.192+0000 7f7289521b80 1 -- 172.21.15.8:0/3413968985 >> 172.21.15.8:0/3413968985 conn(0x55705a0d4950 msgr2=0x55705a1bca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:58.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.192+0000 7f7289521b80 1 -- 172.21.15.8:0/3413968985 shutdown_connections 2023-08-11T12:24:58.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.192+0000 7f7289521b80 1 -- 172.21.15.8:0/3413968985 wait complete. 2023-08-11T12:24:58.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.192+0000 7f7289521b80 20 client.25778 trim_cache size 0 max 16384 2023-08-11T12:24:58.203 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-08-11T12:24:58.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.192+0000 7f7275bff700 1 -- 172.21.15.8:0/1546070176 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f72580a0150 msgr2=0x7f72580a2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:58.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.192+0000 7f7275bff700 1 --2- 172.21.15.8:0/1546070176 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f72580a0150 0x7f72580a2610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7268009fd0 tx=0x7f726800b040 comp rx=0 tx=0).stop 2023-08-11T12:24:58.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.192+0000 7f7275bff700 1 -- 172.21.15.8:0/1546070176 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72701000f0 msgr2=0x7f7270199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:58.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.192+0000 7f7275bff700 1 --2- 172.21.15.8:0/1546070176 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72701000f0 0x7f7270199310 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7264009810 tx=0x7f726400fa00 comp rx=0 tx=0).stop 2023-08-11T12:24:58.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.193+0000 7f7275bff700 1 -- 172.21.15.8:0/1546070176 shutdown_connections 2023-08-11T12:24:58.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.193+0000 7f7275bff700 1 --2- 172.21.15.8:0/1546070176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f727010d2f0 0x7f727019d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.193+0000 7f7275bff700 1 --2- 172.21.15.8:0/1546070176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72700ff740 0x7f7270198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.193+0000 7f7275bff700 1 --2- 172.21.15.8:0/1546070176 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f72580a0150 0x7f72580a2610 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.193+0000 7f7275bff700 1 --2- 172.21.15.8:0/1546070176 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72701000f0 0x7f7270199310 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.193+0000 7f7275bff700 1 -- 172.21.15.8:0/1546070176 >> 172.21.15.8:0/1546070176 conn(0x7f7270076a30 msgr2=0x7f727010e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:58.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.193+0000 7f7275bff700 1 -- 172.21.15.8:0/1546070176 shutdown_connections 2023-08-11T12:24:58.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.193+0000 7f7275bff700 1 -- 172.21.15.8:0/1546070176 wait complete. 2023-08-11T12:24:58.223 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-08-11T12:24:58.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.448+0000 7ff305fff700 1 -- 172.21.15.8:0/2093856530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff300072d50 msgr2=0x7ff300073130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:58.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.448+0000 7ff305fff700 1 --2- 172.21.15.8:0/2093856530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff300072d50 0x7ff300073130 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009990 tx=0x7ff2f0009ca0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.448+0000 7ff305fff700 1 -- 172.21.15.8:0/2093856530 shutdown_connections 2023-08-11T12:24:58.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.448+0000 7ff305fff700 1 --2- 172.21.15.8:0/2093856530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff300072d50 0x7ff300073130 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.448+0000 7ff305fff700 1 --2- 172.21.15.8:0/2093856530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff30010d1a0 0x7ff30010f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.448+0000 7ff305fff700 1 --2- 172.21.15.8:0/2093856530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff300073670 0x7ff30010cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.448+0000 7ff305fff700 1 -- 172.21.15.8:0/2093856530 >> 172.21.15.8:0/2093856530 conn(0x7ff3000fc490 msgr2=0x7ff3000fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:58.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.448+0000 7ff305fff700 1 -- 172.21.15.8:0/2093856530 shutdown_connections 2023-08-11T12:24:58.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.448+0000 7ff305fff700 1 -- 172.21.15.8:0/2093856530 wait complete. 2023-08-11T12:24:58.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.450+0000 7ff305fff700 1 Processor -- start 2023-08-11T12:24:58.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.450+0000 7ff305fff700 1 -- start start 2023-08-11T12:24:58.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.451+0000 7ff305fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff300072d50 0x7ff300198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.451+0000 7ff305fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff300073670 0x7ff3001991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.451+0000 7ff305fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff30010d1a0 0x7ff30019c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.451+0000 7ff305fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30019cba0 con 0x7ff300072d50 2023-08-11T12:24:58.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.451+0000 7ff305fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30019cd10 con 0x7ff300073670 2023-08-11T12:24:58.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.451+0000 7ff305fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30019ced0 con 0x7ff30010d1a0 2023-08-11T12:24:58.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.451+0000 7ff2ff7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff300072d50 0x7ff300198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.451+0000 7ff2feffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff300073670 0x7ff3001991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.451+0000 7ff2ff7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff300072d50 0x7ff300198cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52308/0 (socket says 172.21.15.8:52308) 2023-08-11T12:24:58.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.451+0000 7ff2ff7fe700 1 -- 172.21.15.8:0/3364654836 learned_addr learned my addr 172.21.15.8:0/3364654836 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:58.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.451+0000 7ff2fffff700 1 --2- 172.21.15.8:0/3364654836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff30010d1a0 0x7ff30019c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.452+0000 7ff2feffd700 1 -- 172.21.15.8:0/3364654836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff30010d1a0 msgr2=0x7ff30019c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:58.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.452+0000 7ff2feffd700 1 --2- 172.21.15.8:0/3364654836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff30010d1a0 0x7ff30019c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.452+0000 7ff2feffd700 1 -- 172.21.15.8:0/3364654836 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff300072d50 msgr2=0x7ff300198cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:58.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.452+0000 7ff2feffd700 1 --2- 172.21.15.8:0/3364654836 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff300072d50 0x7ff300198cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.452+0000 7ff2feffd700 1 -- 172.21.15.8:0/3364654836 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f00095f0 con 0x7ff300073670 2023-08-11T12:24:58.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.452+0000 7ff2ff7fe700 1 --2- 172.21.15.8:0/3364654836 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff300072d50 0x7ff300198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:58.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.452+0000 7ff2feffd700 1 --2- 172.21.15.8:0/3364654836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff300073670 0x7ff3001991f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400e9f0 tx=0x7ff2f400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:58.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.452+0000 7ff2fcff9700 1 -- 172.21.15.8:0/3364654836 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f400c9c0 con 0x7ff300073670 2023-08-11T12:24:58.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.452+0000 7ff305fff700 1 -- 172.21.15.8:0/3364654836 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff30019d1b0 con 0x7ff300073670 2023-08-11T12:24:58.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.452+0000 7ff2fcff9700 1 -- 172.21.15.8:0/3364654836 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff2f4010430 con 0x7ff300073670 2023-08-11T12:24:58.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.452+0000 7ff2fcff9700 1 -- 172.21.15.8:0/3364654836 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4018680 con 0x7ff300073670 2023-08-11T12:24:58.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.452+0000 7ff305fff700 1 -- 172.21.15.8:0/3364654836 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3001a5b10 con 0x7ff300073670 2023-08-11T12:24:58.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.456+0000 7ff2fcff9700 1 -- 172.21.15.8:0/3364654836 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) v1 ==== 134846+0+0 (secure 0 0 0) 0x7ff2f4010860 con 0x7ff300073670 2023-08-11T12:24:58.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.457+0000 7ff3199c9b80 1 Processor -- start 2023-08-11T12:24:58.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.458+0000 7ff3199c9b80 1 -- start start 2023-08-11T12:24:58.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.458+0000 7ff3199c9b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565d8d97310 0x5565d8d976f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.458+0000 7ff3199c9b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565d8d97c30 0x5565d8d918e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.458+0000 7ff3199c9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565d8d91e20 0x5565d8d92260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.458+0000 7ff3199c9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565d8cea630 con 0x5565d8d91e20 2023-08-11T12:24:58.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.458+0000 7ff3199c9b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565d8ce7f50 con 0x5565d8d97310 2023-08-11T12:24:58.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.458+0000 7ff2fcff9700 1 --2- 172.21.15.8:0/3364654836 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff2e80a0150 0x7ff2e80a2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.458+0000 7ff3199c9b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565d8ce3840 con 0x5565d8d97c30 2023-08-11T12:24:58.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.458+0000 7ff2fcff9700 1 -- 172.21.15.8:0/3364654836 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7ff2f4014070 con 0x7ff300073670 2023-08-11T12:24:58.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.458+0000 7ff2fffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565d8d97310 0x5565d8d976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.459+0000 7ff2ff7fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565d8d97c30 0x5565d8d918e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.459+0000 7ff2fffff700 1 --2- 172.21.15.8:0/3364654836 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff2e80a0150 0x7ff2e80a2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.459+0000 7ff2ff7fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565d8d97c30 0x5565d8d918e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:38046/0 (socket says 172.21.15.8:38046) 2023-08-11T12:24:58.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.459+0000 7ff2ff7fe700 1 -- 172.21.15.8:0/253843214 learned_addr learned my addr 172.21.15.8:0/253843214 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:58.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.459+0000 7ff2feffd700 1 --2- 172.21.15.8:0/253843214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565d8d91e20 0x5565d8d92260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.459+0000 7ff2ff7fe700 1 -- 172.21.15.8:0/253843214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565d8d97310 msgr2=0x5565d8d976f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:58.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.459+0000 7ff2ff7fe700 1 --2- 172.21.15.8:0/253843214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565d8d97310 0x5565d8d976f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.459+0000 7ff2ff7fe700 1 -- 172.21.15.8:0/253843214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565d8d91e20 msgr2=0x5565d8d92260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:58.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.459+0000 7ff2ff7fe700 1 --2- 172.21.15.8:0/253843214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565d8d91e20 0x5565d8d92260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.459+0000 7ff2ff7fe700 1 -- 172.21.15.8:0/253843214 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565d8b63630 con 0x5565d8d97c30 2023-08-11T12:24:58.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.459+0000 7ff2ff7fe700 1 --2- 172.21.15.8:0/253843214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565d8d97c30 0x5565d8d918e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff2f000b640 tx=0x7ff2f000b670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e9a8b110dd9ee8 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:58.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.459+0000 7ff2fffff700 1 --2- 172.21.15.8:0/3364654836 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff2e80a0150 0x7ff2e80a2610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8009550 tx=0x7ff2f800b040 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:58.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.460+0000 7ff2e5ffb700 1 -- 172.21.15.8:0/253843214 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f001d070 con 0x5565d8d97c30 2023-08-11T12:24:58.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.460+0000 7ff2e5ffb700 1 -- 172.21.15.8:0/253843214 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff2f001e040 con 0x5565d8d97c30 2023-08-11T12:24:58.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.460+0000 7ff2e5ffb700 1 -- 172.21.15.8:0/253843214 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0004e00 con 0x5565d8d97c30 2023-08-11T12:24:58.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.460+0000 7ff3199c9b80 1 -- 172.21.15.8:0/253843214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565d8d97c30 msgr2=0x5565d8d918e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:58.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.460+0000 7ff3199c9b80 1 --2- 172.21.15.8:0/253843214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565d8d97c30 0x5565d8d918e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff2f000b640 tx=0x7ff2f000b670 comp rx=0 tx=0).stop 2023-08-11T12:24:58.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.460+0000 7ff3199c9b80 1 -- 172.21.15.8:0/253843214 shutdown_connections 2023-08-11T12:24:58.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.460+0000 7ff3199c9b80 1 --2- 172.21.15.8:0/253843214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565d8d91e20 0x5565d8d92260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.461+0000 7ff3199c9b80 1 --2- 172.21.15.8:0/253843214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565d8d97310 0x5565d8d976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.461+0000 7ff3199c9b80 1 --2- 172.21.15.8:0/253843214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565d8d97c30 0x5565d8d918e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.461+0000 7ff3199c9b80 1 -- 172.21.15.8:0/253843214 >> 172.21.15.8:0/253843214 conn(0x5565d8cbe950 msgr2=0x5565d8d8c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:58.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.461+0000 7ff3199c9b80 1 -- 172.21.15.8:0/253843214 shutdown_connections 2023-08-11T12:24:58.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.461+0000 7ff3199c9b80 1 -- 172.21.15.8:0/253843214 wait complete. 2023-08-11T12:24:58.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.461+0000 7ff3199c9b80 1 -- start start 2023-08-11T12:24:58.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.462+0000 7ff3199c9b80 1 Processor -- start 2023-08-11T12:24:58.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.462+0000 7ff3199c9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565d8d91e20 0x5565d8d9db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.462+0000 7ff3199c9b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565d8d97310 0x5565d8d9ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.462+0000 7ff3199c9b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565d8d97c30 0x5565d8d9b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.462+0000 7ff3199c9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565d8c81ac0 con 0x5565d8d91e20 2023-08-11T12:24:58.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.462+0000 7ff3199c9b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565d8c817c0 con 0x5565d8d97310 2023-08-11T12:24:58.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.462+0000 7ff3199c9b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565d8b65920 con 0x5565d8d97c30 2023-08-11T12:24:58.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.463+0000 7ff3199c9b80 10 client.0 _ll_register_callbacks cb 0x5565d8c84ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:58.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.463+0000 7ff2fffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565d8d97c30 0x5565d8d9b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.463+0000 7ff2feffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565d8d97310 0x5565d8d9ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.463+0000 7ff2ff7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565d8d91e20 0x5565d8d9db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.463+0000 7ff2fffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565d8d97c30 0x5565d8d9b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:38050/0 (socket says 172.21.15.8:38050) 2023-08-11T12:24:58.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.463+0000 7ff2fffff700 1 -- 172.21.15.8:0/2030315970 learned_addr learned my addr 172.21.15.8:0/2030315970 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:58.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.463+0000 7ff2feffd700 1 -- 172.21.15.8:0/2030315970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565d8d97c30 msgr2=0x5565d8d9b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:58.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.463+0000 7ff2feffd700 1 --2- 172.21.15.8:0/2030315970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565d8d97c30 0x5565d8d9b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.463+0000 7ff2feffd700 1 -- 172.21.15.8:0/2030315970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565d8d91e20 msgr2=0x5565d8d9db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:58.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.463+0000 7ff2feffd700 1 --2- 172.21.15.8:0/2030315970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565d8d91e20 0x5565d8d9db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.463+0000 7ff2feffd700 1 -- 172.21.15.8:0/2030315970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3001102d0 con 0x5565d8d97310 2023-08-11T12:24:58.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.463+0000 7ff2fffff700 1 --2- 172.21.15.8:0/2030315970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565d8d97c30 0x5565d8d9b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:58.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.464+0000 7ff2feffd700 1 --2- 172.21.15.8:0/2030315970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565d8d97310 0x5565d8d9ae30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40c8f90 tx=0x7ff2f40074a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21f4e6a8a2d38c56 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:58.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.464+0000 7ff2deffd700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:24:58.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.464+0000 7ff2deffd700 1 -- 172.21.15.8:0/2030315970 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4014bf0 con 0x5565d8d97310 2023-08-11T12:24:58.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.464+0000 7ff3199c9b80 1 -- 172.21.15.8:0/2030315970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5565d8d84a90 con 0x5565d8d97310 2023-08-11T12:24:58.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.464+0000 7ff2deffd700 1 -- 172.21.15.8:0/2030315970 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7ff2f4098ea0 con 0x5565d8d97310 2023-08-11T12:24:58.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.464+0000 7ff2deffd700 1 -- 172.21.15.8:0/2030315970 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2f409ccd0 con 0x5565d8d97310 2023-08-11T12:24:58.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.464+0000 7ff3199c9b80 10 client.25790 fetch_fsmap learned FSMap version 28 2023-08-11T12:24:58.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.464+0000 7ff3199c9b80 1 -- 172.21.15.8:0/2030315970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5565d8b0fde0 con 0x5565d8d97310 2023-08-11T12:24:58.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.464+0000 7ff2deffd700 1 -- 172.21.15.8:0/2030315970 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5565d8d84a90 con 0x5565d8d97310 2023-08-11T12:24:58.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.464+0000 7ff2deffd700 1 -- 172.21.15.8:0/2030315970 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7894+0+0 (secure 0 0 0) 0x7ff2f40b81b0 con 0x5565d8d97310 2023-08-11T12:24:58.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.464+0000 7ff3199c9b80 10 client.25790 fetch_fsmap finished waiting for FSMap version 28 2023-08-11T12:24:58.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.464+0000 7ff3199c9b80 10 client.25790 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:24:58.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.465+0000 7ff3199c9b80 20 client.25790 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:58.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.465+0000 7ff3199c9b80 1 --2- 172.21.15.8:0/2030315970 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5565d8dab470 0x5565d8dad890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.465+0000 7ff3199c9b80 4 client.25790 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:24:58.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.465+0000 7ff3199c9b80 1 -- 172.21.15.8:0/2030315970 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5565d8d604e0 con 0x5565d8dab470 2023-08-11T12:24:58.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.465+0000 7ff2ff7fe700 1 --2- 172.21.15.8:0/2030315970 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5565d8dab470 0x5565d8dad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.465+0000 7ff2ff7fe700 1 --2- 172.21.15.8:0/2030315970 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5565d8dab470 0x5565d8dad890 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f3c798179aad2d0 server_cookie=824dc83d77f5ab7b in_seq=0 out_seq=0 2023-08-11T12:24:58.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.465+0000 7ff2deffd700 10 client.25790 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:24:58.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.466+0000 7ff2deffd700 1 -- 172.21.15.8:0/2030315970 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5565d8d604e0 con 0x5565d8dab470 2023-08-11T12:24:58.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.466+0000 7ff2deffd700 10 client.25790 handle_command_reply: tid=0 2023-08-11T12:24:58.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.466+0000 7ff3199c9b80 1 client.25790 shutdown 2023-08-11T12:24:58.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.466+0000 7ff3199c9b80 1 -- 172.21.15.8:0/2030315970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565d8d97310 msgr2=0x5565d8d9ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:58.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.466+0000 7ff3199c9b80 1 --2- 172.21.15.8:0/2030315970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565d8d97310 0x5565d8d9ae30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40c8f90 tx=0x7ff2f40074a0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.466+0000 7ff3199c9b80 1 -- 172.21.15.8:0/2030315970 shutdown_connections 2023-08-11T12:24:58.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.466+0000 7ff3199c9b80 1 --2- 172.21.15.8:0/2030315970 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5565d8dab470 0x5565d8dad890 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.466+0000 7ff3199c9b80 1 --2- 172.21.15.8:0/2030315970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565d8d97c30 0x5565d8d9b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.466+0000 7ff3199c9b80 1 --2- 172.21.15.8:0/2030315970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565d8d91e20 0x5565d8d9db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.466+0000 7ff3199c9b80 1 --2- 172.21.15.8:0/2030315970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565d8d97310 0x5565d8d9ae30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.466+0000 7ff2deffd700 0 client.25790 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:24:58.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.466+0000 7ff3199c9b80 1 -- 172.21.15.8:0/2030315970 >> 172.21.15.8:0/2030315970 conn(0x5565d8cbe950 msgr2=0x5565d8d86cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:58.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.467+0000 7ff3199c9b80 1 -- 172.21.15.8:0/2030315970 shutdown_connections 2023-08-11T12:24:58.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.467+0000 7ff3199c9b80 1 -- 172.21.15.8:0/2030315970 wait complete. 2023-08-11T12:24:58.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.467+0000 7ff3199c9b80 20 client.25790 trim_cache size 0 max 16384 2023-08-11T12:24:58.488 INFO:teuthology.orchestra.run.smithi008.stderr:1100000 of 50000000 tuples (2%) done (elapsed 3.16 s, remaining 140.57 s) 2023-08-11T12:24:58.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.480+0000 7ff3199c9b80 1 Processor -- start 2023-08-11T12:24:58.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.480+0000 7ff3199c9b80 1 -- start start 2023-08-11T12:24:58.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.481+0000 7ff3199c9b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565d8d91e20 0x5565d8d918e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.481+0000 7ff3199c9b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565d8d97310 0x5565d8d9d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.481+0000 7ff3199c9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565d8d97c30 0x5565d8d9db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.481+0000 7ff3199c9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565d8d9e310 con 0x5565d8d97c30 2023-08-11T12:24:58.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.481+0000 7ff3199c9b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565d8d96f60 con 0x5565d8d91e20 2023-08-11T12:24:58.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.481+0000 7ff3199c9b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565d8d8d2b0 con 0x5565d8d97310 2023-08-11T12:24:58.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.481+0000 7ff2fffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565d8d97c30 0x5565d8d9db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.481+0000 7ff2ff7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565d8d91e20 0x5565d8d918e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.481+0000 7ff2fffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565d8d97c30 0x5565d8d9db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52332/0 (socket says 172.21.15.8:52332) 2023-08-11T12:24:58.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.481+0000 7ff2fffff700 1 -- 172.21.15.8:0/864910756 learned_addr learned my addr 172.21.15.8:0/864910756 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:58.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.481+0000 7ff2feffd700 1 --2- 172.21.15.8:0/864910756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565d8d97310 0x5565d8d9d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.482+0000 7ff2fffff700 1 -- 172.21.15.8:0/864910756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565d8d97310 msgr2=0x5565d8d9d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:58.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.482+0000 7ff2fffff700 1 --2- 172.21.15.8:0/864910756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565d8d97310 0x5565d8d9d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.482+0000 7ff2fffff700 1 -- 172.21.15.8:0/864910756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565d8d91e20 msgr2=0x5565d8d918e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:58.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.482+0000 7ff2fffff700 1 --2- 172.21.15.8:0/864910756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565d8d91e20 0x5565d8d918e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.482+0000 7ff2fffff700 1 -- 172.21.15.8:0/864910756 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565d8af8c60 con 0x5565d8d97c30 2023-08-11T12:24:58.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.482+0000 7ff2feffd700 1 --2- 172.21.15.8:0/864910756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565d8d97310 0x5565d8d9d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:58.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.482+0000 7ff2ff7fe700 1 --2- 172.21.15.8:0/864910756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565d8d91e20 0x5565d8d918e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:58.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.482+0000 7ff2fffff700 1 --2- 172.21.15.8:0/864910756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565d8d97c30 0x5565d8d9db80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8008fe0 tx=0x7ff2f8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcab549c75d5fd94 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:58.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.482+0000 7ff2e67fc700 1 -- 172.21.15.8:0/864910756 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8020050 con 0x5565d8d97c30 2023-08-11T12:24:58.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.482+0000 7ff2e67fc700 1 -- 172.21.15.8:0/864910756 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff2f8021040 con 0x5565d8d97c30 2023-08-11T12:24:58.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.482+0000 7ff2e67fc700 1 -- 172.21.15.8:0/864910756 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f800e040 con 0x5565d8d97c30 2023-08-11T12:24:58.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.483+0000 7ff3199c9b80 1 -- 172.21.15.8:0/864910756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565d8d97c30 msgr2=0x5565d8d9db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:58.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.483+0000 7ff3199c9b80 1 --2- 172.21.15.8:0/864910756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565d8d97c30 0x5565d8d9db80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8008fe0 tx=0x7ff2f8009920 comp rx=0 tx=0).stop 2023-08-11T12:24:58.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.483+0000 7ff3199c9b80 1 -- 172.21.15.8:0/864910756 shutdown_connections 2023-08-11T12:24:58.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.483+0000 7ff3199c9b80 1 --2- 172.21.15.8:0/864910756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565d8d97c30 0x5565d8d9db80 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.483+0000 7ff3199c9b80 1 --2- 172.21.15.8:0/864910756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565d8d91e20 0x5565d8d918e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.483+0000 7ff3199c9b80 1 --2- 172.21.15.8:0/864910756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565d8d97310 0x5565d8d9d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.483+0000 7ff3199c9b80 1 -- 172.21.15.8:0/864910756 >> 172.21.15.8:0/864910756 conn(0x5565d8cbe950 msgr2=0x5565d8d95060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:58.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.483+0000 7ff3199c9b80 1 -- 172.21.15.8:0/864910756 shutdown_connections 2023-08-11T12:24:58.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.483+0000 7ff3199c9b80 1 -- 172.21.15.8:0/864910756 wait complete. 2023-08-11T12:24:58.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.484+0000 7ff3199c9b80 1 -- start start 2023-08-11T12:24:58.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.484+0000 7ff3199c9b80 1 Processor -- start 2023-08-11T12:24:58.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.484+0000 7ff3199c9b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565d8d91e20 0x5565d8da0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.484+0000 7ff3199c9b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565d8d97310 0x5565d8da0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.484+0000 7ff3199c9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565d8d97c30 0x5565d8df8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.484+0000 7ff3199c9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565d8df86a0 con 0x5565d8d97c30 2023-08-11T12:24:58.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.484+0000 7ff3199c9b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565d8df87e0 con 0x5565d8d97310 2023-08-11T12:24:58.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.484+0000 7ff3199c9b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565d8df89a0 con 0x5565d8d91e20 2023-08-11T12:24:58.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.484+0000 7ff3199c9b80 10 client.0 _ll_register_callbacks cb 0x7ff2f4098800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:58.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.485+0000 7ff2feffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565d8d97310 0x5565d8da0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.485+0000 7ff2feffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565d8d97310 0x5565d8da0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:59794/0 (socket says 172.21.15.8:59794) 2023-08-11T12:24:58.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.485+0000 7ff2feffd700 1 -- 172.21.15.8:0/2412160878 learned_addr learned my addr 172.21.15.8:0/2412160878 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:58.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.485+0000 7ff2ff7fe700 1 --2- 172.21.15.8:0/2412160878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565d8d91e20 0x5565d8da0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.485+0000 7ff2fffff700 1 --2- 172.21.15.8:0/2412160878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565d8d97c30 0x5565d8df8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.485+0000 7ff2feffd700 1 -- 172.21.15.8:0/2412160878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565d8d91e20 msgr2=0x5565d8da0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:58.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.485+0000 7ff2feffd700 1 --2- 172.21.15.8:0/2412160878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565d8d91e20 0x5565d8da0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.485+0000 7ff2feffd700 1 -- 172.21.15.8:0/2412160878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565d8d97c30 msgr2=0x5565d8df8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:58.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.485+0000 7ff2feffd700 1 --2- 172.21.15.8:0/2412160878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565d8d97c30 0x5565d8df8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.485+0000 7ff2feffd700 1 -- 172.21.15.8:0/2412160878 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5565d8b63630 con 0x5565d8d97310 2023-08-11T12:24:58.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.485+0000 7ff2fffff700 1 --2- 172.21.15.8:0/2412160878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565d8d97c30 0x5565d8df8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:24:58.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.485+0000 7ff2ff7fe700 1 --2- 172.21.15.8:0/2412160878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565d8d91e20 0x5565d8da0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:58.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.485+0000 7ff2feffd700 1 --2- 172.21.15.8:0/2412160878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565d8d97310 0x5565d8da0ca0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4095910 tx=0x7ff2f4007510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4670b47a0924387 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:58.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.485+0000 7ff2deffd700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:24:58.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.486+0000 7ff2deffd700 1 -- 172.21.15.8:0/2412160878 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f40b82d0 con 0x5565d8d97310 2023-08-11T12:24:58.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.486+0000 7ff2deffd700 1 -- 172.21.15.8:0/2412160878 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7ff2f4098ea0 con 0x5565d8d97310 2023-08-11T12:24:58.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.486+0000 7ff3199c9b80 1 -- 172.21.15.8:0/2412160878 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff2f001e040 con 0x5565d8d97310 2023-08-11T12:24:58.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.486+0000 7ff2deffd700 1 -- 172.21.15.8:0/2412160878 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2f409ccd0 con 0x5565d8d97310 2023-08-11T12:24:58.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.486+0000 7ff3199c9b80 10 client.25796 fetch_fsmap learned FSMap version 28 2023-08-11T12:24:58.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.486+0000 7ff3199c9b80 1 -- 172.21.15.8:0/2412160878 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5565d8b0fde0 con 0x5565d8d97310 2023-08-11T12:24:58.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.486+0000 7ff2deffd700 1 -- 172.21.15.8:0/2412160878 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff2f001e040 con 0x5565d8d97310 2023-08-11T12:24:58.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.486+0000 7ff2deffd700 1 -- 172.21.15.8:0/2412160878 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7894+0+0 (secure 0 0 0) 0x7ff2f40c9240 con 0x5565d8d97310 2023-08-11T12:24:58.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.486+0000 7ff3199c9b80 10 client.25796 fetch_fsmap finished waiting for FSMap version 28 2023-08-11T12:24:58.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.486+0000 7ff3199c9b80 10 client.25796 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:24:58.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.486+0000 7ff3199c9b80 20 client.25796 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:58.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.486+0000 7ff3199c9b80 1 --2- 172.21.15.8:0/2412160878 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5565d8dfff40 0x5565d8e02360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:58.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.486+0000 7ff3199c9b80 4 client.25796 mds_command: new command op to 24575 tid=0[{"prefix": "damage ls"}] 2023-08-11T12:24:58.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.486+0000 7ff3199c9b80 1 -- 172.21.15.8:0/2412160878 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5565d8cdc820 con 0x5565d8dfff40 2023-08-11T12:24:58.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.487+0000 7ff2ff7fe700 1 --2- 172.21.15.8:0/2412160878 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5565d8dfff40 0x5565d8e02360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:58.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.487+0000 7ff2ff7fe700 1 --2- 172.21.15.8:0/2412160878 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5565d8dfff40 0x5565d8e02360 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa8d6207c60c4174 server_cookie=5f66bc712621f5c4 in_seq=0 out_seq=0 2023-08-11T12:24:58.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.487+0000 7ff2deffd700 10 client.25796 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:24:58.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.487+0000 7ff2deffd700 1 -- 172.21.15.8:0/2412160878 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5565d8cdc820 con 0x5565d8dfff40 2023-08-11T12:24:58.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.487+0000 7ff2deffd700 10 client.25796 handle_command_reply: tid=0 2023-08-11T12:24:58.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.487+0000 7ff3199c9b80 1 client.25796 shutdown 2023-08-11T12:24:58.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.487+0000 7ff3199c9b80 1 -- 172.21.15.8:0/2412160878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565d8d97310 msgr2=0x5565d8da0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:58.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.487+0000 7ff3199c9b80 1 --2- 172.21.15.8:0/2412160878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565d8d97310 0x5565d8da0ca0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4095910 tx=0x7ff2f4007510 comp rx=0 tx=0).stop 2023-08-11T12:24:58.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.488+0000 7ff3199c9b80 1 -- 172.21.15.8:0/2412160878 shutdown_connections 2023-08-11T12:24:58.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.488+0000 7ff3199c9b80 1 --2- 172.21.15.8:0/2412160878 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5565d8dfff40 0x5565d8e02360 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.488+0000 7ff3199c9b80 1 --2- 172.21.15.8:0/2412160878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565d8d91e20 0x5565d8da0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.488+0000 7ff3199c9b80 1 --2- 172.21.15.8:0/2412160878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565d8d97c30 0x5565d8df8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.488+0000 7ff2deffd700 0 client.25796 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:24:58.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.488+0000 7ff3199c9b80 1 --2- 172.21.15.8:0/2412160878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565d8d97310 0x5565d8da0ca0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.488+0000 7ff3199c9b80 1 -- 172.21.15.8:0/2412160878 >> 172.21.15.8:0/2412160878 conn(0x5565d8cbe950 msgr2=0x5565d8d9a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:58.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.488+0000 7ff3199c9b80 1 -- 172.21.15.8:0/2412160878 shutdown_connections 2023-08-11T12:24:58.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.488+0000 7ff3199c9b80 1 -- 172.21.15.8:0/2412160878 wait complete. 2023-08-11T12:24:58.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.488+0000 7ff3199c9b80 20 client.25796 trim_cache size 0 max 16384 2023-08-11T12:24:58.517 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-08-11T12:24:58.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.488+0000 7ff305fff700 1 -- 172.21.15.8:0/3364654836 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff2e80a0150 msgr2=0x7ff2e80a2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:58.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.488+0000 7ff305fff700 1 --2- 172.21.15.8:0/3364654836 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff2e80a0150 0x7ff2e80a2610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8009550 tx=0x7ff2f800b040 comp rx=0 tx=0).stop 2023-08-11T12:24:58.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.488+0000 7ff305fff700 1 -- 172.21.15.8:0/3364654836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff300073670 msgr2=0x7ff3001991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:58.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.488+0000 7ff305fff700 1 --2- 172.21.15.8:0/3364654836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff300073670 0x7ff3001991f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400e9f0 tx=0x7ff2f400ed00 comp rx=0 tx=0).stop 2023-08-11T12:24:58.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.489+0000 7ff305fff700 1 -- 172.21.15.8:0/3364654836 shutdown_connections 2023-08-11T12:24:58.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.489+0000 7ff305fff700 1 --2- 172.21.15.8:0/3364654836 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff2e80a0150 0x7ff2e80a2610 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.489+0000 7ff305fff700 1 --2- 172.21.15.8:0/3364654836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff30010d1a0 0x7ff30019c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.489+0000 7ff305fff700 1 --2- 172.21.15.8:0/3364654836 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff300072d50 0x7ff300198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.489+0000 7ff305fff700 1 --2- 172.21.15.8:0/3364654836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff300073670 0x7ff3001991f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:58.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.489+0000 7ff305fff700 1 -- 172.21.15.8:0/3364654836 >> 172.21.15.8:0/3364654836 conn(0x7ff3000fc490 msgr2=0x7ff30010f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:58.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.489+0000 7ff305fff700 1 -- 172.21.15.8:0/3364654836 shutdown_connections 2023-08-11T12:24:58.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:58.489+0000 7ff305fff700 1 -- 172.21.15.8:0/3364654836 wait complete. 2023-08-11T12:24:58.691 INFO:teuthology.orchestra.run.smithi008.stderr:1200000 of 50000000 tuples (2%) done (elapsed 3.38 s, remaining 137.38 s) 2023-08-11T12:24:58.989 INFO:teuthology.orchestra.run.smithi008.stderr:1300000 of 50000000 tuples (2%) done (elapsed 3.68 s, remaining 137.73 s) 2023-08-11T12:24:59.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:58 smithi194 ceph-mon[130905]: pgmap v14: 129 pgs: 129 active+clean; 91 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 13 MiB/s wr, 420 op/s 2023-08-11T12:24:59.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:58 smithi194 ceph-mon[130905]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:24:59.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:58 smithi045 ceph-mon[130284]: pgmap v14: 129 pgs: 129 active+clean; 91 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 13 MiB/s wr, 420 op/s 2023-08-11T12:24:59.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:58 smithi045 ceph-mon[130284]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:24:59.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:58 smithi008 ceph-mon[97158]: pgmap v14: 129 pgs: 129 active+clean; 91 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 13 MiB/s wr, 420 op/s 2023-08-11T12:24:59.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:58 smithi008 ceph-mon[97158]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:24:59.336 INFO:teuthology.orchestra.run.smithi008.stderr:1400000 of 50000000 tuples (2%) done (elapsed 4.02 s, remaining 139.65 s) 2023-08-11T12:24:59.521 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-08-11T12:24:59.522 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-08-11T12:24:59.530 INFO:teuthology.orchestra.run.smithi008.stderr:1500000 of 50000000 tuples (3%) done (elapsed 4.22 s, remaining 136.36 s) 2023-08-11T12:24:59.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.742+0000 7fb4319ff700 1 -- 172.21.15.8:0/2717635790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb42c073670 msgr2=0x7fb42c10cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:59.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.742+0000 7fb4319ff700 1 --2- 172.21.15.8:0/2717635790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb42c073670 0x7fb42c10cc60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb420009990 tx=0x7fb420009ca0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.742+0000 7fb4319ff700 1 -- 172.21.15.8:0/2717635790 shutdown_connections 2023-08-11T12:24:59.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.742+0000 7fb4319ff700 1 --2- 172.21.15.8:0/2717635790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb42c10d1a0 0x7fb42c10f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.742+0000 7fb4319ff700 1 --2- 172.21.15.8:0/2717635790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb42c072d50 0x7fb42c073130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.742+0000 7fb4319ff700 1 --2- 172.21.15.8:0/2717635790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb42c073670 0x7fb42c10cc60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.742+0000 7fb4319ff700 1 -- 172.21.15.8:0/2717635790 >> 172.21.15.8:0/2717635790 conn(0x7fb42c0fc490 msgr2=0x7fb42c0fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:59.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.742+0000 7fb4319ff700 1 -- 172.21.15.8:0/2717635790 shutdown_connections 2023-08-11T12:24:59.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.742+0000 7fb4319ff700 1 -- 172.21.15.8:0/2717635790 wait complete. 2023-08-11T12:24:59.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.743+0000 7fb4319ff700 1 Processor -- start 2023-08-11T12:24:59.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.743+0000 7fb4319ff700 1 -- start start 2023-08-11T12:24:59.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.743+0000 7fb4319ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb42c072d50 0x7fb42c19e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:59.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.743+0000 7fb4319ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb42c073670 0x7fb42c19ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:59.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.743+0000 7fb4319ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb42c10d1a0 0x7fb42c198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:59.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.743+0000 7fb4319ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c1990d0 con 0x7fb42c072d50 2023-08-11T12:24:59.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.743+0000 7fb4319ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c199240 con 0x7fb42c073670 2023-08-11T12:24:59.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.743+0000 7fb4319ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c199400 con 0x7fb42c10d1a0 2023-08-11T12:24:59.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.744+0000 7fb42a7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb42c073670 0x7fb42c19ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:59.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.744+0000 7fb42a7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb42c073670 0x7fb42c19ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:59812/0 (socket says 172.21.15.8:59812) 2023-08-11T12:24:59.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.744+0000 7fb42a7fc700 1 -- 172.21.15.8:0/2433591077 learned_addr learned my addr 172.21.15.8:0/2433591077 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:59.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.744+0000 7fb42affd700 1 --2- 172.21.15.8:0/2433591077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb42c072d50 0x7fb42c19e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:59.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.744+0000 7fb42b7fe700 1 --2- 172.21.15.8:0/2433591077 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb42c10d1a0 0x7fb42c198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:59.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.744+0000 7fb42a7fc700 1 -- 172.21.15.8:0/2433591077 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb42c10d1a0 msgr2=0x7fb42c198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:59.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.744+0000 7fb42a7fc700 1 --2- 172.21.15.8:0/2433591077 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb42c10d1a0 0x7fb42c198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.744+0000 7fb42a7fc700 1 -- 172.21.15.8:0/2433591077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb42c072d50 msgr2=0x7fb42c19e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:59.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.744+0000 7fb42a7fc700 1 --2- 172.21.15.8:0/2433591077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb42c072d50 0x7fb42c19e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.744+0000 7fb42a7fc700 1 -- 172.21.15.8:0/2433591077 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4200095f0 con 0x7fb42c073670 2023-08-11T12:24:59.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.744+0000 7fb42a7fc700 1 --2- 172.21.15.8:0/2433591077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb42c073670 0x7fb42c19ef30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb420000c00 tx=0x7fb420004790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:59.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.745+0000 7fb4309fd700 1 -- 172.21.15.8:0/2433591077 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42001d070 con 0x7fb42c073670 2023-08-11T12:24:59.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.745+0000 7fb4309fd700 1 -- 172.21.15.8:0/2433591077 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb420021410 con 0x7fb42c073670 2023-08-11T12:24:59.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.745+0000 7fb4309fd700 1 -- 172.21.15.8:0/2433591077 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb420017650 con 0x7fb42c073670 2023-08-11T12:24:59.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.745+0000 7fb4319ff700 1 -- 172.21.15.8:0/2433591077 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb42c199680 con 0x7fb42c073670 2023-08-11T12:24:59.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.745+0000 7fb4319ff700 1 -- 172.21.15.8:0/2433591077 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb42c1a59e0 con 0x7fb42c073670 2023-08-11T12:24:59.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.748+0000 7fb4309fd700 1 -- 172.21.15.8:0/2433591077 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) v1 ==== 134846+0+0 (secure 0 0 0) 0x7fb420021580 con 0x7fb42c073670 2023-08-11T12:24:59.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.750+0000 7fb4452e2b80 1 Processor -- start 2023-08-11T12:24:59.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.750+0000 7fb4452e2b80 1 -- start start 2023-08-11T12:24:59.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.750+0000 7fb4452e2b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cef102b390 0x55cef102b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:59.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.750+0000 7fb4452e2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cef102bcb0 0x55cef1025960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:59.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.751+0000 7fb4452e2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cef1025ea0 0x55cef10262e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:59.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.751+0000 7fb4452e2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cef0f7e6b0 con 0x55cef1025ea0 2023-08-11T12:24:59.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.751+0000 7fb4452e2b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cef0f7bfd0 con 0x55cef102b390 2023-08-11T12:24:59.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.751+0000 7fb4452e2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cef0f778c0 con 0x55cef102bcb0 2023-08-11T12:24:59.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.751+0000 7fb42a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cef1025ea0 0x55cef10262e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:59.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.751+0000 7fb42b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cef102b390 0x55cef102b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:59.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.751+0000 7fb42a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cef1025ea0 0x55cef10262e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52370/0 (socket says 172.21.15.8:52370) 2023-08-11T12:24:59.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.751+0000 7fb42a7fc700 1 -- 172.21.15.8:0/4174657914 learned_addr learned my addr 172.21.15.8:0/4174657914 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:59.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.751+0000 7fb4309fd700 1 --2- 172.21.15.8:0/2433591077 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb4140a01d0 0x7fb4140a2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:59.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.751+0000 7fb42affd700 1 --2- 172.21.15.8:0/4174657914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cef102bcb0 0x55cef1025960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:59.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.751+0000 7fb42b7fe700 1 --2- 172.21.15.8:0/2433591077 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb4140a01d0 0x7fb4140a2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:59.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.752+0000 7fb4309fd700 1 -- 172.21.15.8:0/2433591077 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fb4200ccd20 con 0x7fb42c073670 2023-08-11T12:24:59.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.752+0000 7fb42a7fc700 1 -- 172.21.15.8:0/4174657914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cef102bcb0 msgr2=0x55cef1025960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:59.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.752+0000 7fb42a7fc700 1 --2- 172.21.15.8:0/4174657914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cef102bcb0 0x55cef1025960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.752+0000 7fb42a7fc700 1 -- 172.21.15.8:0/4174657914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cef102b390 msgr2=0x55cef102b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:59.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.752+0000 7fb42a7fc700 1 --2- 172.21.15.8:0/4174657914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cef102b390 0x55cef102b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.752+0000 7fb42a7fc700 1 -- 172.21.15.8:0/4174657914 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cef0df76b0 con 0x55cef1025ea0 2023-08-11T12:24:59.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.752+0000 7fb42affd700 1 --2- 172.21.15.8:0/4174657914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cef102bcb0 0x55cef1025960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:59.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.752+0000 7fb42b7fe700 1 --2- 172.21.15.8:0/4174657914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cef102b390 0x55cef102b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:59.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.752+0000 7fb42a7fc700 1 --2- 172.21.15.8:0/4174657914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cef1025ea0 0x55cef10262e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb420005910 tx=0x7fb420021c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1951eac040c19b server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:59.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.752+0000 7fb42b7fe700 1 --2- 172.21.15.8:0/2433591077 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb4140a01d0 0x7fb4140a2690 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb424009ec0 tx=0x7fb424004b40 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:59.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.752+0000 7fb411ffb700 1 -- 172.21.15.8:0/4174657914 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb420099b40 con 0x55cef1025ea0 2023-08-11T12:24:59.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.752+0000 7fb411ffb700 1 -- 172.21.15.8:0/4174657914 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb420099960 con 0x55cef1025ea0 2023-08-11T12:24:59.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.752+0000 7fb411ffb700 1 -- 172.21.15.8:0/4174657914 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4200ca510 con 0x55cef1025ea0 2023-08-11T12:24:59.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.753+0000 7fb4452e2b80 1 -- 172.21.15.8:0/4174657914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cef1025ea0 msgr2=0x55cef10262e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:59.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.753+0000 7fb4452e2b80 1 --2- 172.21.15.8:0/4174657914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cef1025ea0 0x55cef10262e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb420005910 tx=0x7fb420021c00 comp rx=0 tx=0).stop 2023-08-11T12:24:59.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.753+0000 7fb4452e2b80 1 -- 172.21.15.8:0/4174657914 shutdown_connections 2023-08-11T12:24:59.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.753+0000 7fb4452e2b80 1 --2- 172.21.15.8:0/4174657914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cef1025ea0 0x55cef10262e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.753+0000 7fb4452e2b80 1 --2- 172.21.15.8:0/4174657914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cef102b390 0x55cef102b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.753+0000 7fb4452e2b80 1 --2- 172.21.15.8:0/4174657914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cef102bcb0 0x55cef1025960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.753+0000 7fb4452e2b80 1 -- 172.21.15.8:0/4174657914 >> 172.21.15.8:0/4174657914 conn(0x55cef0f529d0 msgr2=0x55cef1020450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:59.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.754+0000 7fb4452e2b80 1 -- 172.21.15.8:0/4174657914 shutdown_connections 2023-08-11T12:24:59.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.754+0000 7fb4452e2b80 1 -- 172.21.15.8:0/4174657914 wait complete. 2023-08-11T12:24:59.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.755+0000 7fb4452e2b80 1 -- start start 2023-08-11T12:24:59.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.755+0000 7fb4452e2b80 1 Processor -- start 2023-08-11T12:24:59.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.756+0000 7fb4452e2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cef1025ea0 0x55cef1031a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:59.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.756+0000 7fb4452e2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cef102b390 0x55cef102ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:59.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.756+0000 7fb4452e2b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cef102bcb0 0x55cef102f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:59.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.756+0000 7fb4452e2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cef0f15b40 con 0x55cef1025ea0 2023-08-11T12:24:59.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.756+0000 7fb4452e2b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cef0f15840 con 0x55cef102bcb0 2023-08-11T12:24:59.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.756+0000 7fb4452e2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cef0df99a0 con 0x55cef102b390 2023-08-11T12:24:59.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.756+0000 7fb4452e2b80 10 client.0 _ll_register_callbacks cb 0x55cef0f18b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:59.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.756+0000 7fb42a7fc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cef102b390 0x55cef102ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:59.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.756+0000 7fb42a7fc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cef102b390 0x55cef102ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:38108/0 (socket says 172.21.15.8:38108) 2023-08-11T12:24:59.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.756+0000 7fb42a7fc700 1 -- 172.21.15.8:0/825336826 learned_addr learned my addr 172.21.15.8:0/825336826 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:59.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.756+0000 7fb42affd700 1 --2- 172.21.15.8:0/825336826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cef1025ea0 0x55cef1031a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:59.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.756+0000 7fb42b7fe700 1 --2- 172.21.15.8:0/825336826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cef102bcb0 0x55cef102f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:59.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.756+0000 7fb42a7fc700 1 -- 172.21.15.8:0/825336826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cef102bcb0 msgr2=0x55cef102f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:59.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.756+0000 7fb42a7fc700 1 --2- 172.21.15.8:0/825336826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cef102bcb0 0x55cef102f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.756+0000 7fb42a7fc700 1 -- 172.21.15.8:0/825336826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cef1025ea0 msgr2=0x55cef1031a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:59.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.756+0000 7fb42a7fc700 1 --2- 172.21.15.8:0/825336826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cef1025ea0 0x55cef1031a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.756+0000 7fb42a7fc700 1 -- 172.21.15.8:0/825336826 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb41c0098e0 con 0x55cef102b390 2023-08-11T12:24:59.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.757+0000 7fb42a7fc700 1 --2- 172.21.15.8:0/825336826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cef102b390 0x55cef102ed80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb4200a1850 tx=0x7fb42009a510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3f4bf73a2bb2dd9 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:59.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.757+0000 7fb40affd700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:24:59.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.757+0000 7fb40affd700 1 -- 172.21.15.8:0/825336826 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42009de30 con 0x55cef102b390 2023-08-11T12:24:59.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.757+0000 7fb40affd700 1 -- 172.21.15.8:0/825336826 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fb42009a000 con 0x55cef102b390 2023-08-11T12:24:59.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.757+0000 7fb4452e2b80 1 -- 172.21.15.8:0/825336826 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cef1018b10 con 0x55cef102b390 2023-08-11T12:24:59.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.757+0000 7fb40affd700 1 -- 172.21.15.8:0/825336826 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4200a1d80 con 0x55cef102b390 2023-08-11T12:24:59.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.757+0000 7fb4452e2b80 10 client.25819 fetch_fsmap learned FSMap version 29 2023-08-11T12:24:59.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.757+0000 7fb4452e2b80 1 -- 172.21.15.8:0/825336826 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7fb42c1a59e0 con 0x55cef102b390 2023-08-11T12:24:59.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.757+0000 7fb40affd700 1 -- 172.21.15.8:0/825336826 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cef1018b10 con 0x55cef102b390 2023-08-11T12:24:59.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.758+0000 7fb40affd700 1 -- 172.21.15.8:0/825336826 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fb4200a18f0 con 0x55cef102b390 2023-08-11T12:24:59.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.758+0000 7fb4452e2b80 10 client.25819 fetch_fsmap finished waiting for FSMap version 29 2023-08-11T12:24:59.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.758+0000 7fb4452e2b80 10 client.25819 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:24:59.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.758+0000 7fb4452e2b80 20 client.25819 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:59.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.758+0000 7fb4452e2b80 1 --2- 172.21.15.8:0/825336826 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55cef103ec80 0x55cef10410a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:59.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.758+0000 7fb4452e2b80 4 client.25819 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:24:59.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.758+0000 7fb4452e2b80 1 -- 172.21.15.8:0/825336826 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cef0ff4560 con 0x55cef103ec80 2023-08-11T12:24:59.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.758+0000 7fb42affd700 1 --2- 172.21.15.8:0/825336826 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55cef103ec80 0x55cef10410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:59.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.759+0000 7fb42affd700 1 --2- 172.21.15.8:0/825336826 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55cef103ec80 0x55cef10410a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cffc4938b86879a9 server_cookie=b359caee4acf799a in_seq=0 out_seq=0 2023-08-11T12:24:59.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.759+0000 7fb40affd700 10 client.25819 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:24:59.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.759+0000 7fb40affd700 1 -- 172.21.15.8:0/825336826 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55cef0ff4560 con 0x55cef103ec80 2023-08-11T12:24:59.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.759+0000 7fb40affd700 10 client.25819 handle_command_reply: tid=0 2023-08-11T12:24:59.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.759+0000 7fb4452e2b80 1 client.25819 shutdown 2023-08-11T12:24:59.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.760+0000 7fb4452e2b80 1 -- 172.21.15.8:0/825336826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cef102b390 msgr2=0x55cef102ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:59.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.760+0000 7fb4452e2b80 1 --2- 172.21.15.8:0/825336826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cef102b390 0x55cef102ed80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb4200a1850 tx=0x7fb42009a510 comp rx=0 tx=0).stop 2023-08-11T12:24:59.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.760+0000 7fb4452e2b80 1 -- 172.21.15.8:0/825336826 shutdown_connections 2023-08-11T12:24:59.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.760+0000 7fb4452e2b80 1 --2- 172.21.15.8:0/825336826 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55cef103ec80 0x55cef10410a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.760+0000 7fb4452e2b80 1 --2- 172.21.15.8:0/825336826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cef102bcb0 0x55cef102f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.760+0000 7fb4452e2b80 1 --2- 172.21.15.8:0/825336826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cef1025ea0 0x55cef1031a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.760+0000 7fb4452e2b80 1 --2- 172.21.15.8:0/825336826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cef102b390 0x55cef102ed80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.760+0000 7fb40affd700 0 client.25819 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:24:59.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.760+0000 7fb4452e2b80 1 -- 172.21.15.8:0/825336826 >> 172.21.15.8:0/825336826 conn(0x55cef0f529d0 msgr2=0x55cef101ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:59.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.760+0000 7fb4452e2b80 1 -- 172.21.15.8:0/825336826 shutdown_connections 2023-08-11T12:24:59.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.760+0000 7fb4452e2b80 1 -- 172.21.15.8:0/825336826 wait complete. 2023-08-11T12:24:59.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.760+0000 7fb4452e2b80 20 client.25819 trim_cache size 0 max 16384 2023-08-11T12:24:59.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.778+0000 7fb4452e2b80 1 Processor -- start 2023-08-11T12:24:59.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.778+0000 7fb4452e2b80 1 -- start start 2023-08-11T12:24:59.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.778+0000 7fb4452e2b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cef1025ea0 0x55cef1025960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:59.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.778+0000 7fb4452e2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cef102b390 0x55cef10363b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:59.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.778+0000 7fb4452e2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cef102bcb0 0x55cef1031520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:59.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.778+0000 7fb4452e2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cef1018af0 con 0x55cef102b390 2023-08-11T12:24:59.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.778+0000 7fb4452e2b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cef1029990 con 0x55cef1025ea0 2023-08-11T12:24:59.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.778+0000 7fb4452e2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cef1022440 con 0x55cef102bcb0 2023-08-11T12:24:59.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.779+0000 7fb42a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cef102b390 0x55cef10363b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:59.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.779+0000 7fb42affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cef1025ea0 0x55cef1025960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:59.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.779+0000 7fb42a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cef102b390 0x55cef10363b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52394/0 (socket says 172.21.15.8:52394) 2023-08-11T12:24:59.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.779+0000 7fb42a7fc700 1 -- 172.21.15.8:0/847989389 learned_addr learned my addr 172.21.15.8:0/847989389 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:59.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.779+0000 7fb42a7fc700 1 -- 172.21.15.8:0/847989389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cef102bcb0 msgr2=0x55cef1031520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:59.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.779+0000 7fb42b7fe700 1 --2- 172.21.15.8:0/847989389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cef102bcb0 0x55cef1031520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:59.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.779+0000 7fb42a7fc700 1 --2- 172.21.15.8:0/847989389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cef102bcb0 0x55cef1031520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.779+0000 7fb42a7fc700 1 -- 172.21.15.8:0/847989389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cef1025ea0 msgr2=0x55cef1025960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:59.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.779+0000 7fb42a7fc700 1 --2- 172.21.15.8:0/847989389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cef1025ea0 0x55cef1025960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.779+0000 7fb42a7fc700 1 -- 172.21.15.8:0/847989389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cef101a050 con 0x55cef102b390 2023-08-11T12:24:59.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.779+0000 7fb42affd700 1 --2- 172.21.15.8:0/847989389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cef1025ea0 0x55cef1025960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:24:59.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.779+0000 7fb42b7fe700 1 --2- 172.21.15.8:0/847989389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cef102bcb0 0x55cef1031520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:24:59.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.780+0000 7fb42a7fc700 1 --2- 172.21.15.8:0/847989389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cef102b390 0x55cef10363b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb420005910 tx=0x7fb4200b9500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61311ea43ae27358 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:59.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.780+0000 7fb4127fc700 1 -- 172.21.15.8:0/847989389 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4200a1d80 con 0x55cef102b390 2023-08-11T12:24:59.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.780+0000 7fb4127fc700 1 -- 172.21.15.8:0/847989389 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4200c9fa0 con 0x55cef102b390 2023-08-11T12:24:59.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.780+0000 7fb4127fc700 1 -- 172.21.15.8:0/847989389 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4200b9250 con 0x55cef102b390 2023-08-11T12:24:59.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.780+0000 7fb4452e2b80 1 -- 172.21.15.8:0/847989389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cef102b390 msgr2=0x55cef10363b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:59.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.781+0000 7fb4452e2b80 1 --2- 172.21.15.8:0/847989389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cef102b390 0x55cef10363b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb420005910 tx=0x7fb4200b9500 comp rx=0 tx=0).stop 2023-08-11T12:24:59.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.781+0000 7fb4452e2b80 1 -- 172.21.15.8:0/847989389 shutdown_connections 2023-08-11T12:24:59.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.781+0000 7fb4452e2b80 1 --2- 172.21.15.8:0/847989389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cef102bcb0 0x55cef1031520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.781+0000 7fb4452e2b80 1 --2- 172.21.15.8:0/847989389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cef1025ea0 0x55cef1025960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.781+0000 7fb4452e2b80 1 --2- 172.21.15.8:0/847989389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cef102b390 0x55cef10363b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.781+0000 7fb4452e2b80 1 -- 172.21.15.8:0/847989389 >> 172.21.15.8:0/847989389 conn(0x55cef0f529d0 msgr2=0x55cef102ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:59.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.781+0000 7fb4452e2b80 1 -- 172.21.15.8:0/847989389 shutdown_connections 2023-08-11T12:24:59.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.781+0000 7fb4452e2b80 1 -- 172.21.15.8:0/847989389 wait complete. 2023-08-11T12:24:59.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.781+0000 7fb4452e2b80 1 -- start start 2023-08-11T12:24:59.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.781+0000 7fb4452e2b80 1 Processor -- start 2023-08-11T12:24:59.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.782+0000 7fb4452e2b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cef1025ea0 0x55cef10363c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:59.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.782+0000 7fb4452e2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cef102b390 0x55cef10271e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:59.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.782+0000 7fb4452e2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cef102bcb0 0x55cef1027920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:59.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.782+0000 7fb4452e2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cef1028060 con 0x55cef102bcb0 2023-08-11T12:24:59.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.782+0000 7fb4452e2b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cef1092930 con 0x55cef1025ea0 2023-08-11T12:24:59.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.782+0000 7fb4452e2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cef1092a70 con 0x55cef102b390 2023-08-11T12:24:59.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.782+0000 7fb4452e2b80 10 client.0 _ll_register_callbacks cb 0x7fb424009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:24:59.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.782+0000 7fb42a7fc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cef102b390 0x55cef10271e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:59.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.782+0000 7fb42a7fc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cef102b390 0x55cef10271e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:38126/0 (socket says 172.21.15.8:38126) 2023-08-11T12:24:59.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.782+0000 7fb42affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cef1025ea0 0x55cef10363c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:59.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.782+0000 7fb42a7fc700 1 -- 172.21.15.8:0/4112087286 learned_addr learned my addr 172.21.15.8:0/4112087286 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:24:59.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.783+0000 7fb42b7fe700 1 --2- 172.21.15.8:0/4112087286 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cef102bcb0 0x55cef1027920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:59.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.783+0000 7fb42a7fc700 1 -- 172.21.15.8:0/4112087286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cef1025ea0 msgr2=0x55cef10363c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:59.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.783+0000 7fb42a7fc700 1 --2- 172.21.15.8:0/4112087286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cef1025ea0 0x55cef10363c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.783+0000 7fb42a7fc700 1 -- 172.21.15.8:0/4112087286 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cef102bcb0 msgr2=0x55cef1027920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:24:59.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.783+0000 7fb42a7fc700 1 --2- 172.21.15.8:0/4112087286 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cef102bcb0 0x55cef1027920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.783+0000 7fb42a7fc700 1 -- 172.21.15.8:0/4112087286 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb41c004040 con 0x55cef102b390 2023-08-11T12:24:59.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.783+0000 7fb42b7fe700 1 --2- 172.21.15.8:0/4112087286 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cef102bcb0 0x55cef1027920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:24:59.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.783+0000 7fb42a7fc700 1 --2- 172.21.15.8:0/4112087286 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cef102b390 0x55cef10271e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb4200b9590 tx=0x7fb4200b9390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bbadc2682ac695 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:24:59.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.783+0000 7fb40affd700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:24:59.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.783+0000 7fb40affd700 1 -- 172.21.15.8:0/4112087286 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4200a1d80 con 0x55cef102b390 2023-08-11T12:24:59.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.783+0000 7fb4452e2b80 1 -- 172.21.15.8:0/4112087286 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cef0f708a0 con 0x55cef102b390 2023-08-11T12:24:59.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.783+0000 7fb40affd700 1 -- 172.21.15.8:0/4112087286 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fb42009a700 con 0x55cef102b390 2023-08-11T12:24:59.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.784+0000 7fb40affd700 1 -- 172.21.15.8:0/4112087286 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb42009a4f0 con 0x55cef102b390 2023-08-11T12:24:59.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.784+0000 7fb4452e2b80 10 client.25822 fetch_fsmap learned FSMap version 29 2023-08-11T12:24:59.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.784+0000 7fb4452e2b80 1 -- 172.21.15.8:0/4112087286 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7fb42c1a59e0 con 0x55cef102b390 2023-08-11T12:24:59.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.784+0000 7fb40affd700 1 -- 172.21.15.8:0/4112087286 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cef0f708a0 con 0x55cef102b390 2023-08-11T12:24:59.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.784+0000 7fb40affd700 1 -- 172.21.15.8:0/4112087286 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fb420098f60 con 0x55cef102b390 2023-08-11T12:24:59.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.784+0000 7fb4452e2b80 10 client.25822 fetch_fsmap finished waiting for FSMap version 29 2023-08-11T12:24:59.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.784+0000 7fb4452e2b80 10 client.25822 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:24:59.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.784+0000 7fb4452e2b80 20 client.25822 populate_metadata read hostname 'smithi008' 2023-08-11T12:24:59.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.784+0000 7fb4452e2b80 1 --2- 172.21.15.8:0/4112087286 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55cef1093be0 0x55cef1096000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:24:59.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.784+0000 7fb4452e2b80 4 client.25822 mds_command: new command op to 24575 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-08-11T12:24:59.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.784+0000 7fb4452e2b80 1 -- 172.21.15.8:0/4112087286 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55cef0f310d0 con 0x55cef1093be0 2023-08-11T12:24:59.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.784+0000 7fb42affd700 1 --2- 172.21.15.8:0/4112087286 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55cef1093be0 0x55cef1096000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:24:59.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.785+0000 7fb42affd700 1 --2- 172.21.15.8:0/4112087286 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55cef1093be0 0x55cef1096000 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29d44bdc3a302fcc server_cookie=66562a532c926635 in_seq=0 out_seq=0 2023-08-11T12:24:59.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.785+0000 7fb40affd700 10 client.25822 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:24:59.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.787+0000 7fb40affd700 1 -- 172.21.15.8:0/4112087286 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55cef0f310d0 con 0x55cef1093be0 2023-08-11T12:24:59.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.787+0000 7fb40affd700 10 client.25822 handle_command_reply: tid=0 2023-08-11T12:24:59.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.787+0000 7fb4452e2b80 1 client.25822 shutdown 2023-08-11T12:24:59.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.788+0000 7fb4452e2b80 1 -- 172.21.15.8:0/4112087286 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cef102b390 msgr2=0x55cef10271e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:59.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.788+0000 7fb4452e2b80 1 --2- 172.21.15.8:0/4112087286 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cef102b390 0x55cef10271e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb4200b9590 tx=0x7fb4200b9390 comp rx=0 tx=0).stop 2023-08-11T12:24:59.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.788+0000 7fb4452e2b80 1 -- 172.21.15.8:0/4112087286 shutdown_connections 2023-08-11T12:24:59.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.788+0000 7fb4452e2b80 1 --2- 172.21.15.8:0/4112087286 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55cef1093be0 0x55cef1096000 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.788+0000 7fb4452e2b80 1 --2- 172.21.15.8:0/4112087286 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cef102bcb0 0x55cef1027920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.788+0000 7fb4452e2b80 1 --2- 172.21.15.8:0/4112087286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cef1025ea0 0x55cef10363c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.788+0000 7fb4452e2b80 1 --2- 172.21.15.8:0/4112087286 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cef102b390 0x55cef10271e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.788+0000 7fb4452e2b80 1 -- 172.21.15.8:0/4112087286 >> 172.21.15.8:0/4112087286 conn(0x55cef0f529d0 msgr2=0x55cef102c090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:59.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.788+0000 7fb40affd700 0 client.25822 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:24:59.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.788+0000 7fb4452e2b80 1 -- 172.21.15.8:0/4112087286 shutdown_connections 2023-08-11T12:24:59.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.788+0000 7fb4452e2b80 1 -- 172.21.15.8:0/4112087286 wait complete. 2023-08-11T12:24:59.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.788+0000 7fb4452e2b80 20 client.25822 trim_cache size 0 max 16384 2023-08-11T12:24:59.798 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:24:59.798 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2023-08-11T12:24:59.799 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "eb851fbd-5352-43bd-860a-8215674d4059", 2023-08-11T12:24:59.799 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2023-08-11T12:24:59.799 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:24:59.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.789+0000 7fb4319ff700 1 -- 172.21.15.8:0/2433591077 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb4140a01d0 msgr2=0x7fb4140a2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:59.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.789+0000 7fb4319ff700 1 --2- 172.21.15.8:0/2433591077 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb4140a01d0 0x7fb4140a2690 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb424009ec0 tx=0x7fb424004b40 comp rx=0 tx=0).stop 2023-08-11T12:24:59.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.789+0000 7fb4319ff700 1 -- 172.21.15.8:0/2433591077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb42c073670 msgr2=0x7fb42c19ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:24:59.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.789+0000 7fb4319ff700 1 --2- 172.21.15.8:0/2433591077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb42c073670 0x7fb42c19ef30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb420000c00 tx=0x7fb420004790 comp rx=0 tx=0).stop 2023-08-11T12:24:59.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.789+0000 7fb4319ff700 1 -- 172.21.15.8:0/2433591077 shutdown_connections 2023-08-11T12:24:59.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.789+0000 7fb4319ff700 1 --2- 172.21.15.8:0/2433591077 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb4140a01d0 0x7fb4140a2690 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.789+0000 7fb4319ff700 1 --2- 172.21.15.8:0/2433591077 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb42c10d1a0 0x7fb42c198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.789+0000 7fb4319ff700 1 --2- 172.21.15.8:0/2433591077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb42c072d50 0x7fb42c19e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.789+0000 7fb4319ff700 1 --2- 172.21.15.8:0/2433591077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb42c073670 0x7fb42c19ef30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:24:59.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.789+0000 7fb4319ff700 1 -- 172.21.15.8:0/2433591077 >> 172.21.15.8:0/2433591077 conn(0x7fb42c0fc490 msgr2=0x7fb42c10f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:24:59.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.789+0000 7fb4319ff700 1 -- 172.21.15.8:0/2433591077 shutdown_connections 2023-08-11T12:24:59.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:24:59.789+0000 7fb4319ff700 1 -- 172.21.15.8:0/2433591077 wait complete. 2023-08-11T12:24:59.813 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:24:59.875 INFO:teuthology.orchestra.run.smithi008.stderr:1600000 of 50000000 tuples (3%) done (elapsed 4.56 s, remaining 138.02 s) 2023-08-11T12:25:00.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.089+0000 7f6e2fbff700 1 -- 172.21.15.8:0/3057208034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e28072d50 msgr2=0x7f6e28073130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:00.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.089+0000 7f6e2fbff700 1 --2- 172.21.15.8:0/3057208034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e28072d50 0x7f6e28073130 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6e240098f0 tx=0x7f6e24009c00 comp rx=0 tx=0).stop 2023-08-11T12:25:00.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.089+0000 7f6e2fbff700 1 -- 172.21.15.8:0/3057208034 shutdown_connections 2023-08-11T12:25:00.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.089+0000 7f6e2fbff700 1 --2- 172.21.15.8:0/3057208034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e28072d50 0x7f6e28073130 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.089+0000 7f6e2fbff700 1 --2- 172.21.15.8:0/3057208034 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e2810d1a0 0x7f6e2810f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.089+0000 7f6e2fbff700 1 --2- 172.21.15.8:0/3057208034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e28073670 0x7f6e2810cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.089+0000 7f6e2fbff700 1 -- 172.21.15.8:0/3057208034 >> 172.21.15.8:0/3057208034 conn(0x7f6e280fc490 msgr2=0x7f6e280fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:00.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.089+0000 7f6e2fbff700 1 -- 172.21.15.8:0/3057208034 shutdown_connections 2023-08-11T12:25:00.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.089+0000 7f6e2fbff700 1 -- 172.21.15.8:0/3057208034 wait complete. 2023-08-11T12:25:00.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.090+0000 7f6e2fbff700 1 Processor -- start 2023-08-11T12:25:00.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.091+0000 7f6e2fbff700 1 -- start start 2023-08-11T12:25:00.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.091+0000 7f6e2fbff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e28072d50 0x7f6e2819eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:00.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.091+0000 7f6e2fbff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e28073670 0x7f6e2819f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:00.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.091+0000 7f6e2fbff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e2810d1a0 0x7f6e28198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:00.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.091+0000 7f6e2fbff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e281991a0 con 0x7f6e28072d50 2023-08-11T12:25:00.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.091+0000 7f6e2fbff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e28199310 con 0x7f6e28073670 2023-08-11T12:25:00.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.091+0000 7f6e2fbff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e281994d0 con 0x7f6e2810d1a0 2023-08-11T12:25:00.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.091+0000 7f6e2d99b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e28072d50 0x7f6e2819eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:00.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.091+0000 7f6e2d99b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e28072d50 0x7f6e2819eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52416/0 (socket says 172.21.15.8:52416) 2023-08-11T12:25:00.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.091+0000 7f6e2d99b700 1 -- 172.21.15.8:0/2654623850 learned_addr learned my addr 172.21.15.8:0/2654623850 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:00.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.091+0000 7f6e2d19a700 1 --2- 172.21.15.8:0/2654623850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e28073670 0x7f6e2819f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:00.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.092+0000 7f6e2e19c700 1 --2- 172.21.15.8:0/2654623850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e2810d1a0 0x7f6e28198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:00.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.092+0000 7f6e2d99b700 1 -- 172.21.15.8:0/2654623850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e2810d1a0 msgr2=0x7f6e28198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:00.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.092+0000 7f6e2d99b700 1 --2- 172.21.15.8:0/2654623850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e2810d1a0 0x7f6e28198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.092+0000 7f6e2d99b700 1 -- 172.21.15.8:0/2654623850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e28073670 msgr2=0x7f6e2819f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:00.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.092+0000 7f6e2d99b700 1 --2- 172.21.15.8:0/2654623850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e28073670 0x7f6e2819f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.092+0000 7f6e2d99b700 1 -- 172.21.15.8:0/2654623850 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e180095f0 con 0x7f6e28072d50 2023-08-11T12:25:00.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.092+0000 7f6e2e19c700 1 --2- 172.21.15.8:0/2654623850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e2810d1a0 0x7f6e28198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:25:00.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.092+0000 7f6e2d19a700 1 --2- 172.21.15.8:0/2654623850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e28073670 0x7f6e2819f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:00.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.092+0000 7f6e2d99b700 1 --2- 172.21.15.8:0/2654623850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e28072d50 0x7f6e2819eac0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6e24009810 tx=0x7f6e2400fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:00.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.092+0000 7f6e1effd700 1 -- 172.21.15.8:0/2654623850 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2401c070 con 0x7f6e28072d50 2023-08-11T12:25:00.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.092+0000 7f6e2fbff700 1 -- 172.21.15.8:0/2654623850 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e20009c40 con 0x7f6e28072d50 2023-08-11T12:25:00.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.092+0000 7f6e1effd700 1 -- 172.21.15.8:0/2654623850 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e2400bbd0 con 0x7f6e28072d50 2023-08-11T12:25:00.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.092+0000 7f6e1effd700 1 -- 172.21.15.8:0/2654623850 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e240049c0 con 0x7f6e28072d50 2023-08-11T12:25:00.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.093+0000 7f6e2fbff700 1 -- 172.21.15.8:0/2654623850 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e24009520 con 0x7f6e28072d50 2023-08-11T12:25:00.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.096+0000 7f6e1effd700 1 -- 172.21.15.8:0/2654623850 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 134846+0+0 (secure 0 0 0) 0x7f6e24020070 con 0x7f6e28072d50 2023-08-11T12:25:00.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.097+0000 7f6e43586b80 1 Processor -- start 2023-08-11T12:25:00.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.098+0000 7f6e43586b80 1 -- start start 2023-08-11T12:25:00.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.098+0000 7f6e1effd700 1 --2- 172.21.15.8:0/2654623850 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f6e140a0150 0x7f6e140a2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:00.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.098+0000 7f6e1effd700 1 -- 172.21.15.8:0/2654623850 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f6e240cc880 con 0x7f6e28072d50 2023-08-11T12:25:00.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.098+0000 7f6e43586b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565ea077310 0x5565ea0776f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:00.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.098+0000 7f6e43586b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565ea077c30 0x5565ea0718e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:00.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.098+0000 7f6e43586b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565ea071e20 0x5565ea072260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:00.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.098+0000 7f6e43586b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565e9fca630 con 0x5565ea077310 2023-08-11T12:25:00.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.098+0000 7f6e43586b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565e9fc7f50 con 0x5565ea077c30 2023-08-11T12:25:00.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.098+0000 7f6e43586b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565e9fc3840 con 0x5565ea071e20 2023-08-11T12:25:00.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.098+0000 7f6e2e19c700 1 --2- 172.21.15.8:0/2654623850 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f6e140a0150 0x7f6e140a2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:00.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.098+0000 7f6e2d99b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565ea077310 0x5565ea0776f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:00.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.098+0000 7f6e2d19a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565ea077c30 0x5565ea0718e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:00.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.098+0000 7f6e2d99b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565ea077310 0x5565ea0776f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52420/0 (socket says 172.21.15.8:52420) 2023-08-11T12:25:00.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.098+0000 7f6e2d99b700 1 -- 172.21.15.8:0/3329479477 learned_addr learned my addr 172.21.15.8:0/3329479477 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:00.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.099+0000 7f6e2e19c700 1 --2- 172.21.15.8:0/3329479477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565ea071e20 0x5565ea072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:00.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.099+0000 7f6e2d99b700 1 -- 172.21.15.8:0/3329479477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565ea071e20 msgr2=0x5565ea072260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:00.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.099+0000 7f6e2d99b700 1 --2- 172.21.15.8:0/3329479477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565ea071e20 0x5565ea072260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.099+0000 7f6e2d99b700 1 -- 172.21.15.8:0/3329479477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565ea077c30 msgr2=0x5565ea0718e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:00.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.099+0000 7f6e2d99b700 1 --2- 172.21.15.8:0/3329479477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565ea077c30 0x5565ea0718e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.099+0000 7f6e2d99b700 1 -- 172.21.15.8:0/3329479477 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565e9e43630 con 0x5565ea077310 2023-08-11T12:25:00.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.099+0000 7f6e2d19a700 1 --2- 172.21.15.8:0/3329479477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565ea077c30 0x5565ea0718e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:00.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.099+0000 7f6e2e19c700 1 --2- 172.21.15.8:0/2654623850 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f6e140a0150 0x7f6e140a2610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009550 tx=0x7f6e20007c80 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:00.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.099+0000 7f6e2d99b700 1 --2- 172.21.15.8:0/3329479477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565ea077310 0x5565ea0776f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6e24029000 tx=0x7f6e24009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c2db28547bdce4 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:00.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.099+0000 7f6e13fff700 1 -- 172.21.15.8:0/3329479477 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e240994c0 con 0x5565ea077310 2023-08-11T12:25:00.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.100+0000 7f6e13fff700 1 -- 172.21.15.8:0/3329479477 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e2409a260 con 0x5565ea077310 2023-08-11T12:25:00.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.100+0000 7f6e13fff700 1 -- 172.21.15.8:0/3329479477 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e24096400 con 0x5565ea077310 2023-08-11T12:25:00.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.100+0000 7f6e43586b80 1 -- 172.21.15.8:0/3329479477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565ea077310 msgr2=0x5565ea0776f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:00.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.100+0000 7f6e43586b80 1 --2- 172.21.15.8:0/3329479477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565ea077310 0x5565ea0776f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6e24029000 tx=0x7f6e24009c00 comp rx=0 tx=0).stop 2023-08-11T12:25:00.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.100+0000 7f6e43586b80 1 -- 172.21.15.8:0/3329479477 shutdown_connections 2023-08-11T12:25:00.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.100+0000 7f6e43586b80 1 --2- 172.21.15.8:0/3329479477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565ea071e20 0x5565ea072260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.100+0000 7f6e43586b80 1 --2- 172.21.15.8:0/3329479477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565ea077310 0x5565ea0776f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.100+0000 7f6e43586b80 1 --2- 172.21.15.8:0/3329479477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565ea077c30 0x5565ea0718e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.100+0000 7f6e43586b80 1 -- 172.21.15.8:0/3329479477 >> 172.21.15.8:0/3329479477 conn(0x5565e9f9e950 msgr2=0x5565ea06c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:00.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.101+0000 7f6e43586b80 1 -- 172.21.15.8:0/3329479477 shutdown_connections 2023-08-11T12:25:00.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.101+0000 7f6e43586b80 1 -- 172.21.15.8:0/3329479477 wait complete. 2023-08-11T12:25:00.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.101+0000 7f6e43586b80 1 -- start start 2023-08-11T12:25:00.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.101+0000 7f6e43586b80 1 Processor -- start 2023-08-11T12:25:00.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.102+0000 7f6e43586b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565ea071e20 0x5565ea07d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:00.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.102+0000 7f6e43586b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565ea077310 0x5565ea07acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:00.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.102+0000 7f6e43586b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565ea077c30 0x5565ea07b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:00.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.102+0000 7f6e43586b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565e9f61ac0 con 0x5565ea077310 2023-08-11T12:25:00.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.102+0000 7f6e43586b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565e9f617c0 con 0x5565ea071e20 2023-08-11T12:25:00.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.102+0000 7f6e43586b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565e9e45920 con 0x5565ea077c30 2023-08-11T12:25:00.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.102+0000 7f6e43586b80 10 client.0 _ll_register_callbacks cb 0x5565e9f64ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:25:00.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.102+0000 7f6e2d99b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565ea071e20 0x5565ea07d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:00.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.102+0000 7f6e2d99b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565ea071e20 0x5565ea07d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:59890/0 (socket says 172.21.15.8:59890) 2023-08-11T12:25:00.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.102+0000 7f6e2d99b700 1 -- 172.21.15.8:0/4113490210 learned_addr learned my addr 172.21.15.8:0/4113490210 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:00.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.102+0000 7f6e2d19a700 1 --2- 172.21.15.8:0/4113490210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565ea077310 0x5565ea07acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:00.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.102+0000 7f6e2e19c700 1 --2- 172.21.15.8:0/4113490210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565ea077c30 0x5565ea07b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:00.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.103+0000 7f6e2e19c700 1 -- 172.21.15.8:0/4113490210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565ea071e20 msgr2=0x5565ea07d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:00.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.103+0000 7f6e2e19c700 1 --2- 172.21.15.8:0/4113490210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565ea071e20 0x5565ea07d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.103+0000 7f6e2e19c700 1 -- 172.21.15.8:0/4113490210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565ea077310 msgr2=0x5565ea07acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:00.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.103+0000 7f6e2e19c700 1 --2- 172.21.15.8:0/4113490210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565ea077310 0x5565ea07acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.103+0000 7f6e2e19c700 1 -- 172.21.15.8:0/4113490210 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e18011440 con 0x5565ea077c30 2023-08-11T12:25:00.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.103+0000 7f6e2d99b700 1 --2- 172.21.15.8:0/4113490210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565ea071e20 0x5565ea07d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:00.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.103+0000 7f6e2e19c700 1 --2- 172.21.15.8:0/4113490210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565ea077c30 0x5565ea07b210 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6e2819f7c0 tx=0x7f6e20004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99c23c9cd72c45a5 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:00.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.103+0000 7f6e117fa700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:25:00.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.103+0000 7f6e117fa700 1 -- 172.21.15.8:0/4113490210 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2000e050 con 0x5565ea077c30 2023-08-11T12:25:00.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.103+0000 7f6e43586b80 1 -- 172.21.15.8:0/4113490210 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5565ea064a90 con 0x5565ea077c30 2023-08-11T12:25:00.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.103+0000 7f6e117fa700 1 -- 172.21.15.8:0/4113490210 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f6e20017e70 con 0x5565ea077c30 2023-08-11T12:25:00.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.103+0000 7f6e117fa700 1 -- 172.21.15.8:0/4113490210 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e2001ae60 con 0x5565ea077c30 2023-08-11T12:25:00.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.103+0000 7f6e43586b80 10 client.25834 fetch_fsmap learned FSMap version 29 2023-08-11T12:25:00.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.103+0000 7f6e43586b80 1 -- 172.21.15.8:0/4113490210 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f6e24009520 con 0x5565ea077c30 2023-08-11T12:25:00.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.104+0000 7f6e117fa700 1 -- 172.21.15.8:0/4113490210 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5565ea064a90 con 0x5565ea077c30 2023-08-11T12:25:00.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.104+0000 7f6e117fa700 1 -- 172.21.15.8:0/4113490210 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f6e20014050 con 0x5565ea077c30 2023-08-11T12:25:00.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.104+0000 7f6e43586b80 10 client.25834 fetch_fsmap finished waiting for FSMap version 29 2023-08-11T12:25:00.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.104+0000 7f6e43586b80 10 client.25834 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:25:00.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.104+0000 7f6e43586b80 20 client.25834 populate_metadata read hostname 'smithi008' 2023-08-11T12:25:00.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.104+0000 7f6e43586b80 1 --2- 172.21.15.8:0/4113490210 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5565ea08b1d0 0x5565ea08d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:00.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.104+0000 7f6e43586b80 4 client.25834 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:25:00.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.104+0000 7f6e43586b80 1 -- 172.21.15.8:0/4113490210 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5565ea0404e0 con 0x5565ea08b1d0 2023-08-11T12:25:00.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.104+0000 7f6e2d99b700 1 --2- 172.21.15.8:0/4113490210 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5565ea08b1d0 0x5565ea08d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:00.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.105+0000 7f6e2d99b700 1 --2- 172.21.15.8:0/4113490210 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5565ea08b1d0 0x5565ea08d5f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54cd3dfa0a0c35d9 server_cookie=83ed4d97914f4729 in_seq=0 out_seq=0 2023-08-11T12:25:00.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.105+0000 7f6e117fa700 10 client.25834 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:00.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.105+0000 7f6e117fa700 1 -- 172.21.15.8:0/4113490210 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5565ea0404e0 con 0x5565ea08b1d0 2023-08-11T12:25:00.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.105+0000 7f6e117fa700 10 client.25834 handle_command_reply: tid=0 2023-08-11T12:25:00.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.106+0000 7f6e43586b80 1 client.25834 shutdown 2023-08-11T12:25:00.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.106+0000 7f6e43586b80 1 -- 172.21.15.8:0/4113490210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565ea077c30 msgr2=0x5565ea07b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:00.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.106+0000 7f6e43586b80 1 --2- 172.21.15.8:0/4113490210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565ea077c30 0x5565ea07b210 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6e2819f7c0 tx=0x7f6e20004b40 comp rx=0 tx=0).stop 2023-08-11T12:25:00.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.106+0000 7f6e43586b80 1 -- 172.21.15.8:0/4113490210 shutdown_connections 2023-08-11T12:25:00.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.106+0000 7f6e43586b80 1 --2- 172.21.15.8:0/4113490210 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5565ea08b1d0 0x5565ea08d5f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.106+0000 7f6e43586b80 1 --2- 172.21.15.8:0/4113490210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565ea077c30 0x5565ea07b210 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.106+0000 7f6e43586b80 1 --2- 172.21.15.8:0/4113490210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565ea071e20 0x5565ea07d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.106+0000 7f6e117fa700 0 client.25834 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:00.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.106+0000 7f6e43586b80 1 --2- 172.21.15.8:0/4113490210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565ea077310 0x5565ea07acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.106+0000 7f6e43586b80 1 -- 172.21.15.8:0/4113490210 >> 172.21.15.8:0/4113490210 conn(0x5565e9f9e950 msgr2=0x5565ea066cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:00.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.106+0000 7f6e43586b80 1 -- 172.21.15.8:0/4113490210 shutdown_connections 2023-08-11T12:25:00.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.106+0000 7f6e43586b80 1 -- 172.21.15.8:0/4113490210 wait complete. 2023-08-11T12:25:00.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.106+0000 7f6e43586b80 20 client.25834 trim_cache size 0 max 16384 2023-08-11T12:25:00.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.125+0000 7f6e43586b80 1 Processor -- start 2023-08-11T12:25:00.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.125+0000 7f6e43586b80 1 -- start start 2023-08-11T12:25:00.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.125+0000 7f6e43586b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565ea071e20 0x5565ea0718e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:00.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.125+0000 7f6e43586b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565ea077310 0x5565ea078720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:00.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.125+0000 7f6e43586b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565ea077c30 0x5565ea07d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:00.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.125+0000 7f6e43586b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565ea0404e0 con 0x5565ea071e20 2023-08-11T12:25:00.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.125+0000 7f6e43586b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565ea076f90 con 0x5565ea077c30 2023-08-11T12:25:00.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.125+0000 7f6e43586b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565ea088770 con 0x5565ea077310 2023-08-11T12:25:00.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.126+0000 7f6e2d99b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565ea071e20 0x5565ea0718e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:00.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.126+0000 7f6e2d19a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565ea077310 0x5565ea078720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:00.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.126+0000 7f6e2d99b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565ea071e20 0x5565ea0718e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52446/0 (socket says 172.21.15.8:52446) 2023-08-11T12:25:00.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.126+0000 7f6e2d19a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565ea077310 0x5565ea078720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:38166/0 (socket says 172.21.15.8:38166) 2023-08-11T12:25:00.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.126+0000 7f6e2d99b700 1 -- 172.21.15.8:0/3067298824 learned_addr learned my addr 172.21.15.8:0/3067298824 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:00.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.126+0000 7f6e2e19c700 1 --2- 172.21.15.8:0/3067298824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565ea077c30 0x5565ea07d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:00.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.126+0000 7f6e2d19a700 1 -- 172.21.15.8:0/3067298824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565ea077c30 msgr2=0x5565ea07d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:00.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.126+0000 7f6e2d19a700 1 --2- 172.21.15.8:0/3067298824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565ea077c30 0x5565ea07d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.126+0000 7f6e2d19a700 1 -- 172.21.15.8:0/3067298824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565ea071e20 msgr2=0x5565ea0718e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:00.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.126+0000 7f6e2d19a700 1 --2- 172.21.15.8:0/3067298824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565ea071e20 0x5565ea0718e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.126+0000 7f6e2d19a700 1 -- 172.21.15.8:0/3067298824 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565e9defde0 con 0x5565ea077310 2023-08-11T12:25:00.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.126+0000 7f6e2e19c700 1 --2- 172.21.15.8:0/3067298824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565ea077c30 0x5565ea07d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:00.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.127+0000 7f6e2d19a700 1 --2- 172.21.15.8:0/3067298824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565ea077310 0x5565ea078720 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x5565ea07c280 tx=0x7f6e18009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=301b3826559aa346 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:00.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.127+0000 7f6e1cbff700 1 -- 172.21.15.8:0/3067298824 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1802a070 con 0x5565ea077310 2023-08-11T12:25:00.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.127+0000 7f6e1cbff700 1 -- 172.21.15.8:0/3067298824 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e18020040 con 0x5565ea077310 2023-08-11T12:25:00.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.127+0000 7f6e1cbff700 1 -- 172.21.15.8:0/3067298824 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1801f050 con 0x5565ea077310 2023-08-11T12:25:00.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.127+0000 7f6e43586b80 1 -- 172.21.15.8:0/3067298824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565ea077310 msgr2=0x5565ea078720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:00.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.127+0000 7f6e43586b80 1 --2- 172.21.15.8:0/3067298824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565ea077310 0x5565ea078720 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x5565ea07c280 tx=0x7f6e18009310 comp rx=0 tx=0).stop 2023-08-11T12:25:00.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.128+0000 7f6e43586b80 1 -- 172.21.15.8:0/3067298824 shutdown_connections 2023-08-11T12:25:00.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.128+0000 7f6e43586b80 1 --2- 172.21.15.8:0/3067298824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565ea077c30 0x5565ea07d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.128+0000 7f6e43586b80 1 --2- 172.21.15.8:0/3067298824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565ea071e20 0x5565ea0718e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.128+0000 7f6e43586b80 1 --2- 172.21.15.8:0/3067298824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565ea077310 0x5565ea078720 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.128+0000 7f6e43586b80 1 -- 172.21.15.8:0/3067298824 >> 172.21.15.8:0/3067298824 conn(0x5565e9f9e950 msgr2=0x5565ea078010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:00.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.128+0000 7f6e43586b80 1 -- 172.21.15.8:0/3067298824 shutdown_connections 2023-08-11T12:25:00.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.128+0000 7f6e43586b80 1 -- 172.21.15.8:0/3067298824 wait complete. 2023-08-11T12:25:00.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.128+0000 7f6e43586b80 1 -- start start 2023-08-11T12:25:00.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.129+0000 7f6e43586b80 1 Processor -- start 2023-08-11T12:25:00.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.129+0000 7f6e43586b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565ea071e20 0x5565ea081c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:00.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.129+0000 7f6e43586b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565ea077310 0x5565ea0821a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:00.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.129+0000 7f6e43586b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565ea077c30 0x5565ea080290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:00.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.129+0000 7f6e43586b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565ea080910 con 0x5565ea077310 2023-08-11T12:25:00.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.129+0000 7f6e43586b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565ea080a80 con 0x5565ea077c30 2023-08-11T12:25:00.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.129+0000 7f6e43586b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565ea080c40 con 0x5565ea071e20 2023-08-11T12:25:00.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.130+0000 7f6e43586b80 10 client.0 _ll_register_callbacks cb 0x7f6e20017ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:25:00.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.130+0000 7f6e2d99b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565ea071e20 0x5565ea081c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:00.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.130+0000 7f6e2d99b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565ea071e20 0x5565ea081c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:38174/0 (socket says 172.21.15.8:38174) 2023-08-11T12:25:00.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.130+0000 7f6e2d99b700 1 -- 172.21.15.8:0/1285251809 learned_addr learned my addr 172.21.15.8:0/1285251809 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:00.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.130+0000 7f6e2d19a700 1 --2- 172.21.15.8:0/1285251809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565ea077310 0x5565ea0821a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:00.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.130+0000 7f6e2e19c700 1 --2- 172.21.15.8:0/1285251809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565ea077c30 0x5565ea080290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:00.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.130+0000 7f6e2d99b700 1 -- 172.21.15.8:0/1285251809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565ea077c30 msgr2=0x5565ea080290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:00.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.130+0000 7f6e2d99b700 1 --2- 172.21.15.8:0/1285251809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565ea077c30 0x5565ea080290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.130+0000 7f6e2d99b700 1 -- 172.21.15.8:0/1285251809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565ea077310 msgr2=0x5565ea0821a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:00.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.130+0000 7f6e2d99b700 1 --2- 172.21.15.8:0/1285251809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565ea077310 0x5565ea0821a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.130+0000 7f6e2d99b700 1 -- 172.21.15.8:0/1285251809 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e24009520 con 0x5565ea071e20 2023-08-11T12:25:00.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.130+0000 7f6e2d19a700 1 --2- 172.21.15.8:0/1285251809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565ea077310 0x5565ea0821a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:00.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.131+0000 7f6e2d99b700 1 --2- 172.21.15.8:0/1285251809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565ea071e20 0x5565ea081c60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6e24096580 tx=0x7f6e2409a3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7e77f865f301e55 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:00.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.131+0000 7f6e117fa700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:25:00.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.131+0000 7f6e117fa700 1 -- 172.21.15.8:0/1285251809 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e24061020 con 0x5565ea071e20 2023-08-11T12:25:00.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.131+0000 7f6e117fa700 1 -- 172.21.15.8:0/1285251809 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f6e240ae040 con 0x5565ea071e20 2023-08-11T12:25:00.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.131+0000 7f6e43586b80 1 -- 172.21.15.8:0/1285251809 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6e2409a260 con 0x5565ea071e20 2023-08-11T12:25:00.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.131+0000 7f6e117fa700 1 -- 172.21.15.8:0/1285251809 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e24099be0 con 0x5565ea071e20 2023-08-11T12:25:00.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.131+0000 7f6e43586b80 10 client.25840 fetch_fsmap learned FSMap version 29 2023-08-11T12:25:00.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.131+0000 7f6e43586b80 1 -- 172.21.15.8:0/1285251809 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f6e1800f470 con 0x5565ea071e20 2023-08-11T12:25:00.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.131+0000 7f6e117fa700 1 -- 172.21.15.8:0/1285251809 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e2409a260 con 0x5565ea071e20 2023-08-11T12:25:00.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.131+0000 7f6e117fa700 1 -- 172.21.15.8:0/1285251809 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f6e240c9f70 con 0x5565ea071e20 2023-08-11T12:25:00.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.132+0000 7f6e43586b80 10 client.25840 fetch_fsmap finished waiting for FSMap version 29 2023-08-11T12:25:00.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.132+0000 7f6e43586b80 10 client.25840 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:25:00.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.132+0000 7f6e43586b80 20 client.25840 populate_metadata read hostname 'smithi008' 2023-08-11T12:25:00.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.132+0000 7f6e43586b80 1 --2- 172.21.15.8:0/1285251809 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5565ea0dfc90 0x5565ea0e20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:00.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.132+0000 7f6e43586b80 4 client.25840 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:25:00.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.132+0000 7f6e43586b80 1 -- 172.21.15.8:0/1285251809 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5565e9fbc820 con 0x5565ea0dfc90 2023-08-11T12:25:00.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.132+0000 7f6e2d19a700 1 --2- 172.21.15.8:0/1285251809 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5565ea0dfc90 0x5565ea0e20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:00.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.133+0000 7f6e2d19a700 1 --2- 172.21.15.8:0/1285251809 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5565ea0dfc90 0x5565ea0e20b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27d574933e5b97a6 server_cookie=41c736017439695b in_seq=0 out_seq=0 2023-08-11T12:25:00.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.133+0000 7f6e117fa700 10 client.25840 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:00.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.133+0000 7f6e117fa700 1 -- 172.21.15.8:0/1285251809 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5565e9fbc820 con 0x5565ea0dfc90 2023-08-11T12:25:00.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.133+0000 7f6e117fa700 10 client.25840 handle_command_reply: tid=0 2023-08-11T12:25:00.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.133+0000 7f6e43586b80 1 client.25840 shutdown 2023-08-11T12:25:00.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.133+0000 7f6e43586b80 1 -- 172.21.15.8:0/1285251809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565ea071e20 msgr2=0x5565ea081c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:00.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.133+0000 7f6e43586b80 1 --2- 172.21.15.8:0/1285251809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565ea071e20 0x5565ea081c60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6e24096580 tx=0x7f6e2409a3d0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.133+0000 7f6e43586b80 1 -- 172.21.15.8:0/1285251809 shutdown_connections 2023-08-11T12:25:00.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.133+0000 7f6e43586b80 1 --2- 172.21.15.8:0/1285251809 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5565ea0dfc90 0x5565ea0e20b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.133+0000 7f6e43586b80 1 --2- 172.21.15.8:0/1285251809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5565ea071e20 0x5565ea081c60 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.133+0000 7f6e117fa700 0 client.25840 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:00.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.133+0000 7f6e43586b80 1 --2- 172.21.15.8:0/1285251809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565ea077c30 0x5565ea080290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.133+0000 7f6e43586b80 1 --2- 172.21.15.8:0/1285251809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565ea077310 0x5565ea0821a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.133+0000 7f6e43586b80 1 -- 172.21.15.8:0/1285251809 >> 172.21.15.8:0/1285251809 conn(0x5565e9f9e950 msgr2=0x5565ea066420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:00.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.133+0000 7f6e43586b80 1 -- 172.21.15.8:0/1285251809 shutdown_connections 2023-08-11T12:25:00.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.133+0000 7f6e43586b80 1 -- 172.21.15.8:0/1285251809 wait complete. 2023-08-11T12:25:00.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.134+0000 7f6e43586b80 20 client.25840 trim_cache size 0 max 16384 2023-08-11T12:25:00.156 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:25:00.156 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-11T12:25:00.156 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:25:00.156 INFO:teuthology.orchestra.run.smithi008.stdout: "eb851fbd-5352-43bd-860a-8215674d4059": { 2023-08-11T12:25:00.157 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:25:00.157 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "eb851fbd-5352-43bd-860a-8215674d4059", 2023-08-11T12:25:00.157 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:25:00.157 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:25:00.157 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:25:00.157 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:25:00.158 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:59 smithi045 ceph-mon[130284]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:25:00.158 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:59 smithi045 ceph-mon[130284]: scrub summary: active paths [/] 2023-08-11T12:25:00.159 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:59 smithi045 ceph-mon[130284]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:00.159 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:59 smithi045 ceph-mon[130284]: scrub summary: active paths [/] 2023-08-11T12:25:00.159 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:59 smithi045 ceph-mon[130284]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:00.159 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:59 smithi045 ceph-mon[130284]: scrub summary: active paths [/] 2023-08-11T12:25:00.159 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:59 smithi045 ceph-mon[130284]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:00.159 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:59 smithi045 ceph-mon[130284]: scrub summary: active paths [/] 2023-08-11T12:25:00.159 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:24:59 smithi045 ceph-mon[130284]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:00.160 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:59 smithi194 ceph-mon[130905]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:25:00.160 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:59 smithi194 ceph-mon[130905]: scrub summary: active paths [/] 2023-08-11T12:25:00.160 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:59 smithi194 ceph-mon[130905]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:00.160 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:59 smithi194 ceph-mon[130905]: scrub summary: active paths [/] 2023-08-11T12:25:00.160 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:59 smithi194 ceph-mon[130905]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:00.160 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:59 smithi194 ceph-mon[130905]: scrub summary: active paths [/] 2023-08-11T12:25:00.160 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:59 smithi194 ceph-mon[130905]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:00.161 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:59 smithi194 ceph-mon[130905]: scrub summary: active paths [/] 2023-08-11T12:25:00.161 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:24:59 smithi194 ceph-mon[130905]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:00.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.134+0000 7f6e2fbff700 1 -- 172.21.15.8:0/2654623850 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f6e140a0150 msgr2=0x7f6e140a2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:00.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.134+0000 7f6e2fbff700 1 --2- 172.21.15.8:0/2654623850 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f6e140a0150 0x7f6e140a2610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009550 tx=0x7f6e20007c80 comp rx=0 tx=0).stop 2023-08-11T12:25:00.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.134+0000 7f6e2fbff700 1 -- 172.21.15.8:0/2654623850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e28072d50 msgr2=0x7f6e2819eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:00.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.134+0000 7f6e2fbff700 1 --2- 172.21.15.8:0/2654623850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e28072d50 0x7f6e2819eac0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6e24009810 tx=0x7f6e2400fa00 comp rx=0 tx=0).stop 2023-08-11T12:25:00.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.134+0000 7f6e2fbff700 1 -- 172.21.15.8:0/2654623850 shutdown_connections 2023-08-11T12:25:00.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.134+0000 7f6e2fbff700 1 --2- 172.21.15.8:0/2654623850 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f6e140a0150 0x7f6e140a2610 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.134+0000 7f6e2fbff700 1 --2- 172.21.15.8:0/2654623850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e2810d1a0 0x7f6e28198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.134+0000 7f6e2fbff700 1 --2- 172.21.15.8:0/2654623850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e28072d50 0x7f6e2819eac0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.134+0000 7f6e2fbff700 1 --2- 172.21.15.8:0/2654623850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e28073670 0x7f6e2819f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:00.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.134+0000 7f6e2fbff700 1 -- 172.21.15.8:0/2654623850 >> 172.21.15.8:0/2654623850 conn(0x7f6e280fc490 msgr2=0x7f6e2810f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:00.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.134+0000 7f6e2fbff700 1 -- 172.21.15.8:0/2654623850 shutdown_connections 2023-08-11T12:25:00.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:00.135+0000 7f6e2fbff700 1 -- 172.21.15.8:0/2654623850 wait complete. 2023-08-11T12:25:00.163 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:59 smithi008 ceph-mon[97158]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:25:00.163 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:59 smithi008 ceph-mon[97158]: scrub summary: active paths [/] 2023-08-11T12:25:00.163 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:59 smithi008 ceph-mon[97158]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:00.163 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:59 smithi008 ceph-mon[97158]: scrub summary: active paths [/] 2023-08-11T12:25:00.164 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:59 smithi008 ceph-mon[97158]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:00.164 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:59 smithi008 ceph-mon[97158]: scrub summary: active paths [/] 2023-08-11T12:25:00.164 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:59 smithi008 ceph-mon[97158]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:00.164 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:59 smithi008 ceph-mon[97158]: scrub summary: active paths [/] 2023-08-11T12:25:00.164 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:24:59 smithi008 ceph-mon[97158]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:00.165 INFO:tasks.cephfs.filesystem:scrub status for tag:eb851fbd-5352-43bd-860a-8215674d4059 - {'path': '/', 'tag': 'eb851fbd-5352-43bd-860a-8215674d4059', 'options': 'recursive,force'} 2023-08-11T12:25:00.251 INFO:teuthology.orchestra.run.smithi008.stderr:1700000 of 50000000 tuples (3%) done (elapsed 4.94 s, remaining 140.31 s) 2023-08-11T12:25:00.792 INFO:teuthology.orchestra.run.smithi008.stderr:1800000 of 50000000 tuples (3%) done (elapsed 5.48 s, remaining 146.73 s) 2023-08-11T12:25:00.803 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:25:00 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:25:00.412+0000 7fecad688700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-11T12:25:00.804 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:25:00 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:25:00.412+0000 7fecad688700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-11T12:25:00.804 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:25:00 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:25:00.412+0000 7fecad688700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-11T12:25:00.804 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:25:00 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:25:00.412+0000 7fecad688700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-11T12:25:00.804 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:25:00 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:25:00.412+0000 7fecad688700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-11T12:25:01.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:00 smithi194 ceph-mon[130905]: pgmap v15: 129 pgs: 129 active+clean; 91 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 12 MiB/s wr, 338 op/s 2023-08-11T12:25:01.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:00 smithi194 ceph-mon[130905]: scrub queued for path: / 2023-08-11T12:25:01.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:00 smithi194 ceph-mon[130905]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:01.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:00 smithi194 ceph-mon[130905]: scrub summary: active paths [/] 2023-08-11T12:25:01.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:00 smithi194 ceph-mon[130905]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:01.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:00 smithi045 ceph-mon[130284]: pgmap v15: 129 pgs: 129 active+clean; 91 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 12 MiB/s wr, 338 op/s 2023-08-11T12:25:01.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:00 smithi045 ceph-mon[130284]: scrub queued for path: / 2023-08-11T12:25:01.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:00 smithi045 ceph-mon[130284]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:01.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:00 smithi045 ceph-mon[130284]: scrub summary: active paths [/] 2023-08-11T12:25:01.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:00 smithi045 ceph-mon[130284]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:01.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:00 smithi008 ceph-mon[97158]: pgmap v15: 129 pgs: 129 active+clean; 91 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 12 MiB/s wr, 338 op/s 2023-08-11T12:25:01.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:00 smithi008 ceph-mon[97158]: scrub queued for path: / 2023-08-11T12:25:01.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:00 smithi008 ceph-mon[97158]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:01.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:00 smithi008 ceph-mon[97158]: scrub summary: active paths [/] 2023-08-11T12:25:01.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:00 smithi008 ceph-mon[97158]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:03.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:02 smithi194 ceph-mon[130905]: pgmap v16: 129 pgs: 129 active+clean; 99 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 14 MiB/s wr, 342 op/s 2023-08-11T12:25:03.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:02 smithi194 ceph-mon[130905]: mgrmap e24: x(active, since 26s), standbys: y, z 2023-08-11T12:25:03.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:02 smithi045 ceph-mon[130284]: pgmap v16: 129 pgs: 129 active+clean; 99 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 14 MiB/s wr, 342 op/s 2023-08-11T12:25:03.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:02 smithi045 ceph-mon[130284]: mgrmap e24: x(active, since 26s), standbys: y, z 2023-08-11T12:25:03.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:02 smithi008 ceph-mon[97158]: pgmap v16: 129 pgs: 129 active+clean; 99 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 14 MiB/s wr, 342 op/s 2023-08-11T12:25:03.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:02 smithi008 ceph-mon[97158]: mgrmap e24: x(active, since 26s), standbys: y, z 2023-08-11T12:25:04.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:03 smithi194 ceph-mon[130905]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:25:04.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:03 smithi045 ceph-mon[130284]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:25:04.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:03 smithi008 ceph-mon[97158]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:25:05.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:04 smithi194 ceph-mon[130905]: pgmap v17: 129 pgs: 129 active+clean; 225 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 34 MiB/s wr, 476 op/s 2023-08-11T12:25:05.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:04 smithi045 ceph-mon[130284]: pgmap v17: 129 pgs: 129 active+clean; 225 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 34 MiB/s wr, 476 op/s 2023-08-11T12:25:05.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:04 smithi008 ceph-mon[97158]: pgmap v17: 129 pgs: 129 active+clean; 225 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 34 MiB/s wr, 476 op/s 2023-08-11T12:25:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.391+0000 7ffa76fff700 1 -- 172.21.15.8:0/755626152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa701068b0 msgr2=0x7ffa70106c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.391+0000 7ffa76fff700 1 --2- 172.21.15.8:0/755626152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa701068b0 0x7ffa70106c90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffa64009990 tx=0x7ffa64009ca0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.392+0000 7ffa76fff700 1 -- 172.21.15.8:0/755626152 shutdown_connections 2023-08-11T12:25:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.392+0000 7ffa76fff700 1 --2- 172.21.15.8:0/755626152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa701068b0 0x7ffa70106c90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.392+0000 7ffa76fff700 1 --2- 172.21.15.8:0/755626152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa70068840 0x7ffa7010d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.392+0000 7ffa76fff700 1 --2- 172.21.15.8:0/755626152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa70067e80 0x7ffa70068300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.392+0000 7ffa76fff700 1 -- 172.21.15.8:0/755626152 >> 172.21.15.8:0/755626152 conn(0x7ffa70075300 msgr2=0x7ffa70075710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.392+0000 7ffa76fff700 1 -- 172.21.15.8:0/755626152 shutdown_connections 2023-08-11T12:25:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.392+0000 7ffa76fff700 1 -- 172.21.15.8:0/755626152 wait complete. 2023-08-11T12:25:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.393+0000 7ffa76fff700 1 Processor -- start 2023-08-11T12:25:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.393+0000 7ffa76fff700 1 -- start start 2023-08-11T12:25:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.393+0000 7ffa76fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa70067e80 0x7ffa70196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.394+0000 7ffa76fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa70068840 0x7ffa70196eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.394+0000 7ffa76fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa701068b0 0x7ffa7019b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.394+0000 7ffa76fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7019b910 con 0x7ffa70067e80 2023-08-11T12:25:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.394+0000 7ffa76fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7019ba80 con 0x7ffa70068840 2023-08-11T12:25:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.394+0000 7ffa76fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7019bc40 con 0x7ffa701068b0 2023-08-11T12:25:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.394+0000 7ffa6ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa70068840 0x7ffa70196eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.394+0000 7ffa6ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa70068840 0x7ffa70196eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:59928/0 (socket says 172.21.15.8:59928) 2023-08-11T12:25:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.394+0000 7ffa6ffff700 1 -- 172.21.15.8:0/1137613375 learned_addr learned my addr 172.21.15.8:0/1137613375 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.394+0000 7ffa7559c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa701068b0 0x7ffa7019b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.394+0000 7ffa74d9b700 1 --2- 172.21.15.8:0/1137613375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa70067e80 0x7ffa70196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.394+0000 7ffa6ffff700 1 -- 172.21.15.8:0/1137613375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa701068b0 msgr2=0x7ffa7019b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.394+0000 7ffa6ffff700 1 --2- 172.21.15.8:0/1137613375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa701068b0 0x7ffa7019b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.394+0000 7ffa6ffff700 1 -- 172.21.15.8:0/1137613375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa70067e80 msgr2=0x7ffa70196970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.394+0000 7ffa6ffff700 1 --2- 172.21.15.8:0/1137613375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa70067e80 0x7ffa70196970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.394+0000 7ffa6ffff700 1 -- 172.21.15.8:0/1137613375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa640095f0 con 0x7ffa70068840 2023-08-11T12:25:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.394+0000 7ffa7559c700 1 --2- 172.21.15.8:0/1137613375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa701068b0 0x7ffa7019b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.394+0000 7ffa74d9b700 1 --2- 172.21.15.8:0/1137613375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa70067e80 0x7ffa70196970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:25:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.395+0000 7ffa6ffff700 1 --2- 172.21.15.8:0/1137613375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa70068840 0x7ffa70196eb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00e9a0 tx=0x7ffa5c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.395+0000 7ffa6dffb700 1 -- 172.21.15.8:0/1137613375 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c009790 con 0x7ffa70068840 2023-08-11T12:25:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.395+0000 7ffa76fff700 1 -- 172.21.15.8:0/1137613375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa7019bf20 con 0x7ffa70068840 2023-08-11T12:25:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.395+0000 7ffa6dffb700 1 -- 172.21.15.8:0/1137613375 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffa5c00cbd0 con 0x7ffa70068840 2023-08-11T12:25:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.395+0000 7ffa6dffb700 1 -- 172.21.15.8:0/1137613375 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c018680 con 0x7ffa70068840 2023-08-11T12:25:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.395+0000 7ffa76fff700 1 -- 172.21.15.8:0/1137613375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa7006a520 con 0x7ffa70068840 2023-08-11T12:25:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.400+0000 7ffa6dffb700 1 -- 172.21.15.8:0/1137613375 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 24) v1 ==== 134903+0+0 (secure 0 0 0) 0x7ffa5c00cd40 con 0x7ffa70068840 2023-08-11T12:25:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.401+0000 7ffa8a8ecb80 1 Processor -- start 2023-08-11T12:25:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.401+0000 7ffa8a8ecb80 1 -- start start 2023-08-11T12:25:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.402+0000 7ffa8a8ecb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562961fff520 0x562961fff900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.402+0000 7ffa8a8ecb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562961fffe40 0x562961ff2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.402+0000 7ffa8a8ecb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562961ff2b70 0x562961ff2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.402+0000 7ffa8a8ecb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562961f4b5d0 con 0x562961fffe40 2023-08-11T12:25:05.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.402+0000 7ffa8a8ecb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562961f48ef0 con 0x562961fff520 2023-08-11T12:25:05.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.402+0000 7ffa8a8ecb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x562961f447e0 con 0x562961ff2b70 2023-08-11T12:25:05.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.402+0000 7ffa6dffb700 1 --2- 172.21.15.8:0/1137613375 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ffa600a0260 0x7ffa600a2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:05.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.402+0000 7ffa6ffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562961ff2b70 0x562961ff2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.402+0000 7ffa6ffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562961ff2b70 0x562961ff2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:38210/0 (socket says 172.21.15.8:38210) 2023-08-11T12:25:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.402+0000 7ffa6ffff700 1 -- 172.21.15.8:0/1085217274 learned_addr learned my addr 172.21.15.8:0/1085217274 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.402+0000 7ffa6dffb700 1 -- 172.21.15.8:0/1137613375 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7ffa5c014070 con 0x7ffa70068840 2023-08-11T12:25:05.555 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.402+0000 7ffa7559c700 1 --2- 172.21.15.8:0/1085217274 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562961fff520 0x562961fff900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:05.556 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.402+0000 7ffa74d9b700 1 --2- 172.21.15.8:0/1085217274 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562961fffe40 0x562961ff2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:05.556 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.403+0000 7ffa7559c700 1 --2- 172.21.15.8:0/1137613375 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ffa600a0260 0x7ffa600a2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:05.556 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.403+0000 7ffa6ffff700 1 -- 172.21.15.8:0/1085217274 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562961fff520 msgr2=0x562961fff900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:05.556 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.403+0000 7ffa6ffff700 1 --2- 172.21.15.8:0/1085217274 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562961fff520 0x562961fff900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.556 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.403+0000 7ffa6ffff700 1 -- 172.21.15.8:0/1085217274 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562961fffe40 msgr2=0x562961ff2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:05.556 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.403+0000 7ffa6ffff700 1 --2- 172.21.15.8:0/1085217274 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562961fffe40 0x562961ff2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.557 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.403+0000 7ffa6ffff700 1 -- 172.21.15.8:0/1085217274 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562961dc45d0 con 0x562961ff2b70 2023-08-11T12:25:05.557 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.403+0000 7ffa74d9b700 1 --2- 172.21.15.8:0/1085217274 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562961fffe40 0x562961ff2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:05.557 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.403+0000 7ffa6ffff700 1 --2- 172.21.15.8:0/1085217274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562961ff2b70 0x562961ff2fd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c0c9880 tx=0x7ffa5c098c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dbc7757098eb323 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:05.557 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.404+0000 7ffa5affd700 1 -- 172.21.15.8:0/1085217274 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c098ff0 con 0x562961ff2b70 2023-08-11T12:25:05.557 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.404+0000 7ffa5affd700 1 -- 172.21.15.8:0/1085217274 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffa5c09ce20 con 0x562961ff2b70 2023-08-11T12:25:05.562 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.404+0000 7ffa7559c700 1 --2- 172.21.15.8:0/1137613375 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ffa600a0260 0x7ffa600a2720 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ffa68009550 tx=0x7ffa6800b040 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:05.563 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.404+0000 7ffa5affd700 1 -- 172.21.15.8:0/1085217274 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c0a0bd0 con 0x562961ff2b70 2023-08-11T12:25:05.563 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.405+0000 7ffa8a8ecb80 1 -- 172.21.15.8:0/1085217274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562961ff2b70 msgr2=0x562961ff2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:05.563 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.405+0000 7ffa8a8ecb80 1 --2- 172.21.15.8:0/1085217274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562961ff2b70 0x562961ff2fd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c0c9880 tx=0x7ffa5c098c30 comp rx=0 tx=0).stop 2023-08-11T12:25:05.563 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.405+0000 7ffa8a8ecb80 1 -- 172.21.15.8:0/1085217274 shutdown_connections 2023-08-11T12:25:05.563 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.405+0000 7ffa8a8ecb80 1 --2- 172.21.15.8:0/1085217274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562961ff2b70 0x562961ff2fd0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.564 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.405+0000 7ffa8a8ecb80 1 --2- 172.21.15.8:0/1085217274 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562961fff520 0x562961fff900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.564 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.405+0000 7ffa8a8ecb80 1 --2- 172.21.15.8:0/1085217274 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562961fffe40 0x562961ff2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.564 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.405+0000 7ffa8a8ecb80 1 -- 172.21.15.8:0/1085217274 >> 172.21.15.8:0/1085217274 conn(0x562961f1f8f0 msgr2=0x562961fece60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:05.564 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.405+0000 7ffa8a8ecb80 1 -- 172.21.15.8:0/1085217274 shutdown_connections 2023-08-11T12:25:05.564 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.406+0000 7ffa8a8ecb80 1 -- 172.21.15.8:0/1085217274 wait complete. 2023-08-11T12:25:05.564 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.406+0000 7ffa8a8ecb80 1 -- start start 2023-08-11T12:25:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.407+0000 7ffa8a8ecb80 1 Processor -- start 2023-08-11T12:25:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.407+0000 7ffa8a8ecb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562961ff2b70 0x562962006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.407+0000 7ffa8a8ecb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562961fff520 0x562962004100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.407+0000 7ffa8a8ecb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562961fffe40 0x562962004710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.407+0000 7ffa8a8ecb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562961ee2a60 con 0x562961fff520 2023-08-11T12:25:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.407+0000 7ffa8a8ecb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562961ee2760 con 0x562961ff2b70 2023-08-11T12:25:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.407+0000 7ffa8a8ecb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x562961dc68c0 con 0x562961fffe40 2023-08-11T12:25:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.407+0000 7ffa8a8ecb80 10 client.0 _ll_register_callbacks cb 0x562961ee5a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:25:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.407+0000 7ffa7559c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562961fffe40 0x562962004710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.407+0000 7ffa7559c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562961fffe40 0x562962004710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:38226/0 (socket says 172.21.15.8:38226) 2023-08-11T12:25:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.407+0000 7ffa7559c700 1 -- 172.21.15.8:0/3137849447 learned_addr learned my addr 172.21.15.8:0/3137849447 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.408+0000 7ffa6ffff700 1 --2- 172.21.15.8:0/3137849447 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562961fff520 0x562962004100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.408+0000 7ffa74d9b700 1 --2- 172.21.15.8:0/3137849447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562961ff2b70 0x562962006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.408+0000 7ffa7559c700 1 -- 172.21.15.8:0/3137849447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562961ff2b70 msgr2=0x562962006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.408+0000 7ffa7559c700 1 --2- 172.21.15.8:0/3137849447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562961ff2b70 0x562962006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.408+0000 7ffa7559c700 1 -- 172.21.15.8:0/3137849447 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562961fff520 msgr2=0x562962004100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.408+0000 7ffa7559c700 1 --2- 172.21.15.8:0/3137849447 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562961fff520 0x562962004100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.408+0000 7ffa7559c700 1 -- 172.21.15.8:0/3137849447 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa7010e070 con 0x562961fffe40 2023-08-11T12:25:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.408+0000 7ffa74d9b700 1 --2- 172.21.15.8:0/3137849447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562961ff2b70 0x562962006e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:25:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.409+0000 7ffa7559c700 1 --2- 172.21.15.8:0/3137849447 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562961fffe40 0x562962004710 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ffa68007880 tx=0x7ffa68004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=565b2e129ef02806 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.409+0000 7ffa4ffff700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:25:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.409+0000 7ffa4ffff700 1 -- 172.21.15.8:0/3137849447 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa68021070 con 0x562961fffe40 2023-08-11T12:25:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.409+0000 7ffa8a8ecb80 1 -- 172.21.15.8:0/3137849447 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562961fe57e0 con 0x562961fffe40 2023-08-11T12:25:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.409+0000 7ffa4ffff700 1 -- 172.21.15.8:0/3137849447 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7ffa6800e840 con 0x562961fffe40 2023-08-11T12:25:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.409+0000 7ffa4ffff700 1 -- 172.21.15.8:0/3137849447 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa6800ea00 con 0x562961fffe40 2023-08-11T12:25:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.409+0000 7ffa8a8ecb80 10 client.25858 fetch_fsmap learned FSMap version 30 2023-08-11T12:25:05.569 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.409+0000 7ffa8a8ecb80 1 -- 172.21.15.8:0/3137849447 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x7ffa7006a520 con 0x562961fffe40 2023-08-11T12:25:05.569 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.409+0000 7ffa4ffff700 1 -- 172.21.15.8:0/3137849447 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562961fe57e0 con 0x562961fffe40 2023-08-11T12:25:05.569 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.410+0000 7ffa4ffff700 1 -- 172.21.15.8:0/3137849447 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 30) v1 ==== 7910+0+0 (secure 0 0 0) 0x7ffa6801ac40 con 0x562961fffe40 2023-08-11T12:25:05.569 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.410+0000 7ffa8a8ecb80 10 client.25858 fetch_fsmap finished waiting for FSMap version 30 2023-08-11T12:25:05.569 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.410+0000 7ffa8a8ecb80 10 client.25858 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-11T12:25:05.569 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.410+0000 7ffa8a8ecb80 20 client.25858 populate_metadata read hostname 'smithi008' 2023-08-11T12:25:05.569 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.410+0000 7ffa8a8ecb80 1 --2- 172.21.15.8:0/3137849447 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x56296201cf60 0x56296201f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.410+0000 7ffa8a8ecb80 4 client.25858 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:25:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.410+0000 7ffa8a8ecb80 1 -- 172.21.15.8:0/3137849447 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562961fc1480 con 0x56296201cf60 2023-08-11T12:25:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.410+0000 7ffa74d9b700 1 --2- 172.21.15.8:0/3137849447 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x56296201cf60 0x56296201f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.411+0000 7ffa4ffff700 10 client.25858 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.411+0000 7ffa74d9b700 1 --2- 172.21.15.8:0/3137849447 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x56296201cf60 0x56296201f380 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6e4de9e7c4675 server_cookie=688173dff3b8d231 in_seq=0 out_seq=0 2023-08-11T12:25:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.412+0000 7ffa4ffff700 1 -- 172.21.15.8:0/3137849447 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x562961fc1480 con 0x56296201cf60 2023-08-11T12:25:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.412+0000 7ffa4ffff700 10 client.25858 handle_command_reply: tid=0 2023-08-11T12:25:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.412+0000 7ffa8a8ecb80 1 client.25858 shutdown 2023-08-11T12:25:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.412+0000 7ffa8a8ecb80 1 -- 172.21.15.8:0/3137849447 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562961fffe40 msgr2=0x562962004710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.412+0000 7ffa8a8ecb80 1 --2- 172.21.15.8:0/3137849447 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562961fffe40 0x562962004710 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ffa68007880 tx=0x7ffa68004b40 comp rx=0 tx=0).stop 2023-08-11T12:25:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.412+0000 7ffa8a8ecb80 1 -- 172.21.15.8:0/3137849447 shutdown_connections 2023-08-11T12:25:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.412+0000 7ffa8a8ecb80 1 --2- 172.21.15.8:0/3137849447 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x56296201cf60 0x56296201f380 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.412+0000 7ffa8a8ecb80 1 --2- 172.21.15.8:0/3137849447 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562961fffe40 0x562962004710 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.412+0000 7ffa8a8ecb80 1 --2- 172.21.15.8:0/3137849447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562961ff2b70 0x562962006e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.412+0000 7ffa8a8ecb80 1 --2- 172.21.15.8:0/3137849447 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562961fff520 0x562962004100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.412+0000 7ffa4ffff700 0 client.25858 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:05.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.412+0000 7ffa8a8ecb80 1 -- 172.21.15.8:0/3137849447 >> 172.21.15.8:0/3137849447 conn(0x562961f1f8f0 msgr2=0x562961fec5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:05.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.412+0000 7ffa8a8ecb80 1 -- 172.21.15.8:0/3137849447 shutdown_connections 2023-08-11T12:25:05.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.413+0000 7ffa8a8ecb80 1 -- 172.21.15.8:0/3137849447 wait complete. 2023-08-11T12:25:05.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.413+0000 7ffa8a8ecb80 20 client.25858 trim_cache size 0 max 16384 2023-08-11T12:25:05.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.436+0000 7ffa8a8ecb80 1 Processor -- start 2023-08-11T12:25:05.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.436+0000 7ffa8a8ecb80 1 -- start start 2023-08-11T12:25:05.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.437+0000 7ffa8a8ecb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562961ff2b70 0x56296201f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:05.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.437+0000 7ffa8a8ecb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562961fff520 0x562961ffad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:05.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.437+0000 7ffa8a8ecb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562961fffe40 0x562961fecd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:05.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.437+0000 7ffa8a8ecb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562961ff12f0 con 0x562961ff2b70 2023-08-11T12:25:05.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.437+0000 7ffa8a8ecb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562961ffe540 con 0x562961fff520 2023-08-11T12:25:05.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.437+0000 7ffa8a8ecb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629620049b0 con 0x562961fffe40 2023-08-11T12:25:05.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.437+0000 7ffa74d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562961ff2b70 0x56296201f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:05.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.437+0000 7ffa74d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562961ff2b70 0x56296201f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52526/0 (socket says 172.21.15.8:52526) 2023-08-11T12:25:05.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.437+0000 7ffa74d9b700 1 -- 172.21.15.8:0/1860386360 learned_addr learned my addr 172.21.15.8:0/1860386360 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:05.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.437+0000 7ffa6ffff700 1 --2- 172.21.15.8:0/1860386360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562961fff520 0x562961ffad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:05.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.437+0000 7ffa7559c700 1 --2- 172.21.15.8:0/1860386360 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562961fffe40 0x562961fecd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:05.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.438+0000 7ffa6ffff700 1 -- 172.21.15.8:0/1860386360 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562961fffe40 msgr2=0x562961fecd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:05.575 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.438+0000 7ffa6ffff700 1 --2- 172.21.15.8:0/1860386360 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562961fffe40 0x562961fecd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.575 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.438+0000 7ffa6ffff700 1 -- 172.21.15.8:0/1860386360 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562961ff2b70 msgr2=0x56296201f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:05.575 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.438+0000 7ffa6ffff700 1 --2- 172.21.15.8:0/1860386360 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562961ff2b70 0x56296201f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.575 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.438+0000 7ffa6ffff700 1 -- 172.21.15.8:0/1860386360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562961d70d80 con 0x562961fff520 2023-08-11T12:25:05.575 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.438+0000 7ffa74d9b700 1 --2- 172.21.15.8:0/1860386360 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562961ff2b70 0x56296201f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:05.575 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.438+0000 7ffa6ffff700 1 --2- 172.21.15.8:0/1860386360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562961fff520 0x562961ffad50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x562961ff6b10 tx=0x7ffa5c09cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2ac7ef4cad6843a server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:05.576 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.438+0000 7ffa5b7fe700 1 -- 172.21.15.8:0/1860386360 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c098ff0 con 0x562961fff520 2023-08-11T12:25:05.576 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.439+0000 7ffa5b7fe700 1 -- 172.21.15.8:0/1860386360 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffa5c0a0e00 con 0x562961fff520 2023-08-11T12:25:05.576 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.439+0000 7ffa5b7fe700 1 -- 172.21.15.8:0/1860386360 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c0a0970 con 0x562961fff520 2023-08-11T12:25:05.576 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.439+0000 7ffa8a8ecb80 1 -- 172.21.15.8:0/1860386360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562961fff520 msgr2=0x562961ffad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:05.576 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.439+0000 7ffa8a8ecb80 1 --2- 172.21.15.8:0/1860386360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562961fff520 0x562961ffad50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x562961ff6b10 tx=0x7ffa5c09cf90 comp rx=0 tx=0).stop 2023-08-11T12:25:05.576 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.439+0000 7ffa8a8ecb80 1 -- 172.21.15.8:0/1860386360 shutdown_connections 2023-08-11T12:25:05.576 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.439+0000 7ffa8a8ecb80 1 --2- 172.21.15.8:0/1860386360 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562961fffe40 0x562961fecd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.577 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.439+0000 7ffa8a8ecb80 1 --2- 172.21.15.8:0/1860386360 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562961ff2b70 0x56296201f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.577 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.439+0000 7ffa8a8ecb80 1 --2- 172.21.15.8:0/1860386360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562961fff520 0x562961ffad50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.577 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.439+0000 7ffa8a8ecb80 1 -- 172.21.15.8:0/1860386360 >> 172.21.15.8:0/1860386360 conn(0x562961f1f8f0 msgr2=0x562961ff0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:05.577 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.440+0000 7ffa8a8ecb80 1 -- 172.21.15.8:0/1860386360 shutdown_connections 2023-08-11T12:25:05.577 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.440+0000 7ffa8a8ecb80 1 -- 172.21.15.8:0/1860386360 wait complete. 2023-08-11T12:25:05.577 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.440+0000 7ffa8a8ecb80 1 -- start start 2023-08-11T12:25:05.577 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.440+0000 7ffa8a8ecb80 1 Processor -- start 2023-08-11T12:25:05.578 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.441+0000 7ffa8a8ecb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562961ff2b70 0x562962069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:05.578 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.441+0000 7ffa8a8ecb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562961fff520 0x56296206a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:05.578 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.441+0000 7ffa8a8ecb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562961fffe40 0x562961ff6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:05.578 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.441+0000 7ffa8a8ecb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562961ff7300 con 0x562961ff2b70 2023-08-11T12:25:05.578 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.441+0000 7ffa8a8ecb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562961ff7470 con 0x562961fffe40 2023-08-11T12:25:05.578 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.441+0000 7ffa8a8ecb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x562961ff7630 con 0x562961fff520 2023-08-11T12:25:05.578 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.441+0000 7ffa8a8ecb80 10 client.0 _ll_register_callbacks cb 0x7ffa68008c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:25:05.579 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.441+0000 7ffa6ffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562961fff520 0x56296206a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:05.579 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.441+0000 7ffa6ffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562961fff520 0x56296206a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:38238/0 (socket says 172.21.15.8:38238) 2023-08-11T12:25:05.579 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.441+0000 7ffa6ffff700 1 -- 172.21.15.8:0/3052461494 learned_addr learned my addr 172.21.15.8:0/3052461494 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:05.579 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.442+0000 7ffa74d9b700 1 --2- 172.21.15.8:0/3052461494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562961ff2b70 0x562962069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:05.579 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.442+0000 7ffa7559c700 1 --2- 172.21.15.8:0/3052461494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562961fffe40 0x562961ff6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:05.579 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.442+0000 7ffa6ffff700 1 -- 172.21.15.8:0/3052461494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562961fffe40 msgr2=0x562961ff6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:05.579 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.442+0000 7ffa6ffff700 1 --2- 172.21.15.8:0/3052461494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562961fffe40 0x562961ff6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.580 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.442+0000 7ffa6ffff700 1 -- 172.21.15.8:0/3052461494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562961ff2b70 msgr2=0x562962069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:05.580 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.442+0000 7ffa6ffff700 1 --2- 172.21.15.8:0/3052461494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562961ff2b70 0x562962069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.580 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.442+0000 7ffa6ffff700 1 -- 172.21.15.8:0/3052461494 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6400bad0 con 0x562961fff520 2023-08-11T12:25:05.580 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.442+0000 7ffa74d9b700 1 --2- 172.21.15.8:0/3052461494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562961ff2b70 0x562962069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:25:05.580 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.442+0000 7ffa7559c700 1 --2- 172.21.15.8:0/3052461494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562961fffe40 0x562961ff6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:25:05.580 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.442+0000 7ffa6ffff700 1 --2- 172.21.15.8:0/3052461494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562961fff520 0x56296206a450 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c0c9210 tx=0x7ffa5c0a0ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=355631ab8655d815 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:05.580 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.442+0000 7ffa4ffff700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:25:05.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.442+0000 7ffa4ffff700 1 -- 172.21.15.8:0/3052461494 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c0b1120 con 0x562961fff520 2023-08-11T12:25:05.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.442+0000 7ffa4ffff700 1 -- 172.21.15.8:0/3052461494 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7ffa5c098ff0 con 0x562961fff520 2023-08-11T12:25:05.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.442+0000 7ffa8a8ecb80 1 -- 172.21.15.8:0/3052461494 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffa5c09ce20 con 0x562961fff520 2023-08-11T12:25:05.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.442+0000 7ffa4ffff700 1 -- 172.21.15.8:0/3052461494 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa5c0c95f0 con 0x562961fff520 2023-08-11T12:25:05.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.443+0000 7ffa8a8ecb80 10 client.25864 fetch_fsmap learned FSMap version 30 2023-08-11T12:25:05.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.443+0000 7ffa8a8ecb80 1 -- 172.21.15.8:0/3052461494 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x562961dc45d0 con 0x562961fff520 2023-08-11T12:25:05.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.443+0000 7ffa4ffff700 1 -- 172.21.15.8:0/3052461494 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffa5c09ce20 con 0x562961fff520 2023-08-11T12:25:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.443+0000 7ffa4ffff700 1 -- 172.21.15.8:0/3052461494 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 30) v1 ==== 7910+0+0 (secure 0 0 0) 0x7ffa5c0b80c0 con 0x562961fff520 2023-08-11T12:25:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.443+0000 7ffa8a8ecb80 10 client.25864 fetch_fsmap finished waiting for FSMap version 30 2023-08-11T12:25:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.443+0000 7ffa8a8ecb80 10 client.25864 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-11T12:25:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.443+0000 7ffa8a8ecb80 20 client.25864 populate_metadata read hostname 'smithi008' 2023-08-11T12:25:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.443+0000 7ffa8a8ecb80 1 --2- 172.21.15.8:0/3052461494 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5629620719d0 0x562962073df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.443+0000 7ffa8a8ecb80 4 client.25864 mds_command: new command op to 24575 tid=0[{"prefix": "flush journal"}] 2023-08-11T12:25:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.443+0000 7ffa8a8ecb80 1 -- 172.21.15.8:0/3052461494 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562961f3d7c0 con 0x5629620719d0 2023-08-11T12:25:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.443+0000 7ffa74d9b700 1 --2- 172.21.15.8:0/3052461494 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5629620719d0 0x562962073df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.444+0000 7ffa74d9b700 1 --2- 172.21.15.8:0/3052461494 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5629620719d0 0x562962073df0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=138c3816673c931 server_cookie=2577f61ab79d5ce4 in_seq=0 out_seq=0 2023-08-11T12:25:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.444+0000 7ffa4ffff700 10 client.25864 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:05.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.606+0000 7ffa4ffff700 1 -- 172.21.15.8:0/3052461494 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562961f3d7c0 con 0x5629620719d0 2023-08-11T12:25:05.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.606+0000 7ffa4ffff700 10 client.25864 handle_command_reply: tid=0 2023-08-11T12:25:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.606+0000 7ffa8a8ecb80 1 client.25864 shutdown 2023-08-11T12:25:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.606+0000 7ffa8a8ecb80 1 -- 172.21.15.8:0/3052461494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562961fff520 msgr2=0x56296206a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.606+0000 7ffa8a8ecb80 1 --2- 172.21.15.8:0/3052461494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562961fff520 0x56296206a450 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c0c9210 tx=0x7ffa5c0a0ba0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.606+0000 7ffa8a8ecb80 1 -- 172.21.15.8:0/3052461494 shutdown_connections 2023-08-11T12:25:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.606+0000 7ffa8a8ecb80 1 --2- 172.21.15.8:0/3052461494 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5629620719d0 0x562962073df0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.606+0000 7ffa8a8ecb80 1 --2- 172.21.15.8:0/3052461494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562961fffe40 0x562961ff6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.606+0000 7ffa8a8ecb80 1 --2- 172.21.15.8:0/3052461494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562961ff2b70 0x562962069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.606+0000 7ffa4ffff700 0 client.25864 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.606+0000 7ffa8a8ecb80 1 --2- 172.21.15.8:0/3052461494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562961fff520 0x56296206a450 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.606+0000 7ffa8a8ecb80 1 -- 172.21.15.8:0/3052461494 >> 172.21.15.8:0/3052461494 conn(0x562961f1f8f0 msgr2=0x562961ffd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.606+0000 7ffa8a8ecb80 1 -- 172.21.15.8:0/3052461494 shutdown_connections 2023-08-11T12:25:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.606+0000 7ffa8a8ecb80 1 -- 172.21.15.8:0/3052461494 wait complete. 2023-08-11T12:25:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.607+0000 7ffa8a8ecb80 20 client.25864 trim_cache size 0 max 16384 2023-08-11T12:25:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-08-11T12:25:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-08-11T12:25:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-08-11T12:25:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-08-11T12:25:05.613 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.607+0000 7ffa76fff700 1 -- 172.21.15.8:0/1137613375 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ffa600a0260 msgr2=0x7ffa600a2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.607+0000 7ffa76fff700 1 --2- 172.21.15.8:0/1137613375 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ffa600a0260 0x7ffa600a2720 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ffa68009550 tx=0x7ffa6800b040 comp rx=0 tx=0).stop 2023-08-11T12:25:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.607+0000 7ffa76fff700 1 -- 172.21.15.8:0/1137613375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa70068840 msgr2=0x7ffa70196eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.607+0000 7ffa76fff700 1 --2- 172.21.15.8:0/1137613375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa70068840 0x7ffa70196eb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00e9a0 tx=0x7ffa5c00ecb0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.608+0000 7ffa76fff700 1 -- 172.21.15.8:0/1137613375 shutdown_connections 2023-08-11T12:25:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.608+0000 7ffa76fff700 1 --2- 172.21.15.8:0/1137613375 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ffa600a0260 0x7ffa600a2720 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.608+0000 7ffa76fff700 1 --2- 172.21.15.8:0/1137613375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa701068b0 0x7ffa7019b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.608+0000 7ffa76fff700 1 --2- 172.21.15.8:0/1137613375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa70067e80 0x7ffa70196970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.608+0000 7ffa76fff700 1 --2- 172.21.15.8:0/1137613375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa70068840 0x7ffa70196eb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.608+0000 7ffa76fff700 1 -- 172.21.15.8:0/1137613375 >> 172.21.15.8:0/1137613375 conn(0x7ffa70075300 msgr2=0x7ffa700fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.608+0000 7ffa76fff700 1 -- 172.21.15.8:0/1137613375 shutdown_connections 2023-08-11T12:25:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:05.608+0000 7ffa76fff700 1 -- 172.21.15.8:0/1137613375 wait complete. 2023-08-11T12:25:07.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:06 smithi045 ceph-mon[130284]: pgmap v18: 129 pgs: 129 active+clean; 225 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 34 MiB/s wr, 422 op/s 2023-08-11T12:25:07.148 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:06 smithi194 ceph-mon[130905]: pgmap v18: 129 pgs: 129 active+clean; 225 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 34 MiB/s wr, 422 op/s 2023-08-11T12:25:07.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:06 smithi008 ceph-mon[97158]: pgmap v18: 129 pgs: 129 active+clean; 225 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 34 MiB/s wr, 422 op/s 2023-08-11T12:25:08.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:07 smithi194 ceph-mon[130905]: scrub summary: idle 2023-08-11T12:25:08.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:07 smithi194 ceph-mon[130905]: scrub summary: idle 2023-08-11T12:25:08.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:07 smithi045 ceph-mon[130284]: scrub summary: idle 2023-08-11T12:25:08.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:07 smithi045 ceph-mon[130284]: scrub summary: idle 2023-08-11T12:25:08.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:07 smithi008 ceph-mon[97158]: scrub summary: idle 2023-08-11T12:25:08.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:07 smithi008 ceph-mon[97158]: scrub summary: idle 2023-08-11T12:25:09.093 INFO:teuthology.orchestra.run.smithi008.stderr:1900000 of 50000000 tuples (3%) done (elapsed 13.78 s, remaining 348.86 s) 2023-08-11T12:25:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:08 smithi194 ceph-mon[130905]: pgmap v19: 129 pgs: 129 active+clean; 246 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 36 MiB/s wr, 684 op/s 2023-08-11T12:25:09.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:08 smithi045 ceph-mon[130284]: pgmap v19: 129 pgs: 129 active+clean; 246 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 36 MiB/s wr, 684 op/s 2023-08-11T12:25:09.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:08 smithi008 ceph-mon[97158]: pgmap v19: 129 pgs: 129 active+clean; 246 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 36 MiB/s wr, 684 op/s 2023-08-11T12:25:10.766 INFO:teuthology.orchestra.run.smithi008.stderr:2000000 of 50000000 tuples (4%) done (elapsed 15.45 s, remaining 370.88 s) 2023-08-11T12:25:11.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:10 smithi008 ceph-mon[97158]: pgmap v20: 129 pgs: 129 active+clean; 246 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 24 MiB/s wr, 399 op/s 2023-08-11T12:25:11.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:10 smithi194 ceph-mon[130905]: pgmap v20: 129 pgs: 129 active+clean; 246 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 24 MiB/s wr, 399 op/s 2023-08-11T12:25:11.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:10 smithi045 ceph-mon[130284]: pgmap v20: 129 pgs: 129 active+clean; 246 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 24 MiB/s wr, 399 op/s 2023-08-11T12:25:11.251 INFO:teuthology.orchestra.run.smithi008.stderr:2100000 of 50000000 tuples (4%) done (elapsed 15.94 s, remaining 363.55 s) 2023-08-11T12:25:11.588 INFO:teuthology.orchestra.run.smithi008.stderr:2200000 of 50000000 tuples (4%) done (elapsed 16.28 s, remaining 353.62 s) 2023-08-11T12:25:11.760 INFO:teuthology.orchestra.run.smithi008.stderr:2300000 of 50000000 tuples (4%) done (elapsed 16.45 s, remaining 341.11 s) 2023-08-11T12:25:12.044 INFO:teuthology.orchestra.run.smithi008.stderr:2400000 of 50000000 tuples (4%) done (elapsed 16.73 s, remaining 331.84 s) 2023-08-11T12:25:12.404 INFO:teuthology.orchestra.run.smithi008.stderr:2500000 of 50000000 tuples (5%) done (elapsed 17.09 s, remaining 324.73 s) 2023-08-11T12:25:12.625 INFO:teuthology.orchestra.run.smithi008.stderr:2600000 of 50000000 tuples (5%) done (elapsed 17.31 s, remaining 315.62 s) 2023-08-11T12:25:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2700000 of 50000000 tuples (5%) done (elapsed 17.58 s, remaining 307.99 s) 2023-08-11T12:25:13.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:12 smithi194 ceph-mon[130905]: pgmap v21: 129 pgs: 129 active+clean; 270 MiB data, 599 MiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 29 MiB/s wr, 492 op/s 2023-08-11T12:25:13.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:12 smithi045 ceph-mon[130284]: pgmap v21: 129 pgs: 129 active+clean; 270 MiB data, 599 MiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 29 MiB/s wr, 492 op/s 2023-08-11T12:25:13.225 INFO:teuthology.orchestra.run.smithi008.stderr:2800000 of 50000000 tuples (5%) done (elapsed 17.91 s, remaining 301.95 s) 2023-08-11T12:25:13.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:12 smithi008 ceph-mon[97158]: pgmap v21: 129 pgs: 129 active+clean; 270 MiB data, 599 MiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 29 MiB/s wr, 492 op/s 2023-08-11T12:25:13.425 INFO:teuthology.orchestra.run.smithi008.stderr:2900000 of 50000000 tuples (5%) done (elapsed 18.11 s, remaining 294.16 s) 2023-08-11T12:25:13.777 INFO:teuthology.orchestra.run.smithi008.stderr:3000000 of 50000000 tuples (6%) done (elapsed 18.46 s, remaining 289.27 s) 2023-08-11T12:25:14.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:13 smithi194 ceph-mon[130905]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:25:14.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:13 smithi045 ceph-mon[130284]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:25:14.169 INFO:teuthology.orchestra.run.smithi008.stderr:3100000 of 50000000 tuples (6%) done (elapsed 18.86 s, remaining 285.27 s) 2023-08-11T12:25:14.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:13 smithi008 ceph-mon[97158]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:25:14.358 INFO:teuthology.orchestra.run.smithi008.stderr:3200000 of 50000000 tuples (6%) done (elapsed 19.04 s, remaining 278.53 s) 2023-08-11T12:25:14.673 INFO:teuthology.orchestra.run.smithi008.stderr:3300000 of 50000000 tuples (6%) done (elapsed 19.36 s, remaining 273.98 s) 2023-08-11T12:25:15.031 INFO:teuthology.orchestra.run.smithi008.stderr:3400000 of 50000000 tuples (6%) done (elapsed 19.72 s, remaining 270.25 s) 2023-08-11T12:25:15.137 INFO:teuthology.orchestra.run.smithi008.stderr:3500000 of 50000000 tuples (7%) done (elapsed 19.82 s, remaining 263.37 s) 2023-08-11T12:25:15.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:14 smithi194 ceph-mon[130905]: pgmap v22: 129 pgs: 129 active+clean; 283 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 30 MiB/s wr, 528 op/s 2023-08-11T12:25:15.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:14 smithi045 ceph-mon[130284]: pgmap v22: 129 pgs: 129 active+clean; 283 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 30 MiB/s wr, 528 op/s 2023-08-11T12:25:15.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:14 smithi008 ceph-mon[97158]: pgmap v22: 129 pgs: 129 active+clean; 283 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 30 MiB/s wr, 528 op/s 2023-08-11T12:25:15.549 INFO:teuthology.orchestra.run.smithi008.stderr:3600000 of 50000000 tuples (7%) done (elapsed 20.24 s, remaining 260.82 s) 2023-08-11T12:25:15.889 INFO:teuthology.orchestra.run.smithi008.stderr:3700000 of 50000000 tuples (7%) done (elapsed 20.58 s, remaining 257.47 s) 2023-08-11T12:25:16.022 INFO:teuthology.orchestra.run.smithi008.stderr:3800000 of 50000000 tuples (7%) done (elapsed 20.71 s, remaining 251.78 s) 2023-08-11T12:25:16.415 INFO:teuthology.orchestra.run.smithi008.stderr:3900000 of 50000000 tuples (7%) done (elapsed 21.10 s, remaining 249.44 s) 2023-08-11T12:25:16.545 INFO:teuthology.orchestra.run.smithi008.stderr:4000000 of 50000000 tuples (8%) done (elapsed 21.23 s, remaining 244.17 s) 2023-08-11T12:25:16.941 INFO:teuthology.orchestra.run.smithi008.stderr:4100000 of 50000000 tuples (8%) done (elapsed 21.63 s, remaining 242.13 s) 2023-08-11T12:25:17.138 INFO:teuthology.orchestra.run.smithi008.stderr:4200000 of 50000000 tuples (8%) done (elapsed 21.83 s, remaining 238.00 s) 2023-08-11T12:25:17.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:16 smithi194 ceph-mon[130905]: pgmap v23: 129 pgs: 129 active+clean; 283 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 9.1 MiB/s wr, 394 op/s 2023-08-11T12:25:17.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:16 smithi045 ceph-mon[130284]: pgmap v23: 129 pgs: 129 active+clean; 283 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 9.1 MiB/s wr, 394 op/s 2023-08-11T12:25:17.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:16 smithi008 ceph-mon[97158]: pgmap v23: 129 pgs: 129 active+clean; 283 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 9.1 MiB/s wr, 394 op/s 2023-08-11T12:25:17.472 INFO:teuthology.orchestra.run.smithi008.stderr:4300000 of 50000000 tuples (8%) done (elapsed 22.16 s, remaining 235.51 s) 2023-08-11T12:25:17.835 INFO:teuthology.orchestra.run.smithi008.stderr:4400000 of 50000000 tuples (8%) done (elapsed 22.52 s, remaining 233.41 s) 2023-08-11T12:25:18.039 INFO:teuthology.orchestra.run.smithi008.stderr:4500000 of 50000000 tuples (9%) done (elapsed 22.73 s, remaining 229.78 s) 2023-08-11T12:25:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:4600000 of 50000000 tuples (9%) done (elapsed 23.08 s, remaining 227.83 s) 2023-08-11T12:25:18.755 INFO:teuthology.orchestra.run.smithi008.stderr:4700000 of 50000000 tuples (9%) done (elapsed 23.44 s, remaining 225.94 s) 2023-08-11T12:25:18.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.772+0000 7fc4327ff700 1 -- 172.21.15.8:0/2984160875 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc42c1068d0 msgr2=0x7fc42c106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:18.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.772+0000 7fc4327ff700 1 --2- 172.21.15.8:0/2984160875 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc42c1068d0 0x7fc42c106cb0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc41c009990 tx=0x7fc41c009ca0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.772+0000 7fc4327ff700 1 -- 172.21.15.8:0/2984160875 shutdown_connections 2023-08-11T12:25:18.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.772+0000 7fc4327ff700 1 --2- 172.21.15.8:0/2984160875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc42c101280 0x7fc42c10d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.772+0000 7fc4327ff700 1 --2- 172.21.15.8:0/2984160875 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc42c1068d0 0x7fc42c106cb0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.772+0000 7fc4327ff700 1 --2- 172.21.15.8:0/2984160875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc42c1008c0 0x7fc42c100d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.772+0000 7fc4327ff700 1 -- 172.21.15.8:0/2984160875 >> 172.21.15.8:0/2984160875 conn(0x7fc42c0fc3d0 msgr2=0x7fc42c0fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:18.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.773+0000 7fc4327ff700 1 -- 172.21.15.8:0/2984160875 shutdown_connections 2023-08-11T12:25:18.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.773+0000 7fc4327ff700 1 -- 172.21.15.8:0/2984160875 wait complete. 2023-08-11T12:25:18.778 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.774+0000 7fc4327ff700 1 Processor -- start 2023-08-11T12:25:18.779 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.774+0000 7fc4327ff700 1 -- start start 2023-08-11T12:25:18.779 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.774+0000 7fc4327ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc42c1008c0 0x7fc42c072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:18.779 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.774+0000 7fc4327ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc42c101280 0x7fc42c073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:18.779 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.774+0000 7fc4327ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc42c1068d0 0x7fc42c1a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:18.779 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.774+0000 7fc4327ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c073990 con 0x7fc42c1068d0 2023-08-11T12:25:18.779 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.774+0000 7fc4327ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c1a5040 con 0x7fc42c1008c0 2023-08-11T12:25:18.780 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.774+0000 7fc4327ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c1a5180 con 0x7fc42c101280 2023-08-11T12:25:18.780 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.774+0000 7fc42bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc42c1008c0 0x7fc42c072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:18.780 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.774+0000 7fc42bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc42c1008c0 0x7fc42c072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:48286/0 (socket says 172.21.15.8:48286) 2023-08-11T12:25:18.780 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.774+0000 7fc42bfff700 1 -- 172.21.15.8:0/315572772 learned_addr learned my addr 172.21.15.8:0/315572772 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:18.780 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.774+0000 7fc430d9c700 1 --2- 172.21.15.8:0/315572772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc42c1068d0 0x7fc42c1a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:18.780 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.774+0000 7fc42b7fe700 1 --2- 172.21.15.8:0/315572772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc42c101280 0x7fc42c073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:18.780 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.775+0000 7fc42bfff700 1 -- 172.21.15.8:0/315572772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc42c101280 msgr2=0x7fc42c073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:18.781 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.775+0000 7fc42bfff700 1 --2- 172.21.15.8:0/315572772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc42c101280 0x7fc42c073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.781 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.775+0000 7fc42bfff700 1 -- 172.21.15.8:0/315572772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc42c1068d0 msgr2=0x7fc42c1a4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:18.781 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.775+0000 7fc42bfff700 1 --2- 172.21.15.8:0/315572772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc42c1068d0 0x7fc42c1a4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.781 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.775+0000 7fc42bfff700 1 -- 172.21.15.8:0/315572772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41c0095f0 con 0x7fc42c1008c0 2023-08-11T12:25:18.781 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.775+0000 7fc42b7fe700 1 --2- 172.21.15.8:0/315572772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc42c101280 0x7fc42c073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:18.781 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.775+0000 7fc430d9c700 1 --2- 172.21.15.8:0/315572772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc42c1068d0 0x7fc42c1a4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:18.781 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.775+0000 7fc42bfff700 1 --2- 172.21.15.8:0/315572772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc42c1008c0 0x7fc42c072c20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc41c000c00 tx=0x7fc41c005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:18.782 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.775+0000 7fc4297fa700 1 -- 172.21.15.8:0/315572772 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c01d070 con 0x7fc42c1008c0 2023-08-11T12:25:18.783 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.775+0000 7fc4327ff700 1 -- 172.21.15.8:0/315572772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc42c1a5380 con 0x7fc42c1008c0 2023-08-11T12:25:18.783 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.775+0000 7fc4297fa700 1 -- 172.21.15.8:0/315572772 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc41c022470 con 0x7fc42c1008c0 2023-08-11T12:25:18.783 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.775+0000 7fc4297fa700 1 -- 172.21.15.8:0/315572772 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c017650 con 0x7fc42c1008c0 2023-08-11T12:25:18.783 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.776+0000 7fc4327ff700 1 -- 172.21.15.8:0/315572772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc42c1a5860 con 0x7fc42c1008c0 2023-08-11T12:25:18.783 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.779+0000 7fc4297fa700 1 -- 172.21.15.8:0/315572772 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 24) v1 ==== 134903+0+0 (secure 0 0 0) 0x7fc41c0225e0 con 0x7fc42c1008c0 2023-08-11T12:25:18.784 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.780+0000 7fc4461c7b80 1 Processor -- start 2023-08-11T12:25:18.784 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.781+0000 7fc4461c7b80 1 -- start start 2023-08-11T12:25:18.785 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.781+0000 7fc4461c7b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557a872be80 0x5557a872c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:18.785 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.781+0000 7fc4461c7b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557a8726630 0x5557a8726ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:18.785 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.781+0000 7fc4297fa700 1 --2- 172.21.15.8:0/315572772 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fc4140a01e0 0x7fc4140a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:18.785 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.781+0000 7fc4461c7b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5557a8726ff0 0x5557a8732c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:18.785 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.781+0000 7fc4461c7b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557a867f5d0 con 0x5557a872be80 2023-08-11T12:25:18.786 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.781+0000 7fc4461c7b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557a867cef0 con 0x5557a8726630 2023-08-11T12:25:18.786 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.781+0000 7fc4461c7b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557a86787e0 con 0x5557a8726ff0 2023-08-11T12:25:18.786 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.782+0000 7fc4297fa700 1 -- 172.21.15.8:0/315572772 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fc41c0ccf30 con 0x7fc42c1008c0 2023-08-11T12:25:18.786 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.782+0000 7fc42bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557a8726630 0x5557a8726ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:18.786 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.782+0000 7fc430d9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557a872be80 0x5557a872c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:18.786 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.782+0000 7fc42bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557a8726630 0x5557a8726ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:48296/0 (socket says 172.21.15.8:48296) 2023-08-11T12:25:18.786 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.782+0000 7fc42bfff700 1 -- 172.21.15.8:0/2055747599 learned_addr learned my addr 172.21.15.8:0/2055747599 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:18.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.782+0000 7fc42b7fe700 1 --2- 172.21.15.8:0/315572772 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fc4140a01e0 0x7fc4140a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:18.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.782+0000 7fc430d9c700 1 --2- 172.21.15.8:0/2055747599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5557a8726ff0 0x5557a8732c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:18.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.782+0000 7fc42bfff700 1 -- 172.21.15.8:0/2055747599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5557a8726ff0 msgr2=0x5557a8732c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:18.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.782+0000 7fc42bfff700 1 --2- 172.21.15.8:0/2055747599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5557a8726ff0 0x5557a8732c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.782+0000 7fc42bfff700 1 -- 172.21.15.8:0/2055747599 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557a872be80 msgr2=0x5557a872c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:18.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.782+0000 7fc42bfff700 1 --2- 172.21.15.8:0/2055747599 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557a872be80 0x5557a872c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.782+0000 7fc42bfff700 1 -- 172.21.15.8:0/2055747599 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557a84f85d0 con 0x5557a8726630 2023-08-11T12:25:18.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.782+0000 7fc430d9c700 1 --2- 172.21.15.8:0/2055747599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5557a8726ff0 0x5557a8732c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:25:18.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.782+0000 7fc42bfff700 1 --2- 172.21.15.8:0/2055747599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557a8726630 0x5557a8726ab0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc41c096700 tx=0x7fc41c09a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=761afc6af2f97952 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:18.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.783+0000 7fc4127fc700 1 -- 172.21.15.8:0/2055747599 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c09a200 con 0x5557a8726630 2023-08-11T12:25:18.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.783+0000 7fc4127fc700 1 -- 172.21.15.8:0/2055747599 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc41c09e030 con 0x5557a8726630 2023-08-11T12:25:18.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.783+0000 7fc4127fc700 1 -- 172.21.15.8:0/2055747599 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c0998f0 con 0x5557a8726630 2023-08-11T12:25:18.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.783+0000 7fc4461c7b80 1 -- 172.21.15.8:0/2055747599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557a8726630 msgr2=0x5557a8726ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:18.790 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.783+0000 7fc4461c7b80 1 --2- 172.21.15.8:0/2055747599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557a8726630 0x5557a8726ab0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc41c096700 tx=0x7fc41c09a100 comp rx=0 tx=0).stop 2023-08-11T12:25:18.790 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.783+0000 7fc42b7fe700 1 --2- 172.21.15.8:0/315572772 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fc4140a01e0 0x7fc4140a26a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc42c074410 tx=0x7fc420009260 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:18.790 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.784+0000 7fc4461c7b80 1 -- 172.21.15.8:0/2055747599 shutdown_connections 2023-08-11T12:25:18.790 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.784+0000 7fc4461c7b80 1 --2- 172.21.15.8:0/2055747599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5557a8726ff0 0x5557a8732c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.790 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.784+0000 7fc4461c7b80 1 --2- 172.21.15.8:0/2055747599 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557a872be80 0x5557a872c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.790 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.784+0000 7fc4461c7b80 1 --2- 172.21.15.8:0/2055747599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557a8726630 0x5557a8726ab0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.790 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.784+0000 7fc4461c7b80 1 -- 172.21.15.8:0/2055747599 >> 172.21.15.8:0/2055747599 conn(0x5557a86538f0 msgr2=0x5557a8720e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:18.790 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.784+0000 7fc4461c7b80 1 -- 172.21.15.8:0/2055747599 shutdown_connections 2023-08-11T12:25:18.791 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.784+0000 7fc4461c7b80 1 -- 172.21.15.8:0/2055747599 wait complete. 2023-08-11T12:25:18.791 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.784+0000 7fc4461c7b80 1 -- start start 2023-08-11T12:25:18.791 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.785+0000 7fc4461c7b80 1 Processor -- start 2023-08-11T12:25:18.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.785+0000 7fc4461c7b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557a8726630 0x5557a8735640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:18.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.785+0000 7fc4461c7b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557a8726ff0 0x5557a8735b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:18.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.785+0000 7fc4461c7b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5557a872be80 0x5557a872f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:18.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.785+0000 7fc4461c7b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557a8616a60 con 0x5557a8726630 2023-08-11T12:25:18.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.785+0000 7fc4461c7b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557a8616760 con 0x5557a8726ff0 2023-08-11T12:25:18.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.785+0000 7fc4461c7b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557a84fa8c0 con 0x5557a872be80 2023-08-11T12:25:18.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.786+0000 7fc4461c7b80 10 client.0 _ll_register_callbacks cb 0x5557a8619a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:25:18.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.786+0000 7fc42bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557a8726630 0x5557a8735640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:18.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.786+0000 7fc430d9c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5557a872be80 0x5557a872f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:18.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.786+0000 7fc42b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557a8726ff0 0x5557a8735b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:18.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.786+0000 7fc42bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557a8726630 0x5557a8735640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32844/0 (socket says 172.21.15.8:32844) 2023-08-11T12:25:18.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.786+0000 7fc42bfff700 1 -- 172.21.15.8:0/2873349757 learned_addr learned my addr 172.21.15.8:0/2873349757 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:18.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.786+0000 7fc42b7fe700 1 -- 172.21.15.8:0/2873349757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5557a872be80 msgr2=0x5557a872f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:18.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.786+0000 7fc42b7fe700 1 --2- 172.21.15.8:0/2873349757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5557a872be80 0x5557a872f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.786+0000 7fc42b7fe700 1 -- 172.21.15.8:0/2873349757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557a8726630 msgr2=0x5557a8735640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:18.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.786+0000 7fc42b7fe700 1 --2- 172.21.15.8:0/2873349757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557a8726630 0x5557a8735640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.786+0000 7fc42b7fe700 1 -- 172.21.15.8:0/2873349757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc41c0b9040 con 0x5557a8726ff0 2023-08-11T12:25:18.796 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.787+0000 7fc42b7fe700 1 --2- 172.21.15.8:0/2873349757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557a8726ff0 0x5557a8735b80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc420003920 tx=0x7fc4200047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e0edd73aba07b25 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:18.796 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.787+0000 7fc40b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:25:18.796 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.787+0000 7fc40b7fe700 1 -- 172.21.15.8:0/2873349757 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42000e840 con 0x5557a8726ff0 2023-08-11T12:25:18.796 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.787+0000 7fc4461c7b80 1 -- 172.21.15.8:0/2873349757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5557a87197e0 con 0x5557a8726ff0 2023-08-11T12:25:18.796 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.787+0000 7fc40b7fe700 1 -- 172.21.15.8:0/2873349757 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fc42000e9a0 con 0x5557a8726ff0 2023-08-11T12:25:18.796 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.787+0000 7fc40b7fe700 1 -- 172.21.15.8:0/2873349757 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc42000eb60 con 0x5557a8726ff0 2023-08-11T12:25:18.796 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.787+0000 7fc4461c7b80 10 client.25862 fetch_fsmap learned FSMap version 31 2023-08-11T12:25:18.796 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.787+0000 7fc4461c7b80 1 -- 172.21.15.8:0/2873349757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5557a84a4d80 con 0x5557a8726ff0 2023-08-11T12:25:18.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.788+0000 7fc40b7fe700 1 -- 172.21.15.8:0/2873349757 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5557a87197e0 con 0x5557a8726ff0 2023-08-11T12:25:18.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.788+0000 7fc40b7fe700 1 -- 172.21.15.8:0/2873349757 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 31) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fc420024020 con 0x5557a8726ff0 2023-08-11T12:25:18.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.788+0000 7fc4461c7b80 10 client.25862 fetch_fsmap finished waiting for FSMap version 31 2023-08-11T12:25:18.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.788+0000 7fc4461c7b80 10 client.25862 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-11T12:25:18.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.788+0000 7fc4461c7b80 20 client.25862 populate_metadata read hostname 'smithi008' 2023-08-11T12:25:18.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.788+0000 7fc4461c7b80 1 --2- 172.21.15.8:0/2873349757 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5557a873fbf0 0x5557a8742010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:18.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.788+0000 7fc4461c7b80 4 client.25862 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:25:18.798 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.788+0000 7fc4461c7b80 1 -- 172.21.15.8:0/2873349757 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5557a86f5480 con 0x5557a873fbf0 2023-08-11T12:25:18.798 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.788+0000 7fc42bfff700 1 --2- 172.21.15.8:0/2873349757 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5557a873fbf0 0x5557a8742010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:18.798 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.789+0000 7fc42bfff700 1 --2- 172.21.15.8:0/2873349757 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5557a873fbf0 0x5557a8742010 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88c7453a82094a41 server_cookie=f60253f74da7ba86 in_seq=0 out_seq=0 2023-08-11T12:25:18.798 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.789+0000 7fc40b7fe700 10 client.25862 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:18.798 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.789+0000 7fc40b7fe700 1 -- 172.21.15.8:0/2873349757 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5557a86f5480 con 0x5557a873fbf0 2023-08-11T12:25:18.798 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.789+0000 7fc40b7fe700 10 client.25862 handle_command_reply: tid=0 2023-08-11T12:25:18.798 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.789+0000 7fc4461c7b80 1 client.25862 shutdown 2023-08-11T12:25:18.798 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.790+0000 7fc4461c7b80 1 -- 172.21.15.8:0/2873349757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557a8726ff0 msgr2=0x5557a8735b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:18.799 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.790+0000 7fc4461c7b80 1 --2- 172.21.15.8:0/2873349757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557a8726ff0 0x5557a8735b80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc420003920 tx=0x7fc4200047c0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.799 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.790+0000 7fc4461c7b80 1 -- 172.21.15.8:0/2873349757 shutdown_connections 2023-08-11T12:25:18.799 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.790+0000 7fc4461c7b80 1 --2- 172.21.15.8:0/2873349757 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5557a873fbf0 0x5557a8742010 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.799 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.790+0000 7fc4461c7b80 1 --2- 172.21.15.8:0/2873349757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5557a872be80 0x5557a872f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.799 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.790+0000 7fc4461c7b80 1 --2- 172.21.15.8:0/2873349757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557a8726630 0x5557a8735640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.799 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.790+0000 7fc40b7fe700 0 client.25862 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:18.799 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.790+0000 7fc4461c7b80 1 --2- 172.21.15.8:0/2873349757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557a8726ff0 0x5557a8735b80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.799 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.790+0000 7fc4461c7b80 1 -- 172.21.15.8:0/2873349757 >> 172.21.15.8:0/2873349757 conn(0x5557a86538f0 msgr2=0x5557a87205d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.790+0000 7fc4461c7b80 1 -- 172.21.15.8:0/2873349757 shutdown_connections 2023-08-11T12:25:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.790+0000 7fc4461c7b80 1 -- 172.21.15.8:0/2873349757 wait complete. 2023-08-11T12:25:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.790+0000 7fc4461c7b80 20 client.25862 trim_cache size 0 max 16384 2023-08-11T12:25:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.810+0000 7fc4461c7b80 1 Processor -- start 2023-08-11T12:25:18.814 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.810+0000 7fc4461c7b80 1 -- start start 2023-08-11T12:25:18.814 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.811+0000 7fc4461c7b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557a8726630 0x5557a872b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:18.814 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.811+0000 7fc4461c7b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5557a8726ff0 0x5557a872d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:18.815 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.811+0000 7fc4461c7b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557a872be80 0x5557a872f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:18.815 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.811+0000 7fc4461c7b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557a8721ad0 con 0x5557a8726630 2023-08-11T12:25:18.815 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.811+0000 7fc4461c7b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557a871bc20 con 0x5557a872be80 2023-08-11T12:25:18.815 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.811+0000 7fc4461c7b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557a872df20 con 0x5557a8726ff0 2023-08-11T12:25:18.817 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.811+0000 7fc42bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557a8726630 0x5557a872b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:18.817 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.811+0000 7fc42bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557a8726630 0x5557a872b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32854/0 (socket says 172.21.15.8:32854) 2023-08-11T12:25:18.817 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.811+0000 7fc42bfff700 1 -- 172.21.15.8:0/2970771977 learned_addr learned my addr 172.21.15.8:0/2970771977 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:18.817 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.811+0000 7fc42b7fe700 1 --2- 172.21.15.8:0/2970771977 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5557a8726ff0 0x5557a872d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:18.817 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.811+0000 7fc430d9c700 1 --2- 172.21.15.8:0/2970771977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557a872be80 0x5557a872f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.811+0000 7fc42bfff700 1 -- 172.21.15.8:0/2970771977 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5557a8726ff0 msgr2=0x5557a872d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.812+0000 7fc42bfff700 1 --2- 172.21.15.8:0/2970771977 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5557a8726ff0 0x5557a872d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.812+0000 7fc42bfff700 1 -- 172.21.15.8:0/2970771977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557a872be80 msgr2=0x5557a872f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.812+0000 7fc42bfff700 1 --2- 172.21.15.8:0/2970771977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557a872be80 0x5557a872f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.812+0000 7fc42bfff700 1 -- 172.21.15.8:0/2970771977 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557a848dc00 con 0x5557a8726630 2023-08-11T12:25:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.812+0000 7fc42bfff700 1 --2- 172.21.15.8:0/2970771977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557a8726630 0x5557a872b140 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc41c096700 tx=0x7fc41c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18768338b7687439 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.812+0000 7fc412ffd700 1 -- 172.21.15.8:0/2970771977 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c0b2270 con 0x5557a8726630 2023-08-11T12:25:18.819 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.812+0000 7fc412ffd700 1 -- 172.21.15.8:0/2970771977 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc41c0985a0 con 0x5557a8726630 2023-08-11T12:25:18.819 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.812+0000 7fc412ffd700 1 -- 172.21.15.8:0/2970771977 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c09a680 con 0x5557a8726630 2023-08-11T12:25:18.819 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.813+0000 7fc4461c7b80 1 -- 172.21.15.8:0/2970771977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557a8726630 msgr2=0x5557a872b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:18.819 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.813+0000 7fc4461c7b80 1 --2- 172.21.15.8:0/2970771977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557a8726630 0x5557a872b140 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc41c096700 tx=0x7fc41c005fd0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.819 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.813+0000 7fc4461c7b80 1 -- 172.21.15.8:0/2970771977 shutdown_connections 2023-08-11T12:25:18.819 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.813+0000 7fc4461c7b80 1 --2- 172.21.15.8:0/2970771977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557a872be80 0x5557a872f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.819 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.813+0000 7fc4461c7b80 1 --2- 172.21.15.8:0/2970771977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557a8726630 0x5557a872b140 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.820 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.813+0000 7fc4461c7b80 1 --2- 172.21.15.8:0/2970771977 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5557a8726ff0 0x5557a872d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.820 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.813+0000 7fc4461c7b80 1 -- 172.21.15.8:0/2970771977 >> 172.21.15.8:0/2970771977 conn(0x5557a86538f0 msgr2=0x5557a872aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:18.820 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.813+0000 7fc4461c7b80 1 -- 172.21.15.8:0/2970771977 shutdown_connections 2023-08-11T12:25:18.820 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.813+0000 7fc4461c7b80 1 -- 172.21.15.8:0/2970771977 wait complete. 2023-08-11T12:25:18.820 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.813+0000 7fc4461c7b80 1 -- start start 2023-08-11T12:25:18.820 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.814+0000 7fc4461c7b80 1 Processor -- start 2023-08-11T12:25:18.820 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.814+0000 7fc4461c7b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5557a8726630 0x5557a8733110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:18.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.814+0000 7fc4461c7b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557a8726ff0 0x5557a8733650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:18.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.814+0000 7fc4461c7b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557a872be80 0x5557a8733b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:18.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.814+0000 7fc4461c7b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557a8735650 con 0x5557a872be80 2023-08-11T12:25:18.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.814+0000 7fc4461c7b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557a87928a0 con 0x5557a8726ff0 2023-08-11T12:25:18.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.814+0000 7fc4461c7b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557a8792a10 con 0x5557a8726630 2023-08-11T12:25:18.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.814+0000 7fc4461c7b80 10 client.0 _ll_register_callbacks cb 0x5557a8619a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:25:18.823 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.814+0000 7fc430d9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557a872be80 0x5557a8733b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:18.823 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.814+0000 7fc430d9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557a872be80 0x5557a8733b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32860/0 (socket says 172.21.15.8:32860) 2023-08-11T12:25:18.823 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.814+0000 7fc430d9c700 1 -- 172.21.15.8:0/3253396948 learned_addr learned my addr 172.21.15.8:0/3253396948 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:18.823 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.814+0000 7fc42b7fe700 1 --2- 172.21.15.8:0/3253396948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557a8726ff0 0x5557a8733650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:18.824 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.814+0000 7fc42bfff700 1 --2- 172.21.15.8:0/3253396948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5557a8726630 0x5557a8733110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:18.824 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.815+0000 7fc430d9c700 1 -- 172.21.15.8:0/3253396948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5557a8726630 msgr2=0x5557a8733110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:18.824 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.815+0000 7fc430d9c700 1 --2- 172.21.15.8:0/3253396948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5557a8726630 0x5557a8733110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.824 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.815+0000 7fc430d9c700 1 -- 172.21.15.8:0/3253396948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557a8726ff0 msgr2=0x5557a8733650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:18.824 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.815+0000 7fc430d9c700 1 --2- 172.21.15.8:0/3253396948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557a8726ff0 0x5557a8733650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.825 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.815+0000 7fc430d9c700 1 -- 172.21.15.8:0/3253396948 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5557a84f85d0 con 0x5557a872be80 2023-08-11T12:25:18.825 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.815+0000 7fc42b7fe700 1 --2- 172.21.15.8:0/3253396948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557a8726ff0 0x5557a8733650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:18.825 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.815+0000 7fc430d9c700 1 --2- 172.21.15.8:0/3253396948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557a872be80 0x5557a8733b90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc42c074d30 tx=0x7fc424004850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e75678a61ed3506 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:18.825 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.815+0000 7fc40b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:25:18.825 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.815+0000 7fc40b7fe700 1 -- 172.21.15.8:0/3253396948 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc424004db0 con 0x5557a872be80 2023-08-11T12:25:18.825 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.815+0000 7fc4461c7b80 1 -- 172.21.15.8:0/3253396948 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc41c09e030 con 0x5557a872be80 2023-08-11T12:25:18.825 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.815+0000 7fc40b7fe700 1 -- 172.21.15.8:0/3253396948 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fc4240048c0 con 0x5557a872be80 2023-08-11T12:25:18.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.816+0000 7fc40b7fe700 1 -- 172.21.15.8:0/3253396948 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc424007970 con 0x5557a872be80 2023-08-11T12:25:18.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.816+0000 7fc4461c7b80 10 client.15849 fetch_fsmap learned FSMap version 31 2023-08-11T12:25:18.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.816+0000 7fc4461c7b80 1 -- 172.21.15.8:0/3253396948 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5557a84cb1f0 con 0x5557a872be80 2023-08-11T12:25:18.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.816+0000 7fc40b7fe700 1 -- 172.21.15.8:0/3253396948 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc41c09e030 con 0x5557a872be80 2023-08-11T12:25:18.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.816+0000 7fc40b7fe700 1 -- 172.21.15.8:0/3253396948 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 31) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fc42400ed40 con 0x5557a872be80 2023-08-11T12:25:18.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.816+0000 7fc4461c7b80 10 client.15849 fetch_fsmap finished waiting for FSMap version 31 2023-08-11T12:25:18.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.816+0000 7fc4461c7b80 10 client.15849 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-11T12:25:18.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.816+0000 7fc4461c7b80 20 client.15849 populate_metadata read hostname 'smithi008' 2023-08-11T12:25:18.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.816+0000 7fc4461c7b80 1 --2- 172.21.15.8:0/3253396948 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5557a87942b0 0x5557a87966d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:18.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.816+0000 7fc4461c7b80 4 client.15849 mds_command: new command op to 24575 tid=0[{"prefix": "flush journal"}] 2023-08-11T12:25:18.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.816+0000 7fc4461c7b80 1 -- 172.21.15.8:0/3253396948 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5557a86717c0 con 0x5557a87942b0 2023-08-11T12:25:18.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.817+0000 7fc42bfff700 1 --2- 172.21.15.8:0/3253396948 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5557a87942b0 0x5557a87966d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:18.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.817+0000 7fc42bfff700 1 --2- 172.21.15.8:0/3253396948 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5557a87942b0 0x5557a87966d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b09b7fb69f6973d server_cookie=3c24effac97b908c in_seq=0 out_seq=0 2023-08-11T12:25:18.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.817+0000 7fc40b7fe700 10 client.15849 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.827+0000 7fc40b7fe700 1 -- 172.21.15.8:0/3253396948 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5557a86717c0 con 0x5557a87942b0 2023-08-11T12:25:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.827+0000 7fc40b7fe700 10 client.15849 handle_command_reply: tid=0 2023-08-11T12:25:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.827+0000 7fc4461c7b80 1 client.15849 shutdown 2023-08-11T12:25:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.828+0000 7fc4461c7b80 1 -- 172.21.15.8:0/3253396948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557a872be80 msgr2=0x5557a8733b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.828+0000 7fc4461c7b80 1 --2- 172.21.15.8:0/3253396948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557a872be80 0x5557a8733b90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc42c074d30 tx=0x7fc424004850 comp rx=0 tx=0).stop 2023-08-11T12:25:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.828+0000 7fc4461c7b80 1 -- 172.21.15.8:0/3253396948 shutdown_connections 2023-08-11T12:25:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.828+0000 7fc4461c7b80 1 --2- 172.21.15.8:0/3253396948 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5557a87942b0 0x5557a87966d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.828+0000 7fc4461c7b80 1 --2- 172.21.15.8:0/3253396948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5557a8726630 0x5557a8733110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.828+0000 7fc4461c7b80 1 --2- 172.21.15.8:0/3253396948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557a872be80 0x5557a8733b90 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.828+0000 7fc4461c7b80 1 --2- 172.21.15.8:0/3253396948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557a8726ff0 0x5557a8733650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.828+0000 7fc40b7fe700 0 client.15849 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.828+0000 7fc4461c7b80 1 -- 172.21.15.8:0/3253396948 >> 172.21.15.8:0/3253396948 conn(0x5557a86538f0 msgr2=0x5557a8725620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.828+0000 7fc4461c7b80 1 -- 172.21.15.8:0/3253396948 shutdown_connections 2023-08-11T12:25:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.828+0000 7fc4461c7b80 1 -- 172.21.15.8:0/3253396948 wait complete. 2023-08-11T12:25:18.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.828+0000 7fc4461c7b80 20 client.15849 trim_cache size 0 max 16384 2023-08-11T12:25:18.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-08-11T12:25:18.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-08-11T12:25:18.834 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-08-11T12:25:18.834 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-08-11T12:25:18.834 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.829+0000 7fc4327ff700 1 -- 172.21.15.8:0/315572772 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fc4140a01e0 msgr2=0x7fc4140a26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:18.834 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.829+0000 7fc4327ff700 1 --2- 172.21.15.8:0/315572772 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fc4140a01e0 0x7fc4140a26a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc42c074410 tx=0x7fc420009260 comp rx=0 tx=0).stop 2023-08-11T12:25:18.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.829+0000 7fc4327ff700 1 -- 172.21.15.8:0/315572772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc42c1008c0 msgr2=0x7fc42c072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:18.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.829+0000 7fc4327ff700 1 --2- 172.21.15.8:0/315572772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc42c1008c0 0x7fc42c072c20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc41c000c00 tx=0x7fc41c005740 comp rx=0 tx=0).stop 2023-08-11T12:25:18.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.829+0000 7fc4327ff700 1 -- 172.21.15.8:0/315572772 shutdown_connections 2023-08-11T12:25:18.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.829+0000 7fc4327ff700 1 --2- 172.21.15.8:0/315572772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc42c1068d0 0x7fc42c1a4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.829+0000 7fc4327ff700 1 --2- 172.21.15.8:0/315572772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc42c1008c0 0x7fc42c072c20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.829+0000 7fc4327ff700 1 --2- 172.21.15.8:0/315572772 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fc4140a01e0 0x7fc4140a26a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.829+0000 7fc4327ff700 1 --2- 172.21.15.8:0/315572772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc42c101280 0x7fc42c073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:18.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.829+0000 7fc4327ff700 1 -- 172.21.15.8:0/315572772 >> 172.21.15.8:0/315572772 conn(0x7fc42c0fc3d0 msgr2=0x7fc42c0fc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:18.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.829+0000 7fc4327ff700 1 -- 172.21.15.8:0/315572772 shutdown_connections 2023-08-11T12:25:18.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:18.829+0000 7fc4327ff700 1 -- 172.21.15.8:0/315572772 wait complete. 2023-08-11T12:25:18.941 INFO:teuthology.orchestra.run.smithi008.stderr:4800000 of 50000000 tuples (9%) done (elapsed 23.63 s, remaining 222.50 s) 2023-08-11T12:25:19.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:18 smithi194 ceph-mon[130905]: pgmap v24: 129 pgs: 129 active+clean; 460 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 39 MiB/s wr, 424 op/s 2023-08-11T12:25:19.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:18 smithi045 ceph-mon[130284]: pgmap v24: 129 pgs: 129 active+clean; 460 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 39 MiB/s wr, 424 op/s 2023-08-11T12:25:19.281 INFO:teuthology.orchestra.run.smithi008.stderr:4900000 of 50000000 tuples (9%) done (elapsed 23.97 s, remaining 220.61 s) 2023-08-11T12:25:19.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:18 smithi008 ceph-mon[97158]: pgmap v24: 129 pgs: 129 active+clean; 460 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 39 MiB/s wr, 424 op/s 2023-08-11T12:25:19.662 INFO:teuthology.orchestra.run.smithi008.stderr:5000000 of 50000000 tuples (10%) done (elapsed 24.35 s, remaining 219.14 s) 2023-08-11T12:25:19.883 INFO:teuthology.orchestra.run.smithi008.stderr:5100000 of 50000000 tuples (10%) done (elapsed 24.57 s, remaining 216.31 s) 2023-08-11T12:25:20.208 INFO:teuthology.orchestra.run.smithi008.stderr:5200000 of 50000000 tuples (10%) done (elapsed 24.90 s, remaining 214.48 s) 2023-08-11T12:25:20.549 INFO:teuthology.orchestra.run.smithi008.stderr:5300000 of 50000000 tuples (10%) done (elapsed 25.24 s, remaining 212.84 s) 2023-08-11T12:25:20.743 INFO:teuthology.orchestra.run.smithi008.stderr:5400000 of 50000000 tuples (10%) done (elapsed 25.43 s, remaining 210.03 s) 2023-08-11T12:25:21.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:20 smithi008 ceph-mon[97158]: pgmap v25: 129 pgs: 129 active+clean; 460 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 36 MiB/s wr, 162 op/s 2023-08-11T12:25:21.099 INFO:teuthology.orchestra.run.smithi008.stderr:5500000 of 50000000 tuples (11%) done (elapsed 25.79 s, remaining 208.63 s) 2023-08-11T12:25:21.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:20 smithi194 ceph-mon[130905]: pgmap v25: 129 pgs: 129 active+clean; 460 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 36 MiB/s wr, 162 op/s 2023-08-11T12:25:21.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:20 smithi045 ceph-mon[130284]: pgmap v25: 129 pgs: 129 active+clean; 460 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 36 MiB/s wr, 162 op/s 2023-08-11T12:25:21.429 INFO:teuthology.orchestra.run.smithi008.stderr:5600000 of 50000000 tuples (11%) done (elapsed 26.12 s, remaining 207.07 s) 2023-08-11T12:25:21.537 INFO:teuthology.orchestra.run.smithi008.stderr:5700000 of 50000000 tuples (11%) done (elapsed 26.22 s, remaining 203.81 s) 2023-08-11T12:25:21.930 INFO:teuthology.orchestra.run.smithi008.stderr:5800000 of 50000000 tuples (11%) done (elapsed 26.62 s, remaining 202.84 s) 2023-08-11T12:25:22.520 INFO:teuthology.orchestra.run.smithi008.stderr:5900000 of 50000000 tuples (11%) done (elapsed 27.21 s, remaining 203.36 s) 2023-08-11T12:25:22.672 INFO:teuthology.orchestra.run.smithi008.stderr:6000000 of 50000000 tuples (12%) done (elapsed 27.36 s, remaining 200.63 s) 2023-08-11T12:25:23.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:22 smithi194 ceph-mon[130905]: pgmap v26: 129 pgs: 129 active+clean; 560 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 53 MiB/s wr, 179 op/s 2023-08-11T12:25:23.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:22 smithi045 ceph-mon[130284]: pgmap v26: 129 pgs: 129 active+clean; 560 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 53 MiB/s wr, 179 op/s 2023-08-11T12:25:23.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:22 smithi008 ceph-mon[97158]: pgmap v26: 129 pgs: 129 active+clean; 560 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 53 MiB/s wr, 179 op/s 2023-08-11T12:25:23.971 INFO:teuthology.orchestra.run.smithi008.stderr:6100000 of 50000000 tuples (12%) done (elapsed 28.66 s, remaining 206.24 s) 2023-08-11T12:25:24.424 INFO:teuthology.orchestra.run.smithi008.stderr:6200000 of 50000000 tuples (12%) done (elapsed 29.11 s, remaining 205.63 s) 2023-08-11T12:25:24.923 INFO:teuthology.orchestra.run.smithi008.stderr:6300000 of 50000000 tuples (12%) done (elapsed 29.61 s, remaining 205.39 s) 2023-08-11T12:25:25.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:24 smithi194 ceph-mon[130905]: pgmap v27: 129 pgs: 129 active+clean; 636 MiB data, 702 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 61 MiB/s wr, 97 op/s 2023-08-11T12:25:25.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:24 smithi045 ceph-mon[130284]: pgmap v27: 129 pgs: 129 active+clean; 636 MiB data, 702 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 61 MiB/s wr, 97 op/s 2023-08-11T12:25:25.197 INFO:teuthology.orchestra.run.smithi008.stderr:6400000 of 50000000 tuples (12%) done (elapsed 29.88 s, remaining 203.58 s) 2023-08-11T12:25:25.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:24 smithi008 ceph-mon[97158]: pgmap v27: 129 pgs: 129 active+clean; 636 MiB data, 702 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 61 MiB/s wr, 97 op/s 2023-08-11T12:25:25.349 INFO:teuthology.orchestra.run.smithi008.stderr:6500000 of 50000000 tuples (13%) done (elapsed 30.04 s, remaining 201.01 s) 2023-08-11T12:25:25.845 INFO:teuthology.orchestra.run.smithi008.stderr:6600000 of 50000000 tuples (13%) done (elapsed 30.53 s, remaining 200.77 s) 2023-08-11T12:25:26.049 INFO:teuthology.orchestra.run.smithi008.stderr:6700000 of 50000000 tuples (13%) done (elapsed 30.74 s, remaining 198.64 s) 2023-08-11T12:25:26.356 INFO:teuthology.orchestra.run.smithi008.stderr:6800000 of 50000000 tuples (13%) done (elapsed 31.04 s, remaining 197.22 s) 2023-08-11T12:25:26.700 INFO:teuthology.orchestra.run.smithi008.stderr:6900000 of 50000000 tuples (13%) done (elapsed 31.39 s, remaining 196.05 s) 2023-08-11T12:25:26.912 INFO:teuthology.orchestra.run.smithi008.stderr:7000000 of 50000000 tuples (14%) done (elapsed 31.60 s, remaining 194.11 s) 2023-08-11T12:25:27.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:26 smithi194 ceph-mon[130905]: pgmap v28: 129 pgs: 129 active+clean; 636 MiB data, 702 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 59 MiB/s wr, 57 op/s 2023-08-11T12:25:27.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:26 smithi045 ceph-mon[130284]: pgmap v28: 129 pgs: 129 active+clean; 636 MiB data, 702 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 59 MiB/s wr, 57 op/s 2023-08-11T12:25:27.225 INFO:teuthology.orchestra.run.smithi008.stderr:7100000 of 50000000 tuples (14%) done (elapsed 31.91 s, remaining 192.82 s) 2023-08-11T12:25:27.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:26 smithi008 ceph-mon[97158]: pgmap v28: 129 pgs: 129 active+clean; 636 MiB data, 702 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 59 MiB/s wr, 57 op/s 2023-08-11T12:25:27.611 INFO:teuthology.orchestra.run.smithi008.stderr:7200000 of 50000000 tuples (14%) done (elapsed 32.30 s, remaining 192.00 s) 2023-08-11T12:25:27.817 INFO:teuthology.orchestra.run.smithi008.stderr:7300000 of 50000000 tuples (14%) done (elapsed 32.50 s, remaining 190.13 s) 2023-08-11T12:25:28.138 INFO:teuthology.orchestra.run.smithi008.stderr:7400000 of 50000000 tuples (14%) done (elapsed 32.83 s, remaining 188.97 s) 2023-08-11T12:25:28.498 INFO:teuthology.orchestra.run.smithi008.stderr:7500000 of 50000000 tuples (15%) done (elapsed 33.19 s, remaining 188.05 s) 2023-08-11T12:25:28.690 INFO:teuthology.orchestra.run.smithi008.stderr:7600000 of 50000000 tuples (15%) done (elapsed 33.38 s, remaining 186.21 s) 2023-08-11T12:25:28.993 INFO:teuthology.orchestra.run.smithi008.stderr:7700000 of 50000000 tuples (15%) done (elapsed 33.68 s, remaining 185.02 s) 2023-08-11T12:25:29.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:28 smithi194 ceph-mon[130905]: pgmap v29: 129 pgs: 129 active+clean; 1.6 GiB data, 950 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 149 MiB/s wr, 97 op/s 2023-08-11T12:25:29.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:28 smithi045 ceph-mon[130284]: pgmap v29: 129 pgs: 129 active+clean; 1.6 GiB data, 950 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 149 MiB/s wr, 97 op/s 2023-08-11T12:25:29.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:28 smithi008 ceph-mon[97158]: pgmap v29: 129 pgs: 129 active+clean; 1.6 GiB data, 950 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 149 MiB/s wr, 97 op/s 2023-08-11T12:25:29.348 INFO:teuthology.orchestra.run.smithi008.stderr:7800000 of 50000000 tuples (15%) done (elapsed 34.04 s, remaining 184.14 s) 2023-08-11T12:25:29.545 INFO:teuthology.orchestra.run.smithi008.stderr:7900000 of 50000000 tuples (15%) done (elapsed 34.23 s, remaining 182.43 s) 2023-08-11T12:25:29.868 INFO:teuthology.orchestra.run.smithi008.stderr:8000000 of 50000000 tuples (16%) done (elapsed 34.56 s, remaining 181.41 s) 2023-08-11T12:25:30.166 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:25:30.262 INFO:teuthology.orchestra.run.smithi008.stderr:8100000 of 50000000 tuples (16%) done (elapsed 34.95 s, remaining 180.78 s) 2023-08-11T12:25:30.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.388+0000 7f85e79ff700 1 -- 172.21.15.8:0/2451011613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85e01000f0 msgr2=0x7f85e010cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:30.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.388+0000 7f85e79ff700 1 --2- 172.21.15.8:0/2451011613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85e01000f0 0x7f85e010cdb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f85d0009990 tx=0x7f85d0009ca0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.388+0000 7f85e79ff700 1 -- 172.21.15.8:0/2451011613 shutdown_connections 2023-08-11T12:25:30.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.388+0000 7f85e79ff700 1 --2- 172.21.15.8:0/2451011613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85e010d2f0 0x7f85e010f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.388+0000 7f85e79ff700 1 --2- 172.21.15.8:0/2451011613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85e00ff740 0x7f85e00ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.388+0000 7f85e79ff700 1 --2- 172.21.15.8:0/2451011613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85e01000f0 0x7f85e010cdb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.388+0000 7f85e79ff700 1 -- 172.21.15.8:0/2451011613 >> 172.21.15.8:0/2451011613 conn(0x7f85e0076a30 msgr2=0x7f85e0076e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:30.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.388+0000 7f85e79ff700 1 -- 172.21.15.8:0/2451011613 shutdown_connections 2023-08-11T12:25:30.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.388+0000 7f85e79ff700 1 -- 172.21.15.8:0/2451011613 wait complete. 2023-08-11T12:25:30.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.389+0000 7f85e79ff700 1 Processor -- start 2023-08-11T12:25:30.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.389+0000 7f85e79ff700 1 -- start start 2023-08-11T12:25:30.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.390+0000 7f85e79ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85e00ff740 0x7f85e019ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:30.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.390+0000 7f85e79ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85e01000f0 0x7f85e019f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:30.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.390+0000 7f85e79ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85e010d2f0 0x7f85e0198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:30.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.390+0000 7f85e79ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e01991b0 con 0x7f85e010d2f0 2023-08-11T12:25:30.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.390+0000 7f85e79ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e0199320 con 0x7f85e00ff740 2023-08-11T12:25:30.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.390+0000 7f85e79ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e01994e0 con 0x7f85e01000f0 2023-08-11T12:25:30.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.390+0000 7f85e4f9a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85e01000f0 0x7f85e019f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:30.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.390+0000 7f85e579b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85e00ff740 0x7f85e019ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:30.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.390+0000 7f85e4f9a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85e01000f0 0x7f85e019f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:55288/0 (socket says 172.21.15.8:55288) 2023-08-11T12:25:30.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.390+0000 7f85e579b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85e00ff740 0x7f85e019ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:33676/0 (socket says 172.21.15.8:33676) 2023-08-11T12:25:30.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.390+0000 7f85e4f9a700 1 -- 172.21.15.8:0/2171108464 learned_addr learned my addr 172.21.15.8:0/2171108464 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:30.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.390+0000 7f85e5f9c700 1 --2- 172.21.15.8:0/2171108464 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85e010d2f0 0x7f85e0198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:30.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.390+0000 7f85e4f9a700 1 -- 172.21.15.8:0/2171108464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85e00ff740 msgr2=0x7f85e019ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:30.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.390+0000 7f85e4f9a700 1 --2- 172.21.15.8:0/2171108464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85e00ff740 0x7f85e019ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.390+0000 7f85e4f9a700 1 -- 172.21.15.8:0/2171108464 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85e010d2f0 msgr2=0x7f85e0198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:30.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.390+0000 7f85e4f9a700 1 --2- 172.21.15.8:0/2171108464 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85e010d2f0 0x7f85e0198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.390+0000 7f85e4f9a700 1 -- 172.21.15.8:0/2171108464 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d00095f0 con 0x7f85e01000f0 2023-08-11T12:25:30.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.391+0000 7f85e4f9a700 1 --2- 172.21.15.8:0/2171108464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85e01000f0 0x7f85e019f010 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f85d0005910 tx=0x7f85d0004710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:30.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.391+0000 7f85d67fc700 1 -- 172.21.15.8:0/2171108464 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d001d070 con 0x7f85e01000f0 2023-08-11T12:25:30.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.391+0000 7f85e79ff700 1 -- 172.21.15.8:0/2171108464 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e0199760 con 0x7f85e01000f0 2023-08-11T12:25:30.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.391+0000 7f85d67fc700 1 -- 172.21.15.8:0/2171108464 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f85d0022470 con 0x7f85e01000f0 2023-08-11T12:25:30.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.391+0000 7f85d67fc700 1 -- 172.21.15.8:0/2171108464 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d0017650 con 0x7f85e01000f0 2023-08-11T12:25:30.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.391+0000 7f85e79ff700 1 -- 172.21.15.8:0/2171108464 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e01a5ac0 con 0x7f85e01000f0 2023-08-11T12:25:30.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.396+0000 7f85fb3f5b80 1 Processor -- start 2023-08-11T12:25:30.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.396+0000 7f85fb3f5b80 1 -- start start 2023-08-11T12:25:30.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.397+0000 7f85fb3f5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3d4ef6310 0x55d3d4ef66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:30.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.397+0000 7f85fb3f5b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d3d4ef6c30 0x55d3d4ef08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:30.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.397+0000 7f85d67fc700 1 -- 172.21.15.8:0/2171108464 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 24) v1 ==== 134903+0+0 (secure 0 0 0) 0x7f85d00225e0 con 0x7f85e01000f0 2023-08-11T12:25:30.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.397+0000 7f85fb3f5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d3d4ef0e20 0x55d3d4ef1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:30.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.397+0000 7f85fb3f5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3d4e49630 con 0x55d3d4ef6310 2023-08-11T12:25:30.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.397+0000 7f85fb3f5b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3d4e46f50 con 0x55d3d4ef6c30 2023-08-11T12:25:30.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.397+0000 7f85fb3f5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3d4e42840 con 0x55d3d4ef0e20 2023-08-11T12:25:30.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.397+0000 7f85e5f9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3d4ef6310 0x55d3d4ef66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:30.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.397+0000 7f85e4f9a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d3d4ef0e20 0x55d3d4ef1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:30.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.397+0000 7f85e5f9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3d4ef6310 0x55d3d4ef66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39388/0 (socket says 172.21.15.8:39388) 2023-08-11T12:25:30.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.397+0000 7f85e5f9c700 1 -- 172.21.15.8:0/331217005 learned_addr learned my addr 172.21.15.8:0/331217005 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:30.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.397+0000 7f85e579b700 1 --2- 172.21.15.8:0/331217005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d3d4ef6c30 0x55d3d4ef08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:30.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.398+0000 7f85e4f9a700 1 -- 172.21.15.8:0/331217005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d3d4ef6c30 msgr2=0x55d3d4ef08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:30.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.398+0000 7f85e4f9a700 1 --2- 172.21.15.8:0/331217005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d3d4ef6c30 0x55d3d4ef08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.398+0000 7f85e4f9a700 1 -- 172.21.15.8:0/331217005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3d4ef6310 msgr2=0x55d3d4ef66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:30.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.398+0000 7f85e4f9a700 1 --2- 172.21.15.8:0/331217005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3d4ef6310 0x55d3d4ef66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.398+0000 7f85e4f9a700 1 -- 172.21.15.8:0/331217005 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3d4cc2630 con 0x55d3d4ef0e20 2023-08-11T12:25:30.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.398+0000 7f85e5f9c700 1 --2- 172.21.15.8:0/331217005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3d4ef6310 0x55d3d4ef66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:30.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.398+0000 7f85e4f9a700 1 --2- 172.21.15.8:0/331217005 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d3d4ef0e20 0x55d3d4ef1260 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f85d00ca190 tx=0x7f85d00d53c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b56b017db2b4afb4 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:30.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.399+0000 7f85cb7fe700 1 -- 172.21.15.8:0/331217005 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d00d5d80 con 0x55d3d4ef0e20 2023-08-11T12:25:30.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.399+0000 7f85cb7fe700 1 -- 172.21.15.8:0/331217005 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f85d00db8c0 con 0x55d3d4ef0e20 2023-08-11T12:25:30.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.399+0000 7f85cb7fe700 1 -- 172.21.15.8:0/331217005 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d00da740 con 0x55d3d4ef0e20 2023-08-11T12:25:30.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.399+0000 7f85d67fc700 1 --2- 172.21.15.8:0/2171108464 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f85cc0a01e0 0x7f85cc0a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:30.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.399+0000 7f85d67fc700 1 -- 172.21.15.8:0/2171108464 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f85d00ccf10 con 0x7f85e01000f0 2023-08-11T12:25:30.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.399+0000 7f85e5f9c700 1 --2- 172.21.15.8:0/2171108464 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f85cc0a01e0 0x7f85cc0a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:30.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.400+0000 7f85fb3f5b80 1 -- 172.21.15.8:0/331217005 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d3d4ef0e20 msgr2=0x55d3d4ef1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:30.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.400+0000 7f85fb3f5b80 1 --2- 172.21.15.8:0/331217005 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d3d4ef0e20 0x55d3d4ef1260 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f85d00ca190 tx=0x7f85d00d53c0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.401+0000 7f85fb3f5b80 1 -- 172.21.15.8:0/331217005 shutdown_connections 2023-08-11T12:25:30.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.401+0000 7f85fb3f5b80 1 --2- 172.21.15.8:0/331217005 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d3d4ef0e20 0x55d3d4ef1260 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.401+0000 7f85fb3f5b80 1 --2- 172.21.15.8:0/331217005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3d4ef6310 0x55d3d4ef66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.401+0000 7f85fb3f5b80 1 --2- 172.21.15.8:0/331217005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d3d4ef6c30 0x55d3d4ef08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.401+0000 7f85fb3f5b80 1 -- 172.21.15.8:0/331217005 >> 172.21.15.8:0/331217005 conn(0x55d3d4e1d950 msgr2=0x55d3d4eeb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:30.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.401+0000 7f85fb3f5b80 1 -- 172.21.15.8:0/331217005 shutdown_connections 2023-08-11T12:25:30.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.401+0000 7f85e5f9c700 1 --2- 172.21.15.8:0/2171108464 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f85cc0a01e0 0x7f85cc0a26a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f85d8009fd0 tx=0x7f85d800b040 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:30.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.401+0000 7f85fb3f5b80 1 -- 172.21.15.8:0/331217005 wait complete. 2023-08-11T12:25:30.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.402+0000 7f85fb3f5b80 1 -- start start 2023-08-11T12:25:30.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.402+0000 7f85fb3f5b80 1 Processor -- start 2023-08-11T12:25:30.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.403+0000 7f85fb3f5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3d4ef0e20 0x55d3d4efca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:30.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.403+0000 7f85fb3f5b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d3d4ef6310 0x55d3d4ef9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:30.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.403+0000 7f85fb3f5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d3d4ef6c30 0x55d3d4efa270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:30.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.403+0000 7f85fb3f5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3d4de0ac0 con 0x55d3d4ef0e20 2023-08-11T12:25:30.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.403+0000 7f85fb3f5b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3d4de07c0 con 0x55d3d4ef6310 2023-08-11T12:25:30.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.403+0000 7f85fb3f5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3d4cc4920 con 0x55d3d4ef6c30 2023-08-11T12:25:30.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.403+0000 7f85fb3f5b80 10 client.0 _ll_register_callbacks cb 0x55d3d4de3ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:25:30.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.403+0000 7f85e4f9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d3d4ef6310 0x55d3d4ef9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:30.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.404+0000 7f85e4f9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d3d4ef6310 0x55d3d4ef9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:33692/0 (socket says 172.21.15.8:33692) 2023-08-11T12:25:30.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.404+0000 7f85e4f9a700 1 -- 172.21.15.8:0/2723628367 learned_addr learned my addr 172.21.15.8:0/2723628367 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:30.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.404+0000 7f85e5f9c700 1 --2- 172.21.15.8:0/2723628367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d3d4ef6c30 0x55d3d4efa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:30.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.404+0000 7f85e579b700 1 --2- 172.21.15.8:0/2723628367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3d4ef0e20 0x55d3d4efca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:30.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.404+0000 7f85e4f9a700 1 -- 172.21.15.8:0/2723628367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d3d4ef6c30 msgr2=0x55d3d4efa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:30.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.404+0000 7f85e4f9a700 1 --2- 172.21.15.8:0/2723628367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d3d4ef6c30 0x55d3d4efa270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.404+0000 7f85e4f9a700 1 -- 172.21.15.8:0/2723628367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3d4ef0e20 msgr2=0x55d3d4efca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:30.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.404+0000 7f85e4f9a700 1 --2- 172.21.15.8:0/2723628367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3d4ef0e20 0x55d3d4efca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.404+0000 7f85e4f9a700 1 -- 172.21.15.8:0/2723628367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d8009050 con 0x55d3d4ef6310 2023-08-11T12:25:30.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.404+0000 7f85e4f9a700 1 --2- 172.21.15.8:0/2723628367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d3d4ef6310 0x55d3d4ef9d30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f85d0006010 tx=0x7f85d0000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43a700fc03c888d6 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:30.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.404+0000 7f85c8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:25:30.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.404+0000 7f85c8ff9700 1 -- 172.21.15.8:0/2723628367 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d0096450 con 0x55d3d4ef6310 2023-08-11T12:25:30.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.404+0000 7f85fb3f5b80 1 -- 172.21.15.8:0/2723628367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d3d4ee3a90 con 0x55d3d4ef6310 2023-08-11T12:25:30.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.405+0000 7f85c8ff9700 1 -- 172.21.15.8:0/2723628367 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f85d009a810 con 0x55d3d4ef6310 2023-08-11T12:25:30.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.405+0000 7f85c8ff9700 1 -- 172.21.15.8:0/2723628367 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85d0099ee0 con 0x55d3d4ef6310 2023-08-11T12:25:30.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.405+0000 7f85fb3f5b80 10 client.25880 fetch_fsmap learned FSMap version 31 2023-08-11T12:25:30.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.405+0000 7f85fb3f5b80 1 -- 172.21.15.8:0/2723628367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f85e01a5ac0 con 0x55d3d4ef6310 2023-08-11T12:25:30.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.405+0000 7f85c8ff9700 1 -- 172.21.15.8:0/2723628367 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d3d4ee3a90 con 0x55d3d4ef6310 2023-08-11T12:25:30.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.405+0000 7f85c8ff9700 1 -- 172.21.15.8:0/2723628367 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 31) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f85d00d50e0 con 0x55d3d4ef6310 2023-08-11T12:25:30.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.405+0000 7f85fb3f5b80 10 client.25880 fetch_fsmap finished waiting for FSMap version 31 2023-08-11T12:25:30.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.405+0000 7f85fb3f5b80 10 client.25880 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:25:30.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.405+0000 7f85fb3f5b80 20 client.25880 populate_metadata read hostname 'smithi008' 2023-08-11T12:25:30.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.405+0000 7f85fb3f5b80 1 --2- 172.21.15.8:0/2723628367 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55d3d4f09bd0 0x55d3d4f0bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:30.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.405+0000 7f85fb3f5b80 4 client.25880 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:25:30.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.405+0000 7f85fb3f5b80 1 -- 172.21.15.8:0/2723628367 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d3d4ebf4e0 con 0x55d3d4f09bd0 2023-08-11T12:25:30.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.406+0000 7f85e579b700 1 --2- 172.21.15.8:0/2723628367 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55d3d4f09bd0 0x55d3d4f0bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:30.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.406+0000 7f85e579b700 1 --2- 172.21.15.8:0/2723628367 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55d3d4f09bd0 0x55d3d4f0bff0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21607afb84d2e4bc server_cookie=8722be9bd797019b in_seq=0 out_seq=0 2023-08-11T12:25:30.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.406+0000 7f85c8ff9700 10 client.25880 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:30.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.407+0000 7f85c8ff9700 1 -- 172.21.15.8:0/2723628367 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55d3d4ebf4e0 con 0x55d3d4f09bd0 2023-08-11T12:25:30.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.407+0000 7f85c8ff9700 10 client.25880 handle_command_reply: tid=0 2023-08-11T12:25:30.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.407+0000 7f85fb3f5b80 1 client.25880 shutdown 2023-08-11T12:25:30.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.407+0000 7f85fb3f5b80 1 -- 172.21.15.8:0/2723628367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d3d4ef6310 msgr2=0x55d3d4ef9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:30.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.407+0000 7f85fb3f5b80 1 --2- 172.21.15.8:0/2723628367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d3d4ef6310 0x55d3d4ef9d30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f85d0006010 tx=0x7f85d0000bc0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.407+0000 7f85fb3f5b80 1 -- 172.21.15.8:0/2723628367 shutdown_connections 2023-08-11T12:25:30.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.407+0000 7f85fb3f5b80 1 --2- 172.21.15.8:0/2723628367 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55d3d4f09bd0 0x55d3d4f0bff0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.407+0000 7f85fb3f5b80 1 --2- 172.21.15.8:0/2723628367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d3d4ef6c30 0x55d3d4efa270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.407+0000 7f85fb3f5b80 1 --2- 172.21.15.8:0/2723628367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3d4ef0e20 0x55d3d4efca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.407+0000 7f85c8ff9700 0 client.25880 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:30.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.407+0000 7f85fb3f5b80 1 --2- 172.21.15.8:0/2723628367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d3d4ef6310 0x55d3d4ef9d30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.407+0000 7f85fb3f5b80 1 -- 172.21.15.8:0/2723628367 >> 172.21.15.8:0/2723628367 conn(0x55d3d4e1d950 msgr2=0x55d3d4ee5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:30.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.408+0000 7f85fb3f5b80 1 -- 172.21.15.8:0/2723628367 shutdown_connections 2023-08-11T12:25:30.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.408+0000 7f85fb3f5b80 1 -- 172.21.15.8:0/2723628367 wait complete. 2023-08-11T12:25:30.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.408+0000 7f85fb3f5b80 20 client.25880 trim_cache size 0 max 16384 2023-08-11T12:25:30.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.435+0000 7f85fb3f5b80 1 Processor -- start 2023-08-11T12:25:30.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.435+0000 7f85fb3f5b80 1 -- start start 2023-08-11T12:25:30.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.435+0000 7f85fb3f5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3d4ef0e20 0x55d3d4ef08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:30.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.436+0000 7f85fb3f5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d3d4ef6310 0x55d3d4ef78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:30.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.436+0000 7f85fb3f5b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d3d4ef6c30 0x55d3d4f01330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:30.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.436+0000 7f85fb3f5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3d4eeccb0 con 0x55d3d4ef0e20 2023-08-11T12:25:30.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.436+0000 7f85fb3f5b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3d4efa870 con 0x55d3d4ef6c30 2023-08-11T12:25:30.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.436+0000 7f85fb3f5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3d4efa5e0 con 0x55d3d4ef6310 2023-08-11T12:25:30.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.436+0000 7f85e579b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3d4ef0e20 0x55d3d4ef08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:30.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.436+0000 7f85e579b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3d4ef0e20 0x55d3d4ef08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39404/0 (socket says 172.21.15.8:39404) 2023-08-11T12:25:30.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.436+0000 7f85e579b700 1 -- 172.21.15.8:0/1019858584 learned_addr learned my addr 172.21.15.8:0/1019858584 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:30.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.436+0000 7f85e5f9c700 1 --2- 172.21.15.8:0/1019858584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d3d4ef6c30 0x55d3d4f01330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:30.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.436+0000 7f85e4f9a700 1 --2- 172.21.15.8:0/1019858584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d3d4ef6310 0x55d3d4ef78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:30.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.436+0000 7f85e579b700 1 -- 172.21.15.8:0/1019858584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d3d4ef6310 msgr2=0x55d3d4ef78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:30.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.436+0000 7f85e579b700 1 --2- 172.21.15.8:0/1019858584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d3d4ef6310 0x55d3d4ef78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.436+0000 7f85e579b700 1 -- 172.21.15.8:0/1019858584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d3d4ef6c30 msgr2=0x55d3d4f01330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:30.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.436+0000 7f85e579b700 1 --2- 172.21.15.8:0/1019858584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d3d4ef6c30 0x55d3d4f01330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.436+0000 7f85e579b700 1 -- 172.21.15.8:0/1019858584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3d4c6ede0 con 0x55d3d4ef0e20 2023-08-11T12:25:30.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.437+0000 7f85e579b700 1 --2- 172.21.15.8:0/1019858584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3d4ef0e20 0x55d3d4ef08e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x55d3d4f0c8d0 tx=0x7f85dc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4354febaf4ec9eb8 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:30.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.437+0000 7f85cbfff700 1 -- 172.21.15.8:0/1019858584 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc01f310 con 0x55d3d4ef0e20 2023-08-11T12:25:30.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.437+0000 7f85cbfff700 1 -- 172.21.15.8:0/1019858584 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f85dc018040 con 0x55d3d4ef0e20 2023-08-11T12:25:30.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.437+0000 7f85cbfff700 1 -- 172.21.15.8:0/1019858584 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc005020 con 0x55d3d4ef0e20 2023-08-11T12:25:30.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.438+0000 7f85fb3f5b80 1 -- 172.21.15.8:0/1019858584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3d4ef0e20 msgr2=0x55d3d4ef08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:30.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.438+0000 7f85fb3f5b80 1 --2- 172.21.15.8:0/1019858584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3d4ef0e20 0x55d3d4ef08e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x55d3d4f0c8d0 tx=0x7f85dc009260 comp rx=0 tx=0).stop 2023-08-11T12:25:30.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.439+0000 7f85fb3f5b80 1 -- 172.21.15.8:0/1019858584 shutdown_connections 2023-08-11T12:25:30.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.439+0000 7f85fb3f5b80 1 --2- 172.21.15.8:0/1019858584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d3d4ef6c30 0x55d3d4f01330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.439+0000 7f85fb3f5b80 1 --2- 172.21.15.8:0/1019858584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3d4ef0e20 0x55d3d4ef08e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.439+0000 7f85fb3f5b80 1 --2- 172.21.15.8:0/1019858584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d3d4ef6310 0x55d3d4ef78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.439+0000 7f85fb3f5b80 1 -- 172.21.15.8:0/1019858584 >> 172.21.15.8:0/1019858584 conn(0x55d3d4e1d950 msgr2=0x55d3d4ee5420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:30.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.439+0000 7f85fb3f5b80 1 -- 172.21.15.8:0/1019858584 shutdown_connections 2023-08-11T12:25:30.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.439+0000 7f85fb3f5b80 1 -- 172.21.15.8:0/1019858584 wait complete. 2023-08-11T12:25:30.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.440+0000 7f85fb3f5b80 1 -- start start 2023-08-11T12:25:30.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.440+0000 7f85fb3f5b80 1 Processor -- start 2023-08-11T12:25:30.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.442+0000 7f85fb3f5b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d3d4ef0e20 0x55d3d4ef1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:30.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.443+0000 7f85fb3f5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d3d4ef6310 0x55d3d4ef24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:30.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.443+0000 7f85fb3f5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3d4ef6c30 0x55d3d4ef29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:30.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.443+0000 7f85fb3f5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3d4f016b0 con 0x55d3d4ef6c30 2023-08-11T12:25:30.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.443+0000 7f85fb3f5b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3d4f5d880 con 0x55d3d4ef0e20 2023-08-11T12:25:30.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.443+0000 7f85fb3f5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3d4f5d9c0 con 0x55d3d4ef6310 2023-08-11T12:25:30.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.443+0000 7f85fb3f5b80 10 client.0 _ll_register_callbacks cb 0x7f85d8009da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:25:30.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.443+0000 7f85e579b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d3d4ef0e20 0x55d3d4ef1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:30.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.443+0000 7f85e579b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d3d4ef0e20 0x55d3d4ef1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:33718/0 (socket says 172.21.15.8:33718) 2023-08-11T12:25:30.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.443+0000 7f85e579b700 1 -- 172.21.15.8:0/3628977627 learned_addr learned my addr 172.21.15.8:0/3628977627 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:30.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.444+0000 7f85e5f9c700 1 --2- 172.21.15.8:0/3628977627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3d4ef6c30 0x55d3d4ef29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:30.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.444+0000 7f85e4f9a700 1 --2- 172.21.15.8:0/3628977627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d3d4ef6310 0x55d3d4ef24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:30.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.444+0000 7f85e579b700 1 -- 172.21.15.8:0/3628977627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d3d4ef6310 msgr2=0x55d3d4ef24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:30.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.444+0000 7f85e579b700 1 --2- 172.21.15.8:0/3628977627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d3d4ef6310 0x55d3d4ef24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.444+0000 7f85e579b700 1 -- 172.21.15.8:0/3628977627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3d4ef6c30 msgr2=0x55d3d4ef29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:30.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.444+0000 7f85e579b700 1 --2- 172.21.15.8:0/3628977627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3d4ef6c30 0x55d3d4ef29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.444+0000 7f85e579b700 1 -- 172.21.15.8:0/3628977627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85dc009b60 con 0x55d3d4ef0e20 2023-08-11T12:25:30.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.444+0000 7f85e5f9c700 1 --2- 172.21.15.8:0/3628977627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3d4ef6c30 0x55d3d4ef29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:25:30.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.445+0000 7f85e579b700 1 --2- 172.21.15.8:0/3628977627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d3d4ef0e20 0x55d3d4ef1f70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f85dc00a010 tx=0x7f85dc004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e80287005beb9f7 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:30.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.445+0000 7f85c8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:25:30.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.445+0000 7f85c8ff9700 1 -- 172.21.15.8:0/3628977627 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc01f310 con 0x55d3d4ef0e20 2023-08-11T12:25:30.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.445+0000 7f85c8ff9700 1 -- 172.21.15.8:0/3628977627 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f85dc01f470 con 0x55d3d4ef0e20 2023-08-11T12:25:30.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.445+0000 7f85fb3f5b80 1 -- 172.21.15.8:0/3628977627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f85d00db8c0 con 0x55d3d4ef0e20 2023-08-11T12:25:30.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.445+0000 7f85c8ff9700 1 -- 172.21.15.8:0/3628977627 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85dc004040 con 0x55d3d4ef0e20 2023-08-11T12:25:30.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.445+0000 7f85fb3f5b80 10 client.25886 fetch_fsmap learned FSMap version 31 2023-08-11T12:25:30.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.445+0000 7f85fb3f5b80 1 -- 172.21.15.8:0/3628977627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55d3d4c57c60 con 0x55d3d4ef0e20 2023-08-11T12:25:30.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.446+0000 7f85c8ff9700 1 -- 172.21.15.8:0/3628977627 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f85d00db8c0 con 0x55d3d4ef0e20 2023-08-11T12:25:30.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.446+0000 7f85c8ff9700 1 -- 172.21.15.8:0/3628977627 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 31) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f85dc011660 con 0x55d3d4ef0e20 2023-08-11T12:25:30.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.446+0000 7f85fb3f5b80 10 client.25886 fetch_fsmap finished waiting for FSMap version 31 2023-08-11T12:25:30.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.446+0000 7f85fb3f5b80 10 client.25886 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:25:30.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.446+0000 7f85fb3f5b80 20 client.25886 populate_metadata read hostname 'smithi008' 2023-08-11T12:25:30.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.446+0000 7f85fb3f5b80 1 --2- 172.21.15.8:0/3628977627 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55d3d4f67a30 0x55d3d4f69e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:30.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.446+0000 7f85fb3f5b80 4 client.25886 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:25:30.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.446+0000 7f85fb3f5b80 1 -- 172.21.15.8:0/3628977627 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d3d4e3b820 con 0x55d3d4f67a30 2023-08-11T12:25:30.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.447+0000 7f85e4f9a700 1 --2- 172.21.15.8:0/3628977627 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55d3d4f67a30 0x55d3d4f69e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:30.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.447+0000 7f85e4f9a700 1 --2- 172.21.15.8:0/3628977627 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55d3d4f67a30 0x55d3d4f69e50 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90f2a1270e9bea7f server_cookie=ee4b61dff4e3b151 in_seq=0 out_seq=0 2023-08-11T12:25:30.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.447+0000 7f85c8ff9700 10 client.25886 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:30.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.447+0000 7f85c8ff9700 1 -- 172.21.15.8:0/3628977627 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55d3d4e3b820 con 0x55d3d4f67a30 2023-08-11T12:25:30.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.447+0000 7f85c8ff9700 10 client.25886 handle_command_reply: tid=0 2023-08-11T12:25:30.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.447+0000 7f85fb3f5b80 1 client.25886 shutdown 2023-08-11T12:25:30.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.448+0000 7f85fb3f5b80 1 -- 172.21.15.8:0/3628977627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d3d4ef0e20 msgr2=0x55d3d4ef1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:30.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.448+0000 7f85fb3f5b80 1 --2- 172.21.15.8:0/3628977627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d3d4ef0e20 0x55d3d4ef1f70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f85dc00a010 tx=0x7f85dc004a40 comp rx=0 tx=0).stop 2023-08-11T12:25:30.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.448+0000 7f85fb3f5b80 1 -- 172.21.15.8:0/3628977627 shutdown_connections 2023-08-11T12:25:30.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.448+0000 7f85fb3f5b80 1 --2- 172.21.15.8:0/3628977627 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55d3d4f67a30 0x55d3d4f69e50 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.448+0000 7f85fb3f5b80 1 --2- 172.21.15.8:0/3628977627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3d4ef6c30 0x55d3d4ef29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.448+0000 7f85fb3f5b80 1 --2- 172.21.15.8:0/3628977627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d3d4ef0e20 0x55d3d4ef1f70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.448+0000 7f85c8ff9700 0 client.25886 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:30.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.448+0000 7f85fb3f5b80 1 --2- 172.21.15.8:0/3628977627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d3d4ef6310 0x55d3d4ef24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.448+0000 7f85fb3f5b80 1 -- 172.21.15.8:0/3628977627 >> 172.21.15.8:0/3628977627 conn(0x55d3d4e1d950 msgr2=0x55d3d4ef7710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:30.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.448+0000 7f85fb3f5b80 1 -- 172.21.15.8:0/3628977627 shutdown_connections 2023-08-11T12:25:30.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.448+0000 7f85fb3f5b80 1 -- 172.21.15.8:0/3628977627 wait complete. 2023-08-11T12:25:30.454 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:25:30.454 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2023-08-11T12:25:30.455 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2023-08-11T12:25:30.455 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:25:30.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.449+0000 7f85fb3f5b80 20 client.25886 trim_cache size 0 max 16384 2023-08-11T12:25:30.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.450+0000 7f85e79ff700 1 -- 172.21.15.8:0/2171108464 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f85cc0a01e0 msgr2=0x7f85cc0a26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:30.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.450+0000 7f85e79ff700 1 --2- 172.21.15.8:0/2171108464 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f85cc0a01e0 0x7f85cc0a26a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f85d8009fd0 tx=0x7f85d800b040 comp rx=0 tx=0).stop 2023-08-11T12:25:30.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.450+0000 7f85e79ff700 1 -- 172.21.15.8:0/2171108464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85e01000f0 msgr2=0x7f85e019f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:30.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.450+0000 7f85e79ff700 1 --2- 172.21.15.8:0/2171108464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85e01000f0 0x7f85e019f010 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f85d0005910 tx=0x7f85d0004710 comp rx=0 tx=0).stop 2023-08-11T12:25:30.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.450+0000 7f85e79ff700 1 -- 172.21.15.8:0/2171108464 shutdown_connections 2023-08-11T12:25:30.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.450+0000 7f85e79ff700 1 --2- 172.21.15.8:0/2171108464 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85e010d2f0 0x7f85e0198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.450+0000 7f85e79ff700 1 --2- 172.21.15.8:0/2171108464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85e00ff740 0x7f85e019ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.450+0000 7f85e79ff700 1 --2- 172.21.15.8:0/2171108464 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f85cc0a01e0 0x7f85cc0a26a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.450+0000 7f85e79ff700 1 --2- 172.21.15.8:0/2171108464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85e01000f0 0x7f85e019f010 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.450+0000 7f85e79ff700 1 -- 172.21.15.8:0/2171108464 >> 172.21.15.8:0/2171108464 conn(0x7f85e0076a30 msgr2=0x7f85e010e620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:30.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.450+0000 7f85e79ff700 1 -- 172.21.15.8:0/2171108464 shutdown_connections 2023-08-11T12:25:30.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.450+0000 7f85e79ff700 1 -- 172.21.15.8:0/2171108464 wait complete. 2023-08-11T12:25:30.469 INFO:teuthology.orchestra.run.smithi008.stderr:8200000 of 50000000 tuples (16%) done (elapsed 35.16 s, remaining 179.21 s) 2023-08-11T12:25:30.473 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-08-11T12:25:30.474 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-11T12:25:30.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.689+0000 7f6a0a3ff700 1 -- 172.21.15.8:0/1447538523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a04106960 msgr2=0x7f6a04106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:30.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.689+0000 7f6a0a3ff700 1 --2- 172.21.15.8:0/1447538523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a04106960 0x7f6a04106d40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f69f40098f0 tx=0x7f69f4009c00 comp rx=0 tx=0).stop 2023-08-11T12:25:30.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.689+0000 7f6a0a3ff700 1 -- 172.21.15.8:0/1447538523 shutdown_connections 2023-08-11T12:25:30.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.689+0000 7f6a0a3ff700 1 --2- 172.21.15.8:0/1447538523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a04101310 0x7f6a0410d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.689+0000 7f6a0a3ff700 1 --2- 172.21.15.8:0/1447538523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a04106960 0x7f6a04106d40 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.689+0000 7f6a0a3ff700 1 --2- 172.21.15.8:0/1447538523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a04100950 0x7f6a04100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.689+0000 7f6a0a3ff700 1 -- 172.21.15.8:0/1447538523 >> 172.21.15.8:0/1447538523 conn(0x7f6a040fc460 msgr2=0x7f6a040fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:30.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.689+0000 7f6a0a3ff700 1 -- 172.21.15.8:0/1447538523 shutdown_connections 2023-08-11T12:25:30.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.689+0000 7f6a0a3ff700 1 -- 172.21.15.8:0/1447538523 wait complete. 2023-08-11T12:25:30.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.690+0000 7f6a0a3ff700 1 Processor -- start 2023-08-11T12:25:30.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.690+0000 7f6a0a3ff700 1 -- start start 2023-08-11T12:25:30.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.690+0000 7f6a0a3ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a04100950 0x7f6a0419ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:30.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.691+0000 7f6a0a3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a04101310 0x7f6a0419efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:30.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.691+0000 7f6a0a3ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a04106960 0x7f6a04198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:30.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.691+0000 7f6a0a3ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a04199240 con 0x7f6a04100950 2023-08-11T12:25:30.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.691+0000 7f6a0a3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a041993b0 con 0x7f6a04101310 2023-08-11T12:25:30.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.691+0000 7f6a0a3ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a04199570 con 0x7f6a04106960 2023-08-11T12:25:30.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.691+0000 7f6a03fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a04100950 0x7f6a0419ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:30.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.691+0000 7f6a03fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a04100950 0x7f6a0419ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39430/0 (socket says 172.21.15.8:39430) 2023-08-11T12:25:30.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.691+0000 7f6a03fff700 1 -- 172.21.15.8:0/2050617569 learned_addr learned my addr 172.21.15.8:0/2050617569 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:30.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.691+0000 7f6a037fe700 1 --2- 172.21.15.8:0/2050617569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a04101310 0x7f6a0419efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:30.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.691+0000 7f6a0899c700 1 --2- 172.21.15.8:0/2050617569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a04106960 0x7f6a04198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:30.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.691+0000 7f6a03fff700 1 -- 172.21.15.8:0/2050617569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a04106960 msgr2=0x7f6a04198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:30.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.691+0000 7f6a03fff700 1 --2- 172.21.15.8:0/2050617569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a04106960 0x7f6a04198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.691+0000 7f6a03fff700 1 -- 172.21.15.8:0/2050617569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a04101310 msgr2=0x7f6a0419efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:30.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.691+0000 7f6a03fff700 1 --2- 172.21.15.8:0/2050617569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a04101310 0x7f6a0419efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.691+0000 7f6a03fff700 1 -- 172.21.15.8:0/2050617569 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f80095f0 con 0x7f6a04100950 2023-08-11T12:25:30.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.691+0000 7f6a03fff700 1 --2- 172.21.15.8:0/2050617569 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a04100950 0x7f6a0419ea90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009810 tx=0x7f69f400fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:30.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.692+0000 7f6a017fa700 1 -- 172.21.15.8:0/2050617569 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f401c070 con 0x7f6a04100950 2023-08-11T12:25:30.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.692+0000 7f6a017fa700 1 -- 172.21.15.8:0/2050617569 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f69f400bbd0 con 0x7f6a04100950 2023-08-11T12:25:30.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.692+0000 7f6a017fa700 1 -- 172.21.15.8:0/2050617569 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f40049c0 con 0x7f6a04100950 2023-08-11T12:25:30.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.692+0000 7f6a0a3ff700 1 -- 172.21.15.8:0/2050617569 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f4009520 con 0x7f6a04100950 2023-08-11T12:25:30.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.692+0000 7f6a0a3ff700 1 -- 172.21.15.8:0/2050617569 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a041a5830 con 0x7f6a04100950 2023-08-11T12:25:30.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.693+0000 7f6a0a3ff700 1 -- 172.21.15.8:0/2050617569 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a040677a0 con 0x7f6a04100950 2023-08-11T12:25:30.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.695+0000 7f6a017fa700 1 -- 172.21.15.8:0/2050617569 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 24) v1 ==== 134903+0+0 (secure 0 0 0) 0x7f69f4020070 con 0x7f6a04100950 2023-08-11T12:25:30.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.697+0000 7f6a017fa700 1 --2- 172.21.15.8:0/2050617569 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f69ec0a0260 0x7f69ec0a2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:30.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.698+0000 7f6a017fa700 1 -- 172.21.15.8:0/2050617569 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f69f40ccc90 con 0x7f6a04100950 2023-08-11T12:25:30.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.698+0000 7f6a037fe700 1 --2- 172.21.15.8:0/2050617569 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f69ec0a0260 0x7f69ec0a2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:30.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.698+0000 7f6a037fe700 1 --2- 172.21.15.8:0/2050617569 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f69ec0a0260 0x7f69ec0a2720 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6a0419a2a0 tx=0x7f69f8009310 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:30.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.701+0000 7f6a017fa700 1 -- 172.21.15.8:0/2050617569 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f69f40961d0 con 0x7f6a04100950 2023-08-11T12:25:30.787 INFO:teuthology.orchestra.run.smithi008.stderr:8300000 of 50000000 tuples (16%) done (elapsed 35.47 s, remaining 178.23 s) 2023-08-11T12:25:30.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:30 smithi008 ceph-mon[97158]: pgmap v30: 129 pgs: 129 active+clean; 1.6 GiB data, 950 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 119 MiB/s wr, 66 op/s 2023-08-11T12:25:30.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.968+0000 7f6a0a3ff700 1 -- 172.21.15.8:0/2050617569 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a04199fa0 con 0x7f6a04100950 2023-08-11T12:25:30.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.969+0000 7f6a017fa700 1 -- 172.21.15.8:0/2050617569 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+11360 (secure 0 0 0) 0x7f69f40997f0 con 0x7f6a04100950 2023-08-11T12:25:30.971 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:25:30.971 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14469,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2854286216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2854286216},{"type":"v1","addr":"172.21.15.8:6835","nonce":2854286216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/805368621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":805368621},{"type":"v1","addr":"172.21.15.8:6837","nonce":805368621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-11T12:22:03.398475+0000","modified":"2023-08-11T12:25:12.831024+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24575,"mds_1":24550,"mds_2":24517,"mds_3":24500,"mds_4":24464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14526":{"gid":14526,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/2990530720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":2990530720},{"type":"v1","addr":"172.21.15.8:6839","nonce":2990530720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14538":{"gid":14538,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6841/3589272762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":3589272762},{"type":"v1","addr":"172.21.15.8:6841","nonce":3589272762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6833/2043443402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2043443402},{"type":"v1","addr":"172.21.15.194:6833","nonce":2043443402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24464":{"gid":24464,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.45:6833/1208864615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1208864615},{"type":"v1","addr":"172.21.15.45:6833","nonce":1208864615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24500":{"gid":24500,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.45:6835/1776075470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1776075470},{"type":"v1","addr":"172.21.15.45:6835","nonce":1776075470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24517":{"gid":24517,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.194:6835/2457430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2457430285},{"type":"v1","addr":"172.21.15.194:6835","nonce":2457430285}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24529":{"gid":24529,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/3072808560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":3072808560},{"type":"v1","addr":"172.21.15.194:6837","nonce":3072808560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/641549061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":641549061},{"type":"v1","addr":"172.21.15.45:6837","nonce":641549061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.194:6839/2174476491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":2174476491},{"type":"v1","addr":"172.21.15.194:6839","nonce":2174476491}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6839/119684732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":119684732},{"type":"v1","addr":"172.21.15.45:6839","nonce":119684732}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-11T12:25:30.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.971+0000 7f6a0a3ff700 1 -- 172.21.15.8:0/2050617569 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f69ec0a0260 msgr2=0x7f69ec0a2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:30.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.971+0000 7f6a0a3ff700 1 --2- 172.21.15.8:0/2050617569 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f69ec0a0260 0x7f69ec0a2720 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6a0419a2a0 tx=0x7f69f8009310 comp rx=0 tx=0).stop 2023-08-11T12:25:30.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.971+0000 7f6a0a3ff700 1 -- 172.21.15.8:0/2050617569 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a04100950 msgr2=0x7f6a0419ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:30.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.971+0000 7f6a0a3ff700 1 --2- 172.21.15.8:0/2050617569 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a04100950 0x7f6a0419ea90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009810 tx=0x7f69f400fa00 comp rx=0 tx=0).stop 2023-08-11T12:25:30.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.971+0000 7f6a0a3ff700 1 -- 172.21.15.8:0/2050617569 shutdown_connections 2023-08-11T12:25:30.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.971+0000 7f6a0a3ff700 1 --2- 172.21.15.8:0/2050617569 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f69ec0a0260 0x7f69ec0a2720 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.971+0000 7f6a0a3ff700 1 --2- 172.21.15.8:0/2050617569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a04106960 0x7f6a04198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.971+0000 7f6a0a3ff700 1 --2- 172.21.15.8:0/2050617569 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a04100950 0x7f6a0419ea90 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.971+0000 7f6a0a3ff700 1 --2- 172.21.15.8:0/2050617569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a04101310 0x7f6a0419efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:30.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.971+0000 7f6a0a3ff700 1 -- 172.21.15.8:0/2050617569 >> 172.21.15.8:0/2050617569 conn(0x7f6a040fc460 msgr2=0x7f6a0410bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:30.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.972+0000 7f6a0a3ff700 1 -- 172.21.15.8:0/2050617569 shutdown_connections 2023-08-11T12:25:30.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:30.972+0000 7f6a0a3ff700 1 -- 172.21.15.8:0/2050617569 wait complete. 2023-08-11T12:25:30.978 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 31 2023-08-11T12:25:31.003 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-08-11T12:25:31.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:30 smithi194 ceph-mon[130905]: pgmap v30: 129 pgs: 129 active+clean; 1.6 GiB data, 950 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 119 MiB/s wr, 66 op/s 2023-08-11T12:25:31.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:30 smithi045 ceph-mon[130284]: pgmap v30: 129 pgs: 129 active+clean; 1.6 GiB data, 950 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 119 MiB/s wr, 66 op/s 2023-08-11T12:25:31.177 INFO:teuthology.orchestra.run.smithi008.stderr:8400000 of 50000000 tuples (16%) done (elapsed 35.86 s, remaining 177.61 s) 2023-08-11T12:25:31.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.232+0000 7fa4e55ff700 1 -- 172.21.15.8:0/3632050380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4e0072cc0 msgr2=0x7fa4e00730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:31.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.232+0000 7fa4e55ff700 1 --2- 172.21.15.8:0/3632050380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4e0072cc0 0x7fa4e00730a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0009990 tx=0x7fa4d0009ca0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.232+0000 7fa4e55ff700 1 -- 172.21.15.8:0/3632050380 shutdown_connections 2023-08-11T12:25:31.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.232+0000 7fa4e55ff700 1 --2- 172.21.15.8:0/3632050380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4e0111970 0x7fa4e0113d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.232+0000 7fa4e55ff700 1 --2- 172.21.15.8:0/3632050380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4e0072cc0 0x7fa4e00730a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.232+0000 7fa4e55ff700 1 --2- 172.21.15.8:0/3632050380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4e00735e0 0x7fa4e0111430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.232+0000 7fa4e55ff700 1 -- 172.21.15.8:0/3632050380 >> 172.21.15.8:0/3632050380 conn(0x7fa4e00fc490 msgr2=0x7fa4e00fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:31.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.232+0000 7fa4e55ff700 1 -- 172.21.15.8:0/3632050380 shutdown_connections 2023-08-11T12:25:31.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.232+0000 7fa4e55ff700 1 -- 172.21.15.8:0/3632050380 wait complete. 2023-08-11T12:25:31.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.233+0000 7fa4e55ff700 1 Processor -- start 2023-08-11T12:25:31.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.233+0000 7fa4e55ff700 1 -- start start 2023-08-11T12:25:31.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.234+0000 7fa4e55ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4e0072cc0 0x7fa4e019d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.234+0000 7fa4e55ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4e00735e0 0x7fa4e019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.234+0000 7fa4e55ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4e0111970 0x7fa4e01a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.234+0000 7fa4e55ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e01a20c0 con 0x7fa4e00735e0 2023-08-11T12:25:31.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.234+0000 7fa4e55ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e01a2230 con 0x7fa4e0072cc0 2023-08-11T12:25:31.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.234+0000 7fa4e55ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e01a23f0 con 0x7fa4e0111970 2023-08-11T12:25:31.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.234+0000 7fa4deffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4e0072cc0 0x7fa4e019d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.234+0000 7fa4de7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4e00735e0 0x7fa4e019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.234+0000 7fa4deffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4e0072cc0 0x7fa4e019d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:33732/0 (socket says 172.21.15.8:33732) 2023-08-11T12:25:31.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.234+0000 7fa4deffd700 1 -- 172.21.15.8:0/733745565 learned_addr learned my addr 172.21.15.8:0/733745565 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:31.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.234+0000 7fa4df7fe700 1 --2- 172.21.15.8:0/733745565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4e0111970 0x7fa4e01a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.234+0000 7fa4deffd700 1 -- 172.21.15.8:0/733745565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4e0111970 msgr2=0x7fa4e01a1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:31.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.234+0000 7fa4deffd700 1 --2- 172.21.15.8:0/733745565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4e0111970 0x7fa4e01a1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.234+0000 7fa4deffd700 1 -- 172.21.15.8:0/733745565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4e00735e0 msgr2=0x7fa4e019d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:31.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.234+0000 7fa4deffd700 1 --2- 172.21.15.8:0/733745565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4e00735e0 0x7fa4e019d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.234+0000 7fa4deffd700 1 -- 172.21.15.8:0/733745565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d00095f0 con 0x7fa4e0072cc0 2023-08-11T12:25:31.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.234+0000 7fa4de7fc700 1 --2- 172.21.15.8:0/733745565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4e00735e0 0x7fa4e019d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:31.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.235+0000 7fa4deffd700 1 --2- 172.21.15.8:0/733745565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4e0072cc0 0x7fa4e019d0e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0005910 tx=0x7fa4d0005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:31.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.235+0000 7fa4c7fff700 1 -- 172.21.15.8:0/733745565 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d001d070 con 0x7fa4e0072cc0 2023-08-11T12:25:31.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.235+0000 7fa4e55ff700 1 -- 172.21.15.8:0/733745565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e01a2670 con 0x7fa4e0072cc0 2023-08-11T12:25:31.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.235+0000 7fa4c7fff700 1 -- 172.21.15.8:0/733745565 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4d0022470 con 0x7fa4e0072cc0 2023-08-11T12:25:31.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.235+0000 7fa4c7fff700 1 -- 172.21.15.8:0/733745565 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0017650 con 0x7fa4e0072cc0 2023-08-11T12:25:31.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.235+0000 7fa4e55ff700 1 -- 172.21.15.8:0/733745565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e01a9f10 con 0x7fa4e0072cc0 2023-08-11T12:25:31.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.238+0000 7fa4c7fff700 1 -- 172.21.15.8:0/733745565 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 24) v1 ==== 134903+0+0 (secure 0 0 0) 0x7fa4d000fad0 con 0x7fa4e0072cc0 2023-08-11T12:25:31.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.240+0000 7fa4f8ebbb80 1 Processor -- start 2023-08-11T12:25:31.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.240+0000 7fa4c7fff700 1 --2- 172.21.15.8:0/733745565 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fa4c80a01e0 0x7fa4c80a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.240+0000 7fa4c7fff700 1 -- 172.21.15.8:0/733745565 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fa4d00cd0e0 con 0x7fa4e0072cc0 2023-08-11T12:25:31.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.240+0000 7fa4f8ebbb80 1 -- start start 2023-08-11T12:25:31.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.240+0000 7fa4df7fe700 1 --2- 172.21.15.8:0/733745565 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fa4c80a01e0 0x7fa4c80a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.241+0000 7fa4f8ebbb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5610025dc310 0x5610025dc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.241+0000 7fa4f8ebbb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610025dcc30 0x5610025d68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.241+0000 7fa4f8ebbb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5610025d6e20 0x5610025d7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.241+0000 7fa4f8ebbb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56100252f630 con 0x5610025d6e20 2023-08-11T12:25:31.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.241+0000 7fa4f8ebbb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56100252cf50 con 0x5610025dc310 2023-08-11T12:25:31.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.241+0000 7fa4f8ebbb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561002528840 con 0x5610025dcc30 2023-08-11T12:25:31.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.241+0000 7fa4df7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5610025d6e20 0x5610025d7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.241+0000 7fa4de7fc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610025dcc30 0x5610025d68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.241+0000 7fa4df7fe700 1 --2- 172.21.15.8:0/733745565 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fa4c80a01e0 0x7fa4c80a26a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009550 tx=0x7fa4d8009130 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:31.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.241+0000 7fa4df7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5610025d6e20 0x5610025d7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39466/0 (socket says 172.21.15.8:39466) 2023-08-11T12:25:31.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.241+0000 7fa4deffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5610025dc310 0x5610025dc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.241+0000 7fa4df7fe700 1 -- 172.21.15.8:0/3246345615 learned_addr learned my addr 172.21.15.8:0/3246345615 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:31.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.241+0000 7fa4deffd700 1 -- 172.21.15.8:0/3246345615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610025dcc30 msgr2=0x5610025d68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:31.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.241+0000 7fa4deffd700 1 --2- 172.21.15.8:0/3246345615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610025dcc30 0x5610025d68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.241+0000 7fa4deffd700 1 -- 172.21.15.8:0/3246345615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5610025d6e20 msgr2=0x5610025d7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:31.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.241+0000 7fa4deffd700 1 --2- 172.21.15.8:0/3246345615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5610025d6e20 0x5610025d7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.241+0000 7fa4deffd700 1 -- 172.21.15.8:0/3246345615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610023a8630 con 0x5610025dc310 2023-08-11T12:25:31.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.242+0000 7fa4deffd700 1 --2- 172.21.15.8:0/3246345615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5610025dc310 0x5610025dc6f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00ca360 tx=0x7fa4d0005870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57e087104c05dd02 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:31.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.242+0000 7fa4c57fa700 1 -- 172.21.15.8:0/3246345615 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d009a9e0 con 0x5610025dc310 2023-08-11T12:25:31.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.242+0000 7fa4c57fa700 1 -- 172.21.15.8:0/3246345615 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4d009a2e0 con 0x5610025dc310 2023-08-11T12:25:31.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.242+0000 7fa4c57fa700 1 -- 172.21.15.8:0/3246345615 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d000fe50 con 0x5610025dc310 2023-08-11T12:25:31.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.243+0000 7fa4f8ebbb80 1 -- 172.21.15.8:0/3246345615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5610025dc310 msgr2=0x5610025dc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:31.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.243+0000 7fa4f8ebbb80 1 --2- 172.21.15.8:0/3246345615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5610025dc310 0x5610025dc6f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00ca360 tx=0x7fa4d0005870 comp rx=0 tx=0).stop 2023-08-11T12:25:31.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.243+0000 7fa4f8ebbb80 1 -- 172.21.15.8:0/3246345615 shutdown_connections 2023-08-11T12:25:31.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.243+0000 7fa4f8ebbb80 1 --2- 172.21.15.8:0/3246345615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5610025d6e20 0x5610025d7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.243+0000 7fa4f8ebbb80 1 --2- 172.21.15.8:0/3246345615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5610025dc310 0x5610025dc6f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.243+0000 7fa4f8ebbb80 1 --2- 172.21.15.8:0/3246345615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610025dcc30 0x5610025d68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.243+0000 7fa4f8ebbb80 1 -- 172.21.15.8:0/3246345615 >> 172.21.15.8:0/3246345615 conn(0x561002503950 msgr2=0x5610025d13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:31.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.243+0000 7fa4f8ebbb80 1 -- 172.21.15.8:0/3246345615 shutdown_connections 2023-08-11T12:25:31.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.243+0000 7fa4f8ebbb80 1 -- 172.21.15.8:0/3246345615 wait complete. 2023-08-11T12:25:31.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.243+0000 7fa4f8ebbb80 1 -- start start 2023-08-11T12:25:31.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.244+0000 7fa4f8ebbb80 1 Processor -- start 2023-08-11T12:25:31.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.245+0000 7fa4f8ebbb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5610025d6e20 0x5610025e29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.245+0000 7fa4f8ebbb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5610025dc310 0x5610025dfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.245+0000 7fa4f8ebbb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610025dcc30 0x5610025e02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.245+0000 7fa4f8ebbb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610024c6ac0 con 0x5610025dc310 2023-08-11T12:25:31.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.245+0000 7fa4f8ebbb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610024c67c0 con 0x5610025d6e20 2023-08-11T12:25:31.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.245+0000 7fa4f8ebbb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610023aa920 con 0x5610025dcc30 2023-08-11T12:25:31.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.245+0000 7fa4f8ebbb80 10 client.0 _ll_register_callbacks cb 0x5610024c9ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:25:31.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.245+0000 7fa4de7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5610025dc310 0x5610025dfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.245+0000 7fa4deffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5610025d6e20 0x5610025e29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.245+0000 7fa4deffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5610025d6e20 0x5610025e29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:33750/0 (socket says 172.21.15.8:33750) 2023-08-11T12:25:31.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.245+0000 7fa4deffd700 1 -- 172.21.15.8:0/2242893042 learned_addr learned my addr 172.21.15.8:0/2242893042 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:31.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.245+0000 7fa4df7fe700 1 --2- 172.21.15.8:0/2242893042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610025dcc30 0x5610025e02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.245+0000 7fa4deffd700 1 -- 172.21.15.8:0/2242893042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610025dcc30 msgr2=0x5610025e02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:31.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.245+0000 7fa4deffd700 1 --2- 172.21.15.8:0/2242893042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610025dcc30 0x5610025e02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.245+0000 7fa4deffd700 1 -- 172.21.15.8:0/2242893042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5610025dc310 msgr2=0x5610025dfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:31.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.245+0000 7fa4deffd700 1 --2- 172.21.15.8:0/2242893042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5610025dc310 0x5610025dfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.245+0000 7fa4deffd700 1 -- 172.21.15.8:0/2242893042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e01a9f10 con 0x5610025d6e20 2023-08-11T12:25:31.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.245+0000 7fa4de7fc700 1 --2- 172.21.15.8:0/2242893042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5610025dc310 0x5610025dfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:31.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.246+0000 7fa4deffd700 1 --2- 172.21.15.8:0/2242893042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5610025d6e20 0x5610025e29d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa4d009a940 tx=0x7fa4d00ca3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bba4428d4b90cf2 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:31.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.246+0000 7fa4c2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:25:31.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.246+0000 7fa4c2ff5700 1 -- 172.21.15.8:0/2242893042 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d009e110 con 0x5610025d6e20 2023-08-11T12:25:31.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.246+0000 7fa4f8ebbb80 1 -- 172.21.15.8:0/2242893042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5610025c9a90 con 0x5610025d6e20 2023-08-11T12:25:31.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.246+0000 7fa4c2ff5700 1 -- 172.21.15.8:0/2242893042 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fa4d00a2060 con 0x5610025d6e20 2023-08-11T12:25:31.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.246+0000 7fa4c2ff5700 1 -- 172.21.15.8:0/2242893042 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4d0022850 con 0x5610025d6e20 2023-08-11T12:25:31.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.246+0000 7fa4f8ebbb80 10 client.25904 fetch_fsmap learned FSMap version 31 2023-08-11T12:25:31.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.246+0000 7fa4f8ebbb80 1 -- 172.21.15.8:0/2242893042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x561002354de0 con 0x5610025d6e20 2023-08-11T12:25:31.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.246+0000 7fa4c2ff5700 1 -- 172.21.15.8:0/2242893042 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5610025c9a90 con 0x5610025d6e20 2023-08-11T12:25:31.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.247+0000 7fa4c2ff5700 1 -- 172.21.15.8:0/2242893042 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 31) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fa4d00b2130 con 0x5610025d6e20 2023-08-11T12:25:31.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.247+0000 7fa4f8ebbb80 10 client.25904 fetch_fsmap finished waiting for FSMap version 31 2023-08-11T12:25:31.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.247+0000 7fa4f8ebbb80 10 client.25904 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2023-08-11T12:25:31.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.247+0000 7fa4f8ebbb80 20 client.25904 populate_metadata read hostname 'smithi008' 2023-08-11T12:25:31.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.247+0000 7fa4f8ebbb80 1 --2- 172.21.15.8:0/2242893042 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x5610025efbb0 0x5610025f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.247+0000 7fa4f8ebbb80 4 client.25904 mds_command: new command op to 24464 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:25:31.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.247+0000 7fa4f8ebbb80 1 -- 172.21.15.8:0/2242893042 --> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5610025a54e0 con 0x5610025efbb0 2023-08-11T12:25:31.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.247+0000 7fa4de7fc700 1 --2- 172.21.15.8:0/2242893042 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x5610025efbb0 0x5610025f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.248+0000 7fa4de7fc700 1 --2- 172.21.15.8:0/2242893042 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x5610025efbb0 0x5610025f1fd0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d5f8216c52d79ad5 server_cookie=ee6474125072cb84 in_seq=0 out_seq=0 2023-08-11T12:25:31.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.248+0000 7fa4c2ff5700 10 client.25904 ms_handle_connect on v2:172.21.15.45:6832/1208864615 2023-08-11T12:25:31.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.248+0000 7fa4c2ff5700 1 -- 172.21.15.8:0/2242893042 <== mds.4 v2:172.21.15.45:6832/1208864615 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5610025a54e0 con 0x5610025efbb0 2023-08-11T12:25:31.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.248+0000 7fa4c2ff5700 10 client.25904 handle_command_reply: tid=0 2023-08-11T12:25:31.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.248+0000 7fa4f8ebbb80 1 client.25904 shutdown 2023-08-11T12:25:31.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.248+0000 7fa4f8ebbb80 1 -- 172.21.15.8:0/2242893042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5610025d6e20 msgr2=0x5610025e29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:31.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.248+0000 7fa4f8ebbb80 1 --2- 172.21.15.8:0/2242893042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5610025d6e20 0x5610025e29d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa4d009a940 tx=0x7fa4d00ca3c0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.249+0000 7fa4f8ebbb80 1 -- 172.21.15.8:0/2242893042 shutdown_connections 2023-08-11T12:25:31.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.249+0000 7fa4f8ebbb80 1 --2- 172.21.15.8:0/2242893042 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x5610025efbb0 0x5610025f1fd0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.249+0000 7fa4f8ebbb80 1 --2- 172.21.15.8:0/2242893042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610025dcc30 0x5610025e02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.249+0000 7fa4f8ebbb80 1 --2- 172.21.15.8:0/2242893042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5610025d6e20 0x5610025e29d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.249+0000 7fa4f8ebbb80 1 --2- 172.21.15.8:0/2242893042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5610025dc310 0x5610025dfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.249+0000 7fa4c2ff5700 0 client.25904 ms_handle_reset on v2:172.21.15.45:6832/1208864615 2023-08-11T12:25:31.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.249+0000 7fa4f8ebbb80 1 -- 172.21.15.8:0/2242893042 >> 172.21.15.8:0/2242893042 conn(0x561002503950 msgr2=0x5610025cbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:31.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.249+0000 7fa4f8ebbb80 1 -- 172.21.15.8:0/2242893042 shutdown_connections 2023-08-11T12:25:31.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.249+0000 7fa4f8ebbb80 1 -- 172.21.15.8:0/2242893042 wait complete. 2023-08-11T12:25:31.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.249+0000 7fa4f8ebbb80 20 client.25904 trim_cache size 0 max 16384 2023-08-11T12:25:31.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.263+0000 7fa4f8ebbb80 1 Processor -- start 2023-08-11T12:25:31.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.263+0000 7fa4f8ebbb80 1 -- start start 2023-08-11T12:25:31.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.263+0000 7fa4f8ebbb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610025d6e20 0x5610025d68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.263+0000 7fa4f8ebbb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5610025dc310 0x5610025e2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.263+0000 7fa4f8ebbb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5610025dcc30 0x5610025d8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.263+0000 7fa4f8ebbb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610025d2530 con 0x5610025dcc30 2023-08-11T12:25:31.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.263+0000 7fa4f8ebbb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610025e3110 con 0x5610025dc310 2023-08-11T12:25:31.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.263+0000 7fa4f8ebbb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610025da940 con 0x5610025d6e20 2023-08-11T12:25:31.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.264+0000 7fa4deffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610025d6e20 0x5610025d68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.264+0000 7fa4deffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610025d6e20 0x5610025d68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:55378/0 (socket says 172.21.15.8:55378) 2023-08-11T12:25:31.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.264+0000 7fa4deffd700 1 -- 172.21.15.8:0/2396111277 learned_addr learned my addr 172.21.15.8:0/2396111277 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:31.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.264+0000 7fa4df7fe700 1 --2- 172.21.15.8:0/2396111277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5610025dcc30 0x5610025d8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.264+0000 7fa4de7fc700 1 --2- 172.21.15.8:0/2396111277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5610025dc310 0x5610025e2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.264+0000 7fa4deffd700 1 -- 172.21.15.8:0/2396111277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5610025dc310 msgr2=0x5610025e2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:31.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.264+0000 7fa4deffd700 1 --2- 172.21.15.8:0/2396111277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5610025dc310 0x5610025e2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.264+0000 7fa4deffd700 1 -- 172.21.15.8:0/2396111277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5610025dcc30 msgr2=0x5610025d8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:31.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.264+0000 7fa4deffd700 1 --2- 172.21.15.8:0/2396111277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5610025dcc30 0x5610025d8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.264+0000 7fa4deffd700 1 -- 172.21.15.8:0/2396111277 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610025d74d0 con 0x5610025d6e20 2023-08-11T12:25:31.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.264+0000 7fa4deffd700 1 --2- 172.21.15.8:0/2396111277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610025d6e20 0x5610025d68e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0099fe0 tx=0x7fa4d0009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b09bd26f49bca514 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:31.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.265+0000 7fa4c5ffb700 1 -- 172.21.15.8:0/2396111277 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d009e110 con 0x5610025d6e20 2023-08-11T12:25:31.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.265+0000 7fa4c5ffb700 1 -- 172.21.15.8:0/2396111277 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4d00662a0 con 0x5610025d6e20 2023-08-11T12:25:31.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.265+0000 7fa4c5ffb700 1 -- 172.21.15.8:0/2396111277 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d000fd80 con 0x5610025d6e20 2023-08-11T12:25:31.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.265+0000 7fa4f8ebbb80 1 -- 172.21.15.8:0/2396111277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610025d6e20 msgr2=0x5610025d68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:31.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.265+0000 7fa4f8ebbb80 1 --2- 172.21.15.8:0/2396111277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610025d6e20 0x5610025d68e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0099fe0 tx=0x7fa4d0009ca0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.265+0000 7fa4f8ebbb80 1 -- 172.21.15.8:0/2396111277 shutdown_connections 2023-08-11T12:25:31.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.265+0000 7fa4f8ebbb80 1 --2- 172.21.15.8:0/2396111277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610025d6e20 0x5610025d68e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.265+0000 7fa4f8ebbb80 1 --2- 172.21.15.8:0/2396111277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5610025dcc30 0x5610025d8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.265+0000 7fa4f8ebbb80 1 --2- 172.21.15.8:0/2396111277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5610025dc310 0x5610025e2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.265+0000 7fa4f8ebbb80 1 -- 172.21.15.8:0/2396111277 >> 172.21.15.8:0/2396111277 conn(0x561002503950 msgr2=0x5610025d1280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:31.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.266+0000 7fa4f8ebbb80 1 -- 172.21.15.8:0/2396111277 shutdown_connections 2023-08-11T12:25:31.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.266+0000 7fa4f8ebbb80 1 -- 172.21.15.8:0/2396111277 wait complete. 2023-08-11T12:25:31.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.266+0000 7fa4f8ebbb80 1 -- start start 2023-08-11T12:25:31.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.266+0000 7fa4f8ebbb80 1 Processor -- start 2023-08-11T12:25:31.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.267+0000 7fa4f8ebbb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610025d6e20 0x5610025e5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.267+0000 7fa4f8ebbb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5610025dc310 0x5610025e5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.267+0000 7fa4f8ebbb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5610025dcc30 0x5610025e5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.267+0000 7fa4f8ebbb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610025e7840 con 0x5610025dc310 2023-08-11T12:25:31.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.267+0000 7fa4f8ebbb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x561002642820 con 0x5610025dcc30 2023-08-11T12:25:31.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.267+0000 7fa4f8ebbb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561002642960 con 0x5610025d6e20 2023-08-11T12:25:31.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.267+0000 7fa4f8ebbb80 10 client.0 _ll_register_callbacks cb 0x7fa4d80096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:25:31.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.267+0000 7fa4de7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5610025dc310 0x5610025e5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.267+0000 7fa4de7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5610025dc310 0x5610025e5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39478/0 (socket says 172.21.15.8:39478) 2023-08-11T12:25:31.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.267+0000 7fa4de7fc700 1 -- 172.21.15.8:0/2541547452 learned_addr learned my addr 172.21.15.8:0/2541547452 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:31.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.267+0000 7fa4df7fe700 1 --2- 172.21.15.8:0/2541547452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5610025dcc30 0x5610025e5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.267+0000 7fa4deffd700 1 --2- 172.21.15.8:0/2541547452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610025d6e20 0x5610025e5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.267+0000 7fa4de7fc700 1 -- 172.21.15.8:0/2541547452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610025d6e20 msgr2=0x5610025e5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:31.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.267+0000 7fa4de7fc700 1 --2- 172.21.15.8:0/2541547452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610025d6e20 0x5610025e5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.267+0000 7fa4de7fc700 1 -- 172.21.15.8:0/2541547452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5610025dcc30 msgr2=0x5610025e5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:31.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.267+0000 7fa4de7fc700 1 --2- 172.21.15.8:0/2541547452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5610025dcc30 0x5610025e5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.267+0000 7fa4de7fc700 1 -- 172.21.15.8:0/2541547452 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561002354de0 con 0x5610025dc310 2023-08-11T12:25:31.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.267+0000 7fa4df7fe700 1 --2- 172.21.15.8:0/2541547452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5610025dcc30 0x5610025e5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:31.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.268+0000 7fa4de7fc700 1 --2- 172.21.15.8:0/2541547452 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5610025dc310 0x5610025e5860 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x5610025d2160 tx=0x7fa4d4021c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2a51b8ea101bc1 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:31.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.268+0000 7fa4c2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:25:31.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.268+0000 7fa4c2ff5700 1 -- 172.21.15.8:0/2541547452 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d4017040 con 0x5610025dc310 2023-08-11T12:25:31.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.268+0000 7fa4c2ff5700 1 -- 172.21.15.8:0/2541547452 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fa4d40212b0 con 0x5610025dc310 2023-08-11T12:25:31.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.268+0000 7fa4f8ebbb80 1 -- 172.21.15.8:0/2541547452 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa4d009a2e0 con 0x5610025dc310 2023-08-11T12:25:31.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.268+0000 7fa4c2ff5700 1 -- 172.21.15.8:0/2541547452 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4d40122e0 con 0x5610025dc310 2023-08-11T12:25:31.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.268+0000 7fa4f8ebbb80 10 client.15891 fetch_fsmap learned FSMap version 31 2023-08-11T12:25:31.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.268+0000 7fa4f8ebbb80 1 -- 172.21.15.8:0/2541547452 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x56100233dc60 con 0x5610025dc310 2023-08-11T12:25:31.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.269+0000 7fa4c2ff5700 1 -- 172.21.15.8:0/2541547452 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4d009a2e0 con 0x5610025dc310 2023-08-11T12:25:31.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.269+0000 7fa4c2ff5700 1 -- 172.21.15.8:0/2541547452 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 31) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fa4d402a420 con 0x5610025dc310 2023-08-11T12:25:31.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.269+0000 7fa4f8ebbb80 10 client.15891 fetch_fsmap finished waiting for FSMap version 31 2023-08-11T12:25:31.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.269+0000 7fa4f8ebbb80 10 client.15891 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2023-08-11T12:25:31.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.269+0000 7fa4f8ebbb80 20 client.15891 populate_metadata read hostname 'smithi008' 2023-08-11T12:25:31.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.269+0000 7fa4f8ebbb80 1 --2- 172.21.15.8:0/2541547452 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x5610026441c0 0x5610026465e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.269+0000 7fa4f8ebbb80 4 client.15891 mds_command: new command op to 24464 tid=0[{"prefix": "damage ls"}] 2023-08-11T12:25:31.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.269+0000 7fa4f8ebbb80 1 -- 172.21.15.8:0/2541547452 --> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561002521820 con 0x5610026441c0 2023-08-11T12:25:31.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.269+0000 7fa4deffd700 1 --2- 172.21.15.8:0/2541547452 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x5610026441c0 0x5610026465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.270+0000 7fa4deffd700 1 --2- 172.21.15.8:0/2541547452 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x5610026441c0 0x5610026465e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e25350698e3ef549 server_cookie=826ff4effeb5eeb7 in_seq=0 out_seq=0 2023-08-11T12:25:31.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.270+0000 7fa4c2ff5700 10 client.15891 ms_handle_connect on v2:172.21.15.45:6832/1208864615 2023-08-11T12:25:31.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.270+0000 7fa4c2ff5700 1 -- 172.21.15.8:0/2541547452 <== mds.4 v2:172.21.15.45:6832/1208864615 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561002521820 con 0x5610026441c0 2023-08-11T12:25:31.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.270+0000 7fa4c2ff5700 10 client.15891 handle_command_reply: tid=0 2023-08-11T12:25:31.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.270+0000 7fa4f8ebbb80 1 client.15891 shutdown 2023-08-11T12:25:31.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.270+0000 7fa4f8ebbb80 1 -- 172.21.15.8:0/2541547452 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5610025dc310 msgr2=0x5610025e5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:31.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.270+0000 7fa4f8ebbb80 1 --2- 172.21.15.8:0/2541547452 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5610025dc310 0x5610025e5860 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x5610025d2160 tx=0x7fa4d4021c20 comp rx=0 tx=0).stop 2023-08-11T12:25:31.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.270+0000 7fa4f8ebbb80 1 -- 172.21.15.8:0/2541547452 shutdown_connections 2023-08-11T12:25:31.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.270+0000 7fa4f8ebbb80 1 --2- 172.21.15.8:0/2541547452 >> [v2:172.21.15.45:6832/1208864615,v1:172.21.15.45:6833/1208864615] conn(0x5610026441c0 0x5610026465e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.270+0000 7fa4f8ebbb80 1 --2- 172.21.15.8:0/2541547452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5610025d6e20 0x5610025e5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.270+0000 7fa4f8ebbb80 1 --2- 172.21.15.8:0/2541547452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5610025dcc30 0x5610025e5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.270+0000 7fa4f8ebbb80 1 --2- 172.21.15.8:0/2541547452 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5610025dc310 0x5610025e5860 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.270+0000 7fa4f8ebbb80 1 -- 172.21.15.8:0/2541547452 >> 172.21.15.8:0/2541547452 conn(0x561002503950 msgr2=0x5610025dd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:31.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.270+0000 7fa4c2ff5700 0 client.15891 ms_handle_reset on v2:172.21.15.45:6832/1208864615 2023-08-11T12:25:31.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.270+0000 7fa4f8ebbb80 1 -- 172.21.15.8:0/2541547452 shutdown_connections 2023-08-11T12:25:31.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.270+0000 7fa4f8ebbb80 1 -- 172.21.15.8:0/2541547452 wait complete. 2023-08-11T12:25:31.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.271+0000 7fa4f8ebbb80 20 client.15891 trim_cache size 0 max 16384 2023-08-11T12:25:31.283 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-08-11T12:25:31.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.271+0000 7fa4e55ff700 1 -- 172.21.15.8:0/733745565 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fa4c80a01e0 msgr2=0x7fa4c80a26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:31.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.271+0000 7fa4e55ff700 1 --2- 172.21.15.8:0/733745565 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fa4c80a01e0 0x7fa4c80a26a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009550 tx=0x7fa4d8009130 comp rx=0 tx=0).stop 2023-08-11T12:25:31.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.271+0000 7fa4e55ff700 1 -- 172.21.15.8:0/733745565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4e0072cc0 msgr2=0x7fa4e019d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:31.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.271+0000 7fa4e55ff700 1 --2- 172.21.15.8:0/733745565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4e0072cc0 0x7fa4e019d0e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0005910 tx=0x7fa4d0005740 comp rx=0 tx=0).stop 2023-08-11T12:25:31.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.271+0000 7fa4e55ff700 1 -- 172.21.15.8:0/733745565 shutdown_connections 2023-08-11T12:25:31.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.271+0000 7fa4e55ff700 1 --2- 172.21.15.8:0/733745565 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fa4c80a01e0 0x7fa4c80a26a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.271+0000 7fa4e55ff700 1 --2- 172.21.15.8:0/733745565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4e0111970 0x7fa4e01a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.271+0000 7fa4e55ff700 1 --2- 172.21.15.8:0/733745565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4e0072cc0 0x7fa4e019d0e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.271+0000 7fa4e55ff700 1 --2- 172.21.15.8:0/733745565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4e00735e0 0x7fa4e019d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.271+0000 7fa4e55ff700 1 -- 172.21.15.8:0/733745565 >> 172.21.15.8:0/733745565 conn(0x7fa4e00fc490 msgr2=0x7fa4e00fd100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:31.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.271+0000 7fa4e55ff700 1 -- 172.21.15.8:0/733745565 shutdown_connections 2023-08-11T12:25:31.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.272+0000 7fa4e55ff700 1 -- 172.21.15.8:0/733745565 wait complete. 2023-08-11T12:25:31.292 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-08-11T12:25:31.305 INFO:teuthology.orchestra.run.smithi008.stderr:8500000 of 50000000 tuples (17%) done (elapsed 35.99 s, remaining 175.73 s) 2023-08-11T12:25:31.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.513+0000 7f4c999ff700 1 -- 172.21.15.8:0/1339898699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c94101320 msgr2=0x7f4c9410d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:31.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.513+0000 7f4c999ff700 1 --2- 172.21.15.8:0/1339898699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c94101320 0x7f4c9410d830 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c009f90 tx=0x7f4c8c00b330 comp rx=0 tx=0).stop 2023-08-11T12:25:31.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.513+0000 7f4c999ff700 1 -- 172.21.15.8:0/1339898699 shutdown_connections 2023-08-11T12:25:31.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.513+0000 7f4c999ff700 1 --2- 172.21.15.8:0/1339898699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c94106970 0x7f4c94106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.513+0000 7f4c999ff700 1 --2- 172.21.15.8:0/1339898699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c94101320 0x7f4c9410d830 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.513+0000 7f4c999ff700 1 --2- 172.21.15.8:0/1339898699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c94100960 0x7f4c94100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.513+0000 7f4c999ff700 1 -- 172.21.15.8:0/1339898699 >> 172.21.15.8:0/1339898699 conn(0x7f4c940fc490 msgr2=0x7f4c940fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:31.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.513+0000 7f4c999ff700 1 -- 172.21.15.8:0/1339898699 shutdown_connections 2023-08-11T12:25:31.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.513+0000 7f4c999ff700 1 -- 172.21.15.8:0/1339898699 wait complete. 2023-08-11T12:25:31.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.514+0000 7f4c999ff700 1 Processor -- start 2023-08-11T12:25:31.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.514+0000 7f4c999ff700 1 -- start start 2023-08-11T12:25:31.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.515+0000 7f4c999ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c94100960 0x7f4c9419e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.515+0000 7f4c999ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c94101320 0x7f4c9419ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.515+0000 7f4c999ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c94106970 0x7f4c94198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.515+0000 7f4c999ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c94199070 con 0x7f4c94101320 2023-08-11T12:25:31.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.515+0000 7f4c999ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c941991e0 con 0x7f4c94100960 2023-08-11T12:25:31.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.515+0000 7f4c999ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c941993a0 con 0x7f4c94106970 2023-08-11T12:25:31.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.515+0000 7f4c92ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c94100960 0x7f4c9419e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.515+0000 7f4c92ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c94100960 0x7f4c9419e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:33786/0 (socket says 172.21.15.8:33786) 2023-08-11T12:25:31.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.515+0000 7f4c92ffd700 1 -- 172.21.15.8:0/1311141038 learned_addr learned my addr 172.21.15.8:0/1311141038 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:31.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.515+0000 7f4c937fe700 1 --2- 172.21.15.8:0/1311141038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c94106970 0x7f4c94198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.515+0000 7f4c927fc700 1 --2- 172.21.15.8:0/1311141038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c94101320 0x7f4c9419ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.515+0000 7f4c92ffd700 1 -- 172.21.15.8:0/1311141038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c94106970 msgr2=0x7f4c94198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:31.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.515+0000 7f4c92ffd700 1 --2- 172.21.15.8:0/1311141038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c94106970 0x7f4c94198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.515+0000 7f4c92ffd700 1 -- 172.21.15.8:0/1311141038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c94101320 msgr2=0x7f4c9419ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:31.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.515+0000 7f4c92ffd700 1 --2- 172.21.15.8:0/1311141038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c94101320 0x7f4c9419ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.515+0000 7f4c92ffd700 1 -- 172.21.15.8:0/1311141038 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c840095f0 con 0x7f4c94100960 2023-08-11T12:25:31.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.515+0000 7f4c927fc700 1 --2- 172.21.15.8:0/1311141038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c94101320 0x7f4c9419ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:25:31.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.516+0000 7f4c92ffd700 1 --2- 172.21.15.8:0/1311141038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c94100960 0x7f4c9419e8f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4c8400ec10 tx=0x7f4c8400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:31.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.516+0000 7f4c989fd700 1 -- 172.21.15.8:0/1311141038 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8400cd40 con 0x7f4c94100960 2023-08-11T12:25:31.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.516+0000 7f4c989fd700 1 -- 172.21.15.8:0/1311141038 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c840044e0 con 0x7f4c94100960 2023-08-11T12:25:31.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.516+0000 7f4c999ff700 1 -- 172.21.15.8:0/1311141038 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8c009c40 con 0x7f4c94100960 2023-08-11T12:25:31.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.516+0000 7f4c989fd700 1 -- 172.21.15.8:0/1311141038 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c84010690 con 0x7f4c94100960 2023-08-11T12:25:31.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.516+0000 7f4c999ff700 1 -- 172.21.15.8:0/1311141038 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c94199870 con 0x7f4c94100960 2023-08-11T12:25:31.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.519+0000 7f4c989fd700 1 -- 172.21.15.8:0/1311141038 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 24) v1 ==== 134903+0+0 (secure 0 0 0) 0x7f4c84003710 con 0x7f4c94100960 2023-08-11T12:25:31.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.521+0000 7f4c989fd700 1 --2- 172.21.15.8:0/1311141038 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f4c7c0a0260 0x7f4c7c0a2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.521+0000 7f4c989fd700 1 -- 172.21.15.8:0/1311141038 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f4c84014070 con 0x7f4c94100960 2023-08-11T12:25:31.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.521+0000 7f4c927fc700 1 --2- 172.21.15.8:0/1311141038 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f4c7c0a0260 0x7f4c7c0a2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.522+0000 7f4c927fc700 1 --2- 172.21.15.8:0/1311141038 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f4c7c0a0260 0x7f4c7c0a2720 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4c94105e00 tx=0x7f4c88009260 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:31.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.523+0000 7f4cad30fb80 1 Processor -- start 2023-08-11T12:25:31.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.523+0000 7f4cad30fb80 1 -- start start 2023-08-11T12:25:31.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.524+0000 7f4cad30fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b03a3f3310 0x55b03a3f36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.524+0000 7f4cad30fb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b03a3f3c30 0x55b03a3ed8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.524+0000 7f4cad30fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b03a3ede20 0x55b03a3ee260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.524+0000 7f4cad30fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b03a346630 con 0x55b03a3ede20 2023-08-11T12:25:31.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.524+0000 7f4cad30fb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b03a343f50 con 0x55b03a3f3c30 2023-08-11T12:25:31.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.524+0000 7f4cad30fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b03a33f840 con 0x55b03a3f3310 2023-08-11T12:25:31.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.524+0000 7f4c927fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b03a3f3c30 0x55b03a3ed8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.524+0000 7f4c927fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b03a3f3c30 0x55b03a3ed8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:33790/0 (socket says 172.21.15.8:33790) 2023-08-11T12:25:31.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.524+0000 7f4c937fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b03a3ede20 0x55b03a3ee260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.524+0000 7f4c927fc700 1 -- 172.21.15.8:0/4079910715 learned_addr learned my addr 172.21.15.8:0/4079910715 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:31.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.524+0000 7f4c92ffd700 1 --2- 172.21.15.8:0/4079910715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b03a3f3310 0x55b03a3f36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.524+0000 7f4c927fc700 1 -- 172.21.15.8:0/4079910715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b03a3f3310 msgr2=0x55b03a3f36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:31.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.525+0000 7f4c927fc700 1 --2- 172.21.15.8:0/4079910715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b03a3f3310 0x55b03a3f36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.525+0000 7f4c927fc700 1 -- 172.21.15.8:0/4079910715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b03a3ede20 msgr2=0x55b03a3ee260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:31.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.525+0000 7f4c927fc700 1 --2- 172.21.15.8:0/4079910715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b03a3ede20 0x55b03a3ee260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.525+0000 7f4c927fc700 1 -- 172.21.15.8:0/4079910715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b03a1bf630 con 0x55b03a3f3c30 2023-08-11T12:25:31.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.525+0000 7f4c92ffd700 1 --2- 172.21.15.8:0/4079910715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b03a3f3310 0x55b03a3f36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:25:31.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.525+0000 7f4c927fc700 1 --2- 172.21.15.8:0/4079910715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b03a3f3c30 0x55b03a3ed8e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4c88011f60 tx=0x7f4c88014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e98df2c9265f1a4 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:31.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.525+0000 7f4c79ffb700 1 -- 172.21.15.8:0/4079910715 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c88003680 con 0x55b03a3f3c30 2023-08-11T12:25:31.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.525+0000 7f4c79ffb700 1 -- 172.21.15.8:0/4079910715 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c88003ca0 con 0x55b03a3f3c30 2023-08-11T12:25:31.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.525+0000 7f4c79ffb700 1 -- 172.21.15.8:0/4079910715 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c88012cb0 con 0x55b03a3f3c30 2023-08-11T12:25:31.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.526+0000 7f4cad30fb80 1 -- 172.21.15.8:0/4079910715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b03a3f3c30 msgr2=0x55b03a3ed8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:31.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.526+0000 7f4cad30fb80 1 --2- 172.21.15.8:0/4079910715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b03a3f3c30 0x55b03a3ed8e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4c88011f60 tx=0x7f4c88014000 comp rx=0 tx=0).stop 2023-08-11T12:25:31.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.526+0000 7f4cad30fb80 1 -- 172.21.15.8:0/4079910715 shutdown_connections 2023-08-11T12:25:31.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.526+0000 7f4cad30fb80 1 --2- 172.21.15.8:0/4079910715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b03a3f3310 0x55b03a3f36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.526+0000 7f4cad30fb80 1 --2- 172.21.15.8:0/4079910715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b03a3ede20 0x55b03a3ee260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.526+0000 7f4cad30fb80 1 --2- 172.21.15.8:0/4079910715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b03a3f3c30 0x55b03a3ed8e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.526+0000 7f4cad30fb80 1 -- 172.21.15.8:0/4079910715 >> 172.21.15.8:0/4079910715 conn(0x55b03a31a950 msgr2=0x55b03a3e83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:31.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.526+0000 7f4cad30fb80 1 -- 172.21.15.8:0/4079910715 shutdown_connections 2023-08-11T12:25:31.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.526+0000 7f4cad30fb80 1 -- 172.21.15.8:0/4079910715 wait complete. 2023-08-11T12:25:31.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.527+0000 7f4cad30fb80 1 -- start start 2023-08-11T12:25:31.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.527+0000 7f4cad30fb80 1 Processor -- start 2023-08-11T12:25:31.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.528+0000 7f4cad30fb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b03a3ede20 0x55b03a3f9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.528+0000 7f4cad30fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b03a3f3310 0x55b03a3f6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.528+0000 7f4cad30fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b03a3f3c30 0x55b03a3f7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.528+0000 7f4cad30fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b03a2ddac0 con 0x55b03a3f3310 2023-08-11T12:25:31.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.528+0000 7f4cad30fb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b03a2dd7c0 con 0x55b03a3ede20 2023-08-11T12:25:31.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.528+0000 7f4cad30fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b03a1c1920 con 0x55b03a3f3c30 2023-08-11T12:25:31.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.528+0000 7f4cad30fb80 10 client.0 _ll_register_callbacks cb 0x55b03a2e0ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:25:31.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.528+0000 7f4c92ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b03a3ede20 0x55b03a3f9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.528+0000 7f4c937fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b03a3f3c30 0x55b03a3f7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.528+0000 7f4c92ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b03a3ede20 0x55b03a3f9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:33802/0 (socket says 172.21.15.8:33802) 2023-08-11T12:25:31.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.528+0000 7f4c92ffd700 1 -- 172.21.15.8:0/3561426536 learned_addr learned my addr 172.21.15.8:0/3561426536 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:31.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.528+0000 7f4c927fc700 1 --2- 172.21.15.8:0/3561426536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b03a3f3310 0x55b03a3f6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.528+0000 7f4c92ffd700 1 -- 172.21.15.8:0/3561426536 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b03a3f3c30 msgr2=0x55b03a3f7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:31.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.528+0000 7f4c92ffd700 1 --2- 172.21.15.8:0/3561426536 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b03a3f3c30 0x55b03a3f7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.528+0000 7f4c92ffd700 1 -- 172.21.15.8:0/3561426536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b03a3f3310 msgr2=0x55b03a3f6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:31.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.528+0000 7f4c92ffd700 1 --2- 172.21.15.8:0/3561426536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b03a3f3310 0x55b03a3f6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.528+0000 7f4c92ffd700 1 -- 172.21.15.8:0/3561426536 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c88011c60 con 0x55b03a3ede20 2023-08-11T12:25:31.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.529+0000 7f4c92ffd700 1 --2- 172.21.15.8:0/3561426536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b03a3ede20 0x55b03a3f9be0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4c84095b10 tx=0x7f4c840997a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb1eb4364d1ac862 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:31.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.529+0000 7f4c72ffd700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:25:31.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.529+0000 7f4c72ffd700 1 -- 172.21.15.8:0/3561426536 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c84098790 con 0x55b03a3ede20 2023-08-11T12:25:31.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.529+0000 7f4cad30fb80 1 -- 172.21.15.8:0/3561426536 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b03a3e0a90 con 0x55b03a3ede20 2023-08-11T12:25:31.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.529+0000 7f4c72ffd700 1 -- 172.21.15.8:0/3561426536 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f4c8409ced0 con 0x55b03a3ede20 2023-08-11T12:25:31.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.529+0000 7f4c72ffd700 1 -- 172.21.15.8:0/3561426536 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c840b1260 con 0x55b03a3ede20 2023-08-11T12:25:31.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.529+0000 7f4cad30fb80 10 client.25922 fetch_fsmap learned FSMap version 31 2023-08-11T12:25:31.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.529+0000 7f4cad30fb80 1 -- 172.21.15.8:0/3561426536 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55b03a16bde0 con 0x55b03a3ede20 2023-08-11T12:25:31.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.529+0000 7f4c72ffd700 1 -- 172.21.15.8:0/3561426536 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b03a3e0a90 con 0x55b03a3ede20 2023-08-11T12:25:31.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.529+0000 7f4c72ffd700 1 -- 172.21.15.8:0/3561426536 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 31) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f4c840c9490 con 0x55b03a3ede20 2023-08-11T12:25:31.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.530+0000 7f4cad30fb80 10 client.25922 fetch_fsmap finished waiting for FSMap version 31 2023-08-11T12:25:31.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.530+0000 7f4cad30fb80 10 client.25922 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-08-11T12:25:31.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.530+0000 7f4cad30fb80 20 client.25922 populate_metadata read hostname 'smithi008' 2023-08-11T12:25:31.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.530+0000 7f4cad30fb80 1 --2- 172.21.15.8:0/3561426536 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x55b03a407490 0x55b03a409880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.530+0000 7f4cad30fb80 4 client.25922 mds_command: new command op to 24500 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:25:31.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.530+0000 7f4cad30fb80 1 -- 172.21.15.8:0/3561426536 --> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b03a3bc4e0 con 0x55b03a407490 2023-08-11T12:25:31.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.530+0000 7f4c927fc700 1 --2- 172.21.15.8:0/3561426536 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x55b03a407490 0x55b03a409880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.531+0000 7f4c927fc700 1 --2- 172.21.15.8:0/3561426536 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x55b03a407490 0x55b03a409880 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6ac91274c292a8f4 server_cookie=894b3e04307e5187 in_seq=0 out_seq=0 2023-08-11T12:25:31.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.531+0000 7f4c72ffd700 10 client.25922 ms_handle_connect on v2:172.21.15.45:6834/1776075470 2023-08-11T12:25:31.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.532+0000 7f4c72ffd700 1 -- 172.21.15.8:0/3561426536 <== mds.3 v2:172.21.15.45:6834/1776075470 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55b03a3bc4e0 con 0x55b03a407490 2023-08-11T12:25:31.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.532+0000 7f4c72ffd700 10 client.25922 handle_command_reply: tid=0 2023-08-11T12:25:31.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.532+0000 7f4cad30fb80 1 client.25922 shutdown 2023-08-11T12:25:31.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.532+0000 7f4cad30fb80 1 -- 172.21.15.8:0/3561426536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b03a3ede20 msgr2=0x55b03a3f9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:31.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.532+0000 7f4cad30fb80 1 --2- 172.21.15.8:0/3561426536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b03a3ede20 0x55b03a3f9be0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4c84095b10 tx=0x7f4c840997a0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.532+0000 7f4cad30fb80 1 -- 172.21.15.8:0/3561426536 shutdown_connections 2023-08-11T12:25:31.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.532+0000 7f4cad30fb80 1 --2- 172.21.15.8:0/3561426536 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x55b03a407490 0x55b03a409880 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.532+0000 7f4cad30fb80 1 --2- 172.21.15.8:0/3561426536 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b03a3f3c30 0x55b03a3f7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.532+0000 7f4cad30fb80 1 --2- 172.21.15.8:0/3561426536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b03a3ede20 0x55b03a3f9be0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.532+0000 7f4cad30fb80 1 --2- 172.21.15.8:0/3561426536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b03a3f3310 0x55b03a3f6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.532+0000 7f4c72ffd700 0 client.25922 ms_handle_reset on v2:172.21.15.45:6834/1776075470 2023-08-11T12:25:31.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.532+0000 7f4cad30fb80 1 -- 172.21.15.8:0/3561426536 >> 172.21.15.8:0/3561426536 conn(0x55b03a31a950 msgr2=0x55b03a3e2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:31.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.532+0000 7f4cad30fb80 1 -- 172.21.15.8:0/3561426536 shutdown_connections 2023-08-11T12:25:31.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.532+0000 7f4cad30fb80 1 -- 172.21.15.8:0/3561426536 wait complete. 2023-08-11T12:25:31.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.532+0000 7f4cad30fb80 20 client.25922 trim_cache size 0 max 16384 2023-08-11T12:25:31.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.546+0000 7f4cad30fb80 1 Processor -- start 2023-08-11T12:25:31.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.546+0000 7f4cad30fb80 1 -- start start 2023-08-11T12:25:31.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.547+0000 7f4cad30fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b03a3ede20 0x55b03a3ed8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.547+0000 7f4cad30fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b03a3f3310 0x55b03a3f96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.547+0000 7f4cad30fb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b03a3f3c30 0x55b03a3f9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.547+0000 7f4cad30fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b03a3f2fd0 con 0x55b03a3f3310 2023-08-11T12:25:31.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.547+0000 7f4cad30fb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b03a403e80 con 0x55b03a3f3c30 2023-08-11T12:25:31.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.547+0000 7f4cad30fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b03a3e4de0 con 0x55b03a3ede20 2023-08-11T12:25:31.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.547+0000 7f4c92ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b03a3ede20 0x55b03a3ed8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.547+0000 7f4c927fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b03a3f3310 0x55b03a3f96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.547+0000 7f4c92ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b03a3ede20 0x55b03a3ed8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:55414/0 (socket says 172.21.15.8:55414) 2023-08-11T12:25:31.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.547+0000 7f4c92ffd700 1 -- 172.21.15.8:0/4120986434 learned_addr learned my addr 172.21.15.8:0/4120986434 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:31.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.547+0000 7f4c937fe700 1 --2- 172.21.15.8:0/4120986434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b03a3f3c30 0x55b03a3f9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.547+0000 7f4c92ffd700 1 -- 172.21.15.8:0/4120986434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b03a3f3c30 msgr2=0x55b03a3f9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:31.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.547+0000 7f4c92ffd700 1 --2- 172.21.15.8:0/4120986434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b03a3f3c30 0x55b03a3f9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.547+0000 7f4c92ffd700 1 -- 172.21.15.8:0/4120986434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b03a3f3310 msgr2=0x55b03a3f96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:31.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.547+0000 7f4c92ffd700 1 --2- 172.21.15.8:0/4120986434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b03a3f3310 0x55b03a3f96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.547+0000 7f4c92ffd700 1 -- 172.21.15.8:0/4120986434 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b03a154c60 con 0x55b03a3ede20 2023-08-11T12:25:31.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.547+0000 7f4c937fe700 1 --2- 172.21.15.8:0/4120986434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b03a3f3c30 0x55b03a3f9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:25:31.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.548+0000 7f4c92ffd700 1 --2- 172.21.15.8:0/4120986434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b03a3ede20 0x55b03a3ed8e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4c84095ac0 tx=0x7f4c84097650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dce5b61366bbc19 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:31.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.548+0000 7f4c7a7fc700 1 -- 172.21.15.8:0/4120986434 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c84099810 con 0x55b03a3ede20 2023-08-11T12:25:31.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.548+0000 7f4c7a7fc700 1 -- 172.21.15.8:0/4120986434 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c840b1260 con 0x55b03a3ede20 2023-08-11T12:25:31.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.548+0000 7f4c7a7fc700 1 -- 172.21.15.8:0/4120986434 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c840a0eb0 con 0x55b03a3ede20 2023-08-11T12:25:31.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.549+0000 7f4cad30fb80 1 -- 172.21.15.8:0/4120986434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b03a3ede20 msgr2=0x55b03a3ed8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:31.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.549+0000 7f4cad30fb80 1 --2- 172.21.15.8:0/4120986434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b03a3ede20 0x55b03a3ed8e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4c84095ac0 tx=0x7f4c84097650 comp rx=0 tx=0).stop 2023-08-11T12:25:31.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.549+0000 7f4cad30fb80 1 -- 172.21.15.8:0/4120986434 shutdown_connections 2023-08-11T12:25:31.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.549+0000 7f4cad30fb80 1 --2- 172.21.15.8:0/4120986434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b03a3ede20 0x55b03a3ed8e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.549+0000 7f4cad30fb80 1 --2- 172.21.15.8:0/4120986434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b03a3f3c30 0x55b03a3f9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.549+0000 7f4cad30fb80 1 --2- 172.21.15.8:0/4120986434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b03a3f3310 0x55b03a3f96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.549+0000 7f4cad30fb80 1 -- 172.21.15.8:0/4120986434 >> 172.21.15.8:0/4120986434 conn(0x55b03a31a950 msgr2=0x55b03a3e8280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:31.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.549+0000 7f4cad30fb80 1 -- 172.21.15.8:0/4120986434 shutdown_connections 2023-08-11T12:25:31.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.549+0000 7f4cad30fb80 1 -- 172.21.15.8:0/4120986434 wait complete. 2023-08-11T12:25:31.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.550+0000 7f4cad30fb80 1 -- start start 2023-08-11T12:25:31.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.550+0000 7f4cad30fb80 1 Processor -- start 2023-08-11T12:25:31.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.551+0000 7f4cad30fb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b03a3ede20 0x55b03a3fc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.551+0000 7f4cad30fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b03a3f3310 0x55b03a3fccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.551+0000 7f4cad30fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b03a3f3c30 0x55b03a4541b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.551+0000 7f4cad30fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b03a4546f0 con 0x55b03a3f3c30 2023-08-11T12:25:31.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.551+0000 7f4cad30fb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b03a454860 con 0x55b03a3ede20 2023-08-11T12:25:31.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.551+0000 7f4cad30fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b03a454a20 con 0x55b03a3f3310 2023-08-11T12:25:31.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.551+0000 7f4cad30fb80 10 client.0 _ll_register_callbacks cb 0x7f4c84098ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:25:31.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.551+0000 7f4c927fc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b03a3f3310 0x55b03a3fccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.551+0000 7f4c937fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b03a3f3c30 0x55b03a4541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.551+0000 7f4c92ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b03a3ede20 0x55b03a3fc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.551+0000 7f4c927fc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b03a3f3310 0x55b03a3fccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:55428/0 (socket says 172.21.15.8:55428) 2023-08-11T12:25:31.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.551+0000 7f4c927fc700 1 -- 172.21.15.8:0/2055388964 learned_addr learned my addr 172.21.15.8:0/2055388964 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:31.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.551+0000 7f4c92ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b03a3ede20 0x55b03a3fc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:33826/0 (socket says 172.21.15.8:33826) 2023-08-11T12:25:31.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.551+0000 7f4c937fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b03a3f3c30 0x55b03a4541b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39518/0 (socket says 172.21.15.8:39518) 2023-08-11T12:25:31.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.551+0000 7f4c927fc700 1 -- 172.21.15.8:0/2055388964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b03a3ede20 msgr2=0x55b03a3fc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:31.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.551+0000 7f4c927fc700 1 --2- 172.21.15.8:0/2055388964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b03a3ede20 0x55b03a3fc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.551+0000 7f4c927fc700 1 -- 172.21.15.8:0/2055388964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b03a3f3c30 msgr2=0x55b03a4541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:31.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.551+0000 7f4c927fc700 1 --2- 172.21.15.8:0/2055388964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b03a3f3c30 0x55b03a4541b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.551+0000 7f4c927fc700 1 -- 172.21.15.8:0/2055388964 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b03a16bde0 con 0x55b03a3f3310 2023-08-11T12:25:31.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.552+0000 7f4c927fc700 1 --2- 172.21.15.8:0/2055388964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b03a3f3310 0x55b03a3fccc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4c88011f30 tx=0x7f4c88009a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2682a7b2fd95bd8b server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:31.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.552+0000 7f4c72ffd700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:25:31.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.552+0000 7f4c72ffd700 1 -- 172.21.15.8:0/2055388964 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c88033130 con 0x55b03a3f3310 2023-08-11T12:25:31.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.552+0000 7f4cad30fb80 1 -- 172.21.15.8:0/2055388964 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b03a338820 con 0x55b03a3f3310 2023-08-11T12:25:31.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.552+0000 7f4c72ffd700 1 -- 172.21.15.8:0/2055388964 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f4c88018070 con 0x55b03a3f3310 2023-08-11T12:25:31.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.552+0000 7f4c72ffd700 1 -- 172.21.15.8:0/2055388964 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c88033290 con 0x55b03a3f3310 2023-08-11T12:25:31.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.552+0000 7f4cad30fb80 10 client.25939 fetch_fsmap learned FSMap version 31 2023-08-11T12:25:31.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.552+0000 7f4cad30fb80 1 -- 172.21.15.8:0/2055388964 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55b03a192250 con 0x55b03a3f3310 2023-08-11T12:25:31.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.553+0000 7f4c72ffd700 1 -- 172.21.15.8:0/2055388964 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b03a338820 con 0x55b03a3f3310 2023-08-11T12:25:31.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.553+0000 7f4c72ffd700 1 -- 172.21.15.8:0/2055388964 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 31) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f4c88039020 con 0x55b03a3f3310 2023-08-11T12:25:31.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.553+0000 7f4cad30fb80 10 client.25939 fetch_fsmap finished waiting for FSMap version 31 2023-08-11T12:25:31.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.553+0000 7f4cad30fb80 10 client.25939 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-08-11T12:25:31.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.553+0000 7f4cad30fb80 20 client.25939 populate_metadata read hostname 'smithi008' 2023-08-11T12:25:31.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.553+0000 7f4cad30fb80 1 --2- 172.21.15.8:0/2055388964 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x55b03a45c210 0x55b03a45e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.553+0000 7f4cad30fb80 4 client.25939 mds_command: new command op to 24500 tid=0[{"prefix": "damage ls"}] 2023-08-11T12:25:31.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.553+0000 7f4cad30fb80 1 -- 172.21.15.8:0/2055388964 --> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b03a2f9050 con 0x55b03a45c210 2023-08-11T12:25:31.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.553+0000 7f4c92ffd700 1 --2- 172.21.15.8:0/2055388964 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x55b03a45c210 0x55b03a45e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.554+0000 7f4c92ffd700 1 --2- 172.21.15.8:0/2055388964 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x55b03a45c210 0x55b03a45e630 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=95c38b445accb477 server_cookie=fd8e8fd2bed26237 in_seq=0 out_seq=0 2023-08-11T12:25:31.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.554+0000 7f4c72ffd700 10 client.25939 ms_handle_connect on v2:172.21.15.45:6834/1776075470 2023-08-11T12:25:31.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.554+0000 7f4c72ffd700 1 -- 172.21.15.8:0/2055388964 <== mds.3 v2:172.21.15.45:6834/1776075470 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b03a2f9050 con 0x55b03a45c210 2023-08-11T12:25:31.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.554+0000 7f4c72ffd700 10 client.25939 handle_command_reply: tid=0 2023-08-11T12:25:31.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.554+0000 7f4cad30fb80 1 client.25939 shutdown 2023-08-11T12:25:31.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.554+0000 7f4cad30fb80 1 -- 172.21.15.8:0/2055388964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b03a3f3310 msgr2=0x55b03a3fccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:31.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.554+0000 7f4cad30fb80 1 --2- 172.21.15.8:0/2055388964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b03a3f3310 0x55b03a3fccc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4c88011f30 tx=0x7f4c88009a90 comp rx=0 tx=0).stop 2023-08-11T12:25:31.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.554+0000 7f4cad30fb80 1 -- 172.21.15.8:0/2055388964 shutdown_connections 2023-08-11T12:25:31.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.554+0000 7f4cad30fb80 1 --2- 172.21.15.8:0/2055388964 >> [v2:172.21.15.45:6834/1776075470,v1:172.21.15.45:6835/1776075470] conn(0x55b03a45c210 0x55b03a45e630 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.554+0000 7f4cad30fb80 1 --2- 172.21.15.8:0/2055388964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b03a3f3c30 0x55b03a4541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.554+0000 7f4cad30fb80 1 --2- 172.21.15.8:0/2055388964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b03a3ede20 0x55b03a3fc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.554+0000 7f4c72ffd700 0 client.25939 ms_handle_reset on v2:172.21.15.45:6834/1776075470 2023-08-11T12:25:31.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.554+0000 7f4cad30fb80 1 --2- 172.21.15.8:0/2055388964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b03a3f3310 0x55b03a3fccc0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.554+0000 7f4cad30fb80 1 -- 172.21.15.8:0/2055388964 >> 172.21.15.8:0/2055388964 conn(0x55b03a31a950 msgr2=0x55b03a3f20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:31.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.555+0000 7f4cad30fb80 1 -- 172.21.15.8:0/2055388964 shutdown_connections 2023-08-11T12:25:31.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.555+0000 7f4cad30fb80 1 -- 172.21.15.8:0/2055388964 wait complete. 2023-08-11T12:25:31.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.555+0000 7f4cad30fb80 20 client.25939 trim_cache size 0 max 16384 2023-08-11T12:25:31.567 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-08-11T12:25:31.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.556+0000 7f4c999ff700 1 -- 172.21.15.8:0/1311141038 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f4c7c0a0260 msgr2=0x7f4c7c0a2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:31.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.556+0000 7f4c999ff700 1 --2- 172.21.15.8:0/1311141038 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f4c7c0a0260 0x7f4c7c0a2720 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4c94105e00 tx=0x7f4c88009260 comp rx=0 tx=0).stop 2023-08-11T12:25:31.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.556+0000 7f4c999ff700 1 -- 172.21.15.8:0/1311141038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c94100960 msgr2=0x7f4c9419e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:31.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.556+0000 7f4c999ff700 1 --2- 172.21.15.8:0/1311141038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c94100960 0x7f4c9419e8f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4c8400ec10 tx=0x7f4c8400ef20 comp rx=0 tx=0).stop 2023-08-11T12:25:31.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.556+0000 7f4c999ff700 1 -- 172.21.15.8:0/1311141038 shutdown_connections 2023-08-11T12:25:31.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.556+0000 7f4c999ff700 1 --2- 172.21.15.8:0/1311141038 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f4c7c0a0260 0x7f4c7c0a2720 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.556+0000 7f4c999ff700 1 --2- 172.21.15.8:0/1311141038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c94106970 0x7f4c94198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.556+0000 7f4c999ff700 1 --2- 172.21.15.8:0/1311141038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c94100960 0x7f4c9419e8f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.556+0000 7f4c999ff700 1 --2- 172.21.15.8:0/1311141038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c94101320 0x7f4c9419ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.556+0000 7f4c999ff700 1 -- 172.21.15.8:0/1311141038 >> 172.21.15.8:0/1311141038 conn(0x7f4c940fc490 msgr2=0x7f4c9410be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:31.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.556+0000 7f4c999ff700 1 -- 172.21.15.8:0/1311141038 shutdown_connections 2023-08-11T12:25:31.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.556+0000 7f4c999ff700 1 -- 172.21.15.8:0/1311141038 wait complete. 2023-08-11T12:25:31.588 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-08-11T12:25:31.735 INFO:teuthology.orchestra.run.smithi008.stderr:8600000 of 50000000 tuples (17%) done (elapsed 36.42 s, remaining 175.33 s) 2023-08-11T12:25:31.849 INFO:teuthology.orchestra.run.smithi008.stderr:8700000 of 50000000 tuples (17%) done (elapsed 36.54 s, remaining 173.44 s) 2023-08-11T12:25:31.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.858+0000 7ff762bff700 1 -- 172.21.15.8:0/2930099937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff75c0735e0 msgr2=0x7ff75c111450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:31.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.858+0000 7ff762bff700 1 --2- 172.21.15.8:0/2930099937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff75c0735e0 0x7ff75c111450 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff748009990 tx=0x7ff748009ca0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.858+0000 7ff762bff700 1 -- 172.21.15.8:0/2930099937 shutdown_connections 2023-08-11T12:25:31.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.858+0000 7ff762bff700 1 --2- 172.21.15.8:0/2930099937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff75c111990 0x7ff75c113d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.858+0000 7ff762bff700 1 --2- 172.21.15.8:0/2930099937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff75c072cc0 0x7ff75c0730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.858+0000 7ff762bff700 1 --2- 172.21.15.8:0/2930099937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff75c0735e0 0x7ff75c111450 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.858+0000 7ff762bff700 1 -- 172.21.15.8:0/2930099937 >> 172.21.15.8:0/2930099937 conn(0x7ff75c0fc4d0 msgr2=0x7ff75c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:31.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.858+0000 7ff762bff700 1 -- 172.21.15.8:0/2930099937 shutdown_connections 2023-08-11T12:25:31.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.858+0000 7ff762bff700 1 -- 172.21.15.8:0/2930099937 wait complete. 2023-08-11T12:25:31.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.860+0000 7ff762bff700 1 Processor -- start 2023-08-11T12:25:31.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.860+0000 7ff762bff700 1 -- start start 2023-08-11T12:25:31.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.860+0000 7ff762bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff75c072cc0 0x7ff75c19d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.860+0000 7ff762bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff75c0735e0 0x7ff75c19d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.860+0000 7ff762bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff75c111990 0x7ff75c1a19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.860+0000 7ff762bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c1a2000 con 0x7ff75c0735e0 2023-08-11T12:25:31.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.860+0000 7ff762bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c1a2170 con 0x7ff75c072cc0 2023-08-11T12:25:31.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.860+0000 7ff762bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c1a2330 con 0x7ff75c111990 2023-08-11T12:25:31.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.861+0000 7ff75bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff75c0735e0 0x7ff75c19d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.861+0000 7ff75bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff75c0735e0 0x7ff75c19d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39540/0 (socket says 172.21.15.8:39540) 2023-08-11T12:25:31.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.861+0000 7ff76099b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff75c072cc0 0x7ff75c19d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.861+0000 7ff75bfff700 1 -- 172.21.15.8:0/1918277768 learned_addr learned my addr 172.21.15.8:0/1918277768 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:31.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.861+0000 7ff76119c700 1 --2- 172.21.15.8:0/1918277768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff75c111990 0x7ff75c1a19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.861+0000 7ff76099b700 1 -- 172.21.15.8:0/1918277768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff75c111990 msgr2=0x7ff75c1a19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:31.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.861+0000 7ff76099b700 1 --2- 172.21.15.8:0/1918277768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff75c111990 0x7ff75c1a19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.861+0000 7ff76099b700 1 -- 172.21.15.8:0/1918277768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff75c0735e0 msgr2=0x7ff75c19d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:31.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.861+0000 7ff76099b700 1 --2- 172.21.15.8:0/1918277768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff75c0735e0 0x7ff75c19d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.861+0000 7ff76099b700 1 -- 172.21.15.8:0/1918277768 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7480095f0 con 0x7ff75c072cc0 2023-08-11T12:25:31.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.861+0000 7ff75bfff700 1 --2- 172.21.15.8:0/1918277768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff75c0735e0 0x7ff75c19d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:31.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.862+0000 7ff76099b700 1 --2- 172.21.15.8:0/1918277768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff75c072cc0 0x7ff75c19d020 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff75000c970 tx=0x7ff75000cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:31.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.862+0000 7ff759ffb700 1 -- 172.21.15.8:0/1918277768 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff750004440 con 0x7ff75c072cc0 2023-08-11T12:25:31.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.862+0000 7ff762bff700 1 -- 172.21.15.8:0/1918277768 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff75c1a2610 con 0x7ff75c072cc0 2023-08-11T12:25:31.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.862+0000 7ff759ffb700 1 -- 172.21.15.8:0/1918277768 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff750003b40 con 0x7ff75c072cc0 2023-08-11T12:25:31.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.862+0000 7ff759ffb700 1 -- 172.21.15.8:0/1918277768 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff750007bc0 con 0x7ff75c072cc0 2023-08-11T12:25:31.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.862+0000 7ff762bff700 1 -- 172.21.15.8:0/1918277768 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff75c1a9e50 con 0x7ff75c072cc0 2023-08-11T12:25:31.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.866+0000 7ff759ffb700 1 -- 172.21.15.8:0/1918277768 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 24) v1 ==== 134903+0+0 (secure 0 0 0) 0x7ff750003cb0 con 0x7ff75c072cc0 2023-08-11T12:25:31.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.867+0000 7ff759ffb700 1 --2- 172.21.15.8:0/1918277768 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff74c0a01e0 0x7ff74c0a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.867+0000 7ff759ffb700 1 -- 172.21.15.8:0/1918277768 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7ff7500cbb30 con 0x7ff75c072cc0 2023-08-11T12:25:31.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.868+0000 7ff75bfff700 1 --2- 172.21.15.8:0/1918277768 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff74c0a01e0 0x7ff74c0a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.868+0000 7ff75bfff700 1 --2- 172.21.15.8:0/1918277768 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff74c0a01e0 0x7ff74c0a26a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff75c19e630 tx=0x7ff74800b540 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:31.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.869+0000 7ff7764d3b80 1 Processor -- start 2023-08-11T12:25:31.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.869+0000 7ff7764d3b80 1 -- start start 2023-08-11T12:25:31.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.870+0000 7ff7764d3b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621d4ca8310 0x5621d4ca86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.870+0000 7ff7764d3b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621d4ca8c30 0x5621d4ca28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.870+0000 7ff7764d3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5621d4ca2e20 0x5621d4ca3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.870+0000 7ff7764d3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d4bfb630 con 0x5621d4ca2e20 2023-08-11T12:25:31.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.870+0000 7ff7764d3b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d4bf8f50 con 0x5621d4ca8c30 2023-08-11T12:25:31.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.870+0000 7ff7764d3b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d4bf4840 con 0x5621d4ca8310 2023-08-11T12:25:31.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.870+0000 7ff76099b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621d4ca8310 0x5621d4ca86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.870+0000 7ff76099b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621d4ca8310 0x5621d4ca86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:55448/0 (socket says 172.21.15.8:55448) 2023-08-11T12:25:31.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.870+0000 7ff76119c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5621d4ca2e20 0x5621d4ca3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.870+0000 7ff76099b700 1 -- 172.21.15.8:0/1144454912 learned_addr learned my addr 172.21.15.8:0/1144454912 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:31.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.870+0000 7ff75bfff700 1 --2- 172.21.15.8:0/1144454912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621d4ca8c30 0x5621d4ca28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.871+0000 7ff76099b700 1 -- 172.21.15.8:0/1144454912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621d4ca8c30 msgr2=0x5621d4ca28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:31.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.871+0000 7ff76099b700 1 --2- 172.21.15.8:0/1144454912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621d4ca8c30 0x5621d4ca28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.871+0000 7ff76099b700 1 -- 172.21.15.8:0/1144454912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5621d4ca2e20 msgr2=0x5621d4ca3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:31.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.871+0000 7ff76099b700 1 --2- 172.21.15.8:0/1144454912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5621d4ca2e20 0x5621d4ca3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.871+0000 7ff76099b700 1 -- 172.21.15.8:0/1144454912 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621d4a74630 con 0x5621d4ca8310 2023-08-11T12:25:31.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.871+0000 7ff76099b700 1 --2- 172.21.15.8:0/1144454912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621d4ca8310 0x5621d4ca86f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff7500a0580 tx=0x7ff7500988e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2522d6558fc05e9b server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:31.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.871+0000 7ff746ffd700 1 -- 172.21.15.8:0/1144454912 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7500993a0 con 0x5621d4ca8310 2023-08-11T12:25:31.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.871+0000 7ff746ffd700 1 -- 172.21.15.8:0/1144454912 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff750098ca0 con 0x5621d4ca8310 2023-08-11T12:25:31.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.871+0000 7ff746ffd700 1 -- 172.21.15.8:0/1144454912 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff750098190 con 0x5621d4ca8310 2023-08-11T12:25:31.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.872+0000 7ff7764d3b80 1 -- 172.21.15.8:0/1144454912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621d4ca8310 msgr2=0x5621d4ca86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:31.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.872+0000 7ff7764d3b80 1 --2- 172.21.15.8:0/1144454912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621d4ca8310 0x5621d4ca86f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff7500a0580 tx=0x7ff7500988e0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.872+0000 7ff7764d3b80 1 -- 172.21.15.8:0/1144454912 shutdown_connections 2023-08-11T12:25:31.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.872+0000 7ff7764d3b80 1 --2- 172.21.15.8:0/1144454912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621d4ca8310 0x5621d4ca86f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.872+0000 7ff7764d3b80 1 --2- 172.21.15.8:0/1144454912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5621d4ca2e20 0x5621d4ca3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.872+0000 7ff7764d3b80 1 --2- 172.21.15.8:0/1144454912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621d4ca8c30 0x5621d4ca28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.872+0000 7ff7764d3b80 1 -- 172.21.15.8:0/1144454912 >> 172.21.15.8:0/1144454912 conn(0x5621d4bcf950 msgr2=0x5621d4c9d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:31.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.872+0000 7ff7764d3b80 1 -- 172.21.15.8:0/1144454912 shutdown_connections 2023-08-11T12:25:31.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.872+0000 7ff7764d3b80 1 -- 172.21.15.8:0/1144454912 wait complete. 2023-08-11T12:25:31.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.873+0000 7ff7764d3b80 1 -- start start 2023-08-11T12:25:31.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.873+0000 7ff7764d3b80 1 Processor -- start 2023-08-11T12:25:31.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.874+0000 7ff7764d3b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621d4ca2e20 0x5621d4caeba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.874+0000 7ff7764d3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5621d4ca8310 0x5621d4cabec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.874+0000 7ff7764d3b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621d4ca8c30 0x5621d4cac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.874+0000 7ff7764d3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d4b92ac0 con 0x5621d4ca8310 2023-08-11T12:25:31.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.874+0000 7ff7764d3b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d4b927c0 con 0x5621d4ca8c30 2023-08-11T12:25:31.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.874+0000 7ff7764d3b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d4a76920 con 0x5621d4ca2e20 2023-08-11T12:25:31.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.874+0000 7ff7764d3b80 10 client.0 _ll_register_callbacks cb 0x5621d4b95ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:25:31.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.875+0000 7ff76099b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621d4ca2e20 0x5621d4caeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.875+0000 7ff76099b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621d4ca2e20 0x5621d4caeba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:55454/0 (socket says 172.21.15.8:55454) 2023-08-11T12:25:31.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.875+0000 7ff76099b700 1 -- 172.21.15.8:0/4216359039 learned_addr learned my addr 172.21.15.8:0/4216359039 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:31.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.875+0000 7ff75bfff700 1 --2- 172.21.15.8:0/4216359039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5621d4ca8310 0x5621d4cabec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.875+0000 7ff76119c700 1 --2- 172.21.15.8:0/4216359039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621d4ca8c30 0x5621d4cac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.875+0000 7ff76099b700 1 -- 172.21.15.8:0/4216359039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621d4ca8c30 msgr2=0x5621d4cac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:31.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.875+0000 7ff76099b700 1 --2- 172.21.15.8:0/4216359039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621d4ca8c30 0x5621d4cac4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.875+0000 7ff76099b700 1 -- 172.21.15.8:0/4216359039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5621d4ca8310 msgr2=0x5621d4cabec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:31.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.875+0000 7ff76099b700 1 --2- 172.21.15.8:0/4216359039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5621d4ca8310 0x5621d4cabec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.875+0000 7ff76099b700 1 -- 172.21.15.8:0/4216359039 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff75c1a9e50 con 0x5621d4ca2e20 2023-08-11T12:25:31.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.875+0000 7ff75bfff700 1 --2- 172.21.15.8:0/4216359039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5621d4ca8310 0x5621d4cabec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:25:31.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.875+0000 7ff76099b700 1 --2- 172.21.15.8:0/4216359039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621d4ca2e20 0x5621d4caeba0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff7500951a0 tx=0x7ff7500993a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5b00f899cdaa1cd server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:31.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.875+0000 7ff73bfff700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:25:31.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.875+0000 7ff73bfff700 1 -- 172.21.15.8:0/4216359039 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff750099100 con 0x5621d4ca2e20 2023-08-11T12:25:31.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.875+0000 7ff73bfff700 1 -- 172.21.15.8:0/4216359039 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7ff7500a0620 con 0x5621d4ca2e20 2023-08-11T12:25:31.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.875+0000 7ff7764d3b80 1 -- 172.21.15.8:0/4216359039 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5621d4c95a90 con 0x5621d4ca2e20 2023-08-11T12:25:31.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.876+0000 7ff73bfff700 1 -- 172.21.15.8:0/4216359039 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7500a07e0 con 0x5621d4ca2e20 2023-08-11T12:25:31.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.876+0000 7ff7764d3b80 10 client.25948 fetch_fsmap learned FSMap version 31 2023-08-11T12:25:31.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.876+0000 7ff7764d3b80 1 -- 172.21.15.8:0/4216359039 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5621d4a20de0 con 0x5621d4ca2e20 2023-08-11T12:25:31.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.876+0000 7ff73bfff700 1 -- 172.21.15.8:0/4216359039 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7500c6020 con 0x5621d4ca2e20 2023-08-11T12:25:31.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.876+0000 7ff73bfff700 1 -- 172.21.15.8:0/4216359039 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 31) v1 ==== 7914+0+0 (secure 0 0 0) 0x7ff7500c9120 con 0x5621d4ca2e20 2023-08-11T12:25:31.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.876+0000 7ff7764d3b80 10 client.25948 fetch_fsmap finished waiting for FSMap version 31 2023-08-11T12:25:31.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.876+0000 7ff7764d3b80 10 client.25948 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-08-11T12:25:31.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.876+0000 7ff7764d3b80 20 client.25948 populate_metadata read hostname 'smithi008' 2023-08-11T12:25:31.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.876+0000 7ff7764d3b80 1 --2- 172.21.15.8:0/4216359039 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x5621d4cbbf70 0x5621d4cbe360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.876+0000 7ff7764d3b80 4 client.25948 mds_command: new command op to 24517 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:25:31.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.876+0000 7ff7764d3b80 1 -- 172.21.15.8:0/4216359039 --> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5621d4c714e0 con 0x5621d4cbbf70 2023-08-11T12:25:31.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.877+0000 7ff75bfff700 1 --2- 172.21.15.8:0/4216359039 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x5621d4cbbf70 0x5621d4cbe360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.877+0000 7ff75bfff700 1 --2- 172.21.15.8:0/4216359039 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x5621d4cbbf70 0x5621d4cbe360 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=670ecd17dd3c013f server_cookie=83add5e404b5d285 in_seq=0 out_seq=0 2023-08-11T12:25:31.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.877+0000 7ff73bfff700 10 client.25948 ms_handle_connect on v2:172.21.15.194:6834/2457430285 2023-08-11T12:25:31.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.878+0000 7ff73bfff700 1 -- 172.21.15.8:0/4216359039 <== mds.2 v2:172.21.15.194:6834/2457430285 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5621d4c714e0 con 0x5621d4cbbf70 2023-08-11T12:25:31.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.878+0000 7ff73bfff700 10 client.25948 handle_command_reply: tid=0 2023-08-11T12:25:31.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.878+0000 7ff7764d3b80 1 client.25948 shutdown 2023-08-11T12:25:31.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.878+0000 7ff7764d3b80 1 -- 172.21.15.8:0/4216359039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621d4ca2e20 msgr2=0x5621d4caeba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:31.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.878+0000 7ff7764d3b80 1 --2- 172.21.15.8:0/4216359039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621d4ca2e20 0x5621d4caeba0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff7500951a0 tx=0x7ff7500993a0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.878+0000 7ff7764d3b80 1 -- 172.21.15.8:0/4216359039 shutdown_connections 2023-08-11T12:25:31.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.878+0000 7ff7764d3b80 1 --2- 172.21.15.8:0/4216359039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621d4ca2e20 0x5621d4caeba0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.878+0000 7ff7764d3b80 1 --2- 172.21.15.8:0/4216359039 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x5621d4cbbf70 0x5621d4cbe360 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.878+0000 7ff7764d3b80 1 --2- 172.21.15.8:0/4216359039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621d4ca8c30 0x5621d4cac4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.878+0000 7ff7764d3b80 1 --2- 172.21.15.8:0/4216359039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5621d4ca8310 0x5621d4cabec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.878+0000 7ff73bfff700 0 client.25948 ms_handle_reset on v2:172.21.15.194:6834/2457430285 2023-08-11T12:25:31.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.878+0000 7ff7764d3b80 1 -- 172.21.15.8:0/4216359039 >> 172.21.15.8:0/4216359039 conn(0x5621d4bcf950 msgr2=0x5621d4c97cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:31.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.878+0000 7ff7764d3b80 1 -- 172.21.15.8:0/4216359039 shutdown_connections 2023-08-11T12:25:31.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.879+0000 7ff7764d3b80 1 -- 172.21.15.8:0/4216359039 wait complete. 2023-08-11T12:25:31.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.879+0000 7ff7764d3b80 20 client.25948 trim_cache size 0 max 16384 2023-08-11T12:25:31.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.893+0000 7ff7764d3b80 1 Processor -- start 2023-08-11T12:25:31.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.893+0000 7ff7764d3b80 1 -- start start 2023-08-11T12:25:31.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.893+0000 7ff7764d3b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621d4ca2e20 0x5621d4ca28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.893+0000 7ff7764d3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5621d4ca8310 0x5621d4cabe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.893+0000 7ff7764d3b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621d4ca8c30 0x5621d4cae660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.893+0000 7ff7764d3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d4c9e4f0 con 0x5621d4ca8310 2023-08-11T12:25:31.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.893+0000 7ff7764d3b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d4cacb00 con 0x5621d4ca2e20 2023-08-11T12:25:31.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.893+0000 7ff7764d3b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d4ca7f90 con 0x5621d4ca8c30 2023-08-11T12:25:31.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.893+0000 7ff76099b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621d4ca2e20 0x5621d4ca28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.893+0000 7ff76099b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621d4ca2e20 0x5621d4ca28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:33870/0 (socket says 172.21.15.8:33870) 2023-08-11T12:25:31.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.893+0000 7ff76099b700 1 -- 172.21.15.8:0/2429049644 learned_addr learned my addr 172.21.15.8:0/2429049644 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:31.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.893+0000 7ff75bfff700 1 --2- 172.21.15.8:0/2429049644 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5621d4ca8310 0x5621d4cabe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.894+0000 7ff76119c700 1 --2- 172.21.15.8:0/2429049644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621d4ca8c30 0x5621d4cae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.894+0000 7ff76099b700 1 -- 172.21.15.8:0/2429049644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621d4ca8c30 msgr2=0x5621d4cae660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:31.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.894+0000 7ff76099b700 1 --2- 172.21.15.8:0/2429049644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621d4ca8c30 0x5621d4cae660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.894+0000 7ff76099b700 1 -- 172.21.15.8:0/2429049644 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5621d4ca8310 msgr2=0x5621d4cabe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:31.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.894+0000 7ff76099b700 1 --2- 172.21.15.8:0/2429049644 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5621d4ca8310 0x5621d4cabe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.894+0000 7ff76099b700 1 -- 172.21.15.8:0/2429049644 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621d4a09c60 con 0x5621d4ca2e20 2023-08-11T12:25:31.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.894+0000 7ff76099b700 1 --2- 172.21.15.8:0/2429049644 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621d4ca2e20 0x5621d4ca28e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff750098c30 tx=0x7ff750007340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5de3e3bcc16af28a server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:31.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.894+0000 7ff7477fe700 1 -- 172.21.15.8:0/2429049644 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7500c9290 con 0x5621d4ca2e20 2023-08-11T12:25:31.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.894+0000 7ff7477fe700 1 -- 172.21.15.8:0/2429049644 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7500c6070 con 0x5621d4ca2e20 2023-08-11T12:25:31.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.894+0000 7ff7477fe700 1 -- 172.21.15.8:0/2429049644 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7500a0880 con 0x5621d4ca2e20 2023-08-11T12:25:31.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.895+0000 7ff7764d3b80 1 -- 172.21.15.8:0/2429049644 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621d4ca2e20 msgr2=0x5621d4ca28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:31.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.895+0000 7ff7764d3b80 1 --2- 172.21.15.8:0/2429049644 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621d4ca2e20 0x5621d4ca28e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff750098c30 tx=0x7ff750007340 comp rx=0 tx=0).stop 2023-08-11T12:25:31.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.895+0000 7ff7764d3b80 1 -- 172.21.15.8:0/2429049644 shutdown_connections 2023-08-11T12:25:31.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.895+0000 7ff7764d3b80 1 --2- 172.21.15.8:0/2429049644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621d4ca8c30 0x5621d4cae660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.895+0000 7ff7764d3b80 1 --2- 172.21.15.8:0/2429049644 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621d4ca2e20 0x5621d4ca28e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.895+0000 7ff7764d3b80 1 --2- 172.21.15.8:0/2429049644 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5621d4ca8310 0x5621d4cabe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.895+0000 7ff7764d3b80 1 -- 172.21.15.8:0/2429049644 >> 172.21.15.8:0/2429049644 conn(0x5621d4bcf950 msgr2=0x5621d4cab760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:31.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.896+0000 7ff7764d3b80 1 -- 172.21.15.8:0/2429049644 shutdown_connections 2023-08-11T12:25:31.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.896+0000 7ff7764d3b80 1 -- 172.21.15.8:0/2429049644 wait complete. 2023-08-11T12:25:31.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.896+0000 7ff7764d3b80 1 -- start start 2023-08-11T12:25:31.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.897+0000 7ff7764d3b80 1 Processor -- start 2023-08-11T12:25:31.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.897+0000 7ff7764d3b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621d4ca2e20 0x5621d4cb3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.897+0000 7ff7764d3b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621d4ca8310 0x5621d4cb3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.897+0000 7ff7764d3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5621d4ca8c30 0x5621d4cb1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.897+0000 7ff7764d3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d4cb1e80 con 0x5621d4ca8c30 2023-08-11T12:25:31.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.897+0000 7ff7764d3b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d4cb1ff0 con 0x5621d4ca2e20 2023-08-11T12:25:31.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.897+0000 7ff7764d3b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d4cb21b0 con 0x5621d4ca8310 2023-08-11T12:25:31.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.897+0000 7ff7764d3b80 10 client.0 _ll_register_callbacks cb 0x7ff754007c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:25:31.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.898+0000 7ff76099b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621d4ca2e20 0x5621d4cb3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.898+0000 7ff76099b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621d4ca2e20 0x5621d4cb3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:33878/0 (socket says 172.21.15.8:33878) 2023-08-11T12:25:31.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.898+0000 7ff76099b700 1 -- 172.21.15.8:0/1225552213 learned_addr learned my addr 172.21.15.8:0/1225552213 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:31.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.898+0000 7ff75bfff700 1 --2- 172.21.15.8:0/1225552213 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621d4ca8310 0x5621d4cb3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.898+0000 7ff76119c700 1 --2- 172.21.15.8:0/1225552213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5621d4ca8c30 0x5621d4cb1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.898+0000 7ff76099b700 1 -- 172.21.15.8:0/1225552213 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621d4ca8310 msgr2=0x5621d4cb3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:31.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.898+0000 7ff76099b700 1 --2- 172.21.15.8:0/1225552213 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621d4ca8310 0x5621d4cb3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.898+0000 7ff76099b700 1 -- 172.21.15.8:0/1225552213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5621d4ca8c30 msgr2=0x5621d4cb1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:31.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.898+0000 7ff76099b700 1 --2- 172.21.15.8:0/1225552213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5621d4ca8c30 0x5621d4cb1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.898+0000 7ff76099b700 1 -- 172.21.15.8:0/1225552213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621d4a20de0 con 0x5621d4ca2e20 2023-08-11T12:25:31.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.898+0000 7ff76119c700 1 --2- 172.21.15.8:0/1225552213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5621d4ca8c30 0x5621d4cb1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:25:31.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.898+0000 7ff76099b700 1 --2- 172.21.15.8:0/1225552213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621d4ca2e20 0x5621d4cb3120 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff750095710 tx=0x7ff7500c92a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b903742dbf75ea44 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:31.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.898+0000 7ff73bfff700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:25:31.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.898+0000 7ff73bfff700 1 -- 172.21.15.8:0/1225552213 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75009cad0 con 0x5621d4ca2e20 2023-08-11T12:25:31.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.898+0000 7ff7764d3b80 1 -- 172.21.15.8:0/1225552213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff750098ca0 con 0x5621d4ca2e20 2023-08-11T12:25:31.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.898+0000 7ff73bfff700 1 -- 172.21.15.8:0/1225552213 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7ff7500c7080 con 0x5621d4ca2e20 2023-08-11T12:25:31.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.899+0000 7ff73bfff700 1 -- 172.21.15.8:0/1225552213 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff750098600 con 0x5621d4ca2e20 2023-08-11T12:25:31.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.899+0000 7ff7764d3b80 10 client.25940 fetch_fsmap learned FSMap version 31 2023-08-11T12:25:31.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.899+0000 7ff7764d3b80 1 -- 172.21.15.8:0/1225552213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5621d4a47250 con 0x5621d4ca2e20 2023-08-11T12:25:31.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.899+0000 7ff73bfff700 1 -- 172.21.15.8:0/1225552213 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff750098ca0 con 0x5621d4ca2e20 2023-08-11T12:25:31.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.899+0000 7ff73bfff700 1 -- 172.21.15.8:0/1225552213 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 31) v1 ==== 7914+0+0 (secure 0 0 0) 0x7ff75000ed30 con 0x5621d4ca2e20 2023-08-11T12:25:31.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.899+0000 7ff7764d3b80 10 client.25940 fetch_fsmap finished waiting for FSMap version 31 2023-08-11T12:25:31.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.899+0000 7ff7764d3b80 10 client.25940 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-08-11T12:25:31.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.899+0000 7ff7764d3b80 20 client.25940 populate_metadata read hostname 'smithi008' 2023-08-11T12:25:31.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.899+0000 7ff7764d3b80 1 --2- 172.21.15.8:0/1225552213 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x5621d4d109c0 0x5621d4d12db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:31.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.899+0000 7ff7764d3b80 4 client.25940 mds_command: new command op to 24517 tid=0[{"prefix": "damage ls"}] 2023-08-11T12:25:31.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.899+0000 7ff7764d3b80 1 -- 172.21.15.8:0/1225552213 --> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5621d4bed820 con 0x5621d4d109c0 2023-08-11T12:25:31.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.900+0000 7ff75bfff700 1 --2- 172.21.15.8:0/1225552213 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x5621d4d109c0 0x5621d4d12db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:31.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.900+0000 7ff75bfff700 1 --2- 172.21.15.8:0/1225552213 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x5621d4d109c0 0x5621d4d12db0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1b652204aba4c233 server_cookie=c60daffc41062e7c in_seq=0 out_seq=0 2023-08-11T12:25:31.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.900+0000 7ff73bfff700 10 client.25940 ms_handle_connect on v2:172.21.15.194:6834/2457430285 2023-08-11T12:25:31.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.900+0000 7ff73bfff700 1 -- 172.21.15.8:0/1225552213 <== mds.2 v2:172.21.15.194:6834/2457430285 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5621d4bed820 con 0x5621d4d109c0 2023-08-11T12:25:31.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.900+0000 7ff73bfff700 10 client.25940 handle_command_reply: tid=0 2023-08-11T12:25:31.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.900+0000 7ff7764d3b80 1 client.25940 shutdown 2023-08-11T12:25:31.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.900+0000 7ff7764d3b80 1 -- 172.21.15.8:0/1225552213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621d4ca2e20 msgr2=0x5621d4cb3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:31.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.900+0000 7ff7764d3b80 1 --2- 172.21.15.8:0/1225552213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621d4ca2e20 0x5621d4cb3120 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff750095710 tx=0x7ff7500c92a0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.901+0000 7ff7764d3b80 1 -- 172.21.15.8:0/1225552213 shutdown_connections 2023-08-11T12:25:31.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.901+0000 7ff7764d3b80 1 --2- 172.21.15.8:0/1225552213 >> [v2:172.21.15.194:6834/2457430285,v1:172.21.15.194:6835/2457430285] conn(0x5621d4d109c0 0x5621d4d12db0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.901+0000 7ff7764d3b80 1 --2- 172.21.15.8:0/1225552213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5621d4ca8c30 0x5621d4cb1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.901+0000 7ff7764d3b80 1 --2- 172.21.15.8:0/1225552213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621d4ca2e20 0x5621d4cb3120 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.901+0000 7ff7764d3b80 1 --2- 172.21.15.8:0/1225552213 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621d4ca8310 0x5621d4cb3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.901+0000 7ff7764d3b80 1 -- 172.21.15.8:0/1225552213 >> 172.21.15.8:0/1225552213 conn(0x5621d4bcf950 msgr2=0x5621d4c97420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:31.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.901+0000 7ff73bfff700 0 client.25940 ms_handle_reset on v2:172.21.15.194:6834/2457430285 2023-08-11T12:25:31.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.901+0000 7ff7764d3b80 1 -- 172.21.15.8:0/1225552213 shutdown_connections 2023-08-11T12:25:31.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.901+0000 7ff7764d3b80 1 -- 172.21.15.8:0/1225552213 wait complete. 2023-08-11T12:25:31.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.901+0000 7ff7764d3b80 20 client.25940 trim_cache size 0 max 16384 2023-08-11T12:25:31.911 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-08-11T12:25:31.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.902+0000 7ff762bff700 1 -- 172.21.15.8:0/1918277768 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff74c0a01e0 msgr2=0x7ff74c0a26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:31.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.902+0000 7ff762bff700 1 --2- 172.21.15.8:0/1918277768 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff74c0a01e0 0x7ff74c0a26a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff75c19e630 tx=0x7ff74800b540 comp rx=0 tx=0).stop 2023-08-11T12:25:31.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.902+0000 7ff762bff700 1 -- 172.21.15.8:0/1918277768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff75c072cc0 msgr2=0x7ff75c19d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:31.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.902+0000 7ff762bff700 1 --2- 172.21.15.8:0/1918277768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff75c072cc0 0x7ff75c19d020 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff75000c970 tx=0x7ff75000cc80 comp rx=0 tx=0).stop 2023-08-11T12:25:31.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.902+0000 7ff762bff700 1 -- 172.21.15.8:0/1918277768 shutdown_connections 2023-08-11T12:25:31.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.902+0000 7ff762bff700 1 --2- 172.21.15.8:0/1918277768 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff74c0a01e0 0x7ff74c0a26a0 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff75c19e630 tx=0x7ff74800b540 comp rx=0 tx=0).stop 2023-08-11T12:25:31.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.902+0000 7ff762bff700 1 --2- 172.21.15.8:0/1918277768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff75c111990 0x7ff75c1a19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.902+0000 7ff762bff700 1 --2- 172.21.15.8:0/1918277768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff75c072cc0 0x7ff75c19d020 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.902+0000 7ff762bff700 1 --2- 172.21.15.8:0/1918277768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff75c0735e0 0x7ff75c19d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:31.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.902+0000 7ff762bff700 1 -- 172.21.15.8:0/1918277768 >> 172.21.15.8:0/1918277768 conn(0x7ff75c0fc4d0 msgr2=0x7ff75c0fd140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:31.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.902+0000 7ff762bff700 1 -- 172.21.15.8:0/1918277768 shutdown_connections 2023-08-11T12:25:31.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:31.902+0000 7ff762bff700 1 -- 172.21.15.8:0/1918277768 wait complete. 2023-08-11T12:25:31.920 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:31 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2050617569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:25:31.923 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-08-11T12:25:32.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.010+0000 7f09bc9ff700 1 -- 172.21.15.8:0/2476766549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09b8067e80 msgr2=0x7f09b8068300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:32.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.010+0000 7f09bc9ff700 1 --2- 172.21.15.8:0/2476766549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09b8067e80 0x7f09b8068300 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f09ac009990 tx=0x7f09ac009ca0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.011+0000 7f09bc9ff700 1 -- 172.21.15.8:0/2476766549 shutdown_connections 2023-08-11T12:25:32.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.011+0000 7f09bc9ff700 1 --2- 172.21.15.8:0/2476766549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09b81068b0 0x7f09b8106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.011+0000 7f09bc9ff700 1 --2- 172.21.15.8:0/2476766549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09b8068840 0x7f09b810d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.011+0000 7f09bc9ff700 1 --2- 172.21.15.8:0/2476766549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09b8067e80 0x7f09b8068300 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.011+0000 7f09bc9ff700 1 -- 172.21.15.8:0/2476766549 >> 172.21.15.8:0/2476766549 conn(0x7f09b8075300 msgr2=0x7f09b8075710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.011+0000 7f09bc9ff700 1 -- 172.21.15.8:0/2476766549 shutdown_connections 2023-08-11T12:25:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.011+0000 7f09bc9ff700 1 -- 172.21.15.8:0/2476766549 wait complete. 2023-08-11T12:25:32.015 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.012+0000 7f09bc9ff700 1 Processor -- start 2023-08-11T12:25:32.015 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.013+0000 7f09bc9ff700 1 -- start start 2023-08-11T12:25:32.016 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.013+0000 7f09bc9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09b8067e80 0x7f09b80ffa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.016 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.013+0000 7f09bc9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09b8068840 0x7f09b80fffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.016 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.013+0000 7f09bc9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09b81068b0 0x7f09b81a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.017 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.013+0000 7f09bc9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b81007d0 con 0x7f09b81068b0 2023-08-11T12:25:32.017 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.013+0000 7f09bc9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b81a5130 con 0x7f09b8067e80 2023-08-11T12:25:32.017 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.013+0000 7f09bc9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b81a5270 con 0x7f09b8068840 2023-08-11T12:25:32.017 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.013+0000 7f09b659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09b8067e80 0x7f09b80ffa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.017 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.013+0000 7f09b659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09b8067e80 0x7f09b80ffa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:33906/0 (socket says 172.21.15.8:33906) 2023-08-11T12:25:32.017 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.014+0000 7f09b659c700 1 -- 172.21.15.8:0/2607438086 learned_addr learned my addr 172.21.15.8:0/2607438086 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:32.017 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.014+0000 7f09b5d9b700 1 --2- 172.21.15.8:0/2607438086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09b8068840 0x7f09b80fffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.018 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.014+0000 7f09b6d9d700 1 --2- 172.21.15.8:0/2607438086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09b81068b0 0x7f09b81a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.018 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.014+0000 7f09b659c700 1 -- 172.21.15.8:0/2607438086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09b8068840 msgr2=0x7f09b80fffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:32.018 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.014+0000 7f09b659c700 1 --2- 172.21.15.8:0/2607438086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09b8068840 0x7f09b80fffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.018 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.014+0000 7f09b659c700 1 -- 172.21.15.8:0/2607438086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09b81068b0 msgr2=0x7f09b81a4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:32.019 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.014+0000 7f09b659c700 1 --2- 172.21.15.8:0/2607438086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09b81068b0 0x7f09b81a4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.019 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.014+0000 7f09b659c700 1 -- 172.21.15.8:0/2607438086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ac0095f0 con 0x7f09b8067e80 2023-08-11T12:25:32.019 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.014+0000 7f09b5d9b700 1 --2- 172.21.15.8:0/2607438086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09b8068840 0x7f09b80fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:32.019 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.014+0000 7f09b659c700 1 --2- 172.21.15.8:0/2607438086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09b8067e80 0x7f09b80ffa60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f09a800e9a0 tx=0x7f09a800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:32.021 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.014+0000 7f09a77fe700 1 -- 172.21.15.8:0/2607438086 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a8009790 con 0x7f09b8067e80 2023-08-11T12:25:32.021 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.015+0000 7f09bc9ff700 1 -- 172.21.15.8:0/2607438086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b81a54d0 con 0x7f09b8067e80 2023-08-11T12:25:32.021 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.015+0000 7f09a77fe700 1 -- 172.21.15.8:0/2607438086 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f09a800cbd0 con 0x7f09b8067e80 2023-08-11T12:25:32.022 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.015+0000 7f09a77fe700 1 -- 172.21.15.8:0/2607438086 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a8018680 con 0x7f09b8067e80 2023-08-11T12:25:32.022 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.015+0000 7f09bc9ff700 1 -- 172.21.15.8:0/2607438086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b81a5a00 con 0x7f09b8067e80 2023-08-11T12:25:32.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.020+0000 7f09a77fe700 1 -- 172.21.15.8:0/2607438086 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 24) v1 ==== 134903+0+0 (secure 0 0 0) 0x7f09a800cd40 con 0x7f09b8067e80 2023-08-11T12:25:32.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.021+0000 7f09d035bb80 1 Processor -- start 2023-08-11T12:25:32.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.021+0000 7f09d035bb80 1 -- start start 2023-08-11T12:25:32.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.022+0000 7f09d035bb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55daeb9bde80 0x55daeb9be260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.022+0000 7f09a77fe700 1 --2- 172.21.15.8:0/2607438086 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f09a00a0260 0x7f09a00a2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.022+0000 7f09d035bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55daeb9b8630 0x55daeb9b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.026 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.022+0000 7f09d035bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55daeb9b8ff0 0x55daeb9c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.026 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.022+0000 7f09d035bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daeb9115d0 con 0x55daeb9b8630 2023-08-11T12:25:32.026 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.022+0000 7f09d035bb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daeb90eef0 con 0x55daeb9bde80 2023-08-11T12:25:32.026 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.022+0000 7f09d035bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daeb90a7e0 con 0x55daeb9b8ff0 2023-08-11T12:25:32.026 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.022+0000 7f09a77fe700 1 -- 172.21.15.8:0/2607438086 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f09a8014070 con 0x7f09b8067e80 2023-08-11T12:25:32.026 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.022+0000 7f09b6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55daeb9bde80 0x55daeb9be260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.026 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.022+0000 7f09b6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55daeb9bde80 0x55daeb9be260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:33916/0 (socket says 172.21.15.8:33916) 2023-08-11T12:25:32.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.022+0000 7f09b6d9d700 1 -- 172.21.15.8:0/2003534765 learned_addr learned my addr 172.21.15.8:0/2003534765 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:32.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.022+0000 7f09b6d9d700 1 --2- 172.21.15.8:0/2003534765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55daeb9b8ff0 0x55daeb9c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.022+0000 7f09b5d9b700 1 --2- 172.21.15.8:0/2003534765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55daeb9b8630 0x55daeb9b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.023+0000 7f09b659c700 1 --2- 172.21.15.8:0/2607438086 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f09a00a0260 0x7f09a00a2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.023+0000 7f09b6d9d700 1 -- 172.21.15.8:0/2003534765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55daeb9b8ff0 msgr2=0x55daeb9c4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:32.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.023+0000 7f09b6d9d700 1 --2- 172.21.15.8:0/2003534765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55daeb9b8ff0 0x55daeb9c4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.023+0000 7f09b6d9d700 1 -- 172.21.15.8:0/2003534765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55daeb9b8630 msgr2=0x55daeb9b8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:32.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.023+0000 7f09b6d9d700 1 --2- 172.21.15.8:0/2003534765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55daeb9b8630 0x55daeb9b8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.023+0000 7f09b6d9d700 1 -- 172.21.15.8:0/2003534765 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55daeb78a5d0 con 0x55daeb9bde80 2023-08-11T12:25:32.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.023+0000 7f09b6d9d700 1 --2- 172.21.15.8:0/2003534765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55daeb9bde80 0x55daeb9be260 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f09b0009fd0 tx=0x7f09b0009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b8133e870ea4ec1 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:32.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.023+0000 7f09a4ff9700 1 -- 172.21.15.8:0/2003534765 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b000e070 con 0x55daeb9bde80 2023-08-11T12:25:32.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.023+0000 7f09a4ff9700 1 -- 172.21.15.8:0/2003534765 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f09b000f040 con 0x55daeb9bde80 2023-08-11T12:25:32.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.023+0000 7f09a4ff9700 1 -- 172.21.15.8:0/2003534765 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b00178b0 con 0x55daeb9bde80 2023-08-11T12:25:32.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.024+0000 7f09d035bb80 1 -- 172.21.15.8:0/2003534765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55daeb9bde80 msgr2=0x55daeb9be260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:32.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.024+0000 7f09b659c700 1 --2- 172.21.15.8:0/2607438086 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f09a00a0260 0x7f09a00a2720 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f09a80c9110 tx=0x7f09a80b6f90 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:32.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.024+0000 7f09d035bb80 1 --2- 172.21.15.8:0/2003534765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55daeb9bde80 0x55daeb9be260 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f09b0009fd0 tx=0x7f09b0009920 comp rx=0 tx=0).stop 2023-08-11T12:25:32.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.024+0000 7f09d035bb80 1 -- 172.21.15.8:0/2003534765 shutdown_connections 2023-08-11T12:25:32.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.024+0000 7f09d035bb80 1 --2- 172.21.15.8:0/2003534765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55daeb9b8ff0 0x55daeb9c4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.024+0000 7f09d035bb80 1 --2- 172.21.15.8:0/2003534765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55daeb9bde80 0x55daeb9be260 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.024+0000 7f09d035bb80 1 --2- 172.21.15.8:0/2003534765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55daeb9b8630 0x55daeb9b8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.024+0000 7f09d035bb80 1 -- 172.21.15.8:0/2003534765 >> 172.21.15.8:0/2003534765 conn(0x55daeb8e58f0 msgr2=0x55daeb9b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.024+0000 7f09d035bb80 1 -- 172.21.15.8:0/2003534765 shutdown_connections 2023-08-11T12:25:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.024+0000 7f09d035bb80 1 -- 172.21.15.8:0/2003534765 wait complete. 2023-08-11T12:25:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.025+0000 7f09d035bb80 1 -- start start 2023-08-11T12:25:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.025+0000 7f09d035bb80 1 Processor -- start 2023-08-11T12:25:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.026+0000 7f09d035bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55daeb9b8630 0x55daeb9c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.026+0000 7f09d035bb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55daeb9b8ff0 0x55daeb9c8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.026+0000 7f09d035bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55daeb9bde80 0x55daeb9c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.026+0000 7f09d035bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daeb8a8a60 con 0x55daeb9bde80 2023-08-11T12:25:32.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.026+0000 7f09d035bb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daeb8a8760 con 0x55daeb9b8ff0 2023-08-11T12:25:32.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.026+0000 7f09d035bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daeb78c8c0 con 0x55daeb9b8630 2023-08-11T12:25:32.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.026+0000 7f09d035bb80 10 client.0 _ll_register_callbacks cb 0x55daeb8aba50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:25:32.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.026+0000 7f09b5d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55daeb9b8ff0 0x55daeb9c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.027+0000 7f09b5d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55daeb9b8ff0 0x55daeb9c8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:33920/0 (socket says 172.21.15.8:33920) 2023-08-11T12:25:32.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.027+0000 7f09b5d9b700 1 -- 172.21.15.8:0/1313586207 learned_addr learned my addr 172.21.15.8:0/1313586207 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:32.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.027+0000 7f09b6d9d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55daeb9b8630 0x55daeb9c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.027+0000 7f09b6d9d700 1 --2- 172.21.15.8:0/1313586207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55daeb9bde80 0x55daeb9c1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.027+0000 7f09b5d9b700 1 -- 172.21.15.8:0/1313586207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55daeb9b8630 msgr2=0x55daeb9c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:32.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.027+0000 7f09b5d9b700 1 --2- 172.21.15.8:0/1313586207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55daeb9b8630 0x55daeb9c7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.027+0000 7f09b5d9b700 1 -- 172.21.15.8:0/1313586207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55daeb9bde80 msgr2=0x55daeb9c1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:32.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.027+0000 7f09b5d9b700 1 --2- 172.21.15.8:0/1313586207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55daeb9bde80 0x55daeb9c1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.027+0000 7f09b5d9b700 1 -- 172.21.15.8:0/1313586207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b0007500 con 0x55daeb9b8ff0 2023-08-11T12:25:32.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.027+0000 7f09b6d9d700 1 --2- 172.21.15.8:0/1313586207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55daeb9bde80 0x55daeb9c1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:25:32.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.027+0000 7f09b5d9b700 1 --2- 172.21.15.8:0/1313586207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55daeb9b8ff0 0x55daeb9c8050 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f09ac009990 tx=0x7f09ac005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8b63fc0e7519f92 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:32.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.027+0000 7f099dffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:25:32.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.028+0000 7f099dffb700 1 -- 172.21.15.8:0/1313586207 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac01d070 con 0x55daeb9b8ff0 2023-08-11T12:25:32.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.028+0000 7f09d035bb80 1 -- 172.21.15.8:0/1313586207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55daeb9ab7e0 con 0x55daeb9b8ff0 2023-08-11T12:25:32.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.028+0000 7f099dffb700 1 -- 172.21.15.8:0/1313586207 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f09ac004910 con 0x55daeb9b8ff0 2023-08-11T12:25:32.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.028+0000 7f099dffb700 1 -- 172.21.15.8:0/1313586207 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09ac004ad0 con 0x55daeb9b8ff0 2023-08-11T12:25:32.036 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.028+0000 7f09d035bb80 10 client.25952 fetch_fsmap learned FSMap version 31 2023-08-11T12:25:32.036 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.028+0000 7f09d035bb80 1 -- 172.21.15.8:0/1313586207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55daeb736d80 con 0x55daeb9b8ff0 2023-08-11T12:25:32.036 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.028+0000 7f099dffb700 1 -- 172.21.15.8:0/1313586207 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55daeb9ab7e0 con 0x55daeb9b8ff0 2023-08-11T12:25:32.036 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.028+0000 7f099dffb700 1 -- 172.21.15.8:0/1313586207 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 31) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f09ac024ae0 con 0x55daeb9b8ff0 2023-08-11T12:25:32.036 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.029+0000 7f09d035bb80 10 client.25952 fetch_fsmap finished waiting for FSMap version 31 2023-08-11T12:25:32.036 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.029+0000 7f09d035bb80 10 client.25952 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-11T12:25:32.036 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.029+0000 7f09d035bb80 20 client.25952 populate_metadata read hostname 'smithi008' 2023-08-11T12:25:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.029+0000 7f09d035bb80 1 --2- 172.21.15.8:0/1313586207 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55daeb9da980 0x55daeb9dcda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.029+0000 7f09d035bb80 4 client.25952 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:25:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.029+0000 7f09d035bb80 1 -- 172.21.15.8:0/1313586207 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55daeb987480 con 0x55daeb9da980 2023-08-11T12:25:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.029+0000 7f09b6d9d700 1 --2- 172.21.15.8:0/1313586207 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55daeb9da980 0x55daeb9dcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.029+0000 7f09b6d9d700 1 --2- 172.21.15.8:0/1313586207 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55daeb9da980 0x55daeb9dcda0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=712d8ea8872d328b server_cookie=1724df8a8f0cd6ed in_seq=0 out_seq=0 2023-08-11T12:25:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.029+0000 7f099dffb700 10 client.25952 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.030+0000 7f099dffb700 1 -- 172.21.15.8:0/1313586207 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55daeb987480 con 0x55daeb9da980 2023-08-11T12:25:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.030+0000 7f099dffb700 10 client.25952 handle_command_reply: tid=0 2023-08-11T12:25:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.030+0000 7f09d035bb80 1 client.25952 shutdown 2023-08-11T12:25:32.039 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.031+0000 7f09d035bb80 1 -- 172.21.15.8:0/1313586207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55daeb9b8ff0 msgr2=0x55daeb9c8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:32.039 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.031+0000 7f09d035bb80 1 --2- 172.21.15.8:0/1313586207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55daeb9b8ff0 0x55daeb9c8050 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f09ac009990 tx=0x7f09ac005270 comp rx=0 tx=0).stop 2023-08-11T12:25:32.039 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.031+0000 7f09d035bb80 1 -- 172.21.15.8:0/1313586207 shutdown_connections 2023-08-11T12:25:32.039 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.031+0000 7f09d035bb80 1 --2- 172.21.15.8:0/1313586207 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55daeb9da980 0x55daeb9dcda0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.039 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.031+0000 7f09d035bb80 1 --2- 172.21.15.8:0/1313586207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55daeb9b8630 0x55daeb9c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.039 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.031+0000 7f09d035bb80 1 --2- 172.21.15.8:0/1313586207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55daeb9bde80 0x55daeb9c1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.039 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.031+0000 7f09d035bb80 1 --2- 172.21.15.8:0/1313586207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55daeb9b8ff0 0x55daeb9c8050 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.040 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.031+0000 7f099dffb700 0 client.25952 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:32.040 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.031+0000 7f09d035bb80 1 -- 172.21.15.8:0/1313586207 >> 172.21.15.8:0/1313586207 conn(0x55daeb8e58f0 msgr2=0x55daeb9b25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:32.040 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.032+0000 7f09d035bb80 1 -- 172.21.15.8:0/1313586207 shutdown_connections 2023-08-11T12:25:32.040 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.032+0000 7f09d035bb80 1 -- 172.21.15.8:0/1313586207 wait complete. 2023-08-11T12:25:32.040 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.032+0000 7f09d035bb80 20 client.25952 trim_cache size 0 max 16384 2023-08-11T12:25:32.056 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.054+0000 7f09d035bb80 1 Processor -- start 2023-08-11T12:25:32.057 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.055+0000 7f09d035bb80 1 -- start start 2023-08-11T12:25:32.057 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.055+0000 7f09d035bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55daeb9b8630 0x55daeb9e1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.055+0000 7f09d035bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55daeb9b8ff0 0x55daeb9c1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.055+0000 7f09d035bb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55daeb9bde80 0x55daeb9b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.055+0000 7f09d035bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daeb9adc10 con 0x55daeb9b8630 2023-08-11T12:25:32.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.055+0000 7f09d035bb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daeb9c03f0 con 0x55daeb9bde80 2023-08-11T12:25:32.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.055+0000 7f09d035bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daeb9bcbe0 con 0x55daeb9b8ff0 2023-08-11T12:25:32.059 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.055+0000 7f09b5d9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55daeb9b8ff0 0x55daeb9c1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.059 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.056+0000 7f09b5d9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55daeb9b8ff0 0x55daeb9c1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:55516/0 (socket says 172.21.15.8:55516) 2023-08-11T12:25:32.059 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.056+0000 7f09b5d9b700 1 -- 172.21.15.8:0/2164273002 learned_addr learned my addr 172.21.15.8:0/2164273002 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:32.059 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.056+0000 7f09b6d9d700 1 --2- 172.21.15.8:0/2164273002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55daeb9bde80 0x55daeb9b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.060 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.056+0000 7f09b5d9b700 1 -- 172.21.15.8:0/2164273002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55daeb9bde80 msgr2=0x55daeb9b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:32.061 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.056+0000 7f09b5d9b700 1 --2- 172.21.15.8:0/2164273002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55daeb9bde80 0x55daeb9b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.061 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.056+0000 7f09b5d9b700 1 -- 172.21.15.8:0/2164273002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55daeb9b8630 msgr2=0x55daeb9e1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:32.061 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.056+0000 7f09b5d9b700 1 --2- 172.21.15.8:0/2164273002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55daeb9b8630 0x55daeb9e1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.061 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.056+0000 7f09b5d9b700 1 -- 172.21.15.8:0/2164273002 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55daeb71fc00 con 0x55daeb9b8ff0 2023-08-11T12:25:32.061 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.056+0000 7f09b5d9b700 1 --2- 172.21.15.8:0/2164273002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55daeb9b8ff0 0x55daeb9c1650 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f09ac0098e0 tx=0x7f09ac009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56c7e794e14b8faf server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:32.061 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.058+0000 7f09a57fa700 1 -- 172.21.15.8:0/2164273002 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac01d040 con 0x55daeb9b8ff0 2023-08-11T12:25:32.062 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.058+0000 7f09a57fa700 1 -- 172.21.15.8:0/2164273002 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f09ac01e040 con 0x55daeb9b8ff0 2023-08-11T12:25:32.062 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.058+0000 7f09a57fa700 1 -- 172.21.15.8:0/2164273002 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac004970 con 0x55daeb9b8ff0 2023-08-11T12:25:32.063 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.059+0000 7f09d035bb80 1 -- 172.21.15.8:0/2164273002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55daeb9b8ff0 msgr2=0x55daeb9c1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:32.064 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.059+0000 7f09d035bb80 1 --2- 172.21.15.8:0/2164273002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55daeb9b8ff0 0x55daeb9c1650 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f09ac0098e0 tx=0x7f09ac009ca0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.064 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.059+0000 7f09d035bb80 1 -- 172.21.15.8:0/2164273002 shutdown_connections 2023-08-11T12:25:32.064 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.059+0000 7f09d035bb80 1 --2- 172.21.15.8:0/2164273002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55daeb9bde80 0x55daeb9b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.064 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.059+0000 7f09d035bb80 1 --2- 172.21.15.8:0/2164273002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55daeb9b8630 0x55daeb9e1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.064 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.059+0000 7f09d035bb80 1 --2- 172.21.15.8:0/2164273002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55daeb9b8ff0 0x55daeb9c1650 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.065 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.059+0000 7f09d035bb80 1 -- 172.21.15.8:0/2164273002 >> 172.21.15.8:0/2164273002 conn(0x55daeb8e58f0 msgr2=0x55daeb9c2800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:32.065 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.060+0000 7f09d035bb80 1 -- 172.21.15.8:0/2164273002 shutdown_connections 2023-08-11T12:25:32.065 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.060+0000 7f09d035bb80 1 -- 172.21.15.8:0/2164273002 wait complete. 2023-08-11T12:25:32.065 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.060+0000 7f09d035bb80 1 -- start start 2023-08-11T12:25:32.065 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.060+0000 7f09d035bb80 1 Processor -- start 2023-08-11T12:25:32.065 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.061+0000 7f09d035bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55daeb9b8630 0x55daeb9cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.065 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.061+0000 7f09d035bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55daeb9b8ff0 0x55daeb9cc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.066 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.061+0000 7f09d035bb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55daeb9bde80 0x55daeb9cc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.066 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.061+0000 7f09d035bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daeba2d710 con 0x55daeb9b8ff0 2023-08-11T12:25:32.066 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.061+0000 7f09d035bb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daeba2d880 con 0x55daeb9bde80 2023-08-11T12:25:32.066 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.061+0000 7f09d035bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daeba2da40 con 0x55daeb9b8630 2023-08-11T12:25:32.066 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.061+0000 7f09d035bb80 10 client.0 _ll_register_callbacks cb 0x7f09ac009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:25:32.067 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.061+0000 7f09b6d9d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55daeb9b8630 0x55daeb9cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.067 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.061+0000 7f09b6d9d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55daeb9b8630 0x55daeb9cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:55520/0 (socket says 172.21.15.8:55520) 2023-08-11T12:25:32.067 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.061+0000 7f09b6d9d700 1 -- 172.21.15.8:0/181846276 learned_addr learned my addr 172.21.15.8:0/181846276 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:32.067 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.061+0000 7f09b6d9d700 1 --2- 172.21.15.8:0/181846276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55daeb9bde80 0x55daeb9cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.070 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.062+0000 7f09b6d9d700 1 -- 172.21.15.8:0/181846276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55daeb9bde80 msgr2=0x55daeb9cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:32.070 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.062+0000 7f09b6d9d700 1 --2- 172.21.15.8:0/181846276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55daeb9bde80 0x55daeb9cc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.071 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.062+0000 7f09b6d9d700 1 -- 172.21.15.8:0/181846276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55daeb9b8ff0 msgr2=0x55daeb9cc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:32.071 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.062+0000 7f09b6d9d700 1 --2- 172.21.15.8:0/181846276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55daeb9b8ff0 0x55daeb9cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.071 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.062+0000 7f09b6d9d700 1 -- 172.21.15.8:0/181846276 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55daeb736d80 con 0x55daeb9b8630 2023-08-11T12:25:32.071 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.062+0000 7f09b6d9d700 1 --2- 172.21.15.8:0/181846276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55daeb9b8630 0x55daeb9cbd10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f09b00078a0 tx=0x7f09b0029040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27505de1fd4674f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:32.072 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.062+0000 7f099dffb700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:25:32.072 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.062+0000 7f099dffb700 1 -- 172.21.15.8:0/181846276 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b002c070 con 0x55daeb9b8630 2023-08-11T12:25:32.072 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.063+0000 7f099dffb700 1 -- 172.21.15.8:0/181846276 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f09b0017c70 con 0x55daeb9b8630 2023-08-11T12:25:32.072 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.063+0000 7f09d035bb80 1 -- 172.21.15.8:0/181846276 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f09b000f040 con 0x55daeb9b8630 2023-08-11T12:25:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.063+0000 7f099dffb700 1 -- 172.21.15.8:0/181846276 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09b000e040 con 0x55daeb9b8630 2023-08-11T12:25:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.063+0000 7f09d035bb80 10 client.25972 fetch_fsmap learned FSMap version 31 2023-08-11T12:25:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.063+0000 7f09d035bb80 1 -- 172.21.15.8:0/181846276 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55daeb75d1f0 con 0x55daeb9b8630 2023-08-11T12:25:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.063+0000 7f099dffb700 1 -- 172.21.15.8:0/181846276 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f09b000f040 con 0x55daeb9b8630 2023-08-11T12:25:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.064+0000 7f099dffb700 1 -- 172.21.15.8:0/181846276 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 31) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f09b0036030 con 0x55daeb9b8630 2023-08-11T12:25:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.064+0000 7f09d035bb80 10 client.25972 fetch_fsmap finished waiting for FSMap version 31 2023-08-11T12:25:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.064+0000 7f09d035bb80 10 client.25972 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-11T12:25:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.064+0000 7f09d035bb80 20 client.25972 populate_metadata read hostname 'smithi008' 2023-08-11T12:25:32.075 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.064+0000 7f09d035bb80 1 --2- 172.21.15.8:0/181846276 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55daeba2f110 0x55daeba31530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.075 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.064+0000 7f09d035bb80 4 client.25972 mds_command: new command op to 24575 tid=0[{"prefix": "flush journal"}] 2023-08-11T12:25:32.075 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.064+0000 7f09d035bb80 1 -- 172.21.15.8:0/181846276 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55daeb9037c0 con 0x55daeba2f110 2023-08-11T12:25:32.075 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.064+0000 7f09b5d9b700 1 --2- 172.21.15.8:0/181846276 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55daeba2f110 0x55daeba31530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.075 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.065+0000 7f09b5d9b700 1 --2- 172.21.15.8:0/181846276 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55daeba2f110 0x55daeba31530 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d9037ab382dee96 server_cookie=9e75759ee926cb0b in_seq=0 out_seq=0 2023-08-11T12:25:32.075 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.065+0000 7f099dffb700 10 client.25972 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:32.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.082+0000 7f099dffb700 1 -- 172.21.15.8:0/181846276 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55daeb9037c0 con 0x55daeba2f110 2023-08-11T12:25:32.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.082+0000 7f099dffb700 10 client.25972 handle_command_reply: tid=0 2023-08-11T12:25:32.086 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.082+0000 7f09d035bb80 1 client.25972 shutdown 2023-08-11T12:25:32.086 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.082+0000 7f09d035bb80 1 -- 172.21.15.8:0/181846276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55daeb9b8630 msgr2=0x55daeb9cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:32.086 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.082+0000 7f09d035bb80 1 --2- 172.21.15.8:0/181846276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55daeb9b8630 0x55daeb9cbd10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f09b00078a0 tx=0x7f09b0029040 comp rx=0 tx=0).stop 2023-08-11T12:25:32.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.082+0000 7f09d035bb80 1 -- 172.21.15.8:0/181846276 shutdown_connections 2023-08-11T12:25:32.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.082+0000 7f09d035bb80 1 --2- 172.21.15.8:0/181846276 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55daeba2f110 0x55daeba31530 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.088 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.082+0000 7f09d035bb80 1 --2- 172.21.15.8:0/181846276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55daeb9b8630 0x55daeb9cbd10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.088 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.082+0000 7f09d035bb80 1 --2- 172.21.15.8:0/181846276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55daeb9bde80 0x55daeb9cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.089 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.082+0000 7f099dffb700 0 client.25972 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:32.089 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.082+0000 7f09d035bb80 1 --2- 172.21.15.8:0/181846276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55daeb9b8ff0 0x55daeb9cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.089 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.082+0000 7f09d035bb80 1 -- 172.21.15.8:0/181846276 >> 172.21.15.8:0/181846276 conn(0x55daeb8e58f0 msgr2=0x55daeb9c7870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:32.090 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.082+0000 7f09d035bb80 1 -- 172.21.15.8:0/181846276 shutdown_connections 2023-08-11T12:25:32.090 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.082+0000 7f09d035bb80 1 -- 172.21.15.8:0/181846276 wait complete. 2023-08-11T12:25:32.090 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.083+0000 7f09d035bb80 20 client.25972 trim_cache size 0 max 16384 2023-08-11T12:25:32.091 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-08-11T12:25:32.092 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-08-11T12:25:32.092 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-08-11T12:25:32.092 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-08-11T12:25:32.093 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.083+0000 7f09bc9ff700 1 -- 172.21.15.8:0/2607438086 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f09a00a0260 msgr2=0x7f09a00a2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:32.093 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.083+0000 7f09bc9ff700 1 --2- 172.21.15.8:0/2607438086 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f09a00a0260 0x7f09a00a2720 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f09a80c9110 tx=0x7f09a80b6f90 comp rx=0 tx=0).stop 2023-08-11T12:25:32.094 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.083+0000 7f09bc9ff700 1 -- 172.21.15.8:0/2607438086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09b8067e80 msgr2=0x7f09b80ffa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:32.094 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.084+0000 7f09bc9ff700 1 --2- 172.21.15.8:0/2607438086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09b8067e80 0x7f09b80ffa60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f09a800e9a0 tx=0x7f09a800ecb0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.094 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.084+0000 7f09bc9ff700 1 -- 172.21.15.8:0/2607438086 shutdown_connections 2023-08-11T12:25:32.095 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.084+0000 7f09bc9ff700 1 --2- 172.21.15.8:0/2607438086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09b81068b0 0x7f09b81a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.095 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.084+0000 7f09bc9ff700 1 --2- 172.21.15.8:0/2607438086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09b8067e80 0x7f09b80ffa60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.095 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.084+0000 7f09bc9ff700 1 --2- 172.21.15.8:0/2607438086 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f09a00a0260 0x7f09a00a2720 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.095 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.084+0000 7f09bc9ff700 1 --2- 172.21.15.8:0/2607438086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09b8068840 0x7f09b80fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.084+0000 7f09bc9ff700 1 -- 172.21.15.8:0/2607438086 >> 172.21.15.8:0/2607438086 conn(0x7f09b8075300 msgr2=0x7f09b80fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.084+0000 7f09bc9ff700 1 -- 172.21.15.8:0/2607438086 shutdown_connections 2023-08-11T12:25:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:32.084+0000 7f09bc9ff700 1 -- 172.21.15.8:0/2607438086 wait complete. 2023-08-11T12:25:32.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:31 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2050617569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:25:32.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:31 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2050617569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:25:32.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.181+0000 7f8e503ff700 1 -- 172.21.15.8:0/1451797337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e480ff870 msgr2=0x7f8e480ffcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:32.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.181+0000 7f8e503ff700 1 --2- 172.21.15.8:0/1451797337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e480ff870 0x7f8e480ffcf0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009990 tx=0x7f8e38009ca0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.181+0000 7f8e503ff700 1 -- 172.21.15.8:0/1451797337 shutdown_connections 2023-08-11T12:25:32.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.181+0000 7f8e503ff700 1 --2- 172.21.15.8:0/1451797337 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e48105880 0x7f8e48105c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.181+0000 7f8e503ff700 1 --2- 172.21.15.8:0/1451797337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e48100230 0x7f8e4810c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.181+0000 7f8e503ff700 1 --2- 172.21.15.8:0/1451797337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e480ff870 0x7f8e480ffcf0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.181+0000 7f8e503ff700 1 -- 172.21.15.8:0/1451797337 >> 172.21.15.8:0/1451797337 conn(0x7f8e48076a30 msgr2=0x7f8e48076e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:32.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.181+0000 7f8e503ff700 1 -- 172.21.15.8:0/1451797337 shutdown_connections 2023-08-11T12:25:32.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.181+0000 7f8e503ff700 1 -- 172.21.15.8:0/1451797337 wait complete. 2023-08-11T12:25:32.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.182+0000 7f8e503ff700 1 Processor -- start 2023-08-11T12:25:32.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.182+0000 7f8e503ff700 1 -- start start 2023-08-11T12:25:32.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.183+0000 7f8e503ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e480ff870 0x7f8e4819ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.183+0000 7f8e503ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e48100230 0x7f8e4819ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.183+0000 7f8e503ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e48105880 0x7f8e48198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.183+0000 7f8e503ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e48199140 con 0x7f8e48105880 2023-08-11T12:25:32.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.183+0000 7f8e503ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e481992b0 con 0x7f8e48100230 2023-08-11T12:25:32.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.183+0000 7f8e503ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e48199470 con 0x7f8e480ff870 2023-08-11T12:25:32.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.183+0000 7f8e4e99c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e48105880 0x7f8e48198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.183+0000 7f8e4e19b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e480ff870 0x7f8e4819ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.183+0000 7f8e4e99c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e48105880 0x7f8e48198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39618/0 (socket says 172.21.15.8:39618) 2023-08-11T12:25:32.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.183+0000 7f8e4e99c700 1 -- 172.21.15.8:0/2832445617 learned_addr learned my addr 172.21.15.8:0/2832445617 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:32.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.183+0000 7f8e4d99a700 1 --2- 172.21.15.8:0/2832445617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e48100230 0x7f8e4819ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.183+0000 7f8e4e99c700 1 -- 172.21.15.8:0/2832445617 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e480ff870 msgr2=0x7f8e4819ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:32.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.183+0000 7f8e4e99c700 1 --2- 172.21.15.8:0/2832445617 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e480ff870 0x7f8e4819ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.183+0000 7f8e4e99c700 1 -- 172.21.15.8:0/2832445617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e48100230 msgr2=0x7f8e4819ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:32.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.183+0000 7f8e4e99c700 1 --2- 172.21.15.8:0/2832445617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e48100230 0x7f8e4819ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.183+0000 7f8e4e99c700 1 -- 172.21.15.8:0/2832445617 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e380095f0 con 0x7f8e48105880 2023-08-11T12:25:32.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.183+0000 7f8e4e19b700 1 --2- 172.21.15.8:0/2832445617 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e480ff870 0x7f8e4819ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:32.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.184+0000 7f8e4e99c700 1 --2- 172.21.15.8:0/2832445617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e48105880 0x7f8e48198ae0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8e4000ef30 tx=0x7f8e4000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:32.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.184+0000 7f8e3f7fe700 1 -- 172.21.15.8:0/2832445617 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e40018070 con 0x7f8e48105880 2023-08-11T12:25:32.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.184+0000 7f8e503ff700 1 -- 172.21.15.8:0/2832445617 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e481996f0 con 0x7f8e48105880 2023-08-11T12:25:32.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.184+0000 7f8e3f7fe700 1 -- 172.21.15.8:0/2832445617 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e4000f040 con 0x7f8e48105880 2023-08-11T12:25:32.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.184+0000 7f8e3f7fe700 1 -- 172.21.15.8:0/2832445617 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4000cd00 con 0x7f8e48105880 2023-08-11T12:25:32.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.184+0000 7f8e503ff700 1 -- 172.21.15.8:0/2832445617 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e481a5ab0 con 0x7f8e48105880 2023-08-11T12:25:32.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.187+0000 7f8e3f7fe700 1 -- 172.21.15.8:0/2832445617 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 24) v1 ==== 134903+0+0 (secure 0 0 0) 0x7f8e40003a00 con 0x7f8e48105880 2023-08-11T12:25:32.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.189+0000 7f8e63ca2b80 1 Processor -- start 2023-08-11T12:25:32.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.189+0000 7f8e3f7fe700 1 --2- 172.21.15.8:0/2832445617 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f8e340a01e0 0x7f8e340a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.189+0000 7f8e63ca2b80 1 -- start start 2023-08-11T12:25:32.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.189+0000 7f8e3f7fe700 1 -- 172.21.15.8:0/2832445617 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f8e400cb7b0 con 0x7f8e48105880 2023-08-11T12:25:32.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.189+0000 7f8e4d99a700 1 --2- 172.21.15.8:0/2832445617 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f8e340a01e0 0x7f8e340a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.189+0000 7f8e63ca2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f5c92e2e0 0x564f5c92e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.189+0000 7f8e63ca2b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f5c92ec00 0x564f5c932740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.190+0000 7f8e63ca2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f5c932c80 0x564f5c9330c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.190+0000 7f8e63ca2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f5c87e630 con 0x564f5c932c80 2023-08-11T12:25:32.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.190+0000 7f8e63ca2b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f5c87bf50 con 0x564f5c92ec00 2023-08-11T12:25:32.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.190+0000 7f8e63ca2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f5c877840 con 0x564f5c92e2e0 2023-08-11T12:25:32.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.190+0000 7f8e4e99c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f5c932c80 0x564f5c9330c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.190+0000 7f8e4e99c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f5c932c80 0x564f5c9330c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39632/0 (socket says 172.21.15.8:39632) 2023-08-11T12:25:32.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.190+0000 7f8e4e99c700 1 -- 172.21.15.8:0/958617553 learned_addr learned my addr 172.21.15.8:0/958617553 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:32.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.190+0000 7f8e4e19b700 1 --2- 172.21.15.8:0/958617553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f5c92e2e0 0x564f5c92e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.190+0000 7f8e4d99a700 1 --2- 172.21.15.8:0/958617553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f5c92ec00 0x564f5c932740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.190+0000 7f8e4e99c700 1 -- 172.21.15.8:0/958617553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f5c92e2e0 msgr2=0x564f5c92e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:32.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.190+0000 7f8e4e99c700 1 --2- 172.21.15.8:0/958617553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f5c92e2e0 0x564f5c92e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.190+0000 7f8e4e99c700 1 -- 172.21.15.8:0/958617553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f5c92ec00 msgr2=0x564f5c932740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:32.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.190+0000 7f8e4e99c700 1 --2- 172.21.15.8:0/958617553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f5c92ec00 0x564f5c932740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.190+0000 7f8e4e99c700 1 -- 172.21.15.8:0/958617553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f5c6f7630 con 0x564f5c932c80 2023-08-11T12:25:32.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.190+0000 7f8e4e19b700 1 --2- 172.21.15.8:0/958617553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f5c92e2e0 0x564f5c92e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:32.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.190+0000 7f8e4d99a700 1 --2- 172.21.15.8:0/958617553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f5c92ec00 0x564f5c932740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:25:32.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.191+0000 7f8e4d99a700 1 --2- 172.21.15.8:0/2832445617 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f8e340a01e0 0x7f8e340a26a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8e4819a290 tx=0x7f8e3800b850 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:32.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.191+0000 7f8e4e99c700 1 --2- 172.21.15.8:0/958617553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f5c932c80 0x564f5c9330c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8e40094eb0 tx=0x7f8e40098570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46a520d4ebc0ac7 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:32.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.191+0000 7f8e3cbfe700 1 -- 172.21.15.8:0/958617553 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e40004ad0 con 0x564f5c932c80 2023-08-11T12:25:32.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.191+0000 7f8e3cbfe700 1 -- 172.21.15.8:0/958617553 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e4001b320 con 0x564f5c932c80 2023-08-11T12:25:32.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.191+0000 7f8e3cbfe700 1 -- 172.21.15.8:0/958617553 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e40098c10 con 0x564f5c932c80 2023-08-11T12:25:32.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.192+0000 7f8e63ca2b80 1 -- 172.21.15.8:0/958617553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f5c932c80 msgr2=0x564f5c9330c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:32.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.192+0000 7f8e63ca2b80 1 --2- 172.21.15.8:0/958617553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f5c932c80 0x564f5c9330c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8e40094eb0 tx=0x7f8e40098570 comp rx=0 tx=0).stop 2023-08-11T12:25:32.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.192+0000 7f8e63ca2b80 1 -- 172.21.15.8:0/958617553 shutdown_connections 2023-08-11T12:25:32.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.192+0000 7f8e63ca2b80 1 --2- 172.21.15.8:0/958617553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f5c92e2e0 0x564f5c92e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.192+0000 7f8e63ca2b80 1 --2- 172.21.15.8:0/958617553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f5c932c80 0x564f5c9330c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.192+0000 7f8e63ca2b80 1 --2- 172.21.15.8:0/958617553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f5c92ec00 0x564f5c932740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.192+0000 7f8e63ca2b80 1 -- 172.21.15.8:0/958617553 >> 172.21.15.8:0/958617553 conn(0x564f5c852950 msgr2=0x564f5c9203d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:32.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.192+0000 7f8e63ca2b80 1 -- 172.21.15.8:0/958617553 shutdown_connections 2023-08-11T12:25:32.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.192+0000 7f8e63ca2b80 1 -- 172.21.15.8:0/958617553 wait complete. 2023-08-11T12:25:32.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.193+0000 7f8e63ca2b80 1 -- start start 2023-08-11T12:25:32.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.193+0000 7f8e63ca2b80 1 Processor -- start 2023-08-11T12:25:32.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.193+0000 7f8e63ca2b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f5c92e2e0 0x564f5c93a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.193+0000 7f8e63ca2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f5c92ec00 0x564f5c9376d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.193+0000 7f8e63ca2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f5c932c80 0x564f5c937ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.193+0000 7f8e63ca2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f5c815ac0 con 0x564f5c932c80 2023-08-11T12:25:32.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.194+0000 7f8e63ca2b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f5c8157c0 con 0x564f5c92e2e0 2023-08-11T12:25:32.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.194+0000 7f8e63ca2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f5c6f9920 con 0x564f5c92ec00 2023-08-11T12:25:32.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.194+0000 7f8e63ca2b80 10 client.0 _ll_register_callbacks cb 0x564f5c818ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:25:32.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.194+0000 7f8e4d99a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f5c92ec00 0x564f5c9376d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.194+0000 7f8e4d99a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f5c92ec00 0x564f5c9376d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:55566/0 (socket says 172.21.15.8:55566) 2023-08-11T12:25:32.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.194+0000 7f8e4d99a700 1 -- 172.21.15.8:0/3189375495 learned_addr learned my addr 172.21.15.8:0/3189375495 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:32.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.194+0000 7f8e4e19b700 1 --2- 172.21.15.8:0/3189375495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f5c92e2e0 0x564f5c93a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.194+0000 7f8e4e99c700 1 --2- 172.21.15.8:0/3189375495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f5c932c80 0x564f5c937ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.194+0000 7f8e4e19b700 1 -- 172.21.15.8:0/3189375495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f5c92ec00 msgr2=0x564f5c9376d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:32.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.194+0000 7f8e4e19b700 1 --2- 172.21.15.8:0/3189375495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f5c92ec00 0x564f5c9376d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.194+0000 7f8e4e19b700 1 -- 172.21.15.8:0/3189375495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f5c932c80 msgr2=0x564f5c937ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:32.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.194+0000 7f8e4e19b700 1 --2- 172.21.15.8:0/3189375495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f5c932c80 0x564f5c937ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.194+0000 7f8e4e19b700 1 -- 172.21.15.8:0/3189375495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e44009c90 con 0x564f5c92e2e0 2023-08-11T12:25:32.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.195+0000 7f8e4e19b700 1 --2- 172.21.15.8:0/3189375495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f5c92e2e0 0x564f5c93a420 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8e44012cf0 tx=0x7f8e440058e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b77fdd6bf9470ea2 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:32.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.195+0000 7f8e31ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:25:32.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.195+0000 7f8e31ffb700 1 -- 172.21.15.8:0/3189375495 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e44017070 con 0x564f5c92e2e0 2023-08-11T12:25:32.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.195+0000 7f8e63ca2b80 1 -- 172.21.15.8:0/3189375495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564f5c918a90 con 0x564f5c92e2e0 2023-08-11T12:25:32.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.195+0000 7f8e31ffb700 1 -- 172.21.15.8:0/3189375495 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f8e44004030 con 0x564f5c92e2e0 2023-08-11T12:25:32.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.195+0000 7f8e31ffb700 1 -- 172.21.15.8:0/3189375495 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e440041f0 con 0x564f5c92e2e0 2023-08-11T12:25:32.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.195+0000 7f8e63ca2b80 10 client.25970 fetch_fsmap learned FSMap version 31 2023-08-11T12:25:32.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.195+0000 7f8e63ca2b80 1 -- 172.21.15.8:0/3189375495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f8e481a5ab0 con 0x564f5c92e2e0 2023-08-11T12:25:32.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.196+0000 7f8e31ffb700 1 -- 172.21.15.8:0/3189375495 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e44023020 con 0x564f5c92e2e0 2023-08-11T12:25:32.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.196+0000 7f8e31ffb700 1 -- 172.21.15.8:0/3189375495 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 31) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f8e44004b30 con 0x564f5c92e2e0 2023-08-11T12:25:32.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.196+0000 7f8e63ca2b80 10 client.25970 fetch_fsmap finished waiting for FSMap version 31 2023-08-11T12:25:32.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.196+0000 7f8e63ca2b80 10 client.25970 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-08-11T12:25:32.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.196+0000 7f8e63ca2b80 20 client.25970 populate_metadata read hostname 'smithi008' 2023-08-11T12:25:32.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.196+0000 7f8e63ca2b80 1 --2- 172.21.15.8:0/3189375495 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x564f5c947da0 0x564f5c94a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.196+0000 7f8e63ca2b80 4 client.25970 mds_command: new command op to 24550 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:25:32.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.196+0000 7f8e63ca2b80 1 -- 172.21.15.8:0/3189375495 --> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564f5c8f44e0 con 0x564f5c947da0 2023-08-11T12:25:32.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.196+0000 7f8e4d99a700 1 --2- 172.21.15.8:0/3189375495 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x564f5c947da0 0x564f5c94a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.197+0000 7f8e4d99a700 1 --2- 172.21.15.8:0/3189375495 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x564f5c947da0 0x564f5c94a1c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7d3f68dba6feac50 server_cookie=65e57e44e3f53e10 in_seq=0 out_seq=0 2023-08-11T12:25:32.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.197+0000 7f8e31ffb700 10 client.25970 ms_handle_connect on v2:172.21.15.194:6838/2174476491 2023-08-11T12:25:32.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.197+0000 7f8e31ffb700 1 -- 172.21.15.8:0/3189375495 <== mds.1 v2:172.21.15.194:6838/2174476491 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x564f5c8f44e0 con 0x564f5c947da0 2023-08-11T12:25:32.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.197+0000 7f8e31ffb700 10 client.25970 handle_command_reply: tid=0 2023-08-11T12:25:32.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.198+0000 7f8e63ca2b80 1 client.25970 shutdown 2023-08-11T12:25:32.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.198+0000 7f8e63ca2b80 1 -- 172.21.15.8:0/3189375495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f5c92e2e0 msgr2=0x564f5c93a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:32.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.198+0000 7f8e63ca2b80 1 --2- 172.21.15.8:0/3189375495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f5c92e2e0 0x564f5c93a420 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8e44012cf0 tx=0x7f8e440058e0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.198+0000 7f8e63ca2b80 1 -- 172.21.15.8:0/3189375495 shutdown_connections 2023-08-11T12:25:32.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.198+0000 7f8e63ca2b80 1 --2- 172.21.15.8:0/3189375495 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x564f5c947da0 0x564f5c94a1c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.198+0000 7f8e63ca2b80 1 --2- 172.21.15.8:0/3189375495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f5c932c80 0x564f5c937ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.198+0000 7f8e63ca2b80 1 --2- 172.21.15.8:0/3189375495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f5c92e2e0 0x564f5c93a420 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.198+0000 7f8e63ca2b80 1 --2- 172.21.15.8:0/3189375495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f5c92ec00 0x564f5c9376d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.198+0000 7f8e63ca2b80 1 -- 172.21.15.8:0/3189375495 >> 172.21.15.8:0/3189375495 conn(0x564f5c852950 msgr2=0x564f5c9340e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:32.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.198+0000 7f8e31ffb700 0 client.25970 ms_handle_reset on v2:172.21.15.194:6838/2174476491 2023-08-11T12:25:32.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.198+0000 7f8e63ca2b80 1 -- 172.21.15.8:0/3189375495 shutdown_connections 2023-08-11T12:25:32.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.198+0000 7f8e63ca2b80 1 -- 172.21.15.8:0/3189375495 wait complete. 2023-08-11T12:25:32.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.198+0000 7f8e63ca2b80 20 client.25970 trim_cache size 0 max 16384 2023-08-11T12:25:32.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.212+0000 7f8e63ca2b80 1 Processor -- start 2023-08-11T12:25:32.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.212+0000 7f8e63ca2b80 1 -- start start 2023-08-11T12:25:32.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.212+0000 7f8e63ca2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f5c92e2e0 0x564f5c93ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.212+0000 7f8e63ca2b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f5c92ec00 0x564f5c943410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.212+0000 7f8e63ca2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f5c932c80 0x564f5c939ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.212+0000 7f8e63ca2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f5c918850 con 0x564f5c932c80 2023-08-11T12:25:32.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.212+0000 7f8e63ca2b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f5c9382e0 con 0x564f5c92ec00 2023-08-11T12:25:32.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.212+0000 7f8e63ca2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f5c920900 con 0x564f5c92e2e0 2023-08-11T12:25:32.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.212+0000 7f8e4e19b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f5c92e2e0 0x564f5c93ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.212+0000 7f8e4e99c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f5c932c80 0x564f5c939ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.213+0000 7f8e4d99a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f5c92ec00 0x564f5c943410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.213+0000 7f8e4e19b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f5c92e2e0 0x564f5c93ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:55578/0 (socket says 172.21.15.8:55578) 2023-08-11T12:25:32.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.213+0000 7f8e4e19b700 1 -- 172.21.15.8:0/4223642181 learned_addr learned my addr 172.21.15.8:0/4223642181 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:32.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.213+0000 7f8e4d99a700 1 -- 172.21.15.8:0/4223642181 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f5c92e2e0 msgr2=0x564f5c93ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:32.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.213+0000 7f8e4d99a700 1 --2- 172.21.15.8:0/4223642181 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f5c92e2e0 0x564f5c93ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.213+0000 7f8e4d99a700 1 -- 172.21.15.8:0/4223642181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f5c932c80 msgr2=0x564f5c939ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:32.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.213+0000 7f8e4d99a700 1 --2- 172.21.15.8:0/4223642181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f5c932c80 0x564f5c939ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.213+0000 7f8e4d99a700 1 -- 172.21.15.8:0/4223642181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4810a970 con 0x564f5c92ec00 2023-08-11T12:25:32.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.213+0000 7f8e4e19b700 1 --2- 172.21.15.8:0/4223642181 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f5c92e2e0 0x564f5c93ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:32.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.213+0000 7f8e4d99a700 1 --2- 172.21.15.8:0/4223642181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f5c92ec00 0x564f5c943410 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x564f5c94aa90 tx=0x7f8e38022000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf7afacbc7e5b492 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:32.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.213+0000 7f8e3d3ff700 1 -- 172.21.15.8:0/4223642181 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e38036e20 con 0x564f5c92ec00 2023-08-11T12:25:32.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.214+0000 7f8e3d3ff700 1 -- 172.21.15.8:0/4223642181 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e3801e040 con 0x564f5c92ec00 2023-08-11T12:25:32.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.214+0000 7f8e3d3ff700 1 -- 172.21.15.8:0/4223642181 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3800fb80 con 0x564f5c92ec00 2023-08-11T12:25:32.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.214+0000 7f8e63ca2b80 1 -- 172.21.15.8:0/4223642181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f5c92ec00 msgr2=0x564f5c943410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:32.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.214+0000 7f8e63ca2b80 1 --2- 172.21.15.8:0/4223642181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f5c92ec00 0x564f5c943410 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x564f5c94aa90 tx=0x7f8e38022000 comp rx=0 tx=0).stop 2023-08-11T12:25:32.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.214+0000 7f8e63ca2b80 1 -- 172.21.15.8:0/4223642181 shutdown_connections 2023-08-11T12:25:32.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.214+0000 7f8e63ca2b80 1 --2- 172.21.15.8:0/4223642181 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f5c92e2e0 0x564f5c93ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.214+0000 7f8e63ca2b80 1 --2- 172.21.15.8:0/4223642181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f5c932c80 0x564f5c939ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.214+0000 7f8e63ca2b80 1 --2- 172.21.15.8:0/4223642181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f5c92ec00 0x564f5c943410 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.214+0000 7f8e63ca2b80 1 -- 172.21.15.8:0/4223642181 >> 172.21.15.8:0/4223642181 conn(0x564f5c852950 msgr2=0x564f5c91a420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:32.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.214+0000 7f8e63ca2b80 1 -- 172.21.15.8:0/4223642181 shutdown_connections 2023-08-11T12:25:32.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.214+0000 7f8e63ca2b80 1 -- 172.21.15.8:0/4223642181 wait complete. 2023-08-11T12:25:32.221 INFO:teuthology.orchestra.run.smithi008.stderr:8800000 of 50000000 tuples (17%) done (elapsed 36.90 s, remaining 172.78 s) 2023-08-11T12:25:32.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.215+0000 7f8e63ca2b80 1 -- start start 2023-08-11T12:25:32.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.215+0000 7f8e63ca2b80 1 Processor -- start 2023-08-11T12:25:32.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.216+0000 7f8e63ca2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f5c92e2e0 0x564f5c93edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.216+0000 7f8e63ca2b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f5c92ec00 0x564f5c93d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.216+0000 7f8e63ca2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f5c932c80 0x564f5c93d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.216+0000 7f8e63ca2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f5c93dee0 con 0x564f5c92e2e0 2023-08-11T12:25:32.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.216+0000 7f8e63ca2b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f5c93e050 con 0x564f5c92ec00 2023-08-11T12:25:32.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.216+0000 7f8e63ca2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f5c99baa0 con 0x564f5c932c80 2023-08-11T12:25:32.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.216+0000 7f8e63ca2b80 10 client.0 _ll_register_callbacks cb 0x7f8e440127f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:25:32.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.216+0000 7f8e4e19b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f5c92e2e0 0x564f5c93edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.216+0000 7f8e4e19b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f5c92e2e0 0x564f5c93edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39672/0 (socket says 172.21.15.8:39672) 2023-08-11T12:25:32.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.216+0000 7f8e4e19b700 1 -- 172.21.15.8:0/4222372195 learned_addr learned my addr 172.21.15.8:0/4222372195 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:32.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.216+0000 7f8e4d99a700 1 --2- 172.21.15.8:0/4222372195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f5c92ec00 0x564f5c93d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.216+0000 7f8e4e99c700 1 --2- 172.21.15.8:0/4222372195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f5c932c80 0x564f5c93d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.217+0000 7f8e4e19b700 1 -- 172.21.15.8:0/4222372195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f5c932c80 msgr2=0x564f5c93d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:32.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.217+0000 7f8e4e19b700 1 --2- 172.21.15.8:0/4222372195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f5c932c80 0x564f5c93d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.217+0000 7f8e4e19b700 1 -- 172.21.15.8:0/4222372195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f5c92ec00 msgr2=0x564f5c93d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:32.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.217+0000 7f8e4e19b700 1 --2- 172.21.15.8:0/4222372195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f5c92ec00 0x564f5c93d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.217+0000 7f8e4e19b700 1 -- 172.21.15.8:0/4222372195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e481a5ab0 con 0x564f5c92e2e0 2023-08-11T12:25:32.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.217+0000 7f8e4e99c700 1 --2- 172.21.15.8:0/4222372195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f5c932c80 0x564f5c93d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:32.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.217+0000 7f8e4e19b700 1 --2- 172.21.15.8:0/4222372195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f5c92e2e0 0x564f5c93edb0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8e44005750 tx=0x7f8e44009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e150d96d80a82bf server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:32.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.217+0000 7f8e31ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:25:32.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.217+0000 7f8e31ffb700 1 -- 172.21.15.8:0/4222372195 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e44017040 con 0x564f5c92e2e0 2023-08-11T12:25:32.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.217+0000 7f8e63ca2b80 1 -- 172.21.15.8:0/4222372195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8e4001b320 con 0x564f5c92e2e0 2023-08-11T12:25:32.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.217+0000 7f8e31ffb700 1 -- 172.21.15.8:0/4222372195 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f8e44024080 con 0x564f5c92e2e0 2023-08-11T12:25:32.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.218+0000 7f8e31ffb700 1 -- 172.21.15.8:0/4222372195 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e4400fd30 con 0x564f5c92e2e0 2023-08-11T12:25:32.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.218+0000 7f8e63ca2b80 10 client.15948 fetch_fsmap learned FSMap version 31 2023-08-11T12:25:32.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.218+0000 7f8e63ca2b80 1 -- 172.21.15.8:0/4222372195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f8e4810d040 con 0x564f5c92e2e0 2023-08-11T12:25:32.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.218+0000 7f8e31ffb700 1 -- 172.21.15.8:0/4222372195 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e4001b320 con 0x564f5c92e2e0 2023-08-11T12:25:32.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.218+0000 7f8e31ffb700 1 -- 172.21.15.8:0/4222372195 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 31) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f8e44026040 con 0x564f5c92e2e0 2023-08-11T12:25:32.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.218+0000 7f8e63ca2b80 10 client.15948 fetch_fsmap finished waiting for FSMap version 31 2023-08-11T12:25:32.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.218+0000 7f8e63ca2b80 10 client.15948 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-08-11T12:25:32.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.218+0000 7f8e63ca2b80 20 client.15948 populate_metadata read hostname 'smithi008' 2023-08-11T12:25:32.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.218+0000 7f8e63ca2b80 1 --2- 172.21.15.8:0/4222372195 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x564f5c99d200 0x564f5c99f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.218+0000 7f8e63ca2b80 4 client.15948 mds_command: new command op to 24550 tid=0[{"prefix": "damage ls"}] 2023-08-11T12:25:32.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.218+0000 7f8e63ca2b80 1 -- 172.21.15.8:0/4222372195 --> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564f5c870820 con 0x564f5c99d200 2023-08-11T12:25:32.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.219+0000 7f8e4d99a700 1 --2- 172.21.15.8:0/4222372195 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x564f5c99d200 0x564f5c99f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.219+0000 7f8e4d99a700 1 --2- 172.21.15.8:0/4222372195 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x564f5c99d200 0x564f5c99f620 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5c763a673a113ddc server_cookie=9af60138adc0bb9 in_seq=0 out_seq=0 2023-08-11T12:25:32.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.219+0000 7f8e31ffb700 10 client.15948 ms_handle_connect on v2:172.21.15.194:6838/2174476491 2023-08-11T12:25:32.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.219+0000 7f8e31ffb700 1 -- 172.21.15.8:0/4222372195 <== mds.1 v2:172.21.15.194:6838/2174476491 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564f5c870820 con 0x564f5c99d200 2023-08-11T12:25:32.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.219+0000 7f8e31ffb700 10 client.15948 handle_command_reply: tid=0 2023-08-11T12:25:32.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.219+0000 7f8e63ca2b80 1 client.15948 shutdown 2023-08-11T12:25:32.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.220+0000 7f8e63ca2b80 1 -- 172.21.15.8:0/4222372195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f5c92e2e0 msgr2=0x564f5c93edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:32.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.220+0000 7f8e63ca2b80 1 --2- 172.21.15.8:0/4222372195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f5c92e2e0 0x564f5c93edb0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8e44005750 tx=0x7f8e44009e90 comp rx=0 tx=0).stop 2023-08-11T12:25:32.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.220+0000 7f8e63ca2b80 1 -- 172.21.15.8:0/4222372195 shutdown_connections 2023-08-11T12:25:32.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.220+0000 7f8e63ca2b80 1 --2- 172.21.15.8:0/4222372195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f5c932c80 0x564f5c93d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.220+0000 7f8e63ca2b80 1 --2- 172.21.15.8:0/4222372195 >> [v2:172.21.15.194:6838/2174476491,v1:172.21.15.194:6839/2174476491] conn(0x564f5c99d200 0x564f5c99f620 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.220+0000 7f8e63ca2b80 1 --2- 172.21.15.8:0/4222372195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f5c92e2e0 0x564f5c93edb0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.220+0000 7f8e63ca2b80 1 --2- 172.21.15.8:0/4222372195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f5c92ec00 0x564f5c93d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.220+0000 7f8e63ca2b80 1 -- 172.21.15.8:0/4222372195 >> 172.21.15.8:0/4222372195 conn(0x564f5c852950 msgr2=0x564f5c943410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:32.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.220+0000 7f8e31ffb700 0 client.15948 ms_handle_reset on v2:172.21.15.194:6838/2174476491 2023-08-11T12:25:32.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.220+0000 7f8e63ca2b80 1 -- 172.21.15.8:0/4222372195 shutdown_connections 2023-08-11T12:25:32.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.220+0000 7f8e63ca2b80 1 -- 172.21.15.8:0/4222372195 wait complete. 2023-08-11T12:25:32.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.220+0000 7f8e63ca2b80 20 client.15948 trim_cache size 0 max 16384 2023-08-11T12:25:32.232 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-08-11T12:25:32.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.220+0000 7f8e503ff700 1 -- 172.21.15.8:0/2832445617 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f8e340a01e0 msgr2=0x7f8e340a26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:32.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.221+0000 7f8e503ff700 1 --2- 172.21.15.8:0/2832445617 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f8e340a01e0 0x7f8e340a26a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8e4819a290 tx=0x7f8e3800b850 comp rx=0 tx=0).stop 2023-08-11T12:25:32.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.221+0000 7f8e503ff700 1 -- 172.21.15.8:0/2832445617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e48105880 msgr2=0x7f8e48198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:32.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.221+0000 7f8e503ff700 1 --2- 172.21.15.8:0/2832445617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e48105880 0x7f8e48198ae0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8e4000ef30 tx=0x7f8e4000c3a0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.221+0000 7f8e503ff700 1 -- 172.21.15.8:0/2832445617 shutdown_connections 2023-08-11T12:25:32.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.221+0000 7f8e503ff700 1 --2- 172.21.15.8:0/2832445617 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f8e340a01e0 0x7f8e340a26a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.221+0000 7f8e503ff700 1 --2- 172.21.15.8:0/2832445617 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e480ff870 0x7f8e4819ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.221+0000 7f8e503ff700 1 --2- 172.21.15.8:0/2832445617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e48105880 0x7f8e48198ae0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.221+0000 7f8e503ff700 1 --2- 172.21.15.8:0/2832445617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e48100230 0x7f8e4819ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.221+0000 7f8e503ff700 1 -- 172.21.15.8:0/2832445617 >> 172.21.15.8:0/2832445617 conn(0x7f8e48076a30 msgr2=0x7f8e4810acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:32.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.221+0000 7f8e503ff700 1 -- 172.21.15.8:0/2832445617 shutdown_connections 2023-08-11T12:25:32.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.221+0000 7f8e503ff700 1 -- 172.21.15.8:0/2832445617 wait complete. 2023-08-11T12:25:32.243 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-08-11T12:25:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.464+0000 7fe0b95ff700 1 -- 172.21.15.8:0/716969372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0b4072d50 msgr2=0x7fe0b4073130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.464+0000 7fe0b95ff700 1 --2- 172.21.15.8:0/716969372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0b4072d50 0x7fe0b4073130 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe0a40098f0 tx=0x7fe0a4009c00 comp rx=0 tx=0).stop 2023-08-11T12:25:32.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.464+0000 7fe0b95ff700 1 -- 172.21.15.8:0/716969372 shutdown_connections 2023-08-11T12:25:32.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.464+0000 7fe0b95ff700 1 --2- 172.21.15.8:0/716969372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0b4072d50 0x7fe0b4073130 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.464+0000 7fe0b95ff700 1 --2- 172.21.15.8:0/716969372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0b410d1a0 0x7fe0b410f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.464+0000 7fe0b95ff700 1 --2- 172.21.15.8:0/716969372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0b4073670 0x7fe0b410cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.464+0000 7fe0b95ff700 1 -- 172.21.15.8:0/716969372 >> 172.21.15.8:0/716969372 conn(0x7fe0b40fc490 msgr2=0x7fe0b40fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:32.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.464+0000 7fe0b95ff700 1 -- 172.21.15.8:0/716969372 shutdown_connections 2023-08-11T12:25:32.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.464+0000 7fe0b95ff700 1 -- 172.21.15.8:0/716969372 wait complete. 2023-08-11T12:25:32.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.465+0000 7fe0b95ff700 1 Processor -- start 2023-08-11T12:25:32.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.465+0000 7fe0b95ff700 1 -- start start 2023-08-11T12:25:32.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.466+0000 7fe0b95ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0b4072d50 0x7fe0b419eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.466+0000 7fe0b95ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0b4073670 0x7fe0b419f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.466+0000 7fe0b95ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0b410d1a0 0x7fe0b4198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.466+0000 7fe0b95ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b41991a0 con 0x7fe0b4072d50 2023-08-11T12:25:32.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.466+0000 7fe0b95ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b4199310 con 0x7fe0b4073670 2023-08-11T12:25:32.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.466+0000 7fe0b95ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b41994d0 con 0x7fe0b410d1a0 2023-08-11T12:25:32.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.466+0000 7fe0b2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0b4072d50 0x7fe0b419eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.466+0000 7fe0b37fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0b410d1a0 0x7fe0b4198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.466+0000 7fe0b2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0b4072d50 0x7fe0b419eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39686/0 (socket says 172.21.15.8:39686) 2023-08-11T12:25:32.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.466+0000 7fe0b2ffd700 1 -- 172.21.15.8:0/1194009558 learned_addr learned my addr 172.21.15.8:0/1194009558 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:32.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.466+0000 7fe0b27fc700 1 --2- 172.21.15.8:0/1194009558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0b4073670 0x7fe0b419f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.466+0000 7fe0b37fe700 1 -- 172.21.15.8:0/1194009558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0b4073670 msgr2=0x7fe0b419f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:32.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.466+0000 7fe0b37fe700 1 --2- 172.21.15.8:0/1194009558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0b4073670 0x7fe0b419f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.466+0000 7fe0b37fe700 1 -- 172.21.15.8:0/1194009558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0b4072d50 msgr2=0x7fe0b419eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:32.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.466+0000 7fe0b37fe700 1 --2- 172.21.15.8:0/1194009558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0b4072d50 0x7fe0b419eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.466+0000 7fe0b37fe700 1 -- 172.21.15.8:0/1194009558 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a80095f0 con 0x7fe0b410d1a0 2023-08-11T12:25:32.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.466+0000 7fe0b2ffd700 1 --2- 172.21.15.8:0/1194009558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0b4072d50 0x7fe0b419eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:32.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.466+0000 7fe0b27fc700 1 --2- 172.21.15.8:0/1194009558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0b4073670 0x7fe0b419f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:32.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.467+0000 7fe0b37fe700 1 --2- 172.21.15.8:0/1194009558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0b410d1a0 0x7fe0b4198b30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac00efc0 tx=0x7fe0ac00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:32.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.467+0000 7fe09bfff700 1 -- 172.21.15.8:0/1194009558 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac018070 con 0x7fe0b410d1a0 2023-08-11T12:25:32.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.467+0000 7fe09bfff700 1 -- 172.21.15.8:0/1194009558 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe0ac00f040 con 0x7fe0b410d1a0 2023-08-11T12:25:32.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.467+0000 7fe0b95ff700 1 -- 172.21.15.8:0/1194009558 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a4009520 con 0x7fe0b410d1a0 2023-08-11T12:25:32.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.467+0000 7fe09bfff700 1 -- 172.21.15.8:0/1194009558 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac00cd40 con 0x7fe0b410d1a0 2023-08-11T12:25:32.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.467+0000 7fe0b95ff700 1 -- 172.21.15.8:0/1194009558 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b41a58d0 con 0x7fe0b410d1a0 2023-08-11T12:25:32.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.471+0000 7fe09bfff700 1 -- 172.21.15.8:0/1194009558 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 24) v1 ==== 134903+0+0 (secure 0 0 0) 0x7fe0ac003a00 con 0x7fe0b410d1a0 2023-08-11T12:25:32.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.473+0000 7fe09bfff700 1 --2- 172.21.15.8:0/1194009558 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe09c0a01e0 0x7fe09c0a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.473+0000 7fe0ccf2fb80 1 Processor -- start 2023-08-11T12:25:32.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.473+0000 7fe09bfff700 1 -- 172.21.15.8:0/1194009558 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fe0ac0cb7e0 con 0x7fe0b410d1a0 2023-08-11T12:25:32.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.473+0000 7fe0b2ffd700 1 --2- 172.21.15.8:0/1194009558 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe09c0a01e0 0x7fe09c0a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.473+0000 7fe0ccf2fb80 1 -- start start 2023-08-11T12:25:32.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.474+0000 7fe0ccf2fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f749e3310 0x556f749e36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.474+0000 7fe0ccf2fb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f749e3c30 0x556f749dd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.474+0000 7fe0ccf2fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f749dde20 0x556f749de260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.474+0000 7fe0ccf2fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f74936630 con 0x556f749e3310 2023-08-11T12:25:32.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.474+0000 7fe0ccf2fb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f74933f50 con 0x556f749e3c30 2023-08-11T12:25:32.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.474+0000 7fe0ccf2fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f7492f840 con 0x556f749dde20 2023-08-11T12:25:32.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.474+0000 7fe0b2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f749e3310 0x556f749e36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.474+0000 7fe0b27fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f749e3c30 0x556f749dd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.474+0000 7fe0b27fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f749e3c30 0x556f749dd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:34054/0 (socket says 172.21.15.8:34054) 2023-08-11T12:25:32.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.474+0000 7fe0b27fc700 1 -- 172.21.15.8:0/622647427 learned_addr learned my addr 172.21.15.8:0/622647427 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:32.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.474+0000 7fe0b37fe700 1 --2- 172.21.15.8:0/622647427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f749dde20 0x556f749de260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.474+0000 7fe0b2ffd700 1 --2- 172.21.15.8:0/1194009558 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe09c0a01e0 0x7fe09c0a26a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4009fd0 tx=0x7fe0a4019040 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:32.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.475+0000 7fe0b27fc700 1 -- 172.21.15.8:0/622647427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f749dde20 msgr2=0x556f749de260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:32.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.475+0000 7fe0b27fc700 1 --2- 172.21.15.8:0/622647427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f749dde20 0x556f749de260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.475+0000 7fe0b27fc700 1 -- 172.21.15.8:0/622647427 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f749e3310 msgr2=0x556f749e36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:32.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.475+0000 7fe0b27fc700 1 --2- 172.21.15.8:0/622647427 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f749e3310 0x556f749e36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.475+0000 7fe0b27fc700 1 -- 172.21.15.8:0/622647427 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f747af630 con 0x556f749e3c30 2023-08-11T12:25:32.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.475+0000 7fe0b2ffd700 1 --2- 172.21.15.8:0/622647427 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f749e3310 0x556f749e36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:32.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.475+0000 7fe0b27fc700 1 --2- 172.21.15.8:0/622647427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f749e3c30 0x556f749dd8e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe0a80117c0 tx=0x7fe0a8011ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a673e7c0ed1b78b8 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:32.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.475+0000 7fe0997fa700 1 -- 172.21.15.8:0/622647427 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8004830 con 0x556f749e3c30 2023-08-11T12:25:32.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.475+0000 7fe0997fa700 1 -- 172.21.15.8:0/622647427 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe0a8004e50 con 0x556f749e3c30 2023-08-11T12:25:32.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.475+0000 7fe0997fa700 1 -- 172.21.15.8:0/622647427 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a800f860 con 0x556f749e3c30 2023-08-11T12:25:32.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.476+0000 7fe0ccf2fb80 1 -- 172.21.15.8:0/622647427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f749e3c30 msgr2=0x556f749dd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:32.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.476+0000 7fe0ccf2fb80 1 --2- 172.21.15.8:0/622647427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f749e3c30 0x556f749dd8e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe0a80117c0 tx=0x7fe0a8011ad0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.476+0000 7fe0ccf2fb80 1 -- 172.21.15.8:0/622647427 shutdown_connections 2023-08-11T12:25:32.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.476+0000 7fe0ccf2fb80 1 --2- 172.21.15.8:0/622647427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f749dde20 0x556f749de260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.476+0000 7fe0ccf2fb80 1 --2- 172.21.15.8:0/622647427 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f749e3310 0x556f749e36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.476+0000 7fe0ccf2fb80 1 --2- 172.21.15.8:0/622647427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f749e3c30 0x556f749dd8e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.476+0000 7fe0ccf2fb80 1 -- 172.21.15.8:0/622647427 >> 172.21.15.8:0/622647427 conn(0x556f7490a950 msgr2=0x556f749d83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:32.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.476+0000 7fe0ccf2fb80 1 -- 172.21.15.8:0/622647427 shutdown_connections 2023-08-11T12:25:32.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.476+0000 7fe0ccf2fb80 1 -- 172.21.15.8:0/622647427 wait complete. 2023-08-11T12:25:32.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.477+0000 7fe0ccf2fb80 1 -- start start 2023-08-11T12:25:32.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.477+0000 7fe0ccf2fb80 1 Processor -- start 2023-08-11T12:25:32.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.477+0000 7fe0ccf2fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f749dde20 0x556f749e9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.477+0000 7fe0ccf2fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f749e3310 0x556f749e6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.477+0000 7fe0ccf2fb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f749e3c30 0x556f749e73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.477+0000 7fe0ccf2fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f748cdac0 con 0x556f749e3310 2023-08-11T12:25:32.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.477+0000 7fe0ccf2fb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f748cd7c0 con 0x556f749e3c30 2023-08-11T12:25:32.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.477+0000 7fe0ccf2fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f747b1920 con 0x556f749dde20 2023-08-11T12:25:32.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.478+0000 7fe0ccf2fb80 10 client.0 _ll_register_callbacks cb 0x556f748d0ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:25:32.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.478+0000 7fe0b27fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f749e3310 0x556f749e6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.478+0000 7fe0b2ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f749dde20 0x556f749e9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.478+0000 7fe0b27fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f749e3310 0x556f749e6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39700/0 (socket says 172.21.15.8:39700) 2023-08-11T12:25:32.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.478+0000 7fe0b27fc700 1 -- 172.21.15.8:0/2391800551 learned_addr learned my addr 172.21.15.8:0/2391800551 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:32.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.478+0000 7fe0b37fe700 1 --2- 172.21.15.8:0/2391800551 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f749e3c30 0x556f749e73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.478+0000 7fe0b2ffd700 1 -- 172.21.15.8:0/2391800551 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f749e3c30 msgr2=0x556f749e73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:32.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.478+0000 7fe0b2ffd700 1 --2- 172.21.15.8:0/2391800551 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f749e3c30 0x556f749e73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.478+0000 7fe0b2ffd700 1 -- 172.21.15.8:0/2391800551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f749e3310 msgr2=0x556f749e6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:32.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.478+0000 7fe0b2ffd700 1 --2- 172.21.15.8:0/2391800551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f749e3310 0x556f749e6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.478+0000 7fe0b2ffd700 1 -- 172.21.15.8:0/2391800551 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b41102d0 con 0x556f749dde20 2023-08-11T12:25:32.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.479+0000 7fe0b2ffd700 1 --2- 172.21.15.8:0/2391800551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f749dde20 0x556f749e9b10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe0a40098c0 tx=0x7fe0a4009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=364de6d68fa53881 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:32.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.479+0000 7fe096ff5700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:25:32.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.479+0000 7fe096ff5700 1 -- 172.21.15.8:0/2391800551 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a4005420 con 0x556f749dde20 2023-08-11T12:25:32.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.479+0000 7fe096ff5700 1 -- 172.21.15.8:0/2391800551 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fe0a4005580 con 0x556f749dde20 2023-08-11T12:25:32.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.479+0000 7fe0ccf2fb80 1 -- 172.21.15.8:0/2391800551 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556f749d0a90 con 0x556f749dde20 2023-08-11T12:25:32.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.479+0000 7fe096ff5700 1 -- 172.21.15.8:0/2391800551 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0a4003680 con 0x556f749dde20 2023-08-11T12:25:32.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.479+0000 7fe0ccf2fb80 10 client.26002 fetch_fsmap learned FSMap version 31 2023-08-11T12:25:32.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.479+0000 7fe0ccf2fb80 1 -- 172.21.15.8:0/2391800551 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7fe0a8011440 con 0x556f749dde20 2023-08-11T12:25:32.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.479+0000 7fe096ff5700 1 -- 172.21.15.8:0/2391800551 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556f749d0a90 con 0x556f749dde20 2023-08-11T12:25:32.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.480+0000 7fe096ff5700 1 -- 172.21.15.8:0/2391800551 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 31) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fe0a402e070 con 0x556f749dde20 2023-08-11T12:25:32.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.480+0000 7fe0ccf2fb80 10 client.26002 fetch_fsmap finished waiting for FSMap version 31 2023-08-11T12:25:32.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.480+0000 7fe0ccf2fb80 10 client.26002 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:25:32.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.480+0000 7fe0ccf2fb80 20 client.26002 populate_metadata read hostname 'smithi008' 2023-08-11T12:25:32.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.480+0000 7fe0ccf2fb80 1 --2- 172.21.15.8:0/2391800551 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556f749f7560 0x556f749f9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.480+0000 7fe0ccf2fb80 4 client.26002 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:25:32.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.480+0000 7fe0ccf2fb80 1 -- 172.21.15.8:0/2391800551 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556f749ac4e0 con 0x556f749f7560 2023-08-11T12:25:32.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.480+0000 7fe0b27fc700 1 --2- 172.21.15.8:0/2391800551 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556f749f7560 0x556f749f9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.481+0000 7fe0b27fc700 1 --2- 172.21.15.8:0/2391800551 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556f749f7560 0x556f749f9980 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcfb1884de24989b server_cookie=bb7ededc1eba0ec1 in_seq=0 out_seq=0 2023-08-11T12:25:32.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.481+0000 7fe096ff5700 10 client.26002 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:32.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.481+0000 7fe096ff5700 1 -- 172.21.15.8:0/2391800551 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x556f749ac4e0 con 0x556f749f7560 2023-08-11T12:25:32.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.481+0000 7fe096ff5700 10 client.26002 handle_command_reply: tid=0 2023-08-11T12:25:32.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.482+0000 7fe0ccf2fb80 1 client.26002 shutdown 2023-08-11T12:25:32.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.482+0000 7fe0ccf2fb80 1 -- 172.21.15.8:0/2391800551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f749dde20 msgr2=0x556f749e9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:32.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.482+0000 7fe0ccf2fb80 1 --2- 172.21.15.8:0/2391800551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f749dde20 0x556f749e9b10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe0a40098c0 tx=0x7fe0a4009260 comp rx=0 tx=0).stop 2023-08-11T12:25:32.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.482+0000 7fe0ccf2fb80 1 -- 172.21.15.8:0/2391800551 shutdown_connections 2023-08-11T12:25:32.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.482+0000 7fe0ccf2fb80 1 --2- 172.21.15.8:0/2391800551 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556f749f7560 0x556f749f9980 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.482+0000 7fe0ccf2fb80 1 --2- 172.21.15.8:0/2391800551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f749dde20 0x556f749e9b10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.482+0000 7fe0ccf2fb80 1 --2- 172.21.15.8:0/2391800551 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f749e3c30 0x556f749e73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.482+0000 7fe0ccf2fb80 1 --2- 172.21.15.8:0/2391800551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f749e3310 0x556f749e6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.482+0000 7fe096ff5700 0 client.26002 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:32.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.482+0000 7fe0ccf2fb80 1 -- 172.21.15.8:0/2391800551 >> 172.21.15.8:0/2391800551 conn(0x556f7490a950 msgr2=0x556f749d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:32.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.482+0000 7fe0ccf2fb80 1 -- 172.21.15.8:0/2391800551 shutdown_connections 2023-08-11T12:25:32.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.482+0000 7fe0ccf2fb80 1 -- 172.21.15.8:0/2391800551 wait complete. 2023-08-11T12:25:32.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.482+0000 7fe0ccf2fb80 20 client.26002 trim_cache size 0 max 16384 2023-08-11T12:25:32.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.499+0000 7fe0ccf2fb80 1 Processor -- start 2023-08-11T12:25:32.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.499+0000 7fe0ccf2fb80 1 -- start start 2023-08-11T12:25:32.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.499+0000 7fe0ccf2fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f749dde20 0x556f749e95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.499+0000 7fe0ccf2fb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f749e3310 0x556f749e9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.500+0000 7fe0ccf2fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f749e3c30 0x556f749e65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.500+0000 7fe0ccf2fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f749d92b0 con 0x556f749dde20 2023-08-11T12:25:32.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.500+0000 7fe0ccf2fb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f749e79d0 con 0x556f749e3310 2023-08-11T12:25:32.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.500+0000 7fe0ccf2fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f749e5360 con 0x556f749e3c30 2023-08-11T12:25:32.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.500+0000 7fe0b37fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f749e3c30 0x556f749e65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.500+0000 7fe0b37fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f749e3c30 0x556f749e65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:55638/0 (socket says 172.21.15.8:55638) 2023-08-11T12:25:32.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.500+0000 7fe0b2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f749dde20 0x556f749e95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.500+0000 7fe0b37fe700 1 -- 172.21.15.8:0/1975191948 learned_addr learned my addr 172.21.15.8:0/1975191948 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:32.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.500+0000 7fe0b27fc700 1 --2- 172.21.15.8:0/1975191948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f749e3310 0x556f749e9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.500+0000 7fe0b37fe700 1 -- 172.21.15.8:0/1975191948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f749e3310 msgr2=0x556f749e9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:32.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.500+0000 7fe0b37fe700 1 --2- 172.21.15.8:0/1975191948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f749e3310 0x556f749e9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.500+0000 7fe0b37fe700 1 -- 172.21.15.8:0/1975191948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f749dde20 msgr2=0x556f749e95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:32.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.500+0000 7fe0b37fe700 1 --2- 172.21.15.8:0/1975191948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f749dde20 0x556f749e95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.500+0000 7fe0b37fe700 1 -- 172.21.15.8:0/1975191948 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f7475bde0 con 0x556f749e3c30 2023-08-11T12:25:32.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.500+0000 7fe0b2ffd700 1 --2- 172.21.15.8:0/1975191948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f749dde20 0x556f749e95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:32.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.500+0000 7fe0b27fc700 1 --2- 172.21.15.8:0/1975191948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f749e3310 0x556f749e9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:32.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.501+0000 7fe0b37fe700 1 --2- 172.21.15.8:0/1975191948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f749e3c30 0x556f749e65c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac0986e0 tx=0x7fe0ac0093f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42266915c6e1ab2a server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:32.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.501+0000 7fe099ffb700 1 -- 172.21.15.8:0/1975191948 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac01b320 con 0x556f749e3c30 2023-08-11T12:25:32.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.501+0000 7fe099ffb700 1 -- 172.21.15.8:0/1975191948 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe0ac0990e0 con 0x556f749e3c30 2023-08-11T12:25:32.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.501+0000 7fe099ffb700 1 -- 172.21.15.8:0/1975191948 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac096ea0 con 0x556f749e3c30 2023-08-11T12:25:32.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.502+0000 7fe0ccf2fb80 1 -- 172.21.15.8:0/1975191948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f749e3c30 msgr2=0x556f749e65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:32.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.502+0000 7fe0ccf2fb80 1 --2- 172.21.15.8:0/1975191948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f749e3c30 0x556f749e65c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac0986e0 tx=0x7fe0ac0093f0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.502+0000 7fe0ccf2fb80 1 -- 172.21.15.8:0/1975191948 shutdown_connections 2023-08-11T12:25:32.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.502+0000 7fe0ccf2fb80 1 --2- 172.21.15.8:0/1975191948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f749e3c30 0x556f749e65c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.502+0000 7fe0ccf2fb80 1 --2- 172.21.15.8:0/1975191948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f749dde20 0x556f749e95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.502+0000 7fe0ccf2fb80 1 --2- 172.21.15.8:0/1975191948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f749e3310 0x556f749e9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.502+0000 7fe0ccf2fb80 1 -- 172.21.15.8:0/1975191948 >> 172.21.15.8:0/1975191948 conn(0x556f7490a950 msgr2=0x556f749e1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:32.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.502+0000 7fe0ccf2fb80 1 -- 172.21.15.8:0/1975191948 shutdown_connections 2023-08-11T12:25:32.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.502+0000 7fe0ccf2fb80 1 -- 172.21.15.8:0/1975191948 wait complete. 2023-08-11T12:25:32.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.502+0000 7fe0ccf2fb80 1 -- start start 2023-08-11T12:25:32.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.503+0000 7fe0ccf2fb80 1 Processor -- start 2023-08-11T12:25:32.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.503+0000 7fe0ccf2fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f749dde20 0x556f749ee290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.503+0000 7fe0ccf2fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f749e3310 0x556f749ec5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.503+0000 7fe0ccf2fb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f749e3c30 0x556f749ecb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.503+0000 7fe0ccf2fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f749ed050 con 0x556f749dde20 2023-08-11T12:25:32.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.503+0000 7fe0ccf2fb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f749ed1c0 con 0x556f749e3c30 2023-08-11T12:25:32.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.503+0000 7fe0ccf2fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f749ed380 con 0x556f749e3310 2023-08-11T12:25:32.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.503+0000 7fe0ccf2fb80 10 client.0 _ll_register_callbacks cb 0x7fe0a400b870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:25:32.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.504+0000 7fe0b27fc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f749e3310 0x556f749ec5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.504+0000 7fe0b27fc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f749e3310 0x556f749ec5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:55650/0 (socket says 172.21.15.8:55650) 2023-08-11T12:25:32.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.504+0000 7fe0b27fc700 1 -- 172.21.15.8:0/1619985802 learned_addr learned my addr 172.21.15.8:0/1619985802 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:32.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.504+0000 7fe0b2ffd700 1 --2- 172.21.15.8:0/1619985802 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f749dde20 0x556f749ee290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.504+0000 7fe0b37fe700 1 --2- 172.21.15.8:0/1619985802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f749e3c30 0x556f749ecb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.504+0000 7fe0b27fc700 1 -- 172.21.15.8:0/1619985802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f749e3c30 msgr2=0x556f749ecb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:32.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.504+0000 7fe0b27fc700 1 --2- 172.21.15.8:0/1619985802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f749e3c30 0x556f749ecb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.504+0000 7fe0b27fc700 1 -- 172.21.15.8:0/1619985802 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f749dde20 msgr2=0x556f749ee290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:32.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.504+0000 7fe0b27fc700 1 --2- 172.21.15.8:0/1619985802 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f749dde20 0x556f749ee290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.504+0000 7fe0b27fc700 1 -- 172.21.15.8:0/1619985802 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a8011440 con 0x556f749e3310 2023-08-11T12:25:32.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.504+0000 7fe0b37fe700 1 --2- 172.21.15.8:0/1619985802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f749e3c30 0x556f749ecb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:25:32.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.504+0000 7fe0b27fc700 1 --2- 172.21.15.8:0/1619985802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f749e3310 0x556f749ec5d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8005660 tx=0x7fe0a80099f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6643a3eb2c705412 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:32.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.504+0000 7fe096ff5700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:25:32.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.505+0000 7fe096ff5700 1 -- 172.21.15.8:0/1619985802 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8028130 con 0x556f749e3310 2023-08-11T12:25:32.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.505+0000 7fe0ccf2fb80 1 -- 172.21.15.8:0/1619985802 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe0a8004e50 con 0x556f749e3310 2023-08-11T12:25:32.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.505+0000 7fe096ff5700 1 -- 172.21.15.8:0/1619985802 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fe0a8028290 con 0x556f749e3310 2023-08-11T12:25:32.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.505+0000 7fe096ff5700 1 -- 172.21.15.8:0/1619985802 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0a8028450 con 0x556f749e3310 2023-08-11T12:25:32.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.505+0000 7fe0ccf2fb80 10 client.26008 fetch_fsmap learned FSMap version 31 2023-08-11T12:25:32.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.505+0000 7fe0ccf2fb80 1 -- 172.21.15.8:0/1619985802 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x556f747af630 con 0x556f749e3310 2023-08-11T12:25:32.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.505+0000 7fe096ff5700 1 -- 172.21.15.8:0/1619985802 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe0a8004e50 con 0x556f749e3310 2023-08-11T12:25:32.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.505+0000 7fe096ff5700 1 -- 172.21.15.8:0/1619985802 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 31) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fe0a80037a0 con 0x556f749e3310 2023-08-11T12:25:32.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.505+0000 7fe0ccf2fb80 10 client.26008 fetch_fsmap finished waiting for FSMap version 31 2023-08-11T12:25:32.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.505+0000 7fe0ccf2fb80 10 client.26008 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:25:32.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.505+0000 7fe0ccf2fb80 20 client.26008 populate_metadata read hostname 'smithi008' 2023-08-11T12:25:32.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.505+0000 7fe0ccf2fb80 1 --2- 172.21.15.8:0/1619985802 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556f74a4c620 0x556f74a4ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:32.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.505+0000 7fe0ccf2fb80 4 client.26008 mds_command: new command op to 24575 tid=0[{"prefix": "damage ls"}] 2023-08-11T12:25:32.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.505+0000 7fe0ccf2fb80 1 -- 172.21.15.8:0/1619985802 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556f74928820 con 0x556f74a4c620 2023-08-11T12:25:32.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.506+0000 7fe0b2ffd700 1 --2- 172.21.15.8:0/1619985802 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556f74a4c620 0x556f74a4ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:32.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.506+0000 7fe0b2ffd700 1 --2- 172.21.15.8:0/1619985802 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556f74a4c620 0x556f74a4ea40 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a296c6fe2785d84 server_cookie=fc7176018832b603 in_seq=0 out_seq=0 2023-08-11T12:25:32.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.506+0000 7fe096ff5700 10 client.26008 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:32.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.506+0000 7fe096ff5700 1 -- 172.21.15.8:0/1619985802 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556f74928820 con 0x556f74a4c620 2023-08-11T12:25:32.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.506+0000 7fe096ff5700 10 client.26008 handle_command_reply: tid=0 2023-08-11T12:25:32.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.506+0000 7fe0ccf2fb80 1 client.26008 shutdown 2023-08-11T12:25:32.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.507+0000 7fe0ccf2fb80 1 -- 172.21.15.8:0/1619985802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f749e3310 msgr2=0x556f749ec5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:32.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.507+0000 7fe0ccf2fb80 1 --2- 172.21.15.8:0/1619985802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f749e3310 0x556f749ec5d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8005660 tx=0x7fe0a80099f0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.507+0000 7fe0ccf2fb80 1 -- 172.21.15.8:0/1619985802 shutdown_connections 2023-08-11T12:25:32.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.507+0000 7fe0ccf2fb80 1 --2- 172.21.15.8:0/1619985802 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556f74a4c620 0x556f74a4ea40 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.507+0000 7fe0ccf2fb80 1 --2- 172.21.15.8:0/1619985802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f749e3c30 0x556f749ecb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.507+0000 7fe0ccf2fb80 1 --2- 172.21.15.8:0/1619985802 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f749dde20 0x556f749ee290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.507+0000 7fe0ccf2fb80 1 --2- 172.21.15.8:0/1619985802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f749e3310 0x556f749ec5d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.507+0000 7fe0ccf2fb80 1 -- 172.21.15.8:0/1619985802 >> 172.21.15.8:0/1619985802 conn(0x556f7490a950 msgr2=0x556f749d2420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:32.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.507+0000 7fe096ff5700 0 client.26008 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:32.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.507+0000 7fe0ccf2fb80 1 -- 172.21.15.8:0/1619985802 shutdown_connections 2023-08-11T12:25:32.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.507+0000 7fe0ccf2fb80 1 -- 172.21.15.8:0/1619985802 wait complete. 2023-08-11T12:25:32.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.507+0000 7fe0ccf2fb80 20 client.26008 trim_cache size 0 max 16384 2023-08-11T12:25:32.527 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-08-11T12:25:32.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.508+0000 7fe0b95ff700 1 -- 172.21.15.8:0/1194009558 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe09c0a01e0 msgr2=0x7fe09c0a26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:32.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.508+0000 7fe0b95ff700 1 --2- 172.21.15.8:0/1194009558 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe09c0a01e0 0x7fe09c0a26a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4009fd0 tx=0x7fe0a4019040 comp rx=0 tx=0).stop 2023-08-11T12:25:32.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.508+0000 7fe0b95ff700 1 -- 172.21.15.8:0/1194009558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0b410d1a0 msgr2=0x7fe0b4198b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:32.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.508+0000 7fe0b95ff700 1 --2- 172.21.15.8:0/1194009558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0b410d1a0 0x7fe0b4198b30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac00efc0 tx=0x7fe0ac00c3a0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.508+0000 7fe0b95ff700 1 -- 172.21.15.8:0/1194009558 shutdown_connections 2023-08-11T12:25:32.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.508+0000 7fe0b95ff700 1 --2- 172.21.15.8:0/1194009558 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe09c0a01e0 0x7fe09c0a26a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.508+0000 7fe0b95ff700 1 --2- 172.21.15.8:0/1194009558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0b410d1a0 0x7fe0b4198b30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.508+0000 7fe0b95ff700 1 --2- 172.21.15.8:0/1194009558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0b4072d50 0x7fe0b419eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.508+0000 7fe0b95ff700 1 --2- 172.21.15.8:0/1194009558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0b4073670 0x7fe0b419f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:32.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.508+0000 7fe0b95ff700 1 -- 172.21.15.8:0/1194009558 >> 172.21.15.8:0/1194009558 conn(0x7fe0b40fc490 msgr2=0x7fe0b410f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:32.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.508+0000 7fe0b95ff700 1 -- 172.21.15.8:0/1194009558 shutdown_connections 2023-08-11T12:25:32.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:32.508+0000 7fe0b95ff700 1 -- 172.21.15.8:0/1194009558 wait complete. 2023-08-11T12:25:32.658 INFO:teuthology.orchestra.run.smithi008.stderr:8900000 of 50000000 tuples (17%) done (elapsed 37.35 s, remaining 172.46 s) 2023-08-11T12:25:32.773 INFO:teuthology.orchestra.run.smithi008.stderr:9000000 of 50000000 tuples (18%) done (elapsed 37.46 s, remaining 170.65 s) 2023-08-11T12:25:32.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:32 smithi008 ceph-mon[97158]: pgmap v31: 129 pgs: 129 active+clean; 1.7 GiB data, 987 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 136 MiB/s wr, 84 op/s 2023-08-11T12:25:33.141 INFO:teuthology.orchestra.run.smithi008.stderr:9100000 of 50000000 tuples (18%) done (elapsed 37.83 s, remaining 170.02 s) 2023-08-11T12:25:33.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:32 smithi194 ceph-mon[130905]: pgmap v31: 129 pgs: 129 active+clean; 1.7 GiB data, 987 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 136 MiB/s wr, 84 op/s 2023-08-11T12:25:33.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:32 smithi045 ceph-mon[130284]: pgmap v31: 129 pgs: 129 active+clean; 1.7 GiB data, 987 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 136 MiB/s wr, 84 op/s 2023-08-11T12:25:33.321 INFO:teuthology.orchestra.run.smithi008.stderr:9200000 of 50000000 tuples (18%) done (elapsed 38.01 s, remaining 168.56 s) 2023-08-11T12:25:33.534 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-08-11T12:25:33.535 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-08-11T12:25:33.669 INFO:teuthology.orchestra.run.smithi008.stderr:9300000 of 50000000 tuples (18%) done (elapsed 38.36 s, remaining 167.86 s) 2023-08-11T12:25:33.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.750+0000 7f576f7ff700 1 -- 172.21.15.8:0/3741862883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5768072d50 msgr2=0x7f5768073130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:33.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.750+0000 7f576f7ff700 1 --2- 172.21.15.8:0/3741862883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5768072d50 0x7f5768073130 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5764009990 tx=0x7f5764009ca0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.750+0000 7f576f7ff700 1 -- 172.21.15.8:0/3741862883 shutdown_connections 2023-08-11T12:25:33.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.750+0000 7f576f7ff700 1 --2- 172.21.15.8:0/3741862883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f576810d1a0 0x7f576810f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.751+0000 7f576f7ff700 1 --2- 172.21.15.8:0/3741862883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5768072d50 0x7f5768073130 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.751+0000 7f576f7ff700 1 --2- 172.21.15.8:0/3741862883 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5768073670 0x7f576810cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.751+0000 7f576f7ff700 1 -- 172.21.15.8:0/3741862883 >> 172.21.15.8:0/3741862883 conn(0x7f57680fc490 msgr2=0x7f57680fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:33.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.751+0000 7f576f7ff700 1 -- 172.21.15.8:0/3741862883 shutdown_connections 2023-08-11T12:25:33.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.751+0000 7f576f7ff700 1 -- 172.21.15.8:0/3741862883 wait complete. 2023-08-11T12:25:33.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.752+0000 7f576f7ff700 1 Processor -- start 2023-08-11T12:25:33.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.752+0000 7f576f7ff700 1 -- start start 2023-08-11T12:25:33.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.753+0000 7f576f7ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5768072d50 0x7f5768198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:33.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.753+0000 7f576f7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5768073670 0x7f57681991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:33.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.753+0000 7f576f7ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f576810d1a0 0x7f576819c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:33.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.753+0000 7f576f7ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576819cba0 con 0x7f576810d1a0 2023-08-11T12:25:33.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.753+0000 7f576f7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576819cd10 con 0x7f5768073670 2023-08-11T12:25:33.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.753+0000 7f576f7ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576819ced0 con 0x7f5768072d50 2023-08-11T12:25:33.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.753+0000 7f576d59b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5768072d50 0x7f5768198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:33.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.753+0000 7f576d59b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5768072d50 0x7f5768198cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:55668/0 (socket says 172.21.15.8:55668) 2023-08-11T12:25:33.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.753+0000 7f576d59b700 1 -- 172.21.15.8:0/492129734 learned_addr learned my addr 172.21.15.8:0/492129734 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:33.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.753+0000 7f576cd9a700 1 --2- 172.21.15.8:0/492129734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5768073670 0x7f57681991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:33.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.753+0000 7f576dd9c700 1 --2- 172.21.15.8:0/492129734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f576810d1a0 0x7f576819c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:33.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.754+0000 7f576d59b700 1 -- 172.21.15.8:0/492129734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5768073670 msgr2=0x7f57681991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:33.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.754+0000 7f576d59b700 1 --2- 172.21.15.8:0/492129734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5768073670 0x7f57681991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.754+0000 7f576d59b700 1 -- 172.21.15.8:0/492129734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f576810d1a0 msgr2=0x7f576819c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:33.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.754+0000 7f576d59b700 1 --2- 172.21.15.8:0/492129734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f576810d1a0 0x7f576819c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.754+0000 7f576d59b700 1 -- 172.21.15.8:0/492129734 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57640095f0 con 0x7f5768072d50 2023-08-11T12:25:33.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.754+0000 7f576d59b700 1 --2- 172.21.15.8:0/492129734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5768072d50 0x7f5768198cb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5764005910 tx=0x7f5764004710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:33.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.754+0000 7f575e7fc700 1 -- 172.21.15.8:0/492129734 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576401d070 con 0x7f5768072d50 2023-08-11T12:25:33.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.754+0000 7f576f7ff700 1 -- 172.21.15.8:0/492129734 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f576819d150 con 0x7f5768072d50 2023-08-11T12:25:33.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.754+0000 7f575e7fc700 1 -- 172.21.15.8:0/492129734 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5764022470 con 0x7f5768072d50 2023-08-11T12:25:33.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.754+0000 7f575e7fc700 1 -- 172.21.15.8:0/492129734 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5764017650 con 0x7f5768072d50 2023-08-11T12:25:33.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.755+0000 7f576f7ff700 1 -- 172.21.15.8:0/492129734 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57681a5b10 con 0x7f5768072d50 2023-08-11T12:25:33.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.758+0000 7f575e7fc700 1 -- 172.21.15.8:0/492129734 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 24) v1 ==== 134903+0+0 (secure 0 0 0) 0x7f57640225e0 con 0x7f5768072d50 2023-08-11T12:25:33.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.759+0000 7f5783105b80 1 Processor -- start 2023-08-11T12:25:33.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.759+0000 7f5783105b80 1 -- start start 2023-08-11T12:25:33.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.759+0000 7f575e7fc700 1 --2- 172.21.15.8:0/492129734 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f57540a0260 0x7f57540a2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:33.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.759+0000 7f575e7fc700 1 -- 172.21.15.8:0/492129734 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f57640ccdd0 con 0x7f5768072d50 2023-08-11T12:25:33.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.760+0000 7f576dd9c700 1 --2- 172.21.15.8:0/492129734 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f57540a0260 0x7f57540a2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:33.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.760+0000 7f5783105b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56493a3a1390 0x56493a3a1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:33.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.760+0000 7f5783105b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56493a3a1cb0 0x56493a39b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:33.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.760+0000 7f5783105b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56493a39bea0 0x56493a39c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:33.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.760+0000 7f5783105b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56493a2f46b0 con 0x56493a3a1390 2023-08-11T12:25:33.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.760+0000 7f5783105b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56493a2f1fd0 con 0x56493a3a1cb0 2023-08-11T12:25:33.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.760+0000 7f5783105b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56493a2ed8c0 con 0x56493a39bea0 2023-08-11T12:25:33.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.760+0000 7f576dd9c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56493a39bea0 0x56493a39c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:33.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.760+0000 7f576d59b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56493a3a1390 0x56493a3a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:33.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.760+0000 7f576dd9c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56493a39bea0 0x56493a39c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:55676/0 (socket says 172.21.15.8:55676) 2023-08-11T12:25:33.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.760+0000 7f576dd9c700 1 -- 172.21.15.8:0/2041933173 learned_addr learned my addr 172.21.15.8:0/2041933173 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:33.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.760+0000 7f576d59b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56493a3a1390 0x56493a3a1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39756/0 (socket says 172.21.15.8:39756) 2023-08-11T12:25:33.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.760+0000 7f576cd9a700 1 --2- 172.21.15.8:0/2041933173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56493a3a1cb0 0x56493a39b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:33.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.761+0000 7f576d59b700 1 -- 172.21.15.8:0/2041933173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56493a39bea0 msgr2=0x56493a39c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:33.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.761+0000 7f576d59b700 1 --2- 172.21.15.8:0/2041933173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56493a39bea0 0x56493a39c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.761+0000 7f576d59b700 1 -- 172.21.15.8:0/2041933173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56493a3a1cb0 msgr2=0x56493a39b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:33.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.761+0000 7f576d59b700 1 --2- 172.21.15.8:0/2041933173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56493a3a1cb0 0x56493a39b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.761+0000 7f576d59b700 1 -- 172.21.15.8:0/2041933173 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56493a16d6b0 con 0x56493a3a1390 2023-08-11T12:25:33.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.761+0000 7f576cd9a700 1 --2- 172.21.15.8:0/2041933173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56493a3a1cb0 0x56493a39b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:33.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.761+0000 7f576dd9c700 1 --2- 172.21.15.8:0/2041933173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56493a39bea0 0x56493a39c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:33.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.761+0000 7f576dd9c700 1 --2- 172.21.15.8:0/492129734 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f57540a0260 0x7f57540a2720 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f576000f930 tx=0x7f576000fcf0 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:33.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.761+0000 7f576d59b700 1 --2- 172.21.15.8:0/2041933173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56493a3a1390 0x56493a3a1770 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f57640ca050 tx=0x7f576400b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c712c66726f76b76 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:33.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.761+0000 7f57537fe700 1 -- 172.21.15.8:0/2041933173 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576409a6d0 con 0x56493a3a1390 2023-08-11T12:25:33.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.761+0000 7f57537fe700 1 -- 172.21.15.8:0/2041933173 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5764099fd0 con 0x56493a3a1390 2023-08-11T12:25:33.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.761+0000 7f57537fe700 1 -- 172.21.15.8:0/2041933173 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576409a490 con 0x56493a3a1390 2023-08-11T12:25:33.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.762+0000 7f5783105b80 1 -- 172.21.15.8:0/2041933173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56493a3a1390 msgr2=0x56493a3a1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:33.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.762+0000 7f5783105b80 1 --2- 172.21.15.8:0/2041933173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56493a3a1390 0x56493a3a1770 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f57640ca050 tx=0x7f576400b6b0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.762+0000 7f5783105b80 1 -- 172.21.15.8:0/2041933173 shutdown_connections 2023-08-11T12:25:33.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.762+0000 7f5783105b80 1 --2- 172.21.15.8:0/2041933173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56493a39bea0 0x56493a39c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.762+0000 7f5783105b80 1 --2- 172.21.15.8:0/2041933173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56493a3a1390 0x56493a3a1770 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.762+0000 7f5783105b80 1 --2- 172.21.15.8:0/2041933173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56493a3a1cb0 0x56493a39b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.762+0000 7f5783105b80 1 -- 172.21.15.8:0/2041933173 >> 172.21.15.8:0/2041933173 conn(0x56493a2c89d0 msgr2=0x56493a396450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:33.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.762+0000 7f5783105b80 1 -- 172.21.15.8:0/2041933173 shutdown_connections 2023-08-11T12:25:33.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.762+0000 7f5783105b80 1 -- 172.21.15.8:0/2041933173 wait complete. 2023-08-11T12:25:33.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.763+0000 7f5783105b80 1 -- start start 2023-08-11T12:25:33.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.763+0000 7f5783105b80 1 Processor -- start 2023-08-11T12:25:33.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.764+0000 7f5783105b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56493a39bea0 0x56493a3a7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:33.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.764+0000 7f5783105b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56493a3a1390 0x56493a3a4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:33.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.764+0000 7f5783105b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56493a3a1cb0 0x56493a3a5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:33.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.764+0000 7f5783105b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56493a28bb40 con 0x56493a3a1390 2023-08-11T12:25:33.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.764+0000 7f5783105b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56493a28b840 con 0x56493a39bea0 2023-08-11T12:25:33.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.764+0000 7f5783105b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56493a16f9a0 con 0x56493a3a1cb0 2023-08-11T12:25:33.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.764+0000 7f5783105b80 10 client.0 _ll_register_callbacks cb 0x56493a28eb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:25:33.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.764+0000 7f576d59b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56493a39bea0 0x56493a3a7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:33.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.764+0000 7f576d59b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56493a39bea0 0x56493a3a7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:34126/0 (socket says 172.21.15.8:34126) 2023-08-11T12:25:33.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.764+0000 7f576d59b700 1 -- 172.21.15.8:0/1136745355 learned_addr learned my addr 172.21.15.8:0/1136745355 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:33.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.764+0000 7f576cd9a700 1 --2- 172.21.15.8:0/1136745355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56493a3a1390 0x56493a3a4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:33.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.764+0000 7f576dd9c700 1 --2- 172.21.15.8:0/1136745355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56493a3a1cb0 0x56493a3a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:33.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.765+0000 7f576d59b700 1 -- 172.21.15.8:0/1136745355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56493a3a1cb0 msgr2=0x56493a3a5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:33.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.765+0000 7f576d59b700 1 --2- 172.21.15.8:0/1136745355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56493a3a1cb0 0x56493a3a5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.765+0000 7f576d59b700 1 -- 172.21.15.8:0/1136745355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56493a3a1390 msgr2=0x56493a3a4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:33.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.765+0000 7f576d59b700 1 --2- 172.21.15.8:0/1136745355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56493a3a1390 0x56493a3a4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.765+0000 7f576d59b700 1 -- 172.21.15.8:0/1136745355 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57580098e0 con 0x56493a39bea0 2023-08-11T12:25:33.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.765+0000 7f576d59b700 1 --2- 172.21.15.8:0/1136745355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56493a39bea0 0x56493a3a7a80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f57640a1820 tx=0x7f5764022b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65c1c0e90fbaaef9 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:33.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.765+0000 7f5750ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:25:33.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.765+0000 7f5750ff9700 1 -- 172.21.15.8:0/1136745355 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576409a6d0 con 0x56493a39bea0 2023-08-11T12:25:33.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.765+0000 7f5750ff9700 1 -- 172.21.15.8:0/1136745355 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f576409de00 con 0x56493a39bea0 2023-08-11T12:25:33.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.765+0000 7f5783105b80 1 -- 172.21.15.8:0/1136745355 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56493a38eb10 con 0x56493a39bea0 2023-08-11T12:25:33.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.765+0000 7f5750ff9700 1 -- 172.21.15.8:0/1136745355 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57640c5030 con 0x56493a39bea0 2023-08-11T12:25:33.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.765+0000 7f5783105b80 10 client.26006 fetch_fsmap learned FSMap version 31 2023-08-11T12:25:33.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.765+0000 7f5783105b80 1 -- 172.21.15.8:0/1136745355 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f57681a5b10 con 0x56493a39bea0 2023-08-11T12:25:33.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.766+0000 7f5750ff9700 1 -- 172.21.15.8:0/1136745355 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56493a38eb10 con 0x56493a39bea0 2023-08-11T12:25:33.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.766+0000 7f5750ff9700 1 -- 172.21.15.8:0/1136745355 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 31) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f57640ca330 con 0x56493a39bea0 2023-08-11T12:25:33.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.766+0000 7f5783105b80 10 client.26006 fetch_fsmap finished waiting for FSMap version 31 2023-08-11T12:25:33.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.766+0000 7f5783105b80 10 client.26006 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:25:33.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.766+0000 7f5783105b80 20 client.26006 populate_metadata read hostname 'smithi008' 2023-08-11T12:25:33.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.766+0000 7f5783105b80 1 --2- 172.21.15.8:0/1136745355 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x56493a3b4d30 0x56493a3b7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:33.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.766+0000 7f5783105b80 4 client.26006 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:25:33.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.766+0000 7f5783105b80 1 -- 172.21.15.8:0/1136745355 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56493a36a560 con 0x56493a3b4d30 2023-08-11T12:25:33.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.766+0000 7f576cd9a700 1 --2- 172.21.15.8:0/1136745355 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x56493a3b4d30 0x56493a3b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:33.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.767+0000 7f576cd9a700 1 --2- 172.21.15.8:0/1136745355 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x56493a3b4d30 0x56493a3b7150 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f502555304703fe server_cookie=753a178d9cd9f7e4 in_seq=0 out_seq=0 2023-08-11T12:25:33.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.767+0000 7f5750ff9700 10 client.26006 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:33.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.767+0000 7f5750ff9700 1 -- 172.21.15.8:0/1136745355 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x56493a36a560 con 0x56493a3b4d30 2023-08-11T12:25:33.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.767+0000 7f5750ff9700 10 client.26006 handle_command_reply: tid=0 2023-08-11T12:25:33.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.768+0000 7f5783105b80 1 client.26006 shutdown 2023-08-11T12:25:33.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.768+0000 7f5783105b80 1 -- 172.21.15.8:0/1136745355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56493a39bea0 msgr2=0x56493a3a7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:33.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.768+0000 7f5783105b80 1 --2- 172.21.15.8:0/1136745355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56493a39bea0 0x56493a3a7a80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f57640a1820 tx=0x7f5764022b30 comp rx=0 tx=0).stop 2023-08-11T12:25:33.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.768+0000 7f5783105b80 1 -- 172.21.15.8:0/1136745355 shutdown_connections 2023-08-11T12:25:33.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.768+0000 7f5783105b80 1 --2- 172.21.15.8:0/1136745355 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x56493a3b4d30 0x56493a3b7150 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.768+0000 7f5783105b80 1 --2- 172.21.15.8:0/1136745355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56493a3a1cb0 0x56493a3a5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.768+0000 7f5783105b80 1 --2- 172.21.15.8:0/1136745355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56493a39bea0 0x56493a3a7a80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.768+0000 7f5750ff9700 0 client.26006 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:33.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.768+0000 7f5783105b80 1 --2- 172.21.15.8:0/1136745355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56493a3a1390 0x56493a3a4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.768+0000 7f5783105b80 1 -- 172.21.15.8:0/1136745355 >> 172.21.15.8:0/1136745355 conn(0x56493a2c89d0 msgr2=0x56493a390d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:33.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.768+0000 7f5783105b80 1 -- 172.21.15.8:0/1136745355 shutdown_connections 2023-08-11T12:25:33.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.768+0000 7f5783105b80 1 -- 172.21.15.8:0/1136745355 wait complete. 2023-08-11T12:25:33.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.768+0000 7f5783105b80 20 client.26006 trim_cache size 0 max 16384 2023-08-11T12:25:33.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.793+0000 7f5783105b80 1 Processor -- start 2023-08-11T12:25:33.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.794+0000 7f5783105b80 1 -- start start 2023-08-11T12:25:33.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.794+0000 7f5783105b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56493a39bea0 0x56493a3a08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:33.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.794+0000 7f5783105b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56493a3a1390 0x56493a3ac420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:33.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.794+0000 7f5783105b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56493a3a1cb0 0x56493a390bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:33.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.794+0000 7f5783105b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56493a3975b0 con 0x56493a3a1cb0 2023-08-11T12:25:33.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.794+0000 7f5783105b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56493a3a6380 con 0x56493a39bea0 2023-08-11T12:25:33.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.794+0000 7f5783105b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56493a397ce0 con 0x56493a3a1390 2023-08-11T12:25:33.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.794+0000 7f576cd9a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56493a3a1390 0x56493a3ac420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:33.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.795+0000 7f576cd9a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56493a3a1390 0x56493a3ac420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:55702/0 (socket says 172.21.15.8:55702) 2023-08-11T12:25:33.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.795+0000 7f576cd9a700 1 -- 172.21.15.8:0/3358720210 learned_addr learned my addr 172.21.15.8:0/3358720210 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:33.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.795+0000 7f576dd9c700 1 --2- 172.21.15.8:0/3358720210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56493a3a1cb0 0x56493a390bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:33.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.795+0000 7f576d59b700 1 --2- 172.21.15.8:0/3358720210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56493a39bea0 0x56493a3a08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:33.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.795+0000 7f576cd9a700 1 -- 172.21.15.8:0/3358720210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56493a39bea0 msgr2=0x56493a3a08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:33.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.795+0000 7f576cd9a700 1 --2- 172.21.15.8:0/3358720210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56493a39bea0 0x56493a3a08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.795+0000 7f576cd9a700 1 -- 172.21.15.8:0/3358720210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56493a3a1cb0 msgr2=0x56493a390bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:33.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.795+0000 7f576cd9a700 1 --2- 172.21.15.8:0/3358720210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56493a3a1cb0 0x56493a390bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.795+0000 7f576cd9a700 1 -- 172.21.15.8:0/3358720210 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56493a390050 con 0x56493a3a1390 2023-08-11T12:25:33.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.795+0000 7f576d59b700 1 --2- 172.21.15.8:0/3358720210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56493a39bea0 0x56493a3a08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:25:33.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.795+0000 7f576cd9a700 1 --2- 172.21.15.8:0/3358720210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56493a3a1390 0x56493a3ac420 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5758000c00 tx=0x7f5758009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0d62d8557378dbc server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:33.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.796+0000 7f5753fff700 1 -- 172.21.15.8:0/3358720210 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5758017070 con 0x56493a3a1390 2023-08-11T12:25:33.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.796+0000 7f5753fff700 1 -- 172.21.15.8:0/3358720210 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5758018040 con 0x56493a3a1390 2023-08-11T12:25:33.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.796+0000 7f5753fff700 1 -- 172.21.15.8:0/3358720210 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5758021c30 con 0x56493a3a1390 2023-08-11T12:25:33.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.797+0000 7f5783105b80 1 -- 172.21.15.8:0/3358720210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56493a3a1390 msgr2=0x56493a3ac420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:33.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.797+0000 7f5783105b80 1 --2- 172.21.15.8:0/3358720210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56493a3a1390 0x56493a3ac420 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5758000c00 tx=0x7f5758009260 comp rx=0 tx=0).stop 2023-08-11T12:25:33.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.797+0000 7f5783105b80 1 -- 172.21.15.8:0/3358720210 shutdown_connections 2023-08-11T12:25:33.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.797+0000 7f5783105b80 1 --2- 172.21.15.8:0/3358720210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56493a3a1cb0 0x56493a390bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.797+0000 7f5783105b80 1 --2- 172.21.15.8:0/3358720210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56493a39bea0 0x56493a3a08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.797+0000 7f5783105b80 1 --2- 172.21.15.8:0/3358720210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56493a3a1390 0x56493a3ac420 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.797+0000 7f5783105b80 1 -- 172.21.15.8:0/3358720210 >> 172.21.15.8:0/3358720210 conn(0x56493a2c89d0 msgr2=0x56493a3904a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:33.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.797+0000 7f5783105b80 1 -- 172.21.15.8:0/3358720210 shutdown_connections 2023-08-11T12:25:33.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.797+0000 7f5783105b80 1 -- 172.21.15.8:0/3358720210 wait complete. 2023-08-11T12:25:33.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.798+0000 7f5783105b80 1 -- start start 2023-08-11T12:25:33.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.798+0000 7f5783105b80 1 Processor -- start 2023-08-11T12:25:33.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.798+0000 7f5783105b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56493a39bea0 0x56493a402b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:33.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.799+0000 7f5783105b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56493a3a1390 0x56493a403060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:33.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.799+0000 7f5783105b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56493a3a1cb0 0x56493a3fcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:33.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.799+0000 7f5783105b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56493a3fd4d0 con 0x56493a39bea0 2023-08-11T12:25:33.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.799+0000 7f5783105b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56493a3fd640 con 0x56493a3a1cb0 2023-08-11T12:25:33.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.799+0000 7f5783105b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56493a3fd800 con 0x56493a3a1390 2023-08-11T12:25:33.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.799+0000 7f5783105b80 10 client.0 _ll_register_callbacks cb 0x7f5758009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:25:33.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.799+0000 7f576dd9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56493a3a1cb0 0x56493a3fcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:33.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.799+0000 7f576dd9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56493a3a1cb0 0x56493a3fcef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:34130/0 (socket says 172.21.15.8:34130) 2023-08-11T12:25:33.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.799+0000 7f576dd9c700 1 -- 172.21.15.8:0/2374987708 learned_addr learned my addr 172.21.15.8:0/2374987708 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:33.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.799+0000 7f576cd9a700 1 --2- 172.21.15.8:0/2374987708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56493a3a1390 0x56493a403060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:33.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.800+0000 7f576d59b700 1 --2- 172.21.15.8:0/2374987708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56493a39bea0 0x56493a402b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:33.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.800+0000 7f576cd9a700 1 -- 172.21.15.8:0/2374987708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56493a3a1cb0 msgr2=0x56493a3fcef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:33.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.800+0000 7f576cd9a700 1 --2- 172.21.15.8:0/2374987708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56493a3a1cb0 0x56493a3fcef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.800+0000 7f576cd9a700 1 -- 172.21.15.8:0/2374987708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56493a39bea0 msgr2=0x56493a402b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:33.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.800+0000 7f576cd9a700 1 --2- 172.21.15.8:0/2374987708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56493a39bea0 0x56493a402b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.800+0000 7f576cd9a700 1 -- 172.21.15.8:0/2374987708 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5758004040 con 0x56493a3a1390 2023-08-11T12:25:33.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.800+0000 7f576cd9a700 1 --2- 172.21.15.8:0/2374987708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56493a3a1390 0x56493a403060 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5758004660 tx=0x7f5758012200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d904567df39aea2 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:33.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.800+0000 7f5750ff9700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:25:33.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.801+0000 7f5750ff9700 1 -- 172.21.15.8:0/2374987708 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5758017040 con 0x56493a3a1390 2023-08-11T12:25:33.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.801+0000 7f5750ff9700 1 -- 172.21.15.8:0/2374987708 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f5758003cd0 con 0x56493a3a1390 2023-08-11T12:25:33.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.801+0000 7f5783105b80 1 -- 172.21.15.8:0/2374987708 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5764099fd0 con 0x56493a3a1390 2023-08-11T12:25:33.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.801+0000 7f5750ff9700 1 -- 172.21.15.8:0/2374987708 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5758021940 con 0x56493a3a1390 2023-08-11T12:25:33.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.801+0000 7f5783105b80 10 client.26026 fetch_fsmap learned FSMap version 31 2023-08-11T12:25:33.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.801+0000 7f5783105b80 1 -- 172.21.15.8:0/2374987708 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x56493a3b1b40 con 0x56493a3a1390 2023-08-11T12:25:33.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.802+0000 7f5750ff9700 1 -- 172.21.15.8:0/2374987708 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5764099fd0 con 0x56493a3a1390 2023-08-11T12:25:33.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.802+0000 7f5750ff9700 1 -- 172.21.15.8:0/2374987708 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 31) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f5758028070 con 0x56493a3a1390 2023-08-11T12:25:33.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.802+0000 7f5783105b80 10 client.26026 fetch_fsmap finished waiting for FSMap version 31 2023-08-11T12:25:33.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.802+0000 7f5783105b80 10 client.26026 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:25:33.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.802+0000 7f5783105b80 20 client.26026 populate_metadata read hostname 'smithi008' 2023-08-11T12:25:33.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.802+0000 7f5783105b80 1 --2- 172.21.15.8:0/2374987708 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x56493a40a9d0 0x56493a40cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:33.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.802+0000 7f5783105b80 4 client.26026 mds_command: new command op to 24575 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-08-11T12:25:33.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.802+0000 7f5783105b80 1 -- 172.21.15.8:0/2374987708 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x56493a2e68a0 con 0x56493a40a9d0 2023-08-11T12:25:33.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.802+0000 7f576d59b700 1 --2- 172.21.15.8:0/2374987708 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x56493a40a9d0 0x56493a40cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:33.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.803+0000 7f5750ff9700 10 client.26026 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:33.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.803+0000 7f576d59b700 1 --2- 172.21.15.8:0/2374987708 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x56493a40a9d0 0x56493a40cdf0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2e067da6a054746 server_cookie=169682168c1376d3 in_seq=0 out_seq=0 2023-08-11T12:25:33.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.806+0000 7f5750ff9700 1 -- 172.21.15.8:0/2374987708 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56493a2e68a0 con 0x56493a40a9d0 2023-08-11T12:25:33.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.806+0000 7f5750ff9700 10 client.26026 handle_command_reply: tid=0 2023-08-11T12:25:33.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.806+0000 7f5783105b80 1 client.26026 shutdown 2023-08-11T12:25:33.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.806+0000 7f5783105b80 1 -- 172.21.15.8:0/2374987708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56493a3a1390 msgr2=0x56493a403060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:33.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.806+0000 7f5783105b80 1 --2- 172.21.15.8:0/2374987708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56493a3a1390 0x56493a403060 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5758004660 tx=0x7f5758012200 comp rx=0 tx=0).stop 2023-08-11T12:25:33.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.807+0000 7f5783105b80 1 -- 172.21.15.8:0/2374987708 shutdown_connections 2023-08-11T12:25:33.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.807+0000 7f5783105b80 1 --2- 172.21.15.8:0/2374987708 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x56493a40a9d0 0x56493a40cdf0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.807+0000 7f5783105b80 1 --2- 172.21.15.8:0/2374987708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56493a3a1cb0 0x56493a3fcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.807+0000 7f5783105b80 1 --2- 172.21.15.8:0/2374987708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56493a39bea0 0x56493a402b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.807+0000 7f5783105b80 1 --2- 172.21.15.8:0/2374987708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56493a3a1390 0x56493a403060 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.807+0000 7f5783105b80 1 -- 172.21.15.8:0/2374987708 >> 172.21.15.8:0/2374987708 conn(0x56493a2c89d0 msgr2=0x56493a390d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:33.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.807+0000 7f5750ff9700 0 client.26026 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:33.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.807+0000 7f5783105b80 1 -- 172.21.15.8:0/2374987708 shutdown_connections 2023-08-11T12:25:33.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.807+0000 7f5783105b80 1 -- 172.21.15.8:0/2374987708 wait complete. 2023-08-11T12:25:33.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.808+0000 7f5783105b80 20 client.26026 trim_cache size 0 max 16384 2023-08-11T12:25:33.814 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:25:33.814 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2023-08-11T12:25:33.814 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:25:33.814 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2023-08-11T12:25:33.814 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:25:33.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.808+0000 7f576f7ff700 1 -- 172.21.15.8:0/492129734 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f57540a0260 msgr2=0x7f57540a2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:33.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.808+0000 7f576f7ff700 1 --2- 172.21.15.8:0/492129734 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f57540a0260 0x7f57540a2720 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f576000f930 tx=0x7f576000fcf0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.808+0000 7f576f7ff700 1 -- 172.21.15.8:0/492129734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5768072d50 msgr2=0x7f5768198cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:33.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.808+0000 7f576f7ff700 1 --2- 172.21.15.8:0/492129734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5768072d50 0x7f5768198cb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5764005910 tx=0x7f5764004710 comp rx=0 tx=0).stop 2023-08-11T12:25:33.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.808+0000 7f576f7ff700 1 -- 172.21.15.8:0/492129734 shutdown_connections 2023-08-11T12:25:33.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.808+0000 7f576f7ff700 1 --2- 172.21.15.8:0/492129734 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f57540a0260 0x7f57540a2720 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.808+0000 7f576f7ff700 1 --2- 172.21.15.8:0/492129734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5768072d50 0x7f5768198cb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.808+0000 7f576f7ff700 1 --2- 172.21.15.8:0/492129734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f576810d1a0 0x7f576819c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.808+0000 7f576f7ff700 1 --2- 172.21.15.8:0/492129734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5768073670 0x7f57681991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:33.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.808+0000 7f576f7ff700 1 -- 172.21.15.8:0/492129734 >> 172.21.15.8:0/492129734 conn(0x7f57680fc490 msgr2=0x7f576810f360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:33.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.808+0000 7f576f7ff700 1 -- 172.21.15.8:0/492129734 shutdown_connections 2023-08-11T12:25:33.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:33.808+0000 7f576f7ff700 1 -- 172.21.15.8:0/492129734 wait complete. 2023-08-11T12:25:33.832 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:25:34.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.064+0000 7f02119ff700 1 -- 172.21.15.8:0/803597395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f020c100960 msgr2=0x7f020c100de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:34.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.064+0000 7f02119ff700 1 --2- 172.21.15.8:0/803597395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f020c100960 0x7f020c100de0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0200009990 tx=0x7f0200009ca0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.064+0000 7f02119ff700 1 -- 172.21.15.8:0/803597395 shutdown_connections 2023-08-11T12:25:34.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.064+0000 7f02119ff700 1 --2- 172.21.15.8:0/803597395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f020c106970 0x7f020c106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.064+0000 7f02119ff700 1 --2- 172.21.15.8:0/803597395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f020c101320 0x7f020c10d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.064+0000 7f02119ff700 1 --2- 172.21.15.8:0/803597395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f020c100960 0x7f020c100de0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.064+0000 7f02119ff700 1 -- 172.21.15.8:0/803597395 >> 172.21.15.8:0/803597395 conn(0x7f020c0fc490 msgr2=0x7f020c0fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:34.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.064+0000 7f02119ff700 1 -- 172.21.15.8:0/803597395 shutdown_connections 2023-08-11T12:25:34.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.064+0000 7f02119ff700 1 -- 172.21.15.8:0/803597395 wait complete. 2023-08-11T12:25:34.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.066+0000 7f02119ff700 1 Processor -- start 2023-08-11T12:25:34.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.066+0000 7f02119ff700 1 -- start start 2023-08-11T12:25:34.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.067+0000 7f02119ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f020c100960 0x7f020c19c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:34.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.067+0000 7f02119ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f020c101320 0x7f020c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:34.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.067+0000 7f02119ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f020c106970 0x7f020c196870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:34.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.067+0000 7f02119ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c196ee0 con 0x7f020c101320 2023-08-11T12:25:34.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.067+0000 7f02119ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c197050 con 0x7f020c100960 2023-08-11T12:25:34.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.067+0000 7f02119ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c197210 con 0x7f020c106970 2023-08-11T12:25:34.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.067+0000 7f020affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f020c100960 0x7f020c19c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:34.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.067+0000 7f020affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f020c100960 0x7f020c19c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:34142/0 (socket says 172.21.15.8:34142) 2023-08-11T12:25:34.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.067+0000 7f020a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f020c101320 0x7f020c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:34.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.067+0000 7f020affd700 1 -- 172.21.15.8:0/569783503 learned_addr learned my addr 172.21.15.8:0/569783503 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:34.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.067+0000 7f020b7fe700 1 --2- 172.21.15.8:0/569783503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f020c106970 0x7f020c196870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:34.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.067+0000 7f020affd700 1 -- 172.21.15.8:0/569783503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f020c106970 msgr2=0x7f020c196870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:34.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.067+0000 7f020affd700 1 --2- 172.21.15.8:0/569783503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f020c106970 0x7f020c196870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.067+0000 7f020affd700 1 -- 172.21.15.8:0/569783503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f020c101320 msgr2=0x7f020c19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:34.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.067+0000 7f020affd700 1 --2- 172.21.15.8:0/569783503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f020c101320 0x7f020c19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.067+0000 7f020affd700 1 -- 172.21.15.8:0/569783503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0204009c40 con 0x7f020c100960 2023-08-11T12:25:34.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.067+0000 7f020b7fe700 1 --2- 172.21.15.8:0/569783503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f020c106970 0x7f020c196870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:25:34.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.068+0000 7f020affd700 1 --2- 172.21.15.8:0/569783503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f020c100960 0x7f020c19c800 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00e9a0 tx=0x7f01fc00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:34.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.068+0000 7f02109fd700 1 -- 172.21.15.8:0/569783503 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc009790 con 0x7f020c100960 2023-08-11T12:25:34.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.068+0000 7f02119ff700 1 -- 172.21.15.8:0/569783503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02000095f0 con 0x7f020c100960 2023-08-11T12:25:34.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.068+0000 7f02109fd700 1 -- 172.21.15.8:0/569783503 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01fc00cbd0 con 0x7f020c100960 2023-08-11T12:25:34.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.068+0000 7f02109fd700 1 -- 172.21.15.8:0/569783503 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc018680 con 0x7f020c100960 2023-08-11T12:25:34.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.068+0000 7f02119ff700 1 -- 172.21.15.8:0/569783503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020c1a3610 con 0x7f020c100960 2023-08-11T12:25:34.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.073+0000 7f022541ab80 1 Processor -- start 2023-08-11T12:25:34.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.073+0000 7f022541ab80 1 -- start start 2023-08-11T12:25:34.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.073+0000 7f02109fd700 1 -- 172.21.15.8:0/569783503 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 24) v1 ==== 134903+0+0 (secure 0 0 0) 0x7f01fc00cd40 con 0x7f020c100960 2023-08-11T12:25:34.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.073+0000 7f022541ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638b425c310 0x5638b425c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:34.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.073+0000 7f022541ab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638b425cc30 0x5638b42568e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:34.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.073+0000 7f022541ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5638b4256e20 0x5638b4257260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:34.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.073+0000 7f022541ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638b41af630 con 0x5638b4256e20 2023-08-11T12:25:34.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.073+0000 7f022541ab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638b41acf50 con 0x5638b425cc30 2023-08-11T12:25:34.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.073+0000 7f022541ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638b41a8840 con 0x5638b425c310 2023-08-11T12:25:34.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.074+0000 7f020affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638b425cc30 0x5638b42568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:34.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.074+0000 7f020b7fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638b425c310 0x5638b425c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:34.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.074+0000 7f020b7fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638b425c310 0x5638b425c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:55744/0 (socket says 172.21.15.8:55744) 2023-08-11T12:25:34.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.074+0000 7f020b7fe700 1 -- 172.21.15.8:0/3083986166 learned_addr learned my addr 172.21.15.8:0/3083986166 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:34.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.074+0000 7f020a7fc700 1 --2- 172.21.15.8:0/3083986166 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5638b4256e20 0x5638b4257260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:34.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.074+0000 7f020b7fe700 1 -- 172.21.15.8:0/3083986166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638b425cc30 msgr2=0x5638b42568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:34.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.074+0000 7f020b7fe700 1 --2- 172.21.15.8:0/3083986166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638b425cc30 0x5638b42568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.074+0000 7f020b7fe700 1 -- 172.21.15.8:0/3083986166 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5638b4256e20 msgr2=0x5638b4257260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:34.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.074+0000 7f020b7fe700 1 --2- 172.21.15.8:0/3083986166 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5638b4256e20 0x5638b4257260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.074+0000 7f020b7fe700 1 -- 172.21.15.8:0/3083986166 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638b4028630 con 0x5638b425c310 2023-08-11T12:25:34.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.074+0000 7f020b7fe700 1 --2- 172.21.15.8:0/3083986166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638b425c310 0x5638b425c6f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0204007550 tx=0x7f0204009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9d9e9e25bafe283 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:34.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.075+0000 7f01f1ffb700 1 -- 172.21.15.8:0/3083986166 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020400e070 con 0x5638b425c310 2023-08-11T12:25:34.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.075+0000 7f01f1ffb700 1 -- 172.21.15.8:0/3083986166 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f020400f040 con 0x5638b425c310 2023-08-11T12:25:34.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.075+0000 7f01f1ffb700 1 -- 172.21.15.8:0/3083986166 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0204014810 con 0x5638b425c310 2023-08-11T12:25:34.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.075+0000 7f02109fd700 1 --2- 172.21.15.8:0/569783503 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f01f40a01e0 0x7f01f40a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:34.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.075+0000 7f02109fd700 1 -- 172.21.15.8:0/569783503 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f01fc014070 con 0x7f020c100960 2023-08-11T12:25:34.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.075+0000 7f020affd700 1 --2- 172.21.15.8:0/569783503 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f01f40a01e0 0x7f01f40a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:34.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.075+0000 7f022541ab80 1 -- 172.21.15.8:0/3083986166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638b425c310 msgr2=0x5638b425c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:34.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.075+0000 7f022541ab80 1 --2- 172.21.15.8:0/3083986166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638b425c310 0x5638b425c6f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0204007550 tx=0x7f0204009920 comp rx=0 tx=0).stop 2023-08-11T12:25:34.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.076+0000 7f022541ab80 1 -- 172.21.15.8:0/3083986166 shutdown_connections 2023-08-11T12:25:34.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.076+0000 7f022541ab80 1 --2- 172.21.15.8:0/3083986166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638b425c310 0x5638b425c6f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.076+0000 7f022541ab80 1 --2- 172.21.15.8:0/3083986166 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5638b4256e20 0x5638b4257260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.076+0000 7f022541ab80 1 --2- 172.21.15.8:0/3083986166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638b425cc30 0x5638b42568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.076+0000 7f022541ab80 1 -- 172.21.15.8:0/3083986166 >> 172.21.15.8:0/3083986166 conn(0x5638b4183950 msgr2=0x5638b42513d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:34.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.076+0000 7f022541ab80 1 -- 172.21.15.8:0/3083986166 shutdown_connections 2023-08-11T12:25:34.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.076+0000 7f022541ab80 1 -- 172.21.15.8:0/3083986166 wait complete. 2023-08-11T12:25:34.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.076+0000 7f020affd700 1 --2- 172.21.15.8:0/569783503 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f01f40a01e0 0x7f01f40a26a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0c9180 tx=0x7f01fc0cf750 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:34.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.076+0000 7f022541ab80 1 -- start start 2023-08-11T12:25:34.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.077+0000 7f022541ab80 1 Processor -- start 2023-08-11T12:25:34.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.077+0000 7f022541ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638b4256e20 0x5638b4262bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:34.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.077+0000 7f022541ab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638b425c310 0x5638b425fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:34.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.077+0000 7f022541ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5638b425cc30 0x5638b42604b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:34.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.077+0000 7f022541ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638b4146ac0 con 0x5638b425cc30 2023-08-11T12:25:34.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.077+0000 7f022541ab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638b41467c0 con 0x5638b425c310 2023-08-11T12:25:34.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.077+0000 7f022541ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638b402a920 con 0x5638b4256e20 2023-08-11T12:25:34.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.077+0000 7f022541ab80 10 client.0 _ll_register_callbacks cb 0x5638b4149ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:25:34.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.077+0000 7f020a7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638b425c310 0x5638b425fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:34.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.077+0000 7f020b7fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638b4256e20 0x5638b4262bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:34.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.077+0000 7f020a7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638b425c310 0x5638b425fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:34168/0 (socket says 172.21.15.8:34168) 2023-08-11T12:25:34.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.077+0000 7f020a7fc700 1 -- 172.21.15.8:0/2205424307 learned_addr learned my addr 172.21.15.8:0/2205424307 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:34.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.078+0000 7f020b7fe700 1 --2- 172.21.15.8:0/2205424307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5638b425cc30 0x5638b42604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:34.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.078+0000 7f020a7fc700 1 -- 172.21.15.8:0/2205424307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638b4256e20 msgr2=0x5638b4262bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:34.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.078+0000 7f020a7fc700 1 --2- 172.21.15.8:0/2205424307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638b4256e20 0x5638b4262bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.078+0000 7f020a7fc700 1 -- 172.21.15.8:0/2205424307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5638b425cc30 msgr2=0x5638b42604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:34.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.078+0000 7f020a7fc700 1 --2- 172.21.15.8:0/2205424307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5638b425cc30 0x5638b42604b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.078+0000 7f020a7fc700 1 -- 172.21.15.8:0/2205424307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0204009280 con 0x5638b425c310 2023-08-11T12:25:34.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.078+0000 7f020b7fe700 1 --2- 172.21.15.8:0/2205424307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5638b425cc30 0x5638b42604b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:25:34.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.078+0000 7f020a7fc700 1 --2- 172.21.15.8:0/2205424307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638b425c310 0x5638b425fe80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0200015000 tx=0x7f020000bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b16b83a34d8f6ea server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:34.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.078+0000 7f01eaffd700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:25:34.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.078+0000 7f01eaffd700 1 -- 172.21.15.8:0/2205424307 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020001d030 con 0x5638b425c310 2023-08-11T12:25:34.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.078+0000 7f022541ab80 1 -- 172.21.15.8:0/2205424307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5638b4249a90 con 0x5638b425c310 2023-08-11T12:25:34.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.078+0000 7f01eaffd700 1 -- 172.21.15.8:0/2205424307 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f0200004500 con 0x5638b425c310 2023-08-11T12:25:34.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.079+0000 7f01eaffd700 1 -- 172.21.15.8:0/2205424307 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02000046c0 con 0x5638b425c310 2023-08-11T12:25:34.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.079+0000 7f022541ab80 10 client.26021 fetch_fsmap learned FSMap version 32 2023-08-11T12:25:34.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.079+0000 7f022541ab80 1 -- 172.21.15.8:0/2205424307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5638b3fd4de0 con 0x5638b425c310 2023-08-11T12:25:34.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.079+0000 7f01eaffd700 1 -- 172.21.15.8:0/2205424307 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5638b4249a90 con 0x5638b425c310 2023-08-11T12:25:34.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.079+0000 7f01eaffd700 1 -- 172.21.15.8:0/2205424307 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 32) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f020000f7c0 con 0x5638b425c310 2023-08-11T12:25:34.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.079+0000 7f022541ab80 10 client.26021 fetch_fsmap finished waiting for FSMap version 32 2023-08-11T12:25:34.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.079+0000 7f022541ab80 10 client.26021 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:25:34.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.079+0000 7f022541ab80 20 client.26021 populate_metadata read hostname 'smithi008' 2023-08-11T12:25:34.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.079+0000 7f022541ab80 1 --2- 172.21.15.8:0/2205424307 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5638b42705b0 0x5638b42729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:34.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.079+0000 7f022541ab80 4 client.26021 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:25:34.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.079+0000 7f022541ab80 1 -- 172.21.15.8:0/2205424307 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5638b42254e0 con 0x5638b42705b0 2023-08-11T12:25:34.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.080+0000 7f020b7fe700 1 --2- 172.21.15.8:0/2205424307 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5638b42705b0 0x5638b42729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:34.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.080+0000 7f020b7fe700 1 --2- 172.21.15.8:0/2205424307 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5638b42705b0 0x5638b42729d0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfac360da773ede9 server_cookie=747e04bba8db106f in_seq=0 out_seq=0 2023-08-11T12:25:34.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.080+0000 7f01eaffd700 10 client.26021 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:34.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.081+0000 7f01eaffd700 1 -- 172.21.15.8:0/2205424307 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5638b42254e0 con 0x5638b42705b0 2023-08-11T12:25:34.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.081+0000 7f01eaffd700 10 client.26021 handle_command_reply: tid=0 2023-08-11T12:25:34.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.081+0000 7f022541ab80 1 client.26021 shutdown 2023-08-11T12:25:34.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.081+0000 7f022541ab80 1 -- 172.21.15.8:0/2205424307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638b425c310 msgr2=0x5638b425fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:34.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.081+0000 7f022541ab80 1 --2- 172.21.15.8:0/2205424307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638b425c310 0x5638b425fe80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0200015000 tx=0x7f020000bf60 comp rx=0 tx=0).stop 2023-08-11T12:25:34.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.081+0000 7f022541ab80 1 -- 172.21.15.8:0/2205424307 shutdown_connections 2023-08-11T12:25:34.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.081+0000 7f022541ab80 1 --2- 172.21.15.8:0/2205424307 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5638b42705b0 0x5638b42729d0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.081+0000 7f022541ab80 1 --2- 172.21.15.8:0/2205424307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638b4256e20 0x5638b4262bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.081+0000 7f022541ab80 1 --2- 172.21.15.8:0/2205424307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5638b425cc30 0x5638b42604b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.081+0000 7f01eaffd700 0 client.26021 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:34.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.081+0000 7f022541ab80 1 --2- 172.21.15.8:0/2205424307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638b425c310 0x5638b425fe80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.081+0000 7f022541ab80 1 -- 172.21.15.8:0/2205424307 >> 172.21.15.8:0/2205424307 conn(0x5638b4183950 msgr2=0x5638b424bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:34.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.081+0000 7f022541ab80 1 -- 172.21.15.8:0/2205424307 shutdown_connections 2023-08-11T12:25:34.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.081+0000 7f022541ab80 1 -- 172.21.15.8:0/2205424307 wait complete. 2023-08-11T12:25:34.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.082+0000 7f022541ab80 20 client.26021 trim_cache size 0 max 16384 2023-08-11T12:25:34.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.099+0000 7f022541ab80 1 Processor -- start 2023-08-11T12:25:34.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.099+0000 7f022541ab80 1 -- start start 2023-08-11T12:25:34.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.100+0000 7f022541ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5638b4256e20 0x5638b42568e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:34.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.100+0000 7f022541ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638b425c310 0x5638b4267580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:34.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.100+0000 7f022541ab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638b425cc30 0x5638b425f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:34.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.100+0000 7f022541ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638b425fce0 con 0x5638b4256e20 2023-08-11T12:25:34.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.100+0000 7f022541ab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638b4249aa0 con 0x5638b425cc30 2023-08-11T12:25:34.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.100+0000 7f022541ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638b4260b10 con 0x5638b425c310 2023-08-11T12:25:34.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.100+0000 7f020b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5638b4256e20 0x5638b42568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:34.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.100+0000 7f020b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5638b4256e20 0x5638b42568e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39826/0 (socket says 172.21.15.8:39826) 2023-08-11T12:25:34.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.100+0000 7f020b7fe700 1 -- 172.21.15.8:0/1050158947 learned_addr learned my addr 172.21.15.8:0/1050158947 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:34.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.100+0000 7f020a7fc700 1 --2- 172.21.15.8:0/1050158947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638b425c310 0x5638b4267580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:34.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.100+0000 7f020b7fe700 1 --2- 172.21.15.8:0/1050158947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638b425cc30 0x5638b425f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:34.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.101+0000 7f020b7fe700 1 -- 172.21.15.8:0/1050158947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638b425c310 msgr2=0x5638b4267580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:34.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.101+0000 7f020b7fe700 1 --2- 172.21.15.8:0/1050158947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638b425c310 0x5638b4267580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.101+0000 7f020b7fe700 1 -- 172.21.15.8:0/1050158947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638b425cc30 msgr2=0x5638b425f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:34.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.101+0000 7f020b7fe700 1 --2- 172.21.15.8:0/1050158947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638b425cc30 0x5638b425f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.101+0000 7f020b7fe700 1 -- 172.21.15.8:0/1050158947 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638b3fbdc60 con 0x5638b4256e20 2023-08-11T12:25:34.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.101+0000 7f020a7fc700 1 --2- 172.21.15.8:0/1050158947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638b425c310 0x5638b4267580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:34.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.101+0000 7f020b7fe700 1 --2- 172.21.15.8:0/1050158947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5638b4256e20 0x5638b42568e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0204009ef0 tx=0x7f0204007e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce16acd5ad029a19 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:34.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.101+0000 7f01f27fc700 1 -- 172.21.15.8:0/1050158947 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020400e040 con 0x5638b4256e20 2023-08-11T12:25:34.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.101+0000 7f01f27fc700 1 -- 172.21.15.8:0/1050158947 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0204004b50 con 0x5638b4256e20 2023-08-11T12:25:34.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.101+0000 7f01f27fc700 1 -- 172.21.15.8:0/1050158947 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0204015ad0 con 0x5638b4256e20 2023-08-11T12:25:34.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.102+0000 7f022541ab80 1 -- 172.21.15.8:0/1050158947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5638b4256e20 msgr2=0x5638b42568e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:34.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.102+0000 7f022541ab80 1 --2- 172.21.15.8:0/1050158947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5638b4256e20 0x5638b42568e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0204009ef0 tx=0x7f0204007e70 comp rx=0 tx=0).stop 2023-08-11T12:25:34.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.102+0000 7f022541ab80 1 -- 172.21.15.8:0/1050158947 shutdown_connections 2023-08-11T12:25:34.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.102+0000 7f022541ab80 1 --2- 172.21.15.8:0/1050158947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638b425cc30 0x5638b425f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.102+0000 7f022541ab80 1 --2- 172.21.15.8:0/1050158947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5638b4256e20 0x5638b42568e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.102+0000 7f022541ab80 1 --2- 172.21.15.8:0/1050158947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638b425c310 0x5638b4267580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.102+0000 7f022541ab80 1 -- 172.21.15.8:0/1050158947 >> 172.21.15.8:0/1050158947 conn(0x5638b4183950 msgr2=0x5638b425a100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:34.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.102+0000 7f022541ab80 1 -- 172.21.15.8:0/1050158947 shutdown_connections 2023-08-11T12:25:34.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.102+0000 7f022541ab80 1 -- 172.21.15.8:0/1050158947 wait complete. 2023-08-11T12:25:34.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.103+0000 7f022541ab80 1 -- start start 2023-08-11T12:25:34.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.103+0000 7f022541ab80 1 Processor -- start 2023-08-11T12:25:34.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.104+0000 7f022541ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5638b4256e20 0x5638b4267550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:34.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.104+0000 7f022541ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638b425c310 0x5638b42659a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:34.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.104+0000 7f022541ab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638b425cc30 0x5638b42660e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:34.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.104+0000 7f022541ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638b4266780 con 0x5638b4256e20 2023-08-11T12:25:34.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.104+0000 7f022541ab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638b42c4230 con 0x5638b425cc30 2023-08-11T12:25:34.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.104+0000 7f022541ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638b42c4370 con 0x5638b425c310 2023-08-11T12:25:34.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.104+0000 7f022541ab80 10 client.0 _ll_register_callbacks cb 0x7f0200009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:25:34.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.104+0000 7f020a7fc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638b425c310 0x5638b42659a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:34.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.104+0000 7f020b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5638b4256e20 0x5638b4267550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:34.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.104+0000 7f020a7fc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638b425c310 0x5638b42659a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:55772/0 (socket says 172.21.15.8:55772) 2023-08-11T12:25:34.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.104+0000 7f020a7fc700 1 -- 172.21.15.8:0/2667083418 learned_addr learned my addr 172.21.15.8:0/2667083418 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:34.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.104+0000 7f020b7fe700 1 --2- 172.21.15.8:0/2667083418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638b425cc30 0x5638b42660e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:34.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.105+0000 7f020a7fc700 1 -- 172.21.15.8:0/2667083418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638b425cc30 msgr2=0x5638b42660e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:34.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.105+0000 7f020a7fc700 1 --2- 172.21.15.8:0/2667083418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638b425cc30 0x5638b42660e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.105+0000 7f020a7fc700 1 -- 172.21.15.8:0/2667083418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5638b4256e20 msgr2=0x5638b4267550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:34.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.105+0000 7f020a7fc700 1 --2- 172.21.15.8:0/2667083418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5638b4256e20 0x5638b4267550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.105+0000 7f020a7fc700 1 -- 172.21.15.8:0/2667083418 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5638b3fd4de0 con 0x5638b425c310 2023-08-11T12:25:34.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.105+0000 7f020a7fc700 1 --2- 172.21.15.8:0/2667083418 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638b425c310 0x5638b42659a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f020000bbc0 tx=0x7f0200005f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffd25c3f18070167 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:34.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.105+0000 7f01eaffd700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:25:34.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.105+0000 7f01eaffd700 1 -- 172.21.15.8:0/2667083418 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020001d040 con 0x5638b425c310 2023-08-11T12:25:34.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.105+0000 7f01eaffd700 1 -- 172.21.15.8:0/2667083418 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f020000f660 con 0x5638b425c310 2023-08-11T12:25:34.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.105+0000 7f022541ab80 1 -- 172.21.15.8:0/2667083418 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f020400f040 con 0x5638b425c310 2023-08-11T12:25:34.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.105+0000 7f01eaffd700 1 -- 172.21.15.8:0/2667083418 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f020000b2e0 con 0x5638b425c310 2023-08-11T12:25:34.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.105+0000 7f022541ab80 10 client.26044 fetch_fsmap learned FSMap version 32 2023-08-11T12:25:34.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.105+0000 7f022541ab80 1 -- 172.21.15.8:0/2667083418 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f0204015e70 con 0x5638b425c310 2023-08-11T12:25:34.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.106+0000 7f01eaffd700 1 -- 172.21.15.8:0/2667083418 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f020400f040 con 0x5638b425c310 2023-08-11T12:25:34.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.106+0000 7f01eaffd700 1 -- 172.21.15.8:0/2667083418 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 32) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f02000099c0 con 0x5638b425c310 2023-08-11T12:25:34.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.106+0000 7f022541ab80 10 client.26044 fetch_fsmap finished waiting for FSMap version 32 2023-08-11T12:25:34.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.106+0000 7f022541ab80 10 client.26044 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:25:34.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.106+0000 7f022541ab80 20 client.26044 populate_metadata read hostname 'smithi008' 2023-08-11T12:25:34.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.106+0000 7f022541ab80 1 --2- 172.21.15.8:0/2667083418 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5638b42c55f0 0x5638b42c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:34.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.106+0000 7f022541ab80 4 client.26044 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:25:34.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.106+0000 7f022541ab80 1 -- 172.21.15.8:0/2667083418 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5638b41a1820 con 0x5638b42c55f0 2023-08-11T12:25:34.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.106+0000 7f020b7fe700 1 --2- 172.21.15.8:0/2667083418 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5638b42c55f0 0x5638b42c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:34.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.107+0000 7f020b7fe700 1 --2- 172.21.15.8:0/2667083418 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5638b42c55f0 0x5638b42c7a10 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6011a1f4cafa98f6 server_cookie=a5d95a11a9edb4de in_seq=0 out_seq=0 2023-08-11T12:25:34.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.107+0000 7f01eaffd700 10 client.26044 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:34.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.107+0000 7f01eaffd700 1 -- 172.21.15.8:0/2667083418 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5638b41a1820 con 0x5638b42c55f0 2023-08-11T12:25:34.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.107+0000 7f01eaffd700 10 client.26044 handle_command_reply: tid=0 2023-08-11T12:25:34.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.107+0000 7f022541ab80 1 client.26044 shutdown 2023-08-11T12:25:34.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.107+0000 7f022541ab80 1 -- 172.21.15.8:0/2667083418 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638b425c310 msgr2=0x5638b42659a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:34.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.107+0000 7f022541ab80 1 --2- 172.21.15.8:0/2667083418 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638b425c310 0x5638b42659a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f020000bbc0 tx=0x7f0200005f00 comp rx=0 tx=0).stop 2023-08-11T12:25:34.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.107+0000 7f022541ab80 1 -- 172.21.15.8:0/2667083418 shutdown_connections 2023-08-11T12:25:34.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.107+0000 7f022541ab80 1 --2- 172.21.15.8:0/2667083418 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5638b42c55f0 0x5638b42c7a10 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.107+0000 7f022541ab80 1 --2- 172.21.15.8:0/2667083418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638b425cc30 0x5638b42660e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.107+0000 7f01eaffd700 0 client.26044 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:34.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.107+0000 7f022541ab80 1 --2- 172.21.15.8:0/2667083418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5638b4256e20 0x5638b4267550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.107+0000 7f022541ab80 1 --2- 172.21.15.8:0/2667083418 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638b425c310 0x5638b42659a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.107+0000 7f022541ab80 1 -- 172.21.15.8:0/2667083418 >> 172.21.15.8:0/2667083418 conn(0x5638b4183950 msgr2=0x5638b425b050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:34.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.107+0000 7f022541ab80 1 -- 172.21.15.8:0/2667083418 shutdown_connections 2023-08-11T12:25:34.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.107+0000 7f022541ab80 1 -- 172.21.15.8:0/2667083418 wait complete. 2023-08-11T12:25:34.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.108+0000 7f022541ab80 20 client.26044 trim_cache size 0 max 16384 2023-08-11T12:25:34.118 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:25:34.118 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (2 inodes in the stack)", 2023-08-11T12:25:34.118 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:25:34.118 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:25:34.119 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:25:34.119 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:25:34.119 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:25:34.119 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:25:34.119 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:25:34.119 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:25:34.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.108+0000 7f02119ff700 1 -- 172.21.15.8:0/569783503 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f01f40a01e0 msgr2=0x7f01f40a26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:34.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.108+0000 7f02119ff700 1 --2- 172.21.15.8:0/569783503 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f01f40a01e0 0x7f01f40a26a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0c9180 tx=0x7f01fc0cf750 comp rx=0 tx=0).stop 2023-08-11T12:25:34.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.108+0000 7f02119ff700 1 -- 172.21.15.8:0/569783503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f020c100960 msgr2=0x7f020c19c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:34.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.108+0000 7f02119ff700 1 --2- 172.21.15.8:0/569783503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f020c100960 0x7f020c19c800 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00e9a0 tx=0x7f01fc00ecb0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.108+0000 7f02119ff700 1 -- 172.21.15.8:0/569783503 shutdown_connections 2023-08-11T12:25:34.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.108+0000 7f02119ff700 1 --2- 172.21.15.8:0/569783503 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f01f40a01e0 0x7f01f40a26a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.108+0000 7f02119ff700 1 --2- 172.21.15.8:0/569783503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f020c106970 0x7f020c196870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.108+0000 7f02119ff700 1 --2- 172.21.15.8:0/569783503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f020c100960 0x7f020c19c800 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.108+0000 7f02119ff700 1 --2- 172.21.15.8:0/569783503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f020c101320 0x7f020c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:34.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.108+0000 7f02119ff700 1 -- 172.21.15.8:0/569783503 >> 172.21.15.8:0/569783503 conn(0x7f020c0fc490 msgr2=0x7f020c0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:34.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.109+0000 7f02119ff700 1 -- 172.21.15.8:0/569783503 shutdown_connections 2023-08-11T12:25:34.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:25:34.109+0000 7f02119ff700 1 -- 172.21.15.8:0/569783503 wait complete. 2023-08-11T12:25:34.122 INFO:teuthology.orchestra.run.smithi008.stderr:9400000 of 50000000 tuples (18%) done (elapsed 38.81 s, remaining 167.61 s) 2023-08-11T12:25:34.128 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:25:34.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:33 smithi194 ceph-mon[130905]: scrub summary: active paths [/] 2023-08-11T12:25:34.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:33 smithi194 ceph-mon[130905]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:25:34.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:33 smithi045 ceph-mon[130284]: scrub summary: active paths [/] 2023-08-11T12:25:34.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:33 smithi045 ceph-mon[130284]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:25:34.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:33 smithi008 ceph-mon[97158]: scrub summary: active paths [/] 2023-08-11T12:25:34.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:33 smithi008 ceph-mon[97158]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:25:34.347 INFO:teuthology.orchestra.run.smithi008.stderr:9500000 of 50000000 tuples (19%) done (elapsed 39.03 s, remaining 166.41 s) 2023-08-11T12:25:34.638 INFO:teuthology.orchestra.run.smithi008.stderr:9600000 of 50000000 tuples (19%) done (elapsed 39.32 s, remaining 165.49 s) 2023-08-11T12:25:34.978 INFO:teuthology.orchestra.run.smithi008.stderr:9700000 of 50000000 tuples (19%) done (elapsed 39.66 s, remaining 164.79 s) 2023-08-11T12:25:35.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:34 smithi194 ceph-mon[130905]: pgmap v32: 129 pgs: 129 active+clean; 1.7 GiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 132 MiB/s wr, 73 op/s 2023-08-11T12:25:35.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:34 smithi194 ceph-mon[130905]: scrub queued for path: / 2023-08-11T12:25:35.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:34 smithi194 ceph-mon[130905]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:35.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:34 smithi194 ceph-mon[130905]: scrub summary: active paths [/] 2023-08-11T12:25:35.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:34 smithi194 ceph-mon[130905]: scrub summary: active paths [/] 2023-08-11T12:25:35.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:34 smithi194 ceph-mon[130905]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:35.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:34 smithi194 ceph-mon[130905]: scrub summary: active paths [/] 2023-08-11T12:25:35.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:34 smithi194 ceph-mon[130905]: scrub summary: active paths [/] 2023-08-11T12:25:35.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:34 smithi194 ceph-mon[130905]: scrub summary: active paths [/] 2023-08-11T12:25:35.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:34 smithi194 ceph-mon[130905]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:35.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:34 smithi194 ceph-mon[130905]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:35.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:34 smithi194 ceph-mon[130905]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:35.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:34 smithi194 ceph-mon[130905]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:35.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:34 smithi045 ceph-mon[130284]: pgmap v32: 129 pgs: 129 active+clean; 1.7 GiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 132 MiB/s wr, 73 op/s 2023-08-11T12:25:35.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:34 smithi045 ceph-mon[130284]: scrub queued for path: / 2023-08-11T12:25:35.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:34 smithi045 ceph-mon[130284]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:35.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:34 smithi045 ceph-mon[130284]: scrub summary: active paths [/] 2023-08-11T12:25:35.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:34 smithi045 ceph-mon[130284]: scrub summary: active paths [/] 2023-08-11T12:25:35.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:34 smithi045 ceph-mon[130284]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:35.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:34 smithi045 ceph-mon[130284]: scrub summary: active paths [/] 2023-08-11T12:25:35.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:34 smithi045 ceph-mon[130284]: scrub summary: active paths [/] 2023-08-11T12:25:35.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:34 smithi045 ceph-mon[130284]: scrub summary: active paths [/] 2023-08-11T12:25:35.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:34 smithi045 ceph-mon[130284]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:35.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:34 smithi045 ceph-mon[130284]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:35.147 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:34 smithi045 ceph-mon[130284]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:35.148 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:34 smithi045 ceph-mon[130284]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:35.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:34 smithi008 ceph-mon[97158]: pgmap v32: 129 pgs: 129 active+clean; 1.7 GiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 132 MiB/s wr, 73 op/s 2023-08-11T12:25:35.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:34 smithi008 ceph-mon[97158]: scrub queued for path: / 2023-08-11T12:25:35.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:34 smithi008 ceph-mon[97158]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:35.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:34 smithi008 ceph-mon[97158]: scrub summary: active paths [/] 2023-08-11T12:25:35.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:34 smithi008 ceph-mon[97158]: scrub summary: active paths [/] 2023-08-11T12:25:35.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:34 smithi008 ceph-mon[97158]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:35.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:34 smithi008 ceph-mon[97158]: scrub summary: active paths [/] 2023-08-11T12:25:35.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:34 smithi008 ceph-mon[97158]: scrub summary: active paths [/] 2023-08-11T12:25:35.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:34 smithi008 ceph-mon[97158]: scrub summary: active paths [/] 2023-08-11T12:25:35.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:34 smithi008 ceph-mon[97158]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:35.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:34 smithi008 ceph-mon[97158]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:35.307 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:34 smithi008 ceph-mon[97158]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:35.307 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:34 smithi008 ceph-mon[97158]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:35.468 INFO:teuthology.orchestra.run.smithi008.stderr:9800000 of 50000000 tuples (19%) done (elapsed 40.15 s, remaining 164.72 s) 2023-08-11T12:25:36.079 INFO:teuthology.orchestra.run.smithi008.stderr:9900000 of 50000000 tuples (19%) done (elapsed 40.76 s, remaining 165.12 s) 2023-08-11T12:25:36.840 INFO:teuthology.orchestra.run.smithi008.stderr:10000000 of 50000000 tuples (20%) done (elapsed 41.53 s, remaining 166.11 s) 2023-08-11T12:25:36.987 INFO:teuthology.orchestra.run.smithi008.stderr:10100000 of 50000000 tuples (20%) done (elapsed 41.67 s, remaining 164.63 s) 2023-08-11T12:25:37.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:36 smithi194 ceph-mon[130905]: pgmap v33: 129 pgs: 129 active+clean; 1.7 GiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 119 MiB/s wr, 62 op/s 2023-08-11T12:25:37.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:36 smithi045 ceph-mon[130284]: pgmap v33: 129 pgs: 129 active+clean; 1.7 GiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 119 MiB/s wr, 62 op/s 2023-08-11T12:25:37.188 INFO:teuthology.orchestra.run.smithi008.stderr:10200000 of 50000000 tuples (20%) done (elapsed 41.88 s, remaining 163.40 s) 2023-08-11T12:25:37.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:36 smithi008 ceph-mon[97158]: pgmap v33: 129 pgs: 129 active+clean; 1.7 GiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 119 MiB/s wr, 62 op/s 2023-08-11T12:25:37.367 INFO:teuthology.orchestra.run.smithi008.stderr:10300000 of 50000000 tuples (20%) done (elapsed 42.05 s, remaining 162.09 s) 2023-08-11T12:25:37.556 INFO:teuthology.orchestra.run.smithi008.stderr:10400000 of 50000000 tuples (20%) done (elapsed 42.24 s, remaining 160.85 s) 2023-08-11T12:25:37.690 INFO:teuthology.orchestra.run.smithi008.stderr:10500000 of 50000000 tuples (21%) done (elapsed 42.38 s, remaining 159.42 s) 2023-08-11T12:25:37.894 INFO:teuthology.orchestra.run.smithi008.stderr:10600000 of 50000000 tuples (21%) done (elapsed 42.58 s, remaining 158.27 s) 2023-08-11T12:25:38.118 INFO:teuthology.orchestra.run.smithi008.stderr:10700000 of 50000000 tuples (21%) done (elapsed 42.81 s, remaining 157.22 s) 2023-08-11T12:25:38.282 INFO:teuthology.orchestra.run.smithi008.stderr:10800000 of 50000000 tuples (21%) done (elapsed 42.97 s, remaining 155.96 s) 2023-08-11T12:25:38.444 INFO:teuthology.orchestra.run.smithi008.stderr:10900000 of 50000000 tuples (21%) done (elapsed 43.13 s, remaining 154.72 s) 2023-08-11T12:25:38.665 INFO:teuthology.orchestra.run.smithi008.stderr:11000000 of 50000000 tuples (22%) done (elapsed 43.35 s, remaining 153.70 s) 2023-08-11T12:25:38.857 INFO:teuthology.orchestra.run.smithi008.stderr:11100000 of 50000000 tuples (22%) done (elapsed 43.54 s, remaining 152.60 s) 2023-08-11T12:25:39.058 INFO:teuthology.orchestra.run.smithi008.stderr:11200000 of 50000000 tuples (22%) done (elapsed 43.75 s, remaining 151.55 s) 2023-08-11T12:25:39.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:38 smithi194 ceph-mon[130905]: pgmap v34: 129 pgs: 129 active+clean; 2.3 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 179 MiB/s wr, 147 op/s 2023-08-11T12:25:39.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:38 smithi045 ceph-mon[130284]: pgmap v34: 129 pgs: 129 active+clean; 2.3 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 179 MiB/s wr, 147 op/s 2023-08-11T12:25:39.194 INFO:teuthology.orchestra.run.smithi008.stderr:11300000 of 50000000 tuples (22%) done (elapsed 43.88 s, remaining 150.28 s) 2023-08-11T12:25:39.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:38 smithi008 ceph-mon[97158]: pgmap v34: 129 pgs: 129 active+clean; 2.3 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 179 MiB/s wr, 147 op/s 2023-08-11T12:25:39.420 INFO:teuthology.orchestra.run.smithi008.stderr:11400000 of 50000000 tuples (22%) done (elapsed 44.11 s, remaining 149.35 s) 2023-08-11T12:25:39.610 INFO:teuthology.orchestra.run.smithi008.stderr:11500000 of 50000000 tuples (23%) done (elapsed 44.30 s, remaining 148.30 s) 2023-08-11T12:25:39.858 INFO:teuthology.orchestra.run.smithi008.stderr:11600000 of 50000000 tuples (23%) done (elapsed 44.54 s, remaining 147.46 s) 2023-08-11T12:25:39.968 INFO:teuthology.orchestra.run.smithi008.stderr:11700000 of 50000000 tuples (23%) done (elapsed 44.66 s, remaining 146.18 s) 2023-08-11T12:25:40.191 INFO:teuthology.orchestra.run.smithi008.stderr:11800000 of 50000000 tuples (23%) done (elapsed 44.88 s, remaining 145.28 s) 2023-08-11T12:25:40.394 INFO:teuthology.orchestra.run.smithi008.stderr:11900000 of 50000000 tuples (23%) done (elapsed 45.08 s, remaining 144.34 s) 2023-08-11T12:25:40.603 INFO:teuthology.orchestra.run.smithi008.stderr:12000000 of 50000000 tuples (24%) done (elapsed 45.29 s, remaining 143.42 s) 2023-08-11T12:25:40.831 INFO:teuthology.orchestra.run.smithi008.stderr:12100000 of 50000000 tuples (24%) done (elapsed 45.52 s, remaining 142.57 s) 2023-08-11T12:25:40.983 INFO:teuthology.orchestra.run.smithi008.stderr:12200000 of 50000000 tuples (24%) done (elapsed 45.67 s, remaining 141.50 s) 2023-08-11T12:25:41.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:40 smithi008 ceph-mon[97158]: pgmap v35: 129 pgs: 129 active+clean; 2.3 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 89 MiB/s wr, 107 op/s 2023-08-11T12:25:41.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:40 smithi194 ceph-mon[130905]: pgmap v35: 129 pgs: 129 active+clean; 2.3 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 89 MiB/s wr, 107 op/s 2023-08-11T12:25:41.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:40 smithi045 ceph-mon[130284]: pgmap v35: 129 pgs: 129 active+clean; 2.3 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 89 MiB/s wr, 107 op/s 2023-08-11T12:25:41.169 INFO:teuthology.orchestra.run.smithi008.stderr:12300000 of 50000000 tuples (24%) done (elapsed 45.86 s, remaining 140.55 s) 2023-08-11T12:25:41.374 INFO:teuthology.orchestra.run.smithi008.stderr:12400000 of 50000000 tuples (24%) done (elapsed 46.06 s, remaining 139.67 s) 2023-08-11T12:25:41.578 INFO:teuthology.orchestra.run.smithi008.stderr:12500000 of 50000000 tuples (25%) done (elapsed 46.27 s, remaining 138.80 s) 2023-08-11T12:25:41.756 INFO:teuthology.orchestra.run.smithi008.stderr:12600000 of 50000000 tuples (25%) done (elapsed 46.44 s, remaining 137.86 s) 2023-08-11T12:25:41.890 INFO:teuthology.orchestra.run.smithi008.stderr:12700000 of 50000000 tuples (25%) done (elapsed 46.58 s, remaining 136.80 s) 2023-08-11T12:25:42.111 INFO:teuthology.orchestra.run.smithi008.stderr:12800000 of 50000000 tuples (25%) done (elapsed 46.80 s, remaining 136.01 s) 2023-08-11T12:25:42.283 INFO:teuthology.orchestra.run.smithi008.stderr:12900000 of 50000000 tuples (25%) done (elapsed 46.97 s, remaining 135.09 s) 2023-08-11T12:25:42.520 INFO:teuthology.orchestra.run.smithi008.stderr:13000000 of 50000000 tuples (26%) done (elapsed 47.21 s, remaining 134.36 s) 2023-08-11T12:25:42.636 INFO:teuthology.orchestra.run.smithi008.stderr:13100000 of 50000000 tuples (26%) done (elapsed 47.32 s, remaining 133.30 s) 2023-08-11T12:25:42.851 INFO:teuthology.orchestra.run.smithi008.stderr:13200000 of 50000000 tuples (26%) done (elapsed 47.54 s, remaining 132.53 s) 2023-08-11T12:25:43.038 INFO:teuthology.orchestra.run.smithi008.stderr:13300000 of 50000000 tuples (26%) done (elapsed 47.72 s, remaining 131.69 s) 2023-08-11T12:25:43.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:42 smithi194 ceph-mon[130905]: pgmap v36: 129 pgs: 129 active+clean; 2.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 111 MiB/s wr, 127 op/s 2023-08-11T12:25:43.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:42 smithi045 ceph-mon[130284]: pgmap v36: 129 pgs: 129 active+clean; 2.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 111 MiB/s wr, 127 op/s 2023-08-11T12:25:43.204 INFO:teuthology.orchestra.run.smithi008.stderr:13400000 of 50000000 tuples (26%) done (elapsed 47.89 s, remaining 130.81 s) 2023-08-11T12:25:43.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:42 smithi008 ceph-mon[97158]: pgmap v36: 129 pgs: 129 active+clean; 2.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 111 MiB/s wr, 127 op/s 2023-08-11T12:25:43.352 INFO:teuthology.orchestra.run.smithi008.stderr:13500000 of 50000000 tuples (27%) done (elapsed 48.04 s, remaining 129.88 s) 2023-08-11T12:25:43.582 INFO:teuthology.orchestra.run.smithi008.stderr:13600000 of 50000000 tuples (27%) done (elapsed 48.27 s, remaining 129.19 s) 2023-08-11T12:25:43.765 INFO:teuthology.orchestra.run.smithi008.stderr:13700000 of 50000000 tuples (27%) done (elapsed 48.45 s, remaining 128.38 s) 2023-08-11T12:25:44.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:43 smithi194 ceph-mon[130905]: scrub summary: active paths [/] 2023-08-11T12:25:44.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:43 smithi194 ceph-mon[130905]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:44.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:43 smithi045 ceph-mon[130284]: scrub summary: active paths [/] 2023-08-11T12:25:44.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:43 smithi045 ceph-mon[130284]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:44.157 INFO:teuthology.orchestra.run.smithi008.stderr:13800000 of 50000000 tuples (27%) done (elapsed 48.84 s, remaining 128.13 s) 2023-08-11T12:25:44.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:43 smithi008 ceph-mon[97158]: scrub summary: active paths [/] 2023-08-11T12:25:44.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:43 smithi008 ceph-mon[97158]: scrub summary: idle+waiting paths [/] 2023-08-11T12:25:44.829 INFO:teuthology.orchestra.run.smithi008.stderr:13900000 of 50000000 tuples (27%) done (elapsed 49.52 s, remaining 128.60 s) 2023-08-11T12:25:44.982 INFO:teuthology.orchestra.run.smithi008.stderr:14000000 of 50000000 tuples (28%) done (elapsed 49.67 s, remaining 127.72 s) 2023-08-11T12:25:45.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:44 smithi194 ceph-mon[130905]: pgmap v37: 129 pgs: 129 active+clean; 2.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 95 MiB/s wr, 111 op/s 2023-08-11T12:25:45.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:44 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:25:45.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:44 smithi045 ceph-mon[130284]: pgmap v37: 129 pgs: 129 active+clean; 2.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 95 MiB/s wr, 111 op/s 2023-08-11T12:25:45.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:44 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:25:45.327 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:44 smithi008 ceph-mon[97158]: pgmap v37: 129 pgs: 129 active+clean; 2.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 95 MiB/s wr, 111 op/s 2023-08-11T12:25:45.327 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:44 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:25:45.405 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.401+0000 7fe3347ff700 1 -- 172.21.15.8:0/221149493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe32c10f020 msgr2=0x7fe32c10cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:45.405 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.401+0000 7fe3347ff700 1 --2- 172.21.15.8:0/221149493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe32c10f020 0x7fe32c10cde0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe328009990 tx=0x7fe328009ca0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.406 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.403+0000 7fe3347ff700 1 -- 172.21.15.8:0/221149493 shutdown_connections 2023-08-11T12:25:45.406 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.403+0000 7fe3347ff700 1 --2- 172.21.15.8:0/221149493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe32c10f020 0x7fe32c10cde0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.406 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.403+0000 7fe3347ff700 1 --2- 172.21.15.8:0/221149493 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe32c107920 0x7fe32c107dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.406 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.403+0000 7fe3347ff700 1 --2- 172.21.15.8:0/221149493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe32c10f490 0x7fe32c10d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.406 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.403+0000 7fe3347ff700 1 -- 172.21.15.8:0/221149493 >> 172.21.15.8:0/221149493 conn(0x7fe32c06c9e0 msgr2=0x7fe32c06cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:45.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.404+0000 7fe3347ff700 1 -- 172.21.15.8:0/221149493 shutdown_connections 2023-08-11T12:25:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.413+0000 7fe3347ff700 1 -- 172.21.15.8:0/221149493 wait complete. 2023-08-11T12:25:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.414+0000 7fe3347ff700 1 Processor -- start 2023-08-11T12:25:45.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.416+0000 7fe3347ff700 1 -- start start 2023-08-11T12:25:45.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.416+0000 7fe3347ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe32c107920 0x7fe32c11d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:45.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.416+0000 7fe3347ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe32c10f020 0x7fe32c11d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:45.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.416+0000 7fe3347ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe32c10f490 0x7fe32c116430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:45.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.416+0000 7fe3347ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c116c00 con 0x7fe32c10f490 2023-08-11T12:25:45.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.416+0000 7fe3347ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c116d70 con 0x7fe32c107920 2023-08-11T12:25:45.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.416+0000 7fe3347ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c116f30 con 0x7fe32c10f020 2023-08-11T12:25:45.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.417+0000 7fe33259b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe32c107920 0x7fe32c11d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:45.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.417+0000 7fe33259b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe32c107920 0x7fe32c11d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:37444/0 (socket says 172.21.15.8:37444) 2023-08-11T12:25:45.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.417+0000 7fe33259b700 1 -- 172.21.15.8:0/859686245 learned_addr learned my addr 172.21.15.8:0/859686245 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:45.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.417+0000 7fe331d9a700 1 --2- 172.21.15.8:0/859686245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe32c10f020 0x7fe32c11d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:45.421 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.418+0000 7fe33259b700 1 -- 172.21.15.8:0/859686245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe32c10f020 msgr2=0x7fe32c11d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:45.421 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.418+0000 7fe33259b700 1 --2- 172.21.15.8:0/859686245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe32c10f020 0x7fe32c11d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.421 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.418+0000 7fe33259b700 1 -- 172.21.15.8:0/859686245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe32c10f490 msgr2=0x7fe32c116430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:45.421 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.418+0000 7fe33259b700 1 --2- 172.21.15.8:0/859686245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe32c10f490 0x7fe32c116430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.421 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.418+0000 7fe33259b700 1 -- 172.21.15.8:0/859686245 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3280095f0 con 0x7fe32c107920 2023-08-11T12:25:45.421 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.419+0000 7fe33259b700 1 --2- 172.21.15.8:0/859686245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe32c107920 0x7fe32c11d420 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe3280098e0 tx=0x7fe3280037c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:45.422 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.419+0000 7fe3237fe700 1 -- 172.21.15.8:0/859686245 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32801d070 con 0x7fe32c107920 2023-08-11T12:25:45.422 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.420+0000 7fe3237fe700 1 -- 172.21.15.8:0/859686245 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe328005580 con 0x7fe32c107920 2023-08-11T12:25:45.422 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.420+0000 7fe3237fe700 1 -- 172.21.15.8:0/859686245 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32800fe00 con 0x7fe32c107920 2023-08-11T12:25:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.420+0000 7fe3347ff700 1 -- 172.21.15.8:0/859686245 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32c117150 con 0x7fe32c107920 2023-08-11T12:25:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.420+0000 7fe3347ff700 1 -- 172.21.15.8:0/859686245 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32c11b190 con 0x7fe32c107920 2023-08-11T12:25:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.426+0000 7fe348032b80 1 Processor -- start 2023-08-11T12:25:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.427+0000 7fe348032b80 1 -- start start 2023-08-11T12:25:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.427+0000 7fe348032b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbe3997e80 0x55bbe3998260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:45.430 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.427+0000 7fe348032b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbe3992630 0x55bbe3992ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:45.430 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.427+0000 7fe348032b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbe3992ff0 0x55bbe399ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:45.430 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.427+0000 7fe348032b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbe38eb5d0 con 0x55bbe3997e80 2023-08-11T12:25:45.430 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.427+0000 7fe348032b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbe38e8ef0 con 0x55bbe3992ff0 2023-08-11T12:25:45.430 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.427+0000 7fe348032b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbe38e47e0 con 0x55bbe3992630 2023-08-11T12:25:45.433 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.428+0000 7fe331d9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbe3992ff0 0x55bbe399ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:45.433 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.428+0000 7fe331d9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbe3992ff0 0x55bbe399ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:37456/0 (socket says 172.21.15.8:37456) 2023-08-11T12:25:45.433 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.428+0000 7fe331d9a700 1 -- 172.21.15.8:0/2050090790 learned_addr learned my addr 172.21.15.8:0/2050090790 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:45.433 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.428+0000 7fe331d9a700 1 -- 172.21.15.8:0/2050090790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbe3992630 msgr2=0x55bbe3992ab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-11T12:25:45.433 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.428+0000 7fe331d9a700 1 --2- 172.21.15.8:0/2050090790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbe3992630 0x55bbe3992ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.433 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.428+0000 7fe331d9a700 1 -- 172.21.15.8:0/2050090790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbe3997e80 msgr2=0x55bbe3998260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.428+0000 7fe331d9a700 1 --2- 172.21.15.8:0/2050090790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbe3997e80 0x55bbe3998260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.428+0000 7fe331d9a700 1 -- 172.21.15.8:0/2050090790 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbe37645d0 con 0x55bbe3992ff0 2023-08-11T12:25:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.429+0000 7fe331d9a700 1 --2- 172.21.15.8:0/2050090790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbe3992ff0 0x55bbe399ec10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe31c009a70 tx=0x7fe31c009d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b6f7a74f9e3a29d server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.430+0000 7fe320ff9700 1 -- 172.21.15.8:0/2050090790 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c00e8d0 con 0x55bbe3992ff0 2023-08-11T12:25:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.430+0000 7fe320ff9700 1 -- 172.21.15.8:0/2050090790 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe31c013470 con 0x55bbe3992ff0 2023-08-11T12:25:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.430+0000 7fe320ff9700 1 -- 172.21.15.8:0/2050090790 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c012630 con 0x55bbe3992ff0 2023-08-11T12:25:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.431+0000 7fe3237fe700 1 -- 172.21.15.8:0/859686245 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 24) v1 ==== 134903+0+0 (secure 0 0 0) 0x7fe32800f460 con 0x7fe32c107920 2023-08-11T12:25:45.435 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.432+0000 7fe348032b80 1 -- 172.21.15.8:0/2050090790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbe3992ff0 msgr2=0x55bbe399ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:45.435 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.432+0000 7fe348032b80 1 --2- 172.21.15.8:0/2050090790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbe3992ff0 0x55bbe399ec10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe31c009a70 tx=0x7fe31c009d80 comp rx=0 tx=0).stop 2023-08-11T12:25:45.435 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.432+0000 7fe348032b80 1 -- 172.21.15.8:0/2050090790 shutdown_connections 2023-08-11T12:25:45.435 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.432+0000 7fe348032b80 1 --2- 172.21.15.8:0/2050090790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbe3992ff0 0x55bbe399ec10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.432+0000 7fe348032b80 1 --2- 172.21.15.8:0/2050090790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbe3997e80 0x55bbe3998260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.432+0000 7fe348032b80 1 --2- 172.21.15.8:0/2050090790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbe3992630 0x55bbe3992ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.432+0000 7fe348032b80 1 -- 172.21.15.8:0/2050090790 >> 172.21.15.8:0/2050090790 conn(0x55bbe38bf8f0 msgr2=0x55bbe398ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:45.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.433+0000 7fe348032b80 1 -- 172.21.15.8:0/2050090790 shutdown_connections 2023-08-11T12:25:45.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.433+0000 7fe348032b80 1 -- 172.21.15.8:0/2050090790 wait complete. 2023-08-11T12:25:45.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.434+0000 7fe348032b80 1 -- start start 2023-08-11T12:25:45.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.434+0000 7fe348032b80 1 Processor -- start 2023-08-11T12:25:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.436+0000 7fe3237fe700 1 --2- 172.21.15.8:0/859686245 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe3180a0200 0x7fe3180a26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.437+0000 7fe3237fe700 1 -- 172.21.15.8:0/859686245 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fe3280ccdc0 con 0x7fe32c107920 2023-08-11T12:25:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.438+0000 7fe348032b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbe3992630 0x55bbe39a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.438+0000 7fe348032b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbe3992ff0 0x55bbe39a20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.438+0000 7fe332d9c700 1 --2- 172.21.15.8:0/859686245 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe3180a0200 0x7fe3180a26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.438+0000 7fe348032b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbe3997e80 0x55bbe399bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.438+0000 7fe348032b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbe3882a60 con 0x55bbe3992630 2023-08-11T12:25:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.438+0000 7fe348032b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbe3882760 con 0x55bbe3992ff0 2023-08-11T12:25:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.438+0000 7fe348032b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbe37668c0 con 0x55bbe3997e80 2023-08-11T12:25:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.438+0000 7fe348032b80 10 client.0 _ll_register_callbacks cb 0x55bbe3885a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:25:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.439+0000 7fe332d9c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbe3997e80 0x55bbe399bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.439+0000 7fe332d9c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbe3997e80 0x55bbe399bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:35568/0 (socket says 172.21.15.8:35568) 2023-08-11T12:25:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.439+0000 7fe332d9c700 1 -- 172.21.15.8:0/73293281 learned_addr learned my addr 172.21.15.8:0/73293281 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.439+0000 7fe332d9c700 1 --2- 172.21.15.8:0/859686245 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe3180a0200 0x7fe3180a26c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe324007550 tx=0x7fe324007910 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.439+0000 7fe332d9c700 1 -- 172.21.15.8:0/73293281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbe3992ff0 msgr2=0x55bbe39a20c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-11T12:25:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.439+0000 7fe332d9c700 1 --2- 172.21.15.8:0/73293281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbe3992ff0 0x55bbe39a20c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.439+0000 7fe332d9c700 1 -- 172.21.15.8:0/73293281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbe3992630 msgr2=0x55bbe39a1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:45.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.439+0000 7fe332d9c700 1 --2- 172.21.15.8:0/73293281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbe3992630 0x55bbe39a1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.439+0000 7fe332d9c700 1 -- 172.21.15.8:0/73293281 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe31c0096d0 con 0x55bbe3997e80 2023-08-11T12:25:45.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.440+0000 7fe332d9c700 1 --2- 172.21.15.8:0/73293281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbe3997e80 0x55bbe399bee0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe324007d10 tx=0x7fe324017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbdd2fb4fd5c3736 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:45.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.440+0000 7fe315ffb700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:25:45.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.440+0000 7fe315ffb700 1 -- 172.21.15.8:0/73293281 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe324018a40 con 0x55bbe3997e80 2023-08-11T12:25:45.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.440+0000 7fe348032b80 1 -- 172.21.15.8:0/73293281 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bbe39857e0 con 0x55bbe3997e80 2023-08-11T12:25:45.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.440+0000 7fe315ffb700 1 -- 172.21.15.8:0/73293281 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fe324018ba0 con 0x55bbe3997e80 2023-08-11T12:25:45.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.441+0000 7fe315ffb700 1 -- 172.21.15.8:0/73293281 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe324018d60 con 0x55bbe3997e80 2023-08-11T12:25:45.445 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.441+0000 7fe348032b80 10 client.26053 fetch_fsmap learned FSMap version 32 2023-08-11T12:25:45.445 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.441+0000 7fe348032b80 1 -- 172.21.15.8:0/73293281 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55bbe3710d80 con 0x55bbe3997e80 2023-08-11T12:25:45.445 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.441+0000 7fe315ffb700 1 -- 172.21.15.8:0/73293281 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bbe39857e0 con 0x55bbe3997e80 2023-08-11T12:25:45.445 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.441+0000 7fe315ffb700 1 -- 172.21.15.8:0/73293281 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 32) v1 ==== 7926+0+0 (secure 0 0 0) 0x7fe324005020 con 0x55bbe3997e80 2023-08-11T12:25:45.445 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.442+0000 7fe348032b80 10 client.26053 fetch_fsmap finished waiting for FSMap version 32 2023-08-11T12:25:45.445 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.442+0000 7fe348032b80 10 client.26053 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-11T12:25:45.445 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.442+0000 7fe348032b80 20 client.26053 populate_metadata read hostname 'smithi008' 2023-08-11T12:25:45.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.442+0000 7fe348032b80 1 --2- 172.21.15.8:0/73293281 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55bbe39ac150 0x55bbe39ae570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:45.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.442+0000 7fe348032b80 4 client.26053 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:25:45.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.442+0000 7fe348032b80 1 -- 172.21.15.8:0/73293281 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bbe3961480 con 0x55bbe39ac150 2023-08-11T12:25:45.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.442+0000 7fe33259b700 1 --2- 172.21.15.8:0/73293281 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55bbe39ac150 0x55bbe39ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.443+0000 7fe33259b700 1 --2- 172.21.15.8:0/73293281 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55bbe39ac150 0x55bbe39ae570 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b06da23a19b754ed server_cookie=90734e79c27f7cfb in_seq=0 out_seq=0 2023-08-11T12:25:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.443+0000 7fe315ffb700 10 client.26053 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.444+0000 7fe315ffb700 1 -- 172.21.15.8:0/73293281 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55bbe3961480 con 0x55bbe39ac150 2023-08-11T12:25:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.444+0000 7fe315ffb700 10 client.26053 handle_command_reply: tid=0 2023-08-11T12:25:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.444+0000 7fe348032b80 1 client.26053 shutdown 2023-08-11T12:25:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.444+0000 7fe348032b80 1 -- 172.21.15.8:0/73293281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbe3997e80 msgr2=0x55bbe399bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.444+0000 7fe348032b80 1 --2- 172.21.15.8:0/73293281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbe3997e80 0x55bbe399bee0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe324007d10 tx=0x7fe324017000 comp rx=0 tx=0).stop 2023-08-11T12:25:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.444+0000 7fe348032b80 1 -- 172.21.15.8:0/73293281 shutdown_connections 2023-08-11T12:25:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.444+0000 7fe348032b80 1 --2- 172.21.15.8:0/73293281 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55bbe39ac150 0x55bbe39ae570 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.444+0000 7fe348032b80 1 --2- 172.21.15.8:0/73293281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbe3997e80 0x55bbe399bee0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.444+0000 7fe348032b80 1 --2- 172.21.15.8:0/73293281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbe3992630 0x55bbe39a1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.449 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.444+0000 7fe348032b80 1 --2- 172.21.15.8:0/73293281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbe3992ff0 0x55bbe39a20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.449 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.444+0000 7fe348032b80 1 -- 172.21.15.8:0/73293281 >> 172.21.15.8:0/73293281 conn(0x55bbe38bf8f0 msgr2=0x55bbe398c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:45.449 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.444+0000 7fe315ffb700 0 client.26053 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:45.449 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.444+0000 7fe348032b80 1 -- 172.21.15.8:0/73293281 shutdown_connections 2023-08-11T12:25:45.449 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.444+0000 7fe348032b80 1 -- 172.21.15.8:0/73293281 wait complete. 2023-08-11T12:25:45.449 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.445+0000 7fe348032b80 20 client.26053 trim_cache size 0 max 16384 2023-08-11T12:25:45.463 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.461+0000 7fe348032b80 1 Processor -- start 2023-08-11T12:25:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.461+0000 7fe348032b80 1 -- start start 2023-08-11T12:25:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.462+0000 7fe348032b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbe3992630 0x55bbe39a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.462+0000 7fe348032b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbe3992ff0 0x55bbe398cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.462+0000 7fe348032b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbe3997e80 0x55bbe3996f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:45.465 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.462+0000 7fe348032b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbe399d450 con 0x55bbe3997e80 2023-08-11T12:25:45.465 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.462+0000 7fe348032b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbe398edb0 con 0x55bbe3992630 2023-08-11T12:25:45.465 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.462+0000 7fe348032b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbe399d230 con 0x55bbe3992ff0 2023-08-11T12:25:45.465 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.462+0000 7fe33259b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbe3992630 0x55bbe39a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:45.465 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.462+0000 7fe33259b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbe3992630 0x55bbe39a16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:37472/0 (socket says 172.21.15.8:37472) 2023-08-11T12:25:45.466 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.462+0000 7fe33259b700 1 -- 172.21.15.8:0/3588668894 learned_addr learned my addr 172.21.15.8:0/3588668894 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:45.466 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.462+0000 7fe331d9a700 1 --2- 172.21.15.8:0/3588668894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbe3992ff0 0x55bbe398cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:45.466 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.463+0000 7fe332d9c700 1 --2- 172.21.15.8:0/3588668894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbe3997e80 0x55bbe3996f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:45.466 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.463+0000 7fe331d9a700 1 -- 172.21.15.8:0/3588668894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbe3992630 msgr2=0x55bbe39a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.463+0000 7fe331d9a700 1 --2- 172.21.15.8:0/3588668894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbe3992630 0x55bbe39a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.464+0000 7fe331d9a700 1 -- 172.21.15.8:0/3588668894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbe3997e80 msgr2=0x55bbe3996f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.464+0000 7fe331d9a700 1 --2- 172.21.15.8:0/3588668894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbe3997e80 0x55bbe3996f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.464+0000 7fe331d9a700 1 -- 172.21.15.8:0/3588668894 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbe36f9c00 con 0x55bbe3992ff0 2023-08-11T12:25:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.464+0000 7fe331d9a700 1 --2- 172.21.15.8:0/3588668894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbe3992ff0 0x55bbe398cd50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55bbe399d420 tx=0x7fe31c00f8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c2295b1549a7eea server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.465+0000 7fe3217fa700 1 -- 172.21.15.8:0/3588668894 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c00fbd0 con 0x55bbe3992ff0 2023-08-11T12:25:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.465+0000 7fe3217fa700 1 -- 172.21.15.8:0/3588668894 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe31c00fd30 con 0x55bbe3992ff0 2023-08-11T12:25:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.465+0000 7fe3217fa700 1 -- 172.21.15.8:0/3588668894 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c003e70 con 0x55bbe3992ff0 2023-08-11T12:25:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.466+0000 7fe348032b80 1 -- 172.21.15.8:0/3588668894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbe3992ff0 msgr2=0x55bbe398cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.466+0000 7fe348032b80 1 --2- 172.21.15.8:0/3588668894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbe3992ff0 0x55bbe398cd50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55bbe399d420 tx=0x7fe31c00f8e0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.469 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.466+0000 7fe348032b80 1 -- 172.21.15.8:0/3588668894 shutdown_connections 2023-08-11T12:25:45.469 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.466+0000 7fe348032b80 1 --2- 172.21.15.8:0/3588668894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbe3997e80 0x55bbe3996f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.469 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.466+0000 7fe348032b80 1 --2- 172.21.15.8:0/3588668894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbe3992630 0x55bbe39a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.469 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.466+0000 7fe348032b80 1 --2- 172.21.15.8:0/3588668894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbe3992ff0 0x55bbe398cd50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.469 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.466+0000 7fe348032b80 1 -- 172.21.15.8:0/3588668894 >> 172.21.15.8:0/3588668894 conn(0x55bbe38bf8f0 msgr2=0x55bbe399c810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.467+0000 7fe348032b80 1 -- 172.21.15.8:0/3588668894 shutdown_connections 2023-08-11T12:25:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.467+0000 7fe348032b80 1 -- 172.21.15.8:0/3588668894 wait complete. 2023-08-11T12:25:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.467+0000 7fe348032b80 1 -- start start 2023-08-11T12:25:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.467+0000 7fe348032b80 1 Processor -- start 2023-08-11T12:25:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.468+0000 7fe348032b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbe3992630 0x55bbe39f8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.468+0000 7fe348032b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbe3992ff0 0x55bbe39f8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.468+0000 7fe348032b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbe3997e80 0x55bbe39a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.468+0000 7fe348032b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbe39a1150 con 0x55bbe3997e80 2023-08-11T12:25:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.468+0000 7fe348032b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbe39a12c0 con 0x55bbe3992ff0 2023-08-11T12:25:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.468+0000 7fe348032b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbe39a1480 con 0x55bbe3992630 2023-08-11T12:25:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.468+0000 7fe348032b80 10 client.0 _ll_register_callbacks cb 0x7fe32401a4c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:25:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.469+0000 7fe33259b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbe3992630 0x55bbe39f8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.469+0000 7fe33259b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbe3992630 0x55bbe39f8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:35592/0 (socket says 172.21.15.8:35592) 2023-08-11T12:25:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.469+0000 7fe33259b700 1 -- 172.21.15.8:0/1841082761 learned_addr learned my addr 172.21.15.8:0/1841082761 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.469+0000 7fe331d9a700 1 --2- 172.21.15.8:0/1841082761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbe3992ff0 0x55bbe39f8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.469+0000 7fe332d9c700 1 --2- 172.21.15.8:0/1841082761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbe3997e80 0x55bbe39a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.469+0000 7fe33259b700 1 -- 172.21.15.8:0/1841082761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbe3992ff0 msgr2=0x55bbe39f8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.469+0000 7fe33259b700 1 --2- 172.21.15.8:0/1841082761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbe3992ff0 0x55bbe39f8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.469+0000 7fe33259b700 1 -- 172.21.15.8:0/1841082761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbe3997e80 msgr2=0x55bbe39a0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.469+0000 7fe33259b700 1 --2- 172.21.15.8:0/1841082761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbe3997e80 0x55bbe39a0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.469+0000 7fe33259b700 1 -- 172.21.15.8:0/1841082761 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bbe37645d0 con 0x55bbe3992630 2023-08-11T12:25:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.470+0000 7fe33259b700 1 --2- 172.21.15.8:0/1841082761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbe3992630 0x55bbe39f8910 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe328011040 tx=0x7fe328009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ade4fa9a70703fb9 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.470+0000 7fe315ffb700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:25:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.470+0000 7fe315ffb700 1 -- 172.21.15.8:0/1841082761 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32809a420 con 0x55bbe3992630 2023-08-11T12:25:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.470+0000 7fe315ffb700 1 -- 172.21.15.8:0/1841082761 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fe32809a6c0 con 0x55bbe3992630 2023-08-11T12:25:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.470+0000 7fe348032b80 1 -- 172.21.15.8:0/1841082761 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe31c013470 con 0x55bbe3992630 2023-08-11T12:25:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.470+0000 7fe315ffb700 1 -- 172.21.15.8:0/1841082761 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe328099fc0 con 0x55bbe3992630 2023-08-11T12:25:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.470+0000 7fe348032b80 10 client.26059 fetch_fsmap learned FSMap version 32 2023-08-11T12:25:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.470+0000 7fe348032b80 1 -- 172.21.15.8:0/1841082761 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55bbe37371f0 con 0x55bbe3992630 2023-08-11T12:25:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.471+0000 7fe315ffb700 1 -- 172.21.15.8:0/1841082761 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe31c013470 con 0x55bbe3992630 2023-08-11T12:25:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.471+0000 7fe315ffb700 1 -- 172.21.15.8:0/1841082761 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 32) v1 ==== 7926+0+0 (secure 0 0 0) 0x7fe328094bd0 con 0x55bbe3992630 2023-08-11T12:25:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.471+0000 7fe348032b80 10 client.26059 fetch_fsmap finished waiting for FSMap version 32 2023-08-11T12:25:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.471+0000 7fe348032b80 10 client.26059 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-11T12:25:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.471+0000 7fe348032b80 20 client.26059 populate_metadata read hostname 'smithi008' 2023-08-11T12:25:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.471+0000 7fe348032b80 1 --2- 172.21.15.8:0/1841082761 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55bbe3a00450 0x55bbe3a02870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.471+0000 7fe348032b80 4 client.26059 mds_command: new command op to 24575 tid=0[{"prefix": "flush journal"}] 2023-08-11T12:25:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.471+0000 7fe348032b80 1 -- 172.21.15.8:0/1841082761 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55bbe38dd7c0 con 0x55bbe3a00450 2023-08-11T12:25:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.471+0000 7fe331d9a700 1 --2- 172.21.15.8:0/1841082761 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55bbe3a00450 0x55bbe3a02870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.472+0000 7fe331d9a700 1 --2- 172.21.15.8:0/1841082761 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55bbe3a00450 0x55bbe3a02870 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c904fe7ca9aea42c server_cookie=83561d2607d1313f in_seq=0 out_seq=0 2023-08-11T12:25:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.472+0000 7fe315ffb700 10 client.26059 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.532+0000 7fe315ffb700 1 -- 172.21.15.8:0/1841082761 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55bbe38dd7c0 con 0x55bbe3a00450 2023-08-11T12:25:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.532+0000 7fe315ffb700 10 client.26059 handle_command_reply: tid=0 2023-08-11T12:25:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.532+0000 7fe348032b80 1 client.26059 shutdown 2023-08-11T12:25:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.533+0000 7fe348032b80 1 -- 172.21.15.8:0/1841082761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbe3992630 msgr2=0x55bbe39f8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.533+0000 7fe348032b80 1 --2- 172.21.15.8:0/1841082761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbe3992630 0x55bbe39f8910 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe328011040 tx=0x7fe328009ca0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.536 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.533+0000 7fe348032b80 1 -- 172.21.15.8:0/1841082761 shutdown_connections 2023-08-11T12:25:45.536 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.533+0000 7fe348032b80 1 --2- 172.21.15.8:0/1841082761 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55bbe3a00450 0x55bbe3a02870 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.536 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.533+0000 7fe348032b80 1 --2- 172.21.15.8:0/1841082761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbe3992630 0x55bbe39f8910 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.536 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.533+0000 7fe348032b80 1 --2- 172.21.15.8:0/1841082761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbe3997e80 0x55bbe39a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.536 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.533+0000 7fe348032b80 1 --2- 172.21.15.8:0/1841082761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbe3992ff0 0x55bbe39f8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.533+0000 7fe348032b80 1 -- 172.21.15.8:0/1841082761 >> 172.21.15.8:0/1841082761 conn(0x55bbe38bf8f0 msgr2=0x55bbe3996f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.533+0000 7fe315ffb700 0 client.26059 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.533+0000 7fe348032b80 1 -- 172.21.15.8:0/1841082761 shutdown_connections 2023-08-11T12:25:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.533+0000 7fe348032b80 1 -- 172.21.15.8:0/1841082761 wait complete. 2023-08-11T12:25:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.534+0000 7fe348032b80 20 client.26059 trim_cache size 0 max 16384 2023-08-11T12:25:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-08-11T12:25:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-08-11T12:25:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-08-11T12:25:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-08-11T12:25:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.535+0000 7fe3347ff700 1 -- 172.21.15.8:0/859686245 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe3180a0200 msgr2=0x7fe3180a26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.535+0000 7fe3347ff700 1 --2- 172.21.15.8:0/859686245 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe3180a0200 0x7fe3180a26c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe324007550 tx=0x7fe324007910 comp rx=0 tx=0).stop 2023-08-11T12:25:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.535+0000 7fe3347ff700 1 -- 172.21.15.8:0/859686245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe32c107920 msgr2=0x7fe32c11d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.535+0000 7fe3347ff700 1 --2- 172.21.15.8:0/859686245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe32c107920 0x7fe32c11d420 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe3280098e0 tx=0x7fe3280037c0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.536+0000 7fe3347ff700 1 -- 172.21.15.8:0/859686245 shutdown_connections 2023-08-11T12:25:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.536+0000 7fe3347ff700 1 --2- 172.21.15.8:0/859686245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe32c10f490 0x7fe32c116430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.536+0000 7fe3347ff700 1 --2- 172.21.15.8:0/859686245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe32c107920 0x7fe32c11d420 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.536+0000 7fe3347ff700 1 --2- 172.21.15.8:0/859686245 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe3180a0200 0x7fe3180a26c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.536+0000 7fe3347ff700 1 --2- 172.21.15.8:0/859686245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe32c10f020 0x7fe32c11d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.536+0000 7fe3347ff700 1 -- 172.21.15.8:0/859686245 >> 172.21.15.8:0/859686245 conn(0x7fe32c06c9e0 msgr2=0x7fe32c0712b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.536+0000 7fe3347ff700 1 -- 172.21.15.8:0/859686245 shutdown_connections 2023-08-11T12:25:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:45.537+0000 7fe3347ff700 1 -- 172.21.15.8:0/859686245 wait complete. 2023-08-11T12:25:45.754 INFO:teuthology.orchestra.run.smithi008.stderr:14100000 of 50000000 tuples (28%) done (elapsed 50.44 s, remaining 128.43 s) 2023-08-11T12:25:45.970 INFO:teuthology.orchestra.run.smithi008.stderr:14200000 of 50000000 tuples (28%) done (elapsed 50.66 s, remaining 127.71 s) 2023-08-11T12:25:46.185 INFO:teuthology.orchestra.run.smithi008.stderr:14300000 of 50000000 tuples (28%) done (elapsed 50.87 s, remaining 127.00 s) 2023-08-11T12:25:46.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:46 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:25:46.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:46 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:25:46.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:46 smithi008 ceph-mon[97158]: pgmap v38: 129 pgs: 129 active+clean; 2.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 83 MiB/s wr, 105 op/s 2023-08-11T12:25:46.350 INFO:teuthology.orchestra.run.smithi008.stderr:14400000 of 50000000 tuples (28%) done (elapsed 51.04 s, remaining 126.18 s) 2023-08-11T12:25:46.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:46 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:25:46.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:46 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:25:46.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:46 smithi194 ceph-mon[130905]: pgmap v38: 129 pgs: 129 active+clean; 2.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 83 MiB/s wr, 105 op/s 2023-08-11T12:25:46.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:46 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:25:46.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:46 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:25:46.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:46 smithi045 ceph-mon[130284]: pgmap v38: 129 pgs: 129 active+clean; 2.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 83 MiB/s wr, 105 op/s 2023-08-11T12:25:46.538 INFO:teuthology.orchestra.run.smithi008.stderr:14500000 of 50000000 tuples (29%) done (elapsed 51.22 s, remaining 125.41 s) 2023-08-11T12:25:46.732 INFO:teuthology.orchestra.run.smithi008.stderr:14600000 of 50000000 tuples (29%) done (elapsed 51.42 s, remaining 124.67 s) 2023-08-11T12:25:46.925 INFO:teuthology.orchestra.run.smithi008.stderr:14700000 of 50000000 tuples (29%) done (elapsed 51.61 s, remaining 123.94 s) 2023-08-11T12:25:47.110 INFO:teuthology.orchestra.run.smithi008.stderr:14800000 of 50000000 tuples (29%) done (elapsed 51.80 s, remaining 123.19 s) 2023-08-11T12:25:47.227 INFO:teuthology.orchestra.run.smithi008.stderr:14900000 of 50000000 tuples (29%) done (elapsed 51.91 s, remaining 122.29 s) 2023-08-11T12:25:47.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:47 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:25:47.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:47 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:25:47.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:47 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:25:47.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:47 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:25:47.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:47 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:25:47.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:47 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:25:47.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:47 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:25:47.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:47 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:25:47.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:47 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:25:47.428 INFO:teuthology.orchestra.run.smithi008.stderr:15000000 of 50000000 tuples (30%) done (elapsed 52.11 s, remaining 121.60 s) 2023-08-11T12:25:47.634 INFO:teuthology.orchestra.run.smithi008.stderr:15100000 of 50000000 tuples (30%) done (elapsed 52.32 s, remaining 120.93 s) 2023-08-11T12:25:47.785 INFO:teuthology.orchestra.run.smithi008.stderr:15200000 of 50000000 tuples (30%) done (elapsed 52.47 s, remaining 120.13 s) 2023-08-11T12:25:48.007 INFO:teuthology.orchestra.run.smithi008.stderr:15300000 of 50000000 tuples (30%) done (elapsed 52.69 s, remaining 119.51 s) 2023-08-11T12:25:48.200 INFO:teuthology.orchestra.run.smithi008.stderr:15400000 of 50000000 tuples (30%) done (elapsed 52.89 s, remaining 118.82 s) 2023-08-11T12:25:48.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:48 smithi008 ceph-mon[97158]: pgmap v39: 129 pgs: 129 active+clean; 3.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 143 MiB/s wr, 153 op/s 2023-08-11T12:25:48.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:48 smithi194 ceph-mon[130905]: pgmap v39: 129 pgs: 129 active+clean; 3.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 143 MiB/s wr, 153 op/s 2023-08-11T12:25:48.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:48 smithi045 ceph-mon[130284]: pgmap v39: 129 pgs: 129 active+clean; 3.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 143 MiB/s wr, 153 op/s 2023-08-11T12:25:48.419 INFO:teuthology.orchestra.run.smithi008.stderr:15500000 of 50000000 tuples (31%) done (elapsed 53.11 s, remaining 118.20 s) 2023-08-11T12:25:48.534 INFO:teuthology.orchestra.run.smithi008.stderr:15600000 of 50000000 tuples (31%) done (elapsed 53.22 s, remaining 117.36 s) 2023-08-11T12:25:48.759 INFO:teuthology.orchestra.run.smithi008.stderr:15700000 of 50000000 tuples (31%) done (elapsed 53.45 s, remaining 116.76 s) 2023-08-11T12:25:48.952 INFO:teuthology.orchestra.run.smithi008.stderr:15800000 of 50000000 tuples (31%) done (elapsed 53.64 s, remaining 116.11 s) 2023-08-11T12:25:49.141 INFO:teuthology.orchestra.run.smithi008.stderr:15900000 of 50000000 tuples (31%) done (elapsed 53.83 s, remaining 115.44 s) 2023-08-11T12:25:49.280 INFO:teuthology.orchestra.run.smithi008.stderr:16000000 of 50000000 tuples (32%) done (elapsed 53.97 s, remaining 114.68 s) 2023-08-11T12:25:49.535 INFO:teuthology.orchestra.run.smithi008.stderr:16100000 of 50000000 tuples (32%) done (elapsed 54.22 s, remaining 114.17 s) 2023-08-11T12:25:49.729 INFO:teuthology.orchestra.run.smithi008.stderr:16200000 of 50000000 tuples (32%) done (elapsed 54.41 s, remaining 113.52 s) 2023-08-11T12:25:49.929 INFO:teuthology.orchestra.run.smithi008.stderr:16300000 of 50000000 tuples (32%) done (elapsed 54.62 s, remaining 112.92 s) 2023-08-11T12:25:50.146 INFO:teuthology.orchestra.run.smithi008.stderr:16400000 of 50000000 tuples (32%) done (elapsed 54.83 s, remaining 112.34 s) 2023-08-11T12:25:50.339 INFO:teuthology.orchestra.run.smithi008.stderr:16500000 of 50000000 tuples (33%) done (elapsed 55.03 s, remaining 111.72 s) 2023-08-11T12:25:50.491 INFO:teuthology.orchestra.run.smithi008.stderr:16600000 of 50000000 tuples (33%) done (elapsed 55.18 s, remaining 111.02 s) 2023-08-11T12:25:50.672 INFO:teuthology.orchestra.run.smithi008.stderr:16700000 of 50000000 tuples (33%) done (elapsed 55.36 s, remaining 110.39 s) 2023-08-11T12:25:50.886 INFO:teuthology.orchestra.run.smithi008.stderr:16800000 of 50000000 tuples (33%) done (elapsed 55.57 s, remaining 109.82 s) 2023-08-11T12:25:51.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:50 smithi008 ceph-mon[97158]: pgmap v40: 129 pgs: 129 active+clean; 3.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 84 MiB/s wr, 69 op/s 2023-08-11T12:25:51.069 INFO:teuthology.orchestra.run.smithi008.stderr:16900000 of 50000000 tuples (33%) done (elapsed 55.76 s, remaining 109.20 s) 2023-08-11T12:25:51.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:50 smithi194 ceph-mon[130905]: pgmap v40: 129 pgs: 129 active+clean; 3.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 84 MiB/s wr, 69 op/s 2023-08-11T12:25:51.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:50 smithi045 ceph-mon[130284]: pgmap v40: 129 pgs: 129 active+clean; 3.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 84 MiB/s wr, 69 op/s 2023-08-11T12:25:51.273 INFO:teuthology.orchestra.run.smithi008.stderr:17000000 of 50000000 tuples (34%) done (elapsed 55.96 s, remaining 108.63 s) 2023-08-11T12:25:51.512 INFO:teuthology.orchestra.run.smithi008.stderr:17100000 of 50000000 tuples (34%) done (elapsed 56.20 s, remaining 108.13 s) 2023-08-11T12:25:51.679 INFO:teuthology.orchestra.run.smithi008.stderr:17200000 of 50000000 tuples (34%) done (elapsed 56.37 s, remaining 107.49 s) 2023-08-11T12:25:51.875 INFO:teuthology.orchestra.run.smithi008.stderr:17300000 of 50000000 tuples (34%) done (elapsed 56.56 s, remaining 106.91 s) 2023-08-11T12:25:52.087 INFO:teuthology.orchestra.run.smithi008.stderr:17400000 of 50000000 tuples (34%) done (elapsed 56.77 s, remaining 106.37 s) 2023-08-11T12:25:52.273 INFO:teuthology.orchestra.run.smithi008.stderr:17500000 of 50000000 tuples (35%) done (elapsed 56.96 s, remaining 105.78 s) 2023-08-11T12:25:52.483 INFO:teuthology.orchestra.run.smithi008.stderr:17600000 of 50000000 tuples (35%) done (elapsed 57.17 s, remaining 105.24 s) 2023-08-11T12:25:53.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:52 smithi194 ceph-mon[130905]: pgmap v41: 129 pgs: 129 active+clean; 3.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 107 MiB/s wr, 82 op/s 2023-08-11T12:25:53.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:52 smithi045 ceph-mon[130284]: pgmap v41: 129 pgs: 129 active+clean; 3.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 107 MiB/s wr, 82 op/s 2023-08-11T12:25:53.151 INFO:teuthology.orchestra.run.smithi008.stderr:17700000 of 50000000 tuples (35%) done (elapsed 57.84 s, remaining 105.55 s) 2023-08-11T12:25:53.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:52 smithi008 ceph-mon[97158]: pgmap v41: 129 pgs: 129 active+clean; 3.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 107 MiB/s wr, 82 op/s 2023-08-11T12:25:54.168 INFO:teuthology.orchestra.run.smithi008.stderr:17800000 of 50000000 tuples (35%) done (elapsed 58.85 s, remaining 106.47 s) 2023-08-11T12:25:54.315 INFO:teuthology.orchestra.run.smithi008.stderr:17900000 of 50000000 tuples (35%) done (elapsed 59.00 s, remaining 105.81 s) 2023-08-11T12:25:54.807 INFO:teuthology.orchestra.run.smithi008.stderr:18000000 of 50000000 tuples (36%) done (elapsed 59.49 s, remaining 105.77 s) 2023-08-11T12:25:55.019 INFO:teuthology.orchestra.run.smithi008.stderr:18100000 of 50000000 tuples (36%) done (elapsed 59.71 s, remaining 105.23 s) 2023-08-11T12:25:55.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:54 smithi194 ceph-mon[130905]: pgmap v42: 129 pgs: 129 active+clean; 3.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 85 MiB/s wr, 62 op/s 2023-08-11T12:25:55.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:54 smithi045 ceph-mon[130284]: pgmap v42: 129 pgs: 129 active+clean; 3.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 85 MiB/s wr, 62 op/s 2023-08-11T12:25:55.243 INFO:teuthology.orchestra.run.smithi008.stderr:18200000 of 50000000 tuples (36%) done (elapsed 59.93 s, remaining 104.71 s) 2023-08-11T12:25:55.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:54 smithi008 ceph-mon[97158]: pgmap v42: 129 pgs: 129 active+clean; 3.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 85 MiB/s wr, 62 op/s 2023-08-11T12:25:55.390 INFO:teuthology.orchestra.run.smithi008.stderr:18300000 of 50000000 tuples (36%) done (elapsed 60.08 s, remaining 104.07 s) 2023-08-11T12:25:55.587 INFO:teuthology.orchestra.run.smithi008.stderr:18400000 of 50000000 tuples (36%) done (elapsed 60.27 s, remaining 103.51 s) 2023-08-11T12:25:55.806 INFO:teuthology.orchestra.run.smithi008.stderr:18500000 of 50000000 tuples (37%) done (elapsed 60.49 s, remaining 103.00 s) 2023-08-11T12:25:56.035 INFO:teuthology.orchestra.run.smithi008.stderr:18600000 of 50000000 tuples (37%) done (elapsed 60.72 s, remaining 102.51 s) 2023-08-11T12:25:56.264 INFO:teuthology.orchestra.run.smithi008.stderr:18700000 of 50000000 tuples (37%) done (elapsed 60.95 s, remaining 102.02 s) 2023-08-11T12:25:56.379 INFO:teuthology.orchestra.run.smithi008.stderr:18800000 of 50000000 tuples (37%) done (elapsed 61.07 s, remaining 101.34 s) 2023-08-11T12:25:56.616 INFO:teuthology.orchestra.run.smithi008.stderr:18900000 of 50000000 tuples (37%) done (elapsed 61.30 s, remaining 100.87 s) 2023-08-11T12:25:56.797 INFO:teuthology.orchestra.run.smithi008.stderr:19000000 of 50000000 tuples (38%) done (elapsed 61.48 s, remaining 100.32 s) 2023-08-11T12:25:56.962 INFO:teuthology.orchestra.run.smithi008.stderr:19100000 of 50000000 tuples (38%) done (elapsed 61.65 s, remaining 99.74 s) 2023-08-11T12:25:57.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:56 smithi194 ceph-mon[130905]: pgmap v43: 129 pgs: 129 active+clean; 3.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 83 MiB/s wr, 61 op/s 2023-08-11T12:25:57.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:56 smithi045 ceph-mon[130284]: pgmap v43: 129 pgs: 129 active+clean; 3.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 83 MiB/s wr, 61 op/s 2023-08-11T12:25:57.150 INFO:teuthology.orchestra.run.smithi008.stderr:19200000 of 50000000 tuples (38%) done (elapsed 61.84 s, remaining 99.20 s) 2023-08-11T12:25:57.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:56 smithi008 ceph-mon[97158]: pgmap v43: 129 pgs: 129 active+clean; 3.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 83 MiB/s wr, 61 op/s 2023-08-11T12:25:57.381 INFO:teuthology.orchestra.run.smithi008.stderr:19300000 of 50000000 tuples (38%) done (elapsed 62.07 s, remaining 98.73 s) 2023-08-11T12:25:57.561 INFO:teuthology.orchestra.run.smithi008.stderr:19400000 of 50000000 tuples (38%) done (elapsed 62.25 s, remaining 98.19 s) 2023-08-11T12:25:57.749 INFO:teuthology.orchestra.run.smithi008.stderr:19500000 of 50000000 tuples (39%) done (elapsed 62.44 s, remaining 97.66 s) 2023-08-11T12:25:57.976 INFO:teuthology.orchestra.run.smithi008.stderr:19600000 of 50000000 tuples (39%) done (elapsed 62.66 s, remaining 97.19 s) 2023-08-11T12:25:58.113 INFO:teuthology.orchestra.run.smithi008.stderr:19700000 of 50000000 tuples (39%) done (elapsed 62.80 s, remaining 96.59 s) 2023-08-11T12:25:58.305 INFO:teuthology.orchestra.run.smithi008.stderr:19800000 of 50000000 tuples (39%) done (elapsed 62.99 s, remaining 96.08 s) 2023-08-11T12:25:58.520 INFO:teuthology.orchestra.run.smithi008.stderr:19900000 of 50000000 tuples (39%) done (elapsed 63.21 s, remaining 95.60 s) 2023-08-11T12:25:58.690 INFO:teuthology.orchestra.run.smithi008.stderr:20000000 of 50000000 tuples (40%) done (elapsed 63.38 s, remaining 95.07 s) 2023-08-11T12:25:58.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.706+0000 7fb5407ff700 1 -- 172.21.15.8:0/868706025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5381008c0 msgr2=0x7fb538100d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:58.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.706+0000 7fb5407ff700 1 --2- 172.21.15.8:0/868706025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5381008c0 0x7fb538100d40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb528009990 tx=0x7fb528009ca0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.706+0000 7fb5407ff700 1 -- 172.21.15.8:0/868706025 shutdown_connections 2023-08-11T12:25:58.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.706+0000 7fb5407ff700 1 --2- 172.21.15.8:0/868706025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5381068d0 0x7fb538106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.709 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.706+0000 7fb5407ff700 1 --2- 172.21.15.8:0/868706025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb538101280 0x7fb53810d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.709 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.706+0000 7fb5407ff700 1 --2- 172.21.15.8:0/868706025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5381008c0 0x7fb538100d40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.709 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.706+0000 7fb5407ff700 1 -- 172.21.15.8:0/868706025 >> 172.21.15.8:0/868706025 conn(0x7fb5380fc3d0 msgr2=0x7fb5380fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:58.709 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.706+0000 7fb5407ff700 1 -- 172.21.15.8:0/868706025 shutdown_connections 2023-08-11T12:25:58.709 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.706+0000 7fb5407ff700 1 -- 172.21.15.8:0/868706025 wait complete. 2023-08-11T12:25:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.707+0000 7fb5407ff700 1 Processor -- start 2023-08-11T12:25:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.708+0000 7fb5407ff700 1 -- start start 2023-08-11T12:25:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.708+0000 7fb5407ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5381008c0 0x7fb538072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.708+0000 7fb5407ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb538101280 0x7fb538073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.708+0000 7fb5407ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5381068d0 0x7fb5381a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.708+0000 7fb5407ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb538073990 con 0x7fb5381068d0 2023-08-11T12:25:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.708+0000 7fb5407ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5381a5100 con 0x7fb538101280 2023-08-11T12:25:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.708+0000 7fb5407ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5381a5240 con 0x7fb5381008c0 2023-08-11T12:25:58.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.708+0000 7fb53dd9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb538101280 0x7fb538073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:58.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.708+0000 7fb53dd9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb538101280 0x7fb538073160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:58764/0 (socket says 172.21.15.8:58764) 2023-08-11T12:25:58.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.708+0000 7fb53dd9a700 1 -- 172.21.15.8:0/1387436836 learned_addr learned my addr 172.21.15.8:0/1387436836 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:58.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.709+0000 7fb53e59b700 1 --2- 172.21.15.8:0/1387436836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5381008c0 0x7fb538072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:58.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.709+0000 7fb53ed9c700 1 --2- 172.21.15.8:0/1387436836 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5381068d0 0x7fb5381a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:58.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.709+0000 7fb53dd9a700 1 -- 172.21.15.8:0/1387436836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5381008c0 msgr2=0x7fb538072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:58.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.709+0000 7fb53dd9a700 1 --2- 172.21.15.8:0/1387436836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5381008c0 0x7fb538072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.714 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.709+0000 7fb53dd9a700 1 -- 172.21.15.8:0/1387436836 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5381068d0 msgr2=0x7fb5381a4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:58.714 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.709+0000 7fb53dd9a700 1 --2- 172.21.15.8:0/1387436836 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5381068d0 0x7fb5381a4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.714 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.709+0000 7fb53dd9a700 1 -- 172.21.15.8:0/1387436836 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5280095f0 con 0x7fb538101280 2023-08-11T12:25:58.714 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.709+0000 7fb53ed9c700 1 --2- 172.21.15.8:0/1387436836 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5381068d0 0x7fb5381a4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:58.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.709+0000 7fb53dd9a700 1 --2- 172.21.15.8:0/1387436836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb538101280 0x7fb538073160 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb528005910 tx=0x7fb528005720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:58.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.709+0000 7fb52f7fe700 1 -- 172.21.15.8:0/1387436836 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52801d070 con 0x7fb538101280 2023-08-11T12:25:58.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.709+0000 7fb5407ff700 1 -- 172.21.15.8:0/1387436836 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5381a5440 con 0x7fb538101280 2023-08-11T12:25:58.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.710+0000 7fb52f7fe700 1 -- 172.21.15.8:0/1387436836 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb528022470 con 0x7fb538101280 2023-08-11T12:25:58.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.710+0000 7fb52f7fe700 1 -- 172.21.15.8:0/1387436836 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb528017650 con 0x7fb538101280 2023-08-11T12:25:58.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.710+0000 7fb5407ff700 1 -- 172.21.15.8:0/1387436836 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5381a5970 con 0x7fb538101280 2023-08-11T12:25:58.716 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.713+0000 7fb52f7fe700 1 -- 172.21.15.8:0/1387436836 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 24) v1 ==== 134903+0+0 (secure 0 0 0) 0x7fb5280225e0 con 0x7fb538101280 2023-08-11T12:25:58.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.715+0000 7fb52f7fe700 1 --2- 172.21.15.8:0/1387436836 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb5240a01e0 0x7fb5240a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:58.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.715+0000 7fb52f7fe700 1 -- 172.21.15.8:0/1387436836 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fb5280ccf00 con 0x7fb538101280 2023-08-11T12:25:58.718 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.715+0000 7fb53e59b700 1 --2- 172.21.15.8:0/1387436836 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb5240a01e0 0x7fb5240a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:58.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.716+0000 7fb554110b80 1 Processor -- start 2023-08-11T12:25:58.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.716+0000 7fb53e59b700 1 --2- 172.21.15.8:0/1387436836 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb5240a01e0 0x7fb5240a26a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb534009be0 tx=0x7fb534009260 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.716+0000 7fb554110b80 1 -- start start 2023-08-11T12:25:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.716+0000 7fb554110b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ff70210e80 0x55ff70211260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.716+0000 7fb554110b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff7020b630 0x55ff7020bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.716+0000 7fb554110b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ff7020bff0 0x55ff70217c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.716+0000 7fb554110b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff701645d0 con 0x55ff7020b630 2023-08-11T12:25:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.716+0000 7fb554110b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff70161ef0 con 0x55ff7020bff0 2023-08-11T12:25:58.721 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.716+0000 7fb554110b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff7015d7e0 con 0x55ff70210e80 2023-08-11T12:25:58.721 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.717+0000 7fb53dd9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff7020b630 0x55ff7020bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:58.721 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.717+0000 7fb53dd9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff7020b630 0x55ff7020bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44862/0 (socket says 172.21.15.8:44862) 2023-08-11T12:25:58.721 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.717+0000 7fb53dd9a700 1 -- 172.21.15.8:0/2760149829 learned_addr learned my addr 172.21.15.8:0/2760149829 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:58.721 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.717+0000 7fb53e59b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ff70210e80 0x55ff70211260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.717+0000 7fb53ed9c700 1 --2- 172.21.15.8:0/2760149829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ff7020bff0 0x55ff70217c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.717+0000 7fb53dd9a700 1 -- 172.21.15.8:0/2760149829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ff70210e80 msgr2=0x55ff70211260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.717+0000 7fb53dd9a700 1 --2- 172.21.15.8:0/2760149829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ff70210e80 0x55ff70211260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.717+0000 7fb53dd9a700 1 -- 172.21.15.8:0/2760149829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ff7020bff0 msgr2=0x55ff70217c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:58.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.717+0000 7fb53dd9a700 1 --2- 172.21.15.8:0/2760149829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ff7020bff0 0x55ff70217c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.717+0000 7fb53dd9a700 1 -- 172.21.15.8:0/2760149829 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff6ffdd5d0 con 0x55ff7020b630 2023-08-11T12:25:58.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.717+0000 7fb53e59b700 1 --2- 172.21.15.8:0/2760149829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ff70210e80 0x55ff70211260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:58.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.718+0000 7fb53dd9a700 1 --2- 172.21.15.8:0/2760149829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff7020b630 0x55ff7020bab0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb52809a090 tx=0x7fb528022c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653e231d0fefad7a server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:58.727 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.718+0000 7fb52cff9700 1 -- 172.21.15.8:0/2760149829 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb528099ed0 con 0x55ff7020b630 2023-08-11T12:25:58.727 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.718+0000 7fb52cff9700 1 -- 172.21.15.8:0/2760149829 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb528099c40 con 0x55ff7020b630 2023-08-11T12:25:58.727 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.718+0000 7fb52cff9700 1 -- 172.21.15.8:0/2760149829 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5280a1e80 con 0x55ff7020b630 2023-08-11T12:25:58.727 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.719+0000 7fb554110b80 1 -- 172.21.15.8:0/2760149829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff7020b630 msgr2=0x55ff7020bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:58.727 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.719+0000 7fb554110b80 1 --2- 172.21.15.8:0/2760149829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff7020b630 0x55ff7020bab0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb52809a090 tx=0x7fb528022c90 comp rx=0 tx=0).stop 2023-08-11T12:25:58.727 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.719+0000 7fb554110b80 1 -- 172.21.15.8:0/2760149829 shutdown_connections 2023-08-11T12:25:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.719+0000 7fb554110b80 1 --2- 172.21.15.8:0/2760149829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ff70210e80 0x55ff70211260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.719+0000 7fb554110b80 1 --2- 172.21.15.8:0/2760149829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ff7020bff0 0x55ff70217c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.719+0000 7fb554110b80 1 --2- 172.21.15.8:0/2760149829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff7020b630 0x55ff7020bab0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.719+0000 7fb554110b80 1 -- 172.21.15.8:0/2760149829 >> 172.21.15.8:0/2760149829 conn(0x55ff701388f0 msgr2=0x55ff70205e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.719+0000 7fb554110b80 1 -- 172.21.15.8:0/2760149829 shutdown_connections 2023-08-11T12:25:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.719+0000 7fb554110b80 1 -- 172.21.15.8:0/2760149829 wait complete. 2023-08-11T12:25:58.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.720+0000 7fb554110b80 1 -- start start 2023-08-11T12:25:58.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.720+0000 7fb554110b80 1 Processor -- start 2023-08-11T12:25:58.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.720+0000 7fb554110b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ff7020b630 0x55ff7021a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:58.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.720+0000 7fb554110b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ff7020bff0 0x55ff7021ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:58.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.720+0000 7fb554110b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff70210e80 0x55ff70214950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:58.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.720+0000 7fb554110b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff700fba60 con 0x55ff70210e80 2023-08-11T12:25:58.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.720+0000 7fb554110b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff700fb760 con 0x55ff7020b630 2023-08-11T12:25:58.730 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.720+0000 7fb554110b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff6ffdf8c0 con 0x55ff7020bff0 2023-08-11T12:25:58.730 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.720+0000 7fb554110b80 10 client.0 _ll_register_callbacks cb 0x55ff700fea50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:25:58.730 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.721+0000 7fb53e59b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ff7020b630 0x55ff7021a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:58.730 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.721+0000 7fb53dd9a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ff7020bff0 0x55ff7021ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:58.730 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.721+0000 7fb53e59b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ff7020b630 0x55ff7021a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:58782/0 (socket says 172.21.15.8:58782) 2023-08-11T12:25:58.730 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.721+0000 7fb53e59b700 1 -- 172.21.15.8:0/2822822030 learned_addr learned my addr 172.21.15.8:0/2822822030 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.721+0000 7fb53ed9c700 1 --2- 172.21.15.8:0/2822822030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff70210e80 0x55ff70214950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.721+0000 7fb53dd9a700 1 -- 172.21.15.8:0/2822822030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ff7020b630 msgr2=0x55ff7021a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.721+0000 7fb53dd9a700 1 --2- 172.21.15.8:0/2822822030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ff7020b630 0x55ff7021a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.721+0000 7fb53dd9a700 1 -- 172.21.15.8:0/2822822030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff70210e80 msgr2=0x55ff70214950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.721+0000 7fb53dd9a700 1 --2- 172.21.15.8:0/2822822030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff70210e80 0x55ff70214950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.721+0000 7fb53dd9a700 1 -- 172.21.15.8:0/2822822030 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb534017070 con 0x55ff7020bff0 2023-08-11T12:25:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.721+0000 7fb53dd9a700 1 --2- 172.21.15.8:0/2822822030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ff7020bff0 0x55ff7021ab60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb52809a090 tx=0x7fb528022af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d5c473bb522b84d server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.721+0000 7fb521ffb700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:25:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.721+0000 7fb521ffb700 1 -- 172.21.15.8:0/2822822030 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5280ca0f0 con 0x55ff7020bff0 2023-08-11T12:25:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.721+0000 7fb554110b80 1 -- 172.21.15.8:0/2822822030 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ff701fe7e0 con 0x55ff7020bff0 2023-08-11T12:25:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.722+0000 7fb521ffb700 1 -- 172.21.15.8:0/2822822030 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fb52809f050 con 0x55ff7020bff0 2023-08-11T12:25:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.722+0000 7fb521ffb700 1 -- 172.21.15.8:0/2822822030 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5280b2230 con 0x55ff7020bff0 2023-08-11T12:25:58.733 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.722+0000 7fb554110b80 10 client.26071 fetch_fsmap learned FSMap version 32 2023-08-11T12:25:58.733 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.722+0000 7fb554110b80 1 -- 172.21.15.8:0/2822822030 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7fb5381a5970 con 0x55ff7020bff0 2023-08-11T12:25:58.733 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.722+0000 7fb521ffb700 1 -- 172.21.15.8:0/2822822030 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ff701fe7e0 con 0x55ff7020bff0 2023-08-11T12:25:58.733 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.722+0000 7fb521ffb700 1 -- 172.21.15.8:0/2822822030 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 32) v1 ==== 7926+0+0 (secure 0 0 0) 0x7fb5280ca460 con 0x55ff7020bff0 2023-08-11T12:25:58.733 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.722+0000 7fb554110b80 10 client.26071 fetch_fsmap finished waiting for FSMap version 32 2023-08-11T12:25:58.734 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.722+0000 7fb554110b80 10 client.26071 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-11T12:25:58.734 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.722+0000 7fb554110b80 20 client.26071 populate_metadata read hostname 'smithi008' 2023-08-11T12:25:58.734 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.722+0000 7fb554110b80 1 --2- 172.21.15.8:0/2822822030 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55ff702248f0 0x55ff70226d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:58.734 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.722+0000 7fb554110b80 4 client.26071 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:25:58.734 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.722+0000 7fb554110b80 1 -- 172.21.15.8:0/2822822030 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ff701da480 con 0x55ff702248f0 2023-08-11T12:25:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.723+0000 7fb53e59b700 1 --2- 172.21.15.8:0/2822822030 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55ff702248f0 0x55ff70226d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.723+0000 7fb53e59b700 1 --2- 172.21.15.8:0/2822822030 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55ff702248f0 0x55ff70226d10 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2642a0f9a7a2df2a server_cookie=fb7e267dc02d6e87 in_seq=0 out_seq=0 2023-08-11T12:25:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.723+0000 7fb521ffb700 10 client.26071 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.724+0000 7fb521ffb700 1 -- 172.21.15.8:0/2822822030 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55ff701da480 con 0x55ff702248f0 2023-08-11T12:25:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.724+0000 7fb521ffb700 10 client.26071 handle_command_reply: tid=0 2023-08-11T12:25:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.724+0000 7fb554110b80 1 client.26071 shutdown 2023-08-11T12:25:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.724+0000 7fb554110b80 1 -- 172.21.15.8:0/2822822030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ff7020bff0 msgr2=0x55ff7021ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.724+0000 7fb554110b80 1 --2- 172.21.15.8:0/2822822030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ff7020bff0 0x55ff7021ab60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb52809a090 tx=0x7fb528022af0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.724+0000 7fb554110b80 1 -- 172.21.15.8:0/2822822030 shutdown_connections 2023-08-11T12:25:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.724+0000 7fb554110b80 1 --2- 172.21.15.8:0/2822822030 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55ff702248f0 0x55ff70226d10 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.724+0000 7fb554110b80 1 --2- 172.21.15.8:0/2822822030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff70210e80 0x55ff70214950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.737 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.724+0000 7fb521ffb700 0 client.26071 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:58.737 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.724+0000 7fb554110b80 1 --2- 172.21.15.8:0/2822822030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ff7020b630 0x55ff7021a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.737 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.724+0000 7fb554110b80 1 --2- 172.21.15.8:0/2822822030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ff7020bff0 0x55ff7021ab60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.737 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.724+0000 7fb554110b80 1 -- 172.21.15.8:0/2822822030 >> 172.21.15.8:0/2822822030 conn(0x55ff701388f0 msgr2=0x55ff702055d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:58.737 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.725+0000 7fb554110b80 1 -- 172.21.15.8:0/2822822030 shutdown_connections 2023-08-11T12:25:58.737 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.725+0000 7fb554110b80 1 -- 172.21.15.8:0/2822822030 wait complete. 2023-08-11T12:25:58.737 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.725+0000 7fb554110b80 20 client.26071 trim_cache size 0 max 16384 2023-08-11T12:25:58.756 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.754+0000 7fb554110b80 1 Processor -- start 2023-08-11T12:25:58.756 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.754+0000 7fb554110b80 1 -- start start 2023-08-11T12:25:58.756 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.754+0000 7fb554110b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ff7020b630 0x55ff70214a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:58.756 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.754+0000 7fb554110b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ff7020bff0 0x55ff7021a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.754+0000 7fb554110b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff70210e80 0x55ff70210480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.754+0000 7fb554110b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff70206a60 con 0x55ff70210e80 2023-08-11T12:25:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.754+0000 7fb554110b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff70207db0 con 0x55ff7020bff0 2023-08-11T12:25:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.754+0000 7fb554110b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff70200bd0 con 0x55ff7020b630 2023-08-11T12:25:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.754+0000 7fb53dd9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ff7020bff0 0x55ff7021a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.754+0000 7fb53e59b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ff7020b630 0x55ff70214a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.754+0000 7fb53dd9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ff7020bff0 0x55ff7021a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:58788/0 (socket says 172.21.15.8:58788) 2023-08-11T12:25:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.754+0000 7fb53e59b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ff7020b630 0x55ff70214a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:48240/0 (socket says 172.21.15.8:48240) 2023-08-11T12:25:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.754+0000 7fb53dd9a700 1 -- 172.21.15.8:0/2980068645 learned_addr learned my addr 172.21.15.8:0/2980068645 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.754+0000 7fb53ed9c700 1 --2- 172.21.15.8:0/2980068645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff70210e80 0x55ff70210480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.755+0000 7fb53e59b700 1 -- 172.21.15.8:0/2980068645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ff7020bff0 msgr2=0x55ff7021a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.755+0000 7fb53e59b700 1 --2- 172.21.15.8:0/2980068645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ff7020bff0 0x55ff7021a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.755+0000 7fb53e59b700 1 -- 172.21.15.8:0/2980068645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff70210e80 msgr2=0x55ff70210480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.755+0000 7fb53e59b700 1 --2- 172.21.15.8:0/2980068645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff70210e80 0x55ff70210480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.755+0000 7fb53e59b700 1 -- 172.21.15.8:0/2980068645 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff6ff89d80 con 0x55ff7020b630 2023-08-11T12:25:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.755+0000 7fb53dd9a700 1 --2- 172.21.15.8:0/2980068645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ff7020bff0 0x55ff7021a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:25:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.755+0000 7fb53e59b700 1 --2- 172.21.15.8:0/2980068645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ff7020b630 0x55ff70214a80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb534013010 tx=0x7fb534014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed24163603d221e server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.755+0000 7fb52d7fa700 1 -- 172.21.15.8:0/2980068645 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb534024040 con 0x55ff7020b630 2023-08-11T12:25:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.755+0000 7fb52d7fa700 1 -- 172.21.15.8:0/2980068645 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb534026040 con 0x55ff7020b630 2023-08-11T12:25:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.755+0000 7fb52d7fa700 1 -- 172.21.15.8:0/2980068645 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb534003e30 con 0x55ff7020b630 2023-08-11T12:25:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.756+0000 7fb554110b80 1 -- 172.21.15.8:0/2980068645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ff7020b630 msgr2=0x55ff70214a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.756+0000 7fb554110b80 1 --2- 172.21.15.8:0/2980068645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ff7020b630 0x55ff70214a80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb534013010 tx=0x7fb534014000 comp rx=0 tx=0).stop 2023-08-11T12:25:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.756+0000 7fb554110b80 1 -- 172.21.15.8:0/2980068645 shutdown_connections 2023-08-11T12:25:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.756+0000 7fb554110b80 1 --2- 172.21.15.8:0/2980068645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ff7020b630 0x55ff70214a80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.756+0000 7fb554110b80 1 --2- 172.21.15.8:0/2980068645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff70210e80 0x55ff70210480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.764 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.756+0000 7fb554110b80 1 --2- 172.21.15.8:0/2980068645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ff7020bff0 0x55ff7021a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.764 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.756+0000 7fb554110b80 1 -- 172.21.15.8:0/2980068645 >> 172.21.15.8:0/2980068645 conn(0x55ff701388f0 msgr2=0x55ff7020fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:58.764 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.756+0000 7fb554110b80 1 -- 172.21.15.8:0/2980068645 shutdown_connections 2023-08-11T12:25:58.764 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.756+0000 7fb554110b80 1 -- 172.21.15.8:0/2980068645 wait complete. 2023-08-11T12:25:58.764 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.756+0000 7fb554110b80 1 -- start start 2023-08-11T12:25:58.765 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.757+0000 7fb554110b80 1 Processor -- start 2023-08-11T12:25:58.765 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.757+0000 7fb554110b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ff7020b630 0x55ff702708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:58.765 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.757+0000 7fb554110b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff7020bff0 0x55ff70270df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:58.765 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.757+0000 7fb554110b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ff70210e80 0x55ff702715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:58.765 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.757+0000 7fb554110b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff70271ce0 con 0x55ff7020bff0 2023-08-11T12:25:58.765 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.757+0000 7fb554110b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff70271e50 con 0x55ff70210e80 2023-08-11T12:25:58.765 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.757+0000 7fb554110b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff70272010 con 0x55ff7020b630 2023-08-11T12:25:58.766 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.757+0000 7fb554110b80 10 client.0 _ll_register_callbacks cb 0x7fb528022b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:25:58.766 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.757+0000 7fb53e59b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ff7020b630 0x55ff702708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:58.766 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.757+0000 7fb53e59b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ff7020b630 0x55ff702708b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:48246/0 (socket says 172.21.15.8:48246) 2023-08-11T12:25:58.766 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.757+0000 7fb53e59b700 1 -- 172.21.15.8:0/718250100 learned_addr learned my addr 172.21.15.8:0/718250100 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:25:58.766 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.757+0000 7fb53dd9a700 1 --2- 172.21.15.8:0/718250100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff7020bff0 0x55ff70270df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:58.766 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.758+0000 7fb53ed9c700 1 --2- 172.21.15.8:0/718250100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ff70210e80 0x55ff702715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.758+0000 7fb53e59b700 1 -- 172.21.15.8:0/718250100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ff70210e80 msgr2=0x55ff702715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.758+0000 7fb53e59b700 1 --2- 172.21.15.8:0/718250100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ff70210e80 0x55ff702715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.758+0000 7fb53e59b700 1 -- 172.21.15.8:0/718250100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff7020bff0 msgr2=0x55ff70270df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:25:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.758+0000 7fb53e59b700 1 --2- 172.21.15.8:0/718250100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff7020bff0 0x55ff70270df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.758+0000 7fb53e59b700 1 -- 172.21.15.8:0/718250100 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5381a5970 con 0x55ff7020b630 2023-08-11T12:25:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.758+0000 7fb53dd9a700 1 --2- 172.21.15.8:0/718250100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff7020bff0 0x55ff70270df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:25:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.758+0000 7fb53e59b700 1 --2- 172.21.15.8:0/718250100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ff7020b630 0x55ff702708b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb534004330 tx=0x7fb534009040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db890797148229f9 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:25:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.758+0000 7fb521ffb700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:25:58.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.758+0000 7fb521ffb700 1 -- 172.21.15.8:0/718250100 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb534024070 con 0x55ff7020b630 2023-08-11T12:25:58.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.758+0000 7fb554110b80 1 -- 172.21.15.8:0/718250100 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb528099c40 con 0x55ff7020b630 2023-08-11T12:25:58.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.758+0000 7fb521ffb700 1 -- 172.21.15.8:0/718250100 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fb534003a90 con 0x55ff7020b630 2023-08-11T12:25:58.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.758+0000 7fb521ffb700 1 -- 172.21.15.8:0/718250100 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb534003c50 con 0x55ff7020b630 2023-08-11T12:25:58.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.758+0000 7fb554110b80 10 client.26077 fetch_fsmap learned FSMap version 32 2023-08-11T12:25:58.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.758+0000 7fb554110b80 1 -- 172.21.15.8:0/718250100 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7fb534004040 con 0x55ff7020b630 2023-08-11T12:25:58.769 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.759+0000 7fb521ffb700 1 -- 172.21.15.8:0/718250100 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb528099c40 con 0x55ff7020b630 2023-08-11T12:25:58.770 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.759+0000 7fb521ffb700 1 -- 172.21.15.8:0/718250100 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 32) v1 ==== 7926+0+0 (secure 0 0 0) 0x7fb534004360 con 0x55ff7020b630 2023-08-11T12:25:58.770 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.759+0000 7fb554110b80 10 client.26077 fetch_fsmap finished waiting for FSMap version 32 2023-08-11T12:25:58.770 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.759+0000 7fb554110b80 10 client.26077 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-11T12:25:58.770 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.759+0000 7fb554110b80 20 client.26077 populate_metadata read hostname 'smithi008' 2023-08-11T12:25:58.770 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.759+0000 7fb554110b80 1 --2- 172.21.15.8:0/718250100 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55ff702248f0 0x55ff7027b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:25:58.770 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.759+0000 7fb554110b80 4 client.26077 mds_command: new command op to 24575 tid=0[{"prefix": "flush journal"}] 2023-08-11T12:25:58.770 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.759+0000 7fb554110b80 1 -- 172.21.15.8:0/718250100 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ff701567c0 con 0x55ff702248f0 2023-08-11T12:25:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.759+0000 7fb53dd9a700 1 --2- 172.21.15.8:0/718250100 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55ff702248f0 0x55ff7027b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:25:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.760+0000 7fb53dd9a700 1 --2- 172.21.15.8:0/718250100 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55ff702248f0 0x55ff7027b8a0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bb0ffbb94098b97 server_cookie=85d6fe4e3449c160 in_seq=0 out_seq=0 2023-08-11T12:25:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.760+0000 7fb521ffb700 10 client.26077 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.788+0000 7fb521ffb700 1 -- 172.21.15.8:0/718250100 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ff701567c0 con 0x55ff702248f0 2023-08-11T12:25:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.788+0000 7fb521ffb700 10 client.26077 handle_command_reply: tid=0 2023-08-11T12:25:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.788+0000 7fb554110b80 1 client.26077 shutdown 2023-08-11T12:25:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.788+0000 7fb554110b80 1 -- 172.21.15.8:0/718250100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ff7020b630 msgr2=0x55ff702708b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:58.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.788+0000 7fb554110b80 1 --2- 172.21.15.8:0/718250100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ff7020b630 0x55ff702708b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb534004330 tx=0x7fb534009040 comp rx=0 tx=0).stop 2023-08-11T12:25:58.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.789+0000 7fb554110b80 1 -- 172.21.15.8:0/718250100 shutdown_connections 2023-08-11T12:25:58.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.789+0000 7fb554110b80 1 --2- 172.21.15.8:0/718250100 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55ff702248f0 0x55ff7027b8a0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.789+0000 7fb554110b80 1 --2- 172.21.15.8:0/718250100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ff7020b630 0x55ff702708b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.789+0000 7fb554110b80 1 --2- 172.21.15.8:0/718250100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ff70210e80 0x55ff702715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.789+0000 7fb554110b80 1 --2- 172.21.15.8:0/718250100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff7020bff0 0x55ff70270df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.789+0000 7fb554110b80 1 -- 172.21.15.8:0/718250100 >> 172.21.15.8:0/718250100 conn(0x55ff701388f0 msgr2=0x55ff7020aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:58.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.789+0000 7fb521ffb700 0 client.26077 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:25:58.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.789+0000 7fb554110b80 1 -- 172.21.15.8:0/718250100 shutdown_connections 2023-08-11T12:25:58.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.789+0000 7fb554110b80 1 -- 172.21.15.8:0/718250100 wait complete. 2023-08-11T12:25:58.796 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.789+0000 7fb554110b80 20 client.26077 trim_cache size 0 max 16384 2023-08-11T12:25:58.796 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-08-11T12:25:58.796 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-08-11T12:25:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-08-11T12:25:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-08-11T12:25:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.789+0000 7fb5407ff700 1 -- 172.21.15.8:0/1387436836 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb5240a01e0 msgr2=0x7fb5240a26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.789+0000 7fb5407ff700 1 --2- 172.21.15.8:0/1387436836 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb5240a01e0 0x7fb5240a26a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb534009be0 tx=0x7fb534009260 comp rx=0 tx=0).stop 2023-08-11T12:25:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.789+0000 7fb5407ff700 1 -- 172.21.15.8:0/1387436836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb538101280 msgr2=0x7fb538073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:25:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.789+0000 7fb5407ff700 1 --2- 172.21.15.8:0/1387436836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb538101280 0x7fb538073160 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb528005910 tx=0x7fb528005720 comp rx=0 tx=0).stop 2023-08-11T12:25:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.790+0000 7fb5407ff700 1 -- 172.21.15.8:0/1387436836 shutdown_connections 2023-08-11T12:25:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.790+0000 7fb5407ff700 1 --2- 172.21.15.8:0/1387436836 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb5240a01e0 0x7fb5240a26a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.790+0000 7fb5407ff700 1 --2- 172.21.15.8:0/1387436836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5381008c0 0x7fb538072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.790+0000 7fb5407ff700 1 --2- 172.21.15.8:0/1387436836 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5381068d0 0x7fb5381a4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.790+0000 7fb5407ff700 1 --2- 172.21.15.8:0/1387436836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb538101280 0x7fb538073160 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:25:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.790+0000 7fb5407ff700 1 -- 172.21.15.8:0/1387436836 >> 172.21.15.8:0/1387436836 conn(0x7fb5380fc3d0 msgr2=0x7fb5380fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:25:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.790+0000 7fb5407ff700 1 -- 172.21.15.8:0/1387436836 shutdown_connections 2023-08-11T12:25:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:25:58.790+0000 7fb5407ff700 1 -- 172.21.15.8:0/1387436836 wait complete. 2023-08-11T12:25:58.885 INFO:teuthology.orchestra.run.smithi008.stderr:20100000 of 50000000 tuples (40%) done (elapsed 63.57 s, remaining 94.57 s) 2023-08-11T12:25:59.083 INFO:teuthology.orchestra.run.smithi008.stderr:20200000 of 50000000 tuples (40%) done (elapsed 63.77 s, remaining 94.08 s) 2023-08-11T12:25:59.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:25:58 smithi194 ceph-mon[130905]: pgmap v44: 129 pgs: 129 active+clean; 3.5 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 145 MiB/s wr, 97 op/s 2023-08-11T12:25:59.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:25:58 smithi045 ceph-mon[130284]: pgmap v44: 129 pgs: 129 active+clean; 3.5 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 145 MiB/s wr, 97 op/s 2023-08-11T12:25:59.282 INFO:teuthology.orchestra.run.smithi008.stderr:20300000 of 50000000 tuples (40%) done (elapsed 63.97 s, remaining 93.59 s) 2023-08-11T12:25:59.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:25:58 smithi008 ceph-mon[97158]: pgmap v44: 129 pgs: 129 active+clean; 3.5 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 145 MiB/s wr, 97 op/s 2023-08-11T12:25:59.499 INFO:teuthology.orchestra.run.smithi008.stderr:20400000 of 50000000 tuples (40%) done (elapsed 64.19 s, remaining 93.13 s) 2023-08-11T12:25:59.648 INFO:teuthology.orchestra.run.smithi008.stderr:20500000 of 50000000 tuples (41%) done (elapsed 64.34 s, remaining 92.58 s) 2023-08-11T12:25:59.853 INFO:teuthology.orchestra.run.smithi008.stderr:20600000 of 50000000 tuples (41%) done (elapsed 64.54 s, remaining 92.11 s) 2023-08-11T12:26:00.093 INFO:teuthology.orchestra.run.smithi008.stderr:20700000 of 50000000 tuples (41%) done (elapsed 64.78 s, remaining 91.69 s) 2023-08-11T12:26:00.320 INFO:teuthology.orchestra.run.smithi008.stderr:20800000 of 50000000 tuples (41%) done (elapsed 65.01 s, remaining 91.26 s) 2023-08-11T12:26:01.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:00 smithi008 ceph-mon[97158]: pgmap v45: 129 pgs: 129 active+clean; 3.5 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 85 MiB/s wr, 49 op/s 2023-08-11T12:26:01.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:00 smithi194 ceph-mon[130905]: pgmap v45: 129 pgs: 129 active+clean; 3.5 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 85 MiB/s wr, 49 op/s 2023-08-11T12:26:01.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:00 smithi045 ceph-mon[130284]: pgmap v45: 129 pgs: 129 active+clean; 3.5 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 85 MiB/s wr, 49 op/s 2023-08-11T12:26:02.147 INFO:teuthology.orchestra.run.smithi008.stderr:20900000 of 50000000 tuples (41%) done (elapsed 66.83 s, remaining 93.06 s) 2023-08-11T12:26:03.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:02 smithi194 ceph-mon[130905]: pgmap v46: 129 pgs: 129 active+clean; 3.5 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 101 MiB/s wr, 115 op/s 2023-08-11T12:26:03.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:02 smithi045 ceph-mon[130284]: pgmap v46: 129 pgs: 129 active+clean; 3.5 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 101 MiB/s wr, 115 op/s 2023-08-11T12:26:03.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:02 smithi008 ceph-mon[97158]: pgmap v46: 129 pgs: 129 active+clean; 3.5 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 101 MiB/s wr, 115 op/s 2023-08-11T12:26:04.129 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:26:04.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.382+0000 7f7682bff700 1 -- 172.21.15.8:0/1907108456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f767c0735e0 msgr2=0x7f767c111430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:04.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.382+0000 7f7682bff700 1 --2- 172.21.15.8:0/1907108456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f767c0735e0 0x7f767c111430 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7668009990 tx=0x7f7668009ca0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.382+0000 7f7682bff700 1 -- 172.21.15.8:0/1907108456 shutdown_connections 2023-08-11T12:26:04.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.382+0000 7f7682bff700 1 --2- 172.21.15.8:0/1907108456 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f767c111970 0x7f767c113d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.382+0000 7f7682bff700 1 --2- 172.21.15.8:0/1907108456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f767c072cc0 0x7f767c0730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.382+0000 7f7682bff700 1 --2- 172.21.15.8:0/1907108456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f767c0735e0 0x7f767c111430 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.382+0000 7f7682bff700 1 -- 172.21.15.8:0/1907108456 >> 172.21.15.8:0/1907108456 conn(0x7f767c0fc490 msgr2=0x7f767c0fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:04.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.382+0000 7f7682bff700 1 -- 172.21.15.8:0/1907108456 shutdown_connections 2023-08-11T12:26:04.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.382+0000 7f7682bff700 1 -- 172.21.15.8:0/1907108456 wait complete. 2023-08-11T12:26:04.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.384+0000 7f7682bff700 1 Processor -- start 2023-08-11T12:26:04.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.384+0000 7f7682bff700 1 -- start start 2023-08-11T12:26:04.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.384+0000 7f7682bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f767c072cc0 0x7f767c19d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:04.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.384+0000 7f7682bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f767c0735e0 0x7f767c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:04.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.384+0000 7f7682bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f767c111970 0x7f767c1a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:04.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.384+0000 7f7682bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767c1a20e0 con 0x7f767c111970 2023-08-11T12:26:04.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.384+0000 7f7682bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767c1a2250 con 0x7f767c072cc0 2023-08-11T12:26:04.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.384+0000 7f7682bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767c1a2410 con 0x7f767c0735e0 2023-08-11T12:26:04.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.385+0000 7f768099b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f767c072cc0 0x7f767c19d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:04.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.385+0000 7f767bfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f767c0735e0 0x7f767c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:04.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.385+0000 7f768099b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f767c072cc0 0x7f767c19d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:58820/0 (socket says 172.21.15.8:58820) 2023-08-11T12:26:04.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.385+0000 7f767bfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f767c0735e0 0x7f767c19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:48258/0 (socket says 172.21.15.8:48258) 2023-08-11T12:26:04.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.385+0000 7f768099b700 1 -- 172.21.15.8:0/193136915 learned_addr learned my addr 172.21.15.8:0/193136915 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:04.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.385+0000 7f768119c700 1 --2- 172.21.15.8:0/193136915 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f767c111970 0x7f767c1a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:04.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.385+0000 7f768099b700 1 -- 172.21.15.8:0/193136915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f767c0735e0 msgr2=0x7f767c19d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:04.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.385+0000 7f768099b700 1 --2- 172.21.15.8:0/193136915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f767c0735e0 0x7f767c19d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.385+0000 7f768099b700 1 -- 172.21.15.8:0/193136915 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f767c111970 msgr2=0x7f767c1a1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:04.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.385+0000 7f768099b700 1 --2- 172.21.15.8:0/193136915 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f767c111970 0x7f767c1a1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.385+0000 7f768099b700 1 -- 172.21.15.8:0/193136915 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76680095f0 con 0x7f767c072cc0 2023-08-11T12:26:04.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.385+0000 7f767bfff700 1 --2- 172.21.15.8:0/193136915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f767c0735e0 0x7f767c19d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:26:04.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.386+0000 7f768099b700 1 --2- 172.21.15.8:0/193136915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f767c072cc0 0x7f767c19d100 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f767000e9a0 tx=0x7f767000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:04.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.386+0000 7f7679ffb700 1 -- 172.21.15.8:0/193136915 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7670009790 con 0x7f767c072cc0 2023-08-11T12:26:04.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.386+0000 7f7682bff700 1 -- 172.21.15.8:0/193136915 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f767c1a26f0 con 0x7f767c072cc0 2023-08-11T12:26:04.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.386+0000 7f7679ffb700 1 -- 172.21.15.8:0/193136915 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f767000cbd0 con 0x7f767c072cc0 2023-08-11T12:26:04.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.386+0000 7f7679ffb700 1 -- 172.21.15.8:0/193136915 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7670018680 con 0x7f767c072cc0 2023-08-11T12:26:04.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.386+0000 7f7682bff700 1 -- 172.21.15.8:0/193136915 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f767c1a9f30 con 0x7f767c072cc0 2023-08-11T12:26:04.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.390+0000 7f7679ffb700 1 -- 172.21.15.8:0/193136915 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 24) v1 ==== 134903+0+0 (secure 0 0 0) 0x7f767000cd40 con 0x7f767c072cc0 2023-08-11T12:26:04.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.392+0000 7f7696612b80 1 Processor -- start 2023-08-11T12:26:04.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.392+0000 7f7696612b80 1 -- start start 2023-08-11T12:26:04.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.393+0000 7f7696612b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561c5c3e5310 0x561c5c3e56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:04.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.393+0000 7f7696612b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c5c3e5c30 0x561c5c3df8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:04.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.393+0000 7f7696612b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561c5c3dfe20 0x561c5c3e0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:04.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.393+0000 7f7696612b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c5c338630 con 0x561c5c3dfe20 2023-08-11T12:26:04.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.393+0000 7f7696612b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c5c335f50 con 0x561c5c3e5310 2023-08-11T12:26:04.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.393+0000 7f7696612b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c5c331840 con 0x561c5c3e5c30 2023-08-11T12:26:04.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.393+0000 7f768119c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561c5c3e5310 0x561c5c3e56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:04.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.393+0000 7f768119c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561c5c3e5310 0x561c5c3e56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:58830/0 (socket says 172.21.15.8:58830) 2023-08-11T12:26:04.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.393+0000 7f768119c700 1 -- 172.21.15.8:0/4106782763 learned_addr learned my addr 172.21.15.8:0/4106782763 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:04.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.393+0000 7f768099b700 1 --2- 172.21.15.8:0/4106782763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c5c3e5c30 0x561c5c3df8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:04.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.393+0000 7f767bfff700 1 --2- 172.21.15.8:0/4106782763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561c5c3dfe20 0x561c5c3e0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:04.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.394+0000 7f768119c700 1 -- 172.21.15.8:0/4106782763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c5c3e5c30 msgr2=0x561c5c3df8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:04.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.394+0000 7f768119c700 1 --2- 172.21.15.8:0/4106782763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c5c3e5c30 0x561c5c3df8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.394+0000 7f768119c700 1 -- 172.21.15.8:0/4106782763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561c5c3dfe20 msgr2=0x561c5c3e0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:04.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.394+0000 7f768119c700 1 --2- 172.21.15.8:0/4106782763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561c5c3dfe20 0x561c5c3e0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.394+0000 7f768119c700 1 -- 172.21.15.8:0/4106782763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c5c1b1630 con 0x561c5c3e5310 2023-08-11T12:26:04.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.394+0000 7f767bfff700 1 --2- 172.21.15.8:0/4106782763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561c5c3dfe20 0x561c5c3e0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:26:04.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.395+0000 7f768099b700 1 --2- 172.21.15.8:0/4106782763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c5c3e5c30 0x561c5c3df8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:26:04.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.395+0000 7f7679ffb700 1 --2- 172.21.15.8:0/193136915 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f766c0a0260 0x7f766c0a2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:04.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.395+0000 7f7679ffb700 1 -- 172.21.15.8:0/193136915 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f7670014070 con 0x7f767c072cc0 2023-08-11T12:26:04.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.395+0000 7f768099b700 1 --2- 172.21.15.8:0/193136915 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f766c0a0260 0x7f766c0a2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:04.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.395+0000 7f768119c700 1 --2- 172.21.15.8:0/4106782763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561c5c3e5310 0x561c5c3e56f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f76740093e0 tx=0x7f7674009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec613dde96c8826b server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:04.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.396+0000 7f7666ffd700 1 -- 172.21.15.8:0/4106782763 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767400e070 con 0x561c5c3e5310 2023-08-11T12:26:04.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.396+0000 7f7666ffd700 1 -- 172.21.15.8:0/4106782763 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f767400f040 con 0x561c5c3e5310 2023-08-11T12:26:04.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.396+0000 7f7666ffd700 1 -- 172.21.15.8:0/4106782763 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7674014720 con 0x561c5c3e5310 2023-08-11T12:26:04.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.397+0000 7f7696612b80 1 -- 172.21.15.8:0/4106782763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561c5c3e5310 msgr2=0x561c5c3e56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:04.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.397+0000 7f7696612b80 1 --2- 172.21.15.8:0/4106782763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561c5c3e5310 0x561c5c3e56f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f76740093e0 tx=0x7f7674009920 comp rx=0 tx=0).stop 2023-08-11T12:26:04.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.397+0000 7f768099b700 1 --2- 172.21.15.8:0/193136915 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f766c0a0260 0x7f766c0a2720 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f76700c9100 tx=0x7f7670010aa0 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:04.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.397+0000 7f7696612b80 1 -- 172.21.15.8:0/4106782763 shutdown_connections 2023-08-11T12:26:04.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.397+0000 7f7696612b80 1 --2- 172.21.15.8:0/4106782763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561c5c3dfe20 0x561c5c3e0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.397+0000 7f7696612b80 1 --2- 172.21.15.8:0/4106782763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561c5c3e5310 0x561c5c3e56f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.397+0000 7f7696612b80 1 --2- 172.21.15.8:0/4106782763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c5c3e5c30 0x561c5c3df8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.397+0000 7f7696612b80 1 -- 172.21.15.8:0/4106782763 >> 172.21.15.8:0/4106782763 conn(0x561c5c30c950 msgr2=0x561c5c3da3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:04.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.397+0000 7f7696612b80 1 -- 172.21.15.8:0/4106782763 shutdown_connections 2023-08-11T12:26:04.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.397+0000 7f7696612b80 1 -- 172.21.15.8:0/4106782763 wait complete. 2023-08-11T12:26:04.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.398+0000 7f7696612b80 1 -- start start 2023-08-11T12:26:04.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.398+0000 7f7696612b80 1 Processor -- start 2023-08-11T12:26:04.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.399+0000 7f7696612b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561c5c3dfe20 0x561c5c3ebc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:04.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.399+0000 7f7696612b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561c5c3e5310 0x561c5c3e8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:04.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.399+0000 7f7696612b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c5c3e5c30 0x561c5c3e9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:04.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.399+0000 7f7696612b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c5c2cfac0 con 0x561c5c3dfe20 2023-08-11T12:26:04.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.399+0000 7f7696612b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c5c2cf7c0 con 0x561c5c3e5310 2023-08-11T12:26:04.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.399+0000 7f7696612b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c5c1b3920 con 0x561c5c3e5c30 2023-08-11T12:26:04.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.399+0000 7f7696612b80 10 client.0 _ll_register_callbacks cb 0x561c5c2d2ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:26:04.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.400+0000 7f767bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561c5c3e5310 0x561c5c3e8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:04.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.400+0000 7f767bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561c5c3e5310 0x561c5c3e8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:58840/0 (socket says 172.21.15.8:58840) 2023-08-11T12:26:04.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.400+0000 7f767bfff700 1 -- 172.21.15.8:0/1191440711 learned_addr learned my addr 172.21.15.8:0/1191440711 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:04.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.400+0000 7f768119c700 1 --2- 172.21.15.8:0/1191440711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c5c3e5c30 0x561c5c3e9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:04.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.400+0000 7f768119c700 1 --2- 172.21.15.8:0/1191440711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561c5c3dfe20 0x561c5c3ebc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:04.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.401+0000 7f768119c700 1 -- 172.21.15.8:0/1191440711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561c5c3e5310 msgr2=0x561c5c3e8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:04.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.401+0000 7f768119c700 1 --2- 172.21.15.8:0/1191440711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561c5c3e5310 0x561c5c3e8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.401+0000 7f768119c700 1 -- 172.21.15.8:0/1191440711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561c5c3dfe20 msgr2=0x561c5c3ebc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:04.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.401+0000 7f768119c700 1 --2- 172.21.15.8:0/1191440711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561c5c3dfe20 0x561c5c3ebc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.401+0000 7f768119c700 1 -- 172.21.15.8:0/1191440711 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7674009090 con 0x561c5c3e5c30 2023-08-11T12:26:04.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.401+0000 7f768119c700 1 --2- 172.21.15.8:0/1191440711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c5c3e5c30 0x561c5c3e9670 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f76740093e0 tx=0x7f7674015f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fce7c23fb3702be server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:04.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.401+0000 7f765bfff700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:26:04.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.402+0000 7f765bfff700 1 -- 172.21.15.8:0/1191440711 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767400e070 con 0x561c5c3e5c30 2023-08-11T12:26:04.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.402+0000 7f765bfff700 1 -- 172.21.15.8:0/1191440711 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f76740210d0 con 0x561c5c3e5c30 2023-08-11T12:26:04.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.402+0000 7f7696612b80 1 -- 172.21.15.8:0/1191440711 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c5c3d2a90 con 0x561c5c3e5c30 2023-08-11T12:26:04.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.402+0000 7f765bfff700 1 -- 172.21.15.8:0/1191440711 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7674021290 con 0x561c5c3e5c30 2023-08-11T12:26:04.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.402+0000 7f7696612b80 10 client.26086 fetch_fsmap learned FSMap version 32 2023-08-11T12:26:04.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.402+0000 7f7696612b80 1 -- 172.21.15.8:0/1191440711 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x561c5c15dde0 con 0x561c5c3e5c30 2023-08-11T12:26:04.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.403+0000 7f765bfff700 1 -- 172.21.15.8:0/1191440711 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561c5c3d2a90 con 0x561c5c3e5c30 2023-08-11T12:26:04.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.403+0000 7f765bfff700 1 -- 172.21.15.8:0/1191440711 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 32) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f767401f940 con 0x561c5c3e5c30 2023-08-11T12:26:04.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.403+0000 7f7696612b80 10 client.26086 fetch_fsmap finished waiting for FSMap version 32 2023-08-11T12:26:04.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.403+0000 7f7696612b80 10 client.26086 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:26:04.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.403+0000 7f7696612b80 20 client.26086 populate_metadata read hostname 'smithi008' 2023-08-11T12:26:04.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.403+0000 7f7696612b80 1 --2- 172.21.15.8:0/1191440711 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x561c5c40a430 0x561c5c40c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:04.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.403+0000 7f7696612b80 4 client.26086 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:26:04.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.403+0000 7f7696612b80 1 -- 172.21.15.8:0/1191440711 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561c5c3ae4e0 con 0x561c5c40a430 2023-08-11T12:26:04.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.403+0000 7f767bfff700 1 --2- 172.21.15.8:0/1191440711 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x561c5c40a430 0x561c5c40c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:04.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.404+0000 7f765bfff700 10 client.26086 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:26:04.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.404+0000 7f767bfff700 1 --2- 172.21.15.8:0/1191440711 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x561c5c40a430 0x561c5c40c850 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc9f632655d2cf6c server_cookie=41e11b2b3bfa259a in_seq=0 out_seq=0 2023-08-11T12:26:04.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.405+0000 7f765bfff700 1 -- 172.21.15.8:0/1191440711 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x561c5c3ae4e0 con 0x561c5c40a430 2023-08-11T12:26:04.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.405+0000 7f765bfff700 10 client.26086 handle_command_reply: tid=0 2023-08-11T12:26:04.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.405+0000 7f7696612b80 1 client.26086 shutdown 2023-08-11T12:26:04.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.405+0000 7f7696612b80 1 -- 172.21.15.8:0/1191440711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c5c3e5c30 msgr2=0x561c5c3e9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:04.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.405+0000 7f7696612b80 1 --2- 172.21.15.8:0/1191440711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c5c3e5c30 0x561c5c3e9670 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f76740093e0 tx=0x7f7674015f50 comp rx=0 tx=0).stop 2023-08-11T12:26:04.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.405+0000 7f7696612b80 1 -- 172.21.15.8:0/1191440711 shutdown_connections 2023-08-11T12:26:04.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.405+0000 7f7696612b80 1 --2- 172.21.15.8:0/1191440711 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x561c5c40a430 0x561c5c40c850 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.405+0000 7f7696612b80 1 --2- 172.21.15.8:0/1191440711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c5c3e5c30 0x561c5c3e9670 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.405+0000 7f7696612b80 1 --2- 172.21.15.8:0/1191440711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561c5c3dfe20 0x561c5c3ebc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.405+0000 7f7696612b80 1 --2- 172.21.15.8:0/1191440711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561c5c3e5310 0x561c5c3e8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.405+0000 7f7696612b80 1 -- 172.21.15.8:0/1191440711 >> 172.21.15.8:0/1191440711 conn(0x561c5c30c950 msgr2=0x561c5c3d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:04.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.405+0000 7f765bfff700 0 client.26086 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:26:04.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.406+0000 7f7696612b80 1 -- 172.21.15.8:0/1191440711 shutdown_connections 2023-08-11T12:26:04.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.406+0000 7f7696612b80 1 -- 172.21.15.8:0/1191440711 wait complete. 2023-08-11T12:26:04.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.406+0000 7f7696612b80 20 client.26086 trim_cache size 0 max 16384 2023-08-11T12:26:04.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.426+0000 7f7696612b80 1 Processor -- start 2023-08-11T12:26:04.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.426+0000 7f7696612b80 1 -- start start 2023-08-11T12:26:04.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.427+0000 7f7696612b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561c5c3dfe20 0x561c5c3f0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:04.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.427+0000 7f7696612b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c5c3e5310 0x561c5c3e3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:04.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.427+0000 7f7696612b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561c5c3e5c30 0x561c5c3e36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:04.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.427+0000 7f7696612b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c5c3d2a90 con 0x561c5c3dfe20 2023-08-11T12:26:04.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.427+0000 7f7696612b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c5c3dbd40 con 0x561c5c3e5c30 2023-08-11T12:26:04.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.427+0000 7f7696612b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c5c3f54b0 con 0x561c5c3e5310 2023-08-11T12:26:04.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.427+0000 7f767bfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c5c3e5310 0x561c5c3e3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:04.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.427+0000 7f768119c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561c5c3dfe20 0x561c5c3f0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:04.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.427+0000 7f767bfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c5c3e5310 0x561c5c3e3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:48288/0 (socket says 172.21.15.8:48288) 2023-08-11T12:26:04.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.427+0000 7f767bfff700 1 -- 172.21.15.8:0/3451206933 learned_addr learned my addr 172.21.15.8:0/3451206933 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:04.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.427+0000 7f768119c700 1 --2- 172.21.15.8:0/3451206933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561c5c3e5c30 0x561c5c3e36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:04.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.427+0000 7f767bfff700 1 -- 172.21.15.8:0/3451206933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561c5c3e5c30 msgr2=0x561c5c3e36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:04.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.427+0000 7f767bfff700 1 --2- 172.21.15.8:0/3451206933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561c5c3e5c30 0x561c5c3e36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.427+0000 7f767bfff700 1 -- 172.21.15.8:0/3451206933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561c5c3dfe20 msgr2=0x561c5c3f0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:04.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.427+0000 7f767bfff700 1 --2- 172.21.15.8:0/3451206933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561c5c3dfe20 0x561c5c3f0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.427+0000 7f767bfff700 1 -- 172.21.15.8:0/3451206933 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c5c146c60 con 0x561c5c3e5310 2023-08-11T12:26:04.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.428+0000 7f767bfff700 1 --2- 172.21.15.8:0/3451206933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c5c3e5310 0x561c5c3e3180 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f76680098e0 tx=0x7f7668005fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=695049a886e8387a server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:04.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.428+0000 7f76677fe700 1 -- 172.21.15.8:0/3451206933 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766800bce0 con 0x561c5c3e5310 2023-08-11T12:26:04.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.428+0000 7f76677fe700 1 -- 172.21.15.8:0/3451206933 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f766801e040 con 0x561c5c3e5310 2023-08-11T12:26:04.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.428+0000 7f76677fe700 1 -- 172.21.15.8:0/3451206933 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76680052d0 con 0x561c5c3e5310 2023-08-11T12:26:04.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.429+0000 7f7696612b80 1 -- 172.21.15.8:0/3451206933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c5c3e5310 msgr2=0x561c5c3e3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:04.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.429+0000 7f7696612b80 1 --2- 172.21.15.8:0/3451206933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c5c3e5310 0x561c5c3e3180 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f76680098e0 tx=0x7f7668005fb0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.429+0000 7f7696612b80 1 -- 172.21.15.8:0/3451206933 shutdown_connections 2023-08-11T12:26:04.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.429+0000 7f7696612b80 1 --2- 172.21.15.8:0/3451206933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561c5c3e5c30 0x561c5c3e36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.429+0000 7f7696612b80 1 --2- 172.21.15.8:0/3451206933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561c5c3dfe20 0x561c5c3f0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.429+0000 7f7696612b80 1 --2- 172.21.15.8:0/3451206933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c5c3e5310 0x561c5c3e3180 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.429+0000 7f7696612b80 1 -- 172.21.15.8:0/3451206933 >> 172.21.15.8:0/3451206933 conn(0x561c5c30c950 msgr2=0x561c5c406830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:04.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.429+0000 7f7696612b80 1 -- 172.21.15.8:0/3451206933 shutdown_connections 2023-08-11T12:26:04.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.429+0000 7f7696612b80 1 -- 172.21.15.8:0/3451206933 wait complete. 2023-08-11T12:26:04.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.430+0000 7f7696612b80 1 -- start start 2023-08-11T12:26:04.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.430+0000 7f7696612b80 1 Processor -- start 2023-08-11T12:26:04.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.431+0000 7f7696612b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c5c3dfe20 0x561c5c3efda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:04.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.431+0000 7f7696612b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561c5c3e5310 0x561c5c3f02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:04.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.431+0000 7f7696612b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561c5c3e5c30 0x561c5c3ee570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:04.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.431+0000 7f7696612b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c5c3eec80 con 0x561c5c3e5310 2023-08-11T12:26:04.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.431+0000 7f7696612b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c5c3eedf0 con 0x561c5c3e5c30 2023-08-11T12:26:04.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.431+0000 7f7696612b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c5c3eefb0 con 0x561c5c3dfe20 2023-08-11T12:26:04.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.431+0000 7f7696612b80 10 client.0 _ll_register_callbacks cb 0x7f7674015c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:26:04.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.432+0000 7f767bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561c5c3e5310 0x561c5c3f02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:04.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.432+0000 7f768119c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c5c3dfe20 0x561c5c3efda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:04.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.432+0000 7f767bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561c5c3e5310 0x561c5c3f02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44942/0 (socket says 172.21.15.8:44942) 2023-08-11T12:26:04.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.432+0000 7f767bfff700 1 -- 172.21.15.8:0/2704839214 learned_addr learned my addr 172.21.15.8:0/2704839214 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:04.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.432+0000 7f768119c700 1 --2- 172.21.15.8:0/2704839214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561c5c3e5c30 0x561c5c3ee570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:04.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.432+0000 7f767bfff700 1 -- 172.21.15.8:0/2704839214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c5c3dfe20 msgr2=0x561c5c3efda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:04.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.432+0000 7f767bfff700 1 --2- 172.21.15.8:0/2704839214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c5c3dfe20 0x561c5c3efda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.432+0000 7f767bfff700 1 -- 172.21.15.8:0/2704839214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561c5c3e5c30 msgr2=0x561c5c3ee570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:04.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.432+0000 7f767bfff700 1 --2- 172.21.15.8:0/2704839214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561c5c3e5c30 0x561c5c3ee570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.432+0000 7f767bfff700 1 -- 172.21.15.8:0/2704839214 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f767c114710 con 0x561c5c3e5310 2023-08-11T12:26:04.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.432+0000 7f767bfff700 1 --2- 172.21.15.8:0/2704839214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561c5c3e5310 0x561c5c3f02e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f766800be60 tx=0x7f766800be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa865f750db332ed server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:04.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.432+0000 7f765bfff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:26:04.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.433+0000 7f765bfff700 1 -- 172.21.15.8:0/2704839214 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7668027b50 con 0x561c5c3e5310 2023-08-11T12:26:04.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.433+0000 7f7696612b80 1 -- 172.21.15.8:0/2704839214 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f767400f040 con 0x561c5c3e5310 2023-08-11T12:26:04.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.433+0000 7f765bfff700 1 -- 172.21.15.8:0/2704839214 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f7668027050 con 0x561c5c3e5310 2023-08-11T12:26:04.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.433+0000 7f765bfff700 1 -- 172.21.15.8:0/2704839214 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7668027210 con 0x561c5c3e5310 2023-08-11T12:26:04.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.433+0000 7f7696612b80 10 client.16041 fetch_fsmap learned FSMap version 32 2023-08-11T12:26:04.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.433+0000 7f7696612b80 1 -- 172.21.15.8:0/2704839214 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x561c5c184250 con 0x561c5c3e5310 2023-08-11T12:26:04.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.433+0000 7f765bfff700 1 -- 172.21.15.8:0/2704839214 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f767400f040 con 0x561c5c3e5310 2023-08-11T12:26:04.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.433+0000 7f765bfff700 1 -- 172.21.15.8:0/2704839214 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 32) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f7668027670 con 0x561c5c3e5310 2023-08-11T12:26:04.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.433+0000 7f7696612b80 10 client.16041 fetch_fsmap finished waiting for FSMap version 32 2023-08-11T12:26:04.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.433+0000 7f7696612b80 10 client.16041 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:26:04.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.433+0000 7f7696612b80 20 client.16041 populate_metadata read hostname 'smithi008' 2023-08-11T12:26:04.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.433+0000 7f7696612b80 1 --2- 172.21.15.8:0/2704839214 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x561c5c45ef40 0x561c5c461360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:04.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.433+0000 7f7696612b80 4 client.16041 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:26:04.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.433+0000 7f7696612b80 1 -- 172.21.15.8:0/2704839214 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561c5c32a820 con 0x561c5c45ef40 2023-08-11T12:26:04.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.434+0000 7f768119c700 1 --2- 172.21.15.8:0/2704839214 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x561c5c45ef40 0x561c5c461360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:04.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.434+0000 7f768119c700 1 --2- 172.21.15.8:0/2704839214 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x561c5c45ef40 0x561c5c461360 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=116dd7bdbf26ea74 server_cookie=5504a24f7266f749 in_seq=0 out_seq=0 2023-08-11T12:26:04.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.434+0000 7f765bfff700 10 client.16041 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:26:04.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.434+0000 7f765bfff700 1 -- 172.21.15.8:0/2704839214 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x561c5c32a820 con 0x561c5c45ef40 2023-08-11T12:26:04.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.434+0000 7f765bfff700 10 client.16041 handle_command_reply: tid=0 2023-08-11T12:26:04.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.435+0000 7f7696612b80 1 client.16041 shutdown 2023-08-11T12:26:04.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.435+0000 7f7696612b80 1 -- 172.21.15.8:0/2704839214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561c5c3e5310 msgr2=0x561c5c3f02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:04.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.435+0000 7f7696612b80 1 --2- 172.21.15.8:0/2704839214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561c5c3e5310 0x561c5c3f02e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f766800be60 tx=0x7f766800be90 comp rx=0 tx=0).stop 2023-08-11T12:26:04.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.435+0000 7f7696612b80 1 -- 172.21.15.8:0/2704839214 shutdown_connections 2023-08-11T12:26:04.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.435+0000 7f7696612b80 1 --2- 172.21.15.8:0/2704839214 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x561c5c45ef40 0x561c5c461360 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.435+0000 7f7696612b80 1 --2- 172.21.15.8:0/2704839214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c5c3dfe20 0x561c5c3efda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.435+0000 7f7696612b80 1 --2- 172.21.15.8:0/2704839214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561c5c3e5c30 0x561c5c3ee570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.435+0000 7f7696612b80 1 --2- 172.21.15.8:0/2704839214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561c5c3e5310 0x561c5c3f02e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.435+0000 7f765bfff700 0 client.16041 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:26:04.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.435+0000 7f7696612b80 1 -- 172.21.15.8:0/2704839214 >> 172.21.15.8:0/2704839214 conn(0x561c5c30c950 msgr2=0x561c5c3e3180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:04.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.435+0000 7f7696612b80 1 -- 172.21.15.8:0/2704839214 shutdown_connections 2023-08-11T12:26:04.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.435+0000 7f7696612b80 1 -- 172.21.15.8:0/2704839214 wait complete. 2023-08-11T12:26:04.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.436+0000 7f7696612b80 20 client.16041 trim_cache size 0 max 16384 2023-08-11T12:26:04.444 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:26:04.444 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:26:04.444 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:26:04.445 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:26:04.445 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:26:04.445 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:26:04.445 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:26:04.445 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:26:04.445 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:26:04.445 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:26:04.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.436+0000 7f7682bff700 1 -- 172.21.15.8:0/193136915 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f766c0a0260 msgr2=0x7f766c0a2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:04.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.436+0000 7f7682bff700 1 --2- 172.21.15.8:0/193136915 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f766c0a0260 0x7f766c0a2720 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f76700c9100 tx=0x7f7670010aa0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.436+0000 7f7682bff700 1 -- 172.21.15.8:0/193136915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f767c072cc0 msgr2=0x7f767c19d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:04.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.436+0000 7f7682bff700 1 --2- 172.21.15.8:0/193136915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f767c072cc0 0x7f767c19d100 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f767000e9a0 tx=0x7f767000ecb0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.436+0000 7f7682bff700 1 -- 172.21.15.8:0/193136915 shutdown_connections 2023-08-11T12:26:04.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.436+0000 7f7682bff700 1 --2- 172.21.15.8:0/193136915 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f767c111970 0x7f767c1a1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.436+0000 7f7682bff700 1 --2- 172.21.15.8:0/193136915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f767c072cc0 0x7f767c19d100 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.436+0000 7f7682bff700 1 --2- 172.21.15.8:0/193136915 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f766c0a0260 0x7f766c0a2720 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.436+0000 7f7682bff700 1 --2- 172.21.15.8:0/193136915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f767c0735e0 0x7f767c19d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:04.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.436+0000 7f7682bff700 1 -- 172.21.15.8:0/193136915 >> 172.21.15.8:0/193136915 conn(0x7f767c0fc490 msgr2=0x7f767c0fd100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:04.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.437+0000 7f7682bff700 1 -- 172.21.15.8:0/193136915 shutdown_connections 2023-08-11T12:26:04.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:04.437+0000 7f7682bff700 1 -- 172.21.15.8:0/193136915 wait complete. 2023-08-11T12:26:04.460 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:26:05.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:04 smithi194 ceph-mon[130905]: pgmap v47: 129 pgs: 129 active+clean; 3.5 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 78 MiB/s wr, 101 op/s 2023-08-11T12:26:05.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:04 smithi045 ceph-mon[130284]: pgmap v47: 129 pgs: 129 active+clean; 3.5 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 78 MiB/s wr, 101 op/s 2023-08-11T12:26:05.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:04 smithi008 ceph-mon[97158]: pgmap v47: 129 pgs: 129 active+clean; 3.5 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 78 MiB/s wr, 101 op/s 2023-08-11T12:26:07.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:06 smithi194 ceph-mon[130905]: pgmap v48: 129 pgs: 129 active+clean; 3.5 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 78 MiB/s wr, 101 op/s 2023-08-11T12:26:07.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:06 smithi045 ceph-mon[130284]: pgmap v48: 129 pgs: 129 active+clean; 3.5 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 78 MiB/s wr, 101 op/s 2023-08-11T12:26:07.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:06 smithi008 ceph-mon[97158]: pgmap v48: 129 pgs: 129 active+clean; 3.5 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 78 MiB/s wr, 101 op/s 2023-08-11T12:26:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:08 smithi194 ceph-mon[130905]: pgmap v49: 129 pgs: 129 active+clean; 3.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 79 MiB/s wr, 242 op/s 2023-08-11T12:26:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:08 smithi194 ceph-mon[130905]: mgrmap e25: x(active, since 92s), standbys: y, z 2023-08-11T12:26:09.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:08 smithi045 ceph-mon[130284]: pgmap v49: 129 pgs: 129 active+clean; 3.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 79 MiB/s wr, 242 op/s 2023-08-11T12:26:09.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:08 smithi045 ceph-mon[130284]: mgrmap e25: x(active, since 92s), standbys: y, z 2023-08-11T12:26:09.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:08 smithi008 ceph-mon[97158]: pgmap v49: 129 pgs: 129 active+clean; 3.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 79 MiB/s wr, 242 op/s 2023-08-11T12:26:09.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:08 smithi008 ceph-mon[97158]: mgrmap e25: x(active, since 92s), standbys: y, z 2023-08-11T12:26:11.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:10 smithi008 ceph-mon[97158]: pgmap v50: 129 pgs: 129 active+clean; 3.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 18 MiB/s wr, 206 op/s 2023-08-11T12:26:11.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:10 smithi194 ceph-mon[130905]: pgmap v50: 129 pgs: 129 active+clean; 3.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 18 MiB/s wr, 206 op/s 2023-08-11T12:26:11.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:10 smithi045 ceph-mon[130284]: pgmap v50: 129 pgs: 129 active+clean; 3.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 18 MiB/s wr, 206 op/s 2023-08-11T12:26:11.483 INFO:teuthology.orchestra.run.smithi008.stderr:21000000 of 50000000 tuples (42%) done (elapsed 76.17 s, remaining 105.19 s) 2023-08-11T12:26:11.965 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.963+0000 7f1fdd7ff700 1 -- 172.21.15.8:0/1119993254 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fd81008c0 msgr2=0x7f1fd8100d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:11.965 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.963+0000 7f1fdd7ff700 1 --2- 172.21.15.8:0/1119993254 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fd81008c0 0x7f1fd8100d40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0098f0 tx=0x7f1fcc009c00 comp rx=0 tx=0).stop 2023-08-11T12:26:11.965 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.963+0000 7f1fdd7ff700 1 -- 172.21.15.8:0/1119993254 shutdown_connections 2023-08-11T12:26:11.966 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.963+0000 7f1fdd7ff700 1 --2- 172.21.15.8:0/1119993254 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fd8101280 0x7f1fd810d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:11.966 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.963+0000 7f1fdd7ff700 1 --2- 172.21.15.8:0/1119993254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fd81068d0 0x7f1fd8106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:11.966 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.963+0000 7f1fdd7ff700 1 --2- 172.21.15.8:0/1119993254 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fd81008c0 0x7f1fd8100d40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:11.966 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.963+0000 7f1fdd7ff700 1 -- 172.21.15.8:0/1119993254 >> 172.21.15.8:0/1119993254 conn(0x7f1fd80fc3d0 msgr2=0x7f1fd80fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:11.966 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.963+0000 7f1fdd7ff700 1 -- 172.21.15.8:0/1119993254 shutdown_connections 2023-08-11T12:26:11.966 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.963+0000 7f1fdd7ff700 1 -- 172.21.15.8:0/1119993254 wait complete. 2023-08-11T12:26:11.968 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.964+0000 7f1fdd7ff700 1 Processor -- start 2023-08-11T12:26:11.968 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.964+0000 7f1fdd7ff700 1 -- start start 2023-08-11T12:26:11.968 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.965+0000 7f1fdd7ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fd81008c0 0x7f1fd819e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:11.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.965+0000 7f1fdd7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fd8101280 0x7f1fd819eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:11.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.965+0000 7f1fdd7ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fd81068d0 0x7f1fd81989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:11.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.965+0000 7f1fdd7ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd8199050 con 0x7f1fd81068d0 2023-08-11T12:26:11.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.965+0000 7f1fdd7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd81991c0 con 0x7f1fd8101280 2023-08-11T12:26:11.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.965+0000 7f1fdd7ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd8199380 con 0x7f1fd81008c0 2023-08-11T12:26:11.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.965+0000 7f1fd6ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fd81008c0 0x7f1fd819e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:11.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.965+0000 7f1fd67fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fd8101280 0x7f1fd819eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:11.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.965+0000 7f1fd6ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fd81008c0 0x7f1fd819e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:47720/0 (socket says 172.21.15.8:47720) 2023-08-11T12:26:11.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.965+0000 7f1fd6ffd700 1 -- 172.21.15.8:0/4222938939 learned_addr learned my addr 172.21.15.8:0/4222938939 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:11.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.965+0000 7f1fd77fe700 1 --2- 172.21.15.8:0/4222938939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fd81068d0 0x7f1fd81989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:11.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.966+0000 7f1fd6ffd700 1 -- 172.21.15.8:0/4222938939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fd8101280 msgr2=0x7f1fd819eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:11.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.966+0000 7f1fd6ffd700 1 --2- 172.21.15.8:0/4222938939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fd8101280 0x7f1fd819eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:11.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.966+0000 7f1fd6ffd700 1 -- 172.21.15.8:0/4222938939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fd81068d0 msgr2=0x7f1fd81989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:11.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.966+0000 7f1fd6ffd700 1 --2- 172.21.15.8:0/4222938939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fd81068d0 0x7f1fd81989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:11.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.966+0000 7f1fd6ffd700 1 -- 172.21.15.8:0/4222938939 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fcc009520 con 0x7f1fd81008c0 2023-08-11T12:26:11.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.966+0000 7f1fd6ffd700 1 --2- 172.21.15.8:0/4222938939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fd81008c0 0x7f1fd819e970 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1fc800e9c0 tx=0x7f1fc800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:11.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.966+0000 7f1fbffff700 1 -- 172.21.15.8:0/4222938939 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8004a30 con 0x7f1fd81008c0 2023-08-11T12:26:11.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.966+0000 7f1fbffff700 1 -- 172.21.15.8:0/4222938939 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1fc800cc80 con 0x7f1fd81008c0 2023-08-11T12:26:11.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.966+0000 7f1fdd7ff700 1 -- 172.21.15.8:0/4222938939 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd8199660 con 0x7f1fd81008c0 2023-08-11T12:26:11.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.966+0000 7f1fbffff700 1 -- 172.21.15.8:0/4222938939 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc80054e0 con 0x7f1fd81008c0 2023-08-11T12:26:11.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.966+0000 7f1fdd7ff700 1 -- 172.21.15.8:0/4222938939 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd81a5960 con 0x7f1fd81008c0 2023-08-11T12:26:11.972 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.971+0000 7f1fbffff700 1 -- 172.21.15.8:0/4222938939 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f1fc8004b90 con 0x7f1fd81008c0 2023-08-11T12:26:11.973 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.972+0000 7f1ff1048b80 1 Processor -- start 2023-08-11T12:26:11.974 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.972+0000 7f1ff1048b80 1 -- start start 2023-08-11T12:26:11.975 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.972+0000 7f1ff1048b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cf6abee80 0x558cf6abf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:11.975 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.972+0000 7f1ff1048b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558cf6ab9630 0x558cf6ab9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:11.975 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.972+0000 7f1ff1048b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cf6ab9ff0 0x558cf6ac5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:11.975 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.972+0000 7f1ff1048b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cf6a125d0 con 0x558cf6ab9630 2023-08-11T12:26:11.975 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.972+0000 7f1ff1048b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cf6a0fef0 con 0x558cf6ab9ff0 2023-08-11T12:26:11.975 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.972+0000 7f1ff1048b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cf6a0b7e0 con 0x558cf6abee80 2023-08-11T12:26:11.975 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.973+0000 7f1fd6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558cf6ab9630 0x558cf6ab9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:11.976 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.973+0000 7f1fbffff700 1 --2- 172.21.15.8:0/4222938939 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f1fc00a0140 0x7f1fc00a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:11.976 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.973+0000 7f1fd67fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cf6ab9ff0 0x558cf6ac5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:11.976 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.973+0000 7f1fd67fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cf6ab9ff0 0x558cf6ac5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:39944/0 (socket says 172.21.15.8:39944) 2023-08-11T12:26:11.977 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.973+0000 7f1fd67fc700 1 -- 172.21.15.8:0/3774048014 learned_addr learned my addr 172.21.15.8:0/3774048014 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.973+0000 7f1fd77fe700 1 --2- 172.21.15.8:0/3774048014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cf6abee80 0x558cf6abf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.973+0000 7f1fbffff700 1 -- 172.21.15.8:0/4222938939 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f1fc8014070 con 0x7f1fd81008c0 2023-08-11T12:26:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.973+0000 7f1fd77fe700 1 --2- 172.21.15.8:0/4222938939 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f1fc00a0140 0x7f1fc00a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.973+0000 7f1fd67fc700 1 -- 172.21.15.8:0/3774048014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cf6abee80 msgr2=0x558cf6abf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.973+0000 7f1fd67fc700 1 --2- 172.21.15.8:0/3774048014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cf6abee80 0x558cf6abf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.973+0000 7f1fd67fc700 1 -- 172.21.15.8:0/3774048014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558cf6ab9630 msgr2=0x558cf6ab9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.973+0000 7f1fd67fc700 1 --2- 172.21.15.8:0/3774048014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558cf6ab9630 0x558cf6ab9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.973+0000 7f1fd67fc700 1 -- 172.21.15.8:0/3774048014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cf688b5d0 con 0x558cf6ab9ff0 2023-08-11T12:26:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.974+0000 7f1fd67fc700 1 --2- 172.21.15.8:0/3774048014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cf6ab9ff0 0x558cf6ac5c10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc000c00 tx=0x7f1fcc005dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8047bc53ca545a9 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.974+0000 7f1fbd7fa700 1 -- 172.21.15.8:0/3774048014 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc00f6e0 con 0x558cf6ab9ff0 2023-08-11T12:26:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.974+0000 7f1fd77fe700 1 --2- 172.21.15.8:0/4222938939 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f1fc00a0140 0x7f1fc00a2600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0009ec0 tx=0x7f1fd000b040 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.974+0000 7f1fbd7fa700 1 -- 172.21.15.8:0/3774048014 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1fcc01d040 con 0x558cf6ab9ff0 2023-08-11T12:26:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.974+0000 7f1fbd7fa700 1 -- 172.21.15.8:0/3774048014 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc0054a0 con 0x558cf6ab9ff0 2023-08-11T12:26:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.975+0000 7f1ff1048b80 1 -- 172.21.15.8:0/3774048014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cf6ab9ff0 msgr2=0x558cf6ac5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.975+0000 7f1ff1048b80 1 --2- 172.21.15.8:0/3774048014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cf6ab9ff0 0x558cf6ac5c10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc000c00 tx=0x7f1fcc005dc0 comp rx=0 tx=0).stop 2023-08-11T12:26:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.975+0000 7f1ff1048b80 1 -- 172.21.15.8:0/3774048014 shutdown_connections 2023-08-11T12:26:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.975+0000 7f1ff1048b80 1 --2- 172.21.15.8:0/3774048014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cf6abee80 0x558cf6abf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.975+0000 7f1ff1048b80 1 --2- 172.21.15.8:0/3774048014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cf6ab9ff0 0x558cf6ac5c10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.975+0000 7f1ff1048b80 1 --2- 172.21.15.8:0/3774048014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558cf6ab9630 0x558cf6ab9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.975+0000 7f1ff1048b80 1 -- 172.21.15.8:0/3774048014 >> 172.21.15.8:0/3774048014 conn(0x558cf69e68f0 msgr2=0x558cf6ab3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.975+0000 7f1ff1048b80 1 -- 172.21.15.8:0/3774048014 shutdown_connections 2023-08-11T12:26:11.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.975+0000 7f1ff1048b80 1 -- 172.21.15.8:0/3774048014 wait complete. 2023-08-11T12:26:11.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.975+0000 7f1ff1048b80 1 -- start start 2023-08-11T12:26:11.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.976+0000 7f1ff1048b80 1 Processor -- start 2023-08-11T12:26:11.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.976+0000 7f1ff1048b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cf6ab9630 0x558cf6ac89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:11.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.976+0000 7f1ff1048b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558cf6ab9ff0 0x558cf6ac8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:11.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.976+0000 7f1ff1048b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cf6abee80 0x558cf6ac2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:11.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.976+0000 7f1ff1048b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cf69a9a60 con 0x558cf6ab9ff0 2023-08-11T12:26:11.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.976+0000 7f1ff1048b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cf69a9760 con 0x558cf6abee80 2023-08-11T12:26:11.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.976+0000 7f1ff1048b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cf688d8c0 con 0x558cf6ab9630 2023-08-11T12:26:11.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.976+0000 7f1ff1048b80 10 client.0 _ll_register_callbacks cb 0x558cf69aca50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:26:11.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.977+0000 7f1fd6ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cf6ab9630 0x558cf6ac89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:11.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.977+0000 7f1fd77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cf6abee80 0x558cf6ac2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:11.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.977+0000 7f1fd6ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cf6ab9630 0x558cf6ac89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:47738/0 (socket says 172.21.15.8:47738) 2023-08-11T12:26:11.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.977+0000 7f1fd6ffd700 1 -- 172.21.15.8:0/614903450 learned_addr learned my addr 172.21.15.8:0/614903450 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:11.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.977+0000 7f1fd67fc700 1 --2- 172.21.15.8:0/614903450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558cf6ab9ff0 0x558cf6ac8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:11.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.977+0000 7f1fd77fe700 1 -- 172.21.15.8:0/614903450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cf6ab9630 msgr2=0x558cf6ac89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:11.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.977+0000 7f1fd77fe700 1 --2- 172.21.15.8:0/614903450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cf6ab9630 0x558cf6ac89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:11.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.977+0000 7f1fd77fe700 1 -- 172.21.15.8:0/614903450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558cf6ab9ff0 msgr2=0x558cf6ac8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:11.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.977+0000 7f1fd77fe700 1 --2- 172.21.15.8:0/614903450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558cf6ab9ff0 0x558cf6ac8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:11.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.977+0000 7f1fd77fe700 1 -- 172.21.15.8:0/614903450 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd810e090 con 0x558cf6abee80 2023-08-11T12:26:11.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.977+0000 7f1fd67fc700 1 --2- 172.21.15.8:0/614903450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558cf6ab9ff0 0x558cf6ac8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:26:11.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.978+0000 7f1fd77fe700 1 --2- 172.21.15.8:0/614903450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cf6abee80 0x558cf6ac2d40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0019ae0 tx=0x7f1fd0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79175a4873f4f6e9 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:11.988 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.978+0000 7f1fbaff5700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:26:11.988 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.978+0000 7f1fbaff5700 1 -- 172.21.15.8:0/614903450 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd000e070 con 0x558cf6abee80 2023-08-11T12:26:11.988 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.978+0000 7f1ff1048b80 1 -- 172.21.15.8:0/614903450 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558cf6aac7e0 con 0x558cf6abee80 2023-08-11T12:26:11.988 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.978+0000 7f1fbaff5700 1 -- 172.21.15.8:0/614903450 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f1fd0007e40 con 0x558cf6abee80 2023-08-11T12:26:11.988 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.979+0000 7f1fbaff5700 1 -- 172.21.15.8:0/614903450 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fd0016a10 con 0x558cf6abee80 2023-08-11T12:26:11.988 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.979+0000 7f1ff1048b80 10 client.26087 fetch_fsmap learned FSMap version 32 2023-08-11T12:26:11.988 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.979+0000 7f1ff1048b80 1 -- 172.21.15.8:0/614903450 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x558cf6837d80 con 0x558cf6abee80 2023-08-11T12:26:11.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.979+0000 7f1fbaff5700 1 -- 172.21.15.8:0/614903450 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558cf6aac7e0 con 0x558cf6abee80 2023-08-11T12:26:11.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.979+0000 7f1fbaff5700 1 -- 172.21.15.8:0/614903450 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 32) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f1fd0024b80 con 0x558cf6abee80 2023-08-11T12:26:11.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.979+0000 7f1ff1048b80 10 client.26087 fetch_fsmap finished waiting for FSMap version 32 2023-08-11T12:26:11.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.979+0000 7f1ff1048b80 10 client.26087 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-11T12:26:11.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.979+0000 7f1ff1048b80 20 client.26087 populate_metadata read hostname 'smithi008' 2023-08-11T12:26:11.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.979+0000 7f1ff1048b80 1 --2- 172.21.15.8:0/614903450 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x558cf6ad3030 0x558cf6ad5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:11.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.979+0000 7f1ff1048b80 4 client.26087 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:26:11.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.979+0000 7f1ff1048b80 1 -- 172.21.15.8:0/614903450 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558cf6a88480 con 0x558cf6ad3030 2023-08-11T12:26:11.990 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.980+0000 7f1fd6ffd700 1 --2- 172.21.15.8:0/614903450 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x558cf6ad3030 0x558cf6ad5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:11.991 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.980+0000 7f1fd6ffd700 1 --2- 172.21.15.8:0/614903450 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x558cf6ad3030 0x558cf6ad5450 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a6132dbdd20aae6 server_cookie=c67c523afe075224 in_seq=0 out_seq=0 2023-08-11T12:26:11.991 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.980+0000 7f1fbaff5700 10 client.26087 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:26:11.991 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.981+0000 7f1fbaff5700 1 -- 172.21.15.8:0/614903450 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x558cf6a88480 con 0x558cf6ad3030 2023-08-11T12:26:11.991 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.981+0000 7f1fbaff5700 10 client.26087 handle_command_reply: tid=0 2023-08-11T12:26:11.991 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.981+0000 7f1ff1048b80 1 client.26087 shutdown 2023-08-11T12:26:11.991 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.982+0000 7f1ff1048b80 1 -- 172.21.15.8:0/614903450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cf6abee80 msgr2=0x558cf6ac2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.982+0000 7f1ff1048b80 1 --2- 172.21.15.8:0/614903450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cf6abee80 0x558cf6ac2d40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0019ae0 tx=0x7f1fd0004ad0 comp rx=0 tx=0).stop 2023-08-11T12:26:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.982+0000 7f1ff1048b80 1 -- 172.21.15.8:0/614903450 shutdown_connections 2023-08-11T12:26:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.982+0000 7f1ff1048b80 1 --2- 172.21.15.8:0/614903450 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x558cf6ad3030 0x558cf6ad5450 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.982+0000 7f1ff1048b80 1 --2- 172.21.15.8:0/614903450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cf6ab9630 0x558cf6ac89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.982+0000 7f1ff1048b80 1 --2- 172.21.15.8:0/614903450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cf6abee80 0x558cf6ac2d40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.982+0000 7f1ff1048b80 1 --2- 172.21.15.8:0/614903450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558cf6ab9ff0 0x558cf6ac8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:11.993 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.982+0000 7f1ff1048b80 1 -- 172.21.15.8:0/614903450 >> 172.21.15.8:0/614903450 conn(0x558cf69e68f0 msgr2=0x558cf6ab35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:11.993 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.982+0000 7f1fbaff5700 0 client.26087 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:26:11.993 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.982+0000 7f1ff1048b80 1 -- 172.21.15.8:0/614903450 shutdown_connections 2023-08-11T12:26:11.993 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.982+0000 7f1ff1048b80 1 -- 172.21.15.8:0/614903450 wait complete. 2023-08-11T12:26:11.993 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.982+0000 7f1ff1048b80 20 client.26087 trim_cache size 0 max 16384 2023-08-11T12:26:12.001 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.999+0000 7f1ff1048b80 1 Processor -- start 2023-08-11T12:26:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:11.999+0000 7f1ff1048b80 1 -- start start 2023-08-11T12:26:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.000+0000 7f1ff1048b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cf6ab9630 0x558cf6ab3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.000+0000 7f1ff1048b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558cf6ab9ff0 0x558cf6abc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.000+0000 7f1ff1048b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cf6abee80 0x558cf6abb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.000+0000 7f1ff1048b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cf6ab5db0 con 0x558cf6ab9ff0 2023-08-11T12:26:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.000+0000 7f1ff1048b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cf6ac12c0 con 0x558cf6abee80 2023-08-11T12:26:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.000+0000 7f1ff1048b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cf6abd9d0 con 0x558cf6ab9630 2023-08-11T12:26:12.004 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.000+0000 7f1fd6ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cf6ab9630 0x558cf6ab3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:12.004 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.000+0000 7f1fd6ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cf6ab9630 0x558cf6ab3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:47746/0 (socket says 172.21.15.8:47746) 2023-08-11T12:26:12.004 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.000+0000 7f1fd6ffd700 1 -- 172.21.15.8:0/4080292557 learned_addr learned my addr 172.21.15.8:0/4080292557 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:12.004 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.000+0000 7f1fd77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cf6abee80 0x558cf6abb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:12.004 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.000+0000 7f1fd67fc700 1 --2- 172.21.15.8:0/4080292557 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558cf6ab9ff0 0x558cf6abc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:12.004 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.000+0000 7f1fd77fe700 1 -- 172.21.15.8:0/4080292557 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cf6ab9630 msgr2=0x558cf6ab3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:12.005 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.000+0000 7f1fd77fe700 1 --2- 172.21.15.8:0/4080292557 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cf6ab9630 0x558cf6ab3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:12.005 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.000+0000 7f1fd77fe700 1 -- 172.21.15.8:0/4080292557 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558cf6ab9ff0 msgr2=0x558cf6abc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:12.005 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.000+0000 7f1fd77fe700 1 --2- 172.21.15.8:0/4080292557 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558cf6ab9ff0 0x558cf6abc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:12.005 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.000+0000 7f1fd77fe700 1 -- 172.21.15.8:0/4080292557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cf6ac2fd0 con 0x558cf6abee80 2023-08-11T12:26:12.005 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.000+0000 7f1fd6ffd700 1 --2- 172.21.15.8:0/4080292557 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cf6ab9630 0x558cf6ab3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:26:12.005 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.001+0000 7f1fd77fe700 1 --2- 172.21.15.8:0/4080292557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cf6abee80 0x558cf6abb860 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0024f40 tx=0x7f1fd0009320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9680064b0464582 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:12.005 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.001+0000 7f1fbdffb700 1 -- 172.21.15.8:0/4080292557 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd000e040 con 0x558cf6abee80 2023-08-11T12:26:12.006 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.001+0000 7f1fbdffb700 1 -- 172.21.15.8:0/4080292557 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1fd000f040 con 0x558cf6abee80 2023-08-11T12:26:12.006 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.001+0000 7f1fbdffb700 1 -- 172.21.15.8:0/4080292557 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd0024400 con 0x558cf6abee80 2023-08-11T12:26:12.006 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.002+0000 7f1ff1048b80 1 -- 172.21.15.8:0/4080292557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cf6abee80 msgr2=0x558cf6abb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:12.006 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.002+0000 7f1ff1048b80 1 --2- 172.21.15.8:0/4080292557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cf6abee80 0x558cf6abb860 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0024f40 tx=0x7f1fd0009320 comp rx=0 tx=0).stop 2023-08-11T12:26:12.006 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.002+0000 7f1ff1048b80 1 -- 172.21.15.8:0/4080292557 shutdown_connections 2023-08-11T12:26:12.006 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.002+0000 7f1ff1048b80 1 --2- 172.21.15.8:0/4080292557 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cf6ab9630 0x558cf6ab3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:12.006 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.002+0000 7f1ff1048b80 1 --2- 172.21.15.8:0/4080292557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cf6abee80 0x558cf6abb860 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:12.006 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.002+0000 7f1ff1048b80 1 --2- 172.21.15.8:0/4080292557 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558cf6ab9ff0 0x558cf6abc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:12.007 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.002+0000 7f1ff1048b80 1 -- 172.21.15.8:0/4080292557 >> 172.21.15.8:0/4080292557 conn(0x558cf69e68f0 msgr2=0x558cf6ab0740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:12.007 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.002+0000 7f1ff1048b80 1 -- 172.21.15.8:0/4080292557 shutdown_connections 2023-08-11T12:26:12.007 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.002+0000 7f1ff1048b80 1 -- 172.21.15.8:0/4080292557 wait complete. 2023-08-11T12:26:12.009 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.002+0000 7f1ff1048b80 1 -- start start 2023-08-11T12:26:12.009 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.002+0000 7f1ff1048b80 1 Processor -- start 2023-08-11T12:26:12.009 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.003+0000 7f1ff1048b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cf6ab9630 0x558cf6abbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:12.009 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.003+0000 7f1ff1048b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558cf6ab9ff0 0x558cf6acb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:12.009 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.003+0000 7f1ff1048b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cf6abee80 0x558cf6acbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:12.010 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.003+0000 7f1ff1048b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cf6acc330 con 0x558cf6ab9ff0 2023-08-11T12:26:12.010 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.003+0000 7f1ff1048b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cf6acc4a0 con 0x558cf6abee80 2023-08-11T12:26:12.010 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.003+0000 7f1ff1048b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cf6b25cd0 con 0x558cf6ab9630 2023-08-11T12:26:12.010 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.003+0000 7f1ff1048b80 10 client.0 _ll_register_callbacks cb 0x7f1fd00194b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:26:12.010 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.003+0000 7f1fd6ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cf6ab9630 0x558cf6abbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:12.010 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.003+0000 7f1fd67fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558cf6ab9ff0 0x558cf6acb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:12.010 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.003+0000 7f1fd6ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cf6ab9630 0x558cf6abbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:47748/0 (socket says 172.21.15.8:47748) 2023-08-11T12:26:12.010 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.003+0000 7f1fd6ffd700 1 -- 172.21.15.8:0/1917152555 learned_addr learned my addr 172.21.15.8:0/1917152555 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:12.011 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.004+0000 7f1fd77fe700 1 --2- 172.21.15.8:0/1917152555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cf6abee80 0x558cf6acbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:12.011 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.004+0000 7f1fd6ffd700 1 -- 172.21.15.8:0/1917152555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cf6abee80 msgr2=0x558cf6acbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:12.011 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.004+0000 7f1fd6ffd700 1 --2- 172.21.15.8:0/1917152555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cf6abee80 0x558cf6acbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:12.011 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.004+0000 7f1fd6ffd700 1 -- 172.21.15.8:0/1917152555 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558cf6ab9ff0 msgr2=0x558cf6acb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:12.011 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.004+0000 7f1fd6ffd700 1 --2- 172.21.15.8:0/1917152555 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558cf6ab9ff0 0x558cf6acb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:12.011 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.004+0000 7f1fd6ffd700 1 -- 172.21.15.8:0/1917152555 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd81a5960 con 0x558cf6ab9630 2023-08-11T12:26:12.011 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.004+0000 7f1fd67fc700 1 --2- 172.21.15.8:0/1917152555 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558cf6ab9ff0 0x558cf6acb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:26:12.011 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.004+0000 7f1fd6ffd700 1 --2- 172.21.15.8:0/1917152555 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cf6ab9630 0x558cf6abbc50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1fc80957a0 tx=0x7f1fc8009380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9e6162639db8aa1 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:12.012 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.004+0000 7f1fbaff5700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:26:12.012 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.004+0000 7f1fbaff5700 1 -- 172.21.15.8:0/1917152555 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc80a0b40 con 0x558cf6ab9630 2023-08-11T12:26:12.012 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.004+0000 7f1fbaff5700 1 -- 172.21.15.8:0/1917152555 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f1fc80b80b0 con 0x558cf6ab9630 2023-08-11T12:26:12.012 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.004+0000 7f1ff1048b80 1 -- 172.21.15.8:0/1917152555 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1fcc01d040 con 0x558cf6ab9630 2023-08-11T12:26:12.012 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.004+0000 7f1fbaff5700 1 -- 172.21.15.8:0/1917152555 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fc8095440 con 0x558cf6ab9630 2023-08-11T12:26:12.012 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.004+0000 7f1ff1048b80 10 client.26110 fetch_fsmap learned FSMap version 32 2023-08-11T12:26:12.012 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.005+0000 7f1ff1048b80 1 -- 172.21.15.8:0/1917152555 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x558cf6837d80 con 0x558cf6ab9630 2023-08-11T12:26:12.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.005+0000 7f1fbaff5700 1 -- 172.21.15.8:0/1917152555 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1fcc01d040 con 0x558cf6ab9630 2023-08-11T12:26:12.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.005+0000 7f1fbaff5700 1 -- 172.21.15.8:0/1917152555 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 32) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f1fc8016330 con 0x558cf6ab9630 2023-08-11T12:26:12.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.005+0000 7f1ff1048b80 10 client.26110 fetch_fsmap finished waiting for FSMap version 32 2023-08-11T12:26:12.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.005+0000 7f1ff1048b80 10 client.26110 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-11T12:26:12.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.005+0000 7f1ff1048b80 20 client.26110 populate_metadata read hostname 'smithi008' 2023-08-11T12:26:12.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.005+0000 7f1ff1048b80 1 --2- 172.21.15.8:0/1917152555 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x558cf6b274a0 0x558cf6b298c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:12.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.005+0000 7f1ff1048b80 4 client.26110 mds_command: new command op to 24575 tid=0[{"prefix": "flush journal"}] 2023-08-11T12:26:12.014 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.005+0000 7f1ff1048b80 1 -- 172.21.15.8:0/1917152555 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558cf6a047c0 con 0x558cf6b274a0 2023-08-11T12:26:12.014 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.005+0000 7f1fd67fc700 1 --2- 172.21.15.8:0/1917152555 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x558cf6b274a0 0x558cf6b298c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:12.014 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.006+0000 7f1fbaff5700 10 client.26110 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:26:12.014 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.006+0000 7f1fd67fc700 1 --2- 172.21.15.8:0/1917152555 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x558cf6b274a0 0x558cf6b298c0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76db7eeead68c040 server_cookie=a85ec7b12b98060f in_seq=0 out_seq=0 2023-08-11T12:26:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.021+0000 7f1fbaff5700 1 -- 172.21.15.8:0/1917152555 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558cf6a047c0 con 0x558cf6b274a0 2023-08-11T12:26:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.021+0000 7f1fbaff5700 10 client.26110 handle_command_reply: tid=0 2023-08-11T12:26:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.021+0000 7f1ff1048b80 1 client.26110 shutdown 2023-08-11T12:26:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.021+0000 7f1ff1048b80 1 -- 172.21.15.8:0/1917152555 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cf6ab9630 msgr2=0x558cf6abbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.021+0000 7f1ff1048b80 1 --2- 172.21.15.8:0/1917152555 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cf6ab9630 0x558cf6abbc50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1fc80957a0 tx=0x7f1fc8009380 comp rx=0 tx=0).stop 2023-08-11T12:26:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.021+0000 7f1ff1048b80 1 -- 172.21.15.8:0/1917152555 shutdown_connections 2023-08-11T12:26:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.021+0000 7f1ff1048b80 1 --2- 172.21.15.8:0/1917152555 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x558cf6b274a0 0x558cf6b298c0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.021+0000 7f1ff1048b80 1 --2- 172.21.15.8:0/1917152555 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cf6ab9630 0x558cf6abbc50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.021+0000 7f1ff1048b80 1 --2- 172.21.15.8:0/1917152555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cf6abee80 0x558cf6acbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.021+0000 7f1ff1048b80 1 --2- 172.21.15.8:0/1917152555 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558cf6ab9ff0 0x558cf6acb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.021+0000 7f1fbaff5700 0 client.26110 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:26:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.021+0000 7f1ff1048b80 1 -- 172.21.15.8:0/1917152555 >> 172.21.15.8:0/1917152555 conn(0x558cf69e68f0 msgr2=0x558cf6abc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.021+0000 7f1ff1048b80 1 -- 172.21.15.8:0/1917152555 shutdown_connections 2023-08-11T12:26:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.021+0000 7f1ff1048b80 1 -- 172.21.15.8:0/1917152555 wait complete. 2023-08-11T12:26:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.021+0000 7f1ff1048b80 20 client.26110 trim_cache size 0 max 16384 2023-08-11T12:26:12.029 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-08-11T12:26:12.029 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-08-11T12:26:12.029 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-08-11T12:26:12.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-08-11T12:26:12.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.022+0000 7f1fdd7ff700 1 -- 172.21.15.8:0/4222938939 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f1fc00a0140 msgr2=0x7f1fc00a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:12.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.022+0000 7f1fdd7ff700 1 --2- 172.21.15.8:0/4222938939 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f1fc00a0140 0x7f1fc00a2600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0009ec0 tx=0x7f1fd000b040 comp rx=0 tx=0).stop 2023-08-11T12:26:12.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.022+0000 7f1fdd7ff700 1 -- 172.21.15.8:0/4222938939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fd81008c0 msgr2=0x7f1fd819e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:12.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.022+0000 7f1fdd7ff700 1 --2- 172.21.15.8:0/4222938939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fd81008c0 0x7f1fd819e970 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1fc800e9c0 tx=0x7f1fc800ecd0 comp rx=0 tx=0).stop 2023-08-11T12:26:12.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.022+0000 7f1fdd7ff700 1 -- 172.21.15.8:0/4222938939 shutdown_connections 2023-08-11T12:26:12.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.022+0000 7f1fdd7ff700 1 --2- 172.21.15.8:0/4222938939 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f1fc00a0140 0x7f1fc00a2600 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:12.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.022+0000 7f1fdd7ff700 1 --2- 172.21.15.8:0/4222938939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fd81008c0 0x7f1fd819e970 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:12.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.022+0000 7f1fdd7ff700 1 --2- 172.21.15.8:0/4222938939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fd81068d0 0x7f1fd81989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:12.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.022+0000 7f1fdd7ff700 1 --2- 172.21.15.8:0/4222938939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fd8101280 0x7f1fd819eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:12.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.022+0000 7f1fdd7ff700 1 -- 172.21.15.8:0/4222938939 >> 172.21.15.8:0/4222938939 conn(0x7f1fd80fc3d0 msgr2=0x7f1fd810bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:12.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.022+0000 7f1fdd7ff700 1 -- 172.21.15.8:0/4222938939 shutdown_connections 2023-08-11T12:26:12.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:12.022+0000 7f1fdd7ff700 1 -- 172.21.15.8:0/4222938939 wait complete. 2023-08-11T12:26:12.759 INFO:teuthology.orchestra.run.smithi008.stderr:21100000 of 50000000 tuples (42%) done (elapsed 77.45 s, remaining 106.07 s) 2023-08-11T12:26:12.993 INFO:teuthology.orchestra.run.smithi008.stderr:21200000 of 50000000 tuples (42%) done (elapsed 77.68 s, remaining 105.53 s) 2023-08-11T12:26:13.102 INFO:teuthology.orchestra.run.smithi008.stderr:21300000 of 50000000 tuples (42%) done (elapsed 77.79 s, remaining 104.81 s) 2023-08-11T12:26:13.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:12 smithi194 ceph-mon[130905]: pgmap v51: 129 pgs: 129 active+clean; 3.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 19 MiB/s wr, 369 op/s 2023-08-11T12:26:13.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:12 smithi045 ceph-mon[130284]: pgmap v51: 129 pgs: 129 active+clean; 3.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 19 MiB/s wr, 369 op/s 2023-08-11T12:26:13.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:12 smithi008 ceph-mon[97158]: pgmap v51: 129 pgs: 129 active+clean; 3.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 19 MiB/s wr, 369 op/s 2023-08-11T12:26:13.338 INFO:teuthology.orchestra.run.smithi008.stderr:21400000 of 50000000 tuples (42%) done (elapsed 78.02 s, remaining 104.28 s) 2023-08-11T12:26:13.638 INFO:teuthology.orchestra.run.smithi008.stderr:21500000 of 50000000 tuples (43%) done (elapsed 78.33 s, remaining 103.83 s) 2023-08-11T12:26:13.867 INFO:teuthology.orchestra.run.smithi008.stderr:21600000 of 50000000 tuples (43%) done (elapsed 78.55 s, remaining 103.28 s) 2023-08-11T12:26:14.809 INFO:teuthology.orchestra.run.smithi008.stderr:21700000 of 50000000 tuples (43%) done (elapsed 79.49 s, remaining 103.67 s) 2023-08-11T12:26:15.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:14 smithi194 ceph-mon[130905]: pgmap v52: 129 pgs: 129 active+clean; 3.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 2.0 MiB/s wr, 303 op/s 2023-08-11T12:26:15.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:14 smithi045 ceph-mon[130284]: pgmap v52: 129 pgs: 129 active+clean; 3.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 2.0 MiB/s wr, 303 op/s 2023-08-11T12:26:15.272 INFO:teuthology.orchestra.run.smithi008.stderr:21800000 of 50000000 tuples (43%) done (elapsed 79.96 s, remaining 103.43 s) 2023-08-11T12:26:15.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:14 smithi008 ceph-mon[97158]: pgmap v52: 129 pgs: 129 active+clean; 3.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 2.0 MiB/s wr, 303 op/s 2023-08-11T12:26:15.634 INFO:teuthology.orchestra.run.smithi008.stderr:21900000 of 50000000 tuples (43%) done (elapsed 80.32 s, remaining 103.06 s) 2023-08-11T12:26:15.851 INFO:teuthology.orchestra.run.smithi008.stderr:22000000 of 50000000 tuples (44%) done (elapsed 80.54 s, remaining 102.50 s) 2023-08-11T12:26:16.098 INFO:teuthology.orchestra.run.smithi008.stderr:22100000 of 50000000 tuples (44%) done (elapsed 80.78 s, remaining 101.99 s) 2023-08-11T12:26:16.242 INFO:teuthology.orchestra.run.smithi008.stderr:22200000 of 50000000 tuples (44%) done (elapsed 80.93 s, remaining 101.34 s) 2023-08-11T12:26:16.440 INFO:teuthology.orchestra.run.smithi008.stderr:22300000 of 50000000 tuples (44%) done (elapsed 81.13 s, remaining 100.77 s) 2023-08-11T12:26:16.640 INFO:teuthology.orchestra.run.smithi008.stderr:22400000 of 50000000 tuples (44%) done (elapsed 81.33 s, remaining 100.21 s) 2023-08-11T12:26:16.833 INFO:teuthology.orchestra.run.smithi008.stderr:22500000 of 50000000 tuples (45%) done (elapsed 81.52 s, remaining 99.64 s) 2023-08-11T12:26:17.033 INFO:teuthology.orchestra.run.smithi008.stderr:22600000 of 50000000 tuples (45%) done (elapsed 81.72 s, remaining 99.08 s) 2023-08-11T12:26:17.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:16 smithi194 ceph-mon[130905]: pgmap v53: 129 pgs: 129 active+clean; 3.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 2.0 MiB/s wr, 303 op/s 2023-08-11T12:26:17.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:16 smithi045 ceph-mon[130284]: pgmap v53: 129 pgs: 129 active+clean; 3.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 2.0 MiB/s wr, 303 op/s 2023-08-11T12:26:17.185 INFO:teuthology.orchestra.run.smithi008.stderr:22700000 of 50000000 tuples (45%) done (elapsed 81.87 s, remaining 98.46 s) 2023-08-11T12:26:17.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:16 smithi008 ceph-mon[97158]: pgmap v53: 129 pgs: 129 active+clean; 3.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 2.0 MiB/s wr, 303 op/s 2023-08-11T12:26:17.447 INFO:teuthology.orchestra.run.smithi008.stderr:22800000 of 50000000 tuples (45%) done (elapsed 82.13 s, remaining 97.98 s) 2023-08-11T12:26:17.618 INFO:teuthology.orchestra.run.smithi008.stderr:22900000 of 50000000 tuples (45%) done (elapsed 82.30 s, remaining 97.40 s) 2023-08-11T12:26:17.791 INFO:teuthology.orchestra.run.smithi008.stderr:23000000 of 50000000 tuples (46%) done (elapsed 82.48 s, remaining 96.82 s) 2023-08-11T12:26:17.975 INFO:teuthology.orchestra.run.smithi008.stderr:23100000 of 50000000 tuples (46%) done (elapsed 82.66 s, remaining 96.26 s) 2023-08-11T12:26:18.197 INFO:teuthology.orchestra.run.smithi008.stderr:23200000 of 50000000 tuples (46%) done (elapsed 82.88 s, remaining 95.75 s) 2023-08-11T12:26:18.342 INFO:teuthology.orchestra.run.smithi008.stderr:23300000 of 50000000 tuples (46%) done (elapsed 83.03 s, remaining 95.15 s) 2023-08-11T12:26:18.542 INFO:teuthology.orchestra.run.smithi008.stderr:23400000 of 50000000 tuples (46%) done (elapsed 83.23 s, remaining 94.61 s) 2023-08-11T12:26:18.793 INFO:teuthology.orchestra.run.smithi008.stderr:23500000 of 50000000 tuples (47%) done (elapsed 83.48 s, remaining 94.14 s) 2023-08-11T12:26:19.009 INFO:teuthology.orchestra.run.smithi008.stderr:23600000 of 50000000 tuples (47%) done (elapsed 83.70 s, remaining 93.63 s) 2023-08-11T12:26:19.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:18 smithi194 ceph-mon[130905]: pgmap v54: 129 pgs: 129 active+clean; 4.1 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 60 MiB/s wr, 354 op/s 2023-08-11T12:26:19.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:18 smithi045 ceph-mon[130284]: pgmap v54: 129 pgs: 129 active+clean; 4.1 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 60 MiB/s wr, 354 op/s 2023-08-11T12:26:19.194 INFO:teuthology.orchestra.run.smithi008.stderr:23700000 of 50000000 tuples (47%) done (elapsed 83.88 s, remaining 93.08 s) 2023-08-11T12:26:19.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:18 smithi008 ceph-mon[97158]: pgmap v54: 129 pgs: 129 active+clean; 4.1 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 60 MiB/s wr, 354 op/s 2023-08-11T12:26:19.309 INFO:teuthology.orchestra.run.smithi008.stderr:23800000 of 50000000 tuples (47%) done (elapsed 84.00 s, remaining 92.47 s) 2023-08-11T12:26:19.540 INFO:teuthology.orchestra.run.smithi008.stderr:23900000 of 50000000 tuples (47%) done (elapsed 84.23 s, remaining 91.98 s) 2023-08-11T12:26:19.731 INFO:teuthology.orchestra.run.smithi008.stderr:24000000 of 50000000 tuples (48%) done (elapsed 84.42 s, remaining 91.45 s) 2023-08-11T12:26:19.942 INFO:teuthology.orchestra.run.smithi008.stderr:24100000 of 50000000 tuples (48%) done (elapsed 84.63 s, remaining 90.95 s) 2023-08-11T12:26:20.151 INFO:teuthology.orchestra.run.smithi008.stderr:24200000 of 50000000 tuples (48%) done (elapsed 84.84 s, remaining 90.45 s) 2023-08-11T12:26:20.346 INFO:teuthology.orchestra.run.smithi008.stderr:24300000 of 50000000 tuples (48%) done (elapsed 85.03 s, remaining 89.93 s) 2023-08-11T12:26:20.484 INFO:teuthology.orchestra.run.smithi008.stderr:24400000 of 50000000 tuples (48%) done (elapsed 85.17 s, remaining 89.36 s) 2023-08-11T12:26:20.686 INFO:teuthology.orchestra.run.smithi008.stderr:24500000 of 50000000 tuples (49%) done (elapsed 85.37 s, remaining 88.86 s) 2023-08-11T12:26:20.904 INFO:teuthology.orchestra.run.smithi008.stderr:24600000 of 50000000 tuples (49%) done (elapsed 85.59 s, remaining 88.37 s) 2023-08-11T12:26:21.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:20 smithi008 ceph-mon[97158]: pgmap v55: 129 pgs: 129 active+clean; 4.1 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 59 MiB/s wr, 213 op/s 2023-08-11T12:26:21.067 INFO:teuthology.orchestra.run.smithi008.stderr:24700000 of 50000000 tuples (49%) done (elapsed 85.75 s, remaining 87.84 s) 2023-08-11T12:26:21.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:20 smithi194 ceph-mon[130905]: pgmap v55: 129 pgs: 129 active+clean; 4.1 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 59 MiB/s wr, 213 op/s 2023-08-11T12:26:21.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:20 smithi045 ceph-mon[130284]: pgmap v55: 129 pgs: 129 active+clean; 4.1 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 59 MiB/s wr, 213 op/s 2023-08-11T12:26:21.277 INFO:teuthology.orchestra.run.smithi008.stderr:24800000 of 50000000 tuples (49%) done (elapsed 85.96 s, remaining 87.35 s) 2023-08-11T12:26:21.488 INFO:teuthology.orchestra.run.smithi008.stderr:24900000 of 50000000 tuples (49%) done (elapsed 86.18 s, remaining 86.87 s) 2023-08-11T12:26:21.689 INFO:teuthology.orchestra.run.smithi008.stderr:25000000 of 50000000 tuples (50%) done (elapsed 86.38 s, remaining 86.38 s) 2023-08-11T12:26:21.912 INFO:teuthology.orchestra.run.smithi008.stderr:25100000 of 50000000 tuples (50%) done (elapsed 86.60 s, remaining 85.91 s) 2023-08-11T12:26:22.052 INFO:teuthology.orchestra.run.smithi008.stderr:25200000 of 50000000 tuples (50%) done (elapsed 86.74 s, remaining 85.36 s) 2023-08-11T12:26:22.253 INFO:teuthology.orchestra.run.smithi008.stderr:25300000 of 50000000 tuples (50%) done (elapsed 86.94 s, remaining 84.88 s) 2023-08-11T12:26:22.639 INFO:teuthology.orchestra.run.smithi008.stderr:25400000 of 50000000 tuples (50%) done (elapsed 87.33 s, remaining 84.58 s) 2023-08-11T12:26:22.951 INFO:teuthology.orchestra.run.smithi008.stderr:25500000 of 50000000 tuples (51%) done (elapsed 87.64 s, remaining 84.20 s) 2023-08-11T12:26:23.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:22 smithi194 ceph-mon[130905]: pgmap v56: 129 pgs: 129 active+clean; 4.4 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 80 MiB/s wr, 229 op/s 2023-08-11T12:26:23.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:22 smithi045 ceph-mon[130284]: pgmap v56: 129 pgs: 129 active+clean; 4.4 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 80 MiB/s wr, 229 op/s 2023-08-11T12:26:23.279 INFO:teuthology.orchestra.run.smithi008.stderr:25600000 of 50000000 tuples (51%) done (elapsed 87.97 s, remaining 83.84 s) 2023-08-11T12:26:23.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:22 smithi008 ceph-mon[97158]: pgmap v56: 129 pgs: 129 active+clean; 4.4 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 80 MiB/s wr, 229 op/s 2023-08-11T12:26:23.845 INFO:teuthology.orchestra.run.smithi008.stderr:25700000 of 50000000 tuples (51%) done (elapsed 88.53 s, remaining 83.71 s) 2023-08-11T12:26:24.316 INFO:teuthology.orchestra.run.smithi008.stderr:25800000 of 50000000 tuples (51%) done (elapsed 89.00 s, remaining 83.48 s) 2023-08-11T12:26:24.536 INFO:teuthology.orchestra.run.smithi008.stderr:25900000 of 50000000 tuples (51%) done (elapsed 89.22 s, remaining 83.02 s) 2023-08-11T12:26:24.673 INFO:teuthology.orchestra.run.smithi008.stderr:26000000 of 50000000 tuples (52%) done (elapsed 89.36 s, remaining 82.49 s) 2023-08-11T12:26:24.891 INFO:teuthology.orchestra.run.smithi008.stderr:26100000 of 50000000 tuples (52%) done (elapsed 89.58 s, remaining 82.03 s) 2023-08-11T12:26:25.106 INFO:teuthology.orchestra.run.smithi008.stderr:26200000 of 50000000 tuples (52%) done (elapsed 89.79 s, remaining 81.57 s) 2023-08-11T12:26:25.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:24 smithi194 ceph-mon[130905]: pgmap v57: 129 pgs: 129 active+clean; 4.4 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 79 MiB/s wr, 66 op/s 2023-08-11T12:26:25.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:24 smithi045 ceph-mon[130284]: pgmap v57: 129 pgs: 129 active+clean; 4.4 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 79 MiB/s wr, 66 op/s 2023-08-11T12:26:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.187+0000 7f6fc61ff700 1 -- 172.21.15.8:0/879940793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fc0072d50 msgr2=0x7f6fc0073130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.187+0000 7f6fc61ff700 1 --2- 172.21.15.8:0/879940793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fc0072d50 0x7f6fc0073130 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0009990 tx=0x7f6fb0009ca0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.187+0000 7f6fc61ff700 1 -- 172.21.15.8:0/879940793 shutdown_connections 2023-08-11T12:26:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.187+0000 7f6fc61ff700 1 --2- 172.21.15.8:0/879940793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fc010d100 0x7f6fc010f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.187+0000 7f6fc61ff700 1 --2- 172.21.15.8:0/879940793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fc0072d50 0x7f6fc0073130 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.187+0000 7f6fc61ff700 1 --2- 172.21.15.8:0/879940793 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6fc0073670 0x7f6fc010cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.187+0000 7f6fc61ff700 1 -- 172.21.15.8:0/879940793 >> 172.21.15.8:0/879940793 conn(0x7f6fc00fc3d0 msgr2=0x7f6fc00fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.187+0000 7f6fc61ff700 1 -- 172.21.15.8:0/879940793 shutdown_connections 2023-08-11T12:26:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.187+0000 7f6fc61ff700 1 -- 172.21.15.8:0/879940793 wait complete. 2023-08-11T12:26:25.194 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.188+0000 7f6fc61ff700 1 Processor -- start 2023-08-11T12:26:25.194 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.188+0000 7f6fc61ff700 1 -- start start 2023-08-11T12:26:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.189+0000 7f6fc61ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fc0072d50 0x7f6fc019ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.189+0000 7f6fc61ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fc0073670 0x7f6fc019ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.189+0000 7f6fc61ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6fc010d100 0x7f6fc0198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.189+0000 7f6fc61ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc0199110 con 0x7f6fc010d100 2023-08-11T12:26:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.189+0000 7f6fc61ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc0199280 con 0x7f6fc0073670 2023-08-11T12:26:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.189+0000 7f6fc61ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc0199440 con 0x7f6fc0072d50 2023-08-11T12:26:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.189+0000 7f6fbeffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fc0073670 0x7f6fc019ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.189+0000 7f6fbeffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fc0073670 0x7f6fc019ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:45590/0 (socket says 172.21.15.8:45590) 2023-08-11T12:26:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.189+0000 7f6fbeffd700 1 -- 172.21.15.8:0/378558482 learned_addr learned my addr 172.21.15.8:0/378558482 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.189+0000 7f6fbf7fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fc0072d50 0x7f6fc019ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.189+0000 7f6fbffff700 1 --2- 172.21.15.8:0/378558482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6fc010d100 0x7f6fc0198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.189+0000 7f6fbeffd700 1 -- 172.21.15.8:0/378558482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fc0072d50 msgr2=0x7f6fc019ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.189+0000 7f6fbeffd700 1 --2- 172.21.15.8:0/378558482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fc0072d50 0x7f6fc019ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.189+0000 7f6fbeffd700 1 -- 172.21.15.8:0/378558482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6fc010d100 msgr2=0x7f6fc0198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.189+0000 7f6fbeffd700 1 --2- 172.21.15.8:0/378558482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6fc010d100 0x7f6fc0198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.189+0000 7f6fbeffd700 1 -- 172.21.15.8:0/378558482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb00095f0 con 0x7f6fc0073670 2023-08-11T12:26:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.189+0000 7f6fbffff700 1 --2- 172.21.15.8:0/378558482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6fc010d100 0x7f6fc0198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:26:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.190+0000 7f6fbeffd700 1 --2- 172.21.15.8:0/378558482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fc0073670 0x7f6fc019ef70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6fb400e9a0 tx=0x7f6fb400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.190+0000 7f6fbcff9700 1 -- 172.21.15.8:0/378558482 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4009790 con 0x7f6fc0073670 2023-08-11T12:26:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.190+0000 7f6fbcff9700 1 -- 172.21.15.8:0/378558482 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6fb400cbd0 con 0x7f6fc0073670 2023-08-11T12:26:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.190+0000 7f6fc61ff700 1 -- 172.21.15.8:0/378558482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc0199720 con 0x7f6fc0073670 2023-08-11T12:26:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.190+0000 7f6fbcff9700 1 -- 172.21.15.8:0/378558482 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4018680 con 0x7f6fc0073670 2023-08-11T12:26:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.190+0000 7f6fc61ff700 1 -- 172.21.15.8:0/378558482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc01a5a20 con 0x7f6fc0073670 2023-08-11T12:26:25.204 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.194+0000 7f6fbcff9700 1 -- 172.21.15.8:0/378558482 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f6fb400cd40 con 0x7f6fc0073670 2023-08-11T12:26:25.204 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.195+0000 7f6fd9b15b80 1 Processor -- start 2023-08-11T12:26:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.195+0000 7f6fbcff9700 1 --2- 172.21.15.8:0/378558482 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f6fa80a0140 0x7f6fa80a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.195+0000 7f6fd9b15b80 1 -- start start 2023-08-11T12:26:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.195+0000 7f6fbcff9700 1 -- 172.21.15.8:0/378558482 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f6fb4014070 con 0x7f6fc0073670 2023-08-11T12:26:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.195+0000 7f6fbffff700 1 --2- 172.21.15.8:0/378558482 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f6fa80a0140 0x7f6fa80a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.195+0000 7f6fd9b15b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f31ee87e80 0x55f31ee88260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.195+0000 7f6fd9b15b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f31ee82630 0x55f31ee82ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.196+0000 7f6fd9b15b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f31ee82ff0 0x55f31ee8ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:25.206 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.196+0000 7f6fd9b15b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f31eddb5d0 con 0x55f31ee87e80 2023-08-11T12:26:25.206 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.196+0000 7f6fd9b15b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f31edd8ef0 con 0x55f31ee82ff0 2023-08-11T12:26:25.206 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.196+0000 7f6fd9b15b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f31edd47e0 con 0x55f31ee82630 2023-08-11T12:26:25.206 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.196+0000 7f6fbf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f31ee87e80 0x55f31ee88260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:25.206 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.196+0000 7f6fbffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f31ee82ff0 0x55f31ee8ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:25.206 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.196+0000 7f6fbf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f31ee87e80 0x55f31ee88260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41702/0 (socket says 172.21.15.8:41702) 2023-08-11T12:26:25.206 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.196+0000 7f6fbf7fe700 1 -- 172.21.15.8:0/2430194066 learned_addr learned my addr 172.21.15.8:0/2430194066 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.196+0000 7f6fbeffd700 1 --2- 172.21.15.8:0/2430194066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f31ee82630 0x55f31ee82ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.196+0000 7f6fbeffd700 1 -- 172.21.15.8:0/2430194066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f31ee82ff0 msgr2=0x55f31ee8ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.196+0000 7f6fbeffd700 1 --2- 172.21.15.8:0/2430194066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f31ee82ff0 0x55f31ee8ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.196+0000 7f6fbeffd700 1 -- 172.21.15.8:0/2430194066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f31ee87e80 msgr2=0x55f31ee88260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.196+0000 7f6fbeffd700 1 --2- 172.21.15.8:0/2430194066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f31ee87e80 0x55f31ee88260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.196+0000 7f6fbeffd700 1 -- 172.21.15.8:0/2430194066 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f31ec545d0 con 0x55f31ee82630 2023-08-11T12:26:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.196+0000 7f6fbf7fe700 1 --2- 172.21.15.8:0/2430194066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f31ee87e80 0x55f31ee88260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:26:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.196+0000 7f6fbffff700 1 --2- 172.21.15.8:0/378558482 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f6fa80a0140 0x7f6fa80a2600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6fc019f730 tx=0x7f6fb8007a80 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:25.208 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.197+0000 7f6fbeffd700 1 --2- 172.21.15.8:0/2430194066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f31ee82630 0x55f31ee82ab0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40c8fd0 tx=0x7f6fb4098bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4125d148af07e1e1 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:25.208 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.197+0000 7f6fa5ffb700 1 -- 172.21.15.8:0/2430194066 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4098f90 con 0x55f31ee82630 2023-08-11T12:26:25.208 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.197+0000 7f6fa5ffb700 1 -- 172.21.15.8:0/2430194066 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6fb409cdc0 con 0x55f31ee82630 2023-08-11T12:26:25.208 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.197+0000 7f6fa5ffb700 1 -- 172.21.15.8:0/2430194066 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb40986a0 con 0x55f31ee82630 2023-08-11T12:26:25.208 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.198+0000 7f6fd9b15b80 1 -- 172.21.15.8:0/2430194066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f31ee82630 msgr2=0x55f31ee82ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:25.208 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.198+0000 7f6fd9b15b80 1 --2- 172.21.15.8:0/2430194066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f31ee82630 0x55f31ee82ab0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40c8fd0 tx=0x7f6fb4098bf0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.208 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.198+0000 7f6fd9b15b80 1 -- 172.21.15.8:0/2430194066 shutdown_connections 2023-08-11T12:26:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.198+0000 7f6fd9b15b80 1 --2- 172.21.15.8:0/2430194066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f31ee82ff0 0x55f31ee8ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.198+0000 7f6fd9b15b80 1 --2- 172.21.15.8:0/2430194066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f31ee87e80 0x55f31ee88260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.198+0000 7f6fd9b15b80 1 --2- 172.21.15.8:0/2430194066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f31ee82630 0x55f31ee82ab0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.198+0000 7f6fd9b15b80 1 -- 172.21.15.8:0/2430194066 >> 172.21.15.8:0/2430194066 conn(0x55f31edaf8f0 msgr2=0x55f31ee7ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.198+0000 7f6fd9b15b80 1 -- 172.21.15.8:0/2430194066 shutdown_connections 2023-08-11T12:26:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.198+0000 7f6fd9b15b80 1 -- 172.21.15.8:0/2430194066 wait complete. 2023-08-11T12:26:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.198+0000 7f6fd9b15b80 1 -- start start 2023-08-11T12:26:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.199+0000 7f6fd9b15b80 1 Processor -- start 2023-08-11T12:26:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.199+0000 7f6fd9b15b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f31ee82630 0x55f31ee919b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.199+0000 7f6fd9b15b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f31ee82ff0 0x55f31ee91ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.199+0000 7f6fd9b15b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f31ee87e80 0x55f31ee8bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.199+0000 7f6fd9b15b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f31ed72a60 con 0x55f31ee82630 2023-08-11T12:26:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.199+0000 7f6fd9b15b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f31ed72760 con 0x55f31ee82ff0 2023-08-11T12:26:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.199+0000 7f6fd9b15b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f31ec568c0 con 0x55f31ee87e80 2023-08-11T12:26:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.199+0000 7f6fd9b15b80 10 client.0 _ll_register_callbacks cb 0x55f31ed75a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:26:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.199+0000 7f6fbf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f31ee82630 0x55f31ee919b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.199+0000 7f6fbeffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f31ee82ff0 0x55f31ee91ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.199+0000 7f6fbf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f31ee82630 0x55f31ee919b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41718/0 (socket says 172.21.15.8:41718) 2023-08-11T12:26:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.199+0000 7f6fbeffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f31ee82ff0 0x55f31ee91ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:45610/0 (socket says 172.21.15.8:45610) 2023-08-11T12:26:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.199+0000 7f6fbf7fe700 1 -- 172.21.15.8:0/2082139764 learned_addr learned my addr 172.21.15.8:0/2082139764 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.200+0000 7f6fbffff700 1 --2- 172.21.15.8:0/2082139764 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f31ee87e80 0x55f31ee8bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.200+0000 7f6fbeffd700 1 -- 172.21.15.8:0/2082139764 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f31ee87e80 msgr2=0x55f31ee8bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.200+0000 7f6fbeffd700 1 --2- 172.21.15.8:0/2082139764 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f31ee87e80 0x55f31ee8bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.200+0000 7f6fbeffd700 1 -- 172.21.15.8:0/2082139764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f31ee82630 msgr2=0x55f31ee919b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.200+0000 7f6fbeffd700 1 --2- 172.21.15.8:0/2082139764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f31ee82630 0x55f31ee919b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.200+0000 7f6fbeffd700 1 -- 172.21.15.8:0/2082139764 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc0110230 con 0x55f31ee82ff0 2023-08-11T12:26:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.200+0000 7f6fbeffd700 1 --2- 172.21.15.8:0/2082139764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f31ee82ff0 0x55f31ee91ef0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55f31ee887a0 tx=0x7f6fb40994d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5c7b616bdeb2f4d server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.200+0000 7f6f9effd700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:26:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.200+0000 7f6f9effd700 1 -- 172.21.15.8:0/2082139764 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb40a0da0 con 0x55f31ee82ff0 2023-08-11T12:26:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.200+0000 7f6fd9b15b80 1 -- 172.21.15.8:0/2082139764 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f31ee757e0 con 0x55f31ee82ff0 2023-08-11T12:26:25.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.200+0000 7f6f9effd700 1 -- 172.21.15.8:0/2082139764 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f6fb4098f90 con 0x55f31ee82ff0 2023-08-11T12:26:25.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.201+0000 7f6f9effd700 1 -- 172.21.15.8:0/2082139764 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6fb40a0b20 con 0x55f31ee82ff0 2023-08-11T12:26:25.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.201+0000 7f6fd9b15b80 10 client.26105 fetch_fsmap learned FSMap version 32 2023-08-11T12:26:25.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.201+0000 7f6fd9b15b80 1 -- 172.21.15.8:0/2082139764 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f6fc01a5a20 con 0x55f31ee82ff0 2023-08-11T12:26:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.201+0000 7f6f9effd700 1 -- 172.21.15.8:0/2082139764 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f31ee757e0 con 0x55f31ee82ff0 2023-08-11T12:26:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.201+0000 7f6f9effd700 1 -- 172.21.15.8:0/2082139764 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 32) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f6fb4097ef0 con 0x55f31ee82ff0 2023-08-11T12:26:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.201+0000 7f6fd9b15b80 10 client.26105 fetch_fsmap finished waiting for FSMap version 32 2023-08-11T12:26:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.201+0000 7f6fd9b15b80 10 client.26105 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-11T12:26:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.201+0000 7f6fd9b15b80 20 client.26105 populate_metadata read hostname 'smithi008' 2023-08-11T12:26:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.201+0000 7f6fd9b15b80 1 --2- 172.21.15.8:0/2082139764 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f31ee9bc90 0x55f31ee9e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.201+0000 7f6fd9b15b80 4 client.26105 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:26:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.201+0000 7f6fd9b15b80 1 -- 172.21.15.8:0/2082139764 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f31ee51480 con 0x55f31ee9bc90 2023-08-11T12:26:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.201+0000 7f6fbf7fe700 1 --2- 172.21.15.8:0/2082139764 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f31ee9bc90 0x55f31ee9e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.202+0000 7f6fbf7fe700 1 --2- 172.21.15.8:0/2082139764 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f31ee9bc90 0x55f31ee9e0b0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=891b153dfdb5361a server_cookie=4820951185b45c24 in_seq=0 out_seq=0 2023-08-11T12:26:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.202+0000 7f6f9effd700 10 client.26105 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:26:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.203+0000 7f6f9effd700 1 -- 172.21.15.8:0/2082139764 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55f31ee51480 con 0x55f31ee9bc90 2023-08-11T12:26:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.203+0000 7f6f9effd700 10 client.26105 handle_command_reply: tid=0 2023-08-11T12:26:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.203+0000 7f6fd9b15b80 1 client.26105 shutdown 2023-08-11T12:26:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.203+0000 7f6fd9b15b80 1 -- 172.21.15.8:0/2082139764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f31ee82ff0 msgr2=0x55f31ee91ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.203+0000 7f6fd9b15b80 1 --2- 172.21.15.8:0/2082139764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f31ee82ff0 0x55f31ee91ef0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55f31ee887a0 tx=0x7f6fb40994d0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.203+0000 7f6fd9b15b80 1 -- 172.21.15.8:0/2082139764 shutdown_connections 2023-08-11T12:26:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.203+0000 7f6fd9b15b80 1 --2- 172.21.15.8:0/2082139764 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f31ee9bc90 0x55f31ee9e0b0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.203+0000 7f6fd9b15b80 1 --2- 172.21.15.8:0/2082139764 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f31ee87e80 0x55f31ee8bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.203+0000 7f6fd9b15b80 1 --2- 172.21.15.8:0/2082139764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f31ee82630 0x55f31ee919b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.203+0000 7f6fd9b15b80 1 --2- 172.21.15.8:0/2082139764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f31ee82ff0 0x55f31ee91ef0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.203+0000 7f6f9effd700 0 client.26105 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:26:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.203+0000 7f6fd9b15b80 1 -- 172.21.15.8:0/2082139764 >> 172.21.15.8:0/2082139764 conn(0x55f31edaf8f0 msgr2=0x55f31ee7c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.203+0000 7f6fd9b15b80 1 -- 172.21.15.8:0/2082139764 shutdown_connections 2023-08-11T12:26:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.203+0000 7f6fd9b15b80 1 -- 172.21.15.8:0/2082139764 wait complete. 2023-08-11T12:26:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.204+0000 7f6fd9b15b80 20 client.26105 trim_cache size 0 max 16384 2023-08-11T12:26:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.219+0000 7f6fd9b15b80 1 Processor -- start 2023-08-11T12:26:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.219+0000 7f6fd9b15b80 1 -- start start 2023-08-11T12:26:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.219+0000 7f6fd9b15b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f31ee82630 0x55f31ee8aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.220+0000 7f6fd9b15b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f31ee82ff0 0x55f31ee91510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.220+0000 7f6fd9b15b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f31ee87e80 0x55f31ee8bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.220+0000 7f6fd9b15b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f31ee7da60 con 0x55f31ee87e80 2023-08-11T12:26:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.220+0000 7f6fd9b15b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f31ee7e750 con 0x55f31ee82630 2023-08-11T12:26:25.224 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.220+0000 7f6fd9b15b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f31ee7e1a0 con 0x55f31ee82ff0 2023-08-11T12:26:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.220+0000 7f6fbf7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f31ee82630 0x55f31ee8aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.220+0000 7f6fbf7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f31ee82630 0x55f31ee8aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:45612/0 (socket says 172.21.15.8:45612) 2023-08-11T12:26:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.220+0000 7f6fbf7fe700 1 -- 172.21.15.8:0/1404101988 learned_addr learned my addr 172.21.15.8:0/1404101988 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.220+0000 7f6fbeffd700 1 --2- 172.21.15.8:0/1404101988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f31ee82ff0 0x55f31ee91510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.220+0000 7f6fbffff700 1 --2- 172.21.15.8:0/1404101988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f31ee87e80 0x55f31ee8bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:25.226 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.220+0000 7f6fbf7fe700 1 -- 172.21.15.8:0/1404101988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f31ee82ff0 msgr2=0x55f31ee91510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:25.226 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.220+0000 7f6fbf7fe700 1 --2- 172.21.15.8:0/1404101988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f31ee82ff0 0x55f31ee91510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.226 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.220+0000 7f6fbf7fe700 1 -- 172.21.15.8:0/1404101988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f31ee87e80 msgr2=0x55f31ee8bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:25.226 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.220+0000 7f6fbf7fe700 1 --2- 172.21.15.8:0/1404101988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f31ee87e80 0x55f31ee8bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.226 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.220+0000 7f6fbf7fe700 1 -- 172.21.15.8:0/1404101988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f31ec00d80 con 0x55f31ee82630 2023-08-11T12:26:25.226 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.221+0000 7f6fbf7fe700 1 --2- 172.21.15.8:0/1404101988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f31ee82630 0x55f31ee8aff0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000b6f0 tx=0x7f6fb0005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de496be6d373da46 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:25.226 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.221+0000 7f6fa67fc700 1 -- 172.21.15.8:0/1404101988 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb001d040 con 0x55f31ee82630 2023-08-11T12:26:25.227 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.221+0000 7f6fa67fc700 1 -- 172.21.15.8:0/1404101988 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6fb001e040 con 0x55f31ee82630 2023-08-11T12:26:25.227 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.221+0000 7f6fa67fc700 1 -- 172.21.15.8:0/1404101988 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0005440 con 0x55f31ee82630 2023-08-11T12:26:25.227 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.222+0000 7f6fd9b15b80 1 -- 172.21.15.8:0/1404101988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f31ee82630 msgr2=0x55f31ee8aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:25.227 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.222+0000 7f6fd9b15b80 1 --2- 172.21.15.8:0/1404101988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f31ee82630 0x55f31ee8aff0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000b6f0 tx=0x7f6fb0005fd0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.227 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.222+0000 7f6fd9b15b80 1 -- 172.21.15.8:0/1404101988 shutdown_connections 2023-08-11T12:26:25.227 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.222+0000 7f6fd9b15b80 1 --2- 172.21.15.8:0/1404101988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f31ee87e80 0x55f31ee8bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.227 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.222+0000 7f6fd9b15b80 1 --2- 172.21.15.8:0/1404101988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f31ee82630 0x55f31ee8aff0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.227 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.222+0000 7f6fd9b15b80 1 --2- 172.21.15.8:0/1404101988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f31ee82ff0 0x55f31ee91510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.228 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.222+0000 7f6fd9b15b80 1 -- 172.21.15.8:0/1404101988 >> 172.21.15.8:0/1404101988 conn(0x55f31edaf8f0 msgr2=0x55f31ee8b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:25.228 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.222+0000 7f6fd9b15b80 1 -- 172.21.15.8:0/1404101988 shutdown_connections 2023-08-11T12:26:25.228 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.222+0000 7f6fd9b15b80 1 -- 172.21.15.8:0/1404101988 wait complete. 2023-08-11T12:26:25.228 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.222+0000 7f6fd9b15b80 1 -- start start 2023-08-11T12:26:25.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.222+0000 7f6fd9b15b80 1 Processor -- start 2023-08-11T12:26:25.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.223+0000 7f6fd9b15b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f31ee82630 0x55f31eee3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:25.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.223+0000 7f6fd9b15b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f31ee82ff0 0x55f31eee3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:25.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.223+0000 7f6fd9b15b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f31ee87e80 0x55f31eeee910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:25.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.223+0000 7f6fd9b15b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f31eee4750 con 0x55f31ee82630 2023-08-11T12:26:25.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.223+0000 7f6fd9b15b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f31eeeee80 con 0x55f31ee82ff0 2023-08-11T12:26:25.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.223+0000 7f6fd9b15b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f31eeef040 con 0x55f31ee87e80 2023-08-11T12:26:25.232 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.223+0000 7f6fd9b15b80 10 client.0 _ll_register_callbacks cb 0x7f6fb4005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:26:25.232 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.223+0000 7f6fbeffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f31ee82ff0 0x55f31eee3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:25.232 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.223+0000 7f6fbeffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f31ee82ff0 0x55f31eee3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:45616/0 (socket says 172.21.15.8:45616) 2023-08-11T12:26:25.232 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.223+0000 7f6fbf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f31ee82630 0x55f31eee3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:25.232 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.223+0000 7f6fbeffd700 1 -- 172.21.15.8:0/3181225283 learned_addr learned my addr 172.21.15.8:0/3181225283 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:25.232 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.223+0000 7f6fbffff700 1 --2- 172.21.15.8:0/3181225283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f31ee87e80 0x55f31eeee910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:25.232 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.223+0000 7f6fbeffd700 1 -- 172.21.15.8:0/3181225283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f31ee87e80 msgr2=0x55f31eeee910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.224+0000 7f6fbeffd700 1 --2- 172.21.15.8:0/3181225283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f31ee87e80 0x55f31eeee910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.224+0000 7f6fbeffd700 1 -- 172.21.15.8:0/3181225283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f31ee82630 msgr2=0x55f31eee3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.224+0000 7f6fbeffd700 1 --2- 172.21.15.8:0/3181225283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f31ee82630 0x55f31eee3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.224+0000 7f6fbeffd700 1 -- 172.21.15.8:0/3181225283 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb000bb30 con 0x55f31ee82ff0 2023-08-11T12:26:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.224+0000 7f6fbeffd700 1 --2- 172.21.15.8:0/3181225283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f31ee82ff0 0x55f31eee3fc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6fb400e970 tx=0x7f6fb4010b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9bcb2c080079cfa server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.224+0000 7f6f9effd700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:26:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.224+0000 7f6f9effd700 1 -- 172.21.15.8:0/3181225283 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4098f90 con 0x55f31ee82ff0 2023-08-11T12:26:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.224+0000 7f6f9effd700 1 -- 172.21.15.8:0/3181225283 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f6fb40a0da0 con 0x55f31ee82ff0 2023-08-11T12:26:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.224+0000 7f6fd9b15b80 1 -- 172.21.15.8:0/3181225283 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6fb409cdc0 con 0x55f31ee82ff0 2023-08-11T12:26:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.224+0000 7f6f9effd700 1 -- 172.21.15.8:0/3181225283 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6fb4097330 con 0x55f31ee82ff0 2023-08-11T12:26:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.224+0000 7f6fd9b15b80 10 client.26111 fetch_fsmap learned FSMap version 32 2023-08-11T12:26:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.224+0000 7f6fd9b15b80 1 -- 172.21.15.8:0/3181225283 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55f31ebe9c00 con 0x55f31ee82ff0 2023-08-11T12:26:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.225+0000 7f6f9effd700 1 -- 172.21.15.8:0/3181225283 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6fb409cdc0 con 0x55f31ee82ff0 2023-08-11T12:26:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.225+0000 7f6f9effd700 1 -- 172.21.15.8:0/3181225283 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 32) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f6fb4099a40 con 0x55f31ee82ff0 2023-08-11T12:26:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.225+0000 7f6fd9b15b80 10 client.26111 fetch_fsmap finished waiting for FSMap version 32 2023-08-11T12:26:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.225+0000 7f6fd9b15b80 10 client.26111 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-11T12:26:25.235 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.225+0000 7f6fd9b15b80 20 client.26111 populate_metadata read hostname 'smithi008' 2023-08-11T12:26:25.235 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.225+0000 7f6fd9b15b80 1 --2- 172.21.15.8:0/3181225283 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f31eef0580 0x55f31eef29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:25.235 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.225+0000 7f6fd9b15b80 4 client.26111 mds_command: new command op to 24575 tid=0[{"prefix": "flush journal"}] 2023-08-11T12:26:25.235 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.225+0000 7f6fd9b15b80 1 -- 172.21.15.8:0/3181225283 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f31edcd7c0 con 0x55f31eef0580 2023-08-11T12:26:25.235 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.225+0000 7f6fbf7fe700 1 --2- 172.21.15.8:0/3181225283 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f31eef0580 0x55f31eef29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:25.235 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.226+0000 7f6fbf7fe700 1 --2- 172.21.15.8:0/3181225283 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f31eef0580 0x55f31eef29a0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9571c0e468991463 server_cookie=df37e74aa187b223 in_seq=0 out_seq=0 2023-08-11T12:26:25.235 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.226+0000 7f6f9effd700 10 client.26111 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:26:25.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.247+0000 7f6f9effd700 1 -- 172.21.15.8:0/3181225283 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f31edcd7c0 con 0x55f31eef0580 2023-08-11T12:26:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.247+0000 7f6f9effd700 10 client.26111 handle_command_reply: tid=0 2023-08-11T12:26:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.247+0000 7f6fd9b15b80 1 client.26111 shutdown 2023-08-11T12:26:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.247+0000 7f6fd9b15b80 1 -- 172.21.15.8:0/3181225283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f31ee82ff0 msgr2=0x55f31eee3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.247+0000 7f6fd9b15b80 1 --2- 172.21.15.8:0/3181225283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f31ee82ff0 0x55f31eee3fc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6fb400e970 tx=0x7f6fb4010b50 comp rx=0 tx=0).stop 2023-08-11T12:26:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.247+0000 7f6fd9b15b80 1 -- 172.21.15.8:0/3181225283 shutdown_connections 2023-08-11T12:26:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.247+0000 7f6fd9b15b80 1 --2- 172.21.15.8:0/3181225283 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f31eef0580 0x55f31eef29a0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.252 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.247+0000 7f6fd9b15b80 1 --2- 172.21.15.8:0/3181225283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f31ee87e80 0x55f31eeee910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.252 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.247+0000 7f6fd9b15b80 1 --2- 172.21.15.8:0/3181225283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f31ee82630 0x55f31eee3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.252 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.247+0000 7f6f9effd700 0 client.26111 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:26:25.252 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.247+0000 7f6fd9b15b80 1 --2- 172.21.15.8:0/3181225283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f31ee82ff0 0x55f31eee3fc0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.252 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.247+0000 7f6fd9b15b80 1 -- 172.21.15.8:0/3181225283 >> 172.21.15.8:0/3181225283 conn(0x55f31edaf8f0 msgr2=0x55f31ee86de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:25.252 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.247+0000 7f6fd9b15b80 1 -- 172.21.15.8:0/3181225283 shutdown_connections 2023-08-11T12:26:25.252 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.247+0000 7f6fd9b15b80 1 -- 172.21.15.8:0/3181225283 wait complete. 2023-08-11T12:26:25.252 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.248+0000 7f6fd9b15b80 20 client.26111 trim_cache size 0 max 16384 2023-08-11T12:26:25.253 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-08-11T12:26:25.253 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-08-11T12:26:25.253 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-08-11T12:26:25.253 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-08-11T12:26:25.254 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.248+0000 7f6fc61ff700 1 -- 172.21.15.8:0/378558482 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f6fa80a0140 msgr2=0x7f6fa80a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:25.254 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.248+0000 7f6fc61ff700 1 --2- 172.21.15.8:0/378558482 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f6fa80a0140 0x7f6fa80a2600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6fc019f730 tx=0x7f6fb8007a80 comp rx=0 tx=0).stop 2023-08-11T12:26:25.254 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.248+0000 7f6fc61ff700 1 -- 172.21.15.8:0/378558482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fc0073670 msgr2=0x7f6fc019ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:25.254 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.248+0000 7f6fc61ff700 1 --2- 172.21.15.8:0/378558482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fc0073670 0x7f6fc019ef70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6fb400e9a0 tx=0x7f6fb400ecb0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.254 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.248+0000 7f6fc61ff700 1 -- 172.21.15.8:0/378558482 shutdown_connections 2023-08-11T12:26:25.255 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.248+0000 7f6fc61ff700 1 --2- 172.21.15.8:0/378558482 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f6fa80a0140 0x7f6fa80a2600 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.255 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.248+0000 7f6fc61ff700 1 --2- 172.21.15.8:0/378558482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fc0072d50 0x7f6fc019ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.255 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.248+0000 7f6fc61ff700 1 --2- 172.21.15.8:0/378558482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6fc010d100 0x7f6fc0198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.255 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.248+0000 7f6fc61ff700 1 --2- 172.21.15.8:0/378558482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fc0073670 0x7f6fc019ef70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:25.255 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.248+0000 7f6fc61ff700 1 -- 172.21.15.8:0/378558482 >> 172.21.15.8:0/378558482 conn(0x7f6fc00fc3d0 msgr2=0x7f6fc010f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:25.255 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.249+0000 7f6fc61ff700 1 -- 172.21.15.8:0/378558482 shutdown_connections 2023-08-11T12:26:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:25.249+0000 7f6fc61ff700 1 -- 172.21.15.8:0/378558482 wait complete. 2023-08-11T12:26:25.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:24 smithi008 ceph-mon[97158]: pgmap v57: 129 pgs: 129 active+clean; 4.4 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 79 MiB/s wr, 66 op/s 2023-08-11T12:26:25.318 INFO:teuthology.orchestra.run.smithi008.stderr:26300000 of 50000000 tuples (52%) done (elapsed 90.01 s, remaining 81.11 s) 2023-08-11T12:26:25.479 INFO:teuthology.orchestra.run.smithi008.stderr:26400000 of 50000000 tuples (52%) done (elapsed 90.17 s, remaining 80.60 s) 2023-08-11T12:26:25.640 INFO:teuthology.orchestra.run.smithi008.stderr:26500000 of 50000000 tuples (53%) done (elapsed 90.33 s, remaining 80.10 s) 2023-08-11T12:26:25.824 INFO:teuthology.orchestra.run.smithi008.stderr:26600000 of 50000000 tuples (53%) done (elapsed 90.51 s, remaining 79.62 s) 2023-08-11T12:26:26.014 INFO:teuthology.orchestra.run.smithi008.stderr:26700000 of 50000000 tuples (53%) done (elapsed 90.70 s, remaining 79.15 s) 2023-08-11T12:26:26.192 INFO:teuthology.orchestra.run.smithi008.stderr:26800000 of 50000000 tuples (53%) done (elapsed 90.88 s, remaining 78.67 s) 2023-08-11T12:26:26.344 INFO:teuthology.orchestra.run.smithi008.stderr:26900000 of 50000000 tuples (53%) done (elapsed 91.03 s, remaining 78.17 s) 2023-08-11T12:26:26.550 INFO:teuthology.orchestra.run.smithi008.stderr:27000000 of 50000000 tuples (54%) done (elapsed 91.24 s, remaining 77.72 s) 2023-08-11T12:26:26.777 INFO:teuthology.orchestra.run.smithi008.stderr:27100000 of 50000000 tuples (54%) done (elapsed 91.46 s, remaining 77.29 s) 2023-08-11T12:26:26.987 INFO:teuthology.orchestra.run.smithi008.stderr:27200000 of 50000000 tuples (54%) done (elapsed 91.67 s, remaining 76.84 s) 2023-08-11T12:26:27.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:26 smithi194 ceph-mon[130905]: pgmap v58: 129 pgs: 129 active+clean; 4.4 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 79 MiB/s wr, 66 op/s 2023-08-11T12:26:27.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:26 smithi045 ceph-mon[130284]: pgmap v58: 129 pgs: 129 active+clean; 4.4 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 79 MiB/s wr, 66 op/s 2023-08-11T12:26:27.176 INFO:teuthology.orchestra.run.smithi008.stderr:27300000 of 50000000 tuples (54%) done (elapsed 91.86 s, remaining 76.38 s) 2023-08-11T12:26:27.288 INFO:teuthology.orchestra.run.smithi008.stderr:27400000 of 50000000 tuples (54%) done (elapsed 91.97 s, remaining 75.86 s) 2023-08-11T12:26:27.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:26 smithi008 ceph-mon[97158]: pgmap v58: 129 pgs: 129 active+clean; 4.4 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 79 MiB/s wr, 66 op/s 2023-08-11T12:26:27.475 INFO:teuthology.orchestra.run.smithi008.stderr:27500000 of 50000000 tuples (55%) done (elapsed 92.16 s, remaining 75.40 s) 2023-08-11T12:26:27.682 INFO:teuthology.orchestra.run.smithi008.stderr:27600000 of 50000000 tuples (55%) done (elapsed 92.37 s, remaining 74.97 s) 2023-08-11T12:26:27.834 INFO:teuthology.orchestra.run.smithi008.stderr:27700000 of 50000000 tuples (55%) done (elapsed 92.52 s, remaining 74.48 s) 2023-08-11T12:26:28.063 INFO:teuthology.orchestra.run.smithi008.stderr:27800000 of 50000000 tuples (55%) done (elapsed 92.75 s, remaining 74.07 s) 2023-08-11T12:26:28.235 INFO:teuthology.orchestra.run.smithi008.stderr:27900000 of 50000000 tuples (55%) done (elapsed 92.92 s, remaining 73.60 s) 2023-08-11T12:26:28.437 INFO:teuthology.orchestra.run.smithi008.stderr:28000000 of 50000000 tuples (56%) done (elapsed 93.12 s, remaining 73.17 s) 2023-08-11T12:26:28.636 INFO:teuthology.orchestra.run.smithi008.stderr:28100000 of 50000000 tuples (56%) done (elapsed 93.32 s, remaining 72.73 s) 2023-08-11T12:26:28.746 INFO:teuthology.orchestra.run.smithi008.stderr:28200000 of 50000000 tuples (56%) done (elapsed 93.43 s, remaining 72.23 s) 2023-08-11T12:26:28.966 INFO:teuthology.orchestra.run.smithi008.stderr:28300000 of 50000000 tuples (56%) done (elapsed 93.65 s, remaining 71.81 s) 2023-08-11T12:26:29.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:28 smithi194 ceph-mon[130905]: pgmap v59: 129 pgs: 129 active+clean; 5.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 142 MiB/s wr, 112 op/s 2023-08-11T12:26:29.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:28 smithi045 ceph-mon[130284]: pgmap v59: 129 pgs: 129 active+clean; 5.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 142 MiB/s wr, 112 op/s 2023-08-11T12:26:29.157 INFO:teuthology.orchestra.run.smithi008.stderr:28400000 of 50000000 tuples (56%) done (elapsed 93.84 s, remaining 71.37 s) 2023-08-11T12:26:29.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:28 smithi008 ceph-mon[97158]: pgmap v59: 129 pgs: 129 active+clean; 5.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 142 MiB/s wr, 112 op/s 2023-08-11T12:26:29.394 INFO:teuthology.orchestra.run.smithi008.stderr:28500000 of 50000000 tuples (57%) done (elapsed 94.08 s, remaining 70.97 s) 2023-08-11T12:26:29.546 INFO:teuthology.orchestra.run.smithi008.stderr:28600000 of 50000000 tuples (57%) done (elapsed 94.23 s, remaining 70.51 s) 2023-08-11T12:26:29.708 INFO:teuthology.orchestra.run.smithi008.stderr:28700000 of 50000000 tuples (57%) done (elapsed 94.39 s, remaining 70.06 s) 2023-08-11T12:26:29.940 INFO:teuthology.orchestra.run.smithi008.stderr:28800000 of 50000000 tuples (57%) done (elapsed 94.63 s, remaining 69.66 s) 2023-08-11T12:26:30.109 INFO:teuthology.orchestra.run.smithi008.stderr:28900000 of 50000000 tuples (57%) done (elapsed 94.80 s, remaining 69.21 s) 2023-08-11T12:26:30.252 INFO:teuthology.orchestra.run.smithi008.stderr:29000000 of 50000000 tuples (58%) done (elapsed 94.94 s, remaining 68.75 s) 2023-08-11T12:26:30.462 INFO:teuthology.orchestra.run.smithi008.stderr:29100000 of 50000000 tuples (58%) done (elapsed 95.15 s, remaining 68.34 s) 2023-08-11T12:26:30.694 INFO:teuthology.orchestra.run.smithi008.stderr:29200000 of 50000000 tuples (58%) done (elapsed 95.38 s, remaining 67.94 s) 2023-08-11T12:26:31.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:30 smithi008 ceph-mon[97158]: pgmap v60: 129 pgs: 129 active+clean; 5.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 84 MiB/s wr, 61 op/s 2023-08-11T12:26:31.063 INFO:teuthology.orchestra.run.smithi008.stderr:29300000 of 50000000 tuples (58%) done (elapsed 95.75 s, remaining 67.65 s) 2023-08-11T12:26:31.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:30 smithi194 ceph-mon[130905]: pgmap v60: 129 pgs: 129 active+clean; 5.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 84 MiB/s wr, 61 op/s 2023-08-11T12:26:31.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:30 smithi045 ceph-mon[130284]: pgmap v60: 129 pgs: 129 active+clean; 5.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 84 MiB/s wr, 61 op/s 2023-08-11T12:26:31.419 INFO:teuthology.orchestra.run.smithi008.stderr:29400000 of 50000000 tuples (58%) done (elapsed 96.11 s, remaining 67.34 s) 2023-08-11T12:26:32.007 INFO:teuthology.orchestra.run.smithi008.stderr:29500000 of 50000000 tuples (59%) done (elapsed 96.69 s, remaining 67.19 s) 2023-08-11T12:26:32.595 INFO:teuthology.orchestra.run.smithi008.stderr:29600000 of 50000000 tuples (59%) done (elapsed 97.28 s, remaining 67.05 s) 2023-08-11T12:26:33.003 INFO:teuthology.orchestra.run.smithi008.stderr:29700000 of 50000000 tuples (59%) done (elapsed 97.69 s, remaining 66.77 s) 2023-08-11T12:26:33.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:32 smithi194 ceph-mon[130905]: pgmap v61: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 124 MiB/s wr, 80 op/s 2023-08-11T12:26:33.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:32 smithi045 ceph-mon[130284]: pgmap v61: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 124 MiB/s wr, 80 op/s 2023-08-11T12:26:33.214 INFO:teuthology.orchestra.run.smithi008.stderr:29800000 of 50000000 tuples (59%) done (elapsed 97.90 s, remaining 66.36 s) 2023-08-11T12:26:33.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:32 smithi008 ceph-mon[97158]: pgmap v61: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 124 MiB/s wr, 80 op/s 2023-08-11T12:26:33.338 INFO:teuthology.orchestra.run.smithi008.stderr:29900000 of 50000000 tuples (59%) done (elapsed 98.03 s, remaining 65.90 s) 2023-08-11T12:26:33.551 INFO:teuthology.orchestra.run.smithi008.stderr:30000000 of 50000000 tuples (60%) done (elapsed 98.24 s, remaining 65.49 s) 2023-08-11T12:26:33.754 INFO:teuthology.orchestra.run.smithi008.stderr:30100000 of 50000000 tuples (60%) done (elapsed 98.44 s, remaining 65.08 s) 2023-08-11T12:26:33.972 INFO:teuthology.orchestra.run.smithi008.stderr:30200000 of 50000000 tuples (60%) done (elapsed 98.66 s, remaining 64.68 s) 2023-08-11T12:26:34.178 INFO:teuthology.orchestra.run.smithi008.stderr:30300000 of 50000000 tuples (60%) done (elapsed 98.87 s, remaining 64.28 s) 2023-08-11T12:26:34.369 INFO:teuthology.orchestra.run.smithi008.stderr:30400000 of 50000000 tuples (60%) done (elapsed 99.06 s, remaining 63.87 s) 2023-08-11T12:26:34.461 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:26:34.510 INFO:teuthology.orchestra.run.smithi008.stderr:30500000 of 50000000 tuples (61%) done (elapsed 99.20 s, remaining 63.42 s) 2023-08-11T12:26:34.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.713+0000 7f89d3bff700 1 -- 172.21.15.8:0/3038984650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89cc072d50 msgr2=0x7f89cc073130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:34.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.713+0000 7f89d3bff700 1 --2- 172.21.15.8:0/3038984650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89cc072d50 0x7f89cc073130 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f89c8009990 tx=0x7f89c8009ca0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.713+0000 7f89d3bff700 1 -- 172.21.15.8:0/3038984650 shutdown_connections 2023-08-11T12:26:34.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.713+0000 7f89d3bff700 1 --2- 172.21.15.8:0/3038984650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89cc10d1a0 0x7f89cc10f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.713+0000 7f89d3bff700 1 --2- 172.21.15.8:0/3038984650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89cc072d50 0x7f89cc073130 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.713+0000 7f89d3bff700 1 --2- 172.21.15.8:0/3038984650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc073670 0x7f89cc10cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.713+0000 7f89d3bff700 1 -- 172.21.15.8:0/3038984650 >> 172.21.15.8:0/3038984650 conn(0x7f89cc0fc490 msgr2=0x7f89cc0fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:34.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.713+0000 7f89d3bff700 1 -- 172.21.15.8:0/3038984650 shutdown_connections 2023-08-11T12:26:34.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.713+0000 7f89d3bff700 1 -- 172.21.15.8:0/3038984650 wait complete. 2023-08-11T12:26:34.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.714+0000 7f89d3bff700 1 Processor -- start 2023-08-11T12:26:34.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.714+0000 7f89d3bff700 1 -- start start 2023-08-11T12:26:34.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.715+0000 7f89d3bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89cc072d50 0x7f89cc19ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:34.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.715+0000 7f89d3bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc073670 0x7f89cc19efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:34.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.715+0000 7f89d3bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89cc10d1a0 0x7f89cc198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:34.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.715+0000 7f89d3bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc199150 con 0x7f89cc073670 2023-08-11T12:26:34.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.715+0000 7f89d3bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc1992c0 con 0x7f89cc10d1a0 2023-08-11T12:26:34.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.715+0000 7f89d3bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc199480 con 0x7f89cc072d50 2023-08-11T12:26:34.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.715+0000 7f89d219c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89cc10d1a0 0x7f89cc198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:34.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.715+0000 7f89d119a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc073670 0x7f89cc19efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:34.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.715+0000 7f89d219c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89cc10d1a0 0x7f89cc198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:38520/0 (socket says 172.21.15.8:38520) 2023-08-11T12:26:34.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.715+0000 7f89d199b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89cc072d50 0x7f89cc19ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:34.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.715+0000 7f89d219c700 1 -- 172.21.15.8:0/691241835 learned_addr learned my addr 172.21.15.8:0/691241835 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:34.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.716+0000 7f89d219c700 1 -- 172.21.15.8:0/691241835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89cc072d50 msgr2=0x7f89cc19ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:34.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.716+0000 7f89d219c700 1 --2- 172.21.15.8:0/691241835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89cc072d50 0x7f89cc19ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.716+0000 7f89d219c700 1 -- 172.21.15.8:0/691241835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc073670 msgr2=0x7f89cc19efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:34.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.716+0000 7f89d219c700 1 --2- 172.21.15.8:0/691241835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc073670 0x7f89cc19efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.716+0000 7f89d219c700 1 -- 172.21.15.8:0/691241835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c80095f0 con 0x7f89cc10d1a0 2023-08-11T12:26:34.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.716+0000 7f89d199b700 1 --2- 172.21.15.8:0/691241835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89cc072d50 0x7f89cc19ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:26:34.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.716+0000 7f89d119a700 1 --2- 172.21.15.8:0/691241835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc073670 0x7f89cc19efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:26:34.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.716+0000 7f89d219c700 1 --2- 172.21.15.8:0/691241835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89cc10d1a0 0x7f89cc198ae0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f89c400ef30 tx=0x7f89c400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:34.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.716+0000 7f89c2ffd700 1 -- 172.21.15.8:0/691241835 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c4018070 con 0x7f89cc10d1a0 2023-08-11T12:26:34.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.716+0000 7f89c2ffd700 1 -- 172.21.15.8:0/691241835 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f89c400f040 con 0x7f89cc10d1a0 2023-08-11T12:26:34.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.716+0000 7f89c2ffd700 1 -- 172.21.15.8:0/691241835 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c400cd00 con 0x7f89cc10d1a0 2023-08-11T12:26:34.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.716+0000 7f89d3bff700 1 -- 172.21.15.8:0/691241835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89cc199700 con 0x7f89cc10d1a0 2023-08-11T12:26:34.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.716+0000 7f89d3bff700 1 -- 172.21.15.8:0/691241835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89cc1a5a60 con 0x7f89cc10d1a0 2023-08-11T12:26:34.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.719+0000 7f89c2ffd700 1 -- 172.21.15.8:0/691241835 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f89c4003a00 con 0x7f89cc10d1a0 2023-08-11T12:26:34.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.721+0000 7f89e745bb80 1 Processor -- start 2023-08-11T12:26:34.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.722+0000 7f89e745bb80 1 -- start start 2023-08-11T12:26:34.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.722+0000 7f89c2ffd700 1 --2- 172.21.15.8:0/691241835 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f89b80a0140 0x7f89b80a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:34.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.722+0000 7f89e745bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1e3b36310 0x55d1e3b366f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:34.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.722+0000 7f89e745bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1e3b36c30 0x55d1e3b308e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:34.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.722+0000 7f89e745bb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1e3b30e20 0x55d1e3b31260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:34.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.722+0000 7f89c2ffd700 1 -- 172.21.15.8:0/691241835 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f89c40cb430 con 0x7f89cc10d1a0 2023-08-11T12:26:34.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.722+0000 7f89e745bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1e3a89630 con 0x55d1e3b36c30 2023-08-11T12:26:34.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.722+0000 7f89e745bb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1e3a86f50 con 0x55d1e3b30e20 2023-08-11T12:26:34.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.722+0000 7f89e745bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1e3a82840 con 0x55d1e3b36310 2023-08-11T12:26:34.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.722+0000 7f89d199b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1e3b36310 0x55d1e3b366f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:34.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.722+0000 7f89d199b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1e3b36310 0x55d1e3b366f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:38322/0 (socket says 172.21.15.8:38322) 2023-08-11T12:26:34.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.722+0000 7f89d199b700 1 -- 172.21.15.8:0/457794723 learned_addr learned my addr 172.21.15.8:0/457794723 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:34.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.722+0000 7f89d119a700 1 --2- 172.21.15.8:0/691241835 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f89b80a0140 0x7f89b80a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:34.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.722+0000 7f89d219c700 1 --2- 172.21.15.8:0/457794723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1e3b30e20 0x55d1e3b31260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:34.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.723+0000 7f89d119a700 1 --2- 172.21.15.8:0/457794723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1e3b36c30 0x55d1e3b308e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:34.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.723+0000 7f89d219c700 1 -- 172.21.15.8:0/457794723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1e3b36310 msgr2=0x55d1e3b366f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:34.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.723+0000 7f89d219c700 1 --2- 172.21.15.8:0/457794723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1e3b36310 0x55d1e3b366f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.723+0000 7f89d219c700 1 -- 172.21.15.8:0/457794723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1e3b36c30 msgr2=0x55d1e3b308e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:34.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.723+0000 7f89d219c700 1 --2- 172.21.15.8:0/457794723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1e3b36c30 0x55d1e3b308e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.723+0000 7f89d219c700 1 -- 172.21.15.8:0/457794723 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1e3902630 con 0x55d1e3b30e20 2023-08-11T12:26:34.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.723+0000 7f89d199b700 1 --2- 172.21.15.8:0/457794723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1e3b36310 0x55d1e3b366f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:26:34.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.723+0000 7f89d219c700 1 --2- 172.21.15.8:0/457794723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1e3b30e20 0x55d1e3b31260 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f89c40c8830 tx=0x7f89c4098410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34cdc1b48d9a1523 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:34.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.723+0000 7f89d119a700 1 --2- 172.21.15.8:0/691241835 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f89b80a0140 0x7f89b80a2600 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x55d1e3b2d0a0 tx=0x7f89bc009750 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:34.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.723+0000 7f89b7fff700 1 -- 172.21.15.8:0/457794723 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c401b320 con 0x55d1e3b30e20 2023-08-11T12:26:34.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.723+0000 7f89b7fff700 1 -- 172.21.15.8:0/457794723 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f89c4098f80 con 0x55d1e3b30e20 2023-08-11T12:26:34.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.723+0000 7f89b7fff700 1 -- 172.21.15.8:0/457794723 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c4094f90 con 0x55d1e3b30e20 2023-08-11T12:26:34.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.724+0000 7f89e745bb80 1 -- 172.21.15.8:0/457794723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1e3b30e20 msgr2=0x55d1e3b31260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:34.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.724+0000 7f89e745bb80 1 --2- 172.21.15.8:0/457794723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1e3b30e20 0x55d1e3b31260 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f89c40c8830 tx=0x7f89c4098410 comp rx=0 tx=0).stop 2023-08-11T12:26:34.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.724+0000 7f89e745bb80 1 -- 172.21.15.8:0/457794723 shutdown_connections 2023-08-11T12:26:34.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.724+0000 7f89e745bb80 1 --2- 172.21.15.8:0/457794723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1e3b36310 0x55d1e3b366f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.724+0000 7f89e745bb80 1 --2- 172.21.15.8:0/457794723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1e3b30e20 0x55d1e3b31260 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.724+0000 7f89e745bb80 1 --2- 172.21.15.8:0/457794723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1e3b36c30 0x55d1e3b308e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.724+0000 7f89e745bb80 1 -- 172.21.15.8:0/457794723 >> 172.21.15.8:0/457794723 conn(0x55d1e3a5d950 msgr2=0x55d1e3b2b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:34.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.724+0000 7f89e745bb80 1 -- 172.21.15.8:0/457794723 shutdown_connections 2023-08-11T12:26:34.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.724+0000 7f89e745bb80 1 -- 172.21.15.8:0/457794723 wait complete. 2023-08-11T12:26:34.732 INFO:teuthology.orchestra.run.smithi008.stderr:30600000 of 50000000 tuples (61%) done (elapsed 99.41 s, remaining 63.03 s) 2023-08-11T12:26:34.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.725+0000 7f89e745bb80 1 -- start start 2023-08-11T12:26:34.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.725+0000 7f89e745bb80 1 Processor -- start 2023-08-11T12:26:34.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.726+0000 7f89e745bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1e3b30e20 0x55d1e3b3cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:34.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.726+0000 7f89e745bb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1e3b36310 0x55d1e3b39e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:34.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.726+0000 7f89e745bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1e3b36c30 0x55d1e3b3a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:34.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.726+0000 7f89e745bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1e3a20ac0 con 0x55d1e3b36c30 2023-08-11T12:26:34.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.726+0000 7f89e745bb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1e3a207c0 con 0x55d1e3b36310 2023-08-11T12:26:34.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.726+0000 7f89e745bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1e3904920 con 0x55d1e3b30e20 2023-08-11T12:26:34.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.726+0000 7f89e745bb80 10 client.0 _ll_register_callbacks cb 0x55d1e3a23ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:26:34.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.726+0000 7f89d119a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1e3b36310 0x55d1e3b39e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:34.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.726+0000 7f89d219c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1e3b36c30 0x55d1e3b3a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:34.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.726+0000 7f89d119a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1e3b36310 0x55d1e3b39e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:38536/0 (socket says 172.21.15.8:38536) 2023-08-11T12:26:34.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.726+0000 7f89d119a700 1 -- 172.21.15.8:0/2037114068 learned_addr learned my addr 172.21.15.8:0/2037114068 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:34.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.726+0000 7f89d199b700 1 --2- 172.21.15.8:0/2037114068 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1e3b30e20 0x55d1e3b3cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:34.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.726+0000 7f89d119a700 1 -- 172.21.15.8:0/2037114068 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1e3b30e20 msgr2=0x55d1e3b3cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:34.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.726+0000 7f89d119a700 1 --2- 172.21.15.8:0/2037114068 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1e3b30e20 0x55d1e3b3cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.727+0000 7f89d119a700 1 -- 172.21.15.8:0/2037114068 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1e3b36c30 msgr2=0x55d1e3b3a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:34.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.727+0000 7f89d119a700 1 --2- 172.21.15.8:0/2037114068 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1e3b36c30 0x55d1e3b3a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.727+0000 7f89d119a700 1 -- 172.21.15.8:0/2037114068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89cc1102d0 con 0x55d1e3b36310 2023-08-11T12:26:34.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.727+0000 7f89d219c700 1 --2- 172.21.15.8:0/2037114068 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1e3b36c30 0x55d1e3b3a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:26:34.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.727+0000 7f89d119a700 1 --2- 172.21.15.8:0/2037114068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1e3b36310 0x55d1e3b39e60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f89bc00fe50 tx=0x7f89bc0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33f4f7685f6ab64d server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:34.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.727+0000 7f89b57fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:26:34.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.727+0000 7f89b57fa700 1 -- 172.21.15.8:0/2037114068 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc009c20 con 0x55d1e3b36310 2023-08-11T12:26:34.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.727+0000 7f89e745bb80 1 -- 172.21.15.8:0/2037114068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d1e3b23a90 con 0x55d1e3b36310 2023-08-11T12:26:34.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.727+0000 7f89b57fa700 1 -- 172.21.15.8:0/2037114068 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f89bc00fe80 con 0x55d1e3b36310 2023-08-11T12:26:34.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.727+0000 7f89b57fa700 1 -- 172.21.15.8:0/2037114068 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89bc01eb70 con 0x55d1e3b36310 2023-08-11T12:26:34.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.727+0000 7f89e745bb80 10 client.26123 fetch_fsmap learned FSMap version 32 2023-08-11T12:26:34.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.728+0000 7f89e745bb80 1 -- 172.21.15.8:0/2037114068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f89cc1a5a60 con 0x55d1e3b36310 2023-08-11T12:26:34.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.728+0000 7f89b57fa700 1 -- 172.21.15.8:0/2037114068 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d1e3b23a90 con 0x55d1e3b36310 2023-08-11T12:26:34.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.728+0000 7f89b57fa700 1 -- 172.21.15.8:0/2037114068 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 32) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f89bc00e3b0 con 0x55d1e3b36310 2023-08-11T12:26:34.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.728+0000 7f89e745bb80 10 client.26123 fetch_fsmap finished waiting for FSMap version 32 2023-08-11T12:26:34.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.728+0000 7f89e745bb80 10 client.26123 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:26:34.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.728+0000 7f89e745bb80 20 client.26123 populate_metadata read hostname 'smithi008' 2023-08-11T12:26:34.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.728+0000 7f89e745bb80 1 --2- 172.21.15.8:0/2037114068 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55d1e3b4a520 0x55d1e3b4c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:34.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.728+0000 7f89e745bb80 4 client.26123 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:26:34.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.728+0000 7f89e745bb80 1 -- 172.21.15.8:0/2037114068 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d1e3aff4e0 con 0x55d1e3b4a520 2023-08-11T12:26:34.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.728+0000 7f89d199b700 1 --2- 172.21.15.8:0/2037114068 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55d1e3b4a520 0x55d1e3b4c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:34.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.729+0000 7f89b57fa700 10 client.26123 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:26:34.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.729+0000 7f89d199b700 1 --2- 172.21.15.8:0/2037114068 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55d1e3b4a520 0x55d1e3b4c940 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98e7f137e37dca93 server_cookie=8a70fa6fd4d45cd in_seq=0 out_seq=0 2023-08-11T12:26:34.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.730+0000 7f89b57fa700 1 -- 172.21.15.8:0/2037114068 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55d1e3aff4e0 con 0x55d1e3b4a520 2023-08-11T12:26:34.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.730+0000 7f89b57fa700 10 client.26123 handle_command_reply: tid=0 2023-08-11T12:26:34.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.730+0000 7f89e745bb80 1 client.26123 shutdown 2023-08-11T12:26:34.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.730+0000 7f89e745bb80 1 -- 172.21.15.8:0/2037114068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1e3b36310 msgr2=0x55d1e3b39e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:34.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.730+0000 7f89e745bb80 1 --2- 172.21.15.8:0/2037114068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1e3b36310 0x55d1e3b39e60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f89bc00fe50 tx=0x7f89bc0047c0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.730+0000 7f89e745bb80 1 -- 172.21.15.8:0/2037114068 shutdown_connections 2023-08-11T12:26:34.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.730+0000 7f89e745bb80 1 --2- 172.21.15.8:0/2037114068 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55d1e3b4a520 0x55d1e3b4c940 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.730+0000 7f89e745bb80 1 --2- 172.21.15.8:0/2037114068 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1e3b30e20 0x55d1e3b3cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.730+0000 7f89e745bb80 1 --2- 172.21.15.8:0/2037114068 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1e3b36c30 0x55d1e3b3a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.730+0000 7f89e745bb80 1 --2- 172.21.15.8:0/2037114068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1e3b36310 0x55d1e3b39e60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.730+0000 7f89b57fa700 0 client.26123 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:26:34.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.730+0000 7f89e745bb80 1 -- 172.21.15.8:0/2037114068 >> 172.21.15.8:0/2037114068 conn(0x55d1e3a5d950 msgr2=0x55d1e3b25cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:34.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.730+0000 7f89e745bb80 1 -- 172.21.15.8:0/2037114068 shutdown_connections 2023-08-11T12:26:34.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.730+0000 7f89e745bb80 1 -- 172.21.15.8:0/2037114068 wait complete. 2023-08-11T12:26:34.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.731+0000 7f89e745bb80 20 client.26123 trim_cache size 0 max 16384 2023-08-11T12:26:34.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.752+0000 7f89e745bb80 1 Processor -- start 2023-08-11T12:26:34.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.752+0000 7f89e745bb80 1 -- start start 2023-08-11T12:26:34.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.752+0000 7f89e745bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1e3b30e20 0x55d1e3b308e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:34.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.752+0000 7f89e745bb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1e3b36310 0x55d1e3b35790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:34.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.752+0000 7f89e745bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1e3b36c30 0x55d1e3b3c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:34.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.752+0000 7f89e745bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1e3b27b30 con 0x55d1e3b36c30 2023-08-11T12:26:34.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.752+0000 7f89e745bb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1e3b23a30 con 0x55d1e3b36310 2023-08-11T12:26:34.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.752+0000 7f89e745bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1e3b2c720 con 0x55d1e3b30e20 2023-08-11T12:26:34.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.752+0000 7f89d119a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1e3b36310 0x55d1e3b35790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:34.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.753+0000 7f89d199b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1e3b30e20 0x55d1e3b308e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:34.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.753+0000 7f89d119a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1e3b36310 0x55d1e3b35790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:38548/0 (socket says 172.21.15.8:38548) 2023-08-11T12:26:34.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.753+0000 7f89d119a700 1 -- 172.21.15.8:0/403650010 learned_addr learned my addr 172.21.15.8:0/403650010 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:34.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.753+0000 7f89d219c700 1 --2- 172.21.15.8:0/403650010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1e3b36c30 0x55d1e3b3c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:34.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.753+0000 7f89d199b700 1 -- 172.21.15.8:0/403650010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1e3b36310 msgr2=0x55d1e3b35790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:34.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.753+0000 7f89d199b700 1 --2- 172.21.15.8:0/403650010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1e3b36310 0x55d1e3b35790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.753+0000 7f89d199b700 1 -- 172.21.15.8:0/403650010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1e3b36c30 msgr2=0x55d1e3b3c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:34.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.753+0000 7f89d199b700 1 --2- 172.21.15.8:0/403650010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1e3b36c30 0x55d1e3b3c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.753+0000 7f89d199b700 1 -- 172.21.15.8:0/403650010 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1e38aede0 con 0x55d1e3b30e20 2023-08-11T12:26:34.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.753+0000 7f89d199b700 1 --2- 172.21.15.8:0/403650010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1e3b30e20 0x55d1e3b308e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55d1e3b4d200 tx=0x7f89c800b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ca36180c22045da server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:34.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.753+0000 7f89c0bff700 1 -- 172.21.15.8:0/403650010 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c801d040 con 0x55d1e3b30e20 2023-08-11T12:26:34.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.753+0000 7f89c0bff700 1 -- 172.21.15.8:0/403650010 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f89c801e040 con 0x55d1e3b30e20 2023-08-11T12:26:34.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.753+0000 7f89c0bff700 1 -- 172.21.15.8:0/403650010 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c80055a0 con 0x55d1e3b30e20 2023-08-11T12:26:34.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.754+0000 7f89e745bb80 1 -- 172.21.15.8:0/403650010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1e3b30e20 msgr2=0x55d1e3b308e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:34.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.754+0000 7f89e745bb80 1 --2- 172.21.15.8:0/403650010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1e3b30e20 0x55d1e3b308e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55d1e3b4d200 tx=0x7f89c800b260 comp rx=0 tx=0).stop 2023-08-11T12:26:34.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.754+0000 7f89e745bb80 1 -- 172.21.15.8:0/403650010 shutdown_connections 2023-08-11T12:26:34.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.754+0000 7f89e745bb80 1 --2- 172.21.15.8:0/403650010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1e3b30e20 0x55d1e3b308e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.754+0000 7f89e745bb80 1 --2- 172.21.15.8:0/403650010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1e3b36c30 0x55d1e3b3c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.754+0000 7f89e745bb80 1 --2- 172.21.15.8:0/403650010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1e3b36310 0x55d1e3b35790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.754+0000 7f89e745bb80 1 -- 172.21.15.8:0/403650010 >> 172.21.15.8:0/403650010 conn(0x55d1e3a5d950 msgr2=0x55d1e3b35080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:34.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.754+0000 7f89e745bb80 1 -- 172.21.15.8:0/403650010 shutdown_connections 2023-08-11T12:26:34.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.754+0000 7f89e745bb80 1 -- 172.21.15.8:0/403650010 wait complete. 2023-08-11T12:26:34.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.755+0000 7f89e745bb80 1 -- start start 2023-08-11T12:26:34.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.755+0000 7f89e745bb80 1 Processor -- start 2023-08-11T12:26:34.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.755+0000 7f89e745bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1e3b30e20 0x55d1e3b415a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:34.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.755+0000 7f89e745bb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1e3b36310 0x55d1e3b3f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:34.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.755+0000 7f89e745bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1e3b36c30 0x55d1e3b3ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:34.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.755+0000 7f89e745bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1e3b40640 con 0x55d1e3b36c30 2023-08-11T12:26:34.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.755+0000 7f89e745bb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1e3b407b0 con 0x55d1e3b36310 2023-08-11T12:26:34.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.755+0000 7f89e745bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1e3b9e1c0 con 0x55d1e3b30e20 2023-08-11T12:26:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.756+0000 7f89e745bb80 10 client.0 _ll_register_callbacks cb 0x7f89bc00fa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:26:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.756+0000 7f89d119a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1e3b36310 0x55d1e3b3f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.756+0000 7f89d199b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1e3b30e20 0x55d1e3b415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.756+0000 7f89d119a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1e3b36310 0x55d1e3b3f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:38556/0 (socket says 172.21.15.8:38556) 2023-08-11T12:26:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.756+0000 7f89d119a700 1 -- 172.21.15.8:0/1382034597 learned_addr learned my addr 172.21.15.8:0/1382034597 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.756+0000 7f89d219c700 1 --2- 172.21.15.8:0/1382034597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1e3b36c30 0x55d1e3b3ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.756+0000 7f89d119a700 1 -- 172.21.15.8:0/1382034597 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1e3b30e20 msgr2=0x55d1e3b415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.756+0000 7f89d119a700 1 --2- 172.21.15.8:0/1382034597 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1e3b30e20 0x55d1e3b415a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.756+0000 7f89d119a700 1 -- 172.21.15.8:0/1382034597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1e3b36c30 msgr2=0x55d1e3b3ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:34.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.756+0000 7f89d119a700 1 --2- 172.21.15.8:0/1382034597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1e3b36c30 0x55d1e3b3ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.756+0000 7f89d119a700 1 -- 172.21.15.8:0/1382034597 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c800bce0 con 0x55d1e3b36310 2023-08-11T12:26:34.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.756+0000 7f89d199b700 1 --2- 172.21.15.8:0/1382034597 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1e3b30e20 0x55d1e3b415a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:26:34.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.756+0000 7f89d119a700 1 --2- 172.21.15.8:0/1382034597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1e3b36310 0x55d1e3b3f960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f89bc00e7c0 tx=0x7f89bc00ef70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4d77d5ecb754546 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:34.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.756+0000 7f89b57fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:26:34.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.757+0000 7f89b57fa700 1 -- 172.21.15.8:0/1382034597 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc00fe50 con 0x55d1e3b36310 2023-08-11T12:26:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.757+0000 7f89e745bb80 1 -- 172.21.15.8:0/1382034597 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f89c4098f80 con 0x55d1e3b36310 2023-08-11T12:26:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.757+0000 7f89b57fa700 1 -- 172.21.15.8:0/1382034597 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f89bc00e930 con 0x55d1e3b36310 2023-08-11T12:26:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.757+0000 7f89b57fa700 1 -- 172.21.15.8:0/1382034597 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89bc00eaf0 con 0x55d1e3b36310 2023-08-11T12:26:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.757+0000 7f89e745bb80 10 client.26129 fetch_fsmap learned FSMap version 32 2023-08-11T12:26:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.757+0000 7f89e745bb80 1 -- 172.21.15.8:0/1382034597 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55d1e3897c60 con 0x55d1e3b36310 2023-08-11T12:26:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.757+0000 7f89b57fa700 1 -- 172.21.15.8:0/1382034597 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f89c4098f80 con 0x55d1e3b36310 2023-08-11T12:26:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.757+0000 7f89b57fa700 1 -- 172.21.15.8:0/1382034597 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 32) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f89bc030050 con 0x55d1e3b36310 2023-08-11T12:26:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.758+0000 7f89e745bb80 10 client.26129 fetch_fsmap finished waiting for FSMap version 32 2023-08-11T12:26:34.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.758+0000 7f89e745bb80 10 client.26129 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:26:34.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.758+0000 7f89e745bb80 20 client.26129 populate_metadata read hostname 'smithi008' 2023-08-11T12:26:34.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.758+0000 7f89e745bb80 1 --2- 172.21.15.8:0/1382034597 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55d1e3b9f9d0 0x55d1e3ba1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:34.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.758+0000 7f89e745bb80 4 client.26129 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:26:34.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.758+0000 7f89e745bb80 1 -- 172.21.15.8:0/1382034597 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d1e3a7b820 con 0x55d1e3b9f9d0 2023-08-11T12:26:34.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.758+0000 7f89d199b700 1 --2- 172.21.15.8:0/1382034597 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55d1e3b9f9d0 0x55d1e3ba1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:34.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.758+0000 7f89d199b700 1 --2- 172.21.15.8:0/1382034597 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55d1e3b9f9d0 0x55d1e3ba1df0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e08426e8061faf7f server_cookie=5b67053da377a247 in_seq=0 out_seq=0 2023-08-11T12:26:34.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.758+0000 7f89b57fa700 10 client.26129 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:26:34.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.759+0000 7f89b57fa700 1 -- 172.21.15.8:0/1382034597 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55d1e3a7b820 con 0x55d1e3b9f9d0 2023-08-11T12:26:34.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.759+0000 7f89b57fa700 10 client.26129 handle_command_reply: tid=0 2023-08-11T12:26:34.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.759+0000 7f89e745bb80 1 client.26129 shutdown 2023-08-11T12:26:34.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.759+0000 7f89e745bb80 1 -- 172.21.15.8:0/1382034597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1e3b36310 msgr2=0x55d1e3b3f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:34.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.759+0000 7f89e745bb80 1 --2- 172.21.15.8:0/1382034597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1e3b36310 0x55d1e3b3f960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f89bc00e7c0 tx=0x7f89bc00ef70 comp rx=0 tx=0).stop 2023-08-11T12:26:34.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.759+0000 7f89e745bb80 1 -- 172.21.15.8:0/1382034597 shutdown_connections 2023-08-11T12:26:34.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.759+0000 7f89e745bb80 1 --2- 172.21.15.8:0/1382034597 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55d1e3b9f9d0 0x55d1e3ba1df0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.759+0000 7f89e745bb80 1 --2- 172.21.15.8:0/1382034597 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1e3b30e20 0x55d1e3b415a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.759+0000 7f89e745bb80 1 --2- 172.21.15.8:0/1382034597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1e3b36c30 0x55d1e3b3ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.759+0000 7f89b57fa700 0 client.26129 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:26:34.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.759+0000 7f89e745bb80 1 --2- 172.21.15.8:0/1382034597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1e3b36310 0x55d1e3b3f960 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.759+0000 7f89e745bb80 1 -- 172.21.15.8:0/1382034597 >> 172.21.15.8:0/1382034597 conn(0x55d1e3a5d950 msgr2=0x55d1e3b378a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:34.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.759+0000 7f89e745bb80 1 -- 172.21.15.8:0/1382034597 shutdown_connections 2023-08-11T12:26:34.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.759+0000 7f89e745bb80 1 -- 172.21.15.8:0/1382034597 wait complete. 2023-08-11T12:26:34.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.759+0000 7f89e745bb80 20 client.26129 trim_cache size 0 max 16384 2023-08-11T12:26:34.771 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:26:34.771 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:26:34.771 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:26:34.771 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:26:34.771 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:26:34.772 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:26:34.772 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:26:34.772 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:26:34.772 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:26:34.772 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:26:34.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.760+0000 7f89d3bff700 1 -- 172.21.15.8:0/691241835 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f89b80a0140 msgr2=0x7f89b80a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:34.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.760+0000 7f89d3bff700 1 --2- 172.21.15.8:0/691241835 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f89b80a0140 0x7f89b80a2600 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x55d1e3b2d0a0 tx=0x7f89bc009750 comp rx=0 tx=0).stop 2023-08-11T12:26:34.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.760+0000 7f89d3bff700 1 -- 172.21.15.8:0/691241835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89cc10d1a0 msgr2=0x7f89cc198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:34.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.760+0000 7f89d3bff700 1 --2- 172.21.15.8:0/691241835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89cc10d1a0 0x7f89cc198ae0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f89c400ef30 tx=0x7f89c400c3a0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.760+0000 7f89d3bff700 1 -- 172.21.15.8:0/691241835 shutdown_connections 2023-08-11T12:26:34.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.760+0000 7f89d3bff700 1 --2- 172.21.15.8:0/691241835 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f89b80a0140 0x7f89b80a2600 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.760+0000 7f89d3bff700 1 --2- 172.21.15.8:0/691241835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89cc072d50 0x7f89cc19ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.760+0000 7f89d3bff700 1 --2- 172.21.15.8:0/691241835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89cc10d1a0 0x7f89cc198ae0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.760+0000 7f89d3bff700 1 --2- 172.21.15.8:0/691241835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89cc073670 0x7f89cc19efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:34.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.760+0000 7f89d3bff700 1 -- 172.21.15.8:0/691241835 >> 172.21.15.8:0/691241835 conn(0x7f89cc0fc490 msgr2=0x7f89cc10f320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:34.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.760+0000 7f89d3bff700 1 -- 172.21.15.8:0/691241835 shutdown_connections 2023-08-11T12:26:34.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:26:34.760+0000 7f89d3bff700 1 -- 172.21.15.8:0/691241835 wait complete. 2023-08-11T12:26:34.782 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:26:34.932 INFO:teuthology.orchestra.run.smithi008.stderr:30700000 of 50000000 tuples (61%) done (elapsed 99.62 s, remaining 62.63 s) 2023-08-11T12:26:35.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:34 smithi008 ceph-mon[97158]: pgmap v62: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 102 MiB/s wr, 65 op/s 2023-08-11T12:26:35.063 INFO:teuthology.orchestra.run.smithi008.stderr:30800000 of 50000000 tuples (61%) done (elapsed 99.75 s, remaining 62.18 s) 2023-08-11T12:26:35.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:34 smithi194 ceph-mon[130905]: pgmap v62: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 102 MiB/s wr, 65 op/s 2023-08-11T12:26:35.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:34 smithi045 ceph-mon[130284]: pgmap v62: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 102 MiB/s wr, 65 op/s 2023-08-11T12:26:35.229 INFO:teuthology.orchestra.run.smithi008.stderr:30900000 of 50000000 tuples (61%) done (elapsed 99.92 s, remaining 61.76 s) 2023-08-11T12:26:35.467 INFO:teuthology.orchestra.run.smithi008.stderr:31000000 of 50000000 tuples (62%) done (elapsed 100.15 s, remaining 61.38 s) 2023-08-11T12:26:35.609 INFO:teuthology.orchestra.run.smithi008.stderr:31100000 of 50000000 tuples (62%) done (elapsed 100.30 s, remaining 60.95 s) 2023-08-11T12:26:35.780 INFO:teuthology.orchestra.run.smithi008.stderr:31200000 of 50000000 tuples (62%) done (elapsed 100.47 s, remaining 60.54 s) 2023-08-11T12:26:36.008 INFO:teuthology.orchestra.run.smithi008.stderr:31300000 of 50000000 tuples (62%) done (elapsed 100.69 s, remaining 60.16 s) 2023-08-11T12:26:36.202 INFO:teuthology.orchestra.run.smithi008.stderr:31400000 of 50000000 tuples (62%) done (elapsed 100.89 s, remaining 59.76 s) 2023-08-11T12:26:36.393 INFO:teuthology.orchestra.run.smithi008.stderr:31500000 of 50000000 tuples (63%) done (elapsed 101.08 s, remaining 59.36 s) 2023-08-11T12:26:36.520 INFO:teuthology.orchestra.run.smithi008.stderr:31600000 of 50000000 tuples (63%) done (elapsed 101.21 s, remaining 58.93 s) 2023-08-11T12:26:36.716 INFO:teuthology.orchestra.run.smithi008.stderr:31700000 of 50000000 tuples (63%) done (elapsed 101.40 s, remaining 58.54 s) 2023-08-11T12:26:36.951 INFO:teuthology.orchestra.run.smithi008.stderr:31800000 of 50000000 tuples (63%) done (elapsed 101.64 s, remaining 58.17 s) 2023-08-11T12:26:37.116 INFO:teuthology.orchestra.run.smithi008.stderr:31900000 of 50000000 tuples (63%) done (elapsed 101.80 s, remaining 57.76 s) 2023-08-11T12:26:37.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:36 smithi194 ceph-mon[130905]: pgmap v63: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 102 MiB/s wr, 65 op/s 2023-08-11T12:26:37.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:36 smithi045 ceph-mon[130284]: pgmap v63: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 102 MiB/s wr, 65 op/s 2023-08-11T12:26:37.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:36 smithi008 ceph-mon[97158]: pgmap v63: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 102 MiB/s wr, 65 op/s 2023-08-11T12:26:37.306 INFO:teuthology.orchestra.run.smithi008.stderr:32000000 of 50000000 tuples (64%) done (elapsed 101.99 s, remaining 57.37 s) 2023-08-11T12:26:37.506 INFO:teuthology.orchestra.run.smithi008.stderr:32100000 of 50000000 tuples (64%) done (elapsed 102.19 s, remaining 56.99 s) 2023-08-11T12:26:37.723 INFO:teuthology.orchestra.run.smithi008.stderr:32200000 of 50000000 tuples (64%) done (elapsed 102.41 s, remaining 56.61 s) 2023-08-11T12:26:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:32300000 of 50000000 tuples (64%) done (elapsed 102.62 s, remaining 56.24 s) 2023-08-11T12:26:38.084 INFO:teuthology.orchestra.run.smithi008.stderr:32400000 of 50000000 tuples (64%) done (elapsed 102.77 s, remaining 55.83 s) 2023-08-11T12:26:38.325 INFO:teuthology.orchestra.run.smithi008.stderr:32500000 of 50000000 tuples (65%) done (elapsed 103.01 s, remaining 55.47 s) 2023-08-11T12:26:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.404+0000 7fb1acbff700 1 -- 172.21.15.8:0/2069150503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1a81032f0 msgr2=0x7fb1a81037a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.404+0000 7fb1acbff700 1 --2- 172.21.15.8:0/2069150503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1a81032f0 0x7fb1a81037a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb1a000b0a0 tx=0x7fb1a000b3b0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.404+0000 7fb1acbff700 1 -- 172.21.15.8:0/2069150503 shutdown_connections 2023-08-11T12:26:38.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.404+0000 7fb1acbff700 1 --2- 172.21.15.8:0/2069150503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1a81032f0 0x7fb1a81037a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.404+0000 7fb1acbff700 1 --2- 172.21.15.8:0/2069150503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1a81057f0 0x7fb1a8067e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.404+0000 7fb1acbff700 1 --2- 172.21.15.8:0/2069150503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1a80683c0 0x7fb1a8068840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.410 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.404+0000 7fb1acbff700 1 -- 172.21.15.8:0/2069150503 >> 172.21.15.8:0/2069150503 conn(0x7fb1a8075300 msgr2=0x7fb1a8075710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:38.410 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.404+0000 7fb1acbff700 1 -- 172.21.15.8:0/2069150503 shutdown_connections 2023-08-11T12:26:38.410 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.405+0000 7fb1acbff700 1 -- 172.21.15.8:0/2069150503 wait complete. 2023-08-11T12:26:38.413 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.406+0000 7fb1acbff700 1 Processor -- start 2023-08-11T12:26:38.413 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.406+0000 7fb1acbff700 1 -- start start 2023-08-11T12:26:38.414 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.407+0000 7fb1acbff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1a80683c0 0x7fb1a819cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:38.414 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.407+0000 7fb1acbff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1a81032f0 0x7fb1a819d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:38.414 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.407+0000 7fb1acbff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1a81057f0 0x7fb1a81a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:38.414 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.407+0000 7fb1acbff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a81a1f40 con 0x7fb1a81057f0 2023-08-11T12:26:38.414 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.407+0000 7fb1acbff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a81a20b0 con 0x7fb1a80683c0 2023-08-11T12:26:38.414 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.407+0000 7fb1acbff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a81a2270 con 0x7fb1a81032f0 2023-08-11T12:26:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.407+0000 7fb1a659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1a80683c0 0x7fb1a819cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.407+0000 7fb1a659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1a80683c0 0x7fb1a819cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:38762/0 (socket says 172.21.15.8:38762) 2023-08-11T12:26:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.407+0000 7fb1a659c700 1 -- 172.21.15.8:0/333397346 learned_addr learned my addr 172.21.15.8:0/333397346 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.407+0000 7fb1a6d9d700 1 --2- 172.21.15.8:0/333397346 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1a81057f0 0x7fb1a81a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.407+0000 7fb1a5d9b700 1 --2- 172.21.15.8:0/333397346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1a81032f0 0x7fb1a819d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.408+0000 7fb1a659c700 1 -- 172.21.15.8:0/333397346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1a81032f0 msgr2=0x7fb1a819d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.408+0000 7fb1a659c700 1 --2- 172.21.15.8:0/333397346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1a81032f0 0x7fb1a819d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.408+0000 7fb1a659c700 1 -- 172.21.15.8:0/333397346 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1a81057f0 msgr2=0x7fb1a81a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:38.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.408+0000 7fb1a659c700 1 --2- 172.21.15.8:0/333397346 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1a81057f0 0x7fb1a81a1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.408+0000 7fb1a659c700 1 -- 172.21.15.8:0/333397346 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb198009520 con 0x7fb1a80683c0 2023-08-11T12:26:38.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.408+0000 7fb1a6d9d700 1 --2- 172.21.15.8:0/333397346 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1a81057f0 0x7fb1a81a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:26:38.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.408+0000 7fb1a5d9b700 1 --2- 172.21.15.8:0/333397346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1a81032f0 0x7fb1a819d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:26:38.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.408+0000 7fb1a659c700 1 --2- 172.21.15.8:0/333397346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1a80683c0 0x7fb1a819cf60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb19800eb30 tx=0x7fb19800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:38.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.408+0000 7fb1977fe700 1 -- 172.21.15.8:0/333397346 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb198009880 con 0x7fb1a80683c0 2023-08-11T12:26:38.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.408+0000 7fb1acbff700 1 -- 172.21.15.8:0/333397346 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a0009d00 con 0x7fb1a80683c0 2023-08-11T12:26:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.408+0000 7fb1977fe700 1 -- 172.21.15.8:0/333397346 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb1980044e0 con 0x7fb1a80683c0 2023-08-11T12:26:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.408+0000 7fb1977fe700 1 -- 172.21.15.8:0/333397346 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb198010430 con 0x7fb1a80683c0 2023-08-11T12:26:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.409+0000 7fb1acbff700 1 -- 172.21.15.8:0/333397346 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a81a2740 con 0x7fb1a80683c0 2023-08-11T12:26:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.414+0000 7fb1977fe700 1 -- 172.21.15.8:0/333397346 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7fb198003f00 con 0x7fb1a80683c0 2023-08-11T12:26:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.415+0000 7fb1977fe700 1 --2- 172.21.15.8:0/333397346 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb1900a0140 0x7fb1900a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.415+0000 7fb1977fe700 1 -- 172.21.15.8:0/333397346 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fb198014070 con 0x7fb1a80683c0 2023-08-11T12:26:38.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.415+0000 7fb1c0541b80 1 Processor -- start 2023-08-11T12:26:38.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.416+0000 7fb1c0541b80 1 -- start start 2023-08-11T12:26:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.416+0000 7fb1c0541b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f610074e80 0x55f610075260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.416+0000 7fb1c0541b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61006f630 0x55f61006fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.416+0000 7fb1c0541b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f61006fff0 0x55f61007bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.416+0000 7fb1c0541b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f60ffc85d0 con 0x55f610074e80 2023-08-11T12:26:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.416+0000 7fb1c0541b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f60ffc5ef0 con 0x55f61006fff0 2023-08-11T12:26:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.416+0000 7fb1c0541b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f60ffc17e0 con 0x55f61006f630 2023-08-11T12:26:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.416+0000 7fb1a659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f610074e80 0x55f610075260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.417+0000 7fb1a659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f610074e80 0x55f610075260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53472/0 (socket says 172.21.15.8:53472) 2023-08-11T12:26:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.417+0000 7fb1a659c700 1 -- 172.21.15.8:0/3645014001 learned_addr learned my addr 172.21.15.8:0/3645014001 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.417+0000 7fb1a6d9d700 1 --2- 172.21.15.8:0/3645014001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f61006fff0 0x55f61007bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.417+0000 7fb1a659c700 1 -- 172.21.15.8:0/3645014001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61006f630 msgr2=0x55f61006fab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-11T12:26:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.418+0000 7fb1a5d9b700 1 --2- 172.21.15.8:0/3645014001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61006f630 0x55f61006fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.418+0000 7fb1a659c700 1 --2- 172.21.15.8:0/3645014001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61006f630 0x55f61006fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.418+0000 7fb1a659c700 1 -- 172.21.15.8:0/3645014001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f61006fff0 msgr2=0x55f61007bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.418+0000 7fb1a659c700 1 --2- 172.21.15.8:0/3645014001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f61006fff0 0x55f61007bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.418+0000 7fb1a659c700 1 -- 172.21.15.8:0/3645014001 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f60fe415d0 con 0x55f610074e80 2023-08-11T12:26:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.418+0000 7fb1a6d9d700 1 --2- 172.21.15.8:0/3645014001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f61006fff0 0x55f61007bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:26:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.418+0000 7fb1a659c700 1 --2- 172.21.15.8:0/3645014001 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f610074e80 0x55f610075260 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb1980a09c0 tx=0x7fb198098a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac4ab1720694810 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.418+0000 7fb194ff9700 1 -- 172.21.15.8:0/3645014001 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19800cd40 con 0x55f610074e80 2023-08-11T12:26:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.418+0000 7fb194ff9700 1 -- 172.21.15.8:0/3645014001 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb1980990e0 con 0x55f610074e80 2023-08-11T12:26:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.418+0000 7fb194ff9700 1 -- 172.21.15.8:0/3645014001 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1980975a0 con 0x55f610074e80 2023-08-11T12:26:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.419+0000 7fb1c0541b80 1 -- 172.21.15.8:0/3645014001 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f610074e80 msgr2=0x55f610075260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.419+0000 7fb1c0541b80 1 --2- 172.21.15.8:0/3645014001 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f610074e80 0x55f610075260 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb1980a09c0 tx=0x7fb198098a40 comp rx=0 tx=0).stop 2023-08-11T12:26:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.419+0000 7fb1a5d9b700 1 --2- 172.21.15.8:0/3645014001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61006f630 0x55f61006fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:26:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.419+0000 7fb1c0541b80 1 -- 172.21.15.8:0/3645014001 shutdown_connections 2023-08-11T12:26:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.419+0000 7fb1c0541b80 1 --2- 172.21.15.8:0/3645014001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f61006fff0 0x55f61007bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.419+0000 7fb1c0541b80 1 --2- 172.21.15.8:0/3645014001 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f610074e80 0x55f610075260 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.419+0000 7fb1c0541b80 1 --2- 172.21.15.8:0/3645014001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61006f630 0x55f61006fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.419+0000 7fb1c0541b80 1 -- 172.21.15.8:0/3645014001 >> 172.21.15.8:0/3645014001 conn(0x55f60ff9c8f0 msgr2=0x55f610069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.419+0000 7fb1a5d9b700 1 --2- 172.21.15.8:0/333397346 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb1900a0140 0x7fb1900a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.421+0000 7fb1a5d9b700 1 --2- 172.21.15.8:0/333397346 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb1900a0140 0x7fb1900a2600 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb1a819e570 tx=0x7fb19c0097c0 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.422+0000 7fb1c0541b80 1 -- 172.21.15.8:0/3645014001 shutdown_connections 2023-08-11T12:26:38.427 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.422+0000 7fb1c0541b80 1 -- 172.21.15.8:0/3645014001 wait complete. 2023-08-11T12:26:38.427 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.422+0000 7fb1c0541b80 1 -- start start 2023-08-11T12:26:38.427 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.423+0000 7fb1c0541b80 1 Processor -- start 2023-08-11T12:26:38.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.423+0000 7fb1c0541b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f61006fff0 0x55f61007ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:38.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.423+0000 7fb1c0541b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f610074e80 0x55f61007f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:38.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.423+0000 7fb1c0541b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f610078ea0 0x55f610079320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:38.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.423+0000 7fb1c0541b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f60ff5fa60 con 0x55f610074e80 2023-08-11T12:26:38.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.423+0000 7fb1c0541b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f60ff5f760 con 0x55f61006fff0 2023-08-11T12:26:38.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.423+0000 7fb1c0541b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f60fe438c0 con 0x55f610078ea0 2023-08-11T12:26:38.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.423+0000 7fb1c0541b80 10 client.0 _ll_register_callbacks cb 0x55f60ff62a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:26:38.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.424+0000 7fb1a6d9d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f610078ea0 0x55f610079320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:38.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.424+0000 7fb1a659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f61006fff0 0x55f61007ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:38.430 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.424+0000 7fb1a6d9d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f610078ea0 0x55f610079320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:36530/0 (socket says 172.21.15.8:36530) 2023-08-11T12:26:38.430 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.424+0000 7fb1a6d9d700 1 -- 172.21.15.8:0/160973107 learned_addr learned my addr 172.21.15.8:0/160973107 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:38.430 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.424+0000 7fb1a659c700 1 -- 172.21.15.8:0/160973107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f610078ea0 msgr2=0x55f610079320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:38.430 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.424+0000 7fb1a659c700 1 --2- 172.21.15.8:0/160973107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f610078ea0 0x55f610079320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.430 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.424+0000 7fb1a659c700 1 -- 172.21.15.8:0/160973107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f610074e80 msgr2=0x55f61007f120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-11T12:26:38.430 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.424+0000 7fb1a659c700 1 --2- 172.21.15.8:0/160973107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f610074e80 0x55f61007f120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.430 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.424+0000 7fb1a659c700 1 -- 172.21.15.8:0/160973107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a81147f0 con 0x55f61006fff0 2023-08-11T12:26:38.431 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.425+0000 7fb1a659c700 1 --2- 172.21.15.8:0/160973107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f61006fff0 0x55f61007ebe0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55f610070540 tx=0x7fb1980047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4899228b592534b server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:38.431 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.425+0000 7fb18dffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:26:38.431 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.425+0000 7fb18dffb700 1 -- 172.21.15.8:0/160973107 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19809cf10 con 0x55f61006fff0 2023-08-11T12:26:38.431 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.425+0000 7fb1c0541b80 1 -- 172.21.15.8:0/160973107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f6100627e0 con 0x55f61006fff0 2023-08-11T12:26:38.431 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.425+0000 7fb18dffb700 1 -- 172.21.15.8:0/160973107 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fb1980a0ef0 con 0x55f61006fff0 2023-08-11T12:26:38.432 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.425+0000 7fb18dffb700 1 -- 172.21.15.8:0/160973107 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb198003680 con 0x55f61006fff0 2023-08-11T12:26:38.433 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.426+0000 7fb1c0541b80 10 client.26141 fetch_fsmap learned FSMap version 32 2023-08-11T12:26:38.433 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.426+0000 7fb1c0541b80 1 -- 172.21.15.8:0/160973107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7fb1a81a2740 con 0x55f61006fff0 2023-08-11T12:26:38.433 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.426+0000 7fb18dffb700 1 -- 172.21.15.8:0/160973107 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f6100627e0 con 0x55f61006fff0 2023-08-11T12:26:38.433 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.426+0000 7fb18dffb700 1 -- 172.21.15.8:0/160973107 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 32) v1 ==== 7926+0+0 (secure 0 0 0) 0x7fb1980a0a60 con 0x55f61006fff0 2023-08-11T12:26:38.433 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.426+0000 7fb1c0541b80 10 client.26141 fetch_fsmap finished waiting for FSMap version 32 2023-08-11T12:26:38.433 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.426+0000 7fb1c0541b80 10 client.26141 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-11T12:26:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.426+0000 7fb1c0541b80 20 client.26141 populate_metadata read hostname 'smithi008' 2023-08-11T12:26:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.426+0000 7fb1c0541b80 1 --2- 172.21.15.8:0/160973107 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f6100891a0 0x55f61008b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.426+0000 7fb1c0541b80 4 client.26141 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:26:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.426+0000 7fb1c0541b80 1 -- 172.21.15.8:0/160973107 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f61003e480 con 0x55f6100891a0 2023-08-11T12:26:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.427+0000 7fb1a5d9b700 1 --2- 172.21.15.8:0/160973107 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f6100891a0 0x55f61008b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.427+0000 7fb18dffb700 10 client.26141 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:26:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.427+0000 7fb1a5d9b700 1 --2- 172.21.15.8:0/160973107 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f6100891a0 0x55f61008b5c0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccdc269adf67dc6e server_cookie=77aadfe407f826e6 in_seq=0 out_seq=0 2023-08-11T12:26:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.428+0000 7fb18dffb700 1 -- 172.21.15.8:0/160973107 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55f61003e480 con 0x55f6100891a0 2023-08-11T12:26:38.435 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.428+0000 7fb18dffb700 10 client.26141 handle_command_reply: tid=0 2023-08-11T12:26:38.435 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.428+0000 7fb1c0541b80 1 client.26141 shutdown 2023-08-11T12:26:38.435 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.429+0000 7fb1c0541b80 1 -- 172.21.15.8:0/160973107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f61006fff0 msgr2=0x55f61007ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:38.435 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.429+0000 7fb1c0541b80 1 --2- 172.21.15.8:0/160973107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f61006fff0 0x55f61007ebe0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55f610070540 tx=0x7fb1980047c0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.435 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.429+0000 7fb1c0541b80 1 -- 172.21.15.8:0/160973107 shutdown_connections 2023-08-11T12:26:38.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.429+0000 7fb1c0541b80 1 --2- 172.21.15.8:0/160973107 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f6100891a0 0x55f61008b5c0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.429+0000 7fb1c0541b80 1 --2- 172.21.15.8:0/160973107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f610078ea0 0x55f610079320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.429+0000 7fb1c0541b80 1 --2- 172.21.15.8:0/160973107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f61006fff0 0x55f61007ebe0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.429+0000 7fb1c0541b80 1 --2- 172.21.15.8:0/160973107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f610074e80 0x55f61007f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.429+0000 7fb1c0541b80 1 -- 172.21.15.8:0/160973107 >> 172.21.15.8:0/160973107 conn(0x55f60ff9c8f0 msgr2=0x55f6100695d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:38.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.429+0000 7fb18dffb700 0 client.26141 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:26:38.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.429+0000 7fb1c0541b80 1 -- 172.21.15.8:0/160973107 shutdown_connections 2023-08-11T12:26:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.430+0000 7fb1c0541b80 1 -- 172.21.15.8:0/160973107 wait complete. 2023-08-11T12:26:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.430+0000 7fb1c0541b80 20 client.26141 trim_cache size 0 max 16384 2023-08-11T12:26:38.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.447+0000 7fb1c0541b80 1 Processor -- start 2023-08-11T12:26:38.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.448+0000 7fb1c0541b80 1 -- start start 2023-08-11T12:26:38.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.448+0000 7fb1c0541b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f61006fff0 0x55f610072860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:38.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.448+0000 7fb1c0541b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f610074e80 0x55f6100769d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:38.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.448+0000 7fb1c0541b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f610078ea0 0x55f610069d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:38.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.448+0000 7fb1c0541b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6100627e0 con 0x55f610078ea0 2023-08-11T12:26:38.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.448+0000 7fb1c0541b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6100703d0 con 0x55f61006fff0 2023-08-11T12:26:38.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.448+0000 7fb1c0541b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f61006ba60 con 0x55f610074e80 2023-08-11T12:26:38.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.448+0000 7fb1a659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f61006fff0 0x55f610072860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.448+0000 7fb1a6d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f610078ea0 0x55f610069d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.448+0000 7fb1a659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f61006fff0 0x55f610072860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:38778/0 (socket says 172.21.15.8:38778) 2023-08-11T12:26:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.448+0000 7fb1a659c700 1 -- 172.21.15.8:0/2107274770 learned_addr learned my addr 172.21.15.8:0/2107274770 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.449+0000 7fb1a5d9b700 1 --2- 172.21.15.8:0/2107274770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f610074e80 0x55f6100769d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.449+0000 7fb1a659c700 1 -- 172.21.15.8:0/2107274770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f610074e80 msgr2=0x55f6100769d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.449+0000 7fb1a659c700 1 --2- 172.21.15.8:0/2107274770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f610074e80 0x55f6100769d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.449+0000 7fb1a659c700 1 -- 172.21.15.8:0/2107274770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f610078ea0 msgr2=0x55f610069d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.449+0000 7fb1a659c700 1 --2- 172.21.15.8:0/2107274770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f610078ea0 0x55f610069d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.449+0000 7fb1a659c700 1 -- 172.21.15.8:0/2107274770 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f60fdedd80 con 0x55f61006fff0 2023-08-11T12:26:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.449+0000 7fb1a6d9d700 1 --2- 172.21.15.8:0/2107274770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f610078ea0 0x55f610069d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:26:38.458 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.449+0000 7fb1a659c700 1 --2- 172.21.15.8:0/2107274770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f61006fff0 0x55f610072860 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb198095b50 tx=0x7fb198098a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=840e90e2205bda54 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:38.458 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.449+0000 7fb1957fa700 1 -- 172.21.15.8:0/2107274770 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb198003680 con 0x55f61006fff0 2023-08-11T12:26:38.458 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.449+0000 7fb1957fa700 1 -- 172.21.15.8:0/2107274770 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb1980a0ef0 con 0x55f61006fff0 2023-08-11T12:26:38.459 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.449+0000 7fb1957fa700 1 -- 172.21.15.8:0/2107274770 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1980985d0 con 0x55f61006fff0 2023-08-11T12:26:38.459 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.450+0000 7fb1c0541b80 1 -- 172.21.15.8:0/2107274770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f61006fff0 msgr2=0x55f610072860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:38.459 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.450+0000 7fb1c0541b80 1 --2- 172.21.15.8:0/2107274770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f61006fff0 0x55f610072860 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb198095b50 tx=0x7fb198098a40 comp rx=0 tx=0).stop 2023-08-11T12:26:38.459 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.450+0000 7fb1c0541b80 1 -- 172.21.15.8:0/2107274770 shutdown_connections 2023-08-11T12:26:38.460 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.450+0000 7fb1c0541b80 1 --2- 172.21.15.8:0/2107274770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f610078ea0 0x55f610069d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.460 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.450+0000 7fb1c0541b80 1 --2- 172.21.15.8:0/2107274770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f61006fff0 0x55f610072860 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.460 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.450+0000 7fb1c0541b80 1 --2- 172.21.15.8:0/2107274770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f610074e80 0x55f6100769d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.461 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.450+0000 7fb1c0541b80 1 -- 172.21.15.8:0/2107274770 >> 172.21.15.8:0/2107274770 conn(0x55f60ff9c8f0 msgr2=0x55f610085890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:38.461 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.450+0000 7fb1c0541b80 1 -- 172.21.15.8:0/2107274770 shutdown_connections 2023-08-11T12:26:38.461 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.451+0000 7fb1c0541b80 1 -- 172.21.15.8:0/2107274770 wait complete. 2023-08-11T12:26:38.461 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.451+0000 7fb1c0541b80 1 -- start start 2023-08-11T12:26:38.462 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.451+0000 7fb1c0541b80 1 Processor -- start 2023-08-11T12:26:38.462 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.452+0000 7fb1c0541b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61006fff0 0x55f61007c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:38.462 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.452+0000 7fb1c0541b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f610074e80 0x55f61007c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:38.462 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.452+0000 7fb1c0541b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f610078ea0 0x55f61007ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:38.462 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.452+0000 7fb1c0541b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f61007f4e0 con 0x55f610078ea0 2023-08-11T12:26:38.463 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.452+0000 7fb1c0541b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6100dbe10 con 0x55f610074e80 2023-08-11T12:26:38.463 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.452+0000 7fb1c0541b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6100dbfd0 con 0x55f61006fff0 2023-08-11T12:26:38.463 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.452+0000 7fb1c0541b80 10 client.0 _ll_register_callbacks cb 0x7fb19c005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:26:38.463 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.452+0000 7fb1a659c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61006fff0 0x55f61007c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:38.464 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.452+0000 7fb1a5d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f610074e80 0x55f61007c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:38.464 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.452+0000 7fb1a659c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61006fff0 0x55f61007c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:36542/0 (socket says 172.21.15.8:36542) 2023-08-11T12:26:38.464 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.452+0000 7fb1a659c700 1 -- 172.21.15.8:0/2207836303 learned_addr learned my addr 172.21.15.8:0/2207836303 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:38.464 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.452+0000 7fb1a5d9b700 1 -- 172.21.15.8:0/2207836303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61006fff0 msgr2=0x55f61007c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:38.464 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.452+0000 7fb1a5d9b700 1 --2- 172.21.15.8:0/2207836303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61006fff0 0x55f61007c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.465 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.452+0000 7fb1a5d9b700 1 -- 172.21.15.8:0/2207836303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f610078ea0 msgr2=0x55f61007ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:38.465 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.452+0000 7fb1a6d9d700 1 --2- 172.21.15.8:0/2207836303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f610078ea0 0x55f61007ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:38.465 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.453+0000 7fb1a5d9b700 1 --2- 172.21.15.8:0/2207836303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f610078ea0 0x55f61007ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.465 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.453+0000 7fb1a5d9b700 1 -- 172.21.15.8:0/2207836303 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a0009490 con 0x55f610074e80 2023-08-11T12:26:38.465 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.453+0000 7fb1a659c700 1 --2- 172.21.15.8:0/2207836303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61006fff0 0x55f61007c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:26:38.465 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.453+0000 7fb1a6d9d700 1 --2- 172.21.15.8:0/2207836303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f610078ea0 0x55f61007ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:26:38.465 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.453+0000 7fb1a5d9b700 1 --2- 172.21.15.8:0/2207836303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f610074e80 0x55f61007c990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x55f61006bbe0 tx=0x7fb19c009610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17fc6e8f1b8b7c97 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:38.466 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.453+0000 7fb18dffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:26:38.466 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.453+0000 7fb18dffb700 1 -- 172.21.15.8:0/2207836303 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c023040 con 0x55f610074e80 2023-08-11T12:26:38.466 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.453+0000 7fb1c0541b80 1 -- 172.21.15.8:0/2207836303 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb1980990e0 con 0x55f610074e80 2023-08-11T12:26:38.466 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.453+0000 7fb18dffb700 1 -- 172.21.15.8:0/2207836303 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fb19c0273b0 con 0x55f610074e80 2023-08-11T12:26:38.467 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.453+0000 7fb18dffb700 1 -- 172.21.15.8:0/2207836303 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb19c017070 con 0x55f610074e80 2023-08-11T12:26:38.467 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.453+0000 7fb1c0541b80 10 client.26147 fetch_fsmap learned FSMap version 32 2023-08-11T12:26:38.467 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.453+0000 7fb1c0541b80 1 -- 172.21.15.8:0/2207836303 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7fb1a81a2740 con 0x55f610074e80 2023-08-11T12:26:38.467 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.454+0000 7fb18dffb700 1 -- 172.21.15.8:0/2207836303 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb1980990e0 con 0x55f610074e80 2023-08-11T12:26:38.467 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.454+0000 7fb18dffb700 1 -- 172.21.15.8:0/2207836303 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 32) v1 ==== 7926+0+0 (secure 0 0 0) 0x7fb19c026030 con 0x55f610074e80 2023-08-11T12:26:38.467 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.454+0000 7fb1c0541b80 10 client.26147 fetch_fsmap finished waiting for FSMap version 32 2023-08-11T12:26:38.467 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.454+0000 7fb1c0541b80 10 client.26147 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-11T12:26:38.468 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.454+0000 7fb1c0541b80 20 client.26147 populate_metadata read hostname 'smithi008' 2023-08-11T12:26:38.468 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.454+0000 7fb1c0541b80 1 --2- 172.21.15.8:0/2207836303 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f6100dd850 0x55f6100dfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:38.468 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.454+0000 7fb1c0541b80 4 client.26147 mds_command: new command op to 24575 tid=0[{"prefix": "flush journal"}] 2023-08-11T12:26:38.468 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.454+0000 7fb1c0541b80 1 -- 172.21.15.8:0/2207836303 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f60ffba7c0 con 0x55f6100dd850 2023-08-11T12:26:38.468 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.454+0000 7fb1a659c700 1 --2- 172.21.15.8:0/2207836303 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f6100dd850 0x55f6100dfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:38.468 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.455+0000 7fb1a659c700 1 --2- 172.21.15.8:0/2207836303 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f6100dd850 0x55f6100dfc70 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef0fe45d3c77613c server_cookie=16780833eae553bb in_seq=0 out_seq=0 2023-08-11T12:26:38.468 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.455+0000 7fb18dffb700 10 client.26147 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:26:38.483 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.480+0000 7fb18dffb700 1 -- 172.21.15.8:0/2207836303 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f60ffba7c0 con 0x55f6100dd850 2023-08-11T12:26:38.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.480+0000 7fb18dffb700 10 client.26147 handle_command_reply: tid=0 2023-08-11T12:26:38.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.480+0000 7fb1c0541b80 1 client.26147 shutdown 2023-08-11T12:26:38.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.480+0000 7fb1c0541b80 1 -- 172.21.15.8:0/2207836303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f610074e80 msgr2=0x55f61007c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:38.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.480+0000 7fb1c0541b80 1 --2- 172.21.15.8:0/2207836303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f610074e80 0x55f61007c990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x55f61006bbe0 tx=0x7fb19c009610 comp rx=0 tx=0).stop 2023-08-11T12:26:38.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.480+0000 7fb1c0541b80 1 -- 172.21.15.8:0/2207836303 shutdown_connections 2023-08-11T12:26:38.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.480+0000 7fb1c0541b80 1 --2- 172.21.15.8:0/2207836303 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f6100dd850 0x55f6100dfc70 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.480+0000 7fb1c0541b80 1 --2- 172.21.15.8:0/2207836303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61006fff0 0x55f61007c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.480+0000 7fb1c0541b80 1 --2- 172.21.15.8:0/2207836303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f610078ea0 0x55f61007ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.480+0000 7fb18dffb700 0 client.26147 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:26:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.480+0000 7fb1c0541b80 1 --2- 172.21.15.8:0/2207836303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f610074e80 0x55f61007c990 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.480+0000 7fb1c0541b80 1 -- 172.21.15.8:0/2207836303 >> 172.21.15.8:0/2207836303 conn(0x55f60ff9c8f0 msgr2=0x55f6100730b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.480+0000 7fb1c0541b80 1 -- 172.21.15.8:0/2207836303 shutdown_connections 2023-08-11T12:26:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.480+0000 7fb1c0541b80 1 -- 172.21.15.8:0/2207836303 wait complete. 2023-08-11T12:26:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.480+0000 7fb1c0541b80 20 client.26147 trim_cache size 0 max 16384 2023-08-11T12:26:38.486 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-08-11T12:26:38.486 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-08-11T12:26:38.486 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-08-11T12:26:38.486 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-08-11T12:26:38.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.481+0000 7fb1acbff700 1 -- 172.21.15.8:0/333397346 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb1900a0140 msgr2=0x7fb1900a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:38.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.481+0000 7fb1acbff700 1 --2- 172.21.15.8:0/333397346 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb1900a0140 0x7fb1900a2600 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb1a819e570 tx=0x7fb19c0097c0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.481+0000 7fb1acbff700 1 -- 172.21.15.8:0/333397346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1a80683c0 msgr2=0x7fb1a819cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.481+0000 7fb1acbff700 1 --2- 172.21.15.8:0/333397346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1a80683c0 0x7fb1a819cf60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb19800eb30 tx=0x7fb19800eef0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.481+0000 7fb1acbff700 1 -- 172.21.15.8:0/333397346 shutdown_connections 2023-08-11T12:26:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.481+0000 7fb1acbff700 1 --2- 172.21.15.8:0/333397346 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1a81057f0 0x7fb1a81a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.481+0000 7fb1acbff700 1 --2- 172.21.15.8:0/333397346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1a80683c0 0x7fb1a819cf60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.481+0000 7fb1acbff700 1 --2- 172.21.15.8:0/333397346 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb1900a0140 0x7fb1900a2600 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.489 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.481+0000 7fb1acbff700 1 --2- 172.21.15.8:0/333397346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1a81032f0 0x7fb1a819d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:38.489 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.481+0000 7fb1acbff700 1 -- 172.21.15.8:0/333397346 >> 172.21.15.8:0/333397346 conn(0x7fb1a8075300 msgr2=0x7fb1a81022d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:38.489 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.482+0000 7fb1acbff700 1 -- 172.21.15.8:0/333397346 shutdown_connections 2023-08-11T12:26:38.489 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:38.482+0000 7fb1acbff700 1 -- 172.21.15.8:0/333397346 wait complete. 2023-08-11T12:26:38.524 INFO:teuthology.orchestra.run.smithi008.stderr:32600000 of 50000000 tuples (65%) done (elapsed 103.21 s, remaining 55.09 s) 2023-08-11T12:26:38.680 INFO:teuthology.orchestra.run.smithi008.stderr:32700000 of 50000000 tuples (65%) done (elapsed 103.37 s, remaining 54.69 s) 2023-08-11T12:26:38.914 INFO:teuthology.orchestra.run.smithi008.stderr:32800000 of 50000000 tuples (65%) done (elapsed 103.60 s, remaining 54.33 s) 2023-08-11T12:26:39.109 INFO:teuthology.orchestra.run.smithi008.stderr:32900000 of 50000000 tuples (65%) done (elapsed 103.80 s, remaining 53.95 s) 2023-08-11T12:26:39.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:38 smithi194 ceph-mon[130905]: pgmap v64: 129 pgs: 129 active+clean; 5.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 144 MiB/s wr, 96 op/s 2023-08-11T12:26:39.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:38 smithi045 ceph-mon[130284]: pgmap v64: 129 pgs: 129 active+clean; 5.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 144 MiB/s wr, 96 op/s 2023-08-11T12:26:39.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:38 smithi008 ceph-mon[97158]: pgmap v64: 129 pgs: 129 active+clean; 5.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 144 MiB/s wr, 96 op/s 2023-08-11T12:26:39.318 INFO:teuthology.orchestra.run.smithi008.stderr:33000000 of 50000000 tuples (66%) done (elapsed 104.00 s, remaining 53.58 s) 2023-08-11T12:26:39.482 INFO:teuthology.orchestra.run.smithi008.stderr:33100000 of 50000000 tuples (66%) done (elapsed 104.17 s, remaining 53.19 s) 2023-08-11T12:26:39.632 INFO:teuthology.orchestra.run.smithi008.stderr:33200000 of 50000000 tuples (66%) done (elapsed 104.32 s, remaining 52.79 s) 2023-08-11T12:26:39.965 INFO:teuthology.orchestra.run.smithi008.stderr:33300000 of 50000000 tuples (66%) done (elapsed 104.65 s, remaining 52.48 s) 2023-08-11T12:26:40.310 INFO:teuthology.orchestra.run.smithi008.stderr:33400000 of 50000000 tuples (66%) done (elapsed 105.00 s, remaining 52.18 s) 2023-08-11T12:26:41.002 INFO:teuthology.orchestra.run.smithi008.stderr:33500000 of 50000000 tuples (67%) done (elapsed 105.69 s, remaining 52.06 s) 2023-08-11T12:26:41.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:40 smithi008 ceph-mon[97158]: pgmap v65: 129 pgs: 129 active+clean; 5.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 81 MiB/s wr, 50 op/s 2023-08-11T12:26:41.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:40 smithi194 ceph-mon[130905]: pgmap v65: 129 pgs: 129 active+clean; 5.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 81 MiB/s wr, 50 op/s 2023-08-11T12:26:41.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:40 smithi045 ceph-mon[130284]: pgmap v65: 129 pgs: 129 active+clean; 5.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 81 MiB/s wr, 50 op/s 2023-08-11T12:26:41.657 INFO:teuthology.orchestra.run.smithi008.stderr:33600000 of 50000000 tuples (67%) done (elapsed 106.34 s, remaining 51.91 s) 2023-08-11T12:26:43.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:42 smithi194 ceph-mon[130905]: pgmap v66: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 145 MiB/s wr, 85 op/s 2023-08-11T12:26:43.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:42 smithi045 ceph-mon[130284]: pgmap v66: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 145 MiB/s wr, 85 op/s 2023-08-11T12:26:43.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:42 smithi008 ceph-mon[97158]: pgmap v66: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 145 MiB/s wr, 85 op/s 2023-08-11T12:26:45.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:44 smithi194 ceph-mon[130905]: pgmap v67: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 105 MiB/s wr, 66 op/s 2023-08-11T12:26:45.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:44 smithi045 ceph-mon[130284]: pgmap v67: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 105 MiB/s wr, 66 op/s 2023-08-11T12:26:45.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:44 smithi008 ceph-mon[97158]: pgmap v67: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 105 MiB/s wr, 66 op/s 2023-08-11T12:26:47.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:46 smithi194 ceph-mon[130905]: pgmap v68: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 105 MiB/s wr, 66 op/s 2023-08-11T12:26:47.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:46 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:26:47.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:46 smithi045 ceph-mon[130284]: pgmap v68: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 105 MiB/s wr, 66 op/s 2023-08-11T12:26:47.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:46 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:26:47.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:46 smithi008 ceph-mon[97158]: pgmap v68: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 105 MiB/s wr, 66 op/s 2023-08-11T12:26:47.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:46 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:26:48.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:47 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:26:48.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:47 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:26:48.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:47 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:26:48.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:47 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:26:48.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:47 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:26:48.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:47 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:26:48.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:47 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:26:48.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:47 smithi008 ceph-mon[97158]: pgmap v69: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 106 MiB/s wr, 73 op/s 2023-08-11T12:26:48.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:47 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:26:48.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:47 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:26:48.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:47 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:26:48.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:47 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:26:48.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:47 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:26:48.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:47 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:26:48.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:47 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:26:48.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:47 smithi194 ceph-mon[130905]: pgmap v69: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 106 MiB/s wr, 73 op/s 2023-08-11T12:26:48.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:47 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:26:48.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:47 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:26:48.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:47 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:26:48.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:47 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:26:48.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:47 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:26:48.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:47 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:26:48.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:47 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:26:48.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:47 smithi045 ceph-mon[130284]: pgmap v69: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 106 MiB/s wr, 73 op/s 2023-08-11T12:26:51.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:50 smithi008 ceph-mon[97158]: pgmap v70: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 65 MiB/s wr, 42 op/s 2023-08-11T12:26:51.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:50 smithi194 ceph-mon[130905]: pgmap v70: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 65 MiB/s wr, 42 op/s 2023-08-11T12:26:51.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:50 smithi045 ceph-mon[130284]: pgmap v70: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 65 MiB/s wr, 42 op/s 2023-08-11T12:26:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.643+0000 7f777f3ff700 1 -- 172.21.15.8:0/3086967907 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7778101280 msgr2=0x7f777810d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.643+0000 7f777f3ff700 1 --2- 172.21.15.8:0/3086967907 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7778101280 0x7f777810d790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7770009f90 tx=0x7f777000b330 comp rx=0 tx=0).stop 2023-08-11T12:26:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.644+0000 7f777f3ff700 1 -- 172.21.15.8:0/3086967907 shutdown_connections 2023-08-11T12:26:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.644+0000 7f777f3ff700 1 --2- 172.21.15.8:0/3086967907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77781068d0 0x7f7778106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.644+0000 7f777f3ff700 1 --2- 172.21.15.8:0/3086967907 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7778101280 0x7f777810d790 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.644+0000 7f777f3ff700 1 --2- 172.21.15.8:0/3086967907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77781008c0 0x7f7778100d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.644+0000 7f777f3ff700 1 -- 172.21.15.8:0/3086967907 >> 172.21.15.8:0/3086967907 conn(0x7f77780fc3d0 msgr2=0x7f77780fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.644+0000 7f777f3ff700 1 -- 172.21.15.8:0/3086967907 shutdown_connections 2023-08-11T12:26:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.644+0000 7f777f3ff700 1 -- 172.21.15.8:0/3086967907 wait complete. 2023-08-11T12:26:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.645+0000 7f777f3ff700 1 Processor -- start 2023-08-11T12:26:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.645+0000 7f777f3ff700 1 -- start start 2023-08-11T12:26:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.645+0000 7f777f3ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77781008c0 0x7f7778072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.645+0000 7f777f3ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7778101280 0x7f7778073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.645+0000 7f777f3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77781068d0 0x7f77781a4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.645+0000 7f777f3ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7778073990 con 0x7f77781008c0 2023-08-11T12:26:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.645+0000 7f777f3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77781a5060 con 0x7f77781068d0 2023-08-11T12:26:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.645+0000 7f777f3ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77781a51a0 con 0x7f7778101280 2023-08-11T12:26:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.646+0000 7f777d19b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77781008c0 0x7f7778072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.646+0000 7f777d19b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77781008c0 0x7f7778072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39030/0 (socket says 172.21.15.8:39030) 2023-08-11T12:26:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.646+0000 7f777d19b700 1 -- 172.21.15.8:0/1471509725 learned_addr learned my addr 172.21.15.8:0/1471509725 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.646+0000 7f777c99a700 1 --2- 172.21.15.8:0/1471509725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7778101280 0x7f7778073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.646+0000 7f777d99c700 1 --2- 172.21.15.8:0/1471509725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77781068d0 0x7f77781a4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.646+0000 7f777d19b700 1 -- 172.21.15.8:0/1471509725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7778101280 msgr2=0x7f7778073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.646+0000 7f777d19b700 1 --2- 172.21.15.8:0/1471509725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7778101280 0x7f7778073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.646+0000 7f777d19b700 1 -- 172.21.15.8:0/1471509725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77781068d0 msgr2=0x7f77781a4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:51.653 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.646+0000 7f777d19b700 1 --2- 172.21.15.8:0/1471509725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77781068d0 0x7f77781a4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.653 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.646+0000 7f777d19b700 1 -- 172.21.15.8:0/1471509725 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77680095f0 con 0x7f77781008c0 2023-08-11T12:26:51.653 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.646+0000 7f777d19b700 1 --2- 172.21.15.8:0/1471509725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77781008c0 0x7f7778072c20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f777400e9a0 tx=0x7f777400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:51.653 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.646+0000 7f776e7fc700 1 -- 172.21.15.8:0/1471509725 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7774009790 con 0x7f77781008c0 2023-08-11T12:26:51.653 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.647+0000 7f777f3ff700 1 -- 172.21.15.8:0/1471509725 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7770009c40 con 0x7f77781008c0 2023-08-11T12:26:51.653 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.647+0000 7f776e7fc700 1 -- 172.21.15.8:0/1471509725 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7774010430 con 0x7f77781008c0 2023-08-11T12:26:51.653 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.647+0000 7f776e7fc700 1 -- 172.21.15.8:0/1471509725 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7774018680 con 0x7f77781008c0 2023-08-11T12:26:51.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.647+0000 7f777f3ff700 1 -- 172.21.15.8:0/1471509725 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77781a5750 con 0x7f77781008c0 2023-08-11T12:26:51.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.651+0000 7f776e7fc700 1 -- 172.21.15.8:0/1471509725 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f77740105a0 con 0x7f77781008c0 2023-08-11T12:26:51.655 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.652+0000 7f7792d87b80 1 Processor -- start 2023-08-11T12:26:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.652+0000 7f7792d87b80 1 -- start start 2023-08-11T12:26:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.653+0000 7f7792d87b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604f9123e80 0x5604f9124260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.653+0000 7f7792d87b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604f911e630 0x5604f911eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.653+0000 7f7792d87b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604f911eff0 0x5604f912ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.653+0000 7f7792d87b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604f90775d0 con 0x5604f911eff0 2023-08-11T12:26:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.653+0000 7f7792d87b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604f9074ef0 con 0x5604f9123e80 2023-08-11T12:26:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.653+0000 7f7792d87b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604f90707e0 con 0x5604f911e630 2023-08-11T12:26:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.653+0000 7f776e7fc700 1 --2- 172.21.15.8:0/1471509725 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f77640a00c0 0x7f77640a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.653+0000 7f777c99a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604f911eff0 0x5604f912ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.653+0000 7f777c99a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604f911eff0 0x5604f912ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39038/0 (socket says 172.21.15.8:39038) 2023-08-11T12:26:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.653+0000 7f777c99a700 1 -- 172.21.15.8:0/883176512 learned_addr learned my addr 172.21.15.8:0/883176512 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.653+0000 7f776e7fc700 1 -- 172.21.15.8:0/1471509725 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f7774014070 con 0x7f77781008c0 2023-08-11T12:26:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.653+0000 7f777d19b700 1 --2- 172.21.15.8:0/883176512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604f911e630 0x5604f911eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.653+0000 7f777d99c700 1 --2- 172.21.15.8:0/883176512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604f9123e80 0x5604f9124260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.653+0000 7f777d99c700 1 --2- 172.21.15.8:0/1471509725 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f77640a00c0 0x7f77640a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.654+0000 7f777c99a700 1 -- 172.21.15.8:0/883176512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604f911e630 msgr2=0x5604f911eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.654+0000 7f777c99a700 1 --2- 172.21.15.8:0/883176512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604f911e630 0x5604f911eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.654+0000 7f777c99a700 1 -- 172.21.15.8:0/883176512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604f9123e80 msgr2=0x5604f9124260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.654+0000 7f777c99a700 1 --2- 172.21.15.8:0/883176512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604f9123e80 0x5604f9124260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.654+0000 7f777c99a700 1 -- 172.21.15.8:0/883176512 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604f8ef05d0 con 0x5604f911eff0 2023-08-11T12:26:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.654+0000 7f777d19b700 1 --2- 172.21.15.8:0/883176512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604f911e630 0x5604f911eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:26:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.654+0000 7f777c99a700 1 --2- 172.21.15.8:0/883176512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604f911eff0 0x5604f912ac10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7768009f90 tx=0x7f7768011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97d10051d5c3d8c server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.654+0000 7f777d99c700 1 --2- 172.21.15.8:0/1471509725 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f77640a00c0 0x7f77640a2580 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f77700060b0 tx=0x7f7770009700 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.654+0000 7f77637fe700 1 -- 172.21.15.8:0/883176512 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7768004310 con 0x5604f911eff0 2023-08-11T12:26:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.654+0000 7f77637fe700 1 -- 172.21.15.8:0/883176512 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7768004470 con 0x5604f911eff0 2023-08-11T12:26:51.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.654+0000 7f77637fe700 1 -- 172.21.15.8:0/883176512 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7768019910 con 0x5604f911eff0 2023-08-11T12:26:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.655+0000 7f7792d87b80 1 -- 172.21.15.8:0/883176512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604f911eff0 msgr2=0x5604f912ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.655+0000 7f7792d87b80 1 --2- 172.21.15.8:0/883176512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604f911eff0 0x5604f912ac10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7768009f90 tx=0x7f7768011720 comp rx=0 tx=0).stop 2023-08-11T12:26:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.655+0000 7f7792d87b80 1 -- 172.21.15.8:0/883176512 shutdown_connections 2023-08-11T12:26:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.655+0000 7f7792d87b80 1 --2- 172.21.15.8:0/883176512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604f911eff0 0x5604f912ac10 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.655+0000 7f7792d87b80 1 --2- 172.21.15.8:0/883176512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604f9123e80 0x5604f9124260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.655+0000 7f7792d87b80 1 --2- 172.21.15.8:0/883176512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604f911e630 0x5604f911eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.655+0000 7f7792d87b80 1 -- 172.21.15.8:0/883176512 >> 172.21.15.8:0/883176512 conn(0x5604f904b8f0 msgr2=0x5604f9118e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.655+0000 7f7792d87b80 1 -- 172.21.15.8:0/883176512 shutdown_connections 2023-08-11T12:26:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.655+0000 7f7792d87b80 1 -- 172.21.15.8:0/883176512 wait complete. 2023-08-11T12:26:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.656+0000 7f7792d87b80 1 -- start start 2023-08-11T12:26:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.656+0000 7f7792d87b80 1 Processor -- start 2023-08-11T12:26:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.656+0000 7f7792d87b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604f911e630 0x5604f912d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.656+0000 7f7792d87b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604f911eff0 0x5604f912df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.656+0000 7f7792d87b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604f9123e80 0x5604f9127d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.656+0000 7f7792d87b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604f900ea60 con 0x5604f911e630 2023-08-11T12:26:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.656+0000 7f7792d87b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604f900e760 con 0x5604f9123e80 2023-08-11T12:26:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.656+0000 7f7792d87b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604f8ef28c0 con 0x5604f911eff0 2023-08-11T12:26:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.657+0000 7f7792d87b80 10 client.0 _ll_register_callbacks cb 0x5604f9011a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:26:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.657+0000 7f777d19b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604f911e630 0x5604f912d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.657+0000 7f777d19b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604f911e630 0x5604f912d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39040/0 (socket says 172.21.15.8:39040) 2023-08-11T12:26:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.657+0000 7f777d19b700 1 -- 172.21.15.8:0/2992808354 learned_addr learned my addr 172.21.15.8:0/2992808354 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.657+0000 7f777d99c700 1 --2- 172.21.15.8:0/2992808354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604f9123e80 0x5604f9127d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.657+0000 7f777c99a700 1 --2- 172.21.15.8:0/2992808354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604f911eff0 0x5604f912df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.657+0000 7f777d19b700 1 -- 172.21.15.8:0/2992808354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604f911eff0 msgr2=0x5604f912df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.657+0000 7f777d19b700 1 --2- 172.21.15.8:0/2992808354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604f911eff0 0x5604f912df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.657+0000 7f777d19b700 1 -- 172.21.15.8:0/2992808354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604f9123e80 msgr2=0x5604f9127d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.657+0000 7f777d19b700 1 --2- 172.21.15.8:0/2992808354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604f9123e80 0x5604f9127d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.657+0000 7f777d19b700 1 -- 172.21.15.8:0/2992808354 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77781a5750 con 0x5604f911e630 2023-08-11T12:26:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.657+0000 7f777d19b700 1 --2- 172.21.15.8:0/2992808354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604f911e630 0x5604f912d9d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f777400c2d0 tx=0x7f7774098870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e8387a54091730 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.657+0000 7f7760ff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:26:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.658+0000 7f7760ff9700 1 -- 172.21.15.8:0/2992808354 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7774099ea0 con 0x5604f911e630 2023-08-11T12:26:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.658+0000 7f7760ff9700 1 -- 172.21.15.8:0/2992808354 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f7774098e90 con 0x5604f911e630 2023-08-11T12:26:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.658+0000 7f7792d87b80 1 -- 172.21.15.8:0/2992808354 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604f91117e0 con 0x5604f911e630 2023-08-11T12:26:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.658+0000 7f7760ff9700 1 -- 172.21.15.8:0/2992808354 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f777409ccc0 con 0x5604f911e630 2023-08-11T12:26:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.658+0000 7f7792d87b80 10 client.16119 fetch_fsmap learned FSMap version 32 2023-08-11T12:26:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.658+0000 7f7792d87b80 1 -- 172.21.15.8:0/2992808354 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f7768009bc0 con 0x5604f911e630 2023-08-11T12:26:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.658+0000 7f7760ff9700 1 -- 172.21.15.8:0/2992808354 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5604f91117e0 con 0x5604f911e630 2023-08-11T12:26:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.658+0000 7f7760ff9700 1 -- 172.21.15.8:0/2992808354 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 32) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f77740cbd20 con 0x5604f911e630 2023-08-11T12:26:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.658+0000 7f7792d87b80 10 client.16119 fetch_fsmap finished waiting for FSMap version 32 2023-08-11T12:26:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.658+0000 7f7792d87b80 10 client.16119 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-11T12:26:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.658+0000 7f7792d87b80 20 client.16119 populate_metadata read hostname 'smithi008' 2023-08-11T12:26:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.658+0000 7f7792d87b80 1 --2- 172.21.15.8:0/2992808354 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5604f9137f70 0x5604f913a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.658+0000 7f7792d87b80 4 client.16119 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:26:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.658+0000 7f7792d87b80 1 -- 172.21.15.8:0/2992808354 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5604f90ed480 con 0x5604f9137f70 2023-08-11T12:26:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.683+0000 7f777c99a700 1 --2- 172.21.15.8:0/2992808354 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5604f9137f70 0x5604f913a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.684+0000 7f777c99a700 1 --2- 172.21.15.8:0/2992808354 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5604f9137f70 0x5604f913a390 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c32e8d273dccbfd server_cookie=6d6b0ae567864f6 in_seq=0 out_seq=0 2023-08-11T12:26:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.684+0000 7f7760ff9700 10 client.16119 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:26:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.684+0000 7f7760ff9700 1 -- 172.21.15.8:0/2992808354 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5604f90ed480 con 0x5604f9137f70 2023-08-11T12:26:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.684+0000 7f7760ff9700 10 client.16119 handle_command_reply: tid=0 2023-08-11T12:26:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.684+0000 7f7792d87b80 1 client.16119 shutdown 2023-08-11T12:26:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.685+0000 7f7792d87b80 1 -- 172.21.15.8:0/2992808354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604f911e630 msgr2=0x5604f912d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.685+0000 7f7792d87b80 1 --2- 172.21.15.8:0/2992808354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604f911e630 0x5604f912d9d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f777400c2d0 tx=0x7f7774098870 comp rx=0 tx=0).stop 2023-08-11T12:26:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.685+0000 7f7792d87b80 1 -- 172.21.15.8:0/2992808354 shutdown_connections 2023-08-11T12:26:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.685+0000 7f7792d87b80 1 --2- 172.21.15.8:0/2992808354 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5604f9137f70 0x5604f913a390 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.685+0000 7f7792d87b80 1 --2- 172.21.15.8:0/2992808354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604f9123e80 0x5604f9127d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.685+0000 7f7792d87b80 1 --2- 172.21.15.8:0/2992808354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604f911e630 0x5604f912d9d0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.685+0000 7f7760ff9700 0 client.16119 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:26:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.685+0000 7f7792d87b80 1 --2- 172.21.15.8:0/2992808354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604f911eff0 0x5604f912df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.685+0000 7f7792d87b80 1 -- 172.21.15.8:0/2992808354 >> 172.21.15.8:0/2992808354 conn(0x5604f904b8f0 msgr2=0x5604f91185d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.685+0000 7f7792d87b80 1 -- 172.21.15.8:0/2992808354 shutdown_connections 2023-08-11T12:26:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.685+0000 7f7792d87b80 1 -- 172.21.15.8:0/2992808354 wait complete. 2023-08-11T12:26:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.685+0000 7f7792d87b80 20 client.16119 trim_cache size 0 max 16384 2023-08-11T12:26:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.700+0000 7f7792d87b80 1 Processor -- start 2023-08-11T12:26:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.700+0000 7f7792d87b80 1 -- start start 2023-08-11T12:26:51.705 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.701+0000 7f7792d87b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604f911e630 0x5604f9118d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:51.705 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.701+0000 7f7792d87b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604f911eff0 0x5604f9120860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:51.705 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.701+0000 7f7792d87b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604f9123e80 0x5604f9127660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:51.705 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.701+0000 7f7792d87b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604f911adb0 con 0x5604f911eff0 2023-08-11T12:26:51.705 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.701+0000 7f7792d87b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604f9111570 con 0x5604f911e630 2023-08-11T12:26:51.706 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.701+0000 7f7792d87b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604f911a0d0 con 0x5604f9123e80 2023-08-11T12:26:51.706 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.701+0000 7f777d19b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604f911e630 0x5604f9118d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:51.706 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.701+0000 7f777d19b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604f911e630 0x5604f9118d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:39602/0 (socket says 172.21.15.8:39602) 2023-08-11T12:26:51.706 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.701+0000 7f777d19b700 1 -- 172.21.15.8:0/3019147402 learned_addr learned my addr 172.21.15.8:0/3019147402 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:51.706 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.701+0000 7f777c99a700 1 --2- 172.21.15.8:0/3019147402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604f911eff0 0x5604f9120860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:51.706 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.701+0000 7f777d99c700 1 --2- 172.21.15.8:0/3019147402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604f9123e80 0x5604f9127660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:51.706 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.701+0000 7f777d19b700 1 -- 172.21.15.8:0/3019147402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604f9123e80 msgr2=0x5604f9127660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.701+0000 7f777d19b700 1 --2- 172.21.15.8:0/3019147402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604f9123e80 0x5604f9127660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.701+0000 7f777d19b700 1 -- 172.21.15.8:0/3019147402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604f911eff0 msgr2=0x5604f9120860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.701+0000 7f777d19b700 1 --2- 172.21.15.8:0/3019147402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604f911eff0 0x5604f9120860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.701+0000 7f777d19b700 1 -- 172.21.15.8:0/3019147402 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604f8e9cd80 con 0x5604f911e630 2023-08-11T12:26:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.702+0000 7f777d19b700 1 --2- 172.21.15.8:0/3019147402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604f911e630 0x5604f9118d50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7774098b90 tx=0x7f7774098c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d00206da2a1aeede server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.702+0000 7f7763fff700 1 -- 172.21.15.8:0/3019147402 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7774099ea0 con 0x5604f911e630 2023-08-11T12:26:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.702+0000 7f7763fff700 1 -- 172.21.15.8:0/3019147402 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f77740a0900 con 0x5604f911e630 2023-08-11T12:26:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.702+0000 7f7763fff700 1 -- 172.21.15.8:0/3019147402 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77740985e0 con 0x5604f911e630 2023-08-11T12:26:51.711 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.702+0000 7f7792d87b80 1 -- 172.21.15.8:0/3019147402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604f911e630 msgr2=0x5604f9118d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:51.711 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.702+0000 7f7792d87b80 1 --2- 172.21.15.8:0/3019147402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604f911e630 0x5604f9118d50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7774098b90 tx=0x7f7774098c60 comp rx=0 tx=0).stop 2023-08-11T12:26:51.711 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.702+0000 7f7792d87b80 1 -- 172.21.15.8:0/3019147402 shutdown_connections 2023-08-11T12:26:51.711 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.702+0000 7f7792d87b80 1 --2- 172.21.15.8:0/3019147402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604f9123e80 0x5604f9127660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.711 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.702+0000 7f7792d87b80 1 --2- 172.21.15.8:0/3019147402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604f911e630 0x5604f9118d50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.702+0000 7f7792d87b80 1 --2- 172.21.15.8:0/3019147402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604f911eff0 0x5604f9120860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.702+0000 7f7792d87b80 1 -- 172.21.15.8:0/3019147402 >> 172.21.15.8:0/3019147402 conn(0x5604f904b8f0 msgr2=0x5604f9121330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.702+0000 7f7792d87b80 1 -- 172.21.15.8:0/3019147402 shutdown_connections 2023-08-11T12:26:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.703+0000 7f7792d87b80 1 -- 172.21.15.8:0/3019147402 wait complete. 2023-08-11T12:26:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.703+0000 7f7792d87b80 1 -- start start 2023-08-11T12:26:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.703+0000 7f7792d87b80 1 Processor -- start 2023-08-11T12:26:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.704+0000 7f7792d87b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604f911e630 0x5604f912b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.704+0000 7f7792d87b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604f911eff0 0x5604f912bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.704+0000 7f7792d87b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604f9123e80 0x5604f918ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.704+0000 7f7792d87b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604f912c270 con 0x5604f911eff0 2023-08-11T12:26:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.704+0000 7f7792d87b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604f918b190 con 0x5604f911e630 2023-08-11T12:26:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.704+0000 7f7792d87b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604f918b350 con 0x5604f9123e80 2023-08-11T12:26:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.704+0000 7f7792d87b80 10 client.0 _ll_register_callbacks cb 0x7f7774098d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:26:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.704+0000 7f777d19b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604f911e630 0x5604f912b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.704+0000 7f777c99a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604f911eff0 0x5604f912bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.704+0000 7f777d19b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604f911e630 0x5604f912b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:39616/0 (socket says 172.21.15.8:39616) 2023-08-11T12:26:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.704+0000 7f777d19b700 1 -- 172.21.15.8:0/805829584 learned_addr learned my addr 172.21.15.8:0/805829584 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:26:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.704+0000 7f777d99c700 1 --2- 172.21.15.8:0/805829584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604f9123e80 0x5604f918ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:51.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.704+0000 7f777c99a700 1 -- 172.21.15.8:0/805829584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604f9123e80 msgr2=0x5604f918ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:51.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.704+0000 7f777c99a700 1 --2- 172.21.15.8:0/805829584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604f9123e80 0x5604f918ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.704+0000 7f777c99a700 1 -- 172.21.15.8:0/805829584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604f911e630 msgr2=0x5604f912b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:26:51.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.704+0000 7f777c99a700 1 --2- 172.21.15.8:0/805829584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604f911e630 0x5604f912b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.704+0000 7f777c99a700 1 -- 172.21.15.8:0/805829584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7768009bc0 con 0x5604f911eff0 2023-08-11T12:26:51.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.704+0000 7f777d99c700 1 --2- 172.21.15.8:0/805829584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604f9123e80 0x5604f918ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:26:51.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.704+0000 7f777d19b700 1 --2- 172.21.15.8:0/805829584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604f911e630 0x5604f912b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:26:51.716 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.705+0000 7f777c99a700 1 --2- 172.21.15.8:0/805829584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604f911eff0 0x5604f912bad0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7768014040 tx=0x7f77680058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f6820687caf8ba2 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:26:51.716 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.705+0000 7f7760ff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:26:51.716 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.705+0000 7f7760ff9700 1 -- 172.21.15.8:0/805829584 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776802c040 con 0x5604f911eff0 2023-08-11T12:26:51.716 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.705+0000 7f7792d87b80 1 -- 172.21.15.8:0/805829584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7768004470 con 0x5604f911eff0 2023-08-11T12:26:51.716 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.705+0000 7f7760ff9700 1 -- 172.21.15.8:0/805829584 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f7768004110 con 0x5604f911eff0 2023-08-11T12:26:51.716 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.705+0000 7f7760ff9700 1 -- 172.21.15.8:0/805829584 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77680042f0 con 0x5604f911eff0 2023-08-11T12:26:51.716 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.705+0000 7f7792d87b80 10 client.16125 fetch_fsmap learned FSMap version 32 2023-08-11T12:26:51.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.705+0000 7f7792d87b80 1 -- 172.21.15.8:0/805829584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5604f8e85c00 con 0x5604f911eff0 2023-08-11T12:26:51.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.705+0000 7f7760ff9700 1 -- 172.21.15.8:0/805829584 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7768039080 con 0x5604f911eff0 2023-08-11T12:26:51.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.706+0000 7f7760ff9700 1 -- 172.21.15.8:0/805829584 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 32) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f7768004c10 con 0x5604f911eff0 2023-08-11T12:26:51.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.706+0000 7f7792d87b80 10 client.16125 fetch_fsmap finished waiting for FSMap version 32 2023-08-11T12:26:51.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.706+0000 7f7792d87b80 10 client.16125 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-11T12:26:51.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.706+0000 7f7792d87b80 20 client.16125 populate_metadata read hostname 'smithi008' 2023-08-11T12:26:51.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.706+0000 7f7792d87b80 1 --2- 172.21.15.8:0/805829584 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5604f918cb10 0x5604f918ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:26:51.718 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.706+0000 7f7792d87b80 4 client.16125 mds_command: new command op to 24575 tid=0[{"prefix": "flush journal"}] 2023-08-11T12:26:51.718 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.706+0000 7f7792d87b80 1 -- 172.21.15.8:0/805829584 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5604f90697c0 con 0x5604f918cb10 2023-08-11T12:26:51.718 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.706+0000 7f777d19b700 1 --2- 172.21.15.8:0/805829584 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5604f918cb10 0x5604f918ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:26:51.718 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.706+0000 7f777d19b700 1 --2- 172.21.15.8:0/805829584 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5604f918cb10 0x5604f918ef30 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7634d956367fd800 server_cookie=cc9956939ba3e37e in_seq=0 out_seq=0 2023-08-11T12:26:51.718 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.706+0000 7f7760ff9700 10 client.16125 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:26:51.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.720+0000 7f7760ff9700 1 -- 172.21.15.8:0/805829584 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5604f90697c0 con 0x5604f918cb10 2023-08-11T12:26:51.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.720+0000 7f7760ff9700 10 client.16125 handle_command_reply: tid=0 2023-08-11T12:26:51.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.720+0000 7f7792d87b80 1 client.16125 shutdown 2023-08-11T12:26:51.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.720+0000 7f7792d87b80 1 -- 172.21.15.8:0/805829584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604f911eff0 msgr2=0x5604f912bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:51.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.720+0000 7f7792d87b80 1 --2- 172.21.15.8:0/805829584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604f911eff0 0x5604f912bad0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7768014040 tx=0x7f77680058e0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.720+0000 7f7792d87b80 1 -- 172.21.15.8:0/805829584 shutdown_connections 2023-08-11T12:26:51.725 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.720+0000 7f7792d87b80 1 --2- 172.21.15.8:0/805829584 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5604f918cb10 0x5604f918ef30 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.725 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.720+0000 7f7792d87b80 1 --2- 172.21.15.8:0/805829584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604f9123e80 0x5604f918ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.725 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.720+0000 7f7760ff9700 0 client.16125 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:26:51.725 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.720+0000 7f7792d87b80 1 --2- 172.21.15.8:0/805829584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604f911e630 0x5604f912b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.725 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.720+0000 7f7792d87b80 1 --2- 172.21.15.8:0/805829584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604f911eff0 0x5604f912bad0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.725 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.720+0000 7f7792d87b80 1 -- 172.21.15.8:0/805829584 >> 172.21.15.8:0/805829584 conn(0x5604f904b8f0 msgr2=0x5604f9122e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:51.726 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.720+0000 7f7792d87b80 1 -- 172.21.15.8:0/805829584 shutdown_connections 2023-08-11T12:26:51.726 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.720+0000 7f7792d87b80 1 -- 172.21.15.8:0/805829584 wait complete. 2023-08-11T12:26:51.726 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.721+0000 7f7792d87b80 20 client.16125 trim_cache size 0 max 16384 2023-08-11T12:26:51.726 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-08-11T12:26:51.727 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-08-11T12:26:51.727 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-08-11T12:26:51.727 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-08-11T12:26:51.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.721+0000 7f777f3ff700 1 -- 172.21.15.8:0/1471509725 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f77640a00c0 msgr2=0x7f77640a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:51.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.721+0000 7f777f3ff700 1 --2- 172.21.15.8:0/1471509725 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f77640a00c0 0x7f77640a2580 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f77700060b0 tx=0x7f7770009700 comp rx=0 tx=0).stop 2023-08-11T12:26:51.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.721+0000 7f777f3ff700 1 -- 172.21.15.8:0/1471509725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77781008c0 msgr2=0x7f7778072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:26:51.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.721+0000 7f777f3ff700 1 --2- 172.21.15.8:0/1471509725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77781008c0 0x7f7778072c20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f777400e9a0 tx=0x7f777400ecb0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.721+0000 7f777f3ff700 1 -- 172.21.15.8:0/1471509725 shutdown_connections 2023-08-11T12:26:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.721+0000 7f777f3ff700 1 --2- 172.21.15.8:0/1471509725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77781068d0 0x7f77781a4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.721+0000 7f777f3ff700 1 --2- 172.21.15.8:0/1471509725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77781008c0 0x7f7778072c20 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.721+0000 7f777f3ff700 1 --2- 172.21.15.8:0/1471509725 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f77640a00c0 0x7f77640a2580 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.721+0000 7f777f3ff700 1 --2- 172.21.15.8:0/1471509725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7778101280 0x7f7778073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:26:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.721+0000 7f777f3ff700 1 -- 172.21.15.8:0/1471509725 >> 172.21.15.8:0/1471509725 conn(0x7f77780fc3d0 msgr2=0x7f77780fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:26:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.721+0000 7f777f3ff700 1 -- 172.21.15.8:0/1471509725 shutdown_connections 2023-08-11T12:26:51.732 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:26:51.721+0000 7f777f3ff700 1 -- 172.21.15.8:0/1471509725 wait complete. 2023-08-11T12:26:53.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:52 smithi008 ceph-mon[97158]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:26:53.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:52 smithi008 ceph-mon[97158]: pgmap v71: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 65 MiB/s wr, 51 op/s 2023-08-11T12:26:53.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:52 smithi194 ceph-mon[130905]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:26:53.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:52 smithi194 ceph-mon[130905]: pgmap v71: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 65 MiB/s wr, 51 op/s 2023-08-11T12:26:53.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:52 smithi045 ceph-mon[130284]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:26:53.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:52 smithi045 ceph-mon[130284]: pgmap v71: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 65 MiB/s wr, 51 op/s 2023-08-11T12:26:55.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:54 smithi194 ceph-mon[130905]: pgmap v72: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.0 MiB/s wr, 16 op/s 2023-08-11T12:26:55.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:54 smithi045 ceph-mon[130284]: pgmap v72: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.0 MiB/s wr, 16 op/s 2023-08-11T12:26:55.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:54 smithi008 ceph-mon[97158]: pgmap v72: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.0 MiB/s wr, 16 op/s 2023-08-11T12:26:57.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:56 smithi194 ceph-mon[130905]: pgmap v73: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.0 MiB/s wr, 16 op/s 2023-08-11T12:26:57.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:56 smithi045 ceph-mon[130284]: pgmap v73: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.0 MiB/s wr, 16 op/s 2023-08-11T12:26:57.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:56 smithi008 ceph-mon[97158]: pgmap v73: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.0 MiB/s wr, 16 op/s 2023-08-11T12:26:59.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:26:58 smithi194 ceph-mon[130905]: pgmap v74: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1.0 MiB/s wr, 22 op/s 2023-08-11T12:26:59.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:26:58 smithi045 ceph-mon[130284]: pgmap v74: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1.0 MiB/s wr, 22 op/s 2023-08-11T12:26:59.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:26:58 smithi008 ceph-mon[97158]: pgmap v74: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1.0 MiB/s wr, 22 op/s 2023-08-11T12:27:01.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:00 smithi008 ceph-mon[97158]: pgmap v75: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 KiB/s wr, 15 op/s 2023-08-11T12:27:01.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:00 smithi194 ceph-mon[130905]: pgmap v75: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 KiB/s wr, 15 op/s 2023-08-11T12:27:01.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:00 smithi045 ceph-mon[130284]: pgmap v75: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 KiB/s wr, 15 op/s 2023-08-11T12:27:02.349 INFO:teuthology.orchestra.run.smithi008.stderr:33700000 of 50000000 tuples (67%) done (elapsed 127.04 s, remaining 61.44 s) 2023-08-11T12:27:03.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:02 smithi194 ceph-mon[130905]: pgmap v76: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 1.5 MiB/s wr, 49 op/s 2023-08-11T12:27:03.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:02 smithi045 ceph-mon[130284]: pgmap v76: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 1.5 MiB/s wr, 49 op/s 2023-08-11T12:27:03.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:02 smithi008 ceph-mon[97158]: pgmap v76: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 1.5 MiB/s wr, 49 op/s 2023-08-11T12:27:04.783 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:27:04.917 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.914+0000 7f912f3ff700 1 -- 172.21.15.8:0/1819575153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9128102390 msgr2=0x7f912810a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:27:04.917 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.914+0000 7f912f3ff700 1 --2- 172.21.15.8:0/1819575153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9128102390 0x7f912810a870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f91180098f0 tx=0x7f9118009c00 comp rx=0 tx=0).stop 2023-08-11T12:27:04.917 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.915+0000 7f912f3ff700 1 -- 172.21.15.8:0/1819575153 shutdown_connections 2023-08-11T12:27:04.917 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.915+0000 7f912f3ff700 1 --2- 172.21.15.8:0/1819575153 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f912810ae90 0x7f912810d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:04.917 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.915+0000 7f912f3ff700 1 --2- 172.21.15.8:0/1819575153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9128101a70 0x7f9128101e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:04.918 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.915+0000 7f912f3ff700 1 --2- 172.21.15.8:0/1819575153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9128102390 0x7f912810a870 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:04.918 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.915+0000 7f912f3ff700 1 -- 172.21.15.8:0/1819575153 >> 172.21.15.8:0/1819575153 conn(0x7f91280fb270 msgr2=0x7f91280fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:27:04.918 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.915+0000 7f912f3ff700 1 -- 172.21.15.8:0/1819575153 shutdown_connections 2023-08-11T12:27:04.918 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.915+0000 7f912f3ff700 1 -- 172.21.15.8:0/1819575153 wait complete. 2023-08-11T12:27:04.919 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.916+0000 7f912f3ff700 1 Processor -- start 2023-08-11T12:27:04.919 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.916+0000 7f912f3ff700 1 -- start start 2023-08-11T12:27:04.919 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.917+0000 7f912f3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9128101a70 0x7f91280ff6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:04.919 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.917+0000 7f912f3ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9128102390 0x7f91280ffc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:04.919 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.917+0000 7f912f3ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f912810ae90 0x7f9128100160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:04.919 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.917+0000 7f912f3ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91281a93c0 con 0x7f912810ae90 2023-08-11T12:27:04.920 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.917+0000 7f912f3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91281a9500 con 0x7f9128101a70 2023-08-11T12:27:04.920 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.917+0000 7f912f3ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91281a9670 con 0x7f9128102390 2023-08-11T12:27:04.920 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.917+0000 7f912c99a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9128102390 0x7f91280ffc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:04.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.917+0000 7f912c99a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9128102390 0x7f91280ffc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:56252/0 (socket says 172.21.15.8:56252) 2023-08-11T12:27:04.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.917+0000 7f912c99a700 1 -- 172.21.15.8:0/2495735436 learned_addr learned my addr 172.21.15.8:0/2495735436 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:27:04.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.917+0000 7f912d19b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9128101a70 0x7f91280ff6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:04.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.917+0000 7f912d99c700 1 --2- 172.21.15.8:0/2495735436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f912810ae90 0x7f9128100160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:04.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.918+0000 7f912c99a700 1 -- 172.21.15.8:0/2495735436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9128101a70 msgr2=0x7f91280ff6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:27:04.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.918+0000 7f912c99a700 1 --2- 172.21.15.8:0/2495735436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9128101a70 0x7f91280ff6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.918+0000 7f912c99a700 1 -- 172.21.15.8:0/2495735436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f912810ae90 msgr2=0x7f9128100160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:27:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.918+0000 7f912c99a700 1 --2- 172.21.15.8:0/2495735436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f912810ae90 0x7f9128100160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.918+0000 7f912c99a700 1 -- 172.21.15.8:0/2495735436 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9118009520 con 0x7f9128102390 2023-08-11T12:27:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.918+0000 7f912c99a700 1 --2- 172.21.15.8:0/2495735436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9128102390 0x7f91280ffc20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9118009810 tx=0x7f911800fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:27:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.918+0000 7f911e7fc700 1 -- 172.21.15.8:0/2495735436 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911801c070 con 0x7f9128102390 2023-08-11T12:27:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.919+0000 7f911e7fc700 1 -- 172.21.15.8:0/2495735436 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f911800bbd0 con 0x7f9128102390 2023-08-11T12:27:04.923 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.919+0000 7f911e7fc700 1 -- 172.21.15.8:0/2495735436 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91180049c0 con 0x7f9128102390 2023-08-11T12:27:04.923 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.919+0000 7f912f3ff700 1 -- 172.21.15.8:0/2495735436 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91281a98f0 con 0x7f9128102390 2023-08-11T12:27:04.923 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.919+0000 7f912f3ff700 1 -- 172.21.15.8:0/2495735436 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91281a9cf0 con 0x7f9128102390 2023-08-11T12:27:04.926 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.924+0000 7f911e7fc700 1 -- 172.21.15.8:0/2495735436 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f9118020070 con 0x7f9128102390 2023-08-11T12:27:04.927 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.925+0000 7f9142d7ab80 1 Processor -- start 2023-08-11T12:27:04.927 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.925+0000 7f9142d7ab80 1 -- start start 2023-08-11T12:27:04.928 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.926+0000 7f9142d7ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556af7cfee80 0x556af7cff260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:04.928 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.926+0000 7f9142d7ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af7cf9630 0x556af7cf9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:04.928 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.926+0000 7f9142d7ab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556af7cf9ff0 0x556af7d05c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.926+0000 7f9142d7ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af7c525d0 con 0x556af7cfee80 2023-08-11T12:27:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.926+0000 7f9142d7ab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af7c4fef0 con 0x556af7cf9ff0 2023-08-11T12:27:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.926+0000 7f9142d7ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af7c4b7e0 con 0x556af7cf9630 2023-08-11T12:27:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.926+0000 7f912c99a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556af7cf9ff0 0x556af7d05c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.926+0000 7f912d99c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556af7cfee80 0x556af7cff260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.926+0000 7f912c99a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556af7cf9ff0 0x556af7d05c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:53252/0 (socket says 172.21.15.8:53252) 2023-08-11T12:27:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.927+0000 7f912c99a700 1 -- 172.21.15.8:0/3758271283 learned_addr learned my addr 172.21.15.8:0/3758271283 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:27:04.930 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.927+0000 7f912c99a700 1 -- 172.21.15.8:0/3758271283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af7cf9630 msgr2=0x556af7cf9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:27:04.930 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.927+0000 7f912c99a700 1 --2- 172.21.15.8:0/3758271283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af7cf9630 0x556af7cf9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:04.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.927+0000 7f912c99a700 1 -- 172.21.15.8:0/3758271283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556af7cfee80 msgr2=0x556af7cff260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:27:04.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.927+0000 7f912c99a700 1 --2- 172.21.15.8:0/3758271283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556af7cfee80 0x556af7cff260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:04.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.927+0000 7f912c99a700 1 -- 172.21.15.8:0/3758271283 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556af7acb5d0 con 0x556af7cf9ff0 2023-08-11T12:27:04.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.928+0000 7f912c99a700 1 --2- 172.21.15.8:0/3758271283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556af7cf9ff0 0x556af7d05c10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f91180c9ab0 tx=0x7f91180d2a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27df4af049e52592 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:27:04.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.928+0000 7f911e7fc700 1 --2- 172.21.15.8:0/2495735436 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f91140a0140 0x7f91140a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:04.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.928+0000 7f91137fe700 1 -- 172.21.15.8:0/3758271283 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9118095ed0 con 0x556af7cf9ff0 2023-08-11T12:27:04.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.928+0000 7f91137fe700 1 -- 172.21.15.8:0/3758271283 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91180d1030 con 0x556af7cf9ff0 2023-08-11T12:27:04.932 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.928+0000 7f91137fe700 1 -- 172.21.15.8:0/3758271283 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91180a03d0 con 0x556af7cf9ff0 2023-08-11T12:27:04.932 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.928+0000 7f911e7fc700 1 -- 172.21.15.8:0/2495735436 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f91180cc6e0 con 0x7f9128102390 2023-08-11T12:27:04.932 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.928+0000 7f912d99c700 1 --2- 172.21.15.8:0/2495735436 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f91140a0140 0x7f91140a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:04.933 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.929+0000 7f9142d7ab80 1 -- 172.21.15.8:0/3758271283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556af7cf9ff0 msgr2=0x556af7d05c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:27:04.933 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.929+0000 7f9142d7ab80 1 --2- 172.21.15.8:0/3758271283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556af7cf9ff0 0x556af7d05c10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f91180c9ab0 tx=0x7f91180d2a80 comp rx=0 tx=0).stop 2023-08-11T12:27:04.933 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.929+0000 7f9142d7ab80 1 -- 172.21.15.8:0/3758271283 shutdown_connections 2023-08-11T12:27:04.933 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.929+0000 7f9142d7ab80 1 --2- 172.21.15.8:0/3758271283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556af7cf9ff0 0x556af7d05c10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:04.933 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.929+0000 7f9142d7ab80 1 --2- 172.21.15.8:0/3758271283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556af7cfee80 0x556af7cff260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:04.933 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.929+0000 7f9142d7ab80 1 --2- 172.21.15.8:0/3758271283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af7cf9630 0x556af7cf9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:04.934 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.929+0000 7f9142d7ab80 1 -- 172.21.15.8:0/3758271283 >> 172.21.15.8:0/3758271283 conn(0x556af7c268f0 msgr2=0x556af7cf3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:27:04.934 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.930+0000 7f9142d7ab80 1 -- 172.21.15.8:0/3758271283 shutdown_connections 2023-08-11T12:27:04.934 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.930+0000 7f9142d7ab80 1 -- 172.21.15.8:0/3758271283 wait complete. 2023-08-11T12:27:04.935 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.930+0000 7f912d99c700 1 --2- 172.21.15.8:0/2495735436 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f91140a0140 0x7f91140a2600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9120009fd0 tx=0x7f9120009040 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:27:04.935 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.930+0000 7f9142d7ab80 1 -- start start 2023-08-11T12:27:04.935 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.931+0000 7f9142d7ab80 1 Processor -- start 2023-08-11T12:27:04.937 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.932+0000 7f9142d7ab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556af7cf9630 0x556af7d085f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:04.937 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.932+0000 7f9142d7ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af7cf9ff0 0x556af7d08b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:04.938 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.932+0000 7f9142d7ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556af7cfee80 0x556af7d02920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:04.938 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.932+0000 7f9142d7ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af7be9a60 con 0x556af7cfee80 2023-08-11T12:27:04.938 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.932+0000 7f9142d7ab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af7be9760 con 0x556af7cf9630 2023-08-11T12:27:04.938 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.932+0000 7f9142d7ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af7acd8c0 con 0x556af7cf9ff0 2023-08-11T12:27:04.938 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.932+0000 7f9142d7ab80 10 client.0 _ll_register_callbacks cb 0x556af7beca50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:27:04.938 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.932+0000 7f912d19b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556af7cf9630 0x556af7d085f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:04.938 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.932+0000 7f912d19b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556af7cf9630 0x556af7d085f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:53262/0 (socket says 172.21.15.8:53262) 2023-08-11T12:27:04.939 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.933+0000 7f912d19b700 1 -- 172.21.15.8:0/1332067012 learned_addr learned my addr 172.21.15.8:0/1332067012 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:27:04.939 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.933+0000 7f912c99a700 1 --2- 172.21.15.8:0/1332067012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af7cf9ff0 0x556af7d08b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:04.939 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.933+0000 7f912d99c700 1 --2- 172.21.15.8:0/1332067012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556af7cfee80 0x556af7d02920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:04.939 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.933+0000 7f912d19b700 1 -- 172.21.15.8:0/1332067012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af7cf9ff0 msgr2=0x556af7d08b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:27:04.939 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.933+0000 7f912d19b700 1 --2- 172.21.15.8:0/1332067012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af7cf9ff0 0x556af7d08b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:04.939 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.933+0000 7f912d19b700 1 -- 172.21.15.8:0/1332067012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556af7cfee80 msgr2=0x556af7d02920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:27:04.939 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.933+0000 7f912d19b700 1 --2- 172.21.15.8:0/1332067012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556af7cfee80 0x556af7d02920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:04.940 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.933+0000 7f912d19b700 1 -- 172.21.15.8:0/1332067012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91281a9cf0 con 0x556af7cf9630 2023-08-11T12:27:04.940 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.933+0000 7f912d99c700 1 --2- 172.21.15.8:0/1332067012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556af7cfee80 0x556af7d02920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:27:04.940 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.933+0000 7f912d19b700 1 --2- 172.21.15.8:0/1332067012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556af7cf9630 0x556af7d085f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f912400f710 tx=0x7f912400fa20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=971468831d63a561 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:27:04.940 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.934+0000 7f9110ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:27:04.940 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.934+0000 7f9110ff9700 1 -- 172.21.15.8:0/1332067012 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912400a740 con 0x556af7cf9630 2023-08-11T12:27:04.940 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.934+0000 7f9110ff9700 1 -- 172.21.15.8:0/1332067012 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f9124004a30 con 0x556af7cf9630 2023-08-11T12:27:04.941 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.934+0000 7f9142d7ab80 1 -- 172.21.15.8:0/1332067012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556af7cec7e0 con 0x556af7cf9630 2023-08-11T12:27:04.941 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.934+0000 7f9110ff9700 1 -- 172.21.15.8:0/1332067012 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9124004bf0 con 0x556af7cf9630 2023-08-11T12:27:04.941 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.934+0000 7f9142d7ab80 10 client.26177 fetch_fsmap learned FSMap version 33 2023-08-11T12:27:04.941 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.934+0000 7f9142d7ab80 1 -- 172.21.15.8:0/1332067012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x556af7a77d80 con 0x556af7cf9630 2023-08-11T12:27:04.941 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.935+0000 7f9110ff9700 1 -- 172.21.15.8:0/1332067012 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556af7cec7e0 con 0x556af7cf9630 2023-08-11T12:27:04.941 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.935+0000 7f9110ff9700 1 -- 172.21.15.8:0/1332067012 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 33) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f9124005400 con 0x556af7cf9630 2023-08-11T12:27:04.941 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.935+0000 7f9142d7ab80 10 client.26177 fetch_fsmap finished waiting for FSMap version 33 2023-08-11T12:27:04.943 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.936+0000 7f9142d7ab80 10 client.26177 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-11T12:27:04.944 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.936+0000 7f9142d7ab80 20 client.26177 populate_metadata read hostname 'smithi008' 2023-08-11T12:27:04.944 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.936+0000 7f9142d7ab80 1 --2- 172.21.15.8:0/1332067012 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556af7d12c50 0x556af7d15070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:04.944 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.936+0000 7f9142d7ab80 4 client.26177 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:27:04.944 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.936+0000 7f9142d7ab80 1 -- 172.21.15.8:0/1332067012 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556af7cc8480 con 0x556af7d12c50 2023-08-11T12:27:04.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.936+0000 7f912c99a700 1 --2- 172.21.15.8:0/1332067012 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556af7d12c50 0x556af7d15070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:04.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.936+0000 7f912c99a700 1 --2- 172.21.15.8:0/1332067012 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556af7d12c50 0x556af7d15070 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72a4c14772893302 server_cookie=a5c4f5b5b4ad9e31 in_seq=0 out_seq=0 2023-08-11T12:27:04.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.937+0000 7f9110ff9700 10 client.26177 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:27:04.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.937+0000 7f9110ff9700 1 -- 172.21.15.8:0/1332067012 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x556af7cc8480 con 0x556af7d12c50 2023-08-11T12:27:04.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.937+0000 7f9110ff9700 10 client.26177 handle_command_reply: tid=0 2023-08-11T12:27:04.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.937+0000 7f9142d7ab80 1 client.26177 shutdown 2023-08-11T12:27:04.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.938+0000 7f9142d7ab80 1 -- 172.21.15.8:0/1332067012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556af7cf9630 msgr2=0x556af7d085f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:27:04.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.938+0000 7f9142d7ab80 1 --2- 172.21.15.8:0/1332067012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556af7cf9630 0x556af7d085f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f912400f710 tx=0x7f912400fa20 comp rx=0 tx=0).stop 2023-08-11T12:27:04.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.938+0000 7f9142d7ab80 1 -- 172.21.15.8:0/1332067012 shutdown_connections 2023-08-11T12:27:04.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.938+0000 7f9142d7ab80 1 --2- 172.21.15.8:0/1332067012 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556af7d12c50 0x556af7d15070 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:04.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.938+0000 7f9142d7ab80 1 --2- 172.21.15.8:0/1332067012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556af7cfee80 0x556af7d02920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:04.948 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.938+0000 7f9142d7ab80 1 --2- 172.21.15.8:0/1332067012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556af7cf9630 0x556af7d085f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:04.948 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.938+0000 7f9142d7ab80 1 --2- 172.21.15.8:0/1332067012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af7cf9ff0 0x556af7d08b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:04.948 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.938+0000 7f9110ff9700 0 client.26177 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:27:04.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.938+0000 7f9142d7ab80 1 -- 172.21.15.8:0/1332067012 >> 172.21.15.8:0/1332067012 conn(0x556af7c268f0 msgr2=0x556af7cf8620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:27:04.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.938+0000 7f9142d7ab80 1 -- 172.21.15.8:0/1332067012 shutdown_connections 2023-08-11T12:27:04.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.938+0000 7f9142d7ab80 1 -- 172.21.15.8:0/1332067012 wait complete. 2023-08-11T12:27:04.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.939+0000 7f9142d7ab80 20 client.26177 trim_cache size 0 max 16384 2023-08-11T12:27:04.973 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.971+0000 7f9142d7ab80 1 Processor -- start 2023-08-11T12:27:04.973 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.971+0000 7f9142d7ab80 1 -- start start 2023-08-11T12:27:04.974 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.971+0000 7f9142d7ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af7cf9630 0x556af7cfe250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:04.974 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.971+0000 7f9142d7ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556af7cf9ff0 0x556af7d08150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:04.974 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.972+0000 7f9142d7ab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556af7cfee80 0x556af7cf3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:04.975 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.972+0000 7f9142d7ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af7cc8480 con 0x556af7cf9ff0 2023-08-11T12:27:04.975 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.972+0000 7f9142d7ab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af7cec7e0 con 0x556af7cfee80 2023-08-11T12:27:04.975 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.972+0000 7f9142d7ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af7cfa460 con 0x556af7cf9630 2023-08-11T12:27:04.975 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.972+0000 7f912d99c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556af7cfee80 0x556af7cf3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:04.975 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.972+0000 7f912d99c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556af7cfee80 0x556af7cf3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:53268/0 (socket says 172.21.15.8:53268) 2023-08-11T12:27:04.975 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.972+0000 7f912d99c700 1 -- 172.21.15.8:0/1070301434 learned_addr learned my addr 172.21.15.8:0/1070301434 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:27:04.975 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.972+0000 7f912c99a700 1 --2- 172.21.15.8:0/1070301434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556af7cf9ff0 0x556af7d08150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:04.976 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.972+0000 7f912d19b700 1 --2- 172.21.15.8:0/1070301434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af7cf9630 0x556af7cfe250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:04.976 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.972+0000 7f912d99c700 1 -- 172.21.15.8:0/1070301434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af7cf9630 msgr2=0x556af7cfe250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:27:04.976 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.972+0000 7f912d99c700 1 --2- 172.21.15.8:0/1070301434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af7cf9630 0x556af7cfe250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:04.976 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.972+0000 7f912d99c700 1 -- 172.21.15.8:0/1070301434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556af7cf9ff0 msgr2=0x556af7d08150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:27:04.976 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.972+0000 7f912d99c700 1 --2- 172.21.15.8:0/1070301434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556af7cf9ff0 0x556af7d08150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:04.976 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.972+0000 7f912d99c700 1 -- 172.21.15.8:0/1070301434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556af7cf0a10 con 0x556af7cfee80 2023-08-11T12:27:04.977 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.973+0000 7f912d99c700 1 --2- 172.21.15.8:0/1070301434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556af7cfee80 0x556af7cf3d50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f91200164e0 tx=0x7f9120004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d46caebf04d9aa98 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:27:04.977 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.973+0000 7f9113fff700 1 -- 172.21.15.8:0/1070301434 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912001d040 con 0x556af7cfee80 2023-08-11T12:27:04.977 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.973+0000 7f9113fff700 1 -- 172.21.15.8:0/1070301434 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f912000f040 con 0x556af7cfee80 2023-08-11T12:27:04.978 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.973+0000 7f9113fff700 1 -- 172.21.15.8:0/1070301434 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912000e050 con 0x556af7cfee80 2023-08-11T12:27:04.978 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.974+0000 7f9142d7ab80 1 -- 172.21.15.8:0/1070301434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556af7cfee80 msgr2=0x556af7cf3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:27:04.978 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.974+0000 7f9142d7ab80 1 --2- 172.21.15.8:0/1070301434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556af7cfee80 0x556af7cf3d50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f91200164e0 tx=0x7f9120004ad0 comp rx=0 tx=0).stop 2023-08-11T12:27:04.978 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.974+0000 7f9142d7ab80 1 -- 172.21.15.8:0/1070301434 shutdown_connections 2023-08-11T12:27:04.978 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.974+0000 7f9142d7ab80 1 --2- 172.21.15.8:0/1070301434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af7cf9630 0x556af7cfe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:04.978 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.974+0000 7f9142d7ab80 1 --2- 172.21.15.8:0/1070301434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556af7cfee80 0x556af7cf3d50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:04.978 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.974+0000 7f9142d7ab80 1 --2- 172.21.15.8:0/1070301434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556af7cf9ff0 0x556af7d08150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:04.979 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.974+0000 7f9142d7ab80 1 -- 172.21.15.8:0/1070301434 >> 172.21.15.8:0/1070301434 conn(0x556af7c268f0 msgr2=0x556af7cf8620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:27:04.979 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.975+0000 7f9142d7ab80 1 -- 172.21.15.8:0/1070301434 shutdown_connections 2023-08-11T12:27:04.979 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.975+0000 7f9142d7ab80 1 -- 172.21.15.8:0/1070301434 wait complete. 2023-08-11T12:27:04.980 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.975+0000 7f9142d7ab80 1 -- start start 2023-08-11T12:27:04.980 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.976+0000 7f9142d7ab80 1 Processor -- start 2023-08-11T12:27:04.980 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.977+0000 7f9142d7ab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556af7cf9630 0x556af7d06100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:04.980 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.977+0000 7f9142d7ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af7cf9ff0 0x556af7d06640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:04.980 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.977+0000 7f9142d7ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556af7cfee80 0x556af7d5f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:04.980 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.977+0000 7f9142d7ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af7d5fdf0 con 0x556af7cfee80 2023-08-11T12:27:04.980 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.977+0000 7f9142d7ab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af7d5ff60 con 0x556af7cf9630 2023-08-11T12:27:04.981 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.977+0000 7f9142d7ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af7d60120 con 0x556af7cf9ff0 2023-08-11T12:27:04.981 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.977+0000 7f9142d7ab80 10 client.0 _ll_register_callbacks cb 0x7f912400ac40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:27:04.981 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.977+0000 7f912d19b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556af7cf9630 0x556af7d06100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:04.981 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.977+0000 7f912d19b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556af7cf9630 0x556af7d06100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:53270/0 (socket says 172.21.15.8:53270) 2023-08-11T12:27:04.981 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.977+0000 7f912d19b700 1 -- 172.21.15.8:0/3327088386 learned_addr learned my addr 172.21.15.8:0/3327088386 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:27:04.981 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.978+0000 7f912d99c700 1 --2- 172.21.15.8:0/3327088386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556af7cfee80 0x556af7d5f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:04.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.978+0000 7f912d19b700 1 -- 172.21.15.8:0/3327088386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af7cf9ff0 msgr2=0x556af7d06640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-11T12:27:04.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.978+0000 7f912d19b700 1 --2- 172.21.15.8:0/3327088386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af7cf9ff0 0x556af7d06640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:04.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.978+0000 7f912d19b700 1 -- 172.21.15.8:0/3327088386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556af7cfee80 msgr2=0x556af7d5f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:27:04.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.978+0000 7f912d19b700 1 --2- 172.21.15.8:0/3327088386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556af7cfee80 0x556af7d5f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:04.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.978+0000 7f912d19b700 1 -- 172.21.15.8:0/3327088386 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9120007ce0 con 0x556af7cf9630 2023-08-11T12:27:04.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.978+0000 7f912d19b700 1 --2- 172.21.15.8:0/3327088386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556af7cf9630 0x556af7d06100 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f912400f710 tx=0x7f912400afd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62d677d0515291f server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:27:04.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.978+0000 7f9110ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:27:04.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.979+0000 7f9110ff9700 1 -- 172.21.15.8:0/3327088386 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9124018aa0 con 0x556af7cf9630 2023-08-11T12:27:04.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.979+0000 7f9142d7ab80 1 -- 172.21.15.8:0/3327088386 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f91180d1030 con 0x556af7cf9630 2023-08-11T12:27:04.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.979+0000 7f9110ff9700 1 -- 172.21.15.8:0/3327088386 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f9124000e40 con 0x556af7cf9630 2023-08-11T12:27:04.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.979+0000 7f9110ff9700 1 -- 172.21.15.8:0/3327088386 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9124018c00 con 0x556af7cf9630 2023-08-11T12:27:04.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.979+0000 7f9142d7ab80 10 client.26183 fetch_fsmap learned FSMap version 33 2023-08-11T12:27:04.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.979+0000 7f9142d7ab80 1 -- 172.21.15.8:0/3327088386 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x556af7a60c00 con 0x556af7cf9630 2023-08-11T12:27:04.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.979+0000 7f9110ff9700 1 -- 172.21.15.8:0/3327088386 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91180d1030 con 0x556af7cf9630 2023-08-11T12:27:04.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.980+0000 7f9110ff9700 1 -- 172.21.15.8:0/3327088386 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 33) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f91240285a0 con 0x556af7cf9630 2023-08-11T12:27:04.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.980+0000 7f9142d7ab80 10 client.26183 fetch_fsmap finished waiting for FSMap version 33 2023-08-11T12:27:04.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.980+0000 7f9142d7ab80 10 client.26183 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-11T12:27:04.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.980+0000 7f9142d7ab80 20 client.26183 populate_metadata read hostname 'smithi008' 2023-08-11T12:27:04.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.980+0000 7f9142d7ab80 1 --2- 172.21.15.8:0/3327088386 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556af7d67900 0x556af7d69d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:04.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.980+0000 7f9142d7ab80 4 client.26183 mds_command: new command op to 24575 tid=0[{"prefix": "flush journal"}] 2023-08-11T12:27:04.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.980+0000 7f9142d7ab80 1 -- 172.21.15.8:0/3327088386 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556af7c447c0 con 0x556af7d67900 2023-08-11T12:27:04.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.980+0000 7f912c99a700 1 --2- 172.21.15.8:0/3327088386 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556af7d67900 0x556af7d69d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:04.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.980+0000 7f912c99a700 1 --2- 172.21.15.8:0/3327088386 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556af7d67900 0x556af7d69d20 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=962633c07388dcb4 server_cookie=de903fa4264642f in_seq=0 out_seq=0 2023-08-11T12:27:04.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.980+0000 7f9110ff9700 10 client.26183 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:27:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.998+0000 7f9110ff9700 1 -- 172.21.15.8:0/3327088386 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556af7c447c0 con 0x556af7d67900 2023-08-11T12:27:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.998+0000 7f9110ff9700 10 client.26183 handle_command_reply: tid=0 2023-08-11T12:27:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.998+0000 7f9142d7ab80 1 client.26183 shutdown 2023-08-11T12:27:05.001 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.998+0000 7f9142d7ab80 1 -- 172.21.15.8:0/3327088386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556af7cf9630 msgr2=0x556af7d06100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:27:05.001 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.998+0000 7f9142d7ab80 1 --2- 172.21.15.8:0/3327088386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556af7cf9630 0x556af7d06100 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f912400f710 tx=0x7f912400afd0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.001 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.999+0000 7f9142d7ab80 1 -- 172.21.15.8:0/3327088386 shutdown_connections 2023-08-11T12:27:05.001 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.999+0000 7f9142d7ab80 1 --2- 172.21.15.8:0/3327088386 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556af7d67900 0x556af7d69d20 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.999+0000 7f9142d7ab80 1 --2- 172.21.15.8:0/3327088386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556af7cfee80 0x556af7d5f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.999+0000 7f9142d7ab80 1 --2- 172.21.15.8:0/3327088386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556af7cf9630 0x556af7d06100 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.999+0000 7f9142d7ab80 1 --2- 172.21.15.8:0/3327088386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af7cf9ff0 0x556af7d06640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.999+0000 7f9142d7ab80 1 -- 172.21.15.8:0/3327088386 >> 172.21.15.8:0/3327088386 conn(0x556af7c268f0 msgr2=0x556af7cf8620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:27:05.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.999+0000 7f9110ff9700 0 client.26183 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:27:05.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.999+0000 7f9142d7ab80 1 -- 172.21.15.8:0/3327088386 shutdown_connections 2023-08-11T12:27:05.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.999+0000 7f9142d7ab80 1 -- 172.21.15.8:0/3327088386 wait complete. 2023-08-11T12:27:05.003 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:04.999+0000 7f9142d7ab80 20 client.26183 trim_cache size 0 max 16384 2023-08-11T12:27:05.003 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-08-11T12:27:05.003 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-08-11T12:27:05.003 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-08-11T12:27:05.004 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-08-11T12:27:05.004 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:05.000+0000 7f912f3ff700 1 -- 172.21.15.8:0/2495735436 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f91140a0140 msgr2=0x7f91140a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:27:05.004 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:05.000+0000 7f912f3ff700 1 --2- 172.21.15.8:0/2495735436 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f91140a0140 0x7f91140a2600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9120009fd0 tx=0x7f9120009040 comp rx=0 tx=0).stop 2023-08-11T12:27:05.004 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:05.000+0000 7f912f3ff700 1 -- 172.21.15.8:0/2495735436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9128102390 msgr2=0x7f91280ffc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:27:05.005 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:05.000+0000 7f912f3ff700 1 --2- 172.21.15.8:0/2495735436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9128102390 0x7f91280ffc20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9118009810 tx=0x7f911800fa00 comp rx=0 tx=0).stop 2023-08-11T12:27:05.005 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:05.000+0000 7f912f3ff700 1 -- 172.21.15.8:0/2495735436 shutdown_connections 2023-08-11T12:27:05.005 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:05.000+0000 7f912f3ff700 1 --2- 172.21.15.8:0/2495735436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f912810ae90 0x7f9128100160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.005 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:05.000+0000 7f912f3ff700 1 --2- 172.21.15.8:0/2495735436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9128101a70 0x7f91280ff6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.005 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:05.000+0000 7f912f3ff700 1 --2- 172.21.15.8:0/2495735436 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f91140a0140 0x7f91140a2600 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.005 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:05.000+0000 7f912f3ff700 1 --2- 172.21.15.8:0/2495735436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9128102390 0x7f91280ffc20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.006 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:05.000+0000 7f912f3ff700 1 -- 172.21.15.8:0/2495735436 >> 172.21.15.8:0/2495735436 conn(0x7f91280fb270 msgr2=0x7f912810d100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:27:05.006 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:05.001+0000 7f912f3ff700 1 -- 172.21.15.8:0/2495735436 shutdown_connections 2023-08-11T12:27:05.006 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-08-11T12:27:05.001+0000 7f912f3ff700 1 -- 172.21.15.8:0/2495735436 wait complete. 2023-08-11T12:27:05.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.066+0000 7f459bfff700 1 -- 172.21.15.8:0/307376208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4594101320 msgr2=0x7f459410d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:27:05.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.066+0000 7f459bfff700 1 --2- 172.21.15.8:0/307376208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4594101320 0x7f459410d830 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f458c00b0a0 tx=0x7f458c00b3b0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.066+0000 7f459bfff700 1 -- 172.21.15.8:0/307376208 shutdown_connections 2023-08-11T12:27:05.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.066+0000 7f459bfff700 1 --2- 172.21.15.8:0/307376208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4594106970 0x7f4594106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.066+0000 7f459bfff700 1 --2- 172.21.15.8:0/307376208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4594101320 0x7f459410d830 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.066+0000 7f459bfff700 1 --2- 172.21.15.8:0/307376208 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4594100960 0x7f4594100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.066+0000 7f459bfff700 1 -- 172.21.15.8:0/307376208 >> 172.21.15.8:0/307376208 conn(0x7f45940fc490 msgr2=0x7f45940fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:27:05.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.066+0000 7f459bfff700 1 -- 172.21.15.8:0/307376208 shutdown_connections 2023-08-11T12:27:05.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.066+0000 7f459bfff700 1 -- 172.21.15.8:0/307376208 wait complete. 2023-08-11T12:27:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.067+0000 7f459bfff700 1 Processor -- start 2023-08-11T12:27:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.068+0000 7f459bfff700 1 -- start start 2023-08-11T12:27:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.068+0000 7f459bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4594100960 0x7f45941078b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.068+0000 7f459bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4594101320 0x7f4594107df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.068+0000 7f459bfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4594106970 0x7f4594108330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.068+0000 7f459bfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45941a92a0 con 0x7f4594100960 2023-08-11T12:27:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.068+0000 7f459bfff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45941a9410 con 0x7f4594101320 2023-08-11T12:27:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.068+0000 7f459bfff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45941a95d0 con 0x7f4594106970 2023-08-11T12:27:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.069+0000 7f4599d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4594100960 0x7f45941078b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:05.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.069+0000 7f4599d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4594100960 0x7f45941078b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47660/0 (socket says 172.21.15.8:47660) 2023-08-11T12:27:05.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.069+0000 7f459a59c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4594106970 0x7f4594108330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:05.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.069+0000 7f4599d9b700 1 -- 172.21.15.8:0/2367499888 learned_addr learned my addr 172.21.15.8:0/2367499888 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:27:05.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.069+0000 7f459959a700 1 --2- 172.21.15.8:0/2367499888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4594101320 0x7f4594107df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:05.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.069+0000 7f4599d9b700 1 -- 172.21.15.8:0/2367499888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4594106970 msgr2=0x7f4594108330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:27:05.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.069+0000 7f4599d9b700 1 --2- 172.21.15.8:0/2367499888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4594106970 0x7f4594108330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.069+0000 7f4599d9b700 1 -- 172.21.15.8:0/2367499888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4594101320 msgr2=0x7f4594107df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:27:05.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.069+0000 7f4599d9b700 1 --2- 172.21.15.8:0/2367499888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4594101320 0x7f4594107df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.069+0000 7f4599d9b700 1 -- 172.21.15.8:0/2367499888 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458c009d00 con 0x7f4594100960 2023-08-11T12:27:05.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.069+0000 7f459a59c700 1 --2- 172.21.15.8:0/2367499888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4594106970 0x7f4594108330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:27:05.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.070+0000 7f4599d9b700 1 --2- 172.21.15.8:0/2367499888 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4594100960 0x7f45941078b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f459000d950 tx=0x7f459000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:27:05.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.070+0000 7f458affd700 1 -- 172.21.15.8:0/2367499888 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459000f890 con 0x7f4594100960 2023-08-11T12:27:05.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.070+0000 7f458affd700 1 -- 172.21.15.8:0/2367499888 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4590010460 con 0x7f4594100960 2023-08-11T12:27:05.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.070+0000 7f458affd700 1 -- 172.21.15.8:0/2367499888 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459000e610 con 0x7f4594100960 2023-08-11T12:27:05.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.070+0000 7f459bfff700 1 -- 172.21.15.8:0/2367499888 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45941a98b0 con 0x7f4594100960 2023-08-11T12:27:05.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.070+0000 7f459bfff700 1 -- 172.21.15.8:0/2367499888 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45941a9d70 con 0x7f4594100960 2023-08-11T12:27:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.076+0000 7f458affd700 1 -- 172.21.15.8:0/2367499888 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f45900108d0 con 0x7f4594100960 2023-08-11T12:27:05.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.077+0000 7f45af964b80 1 Processor -- start 2023-08-11T12:27:05.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.078+0000 7f45af964b80 1 -- start start 2023-08-11T12:27:05.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.078+0000 7f458affd700 1 --2- 172.21.15.8:0/2367499888 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f45800a0210 0x7f45800a26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:05.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.078+0000 7f45af964b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f74fada310 0x55f74fada6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:05.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.078+0000 7f45af964b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f74fadac30 0x55f74fad48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.078+0000 7f45af964b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f74fad4e20 0x55f74fad5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.078+0000 7f45af964b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74fa2d630 con 0x55f74fada310 2023-08-11T12:27:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.078+0000 7f45af964b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74fa2af50 con 0x55f74fadac30 2023-08-11T12:27:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.078+0000 7f45af964b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74fa26840 con 0x55f74fad4e20 2023-08-11T12:27:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.078+0000 7f458affd700 1 -- 172.21.15.8:0/2367499888 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f45900cb5c0 con 0x7f4594100960 2023-08-11T12:27:05.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.079+0000 7f459959a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f74fadac30 0x55f74fad48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:05.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.079+0000 7f459959a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f74fadac30 0x55f74fad48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:53298/0 (socket says 172.21.15.8:53298) 2023-08-11T12:27:05.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.079+0000 7f459959a700 1 -- 172.21.15.8:0/3220456257 learned_addr learned my addr 172.21.15.8:0/3220456257 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:27:05.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.079+0000 7f459a59c700 1 --2- 172.21.15.8:0/2367499888 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f45800a0210 0x7f45800a26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:05.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.079+0000 7f4599d9b700 1 --2- 172.21.15.8:0/3220456257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f74fada310 0x55f74fada6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:05.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.079+0000 7f459a59c700 1 --2- 172.21.15.8:0/3220456257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f74fad4e20 0x55f74fad5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:05.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.079+0000 7f459959a700 1 -- 172.21.15.8:0/3220456257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f74fad4e20 msgr2=0x55f74fad5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:27:05.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.079+0000 7f459959a700 1 --2- 172.21.15.8:0/3220456257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f74fad4e20 0x55f74fad5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.079+0000 7f459959a700 1 -- 172.21.15.8:0/3220456257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f74fada310 msgr2=0x55f74fada6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:27:05.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.079+0000 7f459959a700 1 --2- 172.21.15.8:0/3220456257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f74fada310 0x55f74fada6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.079+0000 7f459959a700 1 -- 172.21.15.8:0/3220456257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f74f8a6630 con 0x55f74fadac30 2023-08-11T12:27:05.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.079+0000 7f459959a700 1 --2- 172.21.15.8:0/3220456257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f74fadac30 0x55f74fad48e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4584009cf0 tx=0x7f4584011440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bed5bbb388d82ef9 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:27:05.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.080+0000 7f457ffff700 1 -- 172.21.15.8:0/3220456257 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4584011d80 con 0x55f74fadac30 2023-08-11T12:27:05.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.080+0000 7f457ffff700 1 -- 172.21.15.8:0/3220456257 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4584004510 con 0x55f74fadac30 2023-08-11T12:27:05.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.080+0000 7f457ffff700 1 -- 172.21.15.8:0/3220456257 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4584005280 con 0x55f74fadac30 2023-08-11T12:27:05.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.080+0000 7f459a59c700 1 --2- 172.21.15.8:0/2367499888 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f45800a0210 0x7f45800a26d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f458c009cd0 tx=0x7f458c009c40 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:27:05.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.080+0000 7f45af964b80 1 -- 172.21.15.8:0/3220456257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f74fadac30 msgr2=0x55f74fad48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:27:05.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.080+0000 7f45af964b80 1 --2- 172.21.15.8:0/3220456257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f74fadac30 0x55f74fad48e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4584009cf0 tx=0x7f4584011440 comp rx=0 tx=0).stop 2023-08-11T12:27:05.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.081+0000 7f45af964b80 1 -- 172.21.15.8:0/3220456257 shutdown_connections 2023-08-11T12:27:05.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.081+0000 7f45af964b80 1 --2- 172.21.15.8:0/3220456257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f74fad4e20 0x55f74fad5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.081+0000 7f45af964b80 1 --2- 172.21.15.8:0/3220456257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f74fada310 0x55f74fada6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.081+0000 7f45af964b80 1 --2- 172.21.15.8:0/3220456257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f74fadac30 0x55f74fad48e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.081+0000 7f45af964b80 1 -- 172.21.15.8:0/3220456257 >> 172.21.15.8:0/3220456257 conn(0x55f74fa01950 msgr2=0x55f74facf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:27:05.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.081+0000 7f45af964b80 1 -- 172.21.15.8:0/3220456257 shutdown_connections 2023-08-11T12:27:05.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.081+0000 7f45af964b80 1 -- 172.21.15.8:0/3220456257 wait complete. 2023-08-11T12:27:05.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.081+0000 7f45af964b80 1 -- start start 2023-08-11T12:27:05.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.082+0000 7f45af964b80 1 Processor -- start 2023-08-11T12:27:05.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.082+0000 7f45af964b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f74fad4e20 0x55f74fae0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:05.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.083+0000 7f45af964b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f74fada310 0x55f74faddec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:05.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.083+0000 7f45af964b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f74fadac30 0x55f74fade520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:05.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.083+0000 7f45af964b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74f9c4ac0 con 0x55f74fada310 2023-08-11T12:27:05.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.083+0000 7f45af964b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74f9c47c0 con 0x55f74fadac30 2023-08-11T12:27:05.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.083+0000 7f45af964b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74f8a8920 con 0x55f74fad4e20 2023-08-11T12:27:05.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.083+0000 7f45af964b80 10 client.0 _ll_register_callbacks cb 0x55f74f9c7ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:27:05.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.083+0000 7f459959a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f74fada310 0x55f74faddec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:05.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.083+0000 7f459a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f74fadac30 0x55f74fade520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:05.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.083+0000 7f4599d9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f74fad4e20 0x55f74fae0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:05.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.083+0000 7f459959a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f74fada310 0x55f74faddec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47678/0 (socket says 172.21.15.8:47678) 2023-08-11T12:27:05.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.083+0000 7f459959a700 1 -- 172.21.15.8:0/2377309982 learned_addr learned my addr 172.21.15.8:0/2377309982 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:27:05.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.083+0000 7f459959a700 1 -- 172.21.15.8:0/2377309982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f74fad4e20 msgr2=0x55f74fae0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:27:05.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.083+0000 7f459959a700 1 --2- 172.21.15.8:0/2377309982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f74fad4e20 0x55f74fae0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.083+0000 7f459959a700 1 -- 172.21.15.8:0/2377309982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f74fadac30 msgr2=0x55f74fade520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:27:05.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.083+0000 7f459959a700 1 --2- 172.21.15.8:0/2377309982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f74fadac30 0x55f74fade520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.084+0000 7f459959a700 1 -- 172.21.15.8:0/2377309982 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4584009920 con 0x55f74fada310 2023-08-11T12:27:05.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.084+0000 7f459959a700 1 --2- 172.21.15.8:0/2377309982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f74fada310 0x55f74faddec0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f45840046e0 tx=0x7f4584004050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ee50ff08583eb6 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:27:05.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.084+0000 7f457d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:27:05.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.084+0000 7f457d7fa700 1 -- 172.21.15.8:0/2377309982 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4584004750 con 0x55f74fada310 2023-08-11T12:27:05.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.085+0000 7f457d7fa700 1 -- 172.21.15.8:0/2377309982 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f45840048b0 con 0x55f74fada310 2023-08-11T12:27:05.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.085+0000 7f45af964b80 1 -- 172.21.15.8:0/2377309982 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f74fac7a90 con 0x55f74fada310 2023-08-11T12:27:05.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.085+0000 7f457d7fa700 1 -- 172.21.15.8:0/2377309982 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4584004a90 con 0x55f74fada310 2023-08-11T12:27:05.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.085+0000 7f45af964b80 10 client.16152 fetch_fsmap learned FSMap version 33 2023-08-11T12:27:05.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.085+0000 7f45af964b80 1 -- 172.21.15.8:0/2377309982 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55f74f852de0 con 0x55f74fada310 2023-08-11T12:27:05.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.085+0000 7f457d7fa700 1 -- 172.21.15.8:0/2377309982 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f74fac7a90 con 0x55f74fada310 2023-08-11T12:27:05.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.086+0000 7f457d7fa700 1 -- 172.21.15.8:0/2377309982 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 33) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f4584005100 con 0x55f74fada310 2023-08-11T12:27:05.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.086+0000 7f45af964b80 10 client.16152 fetch_fsmap finished waiting for FSMap version 33 2023-08-11T12:27:05.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.086+0000 7f45af964b80 10 client.16152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:27:05.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.086+0000 7f45af964b80 20 client.16152 populate_metadata read hostname 'smithi008' 2023-08-11T12:27:05.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.086+0000 7f45af964b80 1 --2- 172.21.15.8:0/2377309982 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f74faee3c0 0x55f74faf07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:05.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.086+0000 7f45af964b80 4 client.16152 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:27:05.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.086+0000 7f45af964b80 1 -- 172.21.15.8:0/2377309982 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f74faa34e0 con 0x55f74faee3c0 2023-08-11T12:27:05.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.086+0000 7f4599d9b700 1 --2- 172.21.15.8:0/2377309982 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f74faee3c0 0x55f74faf07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:05.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.087+0000 7f4599d9b700 1 --2- 172.21.15.8:0/2377309982 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f74faee3c0 0x55f74faf07e0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa93f32aa4371e99 server_cookie=abc4e63968bcb681 in_seq=0 out_seq=0 2023-08-11T12:27:05.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.087+0000 7f457d7fa700 10 client.16152 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:27:05.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.087+0000 7f457d7fa700 1 -- 172.21.15.8:0/2377309982 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55f74faa34e0 con 0x55f74faee3c0 2023-08-11T12:27:05.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.088+0000 7f457d7fa700 10 client.16152 handle_command_reply: tid=0 2023-08-11T12:27:05.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.088+0000 7f45af964b80 1 client.16152 shutdown 2023-08-11T12:27:05.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.088+0000 7f45af964b80 1 -- 172.21.15.8:0/2377309982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f74fada310 msgr2=0x55f74faddec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:27:05.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.088+0000 7f45af964b80 1 --2- 172.21.15.8:0/2377309982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f74fada310 0x55f74faddec0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f45840046e0 tx=0x7f4584004050 comp rx=0 tx=0).stop 2023-08-11T12:27:05.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.089+0000 7f45af964b80 1 -- 172.21.15.8:0/2377309982 shutdown_connections 2023-08-11T12:27:05.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.089+0000 7f45af964b80 1 --2- 172.21.15.8:0/2377309982 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f74faee3c0 0x55f74faf07e0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.089+0000 7f45af964b80 1 --2- 172.21.15.8:0/2377309982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f74fad4e20 0x55f74fae0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.089+0000 7f45af964b80 1 --2- 172.21.15.8:0/2377309982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f74fadac30 0x55f74fade520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.089+0000 7f45af964b80 1 --2- 172.21.15.8:0/2377309982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f74fada310 0x55f74faddec0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.089+0000 7f45af964b80 1 -- 172.21.15.8:0/2377309982 >> 172.21.15.8:0/2377309982 conn(0x55f74fa01950 msgr2=0x55f74fac9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:27:05.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.089+0000 7f457d7fa700 0 client.16152 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:27:05.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.089+0000 7f45af964b80 1 -- 172.21.15.8:0/2377309982 shutdown_connections 2023-08-11T12:27:05.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.089+0000 7f45af964b80 1 -- 172.21.15.8:0/2377309982 wait complete. 2023-08-11T12:27:05.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.089+0000 7f45af964b80 20 client.16152 trim_cache size 0 max 16384 2023-08-11T12:27:05.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.112+0000 7f45af964b80 1 Processor -- start 2023-08-11T12:27:05.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.112+0000 7f45af964b80 1 -- start start 2023-08-11T12:27:05.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.112+0000 7f45af964b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f74fad4e20 0x55f74fad48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:05.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.112+0000 7f45af964b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f74fada310 0x55f74fae5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:05.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.112+0000 7f45af964b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f74fadac30 0x55f74fad8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:05.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.112+0000 7f45af964b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74faea4b0 con 0x55f74fadac30 2023-08-11T12:27:05.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.112+0000 7f45af964b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74fad0c30 con 0x55f74fada310 2023-08-11T12:27:05.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.112+0000 7f45af964b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74fada940 con 0x55f74fad4e20 2023-08-11T12:27:05.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.113+0000 7f4599d9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f74fad4e20 0x55f74fad48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:05.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.113+0000 7f4599d9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f74fad4e20 0x55f74fad48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:56312/0 (socket says 172.21.15.8:56312) 2023-08-11T12:27:05.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.113+0000 7f4599d9b700 1 -- 172.21.15.8:0/2453833142 learned_addr learned my addr 172.21.15.8:0/2453833142 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:27:05.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.113+0000 7f459959a700 1 --2- 172.21.15.8:0/2453833142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f74fada310 0x55f74fae5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:05.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.113+0000 7f459a59c700 1 --2- 172.21.15.8:0/2453833142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f74fadac30 0x55f74fad8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:05.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.113+0000 7f4599d9b700 1 -- 172.21.15.8:0/2453833142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f74fada310 msgr2=0x55f74fae5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:27:05.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.113+0000 7f4599d9b700 1 --2- 172.21.15.8:0/2453833142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f74fada310 0x55f74fae5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.113+0000 7f4599d9b700 1 -- 172.21.15.8:0/2453833142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f74fadac30 msgr2=0x55f74fad8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:27:05.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.113+0000 7f4599d9b700 1 --2- 172.21.15.8:0/2453833142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f74fadac30 0x55f74fad8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.113+0000 7f4599d9b700 1 -- 172.21.15.8:0/2453833142 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f74f83bc60 con 0x55f74fad4e20 2023-08-11T12:27:05.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.113+0000 7f459959a700 1 --2- 172.21.15.8:0/2453833142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f74fada310 0x55f74fae5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:27:05.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.114+0000 7f4599d9b700 1 --2- 172.21.15.8:0/2453833142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f74fad4e20 0x55f74fad48e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4590098680 tx=0x7f4590010cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1d6463ecde5f2f1 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:27:05.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.114+0000 7f4588ff9700 1 -- 172.21.15.8:0/2453833142 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45900a0790 con 0x55f74fad4e20 2023-08-11T12:27:05.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.114+0000 7f4588ff9700 1 -- 172.21.15.8:0/2453833142 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4590014050 con 0x55f74fad4e20 2023-08-11T12:27:05.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.114+0000 7f4588ff9700 1 -- 172.21.15.8:0/2453833142 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45900cb190 con 0x55f74fad4e20 2023-08-11T12:27:05.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.115+0000 7f45af964b80 1 -- 172.21.15.8:0/2453833142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f74fad4e20 msgr2=0x55f74fad48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:27:05.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.115+0000 7f45af964b80 1 --2- 172.21.15.8:0/2453833142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f74fad4e20 0x55f74fad48e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4590098680 tx=0x7f4590010cd0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.115+0000 7f45af964b80 1 -- 172.21.15.8:0/2453833142 shutdown_connections 2023-08-11T12:27:05.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.115+0000 7f45af964b80 1 --2- 172.21.15.8:0/2453833142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f74fad4e20 0x55f74fad48e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.115+0000 7f45af964b80 1 --2- 172.21.15.8:0/2453833142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f74fadac30 0x55f74fad8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.115+0000 7f45af964b80 1 --2- 172.21.15.8:0/2453833142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f74fada310 0x55f74fae5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.115+0000 7f45af964b80 1 -- 172.21.15.8:0/2453833142 >> 172.21.15.8:0/2453833142 conn(0x55f74fa01950 msgr2=0x55f74faea820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:27:05.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.115+0000 7f45af964b80 1 -- 172.21.15.8:0/2453833142 shutdown_connections 2023-08-11T12:27:05.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.115+0000 7f45af964b80 1 -- 172.21.15.8:0/2453833142 wait complete. 2023-08-11T12:27:05.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.116+0000 7f45af964b80 1 -- start start 2023-08-11T12:27:05.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.116+0000 7f45af964b80 1 Processor -- start 2023-08-11T12:27:05.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.116+0000 7f45af964b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f74fad4e20 0x55f74fae52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:05.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.116+0000 7f45af964b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f74fada310 0x55f74fae35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:05.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.116+0000 7f45af964b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f74fadac30 0x55f74fae3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:05.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.116+0000 7f45af964b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74fae4070 con 0x55f74fadac30 2023-08-11T12:27:05.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.116+0000 7f45af964b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74fae41b0 con 0x55f74fada310 2023-08-11T12:27:05.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.116+0000 7f45af964b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74fae4340 con 0x55f74fad4e20 2023-08-11T12:27:05.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.116+0000 7f45af964b80 10 client.0 _ll_register_callbacks cb 0x7f4590094d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:27:05.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.117+0000 7f459959a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f74fada310 0x55f74fae35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:05.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.117+0000 7f459959a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f74fada310 0x55f74fae35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:53324/0 (socket says 172.21.15.8:53324) 2023-08-11T12:27:05.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.117+0000 7f459959a700 1 -- 172.21.15.8:0/2877904666 learned_addr learned my addr 172.21.15.8:0/2877904666 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:27:05.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.117+0000 7f4599d9b700 1 --2- 172.21.15.8:0/2877904666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f74fad4e20 0x55f74fae52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:05.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.117+0000 7f459a59c700 1 --2- 172.21.15.8:0/2877904666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f74fadac30 0x55f74fae3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:05.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.117+0000 7f459959a700 1 -- 172.21.15.8:0/2877904666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f74fad4e20 msgr2=0x55f74fae52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:27:05.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.117+0000 7f459959a700 1 --2- 172.21.15.8:0/2877904666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f74fad4e20 0x55f74fae52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.117+0000 7f459959a700 1 -- 172.21.15.8:0/2877904666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f74fadac30 msgr2=0x55f74fae3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:27:05.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.117+0000 7f459959a700 1 --2- 172.21.15.8:0/2877904666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f74fadac30 0x55f74fae3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.117+0000 7f459959a700 1 -- 172.21.15.8:0/2877904666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f74f852de0 con 0x55f74fada310 2023-08-11T12:27:05.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.117+0000 7f459959a700 1 --2- 172.21.15.8:0/2877904666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f74fada310 0x55f74fae35b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4584011790 tx=0x7f4584009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0a26e8bad891fca server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:27:05.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.117+0000 7f457d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:27:05.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.118+0000 7f457d7fa700 1 -- 172.21.15.8:0/2877904666 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4584011840 con 0x55f74fada310 2023-08-11T12:27:05.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.118+0000 7f45af964b80 1 -- 172.21.15.8:0/2877904666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4584004510 con 0x55f74fada310 2023-08-11T12:27:05.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.118+0000 7f457d7fa700 1 -- 172.21.15.8:0/2877904666 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f4584000e40 con 0x55f74fada310 2023-08-11T12:27:05.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.118+0000 7f457d7fa700 1 -- 172.21.15.8:0/2877904666 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45840040c0 con 0x55f74fada310 2023-08-11T12:27:05.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.118+0000 7f45af964b80 10 client.26201 fetch_fsmap learned FSMap version 33 2023-08-11T12:27:05.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.118+0000 7f45af964b80 1 -- 172.21.15.8:0/2877904666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7f45941a9d70 con 0x55f74fada310 2023-08-11T12:27:05.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.118+0000 7f457d7fa700 1 -- 172.21.15.8:0/2877904666 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4584004510 con 0x55f74fada310 2023-08-11T12:27:05.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.119+0000 7f457d7fa700 1 -- 172.21.15.8:0/2877904666 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 33) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f4584003c90 con 0x55f74fada310 2023-08-11T12:27:05.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.119+0000 7f45af964b80 10 client.26201 fetch_fsmap finished waiting for FSMap version 33 2023-08-11T12:27:05.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.119+0000 7f45af964b80 10 client.26201 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:27:05.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.119+0000 7f45af964b80 20 client.26201 populate_metadata read hostname 'smithi008' 2023-08-11T12:27:05.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.119+0000 7f45af964b80 1 --2- 172.21.15.8:0/2877904666 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f74fb43260 0x55f74fb45680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:05.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.119+0000 7f45af964b80 4 client.26201 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:27:05.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.119+0000 7f45af964b80 1 -- 172.21.15.8:0/2877904666 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f74fa1f820 con 0x55f74fb43260 2023-08-11T12:27:05.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.119+0000 7f4599d9b700 1 --2- 172.21.15.8:0/2877904666 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f74fb43260 0x55f74fb45680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:05.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.120+0000 7f4599d9b700 1 --2- 172.21.15.8:0/2877904666 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f74fb43260 0x55f74fb45680 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eac6e92c26d4adad server_cookie=fddbb3a6ce7439ce in_seq=0 out_seq=0 2023-08-11T12:27:05.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.120+0000 7f457d7fa700 10 client.26201 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:27:05.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.120+0000 7f457d7fa700 1 -- 172.21.15.8:0/2877904666 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55f74fa1f820 con 0x55f74fb43260 2023-08-11T12:27:05.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.120+0000 7f457d7fa700 10 client.26201 handle_command_reply: tid=0 2023-08-11T12:27:05.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.120+0000 7f45af964b80 1 client.26201 shutdown 2023-08-11T12:27:05.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.120+0000 7f45af964b80 1 -- 172.21.15.8:0/2877904666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f74fada310 msgr2=0x55f74fae35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:27:05.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.120+0000 7f45af964b80 1 --2- 172.21.15.8:0/2877904666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f74fada310 0x55f74fae35b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4584011790 tx=0x7f4584009260 comp rx=0 tx=0).stop 2023-08-11T12:27:05.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.120+0000 7f45af964b80 1 -- 172.21.15.8:0/2877904666 shutdown_connections 2023-08-11T12:27:05.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.120+0000 7f45af964b80 1 --2- 172.21.15.8:0/2877904666 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f74fb43260 0x55f74fb45680 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.120+0000 7f45af964b80 1 --2- 172.21.15.8:0/2877904666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f74fad4e20 0x55f74fae52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.120+0000 7f45af964b80 1 --2- 172.21.15.8:0/2877904666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f74fadac30 0x55f74fae3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.120+0000 7f45af964b80 1 --2- 172.21.15.8:0/2877904666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f74fada310 0x55f74fae35b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.120+0000 7f45af964b80 1 -- 172.21.15.8:0/2877904666 >> 172.21.15.8:0/2877904666 conn(0x55f74fa01950 msgr2=0x55f74fad8160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:27:05.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.120+0000 7f457d7fa700 0 client.26201 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:27:05.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.121+0000 7f45af964b80 1 -- 172.21.15.8:0/2877904666 shutdown_connections 2023-08-11T12:27:05.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.121+0000 7f45af964b80 1 -- 172.21.15.8:0/2877904666 wait complete. 2023-08-11T12:27:05.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.121+0000 7f45af964b80 20 client.26201 trim_cache size 0 max 16384 2023-08-11T12:27:05.130 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:27:05.130 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:27:05.130 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:27:05.131 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:27:05.131 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:27:05.131 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:27:05.131 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:27:05.131 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:27:05.131 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:27:05.131 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:27:05.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.121+0000 7f459bfff700 1 -- 172.21.15.8:0/2367499888 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f45800a0210 msgr2=0x7f45800a26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:27:05.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.121+0000 7f459bfff700 1 --2- 172.21.15.8:0/2367499888 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f45800a0210 0x7f45800a26d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f458c009cd0 tx=0x7f458c009c40 comp rx=0 tx=0).stop 2023-08-11T12:27:05.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.121+0000 7f459bfff700 1 -- 172.21.15.8:0/2367499888 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4594100960 msgr2=0x7f45941078b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:27:05.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.121+0000 7f459bfff700 1 --2- 172.21.15.8:0/2367499888 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4594100960 0x7f45941078b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f459000d950 tx=0x7f459000dc60 comp rx=0 tx=0).stop 2023-08-11T12:27:05.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.122+0000 7f459bfff700 1 -- 172.21.15.8:0/2367499888 shutdown_connections 2023-08-11T12:27:05.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.122+0000 7f459bfff700 1 --2- 172.21.15.8:0/2367499888 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f45800a0210 0x7f45800a26d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.122+0000 7f459bfff700 1 --2- 172.21.15.8:0/2367499888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4594106970 0x7f4594108330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.122+0000 7f459bfff700 1 --2- 172.21.15.8:0/2367499888 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4594100960 0x7f45941078b0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.122+0000 7f459bfff700 1 --2- 172.21.15.8:0/2367499888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4594101320 0x7f4594107df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:05.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.122+0000 7f459bfff700 1 -- 172.21.15.8:0/2367499888 >> 172.21.15.8:0/2367499888 conn(0x7f45940fc490 msgr2=0x7f459410bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:27:05.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.122+0000 7f459bfff700 1 -- 172.21.15.8:0/2367499888 shutdown_connections 2023-08-11T12:27:05.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:05.122+0000 7f459bfff700 1 -- 172.21.15.8:0/2367499888 wait complete. 2023-08-11T12:27:05.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:04 smithi194 ceph-mon[130905]: pgmap v77: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 1.5 MiB/s wr, 40 op/s 2023-08-11T12:27:05.144 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:04 smithi008 ceph-mon[97158]: pgmap v77: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 1.5 MiB/s wr, 40 op/s 2023-08-11T12:27:05.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:04 smithi045 ceph-mon[130284]: pgmap v77: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 1.5 MiB/s wr, 40 op/s 2023-08-11T12:27:05.147 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:27:07.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:06 smithi194 ceph-mon[130905]: pgmap v78: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 1.5 MiB/s wr, 40 op/s 2023-08-11T12:27:07.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:06 smithi045 ceph-mon[130284]: pgmap v78: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 1.5 MiB/s wr, 40 op/s 2023-08-11T12:27:07.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:06 smithi008 ceph-mon[97158]: pgmap v78: 129 pgs: 129 active+clean; 6.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 1.5 MiB/s wr, 40 op/s 2023-08-11T12:27:08.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:07 smithi194 ceph-mon[130905]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:27:08.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:07 smithi045 ceph-mon[130284]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:27:08.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:07 smithi008 ceph-mon[97158]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:27:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:08 smithi194 ceph-mon[130905]: pgmap v79: 129 pgs: 129 active+clean; 6.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 2.6 MiB/s wr, 218 op/s 2023-08-11T12:27:09.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:08 smithi045 ceph-mon[130284]: pgmap v79: 129 pgs: 129 active+clean; 6.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 2.6 MiB/s wr, 218 op/s 2023-08-11T12:27:09.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:08 smithi008 ceph-mon[97158]: pgmap v79: 129 pgs: 129 active+clean; 6.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 2.6 MiB/s wr, 218 op/s 2023-08-11T12:27:09.482 INFO:teuthology.orchestra.run.smithi008.stderr:33800000 of 50000000 tuples (67%) done (elapsed 134.17 s, remaining 64.31 s) 2023-08-11T12:27:09.686 INFO:teuthology.orchestra.run.smithi008.stderr:33900000 of 50000000 tuples (67%) done (elapsed 134.37 s, remaining 63.82 s) 2023-08-11T12:27:09.799 INFO:teuthology.orchestra.run.smithi008.stderr:34000000 of 50000000 tuples (68%) done (elapsed 134.49 s, remaining 63.29 s) 2023-08-11T12:27:09.988 INFO:teuthology.orchestra.run.smithi008.stderr:34100000 of 50000000 tuples (68%) done (elapsed 134.68 s, remaining 62.80 s) 2023-08-11T12:27:10.232 INFO:teuthology.orchestra.run.smithi008.stderr:34200000 of 50000000 tuples (68%) done (elapsed 134.92 s, remaining 62.33 s) 2023-08-11T12:27:10.409 INFO:teuthology.orchestra.run.smithi008.stderr:34300000 of 50000000 tuples (68%) done (elapsed 135.10 s, remaining 61.84 s) 2023-08-11T12:27:10.563 INFO:teuthology.orchestra.run.smithi008.stderr:34400000 of 50000000 tuples (68%) done (elapsed 135.25 s, remaining 61.33 s) 2023-08-11T12:27:10.737 INFO:teuthology.orchestra.run.smithi008.stderr:34500000 of 50000000 tuples (69%) done (elapsed 135.42 s, remaining 60.84 s) 2023-08-11T12:27:11.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:10 smithi008 ceph-mon[97158]: pgmap v80: 129 pgs: 129 active+clean; 6.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 2.6 MiB/s wr, 212 op/s 2023-08-11T12:27:11.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:10 smithi194 ceph-mon[130905]: pgmap v80: 129 pgs: 129 active+clean; 6.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 2.6 MiB/s wr, 212 op/s 2023-08-11T12:27:11.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:10 smithi045 ceph-mon[130284]: pgmap v80: 129 pgs: 129 active+clean; 6.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 2.6 MiB/s wr, 212 op/s 2023-08-11T12:27:11.354 INFO:teuthology.orchestra.run.smithi008.stderr:34600000 of 50000000 tuples (69%) done (elapsed 136.04 s, remaining 60.55 s) 2023-08-11T12:27:11.669 INFO:teuthology.orchestra.run.smithi008.stderr:34700000 of 50000000 tuples (69%) done (elapsed 136.36 s, remaining 60.12 s) 2023-08-11T12:27:11.872 INFO:teuthology.orchestra.run.smithi008.stderr:34800000 of 50000000 tuples (69%) done (elapsed 136.56 s, remaining 59.65 s) 2023-08-11T12:27:12.106 INFO:teuthology.orchestra.run.smithi008.stderr:34900000 of 50000000 tuples (69%) done (elapsed 136.79 s, remaining 59.19 s) 2023-08-11T12:27:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:35000000 of 50000000 tuples (70%) done (elapsed 136.97 s, remaining 58.70 s) 2023-08-11T12:27:12.519 INFO:teuthology.orchestra.run.smithi008.stderr:35100000 of 50000000 tuples (70%) done (elapsed 137.21 s, remaining 58.24 s) 2023-08-11T12:27:12.637 INFO:teuthology.orchestra.run.smithi008.stderr:35200000 of 50000000 tuples (70%) done (elapsed 137.32 s, remaining 57.74 s) 2023-08-11T12:27:12.869 INFO:teuthology.orchestra.run.smithi008.stderr:35300000 of 50000000 tuples (70%) done (elapsed 137.56 s, remaining 57.28 s) 2023-08-11T12:27:13.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:12 smithi008 ceph-mon[97158]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:27:13.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:12 smithi008 ceph-mon[97158]: pgmap v81: 129 pgs: 129 active+clean; 6.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 12 MiB/s wr, 330 op/s 2023-08-11T12:27:13.077 INFO:teuthology.orchestra.run.smithi008.stderr:35400000 of 50000000 tuples (70%) done (elapsed 137.76 s, remaining 56.82 s) 2023-08-11T12:27:13.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:12 smithi194 ceph-mon[130905]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:27:13.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:12 smithi194 ceph-mon[130905]: pgmap v81: 129 pgs: 129 active+clean; 6.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 12 MiB/s wr, 330 op/s 2023-08-11T12:27:13.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:12 smithi045 ceph-mon[130284]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:27:13.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:12 smithi045 ceph-mon[130284]: pgmap v81: 129 pgs: 129 active+clean; 6.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 12 MiB/s wr, 330 op/s 2023-08-11T12:27:13.213 INFO:teuthology.orchestra.run.smithi008.stderr:35500000 of 50000000 tuples (71%) done (elapsed 137.90 s, remaining 56.33 s) 2023-08-11T12:27:13.460 INFO:teuthology.orchestra.run.smithi008.stderr:35600000 of 50000000 tuples (71%) done (elapsed 138.15 s, remaining 55.88 s) 2023-08-11T12:27:13.643 INFO:teuthology.orchestra.run.smithi008.stderr:35700000 of 50000000 tuples (71%) done (elapsed 138.33 s, remaining 55.41 s) 2023-08-11T12:27:13.812 INFO:teuthology.orchestra.run.smithi008.stderr:35800000 of 50000000 tuples (71%) done (elapsed 138.50 s, remaining 54.94 s) 2023-08-11T12:27:13.884 INFO:teuthology.orchestra.run.smithi008.stderr:PQputline failed 2023-08-11T12:27:13.891 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-11T12:27:13.891 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/task/exec.py", line 66, in task remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi008 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 500 -i'" 2023-08-11T12:27:14.014 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=131e6996218e42dbadd9f9c0b2bcd491 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/task/exec.py", line 66, in task remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi008 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 500 -i'" 2023-08-11T12:27:14.017 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2023-08-11T12:27:14.027 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi008.front.sepia.ceph.com 2023-08-11T12:27:14.041 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2023-08-11T12:27:14.051 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2023-08-11T12:27:14.052 INFO:teuthology.task.exec:Executing custom commands... 2023-08-11T12:27:14.052 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi008.front.sepia.ceph.com 2023-08-11T12:27:14.052 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2023-08-11T12:27:14.162 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2023-08-11T12:27:15.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:14 smithi194 ceph-mon[130905]: pgmap v82: 129 pgs: 129 active+clean; 6.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 11 MiB/s wr, 296 op/s 2023-08-11T12:27:15.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:14 smithi045 ceph-mon[130284]: pgmap v82: 129 pgs: 129 active+clean; 6.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 11 MiB/s wr, 296 op/s 2023-08-11T12:27:15.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:14 smithi008 ceph-mon[97158]: pgmap v82: 129 pgs: 129 active+clean; 6.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 11 MiB/s wr, 296 op/s 2023-08-11T12:27:17.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:16 smithi194 ceph-mon[130905]: pgmap v83: 129 pgs: 129 active+clean; 6.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 11 MiB/s wr, 296 op/s 2023-08-11T12:27:17.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:16 smithi045 ceph-mon[130284]: pgmap v83: 129 pgs: 129 active+clean; 6.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 11 MiB/s wr, 296 op/s 2023-08-11T12:27:17.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:16 smithi008 ceph-mon[97158]: pgmap v83: 129 pgs: 129 active+clean; 6.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 11 MiB/s wr, 296 op/s 2023-08-11T12:27:19.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:18 smithi194 ceph-mon[130905]: pgmap v84: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 44 MiB/s wr, 425 op/s 2023-08-11T12:27:19.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:18 smithi045 ceph-mon[130284]: pgmap v84: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 44 MiB/s wr, 425 op/s 2023-08-11T12:27:19.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:18 smithi008 ceph-mon[97158]: pgmap v84: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 44 MiB/s wr, 425 op/s 2023-08-11T12:27:21.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:20 smithi008 ceph-mon[97158]: pgmap v85: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 43 MiB/s wr, 247 op/s 2023-08-11T12:27:21.145 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:20 smithi194 ceph-mon[130905]: pgmap v85: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 43 MiB/s wr, 247 op/s 2023-08-11T12:27:21.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:20 smithi045 ceph-mon[130284]: pgmap v85: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 43 MiB/s wr, 247 op/s 2023-08-11T12:27:23.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:22 smithi194 ceph-mon[130905]: pgmap v86: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 43 MiB/s wr, 617 op/s 2023-08-11T12:27:23.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:22 smithi045 ceph-mon[130284]: pgmap v86: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 43 MiB/s wr, 617 op/s 2023-08-11T12:27:23.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:22 smithi008 ceph-mon[97158]: pgmap v86: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 43 MiB/s wr, 617 op/s 2023-08-11T12:27:25.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:24 smithi194 ceph-mon[130905]: pgmap v87: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 33 MiB/s wr, 499 op/s 2023-08-11T12:27:25.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:24 smithi045 ceph-mon[130284]: pgmap v87: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 33 MiB/s wr, 499 op/s 2023-08-11T12:27:25.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:24 smithi008 ceph-mon[97158]: pgmap v87: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 33 MiB/s wr, 499 op/s 2023-08-11T12:27:27.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:26 smithi194 ceph-mon[130905]: pgmap v88: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 33 MiB/s wr, 499 op/s 2023-08-11T12:27:27.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:26 smithi045 ceph-mon[130284]: pgmap v88: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 33 MiB/s wr, 499 op/s 2023-08-11T12:27:27.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:26 smithi008 ceph-mon[97158]: pgmap v88: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 33 MiB/s wr, 499 op/s 2023-08-11T12:27:29.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:28 smithi194 ceph-mon[130905]: pgmap v89: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 33 MiB/s wr, 633 op/s 2023-08-11T12:27:29.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:28 smithi045 ceph-mon[130284]: pgmap v89: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 33 MiB/s wr, 633 op/s 2023-08-11T12:27:29.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:28 smithi008 ceph-mon[97158]: pgmap v89: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 33 MiB/s wr, 633 op/s 2023-08-11T12:27:31.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:30 smithi008 ceph-mon[97158]: pgmap v90: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 17 KiB/s wr, 504 op/s 2023-08-11T12:27:31.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:30 smithi194 ceph-mon[130905]: pgmap v90: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 17 KiB/s wr, 504 op/s 2023-08-11T12:27:31.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:30 smithi045 ceph-mon[130284]: pgmap v90: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 17 KiB/s wr, 504 op/s 2023-08-11T12:27:33.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:32 smithi194 ceph-mon[130905]: pgmap v91: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 557 KiB/s wr, 531 op/s 2023-08-11T12:27:33.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:32 smithi045 ceph-mon[130284]: pgmap v91: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 557 KiB/s wr, 531 op/s 2023-08-11T12:27:33.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:32 smithi008 ceph-mon[97158]: pgmap v91: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 557 KiB/s wr, 531 op/s 2023-08-11T12:27:34.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:33 smithi194 ceph-mon[130905]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:27:34.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:33 smithi045 ceph-mon[130284]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:27:34.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:33 smithi008 ceph-mon[97158]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:27:35.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:34 smithi194 ceph-mon[130905]: pgmap v92: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 549 KiB/s wr, 160 op/s 2023-08-11T12:27:35.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:34 smithi045 ceph-mon[130284]: pgmap v92: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 549 KiB/s wr, 160 op/s 2023-08-11T12:27:35.148 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:27:35.218 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:34 smithi008 ceph-mon[97158]: pgmap v92: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 549 KiB/s wr, 160 op/s 2023-08-11T12:27:35.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.372+0000 7efd8ffff700 1 -- 172.21.15.8:0/1960699121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd900ff860 msgr2=0x7efd900ffce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:27:35.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.372+0000 7efd8ffff700 1 --2- 172.21.15.8:0/1960699121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd900ff860 0x7efd900ffce0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efd840099c0 tx=0x7efd84009cd0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.372+0000 7efd8ffff700 1 -- 172.21.15.8:0/1960699121 shutdown_connections 2023-08-11T12:27:35.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.372+0000 7efd8ffff700 1 --2- 172.21.15.8:0/1960699121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd90100220 0x7efd9010c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.372+0000 7efd8ffff700 1 --2- 172.21.15.8:0/1960699121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd90105650 0x7efd90105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.372+0000 7efd8ffff700 1 --2- 172.21.15.8:0/1960699121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd900ff860 0x7efd900ffce0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.372+0000 7efd8ffff700 1 -- 172.21.15.8:0/1960699121 >> 172.21.15.8:0/1960699121 conn(0x7efd90075010 msgr2=0x7efd90075420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:27:35.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.372+0000 7efd8ffff700 1 -- 172.21.15.8:0/1960699121 shutdown_connections 2023-08-11T12:27:35.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.372+0000 7efd8ffff700 1 -- 172.21.15.8:0/1960699121 wait complete. 2023-08-11T12:27:35.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.373+0000 7efd8ffff700 1 Processor -- start 2023-08-11T12:27:35.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.373+0000 7efd8ffff700 1 -- start start 2023-08-11T12:27:35.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.374+0000 7efd8ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd900ff860 0x7efd9010cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:35.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.374+0000 7efd8ffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd90100220 0x7efd9010d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:35.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.374+0000 7efd8ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd90105650 0x7efd901a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:35.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.374+0000 7efd8ffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9010dbc0 con 0x7efd90105650 2023-08-11T12:27:35.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.374+0000 7efd8ffff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd901a4f70 con 0x7efd900ff860 2023-08-11T12:27:35.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.374+0000 7efd8ffff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd901a50b0 con 0x7efd90100220 2023-08-11T12:27:35.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.374+0000 7efd8effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd900ff860 0x7efd9010cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:35.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.374+0000 7efd8effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd900ff860 0x7efd9010cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:36904/0 (socket says 172.21.15.8:36904) 2023-08-11T12:27:35.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.374+0000 7efd8effd700 1 -- 172.21.15.8:0/1158594906 learned_addr learned my addr 172.21.15.8:0/1158594906 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:27:35.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.374+0000 7efd8f7fe700 1 --2- 172.21.15.8:0/1158594906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd90105650 0x7efd901a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:35.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.374+0000 7efd8e7fc700 1 --2- 172.21.15.8:0/1158594906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd90100220 0x7efd9010d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:35.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.374+0000 7efd8effd700 1 -- 172.21.15.8:0/1158594906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd90100220 msgr2=0x7efd9010d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:27:35.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.374+0000 7efd8effd700 1 --2- 172.21.15.8:0/1158594906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd90100220 0x7efd9010d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.374+0000 7efd8effd700 1 -- 172.21.15.8:0/1158594906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd90105650 msgr2=0x7efd901a4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:27:35.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.374+0000 7efd8effd700 1 --2- 172.21.15.8:0/1158594906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd90105650 0x7efd901a4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.374+0000 7efd8effd700 1 -- 172.21.15.8:0/1158594906 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd840095f0 con 0x7efd900ff860 2023-08-11T12:27:35.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.375+0000 7efd8effd700 1 --2- 172.21.15.8:0/1158594906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd900ff860 0x7efd9010cde0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efd8000e9d0 tx=0x7efd8000ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:27:35.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.375+0000 7efd77fff700 1 -- 172.21.15.8:0/1158594906 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd80009790 con 0x7efd900ff860 2023-08-11T12:27:35.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.375+0000 7efd77fff700 1 -- 172.21.15.8:0/1158594906 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd8000ee70 con 0x7efd900ff860 2023-08-11T12:27:35.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.375+0000 7efd77fff700 1 -- 172.21.15.8:0/1158594906 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd80010ea0 con 0x7efd900ff860 2023-08-11T12:27:35.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.375+0000 7efd8ffff700 1 -- 172.21.15.8:0/1158594906 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd901a5360 con 0x7efd900ff860 2023-08-11T12:27:35.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.375+0000 7efd8ffff700 1 -- 172.21.15.8:0/1158594906 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd901a57f0 con 0x7efd900ff860 2023-08-11T12:27:35.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.378+0000 7efd77fff700 1 -- 172.21.15.8:0/1158594906 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7efd8000cbd0 con 0x7efd900ff860 2023-08-11T12:27:35.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.379+0000 7efda8caeb80 1 Processor -- start 2023-08-11T12:27:35.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.379+0000 7efda8caeb80 1 -- start start 2023-08-11T12:27:35.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.380+0000 7efda8caeb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5617dff7f510 0x5617dff7f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:35.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.380+0000 7efda8caeb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617dff7fe30 0x5617dff798e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:35.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.380+0000 7efda8caeb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617dff79e20 0x5617dff7a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:35.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.380+0000 7efda8caeb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617dfed2630 con 0x5617dff7f510 2023-08-11T12:27:35.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.380+0000 7efda8caeb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617dfecff50 con 0x5617dff79e20 2023-08-11T12:27:35.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.380+0000 7efda8caeb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617dfecb840 con 0x5617dff7fe30 2023-08-11T12:27:35.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.380+0000 7efd77fff700 1 --2- 172.21.15.8:0/1158594906 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7efd780a00c0 0x7efd780a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:35.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.380+0000 7efd8e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617dff79e20 0x5617dff7a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:35.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.380+0000 7efd8f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5617dff7f510 0x5617dff7f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:35.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.380+0000 7efd8e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617dff79e20 0x5617dff7a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:36910/0 (socket says 172.21.15.8:36910) 2023-08-11T12:27:35.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.380+0000 7efd8f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5617dff7f510 0x5617dff7f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37962/0 (socket says 172.21.15.8:37962) 2023-08-11T12:27:35.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.380+0000 7efd8e7fc700 1 -- 172.21.15.8:0/3160963903 learned_addr learned my addr 172.21.15.8:0/3160963903 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:27:35.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.380+0000 7efd77fff700 1 -- 172.21.15.8:0/1158594906 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7efd80014070 con 0x7efd900ff860 2023-08-11T12:27:35.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.380+0000 7efd8effd700 1 --2- 172.21.15.8:0/3160963903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617dff7fe30 0x5617dff798e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:35.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.381+0000 7efd8e7fc700 1 -- 172.21.15.8:0/3160963903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617dff7fe30 msgr2=0x5617dff798e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:27:35.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.381+0000 7efd8e7fc700 1 --2- 172.21.15.8:0/3160963903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617dff7fe30 0x5617dff798e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.381+0000 7efd8e7fc700 1 -- 172.21.15.8:0/3160963903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5617dff7f510 msgr2=0x5617dff7f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:27:35.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.381+0000 7efd8e7fc700 1 --2- 172.21.15.8:0/3160963903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5617dff7f510 0x5617dff7f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.381+0000 7efd8e7fc700 1 -- 172.21.15.8:0/3160963903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5617dfd4b630 con 0x5617dff79e20 2023-08-11T12:27:35.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.381+0000 7efd8f7fe700 1 --2- 172.21.15.8:0/3160963903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5617dff7f510 0x5617dff7f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:27:35.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.381+0000 7efd8f7fe700 1 --2- 172.21.15.8:0/1158594906 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7efd780a00c0 0x7efd780a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:35.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.381+0000 7efd8e7fc700 1 --2- 172.21.15.8:0/3160963903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617dff79e20 0x5617dff7a280 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efd840058e0 tx=0x7efd84005f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef09369b4f9f22c7 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:27:35.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.381+0000 7efd757fa700 1 -- 172.21.15.8:0/3160963903 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8400ba50 con 0x5617dff79e20 2023-08-11T12:27:35.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.381+0000 7efd757fa700 1 -- 172.21.15.8:0/3160963903 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd8401e040 con 0x5617dff79e20 2023-08-11T12:27:35.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.381+0000 7efd757fa700 1 -- 172.21.15.8:0/3160963903 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd840223f0 con 0x5617dff79e20 2023-08-11T12:27:35.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.382+0000 7efda8caeb80 1 -- 172.21.15.8:0/3160963903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617dff79e20 msgr2=0x5617dff7a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:27:35.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.382+0000 7efd8f7fe700 1 --2- 172.21.15.8:0/1158594906 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7efd780a00c0 0x7efd780a2580 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efd88009ec0 tx=0x7efd88009040 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:27:35.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.382+0000 7efda8caeb80 1 --2- 172.21.15.8:0/3160963903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617dff79e20 0x5617dff7a280 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efd840058e0 tx=0x7efd84005f00 comp rx=0 tx=0).stop 2023-08-11T12:27:35.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.382+0000 7efda8caeb80 1 -- 172.21.15.8:0/3160963903 shutdown_connections 2023-08-11T12:27:35.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.382+0000 7efda8caeb80 1 --2- 172.21.15.8:0/3160963903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617dff79e20 0x5617dff7a280 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.382+0000 7efda8caeb80 1 --2- 172.21.15.8:0/3160963903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5617dff7f510 0x5617dff7f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.382+0000 7efda8caeb80 1 --2- 172.21.15.8:0/3160963903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617dff7fe30 0x5617dff798e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.382+0000 7efda8caeb80 1 -- 172.21.15.8:0/3160963903 >> 172.21.15.8:0/3160963903 conn(0x5617dfea6950 msgr2=0x5617dff744e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:27:35.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.382+0000 7efda8caeb80 1 -- 172.21.15.8:0/3160963903 shutdown_connections 2023-08-11T12:27:35.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.382+0000 7efda8caeb80 1 -- 172.21.15.8:0/3160963903 wait complete. 2023-08-11T12:27:35.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.383+0000 7efda8caeb80 1 -- start start 2023-08-11T12:27:35.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.383+0000 7efda8caeb80 1 Processor -- start 2023-08-11T12:27:35.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.383+0000 7efda8caeb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617dff79e20 0x5617dff85ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:35.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.383+0000 7efda8caeb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617dff7f510 0x5617dff82fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:35.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.383+0000 7efda8caeb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5617dff7fe30 0x5617dff83500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:35.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.383+0000 7efda8caeb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617dfe69ac0 con 0x5617dff7fe30 2023-08-11T12:27:35.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.383+0000 7efda8caeb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617dfe697c0 con 0x5617dff79e20 2023-08-11T12:27:35.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.383+0000 7efda8caeb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617dfd4d920 con 0x5617dff7f510 2023-08-11T12:27:35.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.383+0000 7efda8caeb80 10 client.0 _ll_register_callbacks cb 0x5617dfe6cab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:27:35.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.384+0000 7efd8effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617dff79e20 0x5617dff85ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:35.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.384+0000 7efd8e7fc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617dff7f510 0x5617dff82fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:35.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.384+0000 7efd8effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617dff79e20 0x5617dff85ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:36922/0 (socket says 172.21.15.8:36922) 2023-08-11T12:27:35.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.384+0000 7efd8effd700 1 -- 172.21.15.8:0/753258817 learned_addr learned my addr 172.21.15.8:0/753258817 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:27:35.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.384+0000 7efd8f7fe700 1 --2- 172.21.15.8:0/753258817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5617dff7fe30 0x5617dff83500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:35.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.384+0000 7efd8effd700 1 -- 172.21.15.8:0/753258817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617dff7f510 msgr2=0x5617dff82fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:27:35.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.384+0000 7efd8effd700 1 --2- 172.21.15.8:0/753258817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617dff7f510 0x5617dff82fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.384+0000 7efd8effd700 1 -- 172.21.15.8:0/753258817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5617dff7fe30 msgr2=0x5617dff83500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:27:35.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.384+0000 7efd8effd700 1 --2- 172.21.15.8:0/753258817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5617dff7fe30 0x5617dff83500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.384+0000 7efd8effd700 1 -- 172.21.15.8:0/753258817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd90067bf0 con 0x5617dff79e20 2023-08-11T12:27:35.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.384+0000 7efd8e7fc700 1 --2- 172.21.15.8:0/753258817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617dff7f510 0x5617dff82fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:27:35.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.384+0000 7efd8f7fe700 1 --2- 172.21.15.8:0/753258817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5617dff7fe30 0x5617dff83500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:27:35.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.384+0000 7efd8effd700 1 --2- 172.21.15.8:0/753258817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617dff79e20 0x5617dff85ca0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7efd800953a0 tx=0x7efd800c9440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ff2bef5b3e4e099 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:27:35.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.384+0000 7efd72ff5700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:27:35.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.385+0000 7efd72ff5700 1 -- 172.21.15.8:0/753258817 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8009ccd0 con 0x5617dff79e20 2023-08-11T12:27:35.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.385+0000 7efd72ff5700 1 -- 172.21.15.8:0/753258817 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7efd800a0cb0 con 0x5617dff79e20 2023-08-11T12:27:35.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.385+0000 7efda8caeb80 1 -- 172.21.15.8:0/753258817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5617dff6ca90 con 0x5617dff79e20 2023-08-11T12:27:35.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.385+0000 7efd72ff5700 1 -- 172.21.15.8:0/753258817 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd800a0820 con 0x5617dff79e20 2023-08-11T12:27:35.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.385+0000 7efda8caeb80 10 client.26213 fetch_fsmap learned FSMap version 36 2023-08-11T12:27:35.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.385+0000 7efda8caeb80 1 -- 172.21.15.8:0/753258817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5617dfcf7de0 con 0x5617dff79e20 2023-08-11T12:27:35.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.385+0000 7efd72ff5700 1 -- 172.21.15.8:0/753258817 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5617dff6ca90 con 0x5617dff79e20 2023-08-11T12:27:35.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.385+0000 7efd72ff5700 1 -- 172.21.15.8:0/753258817 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 36) v1 ==== 7942+0+0 (secure 0 0 0) 0x7efd80093ab0 con 0x5617dff79e20 2023-08-11T12:27:35.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.385+0000 7efda8caeb80 10 client.26213 fetch_fsmap finished waiting for FSMap version 36 2023-08-11T12:27:35.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.385+0000 7efda8caeb80 10 client.26213 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:27:35.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.385+0000 7efda8caeb80 20 client.26213 populate_metadata read hostname 'smithi008' 2023-08-11T12:27:35.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.385+0000 7efda8caeb80 1 --2- 172.21.15.8:0/753258817 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5617dff93550 0x5617dff95970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:35.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.385+0000 7efda8caeb80 4 client.26213 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:27:35.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.385+0000 7efda8caeb80 1 -- 172.21.15.8:0/753258817 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5617dff484e0 con 0x5617dff93550 2023-08-11T12:27:35.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.386+0000 7efd8e7fc700 1 --2- 172.21.15.8:0/753258817 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5617dff93550 0x5617dff95970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:35.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.386+0000 7efd8e7fc700 1 --2- 172.21.15.8:0/753258817 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5617dff93550 0x5617dff95970 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d45ac69155dd44df server_cookie=ac13c0de596a5984 in_seq=0 out_seq=0 2023-08-11T12:27:35.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.386+0000 7efd72ff5700 10 client.26213 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:27:35.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.387+0000 7efd72ff5700 1 -- 172.21.15.8:0/753258817 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5617dff484e0 con 0x5617dff93550 2023-08-11T12:27:35.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.387+0000 7efd72ff5700 10 client.26213 handle_command_reply: tid=0 2023-08-11T12:27:35.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.387+0000 7efda8caeb80 1 client.26213 shutdown 2023-08-11T12:27:35.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.387+0000 7efda8caeb80 1 -- 172.21.15.8:0/753258817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617dff79e20 msgr2=0x5617dff85ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:27:35.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.387+0000 7efda8caeb80 1 --2- 172.21.15.8:0/753258817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617dff79e20 0x5617dff85ca0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7efd800953a0 tx=0x7efd800c9440 comp rx=0 tx=0).stop 2023-08-11T12:27:35.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.387+0000 7efda8caeb80 1 -- 172.21.15.8:0/753258817 shutdown_connections 2023-08-11T12:27:35.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.387+0000 7efda8caeb80 1 --2- 172.21.15.8:0/753258817 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5617dff93550 0x5617dff95970 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.387+0000 7efda8caeb80 1 --2- 172.21.15.8:0/753258817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5617dff7fe30 0x5617dff83500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.387+0000 7efd72ff5700 0 client.26213 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:27:35.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.387+0000 7efda8caeb80 1 --2- 172.21.15.8:0/753258817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617dff79e20 0x5617dff85ca0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.387+0000 7efda8caeb80 1 --2- 172.21.15.8:0/753258817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617dff7f510 0x5617dff82fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.387+0000 7efda8caeb80 1 -- 172.21.15.8:0/753258817 >> 172.21.15.8:0/753258817 conn(0x5617dfea6950 msgr2=0x5617dff6ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:27:35.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.388+0000 7efda8caeb80 1 -- 172.21.15.8:0/753258817 shutdown_connections 2023-08-11T12:27:35.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.388+0000 7efda8caeb80 1 -- 172.21.15.8:0/753258817 wait complete. 2023-08-11T12:27:35.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.388+0000 7efda8caeb80 20 client.26213 trim_cache size 0 max 16384 2023-08-11T12:27:35.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.405+0000 7efda8caeb80 1 Processor -- start 2023-08-11T12:27:35.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.405+0000 7efda8caeb80 1 -- start start 2023-08-11T12:27:35.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.405+0000 7efda8caeb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617dff79e20 0x5617dff798e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:35.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.405+0000 7efda8caeb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5617dff7f510 0x5617dff7e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:35.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.405+0000 7efda8caeb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617dff7fe30 0x5617dff8a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:35.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.405+0000 7efda8caeb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617dff8abe0 con 0x5617dff7f510 2023-08-11T12:27:35.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.405+0000 7efda8caeb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617dff754b0 con 0x5617dff79e20 2023-08-11T12:27:35.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.405+0000 7efda8caeb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617dff81540 con 0x5617dff7fe30 2023-08-11T12:27:35.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.406+0000 7efd8effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617dff79e20 0x5617dff798e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:35.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.406+0000 7efd8e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5617dff7f510 0x5617dff7e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:35.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.406+0000 7efd8effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617dff79e20 0x5617dff798e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:36936/0 (socket says 172.21.15.8:36936) 2023-08-11T12:27:35.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.406+0000 7efd8effd700 1 -- 172.21.15.8:0/724792833 learned_addr learned my addr 172.21.15.8:0/724792833 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:27:35.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.406+0000 7efd8f7fe700 1 --2- 172.21.15.8:0/724792833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617dff7fe30 0x5617dff8a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:35.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.406+0000 7efd8effd700 1 -- 172.21.15.8:0/724792833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617dff7fe30 msgr2=0x5617dff8a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:27:35.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.406+0000 7efd8effd700 1 --2- 172.21.15.8:0/724792833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617dff7fe30 0x5617dff8a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.406+0000 7efd8effd700 1 -- 172.21.15.8:0/724792833 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5617dff7f510 msgr2=0x5617dff7e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:27:35.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.406+0000 7efd8effd700 1 --2- 172.21.15.8:0/724792833 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5617dff7f510 0x5617dff7e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.406+0000 7efd8effd700 1 -- 172.21.15.8:0/724792833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5617dff74910 con 0x5617dff79e20 2023-08-11T12:27:35.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.406+0000 7efd8f7fe700 1 --2- 172.21.15.8:0/724792833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617dff7fe30 0x5617dff8a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:27:35.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.406+0000 7efd8e7fc700 1 --2- 172.21.15.8:0/724792833 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5617dff7f510 0x5617dff7e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:27:35.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.406+0000 7efd8effd700 1 --2- 172.21.15.8:0/724792833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617dff79e20 0x5617dff798e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7efd8000e9a0 tx=0x7efd80099020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=701bc2f99ccdc3dc server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:27:35.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.406+0000 7efd75ffb700 1 -- 172.21.15.8:0/724792833 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd800a0cb0 con 0x5617dff79e20 2023-08-11T12:27:35.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.406+0000 7efd75ffb700 1 -- 172.21.15.8:0/724792833 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd800b6e90 con 0x5617dff79e20 2023-08-11T12:27:35.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.406+0000 7efd75ffb700 1 -- 172.21.15.8:0/724792833 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd80093c50 con 0x5617dff79e20 2023-08-11T12:27:35.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.407+0000 7efda8caeb80 1 -- 172.21.15.8:0/724792833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617dff79e20 msgr2=0x5617dff798e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:27:35.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.407+0000 7efda8caeb80 1 --2- 172.21.15.8:0/724792833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617dff79e20 0x5617dff798e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7efd8000e9a0 tx=0x7efd80099020 comp rx=0 tx=0).stop 2023-08-11T12:27:35.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.407+0000 7efda8caeb80 1 -- 172.21.15.8:0/724792833 shutdown_connections 2023-08-11T12:27:35.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.407+0000 7efda8caeb80 1 --2- 172.21.15.8:0/724792833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617dff7fe30 0x5617dff8a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.407+0000 7efda8caeb80 1 --2- 172.21.15.8:0/724792833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617dff79e20 0x5617dff798e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.407+0000 7efda8caeb80 1 --2- 172.21.15.8:0/724792833 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5617dff7f510 0x5617dff7e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.407+0000 7efda8caeb80 1 -- 172.21.15.8:0/724792833 >> 172.21.15.8:0/724792833 conn(0x5617dfea6950 msgr2=0x5617dff6e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:27:35.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.407+0000 7efda8caeb80 1 -- 172.21.15.8:0/724792833 shutdown_connections 2023-08-11T12:27:35.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.407+0000 7efda8caeb80 1 -- 172.21.15.8:0/724792833 wait complete. 2023-08-11T12:27:35.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.407+0000 7efda8caeb80 1 -- start start 2023-08-11T12:27:35.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.408+0000 7efda8caeb80 1 Processor -- start 2023-08-11T12:27:35.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.408+0000 7efda8caeb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5617dff79e20 0x5617dff8a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:35.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.408+0000 7efda8caeb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617dff7f510 0x5617dff86680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:35.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.408+0000 7efda8caeb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617dff7fe30 0x5617dff86bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:35.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.408+0000 7efda8caeb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617dff87100 con 0x5617dff79e20 2023-08-11T12:27:35.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.408+0000 7efda8caeb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617dff87270 con 0x5617dff7f510 2023-08-11T12:27:35.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.408+0000 7efda8caeb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617dff87430 con 0x5617dff7fe30 2023-08-11T12:27:35.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.408+0000 7efda8caeb80 10 client.0 _ll_register_callbacks cb 0x7efd80098800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:27:35.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.408+0000 7efd8effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5617dff79e20 0x5617dff8a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:35.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.408+0000 7efd8e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617dff7f510 0x5617dff86680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:35.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.408+0000 7efd8e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617dff7f510 0x5617dff86680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:36946/0 (socket says 172.21.15.8:36946) 2023-08-11T12:27:35.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.408+0000 7efd8effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5617dff79e20 0x5617dff8a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38006/0 (socket says 172.21.15.8:38006) 2023-08-11T12:27:35.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.408+0000 7efd8e7fc700 1 -- 172.21.15.8:0/1224031277 learned_addr learned my addr 172.21.15.8:0/1224031277 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:27:35.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.409+0000 7efd8f7fe700 1 --2- 172.21.15.8:0/1224031277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617dff7fe30 0x5617dff86bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:35.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.409+0000 7efd8effd700 1 -- 172.21.15.8:0/1224031277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617dff7fe30 msgr2=0x5617dff86bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:27:35.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.409+0000 7efd8effd700 1 --2- 172.21.15.8:0/1224031277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617dff7fe30 0x5617dff86bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.409+0000 7efd8effd700 1 -- 172.21.15.8:0/1224031277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617dff7f510 msgr2=0x5617dff86680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:27:35.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.409+0000 7efd8effd700 1 --2- 172.21.15.8:0/1224031277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617dff7f510 0x5617dff86680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.409+0000 7efd8effd700 1 -- 172.21.15.8:0/1224031277 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5617dfd4b630 con 0x5617dff79e20 2023-08-11T12:27:35.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.409+0000 7efd8e7fc700 1 --2- 172.21.15.8:0/1224031277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617dff7f510 0x5617dff86680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:27:35.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.409+0000 7efd8f7fe700 1 --2- 172.21.15.8:0/1224031277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617dff7fe30 0x5617dff86bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:27:35.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.409+0000 7efd8effd700 1 --2- 172.21.15.8:0/1224031277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5617dff79e20 0x5617dff8a1f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7efd800953a0 tx=0x7efd80098b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=342f0071a2d0ee22 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:27:35.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.409+0000 7efd72ff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:27:35.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.409+0000 7efd72ff5700 1 -- 172.21.15.8:0/1224031277 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd800b82d0 con 0x5617dff79e20 2023-08-11T12:27:35.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.409+0000 7efd72ff5700 1 -- 172.21.15.8:0/1224031277 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7efd800a0cb0 con 0x5617dff79e20 2023-08-11T12:27:35.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.409+0000 7efda8caeb80 1 -- 172.21.15.8:0/1224031277 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efd8401e040 con 0x5617dff79e20 2023-08-11T12:27:35.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.410+0000 7efd72ff5700 1 -- 172.21.15.8:0/1224031277 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd800981b0 con 0x5617dff79e20 2023-08-11T12:27:35.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.410+0000 7efda8caeb80 10 client.16176 fetch_fsmap learned FSMap version 36 2023-08-11T12:27:35.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.410+0000 7efda8caeb80 1 -- 172.21.15.8:0/1224031277 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5617dfcf7de0 con 0x5617dff79e20 2023-08-11T12:27:35.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.410+0000 7efd72ff5700 1 -- 172.21.15.8:0/1224031277 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd8401e040 con 0x5617dff79e20 2023-08-11T12:27:35.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.410+0000 7efd72ff5700 1 -- 172.21.15.8:0/1224031277 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 36) v1 ==== 7942+0+0 (secure 0 0 0) 0x7efd80099830 con 0x5617dff79e20 2023-08-11T12:27:35.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.410+0000 7efda8caeb80 10 client.16176 fetch_fsmap finished waiting for FSMap version 36 2023-08-11T12:27:35.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.410+0000 7efda8caeb80 10 client.16176 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:27:35.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.410+0000 7efda8caeb80 20 client.16176 populate_metadata read hostname 'smithi008' 2023-08-11T12:27:35.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.410+0000 7efda8caeb80 1 --2- 172.21.15.8:0/1224031277 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5617dffe8090 0x5617dffea480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:27:35.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.410+0000 7efda8caeb80 4 client.16176 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:27:35.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.410+0000 7efda8caeb80 1 -- 172.21.15.8:0/1224031277 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5617dfec4820 con 0x5617dffe8090 2023-08-11T12:27:35.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.410+0000 7efd8e7fc700 1 --2- 172.21.15.8:0/1224031277 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5617dffe8090 0x5617dffea480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:27:35.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.411+0000 7efd8e7fc700 1 --2- 172.21.15.8:0/1224031277 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5617dffe8090 0x5617dffea480 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de538b08844efe7f server_cookie=f1f1b1399d91716e in_seq=0 out_seq=0 2023-08-11T12:27:35.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.411+0000 7efd72ff5700 10 client.16176 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:27:35.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.411+0000 7efd72ff5700 1 -- 172.21.15.8:0/1224031277 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5617dfec4820 con 0x5617dffe8090 2023-08-11T12:27:35.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.411+0000 7efd72ff5700 10 client.16176 handle_command_reply: tid=0 2023-08-11T12:27:35.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.411+0000 7efda8caeb80 1 client.16176 shutdown 2023-08-11T12:27:35.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.411+0000 7efda8caeb80 1 -- 172.21.15.8:0/1224031277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5617dff79e20 msgr2=0x5617dff8a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:27:35.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.411+0000 7efda8caeb80 1 --2- 172.21.15.8:0/1224031277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5617dff79e20 0x5617dff8a1f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7efd800953a0 tx=0x7efd80098b10 comp rx=0 tx=0).stop 2023-08-11T12:27:35.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.411+0000 7efda8caeb80 1 -- 172.21.15.8:0/1224031277 shutdown_connections 2023-08-11T12:27:35.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.411+0000 7efda8caeb80 1 --2- 172.21.15.8:0/1224031277 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5617dffe8090 0x5617dffea480 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.411+0000 7efda8caeb80 1 --2- 172.21.15.8:0/1224031277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617dff7fe30 0x5617dff86bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.411+0000 7efda8caeb80 1 --2- 172.21.15.8:0/1224031277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5617dff79e20 0x5617dff8a1f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.411+0000 7efda8caeb80 1 --2- 172.21.15.8:0/1224031277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617dff7f510 0x5617dff86680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.411+0000 7efd72ff5700 0 client.16176 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:27:35.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.411+0000 7efda8caeb80 1 -- 172.21.15.8:0/1224031277 >> 172.21.15.8:0/1224031277 conn(0x5617dfea6950 msgr2=0x5617dff6e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:27:35.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.411+0000 7efda8caeb80 1 -- 172.21.15.8:0/1224031277 shutdown_connections 2023-08-11T12:27:35.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.411+0000 7efda8caeb80 1 -- 172.21.15.8:0/1224031277 wait complete. 2023-08-11T12:27:35.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.412+0000 7efda8caeb80 20 client.16176 trim_cache size 0 max 16384 2023-08-11T12:27:35.441 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:27:35.441 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:27:35.441 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:27:35.442 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:27:35.442 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:27:35.442 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:27:35.442 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:27:35.442 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:27:35.443 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:27:35.443 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:27:35.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.412+0000 7efd8ffff700 1 -- 172.21.15.8:0/1158594906 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7efd780a00c0 msgr2=0x7efd780a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:27:35.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.412+0000 7efd8ffff700 1 --2- 172.21.15.8:0/1158594906 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7efd780a00c0 0x7efd780a2580 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efd88009ec0 tx=0x7efd88009040 comp rx=0 tx=0).stop 2023-08-11T12:27:35.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.412+0000 7efd8ffff700 1 -- 172.21.15.8:0/1158594906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd900ff860 msgr2=0x7efd9010cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:27:35.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.412+0000 7efd8ffff700 1 --2- 172.21.15.8:0/1158594906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd900ff860 0x7efd9010cde0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efd8000e9d0 tx=0x7efd8000ece0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.412+0000 7efd8ffff700 1 -- 172.21.15.8:0/1158594906 shutdown_connections 2023-08-11T12:27:35.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.412+0000 7efd8ffff700 1 --2- 172.21.15.8:0/1158594906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd90105650 0x7efd901a4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.412+0000 7efd8ffff700 1 --2- 172.21.15.8:0/1158594906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd900ff860 0x7efd9010cde0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.412+0000 7efd8ffff700 1 --2- 172.21.15.8:0/1158594906 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7efd780a00c0 0x7efd780a2580 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.412+0000 7efd8ffff700 1 --2- 172.21.15.8:0/1158594906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd90100220 0x7efd9010d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:27:35.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.412+0000 7efd8ffff700 1 -- 172.21.15.8:0/1158594906 >> 172.21.15.8:0/1158594906 conn(0x7efd90075010 msgr2=0x7efd900fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:27:35.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.412+0000 7efd8ffff700 1 -- 172.21.15.8:0/1158594906 shutdown_connections 2023-08-11T12:27:35.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:27:35.412+0000 7efd8ffff700 1 -- 172.21.15.8:0/1158594906 wait complete. 2023-08-11T12:27:35.447 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:27:37.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:36 smithi194 ceph-mon[130905]: pgmap v93: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 549 KiB/s wr, 160 op/s 2023-08-11T12:27:37.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:36 smithi045 ceph-mon[130284]: pgmap v93: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 549 KiB/s wr, 160 op/s 2023-08-11T12:27:37.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:36 smithi008 ceph-mon[97158]: pgmap v93: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 549 KiB/s wr, 160 op/s 2023-08-11T12:27:39.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:38 smithi045 ceph-mon[130284]: pgmap v94: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 670 KiB/s wr, 177 op/s 2023-08-11T12:27:39.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:38 smithi045 ceph-mon[130284]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:27:39.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:38 smithi008 ceph-mon[97158]: pgmap v94: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 670 KiB/s wr, 177 op/s 2023-08-11T12:27:39.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:38 smithi008 ceph-mon[97158]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:27:39.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:38 smithi194 ceph-mon[130905]: pgmap v94: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 670 KiB/s wr, 177 op/s 2023-08-11T12:27:39.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:38 smithi194 ceph-mon[130905]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:27:41.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:40 smithi008 ceph-mon[97158]: pgmap v95: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 660 KiB/s wr, 43 op/s 2023-08-11T12:27:41.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:40 smithi194 ceph-mon[130905]: pgmap v95: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 660 KiB/s wr, 43 op/s 2023-08-11T12:27:41.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:40 smithi045 ceph-mon[130284]: pgmap v95: 129 pgs: 129 active+clean; 7.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 660 KiB/s wr, 43 op/s 2023-08-11T12:27:43.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:42 smithi194 ceph-mon[130905]: pgmap v96: 129 pgs: 129 active+clean; 7.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 26 MiB/s wr, 81 op/s 2023-08-11T12:27:43.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:42 smithi045 ceph-mon[130284]: pgmap v96: 129 pgs: 129 active+clean; 7.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 26 MiB/s wr, 81 op/s 2023-08-11T12:27:43.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:42 smithi008 ceph-mon[97158]: pgmap v96: 129 pgs: 129 active+clean; 7.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 26 MiB/s wr, 81 op/s 2023-08-11T12:27:45.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:44 smithi194 ceph-mon[130905]: pgmap v97: 129 pgs: 129 active+clean; 7.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 25 MiB/s wr, 54 op/s 2023-08-11T12:27:45.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:44 smithi045 ceph-mon[130284]: pgmap v97: 129 pgs: 129 active+clean; 7.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 25 MiB/s wr, 54 op/s 2023-08-11T12:27:45.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:44 smithi008 ceph-mon[97158]: pgmap v97: 129 pgs: 129 active+clean; 7.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 25 MiB/s wr, 54 op/s 2023-08-11T12:27:47.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:46 smithi194 ceph-mon[130905]: pgmap v98: 129 pgs: 129 active+clean; 7.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 25 MiB/s wr, 54 op/s 2023-08-11T12:27:47.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:46 smithi045 ceph-mon[130284]: pgmap v98: 129 pgs: 129 active+clean; 7.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 25 MiB/s wr, 54 op/s 2023-08-11T12:27:47.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:46 smithi008 ceph-mon[97158]: pgmap v98: 129 pgs: 129 active+clean; 7.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 25 MiB/s wr, 54 op/s 2023-08-11T12:27:48.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:47 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:27:48.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:47 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:27:48.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:47 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:27:49.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:48 smithi194 ceph-mon[130905]: pgmap v99: 129 pgs: 129 active+clean; 7.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 25 MiB/s wr, 60 op/s 2023-08-11T12:27:49.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:48 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:27:49.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:48 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:27:49.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:48 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:27:49.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:48 smithi045 ceph-mon[130284]: pgmap v99: 129 pgs: 129 active+clean; 7.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 25 MiB/s wr, 60 op/s 2023-08-11T12:27:49.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:48 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:27:49.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:48 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:27:49.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:48 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:27:49.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:48 smithi008 ceph-mon[97158]: pgmap v99: 129 pgs: 129 active+clean; 7.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 25 MiB/s wr, 60 op/s 2023-08-11T12:27:49.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:48 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:27:49.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:48 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:27:49.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:48 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:27:51.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:50 smithi008 ceph-mon[97158]: pgmap v100: 129 pgs: 129 active+clean; 7.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 44 op/s 2023-08-11T12:27:51.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:50 smithi194 ceph-mon[130905]: pgmap v100: 129 pgs: 129 active+clean; 7.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 44 op/s 2023-08-11T12:27:51.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:50 smithi045 ceph-mon[130284]: pgmap v100: 129 pgs: 129 active+clean; 7.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 44 op/s 2023-08-11T12:27:53.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:52 smithi194 ceph-mon[130905]: pgmap v101: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 33 MiB/s wr, 52 op/s 2023-08-11T12:27:53.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:52 smithi045 ceph-mon[130284]: pgmap v101: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 33 MiB/s wr, 52 op/s 2023-08-11T12:27:53.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:52 smithi008 ceph-mon[97158]: pgmap v101: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 33 MiB/s wr, 52 op/s 2023-08-11T12:27:55.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:54 smithi194 ceph-mon[130905]: pgmap v102: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.2 MiB/s wr, 14 op/s 2023-08-11T12:27:55.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:54 smithi045 ceph-mon[130284]: pgmap v102: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.2 MiB/s wr, 14 op/s 2023-08-11T12:27:55.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:54 smithi008 ceph-mon[97158]: pgmap v102: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.2 MiB/s wr, 14 op/s 2023-08-11T12:27:57.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:56 smithi194 ceph-mon[130905]: pgmap v103: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.3 MiB/s wr, 14 op/s 2023-08-11T12:27:57.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:56 smithi194 ceph-mon[130905]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:27:57.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:56 smithi045 ceph-mon[130284]: pgmap v103: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.3 MiB/s wr, 14 op/s 2023-08-11T12:27:57.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:56 smithi045 ceph-mon[130284]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:27:57.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:56 smithi008 ceph-mon[97158]: pgmap v103: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.3 MiB/s wr, 14 op/s 2023-08-11T12:27:57.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:56 smithi008 ceph-mon[97158]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:27:59.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:27:58 smithi194 ceph-mon[130905]: pgmap v104: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.3 MiB/s wr, 21 op/s 2023-08-11T12:27:59.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:27:58 smithi045 ceph-mon[130284]: pgmap v104: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.3 MiB/s wr, 21 op/s 2023-08-11T12:27:59.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:27:58 smithi008 ceph-mon[97158]: pgmap v104: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.3 MiB/s wr, 21 op/s 2023-08-11T12:28:01.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:00 smithi008 ceph-mon[97158]: pgmap v105: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.3 MiB/s wr, 15 op/s 2023-08-11T12:28:01.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:00 smithi194 ceph-mon[130905]: pgmap v105: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.3 MiB/s wr, 15 op/s 2023-08-11T12:28:01.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:00 smithi045 ceph-mon[130284]: pgmap v105: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.3 MiB/s wr, 15 op/s 2023-08-11T12:28:02.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:01 smithi008 ceph-mon[97158]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:28:02.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:01 smithi194 ceph-mon[130905]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:28:02.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:01 smithi045 ceph-mon[130284]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:28:03.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:02 smithi008 ceph-mon[97158]: pgmap v106: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 8.3 MiB/s wr, 33 op/s 2023-08-11T12:28:03.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:02 smithi194 ceph-mon[130905]: pgmap v106: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 8.3 MiB/s wr, 33 op/s 2023-08-11T12:28:03.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:02 smithi045 ceph-mon[130284]: pgmap v106: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 8.3 MiB/s wr, 33 op/s 2023-08-11T12:28:05.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:04 smithi194 ceph-mon[130905]: pgmap v107: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 69 KiB/s wr, 25 op/s 2023-08-11T12:28:05.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:04 smithi045 ceph-mon[130284]: pgmap v107: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 69 KiB/s wr, 25 op/s 2023-08-11T12:28:05.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:04 smithi008 ceph-mon[97158]: pgmap v107: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 69 KiB/s wr, 25 op/s 2023-08-11T12:28:05.448 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:28:05.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.664+0000 7fe56cfff700 1 -- 172.21.15.8:0/3098140949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe568100960 msgr2=0x7fe568100de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:28:05.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.664+0000 7fe56cfff700 1 --2- 172.21.15.8:0/3098140949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe568100960 0x7fe568100de0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe55c009990 tx=0x7fe55c009ca0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.665+0000 7fe56cfff700 1 -- 172.21.15.8:0/3098140949 shutdown_connections 2023-08-11T12:28:05.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.665+0000 7fe56cfff700 1 --2- 172.21.15.8:0/3098140949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe568101320 0x7fe56810d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.665+0000 7fe56cfff700 1 --2- 172.21.15.8:0/3098140949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe568106970 0x7fe568106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.665+0000 7fe56cfff700 1 --2- 172.21.15.8:0/3098140949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe568100960 0x7fe568100de0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.665+0000 7fe56cfff700 1 -- 172.21.15.8:0/3098140949 >> 172.21.15.8:0/3098140949 conn(0x7fe5680fc490 msgr2=0x7fe5680fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:28:05.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.665+0000 7fe56cfff700 1 -- 172.21.15.8:0/3098140949 shutdown_connections 2023-08-11T12:28:05.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.665+0000 7fe56cfff700 1 -- 172.21.15.8:0/3098140949 wait complete. 2023-08-11T12:28:05.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.666+0000 7fe56cfff700 1 Processor -- start 2023-08-11T12:28:05.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.666+0000 7fe56cfff700 1 -- start start 2023-08-11T12:28:05.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.666+0000 7fe56cfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe568100960 0x7fe56819e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:05.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.666+0000 7fe56cfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe568101320 0x7fe56819eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:05.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.666+0000 7fe56cfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe568106970 0x7fe568198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:05.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.666+0000 7fe56cfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe568199080 con 0x7fe568100960 2023-08-11T12:28:05.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.666+0000 7fe56cfff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5681991f0 con 0x7fe568101320 2023-08-11T12:28:05.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.666+0000 7fe56cfff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5681993b0 con 0x7fe568106970 2023-08-11T12:28:05.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.666+0000 7fe56659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe568100960 0x7fe56819e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:05.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.666+0000 7fe56659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe568100960 0x7fe56819e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36518/0 (socket says 172.21.15.8:36518) 2023-08-11T12:28:05.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.666+0000 7fe56659c700 1 -- 172.21.15.8:0/1948856755 learned_addr learned my addr 172.21.15.8:0/1948856755 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:28:05.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.666+0000 7fe565d9b700 1 --2- 172.21.15.8:0/1948856755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe568101320 0x7fe56819eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:05.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.667+0000 7fe566d9d700 1 --2- 172.21.15.8:0/1948856755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe568106970 0x7fe568198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:05.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.667+0000 7fe56659c700 1 -- 172.21.15.8:0/1948856755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe568106970 msgr2=0x7fe568198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:28:05.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.667+0000 7fe56659c700 1 --2- 172.21.15.8:0/1948856755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe568106970 0x7fe568198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.667+0000 7fe56659c700 1 -- 172.21.15.8:0/1948856755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe568101320 msgr2=0x7fe56819eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:28:05.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.667+0000 7fe56659c700 1 --2- 172.21.15.8:0/1948856755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe568101320 0x7fe56819eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.667+0000 7fe56659c700 1 -- 172.21.15.8:0/1948856755 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe558009520 con 0x7fe568100960 2023-08-11T12:28:05.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.667+0000 7fe56659c700 1 --2- 172.21.15.8:0/1948856755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe568100960 0x7fe56819e9a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe55800eb30 tx=0x7fe55800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:28:05.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.667+0000 7fe5577fe700 1 -- 172.21.15.8:0/1948856755 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe558009880 con 0x7fe568100960 2023-08-11T12:28:05.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.667+0000 7fe56cfff700 1 -- 172.21.15.8:0/1948856755 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe55c0095f0 con 0x7fe568100960 2023-08-11T12:28:05.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.667+0000 7fe5577fe700 1 -- 172.21.15.8:0/1948856755 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe5580044e0 con 0x7fe568100960 2023-08-11T12:28:05.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.667+0000 7fe5577fe700 1 -- 172.21.15.8:0/1948856755 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe558003d80 con 0x7fe568100960 2023-08-11T12:28:05.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.668+0000 7fe56cfff700 1 -- 172.21.15.8:0/1948856755 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5681a57b0 con 0x7fe568100960 2023-08-11T12:28:05.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.671+0000 7fe5577fe700 1 -- 172.21.15.8:0/1948856755 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7fe558003f20 con 0x7fe568100960 2023-08-11T12:28:05.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.672+0000 7fe5808a8b80 1 Processor -- start 2023-08-11T12:28:05.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.672+0000 7fe5577fe700 1 --2- 172.21.15.8:0/1948856755 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe5500a00c0 0x7fe5500a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:05.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.672+0000 7fe5808a8b80 1 -- start start 2023-08-11T12:28:05.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.672+0000 7fe5577fe700 1 -- 172.21.15.8:0/1948856755 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fe558014070 con 0x7fe568100960 2023-08-11T12:28:05.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.672+0000 7fe566d9d700 1 --2- 172.21.15.8:0/1948856755 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe5500a00c0 0x7fe5500a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:05.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.673+0000 7fe5808a8b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbc7d26310 0x55cbc7d266f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:05.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.673+0000 7fe5808a8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbc7d26c30 0x55cbc7d208e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:05.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.673+0000 7fe5808a8b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cbc7d20e20 0x55cbc7d21260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:05.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.673+0000 7fe5808a8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbc7c79630 con 0x55cbc7d26c30 2023-08-11T12:28:05.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.673+0000 7fe5808a8b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbc7c76f50 con 0x55cbc7d26310 2023-08-11T12:28:05.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.673+0000 7fe5808a8b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbc7c72840 con 0x55cbc7d20e20 2023-08-11T12:28:05.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.673+0000 7fe56659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbc7d26310 0x55cbc7d266f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:05.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.673+0000 7fe565d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbc7d26c30 0x55cbc7d208e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:05.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.673+0000 7fe56659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbc7d26310 0x55cbc7d266f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:60176/0 (socket says 172.21.15.8:60176) 2023-08-11T12:28:05.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.673+0000 7fe56659c700 1 -- 172.21.15.8:0/334917051 learned_addr learned my addr 172.21.15.8:0/334917051 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:28:05.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.673+0000 7fe566d9d700 1 --2- 172.21.15.8:0/334917051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cbc7d20e20 0x55cbc7d21260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:05.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.673+0000 7fe56659c700 1 -- 172.21.15.8:0/334917051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cbc7d20e20 msgr2=0x55cbc7d21260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:28:05.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.673+0000 7fe56659c700 1 --2- 172.21.15.8:0/334917051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cbc7d20e20 0x55cbc7d21260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.673+0000 7fe56659c700 1 -- 172.21.15.8:0/334917051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbc7d26c30 msgr2=0x55cbc7d208e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:28:05.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.673+0000 7fe56659c700 1 --2- 172.21.15.8:0/334917051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbc7d26c30 0x55cbc7d208e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.673+0000 7fe56659c700 1 -- 172.21.15.8:0/334917051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cbc7af2630 con 0x55cbc7d26310 2023-08-11T12:28:05.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.673+0000 7fe566d9d700 1 --2- 172.21.15.8:0/1948856755 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe5500a00c0 0x7fe5500a2580 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe56819f6a0 tx=0x7fe560009920 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:28:05.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.674+0000 7fe56659c700 1 --2- 172.21.15.8:0/334917051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbc7d26310 0x55cbc7d266f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe558009230 tx=0x7fe558098b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed9330b1fe7aef48 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:28:05.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.674+0000 7fe554ff9700 1 -- 172.21.15.8:0/334917051 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe558099230 con 0x55cbc7d26310 2023-08-11T12:28:05.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.674+0000 7fe554ff9700 1 -- 172.21.15.8:0/334917051 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe55809d060 con 0x55cbc7d26310 2023-08-11T12:28:05.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.674+0000 7fe554ff9700 1 -- 172.21.15.8:0/334917051 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5580b1220 con 0x55cbc7d26310 2023-08-11T12:28:05.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.674+0000 7fe5808a8b80 1 -- 172.21.15.8:0/334917051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbc7d26310 msgr2=0x55cbc7d266f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:28:05.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.674+0000 7fe5808a8b80 1 --2- 172.21.15.8:0/334917051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbc7d26310 0x55cbc7d266f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe558009230 tx=0x7fe558098b90 comp rx=0 tx=0).stop 2023-08-11T12:28:05.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.675+0000 7fe5808a8b80 1 -- 172.21.15.8:0/334917051 shutdown_connections 2023-08-11T12:28:05.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.675+0000 7fe5808a8b80 1 --2- 172.21.15.8:0/334917051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cbc7d20e20 0x55cbc7d21260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.675+0000 7fe5808a8b80 1 --2- 172.21.15.8:0/334917051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbc7d26310 0x55cbc7d266f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.675+0000 7fe5808a8b80 1 --2- 172.21.15.8:0/334917051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbc7d26c30 0x55cbc7d208e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.675+0000 7fe5808a8b80 1 -- 172.21.15.8:0/334917051 >> 172.21.15.8:0/334917051 conn(0x55cbc7c4d950 msgr2=0x55cbc7d1b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:28:05.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.675+0000 7fe5808a8b80 1 -- 172.21.15.8:0/334917051 shutdown_connections 2023-08-11T12:28:05.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.675+0000 7fe5808a8b80 1 -- 172.21.15.8:0/334917051 wait complete. 2023-08-11T12:28:05.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.675+0000 7fe5808a8b80 1 -- start start 2023-08-11T12:28:05.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.675+0000 7fe5808a8b80 1 Processor -- start 2023-08-11T12:28:05.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.676+0000 7fe5808a8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbc7d20e20 0x55cbc7d2cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:05.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.676+0000 7fe5808a8b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cbc7d26310 0x55cbc7d29e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:05.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.676+0000 7fe5808a8b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbc7d26c30 0x55cbc7d2a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:05.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.676+0000 7fe5808a8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbc7c10ac0 con 0x55cbc7d20e20 2023-08-11T12:28:05.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.676+0000 7fe5808a8b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbc7c107c0 con 0x55cbc7d26c30 2023-08-11T12:28:05.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.676+0000 7fe5808a8b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbc7af4920 con 0x55cbc7d26310 2023-08-11T12:28:05.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.676+0000 7fe5808a8b80 10 client.0 _ll_register_callbacks cb 0x55cbc7c13ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:28:05.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.676+0000 7fe566d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbc7d26c30 0x55cbc7d2a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:05.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.676+0000 7fe56659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbc7d20e20 0x55cbc7d2cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:05.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.676+0000 7fe566d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbc7d26c30 0x55cbc7d2a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:60178/0 (socket says 172.21.15.8:60178) 2023-08-11T12:28:05.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.676+0000 7fe566d9d700 1 -- 172.21.15.8:0/3116941014 learned_addr learned my addr 172.21.15.8:0/3116941014 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:28:05.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.676+0000 7fe565d9b700 1 --2- 172.21.15.8:0/3116941014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cbc7d26310 0x55cbc7d29e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:05.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.677+0000 7fe566d9d700 1 -- 172.21.15.8:0/3116941014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cbc7d26310 msgr2=0x55cbc7d29e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:28:05.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.677+0000 7fe566d9d700 1 --2- 172.21.15.8:0/3116941014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cbc7d26310 0x55cbc7d29e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.677+0000 7fe566d9d700 1 -- 172.21.15.8:0/3116941014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbc7d20e20 msgr2=0x55cbc7d2cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:28:05.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.677+0000 7fe566d9d700 1 --2- 172.21.15.8:0/3116941014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbc7d20e20 0x55cbc7d2cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.677+0000 7fe566d9d700 1 -- 172.21.15.8:0/3116941014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5681a57b0 con 0x55cbc7d26c30 2023-08-11T12:28:05.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.677+0000 7fe566d9d700 1 --2- 172.21.15.8:0/3116941014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbc7d26c30 0x55cbc7d2a4b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe560019ed0 tx=0x7fe560004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e05654a006460e80 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:28:05.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.677+0000 7fe54dffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:28:05.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.677+0000 7fe54dffb700 1 -- 172.21.15.8:0/3116941014 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56000e040 con 0x55cbc7d26c30 2023-08-11T12:28:05.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.677+0000 7fe5808a8b80 1 -- 172.21.15.8:0/3116941014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cbc7d13a90 con 0x55cbc7d26c30 2023-08-11T12:28:05.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.677+0000 7fe54dffb700 1 -- 172.21.15.8:0/3116941014 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fe560004db0 con 0x55cbc7d26c30 2023-08-11T12:28:05.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.678+0000 7fe54dffb700 1 -- 172.21.15.8:0/3116941014 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe560017a60 con 0x55cbc7d26c30 2023-08-11T12:28:05.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.678+0000 7fe5808a8b80 10 client.26231 fetch_fsmap learned FSMap version 39 2023-08-11T12:28:05.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.678+0000 7fe5808a8b80 1 -- 172.21.15.8:0/3116941014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55cbc7a9ede0 con 0x55cbc7d26c30 2023-08-11T12:28:05.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.678+0000 7fe54dffb700 1 -- 172.21.15.8:0/3116941014 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cbc7d13a90 con 0x55cbc7d26c30 2023-08-11T12:28:05.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.678+0000 7fe54dffb700 1 -- 172.21.15.8:0/3116941014 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 39) v1 ==== 7966+0+0 (secure 0 0 0) 0x7fe560004260 con 0x55cbc7d26c30 2023-08-11T12:28:05.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.678+0000 7fe5808a8b80 10 client.26231 fetch_fsmap finished waiting for FSMap version 39 2023-08-11T12:28:05.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.678+0000 7fe5808a8b80 10 client.26231 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:28:05.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.678+0000 7fe5808a8b80 20 client.26231 populate_metadata read hostname 'smithi008' 2023-08-11T12:28:05.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.678+0000 7fe5808a8b80 1 --2- 172.21.15.8:0/3116941014 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55cbc7d3a430 0x55cbc7d3c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:05.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.678+0000 7fe5808a8b80 4 client.26231 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:28:05.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.678+0000 7fe5808a8b80 1 -- 172.21.15.8:0/3116941014 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cbc7cef4e0 con 0x55cbc7d3a430 2023-08-11T12:28:05.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.679+0000 7fe56659c700 1 --2- 172.21.15.8:0/3116941014 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55cbc7d3a430 0x55cbc7d3c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:05.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.679+0000 7fe56659c700 1 --2- 172.21.15.8:0/3116941014 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55cbc7d3a430 0x55cbc7d3c850 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dccc3df5d6c23e15 server_cookie=3cf059989b5706e in_seq=0 out_seq=0 2023-08-11T12:28:05.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.679+0000 7fe54dffb700 10 client.26231 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:28:05.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.680+0000 7fe54dffb700 1 -- 172.21.15.8:0/3116941014 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55cbc7cef4e0 con 0x55cbc7d3a430 2023-08-11T12:28:05.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.680+0000 7fe54dffb700 10 client.26231 handle_command_reply: tid=0 2023-08-11T12:28:05.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.680+0000 7fe5808a8b80 1 client.26231 shutdown 2023-08-11T12:28:05.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.680+0000 7fe5808a8b80 1 -- 172.21.15.8:0/3116941014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbc7d26c30 msgr2=0x55cbc7d2a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:28:05.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.680+0000 7fe5808a8b80 1 --2- 172.21.15.8:0/3116941014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbc7d26c30 0x55cbc7d2a4b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe560019ed0 tx=0x7fe560004b40 comp rx=0 tx=0).stop 2023-08-11T12:28:05.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.680+0000 7fe5808a8b80 1 -- 172.21.15.8:0/3116941014 shutdown_connections 2023-08-11T12:28:05.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.680+0000 7fe5808a8b80 1 --2- 172.21.15.8:0/3116941014 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55cbc7d3a430 0x55cbc7d3c850 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.680+0000 7fe5808a8b80 1 --2- 172.21.15.8:0/3116941014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbc7d26c30 0x55cbc7d2a4b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.680+0000 7fe5808a8b80 1 --2- 172.21.15.8:0/3116941014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbc7d20e20 0x55cbc7d2cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.680+0000 7fe5808a8b80 1 --2- 172.21.15.8:0/3116941014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cbc7d26310 0x55cbc7d29e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.680+0000 7fe54dffb700 0 client.26231 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:28:05.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.680+0000 7fe5808a8b80 1 -- 172.21.15.8:0/3116941014 >> 172.21.15.8:0/3116941014 conn(0x55cbc7c4d950 msgr2=0x55cbc7d15cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:28:05.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.680+0000 7fe5808a8b80 1 -- 172.21.15.8:0/3116941014 shutdown_connections 2023-08-11T12:28:05.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.680+0000 7fe5808a8b80 1 -- 172.21.15.8:0/3116941014 wait complete. 2023-08-11T12:28:05.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.680+0000 7fe5808a8b80 20 client.26231 trim_cache size 0 max 16384 2023-08-11T12:28:05.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.698+0000 7fe5808a8b80 1 Processor -- start 2023-08-11T12:28:05.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.698+0000 7fe5808a8b80 1 -- start start 2023-08-11T12:28:05.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.698+0000 7fe5808a8b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cbc7d20e20 0x55cbc7d2c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:05.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.698+0000 7fe5808a8b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbc7d26310 0x55cbc7d296a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:05.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.699+0000 7fe5808a8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbc7d26c30 0x55cbc7d29be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:05.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.699+0000 7fe5808a8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbc7d36db0 con 0x55cbc7d26c30 2023-08-11T12:28:05.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.699+0000 7fe5808a8b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbc7d2d230 con 0x55cbc7d26310 2023-08-11T12:28:05.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.699+0000 7fe5808a8b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbc7d1c2b0 con 0x55cbc7d20e20 2023-08-11T12:28:05.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.699+0000 7fe565d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbc7d26310 0x55cbc7d296a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:05.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.699+0000 7fe565d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbc7d26310 0x55cbc7d296a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:60192/0 (socket says 172.21.15.8:60192) 2023-08-11T12:28:05.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.699+0000 7fe566d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbc7d26c30 0x55cbc7d29be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:05.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.699+0000 7fe565d9b700 1 -- 172.21.15.8:0/1888857061 learned_addr learned my addr 172.21.15.8:0/1888857061 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:28:05.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.699+0000 7fe56659c700 1 --2- 172.21.15.8:0/1888857061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cbc7d20e20 0x55cbc7d2c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:05.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.699+0000 7fe565d9b700 1 -- 172.21.15.8:0/1888857061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cbc7d20e20 msgr2=0x55cbc7d2c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:28:05.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.699+0000 7fe565d9b700 1 --2- 172.21.15.8:0/1888857061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cbc7d20e20 0x55cbc7d2c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.699+0000 7fe565d9b700 1 -- 172.21.15.8:0/1888857061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbc7d26c30 msgr2=0x55cbc7d29be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:28:05.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.699+0000 7fe565d9b700 1 --2- 172.21.15.8:0/1888857061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbc7d26c30 0x55cbc7d29be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.699+0000 7fe565d9b700 1 -- 172.21.15.8:0/1888857061 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cbc7a87c60 con 0x55cbc7d26310 2023-08-11T12:28:05.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.699+0000 7fe566d9d700 1 --2- 172.21.15.8:0/1888857061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbc7d26c30 0x55cbc7d29be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:28:05.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.700+0000 7fe565d9b700 1 --2- 172.21.15.8:0/1888857061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbc7d26310 0x55cbc7d296a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe55c009990 tx=0x7fe55c005960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24e59bcc2919161d server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:28:05.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.700+0000 7fe5557fa700 1 -- 172.21.15.8:0/1888857061 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c01d030 con 0x55cbc7d26310 2023-08-11T12:28:05.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.700+0000 7fe5557fa700 1 -- 172.21.15.8:0/1888857061 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe55c01e040 con 0x55cbc7d26310 2023-08-11T12:28:05.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.700+0000 7fe5557fa700 1 -- 172.21.15.8:0/1888857061 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c004760 con 0x55cbc7d26310 2023-08-11T12:28:05.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.700+0000 7fe5808a8b80 1 -- 172.21.15.8:0/1888857061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbc7d26310 msgr2=0x55cbc7d296a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:28:05.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.700+0000 7fe5808a8b80 1 --2- 172.21.15.8:0/1888857061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbc7d26310 0x55cbc7d296a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe55c009990 tx=0x7fe55c005960 comp rx=0 tx=0).stop 2023-08-11T12:28:05.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.700+0000 7fe5808a8b80 1 -- 172.21.15.8:0/1888857061 shutdown_connections 2023-08-11T12:28:05.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.700+0000 7fe5808a8b80 1 --2- 172.21.15.8:0/1888857061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cbc7d20e20 0x55cbc7d2c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.700+0000 7fe5808a8b80 1 --2- 172.21.15.8:0/1888857061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbc7d26c30 0x55cbc7d29be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.700+0000 7fe5808a8b80 1 --2- 172.21.15.8:0/1888857061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbc7d26310 0x55cbc7d296a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.700+0000 7fe5808a8b80 1 -- 172.21.15.8:0/1888857061 >> 172.21.15.8:0/1888857061 conn(0x55cbc7c4d950 msgr2=0x55cbc7d1b280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:28:05.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.701+0000 7fe5808a8b80 1 -- 172.21.15.8:0/1888857061 shutdown_connections 2023-08-11T12:28:05.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.701+0000 7fe5808a8b80 1 -- 172.21.15.8:0/1888857061 wait complete. 2023-08-11T12:28:05.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.701+0000 7fe5808a8b80 1 -- start start 2023-08-11T12:28:05.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.701+0000 7fe5808a8b80 1 Processor -- start 2023-08-11T12:28:05.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.702+0000 7fe5808a8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbc7d20e20 0x55cbc7d312c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:05.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.702+0000 7fe5808a8b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cbc7d26310 0x55cbc7d2f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:05.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.702+0000 7fe5808a8b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbc7d26c30 0x55cbc7d2faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:05.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.702+0000 7fe5808a8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbc7d30080 con 0x55cbc7d20e20 2023-08-11T12:28:05.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.702+0000 7fe5808a8b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbc7d301f0 con 0x55cbc7d26c30 2023-08-11T12:28:05.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.702+0000 7fe5808a8b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbc7d303b0 con 0x55cbc7d26310 2023-08-11T12:28:05.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.702+0000 7fe5808a8b80 10 client.0 _ll_register_callbacks cb 0x7fe5600198a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:28:05.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.702+0000 7fe566d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbc7d26c30 0x55cbc7d2faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:05.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.702+0000 7fe566d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbc7d26c30 0x55cbc7d2faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:60200/0 (socket says 172.21.15.8:60200) 2023-08-11T12:28:05.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.702+0000 7fe566d9d700 1 -- 172.21.15.8:0/3438583706 learned_addr learned my addr 172.21.15.8:0/3438583706 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:28:05.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.702+0000 7fe565d9b700 1 --2- 172.21.15.8:0/3438583706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cbc7d26310 0x55cbc7d2f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:05.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.702+0000 7fe56659c700 1 --2- 172.21.15.8:0/3438583706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbc7d20e20 0x55cbc7d312c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:05.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.702+0000 7fe566d9d700 1 -- 172.21.15.8:0/3438583706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cbc7d26310 msgr2=0x55cbc7d2f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:28:05.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.702+0000 7fe566d9d700 1 --2- 172.21.15.8:0/3438583706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cbc7d26310 0x55cbc7d2f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.702+0000 7fe566d9d700 1 -- 172.21.15.8:0/3438583706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbc7d20e20 msgr2=0x55cbc7d312c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:28:05.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.702+0000 7fe566d9d700 1 --2- 172.21.15.8:0/3438583706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbc7d20e20 0x55cbc7d312c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.702+0000 7fe566d9d700 1 -- 172.21.15.8:0/3438583706 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cbc7a9ede0 con 0x55cbc7d26c30 2023-08-11T12:28:05.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.703+0000 7fe566d9d700 1 --2- 172.21.15.8:0/3438583706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbc7d26c30 0x55cbc7d2faf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe560019ed0 tx=0x7fe5600177a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42b40ad569976b96 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:28:05.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.703+0000 7fe54dffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:28:05.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.703+0000 7fe54dffb700 1 -- 172.21.15.8:0/3438583706 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56000e040 con 0x55cbc7d26c30 2023-08-11T12:28:05.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.703+0000 7fe5808a8b80 1 -- 172.21.15.8:0/3438583706 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe55809d060 con 0x55cbc7d26c30 2023-08-11T12:28:05.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.703+0000 7fe54dffb700 1 -- 172.21.15.8:0/3438583706 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fe560004db0 con 0x55cbc7d26c30 2023-08-11T12:28:05.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.703+0000 7fe54dffb700 1 -- 172.21.15.8:0/3438583706 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe560009030 con 0x55cbc7d26c30 2023-08-11T12:28:05.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.703+0000 7fe5808a8b80 10 client.26237 fetch_fsmap learned FSMap version 39 2023-08-11T12:28:05.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.703+0000 7fe5808a8b80 1 -- 172.21.15.8:0/3438583706 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7fe56810e130 con 0x55cbc7d26c30 2023-08-11T12:28:05.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.703+0000 7fe54dffb700 1 -- 172.21.15.8:0/3438583706 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe55809d060 con 0x55cbc7d26c30 2023-08-11T12:28:05.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.704+0000 7fe54dffb700 1 -- 172.21.15.8:0/3438583706 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 39) v1 ==== 7966+0+0 (secure 0 0 0) 0x7fe560004160 con 0x55cbc7d26c30 2023-08-11T12:28:05.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.704+0000 7fe5808a8b80 10 client.26237 fetch_fsmap finished waiting for FSMap version 39 2023-08-11T12:28:05.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.704+0000 7fe5808a8b80 10 client.26237 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:28:05.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.704+0000 7fe5808a8b80 20 client.26237 populate_metadata read hostname 'smithi008' 2023-08-11T12:28:05.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.704+0000 7fe5808a8b80 1 --2- 172.21.15.8:0/3438583706 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55cbc7d8f6a0 0x55cbc7d91ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:05.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.704+0000 7fe5808a8b80 4 client.26237 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:28:05.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.704+0000 7fe5808a8b80 1 -- 172.21.15.8:0/3438583706 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55cbc7c6b820 con 0x55cbc7d8f6a0 2023-08-11T12:28:05.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.704+0000 7fe56659c700 1 --2- 172.21.15.8:0/3438583706 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55cbc7d8f6a0 0x55cbc7d91ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:05.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.704+0000 7fe54dffb700 10 client.26237 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:28:05.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.704+0000 7fe56659c700 1 --2- 172.21.15.8:0/3438583706 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55cbc7d8f6a0 0x55cbc7d91ac0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a935f39f8548144 server_cookie=1635f2db86dede62 in_seq=0 out_seq=0 2023-08-11T12:28:05.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.705+0000 7fe54dffb700 1 -- 172.21.15.8:0/3438583706 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55cbc7c6b820 con 0x55cbc7d8f6a0 2023-08-11T12:28:05.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.705+0000 7fe54dffb700 10 client.26237 handle_command_reply: tid=0 2023-08-11T12:28:05.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.705+0000 7fe5808a8b80 1 client.26237 shutdown 2023-08-11T12:28:05.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.705+0000 7fe5808a8b80 1 -- 172.21.15.8:0/3438583706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbc7d26c30 msgr2=0x55cbc7d2faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:28:05.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.705+0000 7fe5808a8b80 1 --2- 172.21.15.8:0/3438583706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbc7d26c30 0x55cbc7d2faf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe560019ed0 tx=0x7fe5600177a0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.705+0000 7fe5808a8b80 1 -- 172.21.15.8:0/3438583706 shutdown_connections 2023-08-11T12:28:05.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.705+0000 7fe5808a8b80 1 --2- 172.21.15.8:0/3438583706 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55cbc7d8f6a0 0x55cbc7d91ac0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.705+0000 7fe5808a8b80 1 --2- 172.21.15.8:0/3438583706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbc7d26c30 0x55cbc7d2faf0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.705+0000 7fe5808a8b80 1 --2- 172.21.15.8:0/3438583706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbc7d20e20 0x55cbc7d312c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.705+0000 7fe54dffb700 0 client.26237 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:28:05.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.705+0000 7fe5808a8b80 1 --2- 172.21.15.8:0/3438583706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cbc7d26310 0x55cbc7d2f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.705+0000 7fe5808a8b80 1 -- 172.21.15.8:0/3438583706 >> 172.21.15.8:0/3438583706 conn(0x55cbc7c4d950 msgr2=0x55cbc7d25060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:28:05.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.705+0000 7fe5808a8b80 1 -- 172.21.15.8:0/3438583706 shutdown_connections 2023-08-11T12:28:05.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.705+0000 7fe5808a8b80 1 -- 172.21.15.8:0/3438583706 wait complete. 2023-08-11T12:28:05.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.705+0000 7fe5808a8b80 20 client.26237 trim_cache size 0 max 16384 2023-08-11T12:28:05.734 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:28:05.734 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:28:05.734 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:28:05.734 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:28:05.735 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:28:05.735 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:28:05.735 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:28:05.735 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:28:05.735 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:28:05.735 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:28:05.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.706+0000 7fe56cfff700 1 -- 172.21.15.8:0/1948856755 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe5500a00c0 msgr2=0x7fe5500a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:28:05.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.706+0000 7fe56cfff700 1 --2- 172.21.15.8:0/1948856755 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe5500a00c0 0x7fe5500a2580 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe56819f6a0 tx=0x7fe560009920 comp rx=0 tx=0).stop 2023-08-11T12:28:05.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.706+0000 7fe56cfff700 1 -- 172.21.15.8:0/1948856755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe568100960 msgr2=0x7fe56819e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:28:05.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.706+0000 7fe56cfff700 1 --2- 172.21.15.8:0/1948856755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe568100960 0x7fe56819e9a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe55800eb30 tx=0x7fe55800ee40 comp rx=0 tx=0).stop 2023-08-11T12:28:05.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.706+0000 7fe56cfff700 1 -- 172.21.15.8:0/1948856755 shutdown_connections 2023-08-11T12:28:05.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.706+0000 7fe56cfff700 1 --2- 172.21.15.8:0/1948856755 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe5500a00c0 0x7fe5500a2580 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.706+0000 7fe56cfff700 1 --2- 172.21.15.8:0/1948856755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe568106970 0x7fe568198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.706+0000 7fe56cfff700 1 --2- 172.21.15.8:0/1948856755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe568100960 0x7fe56819e9a0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.706+0000 7fe56cfff700 1 --2- 172.21.15.8:0/1948856755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe568101320 0x7fe56819eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:05.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.706+0000 7fe56cfff700 1 -- 172.21.15.8:0/1948856755 >> 172.21.15.8:0/1948856755 conn(0x7fe5680fc490 msgr2=0x7fe56810bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:28:05.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.706+0000 7fe56cfff700 1 -- 172.21.15.8:0/1948856755 shutdown_connections 2023-08-11T12:28:05.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:05.706+0000 7fe56cfff700 1 -- 172.21.15.8:0/1948856755 wait complete. 2023-08-11T12:28:05.739 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:28:07.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:06 smithi194 ceph-mon[130905]: pgmap v108: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 69 KiB/s wr, 25 op/s 2023-08-11T12:28:07.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:06 smithi045 ceph-mon[130284]: pgmap v108: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 69 KiB/s wr, 25 op/s 2023-08-11T12:28:07.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:06 smithi008 ceph-mon[97158]: pgmap v108: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 69 KiB/s wr, 25 op/s 2023-08-11T12:28:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:08 smithi194 ceph-mon[130905]: pgmap v109: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 86 KiB/s wr, 31 op/s 2023-08-11T12:28:09.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:08 smithi045 ceph-mon[130284]: pgmap v109: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 86 KiB/s wr, 31 op/s 2023-08-11T12:28:09.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:08 smithi008 ceph-mon[97158]: pgmap v109: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 86 KiB/s wr, 31 op/s 2023-08-11T12:28:11.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:10 smithi008 ceph-mon[97158]: pgmap v110: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 52 KiB/s wr, 24 op/s 2023-08-11T12:28:11.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:10 smithi194 ceph-mon[130905]: pgmap v110: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 52 KiB/s wr, 24 op/s 2023-08-11T12:28:11.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:10 smithi045 ceph-mon[130284]: pgmap v110: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 52 KiB/s wr, 24 op/s 2023-08-11T12:28:13.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:12 smithi194 ceph-mon[130905]: pgmap v111: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 56 KiB/s wr, 29 op/s 2023-08-11T12:28:13.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:12 smithi045 ceph-mon[130284]: pgmap v111: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 56 KiB/s wr, 29 op/s 2023-08-11T12:28:13.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:12 smithi008 ceph-mon[97158]: pgmap v111: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 56 KiB/s wr, 29 op/s 2023-08-11T12:28:15.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:14 smithi194 ceph-mon[130905]: pgmap v112: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 11 op/s 2023-08-11T12:28:15.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:14 smithi045 ceph-mon[130284]: pgmap v112: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 11 op/s 2023-08-11T12:28:15.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:14 smithi008 ceph-mon[97158]: pgmap v112: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 11 op/s 2023-08-11T12:28:17.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:16 smithi194 ceph-mon[130905]: pgmap v113: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 11 op/s 2023-08-11T12:28:17.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:16 smithi045 ceph-mon[130284]: pgmap v113: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 11 op/s 2023-08-11T12:28:17.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:16 smithi008 ceph-mon[97158]: pgmap v113: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 11 op/s 2023-08-11T12:28:19.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:18 smithi194 ceph-mon[130905]: pgmap v114: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.9 MiB/s wr, 95 op/s 2023-08-11T12:28:19.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:18 smithi045 ceph-mon[130284]: pgmap v114: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.9 MiB/s wr, 95 op/s 2023-08-11T12:28:19.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:18 smithi008 ceph-mon[97158]: pgmap v114: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.9 MiB/s wr, 95 op/s 2023-08-11T12:28:21.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:20 smithi008 ceph-mon[97158]: pgmap v115: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.9 MiB/s wr, 89 op/s 2023-08-11T12:28:21.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:20 smithi194 ceph-mon[130905]: pgmap v115: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.9 MiB/s wr, 89 op/s 2023-08-11T12:28:21.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:20 smithi045 ceph-mon[130284]: pgmap v115: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.9 MiB/s wr, 89 op/s 2023-08-11T12:28:23.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:22 smithi194 ceph-mon[130905]: pgmap v116: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.9 MiB/s wr, 95 op/s 2023-08-11T12:28:23.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:22 smithi045 ceph-mon[130284]: pgmap v116: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.9 MiB/s wr, 95 op/s 2023-08-11T12:28:23.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:22 smithi008 ceph-mon[97158]: pgmap v116: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.9 MiB/s wr, 95 op/s 2023-08-11T12:28:25.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:24 smithi194 ceph-mon[130905]: pgmap v117: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.9 MiB/s wr, 90 op/s 2023-08-11T12:28:25.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:24 smithi045 ceph-mon[130284]: pgmap v117: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.9 MiB/s wr, 90 op/s 2023-08-11T12:28:25.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:24 smithi008 ceph-mon[97158]: pgmap v117: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.9 MiB/s wr, 90 op/s 2023-08-11T12:28:27.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:26 smithi194 ceph-mon[130905]: pgmap v118: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.9 MiB/s wr, 90 op/s 2023-08-11T12:28:27.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:26 smithi045 ceph-mon[130284]: pgmap v118: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.9 MiB/s wr, 90 op/s 2023-08-11T12:28:27.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:26 smithi008 ceph-mon[97158]: pgmap v118: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.9 MiB/s wr, 90 op/s 2023-08-11T12:28:29.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:28 smithi008 ceph-mon[97158]: pgmap v119: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.9 MiB/s wr, 96 op/s 2023-08-11T12:28:29.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:28 smithi194 ceph-mon[130905]: pgmap v119: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.9 MiB/s wr, 96 op/s 2023-08-11T12:28:29.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:28 smithi045 ceph-mon[130284]: pgmap v119: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.9 MiB/s wr, 96 op/s 2023-08-11T12:28:31.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:30 smithi008 ceph-mon[97158]: pgmap v120: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 12 op/s 2023-08-11T12:28:31.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:30 smithi194 ceph-mon[130905]: pgmap v120: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 12 op/s 2023-08-11T12:28:31.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:30 smithi045 ceph-mon[130284]: pgmap v120: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 12 op/s 2023-08-11T12:28:33.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:32 smithi194 ceph-mon[130905]: pgmap v121: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 27 KiB/s wr, 17 op/s 2023-08-11T12:28:33.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:32 smithi045 ceph-mon[130284]: pgmap v121: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 27 KiB/s wr, 17 op/s 2023-08-11T12:28:33.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:32 smithi008 ceph-mon[97158]: pgmap v121: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 27 KiB/s wr, 17 op/s 2023-08-11T12:28:35.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:34 smithi194 ceph-mon[130905]: pgmap v122: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 11 op/s 2023-08-11T12:28:35.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:34 smithi045 ceph-mon[130284]: pgmap v122: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 11 op/s 2023-08-11T12:28:35.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:34 smithi008 ceph-mon[97158]: pgmap v122: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 11 op/s 2023-08-11T12:28:35.741 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:28:35.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.964+0000 7f43bcbff700 1 -- 172.21.15.8:0/256784547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43b8101320 msgr2=0x7f43b810d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:28:35.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.964+0000 7f43bcbff700 1 --2- 172.21.15.8:0/256784547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43b8101320 0x7f43b810d830 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f43b0009f90 tx=0x7f43b000b330 comp rx=0 tx=0).stop 2023-08-11T12:28:35.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.964+0000 7f43bcbff700 1 -- 172.21.15.8:0/256784547 shutdown_connections 2023-08-11T12:28:35.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.964+0000 7f43bcbff700 1 --2- 172.21.15.8:0/256784547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43b8101320 0x7f43b810d830 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:35.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.964+0000 7f43bcbff700 1 --2- 172.21.15.8:0/256784547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43b8106970 0x7f43b8106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:35.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.964+0000 7f43bcbff700 1 --2- 172.21.15.8:0/256784547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43b8100960 0x7f43b8100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:35.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.964+0000 7f43bcbff700 1 -- 172.21.15.8:0/256784547 >> 172.21.15.8:0/256784547 conn(0x7f43b80fc490 msgr2=0x7f43b80fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:28:35.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.964+0000 7f43bcbff700 1 -- 172.21.15.8:0/256784547 shutdown_connections 2023-08-11T12:28:35.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.964+0000 7f43bcbff700 1 -- 172.21.15.8:0/256784547 wait complete. 2023-08-11T12:28:35.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.965+0000 7f43bcbff700 1 Processor -- start 2023-08-11T12:28:35.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.965+0000 7f43bcbff700 1 -- start start 2023-08-11T12:28:35.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.966+0000 7f43bcbff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43b8100960 0x7f43b819e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:35.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.966+0000 7f43bcbff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43b8101320 0x7f43b819eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:35.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.966+0000 7f43bcbff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43b8106970 0x7f43b81989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:35.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.966+0000 7f43bcbff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b8199060 con 0x7f43b8106970 2023-08-11T12:28:35.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.966+0000 7f43bcbff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b81991d0 con 0x7f43b8100960 2023-08-11T12:28:35.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.966+0000 7f43bcbff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b8199390 con 0x7f43b8101320 2023-08-11T12:28:35.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.966+0000 7f43b659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43b8100960 0x7f43b819e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:35.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.966+0000 7f43b6d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43b8106970 0x7f43b81989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:35.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.966+0000 7f43b659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43b8100960 0x7f43b819e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:50164/0 (socket says 172.21.15.8:50164) 2023-08-11T12:28:35.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.966+0000 7f43b659c700 1 -- 172.21.15.8:0/3323813912 learned_addr learned my addr 172.21.15.8:0/3323813912 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:28:35.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.966+0000 7f43affff700 1 --2- 172.21.15.8:0/3323813912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43b8101320 0x7f43b819eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:35.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.966+0000 7f43b659c700 1 -- 172.21.15.8:0/3323813912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43b8101320 msgr2=0x7f43b819eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:28:35.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.966+0000 7f43b659c700 1 --2- 172.21.15.8:0/3323813912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43b8101320 0x7f43b819eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:35.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.966+0000 7f43b659c700 1 -- 172.21.15.8:0/3323813912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43b8106970 msgr2=0x7f43b81989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:28:35.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.966+0000 7f43b659c700 1 --2- 172.21.15.8:0/3323813912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43b8106970 0x7f43b81989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:35.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.966+0000 7f43b659c700 1 -- 172.21.15.8:0/3323813912 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b0009c40 con 0x7f43b8100960 2023-08-11T12:28:35.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.966+0000 7f43b6d9d700 1 --2- 172.21.15.8:0/3323813912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43b8106970 0x7f43b81989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:28:35.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.967+0000 7f43b659c700 1 --2- 172.21.15.8:0/3323813912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43b8100960 0x7f43b819e980 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f43a800e9a0 tx=0x7f43a800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:28:35.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.967+0000 7f43af7fe700 1 -- 172.21.15.8:0/3323813912 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a8009790 con 0x7f43b8100960 2023-08-11T12:28:35.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.967+0000 7f43bcbff700 1 -- 172.21.15.8:0/3323813912 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b8199670 con 0x7f43b8100960 2023-08-11T12:28:35.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.967+0000 7f43af7fe700 1 -- 172.21.15.8:0/3323813912 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43a800cbd0 con 0x7f43b8100960 2023-08-11T12:28:35.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.967+0000 7f43af7fe700 1 -- 172.21.15.8:0/3323813912 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a8018680 con 0x7f43b8100960 2023-08-11T12:28:35.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.967+0000 7f43bcbff700 1 -- 172.21.15.8:0/3323813912 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b81a5970 con 0x7f43b8100960 2023-08-11T12:28:35.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.971+0000 7f43af7fe700 1 -- 172.21.15.8:0/3323813912 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f43a800cd40 con 0x7f43b8100960 2023-08-11T12:28:35.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.971+0000 7f43d0476b80 1 Processor -- start 2023-08-11T12:28:35.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.971+0000 7f43d0476b80 1 -- start start 2023-08-11T12:28:35.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.972+0000 7f43d0476b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d4be14310 0x563d4be146f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:35.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.972+0000 7f43d0476b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563d4be14c30 0x563d4be0e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:35.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.972+0000 7f43d0476b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4be0ee20 0x563d4be0f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:35.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.972+0000 7f43d0476b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d4bd67630 con 0x563d4be0ee20 2023-08-11T12:28:35.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.972+0000 7f43d0476b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d4bd64f50 con 0x563d4be14c30 2023-08-11T12:28:35.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.972+0000 7f43d0476b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d4bd60840 con 0x563d4be14310 2023-08-11T12:28:35.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.972+0000 7f43af7fe700 1 --2- 172.21.15.8:0/3323813912 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f43a40a00c0 0x7f43a40a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:35.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.972+0000 7f43b659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563d4be14c30 0x563d4be0e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:35.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.972+0000 7f43b659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563d4be14c30 0x563d4be0e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:50166/0 (socket says 172.21.15.8:50166) 2023-08-11T12:28:35.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.972+0000 7f43b659c700 1 -- 172.21.15.8:0/711659580 learned_addr learned my addr 172.21.15.8:0/711659580 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:28:35.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.972+0000 7f43affff700 1 --2- 172.21.15.8:0/711659580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4be0ee20 0x563d4be0f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:35.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.972+0000 7f43b6d9d700 1 --2- 172.21.15.8:0/711659580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d4be14310 0x563d4be146f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:35.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.972+0000 7f43af7fe700 1 -- 172.21.15.8:0/3323813912 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f43a8014070 con 0x7f43b8100960 2023-08-11T12:28:35.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.973+0000 7f43b6d9d700 1 --2- 172.21.15.8:0/3323813912 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f43a40a00c0 0x7f43a40a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:35.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.973+0000 7f43b659c700 1 -- 172.21.15.8:0/711659580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d4be14310 msgr2=0x563d4be146f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:28:35.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.973+0000 7f43b659c700 1 --2- 172.21.15.8:0/711659580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d4be14310 0x563d4be146f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:35.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.973+0000 7f43b659c700 1 -- 172.21.15.8:0/711659580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4be0ee20 msgr2=0x563d4be0f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:28:35.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.973+0000 7f43b659c700 1 --2- 172.21.15.8:0/711659580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4be0ee20 0x563d4be0f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:35.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.973+0000 7f43b659c700 1 -- 172.21.15.8:0/711659580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d4bbe0630 con 0x563d4be14c30 2023-08-11T12:28:35.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.973+0000 7f43affff700 1 --2- 172.21.15.8:0/711659580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4be0ee20 0x563d4be0f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:28:35.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.973+0000 7f43b659c700 1 --2- 172.21.15.8:0/711659580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563d4be14c30 0x563d4be0e8e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f43a800c5b0 tx=0x7f43a8098e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93894a17669bd42c server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:28:35.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.973+0000 7f43acff9700 1 -- 172.21.15.8:0/711659580 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a80996b0 con 0x563d4be14c30 2023-08-11T12:28:35.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.973+0000 7f43acff9700 1 -- 172.21.15.8:0/711659580 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43a8098fb0 con 0x563d4be14c30 2023-08-11T12:28:35.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.973+0000 7f43acff9700 1 -- 172.21.15.8:0/711659580 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a8098700 con 0x563d4be14c30 2023-08-11T12:28:35.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.974+0000 7f43d0476b80 1 -- 172.21.15.8:0/711659580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563d4be14c30 msgr2=0x563d4be0e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:28:35.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.974+0000 7f43b6d9d700 1 --2- 172.21.15.8:0/3323813912 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f43a40a00c0 0x7f43a40a2580 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f43b0009550 tx=0x7f43b0009700 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:28:35.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.974+0000 7f43d0476b80 1 --2- 172.21.15.8:0/711659580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563d4be14c30 0x563d4be0e8e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f43a800c5b0 tx=0x7f43a8098e80 comp rx=0 tx=0).stop 2023-08-11T12:28:35.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.974+0000 7f43d0476b80 1 -- 172.21.15.8:0/711659580 shutdown_connections 2023-08-11T12:28:35.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.974+0000 7f43d0476b80 1 --2- 172.21.15.8:0/711659580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d4be14310 0x563d4be146f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:35.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.974+0000 7f43d0476b80 1 --2- 172.21.15.8:0/711659580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4be0ee20 0x563d4be0f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:35.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.974+0000 7f43d0476b80 1 --2- 172.21.15.8:0/711659580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563d4be14c30 0x563d4be0e8e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:35.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.974+0000 7f43d0476b80 1 -- 172.21.15.8:0/711659580 >> 172.21.15.8:0/711659580 conn(0x563d4bd3b950 msgr2=0x563d4be093d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:28:35.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.974+0000 7f43d0476b80 1 -- 172.21.15.8:0/711659580 shutdown_connections 2023-08-11T12:28:35.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.974+0000 7f43d0476b80 1 -- 172.21.15.8:0/711659580 wait complete. 2023-08-11T12:28:35.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.975+0000 7f43d0476b80 1 -- start start 2023-08-11T12:28:35.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.975+0000 7f43d0476b80 1 Processor -- start 2023-08-11T12:28:35.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.975+0000 7f43d0476b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4be0ee20 0x563d4be1abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:35.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.975+0000 7f43d0476b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d4be14310 0x563d4be17f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:35.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.975+0000 7f43d0476b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563d4be14c30 0x563d4be18640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:35.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.975+0000 7f43d0476b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d4bcfeac0 con 0x563d4be0ee20 2023-08-11T12:28:35.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.975+0000 7f43d0476b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d4bcfe7c0 con 0x563d4be14c30 2023-08-11T12:28:35.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.975+0000 7f43d0476b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d4bbe2920 con 0x563d4be14310 2023-08-11T12:28:35.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.975+0000 7f43d0476b80 10 client.0 _ll_register_callbacks cb 0x563d4bd01ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:28:35.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.975+0000 7f43b6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563d4be14c30 0x563d4be18640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:35.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.975+0000 7f43b659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4be0ee20 0x563d4be1abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:35.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.976+0000 7f43b6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563d4be14c30 0x563d4be18640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:50182/0 (socket says 172.21.15.8:50182) 2023-08-11T12:28:35.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.976+0000 7f43b6d9d700 1 -- 172.21.15.8:0/3710575537 learned_addr learned my addr 172.21.15.8:0/3710575537 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:28:35.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.976+0000 7f43affff700 1 --2- 172.21.15.8:0/3710575537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d4be14310 0x563d4be17f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:35.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.976+0000 7f43b6d9d700 1 -- 172.21.15.8:0/3710575537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d4be14310 msgr2=0x563d4be17f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:28:35.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.976+0000 7f43b6d9d700 1 --2- 172.21.15.8:0/3710575537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d4be14310 0x563d4be17f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:35.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.976+0000 7f43b6d9d700 1 -- 172.21.15.8:0/3710575537 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4be0ee20 msgr2=0x563d4be1abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:28:35.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.976+0000 7f43b6d9d700 1 --2- 172.21.15.8:0/3710575537 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4be0ee20 0x563d4be1abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:35.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.976+0000 7f43b6d9d700 1 -- 172.21.15.8:0/3710575537 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a0009860 con 0x563d4be14c30 2023-08-11T12:28:35.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.976+0000 7f43b659c700 1 --2- 172.21.15.8:0/3710575537 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4be0ee20 0x563d4be1abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:28:35.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.976+0000 7f43b6d9d700 1 --2- 172.21.15.8:0/3710575537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563d4be14c30 0x563d4be18640 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f43b0015000 tx=0x7f43b0009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5408931cadfba19 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:28:35.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.976+0000 7f439dffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:28:35.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.976+0000 7f439dffb700 1 -- 172.21.15.8:0/3710575537 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b0027040 con 0x563d4be14c30 2023-08-11T12:28:35.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.976+0000 7f43d0476b80 1 -- 172.21.15.8:0/3710575537 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563d4be01a90 con 0x563d4be14c30 2023-08-11T12:28:35.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.977+0000 7f439dffb700 1 -- 172.21.15.8:0/3710575537 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f43b0003e40 con 0x563d4be14c30 2023-08-11T12:28:35.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.977+0000 7f439dffb700 1 -- 172.21.15.8:0/3710575537 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43b000e040 con 0x563d4be14c30 2023-08-11T12:28:35.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.977+0000 7f43d0476b80 10 client.26249 fetch_fsmap learned FSMap version 39 2023-08-11T12:28:35.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.977+0000 7f43d0476b80 1 -- 172.21.15.8:0/3710575537 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f43b81a5970 con 0x563d4be14c30 2023-08-11T12:28:35.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.977+0000 7f439dffb700 1 -- 172.21.15.8:0/3710575537 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563d4be01a90 con 0x563d4be14c30 2023-08-11T12:28:35.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.977+0000 7f439dffb700 1 -- 172.21.15.8:0/3710575537 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 39) v1 ==== 7966+0+0 (secure 0 0 0) 0x7f43b0020930 con 0x563d4be14c30 2023-08-11T12:28:35.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.977+0000 7f43d0476b80 10 client.26249 fetch_fsmap finished waiting for FSMap version 39 2023-08-11T12:28:35.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.977+0000 7f43d0476b80 10 client.26249 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:28:35.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.977+0000 7f43d0476b80 20 client.26249 populate_metadata read hostname 'smithi008' 2023-08-11T12:28:35.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.977+0000 7f43d0476b80 1 --2- 172.21.15.8:0/3710575537 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x563d4be284b0 0x563d4be2a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:35.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.977+0000 7f43d0476b80 4 client.26249 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:28:35.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.977+0000 7f43d0476b80 1 -- 172.21.15.8:0/3710575537 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563d4bddd4e0 con 0x563d4be284b0 2023-08-11T12:28:35.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.978+0000 7f43b659c700 1 --2- 172.21.15.8:0/3710575537 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x563d4be284b0 0x563d4be2a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:35.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.978+0000 7f43b659c700 1 --2- 172.21.15.8:0/3710575537 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x563d4be284b0 0x563d4be2a8d0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95a665dc683bac49 server_cookie=fef301b88c240221 in_seq=0 out_seq=0 2023-08-11T12:28:35.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.978+0000 7f439dffb700 10 client.26249 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:28:35.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.979+0000 7f439dffb700 1 -- 172.21.15.8:0/3710575537 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x563d4bddd4e0 con 0x563d4be284b0 2023-08-11T12:28:35.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.979+0000 7f439dffb700 10 client.26249 handle_command_reply: tid=0 2023-08-11T12:28:35.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.979+0000 7f43d0476b80 1 client.26249 shutdown 2023-08-11T12:28:35.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.979+0000 7f43d0476b80 1 -- 172.21.15.8:0/3710575537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563d4be14c30 msgr2=0x563d4be18640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:28:35.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.979+0000 7f43d0476b80 1 --2- 172.21.15.8:0/3710575537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563d4be14c30 0x563d4be18640 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f43b0015000 tx=0x7f43b0009920 comp rx=0 tx=0).stop 2023-08-11T12:28:35.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.979+0000 7f43d0476b80 1 -- 172.21.15.8:0/3710575537 shutdown_connections 2023-08-11T12:28:35.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.979+0000 7f43d0476b80 1 --2- 172.21.15.8:0/3710575537 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x563d4be284b0 0x563d4be2a8d0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:35.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.979+0000 7f43d0476b80 1 --2- 172.21.15.8:0/3710575537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563d4be14c30 0x563d4be18640 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:35.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.979+0000 7f43d0476b80 1 --2- 172.21.15.8:0/3710575537 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4be0ee20 0x563d4be1abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:35.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.979+0000 7f439dffb700 0 client.26249 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:28:35.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.979+0000 7f43d0476b80 1 --2- 172.21.15.8:0/3710575537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d4be14310 0x563d4be17f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:35.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.979+0000 7f43d0476b80 1 -- 172.21.15.8:0/3710575537 >> 172.21.15.8:0/3710575537 conn(0x563d4bd3b950 msgr2=0x563d4be03cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:28:35.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.979+0000 7f43d0476b80 1 -- 172.21.15.8:0/3710575537 shutdown_connections 2023-08-11T12:28:35.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.979+0000 7f43d0476b80 1 -- 172.21.15.8:0/3710575537 wait complete. 2023-08-11T12:28:35.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.980+0000 7f43d0476b80 20 client.26249 trim_cache size 0 max 16384 2023-08-11T12:28:36.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.997+0000 7f43d0476b80 1 Processor -- start 2023-08-11T12:28:36.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.997+0000 7f43d0476b80 1 -- start start 2023-08-11T12:28:36.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.997+0000 7f43d0476b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563d4be0ee20 0x563d4be1f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:36.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.997+0000 7f43d0476b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d4be14310 0x563d4be1a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:36.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.997+0000 7f43d0476b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4be14c30 0x563d4be1abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:36.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.997+0000 7f43d0476b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d4be18c40 con 0x563d4be14c30 2023-08-11T12:28:36.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.997+0000 7f43d0476b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d4be24dc0 con 0x563d4be0ee20 2023-08-11T12:28:36.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.997+0000 7f43d0476b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d4be05de0 con 0x563d4be14310 2023-08-11T12:28:36.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.998+0000 7f43b659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563d4be0ee20 0x563d4be1f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:36.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.998+0000 7f43b6d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4be14c30 0x563d4be1abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:36.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.998+0000 7f43b659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563d4be0ee20 0x563d4be1f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:50186/0 (socket says 172.21.15.8:50186) 2023-08-11T12:28:36.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.998+0000 7f43b659c700 1 -- 172.21.15.8:0/303809129 learned_addr learned my addr 172.21.15.8:0/303809129 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:28:36.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.998+0000 7f43affff700 1 --2- 172.21.15.8:0/303809129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d4be14310 0x563d4be1a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:36.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.998+0000 7f43b6d9d700 1 -- 172.21.15.8:0/303809129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d4be14310 msgr2=0x563d4be1a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:28:36.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.998+0000 7f43b6d9d700 1 --2- 172.21.15.8:0/303809129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d4be14310 0x563d4be1a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:36.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.998+0000 7f43b6d9d700 1 -- 172.21.15.8:0/303809129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563d4be0ee20 msgr2=0x563d4be1f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:28:36.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.998+0000 7f43b6d9d700 1 --2- 172.21.15.8:0/303809129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563d4be0ee20 0x563d4be1f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:36.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.998+0000 7f43b6d9d700 1 -- 172.21.15.8:0/303809129 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d4bb8cde0 con 0x563d4be14c30 2023-08-11T12:28:36.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.998+0000 7f43b659c700 1 --2- 172.21.15.8:0/303809129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563d4be0ee20 0x563d4be1f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:28:36.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.998+0000 7f43affff700 1 --2- 172.21.15.8:0/303809129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d4be14310 0x563d4be1a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:28:36.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.998+0000 7f43b6d9d700 1 --2- 172.21.15.8:0/303809129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4be14c30 0x563d4be1abe0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f43b0009790 tx=0x7f43b0004d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc06dd387d6cf08 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:28:36.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.998+0000 7f43ad7fa700 1 -- 172.21.15.8:0/303809129 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b000e070 con 0x563d4be14c30 2023-08-11T12:28:36.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.999+0000 7f43ad7fa700 1 -- 172.21.15.8:0/303809129 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43b001e430 con 0x563d4be14c30 2023-08-11T12:28:36.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.999+0000 7f43ad7fa700 1 -- 172.21.15.8:0/303809129 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b001eae0 con 0x563d4be14c30 2023-08-11T12:28:36.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.999+0000 7f43d0476b80 1 -- 172.21.15.8:0/303809129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4be14c30 msgr2=0x563d4be1abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:28:36.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.999+0000 7f43d0476b80 1 --2- 172.21.15.8:0/303809129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4be14c30 0x563d4be1abe0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f43b0009790 tx=0x7f43b0004d20 comp rx=0 tx=0).stop 2023-08-11T12:28:36.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.999+0000 7f43d0476b80 1 -- 172.21.15.8:0/303809129 shutdown_connections 2023-08-11T12:28:36.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.999+0000 7f43d0476b80 1 --2- 172.21.15.8:0/303809129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4be14c30 0x563d4be1abe0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:36.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.999+0000 7f43d0476b80 1 --2- 172.21.15.8:0/303809129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563d4be0ee20 0x563d4be1f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:36.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.999+0000 7f43d0476b80 1 --2- 172.21.15.8:0/303809129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d4be14310 0x563d4be1a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:36.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.999+0000 7f43d0476b80 1 -- 172.21.15.8:0/303809129 >> 172.21.15.8:0/303809129 conn(0x563d4bd3b950 msgr2=0x563d4be09280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:28:36.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.999+0000 7f43d0476b80 1 -- 172.21.15.8:0/303809129 shutdown_connections 2023-08-11T12:28:36.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:35.999+0000 7f43d0476b80 1 -- 172.21.15.8:0/303809129 wait complete. 2023-08-11T12:28:36.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.000+0000 7f43d0476b80 1 -- start start 2023-08-11T12:28:36.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.000+0000 7f43d0476b80 1 Processor -- start 2023-08-11T12:28:36.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.000+0000 7f43d0476b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d4be0ee20 0x563d4be1d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:36.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.000+0000 7f43d0476b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4be14310 0x563d4be1dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:36.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.000+0000 7f43d0476b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563d4be14c30 0x563d4be7b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:36.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.000+0000 7f43d0476b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d4be7b690 con 0x563d4be14310 2023-08-11T12:28:36.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.000+0000 7f43d0476b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d4be7b800 con 0x563d4be14c30 2023-08-11T12:28:36.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.000+0000 7f43d0476b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d4be7b9c0 con 0x563d4be0ee20 2023-08-11T12:28:36.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.001+0000 7f43d0476b80 10 client.0 _ll_register_callbacks cb 0x7f43b0003a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:28:36.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.001+0000 7f43b659c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d4be0ee20 0x563d4be1d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:36.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.001+0000 7f43b6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563d4be14c30 0x563d4be7b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:36.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.001+0000 7f43affff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4be14310 0x563d4be1dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:36.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.001+0000 7f43b659c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d4be0ee20 0x563d4be1d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:38932/0 (socket says 172.21.15.8:38932) 2023-08-11T12:28:36.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.001+0000 7f43b6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563d4be14c30 0x563d4be7b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:50190/0 (socket says 172.21.15.8:50190) 2023-08-11T12:28:36.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.001+0000 7f43b659c700 1 -- 172.21.15.8:0/1349815211 learned_addr learned my addr 172.21.15.8:0/1349815211 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:28:36.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.001+0000 7f43b659c700 1 -- 172.21.15.8:0/1349815211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563d4be14c30 msgr2=0x563d4be7b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:28:36.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.001+0000 7f43b659c700 1 --2- 172.21.15.8:0/1349815211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563d4be14c30 0x563d4be7b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:36.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.001+0000 7f43b659c700 1 -- 172.21.15.8:0/1349815211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4be14310 msgr2=0x563d4be1dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:28:36.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.001+0000 7f43b659c700 1 --2- 172.21.15.8:0/1349815211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4be14310 0x563d4be1dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:36.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.001+0000 7f43b659c700 1 -- 172.21.15.8:0/1349815211 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563d4bbe0630 con 0x563d4be0ee20 2023-08-11T12:28:36.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.001+0000 7f43affff700 1 --2- 172.21.15.8:0/1349815211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4be14310 0x563d4be1dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:28:36.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.001+0000 7f43b659c700 1 --2- 172.21.15.8:0/1349815211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d4be0ee20 0x563d4be1d6a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f43a80c9050 tx=0x7f43a8010aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9088e73555e595c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:28:36.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.001+0000 7f439dffb700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:28:36.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.002+0000 7f439dffb700 1 -- 172.21.15.8:0/1349815211 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a80a0dc0 con 0x563d4be0ee20 2023-08-11T12:28:36.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.002+0000 7f43d0476b80 1 -- 172.21.15.8:0/1349815211 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f43a8098fb0 con 0x563d4be0ee20 2023-08-11T12:28:36.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.002+0000 7f439dffb700 1 -- 172.21.15.8:0/1349815211 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f43a809cde0 con 0x563d4be0ee20 2023-08-11T12:28:36.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.002+0000 7f439dffb700 1 -- 172.21.15.8:0/1349815211 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43a8099420 con 0x563d4be0ee20 2023-08-11T12:28:36.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.002+0000 7f43d0476b80 10 client.26263 fetch_fsmap learned FSMap version 39 2023-08-11T12:28:36.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.002+0000 7f43d0476b80 1 -- 172.21.15.8:0/1349815211 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f43b81a5970 con 0x563d4be0ee20 2023-08-11T12:28:36.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.002+0000 7f439dffb700 1 -- 172.21.15.8:0/1349815211 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43a8098fb0 con 0x563d4be0ee20 2023-08-11T12:28:36.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.002+0000 7f439dffb700 1 -- 172.21.15.8:0/1349815211 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 39) v1 ==== 7966+0+0 (secure 0 0 0) 0x7f43a8093cc0 con 0x563d4be0ee20 2023-08-11T12:28:36.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.002+0000 7f43d0476b80 10 client.26263 fetch_fsmap finished waiting for FSMap version 39 2023-08-11T12:28:36.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.002+0000 7f43d0476b80 10 client.26263 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:28:36.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.002+0000 7f43d0476b80 20 client.26263 populate_metadata read hostname 'smithi008' 2023-08-11T12:28:36.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.002+0000 7f43d0476b80 1 --2- 172.21.15.8:0/1349815211 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x563d4be7cfb0 0x563d4be7f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:28:36.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.002+0000 7f43d0476b80 4 client.26263 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:28:36.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.002+0000 7f43d0476b80 1 -- 172.21.15.8:0/1349815211 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563d4bd59820 con 0x563d4be7cfb0 2023-08-11T12:28:36.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.003+0000 7f43affff700 1 --2- 172.21.15.8:0/1349815211 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x563d4be7cfb0 0x563d4be7f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:28:36.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.003+0000 7f439dffb700 10 client.26263 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:28:36.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.003+0000 7f43affff700 1 --2- 172.21.15.8:0/1349815211 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x563d4be7cfb0 0x563d4be7f3d0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a21ceccba98b8a8 server_cookie=50fa117b5f3c99dc in_seq=0 out_seq=0 2023-08-11T12:28:36.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.003+0000 7f439dffb700 1 -- 172.21.15.8:0/1349815211 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x563d4bd59820 con 0x563d4be7cfb0 2023-08-11T12:28:36.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.003+0000 7f439dffb700 10 client.26263 handle_command_reply: tid=0 2023-08-11T12:28:36.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.003+0000 7f43d0476b80 1 client.26263 shutdown 2023-08-11T12:28:36.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.004+0000 7f43d0476b80 1 -- 172.21.15.8:0/1349815211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d4be0ee20 msgr2=0x563d4be1d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:28:36.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.004+0000 7f43d0476b80 1 --2- 172.21.15.8:0/1349815211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d4be0ee20 0x563d4be1d6a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f43a80c9050 tx=0x7f43a8010aa0 comp rx=0 tx=0).stop 2023-08-11T12:28:36.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.004+0000 7f43d0476b80 1 -- 172.21.15.8:0/1349815211 shutdown_connections 2023-08-11T12:28:36.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.004+0000 7f43d0476b80 1 --2- 172.21.15.8:0/1349815211 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x563d4be7cfb0 0x563d4be7f3d0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:36.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.004+0000 7f43d0476b80 1 --2- 172.21.15.8:0/1349815211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d4be0ee20 0x563d4be1d6a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:36.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.004+0000 7f43d0476b80 1 --2- 172.21.15.8:0/1349815211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563d4be14c30 0x563d4be7b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:36.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.004+0000 7f439dffb700 0 client.26263 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:28:36.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.004+0000 7f43d0476b80 1 --2- 172.21.15.8:0/1349815211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4be14310 0x563d4be1dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:36.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.004+0000 7f43d0476b80 1 -- 172.21.15.8:0/1349815211 >> 172.21.15.8:0/1349815211 conn(0x563d4bd3b950 msgr2=0x563d4be177a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:28:36.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.004+0000 7f43d0476b80 1 -- 172.21.15.8:0/1349815211 shutdown_connections 2023-08-11T12:28:36.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.004+0000 7f43d0476b80 1 -- 172.21.15.8:0/1349815211 wait complete. 2023-08-11T12:28:36.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.004+0000 7f43d0476b80 20 client.26263 trim_cache size 0 max 16384 2023-08-11T12:28:36.022 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:28:36.022 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:28:36.022 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:28:36.022 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:28:36.023 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:28:36.023 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:28:36.023 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:28:36.023 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:28:36.023 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:28:36.024 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:28:36.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.004+0000 7f43bcbff700 1 -- 172.21.15.8:0/3323813912 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f43a40a00c0 msgr2=0x7f43a40a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:28:36.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.004+0000 7f43bcbff700 1 --2- 172.21.15.8:0/3323813912 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f43a40a00c0 0x7f43a40a2580 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f43b0009550 tx=0x7f43b0009700 comp rx=0 tx=0).stop 2023-08-11T12:28:36.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.004+0000 7f43bcbff700 1 -- 172.21.15.8:0/3323813912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43b8100960 msgr2=0x7f43b819e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:28:36.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.004+0000 7f43bcbff700 1 --2- 172.21.15.8:0/3323813912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43b8100960 0x7f43b819e980 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f43a800e9a0 tx=0x7f43a800ecb0 comp rx=0 tx=0).stop 2023-08-11T12:28:36.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.005+0000 7f43bcbff700 1 -- 172.21.15.8:0/3323813912 shutdown_connections 2023-08-11T12:28:36.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.005+0000 7f43bcbff700 1 --2- 172.21.15.8:0/3323813912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43b8106970 0x7f43b81989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:36.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.005+0000 7f43bcbff700 1 --2- 172.21.15.8:0/3323813912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43b8100960 0x7f43b819e980 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:36.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.005+0000 7f43bcbff700 1 --2- 172.21.15.8:0/3323813912 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f43a40a00c0 0x7f43a40a2580 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:36.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.005+0000 7f43bcbff700 1 --2- 172.21.15.8:0/3323813912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43b8101320 0x7f43b819eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:28:36.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.005+0000 7f43bcbff700 1 -- 172.21.15.8:0/3323813912 >> 172.21.15.8:0/3323813912 conn(0x7f43b80fc490 msgr2=0x7f43b810bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:28:36.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.005+0000 7f43bcbff700 1 -- 172.21.15.8:0/3323813912 shutdown_connections 2023-08-11T12:28:36.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:28:36.005+0000 7f43bcbff700 1 -- 172.21.15.8:0/3323813912 wait complete. 2023-08-11T12:28:36.028 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:28:37.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:36 smithi045 ceph-mon[130284]: pgmap v123: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 11 op/s 2023-08-11T12:28:37.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:36 smithi008 ceph-mon[97158]: pgmap v123: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 11 op/s 2023-08-11T12:28:37.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:36 smithi194 ceph-mon[130905]: pgmap v123: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 11 op/s 2023-08-11T12:28:39.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:38 smithi008 ceph-mon[97158]: pgmap v124: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 KiB/s wr, 16 op/s 2023-08-11T12:28:39.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:38 smithi045 ceph-mon[130284]: pgmap v124: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 KiB/s wr, 16 op/s 2023-08-11T12:28:39.396 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:38 smithi194 ceph-mon[130905]: pgmap v124: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 KiB/s wr, 16 op/s 2023-08-11T12:28:41.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:40 smithi008 ceph-mon[97158]: pgmap v125: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 KiB/s wr, 10 op/s 2023-08-11T12:28:41.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:40 smithi194 ceph-mon[130905]: pgmap v125: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 KiB/s wr, 10 op/s 2023-08-11T12:28:41.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:40 smithi045 ceph-mon[130284]: pgmap v125: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 KiB/s wr, 10 op/s 2023-08-11T12:28:43.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:42 smithi045 ceph-mon[130284]: pgmap v126: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.4 KiB/s wr, 14 op/s 2023-08-11T12:28:43.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:42 smithi008 ceph-mon[97158]: pgmap v126: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.4 KiB/s wr, 14 op/s 2023-08-11T12:28:43.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:42 smithi194 ceph-mon[130905]: pgmap v126: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.4 KiB/s wr, 14 op/s 2023-08-11T12:28:45.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:44 smithi008 ceph-mon[97158]: pgmap v127: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.5 KiB/s wr, 9 op/s 2023-08-11T12:28:45.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:44 smithi008 ceph-mon[97158]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:28:45.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:44 smithi194 ceph-mon[130905]: pgmap v127: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.5 KiB/s wr, 9 op/s 2023-08-11T12:28:45.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:44 smithi194 ceph-mon[130905]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:28:45.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:44 smithi045 ceph-mon[130284]: pgmap v127: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.5 KiB/s wr, 9 op/s 2023-08-11T12:28:45.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:44 smithi045 ceph-mon[130284]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:28:47.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:46 smithi008 ceph-mon[97158]: pgmap v128: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.5 KiB/s wr, 9 op/s 2023-08-11T12:28:47.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:46 smithi194 ceph-mon[130905]: pgmap v128: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.5 KiB/s wr, 9 op/s 2023-08-11T12:28:47.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:46 smithi045 ceph-mon[130284]: pgmap v128: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.5 KiB/s wr, 9 op/s 2023-08-11T12:28:49.274 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:48 smithi045 ceph-mon[130284]: pgmap v129: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 3.7 KiB/s wr, 13 op/s 2023-08-11T12:28:49.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:48 smithi008 ceph-mon[97158]: pgmap v129: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 3.7 KiB/s wr, 13 op/s 2023-08-11T12:28:49.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:48 smithi194 ceph-mon[130905]: pgmap v129: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 3.7 KiB/s wr, 13 op/s 2023-08-11T12:28:50.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:49 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:28:50.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:49 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:28:50.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:49 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:28:50.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:49 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:28:50.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:49 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:28:50.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:49 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:28:50.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:49 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:28:50.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:49 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:28:50.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:49 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:28:50.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:49 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:28:50.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:49 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:28:50.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:49 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:28:51.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:50 smithi008 ceph-mon[97158]: pgmap v130: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2023-08-11T12:28:51.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:50 smithi194 ceph-mon[130905]: pgmap v130: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2023-08-11T12:28:51.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:50 smithi045 ceph-mon[130284]: pgmap v130: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2023-08-11T12:28:53.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:52 smithi008 ceph-mon[97158]: pgmap v131: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2023-08-11T12:28:53.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:52 smithi194 ceph-mon[130905]: pgmap v131: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2023-08-11T12:28:53.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:52 smithi045 ceph-mon[130284]: pgmap v131: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2023-08-11T12:28:55.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:54 smithi008 ceph-mon[97158]: pgmap v132: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1023 B/s wr, 8 op/s 2023-08-11T12:28:55.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:54 smithi008 ceph-mon[97158]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:28:55.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:54 smithi194 ceph-mon[130905]: pgmap v132: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1023 B/s wr, 8 op/s 2023-08-11T12:28:55.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:54 smithi194 ceph-mon[130905]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:28:55.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:54 smithi045 ceph-mon[130284]: pgmap v132: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1023 B/s wr, 8 op/s 2023-08-11T12:28:55.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:54 smithi045 ceph-mon[130284]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:28:57.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:56 smithi008 ceph-mon[97158]: pgmap v133: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1023 B/s wr, 8 op/s 2023-08-11T12:28:57.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:56 smithi194 ceph-mon[130905]: pgmap v133: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1023 B/s wr, 8 op/s 2023-08-11T12:28:57.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:56 smithi045 ceph-mon[130284]: pgmap v133: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1023 B/s wr, 8 op/s 2023-08-11T12:28:59.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:28:58 smithi008 ceph-mon[97158]: pgmap v134: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1023 B/s wr, 13 op/s 2023-08-11T12:28:59.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:28:58 smithi194 ceph-mon[130905]: pgmap v134: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1023 B/s wr, 13 op/s 2023-08-11T12:28:59.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:28:58 smithi045 ceph-mon[130284]: pgmap v134: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1023 B/s wr, 13 op/s 2023-08-11T12:29:01.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:00 smithi008 ceph-mon[97158]: pgmap v135: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 8 op/s 2023-08-11T12:29:01.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:00 smithi194 ceph-mon[130905]: pgmap v135: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 8 op/s 2023-08-11T12:29:01.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:00 smithi045 ceph-mon[130284]: pgmap v135: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 8 op/s 2023-08-11T12:29:03.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:02 smithi008 ceph-mon[97158]: pgmap v136: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 25 op/s 2023-08-11T12:29:03.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:02 smithi194 ceph-mon[130905]: pgmap v136: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 25 op/s 2023-08-11T12:29:03.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:02 smithi045 ceph-mon[130284]: pgmap v136: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 25 op/s 2023-08-11T12:29:05.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:04 smithi008 ceph-mon[97158]: pgmap v137: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-08-11T12:29:05.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:04 smithi194 ceph-mon[130905]: pgmap v137: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-08-11T12:29:05.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:04 smithi045 ceph-mon[130284]: pgmap v137: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-08-11T12:29:06.029 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:29:06.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.263+0000 7fa9935ff700 1 -- 172.21.15.8:0/1862913930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa98c100960 msgr2=0x7fa98c100de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:29:06.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.263+0000 7fa9935ff700 1 --2- 172.21.15.8:0/1862913930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa98c100960 0x7fa98c100de0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa97c009990 tx=0x7fa97c009ca0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.264+0000 7fa9935ff700 1 -- 172.21.15.8:0/1862913930 shutdown_connections 2023-08-11T12:29:06.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.264+0000 7fa9935ff700 1 --2- 172.21.15.8:0/1862913930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa98c106970 0x7fa98c106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.264+0000 7fa9935ff700 1 --2- 172.21.15.8:0/1862913930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa98c101320 0x7fa98c10d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.264+0000 7fa9935ff700 1 --2- 172.21.15.8:0/1862913930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa98c100960 0x7fa98c100de0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.264+0000 7fa9935ff700 1 -- 172.21.15.8:0/1862913930 >> 172.21.15.8:0/1862913930 conn(0x7fa98c0fc490 msgr2=0x7fa98c0fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:29:06.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.264+0000 7fa9935ff700 1 -- 172.21.15.8:0/1862913930 shutdown_connections 2023-08-11T12:29:06.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.264+0000 7fa9935ff700 1 -- 172.21.15.8:0/1862913930 wait complete. 2023-08-11T12:29:06.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.265+0000 7fa9935ff700 1 Processor -- start 2023-08-11T12:29:06.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.265+0000 7fa9935ff700 1 -- start start 2023-08-11T12:29:06.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.265+0000 7fa9935ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa98c100960 0x7fa98c19ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:06.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.265+0000 7fa9935ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa98c101320 0x7fa98c19efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:06.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.265+0000 7fa9935ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa98c106970 0x7fa98c198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:06.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.265+0000 7fa9935ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c199240 con 0x7fa98c106970 2023-08-11T12:29:06.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.265+0000 7fa9935ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c1993b0 con 0x7fa98c100960 2023-08-11T12:29:06.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.265+0000 7fa9935ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c199570 con 0x7fa98c101320 2023-08-11T12:29:06.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.265+0000 7fa99139b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa98c100960 0x7fa98c19ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:06.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.265+0000 7fa99139b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa98c100960 0x7fa98c19ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:46596/0 (socket says 172.21.15.8:46596) 2023-08-11T12:29:06.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.265+0000 7fa99139b700 1 -- 172.21.15.8:0/21535660 learned_addr learned my addr 172.21.15.8:0/21535660 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:29:06.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.266+0000 7fa991b9c700 1 --2- 172.21.15.8:0/21535660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa98c106970 0x7fa98c198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:06.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.266+0000 7fa990b9a700 1 --2- 172.21.15.8:0/21535660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa98c101320 0x7fa98c19efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:06.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.266+0000 7fa99139b700 1 -- 172.21.15.8:0/21535660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa98c101320 msgr2=0x7fa98c19efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:29:06.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.266+0000 7fa99139b700 1 --2- 172.21.15.8:0/21535660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa98c101320 0x7fa98c19efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.266+0000 7fa99139b700 1 -- 172.21.15.8:0/21535660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa98c106970 msgr2=0x7fa98c198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:29:06.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.266+0000 7fa99139b700 1 --2- 172.21.15.8:0/21535660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa98c106970 0x7fa98c198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.266+0000 7fa99139b700 1 -- 172.21.15.8:0/21535660 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97c0095f0 con 0x7fa98c100960 2023-08-11T12:29:06.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.266+0000 7fa99139b700 1 --2- 172.21.15.8:0/21535660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa98c100960 0x7fa98c19ea90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa98800e9a0 tx=0x7fa98800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:29:06.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.266+0000 7fa9827fc700 1 -- 172.21.15.8:0/21535660 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa988009790 con 0x7fa98c100960 2023-08-11T12:29:06.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.266+0000 7fa9935ff700 1 -- 172.21.15.8:0/21535660 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98c199850 con 0x7fa98c100960 2023-08-11T12:29:06.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.266+0000 7fa9827fc700 1 -- 172.21.15.8:0/21535660 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa988010430 con 0x7fa98c100960 2023-08-11T12:29:06.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.266+0000 7fa9827fc700 1 -- 172.21.15.8:0/21535660 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa988018680 con 0x7fa98c100960 2023-08-11T12:29:06.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.267+0000 7fa9935ff700 1 -- 172.21.15.8:0/21535660 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98c1a5a60 con 0x7fa98c100960 2023-08-11T12:29:06.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.270+0000 7fa9827fc700 1 -- 172.21.15.8:0/21535660 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7fa9880105a0 con 0x7fa98c100960 2023-08-11T12:29:06.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.271+0000 7fa9a6ec1b80 1 Processor -- start 2023-08-11T12:29:06.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.271+0000 7fa9a6ec1b80 1 -- start start 2023-08-11T12:29:06.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.272+0000 7fa9a6ec1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562a630ef310 0x562a630ef6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:06.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.272+0000 7fa9827fc700 1 --2- 172.21.15.8:0/21535660 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fa9780a00c0 0x7fa9780a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:06.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.272+0000 7fa9a6ec1b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a630efc30 0x562a630e98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:06.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.272+0000 7fa9a6ec1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a630e9e20 0x562a630ea260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:06.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.272+0000 7fa9a6ec1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a63042630 con 0x562a630ef310 2023-08-11T12:29:06.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.272+0000 7fa9a6ec1b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6303ff50 con 0x562a630efc30 2023-08-11T12:29:06.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.272+0000 7fa9a6ec1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6303b840 con 0x562a630e9e20 2023-08-11T12:29:06.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.272+0000 7fa9827fc700 1 -- 172.21.15.8:0/21535660 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fa988014070 con 0x7fa98c100960 2023-08-11T12:29:06.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.272+0000 7fa991b9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562a630ef310 0x562a630ef6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:06.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.272+0000 7fa99139b700 1 --2- 172.21.15.8:0/21535660 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fa9780a00c0 0x7fa9780a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:06.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.272+0000 7fa991b9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562a630ef310 0x562a630ef6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36234/0 (socket says 172.21.15.8:36234) 2023-08-11T12:29:06.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.272+0000 7fa991b9c700 1 -- 172.21.15.8:0/3882805923 learned_addr learned my addr 172.21.15.8:0/3882805923 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:29:06.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.272+0000 7fa990b9a700 1 --2- 172.21.15.8:0/3882805923 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a630efc30 0x562a630e98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:06.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.272+0000 7fa991b9c700 1 --2- 172.21.15.8:0/3882805923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a630e9e20 0x562a630ea260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:06.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.272+0000 7fa991b9c700 1 -- 172.21.15.8:0/3882805923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a630e9e20 msgr2=0x562a630ea260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:29:06.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.272+0000 7fa991b9c700 1 --2- 172.21.15.8:0/3882805923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a630e9e20 0x562a630ea260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.272+0000 7fa991b9c700 1 -- 172.21.15.8:0/3882805923 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a630efc30 msgr2=0x562a630e98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:29:06.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.272+0000 7fa991b9c700 1 --2- 172.21.15.8:0/3882805923 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a630efc30 0x562a630e98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.273+0000 7fa991b9c700 1 -- 172.21.15.8:0/3882805923 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a62ebb630 con 0x562a630ef310 2023-08-11T12:29:06.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.273+0000 7fa990b9a700 1 --2- 172.21.15.8:0/3882805923 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a630efc30 0x562a630e98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:29:06.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.273+0000 7fa99139b700 1 --2- 172.21.15.8:0/21535660 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fa9780a00c0 0x7fa9780a2580 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa988095390 tx=0x7fa988010b80 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:29:06.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.273+0000 7fa991b9c700 1 --2- 172.21.15.8:0/3882805923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562a630ef310 0x562a630ef6f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa984013a90 tx=0x7fa984009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8baff89b6d17ca47 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:29:06.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.273+0000 7fa9777fe700 1 -- 172.21.15.8:0/3882805923 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98400e040 con 0x562a630ef310 2023-08-11T12:29:06.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.273+0000 7fa9777fe700 1 -- 172.21.15.8:0/3882805923 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa98400f040 con 0x562a630ef310 2023-08-11T12:29:06.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.273+0000 7fa9777fe700 1 -- 172.21.15.8:0/3882805923 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98400fc00 con 0x562a630ef310 2023-08-11T12:29:06.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.274+0000 7fa9a6ec1b80 1 -- 172.21.15.8:0/3882805923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562a630ef310 msgr2=0x562a630ef6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:29:06.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.274+0000 7fa9a6ec1b80 1 --2- 172.21.15.8:0/3882805923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562a630ef310 0x562a630ef6f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa984013a90 tx=0x7fa984009920 comp rx=0 tx=0).stop 2023-08-11T12:29:06.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.274+0000 7fa9a6ec1b80 1 -- 172.21.15.8:0/3882805923 shutdown_connections 2023-08-11T12:29:06.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.274+0000 7fa9a6ec1b80 1 --2- 172.21.15.8:0/3882805923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a630e9e20 0x562a630ea260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.274+0000 7fa9a6ec1b80 1 --2- 172.21.15.8:0/3882805923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562a630ef310 0x562a630ef6f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.274+0000 7fa9a6ec1b80 1 --2- 172.21.15.8:0/3882805923 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a630efc30 0x562a630e98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.274+0000 7fa9a6ec1b80 1 -- 172.21.15.8:0/3882805923 >> 172.21.15.8:0/3882805923 conn(0x562a63016950 msgr2=0x562a630e43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:29:06.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.274+0000 7fa9a6ec1b80 1 -- 172.21.15.8:0/3882805923 shutdown_connections 2023-08-11T12:29:06.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.274+0000 7fa9a6ec1b80 1 -- 172.21.15.8:0/3882805923 wait complete. 2023-08-11T12:29:06.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.274+0000 7fa9a6ec1b80 1 -- start start 2023-08-11T12:29:06.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.275+0000 7fa9a6ec1b80 1 Processor -- start 2023-08-11T12:29:06.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.275+0000 7fa9a6ec1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562a630e9e20 0x562a630f5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:06.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.275+0000 7fa9a6ec1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a630ef310 0x562a630f2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:06.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.275+0000 7fa9a6ec1b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a630efc30 0x562a630f3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:06.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.275+0000 7fa9a6ec1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a62fd9ac0 con 0x562a630e9e20 2023-08-11T12:29:06.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.275+0000 7fa9a6ec1b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a62fd97c0 con 0x562a630efc30 2023-08-11T12:29:06.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.275+0000 7fa9a6ec1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a62ebd920 con 0x562a630ef310 2023-08-11T12:29:06.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.275+0000 7fa9a6ec1b80 10 client.0 _ll_register_callbacks cb 0x562a62fdcab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:29:06.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.275+0000 7fa991b9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562a630e9e20 0x562a630f5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:06.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.276+0000 7fa991b9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562a630e9e20 0x562a630f5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36246/0 (socket says 172.21.15.8:36246) 2023-08-11T12:29:06.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.276+0000 7fa991b9c700 1 -- 172.21.15.8:0/871913009 learned_addr learned my addr 172.21.15.8:0/871913009 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:29:06.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.276+0000 7fa990b9a700 1 --2- 172.21.15.8:0/871913009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a630ef310 0x562a630f2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:06.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.276+0000 7fa991b9c700 1 --2- 172.21.15.8:0/871913009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a630efc30 0x562a630f3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:06.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.276+0000 7fa990b9a700 1 -- 172.21.15.8:0/871913009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a630efc30 msgr2=0x562a630f3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:29:06.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.276+0000 7fa990b9a700 1 --2- 172.21.15.8:0/871913009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a630efc30 0x562a630f3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.276+0000 7fa990b9a700 1 -- 172.21.15.8:0/871913009 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562a630e9e20 msgr2=0x562a630f5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:29:06.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.276+0000 7fa990b9a700 1 --2- 172.21.15.8:0/871913009 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562a630e9e20 0x562a630f5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.276+0000 7fa990b9a700 1 -- 172.21.15.8:0/871913009 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98c10e130 con 0x562a630ef310 2023-08-11T12:29:06.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.276+0000 7fa990b9a700 1 --2- 172.21.15.8:0/871913009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a630ef310 0x562a630f2e00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa97c0059d0 tx=0x7fa97c009910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ae3c8ed15aa5cdc server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:29:06.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.276+0000 7fa974ff9700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:29:06.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.277+0000 7fa974ff9700 1 -- 172.21.15.8:0/871913009 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c01d070 con 0x562a630ef310 2023-08-11T12:29:06.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.277+0000 7fa9a6ec1b80 1 -- 172.21.15.8:0/871913009 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a630dca90 con 0x562a630ef310 2023-08-11T12:29:06.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.277+0000 7fa974ff9700 1 -- 172.21.15.8:0/871913009 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fa97c004500 con 0x562a630ef310 2023-08-11T12:29:06.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.277+0000 7fa974ff9700 1 -- 172.21.15.8:0/871913009 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa97c0046c0 con 0x562a630ef310 2023-08-11T12:29:06.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.277+0000 7fa9a6ec1b80 10 client.26275 fetch_fsmap learned FSMap version 41 2023-08-11T12:29:06.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.277+0000 7fa9a6ec1b80 1 -- 172.21.15.8:0/871913009 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x7fa9840136c0 con 0x562a630ef310 2023-08-11T12:29:06.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.277+0000 7fa974ff9700 1 -- 172.21.15.8:0/871913009 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562a630dca90 con 0x562a630ef310 2023-08-11T12:29:06.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.278+0000 7fa974ff9700 1 -- 172.21.15.8:0/871913009 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 41) v1 ==== 7954+0+0 (secure 0 0 0) 0x7fa97c00f830 con 0x562a630ef310 2023-08-11T12:29:06.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.278+0000 7fa9a6ec1b80 10 client.26275 fetch_fsmap finished waiting for FSMap version 41 2023-08-11T12:29:06.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.278+0000 7fa9a6ec1b80 10 client.26275 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:29:06.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.278+0000 7fa9a6ec1b80 20 client.26275 populate_metadata read hostname 'smithi008' 2023-08-11T12:29:06.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.278+0000 7fa9a6ec1b80 1 --2- 172.21.15.8:0/871913009 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x562a63103500 0x562a63105920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:06.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.278+0000 7fa9a6ec1b80 4 client.26275 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:29:06.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.278+0000 7fa9a6ec1b80 1 -- 172.21.15.8:0/871913009 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562a630b84e0 con 0x562a63103500 2023-08-11T12:29:06.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.278+0000 7fa991b9c700 1 --2- 172.21.15.8:0/871913009 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x562a63103500 0x562a63105920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:06.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.278+0000 7fa991b9c700 1 --2- 172.21.15.8:0/871913009 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x562a63103500 0x562a63105920 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f8d70edffadd768 server_cookie=b59f655910f29e37 in_seq=0 out_seq=0 2023-08-11T12:29:06.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.278+0000 7fa974ff9700 10 client.26275 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:29:06.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.279+0000 7fa974ff9700 1 -- 172.21.15.8:0/871913009 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x562a630b84e0 con 0x562a63103500 2023-08-11T12:29:06.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.279+0000 7fa974ff9700 10 client.26275 handle_command_reply: tid=0 2023-08-11T12:29:06.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.279+0000 7fa9a6ec1b80 1 client.26275 shutdown 2023-08-11T12:29:06.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.280+0000 7fa9a6ec1b80 1 -- 172.21.15.8:0/871913009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a630ef310 msgr2=0x562a630f2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:29:06.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.280+0000 7fa9a6ec1b80 1 --2- 172.21.15.8:0/871913009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a630ef310 0x562a630f2e00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa97c0059d0 tx=0x7fa97c009910 comp rx=0 tx=0).stop 2023-08-11T12:29:06.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.280+0000 7fa9a6ec1b80 1 -- 172.21.15.8:0/871913009 shutdown_connections 2023-08-11T12:29:06.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.280+0000 7fa9a6ec1b80 1 --2- 172.21.15.8:0/871913009 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x562a63103500 0x562a63105920 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.280+0000 7fa9a6ec1b80 1 --2- 172.21.15.8:0/871913009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a630efc30 0x562a630f3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.280+0000 7fa9a6ec1b80 1 --2- 172.21.15.8:0/871913009 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562a630e9e20 0x562a630f5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.280+0000 7fa9a6ec1b80 1 --2- 172.21.15.8:0/871913009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a630ef310 0x562a630f2e00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.280+0000 7fa974ff9700 0 client.26275 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:29:06.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.280+0000 7fa9a6ec1b80 1 -- 172.21.15.8:0/871913009 >> 172.21.15.8:0/871913009 conn(0x562a63016950 msgr2=0x562a630decb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:29:06.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.280+0000 7fa9a6ec1b80 1 -- 172.21.15.8:0/871913009 shutdown_connections 2023-08-11T12:29:06.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.280+0000 7fa9a6ec1b80 1 -- 172.21.15.8:0/871913009 wait complete. 2023-08-11T12:29:06.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.280+0000 7fa9a6ec1b80 20 client.26275 trim_cache size 0 max 16384 2023-08-11T12:29:06.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.297+0000 7fa9a6ec1b80 1 Processor -- start 2023-08-11T12:29:06.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.297+0000 7fa9a6ec1b80 1 -- start start 2023-08-11T12:29:06.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.298+0000 7fa9a6ec1b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a630e9e20 0x562a630f5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:06.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.298+0000 7fa9a6ec1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a630ef310 0x562a630f5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:06.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.298+0000 7fa9a6ec1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562a630efc30 0x562a630f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:06.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.298+0000 7fa9a6ec1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a630f39f0 con 0x562a630efc30 2023-08-11T12:29:06.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.298+0000 7fa9a6ec1b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a630e0b10 con 0x562a630e9e20 2023-08-11T12:29:06.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.298+0000 7fa9a6ec1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a630f1360 con 0x562a630ef310 2023-08-11T12:29:06.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.298+0000 7fa991b9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a630e9e20 0x562a630f5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:06.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.298+0000 7fa991b9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a630e9e20 0x562a630f5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:46616/0 (socket says 172.21.15.8:46616) 2023-08-11T12:29:06.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.298+0000 7fa991b9c700 1 -- 172.21.15.8:0/3738746419 learned_addr learned my addr 172.21.15.8:0/3738746419 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:29:06.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.298+0000 7fa990b9a700 1 --2- 172.21.15.8:0/3738746419 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a630ef310 0x562a630f5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:06.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.298+0000 7fa991b9c700 1 --2- 172.21.15.8:0/3738746419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562a630efc30 0x562a630f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:06.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.299+0000 7fa991b9c700 1 -- 172.21.15.8:0/3738746419 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a630ef310 msgr2=0x562a630f5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:29:06.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.299+0000 7fa991b9c700 1 --2- 172.21.15.8:0/3738746419 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a630ef310 0x562a630f5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.299+0000 7fa991b9c700 1 -- 172.21.15.8:0/3738746419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562a630efc30 msgr2=0x562a630f25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:29:06.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.299+0000 7fa991b9c700 1 --2- 172.21.15.8:0/3738746419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562a630efc30 0x562a630f25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.299+0000 7fa991b9c700 1 -- 172.21.15.8:0/3738746419 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a62e67de0 con 0x562a630e9e20 2023-08-11T12:29:06.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.299+0000 7fa991b9c700 1 --2- 172.21.15.8:0/3738746419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a630e9e20 0x562a630f5610 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa98400d010 tx=0x7fa984009e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9e13f5e5e8c6843 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:29:06.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.299+0000 7fa977fff700 1 -- 172.21.15.8:0/3738746419 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98400e040 con 0x562a630e9e20 2023-08-11T12:29:06.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.299+0000 7fa977fff700 1 -- 172.21.15.8:0/3738746419 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa98400f810 con 0x562a630e9e20 2023-08-11T12:29:06.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.299+0000 7fa977fff700 1 -- 172.21.15.8:0/3738746419 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa984005330 con 0x562a630e9e20 2023-08-11T12:29:06.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.300+0000 7fa9a6ec1b80 1 -- 172.21.15.8:0/3738746419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a630e9e20 msgr2=0x562a630f5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:29:06.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.300+0000 7fa9a6ec1b80 1 --2- 172.21.15.8:0/3738746419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a630e9e20 0x562a630f5610 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa98400d010 tx=0x7fa984009e50 comp rx=0 tx=0).stop 2023-08-11T12:29:06.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.300+0000 7fa9a6ec1b80 1 -- 172.21.15.8:0/3738746419 shutdown_connections 2023-08-11T12:29:06.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.300+0000 7fa9a6ec1b80 1 --2- 172.21.15.8:0/3738746419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562a630efc30 0x562a630f25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.300+0000 7fa9a6ec1b80 1 --2- 172.21.15.8:0/3738746419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a630e9e20 0x562a630f5610 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.300+0000 7fa9a6ec1b80 1 --2- 172.21.15.8:0/3738746419 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a630ef310 0x562a630f5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.300+0000 7fa9a6ec1b80 1 -- 172.21.15.8:0/3738746419 >> 172.21.15.8:0/3738746419 conn(0x562a63016950 msgr2=0x562a630ff760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:29:06.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.300+0000 7fa9a6ec1b80 1 -- 172.21.15.8:0/3738746419 shutdown_connections 2023-08-11T12:29:06.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.300+0000 7fa9a6ec1b80 1 -- 172.21.15.8:0/3738746419 wait complete. 2023-08-11T12:29:06.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.300+0000 7fa9a6ec1b80 1 -- start start 2023-08-11T12:29:06.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.301+0000 7fa9a6ec1b80 1 Processor -- start 2023-08-11T12:29:06.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.301+0000 7fa9a6ec1b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a630e9e20 0x562a630fa290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:06.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.301+0000 7fa9a6ec1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562a630ef310 0x562a630f8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:06.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.301+0000 7fa9a6ec1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a630efc30 0x562a630f8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:06.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.301+0000 7fa9a6ec1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a630f9000 con 0x562a630ef310 2023-08-11T12:29:06.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.301+0000 7fa9a6ec1b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a630f9170 con 0x562a630e9e20 2023-08-11T12:29:06.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.301+0000 7fa9a6ec1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a630f9330 con 0x562a630efc30 2023-08-11T12:29:06.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.301+0000 7fa9a6ec1b80 10 client.0 _ll_register_callbacks cb 0x7fa97c00bb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:29:06.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.302+0000 7fa991b9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a630e9e20 0x562a630fa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:06.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.302+0000 7fa990b9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562a630ef310 0x562a630f8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:06.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.302+0000 7fa991b9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a630e9e20 0x562a630fa290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:46624/0 (socket says 172.21.15.8:46624) 2023-08-11T12:29:06.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.302+0000 7fa990b9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562a630ef310 0x562a630f8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36268/0 (socket says 172.21.15.8:36268) 2023-08-11T12:29:06.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.302+0000 7fa991b9c700 1 -- 172.21.15.8:0/2576855543 learned_addr learned my addr 172.21.15.8:0/2576855543 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:29:06.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.302+0000 7fa991b9c700 1 --2- 172.21.15.8:0/2576855543 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a630efc30 0x562a630f8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:06.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.302+0000 7fa990b9a700 1 -- 172.21.15.8:0/2576855543 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a630efc30 msgr2=0x562a630f8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:29:06.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.302+0000 7fa990b9a700 1 --2- 172.21.15.8:0/2576855543 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a630efc30 0x562a630f8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.302+0000 7fa990b9a700 1 -- 172.21.15.8:0/2576855543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a630e9e20 msgr2=0x562a630fa290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:29:06.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.302+0000 7fa990b9a700 1 --2- 172.21.15.8:0/2576855543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a630e9e20 0x562a630fa290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.302+0000 7fa990b9a700 1 -- 172.21.15.8:0/2576855543 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a62ebb630 con 0x562a630ef310 2023-08-11T12:29:06.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.302+0000 7fa991b9c700 1 --2- 172.21.15.8:0/2576855543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a630e9e20 0x562a630fa290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:29:06.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.302+0000 7fa990b9a700 1 --2- 172.21.15.8:0/2576855543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562a630ef310 0x562a630f8580 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa97c009990 tx=0x7fa97c024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=782181dedf266aee server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:29:06.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.302+0000 7fa974ff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:29:06.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.303+0000 7fa974ff9700 1 -- 172.21.15.8:0/2576855543 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c01d070 con 0x562a630ef310 2023-08-11T12:29:06.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.303+0000 7fa9a6ec1b80 1 -- 172.21.15.8:0/2576855543 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa98400f040 con 0x562a630ef310 2023-08-11T12:29:06.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.303+0000 7fa974ff9700 1 -- 172.21.15.8:0/2576855543 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fa97c00f670 con 0x562a630ef310 2023-08-11T12:29:06.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.303+0000 7fa974ff9700 1 -- 172.21.15.8:0/2576855543 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa97c00f850 con 0x562a630ef310 2023-08-11T12:29:06.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.303+0000 7fa9a6ec1b80 10 client.16230 fetch_fsmap learned FSMap version 41 2023-08-11T12:29:06.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.303+0000 7fa9a6ec1b80 1 -- 172.21.15.8:0/2576855543 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x562a62e50c60 con 0x562a630ef310 2023-08-11T12:29:06.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.303+0000 7fa974ff9700 1 -- 172.21.15.8:0/2576855543 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa98400f040 con 0x562a630ef310 2023-08-11T12:29:06.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.303+0000 7fa974ff9700 1 -- 172.21.15.8:0/2576855543 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 41) v1 ==== 7954+0+0 (secure 0 0 0) 0x7fa97c0244a0 con 0x562a630ef310 2023-08-11T12:29:06.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.303+0000 7fa9a6ec1b80 10 client.16230 fetch_fsmap finished waiting for FSMap version 41 2023-08-11T12:29:06.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.303+0000 7fa9a6ec1b80 10 client.16230 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:29:06.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.303+0000 7fa9a6ec1b80 20 client.16230 populate_metadata read hostname 'smithi008' 2023-08-11T12:29:06.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.303+0000 7fa9a6ec1b80 1 --2- 172.21.15.8:0/2576855543 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x562a63160a10 0x562a63162e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:06.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.303+0000 7fa9a6ec1b80 4 client.16230 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:29:06.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.303+0000 7fa9a6ec1b80 1 -- 172.21.15.8:0/2576855543 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562a63034820 con 0x562a63160a10 2023-08-11T12:29:06.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.304+0000 7fa991b9c700 1 --2- 172.21.15.8:0/2576855543 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x562a63160a10 0x562a63162e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:06.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.304+0000 7fa991b9c700 1 --2- 172.21.15.8:0/2576855543 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x562a63160a10 0x562a63162e30 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef74c4b6786e0803 server_cookie=67f72d7809b93f93 in_seq=0 out_seq=0 2023-08-11T12:29:06.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.304+0000 7fa974ff9700 10 client.16230 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:29:06.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.304+0000 7fa974ff9700 1 -- 172.21.15.8:0/2576855543 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x562a63034820 con 0x562a63160a10 2023-08-11T12:29:06.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.304+0000 7fa974ff9700 10 client.16230 handle_command_reply: tid=0 2023-08-11T12:29:06.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.304+0000 7fa9a6ec1b80 1 client.16230 shutdown 2023-08-11T12:29:06.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.304+0000 7fa9a6ec1b80 1 -- 172.21.15.8:0/2576855543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562a630ef310 msgr2=0x562a630f8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:29:06.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.305+0000 7fa9a6ec1b80 1 --2- 172.21.15.8:0/2576855543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562a630ef310 0x562a630f8580 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa97c009990 tx=0x7fa97c024000 comp rx=0 tx=0).stop 2023-08-11T12:29:06.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.305+0000 7fa9a6ec1b80 1 -- 172.21.15.8:0/2576855543 shutdown_connections 2023-08-11T12:29:06.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.305+0000 7fa9a6ec1b80 1 --2- 172.21.15.8:0/2576855543 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x562a63160a10 0x562a63162e30 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.305+0000 7fa9a6ec1b80 1 --2- 172.21.15.8:0/2576855543 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a630efc30 0x562a630f8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.305+0000 7fa9a6ec1b80 1 --2- 172.21.15.8:0/2576855543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a630e9e20 0x562a630fa290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.305+0000 7fa974ff9700 0 client.16230 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:29:06.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.305+0000 7fa9a6ec1b80 1 --2- 172.21.15.8:0/2576855543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562a630ef310 0x562a630f8580 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.305+0000 7fa9a6ec1b80 1 -- 172.21.15.8:0/2576855543 >> 172.21.15.8:0/2576855543 conn(0x562a63016950 msgr2=0x562a630edf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:29:06.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.305+0000 7fa9a6ec1b80 1 -- 172.21.15.8:0/2576855543 shutdown_connections 2023-08-11T12:29:06.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.305+0000 7fa9a6ec1b80 1 -- 172.21.15.8:0/2576855543 wait complete. 2023-08-11T12:29:06.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.305+0000 7fa9a6ec1b80 20 client.16230 trim_cache size 0 max 16384 2023-08-11T12:29:06.339 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:29:06.339 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:29:06.339 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:29:06.340 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:29:06.340 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:29:06.340 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:29:06.340 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:29:06.341 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:29:06.341 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:29:06.341 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:29:06.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.305+0000 7fa9935ff700 1 -- 172.21.15.8:0/21535660 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fa9780a00c0 msgr2=0x7fa9780a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:29:06.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.305+0000 7fa9935ff700 1 --2- 172.21.15.8:0/21535660 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fa9780a00c0 0x7fa9780a2580 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa988095390 tx=0x7fa988010b80 comp rx=0 tx=0).stop 2023-08-11T12:29:06.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.305+0000 7fa9935ff700 1 -- 172.21.15.8:0/21535660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa98c100960 msgr2=0x7fa98c19ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:29:06.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.305+0000 7fa9935ff700 1 --2- 172.21.15.8:0/21535660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa98c100960 0x7fa98c19ea90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa98800e9a0 tx=0x7fa98800ecb0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.306+0000 7fa9935ff700 1 -- 172.21.15.8:0/21535660 shutdown_connections 2023-08-11T12:29:06.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.306+0000 7fa9935ff700 1 --2- 172.21.15.8:0/21535660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa98c106970 0x7fa98c198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.306+0000 7fa9935ff700 1 --2- 172.21.15.8:0/21535660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa98c100960 0x7fa98c19ea90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.306+0000 7fa9935ff700 1 --2- 172.21.15.8:0/21535660 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fa9780a00c0 0x7fa9780a2580 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.306+0000 7fa9935ff700 1 --2- 172.21.15.8:0/21535660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa98c101320 0x7fa98c19efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:06.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.306+0000 7fa9935ff700 1 -- 172.21.15.8:0/21535660 >> 172.21.15.8:0/21535660 conn(0x7fa98c0fc490 msgr2=0x7fa98c10bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:29:06.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.306+0000 7fa9935ff700 1 -- 172.21.15.8:0/21535660 shutdown_connections 2023-08-11T12:29:06.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:06.306+0000 7fa9935ff700 1 -- 172.21.15.8:0/21535660 wait complete. 2023-08-11T12:29:06.345 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:29:07.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:06 smithi008 ceph-mon[97158]: pgmap v138: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-08-11T12:29:07.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:06 smithi194 ceph-mon[130905]: pgmap v138: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-08-11T12:29:07.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:06 smithi045 ceph-mon[130284]: pgmap v138: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-08-11T12:29:09.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:08 smithi008 ceph-mon[97158]: pgmap v139: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-08-11T12:29:09.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:08 smithi194 ceph-mon[130905]: pgmap v139: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-08-11T12:29:09.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:08 smithi045 ceph-mon[130284]: pgmap v139: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-08-11T12:29:11.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:10 smithi008 ceph-mon[97158]: pgmap v140: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-08-11T12:29:11.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:10 smithi194 ceph-mon[130905]: pgmap v140: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-08-11T12:29:11.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:10 smithi045 ceph-mon[130284]: pgmap v140: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-08-11T12:29:13.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:12 smithi008 ceph-mon[97158]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:29:13.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:12 smithi008 ceph-mon[97158]: pgmap v141: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-08-11T12:29:13.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:12 smithi194 ceph-mon[130905]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:29:13.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:12 smithi194 ceph-mon[130905]: pgmap v141: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-08-11T12:29:13.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:12 smithi045 ceph-mon[130284]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:29:13.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:12 smithi045 ceph-mon[130284]: pgmap v141: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-08-11T12:29:15.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:14 smithi008 ceph-mon[97158]: pgmap v142: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2023-08-11T12:29:15.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:14 smithi194 ceph-mon[130905]: pgmap v142: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2023-08-11T12:29:15.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:14 smithi045 ceph-mon[130284]: pgmap v142: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2023-08-11T12:29:17.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:16 smithi008 ceph-mon[97158]: pgmap v143: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2023-08-11T12:29:17.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:16 smithi194 ceph-mon[130905]: pgmap v143: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2023-08-11T12:29:17.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:16 smithi045 ceph-mon[130284]: pgmap v143: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2023-08-11T12:29:19.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:18 smithi008 ceph-mon[97158]: pgmap v144: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-08-11T12:29:19.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:18 smithi194 ceph-mon[130905]: pgmap v144: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-08-11T12:29:19.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:18 smithi045 ceph-mon[130284]: pgmap v144: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-08-11T12:29:21.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:20 smithi008 ceph-mon[97158]: pgmap v145: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2023-08-11T12:29:21.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:20 smithi194 ceph-mon[130905]: pgmap v145: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2023-08-11T12:29:21.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:20 smithi045 ceph-mon[130284]: pgmap v145: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2023-08-11T12:29:23.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:22 smithi008 ceph-mon[97158]: pgmap v146: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-08-11T12:29:23.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:22 smithi194 ceph-mon[130905]: pgmap v146: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-08-11T12:29:23.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:22 smithi045 ceph-mon[130284]: pgmap v146: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-08-11T12:29:25.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:24 smithi008 ceph-mon[97158]: pgmap v147: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:25.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:24 smithi194 ceph-mon[130905]: pgmap v147: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:25.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:24 smithi045 ceph-mon[130284]: pgmap v147: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:27.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:26 smithi008 ceph-mon[97158]: pgmap v148: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:27.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:26 smithi194 ceph-mon[130905]: pgmap v148: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:27.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:26 smithi045 ceph-mon[130284]: pgmap v148: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:29.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:28 smithi008 ceph-mon[97158]: pgmap v149: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:29:29.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:28 smithi194 ceph-mon[130905]: pgmap v149: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:29:29.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:28 smithi045 ceph-mon[130284]: pgmap v149: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:29:31.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:30 smithi008 ceph-mon[97158]: pgmap v150: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:31.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:30 smithi194 ceph-mon[130905]: pgmap v150: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:31.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:30 smithi045 ceph-mon[130284]: pgmap v150: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:33.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:32 smithi008 ceph-mon[97158]: pgmap v151: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:29:33.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:32 smithi194 ceph-mon[130905]: pgmap v151: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:29:33.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:32 smithi045 ceph-mon[130284]: pgmap v151: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:29:35.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:34 smithi008 ceph-mon[97158]: pgmap v152: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:35.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:34 smithi008 ceph-mon[97158]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:29:35.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:34 smithi194 ceph-mon[130905]: pgmap v152: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:35.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:34 smithi194 ceph-mon[130905]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:29:35.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:34 smithi045 ceph-mon[130284]: pgmap v152: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:35.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:34 smithi045 ceph-mon[130284]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:29:36.346 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:29:36.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.563+0000 7fbd373ff700 1 -- 172.21.15.8:0/4219198658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd30106970 msgr2=0x7fbd30106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:29:36.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.563+0000 7fbd373ff700 1 --2- 172.21.15.8:0/4219198658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd30106970 0x7fbd30106d50 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c009990 tx=0x7fbd2c009ca0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.563+0000 7fbd373ff700 1 -- 172.21.15.8:0/4219198658 shutdown_connections 2023-08-11T12:29:36.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.563+0000 7fbd373ff700 1 --2- 172.21.15.8:0/4219198658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd30101320 0x7fbd3010d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.563+0000 7fbd373ff700 1 --2- 172.21.15.8:0/4219198658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd30106970 0x7fbd30106d50 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.563+0000 7fbd373ff700 1 --2- 172.21.15.8:0/4219198658 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd30100960 0x7fbd30100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.563+0000 7fbd373ff700 1 -- 172.21.15.8:0/4219198658 >> 172.21.15.8:0/4219198658 conn(0x7fbd300fc490 msgr2=0x7fbd300fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:29:36.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.563+0000 7fbd373ff700 1 -- 172.21.15.8:0/4219198658 shutdown_connections 2023-08-11T12:29:36.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.563+0000 7fbd373ff700 1 -- 172.21.15.8:0/4219198658 wait complete. 2023-08-11T12:29:36.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.564+0000 7fbd373ff700 1 Processor -- start 2023-08-11T12:29:36.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.564+0000 7fbd373ff700 1 -- start start 2023-08-11T12:29:36.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.565+0000 7fbd373ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd30100960 0x7fbd3019c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:36.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.565+0000 7fbd373ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd30101320 0x7fbd3019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:36.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.565+0000 7fbd373ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd30106970 0x7fbd30196840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:36.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.565+0000 7fbd373ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd30196eb0 con 0x7fbd30100960 2023-08-11T12:29:36.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.565+0000 7fbd373ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd30197020 con 0x7fbd30101320 2023-08-11T12:29:36.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.565+0000 7fbd373ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd301971e0 con 0x7fbd30106970 2023-08-11T12:29:36.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.565+0000 7fbd3519b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd30100960 0x7fbd3019c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:36.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.565+0000 7fbd3499a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd30101320 0x7fbd3019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:36.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.565+0000 7fbd3519b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd30100960 0x7fbd3019c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34198/0 (socket says 172.21.15.8:34198) 2023-08-11T12:29:36.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.565+0000 7fbd3519b700 1 -- 172.21.15.8:0/4262159800 learned_addr learned my addr 172.21.15.8:0/4262159800 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:29:36.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.565+0000 7fbd3499a700 1 --2- 172.21.15.8:0/4262159800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd30101320 0x7fbd3019cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:57260/0 (socket says 172.21.15.8:57260) 2023-08-11T12:29:36.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.565+0000 7fbd3599c700 1 --2- 172.21.15.8:0/4262159800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd30106970 0x7fbd30196840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:36.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.565+0000 7fbd3519b700 1 -- 172.21.15.8:0/4262159800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd30106970 msgr2=0x7fbd30196840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:29:36.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.565+0000 7fbd3519b700 1 --2- 172.21.15.8:0/4262159800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd30106970 0x7fbd30196840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.565+0000 7fbd3519b700 1 -- 172.21.15.8:0/4262159800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd30101320 msgr2=0x7fbd3019cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:29:36.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.565+0000 7fbd3519b700 1 --2- 172.21.15.8:0/4262159800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd30101320 0x7fbd3019cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.565+0000 7fbd3519b700 1 -- 172.21.15.8:0/4262159800 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2c0095f0 con 0x7fbd30100960 2023-08-11T12:29:36.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.565+0000 7fbd3499a700 1 --2- 172.21.15.8:0/4262159800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd30101320 0x7fbd3019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:29:36.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.566+0000 7fbd3519b700 1 --2- 172.21.15.8:0/4262159800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd30100960 0x7fbd3019c7d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c005910 tx=0x7fbd2c005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:29:36.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.566+0000 7fbd267fc700 1 -- 172.21.15.8:0/4262159800 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c01d070 con 0x7fbd30100960 2023-08-11T12:29:36.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.566+0000 7fbd373ff700 1 -- 172.21.15.8:0/4262159800 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd30197460 con 0x7fbd30100960 2023-08-11T12:29:36.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.566+0000 7fbd267fc700 1 -- 172.21.15.8:0/4262159800 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd2c022470 con 0x7fbd30100960 2023-08-11T12:29:36.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.566+0000 7fbd267fc700 1 -- 172.21.15.8:0/4262159800 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c017650 con 0x7fbd30100960 2023-08-11T12:29:36.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.566+0000 7fbd373ff700 1 -- 172.21.15.8:0/4262159800 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd301a37c0 con 0x7fbd30100960 2023-08-11T12:29:36.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.569+0000 7fbd267fc700 1 -- 172.21.15.8:0/4262159800 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7fbd2c0225e0 con 0x7fbd30100960 2023-08-11T12:29:36.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.571+0000 7fbd4ad8db80 1 Processor -- start 2023-08-11T12:29:36.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.571+0000 7fbd4ad8db80 1 -- start start 2023-08-11T12:29:36.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.571+0000 7fbd267fc700 1 --2- 172.21.15.8:0/4262159800 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fbd1c0a00c0 0x7fbd1c0a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:36.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.571+0000 7fbd267fc700 1 -- 172.21.15.8:0/4262159800 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fbd2c0cccf0 con 0x7fbd30100960 2023-08-11T12:29:36.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.571+0000 7fbd3599c700 1 --2- 172.21.15.8:0/4262159800 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fbd1c0a00c0 0x7fbd1c0a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:36.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.571+0000 7fbd4ad8db80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600b0193310 0x5600b01936f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:36.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.571+0000 7fbd4ad8db80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b0193c30 0x5600b018d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:36.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.571+0000 7fbd4ad8db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5600b018de20 0x5600b018e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:36.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.571+0000 7fbd4ad8db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b00e6630 con 0x5600b018de20 2023-08-11T12:29:36.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.571+0000 7fbd4ad8db80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b00e3f50 con 0x5600b0193310 2023-08-11T12:29:36.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.571+0000 7fbd4ad8db80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b00df840 con 0x5600b0193c30 2023-08-11T12:29:36.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.572+0000 7fbd3519b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600b0193310 0x5600b01936f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:36.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.572+0000 7fbd3519b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600b0193310 0x5600b01936f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:57262/0 (socket says 172.21.15.8:57262) 2023-08-11T12:29:36.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.572+0000 7fbd3519b700 1 -- 172.21.15.8:0/4108339723 learned_addr learned my addr 172.21.15.8:0/4108339723 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:29:36.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.572+0000 7fbd3599c700 1 --2- 172.21.15.8:0/4108339723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5600b018de20 0x5600b018e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:36.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.572+0000 7fbd3499a700 1 --2- 172.21.15.8:0/4108339723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b0193c30 0x5600b018d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:36.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.572+0000 7fbd3519b700 1 -- 172.21.15.8:0/4108339723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b0193c30 msgr2=0x5600b018d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:29:36.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.572+0000 7fbd3519b700 1 --2- 172.21.15.8:0/4108339723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b0193c30 0x5600b018d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.572+0000 7fbd3519b700 1 -- 172.21.15.8:0/4108339723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5600b018de20 msgr2=0x5600b018e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:29:36.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.572+0000 7fbd3519b700 1 --2- 172.21.15.8:0/4108339723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5600b018de20 0x5600b018e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.572+0000 7fbd3519b700 1 -- 172.21.15.8:0/4108339723 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600aff5f630 con 0x5600b0193310 2023-08-11T12:29:36.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.572+0000 7fbd3599c700 1 --2- 172.21.15.8:0/4108339723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5600b018de20 0x5600b018e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:29:36.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.572+0000 7fbd3599c700 1 --2- 172.21.15.8:0/4262159800 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fbd1c0a00c0 0x7fbd1c0a2580 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbd3019d4d0 tx=0x7fbd28007a80 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:29:36.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.572+0000 7fbd3519b700 1 --2- 172.21.15.8:0/4108339723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600b0193310 0x5600b01936f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0a1990 tx=0x7fbd2c009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca9bed285b72efd server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:29:36.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.573+0000 7fbd1b7fe700 1 -- 172.21.15.8:0/4108339723 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c09a140 con 0x5600b0193310 2023-08-11T12:29:36.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.573+0000 7fbd1b7fe700 1 -- 172.21.15.8:0/4108339723 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd2c09df70 con 0x5600b0193310 2023-08-11T12:29:36.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.573+0000 7fbd1b7fe700 1 -- 172.21.15.8:0/4108339723 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c09a5e0 con 0x5600b0193310 2023-08-11T12:29:36.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.573+0000 7fbd4ad8db80 1 -- 172.21.15.8:0/4108339723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600b0193310 msgr2=0x5600b01936f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:29:36.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.573+0000 7fbd4ad8db80 1 --2- 172.21.15.8:0/4108339723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600b0193310 0x5600b01936f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0a1990 tx=0x7fbd2c009310 comp rx=0 tx=0).stop 2023-08-11T12:29:36.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.573+0000 7fbd4ad8db80 1 -- 172.21.15.8:0/4108339723 shutdown_connections 2023-08-11T12:29:36.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.573+0000 7fbd4ad8db80 1 --2- 172.21.15.8:0/4108339723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5600b018de20 0x5600b018e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.573+0000 7fbd4ad8db80 1 --2- 172.21.15.8:0/4108339723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600b0193310 0x5600b01936f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.573+0000 7fbd4ad8db80 1 --2- 172.21.15.8:0/4108339723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b0193c30 0x5600b018d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.573+0000 7fbd4ad8db80 1 -- 172.21.15.8:0/4108339723 >> 172.21.15.8:0/4108339723 conn(0x5600b00ba950 msgr2=0x5600b01883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:29:36.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.573+0000 7fbd4ad8db80 1 -- 172.21.15.8:0/4108339723 shutdown_connections 2023-08-11T12:29:36.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.574+0000 7fbd4ad8db80 1 -- 172.21.15.8:0/4108339723 wait complete. 2023-08-11T12:29:36.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.574+0000 7fbd4ad8db80 1 -- start start 2023-08-11T12:29:36.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.574+0000 7fbd4ad8db80 1 Processor -- start 2023-08-11T12:29:36.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.575+0000 7fbd4ad8db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5600b018de20 0x5600b01a1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:36.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.575+0000 7fbd4ad8db80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b0193310 0x5600b01a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:36.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.575+0000 7fbd4ad8db80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600b0193c30 0x5600b019b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:36.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.575+0000 7fbd4ad8db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b007dac0 con 0x5600b018de20 2023-08-11T12:29:36.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.575+0000 7fbd4ad8db80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b007d7c0 con 0x5600b0193c30 2023-08-11T12:29:36.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.575+0000 7fbd4ad8db80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600aff61920 con 0x5600b0193310 2023-08-11T12:29:36.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.575+0000 7fbd4ad8db80 10 client.0 _ll_register_callbacks cb 0x5600b0080ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:29:36.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.575+0000 7fbd3519b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5600b018de20 0x5600b01a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:36.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.575+0000 7fbd3599c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600b0193c30 0x5600b019b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:36.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.575+0000 7fbd3519b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5600b018de20 0x5600b01a1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34228/0 (socket says 172.21.15.8:34228) 2023-08-11T12:29:36.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.575+0000 7fbd3519b700 1 -- 172.21.15.8:0/2231720806 learned_addr learned my addr 172.21.15.8:0/2231720806 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:29:36.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.575+0000 7fbd3499a700 1 --2- 172.21.15.8:0/2231720806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b0193310 0x5600b01a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:36.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.576+0000 7fbd3599c700 1 -- 172.21.15.8:0/2231720806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b0193310 msgr2=0x5600b01a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:29:36.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.576+0000 7fbd3599c700 1 --2- 172.21.15.8:0/2231720806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b0193310 0x5600b01a15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.576+0000 7fbd3599c700 1 -- 172.21.15.8:0/2231720806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5600b018de20 msgr2=0x5600b01a1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:29:36.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.576+0000 7fbd3599c700 1 --2- 172.21.15.8:0/2231720806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5600b018de20 0x5600b01a1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.576+0000 7fbd3599c700 1 -- 172.21.15.8:0/2231720806 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd301a37c0 con 0x5600b0193c30 2023-08-11T12:29:36.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.576+0000 7fbd3519b700 1 --2- 172.21.15.8:0/2231720806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5600b018de20 0x5600b01a1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:29:36.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.576+0000 7fbd3599c700 1 --2- 172.21.15.8:0/2231720806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600b0193c30 0x5600b019b3f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbd28007e80 tx=0x7fbd28004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c27fe61e2bbd36ab server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:29:36.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.576+0000 7fbd18ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:29:36.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.576+0000 7fbd18ff9700 1 -- 172.21.15.8:0/2231720806 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2800e050 con 0x5600b0193c30 2023-08-11T12:29:36.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.576+0000 7fbd4ad8db80 1 -- 172.21.15.8:0/2231720806 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5600b0180a90 con 0x5600b0193c30 2023-08-11T12:29:36.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.576+0000 7fbd18ff9700 1 -- 172.21.15.8:0/2231720806 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fbd2801c2e0 con 0x5600b0193c30 2023-08-11T12:29:36.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.576+0000 7fbd18ff9700 1 -- 172.21.15.8:0/2231720806 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd28019860 con 0x5600b0193c30 2023-08-11T12:29:36.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.577+0000 7fbd4ad8db80 10 client.26285 fetch_fsmap learned FSMap version 43 2023-08-11T12:29:36.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.577+0000 7fbd4ad8db80 1 -- 172.21.15.8:0/2231720806 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5600aff0bde0 con 0x5600b0193c30 2023-08-11T12:29:36.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.577+0000 7fbd18ff9700 1 -- 172.21.15.8:0/2231720806 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5600b0180a90 con 0x5600b0193c30 2023-08-11T12:29:36.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.577+0000 7fbd18ff9700 1 -- 172.21.15.8:0/2231720806 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 43) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fbd2801ab70 con 0x5600b0193c30 2023-08-11T12:29:36.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.577+0000 7fbd4ad8db80 10 client.26285 fetch_fsmap finished waiting for FSMap version 43 2023-08-11T12:29:36.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.577+0000 7fbd4ad8db80 10 client.26285 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:29:36.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.577+0000 7fbd4ad8db80 20 client.26285 populate_metadata read hostname 'smithi008' 2023-08-11T12:29:36.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.577+0000 7fbd4ad8db80 1 --2- 172.21.15.8:0/2231720806 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5600b01ab5f0 0x5600b01ada10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:36.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.577+0000 7fbd4ad8db80 4 client.26285 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:29:36.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.577+0000 7fbd4ad8db80 1 -- 172.21.15.8:0/2231720806 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5600b015c4e0 con 0x5600b01ab5f0 2023-08-11T12:29:36.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.577+0000 7fbd3519b700 1 --2- 172.21.15.8:0/2231720806 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5600b01ab5f0 0x5600b01ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:36.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.578+0000 7fbd18ff9700 10 client.26285 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:29:36.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.578+0000 7fbd3519b700 1 --2- 172.21.15.8:0/2231720806 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5600b01ab5f0 0x5600b01ada10 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80d4922b8440d2c4 server_cookie=b433ecb52925d15a in_seq=0 out_seq=0 2023-08-11T12:29:36.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.579+0000 7fbd18ff9700 1 -- 172.21.15.8:0/2231720806 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5600b015c4e0 con 0x5600b01ab5f0 2023-08-11T12:29:36.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.579+0000 7fbd18ff9700 10 client.26285 handle_command_reply: tid=0 2023-08-11T12:29:36.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.579+0000 7fbd4ad8db80 1 client.26285 shutdown 2023-08-11T12:29:36.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.579+0000 7fbd4ad8db80 1 -- 172.21.15.8:0/2231720806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600b0193c30 msgr2=0x5600b019b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:29:36.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.579+0000 7fbd4ad8db80 1 --2- 172.21.15.8:0/2231720806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600b0193c30 0x5600b019b3f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbd28007e80 tx=0x7fbd28004b40 comp rx=0 tx=0).stop 2023-08-11T12:29:36.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.579+0000 7fbd4ad8db80 1 -- 172.21.15.8:0/2231720806 shutdown_connections 2023-08-11T12:29:36.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.579+0000 7fbd4ad8db80 1 --2- 172.21.15.8:0/2231720806 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5600b01ab5f0 0x5600b01ada10 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.579+0000 7fbd4ad8db80 1 --2- 172.21.15.8:0/2231720806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600b0193c30 0x5600b019b3f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.579+0000 7fbd4ad8db80 1 --2- 172.21.15.8:0/2231720806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5600b018de20 0x5600b01a1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.579+0000 7fbd4ad8db80 1 --2- 172.21.15.8:0/2231720806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b0193310 0x5600b01a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.579+0000 7fbd18ff9700 0 client.26285 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:29:36.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.579+0000 7fbd4ad8db80 1 -- 172.21.15.8:0/2231720806 >> 172.21.15.8:0/2231720806 conn(0x5600b00ba950 msgr2=0x5600b0182cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:29:36.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.579+0000 7fbd4ad8db80 1 -- 172.21.15.8:0/2231720806 shutdown_connections 2023-08-11T12:29:36.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.579+0000 7fbd4ad8db80 1 -- 172.21.15.8:0/2231720806 wait complete. 2023-08-11T12:29:36.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.579+0000 7fbd4ad8db80 20 client.26285 trim_cache size 0 max 16384 2023-08-11T12:29:36.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.597+0000 7fbd4ad8db80 1 Processor -- start 2023-08-11T12:29:36.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.597+0000 7fbd4ad8db80 1 -- start start 2023-08-11T12:29:36.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.597+0000 7fbd4ad8db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5600b018de20 0x5600b0188340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:36.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.597+0000 7fbd4ad8db80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600b0193310 0x5600b0199430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:36.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.597+0000 7fbd4ad8db80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b0193c30 0x5600b0192590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:36.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.597+0000 7fbd4ad8db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b019a0a0 con 0x5600b018de20 2023-08-11T12:29:36.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.597+0000 7fbd4ad8db80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b0184de0 con 0x5600b0193310 2023-08-11T12:29:36.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.597+0000 7fbd4ad8db80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b019c740 con 0x5600b0193c30 2023-08-11T12:29:36.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.597+0000 7fbd3519b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5600b018de20 0x5600b0188340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:36.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.597+0000 7fbd3499a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600b0193310 0x5600b0199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:36.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.597+0000 7fbd3499a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600b0193310 0x5600b0199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:57278/0 (socket says 172.21.15.8:57278) 2023-08-11T12:29:36.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.597+0000 7fbd3499a700 1 -- 172.21.15.8:0/334531995 learned_addr learned my addr 172.21.15.8:0/334531995 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:29:36.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.598+0000 7fbd3599c700 1 --2- 172.21.15.8:0/334531995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b0193c30 0x5600b0192590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:36.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.598+0000 7fbd3499a700 1 -- 172.21.15.8:0/334531995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b0193c30 msgr2=0x5600b0192590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:29:36.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.598+0000 7fbd3499a700 1 --2- 172.21.15.8:0/334531995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b0193c30 0x5600b0192590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.598+0000 7fbd3499a700 1 -- 172.21.15.8:0/334531995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5600b018de20 msgr2=0x5600b0188340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:29:36.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.598+0000 7fbd3499a700 1 --2- 172.21.15.8:0/334531995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5600b018de20 0x5600b0188340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.598+0000 7fbd3499a700 1 -- 172.21.15.8:0/334531995 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600afef4c60 con 0x5600b0193310 2023-08-11T12:29:36.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.598+0000 7fbd3519b700 1 --2- 172.21.15.8:0/334531995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5600b018de20 0x5600b0188340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:29:36.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.598+0000 7fbd3499a700 1 --2- 172.21.15.8:0/334531995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600b0193310 0x5600b0199430 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbd200127a0 tx=0x7fbd20009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30cb26720f66284d server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:29:36.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.598+0000 7fbd1bfff700 1 -- 172.21.15.8:0/334531995 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20017050 con 0x5600b0193310 2023-08-11T12:29:36.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.598+0000 7fbd1bfff700 1 -- 172.21.15.8:0/334531995 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd20018040 con 0x5600b0193310 2023-08-11T12:29:36.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.598+0000 7fbd1bfff700 1 -- 172.21.15.8:0/334531995 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20003e90 con 0x5600b0193310 2023-08-11T12:29:36.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.599+0000 7fbd4ad8db80 1 -- 172.21.15.8:0/334531995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600b0193310 msgr2=0x5600b0199430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:29:36.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.599+0000 7fbd4ad8db80 1 --2- 172.21.15.8:0/334531995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600b0193310 0x5600b0199430 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbd200127a0 tx=0x7fbd20009260 comp rx=0 tx=0).stop 2023-08-11T12:29:36.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.599+0000 7fbd4ad8db80 1 -- 172.21.15.8:0/334531995 shutdown_connections 2023-08-11T12:29:36.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.599+0000 7fbd4ad8db80 1 --2- 172.21.15.8:0/334531995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b0193c30 0x5600b0192590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.599+0000 7fbd4ad8db80 1 --2- 172.21.15.8:0/334531995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5600b018de20 0x5600b0188340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.599+0000 7fbd4ad8db80 1 --2- 172.21.15.8:0/334531995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600b0193310 0x5600b0199430 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.599+0000 7fbd4ad8db80 1 -- 172.21.15.8:0/334531995 >> 172.21.15.8:0/334531995 conn(0x5600b00ba950 msgr2=0x5600b019bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:29:36.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.599+0000 7fbd4ad8db80 1 -- 172.21.15.8:0/334531995 shutdown_connections 2023-08-11T12:29:36.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.599+0000 7fbd4ad8db80 1 -- 172.21.15.8:0/334531995 wait complete. 2023-08-11T12:29:36.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.599+0000 7fbd4ad8db80 1 -- start start 2023-08-11T12:29:36.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.600+0000 7fbd4ad8db80 1 Processor -- start 2023-08-11T12:29:36.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.600+0000 7fbd4ad8db80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600b018de20 0x5600b01a0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:36.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.600+0000 7fbd4ad8db80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b0193310 0x5600b01a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:36.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.600+0000 7fbd4ad8db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5600b0193c30 0x5600b019ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:36.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.600+0000 7fbd4ad8db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b019f3c0 con 0x5600b0193c30 2023-08-11T12:29:36.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.600+0000 7fbd4ad8db80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b019f530 con 0x5600b018de20 2023-08-11T12:29:36.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.600+0000 7fbd4ad8db80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b019f6f0 con 0x5600b0193310 2023-08-11T12:29:36.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.600+0000 7fbd4ad8db80 10 client.0 _ll_register_callbacks cb 0x7fbd2801c7c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:29:36.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.600+0000 7fbd3519b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600b018de20 0x5600b01a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:36.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.601+0000 7fbd3519b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600b018de20 0x5600b01a0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:57284/0 (socket says 172.21.15.8:57284) 2023-08-11T12:29:36.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.601+0000 7fbd3519b700 1 -- 172.21.15.8:0/763025861 learned_addr learned my addr 172.21.15.8:0/763025861 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:29:36.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.601+0000 7fbd3599c700 1 --2- 172.21.15.8:0/763025861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5600b0193c30 0x5600b019ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:36.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.601+0000 7fbd3499a700 1 --2- 172.21.15.8:0/763025861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b0193310 0x5600b01a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:36.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.601+0000 7fbd3519b700 1 -- 172.21.15.8:0/763025861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b0193310 msgr2=0x5600b01a0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:29:36.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.601+0000 7fbd3519b700 1 --2- 172.21.15.8:0/763025861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b0193310 0x5600b01a0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.601+0000 7fbd3519b700 1 -- 172.21.15.8:0/763025861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5600b0193c30 msgr2=0x5600b019ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:29:36.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.601+0000 7fbd3519b700 1 --2- 172.21.15.8:0/763025861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5600b0193c30 0x5600b019ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.601+0000 7fbd3519b700 1 -- 172.21.15.8:0/763025861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600aff5f630 con 0x5600b018de20 2023-08-11T12:29:36.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.601+0000 7fbd3599c700 1 --2- 172.21.15.8:0/763025861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5600b0193c30 0x5600b019ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:29:36.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.601+0000 7fbd3519b700 1 --2- 172.21.15.8:0/763025861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600b018de20 0x5600b01a0750 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c098490 tx=0x7fbd2c09a010 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e299789d0918eef4 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:29:36.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.601+0000 7fbd18ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:29:36.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.601+0000 7fbd18ff9700 1 -- 172.21.15.8:0/763025861 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c099c80 con 0x5600b018de20 2023-08-11T12:29:36.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.601+0000 7fbd4ad8db80 1 -- 172.21.15.8:0/763025861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbd2c09df70 con 0x5600b018de20 2023-08-11T12:29:36.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.601+0000 7fbd18ff9700 1 -- 172.21.15.8:0/763025861 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7fbd2c0228c0 con 0x5600b018de20 2023-08-11T12:29:36.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.602+0000 7fbd18ff9700 1 -- 172.21.15.8:0/763025861 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd2c066120 con 0x5600b018de20 2023-08-11T12:29:36.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.602+0000 7fbd4ad8db80 10 client.26291 fetch_fsmap learned FSMap version 43 2023-08-11T12:29:36.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.602+0000 7fbd4ad8db80 1 -- 172.21.15.8:0/763025861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x7fbd20012450 con 0x5600b018de20 2023-08-11T12:29:36.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.602+0000 7fbd18ff9700 1 -- 172.21.15.8:0/763025861 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd2c09df70 con 0x5600b018de20 2023-08-11T12:29:36.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.602+0000 7fbd18ff9700 1 -- 172.21.15.8:0/763025861 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 43) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fbd2c0a1a30 con 0x5600b018de20 2023-08-11T12:29:36.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.602+0000 7fbd4ad8db80 10 client.26291 fetch_fsmap finished waiting for FSMap version 43 2023-08-11T12:29:36.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.602+0000 7fbd4ad8db80 10 client.26291 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:29:36.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.602+0000 7fbd4ad8db80 20 client.26291 populate_metadata read hostname 'smithi008' 2023-08-11T12:29:36.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.602+0000 7fbd4ad8db80 1 --2- 172.21.15.8:0/763025861 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5600b02001d0 0x5600b02025f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:29:36.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.602+0000 7fbd4ad8db80 4 client.26291 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:29:36.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.602+0000 7fbd4ad8db80 1 -- 172.21.15.8:0/763025861 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5600b00d8820 con 0x5600b02001d0 2023-08-11T12:29:36.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.602+0000 7fbd3499a700 1 --2- 172.21.15.8:0/763025861 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5600b02001d0 0x5600b02025f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:29:36.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.603+0000 7fbd3499a700 1 --2- 172.21.15.8:0/763025861 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5600b02001d0 0x5600b02025f0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b1c3ca3493295d1 server_cookie=c3787bea283fe8a2 in_seq=0 out_seq=0 2023-08-11T12:29:36.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.603+0000 7fbd18ff9700 10 client.26291 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:29:36.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.603+0000 7fbd18ff9700 1 -- 172.21.15.8:0/763025861 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5600b00d8820 con 0x5600b02001d0 2023-08-11T12:29:36.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.603+0000 7fbd18ff9700 10 client.26291 handle_command_reply: tid=0 2023-08-11T12:29:36.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.603+0000 7fbd4ad8db80 1 client.26291 shutdown 2023-08-11T12:29:36.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.603+0000 7fbd4ad8db80 1 -- 172.21.15.8:0/763025861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600b018de20 msgr2=0x5600b01a0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:29:36.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.603+0000 7fbd4ad8db80 1 --2- 172.21.15.8:0/763025861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600b018de20 0x5600b01a0750 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c098490 tx=0x7fbd2c09a010 comp rx=0 tx=0).stop 2023-08-11T12:29:36.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.603+0000 7fbd4ad8db80 1 -- 172.21.15.8:0/763025861 shutdown_connections 2023-08-11T12:29:36.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.603+0000 7fbd4ad8db80 1 --2- 172.21.15.8:0/763025861 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5600b02001d0 0x5600b02025f0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.603+0000 7fbd4ad8db80 1 --2- 172.21.15.8:0/763025861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5600b0193c30 0x5600b019ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.603+0000 7fbd4ad8db80 1 --2- 172.21.15.8:0/763025861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600b018de20 0x5600b01a0750 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.603+0000 7fbd4ad8db80 1 --2- 172.21.15.8:0/763025861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b0193310 0x5600b01a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.603+0000 7fbd18ff9700 0 client.26291 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:29:36.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.603+0000 7fbd4ad8db80 1 -- 172.21.15.8:0/763025861 >> 172.21.15.8:0/763025861 conn(0x5600b00ba950 msgr2=0x5600b0188280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:29:36.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.603+0000 7fbd4ad8db80 1 -- 172.21.15.8:0/763025861 shutdown_connections 2023-08-11T12:29:36.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.603+0000 7fbd4ad8db80 1 -- 172.21.15.8:0/763025861 wait complete. 2023-08-11T12:29:36.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.604+0000 7fbd4ad8db80 20 client.26291 trim_cache size 0 max 16384 2023-08-11T12:29:36.621 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:29:36.621 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:29:36.622 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:29:36.622 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:29:36.622 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:29:36.622 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:29:36.622 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:29:36.622 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:29:36.623 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:29:36.623 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:29:36.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.604+0000 7fbd373ff700 1 -- 172.21.15.8:0/4262159800 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fbd1c0a00c0 msgr2=0x7fbd1c0a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:29:36.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.604+0000 7fbd373ff700 1 --2- 172.21.15.8:0/4262159800 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fbd1c0a00c0 0x7fbd1c0a2580 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbd3019d4d0 tx=0x7fbd28007a80 comp rx=0 tx=0).stop 2023-08-11T12:29:36.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.604+0000 7fbd373ff700 1 -- 172.21.15.8:0/4262159800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd30100960 msgr2=0x7fbd3019c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:29:36.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.604+0000 7fbd373ff700 1 --2- 172.21.15.8:0/4262159800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd30100960 0x7fbd3019c7d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c005910 tx=0x7fbd2c005720 comp rx=0 tx=0).stop 2023-08-11T12:29:36.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.604+0000 7fbd373ff700 1 -- 172.21.15.8:0/4262159800 shutdown_connections 2023-08-11T12:29:36.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.604+0000 7fbd373ff700 1 --2- 172.21.15.8:0/4262159800 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fbd1c0a00c0 0x7fbd1c0a2580 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.604+0000 7fbd373ff700 1 --2- 172.21.15.8:0/4262159800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd30106970 0x7fbd30196840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.604+0000 7fbd373ff700 1 --2- 172.21.15.8:0/4262159800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd30100960 0x7fbd3019c7d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.604+0000 7fbd373ff700 1 --2- 172.21.15.8:0/4262159800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd30101320 0x7fbd3019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:29:36.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.604+0000 7fbd373ff700 1 -- 172.21.15.8:0/4262159800 >> 172.21.15.8:0/4262159800 conn(0x7fbd300fc490 msgr2=0x7fbd300fcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:29:36.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.604+0000 7fbd373ff700 1 -- 172.21.15.8:0/4262159800 shutdown_connections 2023-08-11T12:29:36.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:29:36.604+0000 7fbd373ff700 1 -- 172.21.15.8:0/4262159800 wait complete. 2023-08-11T12:29:36.627 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:29:37.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:36 smithi008 ceph-mon[97158]: pgmap v153: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:37.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:36 smithi194 ceph-mon[130905]: pgmap v153: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:37.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:36 smithi045 ceph-mon[130284]: pgmap v153: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:39.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:38 smithi008 ceph-mon[97158]: pgmap v154: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:29:39.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:38 smithi194 ceph-mon[130905]: pgmap v154: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:29:39.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:38 smithi045 ceph-mon[130284]: pgmap v154: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:29:41.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:40 smithi008 ceph-mon[97158]: pgmap v155: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:41.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:40 smithi194 ceph-mon[130905]: pgmap v155: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:41.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:40 smithi045 ceph-mon[130284]: pgmap v155: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:43.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:42 smithi008 ceph-mon[97158]: pgmap v156: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:29:43.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:42 smithi194 ceph-mon[130905]: pgmap v156: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:29:43.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:42 smithi045 ceph-mon[130284]: pgmap v156: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:29:44.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:43 smithi008 ceph-mon[97158]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:29:44.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:43 smithi194 ceph-mon[130905]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:29:44.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:43 smithi045 ceph-mon[130284]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:29:45.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:44 smithi008 ceph-mon[97158]: pgmap v157: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:45.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:44 smithi194 ceph-mon[130905]: pgmap v157: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:45.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:44 smithi045 ceph-mon[130284]: pgmap v157: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:47.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:46 smithi008 ceph-mon[97158]: pgmap v158: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:47.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:46 smithi194 ceph-mon[130905]: pgmap v158: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:47.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:46 smithi045 ceph-mon[130284]: pgmap v158: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:49.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:48 smithi008 ceph-mon[97158]: pgmap v159: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:29:49.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:48 smithi194 ceph-mon[130905]: pgmap v159: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:29:49.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:48 smithi045 ceph-mon[130284]: pgmap v159: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:29:51.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:50 smithi008 ceph-mon[97158]: pgmap v160: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:51.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:50 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:29:51.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:50 smithi194 ceph-mon[130905]: pgmap v160: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:51.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:50 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:29:51.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:50 smithi045 ceph-mon[130284]: pgmap v160: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:51.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:50 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:29:52.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:51 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:29:52.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:51 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:29:52.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:51 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:29:52.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:51 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:29:52.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:51 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:29:52.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:51 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:29:52.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:51 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:29:52.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:51 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:29:52.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:51 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:29:53.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:52 smithi194 ceph-mon[130905]: pgmap v161: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:29:53.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:52 smithi194 ceph-mon[130905]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:29:53.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:52 smithi045 ceph-mon[130284]: pgmap v161: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:29:53.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:52 smithi045 ceph-mon[130284]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:29:53.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:52 smithi008 ceph-mon[97158]: pgmap v161: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:29:53.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:52 smithi008 ceph-mon[97158]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:29:55.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:54 smithi008 ceph-mon[97158]: pgmap v162: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:55.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:54 smithi194 ceph-mon[130905]: pgmap v162: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:55.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:54 smithi045 ceph-mon[130284]: pgmap v162: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:57.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:56 smithi008 ceph-mon[97158]: pgmap v163: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:57.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:56 smithi194 ceph-mon[130905]: pgmap v163: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:57.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:56 smithi045 ceph-mon[130284]: pgmap v163: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:29:59.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:58 smithi008 ceph-mon[97158]: pgmap v164: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:29:59.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:29:58 smithi008 ceph-mon[97158]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:29:59.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:58 smithi194 ceph-mon[130905]: pgmap v164: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:29:59.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:29:58 smithi194 ceph-mon[130905]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:29:59.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:58 smithi045 ceph-mon[130284]: pgmap v164: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:29:59.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:29:58 smithi045 ceph-mon[130284]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:30:01.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:00 smithi194 ceph-mon[130905]: pgmap v165: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:01.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:00 smithi194 ceph-mon[130905]: overall HEALTH_OK 2023-08-11T12:30:01.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:00 smithi045 ceph-mon[130284]: pgmap v165: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:01.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:00 smithi045 ceph-mon[130284]: overall HEALTH_OK 2023-08-11T12:30:01.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:00 smithi008 ceph-mon[97158]: pgmap v165: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:01.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:00 smithi008 ceph-mon[97158]: overall HEALTH_OK 2023-08-11T12:30:03.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:02 smithi008 ceph-mon[97158]: pgmap v166: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-08-11T12:30:03.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:02 smithi194 ceph-mon[130905]: pgmap v166: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-08-11T12:30:03.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:02 smithi045 ceph-mon[130284]: pgmap v166: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-08-11T12:30:04.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:03 smithi008 ceph-mon[97158]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:30:04.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:03 smithi194 ceph-mon[130905]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:30:04.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:03 smithi045 ceph-mon[130284]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:30:05.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:04 smithi008 ceph-mon[97158]: pgmap v167: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-08-11T12:30:05.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:04 smithi194 ceph-mon[130905]: pgmap v167: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-08-11T12:30:05.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:04 smithi045 ceph-mon[130284]: pgmap v167: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-08-11T12:30:06.628 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:30:06.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.850+0000 7f98769ff700 1 -- 172.21.15.8:0/1694006186 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9870100960 msgr2=0x7f9870100de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:30:06.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.850+0000 7f98769ff700 1 --2- 172.21.15.8:0/1694006186 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9870100960 0x7f9870100de0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9864009990 tx=0x7f9864009ca0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.850+0000 7f98769ff700 1 -- 172.21.15.8:0/1694006186 shutdown_connections 2023-08-11T12:30:06.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.850+0000 7f98769ff700 1 --2- 172.21.15.8:0/1694006186 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9870101320 0x7f987010d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.850+0000 7f98769ff700 1 --2- 172.21.15.8:0/1694006186 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9870106970 0x7f9870106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.850+0000 7f98769ff700 1 --2- 172.21.15.8:0/1694006186 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9870100960 0x7f9870100de0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.850+0000 7f98769ff700 1 -- 172.21.15.8:0/1694006186 >> 172.21.15.8:0/1694006186 conn(0x7f98700fc490 msgr2=0x7f98700fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:30:06.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.850+0000 7f98769ff700 1 -- 172.21.15.8:0/1694006186 shutdown_connections 2023-08-11T12:30:06.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.850+0000 7f98769ff700 1 -- 172.21.15.8:0/1694006186 wait complete. 2023-08-11T12:30:06.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.851+0000 7f98769ff700 1 Processor -- start 2023-08-11T12:30:06.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.851+0000 7f98769ff700 1 -- start start 2023-08-11T12:30:06.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.851+0000 7f98769ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9870100960 0x7f9870072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:06.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.851+0000 7f98769ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9870101320 0x7f9870073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:06.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.852+0000 7f98769ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9870106970 0x7f98701a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:06.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.852+0000 7f98769ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9870073990 con 0x7f9870101320 2023-08-11T12:30:06.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.852+0000 7f98769ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98701a5140 con 0x7f9870100960 2023-08-11T12:30:06.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.852+0000 7f98769ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98701a5280 con 0x7f9870106970 2023-08-11T12:30:06.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.852+0000 7f986ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9870100960 0x7f9870072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:06.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.852+0000 7f986ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9870100960 0x7f9870072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:44312/0 (socket says 172.21.15.8:44312) 2023-08-11T12:30:06.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.852+0000 7f986ffff700 1 -- 172.21.15.8:0/847042454 learned_addr learned my addr 172.21.15.8:0/847042454 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:30:06.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.852+0000 7f986f7fe700 1 --2- 172.21.15.8:0/847042454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9870101320 0x7f9870073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:06.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.852+0000 7f9874f9c700 1 --2- 172.21.15.8:0/847042454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9870106970 0x7f98701a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:06.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.852+0000 7f986ffff700 1 -- 172.21.15.8:0/847042454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9870106970 msgr2=0x7f98701a4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:30:06.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.852+0000 7f986ffff700 1 --2- 172.21.15.8:0/847042454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9870106970 0x7f98701a4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.852+0000 7f986ffff700 1 -- 172.21.15.8:0/847042454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9870101320 msgr2=0x7f9870073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:30:06.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.852+0000 7f986ffff700 1 --2- 172.21.15.8:0/847042454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9870101320 0x7f9870073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.852+0000 7f986ffff700 1 -- 172.21.15.8:0/847042454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98640095f0 con 0x7f9870100960 2023-08-11T12:30:06.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.852+0000 7f986f7fe700 1 --2- 172.21.15.8:0/847042454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9870101320 0x7f9870073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:30:06.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.852+0000 7f986ffff700 1 --2- 172.21.15.8:0/847042454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9870100960 0x7f9870072c20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f986000e9a0 tx=0x7f986000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:30:06.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.853+0000 7f986d7fa700 1 -- 172.21.15.8:0/847042454 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860009790 con 0x7f9870100960 2023-08-11T12:30:06.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.853+0000 7f986d7fa700 1 -- 172.21.15.8:0/847042454 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f986000cbd0 con 0x7f9870100960 2023-08-11T12:30:06.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.853+0000 7f98769ff700 1 -- 172.21.15.8:0/847042454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98701a54e0 con 0x7f9870100960 2023-08-11T12:30:06.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.853+0000 7f986d7fa700 1 -- 172.21.15.8:0/847042454 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860018680 con 0x7f9870100960 2023-08-11T12:30:06.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.853+0000 7f98769ff700 1 -- 172.21.15.8:0/847042454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98701a59c0 con 0x7f9870100960 2023-08-11T12:30:06.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.858+0000 7f986d7fa700 1 -- 172.21.15.8:0/847042454 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f986000cd40 con 0x7f9870100960 2023-08-11T12:30:06.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.859+0000 7f988a2dfb80 1 Processor -- start 2023-08-11T12:30:06.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.859+0000 7f988a2dfb80 1 -- start start 2023-08-11T12:30:06.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.859+0000 7f988a2dfb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580b3478310 0x5580b34786f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:06.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.859+0000 7f988a2dfb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5580b3478c30 0x5580b34728e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:06.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.859+0000 7f988a2dfb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5580b3472e20 0x5580b3473260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:06.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.859+0000 7f988a2dfb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580b33cb630 con 0x5580b3472e20 2023-08-11T12:30:06.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.859+0000 7f988a2dfb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580b33c8f50 con 0x5580b3478c30 2023-08-11T12:30:06.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.859+0000 7f988a2dfb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580b33c4840 con 0x5580b3478310 2023-08-11T12:30:06.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.859+0000 7f986ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5580b3478c30 0x5580b34728e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:06.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.860+0000 7f9874f9c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580b3478310 0x5580b34786f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:06.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.860+0000 7f9874f9c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580b3478310 0x5580b34786f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:60984/0 (socket says 172.21.15.8:60984) 2023-08-11T12:30:06.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.860+0000 7f9874f9c700 1 -- 172.21.15.8:0/2278062372 learned_addr learned my addr 172.21.15.8:0/2278062372 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:30:06.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.860+0000 7f986f7fe700 1 --2- 172.21.15.8:0/2278062372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5580b3472e20 0x5580b3473260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:06.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.860+0000 7f9874f9c700 1 -- 172.21.15.8:0/2278062372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5580b3478c30 msgr2=0x5580b34728e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:30:06.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.860+0000 7f9874f9c700 1 --2- 172.21.15.8:0/2278062372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5580b3478c30 0x5580b34728e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.860+0000 7f9874f9c700 1 -- 172.21.15.8:0/2278062372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5580b3472e20 msgr2=0x5580b3473260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:30:06.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.860+0000 7f986d7fa700 1 --2- 172.21.15.8:0/847042454 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f98580a00c0 0x7f98580a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:06.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.860+0000 7f9874f9c700 1 --2- 172.21.15.8:0/2278062372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5580b3472e20 0x5580b3473260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.860+0000 7f9874f9c700 1 -- 172.21.15.8:0/2278062372 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5580b3244630 con 0x5580b3478310 2023-08-11T12:30:06.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.860+0000 7f986ffff700 1 --2- 172.21.15.8:0/2278062372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5580b3478c30 0x5580b34728e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:30:06.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.860+0000 7f986f7fe700 1 --2- 172.21.15.8:0/2278062372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5580b3472e20 0x5580b3473260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:30:06.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.860+0000 7f986d7fa700 1 -- 172.21.15.8:0/847042454 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f9860014070 con 0x7f9870100960 2023-08-11T12:30:06.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.861+0000 7f9874f9c700 1 --2- 172.21.15.8:0/847042454 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f98580a00c0 0x7f98580a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:06.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.861+0000 7f9874f9c700 1 --2- 172.21.15.8:0/2278062372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580b3478310 0x5580b34786f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f98680093e0 tx=0x7f9868009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa3ad653f0b2c317 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:30:06.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.861+0000 7f98567fc700 1 -- 172.21.15.8:0/2278062372 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986800e070 con 0x5580b3478310 2023-08-11T12:30:06.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.861+0000 7f98567fc700 1 -- 172.21.15.8:0/2278062372 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f986800f040 con 0x5580b3478310 2023-08-11T12:30:06.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.861+0000 7f98567fc700 1 -- 172.21.15.8:0/2278062372 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9868020630 con 0x5580b3478310 2023-08-11T12:30:06.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.862+0000 7f988a2dfb80 1 -- 172.21.15.8:0/2278062372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580b3478310 msgr2=0x5580b34786f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:30:06.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.862+0000 7f9874f9c700 1 --2- 172.21.15.8:0/847042454 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f98580a00c0 0x7f98580a2580 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f986801f000 tx=0x7f9868022000 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:30:06.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.862+0000 7f988a2dfb80 1 --2- 172.21.15.8:0/2278062372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580b3478310 0x5580b34786f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f98680093e0 tx=0x7f9868009920 comp rx=0 tx=0).stop 2023-08-11T12:30:06.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.862+0000 7f988a2dfb80 1 -- 172.21.15.8:0/2278062372 shutdown_connections 2023-08-11T12:30:06.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.862+0000 7f988a2dfb80 1 --2- 172.21.15.8:0/2278062372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580b3478310 0x5580b34786f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.862+0000 7f988a2dfb80 1 --2- 172.21.15.8:0/2278062372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5580b3472e20 0x5580b3473260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.862+0000 7f988a2dfb80 1 --2- 172.21.15.8:0/2278062372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5580b3478c30 0x5580b34728e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.862+0000 7f988a2dfb80 1 -- 172.21.15.8:0/2278062372 >> 172.21.15.8:0/2278062372 conn(0x5580b339f950 msgr2=0x5580b346d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:30:06.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.862+0000 7f988a2dfb80 1 -- 172.21.15.8:0/2278062372 shutdown_connections 2023-08-11T12:30:06.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.862+0000 7f988a2dfb80 1 -- 172.21.15.8:0/2278062372 wait complete. 2023-08-11T12:30:06.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.863+0000 7f988a2dfb80 1 -- start start 2023-08-11T12:30:06.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.863+0000 7f988a2dfb80 1 Processor -- start 2023-08-11T12:30:06.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.863+0000 7f988a2dfb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580b3472e20 0x5580b347ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:06.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.863+0000 7f988a2dfb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5580b3478310 0x5580b347bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:06.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.863+0000 7f988a2dfb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5580b3478c30 0x5580b347c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:06.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.863+0000 7f988a2dfb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580b3362ac0 con 0x5580b3478310 2023-08-11T12:30:06.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.863+0000 7f988a2dfb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580b33627c0 con 0x5580b3478c30 2023-08-11T12:30:06.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.863+0000 7f988a2dfb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580b3246920 con 0x5580b3472e20 2023-08-11T12:30:06.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.863+0000 7f988a2dfb80 10 client.0 _ll_register_callbacks cb 0x5580b3365ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:30:06.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.864+0000 7f986ffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580b3472e20 0x5580b347ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:06.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.864+0000 7f986ffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580b3472e20 0x5580b347ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:60998/0 (socket says 172.21.15.8:60998) 2023-08-11T12:30:06.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.864+0000 7f986ffff700 1 -- 172.21.15.8:0/2189119969 learned_addr learned my addr 172.21.15.8:0/2189119969 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:30:06.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.864+0000 7f986f7fe700 1 --2- 172.21.15.8:0/2189119969 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5580b3478310 0x5580b347bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:06.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.864+0000 7f9874f9c700 1 --2- 172.21.15.8:0/2189119969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5580b3478c30 0x5580b347c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:06.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.864+0000 7f986ffff700 1 -- 172.21.15.8:0/2189119969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5580b3478c30 msgr2=0x5580b347c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:30:06.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.864+0000 7f986ffff700 1 --2- 172.21.15.8:0/2189119969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5580b3478c30 0x5580b347c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.864+0000 7f986ffff700 1 -- 172.21.15.8:0/2189119969 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5580b3478310 msgr2=0x5580b347bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:30:06.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.864+0000 7f986ffff700 1 --2- 172.21.15.8:0/2189119969 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5580b3478310 0x5580b347bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.864+0000 7f986ffff700 1 -- 172.21.15.8:0/2189119969 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98701a59c0 con 0x5580b3472e20 2023-08-11T12:30:06.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.864+0000 7f986ffff700 1 --2- 172.21.15.8:0/2189119969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580b3472e20 0x5580b347ebf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f98600c9050 tx=0x7f98600c9550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3a8a049b8c7ff76 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:30:06.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.864+0000 7f984f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:30:06.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.865+0000 7f984f7fe700 1 -- 172.21.15.8:0/2189119969 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860098910 con 0x5580b3472e20 2023-08-11T12:30:06.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.865+0000 7f988a2dfb80 1 -- 172.21.15.8:0/2189119969 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5580b3465a90 con 0x5580b3472e20 2023-08-11T12:30:06.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.865+0000 7f984f7fe700 1 -- 172.21.15.8:0/2189119969 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f98600996b0 con 0x5580b3472e20 2023-08-11T12:30:06.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.865+0000 7f984f7fe700 1 -- 172.21.15.8:0/2189119969 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9860098fb0 con 0x5580b3472e20 2023-08-11T12:30:06.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.865+0000 7f988a2dfb80 10 client.26311 fetch_fsmap learned FSMap version 48 2023-08-11T12:30:06.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.865+0000 7f988a2dfb80 1 -- 172.21.15.8:0/2189119969 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x7f9868009090 con 0x5580b3472e20 2023-08-11T12:30:06.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.865+0000 7f984f7fe700 1 -- 172.21.15.8:0/2189119969 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5580b3465a90 con 0x5580b3472e20 2023-08-11T12:30:06.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.865+0000 7f984f7fe700 1 -- 172.21.15.8:0/2189119969 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 48) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f9860093bc0 con 0x5580b3472e20 2023-08-11T12:30:06.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.865+0000 7f988a2dfb80 10 client.26311 fetch_fsmap finished waiting for FSMap version 48 2023-08-11T12:30:06.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.865+0000 7f988a2dfb80 10 client.26311 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:30:06.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.865+0000 7f988a2dfb80 20 client.26311 populate_metadata read hostname 'smithi008' 2023-08-11T12:30:06.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.866+0000 7f988a2dfb80 1 --2- 172.21.15.8:0/2189119969 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5580b348c320 0x5580b348e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:06.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.866+0000 7f988a2dfb80 4 client.26311 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:30:06.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.866+0000 7f988a2dfb80 1 -- 172.21.15.8:0/2189119969 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5580b34414e0 con 0x5580b348c320 2023-08-11T12:30:06.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.866+0000 7f986f7fe700 1 --2- 172.21.15.8:0/2189119969 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5580b348c320 0x5580b348e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:06.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.866+0000 7f986f7fe700 1 --2- 172.21.15.8:0/2189119969 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5580b348c320 0x5580b348e740 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a3bb60ae36aff36 server_cookie=40a9b68f897b7ce8 in_seq=0 out_seq=0 2023-08-11T12:30:06.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.866+0000 7f984f7fe700 10 client.26311 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:30:06.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.867+0000 7f984f7fe700 1 -- 172.21.15.8:0/2189119969 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5580b34414e0 con 0x5580b348c320 2023-08-11T12:30:06.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.867+0000 7f984f7fe700 10 client.26311 handle_command_reply: tid=0 2023-08-11T12:30:06.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.867+0000 7f988a2dfb80 1 client.26311 shutdown 2023-08-11T12:30:06.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.867+0000 7f988a2dfb80 1 -- 172.21.15.8:0/2189119969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580b3472e20 msgr2=0x5580b347ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:30:06.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.867+0000 7f988a2dfb80 1 --2- 172.21.15.8:0/2189119969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580b3472e20 0x5580b347ebf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f98600c9050 tx=0x7f98600c9550 comp rx=0 tx=0).stop 2023-08-11T12:30:06.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.867+0000 7f988a2dfb80 1 -- 172.21.15.8:0/2189119969 shutdown_connections 2023-08-11T12:30:06.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.867+0000 7f988a2dfb80 1 --2- 172.21.15.8:0/2189119969 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5580b348c320 0x5580b348e740 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.867+0000 7f988a2dfb80 1 --2- 172.21.15.8:0/2189119969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580b3472e20 0x5580b347ebf0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.867+0000 7f988a2dfb80 1 --2- 172.21.15.8:0/2189119969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5580b3478c30 0x5580b347c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.867+0000 7f988a2dfb80 1 --2- 172.21.15.8:0/2189119969 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5580b3478310 0x5580b347bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.867+0000 7f984f7fe700 0 client.26311 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:30:06.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.867+0000 7f988a2dfb80 1 -- 172.21.15.8:0/2189119969 >> 172.21.15.8:0/2189119969 conn(0x5580b339f950 msgr2=0x5580b3467cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:30:06.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.867+0000 7f988a2dfb80 1 -- 172.21.15.8:0/2189119969 shutdown_connections 2023-08-11T12:30:06.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.868+0000 7f988a2dfb80 1 -- 172.21.15.8:0/2189119969 wait complete. 2023-08-11T12:30:06.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.868+0000 7f988a2dfb80 20 client.26311 trim_cache size 0 max 16384 2023-08-11T12:30:06.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.885+0000 7f988a2dfb80 1 Processor -- start 2023-08-11T12:30:06.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.885+0000 7f988a2dfb80 1 -- start start 2023-08-11T12:30:06.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.885+0000 7f988a2dfb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5580b3472e20 0x5580b34728e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:06.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.885+0000 7f988a2dfb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580b3478310 0x5580b3483580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:06.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.885+0000 7f988a2dfb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5580b3478c30 0x5580b347e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:06.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.885+0000 7f988a2dfb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580b34884d0 con 0x5580b3472e20 2023-08-11T12:30:06.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.885+0000 7f988a2dfb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580b346d970 con 0x5580b3478c30 2023-08-11T12:30:06.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.885+0000 7f988a2dfb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580b3489b80 con 0x5580b3478310 2023-08-11T12:30:06.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.885+0000 7f986ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5580b3472e20 0x5580b34728e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:06.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.885+0000 7f986ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5580b3472e20 0x5580b34728e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55710/0 (socket says 172.21.15.8:55710) 2023-08-11T12:30:06.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.885+0000 7f986ffff700 1 -- 172.21.15.8:0/832158326 learned_addr learned my addr 172.21.15.8:0/832158326 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:30:06.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.885+0000 7f9874f9c700 1 --2- 172.21.15.8:0/832158326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5580b3478c30 0x5580b347e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:06.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.885+0000 7f986f7fe700 1 --2- 172.21.15.8:0/832158326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580b3478310 0x5580b3483580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:06.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.886+0000 7f986ffff700 1 -- 172.21.15.8:0/832158326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580b3478310 msgr2=0x5580b3483580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:30:06.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.886+0000 7f986ffff700 1 --2- 172.21.15.8:0/832158326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580b3478310 0x5580b3483580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.886+0000 7f986ffff700 1 -- 172.21.15.8:0/832158326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5580b3478c30 msgr2=0x5580b347e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:30:06.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.886+0000 7f986ffff700 1 --2- 172.21.15.8:0/832158326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5580b3478c30 0x5580b347e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.886+0000 7f986ffff700 1 -- 172.21.15.8:0/832158326 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5580b31f0de0 con 0x5580b3472e20 2023-08-11T12:30:06.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.886+0000 7f986f7fe700 1 --2- 172.21.15.8:0/832158326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580b3478310 0x5580b3483580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:30:06.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.886+0000 7f986ffff700 1 --2- 172.21.15.8:0/832158326 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5580b3472e20 0x5580b34728e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9860098f40 tx=0x7f9860098bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d77e08a5c8f2e02 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:30:06.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.886+0000 7f9856ffd700 1 -- 172.21.15.8:0/832158326 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860094da0 con 0x5580b3472e20 2023-08-11T12:30:06.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.886+0000 7f9856ffd700 1 -- 172.21.15.8:0/832158326 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f98600d0030 con 0x5580b3472e20 2023-08-11T12:30:06.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.886+0000 7f9856ffd700 1 -- 172.21.15.8:0/832158326 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860094f90 con 0x5580b3472e20 2023-08-11T12:30:06.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.887+0000 7f988a2dfb80 1 -- 172.21.15.8:0/832158326 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5580b3472e20 msgr2=0x5580b34728e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:30:06.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.887+0000 7f988a2dfb80 1 --2- 172.21.15.8:0/832158326 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5580b3472e20 0x5580b34728e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9860098f40 tx=0x7f9860098bb0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.887+0000 7f988a2dfb80 1 -- 172.21.15.8:0/832158326 shutdown_connections 2023-08-11T12:30:06.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.887+0000 7f988a2dfb80 1 --2- 172.21.15.8:0/832158326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5580b3478c30 0x5580b347e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.887+0000 7f988a2dfb80 1 --2- 172.21.15.8:0/832158326 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5580b3472e20 0x5580b34728e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.887+0000 7f988a2dfb80 1 --2- 172.21.15.8:0/832158326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580b3478310 0x5580b3483580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.887+0000 7f988a2dfb80 1 -- 172.21.15.8:0/832158326 >> 172.21.15.8:0/832158326 conn(0x5580b339f950 msgr2=0x5580b3488800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:30:06.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.887+0000 7f988a2dfb80 1 -- 172.21.15.8:0/832158326 shutdown_connections 2023-08-11T12:30:06.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.887+0000 7f988a2dfb80 1 -- 172.21.15.8:0/832158326 wait complete. 2023-08-11T12:30:06.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.887+0000 7f988a2dfb80 1 -- start start 2023-08-11T12:30:06.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.887+0000 7f988a2dfb80 1 Processor -- start 2023-08-11T12:30:06.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.888+0000 7f988a2dfb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5580b3472e20 0x5580b3481bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:06.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.888+0000 7f988a2dfb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580b3478310 0x5580b34820f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:06.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.888+0000 7f988a2dfb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5580b3478c30 0x5580b3482630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:06.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.888+0000 7f988a2dfb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580b34dffe0 con 0x5580b3472e20 2023-08-11T12:30:06.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.888+0000 7f988a2dfb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580b34e0120 con 0x5580b3478c30 2023-08-11T12:30:06.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.888+0000 7f988a2dfb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580b34e02e0 con 0x5580b3478310 2023-08-11T12:30:06.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.888+0000 7f988a2dfb80 10 client.0 _ll_register_callbacks cb 0x7f986000eef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:30:06.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.888+0000 7f986ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5580b3472e20 0x5580b3481bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:06.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.888+0000 7f9874f9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5580b3478c30 0x5580b3482630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:06.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.888+0000 7f986ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5580b3472e20 0x5580b3481bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55718/0 (socket says 172.21.15.8:55718) 2023-08-11T12:30:06.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.888+0000 7f986ffff700 1 -- 172.21.15.8:0/225234405 learned_addr learned my addr 172.21.15.8:0/225234405 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:30:06.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.888+0000 7f986f7fe700 1 --2- 172.21.15.8:0/225234405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580b3478310 0x5580b34820f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:06.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.888+0000 7f986ffff700 1 -- 172.21.15.8:0/225234405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580b3478310 msgr2=0x5580b34820f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:30:06.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.888+0000 7f986ffff700 1 --2- 172.21.15.8:0/225234405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580b3478310 0x5580b34820f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.888+0000 7f986ffff700 1 -- 172.21.15.8:0/225234405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5580b3478c30 msgr2=0x5580b3482630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:30:06.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.889+0000 7f986ffff700 1 --2- 172.21.15.8:0/225234405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5580b3478c30 0x5580b3482630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.889+0000 7f986ffff700 1 -- 172.21.15.8:0/225234405 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9868009090 con 0x5580b3472e20 2023-08-11T12:30:06.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.889+0000 7f9874f9c700 1 --2- 172.21.15.8:0/225234405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5580b3478c30 0x5580b3482630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:30:06.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.889+0000 7f986ffff700 1 --2- 172.21.15.8:0/225234405 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5580b3472e20 0x5580b3481bb0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9860098cb0 tx=0x7f9860099570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a14d3cd929f120 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:30:06.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.889+0000 7f984f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:30:06.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.889+0000 7f984f7fe700 1 -- 172.21.15.8:0/225234405 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860094fa0 con 0x5580b3472e20 2023-08-11T12:30:06.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.889+0000 7f984f7fe700 1 -- 172.21.15.8:0/225234405 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f9860098fb0 con 0x5580b3472e20 2023-08-11T12:30:06.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.889+0000 7f988a2dfb80 1 -- 172.21.15.8:0/225234405 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f986800f040 con 0x5580b3472e20 2023-08-11T12:30:06.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.889+0000 7f984f7fe700 1 -- 172.21.15.8:0/225234405 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98600a0b40 con 0x5580b3472e20 2023-08-11T12:30:06.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.889+0000 7f988a2dfb80 10 client.16266 fetch_fsmap learned FSMap version 48 2023-08-11T12:30:06.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.889+0000 7f988a2dfb80 1 -- 172.21.15.8:0/225234405 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x5580b31d9c60 con 0x5580b3472e20 2023-08-11T12:30:06.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.889+0000 7f984f7fe700 1 -- 172.21.15.8:0/225234405 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f986800f040 con 0x5580b3472e20 2023-08-11T12:30:06.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.889+0000 7f984f7fe700 1 -- 172.21.15.8:0/225234405 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 48) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f9860099940 con 0x5580b3472e20 2023-08-11T12:30:06.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.890+0000 7f988a2dfb80 10 client.16266 fetch_fsmap finished waiting for FSMap version 48 2023-08-11T12:30:06.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.890+0000 7f988a2dfb80 10 client.16266 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:30:06.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.890+0000 7f988a2dfb80 20 client.16266 populate_metadata read hostname 'smithi008' 2023-08-11T12:30:06.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.890+0000 7f988a2dfb80 1 --2- 172.21.15.8:0/225234405 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5580b34e15e0 0x5580b34e3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:06.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.890+0000 7f988a2dfb80 4 client.16266 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:30:06.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.890+0000 7f988a2dfb80 1 -- 172.21.15.8:0/225234405 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5580b33bd820 con 0x5580b34e15e0 2023-08-11T12:30:06.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.890+0000 7f986f7fe700 1 --2- 172.21.15.8:0/225234405 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5580b34e15e0 0x5580b34e3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:06.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.890+0000 7f984f7fe700 10 client.16266 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:30:06.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.890+0000 7f986f7fe700 1 --2- 172.21.15.8:0/225234405 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5580b34e15e0 0x5580b34e3a00 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4981b8b42104d207 server_cookie=596416350e4cec9c in_seq=0 out_seq=0 2023-08-11T12:30:06.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.891+0000 7f984f7fe700 1 -- 172.21.15.8:0/225234405 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5580b33bd820 con 0x5580b34e15e0 2023-08-11T12:30:06.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.891+0000 7f984f7fe700 10 client.16266 handle_command_reply: tid=0 2023-08-11T12:30:06.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.891+0000 7f988a2dfb80 1 client.16266 shutdown 2023-08-11T12:30:06.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.891+0000 7f988a2dfb80 1 -- 172.21.15.8:0/225234405 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5580b3472e20 msgr2=0x5580b3481bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:30:06.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.891+0000 7f988a2dfb80 1 --2- 172.21.15.8:0/225234405 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5580b3472e20 0x5580b3481bb0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9860098cb0 tx=0x7f9860099570 comp rx=0 tx=0).stop 2023-08-11T12:30:06.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.891+0000 7f988a2dfb80 1 -- 172.21.15.8:0/225234405 shutdown_connections 2023-08-11T12:30:06.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.891+0000 7f988a2dfb80 1 --2- 172.21.15.8:0/225234405 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5580b34e15e0 0x5580b34e3a00 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.891+0000 7f988a2dfb80 1 --2- 172.21.15.8:0/225234405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5580b3478c30 0x5580b3482630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.891+0000 7f988a2dfb80 1 --2- 172.21.15.8:0/225234405 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5580b3472e20 0x5580b3481bb0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.891+0000 7f984f7fe700 0 client.16266 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:30:06.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.891+0000 7f988a2dfb80 1 --2- 172.21.15.8:0/225234405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580b3478310 0x5580b34820f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.891+0000 7f988a2dfb80 1 -- 172.21.15.8:0/225234405 >> 172.21.15.8:0/225234405 conn(0x5580b339f950 msgr2=0x5580b3477080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:30:06.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.891+0000 7f988a2dfb80 1 -- 172.21.15.8:0/225234405 shutdown_connections 2023-08-11T12:30:06.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.891+0000 7f988a2dfb80 1 -- 172.21.15.8:0/225234405 wait complete. 2023-08-11T12:30:06.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.891+0000 7f988a2dfb80 20 client.16266 trim_cache size 0 max 16384 2023-08-11T12:30:06.931 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:30:06.932 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:30:06.932 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:30:06.932 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:30:06.932 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:30:06.933 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:30:06.933 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:30:06.933 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:30:06.933 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:30:06.933 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:30:06.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.892+0000 7f98769ff700 1 -- 172.21.15.8:0/847042454 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f98580a00c0 msgr2=0x7f98580a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:30:06.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.892+0000 7f98769ff700 1 --2- 172.21.15.8:0/847042454 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f98580a00c0 0x7f98580a2580 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f986801f000 tx=0x7f9868022000 comp rx=0 tx=0).stop 2023-08-11T12:30:06.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.892+0000 7f98769ff700 1 -- 172.21.15.8:0/847042454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9870100960 msgr2=0x7f9870072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:30:06.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.892+0000 7f98769ff700 1 --2- 172.21.15.8:0/847042454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9870100960 0x7f9870072c20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f986000e9a0 tx=0x7f986000ecb0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.892+0000 7f98769ff700 1 -- 172.21.15.8:0/847042454 shutdown_connections 2023-08-11T12:30:06.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.892+0000 7f98769ff700 1 --2- 172.21.15.8:0/847042454 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f98580a00c0 0x7f98580a2580 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.892+0000 7f98769ff700 1 --2- 172.21.15.8:0/847042454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9870106970 0x7f98701a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.892+0000 7f98769ff700 1 --2- 172.21.15.8:0/847042454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9870100960 0x7f9870072c20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.892+0000 7f98769ff700 1 --2- 172.21.15.8:0/847042454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9870101320 0x7f9870073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:06.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.892+0000 7f98769ff700 1 -- 172.21.15.8:0/847042454 >> 172.21.15.8:0/847042454 conn(0x7f98700fc490 msgr2=0x7f98700fca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:30:06.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.892+0000 7f98769ff700 1 -- 172.21.15.8:0/847042454 shutdown_connections 2023-08-11T12:30:06.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:06.892+0000 7f98769ff700 1 -- 172.21.15.8:0/847042454 wait complete. 2023-08-11T12:30:06.937 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:30:07.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:06 smithi008 ceph-mon[97158]: pgmap v168: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-08-11T12:30:07.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:06 smithi008 ceph-mon[97158]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:30:07.248 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:06 smithi045 ceph-mon[130284]: pgmap v168: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-08-11T12:30:07.248 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:06 smithi045 ceph-mon[130284]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:30:07.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:06 smithi194 ceph-mon[130905]: pgmap v168: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-08-11T12:30:07.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:06 smithi194 ceph-mon[130905]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:30:08.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:07 smithi045 ceph-mon[130284]: pgmap v169: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-08-11T12:30:08.146 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:07 smithi045 ceph-mon[130284]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:30:08.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:07 smithi008 ceph-mon[97158]: pgmap v169: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-08-11T12:30:08.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:07 smithi008 ceph-mon[97158]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:30:08.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:07 smithi194 ceph-mon[130905]: pgmap v169: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-08-11T12:30:08.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:07 smithi194 ceph-mon[130905]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:30:11.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:10 smithi194 ceph-mon[130905]: pgmap v170: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-08-11T12:30:11.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:10 smithi045 ceph-mon[130284]: pgmap v170: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-08-11T12:30:11.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:10 smithi008 ceph-mon[97158]: pgmap v170: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-08-11T12:30:12.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:11 smithi194 ceph-mon[130905]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:30:12.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:11 smithi045 ceph-mon[130284]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:30:12.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:11 smithi008 ceph-mon[97158]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:30:13.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:12 smithi194 ceph-mon[130905]: pgmap v171: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-08-11T12:30:13.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:12 smithi045 ceph-mon[130284]: pgmap v171: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-08-11T12:30:13.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:12 smithi008 ceph-mon[97158]: pgmap v171: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-08-11T12:30:14.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:13 smithi194 ceph-mon[130905]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:30:14.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:13 smithi045 ceph-mon[130284]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:30:14.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:13 smithi008 ceph-mon[97158]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:30:15.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:14 smithi194 ceph-mon[130905]: pgmap v172: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-08-11T12:30:15.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:14 smithi045 ceph-mon[130284]: pgmap v172: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-08-11T12:30:15.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:14 smithi008 ceph-mon[97158]: pgmap v172: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-08-11T12:30:17.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:16 smithi194 ceph-mon[130905]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:30:17.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:16 smithi194 ceph-mon[130905]: pgmap v173: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-08-11T12:30:17.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:16 smithi045 ceph-mon[130284]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:30:17.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:16 smithi045 ceph-mon[130284]: pgmap v173: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-08-11T12:30:17.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:16 smithi008 ceph-mon[97158]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:30:17.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:16 smithi008 ceph-mon[97158]: pgmap v173: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-08-11T12:30:19.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:18 smithi194 ceph-mon[130905]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:30:19.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:18 smithi194 ceph-mon[130905]: pgmap v174: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2023-08-11T12:30:19.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:18 smithi045 ceph-mon[130284]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:30:19.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:18 smithi045 ceph-mon[130284]: pgmap v174: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2023-08-11T12:30:19.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:18 smithi008 ceph-mon[97158]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:30:19.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:18 smithi008 ceph-mon[97158]: pgmap v174: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2023-08-11T12:30:21.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:20 smithi194 ceph-mon[130905]: pgmap v175: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-08-11T12:30:21.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:20 smithi045 ceph-mon[130284]: pgmap v175: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-08-11T12:30:21.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:20 smithi008 ceph-mon[97158]: pgmap v175: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-08-11T12:30:23.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:22 smithi008 ceph-mon[97158]: pgmap v176: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:30:23.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:22 smithi194 ceph-mon[130905]: pgmap v176: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:30:23.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:22 smithi045 ceph-mon[130284]: pgmap v176: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:30:25.267 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:24 smithi045 ceph-mon[130284]: pgmap v177: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:25.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:24 smithi008 ceph-mon[97158]: pgmap v177: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:25.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:24 smithi194 ceph-mon[130905]: pgmap v177: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:27.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:26 smithi008 ceph-mon[97158]: pgmap v178: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:27.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:26 smithi194 ceph-mon[130905]: pgmap v178: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:27.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:26 smithi045 ceph-mon[130284]: pgmap v178: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:29.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:28 smithi008 ceph-mon[97158]: pgmap v179: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:30:29.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:28 smithi194 ceph-mon[130905]: pgmap v179: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:30:29.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:28 smithi045 ceph-mon[130284]: pgmap v179: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:30:31.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:30 smithi194 ceph-mon[130905]: pgmap v180: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:31.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:30 smithi045 ceph-mon[130284]: pgmap v180: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:31.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:30 smithi008 ceph-mon[97158]: pgmap v180: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:33.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:32 smithi008 ceph-mon[97158]: pgmap v181: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:30:33.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:32 smithi194 ceph-mon[130905]: pgmap v181: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:30:33.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:32 smithi045 ceph-mon[130284]: pgmap v181: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:30:35.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:34 smithi008 ceph-mon[97158]: pgmap v182: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:35.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:34 smithi194 ceph-mon[130905]: pgmap v182: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:35.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:34 smithi045 ceph-mon[130284]: pgmap v182: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:36.939 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:30:37.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.156+0000 7f773b9ff700 1 -- 172.21.15.8:0/134768741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7734100960 msgr2=0x7f7734100de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:30:37.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.156+0000 7f773b9ff700 1 --2- 172.21.15.8:0/134768741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7734100960 0x7f7734100de0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f77240098f0 tx=0x7f7724009c00 comp rx=0 tx=0).stop 2023-08-11T12:30:37.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.156+0000 7f773b9ff700 1 -- 172.21.15.8:0/134768741 shutdown_connections 2023-08-11T12:30:37.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.156+0000 7f773b9ff700 1 --2- 172.21.15.8:0/134768741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7734106970 0x7f7734106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.156+0000 7f773b9ff700 1 --2- 172.21.15.8:0/134768741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7734101320 0x7f773410d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.156+0000 7f773b9ff700 1 --2- 172.21.15.8:0/134768741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7734100960 0x7f7734100de0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.156+0000 7f773b9ff700 1 -- 172.21.15.8:0/134768741 >> 172.21.15.8:0/134768741 conn(0x7f77340fc490 msgr2=0x7f77340fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:30:37.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.156+0000 7f773b9ff700 1 -- 172.21.15.8:0/134768741 shutdown_connections 2023-08-11T12:30:37.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.156+0000 7f773b9ff700 1 -- 172.21.15.8:0/134768741 wait complete. 2023-08-11T12:30:37.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.157+0000 7f773b9ff700 1 Processor -- start 2023-08-11T12:30:37.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.157+0000 7f773b9ff700 1 -- start start 2023-08-11T12:30:37.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.158+0000 7f773b9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7734100960 0x7f773419ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:37.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.158+0000 7f773b9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7734101320 0x7f773419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:37.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.158+0000 7f773b9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7734106970 0x7f7734198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:37.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.158+0000 7f773b9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7734199100 con 0x7f7734100960 2023-08-11T12:30:37.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.158+0000 7f773b9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7734199270 con 0x7f7734106970 2023-08-11T12:30:37.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.158+0000 7f773b9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7734199430 con 0x7f7734101320 2023-08-11T12:30:37.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.158+0000 7f773979b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7734100960 0x7f773419ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:37.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.158+0000 7f773979b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7734100960 0x7f773419ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55622/0 (socket says 172.21.15.8:55622) 2023-08-11T12:30:37.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.158+0000 7f7739f9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7734106970 0x7f7734198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:37.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.158+0000 7f773979b700 1 -- 172.21.15.8:0/3512172406 learned_addr learned my addr 172.21.15.8:0/3512172406 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:30:37.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.158+0000 7f7738f9a700 1 --2- 172.21.15.8:0/3512172406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7734101320 0x7f773419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:37.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.158+0000 7f773979b700 1 -- 172.21.15.8:0/3512172406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7734101320 msgr2=0x7f773419ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:30:37.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.158+0000 7f773979b700 1 --2- 172.21.15.8:0/3512172406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7734101320 0x7f773419ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.158+0000 7f773979b700 1 -- 172.21.15.8:0/3512172406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7734106970 msgr2=0x7f7734198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:30:37.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.158+0000 7f773979b700 1 --2- 172.21.15.8:0/3512172406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7734106970 0x7f7734198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.158+0000 7f773979b700 1 -- 172.21.15.8:0/3512172406 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772c009d00 con 0x7f7734100960 2023-08-11T12:30:37.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.159+0000 7f773979b700 1 --2- 172.21.15.8:0/3512172406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7734100960 0x7f773419ea20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f773000e9a0 tx=0x7f773000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:30:37.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.159+0000 7f772a7fc700 1 -- 172.21.15.8:0/3512172406 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730009790 con 0x7f7734100960 2023-08-11T12:30:37.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.159+0000 7f772a7fc700 1 -- 172.21.15.8:0/3512172406 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7730010430 con 0x7f7734100960 2023-08-11T12:30:37.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.159+0000 7f773b9ff700 1 -- 172.21.15.8:0/3512172406 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7724009520 con 0x7f7734100960 2023-08-11T12:30:37.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.159+0000 7f772a7fc700 1 -- 172.21.15.8:0/3512172406 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730018680 con 0x7f7734100960 2023-08-11T12:30:37.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.159+0000 7f773b9ff700 1 -- 172.21.15.8:0/3512172406 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77341998d0 con 0x7f7734100960 2023-08-11T12:30:37.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.162+0000 7f772a7fc700 1 -- 172.21.15.8:0/3512172406 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f77300105a0 con 0x7f7734100960 2023-08-11T12:30:37.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.163+0000 7f774f410b80 1 Processor -- start 2023-08-11T12:30:37.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.164+0000 7f774f410b80 1 -- start start 2023-08-11T12:30:37.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.164+0000 7f772a7fc700 1 --2- 172.21.15.8:0/3512172406 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f77200a0140 0x7f77200a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:37.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.164+0000 7f772a7fc700 1 -- 172.21.15.8:0/3512172406 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f7730014070 con 0x7f7734100960 2023-08-11T12:30:37.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.164+0000 7f774f410b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55783b75e310 0x55783b75e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:37.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.164+0000 7f774f410b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55783b75ec30 0x55783b7588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:37.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.164+0000 7f774f410b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55783b758e20 0x55783b759260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:37.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.164+0000 7f774f410b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55783b6b1630 con 0x55783b758e20 2023-08-11T12:30:37.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.164+0000 7f774f410b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55783b6aef50 con 0x55783b75e310 2023-08-11T12:30:37.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.164+0000 7f774f410b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55783b6aa840 con 0x55783b75ec30 2023-08-11T12:30:37.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.164+0000 7f773979b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55783b75e310 0x55783b75e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:37.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.164+0000 7f773979b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55783b75e310 0x55783b75e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:54514/0 (socket says 172.21.15.8:54514) 2023-08-11T12:30:37.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.164+0000 7f773979b700 1 -- 172.21.15.8:0/638432240 learned_addr learned my addr 172.21.15.8:0/638432240 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:30:37.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.164+0000 7f7739f9c700 1 --2- 172.21.15.8:0/3512172406 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f77200a0140 0x7f77200a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:37.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.164+0000 7f7739f9c700 1 --2- 172.21.15.8:0/638432240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55783b758e20 0x55783b759260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:37.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.164+0000 7f7738f9a700 1 --2- 172.21.15.8:0/638432240 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55783b75ec30 0x55783b7588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:37.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.165+0000 7f773979b700 1 -- 172.21.15.8:0/638432240 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55783b75ec30 msgr2=0x55783b7588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:30:37.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.165+0000 7f773979b700 1 --2- 172.21.15.8:0/638432240 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55783b75ec30 0x55783b7588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.165+0000 7f773979b700 1 -- 172.21.15.8:0/638432240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55783b758e20 msgr2=0x55783b759260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:30:37.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.165+0000 7f773979b700 1 --2- 172.21.15.8:0/638432240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55783b758e20 0x55783b759260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.165+0000 7f773979b700 1 -- 172.21.15.8:0/638432240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55783b52a630 con 0x55783b75e310 2023-08-11T12:30:37.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.165+0000 7f7739f9c700 1 --2- 172.21.15.8:0/638432240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55783b758e20 0x55783b759260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:30:37.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.165+0000 7f773979b700 1 --2- 172.21.15.8:0/638432240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55783b75e310 0x55783b75e6f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7730095850 tx=0x7f7730098830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d9272f85d2e8db server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:30:37.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.165+0000 7f7739f9c700 1 --2- 172.21.15.8:0/3512172406 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f77200a0140 0x7f77200a2600 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f773419f720 tx=0x7f772c0099e0 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:30:37.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.165+0000 7f771f7fe700 1 -- 172.21.15.8:0/638432240 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77300a0bf0 con 0x55783b75e310 2023-08-11T12:30:37.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.165+0000 7f771f7fe700 1 -- 172.21.15.8:0/638432240 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7730010880 con 0x55783b75e310 2023-08-11T12:30:37.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.165+0000 7f771f7fe700 1 -- 172.21.15.8:0/638432240 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77300982d0 con 0x55783b75e310 2023-08-11T12:30:37.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.166+0000 7f774f410b80 1 -- 172.21.15.8:0/638432240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55783b75e310 msgr2=0x55783b75e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:30:37.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.166+0000 7f774f410b80 1 --2- 172.21.15.8:0/638432240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55783b75e310 0x55783b75e6f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7730095850 tx=0x7f7730098830 comp rx=0 tx=0).stop 2023-08-11T12:30:37.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.166+0000 7f774f410b80 1 -- 172.21.15.8:0/638432240 shutdown_connections 2023-08-11T12:30:37.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.166+0000 7f774f410b80 1 --2- 172.21.15.8:0/638432240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55783b758e20 0x55783b759260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.166+0000 7f774f410b80 1 --2- 172.21.15.8:0/638432240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55783b75e310 0x55783b75e6f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.166+0000 7f774f410b80 1 --2- 172.21.15.8:0/638432240 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55783b75ec30 0x55783b7588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.166+0000 7f774f410b80 1 -- 172.21.15.8:0/638432240 >> 172.21.15.8:0/638432240 conn(0x55783b685950 msgr2=0x55783b7533d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:30:37.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.166+0000 7f774f410b80 1 -- 172.21.15.8:0/638432240 shutdown_connections 2023-08-11T12:30:37.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.166+0000 7f774f410b80 1 -- 172.21.15.8:0/638432240 wait complete. 2023-08-11T12:30:37.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.167+0000 7f774f410b80 1 -- start start 2023-08-11T12:30:37.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.167+0000 7f774f410b80 1 Processor -- start 2023-08-11T12:30:37.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.167+0000 7f774f410b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55783b758e20 0x55783b764c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:37.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.167+0000 7f774f410b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55783b75e310 0x55783b761f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:37.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.167+0000 7f774f410b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55783b75ec30 0x55783b762660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:37.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.167+0000 7f774f410b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55783b648ac0 con 0x55783b75e310 2023-08-11T12:30:37.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.167+0000 7f774f410b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55783b6487c0 con 0x55783b75ec30 2023-08-11T12:30:37.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.167+0000 7f774f410b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55783b52c920 con 0x55783b758e20 2023-08-11T12:30:37.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.167+0000 7f774f410b80 10 client.0 _ll_register_callbacks cb 0x55783b64bab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:30:37.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.168+0000 7f7739f9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55783b75ec30 0x55783b762660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:37.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.168+0000 7f7738f9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55783b75e310 0x55783b761f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:37.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.168+0000 7f773979b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55783b758e20 0x55783b764c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:37.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.168+0000 7f7739f9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55783b75ec30 0x55783b762660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:54520/0 (socket says 172.21.15.8:54520) 2023-08-11T12:30:37.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.168+0000 7f7739f9c700 1 -- 172.21.15.8:0/3970361310 learned_addr learned my addr 172.21.15.8:0/3970361310 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:30:37.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.168+0000 7f773979b700 1 -- 172.21.15.8:0/3970361310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55783b75ec30 msgr2=0x55783b762660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:30:37.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.168+0000 7f773979b700 1 --2- 172.21.15.8:0/3970361310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55783b75ec30 0x55783b762660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.168+0000 7f773979b700 1 -- 172.21.15.8:0/3970361310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55783b75e310 msgr2=0x55783b761f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:30:37.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.168+0000 7f773979b700 1 --2- 172.21.15.8:0/3970361310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55783b75e310 0x55783b761f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.168+0000 7f773979b700 1 -- 172.21.15.8:0/3970361310 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77341998d0 con 0x55783b758e20 2023-08-11T12:30:37.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.168+0000 7f7739f9c700 1 --2- 172.21.15.8:0/3970361310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55783b75ec30 0x55783b762660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:30:37.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.168+0000 7f773979b700 1 --2- 172.21.15.8:0/3970361310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55783b758e20 0x55783b764c70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x55783b765200 tx=0x7f773009cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e31024ce6583c897 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:30:37.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.168+0000 7f771cff9700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:30:37.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.168+0000 7f771cff9700 1 -- 172.21.15.8:0/3970361310 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730097180 con 0x55783b758e20 2023-08-11T12:30:37.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.169+0000 7f774f410b80 1 -- 172.21.15.8:0/3970361310 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55783b74ba90 con 0x55783b758e20 2023-08-11T12:30:37.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.169+0000 7f771cff9700 1 -- 172.21.15.8:0/3970361310 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f77300984e0 con 0x55783b758e20 2023-08-11T12:30:37.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.169+0000 7f771cff9700 1 -- 172.21.15.8:0/3970361310 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7730099040 con 0x55783b758e20 2023-08-11T12:30:37.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.169+0000 7f774f410b80 10 client.26329 fetch_fsmap learned FSMap version 53 2023-08-11T12:30:37.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.169+0000 7f774f410b80 1 -- 172.21.15.8:0/3970361310 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x55783b4d6de0 con 0x55783b758e20 2023-08-11T12:30:37.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.169+0000 7f771cff9700 1 -- 172.21.15.8:0/3970361310 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55783b74ba90 con 0x55783b758e20 2023-08-11T12:30:37.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.169+0000 7f771cff9700 1 -- 172.21.15.8:0/3970361310 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 53) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f7730097d40 con 0x55783b758e20 2023-08-11T12:30:37.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.169+0000 7f774f410b80 10 client.26329 fetch_fsmap finished waiting for FSMap version 53 2023-08-11T12:30:37.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.169+0000 7f774f410b80 10 client.26329 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:30:37.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.169+0000 7f774f410b80 20 client.26329 populate_metadata read hostname 'smithi008' 2023-08-11T12:30:37.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.169+0000 7f774f410b80 1 --2- 172.21.15.8:0/3970361310 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55783b7721d0 0x55783b7745c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:37.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.169+0000 7f774f410b80 4 client.26329 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:30:37.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.169+0000 7f774f410b80 1 -- 172.21.15.8:0/3970361310 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55783b7274e0 con 0x55783b7721d0 2023-08-11T12:30:37.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.170+0000 7f7738f9a700 1 --2- 172.21.15.8:0/3970361310 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55783b7721d0 0x55783b7745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:37.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.170+0000 7f771cff9700 10 client.26329 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:30:37.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.170+0000 7f7738f9a700 1 --2- 172.21.15.8:0/3970361310 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55783b7721d0 0x55783b7745c0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18cf5ce9c87cf4be server_cookie=89a01f12383189ea in_seq=0 out_seq=0 2023-08-11T12:30:37.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.171+0000 7f771cff9700 1 -- 172.21.15.8:0/3970361310 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55783b7274e0 con 0x55783b7721d0 2023-08-11T12:30:37.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.171+0000 7f771cff9700 10 client.26329 handle_command_reply: tid=0 2023-08-11T12:30:37.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.171+0000 7f774f410b80 1 client.26329 shutdown 2023-08-11T12:30:37.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.171+0000 7f774f410b80 1 -- 172.21.15.8:0/3970361310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55783b758e20 msgr2=0x55783b764c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:30:37.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.171+0000 7f774f410b80 1 --2- 172.21.15.8:0/3970361310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55783b758e20 0x55783b764c70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x55783b765200 tx=0x7f773009cd50 comp rx=0 tx=0).stop 2023-08-11T12:30:37.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.171+0000 7f774f410b80 1 -- 172.21.15.8:0/3970361310 shutdown_connections 2023-08-11T12:30:37.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.171+0000 7f774f410b80 1 --2- 172.21.15.8:0/3970361310 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55783b7721d0 0x55783b7745c0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.171+0000 7f774f410b80 1 --2- 172.21.15.8:0/3970361310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55783b758e20 0x55783b764c70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.171+0000 7f774f410b80 1 --2- 172.21.15.8:0/3970361310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55783b75ec30 0x55783b762660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.171+0000 7f774f410b80 1 --2- 172.21.15.8:0/3970361310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55783b75e310 0x55783b761f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.171+0000 7f771cff9700 0 client.26329 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:30:37.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.171+0000 7f774f410b80 1 -- 172.21.15.8:0/3970361310 >> 172.21.15.8:0/3970361310 conn(0x55783b685950 msgr2=0x55783b74dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:30:37.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.171+0000 7f774f410b80 1 -- 172.21.15.8:0/3970361310 shutdown_connections 2023-08-11T12:30:37.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.171+0000 7f774f410b80 1 -- 172.21.15.8:0/3970361310 wait complete. 2023-08-11T12:30:37.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.172+0000 7f774f410b80 20 client.26329 trim_cache size 0 max 16384 2023-08-11T12:30:37.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.189+0000 7f774f410b80 1 Processor -- start 2023-08-11T12:30:37.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.189+0000 7f774f410b80 1 -- start start 2023-08-11T12:30:37.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.190+0000 7f774f410b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55783b758e20 0x55783b7588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:37.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.190+0000 7f774f410b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55783b75e310 0x55783b761ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:37.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.190+0000 7f774f410b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55783b75ec30 0x55783b769580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:37.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.190+0000 7f774f410b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55783b754310 con 0x55783b75e310 2023-08-11T12:30:37.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.190+0000 7f774f410b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55783b762f00 con 0x55783b758e20 2023-08-11T12:30:37.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.190+0000 7f774f410b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55783b75cc70 con 0x55783b75ec30 2023-08-11T12:30:37.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.190+0000 7f773979b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55783b758e20 0x55783b7588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:37.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.190+0000 7f773979b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55783b758e20 0x55783b7588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:54522/0 (socket says 172.21.15.8:54522) 2023-08-11T12:30:37.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.190+0000 7f773979b700 1 -- 172.21.15.8:0/1302294716 learned_addr learned my addr 172.21.15.8:0/1302294716 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:30:37.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.190+0000 7f7738f9a700 1 --2- 172.21.15.8:0/1302294716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55783b75e310 0x55783b761ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:37.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.190+0000 7f7739f9c700 1 --2- 172.21.15.8:0/1302294716 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55783b75ec30 0x55783b769580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:37.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.190+0000 7f773979b700 1 -- 172.21.15.8:0/1302294716 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55783b75ec30 msgr2=0x55783b769580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:30:37.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.190+0000 7f773979b700 1 --2- 172.21.15.8:0/1302294716 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55783b75ec30 0x55783b769580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.190+0000 7f773979b700 1 -- 172.21.15.8:0/1302294716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55783b75e310 msgr2=0x55783b761ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:30:37.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.190+0000 7f773979b700 1 --2- 172.21.15.8:0/1302294716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55783b75e310 0x55783b761ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.190+0000 7f773979b700 1 -- 172.21.15.8:0/1302294716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55783b4bfc60 con 0x55783b758e20 2023-08-11T12:30:37.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.190+0000 7f7738f9a700 1 --2- 172.21.15.8:0/1302294716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55783b75e310 0x55783b761ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:30:37.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.191+0000 7f773979b700 1 --2- 172.21.15.8:0/1302294716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55783b758e20 0x55783b7588e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7730098ae0 tx=0x7f7730010bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14a59125b122bdd1 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:30:37.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.191+0000 7f771ffff700 1 -- 172.21.15.8:0/1302294716 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77300a0bf0 con 0x55783b758e20 2023-08-11T12:30:37.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.191+0000 7f771ffff700 1 -- 172.21.15.8:0/1302294716 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f77300984e0 con 0x55783b758e20 2023-08-11T12:30:37.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.191+0000 7f771ffff700 1 -- 172.21.15.8:0/1302294716 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77300a09c0 con 0x55783b758e20 2023-08-11T12:30:37.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.191+0000 7f774f410b80 1 -- 172.21.15.8:0/1302294716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55783b758e20 msgr2=0x55783b7588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:30:37.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.191+0000 7f774f410b80 1 --2- 172.21.15.8:0/1302294716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55783b758e20 0x55783b7588e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7730098ae0 tx=0x7f7730010bf0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.191+0000 7f774f410b80 1 -- 172.21.15.8:0/1302294716 shutdown_connections 2023-08-11T12:30:37.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.191+0000 7f774f410b80 1 --2- 172.21.15.8:0/1302294716 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55783b75ec30 0x55783b769580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.191+0000 7f774f410b80 1 --2- 172.21.15.8:0/1302294716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55783b758e20 0x55783b7588e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.191+0000 7f774f410b80 1 --2- 172.21.15.8:0/1302294716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55783b75e310 0x55783b761ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.191+0000 7f774f410b80 1 -- 172.21.15.8:0/1302294716 >> 172.21.15.8:0/1302294716 conn(0x55783b685950 msgr2=0x55783b7617c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:30:37.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.191+0000 7f774f410b80 1 -- 172.21.15.8:0/1302294716 shutdown_connections 2023-08-11T12:30:37.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.191+0000 7f774f410b80 1 -- 172.21.15.8:0/1302294716 wait complete. 2023-08-11T12:30:37.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.192+0000 7f774f410b80 1 -- start start 2023-08-11T12:30:37.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.192+0000 7f774f410b80 1 Processor -- start 2023-08-11T12:30:37.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.192+0000 7f774f410b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55783b758e20 0x55783b768cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:37.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.192+0000 7f774f410b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55783b75e310 0x55783b769200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:37.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.192+0000 7f774f410b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55783b75ec30 0x55783b767570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:37.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.192+0000 7f774f410b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55783b767b90 con 0x55783b758e20 2023-08-11T12:30:37.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.193+0000 7f774f410b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55783b767d00 con 0x55783b75e310 2023-08-11T12:30:37.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.193+0000 7f774f410b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55783b767ec0 con 0x55783b75ec30 2023-08-11T12:30:37.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.193+0000 7f774f410b80 10 client.0 _ll_register_callbacks cb 0x7f7730098a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:30:37.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.193+0000 7f7738f9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55783b75e310 0x55783b769200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:37.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.193+0000 7f7738f9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55783b75e310 0x55783b769200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:54538/0 (socket says 172.21.15.8:54538) 2023-08-11T12:30:37.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.193+0000 7f7738f9a700 1 -- 172.21.15.8:0/449368111 learned_addr learned my addr 172.21.15.8:0/449368111 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:30:37.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.193+0000 7f773979b700 1 --2- 172.21.15.8:0/449368111 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55783b758e20 0x55783b768cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:37.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.193+0000 7f7739f9c700 1 --2- 172.21.15.8:0/449368111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55783b75ec30 0x55783b767570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:37.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.193+0000 7f7738f9a700 1 -- 172.21.15.8:0/449368111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55783b75ec30 msgr2=0x55783b767570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:30:37.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.193+0000 7f7738f9a700 1 --2- 172.21.15.8:0/449368111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55783b75ec30 0x55783b767570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.193+0000 7f7738f9a700 1 -- 172.21.15.8:0/449368111 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55783b758e20 msgr2=0x55783b768cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:30:37.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.193+0000 7f7738f9a700 1 --2- 172.21.15.8:0/449368111 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55783b758e20 0x55783b768cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.193+0000 7f7738f9a700 1 -- 172.21.15.8:0/449368111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f773410e130 con 0x55783b75e310 2023-08-11T12:30:37.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.193+0000 7f773979b700 1 --2- 172.21.15.8:0/449368111 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55783b758e20 0x55783b768cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:30:37.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.193+0000 7f7738f9a700 1 --2- 172.21.15.8:0/449368111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55783b75e310 0x55783b769200 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7724000c00 tx=0x7f772400f980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42752a032a5ef8a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:30:37.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.193+0000 7f771cff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:30:37.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.194+0000 7f771cff9700 1 -- 172.21.15.8:0/449368111 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772401c040 con 0x55783b75e310 2023-08-11T12:30:37.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.194+0000 7f771cff9700 1 -- 172.21.15.8:0/449368111 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f77240269b0 con 0x55783b75e310 2023-08-11T12:30:37.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.194+0000 7f774f410b80 1 -- 172.21.15.8:0/449368111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7730010880 con 0x55783b75e310 2023-08-11T12:30:37.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.194+0000 7f771cff9700 1 -- 172.21.15.8:0/449368111 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7724026b70 con 0x55783b75e310 2023-08-11T12:30:37.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.194+0000 7f774f410b80 10 client.26327 fetch_fsmap learned FSMap version 53 2023-08-11T12:30:37.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.194+0000 7f774f410b80 1 -- 172.21.15.8:0/449368111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x55783b4d6de0 con 0x55783b75e310 2023-08-11T12:30:37.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.194+0000 7f771cff9700 1 -- 172.21.15.8:0/449368111 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7730010880 con 0x55783b75e310 2023-08-11T12:30:37.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.194+0000 7f771cff9700 1 -- 172.21.15.8:0/449368111 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 53) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f7724015020 con 0x55783b75e310 2023-08-11T12:30:37.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.194+0000 7f774f410b80 10 client.26327 fetch_fsmap finished waiting for FSMap version 53 2023-08-11T12:30:37.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.194+0000 7f774f410b80 10 client.26327 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:30:37.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.194+0000 7f774f410b80 20 client.26327 populate_metadata read hostname 'smithi008' 2023-08-11T12:30:37.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.194+0000 7f774f410b80 1 --2- 172.21.15.8:0/449368111 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55783b7c6ef0 0x55783b7c9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:30:37.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.194+0000 7f774f410b80 4 client.26327 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:30:37.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.194+0000 7f774f410b80 1 -- 172.21.15.8:0/449368111 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55783b6a3820 con 0x55783b7c6ef0 2023-08-11T12:30:37.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.195+0000 7f773979b700 1 --2- 172.21.15.8:0/449368111 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55783b7c6ef0 0x55783b7c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:30:37.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.195+0000 7f773979b700 1 --2- 172.21.15.8:0/449368111 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55783b7c6ef0 0x55783b7c9310 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2434b5236fee2f33 server_cookie=cbf82c82f4874894 in_seq=0 out_seq=0 2023-08-11T12:30:37.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.195+0000 7f771cff9700 10 client.26327 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:30:37.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.195+0000 7f771cff9700 1 -- 172.21.15.8:0/449368111 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55783b6a3820 con 0x55783b7c6ef0 2023-08-11T12:30:37.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.195+0000 7f771cff9700 10 client.26327 handle_command_reply: tid=0 2023-08-11T12:30:37.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.196+0000 7f774f410b80 1 client.26327 shutdown 2023-08-11T12:30:37.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.196+0000 7f774f410b80 1 -- 172.21.15.8:0/449368111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55783b75e310 msgr2=0x55783b769200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:30:37.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.196+0000 7f774f410b80 1 --2- 172.21.15.8:0/449368111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55783b75e310 0x55783b769200 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7724000c00 tx=0x7f772400f980 comp rx=0 tx=0).stop 2023-08-11T12:30:37.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.196+0000 7f774f410b80 1 -- 172.21.15.8:0/449368111 shutdown_connections 2023-08-11T12:30:37.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.196+0000 7f774f410b80 1 --2- 172.21.15.8:0/449368111 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55783b7c6ef0 0x55783b7c9310 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.196+0000 7f774f410b80 1 --2- 172.21.15.8:0/449368111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55783b75ec30 0x55783b767570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.196+0000 7f774f410b80 1 --2- 172.21.15.8:0/449368111 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55783b758e20 0x55783b768cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.196+0000 7f774f410b80 1 --2- 172.21.15.8:0/449368111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55783b75e310 0x55783b769200 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.196+0000 7f771cff9700 0 client.26327 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:30:37.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.196+0000 7f774f410b80 1 -- 172.21.15.8:0/449368111 >> 172.21.15.8:0/449368111 conn(0x55783b685950 msgr2=0x55783b75f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:30:37.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.196+0000 7f774f410b80 1 -- 172.21.15.8:0/449368111 shutdown_connections 2023-08-11T12:30:37.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.196+0000 7f774f410b80 1 -- 172.21.15.8:0/449368111 wait complete. 2023-08-11T12:30:37.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.196+0000 7f774f410b80 20 client.26327 trim_cache size 0 max 16384 2023-08-11T12:30:37.212 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:30:37.212 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:30:37.213 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:30:37.213 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:30:37.213 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:30:37.213 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:30:37.213 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:30:37.214 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:30:37.214 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:30:37.214 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:30:37.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.197+0000 7f773b9ff700 1 -- 172.21.15.8:0/3512172406 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f77200a0140 msgr2=0x7f77200a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:30:37.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.197+0000 7f773b9ff700 1 --2- 172.21.15.8:0/3512172406 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f77200a0140 0x7f77200a2600 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f773419f720 tx=0x7f772c0099e0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.197+0000 7f773b9ff700 1 -- 172.21.15.8:0/3512172406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7734100960 msgr2=0x7f773419ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:30:37.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.197+0000 7f773b9ff700 1 --2- 172.21.15.8:0/3512172406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7734100960 0x7f773419ea20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f773000e9a0 tx=0x7f773000ecb0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.197+0000 7f773b9ff700 1 -- 172.21.15.8:0/3512172406 shutdown_connections 2023-08-11T12:30:37.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.197+0000 7f773b9ff700 1 --2- 172.21.15.8:0/3512172406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7734106970 0x7f7734198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.197+0000 7f773b9ff700 1 --2- 172.21.15.8:0/3512172406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7734100960 0x7f773419ea20 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.197+0000 7f773b9ff700 1 --2- 172.21.15.8:0/3512172406 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f77200a0140 0x7f77200a2600 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.197+0000 7f773b9ff700 1 --2- 172.21.15.8:0/3512172406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7734101320 0x7f773419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:30:37.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.197+0000 7f773b9ff700 1 -- 172.21.15.8:0/3512172406 >> 172.21.15.8:0/3512172406 conn(0x7f77340fc490 msgr2=0x7f773410bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:30:37.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.197+0000 7f773b9ff700 1 -- 172.21.15.8:0/3512172406 shutdown_connections 2023-08-11T12:30:37.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:30:37.197+0000 7f773b9ff700 1 -- 172.21.15.8:0/3512172406 wait complete. 2023-08-11T12:30:37.217 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:36 smithi008 ceph-mon[97158]: pgmap v183: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:37.218 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:30:37.276 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:36 smithi045 ceph-mon[130284]: pgmap v183: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:37.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:36 smithi194 ceph-mon[130905]: pgmap v183: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:39.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:38 smithi008 ceph-mon[97158]: pgmap v184: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:30:39.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:38 smithi194 ceph-mon[130905]: pgmap v184: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:30:39.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:38 smithi045 ceph-mon[130284]: pgmap v184: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:30:41.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:40 smithi194 ceph-mon[130905]: pgmap v185: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:41.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:40 smithi045 ceph-mon[130284]: pgmap v185: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:41.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:40 smithi008 ceph-mon[97158]: pgmap v185: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:42.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:41 smithi194 ceph-mon[130905]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:30:42.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:41 smithi045 ceph-mon[130284]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:30:42.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:41 smithi008 ceph-mon[97158]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-11T12:30:43.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:42 smithi194 ceph-mon[130905]: pgmap v186: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:30:43.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:42 smithi045 ceph-mon[130284]: pgmap v186: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:30:43.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:42 smithi008 ceph-mon[97158]: pgmap v186: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:30:45.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:44 smithi008 ceph-mon[97158]: pgmap v187: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:45.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:44 smithi194 ceph-mon[130905]: pgmap v187: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:45.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:44 smithi045 ceph-mon[130284]: pgmap v187: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:47.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:46 smithi008 ceph-mon[97158]: pgmap v188: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:47.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:46 smithi194 ceph-mon[130905]: pgmap v188: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:47.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:46 smithi045 ceph-mon[130284]: pgmap v188: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:49.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:48 smithi008 ceph-mon[97158]: pgmap v189: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:30:49.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:48 smithi194 ceph-mon[130905]: pgmap v189: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:30:49.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:48 smithi045 ceph-mon[130284]: pgmap v189: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:30:51.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:50 smithi194 ceph-mon[130905]: pgmap v190: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:51.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:50 smithi045 ceph-mon[130284]: pgmap v190: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:51.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:50 smithi008 ceph-mon[97158]: pgmap v190: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:52.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:51 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:30:52.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:51 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:30:52.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:51 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:30:53.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:52 smithi194 ceph-mon[130905]: pgmap v191: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:30:53.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:52 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:30:53.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:52 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:30:53.144 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:52 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:30:53.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:52 smithi045 ceph-mon[130284]: pgmap v191: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:30:53.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:52 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:30:53.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:52 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:30:53.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:52 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:30:53.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:52 smithi008 ceph-mon[97158]: pgmap v191: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:30:53.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:52 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:30:53.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:52 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:30:53.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:52 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:30:55.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:54 smithi008 ceph-mon[97158]: pgmap v192: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:55.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:54 smithi194 ceph-mon[130905]: pgmap v192: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:55.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:54 smithi045 ceph-mon[130284]: pgmap v192: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:57.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:56 smithi008 ceph-mon[97158]: pgmap v193: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:57.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:56 smithi194 ceph-mon[130905]: pgmap v193: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:57.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:56 smithi045 ceph-mon[130284]: pgmap v193: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:30:59.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:30:58 smithi008 ceph-mon[97158]: pgmap v194: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:30:59.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:30:58 smithi194 ceph-mon[130905]: pgmap v194: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:30:59.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:30:58 smithi045 ceph-mon[130284]: pgmap v194: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:31:01.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:00 smithi194 ceph-mon[130905]: pgmap v195: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:31:01.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:00 smithi045 ceph-mon[130284]: pgmap v195: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:31:01.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:00 smithi008 ceph-mon[97158]: pgmap v195: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:31:03.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:02 smithi008 ceph-mon[97158]: pgmap v196: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-08-11T12:31:03.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:02 smithi194 ceph-mon[130905]: pgmap v196: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-08-11T12:31:03.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:02 smithi045 ceph-mon[130284]: pgmap v196: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-08-11T12:31:05.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:04 smithi008 ceph-mon[97158]: pgmap v197: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-08-11T12:31:05.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:04 smithi194 ceph-mon[130905]: pgmap v197: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-08-11T12:31:05.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:04 smithi045 ceph-mon[130284]: pgmap v197: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-08-11T12:31:07.220 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:31:07.290 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:06 smithi008 ceph-mon[97158]: pgmap v198: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-08-11T12:31:07.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:06 smithi194 ceph-mon[130905]: pgmap v198: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-08-11T12:31:07.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:06 smithi045 ceph-mon[130284]: pgmap v198: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-08-11T12:31:07.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.438+0000 7f30679ff700 1 -- 172.21.15.8:0/3773379896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3060101320 msgr2=0x7f306010d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:31:07.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.438+0000 7f30679ff700 1 --2- 172.21.15.8:0/3773379896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3060101320 0x7f306010d830 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f305800b0a0 tx=0x7f305800b3b0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.439+0000 7f30679ff700 1 -- 172.21.15.8:0/3773379896 shutdown_connections 2023-08-11T12:31:07.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.439+0000 7f30679ff700 1 --2- 172.21.15.8:0/3773379896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3060106970 0x7f3060106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.439+0000 7f30679ff700 1 --2- 172.21.15.8:0/3773379896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3060101320 0x7f306010d830 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.439+0000 7f30679ff700 1 --2- 172.21.15.8:0/3773379896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3060100960 0x7f3060100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.439+0000 7f30679ff700 1 -- 172.21.15.8:0/3773379896 >> 172.21.15.8:0/3773379896 conn(0x7f30600fc490 msgr2=0x7f30600fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:31:07.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.439+0000 7f30679ff700 1 -- 172.21.15.8:0/3773379896 shutdown_connections 2023-08-11T12:31:07.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.439+0000 7f30679ff700 1 -- 172.21.15.8:0/3773379896 wait complete. 2023-08-11T12:31:07.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.440+0000 7f30679ff700 1 Processor -- start 2023-08-11T12:31:07.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.440+0000 7f30679ff700 1 -- start start 2023-08-11T12:31:07.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.440+0000 7f30679ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3060100960 0x7f3060072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:07.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.440+0000 7f30679ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3060101320 0x7f3060073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:07.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.440+0000 7f30679ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3060106970 0x7f30601a4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:07.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.440+0000 7f30679ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3060073990 con 0x7f3060100960 2023-08-11T12:31:07.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.440+0000 7f30679ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30601a5090 con 0x7f3060101320 2023-08-11T12:31:07.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.440+0000 7f30679ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30601a51d0 con 0x7f3060106970 2023-08-11T12:31:07.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.440+0000 7f306579b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3060100960 0x7f3060072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:07.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.440+0000 7f3064f9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3060101320 0x7f3060073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:07.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.440+0000 7f3064f9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3060101320 0x7f3060073160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:42490/0 (socket says 172.21.15.8:42490) 2023-08-11T12:31:07.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.440+0000 7f306579b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3060100960 0x7f3060072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53490/0 (socket says 172.21.15.8:53490) 2023-08-11T12:31:07.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.440+0000 7f3064f9a700 1 -- 172.21.15.8:0/3848513438 learned_addr learned my addr 172.21.15.8:0/3848513438 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:31:07.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.441+0000 7f3065f9c700 1 --2- 172.21.15.8:0/3848513438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3060106970 0x7f30601a4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:07.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.441+0000 7f306579b700 1 -- 172.21.15.8:0/3848513438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3060106970 msgr2=0x7f30601a4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:31:07.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.441+0000 7f306579b700 1 --2- 172.21.15.8:0/3848513438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3060106970 0x7f30601a4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.441+0000 7f306579b700 1 -- 172.21.15.8:0/3848513438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3060101320 msgr2=0x7f3060073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:31:07.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.441+0000 7f306579b700 1 --2- 172.21.15.8:0/3848513438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3060101320 0x7f3060073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.441+0000 7f306579b700 1 -- 172.21.15.8:0/3848513438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3050009520 con 0x7f3060100960 2023-08-11T12:31:07.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.441+0000 7f3064f9a700 1 --2- 172.21.15.8:0/3848513438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3060101320 0x7f3060073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:31:07.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.441+0000 7f306579b700 1 --2- 172.21.15.8:0/3848513438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3060100960 0x7f3060072c20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f305c00e9f0 tx=0x7f305c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:31:07.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.441+0000 7f30567fc700 1 -- 172.21.15.8:0/3848513438 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c00cb70 con 0x7f3060100960 2023-08-11T12:31:07.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.441+0000 7f30679ff700 1 -- 172.21.15.8:0/3848513438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f305c009520 con 0x7f3060100960 2023-08-11T12:31:07.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.441+0000 7f30567fc700 1 -- 172.21.15.8:0/3848513438 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f305c00ee90 con 0x7f3060100960 2023-08-11T12:31:07.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.441+0000 7f30567fc700 1 -- 172.21.15.8:0/3848513438 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c003cf0 con 0x7f3060100960 2023-08-11T12:31:07.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.442+0000 7f30679ff700 1 -- 172.21.15.8:0/3848513438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3058009d00 con 0x7f3060100960 2023-08-11T12:31:07.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.445+0000 7f30567fc700 1 -- 172.21.15.8:0/3848513438 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f305c00ccd0 con 0x7f3060100960 2023-08-11T12:31:07.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.446+0000 7f307b277b80 1 Processor -- start 2023-08-11T12:31:07.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.446+0000 7f30567fc700 1 --2- 172.21.15.8:0/3848513438 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f304c0a00c0 0x7f304c0a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:07.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.446+0000 7f307b277b80 1 -- start start 2023-08-11T12:31:07.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.446+0000 7f30567fc700 1 -- 172.21.15.8:0/3848513438 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f305c014070 con 0x7f3060100960 2023-08-11T12:31:07.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.447+0000 7f307b277b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef751da310 0x55ef751da6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:07.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.447+0000 7f307b277b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ef751dac30 0x55ef751d48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:07.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.447+0000 7f3065f9c700 1 --2- 172.21.15.8:0/3848513438 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f304c0a00c0 0x7f304c0a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:07.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.447+0000 7f307b277b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ef751d4e20 0x55ef751d5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:07.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.447+0000 7f307b277b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7512d630 con 0x55ef751dac30 2023-08-11T12:31:07.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.447+0000 7f307b277b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7512af50 con 0x55ef751d4e20 2023-08-11T12:31:07.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.447+0000 7f307b277b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef75126840 con 0x55ef751da310 2023-08-11T12:31:07.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.447+0000 7f3065f9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ef751d4e20 0x55ef751d5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:07.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.447+0000 7f3064f9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ef751dac30 0x55ef751d48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:07.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.447+0000 7f3064f9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ef751dac30 0x55ef751d48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53492/0 (socket says 172.21.15.8:53492) 2023-08-11T12:31:07.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.447+0000 7f3065f9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ef751d4e20 0x55ef751d5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:42498/0 (socket says 172.21.15.8:42498) 2023-08-11T12:31:07.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.447+0000 7f3064f9a700 1 -- 172.21.15.8:0/1084002908 learned_addr learned my addr 172.21.15.8:0/1084002908 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:31:07.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.447+0000 7f306579b700 1 --2- 172.21.15.8:0/1084002908 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef751da310 0x55ef751da6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:07.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.447+0000 7f306579b700 1 -- 172.21.15.8:0/1084002908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ef751d4e20 msgr2=0x55ef751d5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:31:07.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.447+0000 7f306579b700 1 --2- 172.21.15.8:0/1084002908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ef751d4e20 0x55ef751d5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.447+0000 7f306579b700 1 -- 172.21.15.8:0/1084002908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ef751dac30 msgr2=0x55ef751d48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:31:07.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.447+0000 7f306579b700 1 --2- 172.21.15.8:0/1084002908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ef751dac30 0x55ef751d48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.447+0000 7f306579b700 1 -- 172.21.15.8:0/1084002908 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef74fa6630 con 0x55ef751da310 2023-08-11T12:31:07.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.447+0000 7f3064f9a700 1 --2- 172.21.15.8:0/1084002908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ef751dac30 0x55ef751d48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:31:07.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.448+0000 7f306579b700 1 --2- 172.21.15.8:0/1084002908 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef751da310 0x55ef751da6f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f305c0c8ff0 tx=0x7f305c098910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f951296a19ab0883 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:31:07.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.448+0000 7f3065f9c700 1 --2- 172.21.15.8:0/3848513438 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f304c0a00c0 0x7f304c0a2580 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3060074d30 tx=0x7f305800bab0 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:31:07.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.448+0000 7f304b7fe700 1 -- 172.21.15.8:0/1084002908 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c098fb0 con 0x55ef751da310 2023-08-11T12:31:07.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.448+0000 7f304b7fe700 1 -- 172.21.15.8:0/1084002908 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f305c09cde0 con 0x55ef751da310 2023-08-11T12:31:07.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.448+0000 7f304b7fe700 1 -- 172.21.15.8:0/1084002908 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c0986a0 con 0x55ef751da310 2023-08-11T12:31:07.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.449+0000 7f307b277b80 1 -- 172.21.15.8:0/1084002908 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef751da310 msgr2=0x55ef751da6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:31:07.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.449+0000 7f307b277b80 1 --2- 172.21.15.8:0/1084002908 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef751da310 0x55ef751da6f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f305c0c8ff0 tx=0x7f305c098910 comp rx=0 tx=0).stop 2023-08-11T12:31:07.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.449+0000 7f307b277b80 1 -- 172.21.15.8:0/1084002908 shutdown_connections 2023-08-11T12:31:07.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.449+0000 7f307b277b80 1 --2- 172.21.15.8:0/1084002908 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef751da310 0x55ef751da6f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.449+0000 7f307b277b80 1 --2- 172.21.15.8:0/1084002908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ef751d4e20 0x55ef751d5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.449+0000 7f307b277b80 1 --2- 172.21.15.8:0/1084002908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ef751dac30 0x55ef751d48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.449+0000 7f307b277b80 1 -- 172.21.15.8:0/1084002908 >> 172.21.15.8:0/1084002908 conn(0x55ef75101950 msgr2=0x55ef751cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:31:07.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.449+0000 7f307b277b80 1 -- 172.21.15.8:0/1084002908 shutdown_connections 2023-08-11T12:31:07.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.449+0000 7f307b277b80 1 -- 172.21.15.8:0/1084002908 wait complete. 2023-08-11T12:31:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.449+0000 7f307b277b80 1 -- start start 2023-08-11T12:31:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.449+0000 7f307b277b80 1 Processor -- start 2023-08-11T12:31:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.450+0000 7f307b277b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ef751d4e20 0x55ef751e0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.450+0000 7f307b277b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ef751da310 0x55ef751ddea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:07.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.450+0000 7f307b277b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef751dac30 0x55ef751de5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:07.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.450+0000 7f307b277b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef750c4ac0 con 0x55ef751d4e20 2023-08-11T12:31:07.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.450+0000 7f307b277b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef750c47c0 con 0x55ef751da310 2023-08-11T12:31:07.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.450+0000 7f307b277b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef74fa8920 con 0x55ef751dac30 2023-08-11T12:31:07.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.450+0000 7f307b277b80 10 client.0 _ll_register_callbacks cb 0x55ef750c7ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:31:07.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.450+0000 7f3064f9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ef751da310 0x55ef751ddea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:07.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.450+0000 7f306579b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ef751d4e20 0x55ef751e0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:07.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.450+0000 7f3064f9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ef751da310 0x55ef751ddea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:42510/0 (socket says 172.21.15.8:42510) 2023-08-11T12:31:07.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.450+0000 7f3064f9a700 1 -- 172.21.15.8:0/2155299934 learned_addr learned my addr 172.21.15.8:0/2155299934 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:31:07.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.450+0000 7f3065f9c700 1 --2- 172.21.15.8:0/2155299934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef751dac30 0x55ef751de5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:07.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.451+0000 7f3064f9a700 1 -- 172.21.15.8:0/2155299934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef751dac30 msgr2=0x55ef751de5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:31:07.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.451+0000 7f3064f9a700 1 --2- 172.21.15.8:0/2155299934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef751dac30 0x55ef751de5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.451+0000 7f3064f9a700 1 -- 172.21.15.8:0/2155299934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ef751d4e20 msgr2=0x55ef751e0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:31:07.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.451+0000 7f3064f9a700 1 --2- 172.21.15.8:0/2155299934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ef751d4e20 0x55ef751e0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.451+0000 7f3064f9a700 1 -- 172.21.15.8:0/2155299934 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3050011440 con 0x55ef751da310 2023-08-11T12:31:07.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.451+0000 7f306579b700 1 --2- 172.21.15.8:0/2155299934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ef751d4e20 0x55ef751e0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:31:07.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.451+0000 7f3064f9a700 1 --2- 172.21.15.8:0/2155299934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ef751da310 0x55ef751ddea0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3050011ec0 tx=0x7f305000f6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b89af5dca8be433 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:31:07.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.451+0000 7f3048ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:31:07.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.451+0000 7f3048ff9700 1 -- 172.21.15.8:0/2155299934 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3050016070 con 0x55ef751da310 2023-08-11T12:31:07.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.451+0000 7f307b277b80 1 -- 172.21.15.8:0/2155299934 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ef751c7a90 con 0x55ef751da310 2023-08-11T12:31:07.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.451+0000 7f3048ff9700 1 -- 172.21.15.8:0/2155299934 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f305001a3f0 con 0x55ef751da310 2023-08-11T12:31:07.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.452+0000 7f3048ff9700 1 -- 172.21.15.8:0/2155299934 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f305001a5b0 con 0x55ef751da310 2023-08-11T12:31:07.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.452+0000 7f307b277b80 10 client.26339 fetch_fsmap learned FSMap version 54 2023-08-11T12:31:07.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.452+0000 7f307b277b80 1 -- 172.21.15.8:0/2155299934 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x7f3058009d00 con 0x55ef751da310 2023-08-11T12:31:07.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.452+0000 7f3048ff9700 1 -- 172.21.15.8:0/2155299934 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ef751c7a90 con 0x55ef751da310 2023-08-11T12:31:07.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.452+0000 7f3048ff9700 1 -- 172.21.15.8:0/2155299934 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3050019790 con 0x55ef751da310 2023-08-11T12:31:07.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.452+0000 7f307b277b80 10 client.26339 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:31:07.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.452+0000 7f307b277b80 10 client.26339 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:31:07.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.452+0000 7f307b277b80 20 client.26339 populate_metadata read hostname 'smithi008' 2023-08-11T12:31:07.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.452+0000 7f307b277b80 1 --2- 172.21.15.8:0/2155299934 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55ef751ee490 0x55ef751f08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:07.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.452+0000 7f307b277b80 4 client.26339 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:31:07.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.452+0000 7f307b277b80 1 -- 172.21.15.8:0/2155299934 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ef751a34e0 con 0x55ef751ee490 2023-08-11T12:31:07.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.452+0000 7f306579b700 1 --2- 172.21.15.8:0/2155299934 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55ef751ee490 0x55ef751f08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:07.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.453+0000 7f306579b700 1 --2- 172.21.15.8:0/2155299934 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55ef751ee490 0x55ef751f08b0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5e56d181b282c6b server_cookie=529ff0eb3a8581ed in_seq=0 out_seq=0 2023-08-11T12:31:07.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.453+0000 7f3048ff9700 10 client.26339 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:31:07.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.454+0000 7f3048ff9700 1 -- 172.21.15.8:0/2155299934 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55ef751a34e0 con 0x55ef751ee490 2023-08-11T12:31:07.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.454+0000 7f3048ff9700 10 client.26339 handle_command_reply: tid=0 2023-08-11T12:31:07.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.454+0000 7f307b277b80 1 client.26339 shutdown 2023-08-11T12:31:07.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.454+0000 7f307b277b80 1 -- 172.21.15.8:0/2155299934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ef751da310 msgr2=0x55ef751ddea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:31:07.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.454+0000 7f307b277b80 1 --2- 172.21.15.8:0/2155299934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ef751da310 0x55ef751ddea0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3050011ec0 tx=0x7f305000f6a0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.454+0000 7f307b277b80 1 -- 172.21.15.8:0/2155299934 shutdown_connections 2023-08-11T12:31:07.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.454+0000 7f307b277b80 1 --2- 172.21.15.8:0/2155299934 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55ef751ee490 0x55ef751f08b0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.454+0000 7f307b277b80 1 --2- 172.21.15.8:0/2155299934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef751dac30 0x55ef751de5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.454+0000 7f307b277b80 1 --2- 172.21.15.8:0/2155299934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ef751d4e20 0x55ef751e0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.454+0000 7f3048ff9700 0 client.26339 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:31:07.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.454+0000 7f307b277b80 1 --2- 172.21.15.8:0/2155299934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ef751da310 0x55ef751ddea0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.454+0000 7f307b277b80 1 -- 172.21.15.8:0/2155299934 >> 172.21.15.8:0/2155299934 conn(0x55ef75101950 msgr2=0x55ef751c9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:31:07.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.454+0000 7f307b277b80 1 -- 172.21.15.8:0/2155299934 shutdown_connections 2023-08-11T12:31:07.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.454+0000 7f307b277b80 1 -- 172.21.15.8:0/2155299934 wait complete. 2023-08-11T12:31:07.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.454+0000 7f307b277b80 20 client.26339 trim_cache size 0 max 16384 2023-08-11T12:31:07.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.472+0000 7f307b277b80 1 Processor -- start 2023-08-11T12:31:07.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.472+0000 7f307b277b80 1 -- start start 2023-08-11T12:31:07.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.472+0000 7f307b277b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ef751d4e20 0x55ef751d48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:07.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.472+0000 7f307b277b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef751da310 0x55ef751e5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:07.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.472+0000 7f307b277b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ef751dac30 0x55ef751cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:07.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.472+0000 7f307b277b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef751ea4d0 con 0x55ef751dac30 2023-08-11T12:31:07.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.472+0000 7f307b277b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef751c7a60 con 0x55ef751d4e20 2023-08-11T12:31:07.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.472+0000 7f307b277b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef751d02b0 con 0x55ef751da310 2023-08-11T12:31:07.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.472+0000 7f306579b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ef751d4e20 0x55ef751d48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:07.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.473+0000 7f306579b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ef751d4e20 0x55ef751d48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:42524/0 (socket says 172.21.15.8:42524) 2023-08-11T12:31:07.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.473+0000 7f306579b700 1 -- 172.21.15.8:0/3271416282 learned_addr learned my addr 172.21.15.8:0/3271416282 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:31:07.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.473+0000 7f3065f9c700 1 --2- 172.21.15.8:0/3271416282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ef751dac30 0x55ef751cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:07.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.473+0000 7f3064f9a700 1 --2- 172.21.15.8:0/3271416282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef751da310 0x55ef751e5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:07.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.473+0000 7f306579b700 1 -- 172.21.15.8:0/3271416282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef751da310 msgr2=0x55ef751e5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:31:07.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.473+0000 7f306579b700 1 --2- 172.21.15.8:0/3271416282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef751da310 0x55ef751e5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.473+0000 7f306579b700 1 -- 172.21.15.8:0/3271416282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ef751dac30 msgr2=0x55ef751cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:31:07.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.473+0000 7f306579b700 1 --2- 172.21.15.8:0/3271416282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ef751dac30 0x55ef751cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.473+0000 7f306579b700 1 -- 172.21.15.8:0/3271416282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef74f52de0 con 0x55ef751d4e20 2023-08-11T12:31:07.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.473+0000 7f3065f9c700 1 --2- 172.21.15.8:0/3271416282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ef751dac30 0x55ef751cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:31:07.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.473+0000 7f306579b700 1 --2- 172.21.15.8:0/3271416282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ef751d4e20 0x55ef751d48e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f305c097300 tx=0x7f305c003780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49c188fbdb0bdf19 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:31:07.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.473+0000 7f304bfff700 1 -- 172.21.15.8:0/3271416282 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c0a0dc0 con 0x55ef751d4e20 2023-08-11T12:31:07.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.473+0000 7f304bfff700 1 -- 172.21.15.8:0/3271416282 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f305c097350 con 0x55ef751d4e20 2023-08-11T12:31:07.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.473+0000 7f304bfff700 1 -- 172.21.15.8:0/3271416282 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c099470 con 0x55ef751d4e20 2023-08-11T12:31:07.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.474+0000 7f307b277b80 1 -- 172.21.15.8:0/3271416282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ef751d4e20 msgr2=0x55ef751d48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:31:07.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.474+0000 7f307b277b80 1 --2- 172.21.15.8:0/3271416282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ef751d4e20 0x55ef751d48e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f305c097300 tx=0x7f305c003780 comp rx=0 tx=0).stop 2023-08-11T12:31:07.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.474+0000 7f307b277b80 1 -- 172.21.15.8:0/3271416282 shutdown_connections 2023-08-11T12:31:07.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.474+0000 7f307b277b80 1 --2- 172.21.15.8:0/3271416282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ef751dac30 0x55ef751cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.474+0000 7f307b277b80 1 --2- 172.21.15.8:0/3271416282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ef751d4e20 0x55ef751d48e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.474+0000 7f307b277b80 1 --2- 172.21.15.8:0/3271416282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef751da310 0x55ef751e5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.474+0000 7f307b277b80 1 -- 172.21.15.8:0/3271416282 >> 172.21.15.8:0/3271416282 conn(0x55ef75101950 msgr2=0x55ef751ea800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:31:07.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.474+0000 7f307b277b80 1 -- 172.21.15.8:0/3271416282 shutdown_connections 2023-08-11T12:31:07.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.474+0000 7f307b277b80 1 -- 172.21.15.8:0/3271416282 wait complete. 2023-08-11T12:31:07.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.474+0000 7f307b277b80 1 -- start start 2023-08-11T12:31:07.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.475+0000 7f307b277b80 1 Processor -- start 2023-08-11T12:31:07.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.475+0000 7f307b277b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef751d4e20 0x55ef751e3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:07.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.475+0000 7f307b277b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ef751da310 0x55ef751e3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:07.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.475+0000 7f307b277b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ef751dac30 0x55ef75241160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:07.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.475+0000 7f307b277b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef751e4400 con 0x55ef751da310 2023-08-11T12:31:07.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.475+0000 7f307b277b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef752416a0 con 0x55ef751dac30 2023-08-11T12:31:07.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.475+0000 7f307b277b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef75241810 con 0x55ef751d4e20 2023-08-11T12:31:07.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.475+0000 7f307b277b80 10 client.0 _ll_register_callbacks cb 0x7f3050011990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:31:07.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.475+0000 7f3064f9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ef751da310 0x55ef751e3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:07.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.475+0000 7f3065f9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ef751dac30 0x55ef75241160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:07.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.475+0000 7f3064f9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ef751da310 0x55ef751e3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53512/0 (socket says 172.21.15.8:53512) 2023-08-11T12:31:07.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.475+0000 7f3064f9a700 1 -- 172.21.15.8:0/2980767908 learned_addr learned my addr 172.21.15.8:0/2980767908 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:31:07.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.476+0000 7f306579b700 1 --2- 172.21.15.8:0/2980767908 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef751d4e20 0x55ef751e3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:07.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.476+0000 7f3064f9a700 1 -- 172.21.15.8:0/2980767908 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef751d4e20 msgr2=0x55ef751e3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:31:07.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.476+0000 7f3064f9a700 1 --2- 172.21.15.8:0/2980767908 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef751d4e20 0x55ef751e3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.476+0000 7f3064f9a700 1 -- 172.21.15.8:0/2980767908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ef751dac30 msgr2=0x55ef75241160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:31:07.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.476+0000 7f3064f9a700 1 --2- 172.21.15.8:0/2980767908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ef751dac30 0x55ef75241160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.476+0000 7f3064f9a700 1 -- 172.21.15.8:0/2980767908 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f306010e130 con 0x55ef751da310 2023-08-11T12:31:07.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.476+0000 7f3064f9a700 1 --2- 172.21.15.8:0/2980767908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ef751da310 0x55ef751e3ca0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3050001eb0 tx=0x7f3050009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba18521bbd0edc2c server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:31:07.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.476+0000 7f3048ff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:31:07.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.476+0000 7f3048ff9700 1 -- 172.21.15.8:0/2980767908 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3050016040 con 0x55ef751da310 2023-08-11T12:31:07.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.476+0000 7f307b277b80 1 -- 172.21.15.8:0/2980767908 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f305c09cde0 con 0x55ef751da310 2023-08-11T12:31:07.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.476+0000 7f3048ff9700 1 -- 172.21.15.8:0/2980767908 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9278+0+0 (secure 0 0 0) 0x7f30500197a0 con 0x55ef751da310 2023-08-11T12:31:07.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.477+0000 7f3048ff9700 1 -- 172.21.15.8:0/2980767908 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3050005040 con 0x55ef751da310 2023-08-11T12:31:07.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.477+0000 7f307b277b80 10 client.16302 fetch_fsmap learned FSMap version 54 2023-08-11T12:31:07.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.477+0000 7f307b277b80 1 -- 172.21.15.8:0/2980767908 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x7f305c0b0040 con 0x55ef751da310 2023-08-11T12:31:07.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.477+0000 7f3048ff9700 1 -- 172.21.15.8:0/2980767908 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f305c09cde0 con 0x55ef751da310 2023-08-11T12:31:07.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.477+0000 7f3048ff9700 1 -- 172.21.15.8:0/2980767908 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3050003a60 con 0x55ef751da310 2023-08-11T12:31:07.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.477+0000 7f307b277b80 10 client.16302 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:31:07.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.477+0000 7f307b277b80 10 client.16302 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:31:07.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.477+0000 7f307b277b80 20 client.16302 populate_metadata read hostname 'smithi008' 2023-08-11T12:31:07.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.477+0000 7f307b277b80 1 --2- 172.21.15.8:0/2980767908 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55ef75242ef0 0x55ef75245310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:07.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.477+0000 7f307b277b80 4 client.16302 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:31:07.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.477+0000 7f307b277b80 1 -- 172.21.15.8:0/2980767908 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ef7511f820 con 0x55ef75242ef0 2023-08-11T12:31:07.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.477+0000 7f306579b700 1 --2- 172.21.15.8:0/2980767908 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55ef75242ef0 0x55ef75245310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:07.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.478+0000 7f306579b700 1 --2- 172.21.15.8:0/2980767908 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55ef75242ef0 0x55ef75245310 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6501a52789fea3c5 server_cookie=47a7d03f1613bf4f in_seq=0 out_seq=0 2023-08-11T12:31:07.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.478+0000 7f3048ff9700 10 client.16302 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:31:07.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.478+0000 7f3048ff9700 1 -- 172.21.15.8:0/2980767908 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55ef7511f820 con 0x55ef75242ef0 2023-08-11T12:31:07.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.478+0000 7f3048ff9700 10 client.16302 handle_command_reply: tid=0 2023-08-11T12:31:07.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.478+0000 7f307b277b80 1 client.16302 shutdown 2023-08-11T12:31:07.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.478+0000 7f307b277b80 1 -- 172.21.15.8:0/2980767908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ef751da310 msgr2=0x55ef751e3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:31:07.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.478+0000 7f307b277b80 1 --2- 172.21.15.8:0/2980767908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ef751da310 0x55ef751e3ca0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3050001eb0 tx=0x7f3050009f20 comp rx=0 tx=0).stop 2023-08-11T12:31:07.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.478+0000 7f307b277b80 1 -- 172.21.15.8:0/2980767908 shutdown_connections 2023-08-11T12:31:07.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.478+0000 7f307b277b80 1 --2- 172.21.15.8:0/2980767908 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55ef75242ef0 0x55ef75245310 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.478+0000 7f307b277b80 1 --2- 172.21.15.8:0/2980767908 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef751d4e20 0x55ef751e3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.478+0000 7f307b277b80 1 --2- 172.21.15.8:0/2980767908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ef751dac30 0x55ef75241160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.478+0000 7f307b277b80 1 --2- 172.21.15.8:0/2980767908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ef751da310 0x55ef751e3ca0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.478+0000 7f3048ff9700 0 client.16302 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:31:07.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.478+0000 7f307b277b80 1 -- 172.21.15.8:0/2980767908 >> 172.21.15.8:0/2980767908 conn(0x55ef75101950 msgr2=0x55ef751d8100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:31:07.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.479+0000 7f307b277b80 1 -- 172.21.15.8:0/2980767908 shutdown_connections 2023-08-11T12:31:07.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.479+0000 7f307b277b80 1 -- 172.21.15.8:0/2980767908 wait complete. 2023-08-11T12:31:07.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.479+0000 7f307b277b80 20 client.16302 trim_cache size 0 max 16384 2023-08-11T12:31:07.503 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:31:07.503 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:31:07.503 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:31:07.503 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:31:07.504 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:31:07.504 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:31:07.504 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:31:07.504 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:31:07.504 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:31:07.505 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:31:07.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.479+0000 7f30679ff700 1 -- 172.21.15.8:0/3848513438 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f304c0a00c0 msgr2=0x7f304c0a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:31:07.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.479+0000 7f30679ff700 1 --2- 172.21.15.8:0/3848513438 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f304c0a00c0 0x7f304c0a2580 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3060074d30 tx=0x7f305800bab0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.479+0000 7f30679ff700 1 -- 172.21.15.8:0/3848513438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3060100960 msgr2=0x7f3060072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:31:07.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.479+0000 7f30679ff700 1 --2- 172.21.15.8:0/3848513438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3060100960 0x7f3060072c20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f305c00e9f0 tx=0x7f305c00ed00 comp rx=0 tx=0).stop 2023-08-11T12:31:07.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.479+0000 7f30679ff700 1 -- 172.21.15.8:0/3848513438 shutdown_connections 2023-08-11T12:31:07.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.479+0000 7f30679ff700 1 --2- 172.21.15.8:0/3848513438 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f304c0a00c0 0x7f304c0a2580 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.479+0000 7f30679ff700 1 --2- 172.21.15.8:0/3848513438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3060106970 0x7f30601a4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.479+0000 7f30679ff700 1 --2- 172.21.15.8:0/3848513438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3060100960 0x7f3060072c20 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.479+0000 7f30679ff700 1 --2- 172.21.15.8:0/3848513438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3060101320 0x7f3060073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:07.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.479+0000 7f30679ff700 1 -- 172.21.15.8:0/3848513438 >> 172.21.15.8:0/3848513438 conn(0x7f30600fc490 msgr2=0x7f30600fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:31:07.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.480+0000 7f30679ff700 1 -- 172.21.15.8:0/3848513438 shutdown_connections 2023-08-11T12:31:07.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:07.480+0000 7f30679ff700 1 -- 172.21.15.8:0/3848513438 wait complete. 2023-08-11T12:31:07.509 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:31:09.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:08 smithi008 ceph-mon[97158]: pgmap v199: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-08-11T12:31:09.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:08 smithi008 ceph-mon[97158]: osdmap e91: 12 total, 12 up, 12 in 2023-08-11T12:31:09.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:08 smithi194 ceph-mon[130905]: pgmap v199: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-08-11T12:31:09.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:08 smithi194 ceph-mon[130905]: osdmap e91: 12 total, 12 up, 12 in 2023-08-11T12:31:09.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:08 smithi045 ceph-mon[130284]: pgmap v199: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-08-11T12:31:09.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:08 smithi045 ceph-mon[130284]: osdmap e91: 12 total, 12 up, 12 in 2023-08-11T12:31:11.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:10 smithi194 ceph-mon[130905]: pgmap v201: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-08-11T12:31:11.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:10 smithi045 ceph-mon[130284]: pgmap v201: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-08-11T12:31:11.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:10 smithi008 ceph-mon[97158]: pgmap v201: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-08-11T12:31:13.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:12 smithi008 ceph-mon[97158]: pgmap v202: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:31:13.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:12 smithi194 ceph-mon[130905]: pgmap v202: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:31:13.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:12 smithi045 ceph-mon[130284]: pgmap v202: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:31:15.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:14 smithi008 ceph-mon[97158]: pgmap v203: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:31:15.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:14 smithi008 ceph-mon[97158]: osdmap e92: 12 total, 12 up, 12 in 2023-08-11T12:31:15.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:14 smithi194 ceph-mon[130905]: pgmap v203: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:31:15.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:14 smithi194 ceph-mon[130905]: osdmap e92: 12 total, 12 up, 12 in 2023-08-11T12:31:15.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:14 smithi045 ceph-mon[130284]: pgmap v203: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:31:15.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:14 smithi045 ceph-mon[130284]: osdmap e92: 12 total, 12 up, 12 in 2023-08-11T12:31:17.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:16 smithi008 ceph-mon[97158]: pgmap v205: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-08-11T12:31:17.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:16 smithi194 ceph-mon[130905]: pgmap v205: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-08-11T12:31:17.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:16 smithi045 ceph-mon[130284]: pgmap v205: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-08-11T12:31:19.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:18 smithi008 ceph-mon[97158]: pgmap v206: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-11T12:31:19.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:18 smithi194 ceph-mon[130905]: pgmap v206: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-11T12:31:19.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:18 smithi045 ceph-mon[130284]: pgmap v206: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-11T12:31:21.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:20 smithi194 ceph-mon[130905]: pgmap v207: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:31:21.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:20 smithi045 ceph-mon[130284]: pgmap v207: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:31:21.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:20 smithi008 ceph-mon[97158]: pgmap v207: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:31:23.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:22 smithi008 ceph-mon[97158]: pgmap v208: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:31:23.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:22 smithi194 ceph-mon[130905]: pgmap v208: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:31:23.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:22 smithi045 ceph-mon[130284]: pgmap v208: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:31:25.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:24 smithi008 ceph-mon[97158]: pgmap v209: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:31:25.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:24 smithi194 ceph-mon[130905]: pgmap v209: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:31:25.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:24 smithi045 ceph-mon[130284]: pgmap v209: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:31:27.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:26 smithi008 ceph-mon[97158]: pgmap v210: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:31:27.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:26 smithi194 ceph-mon[130905]: pgmap v210: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:31:27.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:26 smithi045 ceph-mon[130284]: pgmap v210: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:31:29.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:28 smithi008 ceph-mon[97158]: pgmap v211: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:31:29.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:28 smithi194 ceph-mon[130905]: pgmap v211: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:31:29.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:28 smithi045 ceph-mon[130284]: pgmap v211: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:31:31.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:30 smithi194 ceph-mon[130905]: pgmap v212: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:31:31.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:30 smithi045 ceph-mon[130284]: pgmap v212: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:31:31.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:30 smithi008 ceph-mon[97158]: pgmap v212: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:31:33.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:32 smithi008 ceph-mon[97158]: pgmap v213: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:31:33.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:32 smithi194 ceph-mon[130905]: pgmap v213: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:31:33.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:32 smithi045 ceph-mon[130284]: pgmap v213: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:31:35.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:34 smithi008 ceph-mon[97158]: pgmap v214: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:31:35.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:34 smithi194 ceph-mon[130905]: pgmap v214: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:31:35.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:34 smithi045 ceph-mon[130284]: pgmap v214: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:31:37.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:36 smithi008 ceph-mon[97158]: pgmap v215: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:31:37.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:36 smithi194 ceph-mon[130905]: pgmap v215: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:31:37.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:36 smithi045 ceph-mon[130284]: pgmap v215: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:31:37.510 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:31:37.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.725+0000 7f99c7bff700 1 -- 172.21.15.8:0/3098240231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99c0106970 msgr2=0x7f99c0106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:31:37.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.725+0000 7f99c7bff700 1 --2- 172.21.15.8:0/3098240231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99c0106970 0x7f99c0106d50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0098f0 tx=0x7f99bc009c00 comp rx=0 tx=0).stop 2023-08-11T12:31:37.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.725+0000 7f99c7bff700 1 -- 172.21.15.8:0/3098240231 shutdown_connections 2023-08-11T12:31:37.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.725+0000 7f99c7bff700 1 --2- 172.21.15.8:0/3098240231 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99c0101320 0x7f99c010d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.725+0000 7f99c7bff700 1 --2- 172.21.15.8:0/3098240231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99c0106970 0x7f99c0106d50 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.725+0000 7f99c7bff700 1 --2- 172.21.15.8:0/3098240231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99c0100960 0x7f99c0100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.725+0000 7f99c7bff700 1 -- 172.21.15.8:0/3098240231 >> 172.21.15.8:0/3098240231 conn(0x7f99c00fc490 msgr2=0x7f99c00fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:31:37.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.726+0000 7f99c7bff700 1 -- 172.21.15.8:0/3098240231 shutdown_connections 2023-08-11T12:31:37.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.726+0000 7f99c7bff700 1 -- 172.21.15.8:0/3098240231 wait complete. 2023-08-11T12:31:37.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.727+0000 7f99c7bff700 1 Processor -- start 2023-08-11T12:31:37.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.727+0000 7f99c7bff700 1 -- start start 2023-08-11T12:31:37.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.727+0000 7f99c7bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99c0100960 0x7f99c019eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:37.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.727+0000 7f99c7bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99c0101320 0x7f99c019f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:37.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.727+0000 7f99c7bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99c0106970 0x7f99c0198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:37.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.727+0000 7f99c7bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c0199290 con 0x7f99c0106970 2023-08-11T12:31:37.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.727+0000 7f99c7bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c0199400 con 0x7f99c0100960 2023-08-11T12:31:37.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.727+0000 7f99c7bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c01995c0 con 0x7f99c0101320 2023-08-11T12:31:37.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.728+0000 7f99c599b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99c0100960 0x7f99c019eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:37.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.728+0000 7f99c599b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99c0100960 0x7f99c019eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:55322/0 (socket says 172.21.15.8:55322) 2023-08-11T12:31:37.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.728+0000 7f99c599b700 1 -- 172.21.15.8:0/1011805241 learned_addr learned my addr 172.21.15.8:0/1011805241 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:31:37.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.728+0000 7f99c519a700 1 --2- 172.21.15.8:0/1011805241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99c0101320 0x7f99c019f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:37.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.728+0000 7f99c619c700 1 --2- 172.21.15.8:0/1011805241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99c0106970 0x7f99c0198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:37.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.728+0000 7f99c599b700 1 -- 172.21.15.8:0/1011805241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99c0101320 msgr2=0x7f99c019f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:31:37.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.728+0000 7f99c599b700 1 --2- 172.21.15.8:0/1011805241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99c0101320 0x7f99c019f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.728+0000 7f99c599b700 1 -- 172.21.15.8:0/1011805241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99c0106970 msgr2=0x7f99c0198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:31:37.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.728+0000 7f99c599b700 1 --2- 172.21.15.8:0/1011805241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99c0106970 0x7f99c0198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.728+0000 7f99c599b700 1 -- 172.21.15.8:0/1011805241 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b00095f0 con 0x7f99c0100960 2023-08-11T12:31:37.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.728+0000 7f99c599b700 1 --2- 172.21.15.8:0/1011805241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99c0100960 0x7f99c019eae0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f99bc009810 tx=0x7f99bc00fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:31:37.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.729+0000 7f99b6ffd700 1 -- 172.21.15.8:0/1011805241 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc01c070 con 0x7f99c0100960 2023-08-11T12:31:37.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.729+0000 7f99c7bff700 1 -- 172.21.15.8:0/1011805241 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99bc009520 con 0x7f99c0100960 2023-08-11T12:31:37.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.729+0000 7f99b6ffd700 1 -- 172.21.15.8:0/1011805241 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f99bc00bb20 con 0x7f99c0100960 2023-08-11T12:31:37.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.729+0000 7f99b6ffd700 1 -- 172.21.15.8:0/1011805241 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc004930 con 0x7f99c0100960 2023-08-11T12:31:37.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.729+0000 7f99c7bff700 1 -- 172.21.15.8:0/1011805241 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c0199950 con 0x7f99c0100960 2023-08-11T12:31:37.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.732+0000 7f99b6ffd700 1 -- 172.21.15.8:0/1011805241 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f99bc020070 con 0x7f99c0100960 2023-08-11T12:31:37.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.733+0000 7f99db45ab80 1 Processor -- start 2023-08-11T12:31:37.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.733+0000 7f99db45ab80 1 -- start start 2023-08-11T12:31:37.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.733+0000 7f99b6ffd700 1 --2- 172.21.15.8:0/1011805241 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f99ac0a00c0 0x7f99ac0a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:37.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.733+0000 7f99b6ffd700 1 -- 172.21.15.8:0/1011805241 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9366+0+0 (secure 0 0 0) 0x7f99bc0cc680 con 0x7f99c0100960 2023-08-11T12:31:37.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.733+0000 7f99db45ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563655503310 0x5636555036f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:37.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.733+0000 7f99db45ab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563655503c30 0x5636554fd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:37.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.733+0000 7f99db45ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5636554fde20 0x5636554fe260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:37.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.734+0000 7f99db45ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563655456630 con 0x5636554fde20 2023-08-11T12:31:37.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.734+0000 7f99db45ab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563655453f50 con 0x563655503c30 2023-08-11T12:31:37.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.734+0000 7f99db45ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365544f840 con 0x563655503310 2023-08-11T12:31:37.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.734+0000 7f99c599b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563655503310 0x5636555036f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:37.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.734+0000 7f99c619c700 1 --2- 172.21.15.8:0/1011805241 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f99ac0a00c0 0x7f99ac0a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:37.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.734+0000 7f99c519a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563655503c30 0x5636554fd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:37.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.734+0000 7f99c599b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563655503310 0x5636555036f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:33696/0 (socket says 172.21.15.8:33696) 2023-08-11T12:31:37.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.734+0000 7f99c599b700 1 -- 172.21.15.8:0/1578183384 learned_addr learned my addr 172.21.15.8:0/1578183384 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:31:37.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.734+0000 7f99c519a700 1 --2- 172.21.15.8:0/1578183384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563655503c30 0x5636554fd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:55330/0 (socket says 172.21.15.8:55330) 2023-08-11T12:31:37.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.734+0000 7f99c619c700 1 --2- 172.21.15.8:0/1578183384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5636554fde20 0x5636554fe260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:37.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.734+0000 7f99c599b700 1 -- 172.21.15.8:0/1578183384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563655503c30 msgr2=0x5636554fd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:31:37.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.734+0000 7f99c599b700 1 --2- 172.21.15.8:0/1578183384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563655503c30 0x5636554fd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.734+0000 7f99c599b700 1 -- 172.21.15.8:0/1578183384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5636554fde20 msgr2=0x5636554fe260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:31:37.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.734+0000 7f99c599b700 1 --2- 172.21.15.8:0/1578183384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5636554fde20 0x5636554fe260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.734+0000 7f99c599b700 1 -- 172.21.15.8:0/1578183384 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636552cf630 con 0x563655503310 2023-08-11T12:31:37.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.734+0000 7f99c519a700 1 --2- 172.21.15.8:0/1578183384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563655503c30 0x5636554fd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:31:37.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.735+0000 7f99c599b700 1 --2- 172.21.15.8:0/1578183384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563655503310 0x5636555036f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0a12c0 tx=0x7f99bc00bc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8c9046fa763110d server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:31:37.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.735+0000 7f99c619c700 1 --2- 172.21.15.8:0/1011805241 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f99ac0a00c0 0x7f99ac0a2580 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009ec0 tx=0x7f99b80092f0 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:31:37.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.735+0000 7f99abfff700 1 -- 172.21.15.8:0/1578183384 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc099a70 con 0x563655503310 2023-08-11T12:31:37.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.735+0000 7f99abfff700 1 -- 172.21.15.8:0/1578183384 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f99bc09d8a0 con 0x563655503310 2023-08-11T12:31:37.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.735+0000 7f99abfff700 1 -- 172.21.15.8:0/1578183384 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc0cc270 con 0x563655503310 2023-08-11T12:31:37.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.735+0000 7f99db45ab80 1 -- 172.21.15.8:0/1578183384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563655503310 msgr2=0x5636555036f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:31:37.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.735+0000 7f99db45ab80 1 --2- 172.21.15.8:0/1578183384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563655503310 0x5636555036f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0a12c0 tx=0x7f99bc00bc90 comp rx=0 tx=0).stop 2023-08-11T12:31:37.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.736+0000 7f99db45ab80 1 -- 172.21.15.8:0/1578183384 shutdown_connections 2023-08-11T12:31:37.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.736+0000 7f99db45ab80 1 --2- 172.21.15.8:0/1578183384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563655503310 0x5636555036f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.736+0000 7f99db45ab80 1 --2- 172.21.15.8:0/1578183384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5636554fde20 0x5636554fe260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.736+0000 7f99db45ab80 1 --2- 172.21.15.8:0/1578183384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563655503c30 0x5636554fd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.736+0000 7f99db45ab80 1 -- 172.21.15.8:0/1578183384 >> 172.21.15.8:0/1578183384 conn(0x56365542a950 msgr2=0x5636554f83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:31:37.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.736+0000 7f99db45ab80 1 -- 172.21.15.8:0/1578183384 shutdown_connections 2023-08-11T12:31:37.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.736+0000 7f99db45ab80 1 -- 172.21.15.8:0/1578183384 wait complete. 2023-08-11T12:31:37.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.736+0000 7f99db45ab80 1 -- start start 2023-08-11T12:31:37.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.736+0000 7f99db45ab80 1 Processor -- start 2023-08-11T12:31:37.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.737+0000 7f99db45ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5636554fde20 0x563655509ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:37.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.737+0000 7f99db45ab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563655503310 0x563655506e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:37.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.737+0000 7f99db45ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655503c30 0x563655507360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:37.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.737+0000 7f99db45ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636553edac0 con 0x563655503c30 2023-08-11T12:31:37.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.737+0000 7f99db45ab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636553ed7c0 con 0x563655503310 2023-08-11T12:31:37.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.737+0000 7f99db45ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636552d1920 con 0x5636554fde20 2023-08-11T12:31:37.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.737+0000 7f99db45ab80 10 client.0 _ll_register_callbacks cb 0x5636553f0ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:31:37.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.737+0000 7f99c519a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563655503310 0x563655506e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:37.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.737+0000 7f99c519a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563655503310 0x563655506e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:55332/0 (socket says 172.21.15.8:55332) 2023-08-11T12:31:37.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.737+0000 7f99c599b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5636554fde20 0x563655509ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:37.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.737+0000 7f99c519a700 1 -- 172.21.15.8:0/3852831825 learned_addr learned my addr 172.21.15.8:0/3852831825 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:31:37.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.737+0000 7f99c619c700 1 --2- 172.21.15.8:0/3852831825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655503c30 0x563655507360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:37.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.738+0000 7f99c519a700 1 -- 172.21.15.8:0/3852831825 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5636554fde20 msgr2=0x563655509ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:31:37.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.738+0000 7f99c519a700 1 --2- 172.21.15.8:0/3852831825 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5636554fde20 0x563655509ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.738+0000 7f99c519a700 1 -- 172.21.15.8:0/3852831825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655503c30 msgr2=0x563655507360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:31:37.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.738+0000 7f99c519a700 1 --2- 172.21.15.8:0/3852831825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655503c30 0x563655507360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.738+0000 7f99c519a700 1 -- 172.21.15.8:0/3852831825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b0009b80 con 0x563655503310 2023-08-11T12:31:37.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.738+0000 7f99c519a700 1 --2- 172.21.15.8:0/3852831825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563655503310 0x563655506e00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f99b0012cd0 tx=0x7f99b00099d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67cb3abaffcfa61 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:31:37.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.738+0000 7f99a97fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:31:37.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.738+0000 7f99a97fa700 1 -- 172.21.15.8:0/3852831825 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0017070 con 0x563655503310 2023-08-11T12:31:37.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.738+0000 7f99db45ab80 1 -- 172.21.15.8:0/3852831825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5636554f0a90 con 0x563655503310 2023-08-11T12:31:37.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.738+0000 7f99a97fa700 1 -- 172.21.15.8:0/3852831825 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9366+0+0 (secure 0 0 0) 0x7f99b0004030 con 0x563655503310 2023-08-11T12:31:37.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.738+0000 7f99a97fa700 1 -- 172.21.15.8:0/3852831825 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99b00041f0 con 0x563655503310 2023-08-11T12:31:37.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.738+0000 7f99db45ab80 10 client.26357 fetch_fsmap learned FSMap version 54 2023-08-11T12:31:37.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.738+0000 7f99db45ab80 1 -- 172.21.15.8:0/3852831825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x7f99c0199950 con 0x563655503310 2023-08-11T12:31:37.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.739+0000 7f99a97fa700 1 -- 172.21.15.8:0/3852831825 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5636554f0a90 con 0x563655503310 2023-08-11T12:31:37.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.739+0000 7f99a97fa700 1 -- 172.21.15.8:0/3852831825 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f99b0003780 con 0x563655503310 2023-08-11T12:31:37.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.739+0000 7f99db45ab80 10 client.26357 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:31:37.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.739+0000 7f99db45ab80 10 client.26357 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:31:37.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.739+0000 7f99db45ab80 20 client.26357 populate_metadata read hostname 'smithi008' 2023-08-11T12:31:37.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.739+0000 7f99db45ab80 1 --2- 172.21.15.8:0/3852831825 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x563655517210 0x563655519630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:37.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.739+0000 7f99db45ab80 4 client.26357 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:31:37.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.739+0000 7f99db45ab80 1 -- 172.21.15.8:0/3852831825 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5636554cc4e0 con 0x563655517210 2023-08-11T12:31:37.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.739+0000 7f99c599b700 1 --2- 172.21.15.8:0/3852831825 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x563655517210 0x563655519630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:37.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.740+0000 7f99c599b700 1 --2- 172.21.15.8:0/3852831825 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x563655517210 0x563655519630 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50c94e18dd28b7b1 server_cookie=f1c6e1f1a91fae72 in_seq=0 out_seq=0 2023-08-11T12:31:37.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.740+0000 7f99a97fa700 10 client.26357 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:31:37.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.741+0000 7f99a97fa700 1 -- 172.21.15.8:0/3852831825 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5636554cc4e0 con 0x563655517210 2023-08-11T12:31:37.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.741+0000 7f99a97fa700 10 client.26357 handle_command_reply: tid=0 2023-08-11T12:31:37.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.741+0000 7f99db45ab80 1 client.26357 shutdown 2023-08-11T12:31:37.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.741+0000 7f99db45ab80 1 -- 172.21.15.8:0/3852831825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563655503310 msgr2=0x563655506e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:31:37.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.741+0000 7f99db45ab80 1 --2- 172.21.15.8:0/3852831825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563655503310 0x563655506e00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f99b0012cd0 tx=0x7f99b00099d0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.741+0000 7f99db45ab80 1 -- 172.21.15.8:0/3852831825 shutdown_connections 2023-08-11T12:31:37.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.741+0000 7f99db45ab80 1 --2- 172.21.15.8:0/3852831825 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x563655517210 0x563655519630 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.741+0000 7f99db45ab80 1 --2- 172.21.15.8:0/3852831825 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5636554fde20 0x563655509ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.741+0000 7f99db45ab80 1 --2- 172.21.15.8:0/3852831825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655503c30 0x563655507360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.741+0000 7f99a97fa700 0 client.26357 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:31:37.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.741+0000 7f99db45ab80 1 --2- 172.21.15.8:0/3852831825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563655503310 0x563655506e00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.741+0000 7f99db45ab80 1 -- 172.21.15.8:0/3852831825 >> 172.21.15.8:0/3852831825 conn(0x56365542a950 msgr2=0x5636554f2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:31:37.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.741+0000 7f99db45ab80 1 -- 172.21.15.8:0/3852831825 shutdown_connections 2023-08-11T12:31:37.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.741+0000 7f99db45ab80 1 -- 172.21.15.8:0/3852831825 wait complete. 2023-08-11T12:31:37.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.742+0000 7f99db45ab80 20 client.26357 trim_cache size 0 max 16384 2023-08-11T12:31:37.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.759+0000 7f99db45ab80 1 Processor -- start 2023-08-11T12:31:37.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.759+0000 7f99db45ab80 1 -- start start 2023-08-11T12:31:37.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.759+0000 7f99db45ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5636554fde20 0x5636554fd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:37.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.759+0000 7f99db45ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655503310 0x5636555027e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:37.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.759+0000 7f99db45ab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563655503c30 0x56365550e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:37.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.759+0000 7f99db45ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365550e870 con 0x563655503310 2023-08-11T12:31:37.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.759+0000 7f99db45ab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563655514840 con 0x563655503c30 2023-08-11T12:31:37.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.759+0000 7f99db45ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365551e430 con 0x5636554fde20 2023-08-11T12:31:37.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.759+0000 7f99c619c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563655503c30 0x56365550e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:37.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.759+0000 7f99c619c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563655503c30 0x56365550e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:55348/0 (socket says 172.21.15.8:55348) 2023-08-11T12:31:37.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.759+0000 7f99c619c700 1 -- 172.21.15.8:0/3108612077 learned_addr learned my addr 172.21.15.8:0/3108612077 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:31:37.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.760+0000 7f99c519a700 1 --2- 172.21.15.8:0/3108612077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655503310 0x5636555027e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:37.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.760+0000 7f99c599b700 1 --2- 172.21.15.8:0/3108612077 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5636554fde20 0x5636554fd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:37.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.760+0000 7f99c619c700 1 -- 172.21.15.8:0/3108612077 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5636554fde20 msgr2=0x5636554fd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:31:37.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.760+0000 7f99c619c700 1 --2- 172.21.15.8:0/3108612077 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5636554fde20 0x5636554fd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.760+0000 7f99c619c700 1 -- 172.21.15.8:0/3108612077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655503310 msgr2=0x5636555027e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:31:37.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.760+0000 7f99c619c700 1 --2- 172.21.15.8:0/3108612077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655503310 0x5636555027e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.760+0000 7f99c619c700 1 -- 172.21.15.8:0/3108612077 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636554f1fd0 con 0x563655503c30 2023-08-11T12:31:37.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.760+0000 7f99c619c700 1 --2- 172.21.15.8:0/3108612077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563655503c30 0x56365550e330 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f99b80060e0 tx=0x7f99b801d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=511d15f154a6950 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:31:37.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.760+0000 7f99b4bff700 1 -- 172.21.15.8:0/3108612077 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b800e070 con 0x563655503c30 2023-08-11T12:31:37.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.761+0000 7f99b4bff700 1 -- 172.21.15.8:0/3108612077 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f99b800f040 con 0x563655503c30 2023-08-11T12:31:37.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.761+0000 7f99b4bff700 1 -- 172.21.15.8:0/3108612077 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b8028a30 con 0x563655503c30 2023-08-11T12:31:37.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.761+0000 7f99db45ab80 1 -- 172.21.15.8:0/3108612077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563655503c30 msgr2=0x56365550e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:31:37.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.761+0000 7f99db45ab80 1 --2- 172.21.15.8:0/3108612077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563655503c30 0x56365550e330 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f99b80060e0 tx=0x7f99b801d000 comp rx=0 tx=0).stop 2023-08-11T12:31:37.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.761+0000 7f99db45ab80 1 -- 172.21.15.8:0/3108612077 shutdown_connections 2023-08-11T12:31:37.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.761+0000 7f99db45ab80 1 --2- 172.21.15.8:0/3108612077 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5636554fde20 0x5636554fd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.761+0000 7f99db45ab80 1 --2- 172.21.15.8:0/3108612077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563655503c30 0x56365550e330 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.761+0000 7f99db45ab80 1 --2- 172.21.15.8:0/3108612077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655503310 0x5636555027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.761+0000 7f99db45ab80 1 -- 172.21.15.8:0/3108612077 >> 172.21.15.8:0/3108612077 conn(0x56365542a950 msgr2=0x5636554f2420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:31:37.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.761+0000 7f99db45ab80 1 -- 172.21.15.8:0/3108612077 shutdown_connections 2023-08-11T12:31:37.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.761+0000 7f99db45ab80 1 -- 172.21.15.8:0/3108612077 wait complete. 2023-08-11T12:31:37.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.762+0000 7f99db45ab80 1 -- start start 2023-08-11T12:31:37.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.762+0000 7f99db45ab80 1 Processor -- start 2023-08-11T12:31:37.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.762+0000 7f99db45ab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5636554fde20 0x5636554ff230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:37.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.762+0000 7f99db45ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563655503310 0x5636554ff770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:37.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.762+0000 7f99db45ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655503c30 0x5636554ffcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:37.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.762+0000 7f99db45ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365556aec0 con 0x563655503c30 2023-08-11T12:31:37.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.762+0000 7f99db45ab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365556b000 con 0x5636554fde20 2023-08-11T12:31:37.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.762+0000 7f99db45ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365556b140 con 0x563655503310 2023-08-11T12:31:37.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.763+0000 7f99db45ab80 10 client.0 _ll_register_callbacks cb 0x7f99b00127f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:31:37.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.763+0000 7f99c599b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5636554fde20 0x5636554ff230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:37.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.763+0000 7f99c599b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5636554fde20 0x5636554ff230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:55364/0 (socket says 172.21.15.8:55364) 2023-08-11T12:31:37.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.763+0000 7f99c599b700 1 -- 172.21.15.8:0/1523205638 learned_addr learned my addr 172.21.15.8:0/1523205638 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:31:37.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.763+0000 7f99c519a700 1 --2- 172.21.15.8:0/1523205638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563655503310 0x5636554ff770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:37.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.763+0000 7f99c619c700 1 --2- 172.21.15.8:0/1523205638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655503c30 0x5636554ffcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:37.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.763+0000 7f99c599b700 1 -- 172.21.15.8:0/1523205638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563655503310 msgr2=0x5636554ff770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:31:37.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.763+0000 7f99c599b700 1 --2- 172.21.15.8:0/1523205638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563655503310 0x5636554ff770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.763+0000 7f99c599b700 1 -- 172.21.15.8:0/1523205638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655503c30 msgr2=0x5636554ffcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:31:37.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.763+0000 7f99c599b700 1 --2- 172.21.15.8:0/1523205638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655503c30 0x5636554ffcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.763+0000 7f99c599b700 1 -- 172.21.15.8:0/1523205638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b8008570 con 0x5636554fde20 2023-08-11T12:31:37.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.763+0000 7f99c599b700 1 --2- 172.21.15.8:0/1523205638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5636554fde20 0x5636554ff230 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f99bc099770 tx=0x7f99bc00b3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1393955f2e192031 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:31:37.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.763+0000 7f99a97fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:31:37.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.763+0000 7f99a97fa700 1 -- 172.21.15.8:0/1523205638 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc096180 con 0x5636554fde20 2023-08-11T12:31:37.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.764+0000 7f99a97fa700 1 -- 172.21.15.8:0/1523205638 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9366+0+0 (secure 0 0 0) 0x7f99bc0962e0 con 0x5636554fde20 2023-08-11T12:31:37.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.764+0000 7f99db45ab80 1 -- 172.21.15.8:0/1523205638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f99bc09d8a0 con 0x5636554fde20 2023-08-11T12:31:37.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.764+0000 7f99a97fa700 1 -- 172.21.15.8:0/1523205638 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99bc005140 con 0x5636554fde20 2023-08-11T12:31:37.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.764+0000 7f99db45ab80 10 client.26363 fetch_fsmap learned FSMap version 54 2023-08-11T12:31:37.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.764+0000 7f99db45ab80 1 -- 172.21.15.8:0/1523205638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x56365527bde0 con 0x5636554fde20 2023-08-11T12:31:37.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.764+0000 7f99a97fa700 1 -- 172.21.15.8:0/1523205638 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f99bc09d8a0 con 0x5636554fde20 2023-08-11T12:31:37.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.764+0000 7f99a97fa700 1 -- 172.21.15.8:0/1523205638 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f99bc098f60 con 0x5636554fde20 2023-08-11T12:31:37.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.764+0000 7f99db45ab80 10 client.26363 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:31:37.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.764+0000 7f99db45ab80 10 client.26363 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:31:37.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.764+0000 7f99db45ab80 20 client.26363 populate_metadata read hostname 'smithi008' 2023-08-11T12:31:37.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.764+0000 7f99db45ab80 1 --2- 172.21.15.8:0/1523205638 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x56365556c370 0x56365556e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:31:37.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.764+0000 7f99db45ab80 4 client.26363 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:31:37.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.764+0000 7f99db45ab80 1 -- 172.21.15.8:0/1523205638 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563655448820 con 0x56365556c370 2023-08-11T12:31:37.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.764+0000 7f99c519a700 1 --2- 172.21.15.8:0/1523205638 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x56365556c370 0x56365556e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:31:37.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.765+0000 7f99c519a700 1 --2- 172.21.15.8:0/1523205638 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x56365556c370 0x56365556e760 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=704bb5dab3f31c17 server_cookie=afa898a88cdd1b94 in_seq=0 out_seq=0 2023-08-11T12:31:37.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.765+0000 7f99a97fa700 10 client.26363 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:31:37.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.765+0000 7f99a97fa700 1 -- 172.21.15.8:0/1523205638 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x563655448820 con 0x56365556c370 2023-08-11T12:31:37.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.765+0000 7f99a97fa700 10 client.26363 handle_command_reply: tid=0 2023-08-11T12:31:37.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.765+0000 7f99db45ab80 1 client.26363 shutdown 2023-08-11T12:31:37.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.765+0000 7f99db45ab80 1 -- 172.21.15.8:0/1523205638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5636554fde20 msgr2=0x5636554ff230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:31:37.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.765+0000 7f99db45ab80 1 --2- 172.21.15.8:0/1523205638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5636554fde20 0x5636554ff230 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f99bc099770 tx=0x7f99bc00b3e0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.765+0000 7f99db45ab80 1 -- 172.21.15.8:0/1523205638 shutdown_connections 2023-08-11T12:31:37.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.765+0000 7f99db45ab80 1 --2- 172.21.15.8:0/1523205638 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x56365556c370 0x56365556e760 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.765+0000 7f99db45ab80 1 --2- 172.21.15.8:0/1523205638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655503c30 0x5636554ffcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.765+0000 7f99a97fa700 0 client.26363 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:31:37.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.765+0000 7f99db45ab80 1 --2- 172.21.15.8:0/1523205638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5636554fde20 0x5636554ff230 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.765+0000 7f99db45ab80 1 --2- 172.21.15.8:0/1523205638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563655503310 0x5636554ff770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.765+0000 7f99db45ab80 1 -- 172.21.15.8:0/1523205638 >> 172.21.15.8:0/1523205638 conn(0x56365542a950 msgr2=0x563655502650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:31:37.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.766+0000 7f99db45ab80 1 -- 172.21.15.8:0/1523205638 shutdown_connections 2023-08-11T12:31:37.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.766+0000 7f99db45ab80 1 -- 172.21.15.8:0/1523205638 wait complete. 2023-08-11T12:31:37.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.766+0000 7f99db45ab80 20 client.26363 trim_cache size 0 max 16384 2023-08-11T12:31:37.782 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:31:37.783 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:31:37.783 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:31:37.783 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:31:37.783 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:31:37.783 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:31:37.784 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:31:37.784 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:31:37.784 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:31:37.784 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:31:37.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.766+0000 7f99c7bff700 1 -- 172.21.15.8:0/1011805241 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f99ac0a00c0 msgr2=0x7f99ac0a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:31:37.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.766+0000 7f99c7bff700 1 --2- 172.21.15.8:0/1011805241 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f99ac0a00c0 0x7f99ac0a2580 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009ec0 tx=0x7f99b80092f0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.766+0000 7f99c7bff700 1 -- 172.21.15.8:0/1011805241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99c0100960 msgr2=0x7f99c019eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:31:37.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.766+0000 7f99c7bff700 1 --2- 172.21.15.8:0/1011805241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99c0100960 0x7f99c019eae0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f99bc009810 tx=0x7f99bc00fa00 comp rx=0 tx=0).stop 2023-08-11T12:31:37.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.766+0000 7f99c7bff700 1 -- 172.21.15.8:0/1011805241 shutdown_connections 2023-08-11T12:31:37.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.766+0000 7f99c7bff700 1 --2- 172.21.15.8:0/1011805241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99c0106970 0x7f99c0198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.766+0000 7f99c7bff700 1 --2- 172.21.15.8:0/1011805241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99c0100960 0x7f99c019eae0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.766+0000 7f99c7bff700 1 --2- 172.21.15.8:0/1011805241 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f99ac0a00c0 0x7f99ac0a2580 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.766+0000 7f99c7bff700 1 --2- 172.21.15.8:0/1011805241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99c0101320 0x7f99c019f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:31:37.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.767+0000 7f99c7bff700 1 -- 172.21.15.8:0/1011805241 >> 172.21.15.8:0/1011805241 conn(0x7f99c00fc490 msgr2=0x7f99c00fcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:31:37.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.767+0000 7f99c7bff700 1 -- 172.21.15.8:0/1011805241 shutdown_connections 2023-08-11T12:31:37.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:31:37.767+0000 7f99c7bff700 1 -- 172.21.15.8:0/1011805241 wait complete. 2023-08-11T12:31:37.788 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:31:38.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:38 smithi008 ceph-mon[97158]: pgmap v216: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:31:38.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:38 smithi194 ceph-mon[130905]: pgmap v216: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:31:38.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:38 smithi045 ceph-mon[130284]: pgmap v216: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:31:41.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:40 smithi194 ceph-mon[130905]: pgmap v217: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:31:41.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:40 smithi045 ceph-mon[130284]: pgmap v217: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:31:41.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:40 smithi008 ceph-mon[97158]: pgmap v217: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:31:43.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:42 smithi008 ceph-mon[97158]: pgmap v218: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:31:43.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:42 smithi194 ceph-mon[130905]: pgmap v218: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:31:43.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:42 smithi045 ceph-mon[130284]: pgmap v218: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:31:45.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:44 smithi008 ceph-mon[97158]: pgmap v219: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:31:45.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:44 smithi194 ceph-mon[130905]: pgmap v219: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:31:45.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:44 smithi045 ceph-mon[130284]: pgmap v219: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:31:47.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:46 smithi008 ceph-mon[97158]: pgmap v220: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:31:47.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:46 smithi194 ceph-mon[130905]: pgmap v220: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:31:47.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:46 smithi045 ceph-mon[130284]: pgmap v220: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:31:48.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:47 smithi008 ceph-mon[97158]: pgmap v221: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:31:48.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:47 smithi194 ceph-mon[130905]: pgmap v221: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:31:48.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:47 smithi045 ceph-mon[130284]: pgmap v221: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:31:51.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:50 smithi194 ceph-mon[130905]: pgmap v222: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-11T12:31:51.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:50 smithi045 ceph-mon[130284]: pgmap v222: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-11T12:31:51.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:50 smithi008 ceph-mon[97158]: pgmap v222: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-11T12:31:53.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:52 smithi008 ceph-mon[97158]: pgmap v223: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:31:53.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:52 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:31:53.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:52 smithi194 ceph-mon[130905]: pgmap v223: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:31:53.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:52 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:31:53.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:52 smithi045 ceph-mon[130284]: pgmap v223: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:31:53.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:52 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:31:54.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:53 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:31:54.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:53 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:31:54.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:53 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:31:54.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:53 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:31:54.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:53 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:31:54.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:53 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:31:54.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:53 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:31:54.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:53 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:31:54.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:53 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:31:55.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:54 smithi008 ceph-mon[97158]: pgmap v224: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-11T12:31:55.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:54 smithi194 ceph-mon[130905]: pgmap v224: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-11T12:31:55.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:54 smithi045 ceph-mon[130284]: pgmap v224: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-11T12:31:57.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:56 smithi008 ceph-mon[97158]: pgmap v225: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-11T12:31:57.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:56 smithi194 ceph-mon[130905]: pgmap v225: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-11T12:31:57.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:56 smithi045 ceph-mon[130284]: pgmap v225: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-11T12:31:58.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:31:57 smithi008 ceph-mon[97158]: pgmap v226: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-08-11T12:31:58.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:31:57 smithi194 ceph-mon[130905]: pgmap v226: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-08-11T12:31:58.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:31:57 smithi045 ceph-mon[130284]: pgmap v226: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-08-11T12:32:01.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:00 smithi194 ceph-mon[130905]: pgmap v227: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-11T12:32:01.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:00 smithi045 ceph-mon[130284]: pgmap v227: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-11T12:32:01.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:00 smithi008 ceph-mon[97158]: pgmap v227: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-11T12:32:03.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:02 smithi008 ceph-mon[97158]: pgmap v228: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-11T12:32:03.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:02 smithi194 ceph-mon[130905]: pgmap v228: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-11T12:32:03.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:02 smithi045 ceph-mon[130284]: pgmap v228: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-11T12:32:05.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:04 smithi008 ceph-mon[97158]: pgmap v229: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:32:05.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:04 smithi045 ceph-mon[130284]: pgmap v229: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:32:05.396 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:04 smithi194 ceph-mon[130905]: pgmap v229: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:32:06.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:05 smithi008 ceph-mon[97158]: pgmap v230: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:32:06.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:05 smithi194 ceph-mon[130905]: pgmap v230: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:32:06.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:05 smithi045 ceph-mon[130284]: pgmap v230: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:32:07.790 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:32:08.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.097+0000 7f465c1ff700 1 -- 172.21.15.8:0/372481686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4654100960 msgr2=0x7f4654100de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:32:08.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.097+0000 7f465c1ff700 1 --2- 172.21.15.8:0/372481686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4654100960 0x7f4654100de0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4644009990 tx=0x7f4644009ca0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.097+0000 7f465c1ff700 1 -- 172.21.15.8:0/372481686 shutdown_connections 2023-08-11T12:32:08.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.097+0000 7f465c1ff700 1 --2- 172.21.15.8:0/372481686 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4654101320 0x7f465410d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.097+0000 7f465c1ff700 1 --2- 172.21.15.8:0/372481686 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4654106970 0x7f4654106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.097+0000 7f465c1ff700 1 --2- 172.21.15.8:0/372481686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4654100960 0x7f4654100de0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.097+0000 7f465c1ff700 1 -- 172.21.15.8:0/372481686 >> 172.21.15.8:0/372481686 conn(0x7f46540fc490 msgr2=0x7f46540fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:32:08.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.097+0000 7f465c1ff700 1 -- 172.21.15.8:0/372481686 shutdown_connections 2023-08-11T12:32:08.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.097+0000 7f465c1ff700 1 -- 172.21.15.8:0/372481686 wait complete. 2023-08-11T12:32:08.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.098+0000 7f465c1ff700 1 Processor -- start 2023-08-11T12:32:08.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.098+0000 7f465c1ff700 1 -- start start 2023-08-11T12:32:08.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.099+0000 7f465c1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4654100960 0x7f465419e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:08.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.099+0000 7f465c1ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4654101320 0x7f465419ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:08.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.099+0000 7f465c1ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4654106970 0x7f4654198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:08.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.099+0000 7f465c1ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46541990a0 con 0x7f4654101320 2023-08-11T12:32:08.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.099+0000 7f465c1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4654199210 con 0x7f4654100960 2023-08-11T12:32:08.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.099+0000 7f465c1ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46541993d0 con 0x7f4654106970 2023-08-11T12:32:08.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.099+0000 7f4659f9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4654100960 0x7f465419e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:08.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.099+0000 7f4659f9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4654100960 0x7f465419e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:45770/0 (socket says 172.21.15.8:45770) 2023-08-11T12:32:08.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.099+0000 7f4659f9b700 1 -- 172.21.15.8:0/1730283362 learned_addr learned my addr 172.21.15.8:0/1730283362 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:32:08.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.099+0000 7f465979a700 1 --2- 172.21.15.8:0/1730283362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4654101320 0x7f465419ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:08.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.099+0000 7f465a79c700 1 --2- 172.21.15.8:0/1730283362 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4654106970 0x7f4654198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:08.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.099+0000 7f4659f9b700 1 -- 172.21.15.8:0/1730283362 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4654106970 msgr2=0x7f4654198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:32:08.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.099+0000 7f4659f9b700 1 --2- 172.21.15.8:0/1730283362 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4654106970 0x7f4654198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.099+0000 7f4659f9b700 1 -- 172.21.15.8:0/1730283362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4654101320 msgr2=0x7f465419ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:32:08.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.099+0000 7f4659f9b700 1 --2- 172.21.15.8:0/1730283362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4654101320 0x7f465419ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.099+0000 7f4659f9b700 1 -- 172.21.15.8:0/1730283362 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4650009520 con 0x7f4654100960 2023-08-11T12:32:08.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.099+0000 7f465a79c700 1 --2- 172.21.15.8:0/1730283362 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4654106970 0x7f4654198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:32:08.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.100+0000 7f4659f9b700 1 --2- 172.21.15.8:0/1730283362 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4654100960 0x7f465419e9c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f465000eb30 tx=0x7f465000ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:32:08.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.100+0000 7f464affd700 1 -- 172.21.15.8:0/1730283362 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4650009880 con 0x7f4654100960 2023-08-11T12:32:08.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.100+0000 7f465c1ff700 1 -- 172.21.15.8:0/1730283362 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46440095f0 con 0x7f4654100960 2023-08-11T12:32:08.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.100+0000 7f464affd700 1 -- 172.21.15.8:0/1730283362 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46500044e0 con 0x7f4654100960 2023-08-11T12:32:08.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.100+0000 7f464affd700 1 -- 172.21.15.8:0/1730283362 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4650003e90 con 0x7f4654100960 2023-08-11T12:32:08.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.100+0000 7f465c1ff700 1 -- 172.21.15.8:0/1730283362 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46541a57d0 con 0x7f4654100960 2023-08-11T12:32:08.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.103+0000 7f464affd700 1 -- 172.21.15.8:0/1730283362 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f4650004000 con 0x7f4654100960 2023-08-11T12:32:08.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.105+0000 7f466fbf2b80 1 Processor -- start 2023-08-11T12:32:08.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.105+0000 7f464affd700 1 --2- 172.21.15.8:0/1730283362 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f46400a00c0 0x7f46400a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:08.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.105+0000 7f464affd700 1 -- 172.21.15.8:0/1730283362 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9454+0+0 (secure 0 0 0) 0x7f4650014070 con 0x7f4654100960 2023-08-11T12:32:08.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.105+0000 7f466fbf2b80 1 -- start start 2023-08-11T12:32:08.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.105+0000 7f465a79c700 1 --2- 172.21.15.8:0/1730283362 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f46400a00c0 0x7f46400a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:08.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.105+0000 7f466fbf2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561007341310 0x5610073416f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:08.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.105+0000 7f466fbf2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561007341c30 0x56100733b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:08.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.106+0000 7f466fbf2b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56100733be20 0x56100733c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:08.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.106+0000 7f466fbf2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561007294630 con 0x561007341310 2023-08-11T12:32:08.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.106+0000 7f466fbf2b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x561007291f50 con 0x56100733be20 2023-08-11T12:32:08.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.106+0000 7f466fbf2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56100728d840 con 0x561007341c30 2023-08-11T12:32:08.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.106+0000 7f4659f9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561007341310 0x5610073416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:08.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.106+0000 7f465a79c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56100733be20 0x56100733c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:08.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.106+0000 7f4659f9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561007341310 0x5610073416f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52836/0 (socket says 172.21.15.8:52836) 2023-08-11T12:32:08.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.106+0000 7f4659f9b700 1 -- 172.21.15.8:0/2888150928 learned_addr learned my addr 172.21.15.8:0/2888150928 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:32:08.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.106+0000 7f465979a700 1 --2- 172.21.15.8:0/2888150928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561007341c30 0x56100733b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:08.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.106+0000 7f465a79c700 1 --2- 172.21.15.8:0/1730283362 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f46400a00c0 0x7f46400a2580 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f465419f6c0 tx=0x7f464c00b040 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:32:08.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.106+0000 7f4659f9b700 1 -- 172.21.15.8:0/2888150928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561007341c30 msgr2=0x56100733b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:32:08.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.106+0000 7f4659f9b700 1 --2- 172.21.15.8:0/2888150928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561007341c30 0x56100733b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.106+0000 7f4659f9b700 1 -- 172.21.15.8:0/2888150928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56100733be20 msgr2=0x56100733c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:32:08.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.106+0000 7f4659f9b700 1 --2- 172.21.15.8:0/2888150928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56100733be20 0x56100733c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.106+0000 7f4659f9b700 1 -- 172.21.15.8:0/2888150928 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56100710d630 con 0x561007341310 2023-08-11T12:32:08.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.106+0000 7f4659f9b700 1 --2- 172.21.15.8:0/2888150928 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561007341310 0x5610073416f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f465000c5b0 tx=0x7f4650098ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7470db7d692eef8 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:32:08.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.107+0000 7f463ffff700 1 -- 172.21.15.8:0/2888150928 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4650099850 con 0x561007341310 2023-08-11T12:32:08.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.107+0000 7f463ffff700 1 -- 172.21.15.8:0/2888150928 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46500b8040 con 0x561007341310 2023-08-11T12:32:08.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.107+0000 7f463ffff700 1 -- 172.21.15.8:0/2888150928 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46500a0fd0 con 0x561007341310 2023-08-11T12:32:08.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.107+0000 7f466fbf2b80 1 -- 172.21.15.8:0/2888150928 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561007341310 msgr2=0x5610073416f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:32:08.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.107+0000 7f466fbf2b80 1 --2- 172.21.15.8:0/2888150928 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561007341310 0x5610073416f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f465000c5b0 tx=0x7f4650098ff0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.107+0000 7f466fbf2b80 1 -- 172.21.15.8:0/2888150928 shutdown_connections 2023-08-11T12:32:08.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.107+0000 7f466fbf2b80 1 --2- 172.21.15.8:0/2888150928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56100733be20 0x56100733c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.107+0000 7f466fbf2b80 1 --2- 172.21.15.8:0/2888150928 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561007341310 0x5610073416f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.107+0000 7f466fbf2b80 1 --2- 172.21.15.8:0/2888150928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561007341c30 0x56100733b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.107+0000 7f466fbf2b80 1 -- 172.21.15.8:0/2888150928 >> 172.21.15.8:0/2888150928 conn(0x561007268950 msgr2=0x5610073363d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:32:08.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.107+0000 7f466fbf2b80 1 -- 172.21.15.8:0/2888150928 shutdown_connections 2023-08-11T12:32:08.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.108+0000 7f466fbf2b80 1 -- 172.21.15.8:0/2888150928 wait complete. 2023-08-11T12:32:08.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.108+0000 7f466fbf2b80 1 -- start start 2023-08-11T12:32:08.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.108+0000 7f466fbf2b80 1 Processor -- start 2023-08-11T12:32:08.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.109+0000 7f466fbf2b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56100733be20 0x561007347b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:08.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.109+0000 7f466fbf2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561007341310 0x561007344e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:08.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.109+0000 7f466fbf2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561007341c30 0x561007345580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:08.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.109+0000 7f466fbf2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56100722bac0 con 0x561007341310 2023-08-11T12:32:08.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.109+0000 7f466fbf2b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56100722b7c0 con 0x56100733be20 2023-08-11T12:32:08.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.109+0000 7f466fbf2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56100710f920 con 0x561007341c30 2023-08-11T12:32:08.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.109+0000 7f466fbf2b80 10 client.0 _ll_register_callbacks cb 0x56100722eab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:32:08.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.109+0000 7f4659f9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56100733be20 0x561007347b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:08.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.109+0000 7f4659f9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56100733be20 0x561007347b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:45778/0 (socket says 172.21.15.8:45778) 2023-08-11T12:32:08.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.110+0000 7f4659f9b700 1 -- 172.21.15.8:0/3235883749 learned_addr learned my addr 172.21.15.8:0/3235883749 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:32:08.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.110+0000 7f465979a700 1 --2- 172.21.15.8:0/3235883749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561007341310 0x561007344e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:08.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.110+0000 7f465a79c700 1 --2- 172.21.15.8:0/3235883749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561007341c30 0x561007345580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:08.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.110+0000 7f4659f9b700 1 -- 172.21.15.8:0/3235883749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561007341c30 msgr2=0x561007345580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:32:08.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.110+0000 7f4659f9b700 1 --2- 172.21.15.8:0/3235883749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561007341c30 0x561007345580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.110+0000 7f4659f9b700 1 -- 172.21.15.8:0/3235883749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561007341310 msgr2=0x561007344e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:32:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.110+0000 7f4659f9b700 1 --2- 172.21.15.8:0/3235883749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561007341310 0x561007344e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.110+0000 7f4659f9b700 1 -- 172.21.15.8:0/3235883749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46541a57d0 con 0x56100733be20 2023-08-11T12:32:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.110+0000 7f4659f9b700 1 --2- 172.21.15.8:0/3235883749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56100733be20 0x561007347b90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f46500037d0 tx=0x7f4650003830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73cbe4064ea0fc67 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:32:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.110+0000 7f463d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:32:08.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.110+0000 7f463d7fa700 1 -- 172.21.15.8:0/3235883749 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4650065120 con 0x56100733be20 2023-08-11T12:32:08.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.110+0000 7f466fbf2b80 1 -- 172.21.15.8:0/3235883749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56100732ea90 con 0x56100733be20 2023-08-11T12:32:08.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.110+0000 7f463d7fa700 1 -- 172.21.15.8:0/3235883749 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9454+0+0 (secure 0 0 0) 0x7f4650099150 con 0x56100733be20 2023-08-11T12:32:08.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.111+0000 7f463d7fa700 1 -- 172.21.15.8:0/3235883749 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f465000cc90 con 0x56100733be20 2023-08-11T12:32:08.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.111+0000 7f466fbf2b80 10 client.26375 fetch_fsmap learned FSMap version 54 2023-08-11T12:32:08.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.111+0000 7f466fbf2b80 1 -- 172.21.15.8:0/3235883749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x5610070b9de0 con 0x56100733be20 2023-08-11T12:32:08.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.111+0000 7f463d7fa700 1 -- 172.21.15.8:0/3235883749 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56100732ea90 con 0x56100733be20 2023-08-11T12:32:08.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.111+0000 7f463d7fa700 1 -- 172.21.15.8:0/3235883749 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4650098640 con 0x56100733be20 2023-08-11T12:32:08.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.111+0000 7f466fbf2b80 10 client.26375 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:32:08.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.111+0000 7f466fbf2b80 10 client.26375 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:32:08.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.111+0000 7f466fbf2b80 20 client.26375 populate_metadata read hostname 'smithi008' 2023-08-11T12:32:08.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.111+0000 7f466fbf2b80 1 --2- 172.21.15.8:0/3235883749 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x561007354f70 0x561007357360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:08.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.111+0000 7f466fbf2b80 4 client.26375 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:32:08.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.111+0000 7f466fbf2b80 1 -- 172.21.15.8:0/3235883749 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56100730a4e0 con 0x561007354f70 2023-08-11T12:32:08.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.112+0000 7f465979a700 1 --2- 172.21.15.8:0/3235883749 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x561007354f70 0x561007357360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.112+0000 7f465979a700 1 --2- 172.21.15.8:0/3235883749 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x561007354f70 0x561007357360 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba7fb36cc1bd7100 server_cookie=448752f70e93ad4a in_seq=0 out_seq=0 2023-08-11T12:32:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.112+0000 7f463d7fa700 10 client.26375 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:32:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.113+0000 7f463d7fa700 1 -- 172.21.15.8:0/3235883749 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x56100730a4e0 con 0x561007354f70 2023-08-11T12:32:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.113+0000 7f463d7fa700 10 client.26375 handle_command_reply: tid=0 2023-08-11T12:32:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.113+0000 7f466fbf2b80 1 client.26375 shutdown 2023-08-11T12:32:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.113+0000 7f466fbf2b80 1 -- 172.21.15.8:0/3235883749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56100733be20 msgr2=0x561007347b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:32:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.113+0000 7f466fbf2b80 1 --2- 172.21.15.8:0/3235883749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56100733be20 0x561007347b90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f46500037d0 tx=0x7f4650003830 comp rx=0 tx=0).stop 2023-08-11T12:32:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.113+0000 7f466fbf2b80 1 -- 172.21.15.8:0/3235883749 shutdown_connections 2023-08-11T12:32:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.113+0000 7f466fbf2b80 1 --2- 172.21.15.8:0/3235883749 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x561007354f70 0x561007357360 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.113+0000 7f466fbf2b80 1 --2- 172.21.15.8:0/3235883749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561007341c30 0x561007345580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.113+0000 7f466fbf2b80 1 --2- 172.21.15.8:0/3235883749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56100733be20 0x561007347b90 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.113+0000 7f466fbf2b80 1 --2- 172.21.15.8:0/3235883749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561007341310 0x561007344e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.113+0000 7f463d7fa700 0 client.26375 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:32:08.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.113+0000 7f466fbf2b80 1 -- 172.21.15.8:0/3235883749 >> 172.21.15.8:0/3235883749 conn(0x561007268950 msgr2=0x561007330cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:32:08.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.113+0000 7f466fbf2b80 1 -- 172.21.15.8:0/3235883749 shutdown_connections 2023-08-11T12:32:08.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.113+0000 7f466fbf2b80 1 -- 172.21.15.8:0/3235883749 wait complete. 2023-08-11T12:32:08.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.114+0000 7f466fbf2b80 20 client.26375 trim_cache size 0 max 16384 2023-08-11T12:32:08.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.131+0000 7f466fbf2b80 1 Processor -- start 2023-08-11T12:32:08.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.131+0000 7f466fbf2b80 1 -- start start 2023-08-11T12:32:08.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.131+0000 7f466fbf2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56100733be20 0x56100733b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:08.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.131+0000 7f466fbf2b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561007341310 0x561007347650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:08.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.131+0000 7f466fbf2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561007341c30 0x561007347b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:08.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.131+0000 7f466fbf2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561007340fb0 con 0x56100733be20 2023-08-11T12:32:08.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.131+0000 7f466fbf2b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56100735c040 con 0x561007341310 2023-08-11T12:32:08.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.131+0000 7f466fbf2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561007345b80 con 0x561007341c30 2023-08-11T12:32:08.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.131+0000 7f4659f9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56100733be20 0x56100733b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:08.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.131+0000 7f465979a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561007341310 0x561007347650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:08.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.131+0000 7f4659f9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56100733be20 0x56100733b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52858/0 (socket says 172.21.15.8:52858) 2023-08-11T12:32:08.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.131+0000 7f4659f9b700 1 -- 172.21.15.8:0/3134423709 learned_addr learned my addr 172.21.15.8:0/3134423709 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:32:08.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.132+0000 7f465a79c700 1 --2- 172.21.15.8:0/3134423709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561007341c30 0x561007347b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:08.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.132+0000 7f465979a700 1 -- 172.21.15.8:0/3134423709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561007341c30 msgr2=0x561007347b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:32:08.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.132+0000 7f465979a700 1 --2- 172.21.15.8:0/3134423709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561007341c30 0x561007347b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.132+0000 7f465979a700 1 -- 172.21.15.8:0/3134423709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56100733be20 msgr2=0x56100733b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:32:08.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.132+0000 7f465979a700 1 --2- 172.21.15.8:0/3134423709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56100733be20 0x56100733b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.132+0000 7f465979a700 1 -- 172.21.15.8:0/3134423709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56100733c4d0 con 0x561007341310 2023-08-11T12:32:08.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.132+0000 7f4659f9b700 1 --2- 172.21.15.8:0/3134423709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56100733be20 0x56100733b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:32:08.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.132+0000 7f465979a700 1 --2- 172.21.15.8:0/3134423709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561007341310 0x561007347650 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f46440059d0 tx=0x7f4644005960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80b386b091d39014 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:32:08.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.132+0000 7f4648ff9700 1 -- 172.21.15.8:0/3134423709 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464401d040 con 0x561007341310 2023-08-11T12:32:08.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.132+0000 7f4648ff9700 1 -- 172.21.15.8:0/3134423709 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f464401e040 con 0x561007341310 2023-08-11T12:32:08.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.132+0000 7f4648ff9700 1 -- 172.21.15.8:0/3134423709 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46440052a0 con 0x561007341310 2023-08-11T12:32:08.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.133+0000 7f466fbf2b80 1 -- 172.21.15.8:0/3134423709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561007341310 msgr2=0x561007347650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:32:08.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.133+0000 7f466fbf2b80 1 --2- 172.21.15.8:0/3134423709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561007341310 0x561007347650 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f46440059d0 tx=0x7f4644005960 comp rx=0 tx=0).stop 2023-08-11T12:32:08.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.133+0000 7f466fbf2b80 1 -- 172.21.15.8:0/3134423709 shutdown_connections 2023-08-11T12:32:08.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.133+0000 7f466fbf2b80 1 --2- 172.21.15.8:0/3134423709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561007341c30 0x561007347b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.133+0000 7f466fbf2b80 1 --2- 172.21.15.8:0/3134423709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56100733be20 0x56100733b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.133+0000 7f466fbf2b80 1 --2- 172.21.15.8:0/3134423709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561007341310 0x561007347650 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.133+0000 7f466fbf2b80 1 -- 172.21.15.8:0/3134423709 >> 172.21.15.8:0/3134423709 conn(0x561007268950 msgr2=0x5610073517a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:32:08.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.133+0000 7f466fbf2b80 1 -- 172.21.15.8:0/3134423709 shutdown_connections 2023-08-11T12:32:08.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.133+0000 7f466fbf2b80 1 -- 172.21.15.8:0/3134423709 wait complete. 2023-08-11T12:32:08.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.133+0000 7f466fbf2b80 1 -- start start 2023-08-11T12:32:08.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.134+0000 7f466fbf2b80 1 Processor -- start 2023-08-11T12:32:08.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.134+0000 7f466fbf2b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56100733be20 0x56100734c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:08.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.134+0000 7f466fbf2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561007341310 0x56100734a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:08.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.134+0000 7f466fbf2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561007341c30 0x56100734acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:08.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.134+0000 7f466fbf2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56100734b3c0 con 0x561007341310 2023-08-11T12:32:08.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.134+0000 7f466fbf2b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56100734b530 con 0x56100733be20 2023-08-11T12:32:08.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.134+0000 7f466fbf2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610073a8ae0 con 0x561007341c30 2023-08-11T12:32:08.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.134+0000 7f466fbf2b80 10 client.0 _ll_register_callbacks cb 0x7f464c009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:32:08.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.134+0000 7f465979a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561007341310 0x56100734a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:08.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.134+0000 7f4659f9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56100733be20 0x56100734c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:08.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.134+0000 7f4659f9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56100733be20 0x56100734c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:45800/0 (socket says 172.21.15.8:45800) 2023-08-11T12:32:08.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.134+0000 7f4659f9b700 1 -- 172.21.15.8:0/430820097 learned_addr learned my addr 172.21.15.8:0/430820097 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:32:08.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.134+0000 7f465a79c700 1 --2- 172.21.15.8:0/430820097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561007341c30 0x56100734acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:08.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.135+0000 7f4659f9b700 1 -- 172.21.15.8:0/430820097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561007341c30 msgr2=0x56100734acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:32:08.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.135+0000 7f4659f9b700 1 --2- 172.21.15.8:0/430820097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561007341c30 0x56100734acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.135+0000 7f4659f9b700 1 -- 172.21.15.8:0/430820097 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561007341310 msgr2=0x56100734a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:32:08.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.135+0000 7f4659f9b700 1 --2- 172.21.15.8:0/430820097 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561007341310 0x56100734a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.135+0000 7f4659f9b700 1 -- 172.21.15.8:0/430820097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46541a57d0 con 0x56100733be20 2023-08-11T12:32:08.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.135+0000 7f465979a700 1 --2- 172.21.15.8:0/430820097 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561007341310 0x56100734a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:32:08.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.135+0000 7f4659f9b700 1 --2- 172.21.15.8:0/430820097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56100733be20 0x56100734c480 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4650095bc0 tx=0x7f4650004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1027b5df7d8c4354 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:32:08.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.135+0000 7f463d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:32:08.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.135+0000 7f463d7fa700 1 -- 172.21.15.8:0/430820097 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46500995b0 con 0x56100733be20 2023-08-11T12:32:08.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.135+0000 7f466fbf2b80 1 -- 172.21.15.8:0/430820097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f46500b8040 con 0x56100733be20 2023-08-11T12:32:08.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.135+0000 7f463d7fa700 1 -- 172.21.15.8:0/430820097 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9454+0+0 (secure 0 0 0) 0x7f465000cc90 con 0x56100733be20 2023-08-11T12:32:08.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.135+0000 7f463d7fa700 1 -- 172.21.15.8:0/430820097 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4650003680 con 0x56100733be20 2023-08-11T12:32:08.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.136+0000 7f466fbf2b80 10 client.26381 fetch_fsmap learned FSMap version 54 2023-08-11T12:32:08.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.136+0000 7f466fbf2b80 1 -- 172.21.15.8:0/430820097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x7f465410e130 con 0x56100733be20 2023-08-11T12:32:08.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.136+0000 7f463d7fa700 1 -- 172.21.15.8:0/430820097 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46500b8040 con 0x56100733be20 2023-08-11T12:32:08.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.136+0000 7f463d7fa700 1 -- 172.21.15.8:0/430820097 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f46500980b0 con 0x56100733be20 2023-08-11T12:32:08.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.136+0000 7f466fbf2b80 10 client.26381 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:32:08.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.136+0000 7f466fbf2b80 10 client.26381 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:32:08.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.136+0000 7f466fbf2b80 20 client.26381 populate_metadata read hostname 'smithi008' 2023-08-11T12:32:08.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.136+0000 7f466fbf2b80 1 --2- 172.21.15.8:0/430820097 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5610073a9c40 0x5610073ac030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:08.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.136+0000 7f466fbf2b80 4 client.26381 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:32:08.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.136+0000 7f466fbf2b80 1 -- 172.21.15.8:0/430820097 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561007286820 con 0x5610073a9c40 2023-08-11T12:32:08.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.136+0000 7f465979a700 1 --2- 172.21.15.8:0/430820097 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5610073a9c40 0x5610073ac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:08.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.137+0000 7f465979a700 1 --2- 172.21.15.8:0/430820097 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5610073a9c40 0x5610073ac030 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=615cae79921447bc server_cookie=a63b75497a373b73 in_seq=0 out_seq=0 2023-08-11T12:32:08.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.137+0000 7f463d7fa700 10 client.26381 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:32:08.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.137+0000 7f463d7fa700 1 -- 172.21.15.8:0/430820097 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x561007286820 con 0x5610073a9c40 2023-08-11T12:32:08.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.137+0000 7f463d7fa700 10 client.26381 handle_command_reply: tid=0 2023-08-11T12:32:08.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.137+0000 7f466fbf2b80 1 client.26381 shutdown 2023-08-11T12:32:08.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.137+0000 7f466fbf2b80 1 -- 172.21.15.8:0/430820097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56100733be20 msgr2=0x56100734c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:32:08.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.137+0000 7f466fbf2b80 1 --2- 172.21.15.8:0/430820097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56100733be20 0x56100734c480 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4650095bc0 tx=0x7f4650004750 comp rx=0 tx=0).stop 2023-08-11T12:32:08.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.137+0000 7f466fbf2b80 1 -- 172.21.15.8:0/430820097 shutdown_connections 2023-08-11T12:32:08.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.137+0000 7f466fbf2b80 1 --2- 172.21.15.8:0/430820097 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5610073a9c40 0x5610073ac030 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.137+0000 7f466fbf2b80 1 --2- 172.21.15.8:0/430820097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561007341c30 0x56100734acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.137+0000 7f466fbf2b80 1 --2- 172.21.15.8:0/430820097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56100733be20 0x56100734c480 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.137+0000 7f466fbf2b80 1 --2- 172.21.15.8:0/430820097 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561007341310 0x56100734a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.137+0000 7f466fbf2b80 1 -- 172.21.15.8:0/430820097 >> 172.21.15.8:0/430820097 conn(0x561007268950 msgr2=0x561007330420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:32:08.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.137+0000 7f463d7fa700 0 client.26381 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:32:08.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.137+0000 7f466fbf2b80 1 -- 172.21.15.8:0/430820097 shutdown_connections 2023-08-11T12:32:08.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.137+0000 7f466fbf2b80 1 -- 172.21.15.8:0/430820097 wait complete. 2023-08-11T12:32:08.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.137+0000 7f466fbf2b80 20 client.26381 trim_cache size 0 max 16384 2023-08-11T12:32:08.163 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:32:08.163 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:32:08.163 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:32:08.163 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:32:08.163 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:32:08.164 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:32:08.164 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:32:08.164 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:32:08.164 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:32:08.164 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:32:08.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.138+0000 7f465c1ff700 1 -- 172.21.15.8:0/1730283362 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f46400a00c0 msgr2=0x7f46400a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:32:08.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.138+0000 7f465c1ff700 1 --2- 172.21.15.8:0/1730283362 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f46400a00c0 0x7f46400a2580 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f465419f6c0 tx=0x7f464c00b040 comp rx=0 tx=0).stop 2023-08-11T12:32:08.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.138+0000 7f465c1ff700 1 -- 172.21.15.8:0/1730283362 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4654100960 msgr2=0x7f465419e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:32:08.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.138+0000 7f465c1ff700 1 --2- 172.21.15.8:0/1730283362 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4654100960 0x7f465419e9c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f465000eb30 tx=0x7f465000ee40 comp rx=0 tx=0).stop 2023-08-11T12:32:08.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.138+0000 7f465c1ff700 1 -- 172.21.15.8:0/1730283362 shutdown_connections 2023-08-11T12:32:08.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.138+0000 7f465c1ff700 1 --2- 172.21.15.8:0/1730283362 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f46400a00c0 0x7f46400a2580 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.138+0000 7f465c1ff700 1 --2- 172.21.15.8:0/1730283362 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4654106970 0x7f4654198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.138+0000 7f465c1ff700 1 --2- 172.21.15.8:0/1730283362 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4654100960 0x7f465419e9c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.138+0000 7f465c1ff700 1 --2- 172.21.15.8:0/1730283362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4654101320 0x7f465419ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:08.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.138+0000 7f465c1ff700 1 -- 172.21.15.8:0/1730283362 >> 172.21.15.8:0/1730283362 conn(0x7f46540fc490 msgr2=0x7f465410be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:32:08.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.138+0000 7f465c1ff700 1 -- 172.21.15.8:0/1730283362 shutdown_connections 2023-08-11T12:32:08.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:08.138+0000 7f465c1ff700 1 -- 172.21.15.8:0/1730283362 wait complete. 2023-08-11T12:32:08.168 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:32:09.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:08 smithi008 ceph-mon[97158]: osdmap e93: 12 total, 12 up, 12 in 2023-08-11T12:32:09.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:08 smithi008 ceph-mon[97158]: pgmap v232: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:32:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:08 smithi194 ceph-mon[130905]: osdmap e93: 12 total, 12 up, 12 in 2023-08-11T12:32:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:08 smithi194 ceph-mon[130905]: pgmap v232: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:32:09.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:08 smithi045 ceph-mon[130284]: osdmap e93: 12 total, 12 up, 12 in 2023-08-11T12:32:09.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:08 smithi045 ceph-mon[130284]: pgmap v232: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:32:11.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:10 smithi194 ceph-mon[130905]: pgmap v233: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:32:11.148 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:10 smithi045 ceph-mon[130284]: pgmap v233: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:32:11.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:10 smithi008 ceph-mon[97158]: pgmap v233: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:32:13.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:12 smithi008 ceph-mon[97158]: pgmap v234: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:32:13.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:12 smithi194 ceph-mon[130905]: pgmap v234: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:32:13.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:12 smithi045 ceph-mon[130284]: pgmap v234: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:32:14.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:14 smithi008 ceph-mon[97158]: pgmap v235: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:32:14.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:14 smithi194 ceph-mon[130905]: pgmap v235: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:32:14.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:14 smithi045 ceph-mon[130284]: pgmap v235: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:32:16.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:15 smithi194 ceph-mon[130905]: osdmap e94: 12 total, 12 up, 12 in 2023-08-11T12:32:16.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:15 smithi045 ceph-mon[130284]: osdmap e94: 12 total, 12 up, 12 in 2023-08-11T12:32:16.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:15 smithi008 ceph-mon[97158]: osdmap e94: 12 total, 12 up, 12 in 2023-08-11T12:32:17.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:16 smithi194 ceph-mon[130905]: pgmap v237: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 125 B/s wr, 6 op/s 2023-08-11T12:32:17.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:16 smithi045 ceph-mon[130284]: pgmap v237: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 125 B/s wr, 6 op/s 2023-08-11T12:32:17.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:16 smithi008 ceph-mon[97158]: pgmap v237: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 125 B/s wr, 6 op/s 2023-08-11T12:32:19.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:18 smithi008 ceph-mon[97158]: pgmap v238: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:32:19.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:18 smithi194 ceph-mon[130905]: pgmap v238: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:32:19.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:18 smithi045 ceph-mon[130284]: pgmap v238: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:32:21.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:20 smithi194 ceph-mon[130905]: pgmap v239: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:32:21.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:20 smithi045 ceph-mon[130284]: pgmap v239: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:32:21.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:20 smithi008 ceph-mon[97158]: pgmap v239: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:32:23.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:22 smithi008 ceph-mon[97158]: pgmap v240: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:32:23.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:22 smithi194 ceph-mon[130905]: pgmap v240: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:32:23.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:22 smithi045 ceph-mon[130284]: pgmap v240: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:32:24.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:23 smithi008 ceph-mon[97158]: pgmap v241: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:32:24.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:23 smithi194 ceph-mon[130905]: pgmap v241: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:32:24.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:23 smithi045 ceph-mon[130284]: pgmap v241: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:32:27.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:26 smithi008 ceph-mon[97158]: pgmap v242: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:32:27.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:26 smithi194 ceph-mon[130905]: pgmap v242: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:32:27.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:26 smithi045 ceph-mon[130284]: pgmap v242: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:32:28.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:27 smithi008 ceph-mon[97158]: pgmap v243: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:32:28.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:27 smithi194 ceph-mon[130905]: pgmap v243: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:32:28.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:27 smithi045 ceph-mon[130284]: pgmap v243: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:32:31.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:30 smithi194 ceph-mon[130905]: pgmap v244: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:32:31.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:30 smithi045 ceph-mon[130284]: pgmap v244: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:32:31.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:30 smithi008 ceph-mon[97158]: pgmap v244: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:32:32.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:32 smithi008 ceph-mon[97158]: pgmap v245: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:32:32.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:32 smithi194 ceph-mon[130905]: pgmap v245: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:32:32.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:32 smithi045 ceph-mon[130284]: pgmap v245: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:32:34.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:34 smithi008 ceph-mon[97158]: pgmap v246: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:32:34.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:34 smithi194 ceph-mon[130905]: pgmap v246: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:32:34.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:34 smithi045 ceph-mon[130284]: pgmap v246: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:32:36.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:36 smithi008 ceph-mon[97158]: pgmap v247: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:32:36.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:36 smithi194 ceph-mon[130905]: pgmap v247: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:32:36.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:36 smithi045 ceph-mon[130284]: pgmap v247: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:32:38.169 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:32:38.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:38 smithi008 ceph-mon[97158]: pgmap v248: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:32:38.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.388+0000 7fad699ff700 1 -- 172.21.15.8:0/3654823126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad64106970 msgr2=0x7fad64106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:32:38.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.388+0000 7fad699ff700 1 --2- 172.21.15.8:0/3654823126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad64106970 0x7fad64106d50 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fad54009990 tx=0x7fad54009ca0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.388+0000 7fad699ff700 1 -- 172.21.15.8:0/3654823126 shutdown_connections 2023-08-11T12:32:38.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.388+0000 7fad699ff700 1 --2- 172.21.15.8:0/3654823126 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad64101320 0x7fad6410d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.388+0000 7fad699ff700 1 --2- 172.21.15.8:0/3654823126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad64106970 0x7fad64106d50 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.388+0000 7fad699ff700 1 --2- 172.21.15.8:0/3654823126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad64100960 0x7fad64100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.388+0000 7fad699ff700 1 -- 172.21.15.8:0/3654823126 >> 172.21.15.8:0/3654823126 conn(0x7fad640fc490 msgr2=0x7fad640fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:32:38.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.388+0000 7fad699ff700 1 -- 172.21.15.8:0/3654823126 shutdown_connections 2023-08-11T12:32:38.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.389+0000 7fad699ff700 1 -- 172.21.15.8:0/3654823126 wait complete. 2023-08-11T12:32:38.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:38 smithi194 ceph-mon[130905]: pgmap v248: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:32:38.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.389+0000 7fad699ff700 1 Processor -- start 2023-08-11T12:32:38.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.390+0000 7fad699ff700 1 -- start start 2023-08-11T12:32:38.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.390+0000 7fad699ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad64100960 0x7fad64072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:38.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.390+0000 7fad699ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad64101320 0x7fad64073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:38.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.390+0000 7fad699ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad64106970 0x7fad641a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:38.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.390+0000 7fad699ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad64073990 con 0x7fad64100960 2023-08-11T12:32:38.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.390+0000 7fad699ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad641a5160 con 0x7fad64101320 2023-08-11T12:32:38.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.390+0000 7fad699ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad641a52a0 con 0x7fad64106970 2023-08-11T12:32:38.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.390+0000 7fad62ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad64100960 0x7fad64072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:38.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.390+0000 7fad627fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad64101320 0x7fad64073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:38.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.390+0000 7fad62ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad64100960 0x7fad64072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40878/0 (socket says 172.21.15.8:40878) 2023-08-11T12:32:38.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.390+0000 7fad62ffd700 1 -- 172.21.15.8:0/2905564042 learned_addr learned my addr 172.21.15.8:0/2905564042 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:32:38.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.390+0000 7fad637fe700 1 --2- 172.21.15.8:0/2905564042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad64106970 0x7fad641a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:38.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.391+0000 7fad62ffd700 1 -- 172.21.15.8:0/2905564042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad64106970 msgr2=0x7fad641a4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:32:38.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.391+0000 7fad62ffd700 1 --2- 172.21.15.8:0/2905564042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad64106970 0x7fad641a4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.391+0000 7fad62ffd700 1 -- 172.21.15.8:0/2905564042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad64101320 msgr2=0x7fad64073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:32:38.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.391+0000 7fad62ffd700 1 --2- 172.21.15.8:0/2905564042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad64101320 0x7fad64073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.391+0000 7fad62ffd700 1 -- 172.21.15.8:0/2905564042 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad540095f0 con 0x7fad64100960 2023-08-11T12:32:38.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.391+0000 7fad627fc700 1 --2- 172.21.15.8:0/2905564042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad64101320 0x7fad64073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:32:38.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.391+0000 7fad62ffd700 1 --2- 172.21.15.8:0/2905564042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad64100960 0x7fad64072c20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fad54005910 tx=0x7fad54005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:32:38.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.391+0000 7fad689fd700 1 -- 172.21.15.8:0/2905564042 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5401d070 con 0x7fad64100960 2023-08-11T12:32:38.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.391+0000 7fad689fd700 1 -- 172.21.15.8:0/2905564042 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad54022470 con 0x7fad64100960 2023-08-11T12:32:38.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.391+0000 7fad699ff700 1 -- 172.21.15.8:0/2905564042 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad641a54a0 con 0x7fad64100960 2023-08-11T12:32:38.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.391+0000 7fad689fd700 1 -- 172.21.15.8:0/2905564042 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54017650 con 0x7fad64100960 2023-08-11T12:32:38.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.392+0000 7fad699ff700 1 -- 172.21.15.8:0/2905564042 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad641a59d0 con 0x7fad64100960 2023-08-11T12:32:38.401 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:38 smithi045 ceph-mon[130284]: pgmap v248: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:32:38.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.395+0000 7fad689fd700 1 -- 172.21.15.8:0/2905564042 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7fad5400fad0 con 0x7fad64100960 2023-08-11T12:32:38.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.396+0000 7fad7d371b80 1 Processor -- start 2023-08-11T12:32:38.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.396+0000 7fad689fd700 1 --2- 172.21.15.8:0/2905564042 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fad4c0a0140 0x7fad4c0a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:38.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.396+0000 7fad7d371b80 1 -- start start 2023-08-11T12:32:38.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.396+0000 7fad689fd700 1 -- 172.21.15.8:0/2905564042 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9366+0+0 (secure 0 0 0) 0x7fad540cce30 con 0x7fad64100960 2023-08-11T12:32:38.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.396+0000 7fad637fe700 1 --2- 172.21.15.8:0/2905564042 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fad4c0a0140 0x7fad4c0a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:38.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.397+0000 7fad7d371b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdad24d310 0x55cdad24d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:38.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.397+0000 7fad7d371b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cdad24dc30 0x55cdad2478e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:38.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.397+0000 7fad7d371b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdad247e20 0x55cdad248260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:38.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.397+0000 7fad7d371b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdad1a0630 con 0x55cdad24d310 2023-08-11T12:32:38.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.397+0000 7fad7d371b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdad19df50 con 0x55cdad247e20 2023-08-11T12:32:38.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.397+0000 7fad7d371b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdad199840 con 0x55cdad24dc30 2023-08-11T12:32:38.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.397+0000 7fad62ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdad24d310 0x55cdad24d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:38.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.397+0000 7fad62ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdad24d310 0x55cdad24d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40888/0 (socket says 172.21.15.8:40888) 2023-08-11T12:32:38.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.397+0000 7fad62ffd700 1 -- 172.21.15.8:0/360332286 learned_addr learned my addr 172.21.15.8:0/360332286 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:32:38.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.397+0000 7fad627fc700 1 --2- 172.21.15.8:0/360332286 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cdad24dc30 0x55cdad2478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:38.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.397+0000 7fad637fe700 1 --2- 172.21.15.8:0/360332286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdad247e20 0x55cdad248260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:38.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.397+0000 7fad62ffd700 1 -- 172.21.15.8:0/360332286 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cdad24dc30 msgr2=0x55cdad2478e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:32:38.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.397+0000 7fad62ffd700 1 --2- 172.21.15.8:0/360332286 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cdad24dc30 0x55cdad2478e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.397+0000 7fad62ffd700 1 -- 172.21.15.8:0/360332286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdad247e20 msgr2=0x55cdad248260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:32:38.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.397+0000 7fad62ffd700 1 --2- 172.21.15.8:0/360332286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdad247e20 0x55cdad248260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.397+0000 7fad62ffd700 1 -- 172.21.15.8:0/360332286 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cdad019630 con 0x55cdad24d310 2023-08-11T12:32:38.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.397+0000 7fad637fe700 1 --2- 172.21.15.8:0/360332286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdad247e20 0x55cdad248260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:32:38.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.397+0000 7fad637fe700 1 --2- 172.21.15.8:0/2905564042 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fad4c0a0140 0x7fad4c0a2600 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fad64074d30 tx=0x7fad5c003f90 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:32:38.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.398+0000 7fad62ffd700 1 --2- 172.21.15.8:0/360332286 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdad24d310 0x55cdad24d6f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fad54096c90 tx=0x7fad54099d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8848d009278314f0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:32:38.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.398+0000 7fad49ffb700 1 -- 172.21.15.8:0/360332286 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5409e050 con 0x55cdad24d310 2023-08-11T12:32:38.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.398+0000 7fad49ffb700 1 -- 172.21.15.8:0/360332286 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad540a1fa0 con 0x55cdad24d310 2023-08-11T12:32:38.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.398+0000 7fad49ffb700 1 -- 172.21.15.8:0/360332286 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54022930 con 0x55cdad24d310 2023-08-11T12:32:38.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.398+0000 7fad7d371b80 1 -- 172.21.15.8:0/360332286 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdad24d310 msgr2=0x55cdad24d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:32:38.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.398+0000 7fad7d371b80 1 --2- 172.21.15.8:0/360332286 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdad24d310 0x55cdad24d6f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fad54096c90 tx=0x7fad54099d60 comp rx=0 tx=0).stop 2023-08-11T12:32:38.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.399+0000 7fad7d371b80 1 -- 172.21.15.8:0/360332286 shutdown_connections 2023-08-11T12:32:38.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.399+0000 7fad7d371b80 1 --2- 172.21.15.8:0/360332286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdad247e20 0x55cdad248260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.399+0000 7fad7d371b80 1 --2- 172.21.15.8:0/360332286 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdad24d310 0x55cdad24d6f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.399+0000 7fad7d371b80 1 --2- 172.21.15.8:0/360332286 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cdad24dc30 0x55cdad2478e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.399+0000 7fad7d371b80 1 -- 172.21.15.8:0/360332286 >> 172.21.15.8:0/360332286 conn(0x55cdad174950 msgr2=0x55cdad2423d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:32:38.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.399+0000 7fad7d371b80 1 -- 172.21.15.8:0/360332286 shutdown_connections 2023-08-11T12:32:38.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.399+0000 7fad7d371b80 1 -- 172.21.15.8:0/360332286 wait complete. 2023-08-11T12:32:38.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.399+0000 7fad7d371b80 1 -- start start 2023-08-11T12:32:38.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.399+0000 7fad7d371b80 1 Processor -- start 2023-08-11T12:32:38.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.400+0000 7fad7d371b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cdad247e20 0x55cdad253a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:38.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.400+0000 7fad7d371b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdad24d310 0x55cdad250cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:38.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.400+0000 7fad7d371b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdad24dc30 0x55cdad251200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:38.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.400+0000 7fad7d371b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdad137ac0 con 0x55cdad24d310 2023-08-11T12:32:38.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.400+0000 7fad7d371b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdad1377c0 con 0x55cdad24dc30 2023-08-11T12:32:38.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.400+0000 7fad7d371b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdad01b920 con 0x55cdad247e20 2023-08-11T12:32:38.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.400+0000 7fad7d371b80 10 client.0 _ll_register_callbacks cb 0x55cdad13aab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:32:38.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.400+0000 7fad637fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdad24dc30 0x55cdad251200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:38.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.400+0000 7fad637fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdad24dc30 0x55cdad251200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:37086/0 (socket says 172.21.15.8:37086) 2023-08-11T12:32:38.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.400+0000 7fad637fe700 1 -- 172.21.15.8:0/3278500854 learned_addr learned my addr 172.21.15.8:0/3278500854 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:32:38.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.400+0000 7fad627fc700 1 --2- 172.21.15.8:0/3278500854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdad24d310 0x55cdad250cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:38.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.400+0000 7fad62ffd700 1 --2- 172.21.15.8:0/3278500854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cdad247e20 0x55cdad253a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:38.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.401+0000 7fad637fe700 1 -- 172.21.15.8:0/3278500854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cdad247e20 msgr2=0x55cdad253a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:32:38.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.401+0000 7fad637fe700 1 --2- 172.21.15.8:0/3278500854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cdad247e20 0x55cdad253a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.401+0000 7fad637fe700 1 -- 172.21.15.8:0/3278500854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdad24d310 msgr2=0x55cdad250cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:32:38.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.401+0000 7fad637fe700 1 --2- 172.21.15.8:0/3278500854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdad24d310 0x55cdad250cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.401+0000 7fad637fe700 1 -- 172.21.15.8:0/3278500854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad641a59d0 con 0x55cdad24dc30 2023-08-11T12:32:38.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.401+0000 7fad637fe700 1 --2- 172.21.15.8:0/3278500854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdad24dc30 0x55cdad251200 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fad5c007ab0 tx=0x7fad5c004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ccdc7ca40bb603 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:32:38.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.401+0000 7fad42ffd700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:32:38.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.401+0000 7fad42ffd700 1 -- 172.21.15.8:0/3278500854 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c01f070 con 0x55cdad24dc30 2023-08-11T12:32:38.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.401+0000 7fad7d371b80 1 -- 172.21.15.8:0/3278500854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cdad23aa90 con 0x55cdad24dc30 2023-08-11T12:32:38.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.401+0000 7fad42ffd700 1 -- 172.21.15.8:0/3278500854 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9366+0+0 (secure 0 0 0) 0x7fad5c004890 con 0x55cdad24dc30 2023-08-11T12:32:38.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.402+0000 7fad42ffd700 1 -- 172.21.15.8:0/3278500854 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad5c017880 con 0x55cdad24dc30 2023-08-11T12:32:38.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.402+0000 7fad7d371b80 10 client.26390 fetch_fsmap learned FSMap version 54 2023-08-11T12:32:38.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.402+0000 7fad7d371b80 1 -- 172.21.15.8:0/3278500854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x55cdacfc5de0 con 0x55cdad24dc30 2023-08-11T12:32:38.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.402+0000 7fad42ffd700 1 -- 172.21.15.8:0/3278500854 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cdad23aa90 con 0x55cdad24dc30 2023-08-11T12:32:38.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.402+0000 7fad42ffd700 1 -- 172.21.15.8:0/3278500854 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fad5c023b30 con 0x55cdad24dc30 2023-08-11T12:32:38.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.402+0000 7fad7d371b80 10 client.26390 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:32:38.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.402+0000 7fad7d371b80 10 client.26390 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:32:38.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.402+0000 7fad7d371b80 20 client.26390 populate_metadata read hostname 'smithi008' 2023-08-11T12:32:38.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.402+0000 7fad7d371b80 1 --2- 172.21.15.8:0/3278500854 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55cdad261160 0x55cdad263580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:38.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.402+0000 7fad7d371b80 4 client.26390 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:32:38.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.402+0000 7fad7d371b80 1 -- 172.21.15.8:0/3278500854 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cdad2164e0 con 0x55cdad261160 2023-08-11T12:32:38.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.402+0000 7fad62ffd700 1 --2- 172.21.15.8:0/3278500854 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55cdad261160 0x55cdad263580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:38.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.403+0000 7fad62ffd700 1 --2- 172.21.15.8:0/3278500854 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55cdad261160 0x55cdad263580 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d62f689aac3ef9ff server_cookie=8d719f3d07569b43 in_seq=0 out_seq=0 2023-08-11T12:32:38.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.403+0000 7fad42ffd700 10 client.26390 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:32:38.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.404+0000 7fad42ffd700 1 -- 172.21.15.8:0/3278500854 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55cdad2164e0 con 0x55cdad261160 2023-08-11T12:32:38.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.404+0000 7fad42ffd700 10 client.26390 handle_command_reply: tid=0 2023-08-11T12:32:38.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.404+0000 7fad7d371b80 1 client.26390 shutdown 2023-08-11T12:32:38.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.404+0000 7fad7d371b80 1 -- 172.21.15.8:0/3278500854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdad24dc30 msgr2=0x55cdad251200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:32:38.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.404+0000 7fad7d371b80 1 --2- 172.21.15.8:0/3278500854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdad24dc30 0x55cdad251200 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fad5c007ab0 tx=0x7fad5c004b40 comp rx=0 tx=0).stop 2023-08-11T12:32:38.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.404+0000 7fad7d371b80 1 -- 172.21.15.8:0/3278500854 shutdown_connections 2023-08-11T12:32:38.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.404+0000 7fad7d371b80 1 --2- 172.21.15.8:0/3278500854 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55cdad261160 0x55cdad263580 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.404+0000 7fad7d371b80 1 --2- 172.21.15.8:0/3278500854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cdad247e20 0x55cdad253a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.404+0000 7fad7d371b80 1 --2- 172.21.15.8:0/3278500854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdad24dc30 0x55cdad251200 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.404+0000 7fad7d371b80 1 --2- 172.21.15.8:0/3278500854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdad24d310 0x55cdad250cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.404+0000 7fad42ffd700 0 client.26390 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:32:38.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.404+0000 7fad7d371b80 1 -- 172.21.15.8:0/3278500854 >> 172.21.15.8:0/3278500854 conn(0x55cdad174950 msgr2=0x55cdad23ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:32:38.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.404+0000 7fad7d371b80 1 -- 172.21.15.8:0/3278500854 shutdown_connections 2023-08-11T12:32:38.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.404+0000 7fad7d371b80 1 -- 172.21.15.8:0/3278500854 wait complete. 2023-08-11T12:32:38.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.404+0000 7fad7d371b80 20 client.26390 trim_cache size 0 max 16384 2023-08-11T12:32:38.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.422+0000 7fad7d371b80 1 Processor -- start 2023-08-11T12:32:38.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.422+0000 7fad7d371b80 1 -- start start 2023-08-11T12:32:38.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.422+0000 7fad7d371b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdad247e20 0x55cdad258330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:38.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.422+0000 7fad7d371b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cdad24d310 0x55cdad2534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:38.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.422+0000 7fad7d371b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdad24dc30 0x55cdad253a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:38.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.422+0000 7fad7d371b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdad2478e0 con 0x55cdad24dc30 2023-08-11T12:32:38.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.422+0000 7fad7d371b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdad243ef0 con 0x55cdad247e20 2023-08-11T12:32:38.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.422+0000 7fad7d371b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdad23ede0 con 0x55cdad24d310 2023-08-11T12:32:38.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.422+0000 7fad62ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdad247e20 0x55cdad258330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:38.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.422+0000 7fad637fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdad24dc30 0x55cdad253a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:38.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.422+0000 7fad62ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdad247e20 0x55cdad258330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:37102/0 (socket says 172.21.15.8:37102) 2023-08-11T12:32:38.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.422+0000 7fad62ffd700 1 -- 172.21.15.8:0/3943951709 learned_addr learned my addr 172.21.15.8:0/3943951709 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:32:38.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.422+0000 7fad627fc700 1 --2- 172.21.15.8:0/3943951709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cdad24d310 0x55cdad2534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:38.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.423+0000 7fad62ffd700 1 -- 172.21.15.8:0/3943951709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cdad24d310 msgr2=0x55cdad2534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:32:38.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.423+0000 7fad62ffd700 1 --2- 172.21.15.8:0/3943951709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cdad24d310 0x55cdad2534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.423+0000 7fad62ffd700 1 -- 172.21.15.8:0/3943951709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdad24dc30 msgr2=0x55cdad253a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:32:38.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.423+0000 7fad62ffd700 1 --2- 172.21.15.8:0/3943951709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdad24dc30 0x55cdad253a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.423+0000 7fad62ffd700 1 -- 172.21.15.8:0/3943951709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cdacfaec60 con 0x55cdad247e20 2023-08-11T12:32:38.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.423+0000 7fad627fc700 1 --2- 172.21.15.8:0/3943951709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cdad24d310 0x55cdad2534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:32:38.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.423+0000 7fad637fe700 1 --2- 172.21.15.8:0/3943951709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdad24dc30 0x55cdad253a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:32:38.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.423+0000 7fad62ffd700 1 --2- 172.21.15.8:0/3943951709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdad247e20 0x55cdad258330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fad54098570 tx=0x7fad5401a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96c7d42ed759c8cb server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:32:38.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.423+0000 7fad4a7fc700 1 -- 172.21.15.8:0/3943951709 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad540985c0 con 0x55cdad247e20 2023-08-11T12:32:38.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.423+0000 7fad4a7fc700 1 -- 172.21.15.8:0/3943951709 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad5400fd80 con 0x55cdad247e20 2023-08-11T12:32:38.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.423+0000 7fad4a7fc700 1 -- 172.21.15.8:0/3943951709 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad540b2350 con 0x55cdad247e20 2023-08-11T12:32:38.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.424+0000 7fad7d371b80 1 -- 172.21.15.8:0/3943951709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdad247e20 msgr2=0x55cdad258330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:32:38.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.424+0000 7fad7d371b80 1 --2- 172.21.15.8:0/3943951709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdad247e20 0x55cdad258330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fad54098570 tx=0x7fad5401a040 comp rx=0 tx=0).stop 2023-08-11T12:32:38.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.424+0000 7fad7d371b80 1 -- 172.21.15.8:0/3943951709 shutdown_connections 2023-08-11T12:32:38.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.424+0000 7fad7d371b80 1 --2- 172.21.15.8:0/3943951709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdad24dc30 0x55cdad253a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.424+0000 7fad7d371b80 1 --2- 172.21.15.8:0/3943951709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdad247e20 0x55cdad258330 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.424+0000 7fad7d371b80 1 --2- 172.21.15.8:0/3943951709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cdad24d310 0x55cdad2534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.424+0000 7fad7d371b80 1 -- 172.21.15.8:0/3943951709 >> 172.21.15.8:0/3943951709 conn(0x55cdad174950 msgr2=0x55cdad25d430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:32:38.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.424+0000 7fad7d371b80 1 -- 172.21.15.8:0/3943951709 shutdown_connections 2023-08-11T12:32:38.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.424+0000 7fad7d371b80 1 -- 172.21.15.8:0/3943951709 wait complete. 2023-08-11T12:32:38.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.424+0000 7fad7d371b80 1 -- start start 2023-08-11T12:32:38.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.424+0000 7fad7d371b80 1 Processor -- start 2023-08-11T12:32:38.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.425+0000 7fad7d371b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdad247e20 0x55cdad24a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:38.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.425+0000 7fad7d371b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cdad24d310 0x55cdad248d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:38.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.425+0000 7fad7d371b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdad24dc30 0x55cdad249250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:38.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.425+0000 7fad7d371b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdad249790 con 0x55cdad247e20 2023-08-11T12:32:38.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.425+0000 7fad7d371b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdad249900 con 0x55cdad24dc30 2023-08-11T12:32:38.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.425+0000 7fad7d371b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdad249ac0 con 0x55cdad24d310 2023-08-11T12:32:38.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.425+0000 7fad7d371b80 10 client.0 _ll_register_callbacks cb 0x7fad5c0047e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:32:38.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.425+0000 7fad62ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdad247e20 0x55cdad24a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:38.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.425+0000 7fad637fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdad24dc30 0x55cdad249250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:38.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.425+0000 7fad62ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdad247e20 0x55cdad24a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40920/0 (socket says 172.21.15.8:40920) 2023-08-11T12:32:38.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.425+0000 7fad637fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdad24dc30 0x55cdad249250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:37114/0 (socket says 172.21.15.8:37114) 2023-08-11T12:32:38.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.425+0000 7fad62ffd700 1 -- 172.21.15.8:0/3674155069 learned_addr learned my addr 172.21.15.8:0/3674155069 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:32:38.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.425+0000 7fad627fc700 1 --2- 172.21.15.8:0/3674155069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cdad24d310 0x55cdad248d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:38.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.426+0000 7fad637fe700 1 -- 172.21.15.8:0/3674155069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cdad24d310 msgr2=0x55cdad248d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:32:38.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.426+0000 7fad637fe700 1 --2- 172.21.15.8:0/3674155069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cdad24d310 0x55cdad248d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.426+0000 7fad637fe700 1 -- 172.21.15.8:0/3674155069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdad247e20 msgr2=0x55cdad24a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:32:38.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.426+0000 7fad637fe700 1 --2- 172.21.15.8:0/3674155069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdad247e20 0x55cdad24a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.426+0000 7fad637fe700 1 -- 172.21.15.8:0/3674155069 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cdacfc5de0 con 0x55cdad24dc30 2023-08-11T12:32:38.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.426+0000 7fad62ffd700 1 --2- 172.21.15.8:0/3674155069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdad247e20 0x55cdad24a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:32:38.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.426+0000 7fad637fe700 1 --2- 172.21.15.8:0/3674155069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdad24dc30 0x55cdad249250 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fad5c022000 tx=0x7fad5c004ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed5e0d253ded814f server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:32:38.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.426+0000 7fad42ffd700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:32:38.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.426+0000 7fad42ffd700 1 -- 172.21.15.8:0/3674155069 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c01f040 con 0x55cdad24dc30 2023-08-11T12:32:38.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.426+0000 7fad7d371b80 1 -- 172.21.15.8:0/3674155069 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fad540a1fa0 con 0x55cdad24dc30 2023-08-11T12:32:38.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.426+0000 7fad42ffd700 1 -- 172.21.15.8:0/3674155069 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9366+0+0 (secure 0 0 0) 0x7fad5c018ca0 con 0x55cdad24dc30 2023-08-11T12:32:38.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.426+0000 7fad42ffd700 1 -- 172.21.15.8:0/3674155069 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad5c018e60 con 0x55cdad24dc30 2023-08-11T12:32:38.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.426+0000 7fad7d371b80 10 client.26396 fetch_fsmap learned FSMap version 54 2023-08-11T12:32:38.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.426+0000 7fad7d371b80 1 -- 172.21.15.8:0/3674155069 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x55cdad019630 con 0x55cdad24dc30 2023-08-11T12:32:38.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.427+0000 7fad42ffd700 1 -- 172.21.15.8:0/3674155069 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad540a1fa0 con 0x55cdad24dc30 2023-08-11T12:32:38.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.427+0000 7fad42ffd700 1 -- 172.21.15.8:0/3674155069 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fad5c007ae0 con 0x55cdad24dc30 2023-08-11T12:32:38.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.427+0000 7fad7d371b80 10 client.26396 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:32:38.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.427+0000 7fad7d371b80 10 client.26396 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:32:38.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.427+0000 7fad7d371b80 20 client.26396 populate_metadata read hostname 'smithi008' 2023-08-11T12:32:38.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.427+0000 7fad7d371b80 1 --2- 172.21.15.8:0/3674155069 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55cdad2b6040 0x55cdad2b8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:32:38.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.427+0000 7fad7d371b80 4 client.26396 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:32:38.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.427+0000 7fad7d371b80 1 -- 172.21.15.8:0/3674155069 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55cdad192820 con 0x55cdad2b6040 2023-08-11T12:32:38.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.427+0000 7fad62ffd700 1 --2- 172.21.15.8:0/3674155069 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55cdad2b6040 0x55cdad2b8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:32:38.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.428+0000 7fad42ffd700 10 client.26396 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:32:38.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.428+0000 7fad62ffd700 1 --2- 172.21.15.8:0/3674155069 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55cdad2b6040 0x55cdad2b8460 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=170391f47ab8a76f server_cookie=ae4b028ac3fe5b81 in_seq=0 out_seq=0 2023-08-11T12:32:38.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.428+0000 7fad42ffd700 1 -- 172.21.15.8:0/3674155069 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55cdad192820 con 0x55cdad2b6040 2023-08-11T12:32:38.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.428+0000 7fad42ffd700 10 client.26396 handle_command_reply: tid=0 2023-08-11T12:32:38.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.428+0000 7fad7d371b80 1 client.26396 shutdown 2023-08-11T12:32:38.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.428+0000 7fad7d371b80 1 -- 172.21.15.8:0/3674155069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdad24dc30 msgr2=0x55cdad249250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:32:38.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.428+0000 7fad7d371b80 1 --2- 172.21.15.8:0/3674155069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdad24dc30 0x55cdad249250 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fad5c022000 tx=0x7fad5c004ac0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.428+0000 7fad7d371b80 1 -- 172.21.15.8:0/3674155069 shutdown_connections 2023-08-11T12:32:38.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.428+0000 7fad7d371b80 1 --2- 172.21.15.8:0/3674155069 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55cdad2b6040 0x55cdad2b8460 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.428+0000 7fad7d371b80 1 --2- 172.21.15.8:0/3674155069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdad24dc30 0x55cdad249250 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.428+0000 7fad42ffd700 0 client.26396 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:32:38.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.428+0000 7fad7d371b80 1 --2- 172.21.15.8:0/3674155069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdad247e20 0x55cdad24a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.428+0000 7fad7d371b80 1 --2- 172.21.15.8:0/3674155069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cdad24d310 0x55cdad248d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.428+0000 7fad7d371b80 1 -- 172.21.15.8:0/3674155069 >> 172.21.15.8:0/3674155069 conn(0x55cdad174950 msgr2=0x55cdad250920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:32:38.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.428+0000 7fad7d371b80 1 -- 172.21.15.8:0/3674155069 shutdown_connections 2023-08-11T12:32:38.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.428+0000 7fad7d371b80 1 -- 172.21.15.8:0/3674155069 wait complete. 2023-08-11T12:32:38.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.428+0000 7fad7d371b80 20 client.26396 trim_cache size 0 max 16384 2023-08-11T12:32:38.448 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:32:38.449 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:32:38.449 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:32:38.449 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:32:38.449 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:32:38.449 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:32:38.450 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:32:38.450 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:32:38.450 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:32:38.450 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:32:38.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.429+0000 7fad699ff700 1 -- 172.21.15.8:0/2905564042 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fad4c0a0140 msgr2=0x7fad4c0a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:32:38.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.429+0000 7fad699ff700 1 --2- 172.21.15.8:0/2905564042 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fad4c0a0140 0x7fad4c0a2600 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fad64074d30 tx=0x7fad5c003f90 comp rx=0 tx=0).stop 2023-08-11T12:32:38.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.429+0000 7fad699ff700 1 -- 172.21.15.8:0/2905564042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad64100960 msgr2=0x7fad64072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:32:38.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.429+0000 7fad699ff700 1 --2- 172.21.15.8:0/2905564042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad64100960 0x7fad64072c20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fad54005910 tx=0x7fad54005740 comp rx=0 tx=0).stop 2023-08-11T12:32:38.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.429+0000 7fad699ff700 1 -- 172.21.15.8:0/2905564042 shutdown_connections 2023-08-11T12:32:38.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.429+0000 7fad699ff700 1 --2- 172.21.15.8:0/2905564042 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fad4c0a0140 0x7fad4c0a2600 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.429+0000 7fad699ff700 1 --2- 172.21.15.8:0/2905564042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad64106970 0x7fad641a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.429+0000 7fad699ff700 1 --2- 172.21.15.8:0/2905564042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad64100960 0x7fad64072c20 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.429+0000 7fad699ff700 1 --2- 172.21.15.8:0/2905564042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad64101320 0x7fad64073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:32:38.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.429+0000 7fad699ff700 1 -- 172.21.15.8:0/2905564042 >> 172.21.15.8:0/2905564042 conn(0x7fad640fc490 msgr2=0x7fad640fcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:32:38.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.429+0000 7fad699ff700 1 -- 172.21.15.8:0/2905564042 shutdown_connections 2023-08-11T12:32:38.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:32:38.429+0000 7fad699ff700 1 -- 172.21.15.8:0/2905564042 wait complete. 2023-08-11T12:32:38.454 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:32:41.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:40 smithi194 ceph-mon[130905]: pgmap v249: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:32:41.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:40 smithi045 ceph-mon[130284]: pgmap v249: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:32:41.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:40 smithi008 ceph-mon[97158]: pgmap v249: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:32:42.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:42 smithi008 ceph-mon[97158]: pgmap v250: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:32:42.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:42 smithi194 ceph-mon[130905]: pgmap v250: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:32:42.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:42 smithi045 ceph-mon[130284]: pgmap v250: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:32:44.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:44 smithi008 ceph-mon[97158]: pgmap v251: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-11T12:32:44.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:44 smithi194 ceph-mon[130905]: pgmap v251: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-11T12:32:44.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:44 smithi045 ceph-mon[130284]: pgmap v251: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-11T12:32:46.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:46 smithi008 ceph-mon[97158]: pgmap v252: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-11T12:32:46.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:46 smithi194 ceph-mon[130905]: pgmap v252: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-11T12:32:46.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:46 smithi045 ceph-mon[130284]: pgmap v252: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-11T12:32:48.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:48 smithi008 ceph-mon[97158]: pgmap v253: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:32:48.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:48 smithi194 ceph-mon[130905]: pgmap v253: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:32:48.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:48 smithi045 ceph-mon[130284]: pgmap v253: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:32:51.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:50 smithi194 ceph-mon[130905]: pgmap v254: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-11T12:32:51.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:50 smithi045 ceph-mon[130284]: pgmap v254: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-11T12:32:51.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:50 smithi008 ceph-mon[97158]: pgmap v254: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-11T12:32:52.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:52 smithi008 ceph-mon[97158]: pgmap v255: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:32:52.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:52 smithi194 ceph-mon[130905]: pgmap v255: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:32:52.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:52 smithi045 ceph-mon[130284]: pgmap v255: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:32:53.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:53 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:32:53.892 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:53 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:32:53.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:53 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:32:54.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:54 smithi008 ceph-mon[97158]: pgmap v256: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:32:54.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:54 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:32:54.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:54 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:32:54.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:54 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:32:54.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:54 smithi194 ceph-mon[130905]: pgmap v256: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:32:54.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:54 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:32:54.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:54 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:32:54.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:54 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:32:54.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:54 smithi045 ceph-mon[130284]: pgmap v256: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:32:54.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:54 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:32:54.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:54 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:32:54.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:54 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:32:56.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:56 smithi008 ceph-mon[97158]: pgmap v257: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:32:56.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:56 smithi194 ceph-mon[130905]: pgmap v257: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:32:56.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:56 smithi045 ceph-mon[130284]: pgmap v257: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:32:58.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:32:58 smithi008 ceph-mon[97158]: pgmap v258: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:32:58.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:32:58 smithi194 ceph-mon[130905]: pgmap v258: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:32:58.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:32:58 smithi045 ceph-mon[130284]: pgmap v258: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:33:01.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:00 smithi194 ceph-mon[130905]: pgmap v259: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:01.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:00 smithi045 ceph-mon[130284]: pgmap v259: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:01.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:00 smithi008 ceph-mon[97158]: pgmap v259: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:02.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:02 smithi008 ceph-mon[97158]: pgmap v260: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-11T12:33:02.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:02 smithi194 ceph-mon[130905]: pgmap v260: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-11T12:33:02.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:02 smithi045 ceph-mon[130284]: pgmap v260: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-11T12:33:04.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:04 smithi008 ceph-mon[97158]: pgmap v261: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:33:04.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:04 smithi194 ceph-mon[130905]: pgmap v261: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:33:04.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:04 smithi045 ceph-mon[130284]: pgmap v261: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:33:06.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:06 smithi008 ceph-mon[97158]: pgmap v262: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:33:06.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:06 smithi194 ceph-mon[130905]: pgmap v262: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:33:06.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:06 smithi045 ceph-mon[130284]: pgmap v262: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:33:08.456 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:33:08.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.674+0000 7fc5cbdff700 1 -- 172.21.15.8:0/2495416937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5c40735e0 msgr2=0x7fc5c4111430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:33:08.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.674+0000 7fc5cbdff700 1 --2- 172.21.15.8:0/2495416937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5c40735e0 0x7fc5c4111430 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc5b40098f0 tx=0x7fc5b4009c00 comp rx=0 tx=0).stop 2023-08-11T12:33:08.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.674+0000 7fc5cbdff700 1 -- 172.21.15.8:0/2495416937 shutdown_connections 2023-08-11T12:33:08.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.674+0000 7fc5cbdff700 1 --2- 172.21.15.8:0/2495416937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5c4111970 0x7fc5c4113d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.674+0000 7fc5cbdff700 1 --2- 172.21.15.8:0/2495416937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5c4072cc0 0x7fc5c40730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.674+0000 7fc5cbdff700 1 --2- 172.21.15.8:0/2495416937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5c40735e0 0x7fc5c4111430 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.674+0000 7fc5cbdff700 1 -- 172.21.15.8:0/2495416937 >> 172.21.15.8:0/2495416937 conn(0x7fc5c40fc490 msgr2=0x7fc5c40fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:33:08.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.674+0000 7fc5cbdff700 1 -- 172.21.15.8:0/2495416937 shutdown_connections 2023-08-11T12:33:08.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.674+0000 7fc5cbdff700 1 -- 172.21.15.8:0/2495416937 wait complete. 2023-08-11T12:33:08.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.675+0000 7fc5cbdff700 1 Processor -- start 2023-08-11T12:33:08.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.675+0000 7fc5cbdff700 1 -- start start 2023-08-11T12:33:08.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.675+0000 7fc5cbdff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5c4072cc0 0x7fc5c419d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:08.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.675+0000 7fc5cbdff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5c40735e0 0x7fc5c419d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:08.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.675+0000 7fc5cbdff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5c4111970 0x7fc5c41a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:08.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.675+0000 7fc5cbdff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c41a20c0 con 0x7fc5c4111970 2023-08-11T12:33:08.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.675+0000 7fc5cbdff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c41a2230 con 0x7fc5c4072cc0 2023-08-11T12:33:08.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.675+0000 7fc5cbdff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c41a23f0 con 0x7fc5c40735e0 2023-08-11T12:33:08.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.676+0000 7fc5c9b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5c4072cc0 0x7fc5c419d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:08.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.676+0000 7fc5c9b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5c4072cc0 0x7fc5c419d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:57064/0 (socket says 172.21.15.8:57064) 2023-08-11T12:33:08.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.676+0000 7fc5c9b9b700 1 -- 172.21.15.8:0/293721467 learned_addr learned my addr 172.21.15.8:0/293721467 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:33:08.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.676+0000 7fc5ca39c700 1 --2- 172.21.15.8:0/293721467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5c4111970 0x7fc5c41a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:08.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.676+0000 7fc5c939a700 1 --2- 172.21.15.8:0/293721467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5c40735e0 0x7fc5c419d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:08.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.676+0000 7fc5c9b9b700 1 -- 172.21.15.8:0/293721467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5c40735e0 msgr2=0x7fc5c419d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:33:08.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.676+0000 7fc5c9b9b700 1 --2- 172.21.15.8:0/293721467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5c40735e0 0x7fc5c419d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.676+0000 7fc5c9b9b700 1 -- 172.21.15.8:0/293721467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5c4111970 msgr2=0x7fc5c41a1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:33:08.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.676+0000 7fc5c9b9b700 1 --2- 172.21.15.8:0/293721467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5c4111970 0x7fc5c41a1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.676+0000 7fc5c9b9b700 1 -- 172.21.15.8:0/293721467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b4009520 con 0x7fc5c4072cc0 2023-08-11T12:33:08.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.676+0000 7fc5c9b9b700 1 --2- 172.21.15.8:0/293721467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5c4072cc0 0x7fc5c419d0e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc5c000e9c0 tx=0x7fc5c000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:33:08.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.677+0000 7fc5baffd700 1 -- 172.21.15.8:0/293721467 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0004a30 con 0x7fc5c4072cc0 2023-08-11T12:33:08.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.677+0000 7fc5cbdff700 1 -- 172.21.15.8:0/293721467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c41a26d0 con 0x7fc5c4072cc0 2023-08-11T12:33:08.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.677+0000 7fc5baffd700 1 -- 172.21.15.8:0/293721467 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc5c000cc80 con 0x7fc5c4072cc0 2023-08-11T12:33:08.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.677+0000 7fc5baffd700 1 -- 172.21.15.8:0/293721467 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c00054e0 con 0x7fc5c4072cc0 2023-08-11T12:33:08.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.677+0000 7fc5cbdff700 1 -- 172.21.15.8:0/293721467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c41a9f10 con 0x7fc5c4072cc0 2023-08-11T12:33:08.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.680+0000 7fc5baffd700 1 -- 172.21.15.8:0/293721467 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7fc5c0004b90 con 0x7fc5c4072cc0 2023-08-11T12:33:08.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.681+0000 7fc5df6c7b80 1 Processor -- start 2023-08-11T12:33:08.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.682+0000 7fc5df6c7b80 1 -- start start 2023-08-11T12:33:08.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.682+0000 7fc5baffd700 1 --2- 172.21.15.8:0/293721467 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fc5b00a00c0 0x7fc5b00a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:08.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.682+0000 7fc5df6c7b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626f758b310 0x5626f758b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:08.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.682+0000 7fc5df6c7b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5626f758bc30 0x5626f75858e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:08.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.682+0000 7fc5df6c7b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626f7585e20 0x5626f7586260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:08.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.682+0000 7fc5df6c7b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626f74de630 con 0x5626f7585e20 2023-08-11T12:33:08.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.682+0000 7fc5df6c7b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626f74dbf50 con 0x5626f758b310 2023-08-11T12:33:08.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.682+0000 7fc5df6c7b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626f74d7840 con 0x5626f758bc30 2023-08-11T12:33:08.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.682+0000 7fc5baffd700 1 -- 172.21.15.8:0/293721467 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 9454+0+0 (secure 0 0 0) 0x7fc5c0014070 con 0x7fc5c4072cc0 2023-08-11T12:33:08.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.682+0000 7fc5c9b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626f758b310 0x5626f758b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:08.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.682+0000 7fc5c9b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626f758b310 0x5626f758b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:57068/0 (socket says 172.21.15.8:57068) 2023-08-11T12:33:08.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.682+0000 7fc5c9b9b700 1 -- 172.21.15.8:0/1619512881 learned_addr learned my addr 172.21.15.8:0/1619512881 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:33:08.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.682+0000 7fc5c939a700 1 --2- 172.21.15.8:0/1619512881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5626f758bc30 0x5626f75858e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:08.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.682+0000 7fc5ca39c700 1 --2- 172.21.15.8:0/293721467 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fc5b00a00c0 0x7fc5b00a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:08.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.683+0000 7fc5ca39c700 1 --2- 172.21.15.8:0/1619512881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626f7585e20 0x5626f7586260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:08.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.683+0000 7fc5c9b9b700 1 -- 172.21.15.8:0/1619512881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5626f758bc30 msgr2=0x5626f75858e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:33:08.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.683+0000 7fc5c9b9b700 1 --2- 172.21.15.8:0/1619512881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5626f758bc30 0x5626f75858e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.683+0000 7fc5c9b9b700 1 -- 172.21.15.8:0/1619512881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626f7585e20 msgr2=0x5626f7586260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:33:08.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.683+0000 7fc5c9b9b700 1 --2- 172.21.15.8:0/1619512881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626f7585e20 0x5626f7586260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.683+0000 7fc5c9b9b700 1 -- 172.21.15.8:0/1619512881 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626f7357630 con 0x5626f758b310 2023-08-11T12:33:08.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.683+0000 7fc5c9b9b700 1 --2- 172.21.15.8:0/1619512881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626f758b310 0x5626f758b6f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0095890 tx=0x7fc5c0098800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99ea47a76065d657 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:33:08.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.683+0000 7fc5ca39c700 1 --2- 172.21.15.8:0/293721467 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fc5b00a00c0 0x7fc5b00a2580 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009ec0 tx=0x7fc5bc009920 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:33:08.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.683+0000 7fc5affff700 1 -- 172.21.15.8:0/1619512881 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0098e20 con 0x5626f758b310 2023-08-11T12:33:08.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.683+0000 7fc5affff700 1 -- 172.21.15.8:0/1619512881 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc5c009cc50 con 0x5626f758b310 2023-08-11T12:33:08.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.683+0000 7fc5affff700 1 -- 172.21.15.8:0/1619512881 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c00c3010 con 0x5626f758b310 2023-08-11T12:33:08.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.684+0000 7fc5df6c7b80 1 -- 172.21.15.8:0/1619512881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626f758b310 msgr2=0x5626f758b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:33:08.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.684+0000 7fc5df6c7b80 1 --2- 172.21.15.8:0/1619512881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626f758b310 0x5626f758b6f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0095890 tx=0x7fc5c0098800 comp rx=0 tx=0).stop 2023-08-11T12:33:08.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.684+0000 7fc5df6c7b80 1 -- 172.21.15.8:0/1619512881 shutdown_connections 2023-08-11T12:33:08.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.684+0000 7fc5df6c7b80 1 --2- 172.21.15.8:0/1619512881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626f7585e20 0x5626f7586260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.684+0000 7fc5df6c7b80 1 --2- 172.21.15.8:0/1619512881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626f758b310 0x5626f758b6f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.684+0000 7fc5df6c7b80 1 --2- 172.21.15.8:0/1619512881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5626f758bc30 0x5626f75858e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.684+0000 7fc5df6c7b80 1 -- 172.21.15.8:0/1619512881 >> 172.21.15.8:0/1619512881 conn(0x5626f74b2950 msgr2=0x5626f75803d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:33:08.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.684+0000 7fc5df6c7b80 1 -- 172.21.15.8:0/1619512881 shutdown_connections 2023-08-11T12:33:08.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.684+0000 7fc5df6c7b80 1 -- 172.21.15.8:0/1619512881 wait complete. 2023-08-11T12:33:08.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.685+0000 7fc5df6c7b80 1 -- start start 2023-08-11T12:33:08.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.685+0000 7fc5df6c7b80 1 Processor -- start 2023-08-11T12:33:08.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.685+0000 7fc5df6c7b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626f7585e20 0x5626f7591bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:08.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.685+0000 7fc5df6c7b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5626f758b310 0x5626f758ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:08.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.685+0000 7fc5df6c7b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626f758bc30 0x5626f758f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:08.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.685+0000 7fc5df6c7b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626f7475ac0 con 0x5626f7585e20 2023-08-11T12:33:08.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.685+0000 7fc5df6c7b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626f74757c0 con 0x5626f758bc30 2023-08-11T12:33:08.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.685+0000 7fc5df6c7b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626f7359920 con 0x5626f758b310 2023-08-11T12:33:08.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.686+0000 7fc5df6c7b80 10 client.0 _ll_register_callbacks cb 0x5626f7478ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:33:08.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.686+0000 7fc5c9b9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626f7585e20 0x5626f7591bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:08.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.686+0000 7fc5ca39c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626f758bc30 0x5626f758f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:08.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.686+0000 7fc5ca39c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626f758bc30 0x5626f758f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:57074/0 (socket says 172.21.15.8:57074) 2023-08-11T12:33:08.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.686+0000 7fc5ca39c700 1 -- 172.21.15.8:0/3154621051 learned_addr learned my addr 172.21.15.8:0/3154621051 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:33:08.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.686+0000 7fc5c939a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5626f758b310 0x5626f758ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:08.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.686+0000 7fc5c9b9b700 1 -- 172.21.15.8:0/3154621051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5626f758b310 msgr2=0x5626f758ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:33:08.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.686+0000 7fc5c9b9b700 1 --2- 172.21.15.8:0/3154621051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5626f758b310 0x5626f758ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.686+0000 7fc5c9b9b700 1 -- 172.21.15.8:0/3154621051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626f758bc30 msgr2=0x5626f758f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:33:08.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.686+0000 7fc5c9b9b700 1 --2- 172.21.15.8:0/3154621051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626f758bc30 0x5626f758f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.686+0000 7fc5c9b9b700 1 -- 172.21.15.8:0/3154621051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c41a9f10 con 0x5626f7585e20 2023-08-11T12:33:08.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.686+0000 7fc5c9b9b700 1 --2- 172.21.15.8:0/3154621051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626f7585e20 0x5626f7591bb0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0098db0 tx=0x7fc5c00a0cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43c51951f2ef93d1 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:33:08.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.686+0000 7fc5ad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:33:08.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.687+0000 7fc5ad7fa700 1 -- 172.21.15.8:0/3154621051 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c00c3210 con 0x5626f7585e20 2023-08-11T12:33:08.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.687+0000 7fc5ad7fa700 1 -- 172.21.15.8:0/3154621051 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 9454+0+0 (secure 0 0 0) 0x7fc5c00c90e0 con 0x5626f7585e20 2023-08-11T12:33:08.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.687+0000 7fc5df6c7b80 1 -- 172.21.15.8:0/3154621051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5626f7578a90 con 0x5626f7585e20 2023-08-11T12:33:08.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.687+0000 7fc5ad7fa700 1 -- 172.21.15.8:0/3154621051 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5c00c92c0 con 0x5626f7585e20 2023-08-11T12:33:08.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.687+0000 7fc5df6c7b80 10 client.16368 fetch_fsmap learned FSMap version 54 2023-08-11T12:33:08.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.687+0000 7fc5df6c7b80 1 -- 172.21.15.8:0/3154621051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x5626f7303de0 con 0x5626f7585e20 2023-08-11T12:33:08.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.687+0000 7fc5ad7fa700 1 -- 172.21.15.8:0/3154621051 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5626f7578a90 con 0x5626f7585e20 2023-08-11T12:33:08.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.687+0000 7fc5ad7fa700 1 -- 172.21.15.8:0/3154621051 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc5c0098310 con 0x5626f7585e20 2023-08-11T12:33:08.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.687+0000 7fc5df6c7b80 10 client.16368 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:33:08.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.687+0000 7fc5df6c7b80 10 client.16368 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:33:08.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.687+0000 7fc5df6c7b80 20 client.16368 populate_metadata read hostname 'smithi008' 2023-08-11T12:33:08.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.687+0000 7fc5df6c7b80 1 --2- 172.21.15.8:0/3154621051 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5626f759f0a0 0x5626f75a1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:08.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.687+0000 7fc5df6c7b80 4 client.16368 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:33:08.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.687+0000 7fc5df6c7b80 1 -- 172.21.15.8:0/3154621051 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5626f75544e0 con 0x5626f759f0a0 2023-08-11T12:33:08.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.688+0000 7fc5c939a700 1 --2- 172.21.15.8:0/3154621051 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5626f759f0a0 0x5626f75a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:08.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.688+0000 7fc5c939a700 1 --2- 172.21.15.8:0/3154621051 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5626f759f0a0 0x5626f75a1490 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c28e0f0d6ec758cf server_cookie=150d35cfd85b555f in_seq=0 out_seq=0 2023-08-11T12:33:08.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.688+0000 7fc5ad7fa700 10 client.16368 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:33:08.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.689+0000 7fc5ad7fa700 1 -- 172.21.15.8:0/3154621051 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5626f75544e0 con 0x5626f759f0a0 2023-08-11T12:33:08.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.689+0000 7fc5ad7fa700 10 client.16368 handle_command_reply: tid=0 2023-08-11T12:33:08.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.689+0000 7fc5df6c7b80 1 client.16368 shutdown 2023-08-11T12:33:08.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.689+0000 7fc5df6c7b80 1 -- 172.21.15.8:0/3154621051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626f7585e20 msgr2=0x5626f7591bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:33:08.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.689+0000 7fc5df6c7b80 1 --2- 172.21.15.8:0/3154621051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626f7585e20 0x5626f7591bb0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0098db0 tx=0x7fc5c00a0cb0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.690+0000 7fc5df6c7b80 1 -- 172.21.15.8:0/3154621051 shutdown_connections 2023-08-11T12:33:08.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.690+0000 7fc5df6c7b80 1 --2- 172.21.15.8:0/3154621051 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5626f759f0a0 0x5626f75a1490 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.690+0000 7fc5df6c7b80 1 --2- 172.21.15.8:0/3154621051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626f758bc30 0x5626f758f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.690+0000 7fc5df6c7b80 1 --2- 172.21.15.8:0/3154621051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626f7585e20 0x5626f7591bb0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.690+0000 7fc5df6c7b80 1 --2- 172.21.15.8:0/3154621051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5626f758b310 0x5626f758ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.690+0000 7fc5ad7fa700 0 client.16368 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:33:08.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.690+0000 7fc5df6c7b80 1 -- 172.21.15.8:0/3154621051 >> 172.21.15.8:0/3154621051 conn(0x5626f74b2950 msgr2=0x5626f757acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:33:08.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.690+0000 7fc5df6c7b80 1 -- 172.21.15.8:0/3154621051 shutdown_connections 2023-08-11T12:33:08.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.690+0000 7fc5df6c7b80 1 -- 172.21.15.8:0/3154621051 wait complete. 2023-08-11T12:33:08.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.690+0000 7fc5df6c7b80 20 client.16368 trim_cache size 0 max 16384 2023-08-11T12:33:08.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.707+0000 7fc5df6c7b80 1 Processor -- start 2023-08-11T12:33:08.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.708+0000 7fc5df6c7b80 1 -- start start 2023-08-11T12:33:08.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.708+0000 7fc5df6c7b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626f7585e20 0x5626f75858e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:08.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.708+0000 7fc5df6c7b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626f758b310 0x5626f7596520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:08.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.708+0000 7fc5df6c7b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5626f758bc30 0x5626f7591670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:08.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.708+0000 7fc5df6c7b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626f758fe20 con 0x5626f758b310 2023-08-11T12:33:08.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.708+0000 7fc5df6c7b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626f759eec0 con 0x5626f7585e20 2023-08-11T12:33:08.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.708+0000 7fc5df6c7b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626f758af90 con 0x5626f758bc30 2023-08-11T12:33:08.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.708+0000 7fc5c939a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626f758b310 0x5626f7596520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:08.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.708+0000 7fc5c9b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626f7585e20 0x5626f75858e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:08.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.708+0000 7fc5c939a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626f758b310 0x5626f7596520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49806/0 (socket says 172.21.15.8:49806) 2023-08-11T12:33:08.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.708+0000 7fc5c939a700 1 -- 172.21.15.8:0/3386206939 learned_addr learned my addr 172.21.15.8:0/3386206939 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:33:08.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.708+0000 7fc5ca39c700 1 --2- 172.21.15.8:0/3386206939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5626f758bc30 0x5626f7591670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:08.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.708+0000 7fc5c9b9b700 1 -- 172.21.15.8:0/3386206939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5626f758bc30 msgr2=0x5626f7591670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:33:08.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.709+0000 7fc5c9b9b700 1 --2- 172.21.15.8:0/3386206939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5626f758bc30 0x5626f7591670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.709+0000 7fc5c9b9b700 1 -- 172.21.15.8:0/3386206939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626f758b310 msgr2=0x5626f7596520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:33:08.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.709+0000 7fc5c9b9b700 1 --2- 172.21.15.8:0/3386206939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626f758b310 0x5626f7596520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.709+0000 7fc5c9b9b700 1 -- 172.21.15.8:0/3386206939 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626f72ecc60 con 0x5626f7585e20 2023-08-11T12:33:08.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.709+0000 7fc5c939a700 1 --2- 172.21.15.8:0/3386206939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626f758b310 0x5626f7596520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:33:08.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.709+0000 7fc5c9b9b700 1 --2- 172.21.15.8:0/3386206939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626f7585e20 0x5626f75858e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0098b20 tx=0x7fc5c0009550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a05c103876ec09dd server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:33:08.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.709+0000 7fc5b8bff700 1 -- 172.21.15.8:0/3386206939 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0098310 con 0x5626f7585e20 2023-08-11T12:33:08.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.709+0000 7fc5b8bff700 1 -- 172.21.15.8:0/3386206939 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc5c0098470 con 0x5626f7585e20 2023-08-11T12:33:08.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.709+0000 7fc5b8bff700 1 -- 172.21.15.8:0/3386206939 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0016330 con 0x5626f7585e20 2023-08-11T12:33:08.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.710+0000 7fc5df6c7b80 1 -- 172.21.15.8:0/3386206939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626f7585e20 msgr2=0x5626f75858e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:33:08.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.710+0000 7fc5df6c7b80 1 --2- 172.21.15.8:0/3386206939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626f7585e20 0x5626f75858e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0098b20 tx=0x7fc5c0009550 comp rx=0 tx=0).stop 2023-08-11T12:33:08.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.710+0000 7fc5df6c7b80 1 -- 172.21.15.8:0/3386206939 shutdown_connections 2023-08-11T12:33:08.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.710+0000 7fc5df6c7b80 1 --2- 172.21.15.8:0/3386206939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5626f758bc30 0x5626f7591670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.710+0000 7fc5df6c7b80 1 --2- 172.21.15.8:0/3386206939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626f7585e20 0x5626f75858e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.710+0000 7fc5df6c7b80 1 --2- 172.21.15.8:0/3386206939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626f758b310 0x5626f7596520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.710+0000 7fc5df6c7b80 1 -- 172.21.15.8:0/3386206939 >> 172.21.15.8:0/3386206939 conn(0x5626f74b2950 msgr2=0x5626f759b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:33:08.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.710+0000 7fc5df6c7b80 1 -- 172.21.15.8:0/3386206939 shutdown_connections 2023-08-11T12:33:08.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.710+0000 7fc5df6c7b80 1 -- 172.21.15.8:0/3386206939 wait complete. 2023-08-11T12:33:08.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.710+0000 7fc5df6c7b80 1 -- start start 2023-08-11T12:33:08.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.711+0000 7fc5df6c7b80 1 Processor -- start 2023-08-11T12:33:08.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.711+0000 7fc5df6c7b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5626f7585e20 0x5626f7596530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:08.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.711+0000 7fc5df6c7b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626f758b310 0x5626f7586fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:08.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.711+0000 7fc5df6c7b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626f758bc30 0x5626f7587500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:08.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.711+0000 7fc5df6c7b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626f7587bd0 con 0x5626f758b310 2023-08-11T12:33:08.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.711+0000 7fc5df6c7b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626f7587d40 con 0x5626f758bc30 2023-08-11T12:33:08.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.711+0000 7fc5df6c7b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626f75f2cc0 con 0x5626f7585e20 2023-08-11T12:33:08.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.711+0000 7fc5df6c7b80 10 client.0 _ll_register_callbacks cb 0x7fc5c00091e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:33:08.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.711+0000 7fc5ca39c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626f758bc30 0x5626f7587500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:08.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.711+0000 7fc5c9b9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5626f7585e20 0x5626f7596530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:08.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.711+0000 7fc5c939a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626f758b310 0x5626f7586fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:08.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.711+0000 7fc5ca39c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626f758bc30 0x5626f7587500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:57084/0 (socket says 172.21.15.8:57084) 2023-08-11T12:33:08.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.711+0000 7fc5c9b9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5626f7585e20 0x5626f7596530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:44194/0 (socket says 172.21.15.8:44194) 2023-08-11T12:33:08.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.711+0000 7fc5ca39c700 1 -- 172.21.15.8:0/4022054278 learned_addr learned my addr 172.21.15.8:0/4022054278 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:33:08.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.712+0000 7fc5c9b9b700 1 -- 172.21.15.8:0/4022054278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626f758bc30 msgr2=0x5626f7587500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:33:08.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.712+0000 7fc5c9b9b700 1 --2- 172.21.15.8:0/4022054278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626f758bc30 0x5626f7587500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.712+0000 7fc5c9b9b700 1 -- 172.21.15.8:0/4022054278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626f758b310 msgr2=0x5626f7586fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:33:08.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.712+0000 7fc5c9b9b700 1 --2- 172.21.15.8:0/4022054278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626f758b310 0x5626f7586fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.712+0000 7fc5c9b9b700 1 -- 172.21.15.8:0/4022054278 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c4114710 con 0x5626f7585e20 2023-08-11T12:33:08.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.712+0000 7fc5ca39c700 1 --2- 172.21.15.8:0/4022054278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626f758bc30 0x5626f7587500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:33:08.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.712+0000 7fc5c939a700 1 --2- 172.21.15.8:0/4022054278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626f758b310 0x5626f7586fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:33:08.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.712+0000 7fc5c9b9b700 1 --2- 172.21.15.8:0/4022054278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5626f7585e20 0x5626f7596530 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0005950 tx=0x7fc5c00a0cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c44e478ccd60fc1 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:33:08.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.712+0000 7fc5ad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:33:08.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.713+0000 7fc5ad7fa700 1 -- 172.21.15.8:0/4022054278 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0098310 con 0x5626f7585e20 2023-08-11T12:33:08.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.713+0000 7fc5ad7fa700 1 -- 172.21.15.8:0/4022054278 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 9454+0+0 (secure 0 0 0) 0x7fc5c0016540 con 0x5626f7585e20 2023-08-11T12:33:08.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.713+0000 7fc5df6c7b80 1 -- 172.21.15.8:0/4022054278 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc5c009cc50 con 0x5626f7585e20 2023-08-11T12:33:08.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.716+0000 7fc5ad7fa700 1 -- 172.21.15.8:0/4022054278 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5c00b82a0 con 0x5626f7585e20 2023-08-11T12:33:08.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.716+0000 7fc5df6c7b80 10 client.26425 fetch_fsmap learned FSMap version 54 2023-08-11T12:33:08.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.716+0000 7fc5df6c7b80 1 -- 172.21.15.8:0/4022054278 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x5626f7303de0 con 0x5626f7585e20 2023-08-11T12:33:08.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.717+0000 7fc5ad7fa700 1 -- 172.21.15.8:0/4022054278 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc5c009cc50 con 0x5626f7585e20 2023-08-11T12:33:08.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.717+0000 7fc5ad7fa700 1 -- 172.21.15.8:0/4022054278 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc5c000c6e0 con 0x5626f7585e20 2023-08-11T12:33:08.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.717+0000 7fc5df6c7b80 10 client.26425 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:33:08.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.717+0000 7fc5df6c7b80 10 client.26425 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:33:08.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.717+0000 7fc5df6c7b80 20 client.26425 populate_metadata read hostname 'smithi008' 2023-08-11T12:33:08.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.717+0000 7fc5df6c7b80 1 --2- 172.21.15.8:0/4022054278 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5626f75f3e20 0x5626f75f6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:08.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.717+0000 7fc5df6c7b80 4 client.26425 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:33:08.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.717+0000 7fc5df6c7b80 1 -- 172.21.15.8:0/4022054278 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5626f74d0820 con 0x5626f75f3e20 2023-08-11T12:33:08.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.717+0000 7fc5c939a700 1 --2- 172.21.15.8:0/4022054278 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5626f75f3e20 0x5626f75f6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:08.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.718+0000 7fc5ad7fa700 10 client.26425 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:33:08.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.718+0000 7fc5c939a700 1 --2- 172.21.15.8:0/4022054278 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5626f75f3e20 0x5626f75f6210 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e31535af7eb1085 server_cookie=704e51660a4c74ed in_seq=0 out_seq=0 2023-08-11T12:33:08.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.718+0000 7fc5ad7fa700 1 -- 172.21.15.8:0/4022054278 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5626f74d0820 con 0x5626f75f3e20 2023-08-11T12:33:08.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.718+0000 7fc5ad7fa700 10 client.26425 handle_command_reply: tid=0 2023-08-11T12:33:08.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.718+0000 7fc5df6c7b80 1 client.26425 shutdown 2023-08-11T12:33:08.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.718+0000 7fc5df6c7b80 1 -- 172.21.15.8:0/4022054278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5626f7585e20 msgr2=0x5626f7596530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:33:08.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.718+0000 7fc5df6c7b80 1 --2- 172.21.15.8:0/4022054278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5626f7585e20 0x5626f7596530 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0005950 tx=0x7fc5c00a0cb0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.718+0000 7fc5df6c7b80 1 -- 172.21.15.8:0/4022054278 shutdown_connections 2023-08-11T12:33:08.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.718+0000 7fc5df6c7b80 1 --2- 172.21.15.8:0/4022054278 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5626f75f3e20 0x5626f75f6210 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.718+0000 7fc5df6c7b80 1 --2- 172.21.15.8:0/4022054278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5626f7585e20 0x5626f7596530 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.718+0000 7fc5df6c7b80 1 --2- 172.21.15.8:0/4022054278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626f758bc30 0x5626f7587500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.718+0000 7fc5df6c7b80 1 --2- 172.21.15.8:0/4022054278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626f758b310 0x5626f7586fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.718+0000 7fc5ad7fa700 0 client.26425 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:33:08.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.718+0000 7fc5df6c7b80 1 -- 172.21.15.8:0/4022054278 >> 172.21.15.8:0/4022054278 conn(0x5626f74b2950 msgr2=0x5626f758e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:33:08.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.718+0000 7fc5df6c7b80 1 -- 172.21.15.8:0/4022054278 shutdown_connections 2023-08-11T12:33:08.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.718+0000 7fc5df6c7b80 1 -- 172.21.15.8:0/4022054278 wait complete. 2023-08-11T12:33:08.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.718+0000 7fc5df6c7b80 20 client.26425 trim_cache size 0 max 16384 2023-08-11T12:33:08.740 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:33:08.741 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:33:08.741 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:33:08.741 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:33:08.741 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:33:08.741 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:33:08.742 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:33:08.742 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:33:08.742 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:33:08.742 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:33:08.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.719+0000 7fc5cbdff700 1 -- 172.21.15.8:0/293721467 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fc5b00a00c0 msgr2=0x7fc5b00a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:33:08.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.719+0000 7fc5cbdff700 1 --2- 172.21.15.8:0/293721467 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fc5b00a00c0 0x7fc5b00a2580 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009ec0 tx=0x7fc5bc009920 comp rx=0 tx=0).stop 2023-08-11T12:33:08.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.719+0000 7fc5cbdff700 1 -- 172.21.15.8:0/293721467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5c4072cc0 msgr2=0x7fc5c419d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:33:08.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.719+0000 7fc5cbdff700 1 --2- 172.21.15.8:0/293721467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5c4072cc0 0x7fc5c419d0e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc5c000e9c0 tx=0x7fc5c000ecd0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.719+0000 7fc5cbdff700 1 -- 172.21.15.8:0/293721467 shutdown_connections 2023-08-11T12:33:08.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.719+0000 7fc5cbdff700 1 --2- 172.21.15.8:0/293721467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5c4111970 0x7fc5c41a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.719+0000 7fc5cbdff700 1 --2- 172.21.15.8:0/293721467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5c4072cc0 0x7fc5c419d0e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.719+0000 7fc5cbdff700 1 --2- 172.21.15.8:0/293721467 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fc5b00a00c0 0x7fc5b00a2580 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.719+0000 7fc5cbdff700 1 --2- 172.21.15.8:0/293721467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5c40735e0 0x7fc5c419d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:08.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.719+0000 7fc5cbdff700 1 -- 172.21.15.8:0/293721467 >> 172.21.15.8:0/293721467 conn(0x7fc5c40fc490 msgr2=0x7fc5c40fd100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:33:08.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.719+0000 7fc5cbdff700 1 -- 172.21.15.8:0/293721467 shutdown_connections 2023-08-11T12:33:08.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:08.719+0000 7fc5cbdff700 1 -- 172.21.15.8:0/293721467 wait complete. 2023-08-11T12:33:08.746 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:33:08.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:08 smithi008 ceph-mon[97158]: osdmap e95: 12 total, 12 up, 12 in 2023-08-11T12:33:08.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:08 smithi008 ceph-mon[97158]: pgmap v264: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:33:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:08 smithi194 ceph-mon[130905]: osdmap e95: 12 total, 12 up, 12 in 2023-08-11T12:33:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:08 smithi194 ceph-mon[130905]: pgmap v264: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:33:09.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:08 smithi045 ceph-mon[130284]: osdmap e95: 12 total, 12 up, 12 in 2023-08-11T12:33:09.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:08 smithi045 ceph-mon[130284]: pgmap v264: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:33:11.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:10 smithi194 ceph-mon[130905]: pgmap v265: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:33:11.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:10 smithi045 ceph-mon[130284]: pgmap v265: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:33:11.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:10 smithi008 ceph-mon[97158]: pgmap v265: 129 pgs: 129 active+clean; 6.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:33:12.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:12 smithi008 ceph-mon[97158]: pgmap v266: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:33:12.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:12 smithi194 ceph-mon[130905]: pgmap v266: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:33:12.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:12 smithi045 ceph-mon[130284]: pgmap v266: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:33:14.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:14 smithi008 ceph-mon[97158]: pgmap v267: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:33:14.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:14 smithi194 ceph-mon[130905]: pgmap v267: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:33:14.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:14 smithi045 ceph-mon[130284]: pgmap v267: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:33:16.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:15 smithi194 ceph-mon[130905]: osdmap e96: 12 total, 12 up, 12 in 2023-08-11T12:33:16.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:15 smithi045 ceph-mon[130284]: osdmap e96: 12 total, 12 up, 12 in 2023-08-11T12:33:16.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:15 smithi008 ceph-mon[97158]: osdmap e96: 12 total, 12 up, 12 in 2023-08-11T12:33:17.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:16 smithi194 ceph-mon[130905]: pgmap v269: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 124 B/s wr, 6 op/s 2023-08-11T12:33:17.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:16 smithi045 ceph-mon[130284]: pgmap v269: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 124 B/s wr, 6 op/s 2023-08-11T12:33:17.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:16 smithi008 ceph-mon[97158]: pgmap v269: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 124 B/s wr, 6 op/s 2023-08-11T12:33:18.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:18 smithi008 ceph-mon[97158]: pgmap v270: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:33:18.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:18 smithi194 ceph-mon[130905]: pgmap v270: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:33:18.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:18 smithi045 ceph-mon[130284]: pgmap v270: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:33:21.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:20 smithi194 ceph-mon[130905]: pgmap v271: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:33:21.144 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:20 smithi045 ceph-mon[130284]: pgmap v271: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:33:21.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:20 smithi008 ceph-mon[97158]: pgmap v271: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:33:22.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:22 smithi008 ceph-mon[97158]: pgmap v272: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:33:22.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:22 smithi194 ceph-mon[130905]: pgmap v272: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:33:22.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:22 smithi045 ceph-mon[130284]: pgmap v272: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:33:24.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:24 smithi008 ceph-mon[97158]: pgmap v273: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:33:24.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:24 smithi194 ceph-mon[130905]: pgmap v273: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:33:24.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:24 smithi045 ceph-mon[130284]: pgmap v273: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:33:26.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:26 smithi008 ceph-mon[97158]: pgmap v274: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:33:26.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:26 smithi194 ceph-mon[130905]: pgmap v274: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:33:26.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:26 smithi045 ceph-mon[130284]: pgmap v274: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:33:28.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:28 smithi008 ceph-mon[97158]: pgmap v275: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:33:28.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:28 smithi194 ceph-mon[130905]: pgmap v275: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:33:28.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:28 smithi045 ceph-mon[130284]: pgmap v275: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:33:31.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:30 smithi194 ceph-mon[130905]: pgmap v276: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:31.144 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:30 smithi045 ceph-mon[130284]: pgmap v276: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:31.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:30 smithi008 ceph-mon[97158]: pgmap v276: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:32.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:32 smithi008 ceph-mon[97158]: pgmap v277: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:33:32.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:32 smithi194 ceph-mon[130905]: pgmap v277: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:33:32.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:32 smithi045 ceph-mon[130284]: pgmap v277: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:33:34.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:34 smithi008 ceph-mon[97158]: pgmap v278: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:34.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:34 smithi194 ceph-mon[130905]: pgmap v278: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:34.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:34 smithi045 ceph-mon[130284]: pgmap v278: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:36.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:36 smithi008 ceph-mon[97158]: pgmap v279: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:36.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:36 smithi194 ceph-mon[130905]: pgmap v279: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:36.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:36 smithi045 ceph-mon[130284]: pgmap v279: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:38.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:38 smithi008 ceph-mon[97158]: pgmap v280: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:33:38.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:38 smithi194 ceph-mon[130905]: pgmap v280: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:33:38.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:38 smithi045 ceph-mon[130284]: pgmap v280: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:33:38.747 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:33:38.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.966+0000 7f6ea47ff700 1 -- 172.21.15.8:0/2316232337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e9c0735e0 msgr2=0x7f6e9c111430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:33:38.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.966+0000 7f6ea47ff700 1 --2- 172.21.15.8:0/2316232337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e9c0735e0 0x7f6e9c111430 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c009990 tx=0x7f6e8c009ca0 comp rx=0 tx=0).stop 2023-08-11T12:33:38.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.966+0000 7f6ea47ff700 1 -- 172.21.15.8:0/2316232337 shutdown_connections 2023-08-11T12:33:38.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.966+0000 7f6ea47ff700 1 --2- 172.21.15.8:0/2316232337 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e9c111970 0x7f6e9c113d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:38.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.966+0000 7f6ea47ff700 1 --2- 172.21.15.8:0/2316232337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e9c072cc0 0x7f6e9c0730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:38.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.966+0000 7f6ea47ff700 1 --2- 172.21.15.8:0/2316232337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e9c0735e0 0x7f6e9c111430 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:38.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.966+0000 7f6ea47ff700 1 -- 172.21.15.8:0/2316232337 >> 172.21.15.8:0/2316232337 conn(0x7f6e9c0fc490 msgr2=0x7f6e9c0fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:33:38.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.967+0000 7f6ea47ff700 1 -- 172.21.15.8:0/2316232337 shutdown_connections 2023-08-11T12:33:38.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.967+0000 7f6ea47ff700 1 -- 172.21.15.8:0/2316232337 wait complete. 2023-08-11T12:33:38.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.968+0000 7f6ea47ff700 1 Processor -- start 2023-08-11T12:33:38.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.968+0000 7f6ea47ff700 1 -- start start 2023-08-11T12:33:38.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.968+0000 7f6ea47ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e9c072cc0 0x7f6e9c19d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:38.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.968+0000 7f6ea47ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e9c0735e0 0x7f6e9c19d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:38.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.968+0000 7f6ea47ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e9c111970 0x7f6e9c1a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:38.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.968+0000 7f6ea47ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c1a20a0 con 0x7f6e9c0735e0 2023-08-11T12:33:38.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.968+0000 7f6ea47ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c1a2210 con 0x7f6e9c111970 2023-08-11T12:33:38.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.968+0000 7f6ea47ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c1a23d0 con 0x7f6e9c072cc0 2023-08-11T12:33:38.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.968+0000 7f6ea2d9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e9c111970 0x7f6e9c1a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:38.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.968+0000 7f6ea1d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e9c0735e0 0x7f6e9c19d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:38.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.968+0000 7f6ea2d9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e9c111970 0x7f6e9c1a1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:47942/0 (socket says 172.21.15.8:47942) 2023-08-11T12:33:38.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.968+0000 7f6ea2d9c700 1 -- 172.21.15.8:0/851936808 learned_addr learned my addr 172.21.15.8:0/851936808 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:33:38.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.968+0000 7f6ea259b700 1 --2- 172.21.15.8:0/851936808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e9c072cc0 0x7f6e9c19d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:38.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.969+0000 7f6ea2d9c700 1 -- 172.21.15.8:0/851936808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e9c072cc0 msgr2=0x7f6e9c19d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:33:38.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.969+0000 7f6ea2d9c700 1 --2- 172.21.15.8:0/851936808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e9c072cc0 0x7f6e9c19d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:38.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.969+0000 7f6ea2d9c700 1 -- 172.21.15.8:0/851936808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e9c0735e0 msgr2=0x7f6e9c19d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:33:38.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.969+0000 7f6ea2d9c700 1 --2- 172.21.15.8:0/851936808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e9c0735e0 0x7f6e9c19d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:38.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.969+0000 7f6ea2d9c700 1 -- 172.21.15.8:0/851936808 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8c0095f0 con 0x7f6e9c111970 2023-08-11T12:33:38.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.969+0000 7f6ea259b700 1 --2- 172.21.15.8:0/851936808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e9c072cc0 0x7f6e9c19d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:33:38.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.969+0000 7f6ea1d9a700 1 --2- 172.21.15.8:0/851936808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e9c0735e0 0x7f6e9c19d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:33:38.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.969+0000 7f6ea2d9c700 1 --2- 172.21.15.8:0/851936808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e9c111970 0x7f6e9c1a1a60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6e9400ef90 tx=0x7f6e9400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:33:38.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.969+0000 7f6e937fe700 1 -- 172.21.15.8:0/851936808 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e94018070 con 0x7f6e9c111970 2023-08-11T12:33:38.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.969+0000 7f6ea47ff700 1 -- 172.21.15.8:0/851936808 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e9c1a2650 con 0x7f6e9c111970 2023-08-11T12:33:38.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.969+0000 7f6e937fe700 1 -- 172.21.15.8:0/851936808 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e9400f040 con 0x7f6e9c111970 2023-08-11T12:33:38.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.969+0000 7f6e937fe700 1 -- 172.21.15.8:0/851936808 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9400cda0 con 0x7f6e9c111970 2023-08-11T12:33:38.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.970+0000 7f6ea47ff700 1 -- 172.21.15.8:0/851936808 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e9c1a9ef0 con 0x7f6e9c111970 2023-08-11T12:33:38.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.974+0000 7f6e937fe700 1 -- 172.21.15.8:0/851936808 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f6e94003a00 con 0x7f6e9c111970 2023-08-11T12:33:38.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.975+0000 7f6eb81d1b80 1 Processor -- start 2023-08-11T12:33:38.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.975+0000 7f6eb81d1b80 1 -- start start 2023-08-11T12:33:38.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.976+0000 7f6eb81d1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ee85d0310 0x556ee85d06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:38.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.976+0000 7f6eb81d1b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556ee85d0c30 0x556ee85ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:38.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.976+0000 7f6eb81d1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ee85cae20 0x556ee85cb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:38.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.976+0000 7f6eb81d1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee8523630 con 0x556ee85d0310 2023-08-11T12:33:38.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.976+0000 7f6eb81d1b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee8520f50 con 0x556ee85d0c30 2023-08-11T12:33:38.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.976+0000 7f6eb81d1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee851c840 con 0x556ee85cae20 2023-08-11T12:33:38.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.976+0000 7f6ea259b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556ee85d0c30 0x556ee85ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:38.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.976+0000 7f6e937fe700 1 --2- 172.21.15.8:0/851936808 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f6e880a00c0 0x7f6e880a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:38.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.976+0000 7f6ea1d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ee85d0310 0x556ee85d06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:38.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.976+0000 7f6ea259b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556ee85d0c30 0x556ee85ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:47958/0 (socket says 172.21.15.8:47958) 2023-08-11T12:33:38.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.976+0000 7f6ea259b700 1 -- 172.21.15.8:0/1712093135 learned_addr learned my addr 172.21.15.8:0/1712093135 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:33:38.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.976+0000 7f6ea1d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ee85d0310 0x556ee85d06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44568/0 (socket says 172.21.15.8:44568) 2023-08-11T12:33:38.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.976+0000 7f6e937fe700 1 -- 172.21.15.8:0/851936808 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 9366+0+0 (secure 0 0 0) 0x7f6e940cb520 con 0x7f6e9c111970 2023-08-11T12:33:38.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.976+0000 7f6ea2d9c700 1 --2- 172.21.15.8:0/851936808 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f6e880a00c0 0x7f6e880a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:38.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.976+0000 7f6ea259b700 1 -- 172.21.15.8:0/1712093135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ee85cae20 msgr2=0x556ee85cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:33:38.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.976+0000 7f6ea1d9a700 1 --2- 172.21.15.8:0/1712093135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ee85cae20 0x556ee85cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:38.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.976+0000 7f6ea259b700 1 --2- 172.21.15.8:0/1712093135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ee85cae20 0x556ee85cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:38.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.977+0000 7f6ea259b700 1 -- 172.21.15.8:0/1712093135 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ee85d0310 msgr2=0x556ee85d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:33:38.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.977+0000 7f6ea259b700 1 --2- 172.21.15.8:0/1712093135 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ee85d0310 0x556ee85d06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:38.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.977+0000 7f6ea259b700 1 -- 172.21.15.8:0/1712093135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ee839c630 con 0x556ee85d0c30 2023-08-11T12:33:38.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.977+0000 7f6ea1d9a700 1 --2- 172.21.15.8:0/1712093135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ee85cae20 0x556ee85cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:33:38.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.977+0000 7f6ea259b700 1 --2- 172.21.15.8:0/1712093135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556ee85d0c30 0x556ee85ca8e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6e980115f0 tx=0x7f6e98011900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81c6ecdaceb69752 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:33:38.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.977+0000 7f6ea2d9c700 1 --2- 172.21.15.8:0/851936808 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f6e880a00c0 0x7f6e880a2580 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6e940c8920 tx=0x7f6e9400c820 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:33:38.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.977+0000 7f6e90ff9700 1 -- 172.21.15.8:0/1712093135 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e98019630 con 0x556ee85d0c30 2023-08-11T12:33:38.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.977+0000 7f6e90ff9700 1 -- 172.21.15.8:0/1712093135 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e98019c50 con 0x556ee85d0c30 2023-08-11T12:33:38.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.977+0000 7f6e90ff9700 1 -- 172.21.15.8:0/1712093135 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9800ec20 con 0x556ee85d0c30 2023-08-11T12:33:38.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.978+0000 7f6eb81d1b80 1 -- 172.21.15.8:0/1712093135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556ee85d0c30 msgr2=0x556ee85ca8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:33:38.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.978+0000 7f6eb81d1b80 1 --2- 172.21.15.8:0/1712093135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556ee85d0c30 0x556ee85ca8e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6e980115f0 tx=0x7f6e98011900 comp rx=0 tx=0).stop 2023-08-11T12:33:38.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.978+0000 7f6eb81d1b80 1 -- 172.21.15.8:0/1712093135 shutdown_connections 2023-08-11T12:33:38.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.978+0000 7f6eb81d1b80 1 --2- 172.21.15.8:0/1712093135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ee85cae20 0x556ee85cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:38.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.978+0000 7f6eb81d1b80 1 --2- 172.21.15.8:0/1712093135 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ee85d0310 0x556ee85d06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:38.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.978+0000 7f6eb81d1b80 1 --2- 172.21.15.8:0/1712093135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556ee85d0c30 0x556ee85ca8e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:38.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.978+0000 7f6eb81d1b80 1 -- 172.21.15.8:0/1712093135 >> 172.21.15.8:0/1712093135 conn(0x556ee84f7950 msgr2=0x556ee85c53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:33:38.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.978+0000 7f6eb81d1b80 1 -- 172.21.15.8:0/1712093135 shutdown_connections 2023-08-11T12:33:38.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.978+0000 7f6eb81d1b80 1 -- 172.21.15.8:0/1712093135 wait complete. 2023-08-11T12:33:38.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.978+0000 7f6eb81d1b80 1 -- start start 2023-08-11T12:33:38.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.979+0000 7f6eb81d1b80 1 Processor -- start 2023-08-11T12:33:38.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.979+0000 7f6eb81d1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ee85cae20 0x556ee85d6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:38.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.979+0000 7f6eb81d1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ee85d0310 0x556ee85d3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:38.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.979+0000 7f6eb81d1b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556ee85d0c30 0x556ee85d43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:38.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.979+0000 7f6eb81d1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee84baac0 con 0x556ee85cae20 2023-08-11T12:33:38.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.979+0000 7f6eb81d1b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee84ba7c0 con 0x556ee85d0c30 2023-08-11T12:33:38.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.979+0000 7f6eb81d1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee839e920 con 0x556ee85d0310 2023-08-11T12:33:38.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.979+0000 7f6eb81d1b80 10 client.0 _ll_register_callbacks cb 0x556ee84bdab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:33:38.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.980+0000 7f6ea1d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ee85cae20 0x556ee85d6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:38.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.980+0000 7f6ea259b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ee85d0310 0x556ee85d3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:38.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.980+0000 7f6ea259b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ee85d0310 0x556ee85d3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:44054/0 (socket says 172.21.15.8:44054) 2023-08-11T12:33:38.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.980+0000 7f6ea259b700 1 -- 172.21.15.8:0/784781058 learned_addr learned my addr 172.21.15.8:0/784781058 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:33:38.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.980+0000 7f6ea1d9a700 1 --2- 172.21.15.8:0/784781058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556ee85d0c30 0x556ee85d43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:38.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.980+0000 7f6ea259b700 1 -- 172.21.15.8:0/784781058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556ee85d0c30 msgr2=0x556ee85d43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:33:38.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.980+0000 7f6ea259b700 1 --2- 172.21.15.8:0/784781058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556ee85d0c30 0x556ee85d43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:38.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.980+0000 7f6ea259b700 1 -- 172.21.15.8:0/784781058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ee85cae20 msgr2=0x556ee85d6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:33:38.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.980+0000 7f6ea259b700 1 --2- 172.21.15.8:0/784781058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ee85cae20 0x556ee85d6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:38.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.980+0000 7f6ea259b700 1 -- 172.21.15.8:0/784781058 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e98009dd0 con 0x556ee85d0310 2023-08-11T12:33:38.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.980+0000 7f6ea259b700 1 --2- 172.21.15.8:0/784781058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ee85d0310 0x556ee85d3de0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6e98005920 tx=0x7f6e9800ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fabc905df865a880 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:33:38.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.980+0000 7f6e85ffb700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:33:38.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.981+0000 7f6e85ffb700 1 -- 172.21.15.8:0/784781058 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e98019840 con 0x556ee85d0310 2023-08-11T12:33:38.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.981+0000 7f6eb81d1b80 1 -- 172.21.15.8:0/784781058 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556ee85bda90 con 0x556ee85d0310 2023-08-11T12:33:38.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.981+0000 7f6e85ffb700 1 -- 172.21.15.8:0/784781058 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9366+0+0 (secure 0 0 0) 0x7f6e9800e3b0 con 0x556ee85d0310 2023-08-11T12:33:38.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.981+0000 7f6e85ffb700 1 -- 172.21.15.8:0/784781058 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e98005ce0 con 0x556ee85d0310 2023-08-11T12:33:39.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.981+0000 7f6eb81d1b80 10 client.26434 fetch_fsmap learned FSMap version 54 2023-08-11T12:33:39.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.981+0000 7f6eb81d1b80 1 -- 172.21.15.8:0/784781058 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x556ee8348de0 con 0x556ee85d0310 2023-08-11T12:33:39.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.981+0000 7f6e85ffb700 1 -- 172.21.15.8:0/784781058 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556ee85bda90 con 0x556ee85d0310 2023-08-11T12:33:39.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.982+0000 7f6e85ffb700 1 -- 172.21.15.8:0/784781058 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6e980049e0 con 0x556ee85d0310 2023-08-11T12:33:39.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.982+0000 7f6eb81d1b80 10 client.26434 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:33:39.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.982+0000 7f6eb81d1b80 10 client.26434 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:33:39.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.982+0000 7f6eb81d1b80 20 client.26434 populate_metadata read hostname 'smithi008' 2023-08-11T12:33:39.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.982+0000 7f6eb81d1b80 1 --2- 172.21.15.8:0/784781058 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556ee85e43e0 0x556ee85e6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:39.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.982+0000 7f6eb81d1b80 4 client.26434 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:33:39.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.982+0000 7f6eb81d1b80 1 -- 172.21.15.8:0/784781058 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556ee85994e0 con 0x556ee85e43e0 2023-08-11T12:33:39.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.982+0000 7f6ea1d9a700 1 --2- 172.21.15.8:0/784781058 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556ee85e43e0 0x556ee85e6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:39.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.983+0000 7f6e85ffb700 10 client.26434 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:33:39.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.983+0000 7f6ea1d9a700 1 --2- 172.21.15.8:0/784781058 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556ee85e43e0 0x556ee85e6800 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cf5672c72bdc35 server_cookie=87a49c3ef18bbde4 in_seq=0 out_seq=0 2023-08-11T12:33:39.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.983+0000 7f6e85ffb700 1 -- 172.21.15.8:0/784781058 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x556ee85994e0 con 0x556ee85e43e0 2023-08-11T12:33:39.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.983+0000 7f6e85ffb700 10 client.26434 handle_command_reply: tid=0 2023-08-11T12:33:39.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.984+0000 7f6eb81d1b80 1 client.26434 shutdown 2023-08-11T12:33:39.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.984+0000 7f6eb81d1b80 1 -- 172.21.15.8:0/784781058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ee85d0310 msgr2=0x556ee85d3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:33:39.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.984+0000 7f6eb81d1b80 1 --2- 172.21.15.8:0/784781058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ee85d0310 0x556ee85d3de0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6e98005920 tx=0x7f6e9800ee70 comp rx=0 tx=0).stop 2023-08-11T12:33:39.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.984+0000 7f6eb81d1b80 1 -- 172.21.15.8:0/784781058 shutdown_connections 2023-08-11T12:33:39.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.984+0000 7f6eb81d1b80 1 --2- 172.21.15.8:0/784781058 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556ee85e43e0 0x556ee85e6800 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:39.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.984+0000 7f6eb81d1b80 1 --2- 172.21.15.8:0/784781058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556ee85d0c30 0x556ee85d43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:39.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.984+0000 7f6eb81d1b80 1 --2- 172.21.15.8:0/784781058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ee85cae20 0x556ee85d6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:39.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.984+0000 7f6eb81d1b80 1 --2- 172.21.15.8:0/784781058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ee85d0310 0x556ee85d3de0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:39.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.984+0000 7f6e85ffb700 0 client.26434 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:33:39.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.984+0000 7f6eb81d1b80 1 -- 172.21.15.8:0/784781058 >> 172.21.15.8:0/784781058 conn(0x556ee84f7950 msgr2=0x556ee85bfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:33:39.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.984+0000 7f6eb81d1b80 1 -- 172.21.15.8:0/784781058 shutdown_connections 2023-08-11T12:33:39.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.984+0000 7f6eb81d1b80 1 -- 172.21.15.8:0/784781058 wait complete. 2023-08-11T12:33:39.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:38.984+0000 7f6eb81d1b80 20 client.26434 trim_cache size 0 max 16384 2023-08-11T12:33:39.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.002+0000 7f6eb81d1b80 1 Processor -- start 2023-08-11T12:33:39.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.002+0000 7f6eb81d1b80 1 -- start start 2023-08-11T12:33:39.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.002+0000 7f6eb81d1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ee85cae20 0x556ee85ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:39.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.002+0000 7f6eb81d1b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556ee85d0310 0x556ee85ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:39.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.002+0000 7f6eb81d1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ee85d0c30 0x556ee85d65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:39.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.002+0000 7f6eb81d1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee85c60a0 con 0x556ee85cae20 2023-08-11T12:33:39.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.002+0000 7f6eb81d1b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee85cff90 con 0x556ee85d0310 2023-08-11T12:33:39.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.002+0000 7f6eb81d1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee85e04b0 con 0x556ee85d0c30 2023-08-11T12:33:39.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.002+0000 7f6ea259b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556ee85d0310 0x556ee85ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:39.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.002+0000 7f6ea1d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ee85cae20 0x556ee85ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:39.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.002+0000 7f6ea259b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556ee85d0310 0x556ee85ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:47986/0 (socket says 172.21.15.8:47986) 2023-08-11T12:33:39.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.002+0000 7f6ea259b700 1 -- 172.21.15.8:0/3444938615 learned_addr learned my addr 172.21.15.8:0/3444938615 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:33:39.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.003+0000 7f6ea259b700 1 -- 172.21.15.8:0/3444938615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ee85d0c30 msgr2=0x556ee85d65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:33:39.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.003+0000 7f6ea259b700 1 --2- 172.21.15.8:0/3444938615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ee85d0c30 0x556ee85d65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:39.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.003+0000 7f6ea259b700 1 -- 172.21.15.8:0/3444938615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ee85cae20 msgr2=0x556ee85ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:33:39.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.003+0000 7f6ea259b700 1 --2- 172.21.15.8:0/3444938615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ee85cae20 0x556ee85ca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:39.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.003+0000 7f6ea259b700 1 -- 172.21.15.8:0/3444938615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ee8331c60 con 0x556ee85d0310 2023-08-11T12:33:39.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.003+0000 7f6ea259b700 1 --2- 172.21.15.8:0/3444938615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556ee85d0310 0x556ee85ce0e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6e98011510 tx=0x7f6e98023450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8639c2525b4cb9c server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:33:39.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.003+0000 7f6e917fa700 1 -- 172.21.15.8:0/3444938615 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e98019dc0 con 0x556ee85d0310 2023-08-11T12:33:39.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.003+0000 7f6e917fa700 1 -- 172.21.15.8:0/3444938615 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e98015070 con 0x556ee85d0310 2023-08-11T12:33:39.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.003+0000 7f6e917fa700 1 -- 172.21.15.8:0/3444938615 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e98023a00 con 0x556ee85d0310 2023-08-11T12:33:39.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.004+0000 7f6eb81d1b80 1 -- 172.21.15.8:0/3444938615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556ee85d0310 msgr2=0x556ee85ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:33:39.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.004+0000 7f6eb81d1b80 1 --2- 172.21.15.8:0/3444938615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556ee85d0310 0x556ee85ce0e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6e98011510 tx=0x7f6e98023450 comp rx=0 tx=0).stop 2023-08-11T12:33:39.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.004+0000 7f6eb81d1b80 1 -- 172.21.15.8:0/3444938615 shutdown_connections 2023-08-11T12:33:39.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.004+0000 7f6eb81d1b80 1 --2- 172.21.15.8:0/3444938615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ee85d0c30 0x556ee85d65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:39.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.004+0000 7f6eb81d1b80 1 --2- 172.21.15.8:0/3444938615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ee85cae20 0x556ee85ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:39.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.004+0000 7f6eb81d1b80 1 --2- 172.21.15.8:0/3444938615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556ee85d0310 0x556ee85ce0e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:39.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.004+0000 7f6eb81d1b80 1 -- 172.21.15.8:0/3444938615 >> 172.21.15.8:0/3444938615 conn(0x556ee84f7950 msgr2=0x556ee85c5340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:33:39.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.004+0000 7f6eb81d1b80 1 -- 172.21.15.8:0/3444938615 shutdown_connections 2023-08-11T12:33:39.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.004+0000 7f6eb81d1b80 1 -- 172.21.15.8:0/3444938615 wait complete. 2023-08-11T12:33:39.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.004+0000 7f6eb81d1b80 1 -- start start 2023-08-11T12:33:39.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.005+0000 7f6eb81d1b80 1 Processor -- start 2023-08-11T12:33:39.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.005+0000 7f6eb81d1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ee85cae20 0x556ee85d9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:39.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.005+0000 7f6eb81d1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ee85d0310 0x556ee85d9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:39.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.005+0000 7f6eb81d1b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556ee85d0c30 0x556ee8637090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:39.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.005+0000 7f6eb81d1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee85da3a0 con 0x556ee85cae20 2023-08-11T12:33:39.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.005+0000 7f6eb81d1b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee86375d0 con 0x556ee85d0c30 2023-08-11T12:33:39.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.005+0000 7f6eb81d1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee8637710 con 0x556ee85d0310 2023-08-11T12:33:39.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.005+0000 7f6eb81d1b80 10 client.0 _ll_register_callbacks cb 0x7f6e98005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:33:39.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.005+0000 7f6ea1d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ee85cae20 0x556ee85d9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:39.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.005+0000 7f6ea1d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ee85cae20 0x556ee85d9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44592/0 (socket says 172.21.15.8:44592) 2023-08-11T12:33:39.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.005+0000 7f6ea1d9a700 1 -- 172.21.15.8:0/3951260976 learned_addr learned my addr 172.21.15.8:0/3951260976 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:33:39.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.005+0000 7f6ea1d9a700 1 --2- 172.21.15.8:0/3951260976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556ee85d0c30 0x556ee8637090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:39.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.005+0000 7f6ea259b700 1 --2- 172.21.15.8:0/3951260976 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ee85d0310 0x556ee85d9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:39.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.006+0000 7f6ea1d9a700 1 -- 172.21.15.8:0/3951260976 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ee85d0310 msgr2=0x556ee85d9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:33:39.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.006+0000 7f6ea1d9a700 1 --2- 172.21.15.8:0/3951260976 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ee85d0310 0x556ee85d9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:39.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.006+0000 7f6ea1d9a700 1 -- 172.21.15.8:0/3951260976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556ee85d0c30 msgr2=0x556ee8637090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:33:39.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.006+0000 7f6ea1d9a700 1 --2- 172.21.15.8:0/3951260976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556ee85d0c30 0x556ee8637090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:39.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.006+0000 7f6ea1d9a700 1 -- 172.21.15.8:0/3951260976 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556ee8348de0 con 0x556ee85cae20 2023-08-11T12:33:39.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.006+0000 7f6ea1d9a700 1 --2- 172.21.15.8:0/3951260976 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ee85cae20 0x556ee85d9570 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c005b40 tx=0x7f6e8c0058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e14f104a9add9 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:33:39.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.006+0000 7f6e85ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:33:39.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.006+0000 7f6e85ffb700 1 -- 172.21.15.8:0/3951260976 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c01d040 con 0x556ee85cae20 2023-08-11T12:33:39.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.006+0000 7f6e85ffb700 1 -- 172.21.15.8:0/3951260976 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9366+0+0 (secure 0 0 0) 0x7f6e8c02e3a0 con 0x556ee85cae20 2023-08-11T12:33:39.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.006+0000 7f6eb81d1b80 1 -- 172.21.15.8:0/3951260976 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6e98019c50 con 0x556ee85cae20 2023-08-11T12:33:39.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.006+0000 7f6e85ffb700 1 -- 172.21.15.8:0/3951260976 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e8c02ea80 con 0x556ee85cae20 2023-08-11T12:33:39.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.006+0000 7f6eb81d1b80 10 client.16392 fetch_fsmap learned FSMap version 54 2023-08-11T12:33:39.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.006+0000 7f6eb81d1b80 1 -- 172.21.15.8:0/3951260976 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x556ee836f250 con 0x556ee85cae20 2023-08-11T12:33:39.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.007+0000 7f6e85ffb700 1 -- 172.21.15.8:0/3951260976 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e98019c50 con 0x556ee85cae20 2023-08-11T12:33:39.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.007+0000 7f6e85ffb700 1 -- 172.21.15.8:0/3951260976 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6e8c030110 con 0x556ee85cae20 2023-08-11T12:33:39.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.007+0000 7f6eb81d1b80 10 client.16392 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:33:39.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.007+0000 7f6eb81d1b80 10 client.16392 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:33:39.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.007+0000 7f6eb81d1b80 20 client.16392 populate_metadata read hostname 'smithi008' 2023-08-11T12:33:39.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.007+0000 7f6eb81d1b80 1 --2- 172.21.15.8:0/3951260976 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556ee8638e40 0x556ee863b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:33:39.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.007+0000 7f6eb81d1b80 4 client.16392 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:33:39.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.007+0000 7f6eb81d1b80 1 -- 172.21.15.8:0/3951260976 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556ee8515820 con 0x556ee8638e40 2023-08-11T12:33:39.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.007+0000 7f6ea259b700 1 --2- 172.21.15.8:0/3951260976 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556ee8638e40 0x556ee863b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:33:39.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.008+0000 7f6e85ffb700 10 client.16392 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:33:39.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.008+0000 7f6ea259b700 1 --2- 172.21.15.8:0/3951260976 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556ee8638e40 0x556ee863b260 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29e641abf02aadff server_cookie=5d8cbc108eec7679 in_seq=0 out_seq=0 2023-08-11T12:33:39.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.008+0000 7f6e85ffb700 1 -- 172.21.15.8:0/3951260976 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x556ee8515820 con 0x556ee8638e40 2023-08-11T12:33:39.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.008+0000 7f6e85ffb700 10 client.16392 handle_command_reply: tid=0 2023-08-11T12:33:39.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.008+0000 7f6eb81d1b80 1 client.16392 shutdown 2023-08-11T12:33:39.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.008+0000 7f6eb81d1b80 1 -- 172.21.15.8:0/3951260976 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ee85cae20 msgr2=0x556ee85d9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:33:39.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.008+0000 7f6eb81d1b80 1 --2- 172.21.15.8:0/3951260976 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ee85cae20 0x556ee85d9570 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c005b40 tx=0x7f6e8c0058e0 comp rx=0 tx=0).stop 2023-08-11T12:33:39.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.008+0000 7f6eb81d1b80 1 -- 172.21.15.8:0/3951260976 shutdown_connections 2023-08-11T12:33:39.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.008+0000 7f6eb81d1b80 1 --2- 172.21.15.8:0/3951260976 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x556ee8638e40 0x556ee863b260 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:39.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.008+0000 7f6eb81d1b80 1 --2- 172.21.15.8:0/3951260976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556ee85d0c30 0x556ee8637090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:39.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.008+0000 7f6eb81d1b80 1 --2- 172.21.15.8:0/3951260976 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ee85cae20 0x556ee85d9570 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:39.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.008+0000 7f6eb81d1b80 1 --2- 172.21.15.8:0/3951260976 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ee85d0310 0x556ee85d9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:39.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.008+0000 7f6e85ffb700 0 client.16392 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:33:39.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.008+0000 7f6eb81d1b80 1 -- 172.21.15.8:0/3951260976 >> 172.21.15.8:0/3951260976 conn(0x556ee84f7950 msgr2=0x556ee85ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:33:39.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.008+0000 7f6eb81d1b80 1 -- 172.21.15.8:0/3951260976 shutdown_connections 2023-08-11T12:33:39.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.008+0000 7f6eb81d1b80 1 -- 172.21.15.8:0/3951260976 wait complete. 2023-08-11T12:33:39.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.008+0000 7f6eb81d1b80 20 client.16392 trim_cache size 0 max 16384 2023-08-11T12:33:39.029 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:33:39.029 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:33:39.030 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:33:39.030 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:33:39.030 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:33:39.030 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:33:39.030 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:33:39.031 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:33:39.031 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:33:39.031 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:33:39.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.009+0000 7f6ea47ff700 1 -- 172.21.15.8:0/851936808 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f6e880a00c0 msgr2=0x7f6e880a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:33:39.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.009+0000 7f6ea47ff700 1 --2- 172.21.15.8:0/851936808 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f6e880a00c0 0x7f6e880a2580 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6e940c8920 tx=0x7f6e9400c820 comp rx=0 tx=0).stop 2023-08-11T12:33:39.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.009+0000 7f6ea47ff700 1 -- 172.21.15.8:0/851936808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e9c111970 msgr2=0x7f6e9c1a1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:33:39.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.009+0000 7f6ea47ff700 1 --2- 172.21.15.8:0/851936808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e9c111970 0x7f6e9c1a1a60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6e9400ef90 tx=0x7f6e9400c3a0 comp rx=0 tx=0).stop 2023-08-11T12:33:39.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.009+0000 7f6ea47ff700 1 -- 172.21.15.8:0/851936808 shutdown_connections 2023-08-11T12:33:39.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.009+0000 7f6ea47ff700 1 --2- 172.21.15.8:0/851936808 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f6e880a00c0 0x7f6e880a2580 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:39.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.009+0000 7f6ea47ff700 1 --2- 172.21.15.8:0/851936808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e9c072cc0 0x7f6e9c19d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:39.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.009+0000 7f6ea47ff700 1 --2- 172.21.15.8:0/851936808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e9c111970 0x7f6e9c1a1a60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:39.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.009+0000 7f6ea47ff700 1 --2- 172.21.15.8:0/851936808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e9c0735e0 0x7f6e9c19d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:33:39.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.009+0000 7f6ea47ff700 1 -- 172.21.15.8:0/851936808 >> 172.21.15.8:0/851936808 conn(0x7f6e9c0fc490 msgr2=0x7f6e9c0fd100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:33:39.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.009+0000 7f6ea47ff700 1 -- 172.21.15.8:0/851936808 shutdown_connections 2023-08-11T12:33:39.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:33:39.009+0000 7f6ea47ff700 1 -- 172.21.15.8:0/851936808 wait complete. 2023-08-11T12:33:39.035 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:33:41.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:40 smithi194 ceph-mon[130905]: pgmap v281: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:41.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:40 smithi045 ceph-mon[130284]: pgmap v281: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:41.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:40 smithi008 ceph-mon[97158]: pgmap v281: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:42.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:42 smithi008 ceph-mon[97158]: pgmap v282: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:33:42.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:42 smithi194 ceph-mon[130905]: pgmap v282: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:33:42.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:42 smithi045 ceph-mon[130284]: pgmap v282: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:33:44.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:44 smithi008 ceph-mon[97158]: pgmap v283: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:44.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:44 smithi194 ceph-mon[130905]: pgmap v283: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:44.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:44 smithi045 ceph-mon[130284]: pgmap v283: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:46.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:46 smithi008 ceph-mon[97158]: pgmap v284: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:46.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:46 smithi194 ceph-mon[130905]: pgmap v284: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:46.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:46 smithi045 ceph-mon[130284]: pgmap v284: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:48.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:48 smithi008 ceph-mon[97158]: pgmap v285: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:33:48.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:48 smithi194 ceph-mon[130905]: pgmap v285: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:33:48.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:48 smithi045 ceph-mon[130284]: pgmap v285: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:33:51.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:50 smithi194 ceph-mon[130905]: pgmap v286: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:51.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:50 smithi045 ceph-mon[130284]: pgmap v286: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:51.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:50 smithi008 ceph-mon[97158]: pgmap v286: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:52.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:52 smithi008 ceph-mon[97158]: pgmap v287: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:33:52.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:52 smithi194 ceph-mon[130905]: pgmap v287: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:33:52.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:52 smithi045 ceph-mon[130284]: pgmap v287: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:33:54.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:54 smithi008 ceph-mon[97158]: pgmap v288: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:54.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:54 smithi194 ceph-mon[130905]: pgmap v288: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:54.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:54 smithi045 ceph-mon[130284]: pgmap v288: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:55.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:55 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:33:55.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:55 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:33:55.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:55 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:33:56.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:56 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:33:56.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:56 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:33:56.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:56 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:33:56.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:56 smithi008 ceph-mon[97158]: pgmap v289: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:56.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:56 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:33:56.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:56 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:33:56.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:56 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:33:56.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:56 smithi194 ceph-mon[130905]: pgmap v289: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:56.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:56 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:33:56.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:56 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:33:56.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:56 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:33:56.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:56 smithi045 ceph-mon[130284]: pgmap v289: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:33:58.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:33:58 smithi008 ceph-mon[97158]: pgmap v290: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:33:58.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:33:58 smithi194 ceph-mon[130905]: pgmap v290: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:33:58.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:33:58 smithi045 ceph-mon[130284]: pgmap v290: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:34:01.142 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:00 smithi194 ceph-mon[130905]: pgmap v291: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:34:01.144 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:00 smithi045 ceph-mon[130284]: pgmap v291: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:34:01.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:00 smithi008 ceph-mon[97158]: pgmap v291: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:34:02.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:02 smithi008 ceph-mon[97158]: pgmap v292: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-11T12:34:02.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:02 smithi194 ceph-mon[130905]: pgmap v292: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-11T12:34:02.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:02 smithi045 ceph-mon[130284]: pgmap v292: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-11T12:34:04.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:04 smithi008 ceph-mon[97158]: pgmap v293: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:34:04.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:04 smithi194 ceph-mon[130905]: pgmap v293: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:34:04.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:04 smithi045 ceph-mon[130284]: pgmap v293: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:34:06.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:06 smithi008 ceph-mon[97158]: pgmap v294: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:34:06.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:06 smithi194 ceph-mon[130905]: pgmap v294: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:34:06.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:06 smithi045 ceph-mon[130284]: pgmap v294: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:34:09.037 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:34:09.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:08 smithi008 ceph-mon[97158]: osdmap e97: 12 total, 12 up, 12 in 2023-08-11T12:34:09.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:08 smithi008 ceph-mon[97158]: pgmap v296: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:34:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:08 smithi194 ceph-mon[130905]: osdmap e97: 12 total, 12 up, 12 in 2023-08-11T12:34:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:08 smithi194 ceph-mon[130905]: pgmap v296: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:34:09.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:08 smithi045 ceph-mon[130284]: osdmap e97: 12 total, 12 up, 12 in 2023-08-11T12:34:09.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:08 smithi045 ceph-mon[130284]: pgmap v296: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:34:09.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.273+0000 7f83847ff700 1 -- 172.21.15.8:0/1645105889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f837c072d50 msgr2=0x7f837c073130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:34:09.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.273+0000 7f83847ff700 1 --2- 172.21.15.8:0/1645105889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f837c072d50 0x7f837c073130 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8378009990 tx=0x7f8378009ca0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.274+0000 7f83847ff700 1 -- 172.21.15.8:0/1645105889 shutdown_connections 2023-08-11T12:34:09.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.274+0000 7f83847ff700 1 --2- 172.21.15.8:0/1645105889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f837c10d1a0 0x7f837c10f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.274+0000 7f83847ff700 1 --2- 172.21.15.8:0/1645105889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f837c072d50 0x7f837c073130 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.274+0000 7f83847ff700 1 --2- 172.21.15.8:0/1645105889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f837c073670 0x7f837c10cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.274+0000 7f83847ff700 1 -- 172.21.15.8:0/1645105889 >> 172.21.15.8:0/1645105889 conn(0x7f837c0fc490 msgr2=0x7f837c0fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:34:09.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.274+0000 7f83847ff700 1 -- 172.21.15.8:0/1645105889 shutdown_connections 2023-08-11T12:34:09.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.274+0000 7f83847ff700 1 -- 172.21.15.8:0/1645105889 wait complete. 2023-08-11T12:34:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.275+0000 7f83847ff700 1 Processor -- start 2023-08-11T12:34:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.275+0000 7f83847ff700 1 -- start start 2023-08-11T12:34:09.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.275+0000 7f83847ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f837c072d50 0x7f837c198cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:09.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.275+0000 7f83847ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f837c073670 0x7f837c199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:09.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.275+0000 7f83847ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f837c10d1a0 0x7f837c19c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:09.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.275+0000 7f83847ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c19cbc0 con 0x7f837c10d1a0 2023-08-11T12:34:09.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.275+0000 7f83847ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c19cd30 con 0x7f837c072d50 2023-08-11T12:34:09.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.275+0000 7f83847ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c19cef0 con 0x7f837c073670 2023-08-11T12:34:09.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.275+0000 7f838259b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f837c072d50 0x7f837c198cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:09.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.275+0000 7f8382d9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f837c10d1a0 0x7f837c19c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:09.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.275+0000 7f838259b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f837c072d50 0x7f837c198cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:53994/0 (socket says 172.21.15.8:53994) 2023-08-11T12:34:09.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.275+0000 7f838259b700 1 -- 172.21.15.8:0/1603608391 learned_addr learned my addr 172.21.15.8:0/1603608391 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:34:09.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.276+0000 7f8381d9a700 1 --2- 172.21.15.8:0/1603608391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f837c073670 0x7f837c199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:09.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.276+0000 7f8382d9c700 1 -- 172.21.15.8:0/1603608391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f837c073670 msgr2=0x7f837c199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:34:09.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.276+0000 7f8382d9c700 1 --2- 172.21.15.8:0/1603608391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f837c073670 0x7f837c199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.276+0000 7f8382d9c700 1 -- 172.21.15.8:0/1603608391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f837c072d50 msgr2=0x7f837c198cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:34:09.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.276+0000 7f8382d9c700 1 --2- 172.21.15.8:0/1603608391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f837c072d50 0x7f837c198cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.276+0000 7f8382d9c700 1 -- 172.21.15.8:0/1603608391 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c009520 con 0x7f837c10d1a0 2023-08-11T12:34:09.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.276+0000 7f838259b700 1 --2- 172.21.15.8:0/1603608391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f837c072d50 0x7f837c198cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:34:09.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.276+0000 7f8382d9c700 1 --2- 172.21.15.8:0/1603608391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f837c10d1a0 0x7f837c19c5c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f837400efb0 tx=0x7f837400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:34:09.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.276+0000 7f83737fe700 1 -- 172.21.15.8:0/1603608391 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8374003a00 con 0x7f837c10d1a0 2023-08-11T12:34:09.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.276+0000 7f83737fe700 1 -- 172.21.15.8:0/1603608391 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f837400f040 con 0x7f837c10d1a0 2023-08-11T12:34:09.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.276+0000 7f83847ff700 1 -- 172.21.15.8:0/1603608391 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8374009c40 con 0x7f837c10d1a0 2023-08-11T12:34:09.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.276+0000 7f83737fe700 1 -- 172.21.15.8:0/1603608391 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8374004540 con 0x7f837c10d1a0 2023-08-11T12:34:09.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.277+0000 7f83847ff700 1 -- 172.21.15.8:0/1603608391 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83780095f0 con 0x7f837c10d1a0 2023-08-11T12:34:09.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.280+0000 7f83737fe700 1 -- 172.21.15.8:0/1603608391 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f8374003bf0 con 0x7f837c10d1a0 2023-08-11T12:34:09.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.281+0000 7f8398080b80 1 Processor -- start 2023-08-11T12:34:09.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.281+0000 7f8398080b80 1 -- start start 2023-08-11T12:34:09.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.281+0000 7f83737fe700 1 --2- 172.21.15.8:0/1603608391 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f83680a0140 0x7f83680a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:09.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.281+0000 7f8398080b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560dae8b3310 0x560dae8b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:09.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.281+0000 7f83737fe700 1 -- 172.21.15.8:0/1603608391 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 9454+0+0 (secure 0 0 0) 0x7f83740cb530 con 0x7f837c10d1a0 2023-08-11T12:34:09.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.281+0000 7f8398080b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560dae8b3c30 0x560dae8ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:09.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.281+0000 7f8398080b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560dae8ade20 0x560dae8ae260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:09.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.281+0000 7f8398080b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dae806630 con 0x560dae8b3c30 2023-08-11T12:34:09.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.281+0000 7f8398080b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dae803f50 con 0x560dae8b3310 2023-08-11T12:34:09.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.281+0000 7f8398080b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dae7ff840 con 0x560dae8ade20 2023-08-11T12:34:09.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.282+0000 7f8381d9a700 1 --2- 172.21.15.8:0/1603608391 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f83680a0140 0x7f83680a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:09.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.282+0000 7f838259b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560dae8b3310 0x560dae8b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:09.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.282+0000 7f838259b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560dae8b3310 0x560dae8b36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:54004/0 (socket says 172.21.15.8:54004) 2023-08-11T12:34:09.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.282+0000 7f838259b700 1 -- 172.21.15.8:0/194944978 learned_addr learned my addr 172.21.15.8:0/194944978 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:34:09.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.282+0000 7f8381d9a700 1 --2- 172.21.15.8:0/194944978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560dae8b3c30 0x560dae8ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:09.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.282+0000 7f8382d9c700 1 --2- 172.21.15.8:0/194944978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560dae8ade20 0x560dae8ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:09.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.282+0000 7f838259b700 1 -- 172.21.15.8:0/194944978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560dae8ade20 msgr2=0x560dae8ae260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:34:09.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.282+0000 7f838259b700 1 --2- 172.21.15.8:0/194944978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560dae8ade20 0x560dae8ae260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.282+0000 7f838259b700 1 -- 172.21.15.8:0/194944978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560dae8b3c30 msgr2=0x560dae8ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:34:09.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.282+0000 7f838259b700 1 --2- 172.21.15.8:0/194944978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560dae8b3c30 0x560dae8ad8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.282+0000 7f838259b700 1 -- 172.21.15.8:0/194944978 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560dae67f630 con 0x560dae8b3310 2023-08-11T12:34:09.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.282+0000 7f838259b700 1 --2- 172.21.15.8:0/194944978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560dae8b3310 0x560dae8b36f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f837800b640 tx=0x7f837800b670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91bec90542064d22 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:34:09.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.282+0000 7f8381d9a700 1 --2- 172.21.15.8:0/1603608391 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f83680a0140 0x7f83680a2600 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f836c009fd0 tx=0x7f836c009d80 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:34:09.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.283+0000 7f8370ff9700 1 -- 172.21.15.8:0/194944978 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837801d070 con 0x560dae8b3310 2023-08-11T12:34:09.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.283+0000 7f8370ff9700 1 -- 172.21.15.8:0/194944978 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f837801e040 con 0x560dae8b3310 2023-08-11T12:34:09.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.283+0000 7f8370ff9700 1 -- 172.21.15.8:0/194944978 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8378004d50 con 0x560dae8b3310 2023-08-11T12:34:09.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.283+0000 7f8398080b80 1 -- 172.21.15.8:0/194944978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560dae8b3310 msgr2=0x560dae8b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:34:09.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.283+0000 7f8398080b80 1 --2- 172.21.15.8:0/194944978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560dae8b3310 0x560dae8b36f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f837800b640 tx=0x7f837800b670 comp rx=0 tx=0).stop 2023-08-11T12:34:09.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.283+0000 7f8398080b80 1 -- 172.21.15.8:0/194944978 shutdown_connections 2023-08-11T12:34:09.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.283+0000 7f8398080b80 1 --2- 172.21.15.8:0/194944978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560dae8ade20 0x560dae8ae260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.283+0000 7f8398080b80 1 --2- 172.21.15.8:0/194944978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560dae8b3310 0x560dae8b36f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.283+0000 7f8398080b80 1 --2- 172.21.15.8:0/194944978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560dae8b3c30 0x560dae8ad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.283+0000 7f8398080b80 1 -- 172.21.15.8:0/194944978 >> 172.21.15.8:0/194944978 conn(0x560dae7da950 msgr2=0x560dae8a83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:34:09.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.284+0000 7f8398080b80 1 -- 172.21.15.8:0/194944978 shutdown_connections 2023-08-11T12:34:09.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.284+0000 7f8398080b80 1 -- 172.21.15.8:0/194944978 wait complete. 2023-08-11T12:34:09.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.284+0000 7f8398080b80 1 -- start start 2023-08-11T12:34:09.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.284+0000 7f8398080b80 1 Processor -- start 2023-08-11T12:34:09.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.285+0000 7f8398080b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560dae8ade20 0x560dae8b9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:09.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.285+0000 7f8398080b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560dae8b3310 0x560dae8b6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:09.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.285+0000 7f8398080b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560dae8b3c30 0x560dae8b7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:09.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.285+0000 7f8398080b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dae79dac0 con 0x560dae8b3c30 2023-08-11T12:34:09.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.285+0000 7f8398080b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dae79d7c0 con 0x560dae8ade20 2023-08-11T12:34:09.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.285+0000 7f8398080b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dae681920 con 0x560dae8b3310 2023-08-11T12:34:09.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.285+0000 7f8398080b80 10 client.0 _ll_register_callbacks cb 0x560dae7a0ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:34:09.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.285+0000 7f838259b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560dae8ade20 0x560dae8b9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:09.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.285+0000 7f8382d9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560dae8b3c30 0x560dae8b7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:09.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.285+0000 7f838259b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560dae8ade20 0x560dae8b9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:54012/0 (socket says 172.21.15.8:54012) 2023-08-11T12:34:09.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.285+0000 7f838259b700 1 -- 172.21.15.8:0/2974109264 learned_addr learned my addr 172.21.15.8:0/2974109264 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:34:09.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.285+0000 7f8381d9a700 1 --2- 172.21.15.8:0/2974109264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560dae8b3310 0x560dae8b6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:09.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.285+0000 7f838259b700 1 -- 172.21.15.8:0/2974109264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560dae8b3310 msgr2=0x560dae8b6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:34:09.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.285+0000 7f838259b700 1 --2- 172.21.15.8:0/2974109264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560dae8b3310 0x560dae8b6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.285+0000 7f838259b700 1 -- 172.21.15.8:0/2974109264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560dae8b3c30 msgr2=0x560dae8b7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:34:09.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.285+0000 7f838259b700 1 --2- 172.21.15.8:0/2974109264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560dae8b3c30 0x560dae8b7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.285+0000 7f838259b700 1 -- 172.21.15.8:0/2974109264 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837c1102d0 con 0x560dae8ade20 2023-08-11T12:34:09.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.285+0000 7f8382d9c700 1 --2- 172.21.15.8:0/2974109264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560dae8b3c30 0x560dae8b7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:34:09.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.286+0000 7f838259b700 1 --2- 172.21.15.8:0/2974109264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560dae8ade20 0x560dae8b9ad0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8378000c00 tx=0x7f8378022690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=665e430d5390ba01 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:34:09.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.286+0000 7f8365ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:34:09.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.286+0000 7f8365ffb700 1 -- 172.21.15.8:0/2974109264 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837801d030 con 0x560dae8ade20 2023-08-11T12:34:09.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.286+0000 7f8398080b80 1 -- 172.21.15.8:0/2974109264 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560dae8a0a90 con 0x560dae8ade20 2023-08-11T12:34:09.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.286+0000 7f8365ffb700 1 -- 172.21.15.8:0/2974109264 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 9454+0+0 (secure 0 0 0) 0x7f8378022d40 con 0x560dae8ade20 2023-08-11T12:34:09.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.286+0000 7f8365ffb700 1 -- 172.21.15.8:0/2974109264 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f837800f460 con 0x560dae8ade20 2023-08-11T12:34:09.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.286+0000 7f8398080b80 10 client.26444 fetch_fsmap learned FSMap version 54 2023-08-11T12:34:09.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.286+0000 7f8398080b80 1 -- 172.21.15.8:0/2974109264 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x560dae62bde0 con 0x560dae8ade20 2023-08-11T12:34:09.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.287+0000 7f8365ffb700 1 -- 172.21.15.8:0/2974109264 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560dae8a0a90 con 0x560dae8ade20 2023-08-11T12:34:09.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.287+0000 7f8365ffb700 1 -- 172.21.15.8:0/2974109264 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f837802c540 con 0x560dae8ade20 2023-08-11T12:34:09.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.287+0000 7f8398080b80 10 client.26444 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:34:09.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.287+0000 7f8398080b80 10 client.26444 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:34:09.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.287+0000 7f8398080b80 20 client.26444 populate_metadata read hostname 'smithi008' 2023-08-11T12:34:09.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.287+0000 7f8398080b80 1 --2- 172.21.15.8:0/2974109264 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x560dae8c7020 0x560dae8c9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:09.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.287+0000 7f8398080b80 4 client.26444 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:34:09.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.287+0000 7f8398080b80 1 -- 172.21.15.8:0/2974109264 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560dae87c4e0 con 0x560dae8c7020 2023-08-11T12:34:09.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.287+0000 7f8381d9a700 1 --2- 172.21.15.8:0/2974109264 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x560dae8c7020 0x560dae8c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:09.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.288+0000 7f8381d9a700 1 --2- 172.21.15.8:0/2974109264 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x560dae8c7020 0x560dae8c9440 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31bad4597aabe4ae server_cookie=f2ecfaaafcc9c1bf in_seq=0 out_seq=0 2023-08-11T12:34:09.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.288+0000 7f8365ffb700 10 client.26444 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:34:09.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.288+0000 7f8365ffb700 1 -- 172.21.15.8:0/2974109264 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x560dae87c4e0 con 0x560dae8c7020 2023-08-11T12:34:09.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.289+0000 7f8365ffb700 10 client.26444 handle_command_reply: tid=0 2023-08-11T12:34:09.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.289+0000 7f8398080b80 1 client.26444 shutdown 2023-08-11T12:34:09.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.289+0000 7f8398080b80 1 -- 172.21.15.8:0/2974109264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560dae8ade20 msgr2=0x560dae8b9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:34:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.289+0000 7f8398080b80 1 --2- 172.21.15.8:0/2974109264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560dae8ade20 0x560dae8b9ad0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8378000c00 tx=0x7f8378022690 comp rx=0 tx=0).stop 2023-08-11T12:34:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.289+0000 7f8398080b80 1 -- 172.21.15.8:0/2974109264 shutdown_connections 2023-08-11T12:34:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.289+0000 7f8398080b80 1 --2- 172.21.15.8:0/2974109264 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x560dae8c7020 0x560dae8c9440 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.289+0000 7f8398080b80 1 --2- 172.21.15.8:0/2974109264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560dae8b3c30 0x560dae8b7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.289+0000 7f8365ffb700 0 client.26444 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:34:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.289+0000 7f8398080b80 1 --2- 172.21.15.8:0/2974109264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560dae8ade20 0x560dae8b9ad0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.289+0000 7f8398080b80 1 --2- 172.21.15.8:0/2974109264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560dae8b3310 0x560dae8b6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.289+0000 7f8398080b80 1 -- 172.21.15.8:0/2974109264 >> 172.21.15.8:0/2974109264 conn(0x560dae7da950 msgr2=0x560dae8a2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:34:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.289+0000 7f8398080b80 1 -- 172.21.15.8:0/2974109264 shutdown_connections 2023-08-11T12:34:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.289+0000 7f8398080b80 1 -- 172.21.15.8:0/2974109264 wait complete. 2023-08-11T12:34:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.289+0000 7f8398080b80 20 client.26444 trim_cache size 0 max 16384 2023-08-11T12:34:09.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.306+0000 7f8398080b80 1 Processor -- start 2023-08-11T12:34:09.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.306+0000 7f8398080b80 1 -- start start 2023-08-11T12:34:09.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.307+0000 7f8398080b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560dae8ade20 0x560dae8b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:09.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.307+0000 7f8398080b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560dae8b3310 0x560dae8be560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:09.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.307+0000 7f8398080b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560dae8b3c30 0x560dae8a2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:09.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.307+0000 7f8398080b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dae8b83d0 con 0x560dae8b3310 2023-08-11T12:34:09.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.307+0000 7f8398080b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dae8a9be0 con 0x560dae8ade20 2023-08-11T12:34:09.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.307+0000 7f8398080b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dae8a4b30 con 0x560dae8b3c30 2023-08-11T12:34:09.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.307+0000 7f8381d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560dae8b3310 0x560dae8be560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:09.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.307+0000 7f8381d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560dae8b3310 0x560dae8be560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44246/0 (socket says 172.21.15.8:44246) 2023-08-11T12:34:09.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.307+0000 7f8381d9a700 1 -- 172.21.15.8:0/2387786889 learned_addr learned my addr 172.21.15.8:0/2387786889 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:34:09.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.307+0000 7f838259b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560dae8ade20 0x560dae8b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:09.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.307+0000 7f8382d9c700 1 --2- 172.21.15.8:0/2387786889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560dae8b3c30 0x560dae8a2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:09.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.307+0000 7f8381d9a700 1 -- 172.21.15.8:0/2387786889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560dae8b3c30 msgr2=0x560dae8a2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:34:09.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.307+0000 7f8381d9a700 1 --2- 172.21.15.8:0/2387786889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560dae8b3c30 0x560dae8a2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.307+0000 7f8381d9a700 1 -- 172.21.15.8:0/2387786889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560dae8ade20 msgr2=0x560dae8b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:34:09.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.307+0000 7f8381d9a700 1 --2- 172.21.15.8:0/2387786889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560dae8ade20 0x560dae8b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.307+0000 7f8381d9a700 1 -- 172.21.15.8:0/2387786889 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560dae614c60 con 0x560dae8b3310 2023-08-11T12:34:09.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.308+0000 7f8381d9a700 1 --2- 172.21.15.8:0/2387786889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560dae8b3310 0x560dae8be560 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f837c19a2a0 tx=0x7f836c021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dcd7fe6c5db9497 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:34:09.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.308+0000 7f83717fa700 1 -- 172.21.15.8:0/2387786889 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c016040 con 0x560dae8b3310 2023-08-11T12:34:09.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.308+0000 7f83717fa700 1 -- 172.21.15.8:0/2387786889 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f836c02f070 con 0x560dae8b3310 2023-08-11T12:34:09.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.308+0000 7f83717fa700 1 -- 172.21.15.8:0/2387786889 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c00fe10 con 0x560dae8b3310 2023-08-11T12:34:09.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.308+0000 7f8398080b80 1 -- 172.21.15.8:0/2387786889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560dae8b3310 msgr2=0x560dae8be560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:34:09.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.308+0000 7f8398080b80 1 --2- 172.21.15.8:0/2387786889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560dae8b3310 0x560dae8be560 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f837c19a2a0 tx=0x7f836c021000 comp rx=0 tx=0).stop 2023-08-11T12:34:09.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.309+0000 7f8398080b80 1 -- 172.21.15.8:0/2387786889 shutdown_connections 2023-08-11T12:34:09.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.309+0000 7f8398080b80 1 --2- 172.21.15.8:0/2387786889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560dae8b3c30 0x560dae8a2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.309+0000 7f8398080b80 1 --2- 172.21.15.8:0/2387786889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560dae8ade20 0x560dae8b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.309+0000 7f8398080b80 1 --2- 172.21.15.8:0/2387786889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560dae8b3310 0x560dae8be560 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.309+0000 7f8398080b80 1 -- 172.21.15.8:0/2387786889 >> 172.21.15.8:0/2387786889 conn(0x560dae7da950 msgr2=0x560dae8a2420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:34:09.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.309+0000 7f8398080b80 1 -- 172.21.15.8:0/2387786889 shutdown_connections 2023-08-11T12:34:09.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.309+0000 7f8398080b80 1 -- 172.21.15.8:0/2387786889 wait complete. 2023-08-11T12:34:09.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.309+0000 7f8398080b80 1 -- start start 2023-08-11T12:34:09.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.309+0000 7f8398080b80 1 Processor -- start 2023-08-11T12:34:09.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.310+0000 7f8398080b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560dae8ade20 0x560dae90ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:09.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.310+0000 7f8398080b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560dae8b3310 0x560dae90f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:09.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.310+0000 7f8398080b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560dae8b3c30 0x560dae919ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:09.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.310+0000 7f8398080b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dae91a1e0 con 0x560dae8b3310 2023-08-11T12:34:09.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.310+0000 7f8398080b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dae91a320 con 0x560dae8ade20 2023-08-11T12:34:09.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.310+0000 7f8398080b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dae91a4e0 con 0x560dae8b3c30 2023-08-11T12:34:09.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.310+0000 7f8398080b80 10 client.0 _ll_register_callbacks cb 0x7f836c0116a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:34:09.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.310+0000 7f838259b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560dae8ade20 0x560dae90ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:09.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.310+0000 7f838259b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560dae8ade20 0x560dae90ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:54016/0 (socket says 172.21.15.8:54016) 2023-08-11T12:34:09.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.310+0000 7f838259b700 1 -- 172.21.15.8:0/658598425 learned_addr learned my addr 172.21.15.8:0/658598425 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:34:09.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.310+0000 7f8381d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560dae8b3310 0x560dae90f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:09.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.310+0000 7f8382d9c700 1 --2- 172.21.15.8:0/658598425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560dae8b3c30 0x560dae919ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:09.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.310+0000 7f838259b700 1 -- 172.21.15.8:0/658598425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560dae8b3c30 msgr2=0x560dae919ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:34:09.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.310+0000 7f838259b700 1 --2- 172.21.15.8:0/658598425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560dae8b3c30 0x560dae919ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.310+0000 7f838259b700 1 -- 172.21.15.8:0/658598425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560dae8b3310 msgr2=0x560dae90f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:34:09.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.310+0000 7f838259b700 1 --2- 172.21.15.8:0/658598425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560dae8b3310 0x560dae90f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.310+0000 7f838259b700 1 -- 172.21.15.8:0/658598425 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f836c025040 con 0x560dae8ade20 2023-08-11T12:34:09.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.310+0000 7f8382d9c700 1 --2- 172.21.15.8:0/658598425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560dae8b3c30 0x560dae919ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:34:09.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.310+0000 7f8381d9a700 1 --2- 172.21.15.8:0/658598425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560dae8b3310 0x560dae90f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:34:09.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.311+0000 7f838259b700 1 --2- 172.21.15.8:0/658598425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560dae8ade20 0x560dae90ee10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8378005f50 tx=0x7f837802c630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b3bb7592e179306 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:34:09.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.311+0000 7f8365ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:34:09.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.311+0000 7f8365ffb700 1 -- 172.21.15.8:0/658598425 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837801d070 con 0x560dae8ade20 2023-08-11T12:34:09.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.311+0000 7f8365ffb700 1 -- 172.21.15.8:0/658598425 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 9454+0+0 (secure 0 0 0) 0x7f837802cc10 con 0x560dae8ade20 2023-08-11T12:34:09.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.311+0000 7f8398080b80 1 -- 172.21.15.8:0/658598425 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f837801e040 con 0x560dae8ade20 2023-08-11T12:34:09.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.311+0000 7f8365ffb700 1 -- 172.21.15.8:0/658598425 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f837800bee0 con 0x560dae8ade20 2023-08-11T12:34:09.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.311+0000 7f8398080b80 10 client.26450 fetch_fsmap learned FSMap version 54 2023-08-11T12:34:09.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.311+0000 7f8398080b80 1 -- 172.21.15.8:0/658598425 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x560dae652250 con 0x560dae8ade20 2023-08-11T12:34:09.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.311+0000 7f8365ffb700 1 -- 172.21.15.8:0/658598425 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f837801e040 con 0x560dae8ade20 2023-08-11T12:34:09.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.311+0000 7f8365ffb700 1 -- 172.21.15.8:0/658598425 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8378005460 con 0x560dae8ade20 2023-08-11T12:34:09.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.311+0000 7f8398080b80 10 client.26450 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:34:09.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.311+0000 7f8398080b80 10 client.26450 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:34:09.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.311+0000 7f8398080b80 20 client.26450 populate_metadata read hostname 'smithi008' 2023-08-11T12:34:09.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.311+0000 7f8398080b80 1 --2- 172.21.15.8:0/658598425 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x560dae91b860 0x560dae91dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:09.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.311+0000 7f8398080b80 4 client.26450 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:34:09.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.312+0000 7f8398080b80 1 -- 172.21.15.8:0/658598425 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560dae7f8820 con 0x560dae91b860 2023-08-11T12:34:09.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.312+0000 7f8381d9a700 1 --2- 172.21.15.8:0/658598425 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x560dae91b860 0x560dae91dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:09.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.312+0000 7f8365ffb700 10 client.26450 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:34:09.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.312+0000 7f8381d9a700 1 --2- 172.21.15.8:0/658598425 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x560dae91b860 0x560dae91dc80 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=977851f4daba76bc server_cookie=7f08e877478a2398 in_seq=0 out_seq=0 2023-08-11T12:34:09.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.312+0000 7f8365ffb700 1 -- 172.21.15.8:0/658598425 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x560dae7f8820 con 0x560dae91b860 2023-08-11T12:34:09.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.312+0000 7f8365ffb700 10 client.26450 handle_command_reply: tid=0 2023-08-11T12:34:09.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.312+0000 7f8398080b80 1 client.26450 shutdown 2023-08-11T12:34:09.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.313+0000 7f8398080b80 1 -- 172.21.15.8:0/658598425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560dae8ade20 msgr2=0x560dae90ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:34:09.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.313+0000 7f8398080b80 1 --2- 172.21.15.8:0/658598425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560dae8ade20 0x560dae90ee10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8378005f50 tx=0x7f837802c630 comp rx=0 tx=0).stop 2023-08-11T12:34:09.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.313+0000 7f8398080b80 1 -- 172.21.15.8:0/658598425 shutdown_connections 2023-08-11T12:34:09.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.313+0000 7f8398080b80 1 --2- 172.21.15.8:0/658598425 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x560dae91b860 0x560dae91dc80 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.313+0000 7f8398080b80 1 --2- 172.21.15.8:0/658598425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560dae8b3c30 0x560dae919ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.313+0000 7f8398080b80 1 --2- 172.21.15.8:0/658598425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560dae8ade20 0x560dae90ee10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.313+0000 7f8398080b80 1 --2- 172.21.15.8:0/658598425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560dae8b3310 0x560dae90f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.313+0000 7f8365ffb700 0 client.26450 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:34:09.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.313+0000 7f8398080b80 1 -- 172.21.15.8:0/658598425 >> 172.21.15.8:0/658598425 conn(0x560dae7da950 msgr2=0x560dae8c2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:34:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.313+0000 7f8398080b80 1 -- 172.21.15.8:0/658598425 shutdown_connections 2023-08-11T12:34:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.313+0000 7f8398080b80 1 -- 172.21.15.8:0/658598425 wait complete. 2023-08-11T12:34:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.313+0000 7f8398080b80 20 client.26450 trim_cache size 0 max 16384 2023-08-11T12:34:09.329 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:34:09.330 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:34:09.330 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:34:09.330 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:34:09.330 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:34:09.331 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:34:09.331 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:34:09.331 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:34:09.331 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:34:09.331 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:34:09.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.313+0000 7f83847ff700 1 -- 172.21.15.8:0/1603608391 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f83680a0140 msgr2=0x7f83680a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:34:09.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.313+0000 7f83847ff700 1 --2- 172.21.15.8:0/1603608391 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f83680a0140 0x7f83680a2600 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f836c009fd0 tx=0x7f836c009d80 comp rx=0 tx=0).stop 2023-08-11T12:34:09.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.314+0000 7f83847ff700 1 -- 172.21.15.8:0/1603608391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f837c10d1a0 msgr2=0x7f837c19c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:34:09.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.314+0000 7f83847ff700 1 --2- 172.21.15.8:0/1603608391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f837c10d1a0 0x7f837c19c5c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f837400efb0 tx=0x7f837400c3a0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.314+0000 7f83847ff700 1 -- 172.21.15.8:0/1603608391 shutdown_connections 2023-08-11T12:34:09.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.314+0000 7f83847ff700 1 --2- 172.21.15.8:0/1603608391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f837c10d1a0 0x7f837c19c5c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.314+0000 7f83847ff700 1 --2- 172.21.15.8:0/1603608391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f837c072d50 0x7f837c198cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.314+0000 7f83847ff700 1 --2- 172.21.15.8:0/1603608391 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f83680a0140 0x7f83680a2600 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.314+0000 7f83847ff700 1 --2- 172.21.15.8:0/1603608391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f837c073670 0x7f837c199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:09.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.314+0000 7f83847ff700 1 -- 172.21.15.8:0/1603608391 >> 172.21.15.8:0/1603608391 conn(0x7f837c0fc490 msgr2=0x7f837c10f330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:34:09.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.314+0000 7f83847ff700 1 -- 172.21.15.8:0/1603608391 shutdown_connections 2023-08-11T12:34:09.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:09.314+0000 7f83847ff700 1 -- 172.21.15.8:0/1603608391 wait complete. 2023-08-11T12:34:09.335 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:34:11.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:10 smithi194 ceph-mon[130905]: pgmap v297: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:34:11.144 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:10 smithi045 ceph-mon[130284]: pgmap v297: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:34:11.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:10 smithi008 ceph-mon[97158]: pgmap v297: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:34:12.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:12 smithi008 ceph-mon[97158]: pgmap v298: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:34:12.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:12 smithi194 ceph-mon[130905]: pgmap v298: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:34:12.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:12 smithi045 ceph-mon[130284]: pgmap v298: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:34:14.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:14 smithi008 ceph-mon[97158]: pgmap v299: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:34:14.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:14 smithi194 ceph-mon[130905]: pgmap v299: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:34:14.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:14 smithi045 ceph-mon[130284]: pgmap v299: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:34:16.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:15 smithi194 ceph-mon[130905]: osdmap e98: 12 total, 12 up, 12 in 2023-08-11T12:34:16.144 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:15 smithi045 ceph-mon[130284]: osdmap e98: 12 total, 12 up, 12 in 2023-08-11T12:34:16.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:15 smithi008 ceph-mon[97158]: osdmap e98: 12 total, 12 up, 12 in 2023-08-11T12:34:17.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:16 smithi194 ceph-mon[130905]: pgmap v301: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 124 B/s wr, 6 op/s 2023-08-11T12:34:17.144 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:16 smithi045 ceph-mon[130284]: pgmap v301: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 124 B/s wr, 6 op/s 2023-08-11T12:34:17.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:16 smithi008 ceph-mon[97158]: pgmap v301: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 124 B/s wr, 6 op/s 2023-08-11T12:34:18.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:18 smithi008 ceph-mon[97158]: pgmap v302: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:34:18.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:18 smithi194 ceph-mon[130905]: pgmap v302: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:34:18.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:18 smithi045 ceph-mon[130284]: pgmap v302: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:34:21.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:20 smithi194 ceph-mon[130905]: pgmap v303: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:34:21.144 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:20 smithi045 ceph-mon[130284]: pgmap v303: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:34:21.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:20 smithi008 ceph-mon[97158]: pgmap v303: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:34:22.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:22 smithi008 ceph-mon[97158]: pgmap v304: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:34:22.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:22 smithi194 ceph-mon[130905]: pgmap v304: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:34:22.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:22 smithi045 ceph-mon[130284]: pgmap v304: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:34:24.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:24 smithi008 ceph-mon[97158]: pgmap v305: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:34:24.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:24 smithi194 ceph-mon[130905]: pgmap v305: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:34:24.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:24 smithi045 ceph-mon[130284]: pgmap v305: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:34:26.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:26 smithi008 ceph-mon[97158]: pgmap v306: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:34:26.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:26 smithi194 ceph-mon[130905]: pgmap v306: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:34:26.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:26 smithi045 ceph-mon[130284]: pgmap v306: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:34:28.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:28 smithi008 ceph-mon[97158]: pgmap v307: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:34:28.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:28 smithi194 ceph-mon[130905]: pgmap v307: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:34:28.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:28 smithi045 ceph-mon[130284]: pgmap v307: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:34:31.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:30 smithi008 ceph-mon[97158]: pgmap v308: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:34:31.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:30 smithi194 ceph-mon[130905]: pgmap v308: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:34:31.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:30 smithi045 ceph-mon[130284]: pgmap v308: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:34:32.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:32 smithi008 ceph-mon[97158]: pgmap v309: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:34:32.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:32 smithi194 ceph-mon[130905]: pgmap v309: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:34:32.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:32 smithi045 ceph-mon[130284]: pgmap v309: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:34:34.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:34 smithi008 ceph-mon[97158]: pgmap v310: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:34:34.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:34 smithi194 ceph-mon[130905]: pgmap v310: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:34:34.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:34 smithi045 ceph-mon[130284]: pgmap v310: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:34:36.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:36 smithi008 ceph-mon[97158]: pgmap v311: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:34:36.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:36 smithi194 ceph-mon[130905]: pgmap v311: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:34:36.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:36 smithi045 ceph-mon[130284]: pgmap v311: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:34:38.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:38 smithi008 ceph-mon[97158]: pgmap v312: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:34:38.308 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-08-11T12:34:38.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:38 smithi194 ceph-mon[130905]: pgmap v312: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:34:38.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:38 smithi045 ceph-mon[130284]: pgmap v312: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:34:38.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.518+0000 7f2b74bff700 1 -- 172.21.15.8:0/3230127847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b701068d0 msgr2=0x7f2b70106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:34:38.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.518+0000 7f2b74bff700 1 --2- 172.21.15.8:0/3230127847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b701068d0 0x7f2b70106cb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2b600098f0 tx=0x7f2b60009c00 comp rx=0 tx=0).stop 2023-08-11T12:34:38.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.518+0000 7f2b74bff700 1 -- 172.21.15.8:0/3230127847 shutdown_connections 2023-08-11T12:34:38.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.518+0000 7f2b74bff700 1 --2- 172.21.15.8:0/3230127847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b70101280 0x7f2b7010d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:38.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.518+0000 7f2b74bff700 1 --2- 172.21.15.8:0/3230127847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b701068d0 0x7f2b70106cb0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:38.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.518+0000 7f2b74bff700 1 --2- 172.21.15.8:0/3230127847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b701008c0 0x7f2b70100d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:38.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.518+0000 7f2b74bff700 1 -- 172.21.15.8:0/3230127847 >> 172.21.15.8:0/3230127847 conn(0x7f2b700fc3d0 msgr2=0x7f2b700fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:34:38.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.519+0000 7f2b74bff700 1 -- 172.21.15.8:0/3230127847 shutdown_connections 2023-08-11T12:34:38.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.519+0000 7f2b74bff700 1 -- 172.21.15.8:0/3230127847 wait complete. 2023-08-11T12:34:38.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.520+0000 7f2b74bff700 1 Processor -- start 2023-08-11T12:34:38.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.520+0000 7f2b74bff700 1 -- start start 2023-08-11T12:34:38.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.520+0000 7f2b74bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b701008c0 0x7f2b7019e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:38.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.520+0000 7f2b74bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b70101280 0x7f2b7019eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:38.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.520+0000 7f2b74bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b701068d0 0x7f2b701989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:38.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.520+0000 7f2b74bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b70199060 con 0x7f2b70101280 2023-08-11T12:34:38.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.520+0000 7f2b74bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b701991d0 con 0x7f2b701008c0 2023-08-11T12:34:38.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.520+0000 7f2b74bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b70199390 con 0x7f2b701068d0 2023-08-11T12:34:38.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.520+0000 7f2b6e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b701008c0 0x7f2b7019e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:38.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.520+0000 7f2b6e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b701008c0 0x7f2b7019e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:47142/0 (socket says 172.21.15.8:47142) 2023-08-11T12:34:38.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.520+0000 7f2b6e59c700 1 -- 172.21.15.8:0/3213323003 learned_addr learned my addr 172.21.15.8:0/3213323003 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:34:38.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.520+0000 7f2b6dd9b700 1 --2- 172.21.15.8:0/3213323003 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b70101280 0x7f2b7019eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:38.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.521+0000 7f2b6ed9d700 1 --2- 172.21.15.8:0/3213323003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b701068d0 0x7f2b701989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:38.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.521+0000 7f2b6e59c700 1 -- 172.21.15.8:0/3213323003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b701068d0 msgr2=0x7f2b701989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:34:38.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.521+0000 7f2b6e59c700 1 --2- 172.21.15.8:0/3213323003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b701068d0 0x7f2b701989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:38.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.521+0000 7f2b6e59c700 1 -- 172.21.15.8:0/3213323003 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b70101280 msgr2=0x7f2b7019eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:34:38.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.521+0000 7f2b6e59c700 1 --2- 172.21.15.8:0/3213323003 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b70101280 0x7f2b7019eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:38.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.521+0000 7f2b6e59c700 1 -- 172.21.15.8:0/3213323003 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b60009520 con 0x7f2b701008c0 2023-08-11T12:34:38.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.521+0000 7f2b6e59c700 1 --2- 172.21.15.8:0/3213323003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b701008c0 0x7f2b7019e980 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2b60009810 tx=0x7f2b6000bfc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:34:38.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.521+0000 7f2b5f7fe700 1 -- 172.21.15.8:0/3213323003 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6001c070 con 0x7f2b701008c0 2023-08-11T12:34:38.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.521+0000 7f2b5f7fe700 1 -- 172.21.15.8:0/3213323003 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b60005040 con 0x7f2b701008c0 2023-08-11T12:34:38.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.521+0000 7f2b74bff700 1 -- 172.21.15.8:0/3213323003 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b70199610 con 0x7f2b701008c0 2023-08-11T12:34:38.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.521+0000 7f2b5f7fe700 1 -- 172.21.15.8:0/3213323003 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b600049c0 con 0x7f2b701008c0 2023-08-11T12:34:38.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.521+0000 7f2b74bff700 1 -- 172.21.15.8:0/3213323003 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b701a5970 con 0x7f2b701008c0 2023-08-11T12:34:38.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.523+0000 7f2b74bff700 1 -- 172.21.15.8:0/3213323003 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b7004e620 con 0x7f2b701008c0 2023-08-11T12:34:38.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.525+0000 7f2b5f7fe700 1 -- 172.21.15.8:0/3213323003 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f2b60020070 con 0x7f2b701008c0 2023-08-11T12:34:38.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.526+0000 7f2b5f7fe700 1 --2- 172.21.15.8:0/3213323003 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f2b580a00c0 0x7f2b580a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:38.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.526+0000 7f2b5f7fe700 1 -- 172.21.15.8:0/3213323003 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9366+0+0 (secure 0 0 0) 0x7f2b600cc930 con 0x7f2b701008c0 2023-08-11T12:34:38.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.526+0000 7f2b6dd9b700 1 --2- 172.21.15.8:0/3213323003 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f2b580a00c0 0x7f2b580a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:38.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.527+0000 7f2b6dd9b700 1 --2- 172.21.15.8:0/3213323003 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f2b580a00c0 0x7f2b580a2580 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2b70105fe0 tx=0x7f2b64009310 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:34:38.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.529+0000 7f2b5f7fe700 1 -- 172.21.15.8:0/3213323003 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f2b600960f0 con 0x7f2b701008c0 2023-08-11T12:34:38.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.767+0000 7f2b74bff700 1 -- 172.21.15.8:0/3213323003 --> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b70110950 con 0x7f2b580a00c0 2023-08-11T12:34:38.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.776+0000 7f2b5f7fe700 1 -- 172.21.15.8:0/3213323003 <== mgr.25601 v2:172.21.15.8:6800/3843802949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+335 (secure 0 0 0) 0x7f2b70110950 con 0x7f2b580a00c0 2023-08-11T12:34:38.782 INFO:teuthology.orchestra.run.smithi008.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1M", "retention": {"h": 3, "M": 6}, "start": "2023-08-11T00:00:00", "created": "2023-08-11T12:24:36", "first": "2023-08-11T12:25:00", "last": "2023-08-11T12:34:00", "last_pruned": "2023-08-11T12:34:00", "created_count": 10, "pruned_count": 4, "active": true} 2023-08-11T12:34:38.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.778+0000 7f2b74bff700 1 -- 172.21.15.8:0/3213323003 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f2b580a00c0 msgr2=0x7f2b580a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:34:38.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.778+0000 7f2b74bff700 1 --2- 172.21.15.8:0/3213323003 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f2b580a00c0 0x7f2b580a2580 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2b70105fe0 tx=0x7f2b64009310 comp rx=0 tx=0).stop 2023-08-11T12:34:38.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.778+0000 7f2b74bff700 1 -- 172.21.15.8:0/3213323003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b701008c0 msgr2=0x7f2b7019e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:34:38.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.778+0000 7f2b74bff700 1 --2- 172.21.15.8:0/3213323003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b701008c0 0x7f2b7019e980 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2b60009810 tx=0x7f2b6000bfc0 comp rx=0 tx=0).stop 2023-08-11T12:34:38.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.778+0000 7f2b74bff700 1 -- 172.21.15.8:0/3213323003 shutdown_connections 2023-08-11T12:34:38.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.778+0000 7f2b74bff700 1 --2- 172.21.15.8:0/3213323003 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f2b580a00c0 0x7f2b580a2580 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:38.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.778+0000 7f2b74bff700 1 --2- 172.21.15.8:0/3213323003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b701068d0 0x7f2b701989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:38.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.778+0000 7f2b74bff700 1 --2- 172.21.15.8:0/3213323003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b701008c0 0x7f2b7019e980 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:38.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.778+0000 7f2b74bff700 1 --2- 172.21.15.8:0/3213323003 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b70101280 0x7f2b7019eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:38.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.778+0000 7f2b74bff700 1 -- 172.21.15.8:0/3213323003 >> 172.21.15.8:0/3213323003 conn(0x7f2b700fc3d0 msgr2=0x7f2b7010bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:34:38.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.779+0000 7f2b74bff700 1 -- 172.21.15.8:0/3213323003 shutdown_connections 2023-08-11T12:34:38.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:38.779+0000 7f2b74bff700 1 -- 172.21.15.8:0/3213323003 wait complete. 2023-08-11T12:34:38.799 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-08-11T12:34:39.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.000+0000 7ff7ca9ff700 1 -- 172.21.15.8:0/368452818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7c41068d0 msgr2=0x7ff7c4106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:34:39.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.000+0000 7ff7ca9ff700 1 --2- 172.21.15.8:0/368452818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7c41068d0 0x7ff7c4106cb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009990 tx=0x7ff7b4009ca0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.000+0000 7ff7ca9ff700 1 -- 172.21.15.8:0/368452818 shutdown_connections 2023-08-11T12:34:39.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.000+0000 7ff7ca9ff700 1 --2- 172.21.15.8:0/368452818 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7c4101280 0x7ff7c410d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.000+0000 7ff7ca9ff700 1 --2- 172.21.15.8:0/368452818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7c41068d0 0x7ff7c4106cb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.000+0000 7ff7ca9ff700 1 --2- 172.21.15.8:0/368452818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7c41008c0 0x7ff7c4100d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.000+0000 7ff7ca9ff700 1 -- 172.21.15.8:0/368452818 >> 172.21.15.8:0/368452818 conn(0x7ff7c40fc3d0 msgr2=0x7ff7c40fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:34:39.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.000+0000 7ff7ca9ff700 1 -- 172.21.15.8:0/368452818 shutdown_connections 2023-08-11T12:34:39.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.000+0000 7ff7ca9ff700 1 -- 172.21.15.8:0/368452818 wait complete. 2023-08-11T12:34:39.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.001+0000 7ff7ca9ff700 1 Processor -- start 2023-08-11T12:34:39.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.001+0000 7ff7ca9ff700 1 -- start start 2023-08-11T12:34:39.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.002+0000 7ff7ca9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7c41008c0 0x7ff7c4072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:39.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.002+0000 7ff7ca9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7c4101280 0x7ff7c4073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:39.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.002+0000 7ff7ca9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7c41068d0 0x7ff7c41a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:39.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.002+0000 7ff7ca9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c4073990 con 0x7ff7c41008c0 2023-08-11T12:34:39.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.002+0000 7ff7ca9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c41a50a0 con 0x7ff7c41068d0 2023-08-11T12:34:39.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.002+0000 7ff7ca9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c41a51e0 con 0x7ff7c4101280 2023-08-11T12:34:39.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.002+0000 7ff7c3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7c41008c0 0x7ff7c4072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:39.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.002+0000 7ff7c8f9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7c41068d0 0x7ff7c41a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:39.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.002+0000 7ff7c3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7c41008c0 0x7ff7c4072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50418/0 (socket says 172.21.15.8:50418) 2023-08-11T12:34:39.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.002+0000 7ff7c3fff700 1 -- 172.21.15.8:0/1556766743 learned_addr learned my addr 172.21.15.8:0/1556766743 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:34:39.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.002+0000 7ff7c37fe700 1 --2- 172.21.15.8:0/1556766743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7c4101280 0x7ff7c4073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:39.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.002+0000 7ff7c3fff700 1 -- 172.21.15.8:0/1556766743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7c4101280 msgr2=0x7ff7c4073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:34:39.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.002+0000 7ff7c3fff700 1 --2- 172.21.15.8:0/1556766743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7c4101280 0x7ff7c4073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.002+0000 7ff7c3fff700 1 -- 172.21.15.8:0/1556766743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7c41068d0 msgr2=0x7ff7c41a4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:34:39.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.002+0000 7ff7c3fff700 1 --2- 172.21.15.8:0/1556766743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7c41068d0 0x7ff7c41a4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.002+0000 7ff7c3fff700 1 -- 172.21.15.8:0/1556766743 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b40095f0 con 0x7ff7c41008c0 2023-08-11T12:34:39.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.002+0000 7ff7c37fe700 1 --2- 172.21.15.8:0/1556766743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7c4101280 0x7ff7c4073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:34:39.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.002+0000 7ff7c8f9c700 1 --2- 172.21.15.8:0/1556766743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7c41068d0 0x7ff7c41a4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:34:39.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.003+0000 7ff7c3fff700 1 --2- 172.21.15.8:0/1556766743 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7c41008c0 0x7ff7c4072c20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4005910 tx=0x7ff7b4005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:34:39.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.003+0000 7ff7c17fa700 1 -- 172.21.15.8:0/1556766743 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b401d070 con 0x7ff7c41008c0 2023-08-11T12:34:39.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.003+0000 7ff7c17fa700 1 -- 172.21.15.8:0/1556766743 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7b4022470 con 0x7ff7c41008c0 2023-08-11T12:34:39.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.003+0000 7ff7ca9ff700 1 -- 172.21.15.8:0/1556766743 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c41a53e0 con 0x7ff7c41008c0 2023-08-11T12:34:39.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.003+0000 7ff7c17fa700 1 -- 172.21.15.8:0/1556766743 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4017650 con 0x7ff7c41008c0 2023-08-11T12:34:39.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.003+0000 7ff7ca9ff700 1 -- 172.21.15.8:0/1556766743 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c41a58c0 con 0x7ff7c41008c0 2023-08-11T12:34:39.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.004+0000 7ff7ca9ff700 1 -- 172.21.15.8:0/1556766743 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c404e620 con 0x7ff7c41008c0 2023-08-11T12:34:39.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.006+0000 7ff7c17fa700 1 -- 172.21.15.8:0/1556766743 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7ff7b400fad0 con 0x7ff7c41008c0 2023-08-11T12:34:39.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.007+0000 7ff7c17fa700 1 --2- 172.21.15.8:0/1556766743 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff7ac0a00c0 0x7ff7ac0a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:39.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.008+0000 7ff7c17fa700 1 -- 172.21.15.8:0/1556766743 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9366+0+0 (secure 0 0 0) 0x7ff7b40cd630 con 0x7ff7c41008c0 2023-08-11T12:34:39.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.008+0000 7ff7c37fe700 1 --2- 172.21.15.8:0/1556766743 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff7ac0a00c0 0x7ff7ac0a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:39.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.008+0000 7ff7c37fe700 1 --2- 172.21.15.8:0/1556766743 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff7ac0a00c0 0x7ff7ac0a2580 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4074410 tx=0x7ff7b8009260 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:34:39.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.010+0000 7ff7c17fa700 1 -- 172.21.15.8:0/1556766743 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7ff7b4096d60 con 0x7ff7c41008c0 2023-08-11T12:34:39.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:39 smithi008 ceph-mon[97158]: from='client.26456 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:34:39.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.250+0000 7ff7ca9ff700 1 -- 172.21.15.8:0/1556766743 --> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7ff7c4110b00 con 0x7ff7ac0a00c0 2023-08-11T12:34:39.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.257+0000 7ff7c17fa700 1 -- 172.21.15.8:0/1556766743 <== mgr.25601 v2:172.21.15.8:6800/3843802949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7ff7c4110b00 con 0x7ff7ac0a00c0 2023-08-11T12:34:39.260 INFO:teuthology.orchestra.run.smithi008.stdout:/ 1M 6M3h 2023-08-11T12:34:39.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.260+0000 7ff7ca9ff700 1 -- 172.21.15.8:0/1556766743 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff7ac0a00c0 msgr2=0x7ff7ac0a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:34:39.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.260+0000 7ff7ca9ff700 1 --2- 172.21.15.8:0/1556766743 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff7ac0a00c0 0x7ff7ac0a2580 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4074410 tx=0x7ff7b8009260 comp rx=0 tx=0).stop 2023-08-11T12:34:39.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.260+0000 7ff7ca9ff700 1 -- 172.21.15.8:0/1556766743 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7c41008c0 msgr2=0x7ff7c4072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:34:39.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.260+0000 7ff7ca9ff700 1 --2- 172.21.15.8:0/1556766743 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7c41008c0 0x7ff7c4072c20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4005910 tx=0x7ff7b4005740 comp rx=0 tx=0).stop 2023-08-11T12:34:39.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.260+0000 7ff7ca9ff700 1 -- 172.21.15.8:0/1556766743 shutdown_connections 2023-08-11T12:34:39.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.260+0000 7ff7ca9ff700 1 --2- 172.21.15.8:0/1556766743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7c41068d0 0x7ff7c41a4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.260+0000 7ff7ca9ff700 1 --2- 172.21.15.8:0/1556766743 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7c41008c0 0x7ff7c4072c20 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.260+0000 7ff7ca9ff700 1 --2- 172.21.15.8:0/1556766743 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff7ac0a00c0 0x7ff7ac0a2580 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.260+0000 7ff7ca9ff700 1 --2- 172.21.15.8:0/1556766743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7c4101280 0x7ff7c4073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.260+0000 7ff7ca9ff700 1 -- 172.21.15.8:0/1556766743 >> 172.21.15.8:0/1556766743 conn(0x7ff7c40fc3d0 msgr2=0x7ff7c40fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:34:39.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.260+0000 7ff7ca9ff700 1 -- 172.21.15.8:0/1556766743 shutdown_connections 2023-08-11T12:34:39.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.260+0000 7ff7ca9ff700 1 -- 172.21.15.8:0/1556766743 wait complete. 2023-08-11T12:34:39.281 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-08-11T12:34:39.292 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-08-11T12:34:39.337 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:34:39.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:39 smithi194 ceph-mon[130905]: from='client.26456 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:34:39.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:39 smithi045 ceph-mon[130284]: from='client.26456 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:34:39.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.543+0000 7fcf997ff700 1 -- 172.21.15.8:0/4017269744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf94101320 msgr2=0x7fcf9410d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:34:39.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.543+0000 7fcf997ff700 1 --2- 172.21.15.8:0/4017269744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf94101320 0x7fcf9410d830 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c00b0a0 tx=0x7fcf8c00b3b0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.543+0000 7fcf997ff700 1 -- 172.21.15.8:0/4017269744 shutdown_connections 2023-08-11T12:34:39.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.543+0000 7fcf997ff700 1 --2- 172.21.15.8:0/4017269744 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf94106970 0x7fcf94106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.543+0000 7fcf997ff700 1 --2- 172.21.15.8:0/4017269744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf94101320 0x7fcf9410d830 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.543+0000 7fcf997ff700 1 --2- 172.21.15.8:0/4017269744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf94100960 0x7fcf94100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.543+0000 7fcf997ff700 1 -- 172.21.15.8:0/4017269744 >> 172.21.15.8:0/4017269744 conn(0x7fcf940fc490 msgr2=0x7fcf940fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:34:39.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.543+0000 7fcf997ff700 1 -- 172.21.15.8:0/4017269744 shutdown_connections 2023-08-11T12:34:39.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.543+0000 7fcf997ff700 1 -- 172.21.15.8:0/4017269744 wait complete. 2023-08-11T12:34:39.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.544+0000 7fcf997ff700 1 Processor -- start 2023-08-11T12:34:39.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.544+0000 7fcf997ff700 1 -- start start 2023-08-11T12:34:39.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.544+0000 7fcf997ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf94100960 0x7fcf9419e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:39.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.544+0000 7fcf997ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf94101320 0x7fcf9419ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:39.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.545+0000 7fcf997ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf94106970 0x7fcf941989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:39.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.545+0000 7fcf997ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf94199180 con 0x7fcf94101320 2023-08-11T12:34:39.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.545+0000 7fcf997ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf941992f0 con 0x7fcf94106970 2023-08-11T12:34:39.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.545+0000 7fcf997ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf941994b0 con 0x7fcf94100960 2023-08-11T12:34:39.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.545+0000 7fcf8bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf94101320 0x7fcf9419ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:39.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.545+0000 7fcf937fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf94106970 0x7fcf941989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:39.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.545+0000 7fcf937fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf94106970 0x7fcf941989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:47180/0 (socket says 172.21.15.8:47180) 2023-08-11T12:34:39.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.545+0000 7fcf937fe700 1 -- 172.21.15.8:0/1462445265 learned_addr learned my addr 172.21.15.8:0/1462445265 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:34:39.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.545+0000 7fcf92ffd700 1 --2- 172.21.15.8:0/1462445265 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf94100960 0x7fcf9419e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:39.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.545+0000 7fcf937fe700 1 -- 172.21.15.8:0/1462445265 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf94100960 msgr2=0x7fcf9419e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:34:39.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.545+0000 7fcf937fe700 1 --2- 172.21.15.8:0/1462445265 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf94100960 0x7fcf9419e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.545+0000 7fcf937fe700 1 -- 172.21.15.8:0/1462445265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf94101320 msgr2=0x7fcf9419ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:34:39.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.545+0000 7fcf937fe700 1 --2- 172.21.15.8:0/1462445265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf94101320 0x7fcf9419ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.545+0000 7fcf937fe700 1 -- 172.21.15.8:0/1462445265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7c009520 con 0x7fcf94106970 2023-08-11T12:34:39.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.545+0000 7fcf8bfff700 1 --2- 172.21.15.8:0/1462445265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf94101320 0x7fcf9419ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:34:39.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.545+0000 7fcf937fe700 1 --2- 172.21.15.8:0/1462445265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf94106970 0x7fcf941989b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c0062a0 tx=0x7fcf8c007870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:34:39.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.546+0000 7fcf90ff9700 1 -- 172.21.15.8:0/1462445265 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c00e040 con 0x7fcf94106970 2023-08-11T12:34:39.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.546+0000 7fcf997ff700 1 -- 172.21.15.8:0/1462445265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf8c009d00 con 0x7fcf94106970 2023-08-11T12:34:39.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.546+0000 7fcf90ff9700 1 -- 172.21.15.8:0/1462445265 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf8c0094c0 con 0x7fcf94106970 2023-08-11T12:34:39.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.546+0000 7fcf90ff9700 1 -- 172.21.15.8:0/1462445265 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c0052a0 con 0x7fcf94106970 2023-08-11T12:34:39.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.546+0000 7fcf997ff700 1 -- 172.21.15.8:0/1462445265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf941a5770 con 0x7fcf94106970 2023-08-11T12:34:39.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.549+0000 7fcf90ff9700 1 -- 172.21.15.8:0/1462445265 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7fcf8c01d470 con 0x7fcf94106970 2023-08-11T12:34:39.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.550+0000 7fcfad1a0b80 1 Processor -- start 2023-08-11T12:34:39.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.551+0000 7fcfad1a0b80 1 -- start start 2023-08-11T12:34:39.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.551+0000 7fcf90ff9700 1 --2- 172.21.15.8:0/1462445265 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fcf800a00c0 0x7fcf800a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:39.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.551+0000 7fcf90ff9700 1 -- 172.21.15.8:0/1462445265 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9366+0+0 (secure 0 0 0) 0x7fcf8c0ccf10 con 0x7fcf94106970 2023-08-11T12:34:39.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.551+0000 7fcfad1a0b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573087de310 0x5573087de6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:39.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.551+0000 7fcfad1a0b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573087dec30 0x5573087d88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:39.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.551+0000 7fcfad1a0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573087d8e20 0x5573087d9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:39.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.551+0000 7fcfad1a0b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557308731630 con 0x5573087dec30 2023-08-11T12:34:39.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.551+0000 7fcfad1a0b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55730872ef50 con 0x5573087de310 2023-08-11T12:34:39.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.551+0000 7fcfad1a0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55730872a840 con 0x5573087d8e20 2023-08-11T12:34:39.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.551+0000 7fcf8bfff700 1 --2- 172.21.15.8:0/1462445265 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fcf800a00c0 0x7fcf800a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:39.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.551+0000 7fcf92ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573087de310 0x5573087de6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:39.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.551+0000 7fcf92ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573087de310 0x5573087de6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:47186/0 (socket says 172.21.15.8:47186) 2023-08-11T12:34:39.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.551+0000 7fcf92ffd700 1 -- 172.21.15.8:0/2848859708 learned_addr learned my addr 172.21.15.8:0/2848859708 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:34:39.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.552+0000 7fcf92ffd700 1 -- 172.21.15.8:0/2848859708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573087d8e20 msgr2=0x5573087d9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:34:39.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.552+0000 7fcf92ffd700 1 --2- 172.21.15.8:0/2848859708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573087d8e20 0x5573087d9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.552+0000 7fcf92ffd700 1 -- 172.21.15.8:0/2848859708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573087dec30 msgr2=0x5573087d88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:34:39.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.552+0000 7fcf8bfff700 1 --2- 172.21.15.8:0/2848859708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573087dec30 0x5573087d88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:39.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.552+0000 7fcf92ffd700 1 --2- 172.21.15.8:0/2848859708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573087dec30 0x5573087d88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.552+0000 7fcf92ffd700 1 -- 172.21.15.8:0/2848859708 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5573085aa630 con 0x5573087de310 2023-08-11T12:34:39.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.552+0000 7fcf8bfff700 1 --2- 172.21.15.8:0/2848859708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573087dec30 0x5573087d88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:34:39.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.552+0000 7fcf92ffd700 1 --2- 172.21.15.8:0/2848859708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573087de310 0x5573087de6f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcf84009d00 tx=0x7fcf84011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c68e9149d991f7e7 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:34:39.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.552+0000 7fcf8bfff700 1 --2- 172.21.15.8:0/1462445265 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fcf800a00c0 0x7fcf800a2580 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x5573087d50a0 tx=0x7fcf7c009d60 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:34:39.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.552+0000 7fcf897fa700 1 -- 172.21.15.8:0/2848859708 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf84004230 con 0x5573087de310 2023-08-11T12:34:39.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.552+0000 7fcf897fa700 1 -- 172.21.15.8:0/2848859708 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf84004390 con 0x5573087de310 2023-08-11T12:34:39.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.552+0000 7fcf897fa700 1 -- 172.21.15.8:0/2848859708 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf84019780 con 0x5573087de310 2023-08-11T12:34:39.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.553+0000 7fcfad1a0b80 1 -- 172.21.15.8:0/2848859708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573087de310 msgr2=0x5573087de6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:34:39.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.553+0000 7fcfad1a0b80 1 --2- 172.21.15.8:0/2848859708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573087de310 0x5573087de6f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcf84009d00 tx=0x7fcf84011720 comp rx=0 tx=0).stop 2023-08-11T12:34:39.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.553+0000 7fcfad1a0b80 1 -- 172.21.15.8:0/2848859708 shutdown_connections 2023-08-11T12:34:39.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.553+0000 7fcfad1a0b80 1 --2- 172.21.15.8:0/2848859708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573087d8e20 0x5573087d9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.553+0000 7fcfad1a0b80 1 --2- 172.21.15.8:0/2848859708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573087de310 0x5573087de6f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.553+0000 7fcfad1a0b80 1 --2- 172.21.15.8:0/2848859708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573087dec30 0x5573087d88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.553+0000 7fcfad1a0b80 1 -- 172.21.15.8:0/2848859708 >> 172.21.15.8:0/2848859708 conn(0x557308705950 msgr2=0x5573087d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:34:39.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.553+0000 7fcfad1a0b80 1 -- 172.21.15.8:0/2848859708 shutdown_connections 2023-08-11T12:34:39.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.553+0000 7fcfad1a0b80 1 -- 172.21.15.8:0/2848859708 wait complete. 2023-08-11T12:34:39.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.554+0000 7fcfad1a0b80 1 -- start start 2023-08-11T12:34:39.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.554+0000 7fcfad1a0b80 1 Processor -- start 2023-08-11T12:34:39.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.554+0000 7fcfad1a0b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573087d8e20 0x5573087e4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:39.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.554+0000 7fcfad1a0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573087de310 0x5573087e1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:39.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.554+0000 7fcfad1a0b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573087dec30 0x5573087e2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:39.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.554+0000 7fcfad1a0b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573086c8ac0 con 0x5573087dec30 2023-08-11T12:34:39.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.554+0000 7fcfad1a0b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573086c87c0 con 0x5573087d8e20 2023-08-11T12:34:39.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.554+0000 7fcfad1a0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573085ac920 con 0x5573087de310 2023-08-11T12:34:39.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.554+0000 7fcfad1a0b80 10 client.0 _ll_register_callbacks cb 0x5573086cbab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:34:39.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.555+0000 7fcf92ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573087d8e20 0x5573087e4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:39.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.555+0000 7fcf937fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573087dec30 0x5573087e2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:39.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.555+0000 7fcf8bfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573087de310 0x5573087e1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:39.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.555+0000 7fcf92ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573087d8e20 0x5573087e4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:47200/0 (socket says 172.21.15.8:47200) 2023-08-11T12:34:39.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.555+0000 7fcf92ffd700 1 -- 172.21.15.8:0/168205325 learned_addr learned my addr 172.21.15.8:0/168205325 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:34:39.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.555+0000 7fcf937fe700 1 -- 172.21.15.8:0/168205325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573087de310 msgr2=0x5573087e1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:34:39.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.555+0000 7fcf937fe700 1 --2- 172.21.15.8:0/168205325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573087de310 0x5573087e1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.555+0000 7fcf937fe700 1 -- 172.21.15.8:0/168205325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573087d8e20 msgr2=0x5573087e4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:34:39.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.555+0000 7fcf937fe700 1 --2- 172.21.15.8:0/168205325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573087d8e20 0x5573087e4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.555+0000 7fcf937fe700 1 -- 172.21.15.8:0/168205325 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf84009960 con 0x5573087dec30 2023-08-11T12:34:39.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.555+0000 7fcf92ffd700 1 --2- 172.21.15.8:0/168205325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573087d8e20 0x5573087e4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:34:39.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.555+0000 7fcf937fe700 1 --2- 172.21.15.8:0/168205325 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573087dec30 0x5573087e2520 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c0ca2b0 tx=0x7fcf8c096740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3603f661a59c80 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:34:39.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.555+0000 7fcf7a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:34:39.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.555+0000 7fcf7a7fc700 1 -- 172.21.15.8:0/168205325 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c02d2f0 con 0x5573087dec30 2023-08-11T12:34:39.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.556+0000 7fcfad1a0b80 1 -- 172.21.15.8:0/168205325 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5573087cba90 con 0x5573087dec30 2023-08-11T12:34:39.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.556+0000 7fcf7a7fc700 1 -- 172.21.15.8:0/168205325 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9366+0+0 (secure 0 0 0) 0x7fcf8c09aa00 con 0x5573087dec30 2023-08-11T12:34:39.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.556+0000 7fcf7a7fc700 1 -- 172.21.15.8:0/168205325 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf8c09a300 con 0x5573087dec30 2023-08-11T12:34:39.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.556+0000 7fcfad1a0b80 10 client.16431 fetch_fsmap learned FSMap version 54 2023-08-11T12:34:39.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.556+0000 7fcfad1a0b80 1 -- 172.21.15.8:0/168205325 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x557308556de0 con 0x5573087dec30 2023-08-11T12:34:39.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.556+0000 7fcf7a7fc700 1 -- 172.21.15.8:0/168205325 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5573087cba90 con 0x5573087dec30 2023-08-11T12:34:39.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.556+0000 7fcf7a7fc700 1 -- 172.21.15.8:0/168205325 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcf8c0997f0 con 0x5573087dec30 2023-08-11T12:34:39.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.556+0000 7fcfad1a0b80 10 client.16431 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:34:39.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.556+0000 7fcfad1a0b80 10 client.16431 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:34:39.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.556+0000 7fcfad1a0b80 20 client.16431 populate_metadata read hostname 'smithi008' 2023-08-11T12:34:39.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.556+0000 7fcfad1a0b80 1 --2- 172.21.15.8:0/168205325 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5573087f2200 0x5573087f45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:39.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.556+0000 7fcfad1a0b80 4 client.16431 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:34:39.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.556+0000 7fcfad1a0b80 1 -- 172.21.15.8:0/168205325 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5573087a74e0 con 0x5573087f2200 2023-08-11T12:34:39.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.557+0000 7fcf92ffd700 1 --2- 172.21.15.8:0/168205325 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5573087f2200 0x5573087f45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:39.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.557+0000 7fcf92ffd700 1 --2- 172.21.15.8:0/168205325 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5573087f2200 0x5573087f45f0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=706f3029e5cb25b7 server_cookie=b9f2000895fb27e1 in_seq=0 out_seq=0 2023-08-11T12:34:39.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.557+0000 7fcf7a7fc700 10 client.16431 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:34:39.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.558+0000 7fcf7a7fc700 1 -- 172.21.15.8:0/168205325 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5573087a74e0 con 0x5573087f2200 2023-08-11T12:34:39.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.558+0000 7fcf7a7fc700 10 client.16431 handle_command_reply: tid=0 2023-08-11T12:34:39.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.558+0000 7fcfad1a0b80 1 client.16431 shutdown 2023-08-11T12:34:39.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.558+0000 7fcfad1a0b80 1 -- 172.21.15.8:0/168205325 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573087dec30 msgr2=0x5573087e2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:34:39.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.558+0000 7fcfad1a0b80 1 --2- 172.21.15.8:0/168205325 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573087dec30 0x5573087e2520 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c0ca2b0 tx=0x7fcf8c096740 comp rx=0 tx=0).stop 2023-08-11T12:34:39.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.558+0000 7fcfad1a0b80 1 -- 172.21.15.8:0/168205325 shutdown_connections 2023-08-11T12:34:39.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.559+0000 7fcfad1a0b80 1 --2- 172.21.15.8:0/168205325 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5573087f2200 0x5573087f45f0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.559+0000 7fcfad1a0b80 1 --2- 172.21.15.8:0/168205325 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573087dec30 0x5573087e2520 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.559+0000 7fcfad1a0b80 1 --2- 172.21.15.8:0/168205325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573087d8e20 0x5573087e4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.559+0000 7fcfad1a0b80 1 --2- 172.21.15.8:0/168205325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573087de310 0x5573087e1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.559+0000 7fcfad1a0b80 1 -- 172.21.15.8:0/168205325 >> 172.21.15.8:0/168205325 conn(0x557308705950 msgr2=0x5573087cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:34:39.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.559+0000 7fcf7a7fc700 0 client.16431 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:34:39.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.559+0000 7fcfad1a0b80 1 -- 172.21.15.8:0/168205325 shutdown_connections 2023-08-11T12:34:39.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.559+0000 7fcfad1a0b80 1 -- 172.21.15.8:0/168205325 wait complete. 2023-08-11T12:34:39.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.559+0000 7fcfad1a0b80 20 client.16431 trim_cache size 0 max 16384 2023-08-11T12:34:39.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.576+0000 7fcfad1a0b80 1 Processor -- start 2023-08-11T12:34:39.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.576+0000 7fcfad1a0b80 1 -- start start 2023-08-11T12:34:39.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.576+0000 7fcfad1a0b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573087d8e20 0x5573087edc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:39.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.576+0000 7fcfad1a0b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573087de310 0x5573087dc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:39.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.576+0000 7fcfad1a0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573087dec30 0x5573087dc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:39.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.576+0000 7fcfad1a0b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573087f1fd0 con 0x5573087de310 2023-08-11T12:34:39.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.576+0000 7fcfad1a0b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573087d3900 con 0x5573087d8e20 2023-08-11T12:34:39.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.576+0000 7fcfad1a0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573087f4920 con 0x5573087dec30 2023-08-11T12:34:39.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.577+0000 7fcf92ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573087d8e20 0x5573087edc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:39.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.577+0000 7fcf8bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573087de310 0x5573087dc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:39.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.577+0000 7fcf92ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573087d8e20 0x5573087edc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:47202/0 (socket says 172.21.15.8:47202) 2023-08-11T12:34:39.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.577+0000 7fcf92ffd700 1 -- 172.21.15.8:0/602014041 learned_addr learned my addr 172.21.15.8:0/602014041 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:34:39.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.577+0000 7fcf937fe700 1 --2- 172.21.15.8:0/602014041 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573087dec30 0x5573087dc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:39.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.577+0000 7fcf92ffd700 1 -- 172.21.15.8:0/602014041 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573087dec30 msgr2=0x5573087dc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:34:39.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.577+0000 7fcf92ffd700 1 --2- 172.21.15.8:0/602014041 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573087dec30 0x5573087dc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.577+0000 7fcf92ffd700 1 -- 172.21.15.8:0/602014041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573087de310 msgr2=0x5573087dc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:34:39.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.577+0000 7fcf92ffd700 1 --2- 172.21.15.8:0/602014041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573087de310 0x5573087dc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.577+0000 7fcf92ffd700 1 -- 172.21.15.8:0/602014041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55730853fc60 con 0x5573087d8e20 2023-08-11T12:34:39.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.577+0000 7fcf8bfff700 1 --2- 172.21.15.8:0/602014041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573087de310 0x5573087dc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:34:39.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.577+0000 7fcf92ffd700 1 --2- 172.21.15.8:0/602014041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573087d8e20 0x5573087edc20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcf84004360 tx=0x7fcf84003ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d8cdfac21305a84 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:34:39.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.578+0000 7fcf89ffb700 1 -- 172.21.15.8:0/602014041 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf84003a20 con 0x5573087d8e20 2023-08-11T12:34:39.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.578+0000 7fcf89ffb700 1 -- 172.21.15.8:0/602014041 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf84005ce0 con 0x5573087d8e20 2023-08-11T12:34:39.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.578+0000 7fcf89ffb700 1 -- 172.21.15.8:0/602014041 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf84004b40 con 0x5573087d8e20 2023-08-11T12:34:39.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.578+0000 7fcfad1a0b80 1 -- 172.21.15.8:0/602014041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573087d8e20 msgr2=0x5573087edc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:34:39.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.578+0000 7fcfad1a0b80 1 --2- 172.21.15.8:0/602014041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573087d8e20 0x5573087edc20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcf84004360 tx=0x7fcf84003ed0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.578+0000 7fcfad1a0b80 1 -- 172.21.15.8:0/602014041 shutdown_connections 2023-08-11T12:34:39.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.578+0000 7fcfad1a0b80 1 --2- 172.21.15.8:0/602014041 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573087dec30 0x5573087dc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.578+0000 7fcfad1a0b80 1 --2- 172.21.15.8:0/602014041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573087d8e20 0x5573087edc20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.578+0000 7fcfad1a0b80 1 --2- 172.21.15.8:0/602014041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573087de310 0x5573087dc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.578+0000 7fcfad1a0b80 1 -- 172.21.15.8:0/602014041 >> 172.21.15.8:0/602014041 conn(0x557308705950 msgr2=0x5573087f4210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:34:39.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.578+0000 7fcfad1a0b80 1 -- 172.21.15.8:0/602014041 shutdown_connections 2023-08-11T12:34:39.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.579+0000 7fcfad1a0b80 1 -- 172.21.15.8:0/602014041 wait complete. 2023-08-11T12:34:39.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.579+0000 7fcfad1a0b80 1 -- start start 2023-08-11T12:34:39.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.579+0000 7fcfad1a0b80 1 Processor -- start 2023-08-11T12:34:39.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.579+0000 7fcfad1a0b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573087d8e20 0x5573087e9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:39.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.580+0000 7fcfad1a0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573087de310 0x5573087e9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:39.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.580+0000 7fcfad1a0b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573087dec30 0x5573087e7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:39.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.580+0000 7fcfad1a0b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573087e7e80 con 0x5573087dec30 2023-08-11T12:34:39.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.580+0000 7fcfad1a0b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573087e7ff0 con 0x5573087d8e20 2023-08-11T12:34:39.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.580+0000 7fcfad1a0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573087e81b0 con 0x5573087de310 2023-08-11T12:34:39.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.580+0000 7fcfad1a0b80 10 client.0 _ll_register_callbacks cb 0x7fcf8c00bf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:34:39.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.580+0000 7fcf937fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573087dec30 0x5573087e7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:39.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.580+0000 7fcf92ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573087d8e20 0x5573087e9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:39.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.580+0000 7fcf92ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573087d8e20 0x5573087e9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:47218/0 (socket says 172.21.15.8:47218) 2023-08-11T12:34:39.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.580+0000 7fcf937fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573087dec30 0x5573087e7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50456/0 (socket says 172.21.15.8:50456) 2023-08-11T12:34:39.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.580+0000 7fcf92ffd700 1 -- 172.21.15.8:0/3565109806 learned_addr learned my addr 172.21.15.8:0/3565109806 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:34:39.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.580+0000 7fcf8bfff700 1 --2- 172.21.15.8:0/3565109806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573087de310 0x5573087e9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:39.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.580+0000 7fcf937fe700 1 -- 172.21.15.8:0/3565109806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573087de310 msgr2=0x5573087e9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:34:39.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.580+0000 7fcf937fe700 1 --2- 172.21.15.8:0/3565109806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573087de310 0x5573087e9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.580+0000 7fcf937fe700 1 -- 172.21.15.8:0/3565109806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573087d8e20 msgr2=0x5573087e9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:34:39.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.580+0000 7fcf937fe700 1 --2- 172.21.15.8:0/3565109806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573087d8e20 0x5573087e9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.580+0000 7fcf937fe700 1 -- 172.21.15.8:0/3565109806 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf7c012170 con 0x5573087dec30 2023-08-11T12:34:39.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.580+0000 7fcf92ffd700 1 --2- 172.21.15.8:0/3565109806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573087d8e20 0x5573087e9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:34:39.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.580+0000 7fcf937fe700 1 --2- 172.21.15.8:0/3565109806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573087dec30 0x5573087e7770 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c099ba0 tx=0x7fcf8c00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f20dc01901562a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:34:39.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.580+0000 7fcf7a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:34:39.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.581+0000 7fcf7a7fc700 1 -- 172.21.15.8:0/3565109806 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c0b2410 con 0x5573087dec30 2023-08-11T12:34:39.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.581+0000 7fcf7a7fc700 1 -- 172.21.15.8:0/3565109806 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9366+0+0 (secure 0 0 0) 0x7fcf8c09aa00 con 0x5573087dec30 2023-08-11T12:34:39.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.581+0000 7fcfad1a0b80 1 -- 172.21.15.8:0/3565109806 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcf84004390 con 0x5573087dec30 2023-08-11T12:34:39.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.581+0000 7fcf7a7fc700 1 -- 172.21.15.8:0/3565109806 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf8c02d2f0 con 0x5573087dec30 2023-08-11T12:34:39.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.581+0000 7fcfad1a0b80 10 client.16437 fetch_fsmap learned FSMap version 54 2023-08-11T12:34:39.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.581+0000 7fcfad1a0b80 1 -- 172.21.15.8:0/3565109806 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x5573085aa630 con 0x5573087dec30 2023-08-11T12:34:39.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.581+0000 7fcf7a7fc700 1 -- 172.21.15.8:0/3565109806 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf84004390 con 0x5573087dec30 2023-08-11T12:34:39.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.581+0000 7fcf7a7fc700 1 -- 172.21.15.8:0/3565109806 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcf8c066120 con 0x5573087dec30 2023-08-11T12:34:39.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.581+0000 7fcfad1a0b80 10 client.16437 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:34:39.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.581+0000 7fcfad1a0b80 10 client.16437 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:34:39.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.581+0000 7fcfad1a0b80 20 client.16437 populate_metadata read hostname 'smithi008' 2023-08-11T12:34:39.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.581+0000 7fcfad1a0b80 1 --2- 172.21.15.8:0/3565109806 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x557308846c40 0x557308849030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:34:39.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.581+0000 7fcfad1a0b80 4 client.16437 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:34:39.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.581+0000 7fcfad1a0b80 1 -- 172.21.15.8:0/3565109806 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557308723820 con 0x557308846c40 2023-08-11T12:34:39.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.582+0000 7fcf92ffd700 1 --2- 172.21.15.8:0/3565109806 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x557308846c40 0x557308849030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:34:39.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.582+0000 7fcf92ffd700 1 --2- 172.21.15.8:0/3565109806 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x557308846c40 0x557308849030 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad29e24dfcec135c server_cookie=3b9a43b5ab3e750c in_seq=0 out_seq=0 2023-08-11T12:34:39.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.582+0000 7fcf7a7fc700 10 client.16437 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:34:39.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.582+0000 7fcf7a7fc700 1 -- 172.21.15.8:0/3565109806 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x557308723820 con 0x557308846c40 2023-08-11T12:34:39.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.582+0000 7fcf7a7fc700 10 client.16437 handle_command_reply: tid=0 2023-08-11T12:34:39.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.582+0000 7fcfad1a0b80 1 client.16437 shutdown 2023-08-11T12:34:39.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.583+0000 7fcfad1a0b80 1 -- 172.21.15.8:0/3565109806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573087dec30 msgr2=0x5573087e7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:34:39.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.583+0000 7fcfad1a0b80 1 --2- 172.21.15.8:0/3565109806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573087dec30 0x5573087e7770 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c099ba0 tx=0x7fcf8c00bed0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.583+0000 7fcfad1a0b80 1 -- 172.21.15.8:0/3565109806 shutdown_connections 2023-08-11T12:34:39.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.583+0000 7fcfad1a0b80 1 --2- 172.21.15.8:0/3565109806 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x557308846c40 0x557308849030 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.583+0000 7fcfad1a0b80 1 --2- 172.21.15.8:0/3565109806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573087dec30 0x5573087e7770 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.583+0000 7fcfad1a0b80 1 --2- 172.21.15.8:0/3565109806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573087d8e20 0x5573087e9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.583+0000 7fcfad1a0b80 1 --2- 172.21.15.8:0/3565109806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5573087de310 0x5573087e9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.583+0000 7fcf7a7fc700 0 client.16437 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:34:39.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.583+0000 7fcfad1a0b80 1 -- 172.21.15.8:0/3565109806 >> 172.21.15.8:0/3565109806 conn(0x557308705950 msgr2=0x5573087edc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:34:39.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.583+0000 7fcfad1a0b80 1 -- 172.21.15.8:0/3565109806 shutdown_connections 2023-08-11T12:34:39.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.583+0000 7fcfad1a0b80 1 -- 172.21.15.8:0/3565109806 wait complete. 2023-08-11T12:34:39.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.583+0000 7fcfad1a0b80 20 client.16437 trim_cache size 0 max 16384 2023-08-11T12:34:39.609 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:34:39.610 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:34:39.610 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:34:39.610 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:34:39.611 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:34:39.611 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:34:39.612 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:34:39.612 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:34:39.613 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:34:39.613 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:34:39.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.583+0000 7fcf997ff700 1 -- 172.21.15.8:0/1462445265 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fcf800a00c0 msgr2=0x7fcf800a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:34:39.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.583+0000 7fcf997ff700 1 --2- 172.21.15.8:0/1462445265 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fcf800a00c0 0x7fcf800a2580 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x5573087d50a0 tx=0x7fcf7c009d60 comp rx=0 tx=0).stop 2023-08-11T12:34:39.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.583+0000 7fcf997ff700 1 -- 172.21.15.8:0/1462445265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf94106970 msgr2=0x7fcf941989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:34:39.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.583+0000 7fcf997ff700 1 --2- 172.21.15.8:0/1462445265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf94106970 0x7fcf941989b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c0062a0 tx=0x7fcf8c007870 comp rx=0 tx=0).stop 2023-08-11T12:34:39.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.584+0000 7fcf997ff700 1 -- 172.21.15.8:0/1462445265 shutdown_connections 2023-08-11T12:34:39.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.584+0000 7fcf997ff700 1 --2- 172.21.15.8:0/1462445265 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fcf800a00c0 0x7fcf800a2580 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.584+0000 7fcf997ff700 1 --2- 172.21.15.8:0/1462445265 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf94100960 0x7fcf9419e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.584+0000 7fcf997ff700 1 --2- 172.21.15.8:0/1462445265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf94106970 0x7fcf941989b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.584+0000 7fcf997ff700 1 --2- 172.21.15.8:0/1462445265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf94101320 0x7fcf9419ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:34:39.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.584+0000 7fcf997ff700 1 -- 172.21.15.8:0/1462445265 >> 172.21.15.8:0/1462445265 conn(0x7fcf940fc490 msgr2=0x7fcf9410bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:34:39.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.584+0000 7fcf997ff700 1 -- 172.21.15.8:0/1462445265 shutdown_connections 2023-08-11T12:34:39.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:34:39.584+0000 7fcf997ff700 1 -- 172.21.15.8:0/1462445265 wait complete. 2023-08-11T12:34:39.620 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:34:41.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:40 smithi008 ceph-mon[97158]: from='client.16422 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:34:41.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:40 smithi008 ceph-mon[97158]: pgmap v313: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:34:41.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:40 smithi194 ceph-mon[130905]: from='client.16422 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:34:41.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:40 smithi194 ceph-mon[130905]: pgmap v313: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:34:41.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:40 smithi045 ceph-mon[130284]: from='client.16422 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-08-11T12:34:41.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:40 smithi045 ceph-mon[130284]: pgmap v313: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:34:42.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:42 smithi008 ceph-mon[97158]: pgmap v314: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2023-08-11T12:34:42.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:42 smithi194 ceph-mon[130905]: pgmap v314: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2023-08-11T12:34:42.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:42 smithi045 ceph-mon[130284]: pgmap v314: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2023-08-11T12:34:44.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:44 smithi008 ceph-mon[97158]: pgmap v315: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2023-08-11T12:34:44.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:44 smithi194 ceph-mon[130905]: pgmap v315: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2023-08-11T12:34:44.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:44 smithi045 ceph-mon[130284]: pgmap v315: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2023-08-11T12:34:46.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:46 smithi008 ceph-mon[97158]: pgmap v316: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2023-08-11T12:34:46.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:46 smithi194 ceph-mon[130905]: pgmap v316: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2023-08-11T12:34:46.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:46 smithi045 ceph-mon[130284]: pgmap v316: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2023-08-11T12:34:48.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:48 smithi008 ceph-mon[97158]: pgmap v317: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2023-08-11T12:34:48.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:48 smithi194 ceph-mon[130905]: pgmap v317: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2023-08-11T12:34:48.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:48 smithi045 ceph-mon[130284]: pgmap v317: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2023-08-11T12:34:51.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:50 smithi008 ceph-mon[97158]: pgmap v318: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2023-08-11T12:34:51.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:50 smithi194 ceph-mon[130905]: pgmap v318: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2023-08-11T12:34:51.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:50 smithi045 ceph-mon[130284]: pgmap v318: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2023-08-11T12:34:52.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:52 smithi008 ceph-mon[97158]: pgmap v319: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2023-08-11T12:34:52.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:52 smithi194 ceph-mon[130905]: pgmap v319: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2023-08-11T12:34:52.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:52 smithi045 ceph-mon[130284]: pgmap v319: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2023-08-11T12:34:54.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:54 smithi008 ceph-mon[97158]: pgmap v320: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:34:54.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:54 smithi194 ceph-mon[130905]: pgmap v320: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:34:54.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:54 smithi045 ceph-mon[130284]: pgmap v320: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:34:56.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:55 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:34:56.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:55 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:34:56.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:55 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:34:57.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:56 smithi008 ceph-mon[97158]: pgmap v321: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:34:57.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:56 smithi194 ceph-mon[130905]: pgmap v321: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:34:57.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:56 smithi045 ceph-mon[130284]: pgmap v321: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:34:58.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:58 smithi008 ceph-mon[97158]: pgmap v322: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:34:58.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:58 smithi194 ceph-mon[130905]: pgmap v322: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:34:58.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:58 smithi045 ceph-mon[130284]: pgmap v322: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:34:59.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:59 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:34:59.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:59 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:34:59.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:59 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:34:59.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:59 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:34:59.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:59 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:34:59.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:59 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:34:59.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:59 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:34:59.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:59 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:34:59.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:59 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:34:59.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:59 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:34:59.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:59 smithi008 ceph-mon[97158]: Adjusting osd_memory_target on smithi194 to 196.2M 2023-08-11T12:34:59.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:59 smithi008 ceph-mon[97158]: Unable to set osd_memory_target on smithi194 to 205773926: error parsing value: Value '205773926' is below minimum 939524096 2023-08-11T12:34:59.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:59 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:34:59.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:59 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:34:59.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:59 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:34:59.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:34:59 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:34:59.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:59 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:34:59.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:59 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:34:59.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:59 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:34:59.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:59 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:34:59.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:59 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:34:59.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:59 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:34:59.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:59 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:34:59.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:59 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:34:59.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:59 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:34:59.896 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:59 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:34:59.896 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:59 smithi194 ceph-mon[130905]: Adjusting osd_memory_target on smithi194 to 196.2M 2023-08-11T12:34:59.896 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:59 smithi194 ceph-mon[130905]: Unable to set osd_memory_target on smithi194 to 205773926: error parsing value: Value '205773926' is below minimum 939524096 2023-08-11T12:34:59.896 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:59 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:34:59.897 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:59 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:34:59.897 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:59 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:34:59.897 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:34:59 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:34:59.898 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:59 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:34:59.898 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:59 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:34:59.898 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:59 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:34:59.898 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:59 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:34:59.898 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:59 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:34:59.899 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:59 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:34:59.899 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:59 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:34:59.899 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:59 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:34:59.899 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:59 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:34:59.899 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:59 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:34:59.900 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:59 smithi045 ceph-mon[130284]: Adjusting osd_memory_target on smithi194 to 196.2M 2023-08-11T12:34:59.900 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:59 smithi045 ceph-mon[130284]: Unable to set osd_memory_target on smithi194 to 205773926: error parsing value: Value '205773926' is below minimum 939524096 2023-08-11T12:34:59.901 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:59 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:34:59.901 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:59 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:34:59.902 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:59 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:34:59.903 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:34:59 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:35:00.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:00 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:00 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:00 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:00 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:00 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:00 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:00 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:00 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:00 smithi008 ceph-mon[97158]: Adjusting osd_memory_target on smithi045 to 197.2M 2023-08-11T12:35:00.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:00 smithi008 ceph-mon[97158]: Unable to set osd_memory_target on smithi045 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-08-11T12:35:00.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:00 smithi008 ceph-mon[97158]: pgmap v323: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:00.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:00 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:00 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:00 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:00 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:00 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:00 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:00 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:00 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:00 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:35:00.808 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:00 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:35:00.808 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:00 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:35:00.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:00 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:00 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:00 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:00 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:00 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:00 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:00 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.894 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:00 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:00 smithi194 ceph-mon[130905]: Adjusting osd_memory_target on smithi045 to 197.2M 2023-08-11T12:35:00.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:00 smithi194 ceph-mon[130905]: Unable to set osd_memory_target on smithi045 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-08-11T12:35:00.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:00 smithi194 ceph-mon[130905]: pgmap v323: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:00.895 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:00 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.896 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:00 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.896 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:00 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.896 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:00 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.896 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:00 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.896 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:00 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.897 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:00 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.897 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:00 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.897 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:00 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:35:00.897 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:00 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:35:00.898 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:00 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:35:00.898 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:00 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.899 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:00 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.899 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:00 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.899 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:00 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.899 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:00 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.899 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:00 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.900 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:00 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.900 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:00 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.900 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:00 smithi045 ceph-mon[130284]: Adjusting osd_memory_target on smithi045 to 197.2M 2023-08-11T12:35:00.900 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:00 smithi045 ceph-mon[130284]: Unable to set osd_memory_target on smithi045 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-08-11T12:35:00.901 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:00 smithi045 ceph-mon[130284]: pgmap v323: 129 pgs: 129 active+clean; 5.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:00.901 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:00 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.901 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:00 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.902 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:00 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.902 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:00 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.902 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:00 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.902 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:00 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.903 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:00 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.903 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:00 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-11T12:35:00.903 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:00 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:35:00.903 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:00 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:35:00.903 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:00 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:35:02.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:01 smithi008 ceph-mon[97158]: Adjusting osd_memory_target on smithi008 to 222.0M 2023-08-11T12:35:02.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:01 smithi008 ceph-mon[97158]: Unable to set osd_memory_target on smithi008 to 232785100: error parsing value: Value '232785100' is below minimum 939524096 2023-08-11T12:35:02.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:01 smithi194 ceph-mon[130905]: Adjusting osd_memory_target on smithi008 to 222.0M 2023-08-11T12:35:02.435 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:01 smithi194 ceph-mon[130905]: Unable to set osd_memory_target on smithi008 to 232785100: error parsing value: Value '232785100' is below minimum 939524096 2023-08-11T12:35:02.436 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:01 smithi045 ceph-mon[130284]: Adjusting osd_memory_target on smithi008 to 222.0M 2023-08-11T12:35:02.437 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:01 smithi045 ceph-mon[130284]: Unable to set osd_memory_target on smithi008 to 232785100: error parsing value: Value '232785100' is below minimum 939524096 2023-08-11T12:35:03.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:02 smithi008 ceph-mon[97158]: pgmap v324: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-11T12:35:03.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:02 smithi194 ceph-mon[130905]: pgmap v324: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-11T12:35:03.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:02 smithi045 ceph-mon[130284]: pgmap v324: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-11T12:35:04.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:04 smithi008 ceph-mon[97158]: pgmap v325: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:35:04.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:04 smithi194 ceph-mon[130905]: pgmap v325: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:35:04.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:04 smithi045 ceph-mon[130284]: pgmap v325: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:35:06.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:06 smithi008 ceph-mon[97158]: pgmap v326: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:35:06.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:06 smithi194 ceph-mon[130905]: pgmap v326: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:35:06.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:06 smithi045 ceph-mon[130284]: pgmap v326: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:35:09.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:08 smithi008 ceph-mon[97158]: osdmap e99: 12 total, 12 up, 12 in 2023-08-11T12:35:09.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:08 smithi008 ceph-mon[97158]: pgmap v328: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:35:09.142 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:08 smithi194 ceph-mon[130905]: osdmap e99: 12 total, 12 up, 12 in 2023-08-11T12:35:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:08 smithi194 ceph-mon[130905]: pgmap v328: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:35:09.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:08 smithi045 ceph-mon[130284]: osdmap e99: 12 total, 12 up, 12 in 2023-08-11T12:35:09.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:08 smithi045 ceph-mon[130284]: pgmap v328: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:35:09.621 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:35:09.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.840+0000 7fe193dff700 1 -- 172.21.15.8:0/4092352828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe18c106970 msgr2=0x7fe18c106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:35:09.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.840+0000 7fe193dff700 1 --2- 172.21.15.8:0/4092352828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe18c106970 0x7fe18c106d50 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe188009990 tx=0x7fe188009ca0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.840+0000 7fe193dff700 1 -- 172.21.15.8:0/4092352828 shutdown_connections 2023-08-11T12:35:09.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.840+0000 7fe193dff700 1 --2- 172.21.15.8:0/4092352828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe18c101320 0x7fe18c10d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.840+0000 7fe193dff700 1 --2- 172.21.15.8:0/4092352828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe18c106970 0x7fe18c106d50 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.840+0000 7fe193dff700 1 --2- 172.21.15.8:0/4092352828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe18c100960 0x7fe18c100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.840+0000 7fe193dff700 1 -- 172.21.15.8:0/4092352828 >> 172.21.15.8:0/4092352828 conn(0x7fe18c0fc490 msgr2=0x7fe18c0fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:35:09.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.840+0000 7fe193dff700 1 -- 172.21.15.8:0/4092352828 shutdown_connections 2023-08-11T12:35:09.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.840+0000 7fe193dff700 1 -- 172.21.15.8:0/4092352828 wait complete. 2023-08-11T12:35:09.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.842+0000 7fe193dff700 1 Processor -- start 2023-08-11T12:35:09.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.842+0000 7fe193dff700 1 -- start start 2023-08-11T12:35:09.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.842+0000 7fe193dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe18c100960 0x7fe18c072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:09.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.842+0000 7fe193dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe18c101320 0x7fe18c073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:09.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.842+0000 7fe193dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe18c106970 0x7fe18c1a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:09.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.842+0000 7fe193dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c073990 con 0x7fe18c101320 2023-08-11T12:35:09.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.842+0000 7fe193dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c1a5180 con 0x7fe18c106970 2023-08-11T12:35:09.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.842+0000 7fe193dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c1a52c0 con 0x7fe18c100960 2023-08-11T12:35:09.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.843+0000 7fe19139a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe18c101320 0x7fe18c073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:09.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.843+0000 7fe19239c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe18c106970 0x7fe18c1a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:09.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.843+0000 7fe19239c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe18c106970 0x7fe18c1a4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:36390/0 (socket says 172.21.15.8:36390) 2023-08-11T12:35:09.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.843+0000 7fe19239c700 1 -- 172.21.15.8:0/1868051849 learned_addr learned my addr 172.21.15.8:0/1868051849 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:35:09.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.843+0000 7fe191b9b700 1 --2- 172.21.15.8:0/1868051849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe18c100960 0x7fe18c072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:09.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.843+0000 7fe19239c700 1 -- 172.21.15.8:0/1868051849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe18c100960 msgr2=0x7fe18c072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:35:09.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.843+0000 7fe19239c700 1 --2- 172.21.15.8:0/1868051849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe18c100960 0x7fe18c072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.843+0000 7fe19239c700 1 -- 172.21.15.8:0/1868051849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe18c101320 msgr2=0x7fe18c073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:35:09.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.843+0000 7fe19239c700 1 --2- 172.21.15.8:0/1868051849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe18c101320 0x7fe18c073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.843+0000 7fe19239c700 1 -- 172.21.15.8:0/1868051849 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1880095f0 con 0x7fe18c106970 2023-08-11T12:35:09.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.843+0000 7fe19139a700 1 --2- 172.21.15.8:0/1868051849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe18c101320 0x7fe18c073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:35:09.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.843+0000 7fe19239c700 1 --2- 172.21.15.8:0/1868051849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe18c106970 0x7fe18c1a4c40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe18400ef30 tx=0x7fe18400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:35:09.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.844+0000 7fe182ffd700 1 -- 172.21.15.8:0/1868051849 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe184018070 con 0x7fe18c106970 2023-08-11T12:35:09.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.844+0000 7fe182ffd700 1 -- 172.21.15.8:0/1868051849 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe18400f040 con 0x7fe18c106970 2023-08-11T12:35:09.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.844+0000 7fe193dff700 1 -- 172.21.15.8:0/1868051849 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe18c1a54c0 con 0x7fe18c106970 2023-08-11T12:35:09.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.844+0000 7fe182ffd700 1 -- 172.21.15.8:0/1868051849 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18400cd00 con 0x7fe18c106970 2023-08-11T12:35:09.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.844+0000 7fe193dff700 1 -- 172.21.15.8:0/1868051849 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe18c1a5950 con 0x7fe18c106970 2023-08-11T12:35:09.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.847+0000 7fe182ffd700 1 -- 172.21.15.8:0/1868051849 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7fe184003a00 con 0x7fe18c106970 2023-08-11T12:35:09.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.848+0000 7fe1a779cb80 1 Processor -- start 2023-08-11T12:35:09.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.848+0000 7fe1a779cb80 1 -- start start 2023-08-11T12:35:09.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.848+0000 7fe1a779cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8de906310 0x55f8de9066f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:09.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.848+0000 7fe1a779cb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8de906c30 0x55f8de9008e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:09.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.848+0000 7fe1a779cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8de900e20 0x55f8de901260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:09.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.848+0000 7fe1a779cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8de859630 con 0x55f8de906310 2023-08-11T12:35:09.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.848+0000 7fe1a779cb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8de856f50 con 0x55f8de906c30 2023-08-11T12:35:09.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.848+0000 7fe1a779cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8de852840 con 0x55f8de900e20 2023-08-11T12:35:09.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.849+0000 7fe182ffd700 1 --2- 172.21.15.8:0/1868051849 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe1780a00c0 0x7fe1780a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:09.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.849+0000 7fe19139a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8de906310 0x55f8de9066f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:09.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.849+0000 7fe191b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8de906c30 0x55f8de9008e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:09.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.849+0000 7fe182ffd700 1 -- 172.21.15.8:0/1868051849 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 9454+0+0 (secure 0 0 0) 0x7fe1840cb530 con 0x7fe18c106970 2023-08-11T12:35:09.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.849+0000 7fe191b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8de906c30 0x55f8de9008e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:36404/0 (socket says 172.21.15.8:36404) 2023-08-11T12:35:09.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.849+0000 7fe191b9b700 1 -- 172.21.15.8:0/2442041213 learned_addr learned my addr 172.21.15.8:0/2442041213 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:35:09.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.849+0000 7fe19139a700 1 --2- 172.21.15.8:0/2442041213 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8de900e20 0x55f8de901260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:09.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.849+0000 7fe19239c700 1 --2- 172.21.15.8:0/1868051849 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe1780a00c0 0x7fe1780a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:09.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.849+0000 7fe191b9b700 1 -- 172.21.15.8:0/2442041213 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8de900e20 msgr2=0x55f8de901260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:35:09.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.849+0000 7fe191b9b700 1 --2- 172.21.15.8:0/2442041213 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8de900e20 0x55f8de901260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.849+0000 7fe191b9b700 1 -- 172.21.15.8:0/2442041213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8de906310 msgr2=0x55f8de9066f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:35:09.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.849+0000 7fe191b9b700 1 --2- 172.21.15.8:0/2442041213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8de906310 0x55f8de9066f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.849+0000 7fe191b9b700 1 -- 172.21.15.8:0/2442041213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8de6d2630 con 0x55f8de906c30 2023-08-11T12:35:09.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.849+0000 7fe191b9b700 1 --2- 172.21.15.8:0/2442041213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8de906c30 0x55f8de9008e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe188009990 tx=0x7fe188005f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69aaf3d60632b27e server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:35:09.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.850+0000 7fe19239c700 1 --2- 172.21.15.8:0/1868051849 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe1780a00c0 0x7fe1780a2580 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe1840090a0 tx=0x7fe184009ed0 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:35:09.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.850+0000 7fe177fff700 1 -- 172.21.15.8:0/2442041213 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18801d070 con 0x55f8de906c30 2023-08-11T12:35:09.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.850+0000 7fe177fff700 1 -- 172.21.15.8:0/2442041213 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe18801e040 con 0x55f8de906c30 2023-08-11T12:35:09.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.850+0000 7fe177fff700 1 -- 172.21.15.8:0/2442041213 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1880048f0 con 0x55f8de906c30 2023-08-11T12:35:09.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.850+0000 7fe1a779cb80 1 -- 172.21.15.8:0/2442041213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8de906c30 msgr2=0x55f8de9008e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:35:09.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.850+0000 7fe1a779cb80 1 --2- 172.21.15.8:0/2442041213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8de906c30 0x55f8de9008e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe188009990 tx=0x7fe188005f00 comp rx=0 tx=0).stop 2023-08-11T12:35:09.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.850+0000 7fe1a779cb80 1 -- 172.21.15.8:0/2442041213 shutdown_connections 2023-08-11T12:35:09.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.851+0000 7fe1a779cb80 1 --2- 172.21.15.8:0/2442041213 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8de900e20 0x55f8de901260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.851+0000 7fe1a779cb80 1 --2- 172.21.15.8:0/2442041213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8de906310 0x55f8de9066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.851+0000 7fe1a779cb80 1 --2- 172.21.15.8:0/2442041213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8de906c30 0x55f8de9008e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.851+0000 7fe1a779cb80 1 -- 172.21.15.8:0/2442041213 >> 172.21.15.8:0/2442041213 conn(0x55f8de82d950 msgr2=0x55f8de8fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:35:09.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.851+0000 7fe1a779cb80 1 -- 172.21.15.8:0/2442041213 shutdown_connections 2023-08-11T12:35:09.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.851+0000 7fe1a779cb80 1 -- 172.21.15.8:0/2442041213 wait complete. 2023-08-11T12:35:09.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.851+0000 7fe1a779cb80 1 -- start start 2023-08-11T12:35:09.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.851+0000 7fe1a779cb80 1 Processor -- start 2023-08-11T12:35:09.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.852+0000 7fe1a779cb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8de900e20 0x55f8de90cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:09.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.852+0000 7fe1a779cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8de906310 0x55f8de909de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:09.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.852+0000 7fe1a779cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8de906c30 0x55f8de90a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:09.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.852+0000 7fe1a779cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8de7f0ac0 con 0x55f8de906310 2023-08-11T12:35:09.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.852+0000 7fe1a779cb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8de7f07c0 con 0x55f8de900e20 2023-08-11T12:35:09.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.852+0000 7fe1a779cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8de6d4920 con 0x55f8de906c30 2023-08-11T12:35:09.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.852+0000 7fe1a779cb80 10 client.0 _ll_register_callbacks cb 0x55f8de7f3ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:35:09.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.852+0000 7fe19139a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8de900e20 0x55f8de90cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:09.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.852+0000 7fe191b9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8de906310 0x55f8de909de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:09.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.852+0000 7fe191b9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8de906310 0x55f8de909de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45886/0 (socket says 172.21.15.8:45886) 2023-08-11T12:35:09.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.852+0000 7fe191b9b700 1 -- 172.21.15.8:0/490345538 learned_addr learned my addr 172.21.15.8:0/490345538 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:35:09.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.852+0000 7fe19139a700 1 --2- 172.21.15.8:0/490345538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8de906c30 0x55f8de90a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:09.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.852+0000 7fe191b9b700 1 -- 172.21.15.8:0/490345538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8de906c30 msgr2=0x55f8de90a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:35:09.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.852+0000 7fe191b9b700 1 --2- 172.21.15.8:0/490345538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8de906c30 0x55f8de90a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.853+0000 7fe191b9b700 1 -- 172.21.15.8:0/490345538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8de900e20 msgr2=0x55f8de90cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:35:09.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.853+0000 7fe191b9b700 1 --2- 172.21.15.8:0/490345538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8de900e20 0x55f8de90cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.853+0000 7fe191b9b700 1 -- 172.21.15.8:0/490345538 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe18c10e130 con 0x55f8de906310 2023-08-11T12:35:09.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.853+0000 7fe191b9b700 1 --2- 172.21.15.8:0/490345538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8de906310 0x55f8de909de0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe18800b6f0 tx=0x7fe188000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d6aec1a37ba2efd server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:35:09.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.853+0000 7fe1757fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:35:09.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.853+0000 7fe1757fa700 1 -- 172.21.15.8:0/490345538 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18801d040 con 0x55f8de906310 2023-08-11T12:35:09.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.853+0000 7fe1a779cb80 1 -- 172.21.15.8:0/490345538 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f8de8f3a90 con 0x55f8de906310 2023-08-11T12:35:09.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.853+0000 7fe1757fa700 1 -- 172.21.15.8:0/490345538 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 9454+0+0 (secure 0 0 0) 0x7fe18800fd70 con 0x55f8de906310 2023-08-11T12:35:09.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.853+0000 7fe1757fa700 1 -- 172.21.15.8:0/490345538 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe188005610 con 0x55f8de906310 2023-08-11T12:35:09.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.853+0000 7fe1a779cb80 10 client.16449 fetch_fsmap learned FSMap version 54 2023-08-11T12:35:09.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.853+0000 7fe1a779cb80 1 -- 172.21.15.8:0/490345538 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x55f8de67ede0 con 0x55f8de906310 2023-08-11T12:35:09.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.854+0000 7fe1757fa700 1 -- 172.21.15.8:0/490345538 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe18803b020 con 0x55f8de906310 2023-08-11T12:35:09.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.854+0000 7fe1757fa700 1 -- 172.21.15.8:0/490345538 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe188022400 con 0x55f8de906310 2023-08-11T12:35:09.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.854+0000 7fe1a779cb80 10 client.16449 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:35:09.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.854+0000 7fe1a779cb80 10 client.16449 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:35:09.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.854+0000 7fe1a779cb80 20 client.16449 populate_metadata read hostname 'smithi008' 2023-08-11T12:35:09.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.854+0000 7fe1a779cb80 1 --2- 172.21.15.8:0/490345538 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f8de919ef0 0x55f8de91c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:09.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.854+0000 7fe1a779cb80 4 client.16449 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:35:09.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.854+0000 7fe1a779cb80 1 -- 172.21.15.8:0/490345538 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f8de8cf4e0 con 0x55f8de919ef0 2023-08-11T12:35:09.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.854+0000 7fe19139a700 1 --2- 172.21.15.8:0/490345538 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f8de919ef0 0x55f8de91c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:09.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.855+0000 7fe19139a700 1 --2- 172.21.15.8:0/490345538 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f8de919ef0 0x55f8de91c310 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4eaad72c29b778b server_cookie=a01c93ece7f77949 in_seq=0 out_seq=0 2023-08-11T12:35:09.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.855+0000 7fe1757fa700 10 client.16449 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:35:09.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.855+0000 7fe1757fa700 1 -- 172.21.15.8:0/490345538 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55f8de8cf4e0 con 0x55f8de919ef0 2023-08-11T12:35:09.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.855+0000 7fe1757fa700 10 client.16449 handle_command_reply: tid=0 2023-08-11T12:35:09.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.855+0000 7fe1a779cb80 1 client.16449 shutdown 2023-08-11T12:35:09.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.856+0000 7fe1a779cb80 1 -- 172.21.15.8:0/490345538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8de906310 msgr2=0x55f8de909de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:35:09.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.856+0000 7fe1a779cb80 1 --2- 172.21.15.8:0/490345538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8de906310 0x55f8de909de0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe18800b6f0 tx=0x7fe188000bc0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.856+0000 7fe1a779cb80 1 -- 172.21.15.8:0/490345538 shutdown_connections 2023-08-11T12:35:09.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.856+0000 7fe1a779cb80 1 --2- 172.21.15.8:0/490345538 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f8de919ef0 0x55f8de91c310 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.856+0000 7fe1a779cb80 1 --2- 172.21.15.8:0/490345538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8de906c30 0x55f8de90a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.856+0000 7fe1a779cb80 1 --2- 172.21.15.8:0/490345538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8de900e20 0x55f8de90cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.856+0000 7fe1a779cb80 1 --2- 172.21.15.8:0/490345538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8de906310 0x55f8de909de0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.856+0000 7fe1757fa700 0 client.16449 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:35:09.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.856+0000 7fe1a779cb80 1 -- 172.21.15.8:0/490345538 >> 172.21.15.8:0/490345538 conn(0x55f8de82d950 msgr2=0x55f8de8f5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:35:09.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.856+0000 7fe1a779cb80 1 -- 172.21.15.8:0/490345538 shutdown_connections 2023-08-11T12:35:09.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.856+0000 7fe1a779cb80 1 -- 172.21.15.8:0/490345538 wait complete. 2023-08-11T12:35:09.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.856+0000 7fe1a779cb80 20 client.16449 trim_cache size 0 max 16384 2023-08-11T12:35:09.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.873+0000 7fe1a779cb80 1 Processor -- start 2023-08-11T12:35:09.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.874+0000 7fe1a779cb80 1 -- start start 2023-08-11T12:35:09.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.874+0000 7fe1a779cb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8de900e20 0x55f8de9008e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:09.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.874+0000 7fe1a779cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8de906310 0x55f8de90c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:09.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.874+0000 7fe1a779cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8de906c30 0x55f8de90cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:09.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.874+0000 7fe1a779cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8de90d110 con 0x55f8de906c30 2023-08-11T12:35:09.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.874+0000 7fe1a779cb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8de906a70 con 0x55f8de900e20 2023-08-11T12:35:09.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.874+0000 7fe1a779cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8de8f7de0 con 0x55f8de906310 2023-08-11T12:35:09.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.874+0000 7fe19139a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8de900e20 0x55f8de9008e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:09.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.874+0000 7fe19139a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8de900e20 0x55f8de9008e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:36410/0 (socket says 172.21.15.8:36410) 2023-08-11T12:35:09.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.874+0000 7fe19139a700 1 -- 172.21.15.8:0/1489827479 learned_addr learned my addr 172.21.15.8:0/1489827479 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:35:09.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.874+0000 7fe19139a700 1 --2- 172.21.15.8:0/1489827479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8de906c30 0x55f8de90cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:09.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.874+0000 7fe191b9b700 1 --2- 172.21.15.8:0/1489827479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8de906310 0x55f8de90c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:09.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.875+0000 7fe191b9b700 1 -- 172.21.15.8:0/1489827479 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8de900e20 msgr2=0x55f8de9008e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:35:09.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.875+0000 7fe191b9b700 1 --2- 172.21.15.8:0/1489827479 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8de900e20 0x55f8de9008e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.875+0000 7fe191b9b700 1 -- 172.21.15.8:0/1489827479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8de906c30 msgr2=0x55f8de90cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:35:09.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.875+0000 7fe191b9b700 1 --2- 172.21.15.8:0/1489827479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8de906c30 0x55f8de90cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.875+0000 7fe191b9b700 1 -- 172.21.15.8:0/1489827479 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8de667c60 con 0x55f8de906310 2023-08-11T12:35:09.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.875+0000 7fe19139a700 1 --2- 172.21.15.8:0/1489827479 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8de900e20 0x55f8de9008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:35:09.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.875+0000 7fe191b9b700 1 --2- 172.21.15.8:0/1489827479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8de906310 0x55f8de90c5f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe188022760 tx=0x7fe188005a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c82affdfdd83518 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:35:09.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.875+0000 7fe180bff700 1 -- 172.21.15.8:0/1489827479 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18800f7f0 con 0x55f8de906310 2023-08-11T12:35:09.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.875+0000 7fe180bff700 1 -- 172.21.15.8:0/1489827479 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe18803b030 con 0x55f8de906310 2023-08-11T12:35:09.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.875+0000 7fe180bff700 1 -- 172.21.15.8:0/1489827479 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18800fdd0 con 0x55f8de906310 2023-08-11T12:35:09.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.876+0000 7fe1a779cb80 1 -- 172.21.15.8:0/1489827479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8de906310 msgr2=0x55f8de90c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:35:09.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.876+0000 7fe1a779cb80 1 --2- 172.21.15.8:0/1489827479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8de906310 0x55f8de90c5f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe188022760 tx=0x7fe188005a80 comp rx=0 tx=0).stop 2023-08-11T12:35:09.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.876+0000 7fe1a779cb80 1 -- 172.21.15.8:0/1489827479 shutdown_connections 2023-08-11T12:35:09.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.876+0000 7fe1a779cb80 1 --2- 172.21.15.8:0/1489827479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8de906c30 0x55f8de90cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.876+0000 7fe1a779cb80 1 --2- 172.21.15.8:0/1489827479 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8de900e20 0x55f8de9008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.876+0000 7fe1a779cb80 1 --2- 172.21.15.8:0/1489827479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8de906310 0x55f8de90c5f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.876+0000 7fe1a779cb80 1 -- 172.21.15.8:0/1489827479 >> 172.21.15.8:0/1489827479 conn(0x55f8de82d950 msgr2=0x55f8de904060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:35:09.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.876+0000 7fe1a779cb80 1 -- 172.21.15.8:0/1489827479 shutdown_connections 2023-08-11T12:35:09.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.876+0000 7fe1a779cb80 1 -- 172.21.15.8:0/1489827479 wait complete. 2023-08-11T12:35:09.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.876+0000 7fe1a779cb80 1 -- start start 2023-08-11T12:35:09.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.877+0000 7fe1a779cb80 1 Processor -- start 2023-08-11T12:35:09.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.877+0000 7fe1a779cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8de900e20 0x55f8de9112a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:09.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.877+0000 7fe1a779cb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8de906310 0x55f8de90f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:09.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.877+0000 7fe1a779cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8de906c30 0x55f8de90fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:09.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.877+0000 7fe1a779cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8de910050 con 0x55f8de906c30 2023-08-11T12:35:09.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.877+0000 7fe1a779cb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8de910190 con 0x55f8de906310 2023-08-11T12:35:09.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.877+0000 7fe1a779cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8de910350 con 0x55f8de900e20 2023-08-11T12:35:09.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.877+0000 7fe1a779cb80 10 client.0 _ll_register_callbacks cb 0x7fe17c009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:35:09.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.877+0000 7fe19139a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8de900e20 0x55f8de9112a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:09.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.877+0000 7fe191b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8de906310 0x55f8de90f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:09.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.877+0000 7fe191b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8de906310 0x55f8de90f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:36416/0 (socket says 172.21.15.8:36416) 2023-08-11T12:35:09.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.877+0000 7fe191b9b700 1 -- 172.21.15.8:0/3664325636 learned_addr learned my addr 172.21.15.8:0/3664325636 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:35:09.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.877+0000 7fe19139a700 1 --2- 172.21.15.8:0/3664325636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8de906c30 0x55f8de90fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:09.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.878+0000 7fe191b9b700 1 -- 172.21.15.8:0/3664325636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8de900e20 msgr2=0x55f8de9112a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:35:09.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.878+0000 7fe191b9b700 1 --2- 172.21.15.8:0/3664325636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8de900e20 0x55f8de9112a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.878+0000 7fe191b9b700 1 -- 172.21.15.8:0/3664325636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8de906c30 msgr2=0x55f8de90fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:35:09.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.878+0000 7fe191b9b700 1 --2- 172.21.15.8:0/3664325636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8de906c30 0x55f8de90fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.878+0000 7fe191b9b700 1 -- 172.21.15.8:0/3664325636 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17c023490 con 0x55f8de906310 2023-08-11T12:35:09.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.878+0000 7fe191b9b700 1 --2- 172.21.15.8:0/3664325636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8de906310 0x55f8de90f5d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe1880059a0 tx=0x7fe188005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8c7e4ef33f28d0e server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:35:09.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.878+0000 7fe1757fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:35:09.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.878+0000 7fe1757fa700 1 -- 172.21.15.8:0/3664325636 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18801d030 con 0x55f8de906310 2023-08-11T12:35:09.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.879+0000 7fe1757fa700 1 -- 172.21.15.8:0/3664325636 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 9454+0+0 (secure 0 0 0) 0x7fe188000e40 con 0x55f8de906310 2023-08-11T12:35:09.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.879+0000 7fe1a779cb80 1 -- 172.21.15.8:0/3664325636 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe18801e040 con 0x55f8de906310 2023-08-11T12:35:09.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.879+0000 7fe1757fa700 1 -- 172.21.15.8:0/3664325636 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe18800f7f0 con 0x55f8de906310 2023-08-11T12:35:09.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.879+0000 7fe1a779cb80 10 client.26498 fetch_fsmap learned FSMap version 54 2023-08-11T12:35:09.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.879+0000 7fe1a779cb80 1 -- 172.21.15.8:0/3664325636 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x55f8de67ede0 con 0x55f8de906310 2023-08-11T12:35:09.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.879+0000 7fe1757fa700 1 -- 172.21.15.8:0/3664325636 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe18801e040 con 0x55f8de906310 2023-08-11T12:35:09.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.879+0000 7fe1757fa700 1 -- 172.21.15.8:0/3664325636 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe1880049b0 con 0x55f8de906310 2023-08-11T12:35:09.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.880+0000 7fe1a779cb80 10 client.26498 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:35:09.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.880+0000 7fe1a779cb80 10 client.26498 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:35:09.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.880+0000 7fe1a779cb80 20 client.26498 populate_metadata read hostname 'smithi008' 2023-08-11T12:35:09.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.880+0000 7fe1a779cb80 1 --2- 172.21.15.8:0/3664325636 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f8de96ebb0 0x55f8de970fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:09.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.880+0000 7fe1a779cb80 4 client.26498 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:35:09.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.880+0000 7fe1a779cb80 1 -- 172.21.15.8:0/3664325636 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f8de84b820 con 0x55f8de96ebb0 2023-08-11T12:35:09.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.880+0000 7fe19139a700 1 --2- 172.21.15.8:0/3664325636 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f8de96ebb0 0x55f8de970fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:09.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.880+0000 7fe19139a700 1 --2- 172.21.15.8:0/3664325636 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f8de96ebb0 0x55f8de970fa0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f81874673aa66d0a server_cookie=406704a4d528cdb5 in_seq=0 out_seq=0 2023-08-11T12:35:09.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.880+0000 7fe1757fa700 10 client.26498 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:35:09.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.880+0000 7fe1757fa700 1 -- 172.21.15.8:0/3664325636 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55f8de84b820 con 0x55f8de96ebb0 2023-08-11T12:35:09.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.880+0000 7fe1757fa700 10 client.26498 handle_command_reply: tid=0 2023-08-11T12:35:09.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.880+0000 7fe1a779cb80 1 client.26498 shutdown 2023-08-11T12:35:09.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.881+0000 7fe1a779cb80 1 -- 172.21.15.8:0/3664325636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8de906310 msgr2=0x55f8de90f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:35:09.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.881+0000 7fe1a779cb80 1 --2- 172.21.15.8:0/3664325636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8de906310 0x55f8de90f5d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe1880059a0 tx=0x7fe188005f10 comp rx=0 tx=0).stop 2023-08-11T12:35:09.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.881+0000 7fe1a779cb80 1 -- 172.21.15.8:0/3664325636 shutdown_connections 2023-08-11T12:35:09.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.881+0000 7fe1a779cb80 1 --2- 172.21.15.8:0/3664325636 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55f8de96ebb0 0x55f8de970fa0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.881+0000 7fe1a779cb80 1 --2- 172.21.15.8:0/3664325636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8de900e20 0x55f8de9112a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.881+0000 7fe1a779cb80 1 --2- 172.21.15.8:0/3664325636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8de906c30 0x55f8de90fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.881+0000 7fe1a779cb80 1 --2- 172.21.15.8:0/3664325636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8de906310 0x55f8de90f5d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.881+0000 7fe1757fa700 0 client.26498 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:35:09.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.881+0000 7fe1a779cb80 1 -- 172.21.15.8:0/3664325636 >> 172.21.15.8:0/3664325636 conn(0x55f8de82d950 msgr2=0x55f8de907010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:35:09.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.881+0000 7fe1a779cb80 1 -- 172.21.15.8:0/3664325636 shutdown_connections 2023-08-11T12:35:09.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.881+0000 7fe1a779cb80 1 -- 172.21.15.8:0/3664325636 wait complete. 2023-08-11T12:35:09.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.881+0000 7fe1a779cb80 20 client.26498 trim_cache size 0 max 16384 2023-08-11T12:35:09.925 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:35:09.925 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:35:09.926 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:35:09.926 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:35:09.926 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:35:09.926 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:35:09.926 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:35:09.927 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:35:09.927 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:35:09.927 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:35:09.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.882+0000 7fe193dff700 1 -- 172.21.15.8:0/1868051849 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe1780a00c0 msgr2=0x7fe1780a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:35:09.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.882+0000 7fe193dff700 1 --2- 172.21.15.8:0/1868051849 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe1780a00c0 0x7fe1780a2580 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe1840090a0 tx=0x7fe184009ed0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.882+0000 7fe193dff700 1 -- 172.21.15.8:0/1868051849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe18c106970 msgr2=0x7fe18c1a4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:35:09.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.882+0000 7fe193dff700 1 --2- 172.21.15.8:0/1868051849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe18c106970 0x7fe18c1a4c40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe18400ef30 tx=0x7fe18400c3a0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.882+0000 7fe193dff700 1 -- 172.21.15.8:0/1868051849 shutdown_connections 2023-08-11T12:35:09.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.882+0000 7fe193dff700 1 --2- 172.21.15.8:0/1868051849 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe1780a00c0 0x7fe1780a2580 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.882+0000 7fe193dff700 1 --2- 172.21.15.8:0/1868051849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe18c100960 0x7fe18c072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.882+0000 7fe193dff700 1 --2- 172.21.15.8:0/1868051849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe18c106970 0x7fe18c1a4c40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.882+0000 7fe193dff700 1 --2- 172.21.15.8:0/1868051849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe18c101320 0x7fe18c073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:09.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.882+0000 7fe193dff700 1 -- 172.21.15.8:0/1868051849 >> 172.21.15.8:0/1868051849 conn(0x7fe18c0fc490 msgr2=0x7fe18c0fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:35:09.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.882+0000 7fe193dff700 1 -- 172.21.15.8:0/1868051849 shutdown_connections 2023-08-11T12:35:09.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:09.882+0000 7fe193dff700 1 -- 172.21.15.8:0/1868051849 wait complete. 2023-08-11T12:35:09.931 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:35:11.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:10 smithi008 ceph-mon[97158]: pgmap v329: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:35:11.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:10 smithi194 ceph-mon[130905]: pgmap v329: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:35:11.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:10 smithi045 ceph-mon[130284]: pgmap v329: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:35:12.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:12 smithi008 ceph-mon[97158]: pgmap v330: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:35:12.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:12 smithi194 ceph-mon[130905]: pgmap v330: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:35:12.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:12 smithi045 ceph-mon[130284]: pgmap v330: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:35:14.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:14 smithi008 ceph-mon[97158]: pgmap v331: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:35:14.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:14 smithi194 ceph-mon[130905]: pgmap v331: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:35:14.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:14 smithi045 ceph-mon[130284]: pgmap v331: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:35:16.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:15 smithi008 ceph-mon[97158]: osdmap e100: 12 total, 12 up, 12 in 2023-08-11T12:35:16.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:15 smithi194 ceph-mon[130905]: osdmap e100: 12 total, 12 up, 12 in 2023-08-11T12:35:16.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:15 smithi045 ceph-mon[130284]: osdmap e100: 12 total, 12 up, 12 in 2023-08-11T12:35:17.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:16 smithi008 ceph-mon[97158]: pgmap v333: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 124 B/s wr, 6 op/s 2023-08-11T12:35:17.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:16 smithi194 ceph-mon[130905]: pgmap v333: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 124 B/s wr, 6 op/s 2023-08-11T12:35:17.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:16 smithi045 ceph-mon[130284]: pgmap v333: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 124 B/s wr, 6 op/s 2023-08-11T12:35:18.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:18 smithi008 ceph-mon[97158]: pgmap v334: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:35:18.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:18 smithi194 ceph-mon[130905]: pgmap v334: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:35:18.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:18 smithi045 ceph-mon[130284]: pgmap v334: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:35:21.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:20 smithi008 ceph-mon[97158]: pgmap v335: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:35:21.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:20 smithi194 ceph-mon[130905]: pgmap v335: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:35:21.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:20 smithi045 ceph-mon[130284]: pgmap v335: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:35:22.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:22 smithi008 ceph-mon[97158]: pgmap v336: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:35:22.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:22 smithi194 ceph-mon[130905]: pgmap v336: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:35:22.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:22 smithi045 ceph-mon[130284]: pgmap v336: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:35:24.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:24 smithi008 ceph-mon[97158]: pgmap v337: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:35:24.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:24 smithi194 ceph-mon[130905]: pgmap v337: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:35:24.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:24 smithi045 ceph-mon[130284]: pgmap v337: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:35:26.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:26 smithi008 ceph-mon[97158]: pgmap v338: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:35:26.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:26 smithi194 ceph-mon[130905]: pgmap v338: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:35:26.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:26 smithi045 ceph-mon[130284]: pgmap v338: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:35:28.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:28 smithi008 ceph-mon[97158]: pgmap v339: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:35:28.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:28 smithi194 ceph-mon[130905]: pgmap v339: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:35:28.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:28 smithi045 ceph-mon[130284]: pgmap v339: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:35:31.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:30 smithi008 ceph-mon[97158]: pgmap v340: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:31.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:30 smithi194 ceph-mon[130905]: pgmap v340: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:31.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:30 smithi045 ceph-mon[130284]: pgmap v340: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:32.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:32 smithi008 ceph-mon[97158]: pgmap v341: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:35:32.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:32 smithi194 ceph-mon[130905]: pgmap v341: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:35:32.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:32 smithi045 ceph-mon[130284]: pgmap v341: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:35:34.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:34 smithi008 ceph-mon[97158]: pgmap v342: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:34.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:34 smithi194 ceph-mon[130905]: pgmap v342: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:34.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:34 smithi045 ceph-mon[130284]: pgmap v342: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:36.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:36 smithi008 ceph-mon[97158]: pgmap v343: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:36.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:36 smithi194 ceph-mon[130905]: pgmap v343: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:36.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:36 smithi045 ceph-mon[130284]: pgmap v343: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:38.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:38 smithi008 ceph-mon[97158]: pgmap v344: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:35:38.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:38 smithi194 ceph-mon[130905]: pgmap v344: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:35:38.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:38 smithi045 ceph-mon[130284]: pgmap v344: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:35:39.932 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:35:40.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.152+0000 7fd21d7ff700 1 -- 172.21.15.8:0/1014866532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd218106970 msgr2=0x7fd218106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:35:40.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.152+0000 7fd21d7ff700 1 --2- 172.21.15.8:0/1014866532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd218106970 0x7fd218106d50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd208009990 tx=0x7fd208009ca0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.152+0000 7fd21d7ff700 1 -- 172.21.15.8:0/1014866532 shutdown_connections 2023-08-11T12:35:40.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.152+0000 7fd21d7ff700 1 --2- 172.21.15.8:0/1014866532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd218101320 0x7fd21810d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.152+0000 7fd21d7ff700 1 --2- 172.21.15.8:0/1014866532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd218106970 0x7fd218106d50 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.152+0000 7fd21d7ff700 1 --2- 172.21.15.8:0/1014866532 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd218100960 0x7fd218100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.152+0000 7fd21d7ff700 1 -- 172.21.15.8:0/1014866532 >> 172.21.15.8:0/1014866532 conn(0x7fd2180fc490 msgr2=0x7fd2180fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:35:40.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.152+0000 7fd21d7ff700 1 -- 172.21.15.8:0/1014866532 shutdown_connections 2023-08-11T12:35:40.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.152+0000 7fd21d7ff700 1 -- 172.21.15.8:0/1014866532 wait complete. 2023-08-11T12:35:40.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.153+0000 7fd21d7ff700 1 Processor -- start 2023-08-11T12:35:40.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.153+0000 7fd21d7ff700 1 -- start start 2023-08-11T12:35:40.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.154+0000 7fd21d7ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd218100960 0x7fd21819e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:40.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.154+0000 7fd21d7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd218101320 0x7fd21819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:40.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.154+0000 7fd21d7ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd218106970 0x7fd218198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:40.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.154+0000 7fd21d7ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2181990d0 con 0x7fd218100960 2023-08-11T12:35:40.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.154+0000 7fd21d7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd218199240 con 0x7fd218101320 2023-08-11T12:35:40.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.154+0000 7fd21d7ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd218199400 con 0x7fd218106970 2023-08-11T12:35:40.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.154+0000 7fd216ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd218100960 0x7fd21819e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:40.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.154+0000 7fd2167fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd218101320 0x7fd21819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:40.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.154+0000 7fd2167fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd218101320 0x7fd21819ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:45208/0 (socket says 172.21.15.8:45208) 2023-08-11T12:35:40.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.154+0000 7fd2167fc700 1 -- 172.21.15.8:0/3404099716 learned_addr learned my addr 172.21.15.8:0/3404099716 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:35:40.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.154+0000 7fd216ffd700 1 --2- 172.21.15.8:0/3404099716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd218100960 0x7fd21819e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54458/0 (socket says 172.21.15.8:54458) 2023-08-11T12:35:40.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.154+0000 7fd2177fe700 1 --2- 172.21.15.8:0/3404099716 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd218106970 0x7fd218198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:40.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.155+0000 7fd216ffd700 1 -- 172.21.15.8:0/3404099716 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd218106970 msgr2=0x7fd218198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:35:40.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.155+0000 7fd216ffd700 1 --2- 172.21.15.8:0/3404099716 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd218106970 0x7fd218198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.155+0000 7fd216ffd700 1 -- 172.21.15.8:0/3404099716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd218101320 msgr2=0x7fd21819ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:35:40.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.155+0000 7fd216ffd700 1 --2- 172.21.15.8:0/3404099716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd218101320 0x7fd21819ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.155+0000 7fd216ffd700 1 -- 172.21.15.8:0/3404099716 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c009520 con 0x7fd218100960 2023-08-11T12:35:40.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.155+0000 7fd2167fc700 1 --2- 172.21.15.8:0/3404099716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd218101320 0x7fd21819ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:35:40.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.155+0000 7fd216ffd700 1 --2- 172.21.15.8:0/3404099716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd218100960 0x7fd21819e9f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd2080059d0 tx=0x7fd208005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:35:40.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.155+0000 7fd1fffff700 1 -- 172.21.15.8:0/3404099716 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20801d070 con 0x7fd218100960 2023-08-11T12:35:40.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.155+0000 7fd21d7ff700 1 -- 172.21.15.8:0/3404099716 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2080095f0 con 0x7fd218100960 2023-08-11T12:35:40.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.155+0000 7fd1fffff700 1 -- 172.21.15.8:0/3404099716 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd208022470 con 0x7fd218100960 2023-08-11T12:35:40.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.155+0000 7fd1fffff700 1 -- 172.21.15.8:0/3404099716 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208017650 con 0x7fd218100960 2023-08-11T12:35:40.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.155+0000 7fd21d7ff700 1 -- 172.21.15.8:0/3404099716 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2181a5800 con 0x7fd218100960 2023-08-11T12:35:40.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.158+0000 7fd1fffff700 1 -- 172.21.15.8:0/3404099716 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7fd208022890 con 0x7fd218100960 2023-08-11T12:35:40.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.160+0000 7fd2311d6b80 1 Processor -- start 2023-08-11T12:35:40.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.160+0000 7fd2311d6b80 1 -- start start 2023-08-11T12:35:40.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.160+0000 7fd1fffff700 1 --2- 172.21.15.8:0/3404099716 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fd2000a00c0 0x7fd2000a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:40.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.160+0000 7fd1fffff700 1 -- 172.21.15.8:0/3404099716 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9366+0+0 (secure 0 0 0) 0x7fd2080ccdd0 con 0x7fd218100960 2023-08-11T12:35:40.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.160+0000 7fd2177fe700 1 --2- 172.21.15.8:0/3404099716 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fd2000a00c0 0x7fd2000a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:40.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.160+0000 7fd2311d6b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559648bd1310 0x559648bd16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:40.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.161+0000 7fd2311d6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559648bd1c30 0x559648bcb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:40.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.161+0000 7fd2311d6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559648bcbe20 0x559648bcc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:40.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.161+0000 7fd2311d6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559648b24630 con 0x559648bcbe20 2023-08-11T12:35:40.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.161+0000 7fd2311d6b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559648b21f50 con 0x559648bd1310 2023-08-11T12:35:40.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.161+0000 7fd2311d6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x559648b1d840 con 0x559648bd1c30 2023-08-11T12:35:40.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.161+0000 7fd216ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559648bd1310 0x559648bd16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:40.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.161+0000 7fd216ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559648bd1310 0x559648bd16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:45212/0 (socket says 172.21.15.8:45212) 2023-08-11T12:35:40.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.161+0000 7fd216ffd700 1 -- 172.21.15.8:0/3343895725 learned_addr learned my addr 172.21.15.8:0/3343895725 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:35:40.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.161+0000 7fd2177fe700 1 --2- 172.21.15.8:0/3343895725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559648bcbe20 0x559648bcc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:40.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.161+0000 7fd2167fc700 1 --2- 172.21.15.8:0/3343895725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559648bd1c30 0x559648bcb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:40.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.161+0000 7fd216ffd700 1 -- 172.21.15.8:0/3343895725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559648bd1c30 msgr2=0x559648bcb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:35:40.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.161+0000 7fd216ffd700 1 --2- 172.21.15.8:0/3343895725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559648bd1c30 0x559648bcb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.161+0000 7fd216ffd700 1 -- 172.21.15.8:0/3343895725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559648bcbe20 msgr2=0x559648bcc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:35:40.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.161+0000 7fd216ffd700 1 --2- 172.21.15.8:0/3343895725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559648bcbe20 0x559648bcc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.161+0000 7fd216ffd700 1 -- 172.21.15.8:0/3343895725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55964899d630 con 0x559648bd1310 2023-08-11T12:35:40.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.161+0000 7fd2167fc700 1 --2- 172.21.15.8:0/3343895725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559648bd1c30 0x559648bcb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:35:40.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.161+0000 7fd2177fe700 1 --2- 172.21.15.8:0/3404099716 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fd2000a00c0 0x7fd2000a2580 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd210009790 tx=0x7fd210004040 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:35:40.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.161+0000 7fd216ffd700 1 --2- 172.21.15.8:0/3343895725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559648bd1310 0x559648bd16f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd2080966c0 tx=0x7fd208099d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f2bf8c3a303ad4a server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:35:40.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.162+0000 7fd1fd7fa700 1 -- 172.21.15.8:0/3343895725 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20809a1c0 con 0x559648bd1310 2023-08-11T12:35:40.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.162+0000 7fd1fd7fa700 1 -- 172.21.15.8:0/3343895725 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd20809dff0 con 0x559648bd1310 2023-08-11T12:35:40.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.162+0000 7fd1fd7fa700 1 -- 172.21.15.8:0/3343895725 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20809a420 con 0x559648bd1310 2023-08-11T12:35:40.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.162+0000 7fd2311d6b80 1 -- 172.21.15.8:0/3343895725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559648bd1310 msgr2=0x559648bd16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:35:40.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.162+0000 7fd2311d6b80 1 --2- 172.21.15.8:0/3343895725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559648bd1310 0x559648bd16f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd2080966c0 tx=0x7fd208099d80 comp rx=0 tx=0).stop 2023-08-11T12:35:40.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.163+0000 7fd2311d6b80 1 -- 172.21.15.8:0/3343895725 shutdown_connections 2023-08-11T12:35:40.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.163+0000 7fd2311d6b80 1 --2- 172.21.15.8:0/3343895725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559648bcbe20 0x559648bcc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.163+0000 7fd2311d6b80 1 --2- 172.21.15.8:0/3343895725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559648bd1310 0x559648bd16f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.163+0000 7fd2311d6b80 1 --2- 172.21.15.8:0/3343895725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559648bd1c30 0x559648bcb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.163+0000 7fd2311d6b80 1 -- 172.21.15.8:0/3343895725 >> 172.21.15.8:0/3343895725 conn(0x559648af8950 msgr2=0x559648bc63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:35:40.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.163+0000 7fd2311d6b80 1 -- 172.21.15.8:0/3343895725 shutdown_connections 2023-08-11T12:35:40.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.163+0000 7fd2311d6b80 1 -- 172.21.15.8:0/3343895725 wait complete. 2023-08-11T12:35:40.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.163+0000 7fd2311d6b80 1 -- start start 2023-08-11T12:35:40.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.163+0000 7fd2311d6b80 1 Processor -- start 2023-08-11T12:35:40.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.164+0000 7fd2311d6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559648bcbe20 0x559648bd7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:40.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.164+0000 7fd2311d6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559648bd1310 0x559648bd4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:40.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.164+0000 7fd2311d6b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559648bd1c30 0x559648bd5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:40.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.164+0000 7fd2311d6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559648abbac0 con 0x559648bcbe20 2023-08-11T12:35:40.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.164+0000 7fd2311d6b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559648abb7c0 con 0x559648bd1c30 2023-08-11T12:35:40.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.164+0000 7fd2311d6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55964899f920 con 0x559648bd1310 2023-08-11T12:35:40.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.164+0000 7fd2311d6b80 10 client.0 _ll_register_callbacks cb 0x559648abeab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:35:40.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.164+0000 7fd216ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559648bcbe20 0x559648bd7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:40.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.164+0000 7fd2177fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559648bd1c30 0x559648bd5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:40.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.164+0000 7fd2177fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559648bd1c30 0x559648bd5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:45216/0 (socket says 172.21.15.8:45216) 2023-08-11T12:35:40.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.164+0000 7fd2177fe700 1 -- 172.21.15.8:0/4022756694 learned_addr learned my addr 172.21.15.8:0/4022756694 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:35:40.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.164+0000 7fd216ffd700 1 --2- 172.21.15.8:0/4022756694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559648bcbe20 0x559648bd7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54480/0 (socket says 172.21.15.8:54480) 2023-08-11T12:35:40.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.164+0000 7fd2167fc700 1 --2- 172.21.15.8:0/4022756694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559648bd1310 0x559648bd4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:40.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.164+0000 7fd2177fe700 1 -- 172.21.15.8:0/4022756694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559648bd1310 msgr2=0x559648bd4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:35:40.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.164+0000 7fd2177fe700 1 --2- 172.21.15.8:0/4022756694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559648bd1310 0x559648bd4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.165+0000 7fd2177fe700 1 -- 172.21.15.8:0/4022756694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559648bcbe20 msgr2=0x559648bd7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:35:40.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.165+0000 7fd2177fe700 1 --2- 172.21.15.8:0/4022756694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559648bcbe20 0x559648bd7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.165+0000 7fd2177fe700 1 -- 172.21.15.8:0/4022756694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2181a5800 con 0x559648bd1c30 2023-08-11T12:35:40.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.165+0000 7fd2177fe700 1 --2- 172.21.15.8:0/4022756694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559648bd1c30 0x559648bd5280 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd210004a40 tx=0x7fd210004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be0129da84c3b8bf server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:35:40.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.165+0000 7fd1faff5700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:35:40.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.165+0000 7fd1faff5700 1 -- 172.21.15.8:0/4022756694 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21001a670 con 0x559648bd1c30 2023-08-11T12:35:40.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.165+0000 7fd2311d6b80 1 -- 172.21.15.8:0/4022756694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559648bbea90 con 0x559648bd1c30 2023-08-11T12:35:40.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.165+0000 7fd1faff5700 1 -- 172.21.15.8:0/4022756694 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9366+0+0 (secure 0 0 0) 0x7fd21001a7d0 con 0x559648bd1c30 2023-08-11T12:35:40.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.165+0000 7fd1faff5700 1 -- 172.21.15.8:0/4022756694 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd21001a990 con 0x559648bd1c30 2023-08-11T12:35:40.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.165+0000 7fd2311d6b80 10 client.26510 fetch_fsmap learned FSMap version 54 2023-08-11T12:35:40.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.165+0000 7fd2311d6b80 1 -- 172.21.15.8:0/4022756694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x559648949de0 con 0x559648bd1c30 2023-08-11T12:35:40.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.166+0000 7fd1faff5700 1 -- 172.21.15.8:0/4022756694 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559648bbea90 con 0x559648bd1c30 2023-08-11T12:35:40.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.166+0000 7fd1faff5700 1 -- 172.21.15.8:0/4022756694 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd210019c30 con 0x559648bd1c30 2023-08-11T12:35:40.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.166+0000 7fd2311d6b80 10 client.26510 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:35:40.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.166+0000 7fd2311d6b80 10 client.26510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:35:40.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.166+0000 7fd2311d6b80 20 client.26510 populate_metadata read hostname 'smithi008' 2023-08-11T12:35:40.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.166+0000 7fd2311d6b80 1 --2- 172.21.15.8:0/4022756694 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x559648be5140 0x559648be7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:40.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.166+0000 7fd2311d6b80 4 client.26510 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:35:40.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.166+0000 7fd2311d6b80 1 -- 172.21.15.8:0/4022756694 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559648b9a4e0 con 0x559648be5140 2023-08-11T12:35:40.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.166+0000 7fd216ffd700 1 --2- 172.21.15.8:0/4022756694 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x559648be5140 0x559648be7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:40.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.167+0000 7fd1faff5700 10 client.26510 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:35:40.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.167+0000 7fd216ffd700 1 --2- 172.21.15.8:0/4022756694 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x559648be5140 0x559648be7560 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=612e892ce7a7184a server_cookie=221fcdf8239baf2 in_seq=0 out_seq=0 2023-08-11T12:35:40.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.168+0000 7fd1faff5700 1 -- 172.21.15.8:0/4022756694 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x559648b9a4e0 con 0x559648be5140 2023-08-11T12:35:40.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.168+0000 7fd1faff5700 10 client.26510 handle_command_reply: tid=0 2023-08-11T12:35:40.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.168+0000 7fd2311d6b80 1 client.26510 shutdown 2023-08-11T12:35:40.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.168+0000 7fd2311d6b80 1 -- 172.21.15.8:0/4022756694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559648bd1c30 msgr2=0x559648bd5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:35:40.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.168+0000 7fd2311d6b80 1 --2- 172.21.15.8:0/4022756694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559648bd1c30 0x559648bd5280 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd210004a40 tx=0x7fd210004b40 comp rx=0 tx=0).stop 2023-08-11T12:35:40.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.168+0000 7fd2311d6b80 1 -- 172.21.15.8:0/4022756694 shutdown_connections 2023-08-11T12:35:40.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.168+0000 7fd2311d6b80 1 --2- 172.21.15.8:0/4022756694 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x559648be5140 0x559648be7560 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.168+0000 7fd2311d6b80 1 --2- 172.21.15.8:0/4022756694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559648bd1c30 0x559648bd5280 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.168+0000 7fd2311d6b80 1 --2- 172.21.15.8:0/4022756694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559648bcbe20 0x559648bd7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.168+0000 7fd1faff5700 0 client.26510 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:35:40.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.168+0000 7fd2311d6b80 1 --2- 172.21.15.8:0/4022756694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559648bd1310 0x559648bd4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.168+0000 7fd2311d6b80 1 -- 172.21.15.8:0/4022756694 >> 172.21.15.8:0/4022756694 conn(0x559648af8950 msgr2=0x559648bc0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:35:40.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.168+0000 7fd2311d6b80 1 -- 172.21.15.8:0/4022756694 shutdown_connections 2023-08-11T12:35:40.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.168+0000 7fd2311d6b80 1 -- 172.21.15.8:0/4022756694 wait complete. 2023-08-11T12:35:40.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.168+0000 7fd2311d6b80 20 client.26510 trim_cache size 0 max 16384 2023-08-11T12:35:40.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.186+0000 7fd2311d6b80 1 Processor -- start 2023-08-11T12:35:40.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.186+0000 7fd2311d6b80 1 -- start start 2023-08-11T12:35:40.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.186+0000 7fd2311d6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559648bcbe20 0x559648bcb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:40.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.186+0000 7fd2311d6b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559648bd1310 0x559648bdc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:40.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.186+0000 7fd2311d6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559648bd1c30 0x559648bd7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:40.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.187+0000 7fd2311d6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559648bd16f0 con 0x559648bcbe20 2023-08-11T12:35:40.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.187+0000 7fd2311d6b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559648bbe820 con 0x559648bd1310 2023-08-11T12:35:40.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.187+0000 7fd2311d6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x559648bec320 con 0x559648bd1c30 2023-08-11T12:35:40.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.187+0000 7fd216ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559648bcbe20 0x559648bcb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:40.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.187+0000 7fd2167fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559648bd1310 0x559648bdc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:40.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.187+0000 7fd216ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559648bcbe20 0x559648bcb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54486/0 (socket says 172.21.15.8:54486) 2023-08-11T12:35:40.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.187+0000 7fd216ffd700 1 -- 172.21.15.8:0/1797989522 learned_addr learned my addr 172.21.15.8:0/1797989522 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:35:40.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.187+0000 7fd2167fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559648bd1310 0x559648bdc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:45228/0 (socket says 172.21.15.8:45228) 2023-08-11T12:35:40.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.187+0000 7fd2177fe700 1 --2- 172.21.15.8:0/1797989522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559648bd1c30 0x559648bd7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:40.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.187+0000 7fd216ffd700 1 -- 172.21.15.8:0/1797989522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559648bd1c30 msgr2=0x559648bd7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:35:40.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.187+0000 7fd216ffd700 1 --2- 172.21.15.8:0/1797989522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559648bd1c30 0x559648bd7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.187+0000 7fd216ffd700 1 -- 172.21.15.8:0/1797989522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559648bd1310 msgr2=0x559648bdc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:35:40.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.187+0000 7fd216ffd700 1 --2- 172.21.15.8:0/1797989522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559648bd1310 0x559648bdc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.187+0000 7fd216ffd700 1 -- 172.21.15.8:0/1797989522 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559648bcc4d0 con 0x559648bcbe20 2023-08-11T12:35:40.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.187+0000 7fd2167fc700 1 --2- 172.21.15.8:0/1797989522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559648bd1310 0x559648bdc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:35:40.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.187+0000 7fd216ffd700 1 --2- 172.21.15.8:0/1797989522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559648bcbe20 0x559648bcb8e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd20800b6f0 tx=0x7fd208005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d8e950041781cae server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:35:40.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.188+0000 7fd1fdffb700 1 -- 172.21.15.8:0/1797989522 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208098560 con 0x559648bcbe20 2023-08-11T12:35:40.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.188+0000 7fd1fdffb700 1 -- 172.21.15.8:0/1797989522 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd2080225e0 con 0x559648bcbe20 2023-08-11T12:35:40.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.188+0000 7fd1fdffb700 1 -- 172.21.15.8:0/1797989522 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20800fc50 con 0x559648bcbe20 2023-08-11T12:35:40.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.188+0000 7fd2311d6b80 1 -- 172.21.15.8:0/1797989522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559648bcbe20 msgr2=0x559648bcb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:35:40.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.188+0000 7fd2311d6b80 1 --2- 172.21.15.8:0/1797989522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559648bcbe20 0x559648bcb8e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd20800b6f0 tx=0x7fd208005fd0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.189+0000 7fd2311d6b80 1 -- 172.21.15.8:0/1797989522 shutdown_connections 2023-08-11T12:35:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.189+0000 7fd2311d6b80 1 --2- 172.21.15.8:0/1797989522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559648bd1c30 0x559648bd7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.189+0000 7fd2311d6b80 1 --2- 172.21.15.8:0/1797989522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559648bcbe20 0x559648bcb8e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.189+0000 7fd2311d6b80 1 --2- 172.21.15.8:0/1797989522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559648bd1310 0x559648bdc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.189+0000 7fd2311d6b80 1 -- 172.21.15.8:0/1797989522 >> 172.21.15.8:0/1797989522 conn(0x559648af8950 msgr2=0x559648bcef20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:35:40.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.189+0000 7fd2311d6b80 1 -- 172.21.15.8:0/1797989522 shutdown_connections 2023-08-11T12:35:40.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.189+0000 7fd2311d6b80 1 -- 172.21.15.8:0/1797989522 wait complete. 2023-08-11T12:35:40.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.189+0000 7fd2311d6b80 1 -- start start 2023-08-11T12:35:40.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.189+0000 7fd2311d6b80 1 Processor -- start 2023-08-11T12:35:40.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.190+0000 7fd2311d6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559648bcbe20 0x559648bcde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:40.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.190+0000 7fd2311d6b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559648bd1310 0x559648bce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:40.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.190+0000 7fd2311d6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559648bd1c30 0x559648bccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:40.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.190+0000 7fd2311d6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559648bcea80 con 0x559648bd1c30 2023-08-11T12:35:40.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.190+0000 7fd2311d6b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559648bcd250 con 0x559648bd1310 2023-08-11T12:35:40.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.190+0000 7fd2311d6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x559648bcd3e0 con 0x559648bcbe20 2023-08-11T12:35:40.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.190+0000 7fd2311d6b80 10 client.0 _ll_register_callbacks cb 0x559648abeab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:35:40.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.190+0000 7fd2167fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559648bd1310 0x559648bce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:40.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.190+0000 7fd2177fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559648bd1c30 0x559648bccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:40.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.190+0000 7fd2167fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559648bd1310 0x559648bce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:45240/0 (socket says 172.21.15.8:45240) 2023-08-11T12:35:40.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.190+0000 7fd2167fc700 1 -- 172.21.15.8:0/1637338684 learned_addr learned my addr 172.21.15.8:0/1637338684 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:35:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.190+0000 7fd216ffd700 1 --2- 172.21.15.8:0/1637338684 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559648bcbe20 0x559648bcde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.190+0000 7fd2167fc700 1 -- 172.21.15.8:0/1637338684 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559648bcbe20 msgr2=0x559648bcde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:35:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.190+0000 7fd2167fc700 1 --2- 172.21.15.8:0/1637338684 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559648bcbe20 0x559648bcde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.190+0000 7fd2167fc700 1 -- 172.21.15.8:0/1637338684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559648bd1c30 msgr2=0x559648bccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:35:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.190+0000 7fd2167fc700 1 --2- 172.21.15.8:0/1637338684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559648bd1c30 0x559648bccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.190+0000 7fd2167fc700 1 -- 172.21.15.8:0/1637338684 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20c010430 con 0x559648bd1310 2023-08-11T12:35:40.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.190+0000 7fd2177fe700 1 --2- 172.21.15.8:0/1637338684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559648bd1c30 0x559648bccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:35:40.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.191+0000 7fd2167fc700 1 --2- 172.21.15.8:0/1637338684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559648bd1310 0x559648bce340 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd2180feda0 tx=0x7fd20c00f6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3904641aba7f7e97 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:35:40.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.191+0000 7fd1faff5700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:35:40.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.191+0000 7fd1faff5700 1 -- 172.21.15.8:0/1637338684 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c021070 con 0x559648bd1310 2023-08-11T12:35:40.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.191+0000 7fd2311d6b80 1 -- 172.21.15.8:0/1637338684 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd20809dff0 con 0x559648bd1310 2023-08-11T12:35:40.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.191+0000 7fd1faff5700 1 -- 172.21.15.8:0/1637338684 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9366+0+0 (secure 0 0 0) 0x7fd20c004020 con 0x559648bd1310 2023-08-11T12:35:40.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.191+0000 7fd1faff5700 1 -- 172.21.15.8:0/1637338684 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd20c0041e0 con 0x559648bd1310 2023-08-11T12:35:40.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.191+0000 7fd2311d6b80 10 client.26516 fetch_fsmap learned FSMap version 54 2023-08-11T12:35:40.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.191+0000 7fd2311d6b80 1 -- 172.21.15.8:0/1637338684 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x55964899d630 con 0x559648bd1310 2023-08-11T12:35:40.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.191+0000 7fd1faff5700 1 -- 172.21.15.8:0/1637338684 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd20809dff0 con 0x559648bd1310 2023-08-11T12:35:40.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.192+0000 7fd1faff5700 1 -- 172.21.15.8:0/1637338684 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd20c024030 con 0x559648bd1310 2023-08-11T12:35:40.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.192+0000 7fd2311d6b80 10 client.26516 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:35:40.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.192+0000 7fd2311d6b80 10 client.26516 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:35:40.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.192+0000 7fd2311d6b80 20 client.26516 populate_metadata read hostname 'smithi008' 2023-08-11T12:35:40.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.192+0000 7fd2311d6b80 1 --2- 172.21.15.8:0/1637338684 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x559648c39c50 0x559648c3c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:35:40.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.192+0000 7fd2311d6b80 4 client.26516 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:35:40.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.192+0000 7fd2311d6b80 1 -- 172.21.15.8:0/1637338684 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559648b16820 con 0x559648c39c50 2023-08-11T12:35:40.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.192+0000 7fd216ffd700 1 --2- 172.21.15.8:0/1637338684 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x559648c39c50 0x559648c3c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:35:40.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.192+0000 7fd216ffd700 1 --2- 172.21.15.8:0/1637338684 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x559648c39c50 0x559648c3c070 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7dfe6eaf9e31d85c server_cookie=6a7266fdcfc73335 in_seq=0 out_seq=0 2023-08-11T12:35:40.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.192+0000 7fd1faff5700 10 client.26516 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:35:40.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.193+0000 7fd1faff5700 1 -- 172.21.15.8:0/1637338684 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x559648b16820 con 0x559648c39c50 2023-08-11T12:35:40.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.193+0000 7fd1faff5700 10 client.26516 handle_command_reply: tid=0 2023-08-11T12:35:40.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.193+0000 7fd2311d6b80 1 client.26516 shutdown 2023-08-11T12:35:40.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.193+0000 7fd2311d6b80 1 -- 172.21.15.8:0/1637338684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559648bd1310 msgr2=0x559648bce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:35:40.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.193+0000 7fd2311d6b80 1 --2- 172.21.15.8:0/1637338684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559648bd1310 0x559648bce340 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd2180feda0 tx=0x7fd20c00f6a0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.193+0000 7fd2311d6b80 1 -- 172.21.15.8:0/1637338684 shutdown_connections 2023-08-11T12:35:40.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.193+0000 7fd2311d6b80 1 --2- 172.21.15.8:0/1637338684 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x559648c39c50 0x559648c3c070 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.193+0000 7fd2311d6b80 1 --2- 172.21.15.8:0/1637338684 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559648bcbe20 0x559648bcde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.193+0000 7fd2311d6b80 1 --2- 172.21.15.8:0/1637338684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559648bd1c30 0x559648bccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.193+0000 7fd2311d6b80 1 --2- 172.21.15.8:0/1637338684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559648bd1310 0x559648bce340 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.193+0000 7fd1faff5700 0 client.26516 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:35:40.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.193+0000 7fd2311d6b80 1 -- 172.21.15.8:0/1637338684 >> 172.21.15.8:0/1637338684 conn(0x559648af8950 msgr2=0x559648bd2010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:35:40.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.193+0000 7fd2311d6b80 1 -- 172.21.15.8:0/1637338684 shutdown_connections 2023-08-11T12:35:40.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.193+0000 7fd2311d6b80 1 -- 172.21.15.8:0/1637338684 wait complete. 2023-08-11T12:35:40.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.193+0000 7fd2311d6b80 20 client.26516 trim_cache size 0 max 16384 2023-08-11T12:35:40.210 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:35:40.211 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:35:40.211 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:35:40.211 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:35:40.211 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:35:40.211 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:35:40.212 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:35:40.212 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:35:40.212 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:35:40.212 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:35:40.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.194+0000 7fd21d7ff700 1 -- 172.21.15.8:0/3404099716 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fd2000a00c0 msgr2=0x7fd2000a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:35:40.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.194+0000 7fd21d7ff700 1 --2- 172.21.15.8:0/3404099716 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fd2000a00c0 0x7fd2000a2580 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd210009790 tx=0x7fd210004040 comp rx=0 tx=0).stop 2023-08-11T12:35:40.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.194+0000 7fd21d7ff700 1 -- 172.21.15.8:0/3404099716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd218100960 msgr2=0x7fd21819e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:35:40.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.194+0000 7fd21d7ff700 1 --2- 172.21.15.8:0/3404099716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd218100960 0x7fd21819e9f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd2080059d0 tx=0x7fd208005740 comp rx=0 tx=0).stop 2023-08-11T12:35:40.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.194+0000 7fd21d7ff700 1 -- 172.21.15.8:0/3404099716 shutdown_connections 2023-08-11T12:35:40.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.194+0000 7fd21d7ff700 1 --2- 172.21.15.8:0/3404099716 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fd2000a00c0 0x7fd2000a2580 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.194+0000 7fd21d7ff700 1 --2- 172.21.15.8:0/3404099716 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd218106970 0x7fd218198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.194+0000 7fd21d7ff700 1 --2- 172.21.15.8:0/3404099716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd218100960 0x7fd21819e9f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.194+0000 7fd21d7ff700 1 --2- 172.21.15.8:0/3404099716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd218101320 0x7fd21819ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:35:40.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.194+0000 7fd21d7ff700 1 -- 172.21.15.8:0/3404099716 >> 172.21.15.8:0/3404099716 conn(0x7fd2180fc490 msgr2=0x7fd2180fcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:35:40.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.194+0000 7fd21d7ff700 1 -- 172.21.15.8:0/3404099716 shutdown_connections 2023-08-11T12:35:40.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:35:40.194+0000 7fd21d7ff700 1 -- 172.21.15.8:0/3404099716 wait complete. 2023-08-11T12:35:40.220 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:35:41.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:40 smithi008 ceph-mon[97158]: pgmap v345: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:41.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:40 smithi194 ceph-mon[130905]: pgmap v345: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:41.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:40 smithi045 ceph-mon[130284]: pgmap v345: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:42.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:42 smithi008 ceph-mon[97158]: pgmap v346: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:35:42.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:42 smithi194 ceph-mon[130905]: pgmap v346: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:35:42.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:42 smithi045 ceph-mon[130284]: pgmap v346: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:35:44.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:44 smithi008 ceph-mon[97158]: pgmap v347: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:44.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:44 smithi194 ceph-mon[130905]: pgmap v347: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:44.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:44 smithi045 ceph-mon[130284]: pgmap v347: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:46.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:46 smithi008 ceph-mon[97158]: pgmap v348: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:46.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:46 smithi194 ceph-mon[130905]: pgmap v348: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:46.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:46 smithi045 ceph-mon[130284]: pgmap v348: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:48.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:48 smithi008 ceph-mon[97158]: pgmap v349: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:35:48.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:48 smithi194 ceph-mon[130905]: pgmap v349: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:35:48.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:48 smithi045 ceph-mon[130284]: pgmap v349: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:35:51.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:50 smithi008 ceph-mon[97158]: pgmap v350: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:51.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:50 smithi194 ceph-mon[130905]: pgmap v350: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:51.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:50 smithi045 ceph-mon[130284]: pgmap v350: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:52.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:52 smithi008 ceph-mon[97158]: pgmap v351: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:35:52.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:52 smithi194 ceph-mon[130905]: pgmap v351: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:35:52.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:52 smithi045 ceph-mon[130284]: pgmap v351: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:35:54.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:54 smithi008 ceph-mon[97158]: pgmap v352: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:54.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:54 smithi194 ceph-mon[130905]: pgmap v352: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:54.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:54 smithi045 ceph-mon[130284]: pgmap v352: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:56.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:56 smithi008 ceph-mon[97158]: pgmap v353: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:56.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:56 smithi194 ceph-mon[130905]: pgmap v353: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:56.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:56 smithi045 ceph-mon[130284]: pgmap v353: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:35:58.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:35:58 smithi008 ceph-mon[97158]: pgmap v354: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:35:58.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:35:58 smithi194 ceph-mon[130905]: pgmap v354: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:35:58.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:35:58 smithi045 ceph-mon[130284]: pgmap v354: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:36:01.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:00 smithi008 ceph-mon[97158]: pgmap v355: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:01.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:00 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:36:01.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:00 smithi194 ceph-mon[130905]: pgmap v355: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:01.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:00 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:36:01.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:00 smithi045 ceph-mon[130284]: pgmap v355: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:01.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:00 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:36:02.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:02 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:36:02.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:02 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:36:02.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:02 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:36:02.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:02 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:36:02.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:02 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:36:02.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:02 smithi194 ceph-mon[130905]: pgmap v356: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-11T12:36:02.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:02 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:36:02.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:02 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:36:02.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:02 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:36:02.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:02 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:36:02.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:02 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:36:02.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:02 smithi045 ceph-mon[130284]: pgmap v356: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-11T12:36:02.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:02 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:36:02.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:02 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:36:02.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:02 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:36:02.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:02 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:36:02.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:02 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:36:02.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:02 smithi008 ceph-mon[97158]: pgmap v356: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-11T12:36:04.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:04 smithi008 ceph-mon[97158]: pgmap v357: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:36:04.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:04 smithi194 ceph-mon[130905]: pgmap v357: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:36:04.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:04 smithi045 ceph-mon[130284]: pgmap v357: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:36:06.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:06 smithi008 ceph-mon[97158]: pgmap v358: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:36:06.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:06 smithi194 ceph-mon[130905]: pgmap v358: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:36:06.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:06 smithi045 ceph-mon[130284]: pgmap v358: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:36:09.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:08 smithi008 ceph-mon[97158]: osdmap e101: 12 total, 12 up, 12 in 2023-08-11T12:36:09.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:08 smithi008 ceph-mon[97158]: pgmap v360: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:36:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:08 smithi194 ceph-mon[130905]: osdmap e101: 12 total, 12 up, 12 in 2023-08-11T12:36:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:08 smithi194 ceph-mon[130905]: pgmap v360: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:36:09.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:08 smithi045 ceph-mon[130284]: osdmap e101: 12 total, 12 up, 12 in 2023-08-11T12:36:09.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:08 smithi045 ceph-mon[130284]: pgmap v360: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:36:10.221 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:36:10.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.439+0000 7f15399ff700 1 -- 172.21.15.8:0/905140959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1534106970 msgr2=0x7f1534106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:36:10.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.439+0000 7f15399ff700 1 --2- 172.21.15.8:0/905140959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1534106970 0x7f1534106d50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1524009990 tx=0x7f1524009ca0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.440+0000 7f15399ff700 1 -- 172.21.15.8:0/905140959 shutdown_connections 2023-08-11T12:36:10.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.440+0000 7f15399ff700 1 --2- 172.21.15.8:0/905140959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1534101320 0x7f153410d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.440+0000 7f15399ff700 1 --2- 172.21.15.8:0/905140959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1534106970 0x7f1534106d50 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.440+0000 7f15399ff700 1 --2- 172.21.15.8:0/905140959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1534100960 0x7f1534100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.440+0000 7f15399ff700 1 -- 172.21.15.8:0/905140959 >> 172.21.15.8:0/905140959 conn(0x7f15340fc490 msgr2=0x7f15340fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:36:10.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.440+0000 7f15399ff700 1 -- 172.21.15.8:0/905140959 shutdown_connections 2023-08-11T12:36:10.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.440+0000 7f15399ff700 1 -- 172.21.15.8:0/905140959 wait complete. 2023-08-11T12:36:10.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.441+0000 7f15399ff700 1 Processor -- start 2023-08-11T12:36:10.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.441+0000 7f15399ff700 1 -- start start 2023-08-11T12:36:10.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.441+0000 7f15399ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1534100960 0x7f1534072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:10.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.441+0000 7f15399ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1534101320 0x7f1534073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:10.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.441+0000 7f15399ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1534106970 0x7f15341a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:10.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.441+0000 7f15399ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1534073990 con 0x7f1534106970 2023-08-11T12:36:10.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.441+0000 7f15399ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15341a5160 con 0x7f1534101320 2023-08-11T12:36:10.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.441+0000 7f15399ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15341a52a0 con 0x7f1534100960 2023-08-11T12:36:10.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.441+0000 7f152bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1534101320 0x7f1534073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:10.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.441+0000 7f152bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1534101320 0x7f1534073160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:49764/0 (socket says 172.21.15.8:49764) 2023-08-11T12:36:10.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.441+0000 7f152bfff700 1 -- 172.21.15.8:0/957575248 learned_addr learned my addr 172.21.15.8:0/957575248 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:36:10.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.442+0000 7f1532ffd700 1 --2- 172.21.15.8:0/957575248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1534100960 0x7f1534072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:10.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.442+0000 7f15337fe700 1 --2- 172.21.15.8:0/957575248 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1534106970 0x7f15341a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:10.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.442+0000 7f152bfff700 1 -- 172.21.15.8:0/957575248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1534100960 msgr2=0x7f1534072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:36:10.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.442+0000 7f152bfff700 1 --2- 172.21.15.8:0/957575248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1534100960 0x7f1534072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.442+0000 7f152bfff700 1 -- 172.21.15.8:0/957575248 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1534106970 msgr2=0x7f15341a4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:36:10.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.442+0000 7f152bfff700 1 --2- 172.21.15.8:0/957575248 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1534106970 0x7f15341a4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.442+0000 7f152bfff700 1 -- 172.21.15.8:0/957575248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15240095f0 con 0x7f1534101320 2023-08-11T12:36:10.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.442+0000 7f152bfff700 1 --2- 172.21.15.8:0/957575248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1534101320 0x7f1534073160 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f151c00e9a0 tx=0x7f151c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:36:10.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.442+0000 7f15389fd700 1 -- 172.21.15.8:0/957575248 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c009790 con 0x7f1534101320 2023-08-11T12:36:10.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.443+0000 7f15399ff700 1 -- 172.21.15.8:0/957575248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15341a5500 con 0x7f1534101320 2023-08-11T12:36:10.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.443+0000 7f15389fd700 1 -- 172.21.15.8:0/957575248 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f151c010430 con 0x7f1534101320 2023-08-11T12:36:10.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.443+0000 7f15389fd700 1 -- 172.21.15.8:0/957575248 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c018680 con 0x7f1534101320 2023-08-11T12:36:10.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.443+0000 7f15399ff700 1 -- 172.21.15.8:0/957575248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15341a59e0 con 0x7f1534101320 2023-08-11T12:36:10.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.446+0000 7f15389fd700 1 -- 172.21.15.8:0/957575248 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f151c0105a0 con 0x7f1534101320 2023-08-11T12:36:10.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.447+0000 7f154d26bb80 1 Processor -- start 2023-08-11T12:36:10.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.447+0000 7f154d26bb80 1 -- start start 2023-08-11T12:36:10.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.448+0000 7f154d26bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55565a1c8310 0x55565a1c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:10.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.448+0000 7f154d26bb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55565a1c8c30 0x55565a1c28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:10.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.448+0000 7f154d26bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55565a1c2e20 0x55565a1c3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:10.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.448+0000 7f154d26bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565a11b630 con 0x55565a1c8310 2023-08-11T12:36:10.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.448+0000 7f154d26bb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565a118f50 con 0x55565a1c8c30 2023-08-11T12:36:10.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.448+0000 7f154d26bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565a114840 con 0x55565a1c2e20 2023-08-11T12:36:10.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.448+0000 7f1532ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55565a1c8c30 0x55565a1c28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:10.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.448+0000 7f1532ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55565a1c8c30 0x55565a1c28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:49766/0 (socket says 172.21.15.8:49766) 2023-08-11T12:36:10.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.448+0000 7f15337fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55565a1c8310 0x55565a1c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:10.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.448+0000 7f1532ffd700 1 -- 172.21.15.8:0/484145130 learned_addr learned my addr 172.21.15.8:0/484145130 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:36:10.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.448+0000 7f152bfff700 1 --2- 172.21.15.8:0/484145130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55565a1c2e20 0x55565a1c3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:10.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.448+0000 7f15389fd700 1 --2- 172.21.15.8:0/957575248 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f15200a00c0 0x7f15200a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:10.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.448+0000 7f1532ffd700 1 -- 172.21.15.8:0/484145130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55565a1c2e20 msgr2=0x55565a1c3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:36:10.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.448+0000 7f1532ffd700 1 --2- 172.21.15.8:0/484145130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55565a1c2e20 0x55565a1c3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.448+0000 7f1532ffd700 1 -- 172.21.15.8:0/484145130 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55565a1c8310 msgr2=0x55565a1c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:36:10.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.448+0000 7f1532ffd700 1 --2- 172.21.15.8:0/484145130 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55565a1c8310 0x55565a1c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.448+0000 7f1532ffd700 1 -- 172.21.15.8:0/484145130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555659f94630 con 0x55565a1c8c30 2023-08-11T12:36:10.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.448+0000 7f152bfff700 1 --2- 172.21.15.8:0/484145130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55565a1c2e20 0x55565a1c3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:36:10.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.448+0000 7f15389fd700 1 -- 172.21.15.8:0/957575248 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 9454+0+0 (secure 0 0 0) 0x7f151c014070 con 0x7f1534101320 2023-08-11T12:36:10.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.448+0000 7f15337fe700 1 --2- 172.21.15.8:0/957575248 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f15200a00c0 0x7f15200a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:10.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.449+0000 7f1532ffd700 1 --2- 172.21.15.8:0/484145130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55565a1c8c30 0x55565a1c28e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1524005ea0 tx=0x7f1524005ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2a4fe9771fb90ab server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:36:10.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.449+0000 7f1529ffb700 1 -- 172.21.15.8:0/484145130 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152401d070 con 0x55565a1c8c30 2023-08-11T12:36:10.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.449+0000 7f1529ffb700 1 -- 172.21.15.8:0/484145130 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f152401e040 con 0x55565a1c8c30 2023-08-11T12:36:10.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.449+0000 7f1529ffb700 1 -- 172.21.15.8:0/484145130 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15240048e0 con 0x55565a1c8c30 2023-08-11T12:36:10.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.450+0000 7f154d26bb80 1 -- 172.21.15.8:0/484145130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55565a1c8c30 msgr2=0x55565a1c28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:36:10.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.450+0000 7f15337fe700 1 --2- 172.21.15.8:0/957575248 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f15200a00c0 0x7f15200a2580 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1534074d30 tx=0x7f152c009040 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:36:10.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.450+0000 7f154d26bb80 1 --2- 172.21.15.8:0/484145130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55565a1c8c30 0x55565a1c28e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1524005ea0 tx=0x7f1524005ed0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.450+0000 7f154d26bb80 1 -- 172.21.15.8:0/484145130 shutdown_connections 2023-08-11T12:36:10.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.450+0000 7f154d26bb80 1 --2- 172.21.15.8:0/484145130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55565a1c2e20 0x55565a1c3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.450+0000 7f154d26bb80 1 --2- 172.21.15.8:0/484145130 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55565a1c8310 0x55565a1c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.450+0000 7f154d26bb80 1 --2- 172.21.15.8:0/484145130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55565a1c8c30 0x55565a1c28e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.450+0000 7f154d26bb80 1 -- 172.21.15.8:0/484145130 >> 172.21.15.8:0/484145130 conn(0x55565a0ef950 msgr2=0x55565a1bd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:36:10.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.450+0000 7f154d26bb80 1 -- 172.21.15.8:0/484145130 shutdown_connections 2023-08-11T12:36:10.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.450+0000 7f154d26bb80 1 -- 172.21.15.8:0/484145130 wait complete. 2023-08-11T12:36:10.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.450+0000 7f154d26bb80 1 -- start start 2023-08-11T12:36:10.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.451+0000 7f154d26bb80 1 Processor -- start 2023-08-11T12:36:10.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.451+0000 7f154d26bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55565a1c2e20 0x55565a1ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:10.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.451+0000 7f154d26bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55565a1c8310 0x55565a1cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:10.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.451+0000 7f154d26bb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55565a1c8c30 0x55565a1cc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:10.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.451+0000 7f154d26bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565a0b2ac0 con 0x55565a1c2e20 2023-08-11T12:36:10.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.451+0000 7f154d26bb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565a0b27c0 con 0x55565a1c8c30 2023-08-11T12:36:10.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.451+0000 7f154d26bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x555659f96920 con 0x55565a1c8310 2023-08-11T12:36:10.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.451+0000 7f154d26bb80 10 client.0 _ll_register_callbacks cb 0x55565a0b5ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:36:10.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.451+0000 7f1532ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55565a1c2e20 0x55565a1ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:10.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.451+0000 7f152bfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55565a1c8310 0x55565a1cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:10.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.451+0000 7f15337fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55565a1c8c30 0x55565a1cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:10.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.451+0000 7f1532ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55565a1c2e20 0x55565a1ceae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42488/0 (socket says 172.21.15.8:42488) 2023-08-11T12:36:10.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.451+0000 7f1532ffd700 1 -- 172.21.15.8:0/1355379378 learned_addr learned my addr 172.21.15.8:0/1355379378 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:36:10.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.452+0000 7f1532ffd700 1 -- 172.21.15.8:0/1355379378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55565a1c8310 msgr2=0x55565a1cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:36:10.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.452+0000 7f1532ffd700 1 --2- 172.21.15.8:0/1355379378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55565a1c8310 0x55565a1cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.452+0000 7f1532ffd700 1 -- 172.21.15.8:0/1355379378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55565a1c8c30 msgr2=0x55565a1cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:36:10.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.452+0000 7f1532ffd700 1 --2- 172.21.15.8:0/1355379378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55565a1c8c30 0x55565a1cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.452+0000 7f1532ffd700 1 -- 172.21.15.8:0/1355379378 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f153410e130 con 0x55565a1c2e20 2023-08-11T12:36:10.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.452+0000 7f1532ffd700 1 --2- 172.21.15.8:0/1355379378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55565a1c2e20 0x55565a1ceae0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1524009ce0 tx=0x7f152400fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f5b48442665f43 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:36:10.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.452+0000 7f1512ffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:36:10.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.452+0000 7f1512ffd700 1 -- 172.21.15.8:0/1355379378 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152401d040 con 0x55565a1c2e20 2023-08-11T12:36:10.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.452+0000 7f154d26bb80 1 -- 172.21.15.8:0/1355379378 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55565a1b5a90 con 0x55565a1c2e20 2023-08-11T12:36:10.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.452+0000 7f1512ffd700 1 -- 172.21.15.8:0/1355379378 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 9454+0+0 (secure 0 0 0) 0x7f152400fe10 con 0x55565a1c2e20 2023-08-11T12:36:10.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.453+0000 7f1512ffd700 1 -- 172.21.15.8:0/1355379378 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1524005bc0 con 0x55565a1c2e20 2023-08-11T12:36:10.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.453+0000 7f154d26bb80 10 client.16485 fetch_fsmap learned FSMap version 54 2023-08-11T12:36:10.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.453+0000 7f154d26bb80 1 -- 172.21.15.8:0/1355379378 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x555659f40de0 con 0x55565a1c2e20 2023-08-11T12:36:10.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.453+0000 7f1512ffd700 1 -- 172.21.15.8:0/1355379378 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55565a1b5a90 con 0x55565a1c2e20 2023-08-11T12:36:10.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.453+0000 7f1512ffd700 1 -- 172.21.15.8:0/1355379378 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1524037070 con 0x55565a1c2e20 2023-08-11T12:36:10.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.453+0000 7f154d26bb80 10 client.16485 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:36:10.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.453+0000 7f154d26bb80 10 client.16485 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:36:10.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.453+0000 7f154d26bb80 20 client.16485 populate_metadata read hostname 'smithi008' 2023-08-11T12:36:10.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.453+0000 7f154d26bb80 1 --2- 172.21.15.8:0/1355379378 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55565a1dbeb0 0x55565a1de2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:10.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.453+0000 7f154d26bb80 4 client.16485 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:36:10.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.453+0000 7f154d26bb80 1 -- 172.21.15.8:0/1355379378 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55565a1914e0 con 0x55565a1dbeb0 2023-08-11T12:36:10.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.454+0000 7f152bfff700 1 --2- 172.21.15.8:0/1355379378 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55565a1dbeb0 0x55565a1de2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:10.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.454+0000 7f1512ffd700 10 client.16485 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:36:10.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.454+0000 7f152bfff700 1 --2- 172.21.15.8:0/1355379378 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55565a1dbeb0 0x55565a1de2a0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eacc5391edd7a12f server_cookie=99bdb8d88672ae9 in_seq=0 out_seq=0 2023-08-11T12:36:10.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.455+0000 7f1512ffd700 1 -- 172.21.15.8:0/1355379378 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55565a1914e0 con 0x55565a1dbeb0 2023-08-11T12:36:10.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.455+0000 7f1512ffd700 10 client.16485 handle_command_reply: tid=0 2023-08-11T12:36:10.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.455+0000 7f154d26bb80 1 client.16485 shutdown 2023-08-11T12:36:10.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.455+0000 7f154d26bb80 1 -- 172.21.15.8:0/1355379378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55565a1c2e20 msgr2=0x55565a1ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:36:10.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.455+0000 7f154d26bb80 1 --2- 172.21.15.8:0/1355379378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55565a1c2e20 0x55565a1ceae0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1524009ce0 tx=0x7f152400fb30 comp rx=0 tx=0).stop 2023-08-11T12:36:10.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.455+0000 7f154d26bb80 1 -- 172.21.15.8:0/1355379378 shutdown_connections 2023-08-11T12:36:10.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.455+0000 7f154d26bb80 1 --2- 172.21.15.8:0/1355379378 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55565a1dbeb0 0x55565a1de2a0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.455+0000 7f154d26bb80 1 --2- 172.21.15.8:0/1355379378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55565a1c8c30 0x55565a1cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.455+0000 7f154d26bb80 1 --2- 172.21.15.8:0/1355379378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55565a1c2e20 0x55565a1ceae0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.455+0000 7f1512ffd700 0 client.16485 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:36:10.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.455+0000 7f154d26bb80 1 --2- 172.21.15.8:0/1355379378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55565a1c8310 0x55565a1cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.455+0000 7f154d26bb80 1 -- 172.21.15.8:0/1355379378 >> 172.21.15.8:0/1355379378 conn(0x55565a0ef950 msgr2=0x55565a1b7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:36:10.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.455+0000 7f154d26bb80 1 -- 172.21.15.8:0/1355379378 shutdown_connections 2023-08-11T12:36:10.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.455+0000 7f154d26bb80 1 -- 172.21.15.8:0/1355379378 wait complete. 2023-08-11T12:36:10.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.455+0000 7f154d26bb80 20 client.16485 trim_cache size 0 max 16384 2023-08-11T12:36:10.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.473+0000 7f154d26bb80 1 Processor -- start 2023-08-11T12:36:10.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.473+0000 7f154d26bb80 1 -- start start 2023-08-11T12:36:10.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.473+0000 7f154d26bb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55565a1c2e20 0x55565a1c28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:10.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.473+0000 7f154d26bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55565a1c8310 0x55565a1d3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:10.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.473+0000 7f154d26bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55565a1c8c30 0x55565a1ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:10.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.473+0000 7f154d26bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565a1bf030 con 0x55565a1c8c30 2023-08-11T12:36:10.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.473+0000 7f154d26bb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565a1c7fe0 con 0x55565a1c2e20 2023-08-11T12:36:10.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.473+0000 7f154d26bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565a1ca370 con 0x55565a1c8310 2023-08-11T12:36:10.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.473+0000 7f15337fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55565a1c8c30 0x55565a1ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:10.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.473+0000 7f15337fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55565a1c8c30 0x55565a1ce5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42494/0 (socket says 172.21.15.8:42494) 2023-08-11T12:36:10.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.473+0000 7f15337fe700 1 -- 172.21.15.8:0/689248791 learned_addr learned my addr 172.21.15.8:0/689248791 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:36:10.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.473+0000 7f1532ffd700 1 --2- 172.21.15.8:0/689248791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55565a1c2e20 0x55565a1c28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:10.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.473+0000 7f152bfff700 1 --2- 172.21.15.8:0/689248791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55565a1c8310 0x55565a1d3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:10.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.474+0000 7f1532ffd700 1 -- 172.21.15.8:0/689248791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55565a1c8310 msgr2=0x55565a1d3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:36:10.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.474+0000 7f1532ffd700 1 --2- 172.21.15.8:0/689248791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55565a1c8310 0x55565a1d3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.474+0000 7f1532ffd700 1 -- 172.21.15.8:0/689248791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55565a1c8c30 msgr2=0x55565a1ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:36:10.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.474+0000 7f1532ffd700 1 --2- 172.21.15.8:0/689248791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55565a1c8c30 0x55565a1ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.474+0000 7f1532ffd700 1 -- 172.21.15.8:0/689248791 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555659f29c60 con 0x55565a1c2e20 2023-08-11T12:36:10.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.474+0000 7f15337fe700 1 --2- 172.21.15.8:0/689248791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55565a1c8c30 0x55565a1ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:36:10.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.474+0000 7f1532ffd700 1 --2- 172.21.15.8:0/689248791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55565a1c2e20 0x55565a1c28e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1524004c80 tx=0x7f1524000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a03cd3d5720dd26 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:36:10.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.474+0000 7f152a7fc700 1 -- 172.21.15.8:0/689248791 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1524004700 con 0x55565a1c2e20 2023-08-11T12:36:10.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.474+0000 7f152a7fc700 1 -- 172.21.15.8:0/689248791 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1524005bc0 con 0x55565a1c2e20 2023-08-11T12:36:10.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.474+0000 7f152a7fc700 1 -- 172.21.15.8:0/689248791 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1524022660 con 0x55565a1c2e20 2023-08-11T12:36:10.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.475+0000 7f154d26bb80 1 -- 172.21.15.8:0/689248791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55565a1c2e20 msgr2=0x55565a1c28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:36:10.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.475+0000 7f154d26bb80 1 --2- 172.21.15.8:0/689248791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55565a1c2e20 0x55565a1c28e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1524004c80 tx=0x7f1524000bc0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.475+0000 7f154d26bb80 1 -- 172.21.15.8:0/689248791 shutdown_connections 2023-08-11T12:36:10.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.475+0000 7f154d26bb80 1 --2- 172.21.15.8:0/689248791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55565a1c8c30 0x55565a1ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.475+0000 7f154d26bb80 1 --2- 172.21.15.8:0/689248791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55565a1c2e20 0x55565a1c28e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.475+0000 7f154d26bb80 1 --2- 172.21.15.8:0/689248791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55565a1c8310 0x55565a1d3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.475+0000 7f154d26bb80 1 -- 172.21.15.8:0/689248791 >> 172.21.15.8:0/689248791 conn(0x55565a0ef950 msgr2=0x55565a1bd280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:36:10.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.475+0000 7f154d26bb80 1 -- 172.21.15.8:0/689248791 shutdown_connections 2023-08-11T12:36:10.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.475+0000 7f154d26bb80 1 -- 172.21.15.8:0/689248791 wait complete. 2023-08-11T12:36:10.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.475+0000 7f154d26bb80 1 -- start start 2023-08-11T12:36:10.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.476+0000 7f154d26bb80 1 Processor -- start 2023-08-11T12:36:10.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.476+0000 7f154d26bb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55565a1c2e20 0x55565a1c5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:10.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.476+0000 7f154d26bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55565a1c8310 0x55565a1c5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:10.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.476+0000 7f154d26bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55565a1c8c30 0x55565a1c3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:10.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.476+0000 7f154d26bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565a1c4400 con 0x55565a1c8c30 2023-08-11T12:36:10.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.476+0000 7f154d26bb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565a1c4570 con 0x55565a1c2e20 2023-08-11T12:36:10.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.476+0000 7f154d26bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565a1c4730 con 0x55565a1c8310 2023-08-11T12:36:10.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.476+0000 7f154d26bb80 10 client.0 _ll_register_callbacks cb 0x7f152c009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:36:10.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.476+0000 7f15337fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55565a1c8c30 0x55565a1c3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:10.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.476+0000 7f1532ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55565a1c2e20 0x55565a1c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:10.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.477+0000 7f152bfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55565a1c8310 0x55565a1c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:10.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.477+0000 7f1532ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55565a1c2e20 0x55565a1c5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:49794/0 (socket says 172.21.15.8:49794) 2023-08-11T12:36:10.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.477+0000 7f1532ffd700 1 -- 172.21.15.8:0/515479615 learned_addr learned my addr 172.21.15.8:0/515479615 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:36:10.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.477+0000 7f15337fe700 1 -- 172.21.15.8:0/515479615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55565a1c8310 msgr2=0x55565a1c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:36:10.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.477+0000 7f15337fe700 1 --2- 172.21.15.8:0/515479615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55565a1c8310 0x55565a1c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.477+0000 7f15337fe700 1 -- 172.21.15.8:0/515479615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55565a1c2e20 msgr2=0x55565a1c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:36:10.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.477+0000 7f15337fe700 1 --2- 172.21.15.8:0/515479615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55565a1c2e20 0x55565a1c5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.477+0000 7f15337fe700 1 -- 172.21.15.8:0/515479615 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f152c003ae0 con 0x55565a1c8c30 2023-08-11T12:36:10.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.477+0000 7f1532ffd700 1 --2- 172.21.15.8:0/515479615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55565a1c2e20 0x55565a1c5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:36:10.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.477+0000 7f15337fe700 1 --2- 172.21.15.8:0/515479615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55565a1c8c30 0x55565a1c3d10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f152c009690 tx=0x7f152c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311f429fb221964a server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:36:10.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.477+0000 7f1512ffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:36:10.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.478+0000 7f1512ffd700 1 -- 172.21.15.8:0/515479615 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c00e040 con 0x55565a1c8c30 2023-08-11T12:36:10.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.478+0000 7f154d26bb80 1 -- 172.21.15.8:0/515479615 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55565a10d820 con 0x55565a1c8c30 2023-08-11T12:36:10.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.478+0000 7f1512ffd700 1 -- 172.21.15.8:0/515479615 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 9454+0+0 (secure 0 0 0) 0x7f152c01c070 con 0x55565a1c8c30 2023-08-11T12:36:10.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.478+0000 7f1512ffd700 1 -- 172.21.15.8:0/515479615 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f152c017bb0 con 0x55565a1c8c30 2023-08-11T12:36:10.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.478+0000 7f154d26bb80 10 client.16491 fetch_fsmap learned FSMap version 54 2023-08-11T12:36:10.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.478+0000 7f154d26bb80 1 -- 172.21.15.8:0/515479615 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x555659f40de0 con 0x55565a1c8c30 2023-08-11T12:36:10.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.478+0000 7f1512ffd700 1 -- 172.21.15.8:0/515479615 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55565a10d820 con 0x55565a1c8c30 2023-08-11T12:36:10.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.478+0000 7f1512ffd700 1 -- 172.21.15.8:0/515479615 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f152c0253e0 con 0x55565a1c8c30 2023-08-11T12:36:10.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.478+0000 7f154d26bb80 10 client.16491 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:36:10.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.478+0000 7f154d26bb80 10 client.16491 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:36:10.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.478+0000 7f154d26bb80 20 client.16491 populate_metadata read hostname 'smithi008' 2023-08-11T12:36:10.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.478+0000 7f154d26bb80 1 --2- 172.21.15.8:0/515479615 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55565a230c90 0x55565a2330b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:10.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.478+0000 7f154d26bb80 4 client.16491 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:36:10.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.478+0000 7f154d26bb80 1 -- 172.21.15.8:0/515479615 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55565a0ce050 con 0x55565a230c90 2023-08-11T12:36:10.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.479+0000 7f1532ffd700 1 --2- 172.21.15.8:0/515479615 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55565a230c90 0x55565a2330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:10.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.479+0000 7f1532ffd700 1 --2- 172.21.15.8:0/515479615 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55565a230c90 0x55565a2330b0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4796d9fa632781f1 server_cookie=166531d541c100d7 in_seq=0 out_seq=0 2023-08-11T12:36:10.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.479+0000 7f1512ffd700 10 client.16491 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:36:10.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.480+0000 7f1512ffd700 1 -- 172.21.15.8:0/515479615 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55565a0ce050 con 0x55565a230c90 2023-08-11T12:36:10.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.480+0000 7f1512ffd700 10 client.16491 handle_command_reply: tid=0 2023-08-11T12:36:10.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.480+0000 7f154d26bb80 1 client.16491 shutdown 2023-08-11T12:36:10.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.480+0000 7f154d26bb80 1 -- 172.21.15.8:0/515479615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55565a1c8c30 msgr2=0x55565a1c3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:36:10.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.480+0000 7f154d26bb80 1 --2- 172.21.15.8:0/515479615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55565a1c8c30 0x55565a1c3d10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f152c009690 tx=0x7f152c004ad0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.480+0000 7f154d26bb80 1 -- 172.21.15.8:0/515479615 shutdown_connections 2023-08-11T12:36:10.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.480+0000 7f154d26bb80 1 --2- 172.21.15.8:0/515479615 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55565a230c90 0x55565a2330b0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.480+0000 7f154d26bb80 1 --2- 172.21.15.8:0/515479615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55565a1c8c30 0x55565a1c3d10 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.480+0000 7f154d26bb80 1 --2- 172.21.15.8:0/515479615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55565a1c2e20 0x55565a1c5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.480+0000 7f1512ffd700 0 client.16491 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:36:10.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.480+0000 7f154d26bb80 1 --2- 172.21.15.8:0/515479615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55565a1c8310 0x55565a1c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.480+0000 7f154d26bb80 1 -- 172.21.15.8:0/515479615 >> 172.21.15.8:0/515479615 conn(0x55565a0ef950 msgr2=0x55565a1cb600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:36:10.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.480+0000 7f154d26bb80 1 -- 172.21.15.8:0/515479615 shutdown_connections 2023-08-11T12:36:10.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.480+0000 7f154d26bb80 1 -- 172.21.15.8:0/515479615 wait complete. 2023-08-11T12:36:10.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.480+0000 7f154d26bb80 20 client.16491 trim_cache size 0 max 16384 2023-08-11T12:36:10.501 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:36:10.502 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:36:10.502 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:36:10.502 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:36:10.502 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:36:10.503 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:36:10.503 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:36:10.503 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:36:10.503 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:36:10.503 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:36:10.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.481+0000 7f15399ff700 1 -- 172.21.15.8:0/957575248 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f15200a00c0 msgr2=0x7f15200a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:36:10.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.481+0000 7f15399ff700 1 --2- 172.21.15.8:0/957575248 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f15200a00c0 0x7f15200a2580 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1534074d30 tx=0x7f152c009040 comp rx=0 tx=0).stop 2023-08-11T12:36:10.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.481+0000 7f15399ff700 1 -- 172.21.15.8:0/957575248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1534101320 msgr2=0x7f1534073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:36:10.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.481+0000 7f15399ff700 1 --2- 172.21.15.8:0/957575248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1534101320 0x7f1534073160 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f151c00e9a0 tx=0x7f151c00ecb0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.481+0000 7f15399ff700 1 -- 172.21.15.8:0/957575248 shutdown_connections 2023-08-11T12:36:10.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.481+0000 7f15399ff700 1 --2- 172.21.15.8:0/957575248 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f15200a00c0 0x7f15200a2580 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.481+0000 7f15399ff700 1 --2- 172.21.15.8:0/957575248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1534100960 0x7f1534072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.481+0000 7f15399ff700 1 --2- 172.21.15.8:0/957575248 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1534106970 0x7f15341a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.481+0000 7f15399ff700 1 --2- 172.21.15.8:0/957575248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1534101320 0x7f1534073160 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:10.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.481+0000 7f15399ff700 1 -- 172.21.15.8:0/957575248 >> 172.21.15.8:0/957575248 conn(0x7f15340fc490 msgr2=0x7f15340fcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:36:10.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.481+0000 7f15399ff700 1 -- 172.21.15.8:0/957575248 shutdown_connections 2023-08-11T12:36:10.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:10.481+0000 7f15399ff700 1 -- 172.21.15.8:0/957575248 wait complete. 2023-08-11T12:36:10.507 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:36:11.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:10 smithi008 ceph-mon[97158]: pgmap v361: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:36:11.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:10 smithi194 ceph-mon[130905]: pgmap v361: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:36:11.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:10 smithi045 ceph-mon[130284]: pgmap v361: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:36:12.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:12 smithi008 ceph-mon[97158]: pgmap v362: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:36:12.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:12 smithi194 ceph-mon[130905]: pgmap v362: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:36:12.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:12 smithi045 ceph-mon[130284]: pgmap v362: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:36:14.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:14 smithi008 ceph-mon[97158]: pgmap v363: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:36:14.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:14 smithi194 ceph-mon[130905]: pgmap v363: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:36:14.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:14 smithi045 ceph-mon[130284]: pgmap v363: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:36:16.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:15 smithi008 ceph-mon[97158]: osdmap e102: 12 total, 12 up, 12 in 2023-08-11T12:36:16.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:15 smithi194 ceph-mon[130905]: osdmap e102: 12 total, 12 up, 12 in 2023-08-11T12:36:16.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:15 smithi045 ceph-mon[130284]: osdmap e102: 12 total, 12 up, 12 in 2023-08-11T12:36:17.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:16 smithi008 ceph-mon[97158]: pgmap v365: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 123 B/s wr, 6 op/s 2023-08-11T12:36:17.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:16 smithi194 ceph-mon[130905]: pgmap v365: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 123 B/s wr, 6 op/s 2023-08-11T12:36:17.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:16 smithi045 ceph-mon[130284]: pgmap v365: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 123 B/s wr, 6 op/s 2023-08-11T12:36:18.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:18 smithi194 ceph-mon[130905]: pgmap v366: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:36:18.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:18 smithi045 ceph-mon[130284]: pgmap v366: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:36:18.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:18 smithi008 ceph-mon[97158]: pgmap v366: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:36:21.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:20 smithi008 ceph-mon[97158]: pgmap v367: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:36:21.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:20 smithi194 ceph-mon[130905]: pgmap v367: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:36:21.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:20 smithi045 ceph-mon[130284]: pgmap v367: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:36:22.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:22 smithi194 ceph-mon[130905]: pgmap v368: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:36:22.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:22 smithi045 ceph-mon[130284]: pgmap v368: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:36:22.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:22 smithi008 ceph-mon[97158]: pgmap v368: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:36:24.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:24 smithi194 ceph-mon[130905]: pgmap v369: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:36:24.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:24 smithi045 ceph-mon[130284]: pgmap v369: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:36:24.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:24 smithi008 ceph-mon[97158]: pgmap v369: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:36:26.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:26 smithi194 ceph-mon[130905]: pgmap v370: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:36:26.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:26 smithi045 ceph-mon[130284]: pgmap v370: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:36:26.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:26 smithi008 ceph-mon[97158]: pgmap v370: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:36:28.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:28 smithi194 ceph-mon[130905]: pgmap v371: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:36:28.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:28 smithi045 ceph-mon[130284]: pgmap v371: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:36:28.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:28 smithi008 ceph-mon[97158]: pgmap v371: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:36:31.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:30 smithi008 ceph-mon[97158]: pgmap v372: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:31.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:30 smithi194 ceph-mon[130905]: pgmap v372: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:31.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:30 smithi045 ceph-mon[130284]: pgmap v372: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:32.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:32 smithi194 ceph-mon[130905]: pgmap v373: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:36:32.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:32 smithi045 ceph-mon[130284]: pgmap v373: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:36:32.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:32 smithi008 ceph-mon[97158]: pgmap v373: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:36:34.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:34 smithi194 ceph-mon[130905]: pgmap v374: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:34.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:34 smithi045 ceph-mon[130284]: pgmap v374: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:34.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:34 smithi008 ceph-mon[97158]: pgmap v374: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:36.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:36 smithi194 ceph-mon[130905]: pgmap v375: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:36.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:36 smithi045 ceph-mon[130284]: pgmap v375: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:36.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:36 smithi008 ceph-mon[97158]: pgmap v375: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:38.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:38 smithi194 ceph-mon[130905]: pgmap v376: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:36:38.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:38 smithi045 ceph-mon[130284]: pgmap v376: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:36:38.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:38 smithi008 ceph-mon[97158]: pgmap v376: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:36:40.508 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:36:40.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.725+0000 7f0abedff700 1 -- 172.21.15.8:0/3187328694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ab8106970 msgr2=0x7f0ab8106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:36:40.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.725+0000 7f0abedff700 1 --2- 172.21.15.8:0/3187328694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ab8106970 0x7f0ab8106d50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0aac009990 tx=0x7f0aac009ca0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.725+0000 7f0abedff700 1 -- 172.21.15.8:0/3187328694 shutdown_connections 2023-08-11T12:36:40.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.725+0000 7f0abedff700 1 --2- 172.21.15.8:0/3187328694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ab8101320 0x7f0ab810d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.725+0000 7f0abedff700 1 --2- 172.21.15.8:0/3187328694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ab8106970 0x7f0ab8106d50 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.725+0000 7f0abedff700 1 --2- 172.21.15.8:0/3187328694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ab8100960 0x7f0ab8100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.725+0000 7f0abedff700 1 -- 172.21.15.8:0/3187328694 >> 172.21.15.8:0/3187328694 conn(0x7f0ab80fc490 msgr2=0x7f0ab80fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:36:40.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.726+0000 7f0abedff700 1 -- 172.21.15.8:0/3187328694 shutdown_connections 2023-08-11T12:36:40.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.726+0000 7f0abedff700 1 -- 172.21.15.8:0/3187328694 wait complete. 2023-08-11T12:36:40.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.727+0000 7f0abedff700 1 Processor -- start 2023-08-11T12:36:40.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.727+0000 7f0abedff700 1 -- start start 2023-08-11T12:36:40.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.727+0000 7f0abedff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ab8100960 0x7f0ab8072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:40.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.727+0000 7f0abedff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ab8101320 0x7f0ab8073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:40.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.727+0000 7f0abedff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ab8106970 0x7f0ab81a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:40.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.727+0000 7f0abedff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab8073990 con 0x7f0ab8106970 2023-08-11T12:36:40.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.727+0000 7f0abedff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab81a5130 con 0x7f0ab8101320 2023-08-11T12:36:40.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.727+0000 7f0abedff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab81a5270 con 0x7f0ab8100960 2023-08-11T12:36:40.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.727+0000 7f0ab7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ab8101320 0x7f0ab8073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:40.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.727+0000 7f0ab7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ab8101320 0x7f0ab8073160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:33438/0 (socket says 172.21.15.8:33438) 2023-08-11T12:36:40.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.727+0000 7f0ab7fff700 1 -- 172.21.15.8:0/2609818090 learned_addr learned my addr 172.21.15.8:0/2609818090 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:36:40.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.727+0000 7f0abd39c700 1 --2- 172.21.15.8:0/2609818090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ab8106970 0x7f0ab81a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:40.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.728+0000 7f0abcb9b700 1 --2- 172.21.15.8:0/2609818090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ab8100960 0x7f0ab8072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:40.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.728+0000 7f0ab7fff700 1 -- 172.21.15.8:0/2609818090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ab8100960 msgr2=0x7f0ab8072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:36:40.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.728+0000 7f0ab7fff700 1 --2- 172.21.15.8:0/2609818090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ab8100960 0x7f0ab8072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.728+0000 7f0ab7fff700 1 -- 172.21.15.8:0/2609818090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ab8106970 msgr2=0x7f0ab81a4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:36:40.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.728+0000 7f0ab7fff700 1 --2- 172.21.15.8:0/2609818090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ab8106970 0x7f0ab81a4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.728+0000 7f0ab7fff700 1 -- 172.21.15.8:0/2609818090 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aac0095f0 con 0x7f0ab8101320 2023-08-11T12:36:40.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.728+0000 7f0abcb9b700 1 --2- 172.21.15.8:0/2609818090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ab8100960 0x7f0ab8072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:36:40.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.728+0000 7f0ab7fff700 1 --2- 172.21.15.8:0/2609818090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ab8101320 0x7f0ab8073160 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0aa400d950 tx=0x7f0aa400dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:36:40.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.728+0000 7f0ab5ffb700 1 -- 172.21.15.8:0/2609818090 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4009940 con 0x7f0ab8101320 2023-08-11T12:36:40.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.728+0000 7f0abedff700 1 -- 172.21.15.8:0/2609818090 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab81a54d0 con 0x7f0ab8101320 2023-08-11T12:36:40.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.728+0000 7f0ab5ffb700 1 -- 172.21.15.8:0/2609818090 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0aa4010460 con 0x7f0ab8101320 2023-08-11T12:36:40.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.728+0000 7f0ab5ffb700 1 -- 172.21.15.8:0/2609818090 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa400f620 con 0x7f0ab8101320 2023-08-11T12:36:40.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.728+0000 7f0abedff700 1 -- 172.21.15.8:0/2609818090 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab81a59b0 con 0x7f0ab8101320 2023-08-11T12:36:40.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.732+0000 7f0ab5ffb700 1 -- 172.21.15.8:0/2609818090 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f0aa40108d0 con 0x7f0ab8101320 2023-08-11T12:36:40.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.733+0000 7f0ad26cfb80 1 Processor -- start 2023-08-11T12:36:40.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.734+0000 7f0ad26cfb80 1 -- start start 2023-08-11T12:36:40.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.734+0000 7f0ad26cfb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c64fbe0310 0x55c64fbe06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:40.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.734+0000 7f0ad26cfb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c64fbe0c30 0x55c64fbda8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:40.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.734+0000 7f0ad26cfb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c64fbdae20 0x55c64fbdb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:40.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.734+0000 7f0ad26cfb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64fb33630 con 0x55c64fbe0c30 2023-08-11T12:36:40.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.734+0000 7f0ad26cfb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64fb30f50 con 0x55c64fbe0310 2023-08-11T12:36:40.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.734+0000 7f0ad26cfb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64fb2c840 con 0x55c64fbdae20 2023-08-11T12:36:40.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.734+0000 7f0abd39c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c64fbe0310 0x55c64fbe06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:40.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.734+0000 7f0abd39c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c64fbe0310 0x55c64fbe06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:33440/0 (socket says 172.21.15.8:33440) 2023-08-11T12:36:40.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.734+0000 7f0abd39c700 1 -- 172.21.15.8:0/6245935 learned_addr learned my addr 172.21.15.8:0/6245935 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:36:40.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.734+0000 7f0abcb9b700 1 --2- 172.21.15.8:0/6245935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c64fbe0c30 0x55c64fbda8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:40.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.735+0000 7f0ab7fff700 1 --2- 172.21.15.8:0/6245935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c64fbdae20 0x55c64fbdb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:40.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.735+0000 7f0ab5ffb700 1 --2- 172.21.15.8:0/2609818090 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f0aa80a00c0 0x7f0aa80a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:40.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.735+0000 7f0abcb9b700 1 -- 172.21.15.8:0/6245935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c64fbdae20 msgr2=0x55c64fbdb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:36:40.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.735+0000 7f0abcb9b700 1 --2- 172.21.15.8:0/6245935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c64fbdae20 0x55c64fbdb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.735+0000 7f0ab5ffb700 1 -- 172.21.15.8:0/2609818090 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9366+0+0 (secure 0 0 0) 0x7f0aa40cb860 con 0x7f0ab8101320 2023-08-11T12:36:40.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.735+0000 7f0abcb9b700 1 -- 172.21.15.8:0/6245935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c64fbe0310 msgr2=0x55c64fbe06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:36:40.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.735+0000 7f0abcb9b700 1 --2- 172.21.15.8:0/6245935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c64fbe0310 0x55c64fbe06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.735+0000 7f0abcb9b700 1 -- 172.21.15.8:0/6245935 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c64f9ac630 con 0x55c64fbe0c30 2023-08-11T12:36:40.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.735+0000 7f0ab7fff700 1 --2- 172.21.15.8:0/6245935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c64fbdae20 0x55c64fbdb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:36:40.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.735+0000 7f0abd39c700 1 --2- 172.21.15.8:0/6245935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c64fbe0310 0x55c64fbe06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:36:40.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.735+0000 7f0abd39c700 1 --2- 172.21.15.8:0/2609818090 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f0aa80a00c0 0x7f0aa80a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:40.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.735+0000 7f0abcb9b700 1 --2- 172.21.15.8:0/6245935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c64fbe0c30 0x55c64fbda8e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0aac00b2e0 tx=0x7f0aac005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a596c2c403414fc server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:36:40.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.736+0000 7f0aa2ffd700 1 -- 172.21.15.8:0/6245935 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac00beb0 con 0x55c64fbe0c30 2023-08-11T12:36:40.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.736+0000 7f0abd39c700 1 --2- 172.21.15.8:0/2609818090 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f0aa80a00c0 0x7f0aa80a2580 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0007620 tx=0x7f0ab0009040 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:36:40.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.736+0000 7f0aa2ffd700 1 -- 172.21.15.8:0/6245935 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0aac01e040 con 0x55c64fbe0c30 2023-08-11T12:36:40.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.736+0000 7f0aa2ffd700 1 -- 172.21.15.8:0/6245935 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac004ac0 con 0x55c64fbe0c30 2023-08-11T12:36:40.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.736+0000 7f0ad26cfb80 1 -- 172.21.15.8:0/6245935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c64fbe0c30 msgr2=0x55c64fbda8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:36:40.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.736+0000 7f0ad26cfb80 1 --2- 172.21.15.8:0/6245935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c64fbe0c30 0x55c64fbda8e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0aac00b2e0 tx=0x7f0aac005c00 comp rx=0 tx=0).stop 2023-08-11T12:36:40.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.736+0000 7f0ad26cfb80 1 -- 172.21.15.8:0/6245935 shutdown_connections 2023-08-11T12:36:40.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.736+0000 7f0ad26cfb80 1 --2- 172.21.15.8:0/6245935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c64fbdae20 0x55c64fbdb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.736+0000 7f0ad26cfb80 1 --2- 172.21.15.8:0/6245935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c64fbe0310 0x55c64fbe06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.736+0000 7f0ad26cfb80 1 --2- 172.21.15.8:0/6245935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c64fbe0c30 0x55c64fbda8e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.736+0000 7f0ad26cfb80 1 -- 172.21.15.8:0/6245935 >> 172.21.15.8:0/6245935 conn(0x55c64fb07950 msgr2=0x55c64fbd53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:36:40.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.736+0000 7f0ad26cfb80 1 -- 172.21.15.8:0/6245935 shutdown_connections 2023-08-11T12:36:40.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.736+0000 7f0ad26cfb80 1 -- 172.21.15.8:0/6245935 wait complete. 2023-08-11T12:36:40.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.737+0000 7f0ad26cfb80 1 -- start start 2023-08-11T12:36:40.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.737+0000 7f0ad26cfb80 1 Processor -- start 2023-08-11T12:36:40.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.738+0000 7f0ad26cfb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c64fbdae20 0x55c64fbe6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:40.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.738+0000 7f0ad26cfb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c64fbe0310 0x55c64fbe3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:40.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.738+0000 7f0ad26cfb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c64fbe0c30 0x55c64fbe44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:40.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.738+0000 7f0ad26cfb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64facaac0 con 0x55c64fbe0c30 2023-08-11T12:36:40.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.738+0000 7f0ad26cfb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64faca7c0 con 0x55c64fbe0310 2023-08-11T12:36:40.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.738+0000 7f0ad26cfb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64f9ae920 con 0x55c64fbdae20 2023-08-11T12:36:40.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.738+0000 7f0ad26cfb80 10 client.0 _ll_register_callbacks cb 0x55c64facdab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:36:40.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.738+0000 7f0ab7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c64fbe0310 0x55c64fbe3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:40.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.738+0000 7f0ab7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c64fbe0310 0x55c64fbe3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:33452/0 (socket says 172.21.15.8:33452) 2023-08-11T12:36:40.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.738+0000 7f0ab7fff700 1 -- 172.21.15.8:0/1943934520 learned_addr learned my addr 172.21.15.8:0/1943934520 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:36:40.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.738+0000 7f0abd39c700 1 --2- 172.21.15.8:0/1943934520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c64fbe0c30 0x55c64fbe44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:40.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.738+0000 7f0abcb9b700 1 --2- 172.21.15.8:0/1943934520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c64fbdae20 0x55c64fbe6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:40.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.738+0000 7f0ab7fff700 1 -- 172.21.15.8:0/1943934520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c64fbdae20 msgr2=0x55c64fbe6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:36:40.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.738+0000 7f0ab7fff700 1 --2- 172.21.15.8:0/1943934520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c64fbdae20 0x55c64fbe6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.738+0000 7f0ab7fff700 1 -- 172.21.15.8:0/1943934520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c64fbe0c30 msgr2=0x55c64fbe44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:36:40.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.738+0000 7f0ab7fff700 1 --2- 172.21.15.8:0/1943934520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c64fbe0c30 0x55c64fbe44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.738+0000 7f0ab7fff700 1 -- 172.21.15.8:0/1943934520 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab0011300 con 0x55c64fbe0310 2023-08-11T12:36:40.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.739+0000 7f0ab7fff700 1 --2- 172.21.15.8:0/1943934520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c64fbe0310 0x55c64fbe3e80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4095630 tx=0x7f0aa4098810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f7b699de0b915ad server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:36:40.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.739+0000 7f0a97fff700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:36:40.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.739+0000 7f0a97fff700 1 -- 172.21.15.8:0/1943934520 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40c9090 con 0x55c64fbe0310 2023-08-11T12:36:40.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.739+0000 7f0ad26cfb80 1 -- 172.21.15.8:0/1943934520 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c64fbcda90 con 0x55c64fbe0310 2023-08-11T12:36:40.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.739+0000 7f0a97fff700 1 -- 172.21.15.8:0/1943934520 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9366+0+0 (secure 0 0 0) 0x7f0aa4098bc0 con 0x55c64fbe0310 2023-08-11T12:36:40.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.739+0000 7f0a97fff700 1 -- 172.21.15.8:0/1943934520 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0aa409c9f0 con 0x55c64fbe0310 2023-08-11T12:36:40.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.739+0000 7f0ad26cfb80 10 client.26546 fetch_fsmap learned FSMap version 54 2023-08-11T12:36:40.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.739+0000 7f0ad26cfb80 1 -- 172.21.15.8:0/1943934520 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x7f0ab810e130 con 0x55c64fbe0310 2023-08-11T12:36:40.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.739+0000 7f0a97fff700 1 -- 172.21.15.8:0/1943934520 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c64fbcda90 con 0x55c64fbe0310 2023-08-11T12:36:40.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.739+0000 7f0a97fff700 1 -- 172.21.15.8:0/1943934520 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0aa4098140 con 0x55c64fbe0310 2023-08-11T12:36:40.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.739+0000 7f0ad26cfb80 10 client.26546 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:36:40.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.739+0000 7f0ad26cfb80 10 client.26546 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:36:40.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.740+0000 7f0ad26cfb80 20 client.26546 populate_metadata read hostname 'smithi008' 2023-08-11T12:36:40.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.740+0000 7f0ad26cfb80 1 --2- 172.21.15.8:0/1943934520 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55c64fbf4430 0x55c64fbf6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:40.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.740+0000 7f0ad26cfb80 4 client.26546 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:36:40.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.740+0000 7f0ad26cfb80 1 -- 172.21.15.8:0/1943934520 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c64fba94e0 con 0x55c64fbf4430 2023-08-11T12:36:40.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.740+0000 7f0abcb9b700 1 --2- 172.21.15.8:0/1943934520 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55c64fbf4430 0x55c64fbf6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:40.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.740+0000 7f0abcb9b700 1 --2- 172.21.15.8:0/1943934520 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55c64fbf4430 0x55c64fbf6850 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=844a0df0228e798 server_cookie=6a290eaeb2633f14 in_seq=0 out_seq=0 2023-08-11T12:36:40.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.740+0000 7f0a97fff700 10 client.26546 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:36:40.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.741+0000 7f0a97fff700 1 -- 172.21.15.8:0/1943934520 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55c64fba94e0 con 0x55c64fbf4430 2023-08-11T12:36:40.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.741+0000 7f0a97fff700 10 client.26546 handle_command_reply: tid=0 2023-08-11T12:36:40.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.741+0000 7f0ad26cfb80 1 client.26546 shutdown 2023-08-11T12:36:40.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.741+0000 7f0ad26cfb80 1 -- 172.21.15.8:0/1943934520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c64fbe0310 msgr2=0x55c64fbe3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:36:40.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.741+0000 7f0ad26cfb80 1 --2- 172.21.15.8:0/1943934520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c64fbe0310 0x55c64fbe3e80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4095630 tx=0x7f0aa4098810 comp rx=0 tx=0).stop 2023-08-11T12:36:40.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.741+0000 7f0ad26cfb80 1 -- 172.21.15.8:0/1943934520 shutdown_connections 2023-08-11T12:36:40.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.741+0000 7f0ad26cfb80 1 --2- 172.21.15.8:0/1943934520 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55c64fbf4430 0x55c64fbf6850 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.741+0000 7f0ad26cfb80 1 --2- 172.21.15.8:0/1943934520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c64fbdae20 0x55c64fbe6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.742+0000 7f0ad26cfb80 1 --2- 172.21.15.8:0/1943934520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c64fbe0c30 0x55c64fbe44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.742+0000 7f0ad26cfb80 1 --2- 172.21.15.8:0/1943934520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c64fbe0310 0x55c64fbe3e80 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.742+0000 7f0ad26cfb80 1 -- 172.21.15.8:0/1943934520 >> 172.21.15.8:0/1943934520 conn(0x55c64fb07950 msgr2=0x55c64fbcfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:36:40.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.742+0000 7f0a97fff700 0 client.26546 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:36:40.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.742+0000 7f0ad26cfb80 1 -- 172.21.15.8:0/1943934520 shutdown_connections 2023-08-11T12:36:40.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.742+0000 7f0ad26cfb80 1 -- 172.21.15.8:0/1943934520 wait complete. 2023-08-11T12:36:40.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.742+0000 7f0ad26cfb80 20 client.26546 trim_cache size 0 max 16384 2023-08-11T12:36:40.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.759+0000 7f0ad26cfb80 1 Processor -- start 2023-08-11T12:36:40.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.759+0000 7f0ad26cfb80 1 -- start start 2023-08-11T12:36:40.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.759+0000 7f0ad26cfb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c64fbdae20 0x55c64fbda8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:40.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.760+0000 7f0ad26cfb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c64fbe0310 0x55c64fbeb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:40.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.760+0000 7f0ad26cfb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c64fbe0c30 0x55c64fbde100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:40.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.760+0000 7f0ad26cfb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64fbcda90 con 0x55c64fbe0c30 2023-08-11T12:36:40.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.760+0000 7f0ad26cfb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64fbe0940 con 0x55c64fbdae20 2023-08-11T12:36:40.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.760+0000 7f0ad26cfb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64fbdb6a0 con 0x55c64fbe0310 2023-08-11T12:36:40.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.760+0000 7f0abcb9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c64fbdae20 0x55c64fbda8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:40.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.760+0000 7f0abcb9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c64fbdae20 0x55c64fbda8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:33454/0 (socket says 172.21.15.8:33454) 2023-08-11T12:36:40.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.760+0000 7f0abcb9b700 1 -- 172.21.15.8:0/4292795588 learned_addr learned my addr 172.21.15.8:0/4292795588 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:36:40.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.760+0000 7f0abd39c700 1 --2- 172.21.15.8:0/4292795588 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c64fbe0c30 0x55c64fbde100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:40.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.760+0000 7f0ab7fff700 1 --2- 172.21.15.8:0/4292795588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c64fbe0310 0x55c64fbeb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:40.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.760+0000 7f0abcb9b700 1 -- 172.21.15.8:0/4292795588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c64fbe0310 msgr2=0x55c64fbeb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:36:40.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.760+0000 7f0abcb9b700 1 --2- 172.21.15.8:0/4292795588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c64fbe0310 0x55c64fbeb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.760+0000 7f0abcb9b700 1 -- 172.21.15.8:0/4292795588 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c64fbe0c30 msgr2=0x55c64fbde100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:36:40.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.760+0000 7f0abcb9b700 1 --2- 172.21.15.8:0/4292795588 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c64fbe0c30 0x55c64fbde100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.760+0000 7f0abcb9b700 1 -- 172.21.15.8:0/4292795588 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c64f958de0 con 0x55c64fbdae20 2023-08-11T12:36:40.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.760+0000 7f0abd39c700 1 --2- 172.21.15.8:0/4292795588 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c64fbe0c30 0x55c64fbde100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:36:40.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.760+0000 7f0ab7fff700 1 --2- 172.21.15.8:0/4292795588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c64fbe0310 0x55c64fbeb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:36:40.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.760+0000 7f0abcb9b700 1 --2- 172.21.15.8:0/4292795588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c64fbdae20 0x55c64fbda8e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0aac005b40 tx=0x7f0aac009290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfa8761f5b27b983 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:36:40.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.761+0000 7f0aa37fe700 1 -- 172.21.15.8:0/4292795588 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac030150 con 0x55c64fbdae20 2023-08-11T12:36:40.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.761+0000 7f0aa37fe700 1 -- 172.21.15.8:0/4292795588 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0aac0302b0 con 0x55c64fbdae20 2023-08-11T12:36:40.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.761+0000 7f0aa37fe700 1 -- 172.21.15.8:0/4292795588 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac004500 con 0x55c64fbdae20 2023-08-11T12:36:40.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.761+0000 7f0ad26cfb80 1 -- 172.21.15.8:0/4292795588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c64fbdae20 msgr2=0x55c64fbda8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:36:40.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.761+0000 7f0ad26cfb80 1 --2- 172.21.15.8:0/4292795588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c64fbdae20 0x55c64fbda8e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0aac005b40 tx=0x7f0aac009290 comp rx=0 tx=0).stop 2023-08-11T12:36:40.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.761+0000 7f0ad26cfb80 1 -- 172.21.15.8:0/4292795588 shutdown_connections 2023-08-11T12:36:40.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.761+0000 7f0ad26cfb80 1 --2- 172.21.15.8:0/4292795588 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c64fbe0c30 0x55c64fbde100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.761+0000 7f0ad26cfb80 1 --2- 172.21.15.8:0/4292795588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c64fbdae20 0x55c64fbda8e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.761+0000 7f0ad26cfb80 1 --2- 172.21.15.8:0/4292795588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c64fbe0310 0x55c64fbeb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.761+0000 7f0ad26cfb80 1 -- 172.21.15.8:0/4292795588 >> 172.21.15.8:0/4292795588 conn(0x55c64fb07950 msgr2=0x55c64fbefc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:36:40.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.761+0000 7f0ad26cfb80 1 -- 172.21.15.8:0/4292795588 shutdown_connections 2023-08-11T12:36:40.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.761+0000 7f0ad26cfb80 1 -- 172.21.15.8:0/4292795588 wait complete. 2023-08-11T12:36:40.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.762+0000 7f0ad26cfb80 1 -- start start 2023-08-11T12:36:40.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.762+0000 7f0ad26cfb80 1 Processor -- start 2023-08-11T12:36:40.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.763+0000 7f0ad26cfb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c64fbdae20 0x55c64fbea930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:40.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.763+0000 7f0ad26cfb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c64fbe0310 0x55c64fbeae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:40.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.763+0000 7f0ad26cfb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c64fbe0c30 0x55c64fc470e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:40.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.763+0000 7f0ad26cfb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64fc47620 con 0x55c64fbdae20 2023-08-11T12:36:40.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.763+0000 7f0ad26cfb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64fc47760 con 0x55c64fbe0310 2023-08-11T12:36:40.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.763+0000 7f0ad26cfb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64fc478a0 con 0x55c64fbe0c30 2023-08-11T12:36:40.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.763+0000 7f0ad26cfb80 10 client.0 _ll_register_callbacks cb 0x7f0aa4098990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:36:40.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.763+0000 7f0ab7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c64fbe0310 0x55c64fbeae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:40.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.763+0000 7f0ab7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c64fbe0310 0x55c64fbeae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:33460/0 (socket says 172.21.15.8:33460) 2023-08-11T12:36:40.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.763+0000 7f0ab7fff700 1 -- 172.21.15.8:0/785411711 learned_addr learned my addr 172.21.15.8:0/785411711 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:36:40.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.763+0000 7f0abcb9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c64fbdae20 0x55c64fbea930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:40.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.763+0000 7f0abd39c700 1 --2- 172.21.15.8:0/785411711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c64fbe0c30 0x55c64fc470e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:40.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.763+0000 7f0ab7fff700 1 -- 172.21.15.8:0/785411711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c64fbe0c30 msgr2=0x55c64fc470e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:36:40.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.763+0000 7f0ab7fff700 1 --2- 172.21.15.8:0/785411711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c64fbe0c30 0x55c64fc470e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.764+0000 7f0ab7fff700 1 -- 172.21.15.8:0/785411711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c64fbdae20 msgr2=0x55c64fbea930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:36:40.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.764+0000 7f0ab7fff700 1 --2- 172.21.15.8:0/785411711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c64fbdae20 0x55c64fbea930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.764+0000 7f0ab7fff700 1 -- 172.21.15.8:0/785411711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c64f9ac630 con 0x55c64fbe0310 2023-08-11T12:36:40.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.764+0000 7f0ab7fff700 1 --2- 172.21.15.8:0/785411711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c64fbe0310 0x55c64fbeae70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4098b50 tx=0x7f0aa40096c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=987b743f402e80cf server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:36:40.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.764+0000 7f0a97fff700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:36:40.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.764+0000 7f0a97fff700 1 -- 172.21.15.8:0/785411711 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40c9090 con 0x55c64fbe0310 2023-08-11T12:36:40.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.764+0000 7f0a97fff700 1 -- 172.21.15.8:0/785411711 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9366+0+0 (secure 0 0 0) 0x7f0aa4098bc0 con 0x55c64fbe0310 2023-08-11T12:36:40.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.764+0000 7f0ad26cfb80 1 -- 172.21.15.8:0/785411711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0aac01e040 con 0x55c64fbe0310 2023-08-11T12:36:40.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.764+0000 7f0a97fff700 1 -- 172.21.15.8:0/785411711 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0aa4098520 con 0x55c64fbe0310 2023-08-11T12:36:40.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.764+0000 7f0ad26cfb80 10 client.26552 fetch_fsmap learned FSMap version 54 2023-08-11T12:36:40.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.764+0000 7f0ad26cfb80 1 -- 172.21.15.8:0/785411711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x55c64f941c60 con 0x55c64fbe0310 2023-08-11T12:36:40.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.764+0000 7f0a97fff700 1 -- 172.21.15.8:0/785411711 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0aa4062080 con 0x55c64fbe0310 2023-08-11T12:36:40.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.765+0000 7f0a97fff700 1 -- 172.21.15.8:0/785411711 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0aa40b6bb0 con 0x55c64fbe0310 2023-08-11T12:36:40.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.765+0000 7f0ad26cfb80 10 client.26552 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:36:40.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.765+0000 7f0ad26cfb80 10 client.26552 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:36:40.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.765+0000 7f0ad26cfb80 20 client.26552 populate_metadata read hostname 'smithi008' 2023-08-11T12:36:40.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.765+0000 7f0ad26cfb80 1 --2- 172.21.15.8:0/785411711 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55c64fc48a00 0x55c64fc4ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:36:40.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.765+0000 7f0ad26cfb80 4 client.26552 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:36:40.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.765+0000 7f0ad26cfb80 1 -- 172.21.15.8:0/785411711 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c64fb25820 con 0x55c64fc48a00 2023-08-11T12:36:40.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.765+0000 7f0abcb9b700 1 --2- 172.21.15.8:0/785411711 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55c64fc48a00 0x55c64fc4ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:36:40.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.766+0000 7f0abcb9b700 1 --2- 172.21.15.8:0/785411711 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55c64fc48a00 0x55c64fc4ae20 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=240b358927a33cdf server_cookie=836a8117fcdaeb48 in_seq=0 out_seq=0 2023-08-11T12:36:40.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.766+0000 7f0a97fff700 10 client.26552 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:36:40.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.766+0000 7f0a97fff700 1 -- 172.21.15.8:0/785411711 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55c64fb25820 con 0x55c64fc48a00 2023-08-11T12:36:40.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.766+0000 7f0a97fff700 10 client.26552 handle_command_reply: tid=0 2023-08-11T12:36:40.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.766+0000 7f0ad26cfb80 1 client.26552 shutdown 2023-08-11T12:36:40.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.766+0000 7f0ad26cfb80 1 -- 172.21.15.8:0/785411711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c64fbe0310 msgr2=0x55c64fbeae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:36:40.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.766+0000 7f0ad26cfb80 1 --2- 172.21.15.8:0/785411711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c64fbe0310 0x55c64fbeae70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4098b50 tx=0x7f0aa40096c0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.766+0000 7f0ad26cfb80 1 -- 172.21.15.8:0/785411711 shutdown_connections 2023-08-11T12:36:40.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.766+0000 7f0ad26cfb80 1 --2- 172.21.15.8:0/785411711 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55c64fc48a00 0x55c64fc4ae20 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.766+0000 7f0ad26cfb80 1 --2- 172.21.15.8:0/785411711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c64fbe0c30 0x55c64fc470e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.766+0000 7f0ad26cfb80 1 --2- 172.21.15.8:0/785411711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c64fbdae20 0x55c64fbea930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.766+0000 7f0ad26cfb80 1 --2- 172.21.15.8:0/785411711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c64fbe0310 0x55c64fbeae70 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.766+0000 7f0a97fff700 0 client.26552 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:36:40.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.766+0000 7f0ad26cfb80 1 -- 172.21.15.8:0/785411711 >> 172.21.15.8:0/785411711 conn(0x55c64fb07950 msgr2=0x55c64fbde100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:36:40.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.766+0000 7f0ad26cfb80 1 -- 172.21.15.8:0/785411711 shutdown_connections 2023-08-11T12:36:40.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.766+0000 7f0ad26cfb80 1 -- 172.21.15.8:0/785411711 wait complete. 2023-08-11T12:36:40.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.766+0000 7f0ad26cfb80 20 client.26552 trim_cache size 0 max 16384 2023-08-11T12:36:40.799 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:36:40.799 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:36:40.800 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:36:40.800 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:36:40.800 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:36:40.800 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:36:40.800 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:36:40.801 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:36:40.801 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:36:40.801 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:36:40.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.767+0000 7f0abedff700 1 -- 172.21.15.8:0/2609818090 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f0aa80a00c0 msgr2=0x7f0aa80a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:36:40.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.767+0000 7f0abedff700 1 --2- 172.21.15.8:0/2609818090 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f0aa80a00c0 0x7f0aa80a2580 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0007620 tx=0x7f0ab0009040 comp rx=0 tx=0).stop 2023-08-11T12:36:40.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.767+0000 7f0abedff700 1 -- 172.21.15.8:0/2609818090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ab8101320 msgr2=0x7f0ab8073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:36:40.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.767+0000 7f0abedff700 1 --2- 172.21.15.8:0/2609818090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ab8101320 0x7f0ab8073160 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0aa400d950 tx=0x7f0aa400dc60 comp rx=0 tx=0).stop 2023-08-11T12:36:40.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.767+0000 7f0abedff700 1 -- 172.21.15.8:0/2609818090 shutdown_connections 2023-08-11T12:36:40.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.767+0000 7f0abedff700 1 --2- 172.21.15.8:0/2609818090 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f0aa80a00c0 0x7f0aa80a2580 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.767+0000 7f0abedff700 1 --2- 172.21.15.8:0/2609818090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ab8100960 0x7f0ab8072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.767+0000 7f0abedff700 1 --2- 172.21.15.8:0/2609818090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ab8106970 0x7f0ab81a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.767+0000 7f0abedff700 1 --2- 172.21.15.8:0/2609818090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ab8101320 0x7f0ab8073160 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:36:40.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.767+0000 7f0abedff700 1 -- 172.21.15.8:0/2609818090 >> 172.21.15.8:0/2609818090 conn(0x7f0ab80fc490 msgr2=0x7f0ab80fca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:36:40.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.767+0000 7f0abedff700 1 -- 172.21.15.8:0/2609818090 shutdown_connections 2023-08-11T12:36:40.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:36:40.767+0000 7f0abedff700 1 -- 172.21.15.8:0/2609818090 wait complete. 2023-08-11T12:36:40.805 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:36:41.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:40 smithi008 ceph-mon[97158]: pgmap v377: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:41.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:40 smithi194 ceph-mon[130905]: pgmap v377: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:41.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:40 smithi045 ceph-mon[130284]: pgmap v377: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:42.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:42 smithi194 ceph-mon[130905]: pgmap v378: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:36:42.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:42 smithi045 ceph-mon[130284]: pgmap v378: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:36:42.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:42 smithi008 ceph-mon[97158]: pgmap v378: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:36:44.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:44 smithi194 ceph-mon[130905]: pgmap v379: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:44.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:44 smithi045 ceph-mon[130284]: pgmap v379: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:44.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:44 smithi008 ceph-mon[97158]: pgmap v379: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:46.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:46 smithi194 ceph-mon[130905]: pgmap v380: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:46.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:46 smithi045 ceph-mon[130284]: pgmap v380: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:46.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:46 smithi008 ceph-mon[97158]: pgmap v380: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:48.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:48 smithi194 ceph-mon[130905]: pgmap v381: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:36:48.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:48 smithi045 ceph-mon[130284]: pgmap v381: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:36:48.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:48 smithi008 ceph-mon[97158]: pgmap v381: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:36:51.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:50 smithi008 ceph-mon[97158]: pgmap v382: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:51.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:50 smithi194 ceph-mon[130905]: pgmap v382: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:51.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:50 smithi045 ceph-mon[130284]: pgmap v382: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:52.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:52 smithi194 ceph-mon[130905]: pgmap v383: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:36:52.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:52 smithi045 ceph-mon[130284]: pgmap v383: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:36:52.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:52 smithi008 ceph-mon[97158]: pgmap v383: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:36:54.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:54 smithi194 ceph-mon[130905]: pgmap v384: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:54.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:54 smithi045 ceph-mon[130284]: pgmap v384: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:54.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:54 smithi008 ceph-mon[97158]: pgmap v384: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:56.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:56 smithi194 ceph-mon[130905]: pgmap v385: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:56.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:56 smithi045 ceph-mon[130284]: pgmap v385: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:56.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:56 smithi008 ceph-mon[97158]: pgmap v385: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:36:58.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:36:58 smithi194 ceph-mon[130905]: pgmap v386: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:36:58.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:36:58 smithi045 ceph-mon[130284]: pgmap v386: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:36:58.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:36:58 smithi008 ceph-mon[97158]: pgmap v386: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:37:01.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:00 smithi008 ceph-mon[97158]: pgmap v387: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:01.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:00 smithi194 ceph-mon[130905]: pgmap v387: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:01.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:00 smithi045 ceph-mon[130284]: pgmap v387: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:02.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:02 smithi194 ceph-mon[130905]: pgmap v388: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-11T12:37:02.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:02 smithi045 ceph-mon[130284]: pgmap v388: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-11T12:37:02.552 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:02 smithi008 ceph-mon[97158]: pgmap v388: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-11T12:37:03.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:03 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:37:03.396 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:03 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:37:03.397 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:03 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:37:03.397 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:03 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:37:03.397 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:03 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:37:03.398 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:03 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:37:03.398 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:03 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:37:03.398 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:03 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:37:03.398 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:03 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:37:03.399 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:03 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:37:03.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:03 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:37:03.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:03 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:37:03.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:03 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:37:03.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:03 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:37:03.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:03 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:37:04.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:04 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:37:04.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:04 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:37:04.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:04 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:37:04.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:04 smithi194 ceph-mon[130905]: pgmap v389: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:37:04.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:04 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:37:04.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:04 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:37:04.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:04 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:37:04.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:04 smithi045 ceph-mon[130284]: pgmap v389: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:37:04.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:04 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:37:04.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:04 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:37:04.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:04 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:37:04.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:04 smithi008 ceph-mon[97158]: pgmap v389: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:37:06.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:06 smithi045 ceph-mon[130284]: pgmap v390: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:37:06.396 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:06 smithi194 ceph-mon[130905]: pgmap v390: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:37:06.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:06 smithi008 ceph-mon[97158]: pgmap v390: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:37:09.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:08 smithi008 ceph-mon[97158]: osdmap e103: 12 total, 12 up, 12 in 2023-08-11T12:37:09.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:08 smithi008 ceph-mon[97158]: pgmap v392: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:37:09.142 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:08 smithi194 ceph-mon[130905]: osdmap e103: 12 total, 12 up, 12 in 2023-08-11T12:37:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:08 smithi194 ceph-mon[130905]: pgmap v392: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:37:09.144 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:08 smithi045 ceph-mon[130284]: osdmap e103: 12 total, 12 up, 12 in 2023-08-11T12:37:09.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:08 smithi045 ceph-mon[130284]: pgmap v392: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:37:10.806 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:37:11.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.026+0000 7f88173ff700 1 -- 172.21.15.8:0/3276283390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8810106970 msgr2=0x7f8810106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:37:11.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.026+0000 7f88173ff700 1 --2- 172.21.15.8:0/3276283390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8810106970 0x7f8810106d50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f880c009990 tx=0x7f880c009ca0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.026+0000 7f88173ff700 1 -- 172.21.15.8:0/3276283390 shutdown_connections 2023-08-11T12:37:11.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.026+0000 7f88173ff700 1 --2- 172.21.15.8:0/3276283390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8810101320 0x7f881010d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.026+0000 7f88173ff700 1 --2- 172.21.15.8:0/3276283390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8810106970 0x7f8810106d50 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.026+0000 7f88173ff700 1 --2- 172.21.15.8:0/3276283390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8810100960 0x7f8810100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.026+0000 7f88173ff700 1 -- 172.21.15.8:0/3276283390 >> 172.21.15.8:0/3276283390 conn(0x7f88100fc490 msgr2=0x7f88100fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:37:11.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.026+0000 7f88173ff700 1 -- 172.21.15.8:0/3276283390 shutdown_connections 2023-08-11T12:37:11.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.026+0000 7f88173ff700 1 -- 172.21.15.8:0/3276283390 wait complete. 2023-08-11T12:37:11.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.027+0000 7f88173ff700 1 Processor -- start 2023-08-11T12:37:11.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.028+0000 7f88173ff700 1 -- start start 2023-08-11T12:37:11.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.028+0000 7f88173ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8810100960 0x7f881019c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:11.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.028+0000 7f88173ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8810101320 0x7f881019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:11.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.028+0000 7f88173ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8810106970 0x7f8810196840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:11.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.028+0000 7f88173ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8810196eb0 con 0x7f8810101320 2023-08-11T12:37:11.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.028+0000 7f88173ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8810197020 con 0x7f8810100960 2023-08-11T12:37:11.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.028+0000 7f88173ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88101971e0 con 0x7f8810106970 2023-08-11T12:37:11.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.028+0000 7f881519b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8810100960 0x7f881019c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:11.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.029+0000 7f881519b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8810100960 0x7f881019c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:57794/0 (socket says 172.21.15.8:57794) 2023-08-11T12:37:11.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.029+0000 7f881499a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8810101320 0x7f881019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:11.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.029+0000 7f881519b700 1 -- 172.21.15.8:0/3083618669 learned_addr learned my addr 172.21.15.8:0/3083618669 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:37:11.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.029+0000 7f881599c700 1 --2- 172.21.15.8:0/3083618669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8810106970 0x7f8810196840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:11.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.029+0000 7f881519b700 1 -- 172.21.15.8:0/3083618669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8810106970 msgr2=0x7f8810196840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:37:11.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.029+0000 7f881519b700 1 --2- 172.21.15.8:0/3083618669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8810106970 0x7f8810196840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.029+0000 7f881519b700 1 -- 172.21.15.8:0/3083618669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8810101320 msgr2=0x7f881019cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:37:11.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.029+0000 7f881519b700 1 --2- 172.21.15.8:0/3083618669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8810101320 0x7f881019cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.029+0000 7f881519b700 1 -- 172.21.15.8:0/3083618669 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880c0095f0 con 0x7f8810100960 2023-08-11T12:37:11.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.029+0000 7f881599c700 1 --2- 172.21.15.8:0/3083618669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8810106970 0x7f8810196840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:37:11.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.029+0000 7f881499a700 1 --2- 172.21.15.8:0/3083618669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8810101320 0x7f881019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:37:11.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.029+0000 7f881519b700 1 --2- 172.21.15.8:0/3083618669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8810100960 0x7f881019c7d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f880c005910 tx=0x7f880c005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:37:11.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.029+0000 7f88067fc700 1 -- 172.21.15.8:0/3083618669 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c01d070 con 0x7f8810100960 2023-08-11T12:37:11.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.030+0000 7f88173ff700 1 -- 172.21.15.8:0/3083618669 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8810197460 con 0x7f8810100960 2023-08-11T12:37:11.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.030+0000 7f88067fc700 1 -- 172.21.15.8:0/3083618669 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f880c022470 con 0x7f8810100960 2023-08-11T12:37:11.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.030+0000 7f88067fc700 1 -- 172.21.15.8:0/3083618669 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c017650 con 0x7f8810100960 2023-08-11T12:37:11.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.030+0000 7f88173ff700 1 -- 172.21.15.8:0/3083618669 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88101a37c0 con 0x7f8810100960 2023-08-11T12:37:11.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.033+0000 7f88067fc700 1 -- 172.21.15.8:0/3083618669 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f880c00fad0 con 0x7f8810100960 2023-08-11T12:37:11.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.034+0000 7f882acd7b80 1 Processor -- start 2023-08-11T12:37:11.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.034+0000 7f882acd7b80 1 -- start start 2023-08-11T12:37:11.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.034+0000 7f88067fc700 1 --2- 172.21.15.8:0/3083618669 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f87fc0a0140 0x7f87fc0a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:11.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.034+0000 7f882acd7b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b536fcee0 0x562b536fd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:11.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.034+0000 7f882acd7b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b536fd800 0x562b53701300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:11.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.034+0000 7f88067fc700 1 -- 172.21.15.8:0/3083618669 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 9454+0+0 (secure 0 0 0) 0x7f880c0ccf20 con 0x7f8810100960 2023-08-11T12:37:11.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.034+0000 7f882acd7b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562b53701840 0x562b53701ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:11.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.034+0000 7f882acd7b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b53651630 con 0x562b536fd800 2023-08-11T12:37:11.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.034+0000 7f882acd7b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b5364ef50 con 0x562b53701840 2023-08-11T12:37:11.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.034+0000 7f882acd7b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b5364a840 con 0x562b536fcee0 2023-08-11T12:37:11.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.035+0000 7f881599c700 1 --2- 172.21.15.8:0/3083618669 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f87fc0a0140 0x7f87fc0a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:11.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.035+0000 7f881519b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b536fcee0 0x562b536fd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:11.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.035+0000 7f881499a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b536fd800 0x562b53701300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:11.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.035+0000 7f881519b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b536fcee0 0x562b536fd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:36558/0 (socket says 172.21.15.8:36558) 2023-08-11T12:37:11.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.035+0000 7f881519b700 1 -- 172.21.15.8:0/1425230424 learned_addr learned my addr 172.21.15.8:0/1425230424 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:37:11.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.035+0000 7f881599c700 1 --2- 172.21.15.8:0/1425230424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562b53701840 0x562b53701ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:11.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.035+0000 7f881519b700 1 -- 172.21.15.8:0/1425230424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562b53701840 msgr2=0x562b53701ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:37:11.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.035+0000 7f881519b700 1 --2- 172.21.15.8:0/1425230424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562b53701840 0x562b53701ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.035+0000 7f881519b700 1 -- 172.21.15.8:0/1425230424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b536fd800 msgr2=0x562b53701300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:37:11.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.035+0000 7f881519b700 1 --2- 172.21.15.8:0/1425230424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b536fd800 0x562b53701300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.035+0000 7f881519b700 1 -- 172.21.15.8:0/1425230424 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b534ca630 con 0x562b536fcee0 2023-08-11T12:37:11.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.035+0000 7f881499a700 1 --2- 172.21.15.8:0/1425230424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b536fd800 0x562b53701300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:37:11.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.036+0000 7f881519b700 1 --2- 172.21.15.8:0/1425230424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b536fcee0 0x562b536fd2c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f880c09a250 tx=0x7f880c099e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdd8584c15bc8222 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:37:11.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.036+0000 7f881599c700 1 --2- 172.21.15.8:0/3083618669 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f87fc0a0140 0x7f87fc0a2600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8808009fd0 tx=0x7f8808007b00 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:37:11.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.036+0000 7f87fb7fe700 1 -- 172.21.15.8:0/1425230424 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c09a2c0 con 0x562b536fcee0 2023-08-11T12:37:11.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.036+0000 7f87fb7fe700 1 -- 172.21.15.8:0/1425230424 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f880c09e0f0 con 0x562b536fcee0 2023-08-11T12:37:11.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.036+0000 7f87fb7fe700 1 -- 172.21.15.8:0/1425230424 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c0b2210 con 0x562b536fcee0 2023-08-11T12:37:11.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.036+0000 7f882acd7b80 1 -- 172.21.15.8:0/1425230424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b536fcee0 msgr2=0x562b536fd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:37:11.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.036+0000 7f882acd7b80 1 --2- 172.21.15.8:0/1425230424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b536fcee0 0x562b536fd2c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f880c09a250 tx=0x7f880c099e80 comp rx=0 tx=0).stop 2023-08-11T12:37:11.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.037+0000 7f882acd7b80 1 -- 172.21.15.8:0/1425230424 shutdown_connections 2023-08-11T12:37:11.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.037+0000 7f882acd7b80 1 --2- 172.21.15.8:0/1425230424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b536fcee0 0x562b536fd2c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.037+0000 7f882acd7b80 1 --2- 172.21.15.8:0/1425230424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562b53701840 0x562b53701ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.037+0000 7f882acd7b80 1 --2- 172.21.15.8:0/1425230424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b536fd800 0x562b53701300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.037+0000 7f882acd7b80 1 -- 172.21.15.8:0/1425230424 >> 172.21.15.8:0/1425230424 conn(0x562b53625950 msgr2=0x562b536f33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:37:11.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.037+0000 7f882acd7b80 1 -- 172.21.15.8:0/1425230424 shutdown_connections 2023-08-11T12:37:11.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.037+0000 7f882acd7b80 1 -- 172.21.15.8:0/1425230424 wait complete. 2023-08-11T12:37:11.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.037+0000 7f882acd7b80 1 -- start start 2023-08-11T12:37:11.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.037+0000 7f882acd7b80 1 Processor -- start 2023-08-11T12:37:11.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.038+0000 7f882acd7b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b536fcee0 0x562b53708e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:11.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.038+0000 7f882acd7b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562b536fd800 0x562b53706120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:11.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.038+0000 7f882acd7b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b53701840 0x562b53706660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:11.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.038+0000 7f882acd7b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b535e8ac0 con 0x562b536fcee0 2023-08-11T12:37:11.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.038+0000 7f882acd7b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b535e87c0 con 0x562b536fd800 2023-08-11T12:37:11.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.038+0000 7f882acd7b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b534cc920 con 0x562b53701840 2023-08-11T12:37:11.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.038+0000 7f882acd7b80 10 client.0 _ll_register_callbacks cb 0x562b535ebab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:37:11.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.038+0000 7f881499a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562b536fd800 0x562b53706120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:11.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.038+0000 7f881519b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b536fcee0 0x562b53708e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:11.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.038+0000 7f881499a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562b536fd800 0x562b53706120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:57808/0 (socket says 172.21.15.8:57808) 2023-08-11T12:37:11.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.038+0000 7f881499a700 1 -- 172.21.15.8:0/943704315 learned_addr learned my addr 172.21.15.8:0/943704315 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:37:11.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.038+0000 7f881599c700 1 --2- 172.21.15.8:0/943704315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b53701840 0x562b53706660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:11.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.039+0000 7f881499a700 1 -- 172.21.15.8:0/943704315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b53701840 msgr2=0x562b53706660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:37:11.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.039+0000 7f881499a700 1 --2- 172.21.15.8:0/943704315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b53701840 0x562b53706660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.039+0000 7f881499a700 1 -- 172.21.15.8:0/943704315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b536fcee0 msgr2=0x562b53708e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:37:11.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.039+0000 7f881499a700 1 --2- 172.21.15.8:0/943704315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b536fcee0 0x562b53708e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.039+0000 7f881499a700 1 -- 172.21.15.8:0/943704315 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8800007c50 con 0x562b536fd800 2023-08-11T12:37:11.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.039+0000 7f881499a700 1 --2- 172.21.15.8:0/943704315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562b536fd800 0x562b53706120 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8800005e70 tx=0x7f8800011cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca96ecd64ad55827 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:37:11.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.039+0000 7f87f8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:37:11.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.039+0000 7f87f8ff9700 1 -- 172.21.15.8:0/943704315 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8800016070 con 0x562b536fd800 2023-08-11T12:37:11.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.039+0000 7f882acd7b80 1 -- 172.21.15.8:0/943704315 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b536eba90 con 0x562b536fd800 2023-08-11T12:37:11.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.039+0000 7f87f8ff9700 1 -- 172.21.15.8:0/943704315 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 9454+0+0 (secure 0 0 0) 0x7f8800010b10 con 0x562b536fd800 2023-08-11T12:37:11.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.039+0000 7f87f8ff9700 1 -- 172.21.15.8:0/943704315 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8800010cd0 con 0x562b536fd800 2023-08-11T12:37:11.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.039+0000 7f882acd7b80 10 client.26564 fetch_fsmap learned FSMap version 54 2023-08-11T12:37:11.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.039+0000 7f882acd7b80 1 -- 172.21.15.8:0/943704315 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x7f88101a37c0 con 0x562b536fd800 2023-08-11T12:37:11.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.040+0000 7f87f8ff9700 1 -- 172.21.15.8:0/943704315 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562b536eba90 con 0x562b536fd800 2023-08-11T12:37:11.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.040+0000 7f87f8ff9700 1 -- 172.21.15.8:0/943704315 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f880001a3c0 con 0x562b536fd800 2023-08-11T12:37:11.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.040+0000 7f882acd7b80 10 client.26564 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:37:11.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.040+0000 7f882acd7b80 10 client.26564 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:37:11.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.040+0000 7f882acd7b80 20 client.26564 populate_metadata read hostname 'smithi008' 2023-08-11T12:37:11.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.040+0000 7f882acd7b80 1 --2- 172.21.15.8:0/943704315 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x562b537165a0 0x562b537189c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:11.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.040+0000 7f882acd7b80 4 client.26564 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:37:11.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.040+0000 7f882acd7b80 1 -- 172.21.15.8:0/943704315 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562b536c74e0 con 0x562b537165a0 2023-08-11T12:37:11.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.040+0000 7f881519b700 1 --2- 172.21.15.8:0/943704315 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x562b537165a0 0x562b537189c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:11.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.041+0000 7f881519b700 1 --2- 172.21.15.8:0/943704315 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x562b537165a0 0x562b537189c0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbbbf670b375883 server_cookie=71fadedbd290bcc1 in_seq=0 out_seq=0 2023-08-11T12:37:11.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.041+0000 7f87f8ff9700 10 client.26564 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:37:11.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.041+0000 7f87f8ff9700 1 -- 172.21.15.8:0/943704315 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x562b536c74e0 con 0x562b537165a0 2023-08-11T12:37:11.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.041+0000 7f87f8ff9700 10 client.26564 handle_command_reply: tid=0 2023-08-11T12:37:11.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.041+0000 7f882acd7b80 1 client.26564 shutdown 2023-08-11T12:37:11.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.042+0000 7f882acd7b80 1 -- 172.21.15.8:0/943704315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562b536fd800 msgr2=0x562b53706120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:37:11.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.042+0000 7f882acd7b80 1 --2- 172.21.15.8:0/943704315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562b536fd800 0x562b53706120 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8800005e70 tx=0x7f8800011cf0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.042+0000 7f882acd7b80 1 -- 172.21.15.8:0/943704315 shutdown_connections 2023-08-11T12:37:11.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.042+0000 7f882acd7b80 1 --2- 172.21.15.8:0/943704315 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x562b537165a0 0x562b537189c0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.042+0000 7f882acd7b80 1 --2- 172.21.15.8:0/943704315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b53701840 0x562b53706660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.042+0000 7f882acd7b80 1 --2- 172.21.15.8:0/943704315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b536fcee0 0x562b53708e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.042+0000 7f882acd7b80 1 --2- 172.21.15.8:0/943704315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562b536fd800 0x562b53706120 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.042+0000 7f87f8ff9700 0 client.26564 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:37:11.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.042+0000 7f882acd7b80 1 -- 172.21.15.8:0/943704315 >> 172.21.15.8:0/943704315 conn(0x562b53625950 msgr2=0x562b536f3390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:37:11.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.042+0000 7f882acd7b80 1 -- 172.21.15.8:0/943704315 shutdown_connections 2023-08-11T12:37:11.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.042+0000 7f882acd7b80 1 -- 172.21.15.8:0/943704315 wait complete. 2023-08-11T12:37:11.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.042+0000 7f882acd7b80 20 client.26564 trim_cache size 0 max 16384 2023-08-11T12:37:11.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.059+0000 7f882acd7b80 1 Processor -- start 2023-08-11T12:37:11.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.060+0000 7f882acd7b80 1 -- start start 2023-08-11T12:37:11.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.060+0000 7f882acd7b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562b536fcee0 0x562b5370d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:11.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.060+0000 7f882acd7b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b536fd800 0x562b53708930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:11.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.060+0000 7f882acd7b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b53701840 0x562b53708e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:11.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.060+0000 7f882acd7b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b5371d7c0 con 0x562b53701840 2023-08-11T12:37:11.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.060+0000 7f882acd7b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b53700350 con 0x562b536fcee0 2023-08-11T12:37:11.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.060+0000 7f882acd7b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b536efde0 con 0x562b536fd800 2023-08-11T12:37:11.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.060+0000 7f881599c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b53701840 0x562b53708e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:11.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.060+0000 7f881519b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562b536fcee0 0x562b5370d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:11.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.060+0000 7f881519b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562b536fcee0 0x562b5370d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:57812/0 (socket says 172.21.15.8:57812) 2023-08-11T12:37:11.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.060+0000 7f881519b700 1 -- 172.21.15.8:0/3084570149 learned_addr learned my addr 172.21.15.8:0/3084570149 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:37:11.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.060+0000 7f881599c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b53701840 0x562b53708e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34460/0 (socket says 172.21.15.8:34460) 2023-08-11T12:37:11.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.060+0000 7f881499a700 1 --2- 172.21.15.8:0/3084570149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b536fd800 0x562b53708930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:11.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.061+0000 7f881519b700 1 -- 172.21.15.8:0/3084570149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b536fd800 msgr2=0x562b53708930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:37:11.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.061+0000 7f881519b700 1 --2- 172.21.15.8:0/3084570149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b536fd800 0x562b53708930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.061+0000 7f881519b700 1 -- 172.21.15.8:0/3084570149 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b53701840 msgr2=0x562b53708e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:37:11.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.061+0000 7f881519b700 1 --2- 172.21.15.8:0/3084570149 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b53701840 0x562b53708e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.061+0000 7f881519b700 1 -- 172.21.15.8:0/3084570149 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b53476de0 con 0x562b536fcee0 2023-08-11T12:37:11.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.061+0000 7f881599c700 1 --2- 172.21.15.8:0/3084570149 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b53701840 0x562b53708e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:37:11.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.061+0000 7f881519b700 1 --2- 172.21.15.8:0/3084570149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562b536fcee0 0x562b5370d790 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f880c00b6f0 tx=0x7f880c01a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d1a79fd9615b3ef server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:37:11.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.061+0000 7f87fbfff700 1 -- 172.21.15.8:0/3084570149 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c0a20c0 con 0x562b536fcee0 2023-08-11T12:37:11.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.061+0000 7f87fbfff700 1 -- 172.21.15.8:0/3084570149 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f880c098660 con 0x562b536fcee0 2023-08-11T12:37:11.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.061+0000 7f87fbfff700 1 -- 172.21.15.8:0/3084570149 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c022970 con 0x562b536fcee0 2023-08-11T12:37:11.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.062+0000 7f882acd7b80 1 -- 172.21.15.8:0/3084570149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562b536fcee0 msgr2=0x562b5370d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:37:11.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.062+0000 7f882acd7b80 1 --2- 172.21.15.8:0/3084570149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562b536fcee0 0x562b5370d790 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f880c00b6f0 tx=0x7f880c01a040 comp rx=0 tx=0).stop 2023-08-11T12:37:11.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.062+0000 7f882acd7b80 1 -- 172.21.15.8:0/3084570149 shutdown_connections 2023-08-11T12:37:11.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.062+0000 7f882acd7b80 1 --2- 172.21.15.8:0/3084570149 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b53701840 0x562b53708e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.062+0000 7f882acd7b80 1 --2- 172.21.15.8:0/3084570149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562b536fcee0 0x562b5370d790 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.062+0000 7f882acd7b80 1 --2- 172.21.15.8:0/3084570149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b536fd800 0x562b53708930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.062+0000 7f882acd7b80 1 -- 172.21.15.8:0/3084570149 >> 172.21.15.8:0/3084570149 conn(0x562b53625950 msgr2=0x562b536f3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:37:11.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.062+0000 7f882acd7b80 1 -- 172.21.15.8:0/3084570149 shutdown_connections 2023-08-11T12:37:11.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.062+0000 7f882acd7b80 1 -- 172.21.15.8:0/3084570149 wait complete. 2023-08-11T12:37:11.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.062+0000 7f882acd7b80 1 -- start start 2023-08-11T12:37:11.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.062+0000 7f882acd7b80 1 Processor -- start 2023-08-11T12:37:11.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.063+0000 7f882acd7b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562b536fcee0 0x562b5370b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:11.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.063+0000 7f882acd7b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b536fd800 0x562b5370be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:11.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.063+0000 7f882acd7b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b53701840 0x562b53763220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:11.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.063+0000 7f882acd7b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b53763760 con 0x562b536fd800 2023-08-11T12:37:11.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.063+0000 7f882acd7b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b537638d0 con 0x562b536fcee0 2023-08-11T12:37:11.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.063+0000 7f882acd7b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b53763a90 con 0x562b53701840 2023-08-11T12:37:11.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.063+0000 7f882acd7b80 10 client.0 _ll_register_callbacks cb 0x7f88000114f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:37:11.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.063+0000 7f881519b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562b536fcee0 0x562b5370b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:11.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.063+0000 7f881519b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562b536fcee0 0x562b5370b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:57826/0 (socket says 172.21.15.8:57826) 2023-08-11T12:37:11.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.063+0000 7f881519b700 1 -- 172.21.15.8:0/1763596716 learned_addr learned my addr 172.21.15.8:0/1763596716 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:37:11.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.063+0000 7f881499a700 1 --2- 172.21.15.8:0/1763596716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b536fd800 0x562b5370be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:11.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.063+0000 7f881599c700 1 --2- 172.21.15.8:0/1763596716 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b53701840 0x562b53763220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:11.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.064+0000 7f881519b700 1 -- 172.21.15.8:0/1763596716 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b53701840 msgr2=0x562b53763220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:37:11.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.064+0000 7f881519b700 1 --2- 172.21.15.8:0/1763596716 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b53701840 0x562b53763220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.064+0000 7f881519b700 1 -- 172.21.15.8:0/1763596716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b536fd800 msgr2=0x562b5370be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:37:11.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.064+0000 7f881519b700 1 --2- 172.21.15.8:0/1763596716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b536fd800 0x562b5370be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.064+0000 7f881519b700 1 -- 172.21.15.8:0/1763596716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8808021040 con 0x562b536fcee0 2023-08-11T12:37:11.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.064+0000 7f881499a700 1 --2- 172.21.15.8:0/1763596716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b536fd800 0x562b5370be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:37:11.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.064+0000 7f881519b700 1 --2- 172.21.15.8:0/1763596716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562b536fcee0 0x562b5370b910 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f880c0967c0 tx=0x7f880c00b680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9aa00fd61a61c1a8 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:37:11.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.064+0000 7f87f8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:37:11.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.064+0000 7f87f8ff9700 1 -- 172.21.15.8:0/1763596716 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c0a20c0 con 0x562b536fcee0 2023-08-11T12:37:11.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.064+0000 7f882acd7b80 1 -- 172.21.15.8:0/1763596716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f880c09e0f0 con 0x562b536fcee0 2023-08-11T12:37:11.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.064+0000 7f87f8ff9700 1 -- 172.21.15.8:0/1763596716 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 9454+0+0 (secure 0 0 0) 0x7f880c022850 con 0x562b536fcee0 2023-08-11T12:37:11.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.064+0000 7f87f8ff9700 1 -- 172.21.15.8:0/1763596716 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f880c0b2210 con 0x562b536fcee0 2023-08-11T12:37:11.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.064+0000 7f882acd7b80 10 client.26570 fetch_fsmap learned FSMap version 54 2023-08-11T12:37:11.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.064+0000 7f882acd7b80 1 -- 172.21.15.8:0/1763596716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x562b534ca630 con 0x562b536fcee0 2023-08-11T12:37:11.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.064+0000 7f87f8ff9700 1 -- 172.21.15.8:0/1763596716 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f880c09e0f0 con 0x562b536fcee0 2023-08-11T12:37:11.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.065+0000 7f87f8ff9700 1 -- 172.21.15.8:0/1763596716 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f880c082020 con 0x562b536fcee0 2023-08-11T12:37:11.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.065+0000 7f882acd7b80 10 client.26570 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:37:11.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.065+0000 7f882acd7b80 10 client.26570 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:37:11.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.065+0000 7f882acd7b80 20 client.26570 populate_metadata read hostname 'smithi008' 2023-08-11T12:37:11.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.065+0000 7f882acd7b80 1 --2- 172.21.15.8:0/1763596716 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x562b5376ae50 0x562b5376d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:11.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.065+0000 7f882acd7b80 4 client.26570 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:37:11.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.065+0000 7f882acd7b80 1 -- 172.21.15.8:0/1763596716 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562b53643820 con 0x562b5376ae50 2023-08-11T12:37:11.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.065+0000 7f881499a700 1 --2- 172.21.15.8:0/1763596716 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x562b5376ae50 0x562b5376d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:11.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.065+0000 7f881499a700 1 --2- 172.21.15.8:0/1763596716 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x562b5376ae50 0x562b5376d240 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79c2342592d4087a server_cookie=c2919e50c21e4cd6 in_seq=0 out_seq=0 2023-08-11T12:37:11.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.065+0000 7f87f8ff9700 10 client.26570 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:37:11.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.066+0000 7f87f8ff9700 1 -- 172.21.15.8:0/1763596716 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x562b53643820 con 0x562b5376ae50 2023-08-11T12:37:11.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.066+0000 7f87f8ff9700 10 client.26570 handle_command_reply: tid=0 2023-08-11T12:37:11.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.066+0000 7f882acd7b80 1 client.26570 shutdown 2023-08-11T12:37:11.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.066+0000 7f882acd7b80 1 -- 172.21.15.8:0/1763596716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562b536fcee0 msgr2=0x562b5370b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:37:11.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.066+0000 7f882acd7b80 1 --2- 172.21.15.8:0/1763596716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562b536fcee0 0x562b5370b910 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f880c0967c0 tx=0x7f880c00b680 comp rx=0 tx=0).stop 2023-08-11T12:37:11.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.066+0000 7f882acd7b80 1 -- 172.21.15.8:0/1763596716 shutdown_connections 2023-08-11T12:37:11.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.066+0000 7f882acd7b80 1 --2- 172.21.15.8:0/1763596716 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x562b5376ae50 0x562b5376d240 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.066+0000 7f882acd7b80 1 --2- 172.21.15.8:0/1763596716 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b53701840 0x562b53763220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.066+0000 7f882acd7b80 1 --2- 172.21.15.8:0/1763596716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562b536fcee0 0x562b5370b910 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.066+0000 7f882acd7b80 1 --2- 172.21.15.8:0/1763596716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b536fd800 0x562b5370be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.066+0000 7f87f8ff9700 0 client.26570 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:37:11.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.066+0000 7f882acd7b80 1 -- 172.21.15.8:0/1763596716 >> 172.21.15.8:0/1763596716 conn(0x562b53625950 msgr2=0x562b536ed420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:37:11.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.066+0000 7f882acd7b80 1 -- 172.21.15.8:0/1763596716 shutdown_connections 2023-08-11T12:37:11.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.066+0000 7f882acd7b80 1 -- 172.21.15.8:0/1763596716 wait complete. 2023-08-11T12:37:11.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.066+0000 7f882acd7b80 20 client.26570 trim_cache size 0 max 16384 2023-08-11T12:37:11.110 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:37:11.110 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:37:11.110 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:37:11.111 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:37:11.111 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:37:11.111 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:37:11.111 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:37:11.111 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:37:11.112 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:37:11.112 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:37:11.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.067+0000 7f88173ff700 1 -- 172.21.15.8:0/3083618669 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f87fc0a0140 msgr2=0x7f87fc0a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:37:11.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.067+0000 7f88173ff700 1 --2- 172.21.15.8:0/3083618669 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f87fc0a0140 0x7f87fc0a2600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8808009fd0 tx=0x7f8808007b00 comp rx=0 tx=0).stop 2023-08-11T12:37:11.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.067+0000 7f88173ff700 1 -- 172.21.15.8:0/3083618669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8810100960 msgr2=0x7f881019c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:37:11.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.067+0000 7f88173ff700 1 --2- 172.21.15.8:0/3083618669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8810100960 0x7f881019c7d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f880c005910 tx=0x7f880c005740 comp rx=0 tx=0).stop 2023-08-11T12:37:11.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.067+0000 7f88173ff700 1 -- 172.21.15.8:0/3083618669 shutdown_connections 2023-08-11T12:37:11.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.067+0000 7f88173ff700 1 --2- 172.21.15.8:0/3083618669 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f87fc0a0140 0x7f87fc0a2600 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.067+0000 7f88173ff700 1 --2- 172.21.15.8:0/3083618669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8810106970 0x7f8810196840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.067+0000 7f88173ff700 1 --2- 172.21.15.8:0/3083618669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8810100960 0x7f881019c7d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.067+0000 7f88173ff700 1 --2- 172.21.15.8:0/3083618669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8810101320 0x7f881019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:11.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.067+0000 7f88173ff700 1 -- 172.21.15.8:0/3083618669 >> 172.21.15.8:0/3083618669 conn(0x7f88100fc490 msgr2=0x7f88100fcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:37:11.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.067+0000 7f88173ff700 1 -- 172.21.15.8:0/3083618669 shutdown_connections 2023-08-11T12:37:11.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:11.067+0000 7f88173ff700 1 -- 172.21.15.8:0/3083618669 wait complete. 2023-08-11T12:37:11.116 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:37:11.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:10 smithi008 ceph-mon[97158]: pgmap v393: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:37:11.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:10 smithi194 ceph-mon[130905]: pgmap v393: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:37:11.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:10 smithi045 ceph-mon[130284]: pgmap v393: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:37:12.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:12 smithi194 ceph-mon[130905]: pgmap v394: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:37:12.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:12 smithi045 ceph-mon[130284]: pgmap v394: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:37:12.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:12 smithi008 ceph-mon[97158]: pgmap v394: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:37:14.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:14 smithi194 ceph-mon[130905]: pgmap v395: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:37:14.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:14 smithi045 ceph-mon[130284]: pgmap v395: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:37:14.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:14 smithi008 ceph-mon[97158]: pgmap v395: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:37:16.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:15 smithi008 ceph-mon[97158]: osdmap e104: 12 total, 12 up, 12 in 2023-08-11T12:37:16.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:15 smithi194 ceph-mon[130905]: osdmap e104: 12 total, 12 up, 12 in 2023-08-11T12:37:16.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:15 smithi045 ceph-mon[130284]: osdmap e104: 12 total, 12 up, 12 in 2023-08-11T12:37:17.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:16 smithi008 ceph-mon[97158]: pgmap v397: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 123 B/s wr, 6 op/s 2023-08-11T12:37:17.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:16 smithi194 ceph-mon[130905]: pgmap v397: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 123 B/s wr, 6 op/s 2023-08-11T12:37:17.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:16 smithi045 ceph-mon[130284]: pgmap v397: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 123 B/s wr, 6 op/s 2023-08-11T12:37:18.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:18 smithi194 ceph-mon[130905]: pgmap v398: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:37:18.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:18 smithi045 ceph-mon[130284]: pgmap v398: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:37:18.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:18 smithi008 ceph-mon[97158]: pgmap v398: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:37:21.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:20 smithi008 ceph-mon[97158]: pgmap v399: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:37:21.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:20 smithi194 ceph-mon[130905]: pgmap v399: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:37:21.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:20 smithi045 ceph-mon[130284]: pgmap v399: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:37:22.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:22 smithi194 ceph-mon[130905]: pgmap v400: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:37:22.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:22 smithi045 ceph-mon[130284]: pgmap v400: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:37:22.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:22 smithi008 ceph-mon[97158]: pgmap v400: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:37:24.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:24 smithi194 ceph-mon[130905]: pgmap v401: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:37:24.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:24 smithi045 ceph-mon[130284]: pgmap v401: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:37:24.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:24 smithi008 ceph-mon[97158]: pgmap v401: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:37:26.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:26 smithi194 ceph-mon[130905]: pgmap v402: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:37:26.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:26 smithi045 ceph-mon[130284]: pgmap v402: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:37:26.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:26 smithi008 ceph-mon[97158]: pgmap v402: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:37:28.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:28 smithi194 ceph-mon[130905]: pgmap v403: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:37:28.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:28 smithi045 ceph-mon[130284]: pgmap v403: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:37:28.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:28 smithi008 ceph-mon[97158]: pgmap v403: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:37:31.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:30 smithi008 ceph-mon[97158]: pgmap v404: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:31.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:30 smithi194 ceph-mon[130905]: pgmap v404: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:31.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:30 smithi045 ceph-mon[130284]: pgmap v404: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:32.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:32 smithi194 ceph-mon[130905]: pgmap v405: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:37:32.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:32 smithi045 ceph-mon[130284]: pgmap v405: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:37:32.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:32 smithi008 ceph-mon[97158]: pgmap v405: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:37:34.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:34 smithi194 ceph-mon[130905]: pgmap v406: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:34.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:34 smithi045 ceph-mon[130284]: pgmap v406: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:34.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:34 smithi008 ceph-mon[97158]: pgmap v406: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:36.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:36 smithi194 ceph-mon[130905]: pgmap v407: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:36.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:36 smithi045 ceph-mon[130284]: pgmap v407: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:36.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:36 smithi008 ceph-mon[97158]: pgmap v407: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:38.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:38 smithi194 ceph-mon[130905]: pgmap v408: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:37:38.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:38 smithi045 ceph-mon[130284]: pgmap v408: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:37:38.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:38 smithi008 ceph-mon[97158]: pgmap v408: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:37:41.117 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:37:41.302 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:40 smithi008 ceph-mon[97158]: pgmap v409: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:41.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.335+0000 7f558ffff700 1 -- 172.21.15.8:0/786498361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5588072d50 msgr2=0x7f5588073130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:37:41.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.335+0000 7f558ffff700 1 --2- 172.21.15.8:0/786498361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5588072d50 0x7f5588073130 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f55840098f0 tx=0x7f5584009c00 comp rx=0 tx=0).stop 2023-08-11T12:37:41.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.335+0000 7f558ffff700 1 -- 172.21.15.8:0/786498361 shutdown_connections 2023-08-11T12:37:41.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.335+0000 7f558ffff700 1 --2- 172.21.15.8:0/786498361 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f558810d1a0 0x7f558810f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.335+0000 7f558ffff700 1 --2- 172.21.15.8:0/786498361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5588072d50 0x7f5588073130 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.335+0000 7f558ffff700 1 --2- 172.21.15.8:0/786498361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5588073670 0x7f558810cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.335+0000 7f558ffff700 1 -- 172.21.15.8:0/786498361 >> 172.21.15.8:0/786498361 conn(0x7f55880fc490 msgr2=0x7f55880fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:37:41.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.335+0000 7f558ffff700 1 -- 172.21.15.8:0/786498361 shutdown_connections 2023-08-11T12:37:41.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.335+0000 7f558ffff700 1 -- 172.21.15.8:0/786498361 wait complete. 2023-08-11T12:37:41.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.336+0000 7f558ffff700 1 Processor -- start 2023-08-11T12:37:41.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.336+0000 7f558ffff700 1 -- start start 2023-08-11T12:37:41.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.337+0000 7f558ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5588072d50 0x7f558819eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:41.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.337+0000 7f558ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5588073670 0x7f558819f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:41.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.337+0000 7f558ffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f558810d1a0 0x7f5588198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:41.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.337+0000 7f558ffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55881991c0 con 0x7f5588073670 2023-08-11T12:37:41.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.337+0000 7f558ffff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5588199330 con 0x7f5588072d50 2023-08-11T12:37:41.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.337+0000 7f558ffff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55881994f0 con 0x7f558810d1a0 2023-08-11T12:37:41.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.337+0000 7f558dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5588072d50 0x7f558819eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:41.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.337+0000 7f558d59a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5588073670 0x7f558819f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:41.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.337+0000 7f558dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5588072d50 0x7f558819eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:60636/0 (socket says 172.21.15.8:60636) 2023-08-11T12:37:41.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.337+0000 7f558dd9b700 1 -- 172.21.15.8:0/4204901645 learned_addr learned my addr 172.21.15.8:0/4204901645 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:37:41.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.337+0000 7f558d59a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5588073670 0x7f558819f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36504/0 (socket says 172.21.15.8:36504) 2023-08-11T12:37:41.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.337+0000 7f558e59c700 1 --2- 172.21.15.8:0/4204901645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f558810d1a0 0x7f5588198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:41.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.337+0000 7f558d59a700 1 -- 172.21.15.8:0/4204901645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f558810d1a0 msgr2=0x7f5588198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:37:41.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.337+0000 7f558d59a700 1 --2- 172.21.15.8:0/4204901645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f558810d1a0 0x7f5588198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.337+0000 7f558d59a700 1 -- 172.21.15.8:0/4204901645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5588072d50 msgr2=0x7f558819eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:37:41.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.337+0000 7f558d59a700 1 --2- 172.21.15.8:0/4204901645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5588072d50 0x7f558819eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.337+0000 7f558d59a700 1 -- 172.21.15.8:0/4204901645 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5580009d00 con 0x7f5588073670 2023-08-11T12:37:41.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.337+0000 7f558dd9b700 1 --2- 172.21.15.8:0/4204901645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5588072d50 0x7f558819eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:37:41.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.338+0000 7f558d59a700 1 --2- 172.21.15.8:0/4204901645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5588073670 0x7f558819f020 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f557800e9f0 tx=0x7f557800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:37:41.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.338+0000 7f557effd700 1 -- 172.21.15.8:0/4204901645 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557800c9c0 con 0x7f5588073670 2023-08-11T12:37:41.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.338+0000 7f558ffff700 1 -- 172.21.15.8:0/4204901645 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5584009520 con 0x7f5588073670 2023-08-11T12:37:41.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.338+0000 7f557effd700 1 -- 172.21.15.8:0/4204901645 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5578010430 con 0x7f5588073670 2023-08-11T12:37:41.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.338+0000 7f557effd700 1 -- 172.21.15.8:0/4204901645 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5578018680 con 0x7f5588073670 2023-08-11T12:37:41.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.338+0000 7f558ffff700 1 -- 172.21.15.8:0/4204901645 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55881999c0 con 0x7f5588073670 2023-08-11T12:37:41.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.343+0000 7f557effd700 1 -- 172.21.15.8:0/4204901645 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f5578010860 con 0x7f5588073670 2023-08-11T12:37:41.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.344+0000 7f55a3a1eb80 1 Processor -- start 2023-08-11T12:37:41.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.344+0000 7f55a3a1eb80 1 -- start start 2023-08-11T12:37:41.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.344+0000 7f55a3a1eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56293f85a310 0x56293f85a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:41.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.344+0000 7f55a3a1eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56293f85ac30 0x56293f8548e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:41.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.344+0000 7f55a3a1eb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56293f854e20 0x56293f855260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:41.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.344+0000 7f55a3a1eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293f7ad630 con 0x56293f85a310 2023-08-11T12:37:41.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.344+0000 7f55a3a1eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293f7aaf50 con 0x56293f85ac30 2023-08-11T12:37:41.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.344+0000 7f55a3a1eb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293f7a6840 con 0x56293f854e20 2023-08-11T12:37:41.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.344+0000 7f558e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56293f85a310 0x56293f85a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:41.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.344+0000 7f558dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56293f85ac30 0x56293f8548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:41.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.344+0000 7f558e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56293f85a310 0x56293f85a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36520/0 (socket says 172.21.15.8:36520) 2023-08-11T12:37:41.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.345+0000 7f558e59c700 1 -- 172.21.15.8:0/689976314 learned_addr learned my addr 172.21.15.8:0/689976314 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:37:41.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.345+0000 7f558d59a700 1 --2- 172.21.15.8:0/689976314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56293f854e20 0x56293f855260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:41.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.345+0000 7f557effd700 1 --2- 172.21.15.8:0/4204901645 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f55740a00c0 0x7f55740a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:41.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.345+0000 7f558dd9b700 1 -- 172.21.15.8:0/689976314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56293f854e20 msgr2=0x56293f855260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:37:41.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.345+0000 7f558dd9b700 1 --2- 172.21.15.8:0/689976314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56293f854e20 0x56293f855260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.345+0000 7f558dd9b700 1 -- 172.21.15.8:0/689976314 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56293f85a310 msgr2=0x56293f85a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:37:41.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.345+0000 7f558dd9b700 1 --2- 172.21.15.8:0/689976314 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56293f85a310 0x56293f85a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.345+0000 7f558dd9b700 1 -- 172.21.15.8:0/689976314 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56293f626630 con 0x56293f85ac30 2023-08-11T12:37:41.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.345+0000 7f557effd700 1 -- 172.21.15.8:0/4204901645 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9366+0+0 (secure 0 0 0) 0x7f5578014070 con 0x7f5588073670 2023-08-11T12:37:41.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.345+0000 7f558e59c700 1 --2- 172.21.15.8:0/4204901645 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f55740a00c0 0x7f55740a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:41.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.345+0000 7f558dd9b700 1 --2- 172.21.15.8:0/689976314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56293f85ac30 0x56293f8548e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f55840098c0 tx=0x7f5584005e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8c65aaac9be2f18 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:37:41.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.346+0000 7f5573fff700 1 -- 172.21.15.8:0/689976314 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558401c050 con 0x56293f85ac30 2023-08-11T12:37:41.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.346+0000 7f5573fff700 1 -- 172.21.15.8:0/689976314 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f558401d040 con 0x56293f85ac30 2023-08-11T12:37:41.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.346+0000 7f5573fff700 1 -- 172.21.15.8:0/689976314 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5584005330 con 0x56293f85ac30 2023-08-11T12:37:41.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.346+0000 7f55a3a1eb80 1 -- 172.21.15.8:0/689976314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56293f85ac30 msgr2=0x56293f8548e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:37:41.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.346+0000 7f558e59c700 1 --2- 172.21.15.8:0/4204901645 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f55740a00c0 0x7f55740a2580 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5580003ba0 tx=0x7f5580004ad0 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:37:41.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.346+0000 7f55a3a1eb80 1 --2- 172.21.15.8:0/689976314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56293f85ac30 0x56293f8548e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f55840098c0 tx=0x7f5584005e00 comp rx=0 tx=0).stop 2023-08-11T12:37:41.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.346+0000 7f55a3a1eb80 1 -- 172.21.15.8:0/689976314 shutdown_connections 2023-08-11T12:37:41.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.347+0000 7f55a3a1eb80 1 --2- 172.21.15.8:0/689976314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56293f854e20 0x56293f855260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.347+0000 7f55a3a1eb80 1 --2- 172.21.15.8:0/689976314 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56293f85a310 0x56293f85a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.347+0000 7f55a3a1eb80 1 --2- 172.21.15.8:0/689976314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56293f85ac30 0x56293f8548e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.347+0000 7f55a3a1eb80 1 -- 172.21.15.8:0/689976314 >> 172.21.15.8:0/689976314 conn(0x56293f781950 msgr2=0x56293f84f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:37:41.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.347+0000 7f55a3a1eb80 1 -- 172.21.15.8:0/689976314 shutdown_connections 2023-08-11T12:37:41.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.347+0000 7f55a3a1eb80 1 -- 172.21.15.8:0/689976314 wait complete. 2023-08-11T12:37:41.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.347+0000 7f55a3a1eb80 1 -- start start 2023-08-11T12:37:41.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.347+0000 7f55a3a1eb80 1 Processor -- start 2023-08-11T12:37:41.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.348+0000 7f55a3a1eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56293f854e20 0x56293f860b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:41.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.348+0000 7f55a3a1eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56293f85a310 0x56293f85ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:41.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.348+0000 7f55a3a1eb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56293f85ac30 0x56293f85e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:41.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.348+0000 7f55a3a1eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293f744ac0 con 0x56293f85a310 2023-08-11T12:37:41.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.348+0000 7f55a3a1eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293f7447c0 con 0x56293f854e20 2023-08-11T12:37:41.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.348+0000 7f55a3a1eb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293f628920 con 0x56293f85ac30 2023-08-11T12:37:41.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.348+0000 7f55a3a1eb80 10 client.0 _ll_register_callbacks cb 0x56293f747ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:37:41.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.348+0000 7f558dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56293f854e20 0x56293f860b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:41.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.348+0000 7f558e59c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56293f85ac30 0x56293f85e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:41.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.348+0000 7f558dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56293f854e20 0x56293f860b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:60662/0 (socket says 172.21.15.8:60662) 2023-08-11T12:37:41.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.348+0000 7f558dd9b700 1 -- 172.21.15.8:0/529276371 learned_addr learned my addr 172.21.15.8:0/529276371 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:37:41.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.348+0000 7f558d59a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56293f85a310 0x56293f85ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:41.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.348+0000 7f558dd9b700 1 -- 172.21.15.8:0/529276371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56293f85ac30 msgr2=0x56293f85e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:37:41.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.348+0000 7f558dd9b700 1 --2- 172.21.15.8:0/529276371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56293f85ac30 0x56293f85e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.348+0000 7f558dd9b700 1 -- 172.21.15.8:0/529276371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56293f85a310 msgr2=0x56293f85ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:37:41.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.348+0000 7f558dd9b700 1 --2- 172.21.15.8:0/529276371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56293f85a310 0x56293f85ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.348+0000 7f558dd9b700 1 -- 172.21.15.8:0/529276371 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55881102d0 con 0x56293f854e20 2023-08-11T12:37:41.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.349+0000 7f558dd9b700 1 --2- 172.21.15.8:0/529276371 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56293f854e20 0x56293f860b00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5584005e90 tx=0x7f558400b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f3adeed2719616f server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:37:41.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.349+0000 7f55717fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:37:41.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.349+0000 7f55717fa700 1 -- 172.21.15.8:0/529276371 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558401c040 con 0x56293f854e20 2023-08-11T12:37:41.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.349+0000 7f55a3a1eb80 1 -- 172.21.15.8:0/529276371 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56293f847a90 con 0x56293f854e20 2023-08-11T12:37:41.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.349+0000 7f55717fa700 1 -- 172.21.15.8:0/529276371 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 9366+0+0 (secure 0 0 0) 0x7f5584005240 con 0x56293f854e20 2023-08-11T12:37:41.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.349+0000 7f55717fa700 1 -- 172.21.15.8:0/529276371 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5584005400 con 0x56293f854e20 2023-08-11T12:37:41.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.350+0000 7f55a3a1eb80 10 client.26582 fetch_fsmap learned FSMap version 54 2023-08-11T12:37:41.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.350+0000 7f55a3a1eb80 1 -- 172.21.15.8:0/529276371 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x56293f5d2de0 con 0x56293f854e20 2023-08-11T12:37:41.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.350+0000 7f55717fa700 1 -- 172.21.15.8:0/529276371 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56293f847a90 con 0x56293f854e20 2023-08-11T12:37:41.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.350+0000 7f55717fa700 1 -- 172.21.15.8:0/529276371 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5584015020 con 0x56293f854e20 2023-08-11T12:37:41.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.350+0000 7f55a3a1eb80 10 client.26582 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:37:41.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.350+0000 7f55a3a1eb80 10 client.26582 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:37:41.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.350+0000 7f55a3a1eb80 20 client.26582 populate_metadata read hostname 'smithi008' 2023-08-11T12:37:41.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.350+0000 7f55a3a1eb80 1 --2- 172.21.15.8:0/529276371 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x56293f86df10 0x56293f870300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:41.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.350+0000 7f55a3a1eb80 4 client.26582 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:37:41.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.350+0000 7f55a3a1eb80 1 -- 172.21.15.8:0/529276371 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56293f8234e0 con 0x56293f86df10 2023-08-11T12:37:41.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.365+0000 7f558d59a700 1 --2- 172.21.15.8:0/529276371 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x56293f86df10 0x56293f870300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:41.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.365+0000 7f558d59a700 1 --2- 172.21.15.8:0/529276371 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x56293f86df10 0x56293f870300 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f192b25065aa86b3 server_cookie=d227f4b331c7bccc in_seq=0 out_seq=0 2023-08-11T12:37:41.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.365+0000 7f55717fa700 10 client.26582 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:37:41.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.366+0000 7f55717fa700 1 -- 172.21.15.8:0/529276371 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x56293f8234e0 con 0x56293f86df10 2023-08-11T12:37:41.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.366+0000 7f55717fa700 10 client.26582 handle_command_reply: tid=0 2023-08-11T12:37:41.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.366+0000 7f55a3a1eb80 1 client.26582 shutdown 2023-08-11T12:37:41.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.366+0000 7f55a3a1eb80 1 -- 172.21.15.8:0/529276371 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56293f854e20 msgr2=0x56293f860b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:37:41.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.366+0000 7f55a3a1eb80 1 --2- 172.21.15.8:0/529276371 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56293f854e20 0x56293f860b00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5584005e90 tx=0x7f558400b790 comp rx=0 tx=0).stop 2023-08-11T12:37:41.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.366+0000 7f55a3a1eb80 1 -- 172.21.15.8:0/529276371 shutdown_connections 2023-08-11T12:37:41.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.366+0000 7f55a3a1eb80 1 --2- 172.21.15.8:0/529276371 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x56293f86df10 0x56293f870300 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.366+0000 7f55a3a1eb80 1 --2- 172.21.15.8:0/529276371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56293f85ac30 0x56293f85e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.366+0000 7f55a3a1eb80 1 --2- 172.21.15.8:0/529276371 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56293f854e20 0x56293f860b00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.366+0000 7f55a3a1eb80 1 --2- 172.21.15.8:0/529276371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56293f85a310 0x56293f85ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.366+0000 7f55717fa700 0 client.26582 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:37:41.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.366+0000 7f55a3a1eb80 1 -- 172.21.15.8:0/529276371 >> 172.21.15.8:0/529276371 conn(0x56293f781950 msgr2=0x56293f849cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:37:41.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.366+0000 7f55a3a1eb80 1 -- 172.21.15.8:0/529276371 shutdown_connections 2023-08-11T12:37:41.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.367+0000 7f55a3a1eb80 1 -- 172.21.15.8:0/529276371 wait complete. 2023-08-11T12:37:41.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.367+0000 7f55a3a1eb80 20 client.26582 trim_cache size 0 max 16384 2023-08-11T12:37:41.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.384+0000 7f55a3a1eb80 1 Processor -- start 2023-08-11T12:37:41.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.384+0000 7f55a3a1eb80 1 -- start start 2023-08-11T12:37:41.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.384+0000 7f55a3a1eb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56293f854e20 0x56293f8548e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:41.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.384+0000 7f55a3a1eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56293f85a310 0x56293f865520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:41.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.384+0000 7f55a3a1eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56293f85ac30 0x56293f8605c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:41.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.384+0000 7f55a3a1eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293f8513c0 con 0x56293f85ac30 2023-08-11T12:37:41.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.384+0000 7f55a3a1eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293f859f20 con 0x56293f85a310 2023-08-11T12:37:41.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.384+0000 7f55a3a1eb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293f85c310 con 0x56293f854e20 2023-08-11T12:37:41.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.385+0000 7f558dd9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56293f854e20 0x56293f8548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:41.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.385+0000 7f558d59a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56293f85a310 0x56293f865520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:41.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.385+0000 7f558e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56293f85ac30 0x56293f8605c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:41.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.385+0000 7f558d59a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56293f85a310 0x56293f865520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:60678/0 (socket says 172.21.15.8:60678) 2023-08-11T12:37:41.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.385+0000 7f558dd9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56293f854e20 0x56293f8548e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:58496/0 (socket says 172.21.15.8:58496) 2023-08-11T12:37:41.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.385+0000 7f558d59a700 1 -- 172.21.15.8:0/2852851069 learned_addr learned my addr 172.21.15.8:0/2852851069 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:37:41.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.385+0000 7f558d59a700 1 -- 172.21.15.8:0/2852851069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56293f854e20 msgr2=0x56293f8548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:37:41.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.385+0000 7f558d59a700 1 --2- 172.21.15.8:0/2852851069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56293f854e20 0x56293f8548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.385+0000 7f558d59a700 1 -- 172.21.15.8:0/2852851069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56293f85ac30 msgr2=0x56293f8605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:37:41.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.385+0000 7f558d59a700 1 --2- 172.21.15.8:0/2852851069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56293f85ac30 0x56293f8605c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.385+0000 7f558d59a700 1 -- 172.21.15.8:0/2852851069 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56293f5bbc60 con 0x56293f85a310 2023-08-11T12:37:41.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.385+0000 7f558d59a700 1 --2- 172.21.15.8:0/2852851069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56293f85a310 0x56293f865520 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f55780989f0 tx=0x7f55780cdbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2a37a762aef82b8 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:37:41.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.385+0000 7f557cff9700 1 -- 172.21.15.8:0/2852851069 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5578098830 con 0x56293f85a310 2023-08-11T12:37:41.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.385+0000 7f557cff9700 1 -- 172.21.15.8:0/2852851069 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5578098650 con 0x56293f85a310 2023-08-11T12:37:41.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.385+0000 7f557cff9700 1 -- 172.21.15.8:0/2852851069 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55780a0b00 con 0x56293f85a310 2023-08-11T12:37:41.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.386+0000 7f55a3a1eb80 1 -- 172.21.15.8:0/2852851069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56293f85a310 msgr2=0x56293f865520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:37:41.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.386+0000 7f55a3a1eb80 1 --2- 172.21.15.8:0/2852851069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56293f85a310 0x56293f865520 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f55780989f0 tx=0x7f55780cdbe0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.386+0000 7f55a3a1eb80 1 -- 172.21.15.8:0/2852851069 shutdown_connections 2023-08-11T12:37:41.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.386+0000 7f55a3a1eb80 1 --2- 172.21.15.8:0/2852851069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56293f854e20 0x56293f8548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.386+0000 7f55a3a1eb80 1 --2- 172.21.15.8:0/2852851069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56293f85ac30 0x56293f8605c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.386+0000 7f55a3a1eb80 1 --2- 172.21.15.8:0/2852851069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56293f85a310 0x56293f865520 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.386+0000 7f55a3a1eb80 1 -- 172.21.15.8:0/2852851069 >> 172.21.15.8:0/2852851069 conn(0x56293f781950 msgr2=0x56293f84f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:37:41.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.386+0000 7f55a3a1eb80 1 -- 172.21.15.8:0/2852851069 shutdown_connections 2023-08-11T12:37:41.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.386+0000 7f55a3a1eb80 1 -- 172.21.15.8:0/2852851069 wait complete. 2023-08-11T12:37:41.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.387+0000 7f55a3a1eb80 1 -- start start 2023-08-11T12:37:41.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.387+0000 7f55a3a1eb80 1 Processor -- start 2023-08-11T12:37:41.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.388+0000 7f55a3a1eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56293f854e20 0x56293f8574a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:41.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.388+0000 7f55a3a1eb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56293f85a310 0x56293f855d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:41.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.388+0000 7f55a3a1eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56293f85ac30 0x56293f856250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:41.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.388+0000 7f55a3a1eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293f8567c0 con 0x56293f85ac30 2023-08-11T12:37:41.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.388+0000 7f55a3a1eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293f856930 con 0x56293f854e20 2023-08-11T12:37:41.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.388+0000 7f55a3a1eb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293f856af0 con 0x56293f85a310 2023-08-11T12:37:41.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.388+0000 7f55a3a1eb80 10 client.0 _ll_register_callbacks cb 0x7f5580009050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:37:41.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.388+0000 7f558e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56293f85ac30 0x56293f856250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:41.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.388+0000 7f558e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56293f85ac30 0x56293f856250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36550/0 (socket says 172.21.15.8:36550) 2023-08-11T12:37:41.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.388+0000 7f558dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56293f854e20 0x56293f8574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:41.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.388+0000 7f558e59c700 1 -- 172.21.15.8:0/829523348 learned_addr learned my addr 172.21.15.8:0/829523348 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:37:41.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.388+0000 7f558d59a700 1 --2- 172.21.15.8:0/829523348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56293f85a310 0x56293f855d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:41.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.388+0000 7f558e59c700 1 -- 172.21.15.8:0/829523348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56293f85a310 msgr2=0x56293f855d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:37:41.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.388+0000 7f558e59c700 1 --2- 172.21.15.8:0/829523348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56293f85a310 0x56293f855d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.388+0000 7f558e59c700 1 -- 172.21.15.8:0/829523348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56293f854e20 msgr2=0x56293f8574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:37:41.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.388+0000 7f558e59c700 1 --2- 172.21.15.8:0/829523348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56293f854e20 0x56293f8574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.388+0000 7f558e59c700 1 -- 172.21.15.8:0/829523348 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5584009520 con 0x56293f85ac30 2023-08-11T12:37:41.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.388+0000 7f558dd9b700 1 --2- 172.21.15.8:0/829523348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56293f854e20 0x56293f8574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:37:41.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.388+0000 7f558d59a700 1 --2- 172.21.15.8:0/829523348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56293f85a310 0x56293f855d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:37:41.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.389+0000 7f558e59c700 1 --2- 172.21.15.8:0/829523348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56293f85ac30 0x56293f856250 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f55800043d0 tx=0x7f558000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997433d4521f21e0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:37:41.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.389+0000 7f55717fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:37:41.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.389+0000 7f55717fa700 1 -- 172.21.15.8:0/829523348 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5580017ce0 con 0x56293f85ac30 2023-08-11T12:37:41.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.389+0000 7f55a3a1eb80 1 -- 172.21.15.8:0/829523348 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f558401d040 con 0x56293f85ac30 2023-08-11T12:37:41.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.389+0000 7f55717fa700 1 -- 172.21.15.8:0/829523348 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 9366+0+0 (secure 0 0 0) 0x7f5580017e40 con 0x56293f85ac30 2023-08-11T12:37:41.405 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:40 smithi045 ceph-mon[130284]: pgmap v409: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:41.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:40 smithi194 ceph-mon[130905]: pgmap v409: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:41.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.389+0000 7f55717fa700 1 -- 172.21.15.8:0/829523348 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55800243f0 con 0x56293f85ac30 2023-08-11T12:37:41.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.389+0000 7f55a3a1eb80 10 client.16545 fetch_fsmap learned FSMap version 54 2023-08-11T12:37:41.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.389+0000 7f55a3a1eb80 1 -- 172.21.15.8:0/829523348 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x56293f5f9250 con 0x56293f85ac30 2023-08-11T12:37:41.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.389+0000 7f55717fa700 1 -- 172.21.15.8:0/829523348 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f558401d040 con 0x56293f85ac30 2023-08-11T12:37:41.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.390+0000 7f55717fa700 1 -- 172.21.15.8:0/829523348 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f558002d070 con 0x56293f85ac30 2023-08-11T12:37:41.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.390+0000 7f55a3a1eb80 10 client.16545 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:37:41.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.390+0000 7f55a3a1eb80 10 client.16545 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:37:41.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.390+0000 7f55a3a1eb80 20 client.16545 populate_metadata read hostname 'smithi008' 2023-08-11T12:37:41.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.390+0000 7f55a3a1eb80 1 --2- 172.21.15.8:0/829523348 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x56293f8c3150 0x56293f8c5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:37:41.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.390+0000 7f55a3a1eb80 4 client.16545 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:37:41.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.390+0000 7f55a3a1eb80 1 -- 172.21.15.8:0/829523348 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56293f79f820 con 0x56293f8c3150 2023-08-11T12:37:41.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.406+0000 7f558dd9b700 1 --2- 172.21.15.8:0/829523348 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x56293f8c3150 0x56293f8c5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:37:41.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.407+0000 7f558dd9b700 1 --2- 172.21.15.8:0/829523348 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x56293f8c3150 0x56293f8c5570 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce5d4bdde4cdec57 server_cookie=4a9d986ab68de16b in_seq=0 out_seq=0 2023-08-11T12:37:41.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.407+0000 7f55717fa700 10 client.16545 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:37:41.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.407+0000 7f55717fa700 1 -- 172.21.15.8:0/829523348 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x56293f79f820 con 0x56293f8c3150 2023-08-11T12:37:41.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.407+0000 7f55717fa700 10 client.16545 handle_command_reply: tid=0 2023-08-11T12:37:41.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.407+0000 7f55a3a1eb80 1 client.16545 shutdown 2023-08-11T12:37:41.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.407+0000 7f55a3a1eb80 1 -- 172.21.15.8:0/829523348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56293f85ac30 msgr2=0x56293f856250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:37:41.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.407+0000 7f55a3a1eb80 1 --2- 172.21.15.8:0/829523348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56293f85ac30 0x56293f856250 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f55800043d0 tx=0x7f558000b040 comp rx=0 tx=0).stop 2023-08-11T12:37:41.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.407+0000 7f55a3a1eb80 1 -- 172.21.15.8:0/829523348 shutdown_connections 2023-08-11T12:37:41.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.407+0000 7f55a3a1eb80 1 --2- 172.21.15.8:0/829523348 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x56293f8c3150 0x56293f8c5570 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.407+0000 7f55a3a1eb80 1 --2- 172.21.15.8:0/829523348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56293f85ac30 0x56293f856250 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.407+0000 7f55a3a1eb80 1 --2- 172.21.15.8:0/829523348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56293f854e20 0x56293f8574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.407+0000 7f55a3a1eb80 1 --2- 172.21.15.8:0/829523348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56293f85a310 0x56293f855d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.407+0000 7f55a3a1eb80 1 -- 172.21.15.8:0/829523348 >> 172.21.15.8:0/829523348 conn(0x56293f781950 msgr2=0x56293f85d620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:37:41.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.407+0000 7f55717fa700 0 client.16545 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:37:41.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.407+0000 7f55a3a1eb80 1 -- 172.21.15.8:0/829523348 shutdown_connections 2023-08-11T12:37:41.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.407+0000 7f55a3a1eb80 1 -- 172.21.15.8:0/829523348 wait complete. 2023-08-11T12:37:41.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.408+0000 7f55a3a1eb80 20 client.16545 trim_cache size 0 max 16384 2023-08-11T12:37:41.415 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:37:41.416 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:37:41.416 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:37:41.416 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:37:41.416 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:37:41.416 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:37:41.417 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:37:41.417 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:37:41.417 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:37:41.417 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:37:41.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.408+0000 7f558ffff700 1 -- 172.21.15.8:0/4204901645 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f55740a00c0 msgr2=0x7f55740a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:37:41.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.408+0000 7f558ffff700 1 --2- 172.21.15.8:0/4204901645 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f55740a00c0 0x7f55740a2580 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5580003ba0 tx=0x7f5580004ad0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.408+0000 7f558ffff700 1 -- 172.21.15.8:0/4204901645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5588073670 msgr2=0x7f558819f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:37:41.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.408+0000 7f558ffff700 1 --2- 172.21.15.8:0/4204901645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5588073670 0x7f558819f020 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f557800e9f0 tx=0x7f557800ed00 comp rx=0 tx=0).stop 2023-08-11T12:37:41.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.408+0000 7f558ffff700 1 -- 172.21.15.8:0/4204901645 shutdown_connections 2023-08-11T12:37:41.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.408+0000 7f558ffff700 1 --2- 172.21.15.8:0/4204901645 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f55740a00c0 0x7f55740a2580 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.408+0000 7f558ffff700 1 --2- 172.21.15.8:0/4204901645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f558810d1a0 0x7f5588198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.408+0000 7f558ffff700 1 --2- 172.21.15.8:0/4204901645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5588072d50 0x7f558819eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.408+0000 7f558ffff700 1 --2- 172.21.15.8:0/4204901645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5588073670 0x7f558819f020 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:37:41.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.408+0000 7f558ffff700 1 -- 172.21.15.8:0/4204901645 >> 172.21.15.8:0/4204901645 conn(0x7f55880fc490 msgr2=0x7f558810f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:37:41.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.408+0000 7f558ffff700 1 -- 172.21.15.8:0/4204901645 shutdown_connections 2023-08-11T12:37:41.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:37:41.409+0000 7f558ffff700 1 -- 172.21.15.8:0/4204901645 wait complete. 2023-08-11T12:37:41.427 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:37:42.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:42 smithi194 ceph-mon[130905]: pgmap v410: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:37:42.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:42 smithi045 ceph-mon[130284]: pgmap v410: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:37:42.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:42 smithi008 ceph-mon[97158]: pgmap v410: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:37:44.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:44 smithi194 ceph-mon[130905]: pgmap v411: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:44.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:44 smithi045 ceph-mon[130284]: pgmap v411: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:44.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:44 smithi008 ceph-mon[97158]: pgmap v411: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:46.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:46 smithi194 ceph-mon[130905]: pgmap v412: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:46.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:46 smithi045 ceph-mon[130284]: pgmap v412: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:46.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:46 smithi008 ceph-mon[97158]: pgmap v412: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:48.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:48 smithi194 ceph-mon[130905]: pgmap v413: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:37:48.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:48 smithi045 ceph-mon[130284]: pgmap v413: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:37:48.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:48 smithi008 ceph-mon[97158]: pgmap v413: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:37:51.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:50 smithi008 ceph-mon[97158]: pgmap v414: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:51.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:50 smithi194 ceph-mon[130905]: pgmap v414: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:51.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:50 smithi045 ceph-mon[130284]: pgmap v414: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:52.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:52 smithi194 ceph-mon[130905]: pgmap v415: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:37:52.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:52 smithi045 ceph-mon[130284]: pgmap v415: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:37:52.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:52 smithi008 ceph-mon[97158]: pgmap v415: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:37:54.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:54 smithi194 ceph-mon[130905]: pgmap v416: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:54.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:54 smithi045 ceph-mon[130284]: pgmap v416: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:54.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:54 smithi008 ceph-mon[97158]: pgmap v416: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:56.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:56 smithi194 ceph-mon[130905]: pgmap v417: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:56.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:56 smithi045 ceph-mon[130284]: pgmap v417: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:56.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:56 smithi008 ceph-mon[97158]: pgmap v417: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:37:58.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:37:58 smithi194 ceph-mon[130905]: pgmap v418: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:37:58.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:37:58 smithi045 ceph-mon[130284]: pgmap v418: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:37:58.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:37:58 smithi008 ceph-mon[97158]: pgmap v418: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:38:01.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:00 smithi008 ceph-mon[97158]: pgmap v419: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:01.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:00 smithi194 ceph-mon[130905]: pgmap v419: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:01.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:00 smithi045 ceph-mon[130284]: pgmap v419: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:02.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:02 smithi194 ceph-mon[130905]: pgmap v420: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-11T12:38:02.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:02 smithi045 ceph-mon[130284]: pgmap v420: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-11T12:38:02.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:02 smithi008 ceph-mon[97158]: pgmap v420: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-11T12:38:03.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:03 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:38:03.892 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:03 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:38:03.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:03 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:38:04.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:04 smithi008 ceph-mon[97158]: pgmap v421: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:38:04.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:04 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:38:04.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:04 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:38:04.804 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:04 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:38:04.892 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:04 smithi194 ceph-mon[130905]: pgmap v421: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:38:04.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:04 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:38:04.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:04 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:38:04.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:04 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:38:04.894 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:04 smithi045 ceph-mon[130284]: pgmap v421: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:38:04.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:04 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:38:04.895 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:04 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:38:04.896 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:04 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:38:06.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:06 smithi194 ceph-mon[130905]: pgmap v422: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:38:06.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:06 smithi045 ceph-mon[130284]: pgmap v422: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:38:06.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:06 smithi008 ceph-mon[97158]: pgmap v422: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:38:09.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:08 smithi008 ceph-mon[97158]: osdmap e105: 12 total, 12 up, 12 in 2023-08-11T12:38:09.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:08 smithi008 ceph-mon[97158]: pgmap v424: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:38:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:08 smithi194 ceph-mon[130905]: osdmap e105: 12 total, 12 up, 12 in 2023-08-11T12:38:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:08 smithi194 ceph-mon[130905]: pgmap v424: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:38:09.144 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:08 smithi045 ceph-mon[130284]: osdmap e105: 12 total, 12 up, 12 in 2023-08-11T12:38:09.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:08 smithi045 ceph-mon[130284]: pgmap v424: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:38:11.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:10 smithi008 ceph-mon[97158]: pgmap v425: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:38:11.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:10 smithi194 ceph-mon[130905]: pgmap v425: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:38:11.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:10 smithi045 ceph-mon[130284]: pgmap v425: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:38:11.428 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:38:11.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.647+0000 7fcf861ff700 1 -- 172.21.15.8:0/2972600939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf8010d1a0 msgr2=0x7fcf8010f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:38:11.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.647+0000 7fcf861ff700 1 --2- 172.21.15.8:0/2972600939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf8010d1a0 0x7fcf8010f610 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcf7800b0a0 tx=0x7fcf7800b3b0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.647+0000 7fcf861ff700 1 -- 172.21.15.8:0/2972600939 shutdown_connections 2023-08-11T12:38:11.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.647+0000 7fcf861ff700 1 --2- 172.21.15.8:0/2972600939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf8010d1a0 0x7fcf8010f610 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.647+0000 7fcf861ff700 1 --2- 172.21.15.8:0/2972600939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf80072d50 0x7fcf80073130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.647+0000 7fcf861ff700 1 --2- 172.21.15.8:0/2972600939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf80073670 0x7fcf8010cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.647+0000 7fcf861ff700 1 -- 172.21.15.8:0/2972600939 >> 172.21.15.8:0/2972600939 conn(0x7fcf800fc490 msgr2=0x7fcf800fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:38:11.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.647+0000 7fcf861ff700 1 -- 172.21.15.8:0/2972600939 shutdown_connections 2023-08-11T12:38:11.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.647+0000 7fcf861ff700 1 -- 172.21.15.8:0/2972600939 wait complete. 2023-08-11T12:38:11.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.648+0000 7fcf861ff700 1 Processor -- start 2023-08-11T12:38:11.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.648+0000 7fcf861ff700 1 -- start start 2023-08-11T12:38:11.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.648+0000 7fcf861ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf80072d50 0x7fcf80198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:11.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.648+0000 7fcf861ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf80073670 0x7fcf80199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:11.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.648+0000 7fcf861ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf8010d1a0 0x7fcf8019d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:11.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.648+0000 7fcf861ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8019dd30 con 0x7fcf80073670 2023-08-11T12:38:11.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.648+0000 7fcf861ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8019dea0 con 0x7fcf8010d1a0 2023-08-11T12:38:11.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.648+0000 7fcf861ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8019e060 con 0x7fcf80072d50 2023-08-11T12:38:11.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.649+0000 7fcf7ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf8010d1a0 0x7fcf8019d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:11.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.649+0000 7fcf7effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf80073670 0x7fcf80199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:11.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.649+0000 7fcf7ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf8010d1a0 0x7fcf8019d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:35824/0 (socket says 172.21.15.8:35824) 2023-08-11T12:38:11.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.649+0000 7fcf7ffff700 1 -- 172.21.15.8:0/2106930691 learned_addr learned my addr 172.21.15.8:0/2106930691 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:38:11.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.649+0000 7fcf7f7fe700 1 --2- 172.21.15.8:0/2106930691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf80072d50 0x7fcf80198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:11.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.649+0000 7fcf7ffff700 1 -- 172.21.15.8:0/2106930691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf80072d50 msgr2=0x7fcf80198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:38:11.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.649+0000 7fcf7ffff700 1 --2- 172.21.15.8:0/2106930691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf80072d50 0x7fcf80198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.649+0000 7fcf7ffff700 1 -- 172.21.15.8:0/2106930691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf80073670 msgr2=0x7fcf80199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:38:11.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.649+0000 7fcf7ffff700 1 --2- 172.21.15.8:0/2106930691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf80073670 0x7fcf80199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.649+0000 7fcf7ffff700 1 -- 172.21.15.8:0/2106930691 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf78009d00 con 0x7fcf8010d1a0 2023-08-11T12:38:11.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.649+0000 7fcf7ffff700 1 --2- 172.21.15.8:0/2106930691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf8010d1a0 0x7fcf8019d6f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009fd0 tx=0x7fcf7800bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:38:11.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.650+0000 7fcf7cff9700 1 -- 172.21.15.8:0/2106930691 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7800e040 con 0x7fcf8010d1a0 2023-08-11T12:38:11.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.650+0000 7fcf7cff9700 1 -- 172.21.15.8:0/2106930691 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf780094c0 con 0x7fcf8010d1a0 2023-08-11T12:38:11.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.650+0000 7fcf861ff700 1 -- 172.21.15.8:0/2106930691 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf8019e2e0 con 0x7fcf8010d1a0 2023-08-11T12:38:11.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.650+0000 7fcf7cff9700 1 -- 172.21.15.8:0/2106930691 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf780052a0 con 0x7fcf8010d1a0 2023-08-11T12:38:11.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.650+0000 7fcf861ff700 1 -- 172.21.15.8:0/2106930691 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf801a5b80 con 0x7fcf8010d1a0 2023-08-11T12:38:11.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.653+0000 7fcf7cff9700 1 -- 172.21.15.8:0/2106930691 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7fcf7801d470 con 0x7fcf8010d1a0 2023-08-11T12:38:11.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.654+0000 7fcf99a44b80 1 Processor -- start 2023-08-11T12:38:11.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.654+0000 7fcf99a44b80 1 -- start start 2023-08-11T12:38:11.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.655+0000 7fcf7cff9700 1 --2- 172.21.15.8:0/2106930691 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fcf680a0140 0x7fcf680a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:11.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.655+0000 7fcf7cff9700 1 -- 172.21.15.8:0/2106930691 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 9454+0+0 (secure 0 0 0) 0x7fcf780ccb90 con 0x7fcf8010d1a0 2023-08-11T12:38:11.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.655+0000 7fcf99a44b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556edd19310 0x5556edd196f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:11.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.655+0000 7fcf99a44b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5556edd19c30 0x5556edd138e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:11.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.655+0000 7fcf7effd700 1 --2- 172.21.15.8:0/2106930691 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fcf680a0140 0x7fcf680a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:11.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.655+0000 7fcf99a44b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556edd13e20 0x5556edd14260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:11.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.655+0000 7fcf99a44b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556edc6c630 con 0x5556edd19c30 2023-08-11T12:38:11.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.655+0000 7fcf99a44b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556edc69f50 con 0x5556edd19310 2023-08-11T12:38:11.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.655+0000 7fcf99a44b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556edc65840 con 0x5556edd13e20 2023-08-11T12:38:11.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.655+0000 7fcf7f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556edd19310 0x5556edd196f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:11.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.655+0000 7fcf7f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556edd19310 0x5556edd196f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:35838/0 (socket says 172.21.15.8:35838) 2023-08-11T12:38:11.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.655+0000 7fcf7f7fe700 1 -- 172.21.15.8:0/3780537329 learned_addr learned my addr 172.21.15.8:0/3780537329 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:38:11.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.655+0000 7fcf7effd700 1 --2- 172.21.15.8:0/3780537329 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5556edd19c30 0x5556edd138e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:11.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.655+0000 7fcf7ffff700 1 --2- 172.21.15.8:0/3780537329 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556edd13e20 0x5556edd14260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:11.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.656+0000 7fcf7f7fe700 1 -- 172.21.15.8:0/3780537329 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556edd13e20 msgr2=0x5556edd14260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:38:11.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.656+0000 7fcf7f7fe700 1 --2- 172.21.15.8:0/3780537329 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556edd13e20 0x5556edd14260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.656+0000 7fcf7f7fe700 1 -- 172.21.15.8:0/3780537329 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5556edd19c30 msgr2=0x5556edd138e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:38:11.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.656+0000 7fcf7f7fe700 1 --2- 172.21.15.8:0/3780537329 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5556edd19c30 0x5556edd138e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.656+0000 7fcf7f7fe700 1 -- 172.21.15.8:0/3780537329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556edae5630 con 0x5556edd19310 2023-08-11T12:38:11.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.656+0000 7fcf7ffff700 1 --2- 172.21.15.8:0/3780537329 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556edd13e20 0x5556edd14260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:38:11.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.656+0000 7fcf7f7fe700 1 --2- 172.21.15.8:0/3780537329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556edd19310 0x5556edd196f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcf70009d80 tx=0x7fcf70011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd6e30a424c10c8d server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:38:11.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.656+0000 7fcf7effd700 1 --2- 172.21.15.8:0/2106930691 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fcf680a0140 0x7fcf680a2600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x5556edd100a0 tx=0x7fcf74009930 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:38:11.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.656+0000 7fcf65ffb700 1 -- 172.21.15.8:0/3780537329 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf70004230 con 0x5556edd19310 2023-08-11T12:38:11.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.656+0000 7fcf65ffb700 1 -- 172.21.15.8:0/3780537329 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf70004390 con 0x5556edd19310 2023-08-11T12:38:11.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.656+0000 7fcf65ffb700 1 -- 172.21.15.8:0/3780537329 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf70019860 con 0x5556edd19310 2023-08-11T12:38:11.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.657+0000 7fcf99a44b80 1 -- 172.21.15.8:0/3780537329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556edd19310 msgr2=0x5556edd196f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:38:11.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.657+0000 7fcf99a44b80 1 --2- 172.21.15.8:0/3780537329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556edd19310 0x5556edd196f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcf70009d80 tx=0x7fcf70011720 comp rx=0 tx=0).stop 2023-08-11T12:38:11.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.657+0000 7fcf99a44b80 1 -- 172.21.15.8:0/3780537329 shutdown_connections 2023-08-11T12:38:11.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.657+0000 7fcf99a44b80 1 --2- 172.21.15.8:0/3780537329 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556edd13e20 0x5556edd14260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.657+0000 7fcf99a44b80 1 --2- 172.21.15.8:0/3780537329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556edd19310 0x5556edd196f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.657+0000 7fcf99a44b80 1 --2- 172.21.15.8:0/3780537329 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5556edd19c30 0x5556edd138e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.657+0000 7fcf99a44b80 1 -- 172.21.15.8:0/3780537329 >> 172.21.15.8:0/3780537329 conn(0x5556edc40950 msgr2=0x5556edd0e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:38:11.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.657+0000 7fcf99a44b80 1 -- 172.21.15.8:0/3780537329 shutdown_connections 2023-08-11T12:38:11.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.657+0000 7fcf99a44b80 1 -- 172.21.15.8:0/3780537329 wait complete. 2023-08-11T12:38:11.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.658+0000 7fcf99a44b80 1 -- start start 2023-08-11T12:38:11.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.658+0000 7fcf99a44b80 1 Processor -- start 2023-08-11T12:38:11.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.658+0000 7fcf99a44b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556edd13e20 0x5556edd1faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:11.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.658+0000 7fcf99a44b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5556edd19310 0x5556edd1cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:11.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.658+0000 7fcf99a44b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556edd19c30 0x5556edd1d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:11.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.658+0000 7fcf99a44b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556edc03ac0 con 0x5556edd19310 2023-08-11T12:38:11.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.658+0000 7fcf99a44b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556edc037c0 con 0x5556edd13e20 2023-08-11T12:38:11.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.658+0000 7fcf99a44b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556edae7920 con 0x5556edd19c30 2023-08-11T12:38:11.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.658+0000 7fcf99a44b80 10 client.0 _ll_register_callbacks cb 0x5556edc06ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:38:11.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.658+0000 7fcf7f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556edd13e20 0x5556edd1faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:11.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.659+0000 7fcf7f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556edd13e20 0x5556edd1faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:35842/0 (socket says 172.21.15.8:35842) 2023-08-11T12:38:11.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.659+0000 7fcf7f7fe700 1 -- 172.21.15.8:0/2658019529 learned_addr learned my addr 172.21.15.8:0/2658019529 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:38:11.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.659+0000 7fcf7effd700 1 --2- 172.21.15.8:0/2658019529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5556edd19310 0x5556edd1cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:11.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.659+0000 7fcf7ffff700 1 --2- 172.21.15.8:0/2658019529 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556edd19c30 0x5556edd1d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:11.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.659+0000 7fcf7f7fe700 1 -- 172.21.15.8:0/2658019529 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556edd19c30 msgr2=0x5556edd1d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:38:11.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.659+0000 7fcf7f7fe700 1 --2- 172.21.15.8:0/2658019529 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556edd19c30 0x5556edd1d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.659+0000 7fcf7f7fe700 1 -- 172.21.15.8:0/2658019529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5556edd19310 msgr2=0x5556edd1cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:38:11.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.659+0000 7fcf7f7fe700 1 --2- 172.21.15.8:0/2658019529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5556edd19310 0x5556edd1cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.659+0000 7fcf7f7fe700 1 -- 172.21.15.8:0/2658019529 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf700099e0 con 0x5556edd13e20 2023-08-11T12:38:11.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.659+0000 7fcf7ffff700 1 --2- 172.21.15.8:0/2658019529 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556edd19c30 0x5556edd1d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:38:11.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.659+0000 7fcf7effd700 1 --2- 172.21.15.8:0/2658019529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5556edd19310 0x5556edd1cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:38:11.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.659+0000 7fcf7f7fe700 1 --2- 172.21.15.8:0/2658019529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556edd13e20 0x5556edd1faa0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcf7001b040 tx=0x7fcf700039e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cef2c0348a89d171 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:38:11.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.659+0000 7fcf5effd700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:38:11.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.659+0000 7fcf5effd700 1 -- 172.21.15.8:0/2658019529 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf70005450 con 0x5556edd13e20 2023-08-11T12:38:11.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.660+0000 7fcf99a44b80 1 -- 172.21.15.8:0/2658019529 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5556edd06a90 con 0x5556edd13e20 2023-08-11T12:38:11.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.660+0000 7fcf5effd700 1 -- 172.21.15.8:0/2658019529 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 9454+0+0 (secure 0 0 0) 0x7fcf70004500 con 0x5556edd13e20 2023-08-11T12:38:11.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.660+0000 7fcf5effd700 1 -- 172.21.15.8:0/2658019529 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf70003da0 con 0x5556edd13e20 2023-08-11T12:38:11.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.660+0000 7fcf99a44b80 10 client.26600 fetch_fsmap learned FSMap version 54 2023-08-11T12:38:11.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.660+0000 7fcf99a44b80 1 -- 172.21.15.8:0/2658019529 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x5556eda91de0 con 0x5556edd13e20 2023-08-11T12:38:11.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.660+0000 7fcf5effd700 1 -- 172.21.15.8:0/2658019529 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5556edd06a90 con 0x5556edd13e20 2023-08-11T12:38:11.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.660+0000 7fcf5effd700 1 -- 172.21.15.8:0/2658019529 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcf70021040 con 0x5556edd13e20 2023-08-11T12:38:11.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.660+0000 7fcf99a44b80 10 client.26600 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:38:11.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.660+0000 7fcf99a44b80 10 client.26600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:38:11.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.660+0000 7fcf99a44b80 20 client.26600 populate_metadata read hostname 'smithi008' 2023-08-11T12:38:11.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.660+0000 7fcf99a44b80 1 --2- 172.21.15.8:0/2658019529 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5556edd2d420 0x5556edd2f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:11.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.660+0000 7fcf99a44b80 4 client.26600 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:38:11.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.660+0000 7fcf99a44b80 1 -- 172.21.15.8:0/2658019529 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5556edce24e0 con 0x5556edd2d420 2023-08-11T12:38:11.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.661+0000 7fcf7effd700 1 --2- 172.21.15.8:0/2658019529 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5556edd2d420 0x5556edd2f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:11.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.661+0000 7fcf7effd700 1 --2- 172.21.15.8:0/2658019529 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5556edd2d420 0x5556edd2f840 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a874ae0c66cd2d8 server_cookie=ffefde54ba1f9c3c in_seq=0 out_seq=0 2023-08-11T12:38:11.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.661+0000 7fcf5effd700 10 client.26600 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:38:11.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.662+0000 7fcf5effd700 1 -- 172.21.15.8:0/2658019529 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5556edce24e0 con 0x5556edd2d420 2023-08-11T12:38:11.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.662+0000 7fcf5effd700 10 client.26600 handle_command_reply: tid=0 2023-08-11T12:38:11.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.662+0000 7fcf99a44b80 1 client.26600 shutdown 2023-08-11T12:38:11.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.663+0000 7fcf99a44b80 1 -- 172.21.15.8:0/2658019529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556edd13e20 msgr2=0x5556edd1faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:38:11.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.663+0000 7fcf99a44b80 1 --2- 172.21.15.8:0/2658019529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556edd13e20 0x5556edd1faa0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcf7001b040 tx=0x7fcf700039e0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.663+0000 7fcf99a44b80 1 -- 172.21.15.8:0/2658019529 shutdown_connections 2023-08-11T12:38:11.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.663+0000 7fcf99a44b80 1 --2- 172.21.15.8:0/2658019529 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5556edd2d420 0x5556edd2f840 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.663+0000 7fcf99a44b80 1 --2- 172.21.15.8:0/2658019529 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556edd19c30 0x5556edd1d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.663+0000 7fcf5effd700 0 client.26600 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:38:11.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.663+0000 7fcf99a44b80 1 --2- 172.21.15.8:0/2658019529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556edd13e20 0x5556edd1faa0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.663+0000 7fcf99a44b80 1 --2- 172.21.15.8:0/2658019529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5556edd19310 0x5556edd1cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.663+0000 7fcf99a44b80 1 -- 172.21.15.8:0/2658019529 >> 172.21.15.8:0/2658019529 conn(0x5556edc40950 msgr2=0x5556edd08cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:38:11.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.663+0000 7fcf99a44b80 1 -- 172.21.15.8:0/2658019529 shutdown_connections 2023-08-11T12:38:11.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.663+0000 7fcf99a44b80 1 -- 172.21.15.8:0/2658019529 wait complete. 2023-08-11T12:38:11.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.663+0000 7fcf99a44b80 20 client.26600 trim_cache size 0 max 16384 2023-08-11T12:38:11.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.680+0000 7fcf99a44b80 1 Processor -- start 2023-08-11T12:38:11.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.680+0000 7fcf99a44b80 1 -- start start 2023-08-11T12:38:11.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.680+0000 7fcf99a44b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556edd13e20 0x5556edd24580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:11.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.680+0000 7fcf99a44b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556edd19310 0x5556edd1f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:11.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.681+0000 7fcf99a44b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5556edd19c30 0x5556edd1c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:11.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.681+0000 7fcf99a44b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556edce24e0 con 0x5556edd19c30 2023-08-11T12:38:11.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.681+0000 7fcf99a44b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556edd294d0 con 0x5556edd13e20 2023-08-11T12:38:11.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.681+0000 7fcf99a44b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556edd1d9a0 con 0x5556edd19310 2023-08-11T12:38:11.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.681+0000 7fcf7f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556edd13e20 0x5556edd24580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:11.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.681+0000 7fcf7f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556edd13e20 0x5556edd24580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:35852/0 (socket says 172.21.15.8:35852) 2023-08-11T12:38:11.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.681+0000 7fcf7f7fe700 1 -- 172.21.15.8:0/69279876 learned_addr learned my addr 172.21.15.8:0/69279876 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:38:11.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.681+0000 7fcf7ffff700 1 --2- 172.21.15.8:0/69279876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5556edd19c30 0x5556edd1c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:11.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.681+0000 7fcf7effd700 1 --2- 172.21.15.8:0/69279876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556edd19310 0x5556edd1f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:11.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.681+0000 7fcf7f7fe700 1 -- 172.21.15.8:0/69279876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556edd19310 msgr2=0x5556edd1f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:38:11.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.681+0000 7fcf7f7fe700 1 --2- 172.21.15.8:0/69279876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556edd19310 0x5556edd1f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.681+0000 7fcf7f7fe700 1 -- 172.21.15.8:0/69279876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5556edd19c30 msgr2=0x5556edd1c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:38:11.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.681+0000 7fcf7f7fe700 1 --2- 172.21.15.8:0/69279876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5556edd19c30 0x5556edd1c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.681+0000 7fcf7f7fe700 1 -- 172.21.15.8:0/69279876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556eda7ac60 con 0x5556edd13e20 2023-08-11T12:38:11.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.681+0000 7fcf7f7fe700 1 --2- 172.21.15.8:0/69279876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556edd13e20 0x5556edd24580 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcf70019560 tx=0x7fcf70009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee89a620e3d0af5b server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:38:11.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.682+0000 7fcf667fc700 1 -- 172.21.15.8:0/69279876 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf70003b00 con 0x5556edd13e20 2023-08-11T12:38:11.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.682+0000 7fcf667fc700 1 -- 172.21.15.8:0/69279876 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf70005c20 con 0x5556edd13e20 2023-08-11T12:38:11.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.682+0000 7fcf667fc700 1 -- 172.21.15.8:0/69279876 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf70004500 con 0x5556edd13e20 2023-08-11T12:38:11.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.682+0000 7fcf99a44b80 1 -- 172.21.15.8:0/69279876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556edd13e20 msgr2=0x5556edd24580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:38:11.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.682+0000 7fcf99a44b80 1 --2- 172.21.15.8:0/69279876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556edd13e20 0x5556edd24580 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcf70019560 tx=0x7fcf70009ed0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.682+0000 7fcf99a44b80 1 -- 172.21.15.8:0/69279876 shutdown_connections 2023-08-11T12:38:11.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.682+0000 7fcf99a44b80 1 --2- 172.21.15.8:0/69279876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5556edd19c30 0x5556edd1c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.682+0000 7fcf99a44b80 1 --2- 172.21.15.8:0/69279876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556edd13e20 0x5556edd24580 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.682+0000 7fcf99a44b80 1 --2- 172.21.15.8:0/69279876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556edd19310 0x5556edd1f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.682+0000 7fcf99a44b80 1 -- 172.21.15.8:0/69279876 >> 172.21.15.8:0/69279876 conn(0x5556edc40950 msgr2=0x5556edd29760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:38:11.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.682+0000 7fcf99a44b80 1 -- 172.21.15.8:0/69279876 shutdown_connections 2023-08-11T12:38:11.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.682+0000 7fcf99a44b80 1 -- 172.21.15.8:0/69279876 wait complete. 2023-08-11T12:38:11.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.683+0000 7fcf99a44b80 1 -- start start 2023-08-11T12:38:11.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.683+0000 7fcf99a44b80 1 Processor -- start 2023-08-11T12:38:11.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.683+0000 7fcf99a44b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5556edd13e20 0x5556edd16300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:11.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.683+0000 7fcf99a44b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556edd19310 0x5556edd14d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:11.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.683+0000 7fcf99a44b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556edd19c30 0x5556edd15250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:11.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.684+0000 7fcf99a44b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556edd16a10 con 0x5556edd13e20 2023-08-11T12:38:11.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.684+0000 7fcf99a44b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556edd16b80 con 0x5556edd19310 2023-08-11T12:38:11.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.684+0000 7fcf99a44b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556edd15810 con 0x5556edd19c30 2023-08-11T12:38:11.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.684+0000 7fcf99a44b80 10 client.0 _ll_register_callbacks cb 0x7fcf70009c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:38:11.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.684+0000 7fcf7f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5556edd13e20 0x5556edd16300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:11.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.684+0000 7fcf7effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556edd19310 0x5556edd14d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:11.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.684+0000 7fcf7f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5556edd13e20 0x5556edd16300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43928/0 (socket says 172.21.15.8:43928) 2023-08-11T12:38:11.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.684+0000 7fcf7f7fe700 1 -- 172.21.15.8:0/2681316599 learned_addr learned my addr 172.21.15.8:0/2681316599 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:38:11.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.684+0000 7fcf7ffff700 1 --2- 172.21.15.8:0/2681316599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556edd19c30 0x5556edd15250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:11.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.684+0000 7fcf7f7fe700 1 -- 172.21.15.8:0/2681316599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556edd19c30 msgr2=0x5556edd15250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:38:11.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.684+0000 7fcf7f7fe700 1 --2- 172.21.15.8:0/2681316599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556edd19c30 0x5556edd15250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.684+0000 7fcf7f7fe700 1 -- 172.21.15.8:0/2681316599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556edd19310 msgr2=0x5556edd14d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:38:11.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.684+0000 7fcf7f7fe700 1 --2- 172.21.15.8:0/2681316599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556edd19310 0x5556edd14d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.684+0000 7fcf7f7fe700 1 -- 172.21.15.8:0/2681316599 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5556eda91de0 con 0x5556edd13e20 2023-08-11T12:38:11.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.684+0000 7fcf7effd700 1 --2- 172.21.15.8:0/2681316599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556edd19310 0x5556edd14d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:38:11.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.684+0000 7fcf7f7fe700 1 --2- 172.21.15.8:0/2681316599 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5556edd13e20 0x5556edd16300 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fcf70011b20 tx=0x7fcf70019a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6228799495ebcf5b server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:38:11.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.684+0000 7fcf5effd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:38:11.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.685+0000 7fcf5effd700 1 -- 172.21.15.8:0/2681316599 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf70005250 con 0x5556edd13e20 2023-08-11T12:38:11.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.685+0000 7fcf99a44b80 1 -- 172.21.15.8:0/2681316599 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcf70004390 con 0x5556edd13e20 2023-08-11T12:38:11.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.685+0000 7fcf5effd700 1 -- 172.21.15.8:0/2681316599 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 9454+0+0 (secure 0 0 0) 0x7fcf70005680 con 0x5556edd13e20 2023-08-11T12:38:11.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.685+0000 7fcf5effd700 1 -- 172.21.15.8:0/2681316599 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf70019b00 con 0x5556edd13e20 2023-08-11T12:38:11.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.685+0000 7fcf99a44b80 10 client.16563 fetch_fsmap learned FSMap version 54 2023-08-11T12:38:11.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.685+0000 7fcf99a44b80 1 -- 172.21.15.8:0/2681316599 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x5556edab8250 con 0x5556edd13e20 2023-08-11T12:38:11.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.685+0000 7fcf5effd700 1 -- 172.21.15.8:0/2681316599 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf70004390 con 0x5556edd13e20 2023-08-11T12:38:11.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.685+0000 7fcf5effd700 1 -- 172.21.15.8:0/2681316599 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcf70021070 con 0x5556edd13e20 2023-08-11T12:38:11.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.685+0000 7fcf99a44b80 10 client.16563 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:38:11.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.685+0000 7fcf99a44b80 10 client.16563 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:38:11.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.685+0000 7fcf99a44b80 20 client.16563 populate_metadata read hostname 'smithi008' 2023-08-11T12:38:11.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.685+0000 7fcf99a44b80 1 --2- 172.21.15.8:0/2681316599 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5556edd81e40 0x5556edd84230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:11.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.685+0000 7fcf99a44b80 4 client.16563 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:38:11.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.685+0000 7fcf99a44b80 1 -- 172.21.15.8:0/2681316599 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5556edc5e820 con 0x5556edd81e40 2023-08-11T12:38:11.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.686+0000 7fcf7effd700 1 --2- 172.21.15.8:0/2681316599 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5556edd81e40 0x5556edd84230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:11.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.686+0000 7fcf7effd700 1 --2- 172.21.15.8:0/2681316599 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5556edd81e40 0x5556edd84230 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9929b40b1d32567a server_cookie=ffccf20051180e2b in_seq=0 out_seq=0 2023-08-11T12:38:11.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.686+0000 7fcf5effd700 10 client.16563 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:38:11.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.686+0000 7fcf5effd700 1 -- 172.21.15.8:0/2681316599 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5556edc5e820 con 0x5556edd81e40 2023-08-11T12:38:11.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.686+0000 7fcf5effd700 10 client.16563 handle_command_reply: tid=0 2023-08-11T12:38:11.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.687+0000 7fcf99a44b80 1 client.16563 shutdown 2023-08-11T12:38:11.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.687+0000 7fcf99a44b80 1 -- 172.21.15.8:0/2681316599 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5556edd13e20 msgr2=0x5556edd16300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:38:11.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.687+0000 7fcf99a44b80 1 --2- 172.21.15.8:0/2681316599 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5556edd13e20 0x5556edd16300 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fcf70011b20 tx=0x7fcf70019a40 comp rx=0 tx=0).stop 2023-08-11T12:38:11.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.687+0000 7fcf99a44b80 1 -- 172.21.15.8:0/2681316599 shutdown_connections 2023-08-11T12:38:11.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.687+0000 7fcf99a44b80 1 --2- 172.21.15.8:0/2681316599 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5556edd81e40 0x5556edd84230 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.687+0000 7fcf99a44b80 1 --2- 172.21.15.8:0/2681316599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556edd19c30 0x5556edd15250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.687+0000 7fcf5effd700 0 client.16563 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:38:11.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.687+0000 7fcf99a44b80 1 --2- 172.21.15.8:0/2681316599 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5556edd13e20 0x5556edd16300 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.687+0000 7fcf99a44b80 1 --2- 172.21.15.8:0/2681316599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556edd19310 0x5556edd14d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.687+0000 7fcf99a44b80 1 -- 172.21.15.8:0/2681316599 >> 172.21.15.8:0/2681316599 conn(0x5556edc40950 msgr2=0x5556edd08420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:38:11.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.687+0000 7fcf99a44b80 1 -- 172.21.15.8:0/2681316599 shutdown_connections 2023-08-11T12:38:11.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.687+0000 7fcf99a44b80 1 -- 172.21.15.8:0/2681316599 wait complete. 2023-08-11T12:38:11.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.687+0000 7fcf99a44b80 20 client.16563 trim_cache size 0 max 16384 2023-08-11T12:38:11.704 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:38:11.705 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:38:11.705 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:38:11.705 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:38:11.705 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:38:11.705 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:38:11.706 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:38:11.706 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:38:11.706 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:38:11.706 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:38:11.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.688+0000 7fcf861ff700 1 -- 172.21.15.8:0/2106930691 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fcf680a0140 msgr2=0x7fcf680a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:38:11.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.688+0000 7fcf861ff700 1 --2- 172.21.15.8:0/2106930691 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fcf680a0140 0x7fcf680a2600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x5556edd100a0 tx=0x7fcf74009930 comp rx=0 tx=0).stop 2023-08-11T12:38:11.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.688+0000 7fcf861ff700 1 -- 172.21.15.8:0/2106930691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf8010d1a0 msgr2=0x7fcf8019d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:38:11.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.688+0000 7fcf861ff700 1 --2- 172.21.15.8:0/2106930691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf8010d1a0 0x7fcf8019d6f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009fd0 tx=0x7fcf7800bce0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.688+0000 7fcf861ff700 1 -- 172.21.15.8:0/2106930691 shutdown_connections 2023-08-11T12:38:11.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.688+0000 7fcf861ff700 1 --2- 172.21.15.8:0/2106930691 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fcf680a0140 0x7fcf680a2600 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.688+0000 7fcf861ff700 1 --2- 172.21.15.8:0/2106930691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf80072d50 0x7fcf80198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.688+0000 7fcf861ff700 1 --2- 172.21.15.8:0/2106930691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf8010d1a0 0x7fcf8019d6f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.688+0000 7fcf861ff700 1 --2- 172.21.15.8:0/2106930691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf80073670 0x7fcf80199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:11.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.688+0000 7fcf861ff700 1 -- 172.21.15.8:0/2106930691 >> 172.21.15.8:0/2106930691 conn(0x7fcf800fc490 msgr2=0x7fcf80104c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:38:11.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.688+0000 7fcf861ff700 1 -- 172.21.15.8:0/2106930691 shutdown_connections 2023-08-11T12:38:11.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:11.688+0000 7fcf861ff700 1 -- 172.21.15.8:0/2106930691 wait complete. 2023-08-11T12:38:11.711 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:38:12.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:12 smithi194 ceph-mon[130905]: pgmap v426: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:38:12.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:12 smithi045 ceph-mon[130284]: pgmap v426: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:38:12.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:12 smithi008 ceph-mon[97158]: pgmap v426: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:38:14.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:14 smithi194 ceph-mon[130905]: pgmap v427: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:38:14.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:14 smithi045 ceph-mon[130284]: pgmap v427: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:38:14.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:14 smithi008 ceph-mon[97158]: pgmap v427: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:38:16.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:15 smithi008 ceph-mon[97158]: osdmap e106: 12 total, 12 up, 12 in 2023-08-11T12:38:16.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:15 smithi194 ceph-mon[130905]: osdmap e106: 12 total, 12 up, 12 in 2023-08-11T12:38:16.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:15 smithi045 ceph-mon[130284]: osdmap e106: 12 total, 12 up, 12 in 2023-08-11T12:38:17.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:16 smithi008 ceph-mon[97158]: pgmap v429: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 123 B/s wr, 6 op/s 2023-08-11T12:38:17.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:16 smithi194 ceph-mon[130905]: pgmap v429: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 123 B/s wr, 6 op/s 2023-08-11T12:38:17.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:16 smithi045 ceph-mon[130284]: pgmap v429: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 123 B/s wr, 6 op/s 2023-08-11T12:38:18.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:18 smithi194 ceph-mon[130905]: pgmap v430: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:38:18.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:18 smithi045 ceph-mon[130284]: pgmap v430: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:38:18.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:18 smithi008 ceph-mon[97158]: pgmap v430: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:38:21.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:20 smithi008 ceph-mon[97158]: pgmap v431: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:38:21.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:20 smithi194 ceph-mon[130905]: pgmap v431: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:38:21.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:20 smithi045 ceph-mon[130284]: pgmap v431: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:38:22.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:22 smithi194 ceph-mon[130905]: pgmap v432: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:38:22.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:22 smithi045 ceph-mon[130284]: pgmap v432: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:38:22.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:22 smithi008 ceph-mon[97158]: pgmap v432: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:38:24.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:24 smithi194 ceph-mon[130905]: pgmap v433: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:38:24.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:24 smithi045 ceph-mon[130284]: pgmap v433: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:38:24.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:24 smithi008 ceph-mon[97158]: pgmap v433: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:38:26.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:26 smithi194 ceph-mon[130905]: pgmap v434: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:38:26.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:26 smithi045 ceph-mon[130284]: pgmap v434: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:38:26.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:26 smithi008 ceph-mon[97158]: pgmap v434: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:38:28.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:28 smithi194 ceph-mon[130905]: pgmap v435: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:38:28.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:28 smithi045 ceph-mon[130284]: pgmap v435: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:38:28.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:28 smithi008 ceph-mon[97158]: pgmap v435: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:38:31.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:30 smithi008 ceph-mon[97158]: pgmap v436: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:31.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:30 smithi194 ceph-mon[130905]: pgmap v436: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:31.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:30 smithi045 ceph-mon[130284]: pgmap v436: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:32.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:32 smithi194 ceph-mon[130905]: pgmap v437: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:38:32.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:32 smithi045 ceph-mon[130284]: pgmap v437: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:38:32.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:32 smithi008 ceph-mon[97158]: pgmap v437: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:38:34.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:34 smithi194 ceph-mon[130905]: pgmap v438: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:34.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:34 smithi045 ceph-mon[130284]: pgmap v438: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:34.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:34 smithi008 ceph-mon[97158]: pgmap v438: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:36.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:36 smithi194 ceph-mon[130905]: pgmap v439: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:36.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:36 smithi045 ceph-mon[130284]: pgmap v439: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:36.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:36 smithi008 ceph-mon[97158]: pgmap v439: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:38.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:38 smithi194 ceph-mon[130905]: pgmap v440: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:38:38.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:38 smithi045 ceph-mon[130284]: pgmap v440: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:38:38.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:38 smithi008 ceph-mon[97158]: pgmap v440: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:38:41.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:40 smithi008 ceph-mon[97158]: pgmap v441: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:41.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:40 smithi194 ceph-mon[130905]: pgmap v441: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:41.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:40 smithi045 ceph-mon[130284]: pgmap v441: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:41.712 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:38:41.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.928+0000 7f8b0f5ff700 1 -- 172.21.15.8:0/2113192305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b08101320 msgr2=0x7f8b0810d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:38:41.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.928+0000 7f8b0f5ff700 1 --2- 172.21.15.8:0/2113192305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b08101320 0x7f8b0810d830 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8b0000b0a0 tx=0x7f8b0000b3b0 comp rx=0 tx=0).stop 2023-08-11T12:38:41.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.928+0000 7f8b0f5ff700 1 -- 172.21.15.8:0/2113192305 shutdown_connections 2023-08-11T12:38:41.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.928+0000 7f8b0f5ff700 1 --2- 172.21.15.8:0/2113192305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b08101320 0x7f8b0810d830 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:41.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.928+0000 7f8b0f5ff700 1 --2- 172.21.15.8:0/2113192305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b08106970 0x7f8b08106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:41.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.928+0000 7f8b0f5ff700 1 --2- 172.21.15.8:0/2113192305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b08100960 0x7f8b08100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:41.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.928+0000 7f8b0f5ff700 1 -- 172.21.15.8:0/2113192305 >> 172.21.15.8:0/2113192305 conn(0x7f8b080fc490 msgr2=0x7f8b080fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:38:41.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.928+0000 7f8b0f5ff700 1 -- 172.21.15.8:0/2113192305 shutdown_connections 2023-08-11T12:38:41.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.928+0000 7f8b0f5ff700 1 -- 172.21.15.8:0/2113192305 wait complete. 2023-08-11T12:38:41.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.929+0000 7f8b0f5ff700 1 Processor -- start 2023-08-11T12:38:41.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.929+0000 7f8b0f5ff700 1 -- start start 2023-08-11T12:38:41.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.929+0000 7f8b0f5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b08100960 0x7f8b0819ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:41.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.929+0000 7f8b0f5ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b08101320 0x7f8b0819ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:41.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.929+0000 7f8b0f5ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b08106970 0x7f8b08198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:41.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.929+0000 7f8b0f5ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b081991d0 con 0x7f8b08101320 2023-08-11T12:38:41.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.929+0000 7f8b0f5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b08199340 con 0x7f8b08100960 2023-08-11T12:38:41.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.929+0000 7f8b0f5ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b08199500 con 0x7f8b08106970 2023-08-11T12:38:41.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.930+0000 7f8b0d39b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b08100960 0x7f8b0819ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:41.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.930+0000 7f8b0cb9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b08101320 0x7f8b0819ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:41.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.930+0000 7f8b0d39b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b08100960 0x7f8b0819ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:48152/0 (socket says 172.21.15.8:48152) 2023-08-11T12:38:41.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.930+0000 7f8b0d39b700 1 -- 172.21.15.8:0/408779256 learned_addr learned my addr 172.21.15.8:0/408779256 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:38:41.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.930+0000 7f8b0db9c700 1 --2- 172.21.15.8:0/408779256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b08106970 0x7f8b08198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:41.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.930+0000 7f8b0d39b700 1 -- 172.21.15.8:0/408779256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b08106970 msgr2=0x7f8b08198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:38:41.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.930+0000 7f8b0d39b700 1 --2- 172.21.15.8:0/408779256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b08106970 0x7f8b08198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:41.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.930+0000 7f8b0d39b700 1 -- 172.21.15.8:0/408779256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b08101320 msgr2=0x7f8b0819ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:38:41.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.930+0000 7f8b0d39b700 1 --2- 172.21.15.8:0/408779256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b08101320 0x7f8b0819ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:41.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.930+0000 7f8b0d39b700 1 -- 172.21.15.8:0/408779256 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b00009d00 con 0x7f8b08100960 2023-08-11T12:38:41.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.930+0000 7f8b0db9c700 1 --2- 172.21.15.8:0/408779256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b08106970 0x7f8b08198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:38:41.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.930+0000 7f8b0cb9a700 1 --2- 172.21.15.8:0/408779256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b08101320 0x7f8b0819ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:38:41.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.930+0000 7f8b0d39b700 1 --2- 172.21.15.8:0/408779256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b08100960 0x7f8b0819ea20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400e9a0 tx=0x7f8b0400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:38:41.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.931+0000 7f8afe7fc700 1 -- 172.21.15.8:0/408779256 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b04009790 con 0x7f8b08100960 2023-08-11T12:38:41.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.931+0000 7f8b0f5ff700 1 -- 172.21.15.8:0/408779256 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b081997e0 con 0x7f8b08100960 2023-08-11T12:38:41.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.931+0000 7f8afe7fc700 1 -- 172.21.15.8:0/408779256 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b0400cbd0 con 0x7f8b08100960 2023-08-11T12:38:41.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.931+0000 7f8afe7fc700 1 -- 172.21.15.8:0/408779256 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b04018680 con 0x7f8b08100960 2023-08-11T12:38:41.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.931+0000 7f8b0f5ff700 1 -- 172.21.15.8:0/408779256 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b081a59f0 con 0x7f8b08100960 2023-08-11T12:38:41.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.934+0000 7f8afe7fc700 1 -- 172.21.15.8:0/408779256 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f8b0400cd40 con 0x7f8b08100960 2023-08-11T12:38:41.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.935+0000 7f8b22f2fb80 1 Processor -- start 2023-08-11T12:38:41.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.935+0000 7f8b22f2fb80 1 -- start start 2023-08-11T12:38:41.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.936+0000 7f8b22f2fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565186c70310 0x565186c706f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:41.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.936+0000 7f8afe7fc700 1 --2- 172.21.15.8:0/408779256 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f8af40a00c0 0x7f8af40a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:41.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.936+0000 7f8b22f2fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565186c70c30 0x565186c6a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:41.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.936+0000 7f8b22f2fb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565186c6ae20 0x565186c6b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:41.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.936+0000 7f8b22f2fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x565186bc3630 con 0x565186c70310 2023-08-11T12:38:41.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.936+0000 7f8b22f2fb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x565186bc0f50 con 0x565186c6ae20 2023-08-11T12:38:41.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.936+0000 7f8b22f2fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x565186bbc840 con 0x565186c70c30 2023-08-11T12:38:41.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.936+0000 7f8afe7fc700 1 -- 172.21.15.8:0/408779256 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 9366+0+0 (secure 0 0 0) 0x7f8b04014070 con 0x7f8b08100960 2023-08-11T12:38:41.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.936+0000 7f8b0cb9a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565186c70c30 0x565186c6a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:41.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.936+0000 7f8b0db9c700 1 --2- 172.21.15.8:0/408779256 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f8af40a00c0 0x7f8af40a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:41.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.936+0000 7f8b0d39b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565186c70310 0x565186c706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:41.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.936+0000 7f8b0cb9a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565186c70c30 0x565186c6a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:47574/0 (socket says 172.21.15.8:47574) 2023-08-11T12:38:41.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.936+0000 7f8b0cb9a700 1 -- 172.21.15.8:0/1441664209 learned_addr learned my addr 172.21.15.8:0/1441664209 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:38:41.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.936+0000 7f8b0db9c700 1 --2- 172.21.15.8:0/1441664209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565186c6ae20 0x565186c6b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:41.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.936+0000 7f8b0d39b700 1 -- 172.21.15.8:0/1441664209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565186c70c30 msgr2=0x565186c6a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:38:41.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.936+0000 7f8b0d39b700 1 --2- 172.21.15.8:0/1441664209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565186c70c30 0x565186c6a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:41.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.936+0000 7f8b0d39b700 1 -- 172.21.15.8:0/1441664209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565186c6ae20 msgr2=0x565186c6b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:38:41.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.936+0000 7f8b0d39b700 1 --2- 172.21.15.8:0/1441664209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565186c6ae20 0x565186c6b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:41.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.936+0000 7f8b0d39b700 1 -- 172.21.15.8:0/1441664209 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565186a3c630 con 0x565186c70310 2023-08-11T12:38:41.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.937+0000 7f8b0d39b700 1 --2- 172.21.15.8:0/1441664209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565186c70310 0x565186c706f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8b040c8f60 tx=0x7f8b04098880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d152bedbd9ae2e0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:38:41.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.937+0000 7f8b0db9c700 1 --2- 172.21.15.8:0/408779256 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f8af40a00c0 0x7f8af40a2580 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8b000062a0 tx=0x7f8b00006210 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:38:41.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.937+0000 7f8af37fe700 1 -- 172.21.15.8:0/1441664209 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b04097580 con 0x565186c70310 2023-08-11T12:38:41.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.937+0000 7f8af37fe700 1 -- 172.21.15.8:0/1441664209 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b04097100 con 0x565186c70310 2023-08-11T12:38:41.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.937+0000 7f8af37fe700 1 -- 172.21.15.8:0/1441664209 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b04098f90 con 0x565186c70310 2023-08-11T12:38:41.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.937+0000 7f8b22f2fb80 1 -- 172.21.15.8:0/1441664209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565186c70310 msgr2=0x565186c706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:38:41.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.937+0000 7f8b22f2fb80 1 --2- 172.21.15.8:0/1441664209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565186c70310 0x565186c706f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8b040c8f60 tx=0x7f8b04098880 comp rx=0 tx=0).stop 2023-08-11T12:38:41.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.938+0000 7f8b22f2fb80 1 -- 172.21.15.8:0/1441664209 shutdown_connections 2023-08-11T12:38:41.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.938+0000 7f8b22f2fb80 1 --2- 172.21.15.8:0/1441664209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565186c6ae20 0x565186c6b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:41.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.938+0000 7f8b22f2fb80 1 --2- 172.21.15.8:0/1441664209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565186c70310 0x565186c706f0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:41.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.938+0000 7f8b22f2fb80 1 --2- 172.21.15.8:0/1441664209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565186c70c30 0x565186c6a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:41.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.938+0000 7f8b22f2fb80 1 -- 172.21.15.8:0/1441664209 >> 172.21.15.8:0/1441664209 conn(0x565186b97950 msgr2=0x565186c653d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:38:41.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.938+0000 7f8b22f2fb80 1 -- 172.21.15.8:0/1441664209 shutdown_connections 2023-08-11T12:38:41.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.938+0000 7f8b22f2fb80 1 -- 172.21.15.8:0/1441664209 wait complete. 2023-08-11T12:38:41.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.938+0000 7f8b22f2fb80 1 -- start start 2023-08-11T12:38:41.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.938+0000 7f8b22f2fb80 1 Processor -- start 2023-08-11T12:38:41.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.939+0000 7f8b22f2fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565186c6ae20 0x565186c76c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:41.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.939+0000 7f8b22f2fb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565186c70310 0x565186c73eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:41.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.939+0000 7f8b22f2fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565186c70c30 0x565186c745f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:41.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.939+0000 7f8b22f2fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x565186b5aac0 con 0x565186c6ae20 2023-08-11T12:38:41.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.939+0000 7f8b22f2fb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x565186b5a7c0 con 0x565186c70310 2023-08-11T12:38:41.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.939+0000 7f8b22f2fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x565186a3e920 con 0x565186c70c30 2023-08-11T12:38:41.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.939+0000 7f8b22f2fb80 10 client.0 _ll_register_callbacks cb 0x565186b5dab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:38:41.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.939+0000 7f8b0cb9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565186c70310 0x565186c73eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:41.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.939+0000 7f8b0d39b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565186c6ae20 0x565186c76c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:41.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.939+0000 7f8b0cb9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565186c70310 0x565186c73eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:48158/0 (socket says 172.21.15.8:48158) 2023-08-11T12:38:41.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.939+0000 7f8b0cb9a700 1 -- 172.21.15.8:0/822244438 learned_addr learned my addr 172.21.15.8:0/822244438 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:38:41.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.939+0000 7f8b0db9c700 1 --2- 172.21.15.8:0/822244438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565186c70c30 0x565186c745f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:41.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.940+0000 7f8b0d39b700 1 -- 172.21.15.8:0/822244438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565186c70c30 msgr2=0x565186c745f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:38:41.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.940+0000 7f8b0d39b700 1 --2- 172.21.15.8:0/822244438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565186c70c30 0x565186c745f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:41.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.940+0000 7f8b0d39b700 1 -- 172.21.15.8:0/822244438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565186c70310 msgr2=0x565186c73eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:38:41.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.940+0000 7f8b0d39b700 1 --2- 172.21.15.8:0/822244438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565186c70310 0x565186c73eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:41.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.940+0000 7f8b0d39b700 1 -- 172.21.15.8:0/822244438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b081a59f0 con 0x565186c6ae20 2023-08-11T12:38:41.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.940+0000 7f8b0cb9a700 1 --2- 172.21.15.8:0/822244438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565186c70310 0x565186c73eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:38:41.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.940+0000 7f8b0d39b700 1 --2- 172.21.15.8:0/822244438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565186c6ae20 0x565186c76c00 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8b04097270 tx=0x7f8b04094c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66dd0ca0d9600a3 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:38:41.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.940+0000 7f8af0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:38:41.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.940+0000 7f8af0ff9700 1 -- 172.21.15.8:0/822244438 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0409cd50 con 0x565186c6ae20 2023-08-11T12:38:41.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.940+0000 7f8b22f2fb80 1 -- 172.21.15.8:0/822244438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565186c5da90 con 0x565186c6ae20 2023-08-11T12:38:41.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.940+0000 7f8af0ff9700 1 -- 172.21.15.8:0/822244438 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 9366+0+0 (secure 0 0 0) 0x7f8b040a0ae0 con 0x565186c6ae20 2023-08-11T12:38:41.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.940+0000 7f8af0ff9700 1 -- 172.21.15.8:0/822244438 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b040a0d30 con 0x565186c6ae20 2023-08-11T12:38:41.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.940+0000 7f8b22f2fb80 10 client.16575 fetch_fsmap learned FSMap version 54 2023-08-11T12:38:41.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.940+0000 7f8b22f2fb80 1 -- 172.21.15.8:0/822244438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x5651869e8de0 con 0x565186c6ae20 2023-08-11T12:38:41.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.941+0000 7f8af0ff9700 1 -- 172.21.15.8:0/822244438 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x565186c5da90 con 0x565186c6ae20 2023-08-11T12:38:41.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.941+0000 7f8af0ff9700 1 -- 172.21.15.8:0/822244438 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8b04096610 con 0x565186c6ae20 2023-08-11T12:38:41.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.941+0000 7f8b22f2fb80 10 client.16575 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:38:41.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.941+0000 7f8b22f2fb80 10 client.16575 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:38:41.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.941+0000 7f8b22f2fb80 20 client.16575 populate_metadata read hostname 'smithi008' 2023-08-11T12:38:41.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.941+0000 7f8b22f2fb80 1 --2- 172.21.15.8:0/822244438 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x565186c84300 0x565186c86720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:41.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.941+0000 7f8b22f2fb80 4 client.16575 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:38:41.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.941+0000 7f8b22f2fb80 1 -- 172.21.15.8:0/822244438 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565186c394e0 con 0x565186c84300 2023-08-11T12:38:41.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.941+0000 7f8b0cb9a700 1 --2- 172.21.15.8:0/822244438 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x565186c84300 0x565186c86720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:41.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.942+0000 7f8af0ff9700 10 client.16575 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:38:41.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.942+0000 7f8b0cb9a700 1 --2- 172.21.15.8:0/822244438 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x565186c84300 0x565186c86720 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48ee74839a8e49eb server_cookie=4ae7f50859718164 in_seq=0 out_seq=0 2023-08-11T12:38:41.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.943+0000 7f8af0ff9700 1 -- 172.21.15.8:0/822244438 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x565186c394e0 con 0x565186c84300 2023-08-11T12:38:41.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.943+0000 7f8af0ff9700 10 client.16575 handle_command_reply: tid=0 2023-08-11T12:38:41.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.943+0000 7f8b22f2fb80 1 client.16575 shutdown 2023-08-11T12:38:41.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.943+0000 7f8b22f2fb80 1 -- 172.21.15.8:0/822244438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565186c6ae20 msgr2=0x565186c76c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:38:41.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.943+0000 7f8b22f2fb80 1 --2- 172.21.15.8:0/822244438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565186c6ae20 0x565186c76c00 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8b04097270 tx=0x7f8b04094c50 comp rx=0 tx=0).stop 2023-08-11T12:38:41.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.943+0000 7f8b22f2fb80 1 -- 172.21.15.8:0/822244438 shutdown_connections 2023-08-11T12:38:41.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.943+0000 7f8b22f2fb80 1 --2- 172.21.15.8:0/822244438 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x565186c84300 0x565186c86720 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:41.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.943+0000 7f8b22f2fb80 1 --2- 172.21.15.8:0/822244438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565186c70c30 0x565186c745f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:41.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.943+0000 7f8b22f2fb80 1 --2- 172.21.15.8:0/822244438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565186c6ae20 0x565186c76c00 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:41.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.943+0000 7f8af0ff9700 0 client.16575 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:38:41.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.943+0000 7f8b22f2fb80 1 --2- 172.21.15.8:0/822244438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565186c70310 0x565186c73eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:41.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.943+0000 7f8b22f2fb80 1 -- 172.21.15.8:0/822244438 >> 172.21.15.8:0/822244438 conn(0x565186b97950 msgr2=0x565186c5fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:38:41.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.943+0000 7f8b22f2fb80 1 -- 172.21.15.8:0/822244438 shutdown_connections 2023-08-11T12:38:41.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.943+0000 7f8b22f2fb80 1 -- 172.21.15.8:0/822244438 wait complete. 2023-08-11T12:38:41.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.943+0000 7f8b22f2fb80 20 client.16575 trim_cache size 0 max 16384 2023-08-11T12:38:41.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.961+0000 7f8b22f2fb80 1 Processor -- start 2023-08-11T12:38:41.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.961+0000 7f8b22f2fb80 1 -- start start 2023-08-11T12:38:41.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.961+0000 7f8b22f2fb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565186c6ae20 0x565186c6a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:41.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.961+0000 7f8b22f2fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565186c70310 0x565186c7b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:41.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.961+0000 7f8b22f2fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565186c70c30 0x565186c766c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:41.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.961+0000 7f8b22f2fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x565186c394e0 con 0x565186c70310 2023-08-11T12:38:41.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.961+0000 7f8b22f2fb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x565186c5da90 con 0x565186c6ae20 2023-08-11T12:38:41.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.961+0000 7f8b22f2fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x565186c65960 con 0x565186c70c30 2023-08-11T12:38:41.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.961+0000 7f8b0d39b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565186c6ae20 0x565186c6a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:41.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.961+0000 7f8b0cb9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565186c70310 0x565186c7b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:41.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.961+0000 7f8b0d39b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565186c6ae20 0x565186c6a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:48168/0 (socket says 172.21.15.8:48168) 2023-08-11T12:38:41.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.961+0000 7f8b0d39b700 1 -- 172.21.15.8:0/2022952796 learned_addr learned my addr 172.21.15.8:0/2022952796 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:38:41.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.961+0000 7f8b0db9c700 1 --2- 172.21.15.8:0/2022952796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565186c70c30 0x565186c766c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:41.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.961+0000 7f8b0d39b700 1 -- 172.21.15.8:0/2022952796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565186c70c30 msgr2=0x565186c766c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:38:41.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.961+0000 7f8b0d39b700 1 --2- 172.21.15.8:0/2022952796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565186c70c30 0x565186c766c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:41.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.961+0000 7f8b0d39b700 1 -- 172.21.15.8:0/2022952796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565186c70310 msgr2=0x565186c7b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:38:41.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.962+0000 7f8b0d39b700 1 --2- 172.21.15.8:0/2022952796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565186c70310 0x565186c7b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:41.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.962+0000 7f8b0d39b700 1 -- 172.21.15.8:0/2022952796 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651869d1c60 con 0x565186c6ae20 2023-08-11T12:38:41.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.962+0000 7f8b0cb9a700 1 --2- 172.21.15.8:0/2022952796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565186c70310 0x565186c7b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:38:41.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.962+0000 7f8b0d39b700 1 --2- 172.21.15.8:0/2022952796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565186c6ae20 0x565186c6a8e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8b04098c20 tx=0x7f8b04095260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15beed027c79222e server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:38:41.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.962+0000 7f8af3fff700 1 -- 172.21.15.8:0/2022952796 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b04064070 con 0x565186c6ae20 2023-08-11T12:38:41.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.962+0000 7f8af3fff700 1 -- 172.21.15.8:0/2022952796 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b04096a80 con 0x565186c6ae20 2023-08-11T12:38:41.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.962+0000 7f8af3fff700 1 -- 172.21.15.8:0/2022952796 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0409cd50 con 0x565186c6ae20 2023-08-11T12:38:41.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.963+0000 7f8b22f2fb80 1 -- 172.21.15.8:0/2022952796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565186c6ae20 msgr2=0x565186c6a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:38:41.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.963+0000 7f8b22f2fb80 1 --2- 172.21.15.8:0/2022952796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565186c6ae20 0x565186c6a8e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8b04098c20 tx=0x7f8b04095260 comp rx=0 tx=0).stop 2023-08-11T12:38:41.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.963+0000 7f8b22f2fb80 1 -- 172.21.15.8:0/2022952796 shutdown_connections 2023-08-11T12:38:41.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.963+0000 7f8b22f2fb80 1 --2- 172.21.15.8:0/2022952796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565186c70c30 0x565186c766c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:41.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.963+0000 7f8b22f2fb80 1 --2- 172.21.15.8:0/2022952796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565186c6ae20 0x565186c6a8e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:41.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.963+0000 7f8b22f2fb80 1 --2- 172.21.15.8:0/2022952796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565186c70310 0x565186c7b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:41.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.963+0000 7f8b22f2fb80 1 -- 172.21.15.8:0/2022952796 >> 172.21.15.8:0/2022952796 conn(0x565186b97950 msgr2=0x565186c6e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:38:41.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.963+0000 7f8b22f2fb80 1 -- 172.21.15.8:0/2022952796 shutdown_connections 2023-08-11T12:38:41.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.963+0000 7f8b22f2fb80 1 -- 172.21.15.8:0/2022952796 wait complete. 2023-08-11T12:38:41.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.963+0000 7f8b22f2fb80 1 -- start start 2023-08-11T12:38:41.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.963+0000 7f8b22f2fb80 1 Processor -- start 2023-08-11T12:38:41.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.964+0000 7f8b22f2fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565186c6ae20 0x565186c6d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:41.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.964+0000 7f8b22f2fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565186c70310 0x565186c6bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:41.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.964+0000 7f8b22f2fb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565186c70c30 0x565186c6c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:41.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.964+0000 7f8b22f2fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x565186c6db10 con 0x565186c6ae20 2023-08-11T12:38:41.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.964+0000 7f8b22f2fb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x565186c6c860 con 0x565186c70c30 2023-08-11T12:38:41.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.964+0000 7f8b22f2fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x565186c6ca20 con 0x565186c70310 2023-08-11T12:38:41.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.964+0000 7f8b22f2fb80 10 client.0 _ll_register_callbacks cb 0x7f8af8009be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:38:41.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.964+0000 7f8b0d39b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565186c6ae20 0x565186c6d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:41.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.964+0000 7f8b0d39b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565186c6ae20 0x565186c6d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43730/0 (socket says 172.21.15.8:43730) 2023-08-11T12:38:41.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.964+0000 7f8b0d39b700 1 -- 172.21.15.8:0/1741121484 learned_addr learned my addr 172.21.15.8:0/1741121484 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:38:41.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.964+0000 7f8b0db9c700 1 --2- 172.21.15.8:0/1741121484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565186c70c30 0x565186c6c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:41.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.964+0000 7f8b0cb9a700 1 --2- 172.21.15.8:0/1741121484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565186c70310 0x565186c6bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:41.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.964+0000 7f8b0d39b700 1 -- 172.21.15.8:0/1741121484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565186c70310 msgr2=0x565186c6bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:38:41.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.964+0000 7f8b0d39b700 1 --2- 172.21.15.8:0/1741121484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565186c70310 0x565186c6bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:41.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.964+0000 7f8b0d39b700 1 -- 172.21.15.8:0/1741121484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565186c70c30 msgr2=0x565186c6c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:38:41.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.964+0000 7f8b0d39b700 1 --2- 172.21.15.8:0/1741121484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565186c70c30 0x565186c6c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:41.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.964+0000 7f8b0d39b700 1 -- 172.21.15.8:0/1741121484 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5651869e8de0 con 0x565186c6ae20 2023-08-11T12:38:41.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.964+0000 7f8b0cb9a700 1 --2- 172.21.15.8:0/1741121484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565186c70310 0x565186c6bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:38:41.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.965+0000 7f8b0d39b700 1 --2- 172.21.15.8:0/1741121484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565186c6ae20 0x565186c6d360 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8b04095420 tx=0x7f8b04099620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1560b39a29dc1018 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:38:41.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.965+0000 7f8af0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:38:41.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.965+0000 7f8af0ff9700 1 -- 172.21.15.8:0/1741121484 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b040c7070 con 0x565186c6ae20 2023-08-11T12:38:41.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.965+0000 7f8b22f2fb80 1 -- 172.21.15.8:0/1741121484 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565186bb5820 con 0x565186c6ae20 2023-08-11T12:38:41.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.965+0000 7f8af0ff9700 1 -- 172.21.15.8:0/1741121484 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 9366+0+0 (secure 0 0 0) 0x7f8b04098f20 con 0x565186c6ae20 2023-08-11T12:38:41.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.965+0000 7f8af0ff9700 1 -- 172.21.15.8:0/1741121484 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b04064030 con 0x565186c6ae20 2023-08-11T12:38:41.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.965+0000 7f8b22f2fb80 10 client.16581 fetch_fsmap learned FSMap version 54 2023-08-11T12:38:41.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.965+0000 7f8b22f2fb80 1 -- 172.21.15.8:0/1741121484 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x565186a0f250 con 0x565186c6ae20 2023-08-11T12:38:41.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.965+0000 7f8af0ff9700 1 -- 172.21.15.8:0/1741121484 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x565186bb5820 con 0x565186c6ae20 2023-08-11T12:38:41.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.965+0000 7f8af0ff9700 1 -- 172.21.15.8:0/1741121484 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8b040a08a0 con 0x565186c6ae20 2023-08-11T12:38:41.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.966+0000 7f8b22f2fb80 10 client.16581 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:38:41.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.966+0000 7f8b22f2fb80 10 client.16581 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:38:41.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.966+0000 7f8b22f2fb80 20 client.16581 populate_metadata read hostname 'smithi008' 2023-08-11T12:38:41.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.966+0000 7f8b22f2fb80 1 --2- 172.21.15.8:0/1741121484 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x565186cd8cd0 0x565186cdb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:38:41.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.966+0000 7f8b22f2fb80 4 client.16581 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:38:41.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.966+0000 7f8b22f2fb80 1 -- 172.21.15.8:0/1741121484 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x565186b76050 con 0x565186cd8cd0 2023-08-11T12:38:41.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.966+0000 7f8b0cb9a700 1 --2- 172.21.15.8:0/1741121484 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x565186cd8cd0 0x565186cdb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:38:41.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.966+0000 7f8af0ff9700 10 client.16581 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:38:41.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.966+0000 7f8b0cb9a700 1 --2- 172.21.15.8:0/1741121484 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x565186cd8cd0 0x565186cdb0c0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21bc4673987a1dca server_cookie=aa5cb870b1319df5 in_seq=0 out_seq=0 2023-08-11T12:38:41.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.967+0000 7f8af0ff9700 1 -- 172.21.15.8:0/1741121484 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x565186b76050 con 0x565186cd8cd0 2023-08-11T12:38:41.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.967+0000 7f8af0ff9700 10 client.16581 handle_command_reply: tid=0 2023-08-11T12:38:41.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.967+0000 7f8b22f2fb80 1 client.16581 shutdown 2023-08-11T12:38:41.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.967+0000 7f8b22f2fb80 1 -- 172.21.15.8:0/1741121484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565186c6ae20 msgr2=0x565186c6d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:38:41.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.967+0000 7f8b22f2fb80 1 --2- 172.21.15.8:0/1741121484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565186c6ae20 0x565186c6d360 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8b04095420 tx=0x7f8b04099620 comp rx=0 tx=0).stop 2023-08-11T12:38:41.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.967+0000 7f8b22f2fb80 1 -- 172.21.15.8:0/1741121484 shutdown_connections 2023-08-11T12:38:41.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.967+0000 7f8b22f2fb80 1 --2- 172.21.15.8:0/1741121484 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x565186cd8cd0 0x565186cdb0c0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:42.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.967+0000 7f8b22f2fb80 1 --2- 172.21.15.8:0/1741121484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565186c70c30 0x565186c6c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:42.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.967+0000 7f8b22f2fb80 1 --2- 172.21.15.8:0/1741121484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565186c6ae20 0x565186c6d360 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:42.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.967+0000 7f8af0ff9700 0 client.16581 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:38:42.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.967+0000 7f8b22f2fb80 1 --2- 172.21.15.8:0/1741121484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565186c70310 0x565186c6bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:42.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.967+0000 7f8b22f2fb80 1 -- 172.21.15.8:0/1741121484 >> 172.21.15.8:0/1741121484 conn(0x565186b97950 msgr2=0x565186c737a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:38:42.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.967+0000 7f8b22f2fb80 1 -- 172.21.15.8:0/1741121484 shutdown_connections 2023-08-11T12:38:42.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.967+0000 7f8b22f2fb80 1 -- 172.21.15.8:0/1741121484 wait complete. 2023-08-11T12:38:42.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.967+0000 7f8b22f2fb80 20 client.16581 trim_cache size 0 max 16384 2023-08-11T12:38:42.002 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:38:42.002 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:38:42.003 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:38:42.003 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:38:42.003 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:38:42.003 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:38:42.004 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:38:42.004 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:38:42.004 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:38:42.004 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:38:42.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.968+0000 7f8b0f5ff700 1 -- 172.21.15.8:0/408779256 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f8af40a00c0 msgr2=0x7f8af40a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:38:42.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.968+0000 7f8b0f5ff700 1 --2- 172.21.15.8:0/408779256 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f8af40a00c0 0x7f8af40a2580 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8b000062a0 tx=0x7f8b00006210 comp rx=0 tx=0).stop 2023-08-11T12:38:42.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.968+0000 7f8b0f5ff700 1 -- 172.21.15.8:0/408779256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b08100960 msgr2=0x7f8b0819ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:38:42.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.968+0000 7f8b0f5ff700 1 --2- 172.21.15.8:0/408779256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b08100960 0x7f8b0819ea20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400e9a0 tx=0x7f8b0400ecb0 comp rx=0 tx=0).stop 2023-08-11T12:38:42.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.968+0000 7f8b0f5ff700 1 -- 172.21.15.8:0/408779256 shutdown_connections 2023-08-11T12:38:42.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.968+0000 7f8b0f5ff700 1 --2- 172.21.15.8:0/408779256 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f8af40a00c0 0x7f8af40a2580 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:42.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.968+0000 7f8b0f5ff700 1 --2- 172.21.15.8:0/408779256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b08106970 0x7f8b08198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:42.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.968+0000 7f8b0f5ff700 1 --2- 172.21.15.8:0/408779256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b08100960 0x7f8b0819ea20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:42.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.968+0000 7f8b0f5ff700 1 --2- 172.21.15.8:0/408779256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b08101320 0x7f8b0819ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:38:42.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.968+0000 7f8b0f5ff700 1 -- 172.21.15.8:0/408779256 >> 172.21.15.8:0/408779256 conn(0x7f8b080fc490 msgr2=0x7f8b0810bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:38:42.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.968+0000 7f8b0f5ff700 1 -- 172.21.15.8:0/408779256 shutdown_connections 2023-08-11T12:38:42.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:38:41.968+0000 7f8b0f5ff700 1 -- 172.21.15.8:0/408779256 wait complete. 2023-08-11T12:38:42.009 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:38:42.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:42 smithi194 ceph-mon[130905]: pgmap v442: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:38:42.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:42 smithi045 ceph-mon[130284]: pgmap v442: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:38:42.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:42 smithi008 ceph-mon[97158]: pgmap v442: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:38:44.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:44 smithi194 ceph-mon[130905]: pgmap v443: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:44.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:44 smithi045 ceph-mon[130284]: pgmap v443: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:44.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:44 smithi008 ceph-mon[97158]: pgmap v443: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:46.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:46 smithi194 ceph-mon[130905]: pgmap v444: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:46.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:46 smithi045 ceph-mon[130284]: pgmap v444: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:46.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:46 smithi008 ceph-mon[97158]: pgmap v444: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:48.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:48 smithi194 ceph-mon[130905]: pgmap v445: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:38:48.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:48 smithi045 ceph-mon[130284]: pgmap v445: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:38:48.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:48 smithi008 ceph-mon[97158]: pgmap v445: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:38:51.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:50 smithi008 ceph-mon[97158]: pgmap v446: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:51.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:50 smithi194 ceph-mon[130905]: pgmap v446: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:51.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:50 smithi045 ceph-mon[130284]: pgmap v446: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:52.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:52 smithi194 ceph-mon[130905]: pgmap v447: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:38:52.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:52 smithi045 ceph-mon[130284]: pgmap v447: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:38:52.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:52 smithi008 ceph-mon[97158]: pgmap v447: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:38:54.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:54 smithi194 ceph-mon[130905]: pgmap v448: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:54.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:54 smithi045 ceph-mon[130284]: pgmap v448: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:54.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:54 smithi008 ceph-mon[97158]: pgmap v448: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:56.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:56 smithi194 ceph-mon[130905]: pgmap v449: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:56.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:56 smithi045 ceph-mon[130284]: pgmap v449: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:56.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:56 smithi008 ceph-mon[97158]: pgmap v449: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:38:58.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:38:58 smithi194 ceph-mon[130905]: pgmap v450: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:38:58.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:38:58 smithi045 ceph-mon[130284]: pgmap v450: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:38:58.552 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:38:58 smithi008 ceph-mon[97158]: pgmap v450: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:39:01.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:00 smithi008 ceph-mon[97158]: pgmap v451: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:01.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:00 smithi194 ceph-mon[130905]: pgmap v451: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:01.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:00 smithi045 ceph-mon[130284]: pgmap v451: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:02.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:02 smithi194 ceph-mon[130905]: pgmap v452: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-11T12:39:02.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:02 smithi045 ceph-mon[130284]: pgmap v452: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-11T12:39:02.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:02 smithi008 ceph-mon[97158]: pgmap v452: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-11T12:39:04.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:04 smithi194 ceph-mon[130905]: pgmap v453: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:39:04.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:04 smithi045 ceph-mon[130284]: pgmap v453: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:39:04.552 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:04 smithi008 ceph-mon[97158]: pgmap v453: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:39:05.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:05 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:39:05.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:05 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:39:05.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:05 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:39:06.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:06 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:39:06.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:06 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:39:06.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:06 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:39:06.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:06 smithi194 ceph-mon[130905]: pgmap v454: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:39:06.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:06 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:39:06.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:06 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:39:06.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:06 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:39:06.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:06 smithi045 ceph-mon[130284]: pgmap v454: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:39:06.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:06 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:39:06.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:06 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:39:06.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:06 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:39:06.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:06 smithi008 ceph-mon[97158]: pgmap v454: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:39:09.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:08 smithi008 ceph-mon[97158]: osdmap e107: 12 total, 12 up, 12 in 2023-08-11T12:39:09.053 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:08 smithi008 ceph-mon[97158]: pgmap v456: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:39:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:08 smithi194 ceph-mon[130905]: osdmap e107: 12 total, 12 up, 12 in 2023-08-11T12:39:09.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:08 smithi194 ceph-mon[130905]: pgmap v456: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:39:09.144 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:08 smithi045 ceph-mon[130284]: osdmap e107: 12 total, 12 up, 12 in 2023-08-11T12:39:09.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:08 smithi045 ceph-mon[130284]: pgmap v456: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:39:11.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:10 smithi008 ceph-mon[97158]: pgmap v457: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:39:11.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:10 smithi194 ceph-mon[130905]: pgmap v457: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:39:11.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:10 smithi045 ceph-mon[130284]: pgmap v457: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:39:12.010 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:39:12.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.254+0000 7f015cfff700 1 -- 172.21.15.8:0/3250606138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0158100960 msgr2=0x7f0158100de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:39:12.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.254+0000 7f015cfff700 1 --2- 172.21.15.8:0/3250606138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0158100960 0x7f0158100de0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f014c009990 tx=0x7f014c009ca0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.254+0000 7f015cfff700 1 -- 172.21.15.8:0/3250606138 shutdown_connections 2023-08-11T12:39:12.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.254+0000 7f015cfff700 1 --2- 172.21.15.8:0/3250606138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0158106970 0x7f0158106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.254+0000 7f015cfff700 1 --2- 172.21.15.8:0/3250606138 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0158101320 0x7f015810d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.254+0000 7f015cfff700 1 --2- 172.21.15.8:0/3250606138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0158100960 0x7f0158100de0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.254+0000 7f015cfff700 1 -- 172.21.15.8:0/3250606138 >> 172.21.15.8:0/3250606138 conn(0x7f01580fc490 msgr2=0x7f01580fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:39:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.254+0000 7f015cfff700 1 -- 172.21.15.8:0/3250606138 shutdown_connections 2023-08-11T12:39:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.254+0000 7f015cfff700 1 -- 172.21.15.8:0/3250606138 wait complete. 2023-08-11T12:39:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.256+0000 7f015cfff700 1 Processor -- start 2023-08-11T12:39:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.256+0000 7f015cfff700 1 -- start start 2023-08-11T12:39:12.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.257+0000 7f015cfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0158100960 0x7f015819ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:12.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.257+0000 7f015cfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0158101320 0x7f015819efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:12.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.257+0000 7f015cfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0158106970 0x7f0158198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:12.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.257+0000 7f015cfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0158199240 con 0x7f0158106970 2023-08-11T12:39:12.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.257+0000 7f015cfff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01581993b0 con 0x7f0158100960 2023-08-11T12:39:12.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.257+0000 7f015cfff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0158199570 con 0x7f0158101320 2023-08-11T12:39:12.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.257+0000 7f015659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0158100960 0x7f015819ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:12.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.257+0000 7f015659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0158100960 0x7f015819ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:48272/0 (socket says 172.21.15.8:48272) 2023-08-11T12:39:12.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.257+0000 7f015659c700 1 -- 172.21.15.8:0/1623963134 learned_addr learned my addr 172.21.15.8:0/1623963134 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:39:12.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.257+0000 7f0156d9d700 1 --2- 172.21.15.8:0/1623963134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0158106970 0x7f0158198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:12.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.257+0000 7f0155d9b700 1 --2- 172.21.15.8:0/1623963134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0158101320 0x7f015819efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:12.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.257+0000 7f015659c700 1 -- 172.21.15.8:0/1623963134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0158101320 msgr2=0x7f015819efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:39:12.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.257+0000 7f015659c700 1 --2- 172.21.15.8:0/1623963134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0158101320 0x7f015819efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.257+0000 7f015659c700 1 -- 172.21.15.8:0/1623963134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0158106970 msgr2=0x7f0158198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:39:12.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.257+0000 7f015659c700 1 --2- 172.21.15.8:0/1623963134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0158106970 0x7f0158198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.257+0000 7f015659c700 1 -- 172.21.15.8:0/1623963134 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c0095f0 con 0x7f0158100960 2023-08-11T12:39:12.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.257+0000 7f0156d9d700 1 --2- 172.21.15.8:0/1623963134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0158106970 0x7f0158198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:39:12.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.258+0000 7f015659c700 1 --2- 172.21.15.8:0/1623963134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0158100960 0x7f015819ea90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f014800e9a0 tx=0x7f014800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:39:12.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.258+0000 7f01477fe700 1 -- 172.21.15.8:0/1623963134 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148009790 con 0x7f0158100960 2023-08-11T12:39:12.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.258+0000 7f01477fe700 1 -- 172.21.15.8:0/1623963134 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0148010430 con 0x7f0158100960 2023-08-11T12:39:12.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.258+0000 7f015cfff700 1 -- 172.21.15.8:0/1623963134 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0158199850 con 0x7f0158100960 2023-08-11T12:39:12.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.258+0000 7f01477fe700 1 -- 172.21.15.8:0/1623963134 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148018680 con 0x7f0158100960 2023-08-11T12:39:12.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.258+0000 7f015cfff700 1 -- 172.21.15.8:0/1623963134 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01581a5a10 con 0x7f0158100960 2023-08-11T12:39:12.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.261+0000 7f01477fe700 1 -- 172.21.15.8:0/1623963134 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f01480105a0 con 0x7f0158100960 2023-08-11T12:39:12.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.263+0000 7f017093cb80 1 Processor -- start 2023-08-11T12:39:12.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.263+0000 7f01477fe700 1 --2- 172.21.15.8:0/1623963134 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f01400a00c0 0x7f01400a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:12.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.263+0000 7f017093cb80 1 -- start start 2023-08-11T12:39:12.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.263+0000 7f01477fe700 1 -- 172.21.15.8:0/1623963134 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 9454+0+0 (secure 0 0 0) 0x7f0148014070 con 0x7f0158100960 2023-08-11T12:39:12.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.263+0000 7f0156d9d700 1 --2- 172.21.15.8:0/1623963134 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f01400a00c0 0x7f01400a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:12.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.263+0000 7f017093cb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a15a8c9310 0x55a15a8c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:12.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.263+0000 7f017093cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a15a8c9c30 0x55a15a8c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:12.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.263+0000 7f017093cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a15a8c3e20 0x55a15a8c4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:12.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.263+0000 7f017093cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a15a81c630 con 0x55a15a8c3e20 2023-08-11T12:39:12.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.263+0000 7f017093cb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a15a819f50 con 0x55a15a8c9310 2023-08-11T12:39:12.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.263+0000 7f017093cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a15a815840 con 0x55a15a8c9c30 2023-08-11T12:39:12.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.264+0000 7f015659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a15a8c9310 0x55a15a8c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:12.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.264+0000 7f015659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a15a8c9310 0x55a15a8c96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:48282/0 (socket says 172.21.15.8:48282) 2023-08-11T12:39:12.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.264+0000 7f015659c700 1 -- 172.21.15.8:0/1375564855 learned_addr learned my addr 172.21.15.8:0/1375564855 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:39:12.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.264+0000 7f0155d9b700 1 --2- 172.21.15.8:0/1375564855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a15a8c9c30 0x55a15a8c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:12.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.264+0000 7f0156d9d700 1 --2- 172.21.15.8:0/1375564855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a15a8c3e20 0x55a15a8c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:12.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.264+0000 7f015659c700 1 -- 172.21.15.8:0/1375564855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a15a8c9c30 msgr2=0x55a15a8c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:39:12.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.264+0000 7f015659c700 1 --2- 172.21.15.8:0/1375564855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a15a8c9c30 0x55a15a8c38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.264+0000 7f015659c700 1 -- 172.21.15.8:0/1375564855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a15a8c3e20 msgr2=0x55a15a8c4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:39:12.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.264+0000 7f015659c700 1 --2- 172.21.15.8:0/1375564855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a15a8c3e20 0x55a15a8c4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.264+0000 7f0156d9d700 1 --2- 172.21.15.8:0/1623963134 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f01400a00c0 0x7f01400a2580 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f015819f720 tx=0x7f015000b040 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:39:12.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.264+0000 7f015659c700 1 -- 172.21.15.8:0/1375564855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a15a695630 con 0x55a15a8c9310 2023-08-11T12:39:12.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.264+0000 7f015659c700 1 --2- 172.21.15.8:0/1375564855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a15a8c9310 0x55a15a8c96f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f01480a0770 tx=0x7f0148098b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a944d466a69893f2 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:39:12.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.264+0000 7f0144ff9700 1 -- 172.21.15.8:0/1375564855 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148099ea0 con 0x55a15a8c9310 2023-08-11T12:39:12.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.265+0000 7f0144ff9700 1 -- 172.21.15.8:0/1375564855 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f014809ccc0 con 0x55a15a8c9310 2023-08-11T12:39:12.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.265+0000 7f0144ff9700 1 -- 172.21.15.8:0/1375564855 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01480985e0 con 0x55a15a8c9310 2023-08-11T12:39:12.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.265+0000 7f017093cb80 1 -- 172.21.15.8:0/1375564855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a15a8c9310 msgr2=0x55a15a8c96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:39:12.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.265+0000 7f017093cb80 1 --2- 172.21.15.8:0/1375564855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a15a8c9310 0x55a15a8c96f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f01480a0770 tx=0x7f0148098b00 comp rx=0 tx=0).stop 2023-08-11T12:39:12.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.265+0000 7f017093cb80 1 -- 172.21.15.8:0/1375564855 shutdown_connections 2023-08-11T12:39:12.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.265+0000 7f017093cb80 1 --2- 172.21.15.8:0/1375564855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a15a8c3e20 0x55a15a8c4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.265+0000 7f017093cb80 1 --2- 172.21.15.8:0/1375564855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a15a8c9310 0x55a15a8c96f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.265+0000 7f017093cb80 1 --2- 172.21.15.8:0/1375564855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a15a8c9c30 0x55a15a8c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.265+0000 7f017093cb80 1 -- 172.21.15.8:0/1375564855 >> 172.21.15.8:0/1375564855 conn(0x55a15a7f0950 msgr2=0x55a15a8be3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:39:12.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.265+0000 7f017093cb80 1 -- 172.21.15.8:0/1375564855 shutdown_connections 2023-08-11T12:39:12.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.265+0000 7f017093cb80 1 -- 172.21.15.8:0/1375564855 wait complete. 2023-08-11T12:39:12.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.266+0000 7f017093cb80 1 -- start start 2023-08-11T12:39:12.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.266+0000 7f017093cb80 1 Processor -- start 2023-08-11T12:39:12.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.267+0000 7f017093cb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a15a8c3e20 0x55a15a8cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:12.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.267+0000 7f017093cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a15a8c9310 0x55a15a8ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:12.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.267+0000 7f017093cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a15a8c9c30 0x55a15a8cd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:12.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.267+0000 7f017093cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a15a7b3ac0 con 0x55a15a8c9c30 2023-08-11T12:39:12.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.267+0000 7f017093cb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a15a7b37c0 con 0x55a15a8c3e20 2023-08-11T12:39:12.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.267+0000 7f017093cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a15a697920 con 0x55a15a8c9310 2023-08-11T12:39:12.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.267+0000 7f017093cb80 10 client.0 _ll_register_callbacks cb 0x55a15a7b6ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:39:12.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.267+0000 7f015659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a15a8c3e20 0x55a15a8cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:12.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.267+0000 7f015659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a15a8c3e20 0x55a15a8cfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:48286/0 (socket says 172.21.15.8:48286) 2023-08-11T12:39:12.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.267+0000 7f015659c700 1 -- 172.21.15.8:0/3665397772 learned_addr learned my addr 172.21.15.8:0/3665397772 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:39:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.267+0000 7f0156d9d700 1 --2- 172.21.15.8:0/3665397772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a15a8c9c30 0x55a15a8cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.267+0000 7f0155d9b700 1 --2- 172.21.15.8:0/3665397772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a15a8c9310 0x55a15a8ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.268+0000 7f015659c700 1 -- 172.21.15.8:0/3665397772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a15a8c9310 msgr2=0x55a15a8ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:39:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.268+0000 7f015659c700 1 --2- 172.21.15.8:0/3665397772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a15a8c9310 0x55a15a8ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.268+0000 7f015659c700 1 -- 172.21.15.8:0/3665397772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a15a8c9c30 msgr2=0x55a15a8cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:39:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.268+0000 7f015659c700 1 --2- 172.21.15.8:0/3665397772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a15a8c9c30 0x55a15a8cd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.268+0000 7f015659c700 1 -- 172.21.15.8:0/3665397772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01581a5a10 con 0x55a15a8c3e20 2023-08-11T12:39:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.268+0000 7f015659c700 1 --2- 172.21.15.8:0/3665397772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a15a8c3e20 0x55a15a8cfc50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0148009230 tx=0x7f0148094ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=daf021372a6c719c server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:39:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.268+0000 7f013dffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:39:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.268+0000 7f013dffb700 1 -- 172.21.15.8:0/3665397772 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148099ea0 con 0x55a15a8c3e20 2023-08-11T12:39:12.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.268+0000 7f017093cb80 1 -- 172.21.15.8:0/3665397772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a15a8b6a90 con 0x55a15a8c3e20 2023-08-11T12:39:12.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.268+0000 7f013dffb700 1 -- 172.21.15.8:0/3665397772 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 9454+0+0 (secure 0 0 0) 0x7f01480990f0 con 0x55a15a8c3e20 2023-08-11T12:39:12.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.268+0000 7f013dffb700 1 -- 172.21.15.8:0/3665397772 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01480992b0 con 0x55a15a8c3e20 2023-08-11T12:39:12.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.268+0000 7f017093cb80 10 client.26636 fetch_fsmap learned FSMap version 54 2023-08-11T12:39:12.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.269+0000 7f017093cb80 1 -- 172.21.15.8:0/3665397772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x55a15a641de0 con 0x55a15a8c3e20 2023-08-11T12:39:12.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.269+0000 7f013dffb700 1 -- 172.21.15.8:0/3665397772 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a15a8b6a90 con 0x55a15a8c3e20 2023-08-11T12:39:12.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.269+0000 7f013dffb700 1 -- 172.21.15.8:0/3665397772 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0148097fd0 con 0x55a15a8c3e20 2023-08-11T12:39:12.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.269+0000 7f017093cb80 10 client.26636 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:39:12.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.269+0000 7f017093cb80 10 client.26636 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:39:12.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.269+0000 7f017093cb80 20 client.26636 populate_metadata read hostname 'smithi008' 2023-08-11T12:39:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.269+0000 7f017093cb80 1 --2- 172.21.15.8:0/3665397772 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55a15a8dd1a0 0x55a15a8df590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.269+0000 7f017093cb80 4 client.26636 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:39:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.269+0000 7f017093cb80 1 -- 172.21.15.8:0/3665397772 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a15a8924e0 con 0x55a15a8dd1a0 2023-08-11T12:39:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.269+0000 7f0155d9b700 1 --2- 172.21.15.8:0/3665397772 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55a15a8dd1a0 0x55a15a8df590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.270+0000 7f013dffb700 10 client.26636 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:39:12.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.270+0000 7f0155d9b700 1 --2- 172.21.15.8:0/3665397772 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55a15a8dd1a0 0x55a15a8df590 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da5dbe9017a077c0 server_cookie=c08821afd099e135 in_seq=0 out_seq=0 2023-08-11T12:39:12.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.270+0000 7f013dffb700 1 -- 172.21.15.8:0/3665397772 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55a15a8924e0 con 0x55a15a8dd1a0 2023-08-11T12:39:12.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.270+0000 7f013dffb700 10 client.26636 handle_command_reply: tid=0 2023-08-11T12:39:12.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.271+0000 7f017093cb80 1 client.26636 shutdown 2023-08-11T12:39:12.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.271+0000 7f017093cb80 1 -- 172.21.15.8:0/3665397772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a15a8c3e20 msgr2=0x55a15a8cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:39:12.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.271+0000 7f017093cb80 1 --2- 172.21.15.8:0/3665397772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a15a8c3e20 0x55a15a8cfc50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0148009230 tx=0x7f0148094ab0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.271+0000 7f017093cb80 1 -- 172.21.15.8:0/3665397772 shutdown_connections 2023-08-11T12:39:12.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.271+0000 7f017093cb80 1 --2- 172.21.15.8:0/3665397772 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55a15a8dd1a0 0x55a15a8df590 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.271+0000 7f017093cb80 1 --2- 172.21.15.8:0/3665397772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a15a8c9c30 0x55a15a8cd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.271+0000 7f017093cb80 1 --2- 172.21.15.8:0/3665397772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a15a8c3e20 0x55a15a8cfc50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.271+0000 7f017093cb80 1 --2- 172.21.15.8:0/3665397772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a15a8c9310 0x55a15a8ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.271+0000 7f017093cb80 1 -- 172.21.15.8:0/3665397772 >> 172.21.15.8:0/3665397772 conn(0x55a15a7f0950 msgr2=0x55a15a8b8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:39:12.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.271+0000 7f013dffb700 0 client.26636 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:39:12.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.271+0000 7f017093cb80 1 -- 172.21.15.8:0/3665397772 shutdown_connections 2023-08-11T12:39:12.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.271+0000 7f017093cb80 1 -- 172.21.15.8:0/3665397772 wait complete. 2023-08-11T12:39:12.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.271+0000 7f017093cb80 20 client.26636 trim_cache size 0 max 16384 2023-08-11T12:39:12.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.289+0000 7f017093cb80 1 Processor -- start 2023-08-11T12:39:12.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.289+0000 7f017093cb80 1 -- start start 2023-08-11T12:39:12.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.289+0000 7f017093cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a15a8c3e20 0x55a15a8d4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:12.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.289+0000 7f017093cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a15a8c9310 0x55a15a8cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:12.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.289+0000 7f017093cb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a15a8c9c30 0x55a15a8cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:12.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.289+0000 7f017093cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a15a8d9470 con 0x55a15a8c3e20 2023-08-11T12:39:12.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.289+0000 7f017093cb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a15a8924e0 con 0x55a15a8c9c30 2023-08-11T12:39:12.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.289+0000 7f017093cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a15a8dcfc0 con 0x55a15a8c9310 2023-08-11T12:39:12.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.289+0000 7f015659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a15a8c3e20 0x55a15a8d4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:12.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.289+0000 7f015659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a15a8c3e20 0x55a15a8d4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45450/0 (socket says 172.21.15.8:45450) 2023-08-11T12:39:12.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.289+0000 7f0156d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a15a8c9c30 0x55a15a8cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:12.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.289+0000 7f015659c700 1 -- 172.21.15.8:0/372284322 learned_addr learned my addr 172.21.15.8:0/372284322 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:39:12.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.290+0000 7f0155d9b700 1 --2- 172.21.15.8:0/372284322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a15a8c9310 0x55a15a8cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:12.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.290+0000 7f015659c700 1 -- 172.21.15.8:0/372284322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a15a8c9310 msgr2=0x55a15a8cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:39:12.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.290+0000 7f015659c700 1 --2- 172.21.15.8:0/372284322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a15a8c9310 0x55a15a8cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.290+0000 7f015659c700 1 -- 172.21.15.8:0/372284322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a15a8c9c30 msgr2=0x55a15a8cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:39:12.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.290+0000 7f015659c700 1 --2- 172.21.15.8:0/372284322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a15a8c9c30 0x55a15a8cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.290+0000 7f015659c700 1 -- 172.21.15.8:0/372284322 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a15a62ac60 con 0x55a15a8c3e20 2023-08-11T12:39:12.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.290+0000 7f0155d9b700 1 --2- 172.21.15.8:0/372284322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a15a8c9310 0x55a15a8cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:39:12.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.290+0000 7f015659c700 1 --2- 172.21.15.8:0/372284322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a15a8c3e20 0x55a15a8d4530 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0148000c00 tx=0x7f0148098b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2bb38ef5846486 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:39:12.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.290+0000 7f01457fa700 1 -- 172.21.15.8:0/372284322 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148099ea0 con 0x55a15a8c3e20 2023-08-11T12:39:12.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.290+0000 7f01457fa700 1 -- 172.21.15.8:0/372284322 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01480a0810 con 0x55a15a8c3e20 2023-08-11T12:39:12.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.290+0000 7f01457fa700 1 -- 172.21.15.8:0/372284322 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148099350 con 0x55a15a8c3e20 2023-08-11T12:39:12.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.291+0000 7f017093cb80 1 -- 172.21.15.8:0/372284322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a15a8c3e20 msgr2=0x55a15a8d4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:39:12.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.291+0000 7f017093cb80 1 --2- 172.21.15.8:0/372284322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a15a8c3e20 0x55a15a8d4530 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0148000c00 tx=0x7f0148098b00 comp rx=0 tx=0).stop 2023-08-11T12:39:12.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.291+0000 7f017093cb80 1 -- 172.21.15.8:0/372284322 shutdown_connections 2023-08-11T12:39:12.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.291+0000 7f017093cb80 1 --2- 172.21.15.8:0/372284322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a15a8c9c30 0x55a15a8cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.291+0000 7f017093cb80 1 --2- 172.21.15.8:0/372284322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a15a8c3e20 0x55a15a8d4530 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.291+0000 7f017093cb80 1 --2- 172.21.15.8:0/372284322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a15a8c9310 0x55a15a8cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.291+0000 7f017093cb80 1 -- 172.21.15.8:0/372284322 >> 172.21.15.8:0/372284322 conn(0x55a15a7f0950 msgr2=0x55a15a8d97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:39:12.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.291+0000 7f017093cb80 1 -- 172.21.15.8:0/372284322 shutdown_connections 2023-08-11T12:39:12.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.291+0000 7f017093cb80 1 -- 172.21.15.8:0/372284322 wait complete. 2023-08-11T12:39:12.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.291+0000 7f017093cb80 1 -- start start 2023-08-11T12:39:12.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.292+0000 7f017093cb80 1 Processor -- start 2023-08-11T12:39:12.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.292+0000 7f017093cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a15a8c3e20 0x55a15a92a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:12.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.292+0000 7f017093cb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a15a8c9310 0x55a15a92a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:12.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.292+0000 7f017093cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a15a8c9c30 0x55a15a924d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:12.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.292+0000 7f017093cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a15a9253e0 con 0x55a15a8c3e20 2023-08-11T12:39:12.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.292+0000 7f017093cb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a15a925550 con 0x55a15a8c9310 2023-08-11T12:39:12.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.292+0000 7f017093cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a15a925710 con 0x55a15a8c9c30 2023-08-11T12:39:12.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.292+0000 7f017093cb80 10 client.0 _ll_register_callbacks cb 0x7f01500097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:39:12.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.292+0000 7f015659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a15a8c3e20 0x55a15a92a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:12.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.292+0000 7f0155d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a15a8c9310 0x55a15a92a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:12.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.292+0000 7f015659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a15a8c3e20 0x55a15a92a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45462/0 (socket says 172.21.15.8:45462) 2023-08-11T12:39:12.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.292+0000 7f0155d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a15a8c9310 0x55a15a92a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:48302/0 (socket says 172.21.15.8:48302) 2023-08-11T12:39:12.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.292+0000 7f015659c700 1 -- 172.21.15.8:0/2829018032 learned_addr learned my addr 172.21.15.8:0/2829018032 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:39:12.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.293+0000 7f0156d9d700 1 --2- 172.21.15.8:0/2829018032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a15a8c9c30 0x55a15a924d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:12.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.293+0000 7f015659c700 1 -- 172.21.15.8:0/2829018032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a15a8c9c30 msgr2=0x55a15a924d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:39:12.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.293+0000 7f015659c700 1 --2- 172.21.15.8:0/2829018032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a15a8c9c30 0x55a15a924d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.293+0000 7f015659c700 1 -- 172.21.15.8:0/2829018032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a15a8c9310 msgr2=0x55a15a92a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:39:12.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.293+0000 7f015659c700 1 --2- 172.21.15.8:0/2829018032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a15a8c9310 0x55a15a92a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.293+0000 7f015659c700 1 -- 172.21.15.8:0/2829018032 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a15a641de0 con 0x55a15a8c3e20 2023-08-11T12:39:12.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.293+0000 7f0155d9b700 1 --2- 172.21.15.8:0/2829018032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a15a8c9310 0x55a15a92a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:39:12.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.293+0000 7f015659c700 1 --2- 172.21.15.8:0/2829018032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a15a8c3e20 0x55a15a92a420 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f014800cfd0 tx=0x7f0148099480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a86bcc7bda9092 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:39:12.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.293+0000 7f013dffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-08-11T12:39:12.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.293+0000 7f013dffb700 1 -- 172.21.15.8:0/2829018032 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148099ea0 con 0x55a15a8c3e20 2023-08-11T12:39:12.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.293+0000 7f017093cb80 1 -- 172.21.15.8:0/2829018032 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f014809ccc0 con 0x55a15a8c3e20 2023-08-11T12:39:12.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.293+0000 7f013dffb700 1 -- 172.21.15.8:0/2829018032 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 9454+0+0 (secure 0 0 0) 0x7f0148094e80 con 0x55a15a8c3e20 2023-08-11T12:39:12.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.293+0000 7f013dffb700 1 -- 172.21.15.8:0/2829018032 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0148095040 con 0x55a15a8c3e20 2023-08-11T12:39:12.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.293+0000 7f017093cb80 10 client.16599 fetch_fsmap learned FSMap version 54 2023-08-11T12:39:12.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.293+0000 7f017093cb80 1 -- 172.21.15.8:0/2829018032 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x55a15a668250 con 0x55a15a8c3e20 2023-08-11T12:39:12.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.294+0000 7f013dffb700 1 -- 172.21.15.8:0/2829018032 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f014809ccc0 con 0x55a15a8c3e20 2023-08-11T12:39:12.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.294+0000 7f013dffb700 1 -- 172.21.15.8:0/2829018032 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f01480821e0 con 0x55a15a8c3e20 2023-08-11T12:39:12.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.294+0000 7f017093cb80 10 client.16599 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:39:12.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.294+0000 7f017093cb80 10 client.16599 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:39:12.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.294+0000 7f017093cb80 20 client.16599 populate_metadata read hostname 'smithi008' 2023-08-11T12:39:12.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.294+0000 7f017093cb80 1 --2- 172.21.15.8:0/2829018032 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55a15a931d60 0x55a15a934150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:12.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.294+0000 7f017093cb80 4 client.16599 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:39:12.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.294+0000 7f017093cb80 1 -- 172.21.15.8:0/2829018032 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a15a80e820 con 0x55a15a931d60 2023-08-11T12:39:12.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.294+0000 7f0155d9b700 1 --2- 172.21.15.8:0/2829018032 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55a15a931d60 0x55a15a934150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:12.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.295+0000 7f013dffb700 10 client.16599 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:39:12.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.295+0000 7f0155d9b700 1 --2- 172.21.15.8:0/2829018032 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55a15a931d60 0x55a15a934150 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ed9671d4a9c9a62 server_cookie=838bb7e2057e1fce in_seq=0 out_seq=0 2023-08-11T12:39:12.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.295+0000 7f013dffb700 1 -- 172.21.15.8:0/2829018032 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55a15a80e820 con 0x55a15a931d60 2023-08-11T12:39:12.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.295+0000 7f013dffb700 10 client.16599 handle_command_reply: tid=0 2023-08-11T12:39:12.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.295+0000 7f017093cb80 1 client.16599 shutdown 2023-08-11T12:39:12.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.295+0000 7f017093cb80 1 -- 172.21.15.8:0/2829018032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a15a8c3e20 msgr2=0x55a15a92a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:39:12.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.295+0000 7f017093cb80 1 --2- 172.21.15.8:0/2829018032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a15a8c3e20 0x55a15a92a420 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f014800cfd0 tx=0x7f0148099480 comp rx=0 tx=0).stop 2023-08-11T12:39:12.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.295+0000 7f017093cb80 1 -- 172.21.15.8:0/2829018032 shutdown_connections 2023-08-11T12:39:12.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.295+0000 7f017093cb80 1 --2- 172.21.15.8:0/2829018032 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55a15a931d60 0x55a15a934150 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.295+0000 7f017093cb80 1 --2- 172.21.15.8:0/2829018032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a15a8c9c30 0x55a15a924d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.295+0000 7f013dffb700 0 client.16599 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:39:12.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.295+0000 7f017093cb80 1 --2- 172.21.15.8:0/2829018032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a15a8c3e20 0x55a15a92a420 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.295+0000 7f017093cb80 1 --2- 172.21.15.8:0/2829018032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a15a8c9310 0x55a15a92a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.295+0000 7f017093cb80 1 -- 172.21.15.8:0/2829018032 >> 172.21.15.8:0/2829018032 conn(0x55a15a7f0950 msgr2=0x55a15a8cc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:39:12.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.295+0000 7f017093cb80 1 -- 172.21.15.8:0/2829018032 shutdown_connections 2023-08-11T12:39:12.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.295+0000 7f017093cb80 1 -- 172.21.15.8:0/2829018032 wait complete. 2023-08-11T12:39:12.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.296+0000 7f017093cb80 20 client.16599 trim_cache size 0 max 16384 2023-08-11T12:39:12.312 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:39:12.312 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:39:12.312 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:39:12.312 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:39:12.313 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:39:12.313 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:39:12.313 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:39:12.313 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:39:12.313 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:39:12.313 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:39:12.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.296+0000 7f015cfff700 1 -- 172.21.15.8:0/1623963134 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f01400a00c0 msgr2=0x7f01400a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:39:12.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.296+0000 7f015cfff700 1 --2- 172.21.15.8:0/1623963134 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f01400a00c0 0x7f01400a2580 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f015819f720 tx=0x7f015000b040 comp rx=0 tx=0).stop 2023-08-11T12:39:12.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.296+0000 7f015cfff700 1 -- 172.21.15.8:0/1623963134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0158100960 msgr2=0x7f015819ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:39:12.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.296+0000 7f015cfff700 1 --2- 172.21.15.8:0/1623963134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0158100960 0x7f015819ea90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f014800e9a0 tx=0x7f014800ecb0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.296+0000 7f015cfff700 1 -- 172.21.15.8:0/1623963134 shutdown_connections 2023-08-11T12:39:12.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.296+0000 7f015cfff700 1 --2- 172.21.15.8:0/1623963134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0158106970 0x7f0158198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.296+0000 7f015cfff700 1 --2- 172.21.15.8:0/1623963134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0158100960 0x7f015819ea90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.296+0000 7f015cfff700 1 --2- 172.21.15.8:0/1623963134 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f01400a00c0 0x7f01400a2580 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.296+0000 7f015cfff700 1 --2- 172.21.15.8:0/1623963134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0158101320 0x7f015819efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:12.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.296+0000 7f015cfff700 1 -- 172.21.15.8:0/1623963134 >> 172.21.15.8:0/1623963134 conn(0x7f01580fc490 msgr2=0x7f015810bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:39:12.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.296+0000 7f015cfff700 1 -- 172.21.15.8:0/1623963134 shutdown_connections 2023-08-11T12:39:12.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:12.296+0000 7f015cfff700 1 -- 172.21.15.8:0/1623963134 wait complete. 2023-08-11T12:39:12.317 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:39:12.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:12 smithi194 ceph-mon[130905]: pgmap v458: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:39:12.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:12 smithi045 ceph-mon[130284]: pgmap v458: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:39:12.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:12 smithi008 ceph-mon[97158]: pgmap v458: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:39:16.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:15 smithi008 ceph-mon[97158]: pgmap v459: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:39:16.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:15 smithi008 ceph-mon[97158]: osdmap e108: 12 total, 12 up, 12 in 2023-08-11T12:39:16.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:15 smithi194 ceph-mon[130905]: pgmap v459: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:39:16.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:15 smithi194 ceph-mon[130905]: osdmap e108: 12 total, 12 up, 12 in 2023-08-11T12:39:16.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:15 smithi045 ceph-mon[130284]: pgmap v459: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:39:16.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:15 smithi045 ceph-mon[130284]: osdmap e108: 12 total, 12 up, 12 in 2023-08-11T12:39:18.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:17 smithi008 ceph-mon[97158]: pgmap v461: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 123 B/s wr, 6 op/s 2023-08-11T12:39:18.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:17 smithi194 ceph-mon[130905]: pgmap v461: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 123 B/s wr, 6 op/s 2023-08-11T12:39:18.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:17 smithi045 ceph-mon[130284]: pgmap v461: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 123 B/s wr, 6 op/s 2023-08-11T12:39:20.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:19 smithi008 ceph-mon[97158]: pgmap v462: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:39:20.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:19 smithi194 ceph-mon[130905]: pgmap v462: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:39:20.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:19 smithi045 ceph-mon[130284]: pgmap v462: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:39:22.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:21 smithi008 ceph-mon[97158]: pgmap v463: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:39:22.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:21 smithi194 ceph-mon[130905]: pgmap v463: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:39:22.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:21 smithi045 ceph-mon[130284]: pgmap v463: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:39:24.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:23 smithi008 ceph-mon[97158]: pgmap v464: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:39:24.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:23 smithi194 ceph-mon[130905]: pgmap v464: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:39:24.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:23 smithi045 ceph-mon[130284]: pgmap v464: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:39:26.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:25 smithi008 ceph-mon[97158]: pgmap v465: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:39:26.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:25 smithi194 ceph-mon[130905]: pgmap v465: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:39:26.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:25 smithi045 ceph-mon[130284]: pgmap v465: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:39:28.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:27 smithi008 ceph-mon[97158]: pgmap v466: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:39:28.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:27 smithi194 ceph-mon[130905]: pgmap v466: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:39:28.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:27 smithi045 ceph-mon[130284]: pgmap v466: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:39:30.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:29 smithi008 ceph-mon[97158]: pgmap v467: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:39:30.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:29 smithi194 ceph-mon[130905]: pgmap v467: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:39:30.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:29 smithi045 ceph-mon[130284]: pgmap v467: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:39:32.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:32 smithi008 ceph-mon[97158]: pgmap v468: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:32.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:32 smithi194 ceph-mon[130905]: pgmap v468: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:32.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:32 smithi045 ceph-mon[130284]: pgmap v468: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:34.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:34 smithi008 ceph-mon[97158]: pgmap v469: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:39:34.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:34 smithi194 ceph-mon[130905]: pgmap v469: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:39:34.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:34 smithi045 ceph-mon[130284]: pgmap v469: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:39:36.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:36 smithi008 ceph-mon[97158]: pgmap v470: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:36.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:36 smithi194 ceph-mon[130905]: pgmap v470: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:36.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:36 smithi045 ceph-mon[130284]: pgmap v470: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:38.302 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:38 smithi008 ceph-mon[97158]: pgmap v471: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:38.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:38 smithi194 ceph-mon[130905]: pgmap v471: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:38.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:38 smithi045 ceph-mon[130284]: pgmap v471: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:40.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:40 smithi008 ceph-mon[97158]: pgmap v472: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:39:40.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:40 smithi194 ceph-mon[130905]: pgmap v472: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:39:40.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:40 smithi045 ceph-mon[130284]: pgmap v472: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:39:42.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:42 smithi008 ceph-mon[97158]: pgmap v473: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:42.319 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:39:42.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:42 smithi194 ceph-mon[130905]: pgmap v473: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:42.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:42 smithi045 ceph-mon[130284]: pgmap v473: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:42.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.537+0000 7f666f9ff700 1 -- 172.21.15.8:0/61407420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6668101bc0 msgr2=0x7f6668101fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:39:42.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.537+0000 7f666f9ff700 1 --2- 172.21.15.8:0/61407420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6668101bc0 0x7f6668101fa0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6664009990 tx=0x7f6664009ca0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.537+0000 7f666f9ff700 1 -- 172.21.15.8:0/61407420 shutdown_connections 2023-08-11T12:39:42.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.537+0000 7f666f9ff700 1 --2- 172.21.15.8:0/61407420 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f666810af90 0x7f666810d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.537+0000 7f666f9ff700 1 --2- 172.21.15.8:0/61407420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6668101bc0 0x7f6668101fa0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.537+0000 7f666f9ff700 1 --2- 172.21.15.8:0/61407420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66681024e0 0x7f666810a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.537+0000 7f666f9ff700 1 -- 172.21.15.8:0/61407420 >> 172.21.15.8:0/61407420 conn(0x7f6668076a30 msgr2=0x7f6668076e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:39:42.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.537+0000 7f666f9ff700 1 -- 172.21.15.8:0/61407420 shutdown_connections 2023-08-11T12:39:42.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.537+0000 7f666f9ff700 1 -- 172.21.15.8:0/61407420 wait complete. 2023-08-11T12:39:42.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.538+0000 7f666f9ff700 1 Processor -- start 2023-08-11T12:39:42.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.538+0000 7f666f9ff700 1 -- start start 2023-08-11T12:39:42.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.539+0000 7f666f9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6668101bc0 0x7f66680ff810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:42.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.539+0000 7f666f9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66681024e0 0x7f66680ffd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:42.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.539+0000 7f666f9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f666810af90 0x7f66681a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:42.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.539+0000 7f666f9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6668100580 con 0x7f66681024e0 2023-08-11T12:39:42.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.539+0000 7f666f9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66681a5240 con 0x7f666810af90 2023-08-11T12:39:42.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.539+0000 7f666f9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66681a5380 con 0x7f6668101bc0 2023-08-11T12:39:42.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.539+0000 7f666d79b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6668101bc0 0x7f66680ff810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:42.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.539+0000 7f666df9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f666810af90 0x7f66681a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:42.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.539+0000 7f666cf9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66681024e0 0x7f66680ffd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:42.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.539+0000 7f666d79b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6668101bc0 0x7f66680ff810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:47074/0 (socket says 172.21.15.8:47074) 2023-08-11T12:39:42.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.539+0000 7f666d79b700 1 -- 172.21.15.8:0/3952730989 learned_addr learned my addr 172.21.15.8:0/3952730989 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:39:42.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.540+0000 7f666df9c700 1 -- 172.21.15.8:0/3952730989 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6668101bc0 msgr2=0x7f66680ff810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:39:42.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.540+0000 7f666df9c700 1 --2- 172.21.15.8:0/3952730989 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6668101bc0 0x7f66680ff810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.540+0000 7f666df9c700 1 -- 172.21.15.8:0/3952730989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66681024e0 msgr2=0x7f66680ffd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:39:42.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.540+0000 7f666df9c700 1 --2- 172.21.15.8:0/3952730989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66681024e0 0x7f66680ffd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.540+0000 7f666df9c700 1 -- 172.21.15.8:0/3952730989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66640095f0 con 0x7f666810af90 2023-08-11T12:39:42.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.540+0000 7f666d79b700 1 --2- 172.21.15.8:0/3952730989 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6668101bc0 0x7f66680ff810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:39:42.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.540+0000 7f666cf9a700 1 --2- 172.21.15.8:0/3952730989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66681024e0 0x7f66680ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:39:42.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.540+0000 7f666df9c700 1 --2- 172.21.15.8:0/3952730989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f666810af90 0x7f66681a4d00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f666000efc0 tx=0x7f666000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:39:42.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.540+0000 7f665e7fc700 1 -- 172.21.15.8:0/3952730989 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6660018070 con 0x7f666810af90 2023-08-11T12:39:42.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.540+0000 7f666f9ff700 1 -- 172.21.15.8:0/3952730989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66681a5580 con 0x7f666810af90 2023-08-11T12:39:42.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.540+0000 7f665e7fc700 1 -- 172.21.15.8:0/3952730989 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f666000f040 con 0x7f666810af90 2023-08-11T12:39:42.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.540+0000 7f665e7fc700 1 -- 172.21.15.8:0/3952730989 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666000cd40 con 0x7f666810af90 2023-08-11T12:39:42.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.540+0000 7f666f9ff700 1 -- 172.21.15.8:0/3952730989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66681a5a60 con 0x7f666810af90 2023-08-11T12:39:42.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.543+0000 7f665e7fc700 1 -- 172.21.15.8:0/3952730989 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f6660003a00 con 0x7f666810af90 2023-08-11T12:39:42.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.544+0000 7f6683316b80 1 Processor -- start 2023-08-11T12:39:42.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.545+0000 7f6683316b80 1 -- start start 2023-08-11T12:39:42.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.545+0000 7f6683316b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c323ca4310 0x55c323ca46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:42.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.545+0000 7f6683316b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c323ca4c30 0x55c323c9e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:42.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.545+0000 7f6683316b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c323c9ee20 0x55c323c9f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:42.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.545+0000 7f6683316b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c323bf7630 con 0x55c323ca4c30 2023-08-11T12:39:42.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.545+0000 7f6683316b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c323bf4f50 con 0x55c323c9ee20 2023-08-11T12:39:42.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.545+0000 7f6683316b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c323bf0840 con 0x55c323ca4310 2023-08-11T12:39:42.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.545+0000 7f665e7fc700 1 --2- 172.21.15.8:0/3952730989 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f66540a00c0 0x7f66540a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:42.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.545+0000 7f666cf9a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c323ca4310 0x55c323ca46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:42.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.545+0000 7f666cf9a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c323ca4310 0x55c323ca46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:47080/0 (socket says 172.21.15.8:47080) 2023-08-11T12:39:42.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.546+0000 7f666cf9a700 1 -- 172.21.15.8:0/1913941208 learned_addr learned my addr 172.21.15.8:0/1913941208 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:39:42.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.546+0000 7f665e7fc700 1 -- 172.21.15.8:0/3952730989 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 9366+0+0 (secure 0 0 0) 0x7f66600cb590 con 0x7f666810af90 2023-08-11T12:39:42.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.546+0000 7f666d79b700 1 --2- 172.21.15.8:0/1913941208 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c323ca4c30 0x55c323c9e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:42.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.546+0000 7f666cf9a700 1 --2- 172.21.15.8:0/1913941208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c323c9ee20 0x55c323c9f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:42.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.546+0000 7f666df9c700 1 --2- 172.21.15.8:0/3952730989 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f66540a00c0 0x7f66540a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:42.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.546+0000 7f666cf9a700 1 -- 172.21.15.8:0/1913941208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c323c9ee20 msgr2=0x55c323c9f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:39:42.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.546+0000 7f666cf9a700 1 --2- 172.21.15.8:0/1913941208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c323c9ee20 0x55c323c9f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.546+0000 7f666cf9a700 1 -- 172.21.15.8:0/1913941208 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c323ca4c30 msgr2=0x55c323c9e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:39:42.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.546+0000 7f666cf9a700 1 --2- 172.21.15.8:0/1913941208 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c323ca4c30 0x55c323c9e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.546+0000 7f666cf9a700 1 -- 172.21.15.8:0/1913941208 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c323a70630 con 0x55c323ca4310 2023-08-11T12:39:42.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.546+0000 7f666d79b700 1 --2- 172.21.15.8:0/1913941208 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c323ca4c30 0x55c323c9e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:39:42.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.546+0000 7f666cf9a700 1 --2- 172.21.15.8:0/1913941208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c323ca4310 0x55c323ca46f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6658011c70 tx=0x7f6658009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52ccf441503d7af7 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:39:42.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.546+0000 7f666df9c700 1 --2- 172.21.15.8:0/3952730989 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f66540a00c0 0x7f66540a2580 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6660098910 tx=0x7f6660009040 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:39:42.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.547+0000 7f66537fe700 1 -- 172.21.15.8:0/1913941208 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665800f6d0 con 0x55c323ca4310 2023-08-11T12:39:42.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.547+0000 7f66537fe700 1 -- 172.21.15.8:0/1913941208 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f665800fcf0 con 0x55c323ca4310 2023-08-11T12:39:42.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.547+0000 7f66537fe700 1 -- 172.21.15.8:0/1913941208 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665801fb30 con 0x55c323ca4310 2023-08-11T12:39:42.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.547+0000 7f6683316b80 1 -- 172.21.15.8:0/1913941208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c323ca4310 msgr2=0x55c323ca46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:39:42.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.547+0000 7f6683316b80 1 --2- 172.21.15.8:0/1913941208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c323ca4310 0x55c323ca46f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6658011c70 tx=0x7f6658009c30 comp rx=0 tx=0).stop 2023-08-11T12:39:42.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.547+0000 7f6683316b80 1 -- 172.21.15.8:0/1913941208 shutdown_connections 2023-08-11T12:39:42.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.547+0000 7f6683316b80 1 --2- 172.21.15.8:0/1913941208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c323ca4310 0x55c323ca46f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.547+0000 7f6683316b80 1 --2- 172.21.15.8:0/1913941208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c323c9ee20 0x55c323c9f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.547+0000 7f6683316b80 1 --2- 172.21.15.8:0/1913941208 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c323ca4c30 0x55c323c9e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.547+0000 7f6683316b80 1 -- 172.21.15.8:0/1913941208 >> 172.21.15.8:0/1913941208 conn(0x55c323bcb950 msgr2=0x55c323c993d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:39:42.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.547+0000 7f6683316b80 1 -- 172.21.15.8:0/1913941208 shutdown_connections 2023-08-11T12:39:42.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.548+0000 7f6683316b80 1 -- 172.21.15.8:0/1913941208 wait complete. 2023-08-11T12:39:42.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.548+0000 7f6683316b80 1 -- start start 2023-08-11T12:39:42.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.548+0000 7f6683316b80 1 Processor -- start 2023-08-11T12:39:42.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.549+0000 7f6683316b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c323c9ee20 0x55c323caab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:42.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.549+0000 7f6683316b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c323ca4310 0x55c323ca7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:42.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.549+0000 7f6683316b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c323ca4c30 0x55c323ca8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:42.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.549+0000 7f6683316b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c323b8eac0 con 0x55c323ca4c30 2023-08-11T12:39:42.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.549+0000 7f6683316b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c323b8e7c0 con 0x55c323ca4310 2023-08-11T12:39:42.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.549+0000 7f6683316b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c323a72920 con 0x55c323c9ee20 2023-08-11T12:39:42.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.549+0000 7f6683316b80 10 client.0 _ll_register_callbacks cb 0x55c323b91ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:39:42.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.549+0000 7f666d79b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c323ca4310 0x55c323ca7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:42.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.549+0000 7f666d79b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c323ca4310 0x55c323ca7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:48504/0 (socket says 172.21.15.8:48504) 2023-08-11T12:39:42.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.549+0000 7f666d79b700 1 -- 172.21.15.8:0/3959860747 learned_addr learned my addr 172.21.15.8:0/3959860747 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:39:42.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.549+0000 7f666cf9a700 1 --2- 172.21.15.8:0/3959860747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c323c9ee20 0x55c323caab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:42.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.549+0000 7f666cf9a700 1 --2- 172.21.15.8:0/3959860747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c323ca4c30 0x55c323ca8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:42.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.549+0000 7f666d79b700 1 -- 172.21.15.8:0/3959860747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c323c9ee20 msgr2=0x55c323caab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:39:42.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.549+0000 7f666d79b700 1 --2- 172.21.15.8:0/3959860747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c323c9ee20 0x55c323caab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.549+0000 7f666d79b700 1 -- 172.21.15.8:0/3959860747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c323ca4c30 msgr2=0x55c323ca8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:39:42.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.549+0000 7f666d79b700 1 --2- 172.21.15.8:0/3959860747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c323ca4c30 0x55c323ca8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.549+0000 7f666d79b700 1 -- 172.21.15.8:0/3959860747 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6658019040 con 0x55c323ca4310 2023-08-11T12:39:42.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.549+0000 7f666cf9a700 1 --2- 172.21.15.8:0/3959860747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c323c9ee20 0x55c323caab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-11T12:39:42.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.550+0000 7f666d79b700 1 --2- 172.21.15.8:0/3959860747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c323ca4310 0x55c323ca7e40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f666400c010 tx=0x7f6664005320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=405b9eccfcbfd539 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:39:42.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.550+0000 7f6650ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:39:42.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.550+0000 7f6650ff9700 1 -- 172.21.15.8:0/3959860747 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666401d070 con 0x55c323ca4310 2023-08-11T12:39:42.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.550+0000 7f6683316b80 1 -- 172.21.15.8:0/3959860747 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c323c91a90 con 0x55c323ca4310 2023-08-11T12:39:42.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.550+0000 7f6650ff9700 1 -- 172.21.15.8:0/3959860747 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 9366+0+0 (secure 0 0 0) 0x7f6664004910 con 0x55c323ca4310 2023-08-11T12:39:42.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.550+0000 7f6650ff9700 1 -- 172.21.15.8:0/3959860747 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6664004ad0 con 0x55c323ca4310 2023-08-11T12:39:42.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.550+0000 7f6683316b80 10 client.26654 fetch_fsmap learned FSMap version 54 2023-08-11T12:39:42.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.550+0000 7f6683316b80 1 -- 172.21.15.8:0/3959860747 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x55c323a1cde0 con 0x55c323ca4310 2023-08-11T12:39:42.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.551+0000 7f6650ff9700 1 -- 172.21.15.8:0/3959860747 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c323c91a90 con 0x55c323ca4310 2023-08-11T12:39:42.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.551+0000 7f6650ff9700 1 -- 172.21.15.8:0/3959860747 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f666400f460 con 0x55c323ca4310 2023-08-11T12:39:42.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.551+0000 7f6683316b80 10 client.26654 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:39:42.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.551+0000 7f6683316b80 10 client.26654 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:39:42.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.551+0000 7f6683316b80 20 client.26654 populate_metadata read hostname 'smithi008' 2023-08-11T12:39:42.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.551+0000 7f6683316b80 1 --2- 172.21.15.8:0/3959860747 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55c323cb8510 0x55c323cba930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:42.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.551+0000 7f6683316b80 4 client.26654 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:39:42.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.551+0000 7f6683316b80 1 -- 172.21.15.8:0/3959860747 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c323c6d4e0 con 0x55c323cb8510 2023-08-11T12:39:42.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.551+0000 7f666cf9a700 1 --2- 172.21.15.8:0/3959860747 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55c323cb8510 0x55c323cba930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:42.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.552+0000 7f666cf9a700 1 --2- 172.21.15.8:0/3959860747 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55c323cb8510 0x55c323cba930 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ea96f3cf0e7b5eb server_cookie=897120d59e8316bd in_seq=0 out_seq=0 2023-08-11T12:39:42.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.552+0000 7f6650ff9700 10 client.26654 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:39:42.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.552+0000 7f6650ff9700 1 -- 172.21.15.8:0/3959860747 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x7f665802a670 con 0x55c323cb8510 2023-08-11T12:39:42.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.552+0000 7f6650ff9700 10 client.26654 handle_command_reply: tid=0 2023-08-11T12:39:42.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.553+0000 7f6683316b80 1 client.26654 shutdown 2023-08-11T12:39:42.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.553+0000 7f6683316b80 1 -- 172.21.15.8:0/3959860747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c323ca4310 msgr2=0x55c323ca7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:39:42.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.553+0000 7f6683316b80 1 --2- 172.21.15.8:0/3959860747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c323ca4310 0x55c323ca7e40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f666400c010 tx=0x7f6664005320 comp rx=0 tx=0).stop 2023-08-11T12:39:42.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.553+0000 7f6683316b80 1 -- 172.21.15.8:0/3959860747 shutdown_connections 2023-08-11T12:39:42.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.553+0000 7f6683316b80 1 --2- 172.21.15.8:0/3959860747 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55c323cb8510 0x55c323cba930 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.553+0000 7f6683316b80 1 --2- 172.21.15.8:0/3959860747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c323c9ee20 0x55c323caab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.553+0000 7f6683316b80 1 --2- 172.21.15.8:0/3959860747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c323ca4c30 0x55c323ca8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.553+0000 7f6650ff9700 0 client.26654 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:39:42.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.553+0000 7f6683316b80 1 --2- 172.21.15.8:0/3959860747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c323ca4310 0x55c323ca7e40 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.553+0000 7f6683316b80 1 -- 172.21.15.8:0/3959860747 >> 172.21.15.8:0/3959860747 conn(0x55c323bcb950 msgr2=0x55c323c93cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:39:42.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.553+0000 7f6683316b80 1 -- 172.21.15.8:0/3959860747 shutdown_connections 2023-08-11T12:39:42.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.553+0000 7f6683316b80 1 -- 172.21.15.8:0/3959860747 wait complete. 2023-08-11T12:39:42.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.553+0000 7f6683316b80 20 client.26654 trim_cache size 0 max 16384 2023-08-11T12:39:42.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.571+0000 7f6683316b80 1 Processor -- start 2023-08-11T12:39:42.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.571+0000 7f6683316b80 1 -- start start 2023-08-11T12:39:42.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.571+0000 7f6683316b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c323c9ee20 0x55c323c9e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:42.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.571+0000 7f6683316b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c323ca4310 0x55c323ca73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:42.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.571+0000 7f6683316b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c323ca4c30 0x55c323caa650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:42.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.571+0000 7f6683316b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c323ca3f90 con 0x55c323ca4310 2023-08-11T12:39:42.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.571+0000 7f6683316b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c323cb4e80 con 0x55c323c9ee20 2023-08-11T12:39:42.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.571+0000 7f6683316b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c323c91a60 con 0x55c323ca4c30 2023-08-11T12:39:42.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.571+0000 7f666d79b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c323ca4310 0x55c323ca73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:42.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.571+0000 7f666cf9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c323c9ee20 0x55c323c9e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:42.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.571+0000 7f666d79b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c323ca4310 0x55c323ca73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41888/0 (socket says 172.21.15.8:41888) 2023-08-11T12:39:42.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.571+0000 7f666d79b700 1 -- 172.21.15.8:0/2256507145 learned_addr learned my addr 172.21.15.8:0/2256507145 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:39:42.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.571+0000 7f666cf9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c323c9ee20 0x55c323c9e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:48516/0 (socket says 172.21.15.8:48516) 2023-08-11T12:39:42.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.572+0000 7f666cf9a700 1 --2- 172.21.15.8:0/2256507145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c323ca4c30 0x55c323caa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:42.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.572+0000 7f666d79b700 1 -- 172.21.15.8:0/2256507145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c323ca4c30 msgr2=0x55c323caa650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:39:42.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.572+0000 7f666d79b700 1 --2- 172.21.15.8:0/2256507145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c323ca4c30 0x55c323caa650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.572+0000 7f666d79b700 1 -- 172.21.15.8:0/2256507145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c323c9ee20 msgr2=0x55c323c9e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:39:42.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.572+0000 7f666d79b700 1 --2- 172.21.15.8:0/2256507145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c323c9ee20 0x55c323c9e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.572+0000 7f666d79b700 1 -- 172.21.15.8:0/2256507145 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c323c9f4d0 con 0x55c323ca4310 2023-08-11T12:39:42.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.572+0000 7f666cf9a700 1 --2- 172.21.15.8:0/2256507145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c323c9ee20 0x55c323c9e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:39:42.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.572+0000 7f666d79b700 1 --2- 172.21.15.8:0/2256507145 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c323ca4310 0x55c323ca73b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6664000c00 tx=0x7f6664005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69be6759ffeea2ba server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:39:42.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.572+0000 7f6653fff700 1 -- 172.21.15.8:0/2256507145 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666401d040 con 0x55c323ca4310 2023-08-11T12:39:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.572+0000 7f6653fff700 1 -- 172.21.15.8:0/2256507145 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f666401e040 con 0x55c323ca4310 2023-08-11T12:39:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.572+0000 7f6653fff700 1 -- 172.21.15.8:0/2256507145 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6664024480 con 0x55c323ca4310 2023-08-11T12:39:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.573+0000 7f6683316b80 1 -- 172.21.15.8:0/2256507145 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c323ca4310 msgr2=0x55c323ca73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:39:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.573+0000 7f6683316b80 1 --2- 172.21.15.8:0/2256507145 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c323ca4310 0x55c323ca73b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6664000c00 tx=0x7f6664005e80 comp rx=0 tx=0).stop 2023-08-11T12:39:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.573+0000 7f6683316b80 1 -- 172.21.15.8:0/2256507145 shutdown_connections 2023-08-11T12:39:42.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.573+0000 7f6683316b80 1 --2- 172.21.15.8:0/2256507145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c323ca4c30 0x55c323caa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.573+0000 7f6683316b80 1 --2- 172.21.15.8:0/2256507145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c323c9ee20 0x55c323c9e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.573+0000 7f6683316b80 1 --2- 172.21.15.8:0/2256507145 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c323ca4310 0x55c323ca73b0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.573+0000 7f6683316b80 1 -- 172.21.15.8:0/2256507145 >> 172.21.15.8:0/2256507145 conn(0x55c323bcb950 msgr2=0x55c323c99280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:39:42.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.573+0000 7f6683316b80 1 -- 172.21.15.8:0/2256507145 shutdown_connections 2023-08-11T12:39:42.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.573+0000 7f6683316b80 1 -- 172.21.15.8:0/2256507145 wait complete. 2023-08-11T12:39:42.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.573+0000 7f6683316b80 1 -- start start 2023-08-11T12:39:42.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.574+0000 7f6683316b80 1 Processor -- start 2023-08-11T12:39:42.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.574+0000 7f6683316b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c323c9ee20 0x55c323caf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:42.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.574+0000 7f6683316b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c323ca4310 0x55c323cad570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.574+0000 7f6683316b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c323ca4c30 0x55c323cadab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.574+0000 7f6683316b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c323cafaa0 con 0x55c323c9ee20 2023-08-11T12:39:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.574+0000 7f6683316b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c323cadff0 con 0x55c323ca4c30 2023-08-11T12:39:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.574+0000 7f6683316b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c323cae160 con 0x55c323ca4310 2023-08-11T12:39:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.574+0000 7f6683316b80 10 client.0 _ll_register_callbacks cb 0x7f6664009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:39:42.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.574+0000 7f666cf9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c323c9ee20 0x55c323caf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:42.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.574+0000 7f666cf9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c323c9ee20 0x55c323caf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41894/0 (socket says 172.21.15.8:41894) 2023-08-11T12:39:42.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.574+0000 7f666d79b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c323ca4310 0x55c323cad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:42.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.574+0000 7f666cf9a700 1 -- 172.21.15.8:0/1765035967 learned_addr learned my addr 172.21.15.8:0/1765035967 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:39:42.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.574+0000 7f666cf9a700 1 --2- 172.21.15.8:0/1765035967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c323ca4c30 0x55c323cadab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:42.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.575+0000 7f666d79b700 1 -- 172.21.15.8:0/1765035967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c323ca4c30 msgr2=0x55c323cadab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:39:42.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.575+0000 7f666d79b700 1 --2- 172.21.15.8:0/1765035967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c323ca4c30 0x55c323cadab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.575+0000 7f666d79b700 1 -- 172.21.15.8:0/1765035967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c323c9ee20 msgr2=0x55c323caf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:39:42.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.575+0000 7f666d79b700 1 --2- 172.21.15.8:0/1765035967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c323c9ee20 0x55c323caf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.575+0000 7f666d79b700 1 -- 172.21.15.8:0/1765035967 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6658028040 con 0x55c323ca4310 2023-08-11T12:39:42.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.575+0000 7f666d79b700 1 --2- 172.21.15.8:0/1765035967 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c323ca4310 0x55c323cad570 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55c323c99a50 tx=0x7f6664009290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a217d5858d29bc8c server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:39:42.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.575+0000 7f6650ff9700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2023-08-11T12:39:42.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.575+0000 7f6650ff9700 1 -- 172.21.15.8:0/1765035967 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6664004e70 con 0x55c323ca4310 2023-08-11T12:39:42.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.575+0000 7f6683316b80 1 -- 172.21.15.8:0/1765035967 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f665800fcf0 con 0x55c323ca4310 2023-08-11T12:39:42.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.575+0000 7f6650ff9700 1 -- 172.21.15.8:0/1765035967 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 9366+0+0 (secure 0 0 0) 0x7f6664000e40 con 0x55c323ca4310 2023-08-11T12:39:42.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.576+0000 7f6650ff9700 1 -- 172.21.15.8:0/1765035967 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6664004710 con 0x55c323ca4310 2023-08-11T12:39:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.576+0000 7f6683316b80 10 client.26653 fetch_fsmap learned FSMap version 54 2023-08-11T12:39:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.576+0000 7f6683316b80 1 -- 172.21.15.8:0/1765035967 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x55c323a1cde0 con 0x55c323ca4310 2023-08-11T12:39:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.576+0000 7f6650ff9700 1 -- 172.21.15.8:0/1765035967 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f665800fcf0 con 0x55c323ca4310 2023-08-11T12:39:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.576+0000 7f6650ff9700 1 -- 172.21.15.8:0/1765035967 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6664024b00 con 0x55c323ca4310 2023-08-11T12:39:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.576+0000 7f6683316b80 10 client.26653 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:39:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.576+0000 7f6683316b80 10 client.26653 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:39:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.576+0000 7f6683316b80 20 client.26653 populate_metadata read hostname 'smithi008' 2023-08-11T12:39:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.576+0000 7f6683316b80 1 --2- 172.21.15.8:0/1765035967 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55c323d0d050 0x55c323d0f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:39:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.576+0000 7f6683316b80 4 client.26653 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:39:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.576+0000 7f6683316b80 1 -- 172.21.15.8:0/1765035967 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c323be9820 con 0x55c323d0d050 2023-08-11T12:39:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.576+0000 7f666cf9a700 1 --2- 172.21.15.8:0/1765035967 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55c323d0d050 0x55c323d0f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:39:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.577+0000 7f666cf9a700 1 --2- 172.21.15.8:0/1765035967 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55c323d0d050 0x55c323d0f470 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1db46a7e68a5e430 server_cookie=85efb5e661619b69 in_seq=0 out_seq=0 2023-08-11T12:39:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.577+0000 7f6650ff9700 10 client.26653 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:39:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.577+0000 7f6650ff9700 1 -- 172.21.15.8:0/1765035967 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55c323be9820 con 0x55c323d0d050 2023-08-11T12:39:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.577+0000 7f6650ff9700 10 client.26653 handle_command_reply: tid=0 2023-08-11T12:39:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.577+0000 7f6683316b80 1 client.26653 shutdown 2023-08-11T12:39:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.577+0000 7f6683316b80 1 -- 172.21.15.8:0/1765035967 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c323ca4310 msgr2=0x55c323cad570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:39:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.577+0000 7f6683316b80 1 --2- 172.21.15.8:0/1765035967 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c323ca4310 0x55c323cad570 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55c323c99a50 tx=0x7f6664009290 comp rx=0 tx=0).stop 2023-08-11T12:39:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.577+0000 7f6683316b80 1 -- 172.21.15.8:0/1765035967 shutdown_connections 2023-08-11T12:39:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.577+0000 7f6683316b80 1 --2- 172.21.15.8:0/1765035967 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x55c323d0d050 0x55c323d0f470 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.577+0000 7f6683316b80 1 --2- 172.21.15.8:0/1765035967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c323ca4c30 0x55c323cadab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.577+0000 7f6683316b80 1 --2- 172.21.15.8:0/1765035967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c323c9ee20 0x55c323caf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.577+0000 7f6650ff9700 0 client.26653 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:39:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.577+0000 7f6683316b80 1 --2- 172.21.15.8:0/1765035967 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c323ca4310 0x55c323cad570 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.577+0000 7f6683316b80 1 -- 172.21.15.8:0/1765035967 >> 172.21.15.8:0/1765035967 conn(0x55c323bcb950 msgr2=0x55c323c93420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:39:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.577+0000 7f6683316b80 1 -- 172.21.15.8:0/1765035967 shutdown_connections 2023-08-11T12:39:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.577+0000 7f6683316b80 1 -- 172.21.15.8:0/1765035967 wait complete. 2023-08-11T12:39:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.578+0000 7f6683316b80 20 client.26653 trim_cache size 0 max 16384 2023-08-11T12:39:42.594 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:39:42.595 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:39:42.595 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:39:42.595 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:39:42.595 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:39:42.596 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:39:42.596 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:39:42.596 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:39:42.596 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:39:42.596 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:39:42.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.578+0000 7f666f9ff700 1 -- 172.21.15.8:0/3952730989 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f66540a00c0 msgr2=0x7f66540a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:39:42.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.578+0000 7f666f9ff700 1 --2- 172.21.15.8:0/3952730989 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f66540a00c0 0x7f66540a2580 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6660098910 tx=0x7f6660009040 comp rx=0 tx=0).stop 2023-08-11T12:39:42.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.578+0000 7f666f9ff700 1 -- 172.21.15.8:0/3952730989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f666810af90 msgr2=0x7f66681a4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:39:42.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.578+0000 7f666f9ff700 1 --2- 172.21.15.8:0/3952730989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f666810af90 0x7f66681a4d00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f666000efc0 tx=0x7f666000c3a0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.578+0000 7f666f9ff700 1 -- 172.21.15.8:0/3952730989 shutdown_connections 2023-08-11T12:39:42.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.578+0000 7f666f9ff700 1 --2- 172.21.15.8:0/3952730989 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f66540a00c0 0x7f66540a2580 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.578+0000 7f666f9ff700 1 --2- 172.21.15.8:0/3952730989 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6668101bc0 0x7f66680ff810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.578+0000 7f666f9ff700 1 --2- 172.21.15.8:0/3952730989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f666810af90 0x7f66681a4d00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.578+0000 7f666f9ff700 1 --2- 172.21.15.8:0/3952730989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66681024e0 0x7f66680ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:39:42.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.578+0000 7f666f9ff700 1 -- 172.21.15.8:0/3952730989 >> 172.21.15.8:0/3952730989 conn(0x7f6668076a30 msgr2=0x7f66680fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:39:42.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.578+0000 7f666f9ff700 1 -- 172.21.15.8:0/3952730989 shutdown_connections 2023-08-11T12:39:42.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:39:42.578+0000 7f666f9ff700 1 -- 172.21.15.8:0/3952730989 wait complete. 2023-08-11T12:39:42.601 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:39:44.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:44 smithi008 ceph-mon[97158]: pgmap v474: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:39:44.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:44 smithi194 ceph-mon[130905]: pgmap v474: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:39:44.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:44 smithi045 ceph-mon[130284]: pgmap v474: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:39:46.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:46 smithi008 ceph-mon[97158]: pgmap v475: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:46.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:46 smithi194 ceph-mon[130905]: pgmap v475: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:46.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:46 smithi045 ceph-mon[130284]: pgmap v475: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:48.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:48 smithi008 ceph-mon[97158]: pgmap v476: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:48.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:48 smithi194 ceph-mon[130905]: pgmap v476: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:48.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:48 smithi045 ceph-mon[130284]: pgmap v476: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:50.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:50 smithi008 ceph-mon[97158]: pgmap v477: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:39:50.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:50 smithi194 ceph-mon[130905]: pgmap v477: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:39:50.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:50 smithi045 ceph-mon[130284]: pgmap v477: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:39:52.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:52 smithi008 ceph-mon[97158]: pgmap v478: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:52.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:52 smithi194 ceph-mon[130905]: pgmap v478: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:52.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:52 smithi045 ceph-mon[130284]: pgmap v478: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:54.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:54 smithi008 ceph-mon[97158]: pgmap v479: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:39:54.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:54 smithi194 ceph-mon[130905]: pgmap v479: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:39:54.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:54 smithi045 ceph-mon[130284]: pgmap v479: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:39:56.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:56 smithi008 ceph-mon[97158]: pgmap v480: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:56.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:56 smithi194 ceph-mon[130905]: pgmap v480: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:56.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:56 smithi045 ceph-mon[130284]: pgmap v480: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:57.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:57 smithi194 ceph-mon[130905]: pgmap v481: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:57.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:57 smithi045 ceph-mon[130284]: pgmap v481: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:57.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:57 smithi008 ceph-mon[97158]: pgmap v481: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:39:59.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:39:59 smithi194 ceph-mon[130905]: pgmap v482: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:39:59.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:39:59 smithi045 ceph-mon[130284]: pgmap v482: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:39:59.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:39:59 smithi008 ceph-mon[97158]: pgmap v482: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:40:01.302 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:00 smithi008 ceph-mon[97158]: overall HEALTH_OK 2023-08-11T12:40:01.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:00 smithi194 ceph-mon[130905]: overall HEALTH_OK 2023-08-11T12:40:01.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:00 smithi045 ceph-mon[130284]: overall HEALTH_OK 2023-08-11T12:40:02.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:01 smithi008 ceph-mon[97158]: pgmap v483: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:02.388 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:01 smithi045 ceph-mon[130284]: pgmap v483: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:02.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:01 smithi194 ceph-mon[130905]: pgmap v483: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:04.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:03 smithi008 ceph-mon[97158]: pgmap v484: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-11T12:40:04.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:03 smithi194 ceph-mon[130905]: pgmap v484: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-11T12:40:04.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:03 smithi045 ceph-mon[130284]: pgmap v484: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-11T12:40:06.142 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:06 smithi194 ceph-mon[130905]: pgmap v485: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:40:06.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:06 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:40:06.302 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:06 smithi008 ceph-mon[97158]: pgmap v485: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:40:06.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:06 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:40:06.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:06 smithi045 ceph-mon[130284]: pgmap v485: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:40:06.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:06 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-11T12:40:07.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:07 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:40:07.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:07 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:40:07.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:07 smithi008 ceph-mon[97158]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:40:07.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:07 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:40:07.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:07 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:40:07.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:07 smithi194 ceph-mon[130905]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:40:07.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:07 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-11T12:40:07.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:07 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-11T12:40:07.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:07 smithi045 ceph-mon[130284]: from='mgr.25601 ' entity='mgr.x' 2023-08-11T12:40:08.302 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:08 smithi008 ceph-mon[97158]: pgmap v486: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:40:08.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:08 smithi194 ceph-mon[130905]: pgmap v486: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:40:08.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:08 smithi045 ceph-mon[130284]: pgmap v486: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-11T12:40:09.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:09 smithi008 ceph-mon[97158]: osdmap e109: 12 total, 12 up, 12 in 2023-08-11T12:40:09.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:09 smithi194 ceph-mon[130905]: osdmap e109: 12 total, 12 up, 12 in 2023-08-11T12:40:09.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:09 smithi045 ceph-mon[130284]: osdmap e109: 12 total, 12 up, 12 in 2023-08-11T12:40:10.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:10 smithi008 ceph-mon[97158]: pgmap v488: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:40:10.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:10 smithi194 ceph-mon[130905]: pgmap v488: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:40:10.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:10 smithi045 ceph-mon[130284]: pgmap v488: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:40:12.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:12 smithi008 ceph-mon[97158]: pgmap v489: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:40:12.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:12 smithi194 ceph-mon[130905]: pgmap v489: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:40:12.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:12 smithi045 ceph-mon[130284]: pgmap v489: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-11T12:40:12.601 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-11T12:40:12.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.822+0000 7f4d0c9ff700 1 -- 172.21.15.8:0/1421200048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d08106970 msgr2=0x7f4d08106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:12.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.822+0000 7f4d0c9ff700 1 --2- 172.21.15.8:0/1421200048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d08106970 0x7f4d08106d50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8009990 tx=0x7f4cf8009ca0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.822+0000 7f4d0c9ff700 1 -- 172.21.15.8:0/1421200048 shutdown_connections 2023-08-11T12:40:12.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.822+0000 7f4d0c9ff700 1 --2- 172.21.15.8:0/1421200048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d08101320 0x7f4d0810d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.822+0000 7f4d0c9ff700 1 --2- 172.21.15.8:0/1421200048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d08106970 0x7f4d08106d50 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.822+0000 7f4d0c9ff700 1 --2- 172.21.15.8:0/1421200048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d08100960 0x7f4d08100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.822+0000 7f4d0c9ff700 1 -- 172.21.15.8:0/1421200048 >> 172.21.15.8:0/1421200048 conn(0x7f4d080fc490 msgr2=0x7f4d080fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:12.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.822+0000 7f4d0c9ff700 1 -- 172.21.15.8:0/1421200048 shutdown_connections 2023-08-11T12:40:12.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.822+0000 7f4d0c9ff700 1 -- 172.21.15.8:0/1421200048 wait complete. 2023-08-11T12:40:12.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.823+0000 7f4d0c9ff700 1 Processor -- start 2023-08-11T12:40:12.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.824+0000 7f4d0c9ff700 1 -- start start 2023-08-11T12:40:12.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.824+0000 7f4d0c9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d08100960 0x7f4d0819e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:12.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.824+0000 7f4d0c9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d08101320 0x7f4d0819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:12.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.824+0000 7f4d0c9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d08106970 0x7f4d08198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:12.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.824+0000 7f4d0c9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d081990b0 con 0x7f4d08100960 2023-08-11T12:40:12.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.824+0000 7f4d0c9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d08199220 con 0x7f4d08101320 2023-08-11T12:40:12.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.824+0000 7f4d0c9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d081993e0 con 0x7f4d08106970 2023-08-11T12:40:12.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.825+0000 7f4d0659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d08100960 0x7f4d0819e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:12.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.825+0000 7f4d05d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d08101320 0x7f4d0819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:12.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.825+0000 7f4d0659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d08100960 0x7f4d0819e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50542/0 (socket says 172.21.15.8:50542) 2023-08-11T12:40:12.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.825+0000 7f4d0659c700 1 -- 172.21.15.8:0/1848936499 learned_addr learned my addr 172.21.15.8:0/1848936499 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:40:12.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.825+0000 7f4d06d9d700 1 --2- 172.21.15.8:0/1848936499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d08106970 0x7f4d08198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:12.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.825+0000 7f4d0659c700 1 -- 172.21.15.8:0/1848936499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d08106970 msgr2=0x7f4d08198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:12.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.825+0000 7f4d0659c700 1 --2- 172.21.15.8:0/1848936499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d08106970 0x7f4d08198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.825+0000 7f4d0659c700 1 -- 172.21.15.8:0/1848936499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d08101320 msgr2=0x7f4d0819ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:12.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.825+0000 7f4d0659c700 1 --2- 172.21.15.8:0/1848936499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d08101320 0x7f4d0819ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.825+0000 7f4d0659c700 1 -- 172.21.15.8:0/1848936499 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf80095f0 con 0x7f4d08100960 2023-08-11T12:40:12.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.825+0000 7f4d05d9b700 1 --2- 172.21.15.8:0/1848936499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d08101320 0x7f4d0819ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:40:12.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.825+0000 7f4d0659c700 1 --2- 172.21.15.8:0/1848936499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d08100960 0x7f4d0819e9d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8005910 tx=0x7f4cf8005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:12.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.825+0000 7f4cf77fe700 1 -- 172.21.15.8:0/1848936499 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf801d070 con 0x7f4d08100960 2023-08-11T12:40:12.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.826+0000 7f4cf77fe700 1 -- 172.21.15.8:0/1848936499 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4cf8022470 con 0x7f4d08100960 2023-08-11T12:40:12.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.826+0000 7f4d0c9ff700 1 -- 172.21.15.8:0/1848936499 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d08199660 con 0x7f4d08100960 2023-08-11T12:40:12.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.826+0000 7f4cf77fe700 1 -- 172.21.15.8:0/1848936499 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8017650 con 0x7f4d08100960 2023-08-11T12:40:12.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.826+0000 7f4d0c9ff700 1 -- 172.21.15.8:0/1848936499 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d081a59c0 con 0x7f4d08100960 2023-08-11T12:40:12.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.829+0000 7f4cf77fe700 1 -- 172.21.15.8:0/1848936499 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f4cf800fad0 con 0x7f4d08100960 2023-08-11T12:40:12.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.830+0000 7f4d2035eb80 1 Processor -- start 2023-08-11T12:40:12.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.831+0000 7f4d2035eb80 1 -- start start 2023-08-11T12:40:12.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.831+0000 7f4cf77fe700 1 --2- 172.21.15.8:0/1848936499 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f4cf00a0140 0x7f4cf00a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:12.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.831+0000 7f4d2035eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5614bed91310 0x5614bed916f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:12.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.831+0000 7f4d2035eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614bed91c30 0x5614bed8b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:12.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.831+0000 7f4d2035eb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5614bed8be20 0x5614bed8c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:12.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.831+0000 7f4d2035eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614bece4630 con 0x5614bed91310 2023-08-11T12:40:12.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.831+0000 7f4d2035eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614bece1f50 con 0x5614bed91c30 2023-08-11T12:40:12.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.831+0000 7f4cf77fe700 1 -- 172.21.15.8:0/1848936499 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 9454+0+0 (secure 0 0 0) 0x7f4cf80cce80 con 0x7f4d08100960 2023-08-11T12:40:12.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.831+0000 7f4d2035eb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614becdd840 con 0x5614bed8be20 2023-08-11T12:40:12.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.831+0000 7f4d06d9d700 1 --2- 172.21.15.8:0/1848936499 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f4cf00a0140 0x7f4cf00a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:12.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.831+0000 7f4d05d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614bed91c30 0x5614bed8b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:12.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.831+0000 7f4d0659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5614bed91310 0x5614bed916f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:12.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.831+0000 7f4d05d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614bed91c30 0x5614bed8b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:49770/0 (socket says 172.21.15.8:49770) 2023-08-11T12:40:12.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.831+0000 7f4d05d9b700 1 -- 172.21.15.8:0/512482404 learned_addr learned my addr 172.21.15.8:0/512482404 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:40:12.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.831+0000 7f4d06d9d700 1 --2- 172.21.15.8:0/512482404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5614bed8be20 0x5614bed8c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:12.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.832+0000 7f4d05d9b700 1 -- 172.21.15.8:0/512482404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5614bed8be20 msgr2=0x5614bed8c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:40:12.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.832+0000 7f4d05d9b700 1 --2- 172.21.15.8:0/512482404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5614bed8be20 0x5614bed8c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.832+0000 7f4d05d9b700 1 -- 172.21.15.8:0/512482404 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5614bed91310 msgr2=0x5614bed916f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:40:12.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.832+0000 7f4d05d9b700 1 --2- 172.21.15.8:0/512482404 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5614bed91310 0x5614bed916f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.832+0000 7f4d05d9b700 1 -- 172.21.15.8:0/512482404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614beb5d630 con 0x5614bed91c30 2023-08-11T12:40:12.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.832+0000 7f4d0659c700 1 --2- 172.21.15.8:0/512482404 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5614bed91310 0x5614bed916f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:40:12.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.832+0000 7f4d05d9b700 1 --2- 172.21.15.8:0/512482404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614bed91c30 0x5614bed8b8e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc010580 tx=0x7f4cfc010890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15ab84c58885c978 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:12.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.832+0000 7f4d06d9d700 1 --2- 172.21.15.8:0/1848936499 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f4cf00a0140 0x7f4cf00a2600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4d00009ec0 tx=0x7f4d00009920 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:12.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.832+0000 7f4cf4ff9700 1 -- 172.21.15.8:0/512482404 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc01c680 con 0x5614bed91c30 2023-08-11T12:40:12.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.832+0000 7f4cf4ff9700 1 -- 172.21.15.8:0/512482404 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4cfc015070 con 0x5614bed91c30 2023-08-11T12:40:12.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.832+0000 7f4cf4ff9700 1 -- 172.21.15.8:0/512482404 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc011af0 con 0x5614bed91c30 2023-08-11T12:40:12.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.833+0000 7f4d2035eb80 1 -- 172.21.15.8:0/512482404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614bed91c30 msgr2=0x5614bed8b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:12.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.833+0000 7f4d2035eb80 1 --2- 172.21.15.8:0/512482404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614bed91c30 0x5614bed8b8e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc010580 tx=0x7f4cfc010890 comp rx=0 tx=0).stop 2023-08-11T12:40:12.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.833+0000 7f4d2035eb80 1 -- 172.21.15.8:0/512482404 shutdown_connections 2023-08-11T12:40:12.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.833+0000 7f4d2035eb80 1 --2- 172.21.15.8:0/512482404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5614bed8be20 0x5614bed8c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.833+0000 7f4d2035eb80 1 --2- 172.21.15.8:0/512482404 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5614bed91310 0x5614bed916f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.833+0000 7f4d2035eb80 1 --2- 172.21.15.8:0/512482404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614bed91c30 0x5614bed8b8e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.833+0000 7f4d2035eb80 1 -- 172.21.15.8:0/512482404 >> 172.21.15.8:0/512482404 conn(0x5614becb8950 msgr2=0x5614bed863d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:12.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.833+0000 7f4d2035eb80 1 -- 172.21.15.8:0/512482404 shutdown_connections 2023-08-11T12:40:12.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.833+0000 7f4d2035eb80 1 -- 172.21.15.8:0/512482404 wait complete. 2023-08-11T12:40:12.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.834+0000 7f4d2035eb80 1 -- start start 2023-08-11T12:40:12.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.834+0000 7f4d2035eb80 1 Processor -- start 2023-08-11T12:40:12.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.834+0000 7f4d2035eb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5614bed8be20 0x5614bed97bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:12.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.834+0000 7f4d2035eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614bed91310 0x5614bed94e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:12.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.834+0000 7f4d2035eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5614bed91c30 0x5614bed95570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:12.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.834+0000 7f4d2035eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614bec7bac0 con 0x5614bed91c30 2023-08-11T12:40:12.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.834+0000 7f4d2035eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614bec7b7c0 con 0x5614bed91310 2023-08-11T12:40:12.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.834+0000 7f4d2035eb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614beb5f920 con 0x5614bed8be20 2023-08-11T12:40:12.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.834+0000 7f4d2035eb80 10 client.0 _ll_register_callbacks cb 0x5614bec7eab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:40:12.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.834+0000 7f4d05d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614bed91310 0x5614bed94e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:12.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.835+0000 7f4d05d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614bed91310 0x5614bed94e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:49784/0 (socket says 172.21.15.8:49784) 2023-08-11T12:40:12.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.835+0000 7f4d05d9b700 1 -- 172.21.15.8:0/891701096 learned_addr learned my addr 172.21.15.8:0/891701096 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:40:12.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.835+0000 7f4d06d9d700 1 --2- 172.21.15.8:0/891701096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5614bed91c30 0x5614bed95570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:12.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.835+0000 7f4d0659c700 1 --2- 172.21.15.8:0/891701096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5614bed8be20 0x5614bed97bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:12.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.835+0000 7f4d05d9b700 1 -- 172.21.15.8:0/891701096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5614bed8be20 msgr2=0x5614bed97bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:40:12.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.835+0000 7f4d05d9b700 1 --2- 172.21.15.8:0/891701096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5614bed8be20 0x5614bed97bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.835+0000 7f4d05d9b700 1 -- 172.21.15.8:0/891701096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5614bed91c30 msgr2=0x5614bed95570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:40:12.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.835+0000 7f4d05d9b700 1 --2- 172.21.15.8:0/891701096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5614bed91c30 0x5614bed95570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.835+0000 7f4d05d9b700 1 -- 172.21.15.8:0/891701096 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d081a59c0 con 0x5614bed91310 2023-08-11T12:40:12.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.835+0000 7f4d0659c700 1 --2- 172.21.15.8:0/891701096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5614bed8be20 0x5614bed97bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-11T12:40:12.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.835+0000 7f4d05d9b700 1 --2- 172.21.15.8:0/891701096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614bed91310 0x5614bed94e80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc010550 tx=0x7f4cfc0129b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c67304c938b59926 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:12.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.835+0000 7f4cedffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:40:12.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.835+0000 7f4cedffb700 1 -- 172.21.15.8:0/891701096 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc004220 con 0x5614bed91310 2023-08-11T12:40:12.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.836+0000 7f4d2035eb80 1 -- 172.21.15.8:0/891701096 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5614bed7ea90 con 0x5614bed91310 2023-08-11T12:40:12.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.836+0000 7f4cedffb700 1 -- 172.21.15.8:0/891701096 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 9454+0+0 (secure 0 0 0) 0x7f4cfc022050 con 0x5614bed91310 2023-08-11T12:40:12.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.836+0000 7f4cedffb700 1 -- 172.21.15.8:0/891701096 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4cfc010eb0 con 0x5614bed91310 2023-08-11T12:40:12.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.836+0000 7f4d2035eb80 10 client.26672 fetch_fsmap learned FSMap version 54 2023-08-11T12:40:12.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.836+0000 7f4d2035eb80 1 -- 172.21.15.8:0/891701096 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x7f4cfc00bd50 con 0x5614bed91310 2023-08-11T12:40:12.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.836+0000 7f4cedffb700 1 -- 172.21.15.8:0/891701096 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5614bed7ea90 con 0x5614bed91310 2023-08-11T12:40:12.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.836+0000 7f4cedffb700 1 -- 172.21.15.8:0/891701096 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4cfc024070 con 0x5614bed91310 2023-08-11T12:40:12.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.836+0000 7f4d2035eb80 10 client.26672 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:40:12.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.836+0000 7f4d2035eb80 10 client.26672 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:40:12.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.837+0000 7f4d2035eb80 20 client.26672 populate_metadata read hostname 'smithi008' 2023-08-11T12:40:12.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.837+0000 7f4d2035eb80 1 --2- 172.21.15.8:0/891701096 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5614beda52e0 0x5614beda7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:12.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.837+0000 7f4d2035eb80 4 client.26672 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-11T12:40:12.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.837+0000 7f4d2035eb80 1 -- 172.21.15.8:0/891701096 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5614bed5a4e0 con 0x5614beda52e0 2023-08-11T12:40:12.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.837+0000 7f4d0659c700 1 --2- 172.21.15.8:0/891701096 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5614beda52e0 0x5614beda7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:12.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.837+0000 7f4d0659c700 1 --2- 172.21.15.8:0/891701096 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5614beda52e0 0x5614beda7700 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=667b9a8ee00c39 server_cookie=95888eec1a9e7925 in_seq=0 out_seq=0 2023-08-11T12:40:12.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.837+0000 7f4cedffb700 10 client.26672 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:40:12.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.838+0000 7f4cedffb700 1 -- 172.21.15.8:0/891701096 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5614bed5a4e0 con 0x5614beda52e0 2023-08-11T12:40:12.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.838+0000 7f4cedffb700 10 client.26672 handle_command_reply: tid=0 2023-08-11T12:40:12.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.838+0000 7f4d2035eb80 1 client.26672 shutdown 2023-08-11T12:40:12.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.839+0000 7f4d2035eb80 1 -- 172.21.15.8:0/891701096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614bed91310 msgr2=0x5614bed94e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:12.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.839+0000 7f4d2035eb80 1 --2- 172.21.15.8:0/891701096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614bed91310 0x5614bed94e80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc010550 tx=0x7f4cfc0129b0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.839+0000 7f4d2035eb80 1 -- 172.21.15.8:0/891701096 shutdown_connections 2023-08-11T12:40:12.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.839+0000 7f4d2035eb80 1 --2- 172.21.15.8:0/891701096 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5614beda52e0 0x5614beda7700 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.839+0000 7f4d2035eb80 1 --2- 172.21.15.8:0/891701096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5614bed8be20 0x5614bed97bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.839+0000 7f4d2035eb80 1 --2- 172.21.15.8:0/891701096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5614bed91c30 0x5614bed95570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.839+0000 7f4cedffb700 0 client.26672 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:40:12.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.839+0000 7f4d2035eb80 1 --2- 172.21.15.8:0/891701096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614bed91310 0x5614bed94e80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.839+0000 7f4d2035eb80 1 -- 172.21.15.8:0/891701096 >> 172.21.15.8:0/891701096 conn(0x5614becb8950 msgr2=0x5614bed80cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:12.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.839+0000 7f4d2035eb80 1 -- 172.21.15.8:0/891701096 shutdown_connections 2023-08-11T12:40:12.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.839+0000 7f4d2035eb80 1 -- 172.21.15.8:0/891701096 wait complete. 2023-08-11T12:40:12.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.839+0000 7f4d2035eb80 20 client.26672 trim_cache size 0 max 16384 2023-08-11T12:40:12.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.856+0000 7f4d2035eb80 1 Processor -- start 2023-08-11T12:40:12.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.857+0000 7f4d2035eb80 1 -- start start 2023-08-11T12:40:12.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.857+0000 7f4d2035eb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5614bed8be20 0x5614bed8b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:12.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.857+0000 7f4d2035eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5614bed91310 0x5614bed8f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:12.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.857+0000 7f4d2035eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614bed91c30 0x5614bed8f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:12.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.857+0000 7f4d2035eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614bed90f10 con 0x5614bed91310 2023-08-11T12:40:12.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.857+0000 7f4d2035eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614bed8fbd0 con 0x5614bed91c30 2023-08-11T12:40:12.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.857+0000 7f4d2035eb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614bed96310 con 0x5614bed8be20 2023-08-11T12:40:12.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.857+0000 7f4d05d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5614bed91310 0x5614bed8f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:12.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.857+0000 7f4d05d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5614bed91310 0x5614bed8f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50580/0 (socket says 172.21.15.8:50580) 2023-08-11T12:40:12.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.857+0000 7f4d05d9b700 1 -- 172.21.15.8:0/261724725 learned_addr learned my addr 172.21.15.8:0/261724725 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:40:12.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.857+0000 7f4d06d9d700 1 --2- 172.21.15.8:0/261724725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614bed91c30 0x5614bed8f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:12.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.857+0000 7f4d0659c700 1 --2- 172.21.15.8:0/261724725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5614bed8be20 0x5614bed8b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:12.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.857+0000 7f4d05d9b700 1 -- 172.21.15.8:0/261724725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5614bed8be20 msgr2=0x5614bed8b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:40:12.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.857+0000 7f4d05d9b700 1 --2- 172.21.15.8:0/261724725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5614bed8be20 0x5614bed8b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.857+0000 7f4d05d9b700 1 -- 172.21.15.8:0/261724725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614bed91c30 msgr2=0x5614bed8f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:40:12.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.857+0000 7f4d05d9b700 1 --2- 172.21.15.8:0/261724725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614bed91c30 0x5614bed8f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.858+0000 7f4d05d9b700 1 -- 172.21.15.8:0/261724725 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614beb09de0 con 0x5614bed91310 2023-08-11T12:40:12.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.858+0000 7f4d05d9b700 1 --2- 172.21.15.8:0/261724725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5614bed91310 0x5614bed8f060 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc003e30 tx=0x7f4cfc010480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3af6933538cdb0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:12.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.858+0000 7f4cf57fa700 1 -- 172.21.15.8:0/261724725 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc012ad0 con 0x5614bed91310 2023-08-11T12:40:12.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.858+0000 7f4cf57fa700 1 -- 172.21.15.8:0/261724725 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4cfc010eb0 con 0x5614bed91310 2023-08-11T12:40:12.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.858+0000 7f4cf57fa700 1 -- 172.21.15.8:0/261724725 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc005520 con 0x5614bed91310 2023-08-11T12:40:12.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.859+0000 7f4d2035eb80 1 -- 172.21.15.8:0/261724725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5614bed91310 msgr2=0x5614bed8f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:12.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.859+0000 7f4d2035eb80 1 --2- 172.21.15.8:0/261724725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5614bed91310 0x5614bed8f060 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc003e30 tx=0x7f4cfc010480 comp rx=0 tx=0).stop 2023-08-11T12:40:12.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.859+0000 7f4d2035eb80 1 -- 172.21.15.8:0/261724725 shutdown_connections 2023-08-11T12:40:12.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.859+0000 7f4d2035eb80 1 --2- 172.21.15.8:0/261724725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5614bed8be20 0x5614bed8b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.859+0000 7f4d2035eb80 1 --2- 172.21.15.8:0/261724725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614bed91c30 0x5614bed8f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.859+0000 7f4d2035eb80 1 --2- 172.21.15.8:0/261724725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5614bed91310 0x5614bed8f060 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.859+0000 7f4d2035eb80 1 -- 172.21.15.8:0/261724725 >> 172.21.15.8:0/261724725 conn(0x5614becb8950 msgr2=0x5614bed86340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:12.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.859+0000 7f4d2035eb80 1 -- 172.21.15.8:0/261724725 shutdown_connections 2023-08-11T12:40:12.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.859+0000 7f4d2035eb80 1 -- 172.21.15.8:0/261724725 wait complete. 2023-08-11T12:40:12.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.859+0000 7f4d2035eb80 1 -- start start 2023-08-11T12:40:12.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.859+0000 7f4d2035eb80 1 Processor -- start 2023-08-11T12:40:12.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.860+0000 7f4d2035eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614bed8be20 0x5614bed9c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:12.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.860+0000 7f4d2035eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5614bed91310 0x5614bed9a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:12.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.860+0000 7f4d2035eb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5614bed91c30 0x5614bed9abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:12.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.860+0000 7f4d2035eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614bed9b180 con 0x5614bed91310 2023-08-11T12:40:12.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.860+0000 7f4d2035eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614bed9b2c0 con 0x5614bed8be20 2023-08-11T12:40:12.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.860+0000 7f4d2035eb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614bed9b480 con 0x5614bed91c30 2023-08-11T12:40:12.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.860+0000 7f4d2035eb80 10 client.0 _ll_register_callbacks cb 0x7f4cf8022b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-11T12:40:12.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.860+0000 7f4d0659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614bed8be20 0x5614bed9c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:12.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.860+0000 7f4d0659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614bed8be20 0x5614bed9c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:49810/0 (socket says 172.21.15.8:49810) 2023-08-11T12:40:12.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.860+0000 7f4d0659c700 1 -- 172.21.15.8:0/3396367713 learned_addr learned my addr 172.21.15.8:0/3396367713 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:40:12.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.860+0000 7f4d05d9b700 1 --2- 172.21.15.8:0/3396367713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5614bed91310 0x5614bed9a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:12.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.860+0000 7f4d06d9d700 1 --2- 172.21.15.8:0/3396367713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5614bed91c30 0x5614bed9abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:12.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.861+0000 7f4d0659c700 1 -- 172.21.15.8:0/3396367713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5614bed91c30 msgr2=0x5614bed9abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:40:12.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.861+0000 7f4d0659c700 1 --2- 172.21.15.8:0/3396367713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5614bed91c30 0x5614bed9abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.861+0000 7f4d0659c700 1 -- 172.21.15.8:0/3396367713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5614bed91310 msgr2=0x5614bed9a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-11T12:40:12.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.861+0000 7f4d0659c700 1 --2- 172.21.15.8:0/3396367713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5614bed91310 0x5614bed9a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.861+0000 7f4d0659c700 1 -- 172.21.15.8:0/3396367713 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cfc00bd50 con 0x5614bed8be20 2023-08-11T12:40:12.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.861+0000 7f4d0659c700 1 --2- 172.21.15.8:0/3396367713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614bed8be20 0x5614bed9c3b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8022bd0 tx=0x7f4cf8005d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f0aff9db9fc2f94 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:12.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.861+0000 7f4cedffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-08-11T12:40:12.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.861+0000 7f4cedffb700 1 -- 172.21.15.8:0/3396367713 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf809a920 con 0x5614bed8be20 2023-08-11T12:40:12.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.861+0000 7f4cedffb700 1 -- 172.21.15.8:0/3396367713 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 9454+0+0 (secure 0 0 0) 0x7f4cf809a220 con 0x5614bed8be20 2023-08-11T12:40:12.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.861+0000 7f4d2035eb80 1 -- 172.21.15.8:0/3396367713 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4cfc015070 con 0x5614bed8be20 2023-08-11T12:40:12.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.861+0000 7f4cedffb700 1 -- 172.21.15.8:0/3396367713 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4cf809e050 con 0x5614bed8be20 2023-08-11T12:40:12.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.861+0000 7f4d2035eb80 10 client.26678 fetch_fsmap learned FSMap version 54 2023-08-11T12:40:12.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.861+0000 7f4d2035eb80 1 -- 172.21.15.8:0/3396367713 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x5614beaf2c60 con 0x5614bed8be20 2023-08-11T12:40:12.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.862+0000 7f4cedffb700 1 -- 172.21.15.8:0/3396367713 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4cfc015070 con 0x5614bed8be20 2023-08-11T12:40:12.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.862+0000 7f4cedffb700 1 -- 172.21.15.8:0/3396367713 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4cf80ca450 con 0x5614bed8be20 2023-08-11T12:40:12.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.862+0000 7f4d2035eb80 10 client.26678 fetch_fsmap finished waiting for FSMap version 54 2023-08-11T12:40:12.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.862+0000 7f4d2035eb80 10 client.26678 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-11T12:40:12.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.862+0000 7f4d2035eb80 20 client.26678 populate_metadata read hostname 'smithi008' 2023-08-11T12:40:12.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.862+0000 7f4d2035eb80 1 --2- 172.21.15.8:0/3396367713 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5614bedfa1a0 0x5614bedfc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:12.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.862+0000 7f4d2035eb80 4 client.26678 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-11T12:40:12.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.862+0000 7f4d2035eb80 1 -- 172.21.15.8:0/3396367713 --> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5614becd6820 con 0x5614bedfa1a0 2023-08-11T12:40:12.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.862+0000 7f4d05d9b700 1 --2- 172.21.15.8:0/3396367713 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5614bedfa1a0 0x5614bedfc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:12.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.862+0000 7f4d05d9b700 1 --2- 172.21.15.8:0/3396367713 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5614bedfa1a0 0x5614bedfc5c0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c6ad5f2e25e96a3 server_cookie=1707eab5b56553e3 in_seq=0 out_seq=0 2023-08-11T12:40:12.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.862+0000 7f4cedffb700 10 client.26678 ms_handle_connect on v2:172.21.15.45:6838/119684732 2023-08-11T12:40:12.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.863+0000 7f4cedffb700 1 -- 172.21.15.8:0/3396367713 <== mds.0 v2:172.21.15.45:6838/119684732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5614becd6820 con 0x5614bedfa1a0 2023-08-11T12:40:12.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.863+0000 7f4cedffb700 10 client.26678 handle_command_reply: tid=0 2023-08-11T12:40:12.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.863+0000 7f4d2035eb80 1 client.26678 shutdown 2023-08-11T12:40:12.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.863+0000 7f4d2035eb80 1 -- 172.21.15.8:0/3396367713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614bed8be20 msgr2=0x5614bed9c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:12.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.863+0000 7f4d2035eb80 1 --2- 172.21.15.8:0/3396367713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614bed8be20 0x5614bed9c3b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8022bd0 tx=0x7f4cf8005d40 comp rx=0 tx=0).stop 2023-08-11T12:40:12.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.863+0000 7f4d2035eb80 1 -- 172.21.15.8:0/3396367713 shutdown_connections 2023-08-11T12:40:12.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.863+0000 7f4d2035eb80 1 --2- 172.21.15.8:0/3396367713 >> [v2:172.21.15.45:6838/119684732,v1:172.21.15.45:6839/119684732] conn(0x5614bedfa1a0 0x5614bedfc5c0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.863+0000 7f4d2035eb80 1 --2- 172.21.15.8:0/3396367713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5614bed91c30 0x5614bed9abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.863+0000 7f4d2035eb80 1 --2- 172.21.15.8:0/3396367713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614bed8be20 0x5614bed9c3b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.863+0000 7f4cedffb700 0 client.26678 ms_handle_reset on v2:172.21.15.45:6838/119684732 2023-08-11T12:40:12.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.863+0000 7f4d2035eb80 1 --2- 172.21.15.8:0/3396367713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5614bed91310 0x5614bed9a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.863+0000 7f4d2035eb80 1 -- 172.21.15.8:0/3396367713 >> 172.21.15.8:0/3396367713 conn(0x5614becb8950 msgr2=0x5614bed8f060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:12.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.863+0000 7f4d2035eb80 1 -- 172.21.15.8:0/3396367713 shutdown_connections 2023-08-11T12:40:12.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.863+0000 7f4d2035eb80 1 -- 172.21.15.8:0/3396367713 wait complete. 2023-08-11T12:40:12.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.863+0000 7f4d2035eb80 20 client.26678 trim_cache size 0 max 16384 2023-08-11T12:40:12.888 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:40:12.889 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-11T12:40:12.889 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-08-11T12:40:12.889 INFO:teuthology.orchestra.run.smithi008.stdout: "5e68dd8f-a414-4964-873f-02d84fe4fbc6": { 2023-08-11T12:40:12.889 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-08-11T12:40:12.890 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5e68dd8f-a414-4964-873f-02d84fe4fbc6", 2023-08-11T12:40:12.890 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-08-11T12:40:12.890 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:12.890 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:12.891 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:40:12.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.864+0000 7f4d0c9ff700 1 -- 172.21.15.8:0/1848936499 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f4cf00a0140 msgr2=0x7f4cf00a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:12.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.864+0000 7f4d0c9ff700 1 --2- 172.21.15.8:0/1848936499 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f4cf00a0140 0x7f4cf00a2600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4d00009ec0 tx=0x7f4d00009920 comp rx=0 tx=0).stop 2023-08-11T12:40:12.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.864+0000 7f4d0c9ff700 1 -- 172.21.15.8:0/1848936499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d08100960 msgr2=0x7f4d0819e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:12.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.864+0000 7f4d0c9ff700 1 --2- 172.21.15.8:0/1848936499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d08100960 0x7f4d0819e9d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8005910 tx=0x7f4cf8005740 comp rx=0 tx=0).stop 2023-08-11T12:40:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.864+0000 7f4d0c9ff700 1 -- 172.21.15.8:0/1848936499 shutdown_connections 2023-08-11T12:40:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.864+0000 7f4d0c9ff700 1 --2- 172.21.15.8:0/1848936499 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f4cf00a0140 0x7f4cf00a2600 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.864+0000 7f4d0c9ff700 1 --2- 172.21.15.8:0/1848936499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d08106970 0x7f4d08198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.864+0000 7f4d0c9ff700 1 --2- 172.21.15.8:0/1848936499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d08100960 0x7f4d0819e9d0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.864+0000 7f4d0c9ff700 1 --2- 172.21.15.8:0/1848936499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d08101320 0x7f4d0819ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:12.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.864+0000 7f4d0c9ff700 1 -- 172.21.15.8:0/1848936499 >> 172.21.15.8:0/1848936499 conn(0x7f4d080fc490 msgr2=0x7f4d0810bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:12.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.864+0000 7f4d0c9ff700 1 -- 172.21.15.8:0/1848936499 shutdown_connections 2023-08-11T12:40:12.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:12.864+0000 7f4d0c9ff700 1 -- 172.21.15.8:0/1848936499 wait complete. 2023-08-11T12:40:12.895 INFO:tasks.cephfs.filesystem:scrub status for tag:5e68dd8f-a414-4964-873f-02d84fe4fbc6 - {'path': '/', 'tag': '5e68dd8f-a414-4964-873f-02d84fe4fbc6', 'options': 'recursive,force'} 2023-08-11T12:40:12.895 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_92684807f016ce045ac66e37fdde6f8c47857bcc/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_92684807f016ce045ac66e37fdde6f8c47857bcc/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_92684807f016ce045ac66e37fdde6f8c47857bcc/qa/tasks/fwd_scrub.py", line 76, in _scrub done = self.fs.wait_until_scrub_complete(tag=tag, sleep=30, timeout=self.scrub_timeout) File "/home/teuthworker/src/git.ceph.com_ceph-c_92684807f016ce045ac66e37fdde6f8c47857bcc/qa/tasks/cephfs/filesystem.py", line 1730, in wait_until_scrub_complete while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (31) after waiting for 900 seconds 2023-08-11T12:40:12.902 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_92684807f016ce045ac66e37fdde6f8c47857bcc/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_92684807f016ce045ac66e37fdde6f8c47857bcc/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-08-11T12:40:12.906 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-08-11T12:40:12.917 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-11T12:40:13.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.142+0000 7f29303ff700 1 -- 172.21.15.8:0/2761885199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2928100950 msgr2=0x7f2928100dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:13.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.142+0000 7f29303ff700 1 --2- 172.21.15.8:0/2761885199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2928100950 0x7f2928100dd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2918009990 tx=0x7f2918009ca0 comp rx=0 tx=0).stop 2023-08-11T12:40:13.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.142+0000 7f29303ff700 1 -- 172.21.15.8:0/2761885199 shutdown_connections 2023-08-11T12:40:13.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.142+0000 7f29303ff700 1 --2- 172.21.15.8:0/2761885199 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2928101310 0x7f292810d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:13.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.142+0000 7f29303ff700 1 --2- 172.21.15.8:0/2761885199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2928106960 0x7f2928106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:13.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.142+0000 7f29303ff700 1 --2- 172.21.15.8:0/2761885199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2928100950 0x7f2928100dd0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:13.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.142+0000 7f29303ff700 1 -- 172.21.15.8:0/2761885199 >> 172.21.15.8:0/2761885199 conn(0x7f29280fc460 msgr2=0x7f29280fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:13.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.142+0000 7f29303ff700 1 -- 172.21.15.8:0/2761885199 shutdown_connections 2023-08-11T12:40:13.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.143+0000 7f29303ff700 1 -- 172.21.15.8:0/2761885199 wait complete. 2023-08-11T12:40:13.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.144+0000 7f29303ff700 1 Processor -- start 2023-08-11T12:40:13.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.144+0000 7f29303ff700 1 -- start start 2023-08-11T12:40:13.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.144+0000 7f29303ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2928100950 0x7f292819c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:13.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.144+0000 7f29303ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2928101310 0x7f292819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:13.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.144+0000 7f29303ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2928106960 0x7f2928196840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:13.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.144+0000 7f29303ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2928196eb0 con 0x7f2928100950 2023-08-11T12:40:13.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.144+0000 7f29303ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2928197020 con 0x7f2928101310 2023-08-11T12:40:13.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.144+0000 7f29303ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29281971e0 con 0x7f2928106960 2023-08-11T12:40:13.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.144+0000 7f292d99a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2928101310 0x7f292819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:13.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.144+0000 7f292e19b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2928100950 0x7f292819c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:13.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.144+0000 7f292d99a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2928101310 0x7f292819cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:49834/0 (socket says 172.21.15.8:49834) 2023-08-11T12:40:13.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.144+0000 7f292d99a700 1 -- 172.21.15.8:0/787806973 learned_addr learned my addr 172.21.15.8:0/787806973 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:40:13.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.144+0000 7f292e19b700 1 --2- 172.21.15.8:0/787806973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2928100950 0x7f292819c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50608/0 (socket says 172.21.15.8:50608) 2023-08-11T12:40:13.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.145+0000 7f292e99c700 1 --2- 172.21.15.8:0/787806973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2928106960 0x7f2928196840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:13.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.145+0000 7f292e19b700 1 -- 172.21.15.8:0/787806973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2928106960 msgr2=0x7f2928196840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:13.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.145+0000 7f292e19b700 1 --2- 172.21.15.8:0/787806973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2928106960 0x7f2928196840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:13.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.145+0000 7f292e19b700 1 -- 172.21.15.8:0/787806973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2928101310 msgr2=0x7f292819cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:13.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.145+0000 7f292e19b700 1 --2- 172.21.15.8:0/787806973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2928101310 0x7f292819cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:13.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.145+0000 7f292e19b700 1 -- 172.21.15.8:0/787806973 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29180095f0 con 0x7f2928100950 2023-08-11T12:40:13.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.145+0000 7f292d99a700 1 --2- 172.21.15.8:0/787806973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2928101310 0x7f292819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:40:13.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.145+0000 7f292e19b700 1 --2- 172.21.15.8:0/787806973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2928100950 0x7f292819c7d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f292400e9f0 tx=0x7f292400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:13.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.145+0000 7f291f7fe700 1 -- 172.21.15.8:0/787806973 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292400c9c0 con 0x7f2928100950 2023-08-11T12:40:13.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.145+0000 7f291f7fe700 1 -- 172.21.15.8:0/787806973 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2924010430 con 0x7f2928100950 2023-08-11T12:40:13.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.145+0000 7f29303ff700 1 -- 172.21.15.8:0/787806973 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29281974c0 con 0x7f2928100950 2023-08-11T12:40:13.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.145+0000 7f291f7fe700 1 -- 172.21.15.8:0/787806973 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2924018680 con 0x7f2928100950 2023-08-11T12:40:13.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.145+0000 7f29303ff700 1 -- 172.21.15.8:0/787806973 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29281a37c0 con 0x7f2928100950 2023-08-11T12:40:13.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.146+0000 7f29303ff700 1 -- 172.21.15.8:0/787806973 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29280677a0 con 0x7f2928100950 2023-08-11T12:40:13.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.148+0000 7f291f7fe700 1 -- 172.21.15.8:0/787806973 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f2924010860 con 0x7f2928100950 2023-08-11T12:40:13.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.150+0000 7f291f7fe700 1 --2- 172.21.15.8:0/787806973 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f29140a0140 0x7f29140a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:13.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.151+0000 7f291f7fe700 1 -- 172.21.15.8:0/787806973 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 9454+0+0 (secure 0 0 0) 0x7f2924014070 con 0x7f2928100950 2023-08-11T12:40:13.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.151+0000 7f292d99a700 1 --2- 172.21.15.8:0/787806973 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f29140a0140 0x7f29140a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:13.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.151+0000 7f292d99a700 1 --2- 172.21.15.8:0/787806973 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f29140a0140 0x7f29140a2600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2928105f40 tx=0x7f291800b260 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:13.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.155+0000 7f291f7fe700 1 -- 172.21.15.8:0/787806973 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f2924051c30 con 0x7f2928100950 2023-08-11T12:40:13.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.369+0000 7f29303ff700 1 -- 172.21.15.8:0/787806973 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29281109e0 con 0x7f2928100950 2023-08-11T12:40:13.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.370+0000 7f291f7fe700 1 -- 172.21.15.8:0/787806973 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+25044 (secure 0 0 0) 0x7f2924095110 con 0x7f2928100950 2023-08-11T12:40:13.372 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:40:13.372 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":109,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","created":"2023-08-11T12:14:28.341113+0000","modified":"2023-08-11T12:40:08.006608+0000","last_up_change":"2023-08-11T12:21:14.913735+0000","last_in_change":"2023-08-11T12:20:57.476558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-11T12:17:49.040758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-11T12:22:01.383296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-11T12:22:02.816329+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":27,"snap_epoch":109,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-11T12:22:06.369375+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":27,"snap_epoch":109,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f903e393-7894-42d6-8b11-737ceef1f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6803","nonce":664104961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6805","nonce":664104961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6809","nonce":664104961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6807","nonce":664104961}]},"public_addr":"172.21.15.8:6803/664104961","cluster_addr":"172.21.15.8:6805/664104961","heartbeat_back_addr":"172.21.15.8:6809/664104961","heartbeat_front_addr":"172.21.15.8:6807/664104961","state":["exists","up"]},{"osd":1,"uuid":"1e988e5c-e78c-46d5-80a5-dff7ac38cbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6801","nonce":4187350703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6803","nonce":4187350703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6807","nonce":4187350703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6805","nonce":4187350703}]},"public_addr":"172.21.15.45:6801/4187350703","cluster_addr":"172.21.15.45:6803/4187350703","heartbeat_back_addr":"172.21.15.45:6807/4187350703","heartbeat_front_addr":"172.21.15.45:6805/4187350703","state":["exists","up"]},{"osd":2,"uuid":"1835217c-a93c-4181-b8b8-cc410bab1a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6801","nonce":2547818140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6803","nonce":2547818140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6807","nonce":2547818140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6805","nonce":2547818140}]},"public_addr":"172.21.15.194:6801/2547818140","cluster_addr":"172.21.15.194:6803/2547818140","heartbeat_back_addr":"172.21.15.194:6807/2547818140","heartbeat_front_addr":"172.21.15.194:6805/2547818140","state":["exists","up"]},{"osd":3,"uuid":"b55ae61a-731c-4312-a998-661122b84788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6811","nonce":187418883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6813","nonce":187418883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6817","nonce":187418883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6815","nonce":187418883}]},"public_addr":"172.21.15.8:6811/187418883","cluster_addr":"172.21.15.8:6813/187418883","heartbeat_back_addr":"172.21.15.8:6817/187418883","heartbeat_front_addr":"172.21.15.8:6815/187418883","state":["exists","up"]},{"osd":4,"uuid":"2c28acbb-e807-4559-8aa2-a35ca84b5d43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6809","nonce":3099704571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6811","nonce":3099704571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6815","nonce":3099704571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6813","nonce":3099704571}]},"public_addr":"172.21.15.45:6809/3099704571","cluster_addr":"172.21.15.45:6811/3099704571","heartbeat_back_addr":"172.21.15.45:6815/3099704571","heartbeat_front_addr":"172.21.15.45:6813/3099704571","state":["exists","up"]},{"osd":5,"uuid":"37032289-8016-4730-9b69-f7985e058ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6809","nonce":263803874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6811","nonce":263803874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6815","nonce":263803874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6813","nonce":263803874}]},"public_addr":"172.21.15.194:6809/263803874","cluster_addr":"172.21.15.194:6811/263803874","heartbeat_back_addr":"172.21.15.194:6815/263803874","heartbeat_front_addr":"172.21.15.194:6813/263803874","state":["exists","up"]},{"osd":6,"uuid":"32d2dab9-6944-40d1-ada9-4f941821b063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6819","nonce":1802966829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6821","nonce":1802966829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6825","nonce":1802966829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6823","nonce":1802966829}]},"public_addr":"172.21.15.8:6819/1802966829","cluster_addr":"172.21.15.8:6821/1802966829","heartbeat_back_addr":"172.21.15.8:6825/1802966829","heartbeat_front_addr":"172.21.15.8:6823/1802966829","state":["exists","up"]},{"osd":7,"uuid":"086aff58-1554-49fe-92ff-5166b115aeef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6817","nonce":3715737148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6819","nonce":3715737148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6823","nonce":3715737148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6821","nonce":3715737148}]},"public_addr":"172.21.15.45:6817/3715737148","cluster_addr":"172.21.15.45:6819/3715737148","heartbeat_back_addr":"172.21.15.45:6823/3715737148","heartbeat_front_addr":"172.21.15.45:6821/3715737148","state":["exists","up"]},{"osd":8,"uuid":"7fff5e95-2453-4ea6-a5c1-3bba6a1f6400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6817","nonce":57497127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6819","nonce":57497127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6823","nonce":57497127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6821","nonce":57497127}]},"public_addr":"172.21.15.194:6817/57497127","cluster_addr":"172.21.15.194:6819/57497127","heartbeat_back_addr":"172.21.15.194:6823/57497127","heartbeat_front_addr":"172.21.15.194:6821/57497127","state":["exists","up"]},{"osd":9,"uuid":"31ab0121-4c92-42ec-9f19-e672062e8814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6827","nonce":434661930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6829","nonce":434661930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6833","nonce":434661930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6831","nonce":434661930}]},"public_addr":"172.21.15.8:6827/434661930","cluster_addr":"172.21.15.8:6829/434661930","heartbeat_back_addr":"172.21.15.8:6833/434661930","heartbeat_front_addr":"172.21.15.8:6831/434661930","state":["exists","up"]},{"osd":10,"uuid":"62c632e4-94f6-4630-9d94-8d28fccacf45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6825","nonce":3281212184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6827","nonce":3281212184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6831","nonce":3281212184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6829","nonce":3281212184}]},"public_addr":"172.21.15.45:6825/3281212184","cluster_addr":"172.21.15.45:6827/3281212184","heartbeat_back_addr":"172.21.15.45:6831/3281212184","heartbeat_front_addr":"172.21.15.45:6829/3281212184","state":["exists","up"]},{"osd":11,"uuid":"8ca4a80d-cd75-4230-b46d-aef6fdc03e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6825","nonce":1637875895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6827","nonce":1637875895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6831","nonce":1637875895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6829","nonce":1637875895}]},"public_addr":"172.21.15.194:6825/1637875895","cluster_addr":"172.21.15.194:6827/1637875895","heartbeat_back_addr":"172.21.15.194:6831/1637875895","heartbeat_front_addr":"172.21.15.194:6829/1637875895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:04.255616+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:26.243863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:46.630365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:12.926291+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:35.747049+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:55.793767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:21.685725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:43.703215+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:04.043674+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:30.320026+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:52.751974+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:21:13.230024+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6801/2041276411":"2023-08-12T12:24:35.743200+0000","172.21.15.8:0/3461107704":"2023-08-12T12:24:35.743200+0000","172.21.15.8:0/340114165":"2023-08-12T12:24:35.743200+0000","172.21.15.8:0/2764282698":"2023-08-12T12:24:35.743200+0000","172.21.15.8:0/2000592056":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2102228072":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2132227156":"2023-08-12T12:24:35.743200+0000","172.21.15.8:6800/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:6800/2041276411":"2023-08-12T12:24:35.743200+0000","172.21.15.8:0/2374527928":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2928221278":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2744750874":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/3681755887":"2023-08-12T12:15:02.528403+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":14,"length":1},{"begin":27,"length":1}]},{"pool":4,"snaps":[{"begin":14,"length":1},{"begin":27,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":14,"length":1},{"begin":27,"length":1}]},{"pool":4,"snaps":[{"begin":14,"length":1},{"begin":27,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-11T12:40:13.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.373+0000 7f29303ff700 1 -- 172.21.15.8:0/787806973 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f29140a0140 msgr2=0x7f29140a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:13.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.373+0000 7f29303ff700 1 --2- 172.21.15.8:0/787806973 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f29140a0140 0x7f29140a2600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2928105f40 tx=0x7f291800b260 comp rx=0 tx=0).stop 2023-08-11T12:40:13.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.373+0000 7f29303ff700 1 -- 172.21.15.8:0/787806973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2928100950 msgr2=0x7f292819c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:13.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.373+0000 7f29303ff700 1 --2- 172.21.15.8:0/787806973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2928100950 0x7f292819c7d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f292400e9f0 tx=0x7f292400ed00 comp rx=0 tx=0).stop 2023-08-11T12:40:13.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.373+0000 7f29303ff700 1 -- 172.21.15.8:0/787806973 shutdown_connections 2023-08-11T12:40:13.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.373+0000 7f29303ff700 1 --2- 172.21.15.8:0/787806973 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f29140a0140 0x7f29140a2600 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:13.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.373+0000 7f29303ff700 1 --2- 172.21.15.8:0/787806973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2928106960 0x7f2928196840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:13.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.373+0000 7f29303ff700 1 --2- 172.21.15.8:0/787806973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2928100950 0x7f292819c7d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:13.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.373+0000 7f29303ff700 1 --2- 172.21.15.8:0/787806973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2928101310 0x7f292819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:13.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.373+0000 7f29303ff700 1 -- 172.21.15.8:0/787806973 >> 172.21.15.8:0/787806973 conn(0x7f29280fc460 msgr2=0x7f2928104460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:13.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.373+0000 7f29303ff700 1 -- 172.21.15.8:0/787806973 shutdown_connections 2023-08-11T12:40:13.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.373+0000 7f29303ff700 1 -- 172.21.15.8:0/787806973 wait complete. 2023-08-11T12:40:13.394 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-11T12:17:49.040758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-11T12:22:01.383296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-11T12:22:02.816329+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 27, 'snap_epoch': 109, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-11T12:22:06.369375+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 27, 'snap_epoch': 109, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-11T12:40:13.395 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-11T12:40:13.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.602+0000 7fd3a57ff700 1 -- 172.21.15.8:0/1621061170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3a0072d50 msgr2=0x7fd3a0073130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:13.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.602+0000 7fd3a57ff700 1 --2- 172.21.15.8:0/1621061170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3a0072d50 0x7fd3a0073130 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd390009990 tx=0x7fd390009ca0 comp rx=0 tx=0).stop 2023-08-11T12:40:13.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.602+0000 7fd3a57ff700 1 -- 172.21.15.8:0/1621061170 shutdown_connections 2023-08-11T12:40:13.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.602+0000 7fd3a57ff700 1 --2- 172.21.15.8:0/1621061170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3a010d1a0 0x7fd3a010f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:13.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.602+0000 7fd3a57ff700 1 --2- 172.21.15.8:0/1621061170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3a0072d50 0x7fd3a0073130 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:13.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.602+0000 7fd3a57ff700 1 --2- 172.21.15.8:0/1621061170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3a0073670 0x7fd3a010cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:13.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.602+0000 7fd3a57ff700 1 -- 172.21.15.8:0/1621061170 >> 172.21.15.8:0/1621061170 conn(0x7fd3a00fc490 msgr2=0x7fd3a00fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:13.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.602+0000 7fd3a57ff700 1 -- 172.21.15.8:0/1621061170 shutdown_connections 2023-08-11T12:40:13.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.602+0000 7fd3a57ff700 1 -- 172.21.15.8:0/1621061170 wait complete. 2023-08-11T12:40:13.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.603+0000 7fd3a57ff700 1 Processor -- start 2023-08-11T12:40:13.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.603+0000 7fd3a57ff700 1 -- start start 2023-08-11T12:40:13.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.604+0000 7fd3a57ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3a0072d50 0x7fd3a0198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:13.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.604+0000 7fd3a57ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3a0073670 0x7fd3a01991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:13.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.604+0000 7fd3a57ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3a010d1a0 0x7fd3a019c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:13.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.604+0000 7fd3a57ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a019cba0 con 0x7fd3a0072d50 2023-08-11T12:40:13.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.604+0000 7fd3a57ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a019cd10 con 0x7fd3a0073670 2023-08-11T12:40:13.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.604+0000 7fd3a57ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a019ced0 con 0x7fd3a010d1a0 2023-08-11T12:40:13.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.604+0000 7fd39effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3a0072d50 0x7fd3a0198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:13.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.604+0000 7fd39e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3a0073670 0x7fd3a01991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:13.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.604+0000 7fd39e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3a0073670 0x7fd3a01991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:49852/0 (socket says 172.21.15.8:49852) 2023-08-11T12:40:13.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.604+0000 7fd39e7fc700 1 -- 172.21.15.8:0/165856650 learned_addr learned my addr 172.21.15.8:0/165856650 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:40:13.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.604+0000 7fd39f7fe700 1 --2- 172.21.15.8:0/165856650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3a010d1a0 0x7fd3a019c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:13.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.605+0000 7fd39e7fc700 1 -- 172.21.15.8:0/165856650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3a010d1a0 msgr2=0x7fd3a019c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:13.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.605+0000 7fd39e7fc700 1 --2- 172.21.15.8:0/165856650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3a010d1a0 0x7fd3a019c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:13.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.605+0000 7fd39e7fc700 1 -- 172.21.15.8:0/165856650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3a0072d50 msgr2=0x7fd3a0198cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:13.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.605+0000 7fd39e7fc700 1 --2- 172.21.15.8:0/165856650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3a0072d50 0x7fd3a0198cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:13.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.605+0000 7fd39e7fc700 1 -- 172.21.15.8:0/165856650 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3900095f0 con 0x7fd3a0073670 2023-08-11T12:40:13.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.605+0000 7fd39effd700 1 --2- 172.21.15.8:0/165856650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3a0072d50 0x7fd3a0198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:40:13.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.605+0000 7fd39e7fc700 1 --2- 172.21.15.8:0/165856650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3a0073670 0x7fd3a01991f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd39400e9a0 tx=0x7fd39400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:13.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.605+0000 7fd387fff700 1 -- 172.21.15.8:0/165856650 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd394009790 con 0x7fd3a0073670 2023-08-11T12:40:13.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.605+0000 7fd3a57ff700 1 -- 172.21.15.8:0/165856650 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a019d1b0 con 0x7fd3a0073670 2023-08-11T12:40:13.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.605+0000 7fd387fff700 1 -- 172.21.15.8:0/165856650 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd394010430 con 0x7fd3a0073670 2023-08-11T12:40:13.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.605+0000 7fd387fff700 1 -- 172.21.15.8:0/165856650 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd394018680 con 0x7fd3a0073670 2023-08-11T12:40:13.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.605+0000 7fd3a57ff700 1 -- 172.21.15.8:0/165856650 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a01a5b10 con 0x7fd3a0073670 2023-08-11T12:40:13.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.606+0000 7fd3a57ff700 1 -- 172.21.15.8:0/165856650 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a00677a0 con 0x7fd3a0073670 2023-08-11T12:40:13.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.608+0000 7fd387fff700 1 -- 172.21.15.8:0/165856650 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7fd3940105a0 con 0x7fd3a0073670 2023-08-11T12:40:13.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.610+0000 7fd387fff700 1 --2- 172.21.15.8:0/165856650 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fd3880a0140 0x7fd3880a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:13.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.610+0000 7fd387fff700 1 -- 172.21.15.8:0/165856650 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 9454+0+0 (secure 0 0 0) 0x7fd394014070 con 0x7fd3a0073670 2023-08-11T12:40:13.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.610+0000 7fd39effd700 1 --2- 172.21.15.8:0/165856650 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fd3880a0140 0x7fd3880a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:13.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.611+0000 7fd39effd700 1 --2- 172.21.15.8:0/165856650 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fd3880a0140 0x7fd3880a2600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd39000b2e0 tx=0x7fd390005fb0 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:13.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.613+0000 7fd387fff700 1 -- 172.21.15.8:0/165856650 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fd394095460 con 0x7fd3a0073670 2023-08-11T12:40:13.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.832+0000 7fd3a57ff700 1 -- 172.21.15.8:0/165856650 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd3a0112b10 con 0x7fd3a0073670 2023-08-11T12:40:13.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.832+0000 7fd387fff700 1 -- 172.21.15.8:0/165856650 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v109) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd394026020 con 0x7fd3a0073670 2023-08-11T12:40:13.834 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-08-11T12:40:13.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.835+0000 7fd3a57ff700 1 -- 172.21.15.8:0/165856650 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fd3880a0140 msgr2=0x7fd3880a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:13.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.835+0000 7fd3a57ff700 1 --2- 172.21.15.8:0/165856650 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fd3880a0140 0x7fd3880a2600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd39000b2e0 tx=0x7fd390005fb0 comp rx=0 tx=0).stop 2023-08-11T12:40:13.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.835+0000 7fd3a57ff700 1 -- 172.21.15.8:0/165856650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3a0073670 msgr2=0x7fd3a01991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:13.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.835+0000 7fd3a57ff700 1 --2- 172.21.15.8:0/165856650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3a0073670 0x7fd3a01991f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd39400e9a0 tx=0x7fd39400ecb0 comp rx=0 tx=0).stop 2023-08-11T12:40:13.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.835+0000 7fd3a57ff700 1 -- 172.21.15.8:0/165856650 shutdown_connections 2023-08-11T12:40:13.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.835+0000 7fd3a57ff700 1 --2- 172.21.15.8:0/165856650 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fd3880a0140 0x7fd3880a2600 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:13.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.835+0000 7fd3a57ff700 1 --2- 172.21.15.8:0/165856650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3a010d1a0 0x7fd3a019c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:13.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.835+0000 7fd3a57ff700 1 --2- 172.21.15.8:0/165856650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3a0072d50 0x7fd3a0198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:13.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.835+0000 7fd3a57ff700 1 --2- 172.21.15.8:0/165856650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3a0073670 0x7fd3a01991f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:13.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.835+0000 7fd3a57ff700 1 -- 172.21.15.8:0/165856650 >> 172.21.15.8:0/165856650 conn(0x7fd3a00fc490 msgr2=0x7fd3a010f360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:13.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.835+0000 7fd3a57ff700 1 -- 172.21.15.8:0/165856650 shutdown_connections 2023-08-11T12:40:13.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:13.835+0000 7fd3a57ff700 1 -- 172.21.15.8:0/165856650 wait complete. 2023-08-11T12:40:13.855 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-11T12:40:14.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.064+0000 7f2d0c9ff700 1 -- 172.21.15.8:0/1190996295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d08106980 msgr2=0x7f2d08106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:14.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.064+0000 7f2d0c9ff700 1 --2- 172.21.15.8:0/1190996295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d08106980 0x7f2d08106d60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009990 tx=0x7f2cf8009ca0 comp rx=0 tx=0).stop 2023-08-11T12:40:14.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.064+0000 7f2d0c9ff700 1 -- 172.21.15.8:0/1190996295 shutdown_connections 2023-08-11T12:40:14.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.064+0000 7f2d0c9ff700 1 --2- 172.21.15.8:0/1190996295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d08101330 0x7f2d0810d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:14.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.064+0000 7f2d0c9ff700 1 --2- 172.21.15.8:0/1190996295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d08106980 0x7f2d08106d60 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:14.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.064+0000 7f2d0c9ff700 1 --2- 172.21.15.8:0/1190996295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d08100970 0x7f2d08100df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:14.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.064+0000 7f2d0c9ff700 1 -- 172.21.15.8:0/1190996295 >> 172.21.15.8:0/1190996295 conn(0x7f2d080fc460 msgr2=0x7f2d080fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:14.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.064+0000 7f2d0c9ff700 1 -- 172.21.15.8:0/1190996295 shutdown_connections 2023-08-11T12:40:14.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.064+0000 7f2d0c9ff700 1 -- 172.21.15.8:0/1190996295 wait complete. 2023-08-11T12:40:14.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.065+0000 7f2d0c9ff700 1 Processor -- start 2023-08-11T12:40:14.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.065+0000 7f2d0c9ff700 1 -- start start 2023-08-11T12:40:14.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.066+0000 7f2d0c9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d08100970 0x7f2d0819e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:14.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.066+0000 7f2d0c9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d08101330 0x7f2d0819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:14.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.066+0000 7f2d0c9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d08106980 0x7f2d081989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:14.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.066+0000 7f2d0c9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d081991a0 con 0x7f2d08100970 2023-08-11T12:40:14.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.066+0000 7f2d0c9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d08199310 con 0x7f2d08106980 2023-08-11T12:40:14.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.066+0000 7f2d0c9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d081994d0 con 0x7f2d08101330 2023-08-11T12:40:14.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.066+0000 7f2d0659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d08100970 0x7f2d0819e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:14.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.066+0000 7f2d06d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d08106980 0x7f2d081989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:14.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.066+0000 7f2d0659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d08100970 0x7f2d0819e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50648/0 (socket says 172.21.15.8:50648) 2023-08-11T12:40:14.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.066+0000 7f2d0659c700 1 -- 172.21.15.8:0/3565923710 learned_addr learned my addr 172.21.15.8:0/3565923710 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:40:14.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.066+0000 7f2cfffff700 1 --2- 172.21.15.8:0/3565923710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d08101330 0x7f2d0819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:14.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.066+0000 7f2d0659c700 1 -- 172.21.15.8:0/3565923710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d08101330 msgr2=0x7f2d0819ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:14.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.066+0000 7f2d0659c700 1 --2- 172.21.15.8:0/3565923710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d08101330 0x7f2d0819ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:14.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.066+0000 7f2d0659c700 1 -- 172.21.15.8:0/3565923710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d08106980 msgr2=0x7f2d081989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:14.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.066+0000 7f2d0659c700 1 --2- 172.21.15.8:0/3565923710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d08106980 0x7f2d081989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:14.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.067+0000 7f2d0659c700 1 -- 172.21.15.8:0/3565923710 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf80095f0 con 0x7f2d08100970 2023-08-11T12:40:14.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.067+0000 7f2d06d9d700 1 --2- 172.21.15.8:0/3565923710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d08106980 0x7f2d081989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:40:14.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.067+0000 7f2d0659c700 1 --2- 172.21.15.8:0/3565923710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d08100970 0x7f2d0819e9f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2cf800b2e0 tx=0x7f2cf8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:14.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.067+0000 7f2cff7fe700 1 -- 172.21.15.8:0/3565923710 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf801d070 con 0x7f2d08100970 2023-08-11T12:40:14.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.067+0000 7f2cff7fe700 1 -- 172.21.15.8:0/3565923710 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2cf8021410 con 0x7f2d08100970 2023-08-11T12:40:14.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.067+0000 7f2d0c9ff700 1 -- 172.21.15.8:0/3565923710 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d08199750 con 0x7f2d08100970 2023-08-11T12:40:14.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.067+0000 7f2cff7fe700 1 -- 172.21.15.8:0/3565923710 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8017650 con 0x7f2d08100970 2023-08-11T12:40:14.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.067+0000 7f2d0c9ff700 1 -- 172.21.15.8:0/3565923710 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d081a5970 con 0x7f2d08100970 2023-08-11T12:40:14.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.068+0000 7f2d0c9ff700 1 -- 172.21.15.8:0/3565923710 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d080677a0 con 0x7f2d08100970 2023-08-11T12:40:14.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.070+0000 7f2cff7fe700 1 -- 172.21.15.8:0/3565923710 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f2cf8021580 con 0x7f2d08100970 2023-08-11T12:40:14.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.072+0000 7f2cff7fe700 1 --2- 172.21.15.8:0/3565923710 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f2cf40a0140 0x7f2cf40a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:14.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.072+0000 7f2cff7fe700 1 -- 172.21.15.8:0/3565923710 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 9454+0+0 (secure 0 0 0) 0x7f2cf80ccb80 con 0x7f2d08100970 2023-08-11T12:40:14.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.072+0000 7f2cfffff700 1 --2- 172.21.15.8:0/3565923710 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f2cf40a0140 0x7f2cf40a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:14.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.072+0000 7f2cfffff700 1 --2- 172.21.15.8:0/3565923710 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f2cf40a0140 0x7f2cf40a2600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2d0819a200 tx=0x7f2cf0009260 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:14.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.075+0000 7f2cff7fe700 1 -- 172.21.15.8:0/3565923710 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f2cf80963d0 con 0x7f2d08100970 2023-08-11T12:40:14.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.286+0000 7f2d0c9ff700 1 -- 172.21.15.8:0/3565923710 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2d081108b0 con 0x7f2d08100970 2023-08-11T12:40:14.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.287+0000 7f2cff7fe700 1 -- 172.21.15.8:0/3565923710 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v109) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2cf80999f0 con 0x7f2d08100970 2023-08-11T12:40:14.289 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-08-11T12:40:14.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.289+0000 7f2d0c9ff700 1 -- 172.21.15.8:0/3565923710 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f2cf40a0140 msgr2=0x7f2cf40a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:14.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.289+0000 7f2d0c9ff700 1 --2- 172.21.15.8:0/3565923710 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f2cf40a0140 0x7f2cf40a2600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2d0819a200 tx=0x7f2cf0009260 comp rx=0 tx=0).stop 2023-08-11T12:40:14.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.289+0000 7f2d0c9ff700 1 -- 172.21.15.8:0/3565923710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d08100970 msgr2=0x7f2d0819e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:14.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.289+0000 7f2d0c9ff700 1 --2- 172.21.15.8:0/3565923710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d08100970 0x7f2d0819e9f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2cf800b2e0 tx=0x7f2cf8004730 comp rx=0 tx=0).stop 2023-08-11T12:40:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.289+0000 7f2d0c9ff700 1 -- 172.21.15.8:0/3565923710 shutdown_connections 2023-08-11T12:40:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.289+0000 7f2d0c9ff700 1 --2- 172.21.15.8:0/3565923710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d08106980 0x7f2d081989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.289+0000 7f2d0c9ff700 1 --2- 172.21.15.8:0/3565923710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d08100970 0x7f2d0819e9f0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.289+0000 7f2d0c9ff700 1 --2- 172.21.15.8:0/3565923710 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f2cf40a0140 0x7f2cf40a2600 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.289+0000 7f2d0c9ff700 1 --2- 172.21.15.8:0/3565923710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d08101330 0x7f2d0819ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:14.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.289+0000 7f2d0c9ff700 1 -- 172.21.15.8:0/3565923710 >> 172.21.15.8:0/3565923710 conn(0x7f2d080fc460 msgr2=0x7f2d0810bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:14.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.290+0000 7f2d0c9ff700 1 -- 172.21.15.8:0/3565923710 shutdown_connections 2023-08-11T12:40:14.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.290+0000 7f2d0c9ff700 1 -- 172.21.15.8:0/3565923710 wait complete. 2023-08-11T12:40:14.302 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:14 smithi008 ceph-mon[97158]: pgmap v490: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:40:14.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:14 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/787806973' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:40:14.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:14 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/165856650' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:40:14.309 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-11T12:40:14.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:14 smithi194 ceph-mon[130905]: pgmap v490: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:40:14.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:14 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/787806973' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:40:14.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:14 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/165856650' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:40:14.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:14 smithi045 ceph-mon[130284]: pgmap v490: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:40:14.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:14 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/787806973' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:40:14.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:14 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/165856650' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:40:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.517+0000 7fbc2dbff700 1 -- 172.21.15.8:0/3788736260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc28072d50 msgr2=0x7fbc28073130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.517+0000 7fbc2dbff700 1 --2- 172.21.15.8:0/3788736260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc28072d50 0x7fbc28073130 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbc18009990 tx=0x7fbc18009ca0 comp rx=0 tx=0).stop 2023-08-11T12:40:14.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.517+0000 7fbc2dbff700 1 -- 172.21.15.8:0/3788736260 shutdown_connections 2023-08-11T12:40:14.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.517+0000 7fbc2dbff700 1 --2- 172.21.15.8:0/3788736260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc2810d1a0 0x7fbc2810f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:14.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.517+0000 7fbc2dbff700 1 --2- 172.21.15.8:0/3788736260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc28072d50 0x7fbc28073130 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:14.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.517+0000 7fbc2dbff700 1 --2- 172.21.15.8:0/3788736260 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc28073670 0x7fbc2810cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:14.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.517+0000 7fbc2dbff700 1 -- 172.21.15.8:0/3788736260 >> 172.21.15.8:0/3788736260 conn(0x7fbc280fc490 msgr2=0x7fbc280fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:14.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.517+0000 7fbc2dbff700 1 -- 172.21.15.8:0/3788736260 shutdown_connections 2023-08-11T12:40:14.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.517+0000 7fbc2dbff700 1 -- 172.21.15.8:0/3788736260 wait complete. 2023-08-11T12:40:14.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.518+0000 7fbc2dbff700 1 Processor -- start 2023-08-11T12:40:14.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.518+0000 7fbc2dbff700 1 -- start start 2023-08-11T12:40:14.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.518+0000 7fbc2dbff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc28072d50 0x7fbc2819ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:14.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.518+0000 7fbc2dbff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc28073670 0x7fbc2819efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:14.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.518+0000 7fbc2dbff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc2810d1a0 0x7fbc28198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:14.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.518+0000 7fbc2dbff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc28199150 con 0x7fbc2810d1a0 2023-08-11T12:40:14.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.518+0000 7fbc2dbff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc281992c0 con 0x7fbc28073670 2023-08-11T12:40:14.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.518+0000 7fbc2dbff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc28199480 con 0x7fbc28072d50 2023-08-11T12:40:14.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.519+0000 7fbc26ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc28073670 0x7fbc2819efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:14.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.519+0000 7fbc26ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc28073670 0x7fbc2819efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:49900/0 (socket says 172.21.15.8:49900) 2023-08-11T12:40:14.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.519+0000 7fbc26ffd700 1 -- 172.21.15.8:0/391892607 learned_addr learned my addr 172.21.15.8:0/391892607 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:40:14.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.519+0000 7fbc277fe700 1 --2- 172.21.15.8:0/391892607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc28072d50 0x7fbc2819ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:14.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.519+0000 7fbc27fff700 1 --2- 172.21.15.8:0/391892607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc2810d1a0 0x7fbc28198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:14.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.519+0000 7fbc26ffd700 1 -- 172.21.15.8:0/391892607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc28072d50 msgr2=0x7fbc2819ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:14.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.519+0000 7fbc26ffd700 1 --2- 172.21.15.8:0/391892607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc28072d50 0x7fbc2819ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:14.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.519+0000 7fbc26ffd700 1 -- 172.21.15.8:0/391892607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc2810d1a0 msgr2=0x7fbc28198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:14.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.519+0000 7fbc26ffd700 1 --2- 172.21.15.8:0/391892607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc2810d1a0 0x7fbc28198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:14.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.519+0000 7fbc26ffd700 1 -- 172.21.15.8:0/391892607 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc180095f0 con 0x7fbc28073670 2023-08-11T12:40:14.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.519+0000 7fbc26ffd700 1 --2- 172.21.15.8:0/391892607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc28073670 0x7fbc2819efb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c00e9a0 tx=0x7fbc1c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:14.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.519+0000 7fbc24ff9700 1 -- 172.21.15.8:0/391892607 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c00ca10 con 0x7fbc28073670 2023-08-11T12:40:14.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.519+0000 7fbc24ff9700 1 -- 172.21.15.8:0/391892607 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbc1c00cb70 con 0x7fbc28073670 2023-08-11T12:40:14.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.519+0000 7fbc24ff9700 1 -- 172.21.15.8:0/391892607 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c018680 con 0x7fbc28073670 2023-08-11T12:40:14.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.520+0000 7fbc2dbff700 1 -- 172.21.15.8:0/391892607 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc28199760 con 0x7fbc28073670 2023-08-11T12:40:14.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.520+0000 7fbc2dbff700 1 -- 172.21.15.8:0/391892607 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc281a5a60 con 0x7fbc28073670 2023-08-11T12:40:14.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.521+0000 7fbc2dbff700 1 -- 172.21.15.8:0/391892607 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc280677a0 con 0x7fbc28073670 2023-08-11T12:40:14.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.523+0000 7fbc24ff9700 1 -- 172.21.15.8:0/391892607 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7fbc1c00cce0 con 0x7fbc28073670 2023-08-11T12:40:14.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.524+0000 7fbc24ff9700 1 --2- 172.21.15.8:0/391892607 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fbc100a0140 0x7fbc100a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:14.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.525+0000 7fbc24ff9700 1 -- 172.21.15.8:0/391892607 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 9454+0+0 (secure 0 0 0) 0x7fbc1c014070 con 0x7fbc28073670 2023-08-11T12:40:14.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.525+0000 7fbc277fe700 1 --2- 172.21.15.8:0/391892607 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fbc100a0140 0x7fbc100a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:14.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.525+0000 7fbc277fe700 1 --2- 172.21.15.8:0/391892607 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fbc100a0140 0x7fbc100a2600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800b2e0 tx=0x7fbc18005fd0 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:14.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.529+0000 7fbc24ff9700 1 -- 172.21.15.8:0/391892607 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fbc1c095510 con 0x7fbc28073670 2023-08-11T12:40:14.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.745+0000 7fbc2dbff700 1 -- 172.21.15.8:0/391892607 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbc28112bd0 con 0x7fbc28073670 2023-08-11T12:40:14.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.746+0000 7fbc24ff9700 1 -- 172.21.15.8:0/391892607 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v109) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbc1c0260a0 con 0x7fbc28073670 2023-08-11T12:40:14.748 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-08-11T12:40:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.748+0000 7fbc2dbff700 1 -- 172.21.15.8:0/391892607 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fbc100a0140 msgr2=0x7fbc100a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.748+0000 7fbc2dbff700 1 --2- 172.21.15.8:0/391892607 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fbc100a0140 0x7fbc100a2600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800b2e0 tx=0x7fbc18005fd0 comp rx=0 tx=0).stop 2023-08-11T12:40:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.748+0000 7fbc2dbff700 1 -- 172.21.15.8:0/391892607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc28073670 msgr2=0x7fbc2819efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.748+0000 7fbc2dbff700 1 --2- 172.21.15.8:0/391892607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc28073670 0x7fbc2819efb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c00e9a0 tx=0x7fbc1c00ecb0 comp rx=0 tx=0).stop 2023-08-11T12:40:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.748+0000 7fbc2dbff700 1 -- 172.21.15.8:0/391892607 shutdown_connections 2023-08-11T12:40:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.748+0000 7fbc2dbff700 1 --2- 172.21.15.8:0/391892607 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fbc100a0140 0x7fbc100a2600 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.748+0000 7fbc2dbff700 1 --2- 172.21.15.8:0/391892607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc28072d50 0x7fbc2819ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.748+0000 7fbc2dbff700 1 --2- 172.21.15.8:0/391892607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc2810d1a0 0x7fbc28198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.748+0000 7fbc2dbff700 1 --2- 172.21.15.8:0/391892607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc28073670 0x7fbc2819efb0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:14.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.748+0000 7fbc2dbff700 1 -- 172.21.15.8:0/391892607 >> 172.21.15.8:0/391892607 conn(0x7fbc280fc490 msgr2=0x7fbc2810f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:14.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.749+0000 7fbc2dbff700 1 -- 172.21.15.8:0/391892607 shutdown_connections 2023-08-11T12:40:14.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.749+0000 7fbc2dbff700 1 -- 172.21.15.8:0/391892607 wait complete. 2023-08-11T12:40:14.768 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-11T12:40:14.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.975+0000 7f3f31fff700 1 -- 172.21.15.8:0/1139872900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f2c106970 msgr2=0x7f3f2c106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:14.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.975+0000 7f3f31fff700 1 --2- 172.21.15.8:0/1139872900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f2c106970 0x7f3f2c106d50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c009990 tx=0x7f3f1c009ca0 comp rx=0 tx=0).stop 2023-08-11T12:40:14.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.975+0000 7f3f31fff700 1 -- 172.21.15.8:0/1139872900 shutdown_connections 2023-08-11T12:40:14.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.975+0000 7f3f31fff700 1 --2- 172.21.15.8:0/1139872900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f2c106970 0x7f3f2c106d50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:14.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.975+0000 7f3f31fff700 1 --2- 172.21.15.8:0/1139872900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f2c101320 0x7f3f2c10d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:14.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.975+0000 7f3f31fff700 1 --2- 172.21.15.8:0/1139872900 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f2c100960 0x7f3f2c100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:14.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.975+0000 7f3f31fff700 1 -- 172.21.15.8:0/1139872900 >> 172.21.15.8:0/1139872900 conn(0x7f3f2c0fc490 msgr2=0x7f3f2c0fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:14.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.975+0000 7f3f31fff700 1 -- 172.21.15.8:0/1139872900 shutdown_connections 2023-08-11T12:40:14.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.975+0000 7f3f31fff700 1 -- 172.21.15.8:0/1139872900 wait complete. 2023-08-11T12:40:14.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.977+0000 7f3f31fff700 1 Processor -- start 2023-08-11T12:40:14.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.977+0000 7f3f31fff700 1 -- start start 2023-08-11T12:40:14.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.978+0000 7f3f31fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f2c100960 0x7f3f2c072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:14.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.978+0000 7f3f31fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f2c101320 0x7f3f2c073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:14.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.978+0000 7f3f31fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f2c106970 0x7f3f2c1a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:14.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.978+0000 7f3f31fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c073990 con 0x7f3f2c101320 2023-08-11T12:40:14.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.978+0000 7f3f31fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c1a5140 con 0x7f3f2c106970 2023-08-11T12:40:14.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.978+0000 7f3f31fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c1a5280 con 0x7f3f2c100960 2023-08-11T12:40:14.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.978+0000 7f3f2affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f2c101320 0x7f3f2c073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:14.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.978+0000 7f3f2affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f2c101320 0x7f3f2c073160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50694/0 (socket says 172.21.15.8:50694) 2023-08-11T12:40:14.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.978+0000 7f3f2affd700 1 -- 172.21.15.8:0/140529172 learned_addr learned my addr 172.21.15.8:0/140529172 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:40:14.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.978+0000 7f3f2b7fe700 1 --2- 172.21.15.8:0/140529172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f2c100960 0x7f3f2c072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:14.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.978+0000 7f3f2bfff700 1 --2- 172.21.15.8:0/140529172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f2c106970 0x7f3f2c1a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:14.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.978+0000 7f3f2affd700 1 -- 172.21.15.8:0/140529172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f2c100960 msgr2=0x7f3f2c072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:14.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.978+0000 7f3f2affd700 1 --2- 172.21.15.8:0/140529172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f2c100960 0x7f3f2c072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:14.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.978+0000 7f3f2affd700 1 -- 172.21.15.8:0/140529172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f2c106970 msgr2=0x7f3f2c1a4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:14.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.978+0000 7f3f2affd700 1 --2- 172.21.15.8:0/140529172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f2c106970 0x7f3f2c1a4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:14.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.978+0000 7f3f2affd700 1 -- 172.21.15.8:0/140529172 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1c0095f0 con 0x7f3f2c101320 2023-08-11T12:40:14.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.979+0000 7f3f2affd700 1 --2- 172.21.15.8:0/140529172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f2c101320 0x7f3f2c073160 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000e9a0 tx=0x7f3f2000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:14.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.979+0000 7f3f28ff9700 1 -- 172.21.15.8:0/140529172 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f20009790 con 0x7f3f2c101320 2023-08-11T12:40:14.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.979+0000 7f3f31fff700 1 -- 172.21.15.8:0/140529172 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f2c1a54e0 con 0x7f3f2c101320 2023-08-11T12:40:14.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.979+0000 7f3f28ff9700 1 -- 172.21.15.8:0/140529172 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f20010430 con 0x7f3f2c101320 2023-08-11T12:40:14.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.979+0000 7f3f28ff9700 1 -- 172.21.15.8:0/140529172 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f20018680 con 0x7f3f2c101320 2023-08-11T12:40:14.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.979+0000 7f3f31fff700 1 -- 172.21.15.8:0/140529172 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f2c1a5a10 con 0x7f3f2c101320 2023-08-11T12:40:14.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.980+0000 7f3f31fff700 1 -- 172.21.15.8:0/140529172 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f2c0677a0 con 0x7f3f2c101320 2023-08-11T12:40:14.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.982+0000 7f3f28ff9700 1 -- 172.21.15.8:0/140529172 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f3f200105a0 con 0x7f3f2c101320 2023-08-11T12:40:14.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.983+0000 7f3f28ff9700 1 --2- 172.21.15.8:0/140529172 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f3f140a00c0 0x7f3f140a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:14.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.984+0000 7f3f28ff9700 1 -- 172.21.15.8:0/140529172 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 9454+0+0 (secure 0 0 0) 0x7f3f20014070 con 0x7f3f2c101320 2023-08-11T12:40:14.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.984+0000 7f3f2b7fe700 1 --2- 172.21.15.8:0/140529172 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f3f140a00c0 0x7f3f140a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:14.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.984+0000 7f3f2b7fe700 1 --2- 172.21.15.8:0/140529172 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f3f140a00c0 0x7f3f140a2580 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c00b2e0 tx=0x7f3f1c005fd0 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:14.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:14.987+0000 7f3f28ff9700 1 -- 172.21.15.8:0/140529172 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f3f20051c30 con 0x7f3f2c101320 2023-08-11T12:40:15.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.204+0000 7f3f31fff700 1 -- 172.21.15.8:0/140529172 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3f2c110900 con 0x7f3f2c101320 2023-08-11T12:40:15.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.204+0000 7f3f28ff9700 1 -- 172.21.15.8:0/140529172 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v110) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3f20095260 con 0x7f3f2c101320 2023-08-11T12:40:15.206 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-08-11T12:40:15.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.207+0000 7f3f31fff700 1 -- 172.21.15.8:0/140529172 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f3f140a00c0 msgr2=0x7f3f140a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.207+0000 7f3f31fff700 1 --2- 172.21.15.8:0/140529172 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f3f140a00c0 0x7f3f140a2580 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c00b2e0 tx=0x7f3f1c005fd0 comp rx=0 tx=0).stop 2023-08-11T12:40:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.207+0000 7f3f31fff700 1 -- 172.21.15.8:0/140529172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f2c101320 msgr2=0x7f3f2c073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.207+0000 7f3f31fff700 1 --2- 172.21.15.8:0/140529172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f2c101320 0x7f3f2c073160 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000e9a0 tx=0x7f3f2000ecb0 comp rx=0 tx=0).stop 2023-08-11T12:40:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.207+0000 7f3f31fff700 1 -- 172.21.15.8:0/140529172 shutdown_connections 2023-08-11T12:40:15.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.207+0000 7f3f31fff700 1 --2- 172.21.15.8:0/140529172 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f3f140a00c0 0x7f3f140a2580 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:15.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.207+0000 7f3f31fff700 1 --2- 172.21.15.8:0/140529172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f2c100960 0x7f3f2c072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:15.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.207+0000 7f3f31fff700 1 --2- 172.21.15.8:0/140529172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f2c106970 0x7f3f2c1a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:15.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.207+0000 7f3f31fff700 1 --2- 172.21.15.8:0/140529172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f2c101320 0x7f3f2c073160 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:15.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.207+0000 7f3f31fff700 1 -- 172.21.15.8:0/140529172 >> 172.21.15.8:0/140529172 conn(0x7f3f2c0fc490 msgr2=0x7f3f2c0fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:15.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.207+0000 7f3f31fff700 1 -- 172.21.15.8:0/140529172 shutdown_connections 2023-08-11T12:40:15.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.207+0000 7f3f31fff700 1 -- 172.21.15.8:0/140529172 wait complete. 2023-08-11T12:40:15.227 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-08-11T12:40:15.302 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:15 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3565923710' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:40:15.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:15 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/391892607' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:40:15.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:15 smithi008 ceph-mon[97158]: osdmap e110: 12 total, 12 up, 12 in 2023-08-11T12:40:15.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:15 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3565923710' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:40:15.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:15 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/391892607' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:40:15.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:15 smithi194 ceph-mon[130905]: osdmap e110: 12 total, 12 up, 12 in 2023-08-11T12:40:15.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:15 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3565923710' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:40:15.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:15 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/391892607' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:40:15.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:15 smithi045 ceph-mon[130284]: osdmap e110: 12 total, 12 up, 12 in 2023-08-11T12:40:15.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.446+0000 7f15b39ff700 1 -- 172.21.15.8:0/3282662266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15ac101300 msgr2=0x7f15ac10d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:15.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.446+0000 7f15b39ff700 1 --2- 172.21.15.8:0/3282662266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15ac101300 0x7f15ac10d810 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f15a400b0a0 tx=0x7f15a400b3b0 comp rx=0 tx=0).stop 2023-08-11T12:40:15.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.447+0000 7f15b39ff700 1 -- 172.21.15.8:0/3282662266 shutdown_connections 2023-08-11T12:40:15.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.447+0000 7f15b39ff700 1 --2- 172.21.15.8:0/3282662266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15ac101300 0x7f15ac10d810 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:15.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.447+0000 7f15b39ff700 1 --2- 172.21.15.8:0/3282662266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15ac106950 0x7f15ac106d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:15.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.447+0000 7f15b39ff700 1 --2- 172.21.15.8:0/3282662266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15ac100940 0x7f15ac100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:15.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.447+0000 7f15b39ff700 1 -- 172.21.15.8:0/3282662266 >> 172.21.15.8:0/3282662266 conn(0x7f15ac0fc430 msgr2=0x7f15ac0fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:15.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.447+0000 7f15b39ff700 1 -- 172.21.15.8:0/3282662266 shutdown_connections 2023-08-11T12:40:15.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.447+0000 7f15b39ff700 1 -- 172.21.15.8:0/3282662266 wait complete. 2023-08-11T12:40:15.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.448+0000 7f15b39ff700 1 Processor -- start 2023-08-11T12:40:15.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.448+0000 7f15b39ff700 1 -- start start 2023-08-11T12:40:15.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.448+0000 7f15b39ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15ac100940 0x7f15ac19e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:15.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.448+0000 7f15b39ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15ac101300 0x7f15ac19ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:15.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.448+0000 7f15b39ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15ac106950 0x7f15ac198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:15.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.448+0000 7f15b39ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac198fe0 con 0x7f15ac101300 2023-08-11T12:40:15.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.448+0000 7f15b39ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac199150 con 0x7f15ac100940 2023-08-11T12:40:15.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.448+0000 7f15b39ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac199310 con 0x7f15ac106950 2023-08-11T12:40:15.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.449+0000 7f15b179b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15ac100940 0x7f15ac19e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:15.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.449+0000 7f15b0f9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15ac101300 0x7f15ac19ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:15.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.449+0000 7f15b179b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15ac100940 0x7f15ac19e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:49946/0 (socket says 172.21.15.8:49946) 2023-08-11T12:40:15.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.449+0000 7f15b0f9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15ac101300 0x7f15ac19ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50712/0 (socket says 172.21.15.8:50712) 2023-08-11T12:40:15.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.449+0000 7f15b179b700 1 -- 172.21.15.8:0/243879608 learned_addr learned my addr 172.21.15.8:0/243879608 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:40:15.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.449+0000 7f15b1f9c700 1 --2- 172.21.15.8:0/243879608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15ac106950 0x7f15ac198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:15.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.449+0000 7f15b0f9a700 1 -- 172.21.15.8:0/243879608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15ac106950 msgr2=0x7f15ac198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:15.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.449+0000 7f15b0f9a700 1 --2- 172.21.15.8:0/243879608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15ac106950 0x7f15ac198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:15.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.449+0000 7f15b0f9a700 1 -- 172.21.15.8:0/243879608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15ac100940 msgr2=0x7f15ac19e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:15.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.449+0000 7f15b0f9a700 1 --2- 172.21.15.8:0/243879608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15ac100940 0x7f15ac19e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:15.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.449+0000 7f15b0f9a700 1 -- 172.21.15.8:0/243879608 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a8009520 con 0x7f15ac101300 2023-08-11T12:40:15.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.449+0000 7f15b179b700 1 --2- 172.21.15.8:0/243879608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15ac100940 0x7f15ac19e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:40:15.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.449+0000 7f15b0f9a700 1 --2- 172.21.15.8:0/243879608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15ac101300 0x7f15ac19ee40 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f159c00e9f0 tx=0x7f159c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:15.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.449+0000 7f15a27fc700 1 -- 172.21.15.8:0/243879608 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c00c9c0 con 0x7f15ac101300 2023-08-11T12:40:15.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.450+0000 7f15a27fc700 1 -- 172.21.15.8:0/243879608 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f159c010430 con 0x7f15ac101300 2023-08-11T12:40:15.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.450+0000 7f15b39ff700 1 -- 172.21.15.8:0/243879608 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a4009d00 con 0x7f15ac101300 2023-08-11T12:40:15.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.450+0000 7f15a27fc700 1 -- 172.21.15.8:0/243879608 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c018680 con 0x7f15ac101300 2023-08-11T12:40:15.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.450+0000 7f15b39ff700 1 -- 172.21.15.8:0/243879608 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ac1a5710 con 0x7f15ac101300 2023-08-11T12:40:15.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.451+0000 7f15b39ff700 1 -- 172.21.15.8:0/243879608 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ac0677a0 con 0x7f15ac101300 2023-08-11T12:40:15.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.453+0000 7f15a27fc700 1 -- 172.21.15.8:0/243879608 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f159c010860 con 0x7f15ac101300 2023-08-11T12:40:15.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.455+0000 7f15a27fc700 1 --2- 172.21.15.8:0/243879608 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f15980a00c0 0x7f15980a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:15.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.455+0000 7f15a27fc700 1 -- 172.21.15.8:0/243879608 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 9366+0+0 (secure 0 0 0) 0x7f159c014070 con 0x7f15ac101300 2023-08-11T12:40:15.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.455+0000 7f15b179b700 1 --2- 172.21.15.8:0/243879608 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f15980a00c0 0x7f15980a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:15.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.456+0000 7f15b179b700 1 --2- 172.21.15.8:0/243879608 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f15980a00c0 0x7f15980a2580 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f15a80116b0 tx=0x7f15a8009260 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:15.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.459+0000 7f15a27fc700 1 -- 172.21.15.8:0/243879608 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f159c051c30 con 0x7f15ac101300 2023-08-11T12:40:15.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.734+0000 7f15b39ff700 1 -- 172.21.15.8:0/243879608 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f15ac110970 con 0x7f15ac101300 2023-08-11T12:40:15.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.745+0000 7f15a27fc700 1 -- 172.21.15.8:0/243879608 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) v1 ==== 81+0+728377 (secure 0 0 0) 0x7f159c0951c0 con 0x7f15ac101300 2023-08-11T12:40:15.756 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:40:15.757 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:40:15.757 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 25, 2023-08-11T12:40:15.757 INFO:teuthology.orchestra.run.smithi008.stdout: "active_gid": 25601, 2023-08-11T12:40:15.757 INFO:teuthology.orchestra.run.smithi008.stdout: "active_name": "x", 2023-08-11T12:40:15.758 INFO:teuthology.orchestra.run.smithi008.stdout: "active_addrs": { 2023-08-11T12:40:15.758 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2023-08-11T12:40:15.758 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:15.758 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2023-08-11T12:40:15.759 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6800", 2023-08-11T12:40:15.759 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 3843802949 2023-08-11T12:40:15.759 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.759 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:15.759 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2023-08-11T12:40:15.760 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6801", 2023-08-11T12:40:15.760 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 3843802949 2023-08-11T12:40:15.761 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:15.761 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-11T12:40:15.761 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.761 INFO:teuthology.orchestra.run.smithi008.stdout: "active_addr": "172.21.15.8:6801/3843802949", 2023-08-11T12:40:15.761 INFO:teuthology.orchestra.run.smithi008.stdout: "active_change": "2023-08-11T12:24:35.743454+0000", 2023-08-11T12:40:15.762 INFO:teuthology.orchestra.run.smithi008.stdout: "active_mgr_features": 4540138322906710015, 2023-08-11T12:40:15.762 INFO:teuthology.orchestra.run.smithi008.stdout: "available": true, 2023-08-11T12:40:15.762 INFO:teuthology.orchestra.run.smithi008.stdout: "standbys": [ 2023-08-11T12:40:15.762 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:15.762 INFO:teuthology.orchestra.run.smithi008.stdout: "gid": 25598, 2023-08-11T12:40:15.763 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "y", 2023-08-11T12:40:15.763 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr_features": 4540138322906710015, 2023-08-11T12:40:15.763 INFO:teuthology.orchestra.run.smithi008.stdout: "available_modules": [ 2023-08-11T12:40:15.763 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:15.764 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "alerts", 2023-08-11T12:40:15.764 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:15.764 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:15.765 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:15.765 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-08-11T12:40:15.765 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-08-11T12:40:15.765 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:15.765 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.766 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.766 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-08-11T12:40:15.766 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.767 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.767 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.767 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How frequently to reexamine health status", 2023-08-11T12:40:15.767 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.768 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.768 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.768 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.768 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:15.768 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:15.769 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.769 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.769 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.769 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:15.769 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.770 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.770 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:15.770 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:15.770 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:15.770 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:15.771 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:15.771 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:15.771 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:15.771 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:15.772 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:15.772 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.772 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.772 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.772 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.773 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:15.773 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:15.773 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:15.773 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.773 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.774 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:15.774 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.774 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.774 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.774 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:15.775 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.775 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.775 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.775 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.775 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:15.776 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:15.776 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.776 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.776 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.776 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:15.777 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.777 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.777 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:15.777 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:15.777 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:15.778 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:15.778 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:15.778 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:15.778 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:15.779 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:15.779 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:15.779 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.779 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.779 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.780 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.780 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:15.780 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:15.780 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:15.780 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.781 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.781 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:15.781 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.781 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.781 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.782 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:15.782 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.782 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.782 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.782 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.783 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_destination": { 2023-08-11T12:40:15.783 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_destination", 2023-08-11T12:40:15.783 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.783 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.783 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.783 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:15.784 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.784 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.784 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.784 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Email address to send alerts to", 2023-08-11T12:40:15.785 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.785 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.785 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.785 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.785 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_from_name": { 2023-08-11T12:40:15.785 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_from_name", 2023-08-11T12:40:15.786 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.786 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.786 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.786 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "Ceph", 2023-08-11T12:40:15.786 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.787 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.787 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.787 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Email From: name", 2023-08-11T12:40:15.787 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.787 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.788 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.788 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.788 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_host": { 2023-08-11T12:40:15.788 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_host", 2023-08-11T12:40:15.789 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.789 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.789 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.789 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:15.789 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.790 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.790 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.790 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP server", 2023-08-11T12:40:15.790 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.790 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.791 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.791 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.791 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_password": { 2023-08-11T12:40:15.791 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_password", 2023-08-11T12:40:15.791 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.792 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.792 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.792 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:15.792 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.792 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.793 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.793 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Password to authenticate with", 2023-08-11T12:40:15.793 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.793 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.793 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.794 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.794 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_port": { 2023-08-11T12:40:15.794 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_port", 2023-08-11T12:40:15.794 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:15.794 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.795 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.795 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "465", 2023-08-11T12:40:15.795 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.796 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.796 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.796 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP port", 2023-08-11T12:40:15.796 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.797 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.797 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.797 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.797 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_sender": { 2023-08-11T12:40:15.797 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_sender", 2023-08-11T12:40:15.798 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.798 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.798 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.798 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:15.799 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.799 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.799 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.799 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP envelope sender", 2023-08-11T12:40:15.799 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.800 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.800 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.800 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.800 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_ssl": { 2023-08-11T12:40:15.801 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_ssl", 2023-08-11T12:40:15.801 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:15.801 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.801 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.801 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:15.802 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.802 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.802 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.802 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use SSL to connect to SMTP server", 2023-08-11T12:40:15.802 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.803 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.803 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.803 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.803 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_user": { 2023-08-11T12:40:15.803 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_user", 2023-08-11T12:40:15.804 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.804 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.804 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.804 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:15.804 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.805 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.805 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.805 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "User to authenticate as", 2023-08-11T12:40:15.805 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.805 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.806 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.806 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:15.806 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:15.806 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.806 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:15.807 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "balancer", 2023-08-11T12:40:15.807 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:15.807 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:15.807 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:15.807 INFO:teuthology.orchestra.run.smithi008.stdout: "active": { 2023-08-11T12:40:15.808 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "active", 2023-08-11T12:40:15.808 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:15.808 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.808 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.808 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:15.809 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.809 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.809 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.809 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "automatically balance PGs across cluster", 2023-08-11T12:40:15.809 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.810 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.810 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.810 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.810 INFO:teuthology.orchestra.run.smithi008.stdout: "begin_time": { 2023-08-11T12:40:15.810 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "begin_time", 2023-08-11T12:40:15.811 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.811 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.811 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.811 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0000", 2023-08-11T12:40:15.811 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.812 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.812 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.812 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "beginning time of day to automatically balance", 2023-08-11T12:40:15.812 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-08-11T12:40:15.812 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.813 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.813 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.813 INFO:teuthology.orchestra.run.smithi008.stdout: "begin_weekday": { 2023-08-11T12:40:15.813 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "begin_weekday", 2023-08-11T12:40:15.813 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-08-11T12:40:15.814 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.814 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.814 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-08-11T12:40:15.814 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0", 2023-08-11T12:40:15.814 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "6", 2023-08-11T12:40:15.815 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.815 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-08-11T12:40:15.815 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-08-11T12:40:15.815 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.815 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.816 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.816 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_max_iterations": { 2023-08-11T12:40:15.816 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_max_iterations", 2023-08-11T12:40:15.816 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-08-11T12:40:15.817 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.817 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.817 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "25", 2023-08-11T12:40:15.817 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-08-11T12:40:15.817 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "250", 2023-08-11T12:40:15.818 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.818 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-08-11T12:40:15.818 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.818 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.819 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.819 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_metrics": { 2023-08-11T12:40:15.819 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_metrics", 2023-08-11T12:40:15.819 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.820 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.820 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.820 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "pgs,objects,bytes", 2023-08-11T12:40:15.820 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.821 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.821 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.821 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-08-11T12:40:15.821 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-08-11T12:40:15.822 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.822 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.822 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.822 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_step": { 2023-08-11T12:40:15.822 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_step", 2023-08-11T12:40:15.823 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-08-11T12:40:15.823 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.823 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.823 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0.5", 2023-08-11T12:40:15.823 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0.001", 2023-08-11T12:40:15.824 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "0.999", 2023-08-11T12:40:15.824 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.824 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "aggressiveness of optimization", 2023-08-11T12:40:15.824 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-08-11T12:40:15.824 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.825 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.825 INFO:teuthology.orchestra.run.smithi008.stdout: "end_time": { 2023-08-11T12:40:15.825 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "end_time", 2023-08-11T12:40:15.825 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.826 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.826 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.826 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "2359", 2023-08-11T12:40:15.826 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.827 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.827 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.827 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "ending time of day to automatically balance", 2023-08-11T12:40:15.827 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-08-11T12:40:15.827 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.828 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.828 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.828 INFO:teuthology.orchestra.run.smithi008.stdout: "end_weekday": { 2023-08-11T12:40:15.828 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "end_weekday", 2023-08-11T12:40:15.828 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-08-11T12:40:15.829 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.829 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.829 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-08-11T12:40:15.829 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0", 2023-08-11T12:40:15.829 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "6", 2023-08-11T12:40:15.830 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.830 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-08-11T12:40:15.830 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-08-11T12:40:15.830 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.830 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.831 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.831 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:15.831 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:15.831 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.831 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.832 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.832 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:15.832 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.832 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.832 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:15.833 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:15.833 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:15.833 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:15.833 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:15.833 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:15.834 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:15.834 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:15.834 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:15.834 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.834 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.834 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.835 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.835 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:15.835 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:15.835 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:15.836 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.836 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.836 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:15.836 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.837 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.837 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.837 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:15.837 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.837 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.838 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.838 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.838 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:15.838 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:15.838 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.839 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.839 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.839 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:15.839 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.839 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.840 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:15.840 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:15.840 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:15.840 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:15.840 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:15.841 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:15.841 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:15.841 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:15.841 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:15.841 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.842 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.842 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.842 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.842 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:15.842 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:15.843 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:15.843 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.843 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.843 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:15.843 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.844 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.844 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.844 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:15.844 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.844 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.845 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.845 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.845 INFO:teuthology.orchestra.run.smithi008.stdout: "min_score": { 2023-08-11T12:40:15.845 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "min_score", 2023-08-11T12:40:15.845 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-08-11T12:40:15.846 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.846 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.846 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-08-11T12:40:15.846 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.846 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.847 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.847 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-08-11T12:40:15.847 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.847 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.847 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.848 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.848 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": { 2023-08-11T12:40:15.848 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mode", 2023-08-11T12:40:15.848 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.848 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.849 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.849 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "upmap", 2023-08-11T12:40:15.849 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.849 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.849 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:15.850 INFO:teuthology.orchestra.run.smithi008.stdout: "crush-compat", 2023-08-11T12:40:15.850 INFO:teuthology.orchestra.run.smithi008.stdout: "none", 2023-08-11T12:40:15.850 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap" 2023-08-11T12:40:15.850 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:15.850 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Balancer mode", 2023-08-11T12:40:15.851 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.851 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.851 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.851 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.851 INFO:teuthology.orchestra.run.smithi008.stdout: "pool_ids": { 2023-08-11T12:40:15.852 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pool_ids", 2023-08-11T12:40:15.852 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.852 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.852 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.852 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:15.853 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.853 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.853 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.853 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-08-11T12:40:15.853 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.854 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.854 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.854 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.854 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-08-11T12:40:15.854 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-08-11T12:40:15.854 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:15.855 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.855 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.855 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-08-11T12:40:15.855 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.855 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.856 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.856 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-08-11T12:40:15.856 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.856 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.856 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.857 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.857 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap_max_deviation": { 2023-08-11T12:40:15.857 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "upmap_max_deviation", 2023-08-11T12:40:15.857 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:15.857 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.858 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.858 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-08-11T12:40:15.858 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-08-11T12:40:15.858 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.858 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.859 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "deviation below which no optimization is attempted", 2023-08-11T12:40:15.859 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-08-11T12:40:15.859 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.859 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.859 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.860 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap_max_optimizations": { 2023-08-11T12:40:15.860 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "upmap_max_optimizations", 2023-08-11T12:40:15.860 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-08-11T12:40:15.860 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.860 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.861 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-08-11T12:40:15.861 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.861 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.861 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.861 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-08-11T12:40:15.862 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.862 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.862 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.862 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:15.863 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:15.863 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.863 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:15.863 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cephadm", 2023-08-11T12:40:15.864 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:15.864 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:15.864 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:15.864 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_down_multiplier": { 2023-08-11T12:40:15.864 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_down_multiplier", 2023-08-11T12:40:15.865 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-08-11T12:40:15.865 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.865 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.865 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3.0", 2023-08-11T12:40:15.865 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.866 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.866 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.866 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-08-11T12:40:15.866 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.867 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.867 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.867 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_refresh_rate": { 2023-08-11T12:40:15.867 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_refresh_rate", 2023-08-11T12:40:15.867 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:15.868 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.868 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.868 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "20", 2023-08-11T12:40:15.868 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.868 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.869 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.869 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-08-11T12:40:15.869 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.869 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.869 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.870 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.870 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_starting_port": { 2023-08-11T12:40:15.870 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_starting_port", 2023-08-11T12:40:15.870 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:15.870 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.871 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.871 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "4721", 2023-08-11T12:40:15.871 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.871 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.871 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.872 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-08-11T12:40:15.872 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.872 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.872 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.873 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_ptrace": { 2023-08-11T12:40:15.873 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_ptrace", 2023-08-11T12:40:15.873 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:15.873 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.874 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.874 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:15.874 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.874 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.874 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.875 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-08-11T12:40:15.875 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-08-11T12:40:15.875 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.875 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.876 INFO:teuthology.orchestra.run.smithi008.stdout: "autotune_interval": { 2023-08-11T12:40:15.876 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "autotune_interval", 2023-08-11T12:40:15.876 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:15.876 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.876 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.877 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-08-11T12:40:15.877 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.877 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.877 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.877 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to autotune daemon memory", 2023-08-11T12:40:15.878 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.878 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.878 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.878 INFO:teuthology.orchestra.run.smithi008.stdout: "autotune_memory_target_ratio": { 2023-08-11T12:40:15.879 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "autotune_memory_target_ratio", 2023-08-11T12:40:15.879 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-08-11T12:40:15.879 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.879 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.879 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0.7", 2023-08-11T12:40:15.880 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.880 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.880 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.880 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-08-11T12:40:15.880 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.881 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.881 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.881 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.881 INFO:teuthology.orchestra.run.smithi008.stdout: "cgroups_split": { 2023-08-11T12:40:15.881 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cgroups_split", 2023-08-11T12:40:15.882 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:15.882 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.882 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.882 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:15.882 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.883 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.883 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.883 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-08-11T12:40:15.883 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.883 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.884 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.884 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.884 INFO:teuthology.orchestra.run.smithi008.stdout: "config_checks_enabled": { 2023-08-11T12:40:15.884 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_checks_enabled", 2023-08-11T12:40:15.884 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:15.885 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.885 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.885 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:15.885 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.886 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.886 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.886 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-08-11T12:40:15.886 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.886 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.886 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.887 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.887 INFO:teuthology.orchestra.run.smithi008.stdout: "config_dashboard": { 2023-08-11T12:40:15.887 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_dashboard", 2023-08-11T12:40:15.887 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:15.887 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.888 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.888 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:15.888 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.888 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.888 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.889 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-08-11T12:40:15.889 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.889 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.889 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.889 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.890 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_alertmanager": { 2023-08-11T12:40:15.890 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_alertmanager", 2023-08-11T12:40:15.890 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.890 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.890 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.891 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-08-11T12:40:15.891 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.891 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.891 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.891 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-08-11T12:40:15.892 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.892 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.892 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.892 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_base": { 2023-08-11T12:40:15.893 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_base", 2023-08-11T12:40:15.893 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.893 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.893 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.893 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/ceph", 2023-08-11T12:40:15.894 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.894 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.894 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.894 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Container image name, without the tag", 2023-08-11T12:40:15.894 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.895 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.895 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.895 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.895 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_elasticsearch": { 2023-08-11T12:40:15.895 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_elasticsearch", 2023-08-11T12:40:15.895 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.896 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.896 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.896 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-08-11T12:40:15.897 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.897 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.897 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.897 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "elasticsearch container image", 2023-08-11T12:40:15.897 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.898 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.898 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.898 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.898 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_grafana": { 2023-08-11T12:40:15.898 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_grafana", 2023-08-11T12:40:15.899 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.899 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.899 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.899 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-08-11T12:40:15.899 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.900 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.900 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.900 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-08-11T12:40:15.900 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.900 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.901 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.901 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.901 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_haproxy": { 2023-08-11T12:40:15.901 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_haproxy", 2023-08-11T12:40:15.901 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.902 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.902 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.902 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-08-11T12:40:15.902 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.902 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.902 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.903 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "HAproxy container image", 2023-08-11T12:40:15.903 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.903 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.903 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.903 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.904 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_agent": { 2023-08-11T12:40:15.904 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_agent", 2023-08-11T12:40:15.904 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.904 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.904 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.905 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-08-11T12:40:15.905 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.905 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.905 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.905 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger agent container image", 2023-08-11T12:40:15.906 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.906 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.906 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.906 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.907 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_collector": { 2023-08-11T12:40:15.907 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_collector", 2023-08-11T12:40:15.907 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.907 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.907 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.908 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-08-11T12:40:15.908 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.908 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.908 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.908 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger collector container image", 2023-08-11T12:40:15.909 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.909 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.909 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.909 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.909 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_query": { 2023-08-11T12:40:15.910 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_query", 2023-08-11T12:40:15.910 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.910 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.910 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.910 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-08-11T12:40:15.911 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.911 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.911 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.911 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger query container image", 2023-08-11T12:40:15.911 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.912 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.912 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.912 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.912 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_keepalived": { 2023-08-11T12:40:15.912 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_keepalived", 2023-08-11T12:40:15.913 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.913 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.913 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.913 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-08-11T12:40:15.914 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.914 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.914 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.914 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Keepalived container image", 2023-08-11T12:40:15.914 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.915 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.915 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.915 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.915 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_loki": { 2023-08-11T12:40:15.915 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_loki", 2023-08-11T12:40:15.916 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.916 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.916 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.916 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-08-11T12:40:15.916 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.917 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.917 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.917 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Loki container image", 2023-08-11T12:40:15.917 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.917 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.918 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.918 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.918 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_node_exporter": { 2023-08-11T12:40:15.918 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_node_exporter", 2023-08-11T12:40:15.918 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.919 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.919 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.919 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-08-11T12:40:15.919 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.919 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.920 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.920 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-08-11T12:40:15.920 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.920 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.920 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.921 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.921 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_nvmeof": { 2023-08-11T12:40:15.921 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_nvmeof", 2023-08-11T12:40:15.921 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.921 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.922 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.922 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.1", 2023-08-11T12:40:15.922 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.922 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.922 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.923 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Nvme-of container image", 2023-08-11T12:40:15.923 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.923 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.923 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.923 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.924 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_prometheus": { 2023-08-11T12:40:15.924 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_prometheus", 2023-08-11T12:40:15.924 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.924 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.924 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.925 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-08-11T12:40:15.925 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.925 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.925 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.925 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-08-11T12:40:15.926 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.926 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.926 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.926 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.926 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_promtail": { 2023-08-11T12:40:15.927 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_promtail", 2023-08-11T12:40:15.927 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.927 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.927 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.927 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-08-11T12:40:15.928 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.928 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.928 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.928 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Promtail container image", 2023-08-11T12:40:15.928 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.929 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.929 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.929 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.929 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_snmp_gateway": { 2023-08-11T12:40:15.929 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_snmp_gateway", 2023-08-11T12:40:15.930 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.930 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.930 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.930 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-08-11T12:40:15.930 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.931 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.931 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.931 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SNMP Gateway container image", 2023-08-11T12:40:15.931 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.931 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.932 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.932 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.932 INFO:teuthology.orchestra.run.smithi008.stdout: "container_init": { 2023-08-11T12:40:15.932 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_init", 2023-08-11T12:40:15.932 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:15.933 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.933 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.933 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:15.933 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.933 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.934 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.934 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Run podman/docker with `--init`", 2023-08-11T12:40:15.934 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.934 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.934 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.935 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.935 INFO:teuthology.orchestra.run.smithi008.stdout: "daemon_cache_timeout": { 2023-08-11T12:40:15.935 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "daemon_cache_timeout", 2023-08-11T12:40:15.935 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:15.935 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.936 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.936 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-08-11T12:40:15.936 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.936 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.936 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.937 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-08-11T12:40:15.937 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.937 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.937 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.937 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.937 INFO:teuthology.orchestra.run.smithi008.stdout: "default_cephadm_command_timeout": { 2023-08-11T12:40:15.938 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "default_cephadm_command_timeout", 2023-08-11T12:40:15.938 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:15.938 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.938 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.938 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "900", 2023-08-11T12:40:15.939 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.939 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.939 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.939 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-08-11T12:40:15.939 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.940 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.940 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.940 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.940 INFO:teuthology.orchestra.run.smithi008.stdout: "default_registry": { 2023-08-11T12:40:15.941 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "default_registry", 2023-08-11T12:40:15.941 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.941 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.941 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.941 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io", 2023-08-11T12:40:15.942 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.942 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.942 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.942 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-08-11T12:40:15.942 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.943 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.943 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.943 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.943 INFO:teuthology.orchestra.run.smithi008.stdout: "device_cache_timeout": { 2023-08-11T12:40:15.943 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_cache_timeout", 2023-08-11T12:40:15.944 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:15.944 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.944 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.944 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1800", 2023-08-11T12:40:15.944 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.945 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.945 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.945 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache device inventory", 2023-08-11T12:40:15.945 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.945 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.946 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.946 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.946 INFO:teuthology.orchestra.run.smithi008.stdout: "device_enhanced_scan": { 2023-08-11T12:40:15.946 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_enhanced_scan", 2023-08-11T12:40:15.946 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:15.947 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.947 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.947 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:15.947 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.947 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.948 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.948 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use libstoragemgmt during device scans", 2023-08-11T12:40:15.948 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.948 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.948 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.949 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.949 INFO:teuthology.orchestra.run.smithi008.stdout: "facts_cache_timeout": { 2023-08-11T12:40:15.949 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "facts_cache_timeout", 2023-08-11T12:40:15.949 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:15.949 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.950 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.950 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-08-11T12:40:15.950 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.950 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.950 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.950 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache host facts data", 2023-08-11T12:40:15.951 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.951 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.951 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.951 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.951 INFO:teuthology.orchestra.run.smithi008.stdout: "host_check_interval": { 2023-08-11T12:40:15.952 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "host_check_interval", 2023-08-11T12:40:15.952 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:15.952 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.952 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.952 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-08-11T12:40:15.953 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.953 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.953 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.953 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to perform a host check", 2023-08-11T12:40:15.953 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.954 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.954 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.954 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.954 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:15.954 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:15.955 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.955 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.955 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.955 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:15.955 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.956 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.956 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:15.956 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:15.956 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:15.956 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:15.957 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:15.957 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:15.957 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:15.957 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:15.957 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:15.958 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.958 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.958 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.958 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.958 INFO:teuthology.orchestra.run.smithi008.stdout: "log_refresh_metadata": { 2023-08-11T12:40:15.959 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_refresh_metadata", 2023-08-11T12:40:15.959 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:15.959 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.959 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.959 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:15.960 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.960 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.960 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.960 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-08-11T12:40:15.960 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.961 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.961 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.961 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:15.961 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:15.962 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:15.962 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.962 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.962 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:15.962 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.962 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.963 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.963 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-08-11T12:40:15.963 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.963 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.963 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.964 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.964 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:15.964 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:15.964 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.965 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.965 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.965 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:15.965 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.965 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.966 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:15.966 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:15.966 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:15.966 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:15.966 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:15.967 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:15.967 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:15.967 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:15.967 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:15.967 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.967 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.968 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.968 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.968 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:15.968 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:15.968 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:15.969 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.969 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:15.969 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:15.969 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.969 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.970 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.970 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:15.970 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.970 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.970 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.971 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.971 INFO:teuthology.orchestra.run.smithi008.stdout: "manage_etc_ceph_ceph_conf": { 2023-08-11T12:40:15.971 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-08-11T12:40:15.971 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:15.971 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.972 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.972 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:15.972 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.972 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.972 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.973 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-08-11T12:40:15.973 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.973 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.973 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.973 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.974 INFO:teuthology.orchestra.run.smithi008.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-08-11T12:40:15.974 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-08-11T12:40:15.974 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.974 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.974 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.975 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "*", 2023-08-11T12:40:15.975 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.975 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.975 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.975 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-08-11T12:40:15.976 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.976 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.976 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.976 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.976 INFO:teuthology.orchestra.run.smithi008.stdout: "max_count_per_host": { 2023-08-11T12:40:15.977 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_count_per_host", 2023-08-11T12:40:15.977 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:15.977 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.977 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.977 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-08-11T12:40:15.978 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.978 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.978 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.978 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "max number of daemons per service per host", 2023-08-11T12:40:15.978 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.979 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.979 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.979 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.979 INFO:teuthology.orchestra.run.smithi008.stdout: "max_osd_draining_count": { 2023-08-11T12:40:15.979 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_osd_draining_count", 2023-08-11T12:40:15.980 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:15.980 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.980 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.980 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-08-11T12:40:15.980 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.981 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.981 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.981 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-08-11T12:40:15.981 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.981 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.982 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.982 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.982 INFO:teuthology.orchestra.run.smithi008.stdout: "migration_current": { 2023-08-11T12:40:15.982 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "migration_current", 2023-08-11T12:40:15.982 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:15.983 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.983 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.983 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:15.983 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.983 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.984 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.984 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "internal - do not modify", 2023-08-11T12:40:15.984 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.984 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.984 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.985 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.985 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": { 2023-08-11T12:40:15.985 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mode", 2023-08-11T12:40:15.985 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.985 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.986 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.986 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "root", 2023-08-11T12:40:15.986 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.986 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.986 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:15.987 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm-package", 2023-08-11T12:40:15.987 INFO:teuthology.orchestra.run.smithi008.stdout: "root" 2023-08-11T12:40:15.987 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:15.987 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "mode for remote execution of cephadm", 2023-08-11T12:40:15.987 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.988 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.988 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.988 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.988 INFO:teuthology.orchestra.run.smithi008.stdout: "prometheus_alerts_path": { 2023-08-11T12:40:15.988 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prometheus_alerts_path", 2023-08-11T12:40:15.989 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.989 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.989 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.989 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-08-11T12:40:15.989 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.990 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.990 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.990 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-08-11T12:40:15.990 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.990 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.991 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.991 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.991 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_insecure": { 2023-08-11T12:40:15.991 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_insecure", 2023-08-11T12:40:15.991 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:15.991 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.992 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.992 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:15.992 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.992 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.992 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.993 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-08-11T12:40:15.993 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.993 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.993 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.993 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.994 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_password": { 2023-08-11T12:40:15.994 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_password", 2023-08-11T12:40:15.994 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.994 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.995 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.995 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:15.995 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.995 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.996 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.996 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-08-11T12:40:15.996 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:15.997 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:15.997 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:15.997 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:15.997 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_url": { 2023-08-11T12:40:15.998 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_url", 2023-08-11T12:40:15.998 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:15.998 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:15.998 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:15.999 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:15.999 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:15.999 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:15.999 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:15.999 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-08-11T12:40:16.000 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.000 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.000 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.000 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.000 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_username": { 2023-08-11T12:40:16.001 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_username", 2023-08-11T12:40:16.001 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.001 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.001 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.001 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.002 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.002 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.002 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.002 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-08-11T12:40:16.002 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.003 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.003 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.003 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.003 INFO:teuthology.orchestra.run.smithi008.stdout: "secure_monitoring_stack": { 2023-08-11T12:40:16.003 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "secure_monitoring_stack", 2023-08-11T12:40:16.004 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.004 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.004 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.004 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.004 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.005 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.005 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.005 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-08-11T12:40:16.005 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.005 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.006 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.006 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.006 INFO:teuthology.orchestra.run.smithi008.stdout: "service_discovery_port": { 2023-08-11T12:40:16.006 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "service_discovery_port", 2023-08-11T12:40:16.006 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.007 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.007 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.007 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8765", 2023-08-11T12:40:16.007 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.007 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.007 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.008 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "cephadm service discovery port", 2023-08-11T12:40:16.008 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.008 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.008 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.009 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.009 INFO:teuthology.orchestra.run.smithi008.stdout: "ssh_config_file": { 2023-08-11T12:40:16.009 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssh_config_file", 2023-08-11T12:40:16.009 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.009 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.009 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.010 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.010 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.010 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.010 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.011 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-08-11T12:40:16.011 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.011 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.011 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.011 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.012 INFO:teuthology.orchestra.run.smithi008.stdout: "use_agent": { 2023-08-11T12:40:16.012 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "use_agent", 2023-08-11T12:40:16.012 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.012 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.012 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.013 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.013 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.013 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.013 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.013 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-08-11T12:40:16.014 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.014 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.014 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.014 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.014 INFO:teuthology.orchestra.run.smithi008.stdout: "use_repo_digest": { 2023-08-11T12:40:16.015 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "use_repo_digest", 2023-08-11T12:40:16.015 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.015 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.015 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.015 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.016 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.016 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.016 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.016 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-08-11T12:40:16.016 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.017 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.017 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.017 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.017 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_failed_host_check": { 2023-08-11T12:40:16.017 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_failed_host_check", 2023-08-11T12:40:16.018 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.018 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.018 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.018 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.018 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.019 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.019 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.019 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if the host check fails", 2023-08-11T12:40:16.019 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.019 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.020 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.020 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.020 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_stray_daemons": { 2023-08-11T12:40:16.020 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_stray_daemons", 2023-08-11T12:40:16.020 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.021 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.021 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.021 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.021 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.022 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.022 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.022 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-08-11T12:40:16.022 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.022 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.023 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.023 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.023 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_stray_hosts": { 2023-08-11T12:40:16.023 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_stray_hosts", 2023-08-11T12:40:16.023 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.023 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.024 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.024 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.024 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.024 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.025 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.025 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-08-11T12:40:16.025 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.025 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.025 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.026 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.026 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.026 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.026 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.026 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crash", 2023-08-11T12:40:16.026 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.027 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.027 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.027 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.027 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.027 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.028 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.028 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.028 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.028 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.028 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.029 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.029 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.029 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.029 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.029 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.030 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.030 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.030 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.030 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.030 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.031 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.031 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.031 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.031 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.031 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.032 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.032 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.032 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.032 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.032 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.033 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.033 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.033 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.033 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.033 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.034 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.034 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.034 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.034 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.034 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.034 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.035 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.035 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.035 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.035 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.035 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.036 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.036 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.036 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.036 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.036 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.037 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.037 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.037 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.037 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.037 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.038 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.038 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.038 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.038 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.038 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.039 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.039 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.039 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.039 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.039 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.040 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.040 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.040 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.040 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.040 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.041 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.041 INFO:teuthology.orchestra.run.smithi008.stdout: "retain_interval": { 2023-08-11T12:40:16.041 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "retain_interval", 2023-08-11T12:40:16.041 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:16.041 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.042 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.042 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "31536000", 2023-08-11T12:40:16.042 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.042 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.042 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.043 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long to retain crashes before pruning them", 2023-08-11T12:40:16.043 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.043 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.043 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.043 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.044 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_recent_interval": { 2023-08-11T12:40:16.044 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_recent_interval", 2023-08-11T12:40:16.044 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:16.044 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.044 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.045 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1209600", 2023-08-11T12:40:16.045 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.045 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.045 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.045 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "time interval in which to warn about recent crashes", 2023-08-11T12:40:16.045 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.046 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.046 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.046 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.046 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.047 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.047 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.047 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "dashboard", 2023-08-11T12:40:16.047 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.047 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.048 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.048 INFO:teuthology.orchestra.run.smithi008.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-08-11T12:40:16.048 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-08-11T12:40:16.048 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.048 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.049 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.049 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-08-11T12:40:16.049 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.049 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.049 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.050 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.050 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.050 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.050 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.050 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.051 INFO:teuthology.orchestra.run.smithi008.stdout: "ALERTMANAGER_API_HOST": { 2023-08-11T12:40:16.051 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ALERTMANAGER_API_HOST", 2023-08-11T12:40:16.051 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.051 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.052 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.052 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.052 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.052 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.053 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.053 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.053 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.053 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.053 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.054 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.054 INFO:teuthology.orchestra.run.smithi008.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-08-11T12:40:16.054 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-08-11T12:40:16.054 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.054 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.055 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.055 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.055 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.055 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.055 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.056 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.056 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.056 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.056 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.056 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.057 INFO:teuthology.orchestra.run.smithi008.stdout: "AUDIT_API_ENABLED": { 2023-08-11T12:40:16.057 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "AUDIT_API_ENABLED", 2023-08-11T12:40:16.057 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.057 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.057 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.058 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.058 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.058 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.058 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.058 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.059 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.059 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.059 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.059 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.059 INFO:teuthology.orchestra.run.smithi008.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-08-11T12:40:16.060 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-08-11T12:40:16.060 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.060 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.060 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.060 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.061 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.061 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.061 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.061 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.061 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.062 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.062 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.062 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.062 INFO:teuthology.orchestra.run.smithi008.stdout: "ENABLE_BROWSABLE_API": { 2023-08-11T12:40:16.062 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ENABLE_BROWSABLE_API", 2023-08-11T12:40:16.063 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.063 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.063 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.063 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.063 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.064 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.064 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.064 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.064 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.064 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.065 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.065 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.065 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-08-11T12:40:16.065 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-08-11T12:40:16.066 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.066 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.066 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.066 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.066 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.067 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.067 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.067 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.067 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.067 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.068 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.068 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.068 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-08-11T12:40:16.068 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-08-11T12:40:16.068 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.069 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.069 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.069 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.069 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.069 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.070 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.070 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.070 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.070 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.071 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.071 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.071 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-08-11T12:40:16.071 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-08-11T12:40:16.071 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.072 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.072 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.072 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.072 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.072 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.073 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.073 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.073 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.073 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.073 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.074 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.074 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-08-11T12:40:16.074 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-08-11T12:40:16.074 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.074 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.075 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.075 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.075 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.075 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.075 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.076 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.076 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.076 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.076 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.076 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.077 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_NFS": { 2023-08-11T12:40:16.077 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-08-11T12:40:16.077 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.077 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.077 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.078 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.078 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.078 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.078 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.078 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.079 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.079 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.079 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.079 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.079 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_RBD": { 2023-08-11T12:40:16.080 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-08-11T12:40:16.080 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.080 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.080 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.080 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.081 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.081 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.081 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.081 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.081 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.082 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.082 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.082 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.082 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_RGW": { 2023-08-11T12:40:16.082 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-08-11T12:40:16.083 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.083 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.083 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.083 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.083 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.084 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.084 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.084 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.084 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.084 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.085 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.085 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.085 INFO:teuthology.orchestra.run.smithi008.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-08-11T12:40:16.085 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-08-11T12:40:16.086 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.086 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.086 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.086 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.086 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.087 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.087 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.087 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.087 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.087 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.088 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.088 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.088 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_PASSWORD": { 2023-08-11T12:40:16.088 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_PASSWORD", 2023-08-11T12:40:16.088 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.089 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.089 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.089 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2023-08-11T12:40:16.089 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.089 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.090 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.090 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.090 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.090 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.090 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.091 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.091 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-08-11T12:40:16.091 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-08-11T12:40:16.091 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.091 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.092 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.092 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.092 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.092 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.092 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.093 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.093 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.093 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.093 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.093 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.094 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_URL": { 2023-08-11T12:40:16.094 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_URL", 2023-08-11T12:40:16.094 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.094 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.094 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.095 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.095 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.095 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.095 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.095 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.096 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.096 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.096 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.096 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.096 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_USERNAME": { 2023-08-11T12:40:16.097 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_USERNAME", 2023-08-11T12:40:16.097 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.097 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.097 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.097 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2023-08-11T12:40:16.098 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.098 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.098 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.098 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.098 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.099 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.099 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.099 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.099 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-08-11T12:40:16.099 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-08-11T12:40:16.100 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.100 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.100 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.100 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.100 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.100 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.101 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.101 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.101 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.101 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.102 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.102 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.102 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-08-11T12:40:16.102 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-08-11T12:40:16.102 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.103 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.103 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.103 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.103 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.103 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.104 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.104 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.104 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.104 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.104 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.105 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.105 INFO:teuthology.orchestra.run.smithi008.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-08-11T12:40:16.105 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-08-11T12:40:16.105 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.105 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.106 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.106 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.106 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.106 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.106 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.106 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.107 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.107 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.107 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.107 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.107 INFO:teuthology.orchestra.run.smithi008.stdout: "ISSUE_TRACKER_API_KEY": { 2023-08-11T12:40:16.108 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-08-11T12:40:16.108 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.108 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.108 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.108 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.109 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.109 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.109 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.109 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.110 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.110 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.110 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.110 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.111 INFO:teuthology.orchestra.run.smithi008.stdout: "PROMETHEUS_API_HOST": { 2023-08-11T12:40:16.111 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PROMETHEUS_API_HOST", 2023-08-11T12:40:16.111 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.111 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.111 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.111 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.112 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.112 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.112 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.112 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.112 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.113 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.113 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.113 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.113 INFO:teuthology.orchestra.run.smithi008.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-08-11T12:40:16.114 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-08-11T12:40:16.114 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.114 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.114 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.115 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.115 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.115 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.115 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.115 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.116 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.116 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.116 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.116 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.116 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-08-11T12:40:16.117 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-08-11T12:40:16.117 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.117 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.117 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.118 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.118 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.118 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.118 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.119 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.119 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.119 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.119 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.119 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.120 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-08-11T12:40:16.120 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-08-11T12:40:16.120 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.120 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.120 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.121 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.121 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.121 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.121 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.121 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.122 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.122 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.122 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.122 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.123 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-08-11T12:40:16.123 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-08-11T12:40:16.123 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.123 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.123 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.124 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.124 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.124 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.124 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.125 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.125 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.125 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.125 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.125 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.126 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-08-11T12:40:16.126 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-08-11T12:40:16.126 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.126 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.126 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.127 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.127 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.127 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.127 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.128 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.128 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.128 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.128 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.128 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.129 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-08-11T12:40:16.129 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-08-11T12:40:16.129 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.129 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.129 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.130 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.130 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.130 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.130 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.130 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.131 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.131 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.131 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.131 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.131 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-08-11T12:40:16.132 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-08-11T12:40:16.132 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.132 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.132 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.132 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.133 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.133 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.133 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.133 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.133 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.134 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.134 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.134 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.134 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-08-11T12:40:16.134 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-08-11T12:40:16.135 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.135 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.135 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.135 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.135 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.136 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.136 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.136 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.136 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.136 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.137 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.137 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.137 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_ENABLED": { 2023-08-11T12:40:16.137 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_ENABLED", 2023-08-11T12:40:16.137 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.138 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.138 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.138 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.138 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.138 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.139 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.139 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.139 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.139 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.139 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.140 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.140 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-08-11T12:40:16.140 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-08-11T12:40:16.140 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.140 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.141 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.141 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-08-11T12:40:16.141 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.141 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.141 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.142 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.142 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.142 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.142 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.142 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.143 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-08-11T12:40:16.143 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-08-11T12:40:16.143 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.143 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.143 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.144 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-08-11T12:40:16.144 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.144 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.144 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.144 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.145 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.145 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.145 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.145 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.145 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-08-11T12:40:16.146 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-08-11T12:40:16.146 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.146 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.146 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.146 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8", 2023-08-11T12:40:16.147 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.147 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.147 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.147 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.147 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.148 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.148 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.148 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.148 INFO:teuthology.orchestra.run.smithi008.stdout: "REST_REQUESTS_TIMEOUT": { 2023-08-11T12:40:16.148 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-08-11T12:40:16.149 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.149 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.149 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.149 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "45", 2023-08-11T12:40:16.149 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.149 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.150 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.150 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.150 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.150 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.150 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.151 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.151 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_ACCESS_KEY": { 2023-08-11T12:40:16.151 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_ACCESS_KEY", 2023-08-11T12:40:16.151 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.151 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.152 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.152 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.152 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.152 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.152 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.153 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.153 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.153 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.153 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.153 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.154 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-08-11T12:40:16.154 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-08-11T12:40:16.154 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.154 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.154 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.155 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2023-08-11T12:40:16.155 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.155 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.155 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.155 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.156 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.156 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.156 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.156 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.156 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_SECRET_KEY": { 2023-08-11T12:40:16.157 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_SECRET_KEY", 2023-08-11T12:40:16.157 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.157 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.157 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.157 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.158 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.158 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.158 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.158 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.158 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.159 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.159 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.159 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.159 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_SSL_VERIFY": { 2023-08-11T12:40:16.159 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_SSL_VERIFY", 2023-08-11T12:40:16.160 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.160 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.160 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.161 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.161 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.161 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.161 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.161 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.162 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.162 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.162 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.162 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.162 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-08-11T12:40:16.162 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-08-11T12:40:16.163 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.163 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.163 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.163 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-08-11T12:40:16.164 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.164 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.164 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.164 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.165 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.165 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.165 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.165 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.166 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-08-11T12:40:16.166 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-08-11T12:40:16.166 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.166 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.166 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.167 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-08-11T12:40:16.167 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.167 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.167 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.168 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.168 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.168 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.168 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.168 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.169 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-08-11T12:40:16.169 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-08-11T12:40:16.169 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.169 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.169 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.170 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-08-11T12:40:16.170 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.170 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.170 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.170 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.171 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.171 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.171 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.171 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.171 INFO:teuthology.orchestra.run.smithi008.stdout: "cross_origin_url": { 2023-08-11T12:40:16.172 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cross_origin_url", 2023-08-11T12:40:16.172 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.172 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.172 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.173 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.173 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.173 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.173 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.173 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.174 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.174 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.174 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.175 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.175 INFO:teuthology.orchestra.run.smithi008.stdout: "crt_file": { 2023-08-11T12:40:16.175 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crt_file", 2023-08-11T12:40:16.175 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.176 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.176 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.176 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.176 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.176 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.177 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.177 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.177 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.177 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.178 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.178 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.178 INFO:teuthology.orchestra.run.smithi008.stdout: "debug": { 2023-08-11T12:40:16.178 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "debug", 2023-08-11T12:40:16.178 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.179 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.179 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.179 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.179 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.180 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.180 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.180 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable/disable debug options", 2023-08-11T12:40:16.180 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.180 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.181 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.181 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.181 INFO:teuthology.orchestra.run.smithi008.stdout: "jwt_token_ttl": { 2023-08-11T12:40:16.181 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "jwt_token_ttl", 2023-08-11T12:40:16.181 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.182 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.182 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.182 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "28800", 2023-08-11T12:40:16.182 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.182 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.183 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.183 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.183 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.183 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.183 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.184 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.184 INFO:teuthology.orchestra.run.smithi008.stdout: "key_file": { 2023-08-11T12:40:16.184 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "key_file", 2023-08-11T12:40:16.184 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.185 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.185 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.185 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.185 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.185 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.186 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.186 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.186 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.186 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.186 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.187 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.187 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.187 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.187 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.187 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.188 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.188 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.188 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.188 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.188 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.189 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.189 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.189 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.189 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.189 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.190 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.190 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.190 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.190 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.190 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.191 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.191 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.191 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.191 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.191 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.192 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.192 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.192 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.192 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.192 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.193 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.193 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.193 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.193 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.193 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.193 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.194 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.194 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.194 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.194 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.194 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.195 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.195 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.195 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.195 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.195 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.196 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.196 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.196 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.196 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.196 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.197 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.197 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.197 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.197 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.197 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.198 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.198 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.198 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.198 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.198 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.199 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.199 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.199 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.199 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.199 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.200 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.200 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.200 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.200 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.200 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.201 INFO:teuthology.orchestra.run.smithi008.stdout: "motd": { 2023-08-11T12:40:16.201 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "motd", 2023-08-11T12:40:16.201 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.201 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.201 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.202 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.202 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.202 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.202 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.202 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "The message of the day", 2023-08-11T12:40:16.203 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.203 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.203 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.203 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.203 INFO:teuthology.orchestra.run.smithi008.stdout: "redirect_resolve_ip_addr": { 2023-08-11T12:40:16.204 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "redirect_resolve_ip_addr", 2023-08-11T12:40:16.204 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.204 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.204 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.204 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.205 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.205 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.205 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.205 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.205 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.206 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.206 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.206 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.206 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2023-08-11T12:40:16.206 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2023-08-11T12:40:16.207 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.207 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.207 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.207 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "::", 2023-08-11T12:40:16.208 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.208 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.208 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.208 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.208 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.209 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.209 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.209 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.209 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2023-08-11T12:40:16.209 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2023-08-11T12:40:16.210 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.210 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.210 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.210 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8080", 2023-08-11T12:40:16.211 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.211 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.211 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.211 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.211 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.212 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.212 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.212 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.212 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl": { 2023-08-11T12:40:16.212 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl", 2023-08-11T12:40:16.213 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.213 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.213 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.213 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.214 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.214 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.214 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.214 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.214 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.215 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.215 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.215 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.215 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl_server_port": { 2023-08-11T12:40:16.215 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl_server_port", 2023-08-11T12:40:16.216 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.216 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.216 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.216 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8443", 2023-08-11T12:40:16.216 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.217 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.217 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.217 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.217 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.218 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.218 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.218 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.218 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_behaviour": { 2023-08-11T12:40:16.218 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_behaviour", 2023-08-11T12:40:16.219 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.219 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.219 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.219 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "redirect", 2023-08-11T12:40:16.219 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.220 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.220 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.220 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.220 INFO:teuthology.orchestra.run.smithi008.stdout: "redirect" 2023-08-11T12:40:16.221 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.221 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.221 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.221 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.221 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.222 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.222 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_error_status_code": { 2023-08-11T12:40:16.222 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_error_status_code", 2023-08-11T12:40:16.222 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.222 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.223 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.223 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "500", 2023-08-11T12:40:16.223 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "400", 2023-08-11T12:40:16.223 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "599", 2023-08-11T12:40:16.223 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.224 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.224 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.224 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.224 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.224 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.225 INFO:teuthology.orchestra.run.smithi008.stdout: "url_prefix": { 2023-08-11T12:40:16.225 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "url_prefix", 2023-08-11T12:40:16.225 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.225 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.225 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.226 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.226 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.226 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.226 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.226 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.226 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.227 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.227 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.227 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.227 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.227 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.228 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.228 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "devicehealth", 2023-08-11T12:40:16.228 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.228 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.228 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.229 INFO:teuthology.orchestra.run.smithi008.stdout: "enable_monitoring": { 2023-08-11T12:40:16.229 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enable_monitoring", 2023-08-11T12:40:16.229 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.229 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.229 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.230 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.230 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.230 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.230 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.230 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "monitor device health metrics", 2023-08-11T12:40:16.231 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.231 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.231 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.231 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.231 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.232 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.232 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.232 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.232 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.232 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.233 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.233 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.233 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.233 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.233 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.233 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.234 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.234 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.234 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.234 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.235 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.235 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.235 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.235 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.236 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.236 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.236 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.236 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.236 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.237 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.237 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.237 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.237 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.237 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.237 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.238 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.238 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.238 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.238 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.239 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.239 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.239 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.239 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.239 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.240 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.240 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.240 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.240 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.240 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.241 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.241 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.241 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.241 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.241 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.242 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.242 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.242 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.242 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.242 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.243 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.243 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.243 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.243 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.243 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.244 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.244 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.244 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.244 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.244 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.245 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.245 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.245 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.245 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.245 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.245 INFO:teuthology.orchestra.run.smithi008.stdout: "mark_out_threshold": { 2023-08-11T12:40:16.246 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mark_out_threshold", 2023-08-11T12:40:16.246 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:16.246 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.246 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.246 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "2419200", 2023-08-11T12:40:16.247 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.247 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.247 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.247 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-08-11T12:40:16.247 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.248 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.248 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.248 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.248 INFO:teuthology.orchestra.run.smithi008.stdout: "pool_name": { 2023-08-11T12:40:16.248 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pool_name", 2023-08-11T12:40:16.249 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.249 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.249 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.249 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "device_health_metrics", 2023-08-11T12:40:16.250 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.250 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.250 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.250 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "name of pool in which to store device health metrics", 2023-08-11T12:40:16.250 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.251 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.251 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.251 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.251 INFO:teuthology.orchestra.run.smithi008.stdout: "retention_period": { 2023-08-11T12:40:16.251 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "retention_period", 2023-08-11T12:40:16.252 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:16.252 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.252 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.252 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15552000", 2023-08-11T12:40:16.253 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.253 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.253 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.253 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long to retain device health metrics", 2023-08-11T12:40:16.253 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.254 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.254 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.254 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.254 INFO:teuthology.orchestra.run.smithi008.stdout: "scrape_frequency": { 2023-08-11T12:40:16.254 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "scrape_frequency", 2023-08-11T12:40:16.255 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:16.255 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.255 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.255 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "86400", 2023-08-11T12:40:16.255 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.256 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.256 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.256 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to scrape device health metrics", 2023-08-11T12:40:16.256 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.256 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.257 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.257 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.257 INFO:teuthology.orchestra.run.smithi008.stdout: "self_heal": { 2023-08-11T12:40:16.257 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "self_heal", 2023-08-11T12:40:16.257 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.258 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.258 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.258 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.258 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.258 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.259 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.259 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-08-11T12:40:16.259 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.259 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.259 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.260 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.260 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-08-11T12:40:16.260 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-08-11T12:40:16.260 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:16.261 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.261 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.261 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-08-11T12:40:16.261 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.262 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.262 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.262 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to wake up and check device health", 2023-08-11T12:40:16.262 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.262 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.263 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.263 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.263 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_threshold": { 2023-08-11T12:40:16.264 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_threshold", 2023-08-11T12:40:16.264 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:16.264 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.264 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.265 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "7257600", 2023-08-11T12:40:16.265 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.265 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.265 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.265 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-08-11T12:40:16.266 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.266 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.266 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.266 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.266 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.267 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.267 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.267 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "diskprediction_local", 2023-08-11T12:40:16.267 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.268 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.268 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.268 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.268 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.269 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.269 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.269 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.269 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.269 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.270 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.270 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.270 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.270 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.270 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.271 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.271 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.271 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.271 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.271 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.272 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.272 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.272 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.272 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.272 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.273 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.273 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.273 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.273 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.273 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.274 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.274 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.274 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.274 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.274 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.275 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.275 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.275 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.275 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.275 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.276 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.276 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.276 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.276 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.276 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.277 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.277 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.277 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.277 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.278 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.278 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.278 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.278 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.278 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.279 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.279 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.279 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.279 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.279 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.280 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.280 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.280 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.280 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.280 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.281 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.281 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.281 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.281 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.281 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.281 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.282 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.282 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.282 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.282 INFO:teuthology.orchestra.run.smithi008.stdout: "predict_interval": { 2023-08-11T12:40:16.283 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "predict_interval", 2023-08-11T12:40:16.283 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.283 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.283 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.283 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "86400", 2023-08-11T12:40:16.284 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.284 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.284 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.284 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.284 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.285 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.285 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.285 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.285 INFO:teuthology.orchestra.run.smithi008.stdout: "predictor_model": { 2023-08-11T12:40:16.285 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "predictor_model", 2023-08-11T12:40:16.285 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.286 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.286 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.286 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "prophetstor", 2023-08-11T12:40:16.286 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.286 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.287 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.287 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.287 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.287 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.287 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.288 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.288 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-08-11T12:40:16.288 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-08-11T12:40:16.288 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.288 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.289 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.289 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-08-11T12:40:16.289 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.289 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.289 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.290 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.290 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.290 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.290 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.290 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.291 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.291 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.291 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.291 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "influx", 2023-08-11T12:40:16.291 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": false, 2023-08-11T12:40:16.292 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "influxdb python module not found", 2023-08-11T12:40:16.292 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.292 INFO:teuthology.orchestra.run.smithi008.stdout: "batch_size": { 2023-08-11T12:40:16.292 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "batch_size", 2023-08-11T12:40:16.292 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.293 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.293 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.293 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5000", 2023-08-11T12:40:16.293 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.293 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.294 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.294 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-08-11T12:40:16.294 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.294 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.294 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.295 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.295 INFO:teuthology.orchestra.run.smithi008.stdout: "database": { 2023-08-11T12:40:16.295 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "database", 2023-08-11T12:40:16.295 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.295 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.296 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.296 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "ceph", 2023-08-11T12:40:16.296 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.296 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.296 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.297 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-08-11T12:40:16.297 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.297 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.297 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.297 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.298 INFO:teuthology.orchestra.run.smithi008.stdout: "hostname": { 2023-08-11T12:40:16.298 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "hostname", 2023-08-11T12:40:16.298 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.298 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.298 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.298 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.299 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.299 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.299 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.299 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB server hostname", 2023-08-11T12:40:16.299 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.300 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.300 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.300 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.300 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-08-11T12:40:16.300 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-08-11T12:40:16.301 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:16.301 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.301 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.301 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "30", 2023-08-11T12:40:16.301 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "5", 2023-08-11T12:40:16.302 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.302 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.302 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-08-11T12:40:16.303 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.303 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.303 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.303 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.303 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.304 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.304 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.304 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.304 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.304 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.305 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.305 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.305 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.305 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.305 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.306 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.306 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.306 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.306 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.306 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.307 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.307 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.307 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.307 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.307 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.308 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.308 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.308 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.308 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.309 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.309 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.309 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.309 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.310 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.310 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.310 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.310 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.311 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.311 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.311 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.311 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.311 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.312 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.312 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.312 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.312 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.313 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.313 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.313 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.313 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.313 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.314 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.314 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.314 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.314 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.315 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.315 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.315 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.315 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.316 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.316 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.316 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.316 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.317 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.317 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.317 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.317 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.317 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.318 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.318 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.318 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.318 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.319 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.319 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.319 INFO:teuthology.orchestra.run.smithi008.stdout: "password": { 2023-08-11T12:40:16.319 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "password", 2023-08-11T12:40:16.320 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.320 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.320 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.320 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.320 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.321 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.321 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.321 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "password of InfluxDB server user", 2023-08-11T12:40:16.321 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.321 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.322 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.322 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.322 INFO:teuthology.orchestra.run.smithi008.stdout: "port": { 2023-08-11T12:40:16.322 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "port", 2023-08-11T12:40:16.322 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.323 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.323 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.323 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8086", 2023-08-11T12:40:16.323 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.323 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.324 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.324 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB server port", 2023-08-11T12:40:16.324 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.324 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.324 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.325 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl": { 2023-08-11T12:40:16.325 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl", 2023-08-11T12:40:16.325 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.326 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.326 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.326 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "false", 2023-08-11T12:40:16.326 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.326 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.327 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.327 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-08-11T12:40:16.327 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.327 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.327 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.328 INFO:teuthology.orchestra.run.smithi008.stdout: "threads": { 2023-08-11T12:40:16.328 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "threads", 2023-08-11T12:40:16.328 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.329 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.329 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.329 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-08-11T12:40:16.329 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-08-11T12:40:16.329 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "32", 2023-08-11T12:40:16.330 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.330 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-08-11T12:40:16.330 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.330 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.330 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.331 INFO:teuthology.orchestra.run.smithi008.stdout: "username": { 2023-08-11T12:40:16.331 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "username", 2023-08-11T12:40:16.331 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.331 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.332 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.332 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.332 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.332 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.332 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.333 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "username of InfluxDB server user", 2023-08-11T12:40:16.333 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.333 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.333 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.334 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.334 INFO:teuthology.orchestra.run.smithi008.stdout: "verify_ssl": { 2023-08-11T12:40:16.334 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "verify_ssl", 2023-08-11T12:40:16.334 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.334 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.334 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.335 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "true", 2023-08-11T12:40:16.335 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.335 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.335 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.335 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-08-11T12:40:16.336 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.336 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.336 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.336 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.336 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.337 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "insights", 2023-08-11T12:40:16.337 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.338 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.338 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.338 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.338 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.338 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.339 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.339 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.339 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.339 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.339 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.340 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.340 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.340 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.340 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.340 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.341 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.341 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.341 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.341 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.341 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.342 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.342 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.342 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.342 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.343 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.343 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.343 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.343 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.343 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.343 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.344 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.344 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.344 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.344 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.344 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.345 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.345 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.345 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.346 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.346 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.346 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.346 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.346 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.347 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.347 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.347 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.347 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.347 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.348 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.348 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.348 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.348 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.348 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.349 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.349 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.349 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.349 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.350 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.350 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.350 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.350 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.350 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.351 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.351 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.351 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.351 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.351 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.352 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.352 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.352 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.353 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "iostat", 2023-08-11T12:40:16.353 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.353 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.353 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.353 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.354 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.354 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.354 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.354 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.354 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.355 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.355 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.355 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.355 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.356 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.356 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.356 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.356 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.356 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.357 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.357 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.357 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.357 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.357 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.358 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.358 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.358 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.358 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.358 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.359 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.359 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.359 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.359 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.359 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.359 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.360 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.360 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.360 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.360 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.361 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.361 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.361 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.361 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.361 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.362 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.362 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.362 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.362 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.362 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.363 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.363 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.363 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.363 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.363 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.364 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.364 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.364 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.364 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.364 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.365 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.365 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.365 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.365 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.366 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.366 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.366 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.366 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.366 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.367 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.367 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.367 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.368 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.368 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.368 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.368 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.369 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.369 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.369 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "k8sevents", 2023-08-11T12:40:16.369 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.369 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.370 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.370 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_event_retention_days": { 2023-08-11T12:40:16.370 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ceph_event_retention_days", 2023-08-11T12:40:16.370 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.370 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.371 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.371 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "7", 2023-08-11T12:40:16.371 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.371 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.371 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.371 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Days to hold ceph event information within local cache", 2023-08-11T12:40:16.372 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.372 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.372 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.372 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.373 INFO:teuthology.orchestra.run.smithi008.stdout: "config_check_secs": { 2023-08-11T12:40:16.373 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_check_secs", 2023-08-11T12:40:16.373 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.373 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.373 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.374 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-08-11T12:40:16.374 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "10", 2023-08-11T12:40:16.374 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.374 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.374 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-08-11T12:40:16.374 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.375 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.375 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.375 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.375 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.375 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.376 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.376 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.376 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.376 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.376 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.377 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.377 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.377 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.377 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.377 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.378 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.378 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.378 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.378 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.378 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.379 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.379 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.379 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.379 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.379 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.380 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.380 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.380 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.380 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.380 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.381 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.381 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.381 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.381 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.381 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.382 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.382 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.382 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.382 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.382 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.382 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.383 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.383 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.383 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.383 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.383 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.384 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.384 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.384 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.384 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.385 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.385 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.385 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.385 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.386 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.386 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.386 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.386 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.386 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.387 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.387 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.387 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.387 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.388 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.388 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.388 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.388 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.388 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.389 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.389 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.389 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.389 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.389 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.390 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.390 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.390 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.390 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "localpool", 2023-08-11T12:40:16.390 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.391 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.391 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.391 INFO:teuthology.orchestra.run.smithi008.stdout: "failure_domain": { 2023-08-11T12:40:16.391 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "failure_domain", 2023-08-11T12:40:16.391 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.392 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.392 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.392 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "host", 2023-08-11T12:40:16.392 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.392 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.393 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.393 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "failure domain for any created local pool", 2023-08-11T12:40:16.393 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-08-11T12:40:16.393 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.394 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.394 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.394 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.394 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.394 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.395 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.395 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.395 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.395 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.396 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.396 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.396 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.396 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.396 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.397 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.397 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.397 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.397 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.398 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.398 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.398 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.398 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.398 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.398 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.399 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.399 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.399 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.399 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.399 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.400 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.400 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.400 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.400 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.401 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.401 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.401 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.401 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.401 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.402 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.402 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.402 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.402 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.402 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.403 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.403 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.403 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.403 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.403 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.403 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.404 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.404 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.404 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.404 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.404 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.405 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.405 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.405 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.405 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.405 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.406 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.406 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.406 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.406 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.406 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.407 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.407 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.407 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.407 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.407 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.408 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.408 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.408 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.408 INFO:teuthology.orchestra.run.smithi008.stdout: "min_size": { 2023-08-11T12:40:16.408 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "min_size", 2023-08-11T12:40:16.409 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.409 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.409 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.409 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.410 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.410 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.410 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.410 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default min_size for any created local pool", 2023-08-11T12:40:16.410 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-08-11T12:40:16.411 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.411 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.411 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.411 INFO:teuthology.orchestra.run.smithi008.stdout: "num_rep": { 2023-08-11T12:40:16.411 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "num_rep", 2023-08-11T12:40:16.412 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.412 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.412 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.412 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3", 2023-08-11T12:40:16.412 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.413 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.413 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.413 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default replica count for any created local pool", 2023-08-11T12:40:16.413 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.413 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.414 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.414 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.414 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_num": { 2023-08-11T12:40:16.414 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pg_num", 2023-08-11T12:40:16.414 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.415 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.415 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.415 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "128", 2023-08-11T12:40:16.415 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.415 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.416 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.416 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default pg_num for any created local pool", 2023-08-11T12:40:16.416 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.416 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.416 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.417 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.417 INFO:teuthology.orchestra.run.smithi008.stdout: "prefix": { 2023-08-11T12:40:16.417 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prefix", 2023-08-11T12:40:16.417 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.417 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.418 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.418 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.418 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.418 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.418 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.419 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "name prefix for any created local pool", 2023-08-11T12:40:16.419 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.419 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.419 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.419 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.420 INFO:teuthology.orchestra.run.smithi008.stdout: "subtree": { 2023-08-11T12:40:16.420 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "subtree", 2023-08-11T12:40:16.420 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.420 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.420 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.421 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "rack", 2023-08-11T12:40:16.421 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.421 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.421 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.421 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "CRUSH level for which to create a local pool", 2023-08-11T12:40:16.422 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-08-11T12:40:16.422 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.422 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.422 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.422 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.423 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.423 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.423 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mds_autoscaler", 2023-08-11T12:40:16.423 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.423 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.424 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.424 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.424 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.424 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.424 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.425 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.425 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.425 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.425 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.425 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.426 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.426 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.426 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.426 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.426 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.426 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.427 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.427 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.427 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.427 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.427 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.428 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.428 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.428 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.428 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.428 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.429 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.429 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.429 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.429 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.429 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.430 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.430 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.430 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.430 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.430 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.431 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.431 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.431 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.431 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.431 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.432 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.432 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.432 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.432 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.432 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.433 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.433 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.433 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.433 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.433 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.434 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.434 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.434 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.434 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.434 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.435 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.435 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.435 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.435 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.435 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.436 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.436 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.436 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.436 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.436 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.437 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.437 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.437 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.437 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.437 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.438 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.438 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.438 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.438 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mirroring", 2023-08-11T12:40:16.438 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.439 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.439 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.439 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.439 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.439 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.440 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.440 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.440 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.440 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.440 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.441 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.441 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.441 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.441 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.441 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.441 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.442 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.442 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.442 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.442 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.443 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.443 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.443 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.443 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.443 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.444 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.444 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.444 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.444 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.444 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.445 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.445 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.445 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.445 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.445 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.446 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.446 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.446 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.446 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.447 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.447 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.447 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.447 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.447 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.448 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.448 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.448 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.448 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.449 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.449 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.449 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.449 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.449 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.450 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.450 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.450 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.450 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.450 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.451 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.451 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.451 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.451 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.451 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.452 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.452 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.452 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.452 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.452 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.453 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.453 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.453 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.453 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.453 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.454 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.454 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.454 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "nfs", 2023-08-11T12:40:16.454 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.454 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.455 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.455 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.455 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.455 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.455 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.456 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.456 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.456 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.456 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.456 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.456 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.457 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.457 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.457 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.457 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.458 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.458 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.458 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.458 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.458 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.458 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.459 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.459 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.459 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.459 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.459 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.460 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.460 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.460 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.460 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.460 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.461 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.461 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.461 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.461 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.462 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.462 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.462 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.462 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.462 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.462 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.463 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.463 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.463 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.463 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.463 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.464 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.464 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.464 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.464 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.465 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.465 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.465 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.465 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.465 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.466 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.466 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.466 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.466 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.466 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.466 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.467 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.467 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.467 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.467 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.467 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.468 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.468 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.468 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.468 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.469 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.469 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.469 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.469 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.469 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "orchestrator", 2023-08-11T12:40:16.470 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.470 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.470 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.470 INFO:teuthology.orchestra.run.smithi008.stdout: "fail_fs": { 2023-08-11T12:40:16.470 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "fail_fs", 2023-08-11T12:40:16.471 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.471 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.471 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.471 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.471 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.472 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.472 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.472 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-08-11T12:40:16.472 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.472 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.473 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.473 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.473 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.473 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.474 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.474 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.474 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.474 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.474 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.475 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.475 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.475 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.475 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.475 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.475 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.476 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.476 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.476 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.476 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.476 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.477 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.477 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.477 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.477 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.477 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.478 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.478 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.478 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.478 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.478 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.479 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.479 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.479 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.479 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.479 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.480 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.480 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.480 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.480 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.480 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.481 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.481 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.481 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.481 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.481 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.482 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.482 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.482 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.483 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.483 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.483 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.483 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.483 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.484 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.484 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.484 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.484 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.484 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.485 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.485 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.485 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.485 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.485 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.485 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.486 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.486 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.486 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.486 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.486 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.487 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.487 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.487 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.487 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator": { 2023-08-11T12:40:16.488 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "orchestrator", 2023-08-11T12:40:16.488 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.488 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.488 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.488 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.489 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.489 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.489 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.489 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm", 2023-08-11T12:40:16.490 INFO:teuthology.orchestra.run.smithi008.stdout: "rook", 2023-08-11T12:40:16.490 INFO:teuthology.orchestra.run.smithi008.stdout: "test_orchestrator" 2023-08-11T12:40:16.490 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.490 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Orchestrator backend", 2023-08-11T12:40:16.490 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.491 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.491 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.491 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.491 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.491 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.492 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.492 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "osd_perf_query", 2023-08-11T12:40:16.492 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.492 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.492 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.493 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.493 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.493 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.493 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.493 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.494 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.494 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.494 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.494 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.494 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.494 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.495 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.495 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.495 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.495 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.495 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.496 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.496 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.496 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.496 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.496 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.497 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.497 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.497 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.497 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.497 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.498 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.498 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.498 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.498 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.498 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.499 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.499 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.499 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.499 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.499 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.500 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.500 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.500 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.500 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.500 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.501 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.501 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.501 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.501 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.501 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.502 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.502 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.502 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.502 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.502 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.503 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.503 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.503 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.503 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.503 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.503 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.504 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.504 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.504 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.504 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.504 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.505 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.505 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.505 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.505 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.505 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.506 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.506 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.506 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.506 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.506 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.507 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.507 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "osd_support", 2023-08-11T12:40:16.507 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.507 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.508 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.508 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.508 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.508 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.508 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.509 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.509 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.509 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.509 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.509 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.510 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.510 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.510 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.510 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.510 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.511 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.511 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.511 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.511 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.511 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.512 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.512 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.512 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.512 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.512 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.513 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.513 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.513 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.513 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.513 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.514 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.514 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.514 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.514 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.515 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.515 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.515 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.515 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.515 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.516 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.516 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.516 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.516 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.516 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.517 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.517 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.517 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.517 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.517 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.518 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.518 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.518 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.518 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.518 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.519 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.519 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.519 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.519 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.519 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.519 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.520 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.520 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.520 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.520 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.520 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.521 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.521 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.521 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.521 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.521 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.522 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.522 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.522 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.522 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.522 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pg_autoscaler", 2023-08-11T12:40:16.523 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.523 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.523 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.523 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.523 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.524 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.524 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.524 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.524 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.524 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.525 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.525 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.525 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.525 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.525 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.526 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.526 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.526 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.526 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.526 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.527 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.527 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.527 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.527 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.527 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.528 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.528 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.528 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.528 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.528 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.529 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.529 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.529 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.529 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.529 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.530 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.530 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.530 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.530 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.530 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.531 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.531 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.531 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.531 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.531 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.532 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.532 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.532 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.532 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.533 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.533 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.533 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.533 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.533 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.534 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.534 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.534 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.534 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.534 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.535 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.535 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.535 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.535 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.535 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.535 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.536 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.536 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.536 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.536 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.536 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.537 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.537 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.537 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.537 INFO:teuthology.orchestra.run.smithi008.stdout: "noautoscale": { 2023-08-11T12:40:16.537 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "noautoscale", 2023-08-11T12:40:16.538 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.538 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.538 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.538 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.538 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.539 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.539 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.539 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "global autoscale flag", 2023-08-11T12:40:16.539 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-08-11T12:40:16.540 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.540 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.540 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.540 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-08-11T12:40:16.540 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-08-11T12:40:16.541 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:16.541 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.541 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.541 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-08-11T12:40:16.541 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.541 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.542 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.542 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.542 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.542 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.542 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.543 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.543 INFO:teuthology.orchestra.run.smithi008.stdout: "threshold": { 2023-08-11T12:40:16.543 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "threshold", 2023-08-11T12:40:16.543 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-08-11T12:40:16.543 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.544 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.544 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3.0", 2023-08-11T12:40:16.544 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1.0", 2023-08-11T12:40:16.544 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.544 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.545 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "scaling threshold", 2023-08-11T12:40:16.545 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-08-11T12:40:16.545 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.545 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.545 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.546 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.546 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.546 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.546 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "progress", 2023-08-11T12:40:16.546 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.547 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.547 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.547 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_pg_recovery_event": { 2023-08-11T12:40:16.547 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_pg_recovery_event", 2023-08-11T12:40:16.547 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.548 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.548 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.548 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.548 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.548 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.549 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.549 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow the module to show pg recovery progress", 2023-08-11T12:40:16.549 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.549 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.549 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.550 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.550 INFO:teuthology.orchestra.run.smithi008.stdout: "enabled": { 2023-08-11T12:40:16.550 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enabled", 2023-08-11T12:40:16.550 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.550 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.551 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.551 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.551 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.552 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.552 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.552 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.552 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.552 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.553 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.553 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.553 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.553 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.553 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.554 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.554 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.554 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.554 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.554 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.555 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.555 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.555 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.555 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.556 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.556 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.556 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.556 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.556 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.557 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.557 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.557 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.557 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.557 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.558 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.558 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.558 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.558 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.558 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.559 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.559 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.559 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.559 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.559 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.560 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.560 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.560 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.560 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.560 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.561 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.561 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.561 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.561 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.561 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.562 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.562 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.562 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.562 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.562 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.563 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.563 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.563 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.563 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.563 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.564 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.564 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.564 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.564 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.564 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.565 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.565 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.565 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.565 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.565 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.566 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.566 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.566 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.566 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.566 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.567 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.567 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.567 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.567 INFO:teuthology.orchestra.run.smithi008.stdout: "max_completed_events": { 2023-08-11T12:40:16.567 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_completed_events", 2023-08-11T12:40:16.568 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.568 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.568 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.568 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "50", 2023-08-11T12:40:16.568 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.569 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.569 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.569 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "number of past completed events to remember", 2023-08-11T12:40:16.569 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.569 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.570 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.570 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.570 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-08-11T12:40:16.570 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-08-11T12:40:16.570 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:16.571 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.571 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.571 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-08-11T12:40:16.571 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.571 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.572 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.572 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long the module is going to sleep", 2023-08-11T12:40:16.572 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.572 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.572 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.573 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.573 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.573 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.573 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.573 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prometheus", 2023-08-11T12:40:16.574 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.574 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.574 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.574 INFO:teuthology.orchestra.run.smithi008.stdout: "cache": { 2023-08-11T12:40:16.574 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cache", 2023-08-11T12:40:16.575 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.575 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.575 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.575 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.575 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.575 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.576 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.576 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.576 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.576 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.576 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.577 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.577 INFO:teuthology.orchestra.run.smithi008.stdout: "exclude_perf_counters": { 2023-08-11T12:40:16.577 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "exclude_perf_counters", 2023-08-11T12:40:16.577 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.577 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.578 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.578 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.578 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.578 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.578 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.579 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-08-11T12:40:16.579 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-08-11T12:40:16.579 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.579 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.579 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.580 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.580 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.580 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.580 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.580 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.581 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.581 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.581 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.581 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.581 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.582 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.582 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.582 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.582 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.582 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.583 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.583 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.583 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.583 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.583 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.583 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.584 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.584 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.584 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.584 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.584 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.585 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.585 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.585 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.585 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.585 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.586 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.586 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.586 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.586 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.586 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.587 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.587 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.587 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.587 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.587 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.588 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.588 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.588 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.588 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.588 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.589 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.589 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.589 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.589 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.589 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.590 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.590 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.590 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.590 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.590 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.591 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.591 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.591 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.591 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.591 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.592 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.592 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.592 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.592 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.592 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.593 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.593 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.593 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.593 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.593 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_stats_pools": { 2023-08-11T12:40:16.594 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_stats_pools", 2023-08-11T12:40:16.594 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.594 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.594 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.594 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.595 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.595 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.595 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.595 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.595 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.596 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.596 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.596 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.596 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_stats_pools_refresh_interval": { 2023-08-11T12:40:16.596 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-08-11T12:40:16.597 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.597 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.597 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.597 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "300", 2023-08-11T12:40:16.597 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.598 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.598 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.598 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.598 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.598 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.599 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.599 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.599 INFO:teuthology.orchestra.run.smithi008.stdout: "scrape_interval": { 2023-08-11T12:40:16.599 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "scrape_interval", 2023-08-11T12:40:16.599 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-08-11T12:40:16.599 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.600 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.600 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15.0", 2023-08-11T12:40:16.600 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.600 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.600 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.601 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.601 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.601 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.601 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.601 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.602 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2023-08-11T12:40:16.602 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2023-08-11T12:40:16.602 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.602 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.602 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.603 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "::", 2023-08-11T12:40:16.603 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.603 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.603 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.603 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-08-11T12:40:16.604 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.604 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.604 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.604 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.604 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2023-08-11T12:40:16.605 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2023-08-11T12:40:16.605 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.605 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.605 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.605 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "9283", 2023-08-11T12:40:16.606 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.606 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.606 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.606 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-08-11T12:40:16.606 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.607 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.607 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.607 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.607 INFO:teuthology.orchestra.run.smithi008.stdout: "stale_cache_strategy": { 2023-08-11T12:40:16.608 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "stale_cache_strategy", 2023-08-11T12:40:16.608 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.608 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.608 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.608 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "log", 2023-08-11T12:40:16.609 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.609 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.609 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.609 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.609 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.610 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.610 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.610 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.610 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_behaviour": { 2023-08-11T12:40:16.610 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_behaviour", 2023-08-11T12:40:16.611 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.611 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.611 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.611 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "default", 2023-08-11T12:40:16.611 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.612 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.612 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.612 INFO:teuthology.orchestra.run.smithi008.stdout: "default", 2023-08-11T12:40:16.612 INFO:teuthology.orchestra.run.smithi008.stdout: "error" 2023-08-11T12:40:16.612 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.613 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.613 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.613 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.613 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.613 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.614 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_error_status_code": { 2023-08-11T12:40:16.614 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_error_status_code", 2023-08-11T12:40:16.614 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.614 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.614 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.615 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "500", 2023-08-11T12:40:16.615 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "400", 2023-08-11T12:40:16.615 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "599", 2023-08-11T12:40:16.615 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.615 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.616 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.616 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.616 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.616 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.616 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.617 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.617 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.617 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_support", 2023-08-11T12:40:16.617 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.617 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.618 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.618 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.618 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.618 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.618 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.619 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.619 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.619 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.619 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.619 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.620 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.620 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.620 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.620 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.620 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.621 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.621 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.621 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.621 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.621 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.622 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.622 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.622 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.622 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.622 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.622 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.623 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.623 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.623 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.623 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.623 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.624 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.624 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.624 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.624 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.624 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.625 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.625 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.625 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.625 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.626 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.626 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.626 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.626 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.626 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.627 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.627 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.627 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.627 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.627 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.628 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.628 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.628 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.628 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.628 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.629 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.629 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.629 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.629 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.629 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.630 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.630 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.630 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.631 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.631 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.631 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.631 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.631 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.632 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.632 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.632 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.632 INFO:teuthology.orchestra.run.smithi008.stdout: "max_concurrent_snap_create": { 2023-08-11T12:40:16.632 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_concurrent_snap_create", 2023-08-11T12:40:16.633 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.633 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.633 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.633 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-08-11T12:40:16.633 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.634 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.634 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.634 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.634 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.634 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.635 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.635 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.635 INFO:teuthology.orchestra.run.smithi008.stdout: "mirror_snapshot_schedule": { 2023-08-11T12:40:16.635 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mirror_snapshot_schedule", 2023-08-11T12:40:16.635 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.636 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.636 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.636 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.636 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.636 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.637 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.637 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.637 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.637 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.637 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.638 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.638 INFO:teuthology.orchestra.run.smithi008.stdout: "trash_purge_schedule": { 2023-08-11T12:40:16.638 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "trash_purge_schedule", 2023-08-11T12:40:16.638 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.638 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.639 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.639 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.639 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.639 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.639 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.639 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.640 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.640 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.640 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.640 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.640 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.641 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.641 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.641 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "restful", 2023-08-11T12:40:16.641 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.641 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.642 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.642 INFO:teuthology.orchestra.run.smithi008.stdout: "enable_auth": { 2023-08-11T12:40:16.642 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enable_auth", 2023-08-11T12:40:16.642 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.642 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.643 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.643 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.643 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.643 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.643 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.644 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.644 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.644 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.644 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.644 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.645 INFO:teuthology.orchestra.run.smithi008.stdout: "key_file": { 2023-08-11T12:40:16.645 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "key_file", 2023-08-11T12:40:16.645 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.645 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.645 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.646 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.646 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.646 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.646 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.646 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.646 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.647 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.647 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.647 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.647 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.647 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.648 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.648 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.648 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.648 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.648 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.649 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.649 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.649 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.649 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.649 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.650 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.650 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.650 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.650 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.650 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.651 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.651 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.651 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.651 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.651 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.652 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.652 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.652 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.652 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.652 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.653 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.653 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.653 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.653 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.653 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.654 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.654 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.654 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.654 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.654 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.655 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.655 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.655 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.655 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.656 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.656 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.656 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.656 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.656 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.657 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.657 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.657 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.657 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.657 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.658 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.658 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.658 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.658 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.658 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.659 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.659 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.659 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.659 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.659 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.660 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.660 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.660 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.660 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.660 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.661 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.661 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.661 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.661 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.661 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2023-08-11T12:40:16.661 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2023-08-11T12:40:16.662 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.662 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.662 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.662 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.662 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.663 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.663 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.663 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.663 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.663 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.664 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.664 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.664 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2023-08-11T12:40:16.665 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2023-08-11T12:40:16.665 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.665 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.665 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.666 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.666 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.666 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.666 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.666 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.667 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.667 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.667 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.667 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.668 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.668 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.668 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.668 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rgw", 2023-08-11T12:40:16.668 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.669 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.669 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.669 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.669 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.669 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.670 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.670 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.670 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.670 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.671 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.671 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.671 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.671 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.671 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.672 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.672 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.672 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.672 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.672 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.673 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.673 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.673 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.673 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.673 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.674 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.674 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.674 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.674 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.674 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.675 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.675 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.675 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.675 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.675 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.675 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.676 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.676 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.676 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.676 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.677 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.677 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.677 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.677 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.677 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.678 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.678 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.678 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.678 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.678 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.679 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.679 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.679 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.679 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.679 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.679 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.680 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.680 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.680 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.680 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.681 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.681 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.681 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.681 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.681 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.682 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.682 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.682 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.682 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.682 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.683 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.683 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.683 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.683 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.683 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.684 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.684 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rook", 2023-08-11T12:40:16.684 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.684 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.684 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.685 INFO:teuthology.orchestra.run.smithi008.stdout: "drive_group_interval": { 2023-08-11T12:40:16.685 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "drive_group_interval", 2023-08-11T12:40:16.685 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-08-11T12:40:16.685 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.685 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.686 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "300.0", 2023-08-11T12:40:16.686 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.686 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.686 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.686 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-08-11T12:40:16.687 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.687 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.687 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.687 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.687 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.688 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.688 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.688 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.688 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.688 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.689 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.689 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.689 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.689 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.689 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.690 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.690 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.690 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.690 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.690 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.691 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.691 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.691 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.691 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.691 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.692 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.692 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.692 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.692 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.692 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.693 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.693 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.693 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.693 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.693 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.693 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.694 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.694 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.694 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.694 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.694 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.695 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.695 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.695 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.695 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.695 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.696 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.696 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.696 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.696 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.696 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.697 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.697 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.697 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.697 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.697 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.698 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.698 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.698 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.698 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.698 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.699 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.699 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.699 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.699 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.699 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.700 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.700 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.700 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.700 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.700 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.701 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.701 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.701 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.701 INFO:teuthology.orchestra.run.smithi008.stdout: "storage_class": { 2023-08-11T12:40:16.701 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "storage_class", 2023-08-11T12:40:16.702 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.702 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.702 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.702 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "local", 2023-08-11T12:40:16.702 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.702 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.703 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.703 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-08-11T12:40:16.703 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.703 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.704 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.704 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.704 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.704 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.704 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.705 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "selftest", 2023-08-11T12:40:16.705 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.705 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.705 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.705 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.706 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.706 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.706 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.706 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.706 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.707 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.707 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.707 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.707 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.707 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.708 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.708 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.708 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.708 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.708 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.709 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.709 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.709 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.709 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.709 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.710 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.710 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.710 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.710 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.710 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.711 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.711 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.711 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.711 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.711 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.712 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.712 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.712 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.712 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.712 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.713 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.713 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.713 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.713 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.713 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.714 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.714 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.714 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.714 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.714 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.714 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.715 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.715 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.715 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.715 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.715 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.716 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.716 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.716 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.716 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.716 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.717 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.717 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.717 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.717 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.717 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.718 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.718 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.718 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.718 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.718 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.719 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.719 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.719 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.719 INFO:teuthology.orchestra.run.smithi008.stdout: "roption1": { 2023-08-11T12:40:16.719 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "roption1", 2023-08-11T12:40:16.720 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.720 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.720 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.720 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.720 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.721 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.721 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.721 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.721 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.721 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.722 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.722 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.722 INFO:teuthology.orchestra.run.smithi008.stdout: "roption2": { 2023-08-11T12:40:16.722 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "roption2", 2023-08-11T12:40:16.722 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.723 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.723 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.723 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "xyz", 2023-08-11T12:40:16.723 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.723 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.724 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.724 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.724 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.724 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.724 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.725 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.725 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption1": { 2023-08-11T12:40:16.725 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption1", 2023-08-11T12:40:16.725 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.725 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.726 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.726 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.726 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.726 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.726 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.727 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.727 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.727 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.727 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.727 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.728 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption2": { 2023-08-11T12:40:16.728 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption2", 2023-08-11T12:40:16.728 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.728 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.728 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.729 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.729 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.729 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.729 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.729 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.730 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.730 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.730 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.730 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.730 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption3": { 2023-08-11T12:40:16.731 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption3", 2023-08-11T12:40:16.731 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-08-11T12:40:16.731 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.731 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.731 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.732 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.732 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.732 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.732 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.733 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.733 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.733 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.733 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.733 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption4": { 2023-08-11T12:40:16.733 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption4", 2023-08-11T12:40:16.734 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.734 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.734 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.734 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.734 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.735 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.735 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.735 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.735 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.735 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.736 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.736 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.736 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption5": { 2023-08-11T12:40:16.736 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption5", 2023-08-11T12:40:16.736 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.737 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.737 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.737 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.737 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.737 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.738 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.738 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.738 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.738 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.738 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.739 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.739 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption6": { 2023-08-11T12:40:16.739 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption6", 2023-08-11T12:40:16.739 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.739 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.740 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.740 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.740 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.740 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.740 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.741 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.741 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.741 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.741 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.741 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.742 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption7": { 2023-08-11T12:40:16.742 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption7", 2023-08-11T12:40:16.742 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.742 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.742 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.743 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.743 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-08-11T12:40:16.743 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "42", 2023-08-11T12:40:16.743 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.744 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.744 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.744 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.744 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.744 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.745 INFO:teuthology.orchestra.run.smithi008.stdout: "testkey": { 2023-08-11T12:40:16.745 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testkey", 2023-08-11T12:40:16.745 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.745 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.745 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.745 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.746 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.746 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.746 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.746 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.746 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.747 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.747 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.747 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.747 INFO:teuthology.orchestra.run.smithi008.stdout: "testlkey": { 2023-08-11T12:40:16.747 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testlkey", 2023-08-11T12:40:16.748 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.748 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.748 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.748 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.748 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.749 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.749 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.749 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.749 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.749 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.750 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.750 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.750 INFO:teuthology.orchestra.run.smithi008.stdout: "testnewline": { 2023-08-11T12:40:16.750 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testnewline", 2023-08-11T12:40:16.750 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.751 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.751 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.751 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.751 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.751 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.752 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.752 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.752 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.752 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.753 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.753 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.753 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.753 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.753 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.754 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snap_schedule", 2023-08-11T12:40:16.754 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.754 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.754 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.754 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_m_granularity": { 2023-08-11T12:40:16.755 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_m_granularity", 2023-08-11T12:40:16.755 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.755 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.755 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.755 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.756 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.756 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.756 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.756 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow minute scheduled snapshots", 2023-08-11T12:40:16.757 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.757 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.757 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.757 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.757 INFO:teuthology.orchestra.run.smithi008.stdout: "dump_on_update": { 2023-08-11T12:40:16.758 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "dump_on_update", 2023-08-11T12:40:16.758 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.758 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.758 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.758 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.759 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.759 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.759 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.759 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "dump database to debug log on update", 2023-08-11T12:40:16.759 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.760 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.760 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.760 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.760 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.761 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.761 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.761 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.761 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.761 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.762 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.762 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.762 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.762 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.762 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.763 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.763 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.763 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.763 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.763 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.764 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.764 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.764 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.764 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.764 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.765 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.765 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.765 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.765 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.765 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.766 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.766 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.766 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.766 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.766 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.767 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.767 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.767 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.767 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.767 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.768 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.768 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.768 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.768 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.768 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.769 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.769 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.769 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.769 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.769 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.769 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.770 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.770 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.770 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.770 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.770 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.771 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.771 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.771 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.771 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.771 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.772 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.772 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.772 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.772 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.772 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.773 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.773 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.773 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.773 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.773 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.774 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.774 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.774 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.774 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.774 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.775 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.775 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "stats", 2023-08-11T12:40:16.775 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.775 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.775 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.775 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.776 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.776 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.776 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.776 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.776 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.777 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.777 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.777 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.777 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.777 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.778 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.778 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.778 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.778 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.778 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.779 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.779 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.779 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.779 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.779 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.780 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.780 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.780 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.780 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.780 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.781 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.781 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.781 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.781 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.781 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.782 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.782 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.782 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.782 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.782 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.783 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.783 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.783 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.783 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.783 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.784 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.784 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.784 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.784 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.784 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.785 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.785 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.785 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.785 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.785 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.786 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.786 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.786 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.786 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.786 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.787 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.787 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.787 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.787 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.787 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.788 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.788 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.788 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.788 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.788 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.789 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.789 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.789 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.789 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.789 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.789 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.790 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.790 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "status", 2023-08-11T12:40:16.790 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.790 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.790 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.791 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.791 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.791 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.791 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.792 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.792 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.792 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.792 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.793 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.793 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.793 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.793 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.793 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.794 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.794 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.794 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.794 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.795 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.795 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.795 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.795 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.795 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.796 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.796 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.796 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.796 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.797 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.797 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.797 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.797 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.797 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.798 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.798 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.798 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.798 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.798 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.799 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.799 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.799 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.799 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.799 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.800 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.800 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.800 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.800 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.800 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.801 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.801 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.801 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.801 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.801 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.801 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.802 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.802 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.802 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.802 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.802 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.803 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.803 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.803 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.803 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.803 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.804 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.804 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.804 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.804 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.804 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.805 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.805 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.805 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.805 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.806 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.806 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.806 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "telegraf", 2023-08-11T12:40:16.806 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.806 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.807 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.807 INFO:teuthology.orchestra.run.smithi008.stdout: "address": { 2023-08-11T12:40:16.807 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "address", 2023-08-11T12:40:16.807 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.807 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.807 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.808 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-08-11T12:40:16.808 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.808 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.808 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.809 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.809 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.809 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.809 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.809 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.810 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-08-11T12:40:16.810 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-08-11T12:40:16.810 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:16.810 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.810 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.811 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15", 2023-08-11T12:40:16.811 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.811 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.811 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.811 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.811 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.812 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.812 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.812 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.812 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.812 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.813 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.813 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.813 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.813 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.813 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.814 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.814 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.814 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.814 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.814 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.815 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.815 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.815 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.815 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.815 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.816 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.816 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.816 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.816 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.816 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.817 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.817 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.817 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.817 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.817 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.818 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.818 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.818 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.818 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.818 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.819 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.819 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.819 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.819 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.820 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.820 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.820 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.820 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.820 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.821 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.821 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.821 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.821 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.821 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.821 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.822 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.822 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.822 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.822 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.823 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.823 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.823 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.823 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.823 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.824 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.824 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.824 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.824 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.824 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.825 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.825 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.825 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.825 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.825 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.826 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.826 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.826 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.826 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.826 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.827 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.827 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "telemetry", 2023-08-11T12:40:16.827 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.827 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.827 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.827 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_basic": { 2023-08-11T12:40:16.828 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_basic", 2023-08-11T12:40:16.828 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.828 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.828 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.828 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.829 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.829 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.829 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.829 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share basic cluster information (size, version)", 2023-08-11T12:40:16.829 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.830 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.830 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.830 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_crash": { 2023-08-11T12:40:16.830 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_crash", 2023-08-11T12:40:16.831 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.831 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.831 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.831 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.831 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.832 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.832 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.832 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-08-11T12:40:16.832 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.832 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.833 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.833 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.833 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_device": { 2023-08-11T12:40:16.833 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_device", 2023-08-11T12:40:16.833 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.834 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.834 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.834 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.834 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.834 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.835 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.835 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-08-11T12:40:16.835 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.835 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.835 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.835 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.836 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_ident": { 2023-08-11T12:40:16.836 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_ident", 2023-08-11T12:40:16.836 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.836 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.836 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.837 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.837 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.837 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.837 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.837 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-08-11T12:40:16.838 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.838 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.838 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.838 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.838 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_perf": { 2023-08-11T12:40:16.839 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_perf", 2023-08-11T12:40:16.839 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.839 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.839 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.839 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.840 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.840 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.840 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.840 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share various performance metrics of a cluster", 2023-08-11T12:40:16.840 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.841 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.841 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.841 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.841 INFO:teuthology.orchestra.run.smithi008.stdout: "contact": { 2023-08-11T12:40:16.841 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "contact", 2023-08-11T12:40:16.842 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.842 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.842 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.842 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.842 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.843 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.843 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.843 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.843 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.843 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.843 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.844 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.844 INFO:teuthology.orchestra.run.smithi008.stdout: "description": { 2023-08-11T12:40:16.844 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "description", 2023-08-11T12:40:16.844 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.844 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.845 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.845 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.845 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.845 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.845 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.846 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.846 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.846 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.846 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.846 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.847 INFO:teuthology.orchestra.run.smithi008.stdout: "device_url": { 2023-08-11T12:40:16.847 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_url", 2023-08-11T12:40:16.847 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.847 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.847 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.848 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-08-11T12:40:16.848 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.848 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.848 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.849 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.849 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.849 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.849 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.849 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.850 INFO:teuthology.orchestra.run.smithi008.stdout: "enabled": { 2023-08-11T12:40:16.850 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enabled", 2023-08-11T12:40:16.850 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.850 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.850 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.851 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.851 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.851 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.851 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.851 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.852 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.852 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.852 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.852 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.852 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-08-11T12:40:16.853 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-08-11T12:40:16.853 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.853 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.853 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.853 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "24", 2023-08-11T12:40:16.854 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "8", 2023-08-11T12:40:16.854 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.854 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.854 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.854 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.855 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.855 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.855 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.855 INFO:teuthology.orchestra.run.smithi008.stdout: "last_opt_revision": { 2023-08-11T12:40:16.855 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "last_opt_revision", 2023-08-11T12:40:16.856 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.856 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.856 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.856 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1", 2023-08-11T12:40:16.856 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.857 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.857 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.857 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.857 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.857 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.858 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.858 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.858 INFO:teuthology.orchestra.run.smithi008.stdout: "leaderboard": { 2023-08-11T12:40:16.858 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "leaderboard", 2023-08-11T12:40:16.858 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.859 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.859 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.859 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.859 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.859 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.860 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.860 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.860 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.860 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.861 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.861 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.861 INFO:teuthology.orchestra.run.smithi008.stdout: "leaderboard_description": { 2023-08-11T12:40:16.861 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "leaderboard_description", 2023-08-11T12:40:16.861 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.862 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.862 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.862 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.862 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.863 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.863 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.863 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.863 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.863 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.864 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.864 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.864 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.864 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.865 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.865 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.865 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.865 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.865 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.866 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.866 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.866 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.866 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.866 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.867 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.867 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.867 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.867 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.867 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.868 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.868 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.868 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.868 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.868 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.869 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.869 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.869 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.869 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.869 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.870 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.870 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.870 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.870 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.870 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.870 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.871 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.871 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.871 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.872 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.872 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.872 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.872 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.872 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.873 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.873 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.873 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.873 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.873 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.874 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.874 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.874 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.874 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.875 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.875 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.875 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.875 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.876 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.876 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.876 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.876 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.876 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.877 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.877 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.877 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.877 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.877 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.878 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.878 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.878 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.879 INFO:teuthology.orchestra.run.smithi008.stdout: "organization": { 2023-08-11T12:40:16.879 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "organization", 2023-08-11T12:40:16.879 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.879 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.879 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.880 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.880 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.880 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.880 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.880 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.881 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.881 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.881 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.881 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.881 INFO:teuthology.orchestra.run.smithi008.stdout: "proxy": { 2023-08-11T12:40:16.882 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "proxy", 2023-08-11T12:40:16.882 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.882 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.882 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.882 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.883 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.883 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.883 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.883 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.883 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.884 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.884 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.884 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.884 INFO:teuthology.orchestra.run.smithi008.stdout: "url": { 2023-08-11T12:40:16.884 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "url", 2023-08-11T12:40:16.885 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.885 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.885 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.885 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-08-11T12:40:16.886 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.886 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.886 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.886 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.886 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.887 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.887 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.887 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.887 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.887 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.888 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.888 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "test_orchestrator", 2023-08-11T12:40:16.888 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.888 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.888 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.889 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.889 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.889 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.889 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.890 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.890 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.890 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.890 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.890 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.890 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.891 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.891 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.891 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.891 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.891 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.892 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.892 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.892 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.892 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.893 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.893 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.893 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.893 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.894 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.894 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.894 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.894 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.894 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.895 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.895 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.895 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.895 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.895 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.896 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.896 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.896 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.896 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.897 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.897 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.897 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.897 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.897 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.897 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.898 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.898 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.898 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.898 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.898 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.899 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.899 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.899 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.899 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.900 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.900 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.900 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.900 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.900 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.901 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.901 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.901 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.901 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.901 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.902 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.902 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.902 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.902 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.902 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.903 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.903 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.903 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.903 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.903 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.904 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "volumes", 2023-08-11T12:40:16.904 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.904 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.904 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.905 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.905 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.905 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.905 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.905 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.906 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.906 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.906 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.906 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.906 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.907 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.907 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.907 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.907 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.907 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.908 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.908 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.908 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.908 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.909 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.909 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.909 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.909 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.909 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.910 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.910 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.910 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.910 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.910 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.911 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.911 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.911 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.911 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.911 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.912 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.912 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.912 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.912 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.912 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.913 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.913 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.913 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.913 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.913 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.914 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.914 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.914 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.914 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.915 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.915 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.915 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.915 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.915 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.915 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.916 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.916 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.916 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.916 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.916 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.917 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.917 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.917 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.917 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.917 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.918 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.918 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.918 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.918 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.918 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.919 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.919 INFO:teuthology.orchestra.run.smithi008.stdout: "max_concurrent_clones": { 2023-08-11T12:40:16.919 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_concurrent_clones", 2023-08-11T12:40:16.919 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.919 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.920 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.920 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "4", 2023-08-11T12:40:16.920 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.920 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.920 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.921 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Number of asynchronous cloner threads", 2023-08-11T12:40:16.921 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.921 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.921 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.921 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.922 INFO:teuthology.orchestra.run.smithi008.stdout: "snapshot_clone_delay": { 2023-08-11T12:40:16.922 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snapshot_clone_delay", 2023-08-11T12:40:16.922 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.922 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.922 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.923 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-08-11T12:40:16.923 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.923 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.923 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.923 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-08-11T12:40:16.924 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.924 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.924 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.924 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.925 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.925 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.925 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.925 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix", 2023-08-11T12:40:16.925 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.926 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.926 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.926 INFO:teuthology.orchestra.run.smithi008.stdout: "discovery_interval": { 2023-08-11T12:40:16.926 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "discovery_interval", 2023-08-11T12:40:16.926 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-08-11T12:40:16.927 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.927 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.927 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "100", 2023-08-11T12:40:16.927 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.927 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.928 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.928 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.928 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.928 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.928 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.929 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.929 INFO:teuthology.orchestra.run.smithi008.stdout: "identifier": { 2023-08-11T12:40:16.929 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "identifier", 2023-08-11T12:40:16.929 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.929 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.929 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.930 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.930 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.930 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.930 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.930 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.931 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.931 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.931 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.931 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.931 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-08-11T12:40:16.932 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-08-11T12:40:16.932 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:16.932 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.932 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.932 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-08-11T12:40:16.933 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.933 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.933 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.933 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.933 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.934 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.934 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.934 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.934 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.934 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.935 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.935 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.935 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.935 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.935 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.936 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.936 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.936 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.936 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.936 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.937 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.937 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.937 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.937 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.937 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.938 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.938 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.938 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.938 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.938 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.939 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.939 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.939 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.939 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.940 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.940 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.940 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.940 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.940 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.941 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.941 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.941 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.941 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.941 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.942 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.942 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.942 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.942 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.942 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.943 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.943 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.943 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.943 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.943 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.944 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.944 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.944 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.944 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.944 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.945 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.945 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.945 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.945 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.945 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.946 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.946 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.946 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.946 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.947 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.947 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.947 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.947 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.947 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.948 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.948 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.948 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.948 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.948 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.949 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_host": { 2023-08-11T12:40:16.949 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_host", 2023-08-11T12:40:16.949 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.949 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.950 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.950 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.950 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.950 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.950 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.951 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.951 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.951 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.951 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.951 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.952 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_port": { 2023-08-11T12:40:16.952 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_port", 2023-08-11T12:40:16.952 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.952 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.952 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.953 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10051", 2023-08-11T12:40:16.953 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.953 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.953 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.954 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.954 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.954 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.954 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.954 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.955 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_sender": { 2023-08-11T12:40:16.955 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_sender", 2023-08-11T12:40:16.955 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.955 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.955 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:16.956 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-08-11T12:40:16.956 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.956 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.956 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.957 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.957 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.957 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.957 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.957 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.958 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.958 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:16.958 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-11T12:40:16.958 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.958 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.959 INFO:teuthology.orchestra.run.smithi008.stdout: "gid": 25603, 2023-08-11T12:40:16.959 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "z", 2023-08-11T12:40:16.959 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr_features": 4540138322906710015, 2023-08-11T12:40:16.959 INFO:teuthology.orchestra.run.smithi008.stdout: "available_modules": [ 2023-08-11T12:40:16.959 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:16.960 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "alerts", 2023-08-11T12:40:16.960 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:16.960 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:16.960 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:16.960 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-08-11T12:40:16.961 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-08-11T12:40:16.961 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:16.961 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.961 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.961 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-08-11T12:40:16.962 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.962 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.962 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.962 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How frequently to reexamine health status", 2023-08-11T12:40:16.962 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.963 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.963 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.963 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.963 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:16.963 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:16.964 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.964 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.964 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.964 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.964 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.965 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.965 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.965 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.965 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.965 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.966 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.966 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.966 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.966 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.966 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.967 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.967 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.967 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.967 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.967 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:16.968 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:16.968 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.968 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.968 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.968 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.969 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.969 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.969 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.969 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.969 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.970 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.970 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.970 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.970 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:16.970 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:16.970 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.971 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.971 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.971 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:16.971 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.972 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.972 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:16.972 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:16.972 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:16.972 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:16.973 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:16.973 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:16.973 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:16.973 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:16.973 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.973 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.974 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.974 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.974 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.974 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:16.974 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:16.975 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.975 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.975 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.975 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:16.975 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.976 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.976 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.976 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:16.976 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.977 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.977 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.977 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.977 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_destination": { 2023-08-11T12:40:16.977 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_destination", 2023-08-11T12:40:16.978 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.978 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.978 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.978 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.978 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.979 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.979 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.979 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Email address to send alerts to", 2023-08-11T12:40:16.979 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.980 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.980 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.980 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.980 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_from_name": { 2023-08-11T12:40:16.980 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_from_name", 2023-08-11T12:40:16.981 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.981 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.981 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.981 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "Ceph", 2023-08-11T12:40:16.981 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.982 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.982 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.982 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Email From: name", 2023-08-11T12:40:16.982 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.983 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.983 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.983 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.983 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_host": { 2023-08-11T12:40:16.983 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_host", 2023-08-11T12:40:16.984 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.984 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.984 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.984 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.985 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.985 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.985 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.985 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP server", 2023-08-11T12:40:16.985 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.986 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.986 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.986 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.986 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_password": { 2023-08-11T12:40:16.986 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_password", 2023-08-11T12:40:16.987 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.987 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.987 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.987 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.987 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.988 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.988 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.988 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Password to authenticate with", 2023-08-11T12:40:16.988 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.988 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.989 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.989 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.989 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_port": { 2023-08-11T12:40:16.989 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_port", 2023-08-11T12:40:16.990 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:16.990 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.990 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.990 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "465", 2023-08-11T12:40:16.990 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.991 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.991 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.991 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP port", 2023-08-11T12:40:16.991 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.991 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.992 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.992 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.992 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_sender": { 2023-08-11T12:40:16.992 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_sender", 2023-08-11T12:40:16.992 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.993 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.993 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.993 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.993 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.993 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.994 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.994 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP envelope sender", 2023-08-11T12:40:16.994 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.994 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.994 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.995 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.995 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_ssl": { 2023-08-11T12:40:16.995 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_ssl", 2023-08-11T12:40:16.995 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:16.995 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.996 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.996 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:16.996 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.996 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.996 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.997 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use SSL to connect to SMTP server", 2023-08-11T12:40:16.997 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:16.997 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:16.997 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:16.997 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:16.998 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_user": { 2023-08-11T12:40:16.998 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_user", 2023-08-11T12:40:16.998 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:16.998 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:16.998 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:16.999 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:16.999 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:16.999 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:16.999 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:16.999 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "User to authenticate as", 2023-08-11T12:40:17.000 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.000 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.000 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.000 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.000 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.001 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.001 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:17.001 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "balancer", 2023-08-11T12:40:17.001 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:17.001 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:17.002 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:17.002 INFO:teuthology.orchestra.run.smithi008.stdout: "active": { 2023-08-11T12:40:17.002 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "active", 2023-08-11T12:40:17.002 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.002 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.003 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.003 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.003 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.003 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.004 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.004 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "automatically balance PGs across cluster", 2023-08-11T12:40:17.004 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.004 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.005 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.005 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.005 INFO:teuthology.orchestra.run.smithi008.stdout: "begin_time": { 2023-08-11T12:40:17.005 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "begin_time", 2023-08-11T12:40:17.005 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.006 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.006 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.006 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0000", 2023-08-11T12:40:17.006 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.007 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.007 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.007 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "beginning time of day to automatically balance", 2023-08-11T12:40:17.007 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-08-11T12:40:17.007 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.008 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.008 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.008 INFO:teuthology.orchestra.run.smithi008.stdout: "begin_weekday": { 2023-08-11T12:40:17.008 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "begin_weekday", 2023-08-11T12:40:17.008 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-08-11T12:40:17.009 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.009 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.009 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-08-11T12:40:17.009 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0", 2023-08-11T12:40:17.009 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "6", 2023-08-11T12:40:17.010 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.010 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-08-11T12:40:17.010 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-08-11T12:40:17.010 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.010 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.011 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.011 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_max_iterations": { 2023-08-11T12:40:17.011 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_max_iterations", 2023-08-11T12:40:17.011 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-08-11T12:40:17.011 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.012 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.012 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "25", 2023-08-11T12:40:17.012 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-08-11T12:40:17.012 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "250", 2023-08-11T12:40:17.013 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.013 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-08-11T12:40:17.013 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.013 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.013 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.014 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.014 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_metrics": { 2023-08-11T12:40:17.014 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_metrics", 2023-08-11T12:40:17.014 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.014 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.015 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.015 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "pgs,objects,bytes", 2023-08-11T12:40:17.015 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.015 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.015 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.016 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-08-11T12:40:17.016 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-08-11T12:40:17.016 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.016 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.017 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.017 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_step": { 2023-08-11T12:40:17.017 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_step", 2023-08-11T12:40:17.017 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-08-11T12:40:17.017 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.018 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.018 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0.5", 2023-08-11T12:40:17.018 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0.001", 2023-08-11T12:40:17.018 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "0.999", 2023-08-11T12:40:17.018 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.019 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "aggressiveness of optimization", 2023-08-11T12:40:17.019 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-08-11T12:40:17.019 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.019 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.019 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.020 INFO:teuthology.orchestra.run.smithi008.stdout: "end_time": { 2023-08-11T12:40:17.020 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "end_time", 2023-08-11T12:40:17.020 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.020 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.020 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.021 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "2359", 2023-08-11T12:40:17.021 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.021 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.021 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.021 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "ending time of day to automatically balance", 2023-08-11T12:40:17.022 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-08-11T12:40:17.022 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.022 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.022 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.022 INFO:teuthology.orchestra.run.smithi008.stdout: "end_weekday": { 2023-08-11T12:40:17.023 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "end_weekday", 2023-08-11T12:40:17.023 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-08-11T12:40:17.023 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.023 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.023 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-08-11T12:40:17.024 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0", 2023-08-11T12:40:17.024 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "6", 2023-08-11T12:40:17.024 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.024 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-08-11T12:40:17.025 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-08-11T12:40:17.025 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.025 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.025 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.025 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:17.026 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:17.026 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.026 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.026 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.026 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.027 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.027 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.027 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.027 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.027 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.028 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.028 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.028 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.028 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.028 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.029 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.029 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.029 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.029 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.029 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.030 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:17.030 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:17.030 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.030 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.030 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.031 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.031 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.031 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.031 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.031 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.032 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.032 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.032 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.032 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.032 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:17.033 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:17.033 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.033 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.033 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.033 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:17.034 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.034 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.034 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.034 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.034 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.035 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.035 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.035 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.035 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.035 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.036 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.036 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.036 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.036 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.037 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.037 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:17.037 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:17.037 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.037 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.037 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.038 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.038 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.038 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.038 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.038 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.039 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.039 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.039 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.039 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.039 INFO:teuthology.orchestra.run.smithi008.stdout: "min_score": { 2023-08-11T12:40:17.040 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "min_score", 2023-08-11T12:40:17.040 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-08-11T12:40:17.040 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.040 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.041 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-08-11T12:40:17.041 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.041 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.041 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.041 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-08-11T12:40:17.042 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.042 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.042 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.042 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.042 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": { 2023-08-11T12:40:17.043 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mode", 2023-08-11T12:40:17.043 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.043 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.043 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.043 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "upmap", 2023-08-11T12:40:17.044 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.044 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.044 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.044 INFO:teuthology.orchestra.run.smithi008.stdout: "crush-compat", 2023-08-11T12:40:17.044 INFO:teuthology.orchestra.run.smithi008.stdout: "none", 2023-08-11T12:40:17.045 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap" 2023-08-11T12:40:17.045 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.045 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Balancer mode", 2023-08-11T12:40:17.045 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.046 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.046 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.046 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.046 INFO:teuthology.orchestra.run.smithi008.stdout: "pool_ids": { 2023-08-11T12:40:17.046 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pool_ids", 2023-08-11T12:40:17.047 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.047 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.047 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.047 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.047 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.048 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.048 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.048 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-08-11T12:40:17.048 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.048 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.049 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.049 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.049 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-08-11T12:40:17.049 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-08-11T12:40:17.049 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:17.050 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.050 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.050 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-08-11T12:40:17.050 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.051 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.051 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.051 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-08-11T12:40:17.051 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.051 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.051 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.052 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.052 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap_max_deviation": { 2023-08-11T12:40:17.052 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "upmap_max_deviation", 2023-08-11T12:40:17.052 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.053 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.053 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.053 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-08-11T12:40:17.053 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-08-11T12:40:17.054 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.054 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.054 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "deviation below which no optimization is attempted", 2023-08-11T12:40:17.054 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-08-11T12:40:17.055 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.055 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.055 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.055 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap_max_optimizations": { 2023-08-11T12:40:17.055 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "upmap_max_optimizations", 2023-08-11T12:40:17.056 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-08-11T12:40:17.056 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.056 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.056 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-08-11T12:40:17.056 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.057 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.057 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.057 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-08-11T12:40:17.057 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.058 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.058 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.058 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.058 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.058 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.059 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:17.059 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cephadm", 2023-08-11T12:40:17.059 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:17.059 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:17.059 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:17.060 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_down_multiplier": { 2023-08-11T12:40:17.060 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_down_multiplier", 2023-08-11T12:40:17.060 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-08-11T12:40:17.060 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.060 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.061 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3.0", 2023-08-11T12:40:17.061 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.061 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.061 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.061 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-08-11T12:40:17.062 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.062 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.062 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.062 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.063 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_refresh_rate": { 2023-08-11T12:40:17.063 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_refresh_rate", 2023-08-11T12:40:17.063 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:17.063 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.063 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.063 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "20", 2023-08-11T12:40:17.064 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.064 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.064 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.064 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-08-11T12:40:17.065 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.065 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.065 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.065 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.065 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_starting_port": { 2023-08-11T12:40:17.066 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_starting_port", 2023-08-11T12:40:17.066 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.066 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.066 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.066 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "4721", 2023-08-11T12:40:17.067 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.067 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.067 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.067 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-08-11T12:40:17.067 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.068 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.068 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.068 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.068 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_ptrace": { 2023-08-11T12:40:17.068 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_ptrace", 2023-08-11T12:40:17.069 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.069 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.069 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.069 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.069 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.070 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.070 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.070 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-08-11T12:40:17.070 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-08-11T12:40:17.070 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.071 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.071 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.071 INFO:teuthology.orchestra.run.smithi008.stdout: "autotune_interval": { 2023-08-11T12:40:17.071 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "autotune_interval", 2023-08-11T12:40:17.071 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:17.072 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.072 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.072 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-08-11T12:40:17.072 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.072 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.073 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.073 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to autotune daemon memory", 2023-08-11T12:40:17.073 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.073 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.073 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.074 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.074 INFO:teuthology.orchestra.run.smithi008.stdout: "autotune_memory_target_ratio": { 2023-08-11T12:40:17.074 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "autotune_memory_target_ratio", 2023-08-11T12:40:17.074 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-08-11T12:40:17.074 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.075 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.075 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0.7", 2023-08-11T12:40:17.075 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.075 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.075 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.076 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-08-11T12:40:17.076 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.076 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.076 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.076 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.077 INFO:teuthology.orchestra.run.smithi008.stdout: "cgroups_split": { 2023-08-11T12:40:17.077 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cgroups_split", 2023-08-11T12:40:17.077 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.077 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.077 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.078 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.078 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.078 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.078 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.078 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-08-11T12:40:17.078 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.079 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.079 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.079 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.079 INFO:teuthology.orchestra.run.smithi008.stdout: "config_checks_enabled": { 2023-08-11T12:40:17.080 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_checks_enabled", 2023-08-11T12:40:17.080 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.080 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.080 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.080 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.081 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.081 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.081 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.081 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-08-11T12:40:17.081 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.082 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.082 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.082 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.082 INFO:teuthology.orchestra.run.smithi008.stdout: "config_dashboard": { 2023-08-11T12:40:17.082 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_dashboard", 2023-08-11T12:40:17.083 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.083 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.083 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.083 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.083 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.084 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.084 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.084 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-08-11T12:40:17.084 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.085 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.085 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.085 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.085 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_alertmanager": { 2023-08-11T12:40:17.085 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_alertmanager", 2023-08-11T12:40:17.086 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.086 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.086 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.086 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-08-11T12:40:17.086 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.087 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.087 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.087 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-08-11T12:40:17.087 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.087 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.088 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.088 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.088 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_base": { 2023-08-11T12:40:17.088 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_base", 2023-08-11T12:40:17.089 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.089 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.089 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.089 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/ceph", 2023-08-11T12:40:17.089 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.090 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.090 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.090 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Container image name, without the tag", 2023-08-11T12:40:17.090 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.090 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.091 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.091 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.091 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_elasticsearch": { 2023-08-11T12:40:17.091 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_elasticsearch", 2023-08-11T12:40:17.091 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.092 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.092 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.092 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-08-11T12:40:17.092 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.093 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.093 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.093 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "elasticsearch container image", 2023-08-11T12:40:17.093 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.093 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.093 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.094 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.094 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_grafana": { 2023-08-11T12:40:17.094 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_grafana", 2023-08-11T12:40:17.094 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.094 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.095 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.095 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-08-11T12:40:17.095 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.095 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.095 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.096 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-08-11T12:40:17.096 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.096 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.096 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.097 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.097 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_haproxy": { 2023-08-11T12:40:17.097 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_haproxy", 2023-08-11T12:40:17.097 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.097 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.098 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.098 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-08-11T12:40:17.098 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.098 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.098 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.099 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "HAproxy container image", 2023-08-11T12:40:17.099 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.099 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.099 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.100 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.100 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_agent": { 2023-08-11T12:40:17.100 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_agent", 2023-08-11T12:40:17.100 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.100 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.101 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.101 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-08-11T12:40:17.101 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.101 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.101 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.102 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger agent container image", 2023-08-11T12:40:17.102 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.102 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.102 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.102 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.103 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_collector": { 2023-08-11T12:40:17.103 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_collector", 2023-08-11T12:40:17.103 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.103 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.103 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.104 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-08-11T12:40:17.104 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.104 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.104 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.104 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger collector container image", 2023-08-11T12:40:17.105 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.105 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.105 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.105 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.106 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_query": { 2023-08-11T12:40:17.106 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_query", 2023-08-11T12:40:17.106 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.106 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.106 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.107 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-08-11T12:40:17.107 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.107 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.107 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.107 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger query container image", 2023-08-11T12:40:17.108 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.108 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.108 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.108 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.108 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_keepalived": { 2023-08-11T12:40:17.109 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_keepalived", 2023-08-11T12:40:17.109 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.109 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.109 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.109 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-08-11T12:40:17.110 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.110 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.110 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.110 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Keepalived container image", 2023-08-11T12:40:17.111 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.111 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.111 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.111 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.111 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_loki": { 2023-08-11T12:40:17.112 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_loki", 2023-08-11T12:40:17.112 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.112 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.112 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.112 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-08-11T12:40:17.113 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.113 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.113 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.113 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Loki container image", 2023-08-11T12:40:17.113 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.114 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.114 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.114 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.114 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_node_exporter": { 2023-08-11T12:40:17.114 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_node_exporter", 2023-08-11T12:40:17.115 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.115 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.115 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.115 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-08-11T12:40:17.115 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.116 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.116 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.116 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-08-11T12:40:17.116 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.116 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.117 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.117 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.117 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_nvmeof": { 2023-08-11T12:40:17.117 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_nvmeof", 2023-08-11T12:40:17.117 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.118 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.118 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.118 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.1", 2023-08-11T12:40:17.118 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.118 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.119 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.119 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Nvme-of container image", 2023-08-11T12:40:17.119 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.119 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.119 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.120 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.120 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_prometheus": { 2023-08-11T12:40:17.120 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_prometheus", 2023-08-11T12:40:17.120 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.120 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.121 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.121 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-08-11T12:40:17.121 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.121 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.121 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.121 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-08-11T12:40:17.122 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.122 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.122 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.122 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.123 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_promtail": { 2023-08-11T12:40:17.123 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_promtail", 2023-08-11T12:40:17.123 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.123 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.123 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.124 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-08-11T12:40:17.124 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.124 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.124 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.124 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Promtail container image", 2023-08-11T12:40:17.125 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.125 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.125 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.125 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.125 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_snmp_gateway": { 2023-08-11T12:40:17.126 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_snmp_gateway", 2023-08-11T12:40:17.126 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.126 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.126 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.127 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-08-11T12:40:17.127 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.127 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.127 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.127 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SNMP Gateway container image", 2023-08-11T12:40:17.128 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.128 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.128 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.128 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.128 INFO:teuthology.orchestra.run.smithi008.stdout: "container_init": { 2023-08-11T12:40:17.129 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_init", 2023-08-11T12:40:17.129 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.129 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.129 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.129 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.130 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.130 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.130 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.130 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Run podman/docker with `--init`", 2023-08-11T12:40:17.130 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.130 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.131 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.131 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.131 INFO:teuthology.orchestra.run.smithi008.stdout: "daemon_cache_timeout": { 2023-08-11T12:40:17.131 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "daemon_cache_timeout", 2023-08-11T12:40:17.131 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:17.132 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.132 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.132 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-08-11T12:40:17.132 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.133 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.133 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.133 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-08-11T12:40:17.133 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.133 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.134 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.134 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.134 INFO:teuthology.orchestra.run.smithi008.stdout: "default_cephadm_command_timeout": { 2023-08-11T12:40:17.134 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "default_cephadm_command_timeout", 2023-08-11T12:40:17.134 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:17.135 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.135 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.135 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "900", 2023-08-11T12:40:17.135 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.135 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.136 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.136 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-08-11T12:40:17.136 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.136 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.136 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.137 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.137 INFO:teuthology.orchestra.run.smithi008.stdout: "default_registry": { 2023-08-11T12:40:17.137 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "default_registry", 2023-08-11T12:40:17.137 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.137 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.138 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.138 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io", 2023-08-11T12:40:17.138 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.138 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.138 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.139 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-08-11T12:40:17.139 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.139 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.139 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.139 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.140 INFO:teuthology.orchestra.run.smithi008.stdout: "device_cache_timeout": { 2023-08-11T12:40:17.140 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_cache_timeout", 2023-08-11T12:40:17.140 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:17.140 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.140 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.141 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1800", 2023-08-11T12:40:17.141 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.141 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.141 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.141 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache device inventory", 2023-08-11T12:40:17.142 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.142 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.142 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.142 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.142 INFO:teuthology.orchestra.run.smithi008.stdout: "device_enhanced_scan": { 2023-08-11T12:40:17.143 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_enhanced_scan", 2023-08-11T12:40:17.143 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.143 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.143 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.143 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.144 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.144 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.144 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.144 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use libstoragemgmt during device scans", 2023-08-11T12:40:17.144 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.145 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.145 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.145 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.145 INFO:teuthology.orchestra.run.smithi008.stdout: "facts_cache_timeout": { 2023-08-11T12:40:17.145 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "facts_cache_timeout", 2023-08-11T12:40:17.146 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:17.146 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.146 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.146 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-08-11T12:40:17.146 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.147 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.147 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.147 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache host facts data", 2023-08-11T12:40:17.147 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.147 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.148 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.148 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.148 INFO:teuthology.orchestra.run.smithi008.stdout: "host_check_interval": { 2023-08-11T12:40:17.148 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "host_check_interval", 2023-08-11T12:40:17.148 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:17.149 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.149 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.149 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-08-11T12:40:17.149 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.149 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.150 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.150 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to perform a host check", 2023-08-11T12:40:17.150 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.150 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.150 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.151 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.151 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:17.151 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:17.151 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.151 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.152 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.152 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.152 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.152 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.152 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.153 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.153 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.153 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.153 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.153 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.154 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.154 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.154 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.154 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.154 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.155 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.155 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.155 INFO:teuthology.orchestra.run.smithi008.stdout: "log_refresh_metadata": { 2023-08-11T12:40:17.155 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_refresh_metadata", 2023-08-11T12:40:17.155 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.156 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.156 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.156 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.156 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.156 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.157 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.157 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-08-11T12:40:17.157 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.157 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.157 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.158 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.158 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:17.158 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:17.158 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.158 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.159 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.159 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.159 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.159 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.159 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.160 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-08-11T12:40:17.160 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.160 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.160 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.161 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.161 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:17.161 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:17.161 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.162 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.162 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.162 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:17.162 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.162 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.163 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.163 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.163 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.163 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.163 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.164 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.164 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.164 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.164 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.164 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.165 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.165 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.165 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.165 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:17.165 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:17.166 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.166 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.166 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.166 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.166 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.167 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.167 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.167 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.167 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.167 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.168 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.168 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.168 INFO:teuthology.orchestra.run.smithi008.stdout: "manage_etc_ceph_ceph_conf": { 2023-08-11T12:40:17.168 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-08-11T12:40:17.168 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.169 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.169 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.169 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.169 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.170 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.170 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.170 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-08-11T12:40:17.170 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.170 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.171 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.171 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.171 INFO:teuthology.orchestra.run.smithi008.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-08-11T12:40:17.171 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-08-11T12:40:17.171 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.172 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.172 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.172 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "*", 2023-08-11T12:40:17.172 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.172 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.173 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.173 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-08-11T12:40:17.173 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.173 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.173 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.174 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.174 INFO:teuthology.orchestra.run.smithi008.stdout: "max_count_per_host": { 2023-08-11T12:40:17.174 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_count_per_host", 2023-08-11T12:40:17.174 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.174 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.175 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.175 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-08-11T12:40:17.175 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.175 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.175 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.176 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "max number of daemons per service per host", 2023-08-11T12:40:17.176 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.176 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.176 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.176 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.177 INFO:teuthology.orchestra.run.smithi008.stdout: "max_osd_draining_count": { 2023-08-11T12:40:17.177 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_osd_draining_count", 2023-08-11T12:40:17.177 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.177 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.177 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.178 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-08-11T12:40:17.178 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.178 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.178 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.178 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-08-11T12:40:17.179 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.179 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.179 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.179 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.179 INFO:teuthology.orchestra.run.smithi008.stdout: "migration_current": { 2023-08-11T12:40:17.180 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "migration_current", 2023-08-11T12:40:17.180 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.180 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.180 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.180 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.181 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.181 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.181 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.181 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "internal - do not modify", 2023-08-11T12:40:17.181 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.182 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.182 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.182 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.182 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": { 2023-08-11T12:40:17.182 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mode", 2023-08-11T12:40:17.183 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.183 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.183 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.183 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "root", 2023-08-11T12:40:17.183 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.184 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.184 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.184 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm-package", 2023-08-11T12:40:17.184 INFO:teuthology.orchestra.run.smithi008.stdout: "root" 2023-08-11T12:40:17.184 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.185 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "mode for remote execution of cephadm", 2023-08-11T12:40:17.185 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.185 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.185 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.185 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.186 INFO:teuthology.orchestra.run.smithi008.stdout: "prometheus_alerts_path": { 2023-08-11T12:40:17.186 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prometheus_alerts_path", 2023-08-11T12:40:17.186 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.186 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.186 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.187 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-08-11T12:40:17.187 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.187 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.187 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.187 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-08-11T12:40:17.188 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.188 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.190 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.190 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.190 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_insecure": { 2023-08-11T12:40:17.191 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_insecure", 2023-08-11T12:40:17.192 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.192 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.192 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.192 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.193 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.193 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.193 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.193 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-08-11T12:40:17.193 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.194 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.194 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.194 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.195 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_password": { 2023-08-11T12:40:17.195 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_password", 2023-08-11T12:40:17.195 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.195 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.196 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.196 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.196 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.196 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.196 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.198 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-08-11T12:40:17.198 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.199 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.199 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.199 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.199 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_url": { 2023-08-11T12:40:17.200 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_url", 2023-08-11T12:40:17.200 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.200 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.200 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.200 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.201 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.201 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.201 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.202 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-08-11T12:40:17.202 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.202 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.202 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.202 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.203 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_username": { 2023-08-11T12:40:17.203 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_username", 2023-08-11T12:40:17.203 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.203 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.204 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.204 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.204 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.204 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.204 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.205 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-08-11T12:40:17.205 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.205 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.205 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.205 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.206 INFO:teuthology.orchestra.run.smithi008.stdout: "secure_monitoring_stack": { 2023-08-11T12:40:17.206 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "secure_monitoring_stack", 2023-08-11T12:40:17.206 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.206 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.206 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.206 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.207 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.207 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.207 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.207 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-08-11T12:40:17.207 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.208 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.208 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.208 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.208 INFO:teuthology.orchestra.run.smithi008.stdout: "service_discovery_port": { 2023-08-11T12:40:17.208 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "service_discovery_port", 2023-08-11T12:40:17.209 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.209 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.209 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.209 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8765", 2023-08-11T12:40:17.209 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.210 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.210 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.210 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "cephadm service discovery port", 2023-08-11T12:40:17.210 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.210 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.211 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.211 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.211 INFO:teuthology.orchestra.run.smithi008.stdout: "ssh_config_file": { 2023-08-11T12:40:17.211 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssh_config_file", 2023-08-11T12:40:17.212 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.212 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.212 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.213 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.213 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.213 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.213 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.213 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-08-11T12:40:17.214 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.214 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.214 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.214 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.214 INFO:teuthology.orchestra.run.smithi008.stdout: "use_agent": { 2023-08-11T12:40:17.214 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "use_agent", 2023-08-11T12:40:17.215 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.215 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.215 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.215 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.215 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.216 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.216 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.216 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-08-11T12:40:17.216 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.216 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.217 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.217 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.217 INFO:teuthology.orchestra.run.smithi008.stdout: "use_repo_digest": { 2023-08-11T12:40:17.217 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "use_repo_digest", 2023-08-11T12:40:17.217 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.218 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.218 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.218 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.218 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.219 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.219 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.219 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-08-11T12:40:17.219 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.219 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.220 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.220 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.220 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_failed_host_check": { 2023-08-11T12:40:17.220 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_failed_host_check", 2023-08-11T12:40:17.221 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.221 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.221 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.221 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.221 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.221 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.222 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.222 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if the host check fails", 2023-08-11T12:40:17.222 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.222 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.223 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.223 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.223 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_stray_daemons": { 2023-08-11T12:40:17.223 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_stray_daemons", 2023-08-11T12:40:17.223 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.223 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.224 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.224 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.224 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.224 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.224 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.225 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-08-11T12:40:17.225 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.225 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.225 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.225 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.226 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_stray_hosts": { 2023-08-11T12:40:17.226 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_stray_hosts", 2023-08-11T12:40:17.226 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.226 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.226 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.227 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.227 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.227 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.227 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.227 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-08-11T12:40:17.228 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.228 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.228 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.228 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.228 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.229 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.229 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:17.229 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crash", 2023-08-11T12:40:17.229 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:17.229 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:17.230 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:17.230 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:17.230 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:17.230 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.230 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.231 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.231 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.231 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.231 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.232 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.232 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.232 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.232 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.232 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.233 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.233 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.233 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.233 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.233 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.234 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.234 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.234 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.234 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:17.234 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:17.235 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.235 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.235 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.235 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.235 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.236 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.236 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.236 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.236 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.237 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.237 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.237 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.237 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:17.237 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:17.237 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.238 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.238 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.238 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:17.238 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.238 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.239 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.239 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.239 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.239 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.239 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.240 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.240 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.240 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.240 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.240 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.241 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.241 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.241 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.241 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:17.241 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:17.242 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.242 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.242 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.242 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.242 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.243 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.243 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.243 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.243 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.243 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.244 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.244 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.244 INFO:teuthology.orchestra.run.smithi008.stdout: "retain_interval": { 2023-08-11T12:40:17.244 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "retain_interval", 2023-08-11T12:40:17.244 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:17.245 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.245 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.245 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "31536000", 2023-08-11T12:40:17.245 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.245 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.246 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.246 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long to retain crashes before pruning them", 2023-08-11T12:40:17.246 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.246 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.246 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.247 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.247 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_recent_interval": { 2023-08-11T12:40:17.247 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_recent_interval", 2023-08-11T12:40:17.247 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:17.247 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.248 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.248 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1209600", 2023-08-11T12:40:17.248 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.248 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.248 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.249 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "time interval in which to warn about recent crashes", 2023-08-11T12:40:17.249 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.249 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.249 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.249 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.250 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.250 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.250 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:17.250 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "dashboard", 2023-08-11T12:40:17.250 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:17.251 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:17.251 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:17.251 INFO:teuthology.orchestra.run.smithi008.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-08-11T12:40:17.251 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-08-11T12:40:17.251 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.251 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.252 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.252 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-08-11T12:40:17.252 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.252 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.253 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.253 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.253 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.253 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.253 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.253 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.254 INFO:teuthology.orchestra.run.smithi008.stdout: "ALERTMANAGER_API_HOST": { 2023-08-11T12:40:17.254 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ALERTMANAGER_API_HOST", 2023-08-11T12:40:17.254 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.254 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.254 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.255 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.255 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.255 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.255 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.255 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.256 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.256 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.256 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.256 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.256 INFO:teuthology.orchestra.run.smithi008.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-08-11T12:40:17.257 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-08-11T12:40:17.257 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.257 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.257 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.257 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.258 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.258 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.258 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.258 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.258 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.259 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.259 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.259 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.259 INFO:teuthology.orchestra.run.smithi008.stdout: "AUDIT_API_ENABLED": { 2023-08-11T12:40:17.259 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "AUDIT_API_ENABLED", 2023-08-11T12:40:17.260 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.260 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.260 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.260 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.260 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.261 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.261 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.261 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.261 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.261 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.261 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.262 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.262 INFO:teuthology.orchestra.run.smithi008.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-08-11T12:40:17.262 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-08-11T12:40:17.262 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.262 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.263 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.263 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.263 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.263 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.263 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.264 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.264 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.264 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.264 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.264 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.265 INFO:teuthology.orchestra.run.smithi008.stdout: "ENABLE_BROWSABLE_API": { 2023-08-11T12:40:17.265 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ENABLE_BROWSABLE_API", 2023-08-11T12:40:17.265 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.265 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.265 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.266 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.266 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.266 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.266 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.266 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.267 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.267 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.267 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.267 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.267 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-08-11T12:40:17.268 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-08-11T12:40:17.268 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.268 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.268 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.268 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.269 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.269 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.269 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.269 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.269 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.270 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.270 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.270 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-08-11T12:40:17.270 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-08-11T12:40:17.270 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.271 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.271 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.271 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.271 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.272 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.272 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.272 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.272 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.272 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.273 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.273 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.273 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-08-11T12:40:17.273 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-08-11T12:40:17.273 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.274 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.274 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.274 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.274 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.275 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.275 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.275 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.275 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.275 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.276 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.276 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.276 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-08-11T12:40:17.276 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-08-11T12:40:17.276 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.277 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.277 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.277 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.277 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.277 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.278 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.278 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.278 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.278 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.278 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.279 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.279 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_NFS": { 2023-08-11T12:40:17.279 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-08-11T12:40:17.279 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.279 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.280 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.280 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.280 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.280 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.281 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.281 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.281 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.281 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.282 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.282 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.282 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_RBD": { 2023-08-11T12:40:17.282 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-08-11T12:40:17.282 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.283 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.283 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.283 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.283 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.283 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.284 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.284 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.284 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.284 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.284 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.285 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.285 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_RGW": { 2023-08-11T12:40:17.285 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-08-11T12:40:17.285 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.285 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.286 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.286 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.286 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.286 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.286 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.287 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.287 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.287 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.287 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.287 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.288 INFO:teuthology.orchestra.run.smithi008.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-08-11T12:40:17.288 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-08-11T12:40:17.288 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.288 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.288 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.289 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.289 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.289 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.289 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.289 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.290 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.290 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.290 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.290 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.290 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_PASSWORD": { 2023-08-11T12:40:17.290 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_PASSWORD", 2023-08-11T12:40:17.291 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.291 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.291 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.291 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2023-08-11T12:40:17.291 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.292 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.292 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.292 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.292 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.292 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.293 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.293 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.293 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-08-11T12:40:17.293 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-08-11T12:40:17.293 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.294 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.294 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.294 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.294 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.294 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.295 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.295 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.295 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.295 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.295 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.296 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.296 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_URL": { 2023-08-11T12:40:17.296 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_URL", 2023-08-11T12:40:17.296 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.296 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.297 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.297 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.297 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.297 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.297 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.297 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.298 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.298 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.298 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.298 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.298 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_USERNAME": { 2023-08-11T12:40:17.299 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_USERNAME", 2023-08-11T12:40:17.299 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.299 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.299 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.299 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2023-08-11T12:40:17.300 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.300 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.300 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.300 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.300 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.301 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.301 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.301 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.301 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-08-11T12:40:17.301 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-08-11T12:40:17.302 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.302 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.302 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.302 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.302 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.303 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.303 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.303 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.303 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.303 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.304 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.304 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.304 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-08-11T12:40:17.304 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-08-11T12:40:17.304 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.305 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.305 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.305 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.305 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.305 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.305 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.306 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.306 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.306 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.306 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.306 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.307 INFO:teuthology.orchestra.run.smithi008.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-08-11T12:40:17.307 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-08-11T12:40:17.307 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.307 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.307 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.308 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.308 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.308 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.308 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.308 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.309 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.309 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.309 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.309 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.309 INFO:teuthology.orchestra.run.smithi008.stdout: "ISSUE_TRACKER_API_KEY": { 2023-08-11T12:40:17.310 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-08-11T12:40:17.310 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.310 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.310 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.310 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.311 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.311 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.311 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.311 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.311 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.312 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.312 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.312 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.312 INFO:teuthology.orchestra.run.smithi008.stdout: "PROMETHEUS_API_HOST": { 2023-08-11T12:40:17.312 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PROMETHEUS_API_HOST", 2023-08-11T12:40:17.313 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.313 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.313 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.313 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.313 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.314 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.314 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.314 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.314 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.314 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.315 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.315 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.315 INFO:teuthology.orchestra.run.smithi008.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-08-11T12:40:17.315 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-08-11T12:40:17.315 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.316 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.316 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.316 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.316 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.316 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.317 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.317 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.317 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.317 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.317 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.318 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.318 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-08-11T12:40:17.318 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-08-11T12:40:17.318 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.318 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.319 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.319 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.319 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.319 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.319 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.320 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.320 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.320 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.320 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.320 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.321 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-08-11T12:40:17.321 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-08-11T12:40:17.321 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.321 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.321 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.322 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.322 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.322 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.322 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.322 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.323 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.323 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.323 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.323 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.323 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-08-11T12:40:17.323 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-08-11T12:40:17.324 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.324 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.324 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.324 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.324 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.325 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.325 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.325 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.325 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.325 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.326 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.326 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.326 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-08-11T12:40:17.326 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-08-11T12:40:17.326 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.327 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.327 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.327 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.327 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.327 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.328 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.328 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.328 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.328 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.328 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.329 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-08-11T12:40:17.329 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-08-11T12:40:17.329 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.329 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.330 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.330 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.330 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.330 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.330 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.331 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.331 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.331 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.331 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.331 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-08-11T12:40:17.332 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-08-11T12:40:17.332 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.332 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.332 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.332 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.333 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.333 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.333 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.333 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.333 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.334 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.334 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.337 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-08-11T12:40:17.337 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-08-11T12:40:17.337 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.337 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.337 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.338 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.338 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.338 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.338 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.338 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.339 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.339 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.339 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.339 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.339 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_ENABLED": { 2023-08-11T12:40:17.340 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_ENABLED", 2023-08-11T12:40:17.340 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.340 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.340 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.340 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.341 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.341 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.341 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.341 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.341 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.342 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.342 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.342 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-08-11T12:40:17.342 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-08-11T12:40:17.343 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.343 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.343 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.343 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-08-11T12:40:17.343 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.344 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.344 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.344 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.344 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.344 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.345 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.345 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-08-11T12:40:17.345 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-08-11T12:40:17.345 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.346 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.346 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.346 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-08-11T12:40:17.346 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.346 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.347 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.347 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.347 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.347 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.347 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.348 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-08-11T12:40:17.348 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-08-11T12:40:17.348 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.348 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.349 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.349 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8", 2023-08-11T12:40:17.349 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.349 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.349 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.350 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.350 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.350 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.350 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.351 INFO:teuthology.orchestra.run.smithi008.stdout: "REST_REQUESTS_TIMEOUT": { 2023-08-11T12:40:17.351 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-08-11T12:40:17.351 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.351 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.351 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.352 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "45", 2023-08-11T12:40:17.352 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.352 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.352 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.352 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.353 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.353 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.353 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.353 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_ACCESS_KEY": { 2023-08-11T12:40:17.354 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_ACCESS_KEY", 2023-08-11T12:40:17.354 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.354 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.354 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.354 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.354 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.355 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.355 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.355 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.355 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.355 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.356 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.356 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.356 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-08-11T12:40:17.356 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-08-11T12:40:17.356 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.357 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.357 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.357 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2023-08-11T12:40:17.357 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.357 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.358 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.358 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.358 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.358 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.358 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.359 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_SECRET_KEY": { 2023-08-11T12:40:17.359 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_SECRET_KEY", 2023-08-11T12:40:17.359 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.359 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.360 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.360 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.360 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.360 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.360 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.361 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.361 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.361 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.361 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.361 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.362 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_SSL_VERIFY": { 2023-08-11T12:40:17.362 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_SSL_VERIFY", 2023-08-11T12:40:17.362 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.362 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.362 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.363 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.363 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.363 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.363 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.363 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.363 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.364 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.364 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.364 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.364 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-08-11T12:40:17.364 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-08-11T12:40:17.365 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.365 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.365 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.365 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-08-11T12:40:17.365 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.366 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.366 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.366 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.366 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.366 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.367 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.367 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.367 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-08-11T12:40:17.367 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-08-11T12:40:17.367 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.368 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.368 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.368 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-08-11T12:40:17.368 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.368 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.369 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.369 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.369 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.369 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.369 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.370 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.370 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-08-11T12:40:17.370 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-08-11T12:40:17.370 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.370 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.371 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.371 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-08-11T12:40:17.371 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.371 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.371 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.372 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.372 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.372 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.372 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.372 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.373 INFO:teuthology.orchestra.run.smithi008.stdout: "cross_origin_url": { 2023-08-11T12:40:17.373 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cross_origin_url", 2023-08-11T12:40:17.373 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.373 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.373 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.373 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.374 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.374 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.374 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.374 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.374 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.375 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.375 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.375 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.375 INFO:teuthology.orchestra.run.smithi008.stdout: "crt_file": { 2023-08-11T12:40:17.375 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crt_file", 2023-08-11T12:40:17.376 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.376 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.376 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.376 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.376 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.377 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.377 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.377 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.377 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.377 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.378 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.378 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.378 INFO:teuthology.orchestra.run.smithi008.stdout: "debug": { 2023-08-11T12:40:17.378 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "debug", 2023-08-11T12:40:17.378 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.379 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.379 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.379 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.379 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.379 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.380 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.380 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable/disable debug options", 2023-08-11T12:40:17.380 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.380 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.380 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.381 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.381 INFO:teuthology.orchestra.run.smithi008.stdout: "jwt_token_ttl": { 2023-08-11T12:40:17.381 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "jwt_token_ttl", 2023-08-11T12:40:17.381 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.381 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.382 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.382 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "28800", 2023-08-11T12:40:17.382 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.382 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.382 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.382 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.383 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.383 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.383 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.383 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.384 INFO:teuthology.orchestra.run.smithi008.stdout: "key_file": { 2023-08-11T12:40:17.384 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "key_file", 2023-08-11T12:40:17.384 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.384 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.384 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.385 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.385 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.385 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.385 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.385 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.385 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.386 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.386 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.386 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.386 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:17.386 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:17.387 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.387 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.387 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.387 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.387 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.388 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.388 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.388 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.388 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.388 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.389 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.389 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.389 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.389 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.389 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.390 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.390 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.390 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.390 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.390 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:17.391 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:17.391 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.391 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.391 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.391 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.392 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.392 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.392 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.392 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.392 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.393 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.393 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.393 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.393 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:17.393 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:17.394 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.394 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.394 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.394 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:17.394 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.395 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.395 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.395 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.395 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.395 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.396 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.396 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.396 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.396 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.396 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.397 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.397 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.397 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.397 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.397 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:17.397 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:17.398 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.398 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.398 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.398 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.398 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.399 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.399 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.399 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.399 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.399 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.400 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.400 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.400 INFO:teuthology.orchestra.run.smithi008.stdout: "motd": { 2023-08-11T12:40:17.400 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "motd", 2023-08-11T12:40:17.400 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.401 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.401 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.401 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.401 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.401 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.402 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.402 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "The message of the day", 2023-08-11T12:40:17.402 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.402 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.402 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.403 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.403 INFO:teuthology.orchestra.run.smithi008.stdout: "redirect_resolve_ip_addr": { 2023-08-11T12:40:17.403 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "redirect_resolve_ip_addr", 2023-08-11T12:40:17.403 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.403 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.404 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.404 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.404 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.404 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.404 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.405 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.405 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.405 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.405 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.405 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.405 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2023-08-11T12:40:17.406 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2023-08-11T12:40:17.406 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.406 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.406 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.406 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "::", 2023-08-11T12:40:17.407 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.407 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.407 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.407 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.407 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.408 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.408 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.408 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.408 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2023-08-11T12:40:17.408 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2023-08-11T12:40:17.409 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.409 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.409 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.409 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8080", 2023-08-11T12:40:17.409 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.410 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.410 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.410 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.410 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.410 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.411 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.411 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.411 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl": { 2023-08-11T12:40:17.411 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl", 2023-08-11T12:40:17.411 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.412 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.412 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.412 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.412 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.412 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.413 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.413 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.413 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.413 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.413 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.413 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.414 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl_server_port": { 2023-08-11T12:40:17.414 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl_server_port", 2023-08-11T12:40:17.414 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.414 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.414 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.415 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8443", 2023-08-11T12:40:17.415 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.415 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.415 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.415 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.416 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.416 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.416 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.416 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.416 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_behaviour": { 2023-08-11T12:40:17.417 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_behaviour", 2023-08-11T12:40:17.417 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.417 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.417 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.417 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "redirect", 2023-08-11T12:40:17.418 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.418 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.418 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.418 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.418 INFO:teuthology.orchestra.run.smithi008.stdout: "redirect" 2023-08-11T12:40:17.419 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.419 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.419 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.419 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.419 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.420 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.420 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_error_status_code": { 2023-08-11T12:40:17.420 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_error_status_code", 2023-08-11T12:40:17.420 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.420 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.421 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.421 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "500", 2023-08-11T12:40:17.421 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "400", 2023-08-11T12:40:17.421 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "599", 2023-08-11T12:40:17.421 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.422 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.422 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.422 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.422 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.422 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.423 INFO:teuthology.orchestra.run.smithi008.stdout: "url_prefix": { 2023-08-11T12:40:17.423 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "url_prefix", 2023-08-11T12:40:17.423 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.423 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.423 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.424 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.424 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.424 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.424 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.424 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.425 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.425 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.425 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.425 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.425 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.426 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.426 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:17.426 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "devicehealth", 2023-08-11T12:40:17.426 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:17.426 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:17.427 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:17.427 INFO:teuthology.orchestra.run.smithi008.stdout: "enable_monitoring": { 2023-08-11T12:40:17.427 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enable_monitoring", 2023-08-11T12:40:17.427 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.427 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.429 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.429 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.429 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.429 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.429 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.430 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "monitor device health metrics", 2023-08-11T12:40:17.430 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.430 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.430 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.430 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.431 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:17.431 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:17.431 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.431 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.431 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.431 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.432 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.432 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.432 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.432 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.433 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.433 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.433 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.433 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.433 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.434 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.434 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.434 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.434 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.434 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.434 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.435 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:17.435 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:17.435 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.435 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.435 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.436 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.436 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.436 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.436 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.436 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.437 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.437 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.437 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.437 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.437 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:17.438 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:17.438 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.438 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.438 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.438 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:17.439 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.439 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.439 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.439 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.439 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.440 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.440 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.440 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.440 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.440 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.441 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.441 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.441 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.441 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.441 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.442 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:17.442 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:17.442 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.442 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.442 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.442 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.443 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.443 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.443 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.443 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.443 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.444 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.444 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.444 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.444 INFO:teuthology.orchestra.run.smithi008.stdout: "mark_out_threshold": { 2023-08-11T12:40:17.444 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mark_out_threshold", 2023-08-11T12:40:17.445 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:17.445 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.445 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.445 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "2419200", 2023-08-11T12:40:17.445 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.446 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.446 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.446 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-08-11T12:40:17.446 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.446 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.447 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.447 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.447 INFO:teuthology.orchestra.run.smithi008.stdout: "pool_name": { 2023-08-11T12:40:17.447 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pool_name", 2023-08-11T12:40:17.447 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.448 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.448 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.448 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "device_health_metrics", 2023-08-11T12:40:17.448 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.448 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.449 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.449 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "name of pool in which to store device health metrics", 2023-08-11T12:40:17.449 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.449 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.449 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.450 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.450 INFO:teuthology.orchestra.run.smithi008.stdout: "retention_period": { 2023-08-11T12:40:17.450 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "retention_period", 2023-08-11T12:40:17.450 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:17.450 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.451 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.451 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15552000", 2023-08-11T12:40:17.451 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.451 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.451 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.452 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long to retain device health metrics", 2023-08-11T12:40:17.452 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.452 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.452 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.452 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.453 INFO:teuthology.orchestra.run.smithi008.stdout: "scrape_frequency": { 2023-08-11T12:40:17.453 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "scrape_frequency", 2023-08-11T12:40:17.453 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:17.453 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.453 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.453 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "86400", 2023-08-11T12:40:17.454 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.454 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.454 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.454 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to scrape device health metrics", 2023-08-11T12:40:17.454 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.455 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.455 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.455 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.455 INFO:teuthology.orchestra.run.smithi008.stdout: "self_heal": { 2023-08-11T12:40:17.455 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "self_heal", 2023-08-11T12:40:17.456 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.456 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.456 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.456 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.456 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.457 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.457 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.457 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-08-11T12:40:17.457 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.457 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.458 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.458 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.458 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-08-11T12:40:17.458 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-08-11T12:40:17.458 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:17.459 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.459 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.459 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-08-11T12:40:17.459 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.459 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.460 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.460 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to wake up and check device health", 2023-08-11T12:40:17.460 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.460 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.460 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.461 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.461 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_threshold": { 2023-08-11T12:40:17.461 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_threshold", 2023-08-11T12:40:17.461 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:17.461 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.462 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.462 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "7257600", 2023-08-11T12:40:17.462 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.462 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.462 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.463 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-08-11T12:40:17.463 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.463 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.463 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.463 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.464 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.464 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.464 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:17.464 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "diskprediction_local", 2023-08-11T12:40:17.464 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:17.465 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:17.465 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:17.465 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:17.465 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:17.465 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.466 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.466 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.466 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.466 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.466 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.467 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.467 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.467 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.467 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.467 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.467 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.468 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.468 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.468 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.468 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.468 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.469 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.469 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.469 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:17.469 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:17.469 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.470 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.470 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.470 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.470 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.470 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.471 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.471 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.471 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.471 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.471 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.472 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.472 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:17.472 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:17.472 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.472 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.473 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.473 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:17.473 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.473 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.473 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.474 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.474 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.474 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.474 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.474 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.475 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.475 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.475 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.475 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.475 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.476 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.476 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.476 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:17.476 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:17.476 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.477 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.477 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.477 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.477 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.477 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.478 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.478 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.478 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.478 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.478 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.479 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.479 INFO:teuthology.orchestra.run.smithi008.stdout: "predict_interval": { 2023-08-11T12:40:17.479 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "predict_interval", 2023-08-11T12:40:17.479 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.479 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.480 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.480 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "86400", 2023-08-11T12:40:17.480 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.480 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.480 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.481 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.481 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.481 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.481 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.481 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.481 INFO:teuthology.orchestra.run.smithi008.stdout: "predictor_model": { 2023-08-11T12:40:17.482 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "predictor_model", 2023-08-11T12:40:17.482 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.482 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.482 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.482 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "prophetstor", 2023-08-11T12:40:17.483 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.483 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.483 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.483 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.483 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.484 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.484 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.484 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.484 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-08-11T12:40:17.484 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-08-11T12:40:17.485 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.485 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.485 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.485 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-08-11T12:40:17.485 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.486 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.486 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.486 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.486 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.486 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.487 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.487 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.487 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.487 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.487 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:17.488 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "influx", 2023-08-11T12:40:17.488 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": false, 2023-08-11T12:40:17.488 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "influxdb python module not found", 2023-08-11T12:40:17.488 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:17.488 INFO:teuthology.orchestra.run.smithi008.stdout: "batch_size": { 2023-08-11T12:40:17.489 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "batch_size", 2023-08-11T12:40:17.489 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.489 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.489 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.489 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5000", 2023-08-11T12:40:17.490 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.490 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.490 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.490 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-08-11T12:40:17.490 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.490 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.491 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.491 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.491 INFO:teuthology.orchestra.run.smithi008.stdout: "database": { 2023-08-11T12:40:17.491 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "database", 2023-08-11T12:40:17.491 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.492 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.492 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.492 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "ceph", 2023-08-11T12:40:17.492 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.492 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.493 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.493 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-08-11T12:40:17.493 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.493 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.493 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.494 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.494 INFO:teuthology.orchestra.run.smithi008.stdout: "hostname": { 2023-08-11T12:40:17.494 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "hostname", 2023-08-11T12:40:17.494 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.494 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.495 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.495 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.495 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.495 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.496 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.496 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB server hostname", 2023-08-11T12:40:17.496 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.496 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.496 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.497 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.497 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-08-11T12:40:17.497 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-08-11T12:40:17.497 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:17.497 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.497 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.498 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "30", 2023-08-11T12:40:17.498 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "5", 2023-08-11T12:40:17.498 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.498 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.498 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-08-11T12:40:17.499 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.499 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.499 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.499 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.499 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:17.500 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:17.500 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.500 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.500 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.500 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.501 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.501 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.501 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.501 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.501 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.502 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.502 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.502 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.502 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.502 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.503 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.503 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.503 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.503 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.503 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.504 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:17.504 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:17.504 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.504 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.504 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.505 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.505 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.505 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.505 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.505 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.506 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.506 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.506 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.506 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.506 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:17.507 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:17.507 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.507 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.507 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.507 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:17.508 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.508 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.508 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.508 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.508 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.509 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.509 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.509 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.509 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.509 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.510 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.510 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.510 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.510 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.510 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.511 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:17.511 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:17.511 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.511 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.511 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.511 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.512 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.512 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.512 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.512 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.512 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.513 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.513 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.513 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.513 INFO:teuthology.orchestra.run.smithi008.stdout: "password": { 2023-08-11T12:40:17.513 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "password", 2023-08-11T12:40:17.514 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.514 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.514 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.514 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.514 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.515 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.515 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.515 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "password of InfluxDB server user", 2023-08-11T12:40:17.515 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.515 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.516 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.516 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.516 INFO:teuthology.orchestra.run.smithi008.stdout: "port": { 2023-08-11T12:40:17.516 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "port", 2023-08-11T12:40:17.516 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.517 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.517 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.517 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8086", 2023-08-11T12:40:17.517 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.517 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.518 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.518 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB server port", 2023-08-11T12:40:17.518 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.518 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.518 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.519 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.519 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl": { 2023-08-11T12:40:17.519 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl", 2023-08-11T12:40:17.519 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.519 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.520 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.520 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "false", 2023-08-11T12:40:17.520 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.520 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.520 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.521 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-08-11T12:40:17.521 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.521 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.521 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.521 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.522 INFO:teuthology.orchestra.run.smithi008.stdout: "threads": { 2023-08-11T12:40:17.522 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "threads", 2023-08-11T12:40:17.522 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.522 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.522 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.523 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-08-11T12:40:17.523 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-08-11T12:40:17.523 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "32", 2023-08-11T12:40:17.523 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.523 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-08-11T12:40:17.524 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.524 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.524 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.524 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.524 INFO:teuthology.orchestra.run.smithi008.stdout: "username": { 2023-08-11T12:40:17.525 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "username", 2023-08-11T12:40:17.525 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.525 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.525 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.525 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.526 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.526 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.526 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.526 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "username of InfluxDB server user", 2023-08-11T12:40:17.526 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.526 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.527 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.527 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.527 INFO:teuthology.orchestra.run.smithi008.stdout: "verify_ssl": { 2023-08-11T12:40:17.527 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "verify_ssl", 2023-08-11T12:40:17.527 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.528 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.528 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.528 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "true", 2023-08-11T12:40:17.528 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.528 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.529 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.529 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-08-11T12:40:17.529 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.529 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.529 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.530 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.530 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.530 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.530 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:17.530 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "insights", 2023-08-11T12:40:17.531 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:17.531 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:17.531 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:17.531 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:17.531 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:17.532 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.532 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.532 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.532 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.532 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.533 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.533 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.533 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.533 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.533 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.534 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.534 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.534 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.534 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.534 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.535 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.535 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.535 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.535 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.535 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:17.536 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:17.536 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.536 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.536 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.536 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.537 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.537 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.537 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.537 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.537 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.538 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.538 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.538 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.538 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:17.538 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:17.539 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.539 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.539 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.539 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:17.539 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.540 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.540 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.540 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.540 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.540 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.541 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.541 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.541 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.541 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.541 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.542 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.542 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.542 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.542 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.542 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:17.543 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:17.543 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.543 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.543 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.543 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.544 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.544 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.544 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.544 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.544 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.545 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.545 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.545 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.545 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.545 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.545 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:17.546 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "iostat", 2023-08-11T12:40:17.546 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:17.546 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:17.546 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:17.546 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:17.547 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:17.547 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.547 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.547 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.547 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.548 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.548 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.548 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.548 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.548 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.549 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.549 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.549 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.549 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.549 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.550 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.550 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.550 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.550 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.550 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.551 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:17.551 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:17.551 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.551 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.551 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.552 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.552 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.552 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.552 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.552 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.553 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.553 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.553 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.553 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.553 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:17.554 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:17.554 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.554 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.554 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.554 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:17.554 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.555 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.555 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.555 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.555 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.555 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.556 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.556 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.556 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.556 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.556 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.557 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.557 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.557 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.557 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.557 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:17.558 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:17.558 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.558 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.558 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.558 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.559 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.559 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.559 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.559 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.559 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.560 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.560 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.560 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.560 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.560 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.561 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:17.561 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "k8sevents", 2023-08-11T12:40:17.561 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:17.561 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:17.561 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:17.562 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_event_retention_days": { 2023-08-11T12:40:17.562 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ceph_event_retention_days", 2023-08-11T12:40:17.562 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.562 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.562 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.563 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "7", 2023-08-11T12:40:17.563 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.563 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.563 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.563 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Days to hold ceph event information within local cache", 2023-08-11T12:40:17.564 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.564 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.564 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.564 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.564 INFO:teuthology.orchestra.run.smithi008.stdout: "config_check_secs": { 2023-08-11T12:40:17.565 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_check_secs", 2023-08-11T12:40:17.565 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.565 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.565 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.565 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-08-11T12:40:17.565 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "10", 2023-08-11T12:40:17.566 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.566 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.566 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-08-11T12:40:17.566 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.566 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.567 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.567 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.567 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:17.567 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:17.567 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.568 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.568 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.568 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.568 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.569 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.569 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.569 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.570 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.570 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.570 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.570 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.571 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.571 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.571 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.572 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.572 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.572 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.572 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.573 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:17.573 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:17.573 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.573 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.573 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.574 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.574 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.574 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.574 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.575 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.575 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.575 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.575 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.575 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.576 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:17.576 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:17.576 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.576 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.576 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.577 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:17.577 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.577 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.577 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.577 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.577 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.578 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.578 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.578 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.578 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.578 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.579 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.579 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.579 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.579 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.579 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.580 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:17.580 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:17.580 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.580 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.580 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.581 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.581 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.581 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.581 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.581 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.582 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.582 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.582 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.582 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.582 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.583 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.583 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:17.583 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "localpool", 2023-08-11T12:40:17.583 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:17.583 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:17.584 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:17.584 INFO:teuthology.orchestra.run.smithi008.stdout: "failure_domain": { 2023-08-11T12:40:17.584 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "failure_domain", 2023-08-11T12:40:17.584 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.584 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.585 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.585 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "host", 2023-08-11T12:40:17.585 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.585 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.585 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.586 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "failure domain for any created local pool", 2023-08-11T12:40:17.586 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-08-11T12:40:17.586 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.586 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.586 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.587 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:17.587 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:17.587 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.587 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.587 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.588 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.588 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.588 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.588 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.588 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.589 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.589 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.589 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.589 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.589 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.590 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.590 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.590 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.590 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.590 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.591 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.591 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:17.591 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:17.591 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.591 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.592 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.592 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.592 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.592 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.592 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.593 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.593 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.593 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.593 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.593 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.594 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:17.594 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:17.594 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.594 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.594 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.595 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:17.595 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.595 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.595 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.595 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.595 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.596 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.596 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.596 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.596 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.596 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.597 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.597 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.597 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.597 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.597 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.598 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:17.598 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:17.598 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.598 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.598 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.599 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.599 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.599 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.599 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.599 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.600 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.600 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.600 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.600 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.600 INFO:teuthology.orchestra.run.smithi008.stdout: "min_size": { 2023-08-11T12:40:17.601 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "min_size", 2023-08-11T12:40:17.601 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.601 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.601 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.601 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.602 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.602 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.602 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.602 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default min_size for any created local pool", 2023-08-11T12:40:17.602 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-08-11T12:40:17.603 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.603 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.603 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.603 INFO:teuthology.orchestra.run.smithi008.stdout: "num_rep": { 2023-08-11T12:40:17.603 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "num_rep", 2023-08-11T12:40:17.603 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.604 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.604 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.604 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3", 2023-08-11T12:40:17.604 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.605 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.605 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.605 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default replica count for any created local pool", 2023-08-11T12:40:17.605 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.605 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.605 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.606 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.606 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_num": { 2023-08-11T12:40:17.606 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pg_num", 2023-08-11T12:40:17.606 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.606 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.607 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.607 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "128", 2023-08-11T12:40:17.607 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.607 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.607 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.608 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default pg_num for any created local pool", 2023-08-11T12:40:17.608 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.608 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.608 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.608 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.609 INFO:teuthology.orchestra.run.smithi008.stdout: "prefix": { 2023-08-11T12:40:17.609 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prefix", 2023-08-11T12:40:17.609 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.609 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.610 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.610 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.610 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.610 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.610 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.610 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "name prefix for any created local pool", 2023-08-11T12:40:17.611 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.611 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.611 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.611 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.611 INFO:teuthology.orchestra.run.smithi008.stdout: "subtree": { 2023-08-11T12:40:17.612 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "subtree", 2023-08-11T12:40:17.612 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.612 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.612 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.612 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "rack", 2023-08-11T12:40:17.613 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.613 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.613 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.613 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "CRUSH level for which to create a local pool", 2023-08-11T12:40:17.613 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-08-11T12:40:17.614 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.614 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.614 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.614 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.614 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.615 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:17.615 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mds_autoscaler", 2023-08-11T12:40:17.615 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:17.615 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:17.615 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:17.616 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:17.616 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:17.616 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.616 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.616 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.617 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.617 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.617 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.617 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.617 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.618 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.618 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.618 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.618 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.618 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.619 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.619 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.619 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.619 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.619 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.620 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.620 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:17.620 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:17.620 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.620 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.621 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.621 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.621 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.621 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.621 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.622 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.622 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.622 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.622 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.622 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.622 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:17.623 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:17.623 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.623 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.623 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.623 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:17.624 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.624 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.624 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.624 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.625 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.625 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.625 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.625 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.625 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.625 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.626 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.626 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.626 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.626 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.626 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.627 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:17.627 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:17.627 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.627 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.627 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.628 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.628 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.628 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.628 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.628 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.629 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.629 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.629 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.629 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.629 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.630 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.630 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:17.630 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mirroring", 2023-08-11T12:40:17.630 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:17.630 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:17.631 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:17.631 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:17.631 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:17.631 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.631 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.632 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.632 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.632 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.632 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.632 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.633 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.633 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.633 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.633 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.633 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.634 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.634 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.634 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.634 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.634 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.635 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.635 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.635 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:17.635 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:17.635 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.636 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.636 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.636 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.636 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.636 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.637 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.637 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.637 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.637 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.637 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.637 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.638 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:17.638 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:17.638 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.638 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.638 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.639 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:17.639 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.639 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.639 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.639 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.640 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.640 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.640 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.640 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.640 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.641 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.641 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.641 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.641 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.641 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.642 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.642 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:17.642 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:17.642 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.642 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.643 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.643 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.643 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.643 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.643 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.644 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.644 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.644 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.644 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.644 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.645 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.645 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.645 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:17.645 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "nfs", 2023-08-11T12:40:17.645 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:17.646 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:17.646 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:17.646 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:17.646 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:17.646 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.647 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.647 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.647 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.647 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.647 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.647 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.648 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.648 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.648 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.649 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.649 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.649 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.649 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.649 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.650 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.650 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.650 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.650 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.650 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:17.651 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:17.651 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.651 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.651 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.651 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.652 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.652 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.652 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.652 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.652 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.653 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.653 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.653 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.653 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:17.653 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:17.654 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.654 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.654 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.654 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:17.654 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.655 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.655 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.655 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.655 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.655 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.656 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.656 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.656 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.656 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.656 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.656 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.657 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.657 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.657 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.657 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:17.657 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:17.658 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.658 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.658 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.658 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.658 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.659 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.659 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.659 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.659 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.659 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.660 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.660 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.660 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.660 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.660 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:17.661 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "orchestrator", 2023-08-11T12:40:17.661 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:17.661 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:17.661 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:17.661 INFO:teuthology.orchestra.run.smithi008.stdout: "fail_fs": { 2023-08-11T12:40:17.662 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "fail_fs", 2023-08-11T12:40:17.662 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.662 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.662 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.662 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.663 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.663 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.663 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.663 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-08-11T12:40:17.663 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.664 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.664 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.664 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.664 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:17.664 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:17.665 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.665 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.665 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.665 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.665 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.666 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.666 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.666 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.666 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.666 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.667 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.667 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.667 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.667 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.667 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.668 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.668 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.668 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.668 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.668 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:17.669 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:17.669 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.669 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.669 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.669 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.669 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.670 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.670 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.670 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.670 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.670 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.671 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.671 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.671 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:17.671 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:17.671 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.672 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.672 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.672 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:17.672 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.672 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.673 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.673 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.673 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.673 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.673 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.674 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.674 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.674 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.674 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.675 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.675 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.675 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.675 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.676 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:17.676 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:17.676 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.676 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.676 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.677 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.677 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.677 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.677 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.678 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.678 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.678 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.678 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.678 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.679 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator": { 2023-08-11T12:40:17.679 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "orchestrator", 2023-08-11T12:40:17.679 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.679 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.679 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.680 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.680 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.680 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.680 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.681 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm", 2023-08-11T12:40:17.681 INFO:teuthology.orchestra.run.smithi008.stdout: "rook", 2023-08-11T12:40:17.681 INFO:teuthology.orchestra.run.smithi008.stdout: "test_orchestrator" 2023-08-11T12:40:17.681 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.681 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Orchestrator backend", 2023-08-11T12:40:17.682 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.682 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.682 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.682 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.682 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.683 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.683 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:17.683 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "osd_perf_query", 2023-08-11T12:40:17.683 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:17.683 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:17.684 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:17.684 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:17.684 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:17.684 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.685 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.685 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.685 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.685 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.685 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.686 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.686 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.686 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.686 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.686 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.687 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.687 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.687 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.687 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.687 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.688 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.688 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.688 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.688 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:17.689 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:17.689 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.689 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.689 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.689 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.690 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.690 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.690 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.690 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.691 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.691 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.691 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.691 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.691 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:17.692 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:17.692 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.692 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.692 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.692 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:17.693 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.693 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.693 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.693 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.693 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.694 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.694 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.694 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.694 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.695 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.695 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.695 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.695 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.695 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.696 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.696 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:17.696 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:17.696 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.696 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.697 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.697 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.697 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.697 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.698 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.698 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.698 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.698 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.698 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.699 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.699 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.699 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.699 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:17.699 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "osd_support", 2023-08-11T12:40:17.700 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:17.700 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:17.700 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:17.700 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:17.700 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:17.701 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.701 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.701 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.701 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.701 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.702 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.702 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.702 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.702 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.703 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.703 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.703 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.703 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.703 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.704 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.704 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.704 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.704 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.704 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.705 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:17.705 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:17.705 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.705 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.705 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.706 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.706 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.706 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.706 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.706 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.707 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.707 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.707 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.707 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.708 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:17.708 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:17.708 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.708 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.708 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.709 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:17.709 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.709 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.709 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.709 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.710 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.710 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.710 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.710 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.710 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.711 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.711 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.711 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.711 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.711 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.712 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.712 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:17.712 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:17.712 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.713 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.713 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.713 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.713 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.713 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.714 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.714 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.714 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.714 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.714 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.715 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.715 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.715 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.715 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:17.715 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pg_autoscaler", 2023-08-11T12:40:17.716 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:17.716 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:17.716 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:17.716 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:17.717 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:17.717 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.717 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.717 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.717 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.718 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.718 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.718 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.718 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.718 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.719 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.719 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.719 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.719 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.719 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.720 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.720 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.720 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.720 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.721 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.721 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:17.721 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:17.721 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.721 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.722 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.722 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.722 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.722 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.722 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.723 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.723 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.723 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.723 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.723 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.724 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:17.724 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:17.724 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.724 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.724 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.725 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:17.725 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.725 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.725 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.725 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.726 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.726 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.726 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.726 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.727 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.727 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.727 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.727 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.727 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.728 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.728 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.728 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:17.728 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:17.728 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.729 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.729 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.729 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.729 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.730 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.730 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.730 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.730 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.730 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.731 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.731 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.731 INFO:teuthology.orchestra.run.smithi008.stdout: "noautoscale": { 2023-08-11T12:40:17.731 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "noautoscale", 2023-08-11T12:40:17.731 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.732 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.732 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.732 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.732 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.732 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.733 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.733 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "global autoscale flag", 2023-08-11T12:40:17.733 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-08-11T12:40:17.733 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.734 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.734 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.734 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-08-11T12:40:17.734 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-08-11T12:40:17.734 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:17.735 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.735 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.735 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-08-11T12:40:17.735 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.735 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.736 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.736 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.736 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.736 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.736 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.737 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.737 INFO:teuthology.orchestra.run.smithi008.stdout: "threshold": { 2023-08-11T12:40:17.737 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "threshold", 2023-08-11T12:40:17.737 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-08-11T12:40:17.737 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.738 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.738 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3.0", 2023-08-11T12:40:17.738 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1.0", 2023-08-11T12:40:17.738 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.739 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.739 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "scaling threshold", 2023-08-11T12:40:17.739 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-08-11T12:40:17.739 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.739 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.740 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.740 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.740 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.740 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:17.740 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "progress", 2023-08-11T12:40:17.741 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:17.741 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:17.741 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:17.741 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_pg_recovery_event": { 2023-08-11T12:40:17.741 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_pg_recovery_event", 2023-08-11T12:40:17.742 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.742 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.742 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.742 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.742 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.743 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.743 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.743 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow the module to show pg recovery progress", 2023-08-11T12:40:17.743 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.744 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.744 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.744 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.744 INFO:teuthology.orchestra.run.smithi008.stdout: "enabled": { 2023-08-11T12:40:17.744 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enabled", 2023-08-11T12:40:17.745 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.745 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.745 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.745 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.745 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.746 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.746 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.746 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.746 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.746 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.747 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.747 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.747 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:17.747 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:17.747 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.748 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.748 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.748 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.748 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.749 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.749 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.749 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.749 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.749 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.750 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.750 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.750 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.750 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.750 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.751 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.751 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.751 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.751 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.751 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:17.752 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:17.752 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.752 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.752 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.753 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.753 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.753 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.753 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.753 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.754 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.754 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.754 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.754 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.754 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:17.755 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:17.755 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.755 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.755 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.755 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:17.756 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.756 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.756 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.756 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.757 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.757 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.757 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.757 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.757 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.758 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.758 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.758 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.758 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.758 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.759 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.759 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:17.759 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:17.759 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.759 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.760 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.760 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.760 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.760 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.761 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.761 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.761 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.761 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.761 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.762 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.762 INFO:teuthology.orchestra.run.smithi008.stdout: "max_completed_events": { 2023-08-11T12:40:17.762 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_completed_events", 2023-08-11T12:40:17.762 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.762 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.763 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.763 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "50", 2023-08-11T12:40:17.763 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.763 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.763 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.764 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "number of past completed events to remember", 2023-08-11T12:40:17.764 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.764 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.764 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.765 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.765 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-08-11T12:40:17.765 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-08-11T12:40:17.765 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:17.765 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.766 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.766 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-08-11T12:40:17.766 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.766 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.766 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.767 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long the module is going to sleep", 2023-08-11T12:40:17.767 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.767 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.767 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.767 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.768 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.768 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.768 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:17.768 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prometheus", 2023-08-11T12:40:17.769 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:17.769 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:17.769 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:17.769 INFO:teuthology.orchestra.run.smithi008.stdout: "cache": { 2023-08-11T12:40:17.769 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cache", 2023-08-11T12:40:17.770 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.770 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.770 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.770 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.770 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.771 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.771 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.771 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.771 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.772 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.772 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.772 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.772 INFO:teuthology.orchestra.run.smithi008.stdout: "exclude_perf_counters": { 2023-08-11T12:40:17.772 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "exclude_perf_counters", 2023-08-11T12:40:17.773 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.773 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.773 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.773 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.773 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.774 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.774 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.774 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-08-11T12:40:17.774 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-08-11T12:40:17.775 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.775 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.775 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.775 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:17.775 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:17.776 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.776 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.776 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.776 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.776 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.777 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.777 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.777 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.777 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.777 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.778 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.778 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.778 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.778 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.779 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.779 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.779 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.779 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.779 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.780 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:17.780 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:17.780 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.780 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.780 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.781 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.781 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.781 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.781 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.782 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.782 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.782 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.782 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.782 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.783 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:17.783 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:17.783 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.783 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.783 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.784 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:17.784 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.784 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.784 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.784 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.785 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.785 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.785 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.785 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.785 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.786 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.786 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.786 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.786 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.787 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.787 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.787 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:17.787 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:17.787 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.788 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.788 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.788 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.788 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.788 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.789 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.789 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.789 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.789 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.789 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.790 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.790 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_stats_pools": { 2023-08-11T12:40:17.790 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_stats_pools", 2023-08-11T12:40:17.790 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.790 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.791 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.791 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.791 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.791 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.791 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.792 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.792 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.792 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.792 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.793 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.793 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_stats_pools_refresh_interval": { 2023-08-11T12:40:17.793 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-08-11T12:40:17.793 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.793 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.794 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.794 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "300", 2023-08-11T12:40:17.794 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.794 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.794 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.795 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.795 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.795 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.795 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.795 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.796 INFO:teuthology.orchestra.run.smithi008.stdout: "scrape_interval": { 2023-08-11T12:40:17.796 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "scrape_interval", 2023-08-11T12:40:17.796 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-08-11T12:40:17.796 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.797 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.797 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15.0", 2023-08-11T12:40:17.797 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.797 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.797 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.798 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.798 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.798 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.798 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.798 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.799 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2023-08-11T12:40:17.799 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2023-08-11T12:40:17.799 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.799 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.799 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.800 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "::", 2023-08-11T12:40:17.800 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.800 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.800 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.800 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-08-11T12:40:17.801 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.801 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.801 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.801 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.802 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2023-08-11T12:40:17.802 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2023-08-11T12:40:17.802 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.802 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.802 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.803 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "9283", 2023-08-11T12:40:17.803 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.803 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.803 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.803 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-08-11T12:40:17.804 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.804 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.804 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.804 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.804 INFO:teuthology.orchestra.run.smithi008.stdout: "stale_cache_strategy": { 2023-08-11T12:40:17.805 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "stale_cache_strategy", 2023-08-11T12:40:17.805 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.805 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.805 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.806 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "log", 2023-08-11T12:40:17.806 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.806 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.806 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.806 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.807 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.807 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.807 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.807 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.807 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_behaviour": { 2023-08-11T12:40:17.808 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_behaviour", 2023-08-11T12:40:17.808 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.808 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.808 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.809 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "default", 2023-08-11T12:40:17.809 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.809 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.809 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.809 INFO:teuthology.orchestra.run.smithi008.stdout: "default", 2023-08-11T12:40:17.810 INFO:teuthology.orchestra.run.smithi008.stdout: "error" 2023-08-11T12:40:17.810 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.810 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.810 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.810 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.811 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.811 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.811 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_error_status_code": { 2023-08-11T12:40:17.811 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_error_status_code", 2023-08-11T12:40:17.811 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.812 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.812 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.812 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "500", 2023-08-11T12:40:17.812 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "400", 2023-08-11T12:40:17.813 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "599", 2023-08-11T12:40:17.813 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.813 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.813 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.813 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.814 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.814 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.814 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.814 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.814 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:17.815 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_support", 2023-08-11T12:40:17.815 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:17.815 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:17.815 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:17.815 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:17.816 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:17.816 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.816 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.816 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.817 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.817 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.817 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.817 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.817 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.818 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.818 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.818 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.818 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.818 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.819 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.819 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.819 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.819 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.819 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.820 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.820 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:17.820 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:17.820 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.821 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.821 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.821 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.821 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.821 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.822 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.822 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.822 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.822 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.822 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.823 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.823 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:17.823 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:17.823 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.823 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.824 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.824 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:17.824 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.824 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.824 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.825 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.825 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.825 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.825 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.826 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.826 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.826 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.826 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.826 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.827 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.827 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.827 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.827 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:17.827 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:17.828 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.828 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.828 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.828 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.828 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.829 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.829 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.829 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.829 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.829 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.830 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.830 INFO:teuthology.orchestra.run.smithi008.stdout: "max_concurrent_snap_create": { 2023-08-11T12:40:17.830 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_concurrent_snap_create", 2023-08-11T12:40:17.831 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.831 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.831 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.831 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-08-11T12:40:17.831 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.832 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.832 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.832 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.832 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.832 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.833 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.833 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.833 INFO:teuthology.orchestra.run.smithi008.stdout: "mirror_snapshot_schedule": { 2023-08-11T12:40:17.833 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mirror_snapshot_schedule", 2023-08-11T12:40:17.833 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.834 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.834 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.834 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.834 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.834 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.835 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.835 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.835 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.835 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.835 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.836 INFO:teuthology.orchestra.run.smithi008.stdout: "trash_purge_schedule": { 2023-08-11T12:40:17.836 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "trash_purge_schedule", 2023-08-11T12:40:17.836 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.837 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.837 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.837 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.837 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.837 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.838 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.838 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.838 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.838 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.838 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.839 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.839 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.839 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.839 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:17.839 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "restful", 2023-08-11T12:40:17.840 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:17.840 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:17.840 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:17.840 INFO:teuthology.orchestra.run.smithi008.stdout: "enable_auth": { 2023-08-11T12:40:17.840 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enable_auth", 2023-08-11T12:40:17.841 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.841 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.841 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.841 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.842 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.842 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.842 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.842 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.842 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.843 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.843 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.843 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.843 INFO:teuthology.orchestra.run.smithi008.stdout: "key_file": { 2023-08-11T12:40:17.843 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "key_file", 2023-08-11T12:40:17.844 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.844 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.844 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.844 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.844 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.845 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.845 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.845 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.845 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.845 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.846 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.846 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.846 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:17.846 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:17.846 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.847 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.847 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.847 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.847 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.848 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.848 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.848 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.848 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.848 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.849 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.849 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.849 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.849 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.849 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.850 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.850 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.850 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.850 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.851 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:17.851 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:17.851 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.851 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.851 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.852 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.852 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.852 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.852 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.852 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.853 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.853 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.853 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.853 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.853 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:17.854 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:17.854 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.854 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.854 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.854 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:17.855 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.855 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.855 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.855 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.856 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.856 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.856 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.856 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.856 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.857 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.857 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.857 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.857 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.857 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.858 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.858 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:17.858 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:17.858 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.858 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.859 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.859 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.859 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.859 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.859 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.860 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.860 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.860 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.860 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.861 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.861 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2023-08-11T12:40:17.861 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2023-08-11T12:40:17.861 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.861 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.862 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.862 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.862 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.862 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.862 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.863 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.863 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.863 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.863 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.863 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.864 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2023-08-11T12:40:17.864 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2023-08-11T12:40:17.864 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.864 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.865 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.865 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.865 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.865 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.865 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.866 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.866 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.866 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.866 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.866 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.867 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.867 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:17.867 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rgw", 2023-08-11T12:40:17.867 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:17.868 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:17.868 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:17.868 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:17.868 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:17.869 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.869 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.869 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.869 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.869 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.870 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.870 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.870 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.870 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.870 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.871 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.871 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.871 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.871 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.871 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.872 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.872 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.872 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.872 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.873 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:17.873 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:17.873 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.873 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.873 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.874 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.874 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.874 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.874 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.874 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.875 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.875 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.875 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.875 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:17.876 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:17.876 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.876 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.876 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.876 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:17.877 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.877 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.877 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.877 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.878 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.878 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.878 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.878 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.878 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.879 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.879 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.879 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.879 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.879 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.880 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.880 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:17.880 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:17.880 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.880 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.881 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.881 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.881 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.881 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.881 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.882 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.882 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.882 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.882 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.882 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.883 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.883 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.883 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:17.883 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rook", 2023-08-11T12:40:17.884 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:17.884 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:17.884 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:17.884 INFO:teuthology.orchestra.run.smithi008.stdout: "drive_group_interval": { 2023-08-11T12:40:17.884 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "drive_group_interval", 2023-08-11T12:40:17.885 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-08-11T12:40:17.885 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.885 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.885 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "300.0", 2023-08-11T12:40:17.885 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.886 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.886 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.886 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-08-11T12:40:17.886 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.886 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.887 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.887 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.887 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:17.887 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:17.887 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.888 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.888 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.888 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.888 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.889 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.889 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.889 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.889 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.889 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.890 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.890 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.890 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.890 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.890 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.891 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.891 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.891 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.891 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.892 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:17.892 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:17.892 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.892 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.892 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.893 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.893 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.893 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.893 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.893 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.894 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.894 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.894 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.894 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.894 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:17.895 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:17.895 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.895 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.895 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.895 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:17.896 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.896 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.896 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.896 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.897 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.897 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.897 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.897 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.897 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.898 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.898 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.898 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.898 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.898 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.899 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.899 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:17.899 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:17.899 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.899 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.900 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.900 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.900 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.900 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.901 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.901 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.901 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.901 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.901 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.902 INFO:teuthology.orchestra.run.smithi008.stdout: "storage_class": { 2023-08-11T12:40:17.902 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "storage_class", 2023-08-11T12:40:17.902 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.902 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.903 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.903 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "local", 2023-08-11T12:40:17.903 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.903 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.903 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.904 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-08-11T12:40:17.904 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.904 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.904 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.904 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.905 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.905 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.905 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:17.905 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "selftest", 2023-08-11T12:40:17.906 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:17.906 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:17.906 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:17.906 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:17.906 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:17.907 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.907 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.907 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.907 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.907 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.908 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.908 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.908 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.908 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.908 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.909 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.909 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.909 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.909 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.909 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.910 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.910 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.910 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.910 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.911 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:17.911 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:17.911 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.911 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.911 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.912 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.912 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.912 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.912 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.912 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.913 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.913 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.913 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.913 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.913 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:17.914 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:17.914 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.914 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.914 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.914 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:17.915 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.915 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.915 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.915 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.915 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.916 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.916 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.916 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.916 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.917 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.917 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.917 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.917 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.917 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.918 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.918 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:17.918 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:17.918 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.918 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.919 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.919 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.919 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.919 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.919 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.920 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.920 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.920 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.920 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.920 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.921 INFO:teuthology.orchestra.run.smithi008.stdout: "roption1": { 2023-08-11T12:40:17.921 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "roption1", 2023-08-11T12:40:17.921 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.921 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.922 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.922 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.922 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.922 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.922 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.923 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.923 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.923 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.923 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.923 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.924 INFO:teuthology.orchestra.run.smithi008.stdout: "roption2": { 2023-08-11T12:40:17.924 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "roption2", 2023-08-11T12:40:17.924 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.924 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.924 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.925 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "xyz", 2023-08-11T12:40:17.925 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.925 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.925 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.925 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.926 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.926 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.926 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.926 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.926 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption1": { 2023-08-11T12:40:17.927 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption1", 2023-08-11T12:40:17.927 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.927 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.927 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.927 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.928 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.928 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.928 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.928 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.929 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.929 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.929 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.929 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.929 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption2": { 2023-08-11T12:40:17.930 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption2", 2023-08-11T12:40:17.930 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.930 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.930 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.931 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.931 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.931 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.931 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.931 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.932 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.932 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.932 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.932 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.932 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption3": { 2023-08-11T12:40:17.933 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption3", 2023-08-11T12:40:17.933 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-08-11T12:40:17.933 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.933 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.933 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.934 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.934 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.934 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.934 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.934 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.935 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.935 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.935 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.935 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption4": { 2023-08-11T12:40:17.936 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption4", 2023-08-11T12:40:17.936 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.936 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.936 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.936 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.937 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.937 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.937 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.937 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.937 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.938 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.938 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.938 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.938 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption5": { 2023-08-11T12:40:17.938 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption5", 2023-08-11T12:40:17.939 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.939 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.939 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.939 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.939 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.940 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.940 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.940 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.940 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.941 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.941 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.941 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.941 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption6": { 2023-08-11T12:40:17.941 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption6", 2023-08-11T12:40:17.942 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.942 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.942 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.942 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:17.942 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.943 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.943 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.943 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.943 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.943 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.944 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.944 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.944 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption7": { 2023-08-11T12:40:17.944 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption7", 2023-08-11T12:40:17.944 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:17.945 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.945 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.945 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.945 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-08-11T12:40:17.945 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "42", 2023-08-11T12:40:17.946 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.946 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.946 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.946 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.947 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.947 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.947 INFO:teuthology.orchestra.run.smithi008.stdout: "testkey": { 2023-08-11T12:40:17.947 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testkey", 2023-08-11T12:40:17.947 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.948 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.948 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.948 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.948 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.948 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.949 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.949 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.949 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.949 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.949 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.950 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.950 INFO:teuthology.orchestra.run.smithi008.stdout: "testlkey": { 2023-08-11T12:40:17.950 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testlkey", 2023-08-11T12:40:17.950 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.950 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.951 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.951 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.951 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.951 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.952 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.952 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.952 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.952 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.952 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.953 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.953 INFO:teuthology.orchestra.run.smithi008.stdout: "testnewline": { 2023-08-11T12:40:17.953 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testnewline", 2023-08-11T12:40:17.953 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.953 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.954 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:17.954 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.954 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.954 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.954 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.955 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.955 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.955 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.955 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.955 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.956 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.956 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.956 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:17.956 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snap_schedule", 2023-08-11T12:40:17.957 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:17.957 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:17.957 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:17.957 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_m_granularity": { 2023-08-11T12:40:17.957 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_m_granularity", 2023-08-11T12:40:17.958 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.958 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.958 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.958 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.958 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.959 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.959 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.959 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow minute scheduled snapshots", 2023-08-11T12:40:17.959 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.959 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.960 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.960 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.960 INFO:teuthology.orchestra.run.smithi008.stdout: "dump_on_update": { 2023-08-11T12:40:17.960 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "dump_on_update", 2023-08-11T12:40:17.960 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.961 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.961 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.961 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.961 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.962 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.962 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.962 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "dump database to debug log on update", 2023-08-11T12:40:17.962 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.962 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.963 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.963 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.963 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:17.963 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:17.963 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.964 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.964 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.964 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.964 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.964 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.965 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.965 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.965 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.965 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.965 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.966 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.966 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.966 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.966 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.967 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.967 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.967 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.967 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.967 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:17.968 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:17.968 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.968 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.968 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.968 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.969 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.969 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.969 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.969 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.970 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.970 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.970 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.970 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.970 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:17.971 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:17.971 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.971 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.971 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.971 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:17.972 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.972 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.972 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.972 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.972 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.973 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.973 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.973 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.973 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.974 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.974 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.974 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.974 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.974 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.975 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.975 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:17.975 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:17.975 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.975 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.976 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.976 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.976 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.976 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.976 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.977 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.977 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.977 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.977 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.977 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.978 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.978 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.978 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:17.978 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "stats", 2023-08-11T12:40:17.979 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:17.979 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:17.979 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:17.979 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:17.979 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:17.980 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.980 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.980 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.980 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.980 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.981 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.981 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.981 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.981 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.981 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.982 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.982 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.982 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.982 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.982 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.983 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.983 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.983 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.983 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.984 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:17.984 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:17.984 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.984 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.984 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.985 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.985 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.985 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.985 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.985 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.986 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.986 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.986 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.986 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.986 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:17.987 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:17.987 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.987 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.987 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.987 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:17.988 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.988 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.988 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.988 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.989 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.989 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.989 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.989 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.989 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.990 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.990 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.990 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.990 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.990 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.991 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.991 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:17.991 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:17.991 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:17.991 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.992 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.992 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:17.992 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.992 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.993 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:17.993 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.993 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.993 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.993 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.994 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.994 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:17.994 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:17.994 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:17.994 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "status", 2023-08-11T12:40:17.995 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:17.995 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:17.995 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:17.995 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:17.995 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:17.996 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:17.996 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:17.996 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:17.996 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:17.997 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:17.997 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:17.997 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:17.997 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:17.997 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:17.998 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:17.998 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:17.998 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:17.998 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:17.998 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:17.999 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:17.999 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:17.999 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:17.999 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:17.999 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.000 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:18.000 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:18.000 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.000 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.001 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.001 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.001 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.001 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.001 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.002 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.002 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.002 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.002 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.002 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.003 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:18.003 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:18.003 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.003 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.003 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.004 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:18.004 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.004 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.004 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.004 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.005 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.005 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.005 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.005 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.006 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.006 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.006 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.006 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.006 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.007 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.007 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.007 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:18.007 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:18.007 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.008 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.008 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.008 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.008 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.008 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.009 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.009 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.009 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.009 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.009 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.010 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.010 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.010 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.010 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:18.010 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "telegraf", 2023-08-11T12:40:18.011 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:18.011 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:18.011 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:18.011 INFO:teuthology.orchestra.run.smithi008.stdout: "address": { 2023-08-11T12:40:18.012 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "address", 2023-08-11T12:40:18.012 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.012 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.012 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.012 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-08-11T12:40:18.013 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.013 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.013 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.013 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.013 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.014 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.014 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.014 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.014 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-08-11T12:40:18.014 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-08-11T12:40:18.015 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:18.015 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.015 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.015 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15", 2023-08-11T12:40:18.016 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.016 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.016 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.016 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.016 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.017 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.017 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.017 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.017 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:18.017 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:18.018 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.018 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.018 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.018 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.018 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.019 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.019 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.019 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.019 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.019 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.020 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.020 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.020 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.020 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.021 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.021 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.021 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.021 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.021 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.022 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:18.022 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:18.022 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.022 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.022 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.023 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.023 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.023 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.023 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.023 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.024 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.024 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.024 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.024 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.024 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:18.025 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:18.025 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.025 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.025 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.026 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:18.026 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.026 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.026 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.026 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.027 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.027 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.027 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.027 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.027 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.028 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.028 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.028 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.028 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.028 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.029 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.029 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:18.029 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:18.029 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.029 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.030 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.030 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.030 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.030 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.030 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.031 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.031 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.031 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.031 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.032 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.032 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.032 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.032 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:18.032 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "telemetry", 2023-08-11T12:40:18.033 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:18.033 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:18.033 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:18.033 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_basic": { 2023-08-11T12:40:18.033 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_basic", 2023-08-11T12:40:18.034 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.034 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.034 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.034 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.034 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.035 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.035 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.035 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share basic cluster information (size, version)", 2023-08-11T12:40:18.035 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.035 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.036 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.036 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.036 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_crash": { 2023-08-11T12:40:18.036 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_crash", 2023-08-11T12:40:18.037 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.037 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.037 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.037 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.037 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.038 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.038 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.038 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-08-11T12:40:18.038 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.038 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.039 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.039 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.039 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_device": { 2023-08-11T12:40:18.039 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_device", 2023-08-11T12:40:18.039 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.040 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.040 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.040 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.040 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.041 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.041 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.041 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-08-11T12:40:18.041 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.041 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.042 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.042 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.042 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_ident": { 2023-08-11T12:40:18.042 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_ident", 2023-08-11T12:40:18.042 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.043 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.043 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.043 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.043 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.043 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.044 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.044 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-08-11T12:40:18.044 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.044 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.045 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.045 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.045 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_perf": { 2023-08-11T12:40:18.045 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_perf", 2023-08-11T12:40:18.045 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.046 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.046 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.046 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.046 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.046 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.047 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.047 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share various performance metrics of a cluster", 2023-08-11T12:40:18.047 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.047 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.047 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.048 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.048 INFO:teuthology.orchestra.run.smithi008.stdout: "contact": { 2023-08-11T12:40:18.048 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "contact", 2023-08-11T12:40:18.048 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.048 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.049 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.049 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.049 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.049 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.050 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.050 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.050 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.050 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.050 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.051 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.051 INFO:teuthology.orchestra.run.smithi008.stdout: "description": { 2023-08-11T12:40:18.051 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "description", 2023-08-11T12:40:18.051 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.051 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.052 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.052 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.052 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.052 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.053 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.053 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.053 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.053 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.053 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.054 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.054 INFO:teuthology.orchestra.run.smithi008.stdout: "device_url": { 2023-08-11T12:40:18.054 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_url", 2023-08-11T12:40:18.054 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.054 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.055 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.055 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-08-11T12:40:18.055 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.055 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.055 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.056 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.056 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.056 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.056 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.056 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.057 INFO:teuthology.orchestra.run.smithi008.stdout: "enabled": { 2023-08-11T12:40:18.057 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enabled", 2023-08-11T12:40:18.057 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.057 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.058 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.058 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.058 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.058 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.058 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.059 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.059 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.059 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.059 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.059 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.060 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-08-11T12:40:18.060 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-08-11T12:40:18.060 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.060 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.060 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.061 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "24", 2023-08-11T12:40:18.061 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "8", 2023-08-11T12:40:18.061 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.061 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.062 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.062 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.062 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.062 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.062 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.063 INFO:teuthology.orchestra.run.smithi008.stdout: "last_opt_revision": { 2023-08-11T12:40:18.063 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "last_opt_revision", 2023-08-11T12:40:18.063 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.063 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.063 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.064 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1", 2023-08-11T12:40:18.064 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.064 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.064 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.064 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.065 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.065 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.065 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.065 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.065 INFO:teuthology.orchestra.run.smithi008.stdout: "leaderboard": { 2023-08-11T12:40:18.066 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "leaderboard", 2023-08-11T12:40:18.066 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.066 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.066 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.067 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.067 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.067 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.067 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.067 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.068 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.068 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.068 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.068 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.068 INFO:teuthology.orchestra.run.smithi008.stdout: "leaderboard_description": { 2023-08-11T12:40:18.069 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "leaderboard_description", 2023-08-11T12:40:18.069 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.069 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.069 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.069 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.070 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.070 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.070 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.070 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.071 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.071 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.071 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.071 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.071 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:18.072 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:18.072 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.072 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.072 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.072 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.073 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.073 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.073 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.073 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.073 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.074 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.074 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.074 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.074 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.074 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.075 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.075 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.075 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.075 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.076 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.076 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:18.076 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:18.076 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.076 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.077 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.077 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.077 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.077 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.077 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.078 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.078 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.078 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.078 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.078 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.079 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:18.079 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:18.079 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.079 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.079 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.080 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:18.080 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.080 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.080 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.081 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.081 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.081 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.081 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.081 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.082 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.082 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.082 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.082 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.082 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.083 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.083 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.083 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:18.083 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:18.083 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.084 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.084 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.084 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.084 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.085 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.085 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.085 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.085 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.085 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.086 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.086 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.086 INFO:teuthology.orchestra.run.smithi008.stdout: "organization": { 2023-08-11T12:40:18.086 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "organization", 2023-08-11T12:40:18.086 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.087 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.087 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.087 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.087 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.087 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.088 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.088 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.088 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.088 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.088 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.089 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.089 INFO:teuthology.orchestra.run.smithi008.stdout: "proxy": { 2023-08-11T12:40:18.089 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "proxy", 2023-08-11T12:40:18.089 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.090 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.090 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.090 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.090 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.090 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.091 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.091 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.091 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.091 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.091 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.092 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.092 INFO:teuthology.orchestra.run.smithi008.stdout: "url": { 2023-08-11T12:40:18.092 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "url", 2023-08-11T12:40:18.092 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.093 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.093 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.093 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-08-11T12:40:18.093 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.093 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.094 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.094 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.094 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.094 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.094 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.095 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.095 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.095 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.095 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:18.095 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "test_orchestrator", 2023-08-11T12:40:18.096 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:18.096 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:18.096 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:18.096 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:18.097 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:18.097 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.097 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.097 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.097 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.098 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.098 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.098 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.098 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.098 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.099 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.099 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.099 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.099 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.099 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.100 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.100 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.100 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.100 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.100 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.101 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:18.101 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:18.101 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.101 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.102 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.102 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.102 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.102 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.102 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.103 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.103 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.103 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.103 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.103 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.104 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:18.104 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:18.104 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.104 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.104 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.105 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:18.105 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.105 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.105 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.105 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.106 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.106 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.106 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.106 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.107 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.107 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.107 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.107 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.107 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.108 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.108 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.108 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:18.108 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:18.108 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.109 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.109 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.109 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.109 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.109 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.110 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.110 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.110 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.110 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.111 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.111 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.111 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.111 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.111 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:18.112 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "volumes", 2023-08-11T12:40:18.112 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:18.112 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:18.112 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:18.112 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:18.113 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:18.113 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.113 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.113 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.113 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.114 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.114 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.114 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.114 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.114 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.115 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.115 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.115 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.115 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.116 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.116 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.116 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.116 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.116 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.117 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.117 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:18.117 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:18.117 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.117 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.118 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.118 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.118 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.118 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.119 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.119 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.119 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.119 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.119 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.120 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.120 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:18.120 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:18.120 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.120 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.121 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.121 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:18.121 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.121 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.122 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.122 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.122 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.122 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.123 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.123 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.123 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.123 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.123 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.124 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.124 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.124 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.124 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.124 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:18.125 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:18.125 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.125 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.125 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.125 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.126 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.126 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.126 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.126 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.127 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.127 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.127 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.127 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.127 INFO:teuthology.orchestra.run.smithi008.stdout: "max_concurrent_clones": { 2023-08-11T12:40:18.128 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_concurrent_clones", 2023-08-11T12:40:18.128 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.128 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.128 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.129 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "4", 2023-08-11T12:40:18.129 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.129 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.129 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.129 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Number of asynchronous cloner threads", 2023-08-11T12:40:18.130 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.130 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.130 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.130 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.130 INFO:teuthology.orchestra.run.smithi008.stdout: "snapshot_clone_delay": { 2023-08-11T12:40:18.131 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snapshot_clone_delay", 2023-08-11T12:40:18.131 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.131 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.131 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.132 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-08-11T12:40:18.132 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.132 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.132 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.132 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-08-11T12:40:18.133 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.133 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.133 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.133 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.133 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.134 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.134 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:18.134 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix", 2023-08-11T12:40:18.134 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:18.134 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:18.135 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:18.135 INFO:teuthology.orchestra.run.smithi008.stdout: "discovery_interval": { 2023-08-11T12:40:18.135 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "discovery_interval", 2023-08-11T12:40:18.135 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-08-11T12:40:18.135 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.136 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.136 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "100", 2023-08-11T12:40:18.136 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.136 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.137 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.137 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.137 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.137 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.137 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.138 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.138 INFO:teuthology.orchestra.run.smithi008.stdout: "identifier": { 2023-08-11T12:40:18.138 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "identifier", 2023-08-11T12:40:18.138 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.138 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.139 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.139 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.139 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.139 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.139 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.140 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.140 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.140 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.140 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.141 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.141 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-08-11T12:40:18.141 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-08-11T12:40:18.141 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:18.141 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.142 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.142 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-08-11T12:40:18.142 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.142 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.143 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.143 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.143 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.143 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.144 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.144 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.144 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:18.144 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:18.145 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.145 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.145 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.145 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.145 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.146 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.146 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.146 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.146 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.146 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.147 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.147 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.147 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.147 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.147 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.148 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.148 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.148 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.148 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.148 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:18.149 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:18.149 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.149 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.149 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.149 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.150 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.150 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.150 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.150 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.150 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.151 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.151 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.151 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.151 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:18.151 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:18.152 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.152 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.152 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.152 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:18.152 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.153 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.153 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.153 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.153 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.153 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.154 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.154 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.154 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.154 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.154 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.155 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.155 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.155 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.155 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.155 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:18.156 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:18.156 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.156 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.156 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.156 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.157 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.157 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.157 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.157 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.157 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.158 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.158 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.158 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.158 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_host": { 2023-08-11T12:40:18.158 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_host", 2023-08-11T12:40:18.159 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.159 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.159 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.159 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.159 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.160 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.160 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.160 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.160 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.160 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.161 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.161 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.161 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_port": { 2023-08-11T12:40:18.161 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_port", 2023-08-11T12:40:18.161 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.162 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.162 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.162 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10051", 2023-08-11T12:40:18.162 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.162 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.163 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.163 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.163 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.163 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.163 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.164 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.164 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_sender": { 2023-08-11T12:40:18.164 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_sender", 2023-08-11T12:40:18.164 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.164 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.165 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.165 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-08-11T12:40:18.165 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.165 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.165 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.166 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.166 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.166 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.166 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.166 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.167 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.167 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.167 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-11T12:40:18.167 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.167 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.168 INFO:teuthology.orchestra.run.smithi008.stdout: "modules": [ 2023-08-11T12:40:18.168 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm", 2023-08-11T12:40:18.168 INFO:teuthology.orchestra.run.smithi008.stdout: "dashboard", 2023-08-11T12:40:18.168 INFO:teuthology.orchestra.run.smithi008.stdout: "iostat", 2023-08-11T12:40:18.168 INFO:teuthology.orchestra.run.smithi008.stdout: "nfs", 2023-08-11T12:40:18.169 INFO:teuthology.orchestra.run.smithi008.stdout: "restful", 2023-08-11T12:40:18.169 INFO:teuthology.orchestra.run.smithi008.stdout: "snap_schedule" 2023-08-11T12:40:18.169 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.169 INFO:teuthology.orchestra.run.smithi008.stdout: "available_modules": [ 2023-08-11T12:40:18.169 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:18.170 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "alerts", 2023-08-11T12:40:18.170 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:18.170 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:18.170 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:18.170 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-08-11T12:40:18.171 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-08-11T12:40:18.171 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:18.171 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.171 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.171 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-08-11T12:40:18.172 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.172 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.172 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.172 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How frequently to reexamine health status", 2023-08-11T12:40:18.172 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.173 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.173 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.173 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.173 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:18.173 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:18.174 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.174 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.174 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.174 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.174 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.175 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.175 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.175 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.175 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.175 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.176 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.176 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.176 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.176 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.176 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.177 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.177 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.177 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.177 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.177 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:18.178 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:18.178 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.178 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.178 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.178 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.179 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.179 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.179 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.179 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.179 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.180 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.180 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.180 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.180 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:18.180 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:18.181 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.181 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.181 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.181 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:18.181 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.182 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.182 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.182 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.182 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.182 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.183 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.183 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.183 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.183 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.183 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.184 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.184 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.184 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.184 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.184 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:18.185 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:18.185 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.185 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.185 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.185 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.186 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.186 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.186 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.186 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.186 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.187 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.187 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.187 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.187 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_destination": { 2023-08-11T12:40:18.187 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_destination", 2023-08-11T12:40:18.188 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.188 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.188 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.188 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.188 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.189 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.189 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.189 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Email address to send alerts to", 2023-08-11T12:40:18.189 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.189 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.190 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.190 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.190 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_from_name": { 2023-08-11T12:40:18.190 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_from_name", 2023-08-11T12:40:18.190 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.191 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.191 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.191 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "Ceph", 2023-08-11T12:40:18.191 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.191 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.192 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.192 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Email From: name", 2023-08-11T12:40:18.192 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.192 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.193 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.193 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.193 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_host": { 2023-08-11T12:40:18.193 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_host", 2023-08-11T12:40:18.193 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.193 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.194 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.194 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.194 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.194 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.194 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.195 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP server", 2023-08-11T12:40:18.195 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.195 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.195 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.195 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.196 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_password": { 2023-08-11T12:40:18.196 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_password", 2023-08-11T12:40:18.196 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.196 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.197 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.197 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.197 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.197 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.197 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.197 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Password to authenticate with", 2023-08-11T12:40:18.198 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.198 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.198 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.198 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.198 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_port": { 2023-08-11T12:40:18.199 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_port", 2023-08-11T12:40:18.199 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.199 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.199 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.199 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "465", 2023-08-11T12:40:18.200 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.200 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.200 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.200 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP port", 2023-08-11T12:40:18.200 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.201 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.201 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.201 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.201 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_sender": { 2023-08-11T12:40:18.201 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_sender", 2023-08-11T12:40:18.202 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.202 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.202 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.202 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.202 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.203 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.203 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.203 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP envelope sender", 2023-08-11T12:40:18.203 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.203 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.204 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.204 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.204 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_ssl": { 2023-08-11T12:40:18.204 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_ssl", 2023-08-11T12:40:18.204 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.205 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.205 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.205 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.205 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.205 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.206 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.206 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use SSL to connect to SMTP server", 2023-08-11T12:40:18.206 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.206 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.206 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.207 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.207 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_user": { 2023-08-11T12:40:18.207 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_user", 2023-08-11T12:40:18.207 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.207 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.208 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.208 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.208 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.208 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.208 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.209 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "User to authenticate as", 2023-08-11T12:40:18.209 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.209 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.209 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.209 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.210 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.210 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.210 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:18.210 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "balancer", 2023-08-11T12:40:18.210 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:18.210 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:18.211 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:18.211 INFO:teuthology.orchestra.run.smithi008.stdout: "active": { 2023-08-11T12:40:18.211 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "active", 2023-08-11T12:40:18.211 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.212 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.212 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.212 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.212 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.212 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.213 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.213 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "automatically balance PGs across cluster", 2023-08-11T12:40:18.213 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.213 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.213 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.214 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.214 INFO:teuthology.orchestra.run.smithi008.stdout: "begin_time": { 2023-08-11T12:40:18.214 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "begin_time", 2023-08-11T12:40:18.214 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.214 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.214 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.215 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0000", 2023-08-11T12:40:18.215 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.215 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.215 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.215 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "beginning time of day to automatically balance", 2023-08-11T12:40:18.216 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-08-11T12:40:18.216 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.216 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.216 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.217 INFO:teuthology.orchestra.run.smithi008.stdout: "begin_weekday": { 2023-08-11T12:40:18.217 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "begin_weekday", 2023-08-11T12:40:18.217 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-08-11T12:40:18.217 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.217 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.217 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-08-11T12:40:18.218 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0", 2023-08-11T12:40:18.218 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "6", 2023-08-11T12:40:18.218 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.218 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-08-11T12:40:18.218 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-08-11T12:40:18.219 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.219 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.219 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.219 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_max_iterations": { 2023-08-11T12:40:18.220 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_max_iterations", 2023-08-11T12:40:18.220 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-08-11T12:40:18.220 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.220 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.220 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "25", 2023-08-11T12:40:18.221 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-08-11T12:40:18.221 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "250", 2023-08-11T12:40:18.221 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.221 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-08-11T12:40:18.221 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.222 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.222 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.222 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.222 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_metrics": { 2023-08-11T12:40:18.222 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_metrics", 2023-08-11T12:40:18.223 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.223 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.223 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.223 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "pgs,objects,bytes", 2023-08-11T12:40:18.223 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.224 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.224 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.224 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-08-11T12:40:18.224 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-08-11T12:40:18.224 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.225 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.225 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.225 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_step": { 2023-08-11T12:40:18.225 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_step", 2023-08-11T12:40:18.225 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-08-11T12:40:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0.5", 2023-08-11T12:40:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0.001", 2023-08-11T12:40:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "0.999", 2023-08-11T12:40:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "aggressiveness of optimization", 2023-08-11T12:40:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-08-11T12:40:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.228 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.228 INFO:teuthology.orchestra.run.smithi008.stdout: "end_time": { 2023-08-11T12:40:18.228 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "end_time", 2023-08-11T12:40:18.228 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.228 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.229 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.229 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "2359", 2023-08-11T12:40:18.229 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.229 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.229 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.230 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "ending time of day to automatically balance", 2023-08-11T12:40:18.230 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-08-11T12:40:18.230 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.230 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.230 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.231 INFO:teuthology.orchestra.run.smithi008.stdout: "end_weekday": { 2023-08-11T12:40:18.231 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "end_weekday", 2023-08-11T12:40:18.231 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-08-11T12:40:18.231 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.231 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.232 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-08-11T12:40:18.232 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0", 2023-08-11T12:40:18.232 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "6", 2023-08-11T12:40:18.232 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.232 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-08-11T12:40:18.233 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-08-11T12:40:18.233 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.233 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.233 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.233 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:18.234 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:18.234 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.234 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.234 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.235 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.235 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.235 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.235 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.235 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.235 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.236 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.236 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.236 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.236 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.237 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.237 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.237 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.237 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.237 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.238 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.238 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:18.238 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:18.238 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.238 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.239 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.239 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.239 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.239 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.239 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.240 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.240 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.240 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.240 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.240 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.241 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:18.241 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:18.241 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.241 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.241 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.242 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:18.242 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.242 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.242 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.242 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.243 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.243 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.243 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.243 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.243 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.244 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.244 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.244 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.244 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.244 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.245 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.245 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:18.245 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:18.245 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.245 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.245 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.246 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.246 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.246 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.246 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.246 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.247 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.247 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.247 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.247 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.248 INFO:teuthology.orchestra.run.smithi008.stdout: "min_score": { 2023-08-11T12:40:18.248 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "min_score", 2023-08-11T12:40:18.248 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-08-11T12:40:18.248 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.248 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.249 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-08-11T12:40:18.249 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.249 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.249 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.250 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-08-11T12:40:18.250 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.250 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.251 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.251 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.251 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": { 2023-08-11T12:40:18.251 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mode", 2023-08-11T12:40:18.251 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.252 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.252 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.252 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "upmap", 2023-08-11T12:40:18.252 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.253 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.253 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.253 INFO:teuthology.orchestra.run.smithi008.stdout: "crush-compat", 2023-08-11T12:40:18.253 INFO:teuthology.orchestra.run.smithi008.stdout: "none", 2023-08-11T12:40:18.253 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap" 2023-08-11T12:40:18.253 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.254 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Balancer mode", 2023-08-11T12:40:18.254 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.254 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.254 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.254 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.255 INFO:teuthology.orchestra.run.smithi008.stdout: "pool_ids": { 2023-08-11T12:40:18.255 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pool_ids", 2023-08-11T12:40:18.255 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.255 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.255 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.256 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.256 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.256 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.256 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.256 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-08-11T12:40:18.257 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.257 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.257 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.257 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.258 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-08-11T12:40:18.258 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-08-11T12:40:18.258 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:18.258 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.258 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.259 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-08-11T12:40:18.259 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.259 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.259 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.259 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-08-11T12:40:18.260 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.260 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.260 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.260 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.260 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap_max_deviation": { 2023-08-11T12:40:18.261 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "upmap_max_deviation", 2023-08-11T12:40:18.261 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.261 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.261 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.261 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-08-11T12:40:18.262 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-08-11T12:40:18.262 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.262 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.262 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "deviation below which no optimization is attempted", 2023-08-11T12:40:18.262 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-08-11T12:40:18.263 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.263 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.263 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.263 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap_max_optimizations": { 2023-08-11T12:40:18.263 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "upmap_max_optimizations", 2023-08-11T12:40:18.264 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-08-11T12:40:18.264 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.264 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.264 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-08-11T12:40:18.264 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.265 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.265 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.265 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-08-11T12:40:18.265 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.265 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.266 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.266 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.266 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.266 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.266 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:18.267 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cephadm", 2023-08-11T12:40:18.267 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:18.267 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:18.267 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:18.267 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_down_multiplier": { 2023-08-11T12:40:18.268 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_down_multiplier", 2023-08-11T12:40:18.268 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-08-11T12:40:18.268 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.268 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.268 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3.0", 2023-08-11T12:40:18.269 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.269 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.269 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.269 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-08-11T12:40:18.269 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.270 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.270 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.270 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_refresh_rate": { 2023-08-11T12:40:18.270 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_refresh_rate", 2023-08-11T12:40:18.270 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:18.271 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.271 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.271 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "20", 2023-08-11T12:40:18.271 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.271 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.272 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.272 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-08-11T12:40:18.272 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.272 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.273 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.273 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.273 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_starting_port": { 2023-08-11T12:40:18.273 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_starting_port", 2023-08-11T12:40:18.273 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.274 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.274 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.274 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "4721", 2023-08-11T12:40:18.274 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.274 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.274 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.275 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-08-11T12:40:18.275 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.275 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.275 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.275 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.276 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_ptrace": { 2023-08-11T12:40:18.276 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_ptrace", 2023-08-11T12:40:18.276 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.276 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.276 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.277 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.277 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.277 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.277 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.277 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-08-11T12:40:18.278 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-08-11T12:40:18.278 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.278 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.278 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.278 INFO:teuthology.orchestra.run.smithi008.stdout: "autotune_interval": { 2023-08-11T12:40:18.279 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "autotune_interval", 2023-08-11T12:40:18.279 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:18.279 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.279 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.279 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-08-11T12:40:18.280 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.280 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.280 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.280 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to autotune daemon memory", 2023-08-11T12:40:18.280 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.281 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.281 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.281 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.281 INFO:teuthology.orchestra.run.smithi008.stdout: "autotune_memory_target_ratio": { 2023-08-11T12:40:18.281 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "autotune_memory_target_ratio", 2023-08-11T12:40:18.282 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-08-11T12:40:18.282 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.282 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.282 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0.7", 2023-08-11T12:40:18.282 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.283 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.283 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.283 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-08-11T12:40:18.283 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.283 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.284 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.284 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.284 INFO:teuthology.orchestra.run.smithi008.stdout: "cgroups_split": { 2023-08-11T12:40:18.284 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cgroups_split", 2023-08-11T12:40:18.284 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.285 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.285 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.285 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.285 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.285 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.286 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.286 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-08-11T12:40:18.286 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.286 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.286 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.287 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.287 INFO:teuthology.orchestra.run.smithi008.stdout: "config_checks_enabled": { 2023-08-11T12:40:18.287 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_checks_enabled", 2023-08-11T12:40:18.287 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.287 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.288 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.288 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.288 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.288 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.288 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.289 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-08-11T12:40:18.289 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.289 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.289 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.289 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.290 INFO:teuthology.orchestra.run.smithi008.stdout: "config_dashboard": { 2023-08-11T12:40:18.290 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_dashboard", 2023-08-11T12:40:18.290 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.290 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.290 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.291 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.291 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.291 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.291 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.291 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-08-11T12:40:18.292 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.292 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.292 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.292 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.292 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_alertmanager": { 2023-08-11T12:40:18.293 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_alertmanager", 2023-08-11T12:40:18.293 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.293 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.293 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.293 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-08-11T12:40:18.294 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.294 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.294 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.294 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-08-11T12:40:18.294 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.294 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.295 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.295 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.295 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_base": { 2023-08-11T12:40:18.295 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_base", 2023-08-11T12:40:18.295 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.296 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.296 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.296 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/ceph", 2023-08-11T12:40:18.296 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.297 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.297 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.297 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Container image name, without the tag", 2023-08-11T12:40:18.297 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.297 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.297 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.298 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.298 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_elasticsearch": { 2023-08-11T12:40:18.298 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_elasticsearch", 2023-08-11T12:40:18.298 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.298 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.299 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.299 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-08-11T12:40:18.299 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.299 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.299 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.300 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "elasticsearch container image", 2023-08-11T12:40:18.300 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.300 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.300 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.301 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.301 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_grafana": { 2023-08-11T12:40:18.301 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_grafana", 2023-08-11T12:40:18.301 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.301 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.302 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.302 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-08-11T12:40:18.302 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.302 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.302 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.303 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-08-11T12:40:18.303 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.303 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.303 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.303 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.304 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_haproxy": { 2023-08-11T12:40:18.304 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_haproxy", 2023-08-11T12:40:18.304 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.304 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.304 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.305 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-08-11T12:40:18.305 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.305 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.305 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.305 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "HAproxy container image", 2023-08-11T12:40:18.306 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.306 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.306 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.306 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.306 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_agent": { 2023-08-11T12:40:18.307 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_agent", 2023-08-11T12:40:18.307 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.307 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.307 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.307 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-08-11T12:40:18.308 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.308 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.308 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.308 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger agent container image", 2023-08-11T12:40:18.308 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.309 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.309 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.309 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.309 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_collector": { 2023-08-11T12:40:18.309 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_collector", 2023-08-11T12:40:18.309 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.310 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.310 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.310 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-08-11T12:40:18.310 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.310 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.311 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.311 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger collector container image", 2023-08-11T12:40:18.311 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.311 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.311 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.312 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.312 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_query": { 2023-08-11T12:40:18.312 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_query", 2023-08-11T12:40:18.312 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.312 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.313 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.313 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-08-11T12:40:18.313 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.313 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.313 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.314 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger query container image", 2023-08-11T12:40:18.314 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.314 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.314 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.314 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.315 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_keepalived": { 2023-08-11T12:40:18.315 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_keepalived", 2023-08-11T12:40:18.315 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.315 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.315 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.316 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-08-11T12:40:18.316 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.316 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.316 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.316 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Keepalived container image", 2023-08-11T12:40:18.317 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.317 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.317 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.317 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.317 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_loki": { 2023-08-11T12:40:18.317 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_loki", 2023-08-11T12:40:18.318 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.318 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.318 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.318 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-08-11T12:40:18.318 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.319 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.319 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.319 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Loki container image", 2023-08-11T12:40:18.319 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.319 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.320 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.320 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.320 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_node_exporter": { 2023-08-11T12:40:18.320 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_node_exporter", 2023-08-11T12:40:18.320 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.321 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.321 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.321 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-08-11T12:40:18.321 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.321 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.322 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.322 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-08-11T12:40:18.322 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.322 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.322 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.323 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.323 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_nvmeof": { 2023-08-11T12:40:18.323 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_nvmeof", 2023-08-11T12:40:18.323 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.323 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.324 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.324 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.1", 2023-08-11T12:40:18.324 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.324 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.324 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.325 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Nvme-of container image", 2023-08-11T12:40:18.325 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.325 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.325 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.326 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_prometheus": { 2023-08-11T12:40:18.326 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_prometheus", 2023-08-11T12:40:18.326 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.326 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.326 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.326 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-08-11T12:40:18.327 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.327 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.327 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.327 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-08-11T12:40:18.327 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.328 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.328 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.328 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_promtail": { 2023-08-11T12:40:18.328 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_promtail", 2023-08-11T12:40:18.329 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.329 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.329 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.329 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-08-11T12:40:18.329 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.330 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.330 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.330 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Promtail container image", 2023-08-11T12:40:18.330 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.330 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.331 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.331 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_snmp_gateway": { 2023-08-11T12:40:18.331 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_snmp_gateway", 2023-08-11T12:40:18.331 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-08-11T12:40:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SNMP Gateway container image", 2023-08-11T12:40:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: "container_init": { 2023-08-11T12:40:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_init", 2023-08-11T12:40:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Run podman/docker with `--init`", 2023-08-11T12:40:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "daemon_cache_timeout": { 2023-08-11T12:40:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "daemon_cache_timeout", 2023-08-11T12:40:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-08-11T12:40:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-08-11T12:40:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: "default_cephadm_command_timeout": { 2023-08-11T12:40:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "default_cephadm_command_timeout", 2023-08-11T12:40:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "900", 2023-08-11T12:40:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-08-11T12:40:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: "default_registry": { 2023-08-11T12:40:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "default_registry", 2023-08-11T12:40:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io", 2023-08-11T12:40:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.344 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.344 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.344 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-08-11T12:40:18.344 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.344 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.345 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.345 INFO:teuthology.orchestra.run.smithi008.stdout: "device_cache_timeout": { 2023-08-11T12:40:18.345 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_cache_timeout", 2023-08-11T12:40:18.345 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:18.345 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.346 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.346 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1800", 2023-08-11T12:40:18.346 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.346 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.346 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.347 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache device inventory", 2023-08-11T12:40:18.347 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.347 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.347 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.348 INFO:teuthology.orchestra.run.smithi008.stdout: "device_enhanced_scan": { 2023-08-11T12:40:18.348 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_enhanced_scan", 2023-08-11T12:40:18.348 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.348 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.348 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.349 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.349 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.349 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.349 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.349 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use libstoragemgmt during device scans", 2023-08-11T12:40:18.350 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.350 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.350 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.350 INFO:teuthology.orchestra.run.smithi008.stdout: "facts_cache_timeout": { 2023-08-11T12:40:18.351 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "facts_cache_timeout", 2023-08-11T12:40:18.351 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:18.351 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.351 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.351 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-08-11T12:40:18.352 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.352 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.352 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.352 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache host facts data", 2023-08-11T12:40:18.352 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.353 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.353 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.353 INFO:teuthology.orchestra.run.smithi008.stdout: "host_check_interval": { 2023-08-11T12:40:18.353 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "host_check_interval", 2023-08-11T12:40:18.354 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:18.354 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.354 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.354 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-08-11T12:40:18.354 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.355 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.355 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.355 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to perform a host check", 2023-08-11T12:40:18.355 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.355 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.356 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.356 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.356 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:18.356 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:18.356 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.357 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.357 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.357 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.357 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.357 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.358 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.358 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.358 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.358 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.358 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.359 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.359 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.359 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.359 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.359 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.360 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.360 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.360 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.360 INFO:teuthology.orchestra.run.smithi008.stdout: "log_refresh_metadata": { 2023-08-11T12:40:18.360 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_refresh_metadata", 2023-08-11T12:40:18.361 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.361 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.361 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.361 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.361 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.362 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.362 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.362 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-08-11T12:40:18.362 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.362 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.363 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.363 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.363 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:18.363 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:18.363 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.364 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.364 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.364 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.364 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.364 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.365 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.365 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-08-11T12:40:18.365 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.365 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.365 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.366 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.366 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:18.366 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:18.366 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.366 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.367 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.367 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:18.367 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.367 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.367 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.368 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.368 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.368 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.368 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.368 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.369 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.369 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.369 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.369 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.369 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.369 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.370 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.370 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:18.370 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:18.370 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.370 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.371 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.371 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.371 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.371 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.371 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.372 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.372 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.372 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.372 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.372 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.373 INFO:teuthology.orchestra.run.smithi008.stdout: "manage_etc_ceph_ceph_conf": { 2023-08-11T12:40:18.373 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-08-11T12:40:18.373 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.373 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.373 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.374 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.374 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.374 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.374 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.374 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-08-11T12:40:18.375 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.375 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.375 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.375 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.375 INFO:teuthology.orchestra.run.smithi008.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-08-11T12:40:18.376 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-08-11T12:40:18.376 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.376 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.376 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.376 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "*", 2023-08-11T12:40:18.377 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.377 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.377 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.377 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-08-11T12:40:18.377 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.378 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.378 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.378 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.378 INFO:teuthology.orchestra.run.smithi008.stdout: "max_count_per_host": { 2023-08-11T12:40:18.378 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_count_per_host", 2023-08-11T12:40:18.379 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.379 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.379 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.379 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-08-11T12:40:18.379 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.380 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.380 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.380 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "max number of daemons per service per host", 2023-08-11T12:40:18.380 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.381 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.381 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.381 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.381 INFO:teuthology.orchestra.run.smithi008.stdout: "max_osd_draining_count": { 2023-08-11T12:40:18.381 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_osd_draining_count", 2023-08-11T12:40:18.382 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.382 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.382 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.382 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-08-11T12:40:18.382 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.382 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.383 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.383 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-08-11T12:40:18.383 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.383 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.383 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.384 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.384 INFO:teuthology.orchestra.run.smithi008.stdout: "migration_current": { 2023-08-11T12:40:18.384 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "migration_current", 2023-08-11T12:40:18.384 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.384 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.385 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.385 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.385 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.385 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.386 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.386 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "internal - do not modify", 2023-08-11T12:40:18.386 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.386 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.386 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.387 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.387 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": { 2023-08-11T12:40:18.387 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mode", 2023-08-11T12:40:18.387 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.387 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.387 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.388 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "root", 2023-08-11T12:40:18.388 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.388 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.388 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.389 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm-package", 2023-08-11T12:40:18.389 INFO:teuthology.orchestra.run.smithi008.stdout: "root" 2023-08-11T12:40:18.389 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.389 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "mode for remote execution of cephadm", 2023-08-11T12:40:18.389 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.390 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.390 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.390 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.390 INFO:teuthology.orchestra.run.smithi008.stdout: "prometheus_alerts_path": { 2023-08-11T12:40:18.390 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prometheus_alerts_path", 2023-08-11T12:40:18.391 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.391 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.391 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.391 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-08-11T12:40:18.391 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.392 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.392 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.392 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-08-11T12:40:18.392 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.392 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.393 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.393 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.393 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_insecure": { 2023-08-11T12:40:18.393 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_insecure", 2023-08-11T12:40:18.393 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.394 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.394 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.394 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.394 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.394 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.395 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.395 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-08-11T12:40:18.395 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.395 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.395 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.396 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.396 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_password": { 2023-08-11T12:40:18.396 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_password", 2023-08-11T12:40:18.396 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.396 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.397 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.397 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.397 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.397 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.397 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.398 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-08-11T12:40:18.398 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.398 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.398 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.398 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.399 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_url": { 2023-08-11T12:40:18.399 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_url", 2023-08-11T12:40:18.399 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.399 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.399 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.400 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.400 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.400 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.400 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.400 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-08-11T12:40:18.401 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.401 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.401 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.401 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.401 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_username": { 2023-08-11T12:40:18.402 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_username", 2023-08-11T12:40:18.402 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.402 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.402 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.402 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.403 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.403 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.403 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.403 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-08-11T12:40:18.403 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.404 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.404 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.404 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.404 INFO:teuthology.orchestra.run.smithi008.stdout: "secure_monitoring_stack": { 2023-08-11T12:40:18.404 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "secure_monitoring_stack", 2023-08-11T12:40:18.405 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.405 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.405 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.405 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.405 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.405 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.406 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.406 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-08-11T12:40:18.406 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.406 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.406 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.407 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.407 INFO:teuthology.orchestra.run.smithi008.stdout: "service_discovery_port": { 2023-08-11T12:40:18.407 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "service_discovery_port", 2023-08-11T12:40:18.407 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.407 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.408 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.408 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8765", 2023-08-11T12:40:18.408 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.408 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.408 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.409 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "cephadm service discovery port", 2023-08-11T12:40:18.409 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.409 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.409 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.409 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.410 INFO:teuthology.orchestra.run.smithi008.stdout: "ssh_config_file": { 2023-08-11T12:40:18.410 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssh_config_file", 2023-08-11T12:40:18.410 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.410 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.410 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.411 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.411 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.411 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.411 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.411 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-08-11T12:40:18.412 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.412 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.412 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.412 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.412 INFO:teuthology.orchestra.run.smithi008.stdout: "use_agent": { 2023-08-11T12:40:18.413 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "use_agent", 2023-08-11T12:40:18.413 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.413 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.413 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.413 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.414 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.414 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.414 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.414 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-08-11T12:40:18.414 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.415 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.415 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.415 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.415 INFO:teuthology.orchestra.run.smithi008.stdout: "use_repo_digest": { 2023-08-11T12:40:18.415 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "use_repo_digest", 2023-08-11T12:40:18.416 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.416 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.416 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.416 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.416 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.417 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.417 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.417 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-08-11T12:40:18.417 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.417 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.418 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.418 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.418 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_failed_host_check": { 2023-08-11T12:40:18.418 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_failed_host_check", 2023-08-11T12:40:18.418 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.419 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.419 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.419 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.419 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.419 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.420 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.420 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if the host check fails", 2023-08-11T12:40:18.420 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.420 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.420 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.421 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.421 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_stray_daemons": { 2023-08-11T12:40:18.421 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_stray_daemons", 2023-08-11T12:40:18.421 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.421 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.422 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.422 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.422 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.422 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.422 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.423 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-08-11T12:40:18.423 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.423 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.423 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.423 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.424 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_stray_hosts": { 2023-08-11T12:40:18.424 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_stray_hosts", 2023-08-11T12:40:18.424 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.424 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.424 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.425 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.425 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.425 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.425 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.425 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-08-11T12:40:18.426 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.426 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.426 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.426 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.426 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.427 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.427 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:18.427 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crash", 2023-08-11T12:40:18.427 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:18.427 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:18.428 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:18.428 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:18.428 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:18.428 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.428 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.429 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.429 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.429 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.429 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.429 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.430 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.430 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.430 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.430 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.430 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.431 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.431 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.431 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.431 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.431 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.432 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.432 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.432 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:18.432 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:18.432 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.433 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.433 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.433 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.433 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.433 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.434 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.434 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.434 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.434 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.434 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.434 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.435 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:18.435 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:18.435 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.435 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.435 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.436 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:18.436 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.436 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.436 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.436 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.437 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.437 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.437 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.437 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.437 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.438 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.438 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.438 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.438 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.438 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.439 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.439 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:18.439 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:18.439 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.439 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.440 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.440 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.440 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.440 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.440 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.441 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.441 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.441 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.441 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.441 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.442 INFO:teuthology.orchestra.run.smithi008.stdout: "retain_interval": { 2023-08-11T12:40:18.442 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "retain_interval", 2023-08-11T12:40:18.442 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:18.442 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.442 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.443 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "31536000", 2023-08-11T12:40:18.443 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.443 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.443 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.443 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long to retain crashes before pruning them", 2023-08-11T12:40:18.443 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.444 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.444 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.444 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.444 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_recent_interval": { 2023-08-11T12:40:18.444 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_recent_interval", 2023-08-11T12:40:18.445 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:18.445 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.445 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.445 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1209600", 2023-08-11T12:40:18.445 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.446 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.446 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.446 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "time interval in which to warn about recent crashes", 2023-08-11T12:40:18.446 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.446 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.447 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.447 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.447 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.447 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.447 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:18.448 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "dashboard", 2023-08-11T12:40:18.448 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:18.448 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:18.448 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:18.448 INFO:teuthology.orchestra.run.smithi008.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-08-11T12:40:18.449 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-08-11T12:40:18.449 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.449 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.449 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.449 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-08-11T12:40:18.450 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.450 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.450 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.450 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.450 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.451 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.451 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.451 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.451 INFO:teuthology.orchestra.run.smithi008.stdout: "ALERTMANAGER_API_HOST": { 2023-08-11T12:40:18.451 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ALERTMANAGER_API_HOST", 2023-08-11T12:40:18.452 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.452 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.452 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.452 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.452 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.453 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.453 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.453 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.453 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.453 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.454 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.454 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.454 INFO:teuthology.orchestra.run.smithi008.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-08-11T12:40:18.454 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-08-11T12:40:18.454 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.454 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.455 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.455 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.455 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.455 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.455 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.456 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.456 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.456 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.456 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.457 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.457 INFO:teuthology.orchestra.run.smithi008.stdout: "AUDIT_API_ENABLED": { 2023-08-11T12:40:18.457 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "AUDIT_API_ENABLED", 2023-08-11T12:40:18.457 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.457 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.457 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.458 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.458 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.458 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.458 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.458 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.459 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.459 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.459 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.459 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.459 INFO:teuthology.orchestra.run.smithi008.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-08-11T12:40:18.460 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-08-11T12:40:18.460 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.460 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.460 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.460 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.461 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.461 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.461 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.461 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.461 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.462 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.462 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.462 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.462 INFO:teuthology.orchestra.run.smithi008.stdout: "ENABLE_BROWSABLE_API": { 2023-08-11T12:40:18.462 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ENABLE_BROWSABLE_API", 2023-08-11T12:40:18.463 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.463 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.463 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.463 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.463 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.464 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.464 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.464 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.464 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.464 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.465 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.465 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.465 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-08-11T12:40:18.465 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-08-11T12:40:18.465 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.466 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.466 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.466 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.466 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.466 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.467 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.467 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.467 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.467 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.467 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.468 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.468 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-08-11T12:40:18.468 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-08-11T12:40:18.468 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.468 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.469 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.469 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.469 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.469 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.469 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.470 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.470 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.470 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.470 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.470 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.470 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-08-11T12:40:18.471 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-08-11T12:40:18.471 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.471 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.471 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.472 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.472 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.472 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.472 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.472 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.473 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.473 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.473 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.473 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.473 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-08-11T12:40:18.474 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-08-11T12:40:18.474 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.474 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.474 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.474 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.474 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.475 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.475 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.475 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.475 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.475 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.476 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.476 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.476 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_NFS": { 2023-08-11T12:40:18.476 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-08-11T12:40:18.476 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.477 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.477 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.477 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.477 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.477 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.478 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.478 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.478 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.478 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.478 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.479 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.479 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_RBD": { 2023-08-11T12:40:18.479 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-08-11T12:40:18.479 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.479 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.480 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.480 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.480 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.480 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.480 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.481 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.481 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.481 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.481 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.481 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.482 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_RGW": { 2023-08-11T12:40:18.482 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-08-11T12:40:18.482 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.482 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.482 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.483 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.483 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.483 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.483 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.483 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.484 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.484 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.484 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.484 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.484 INFO:teuthology.orchestra.run.smithi008.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-08-11T12:40:18.485 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-08-11T12:40:18.485 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.485 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.485 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.485 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.486 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.486 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.486 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.486 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.486 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.487 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.487 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.487 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.487 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_PASSWORD": { 2023-08-11T12:40:18.487 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_PASSWORD", 2023-08-11T12:40:18.488 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.488 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.488 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.488 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2023-08-11T12:40:18.488 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.489 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.489 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.489 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.489 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.489 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.490 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.490 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.490 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-08-11T12:40:18.490 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-08-11T12:40:18.490 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.491 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.491 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.491 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.491 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.491 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.492 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.492 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.492 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.492 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.492 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.493 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.493 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_URL": { 2023-08-11T12:40:18.493 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_URL", 2023-08-11T12:40:18.493 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.493 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.493 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.494 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.494 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.494 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.494 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.494 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.495 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.495 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.495 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.495 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.495 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_USERNAME": { 2023-08-11T12:40:18.496 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_USERNAME", 2023-08-11T12:40:18.496 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.496 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.496 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.496 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2023-08-11T12:40:18.497 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.497 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.497 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.497 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.497 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.498 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.498 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.498 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.498 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-08-11T12:40:18.498 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-08-11T12:40:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.500 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.500 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.500 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.500 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.500 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.501 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.501 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.501 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-08-11T12:40:18.501 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-08-11T12:40:18.501 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.502 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.502 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.502 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.502 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.502 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.503 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.503 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.503 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.503 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.503 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.504 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.504 INFO:teuthology.orchestra.run.smithi008.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-08-11T12:40:18.504 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-08-11T12:40:18.504 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.504 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.505 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.505 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.505 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.505 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.505 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.506 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.506 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.506 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.506 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.506 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.507 INFO:teuthology.orchestra.run.smithi008.stdout: "ISSUE_TRACKER_API_KEY": { 2023-08-11T12:40:18.507 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-08-11T12:40:18.507 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.507 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.507 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.508 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.508 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.508 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.508 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.508 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.509 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.509 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.509 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.509 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.509 INFO:teuthology.orchestra.run.smithi008.stdout: "PROMETHEUS_API_HOST": { 2023-08-11T12:40:18.510 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PROMETHEUS_API_HOST", 2023-08-11T12:40:18.510 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.510 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.510 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.510 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.510 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.511 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.511 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.511 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.511 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.511 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.512 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.512 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.512 INFO:teuthology.orchestra.run.smithi008.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-08-11T12:40:18.512 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-08-11T12:40:18.513 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.513 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.513 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.513 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.513 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.514 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.514 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.514 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.514 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.514 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.515 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.515 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.515 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-08-11T12:40:18.515 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-08-11T12:40:18.515 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.515 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.516 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.516 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.516 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.516 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.517 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.517 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.517 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.517 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.517 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.518 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.518 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-08-11T12:40:18.518 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-08-11T12:40:18.518 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.518 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.519 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.519 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.519 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.519 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.519 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.520 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.520 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.520 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.520 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.520 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-08-11T12:40:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-08-11T12:40:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.522 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.522 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.522 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.522 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.522 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.522 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.523 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.523 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.523 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.523 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-08-11T12:40:18.523 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-08-11T12:40:18.524 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.524 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.524 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.524 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.525 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.525 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.525 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.525 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.525 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.526 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.526 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.526 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.526 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-08-11T12:40:18.526 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-08-11T12:40:18.527 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.527 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.527 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.527 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.527 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.529 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.529 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.529 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-08-11T12:40:18.529 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-08-11T12:40:18.529 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.530 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.530 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.530 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.530 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.530 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.531 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.531 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.531 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.531 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.531 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.532 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.532 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-08-11T12:40:18.532 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-08-11T12:40:18.532 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.532 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.533 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.533 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.533 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.533 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.533 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.534 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.534 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.534 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.534 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.534 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.535 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_ENABLED": { 2023-08-11T12:40:18.535 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_ENABLED", 2023-08-11T12:40:18.535 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.535 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.535 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.536 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.536 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.536 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.536 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.536 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.537 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.537 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.537 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.537 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.537 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-08-11T12:40:18.538 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-08-11T12:40:18.538 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.538 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.538 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.538 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-08-11T12:40:18.539 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.539 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.539 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.539 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.539 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.540 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.540 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.540 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.540 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-08-11T12:40:18.540 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-08-11T12:40:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-08-11T12:40:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.542 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.542 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.542 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.542 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.542 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.543 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.543 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.543 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-08-11T12:40:18.543 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-08-11T12:40:18.543 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.544 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.544 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.544 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8", 2023-08-11T12:40:18.544 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.544 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.546 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.546 INFO:teuthology.orchestra.run.smithi008.stdout: "REST_REQUESTS_TIMEOUT": { 2023-08-11T12:40:18.546 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-08-11T12:40:18.546 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.546 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.546 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.547 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "45", 2023-08-11T12:40:18.547 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.547 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.547 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.547 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.548 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.548 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.548 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.548 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.548 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_ACCESS_KEY": { 2023-08-11T12:40:18.549 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_ACCESS_KEY", 2023-08-11T12:40:18.549 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.549 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.549 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.549 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.550 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.550 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.550 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.550 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.550 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.551 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.551 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.551 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.551 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-08-11T12:40:18.551 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-08-11T12:40:18.552 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.552 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.552 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.552 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2023-08-11T12:40:18.552 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.553 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.553 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.553 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.553 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.553 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.554 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.554 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.554 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_SECRET_KEY": { 2023-08-11T12:40:18.554 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_SECRET_KEY", 2023-08-11T12:40:18.554 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.555 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.555 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.555 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.555 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.555 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.556 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.556 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.556 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.556 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.556 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.556 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.557 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_SSL_VERIFY": { 2023-08-11T12:40:18.557 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_SSL_VERIFY", 2023-08-11T12:40:18.557 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.557 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.559 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.559 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.559 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.559 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.559 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-08-11T12:40:18.560 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-08-11T12:40:18.560 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.560 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.560 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.561 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-08-11T12:40:18.561 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.561 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.561 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.561 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.562 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.562 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.562 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.562 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.562 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-08-11T12:40:18.563 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-08-11T12:40:18.563 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.563 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.563 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.563 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-08-11T12:40:18.564 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.564 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.564 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.564 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.564 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-08-11T12:40:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-08-11T12:40:18.566 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.566 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.566 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.566 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-08-11T12:40:18.566 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.567 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.567 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.567 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.567 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.567 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.568 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.568 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.568 INFO:teuthology.orchestra.run.smithi008.stdout: "cross_origin_url": { 2023-08-11T12:40:18.568 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cross_origin_url", 2023-08-11T12:40:18.568 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.570 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.570 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.570 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.570 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.570 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.571 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.571 INFO:teuthology.orchestra.run.smithi008.stdout: "crt_file": { 2023-08-11T12:40:18.571 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crt_file", 2023-08-11T12:40:18.571 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.571 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.573 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.573 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.573 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.573 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.573 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: "debug": { 2023-08-11T12:40:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "debug", 2023-08-11T12:40:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable/disable debug options", 2023-08-11T12:40:18.576 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.576 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.576 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.576 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.576 INFO:teuthology.orchestra.run.smithi008.stdout: "jwt_token_ttl": { 2023-08-11T12:40:18.577 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "jwt_token_ttl", 2023-08-11T12:40:18.577 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.577 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.577 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.577 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "28800", 2023-08-11T12:40:18.578 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.578 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.578 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.578 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.578 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.578 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.579 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.579 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.579 INFO:teuthology.orchestra.run.smithi008.stdout: "key_file": { 2023-08-11T12:40:18.579 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "key_file", 2023-08-11T12:40:18.579 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.580 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.580 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.580 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.580 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.580 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.581 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.581 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.581 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.581 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.581 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.582 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.582 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:18.582 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:18.582 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.582 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.583 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.583 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.583 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.583 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.583 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.584 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.584 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.584 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.584 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.584 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.585 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.585 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.585 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.585 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.585 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.586 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.586 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.586 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:18.586 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:18.586 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.587 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.587 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.587 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.587 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.587 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.588 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.588 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.588 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.588 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.588 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.589 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.589 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:18.589 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:18.589 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.589 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.589 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.590 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:18.590 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.590 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.590 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.590 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.591 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.591 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.591 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.591 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.591 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.592 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.592 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.592 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.592 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.592 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.593 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.593 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:18.593 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:18.593 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.593 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.594 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.594 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.594 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.594 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.594 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.595 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.595 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.595 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.595 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.595 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.596 INFO:teuthology.orchestra.run.smithi008.stdout: "motd": { 2023-08-11T12:40:18.596 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "motd", 2023-08-11T12:40:18.596 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.596 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.596 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.597 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.597 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.597 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.597 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.597 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "The message of the day", 2023-08-11T12:40:18.598 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.598 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.598 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.598 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.598 INFO:teuthology.orchestra.run.smithi008.stdout: "redirect_resolve_ip_addr": { 2023-08-11T12:40:18.598 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "redirect_resolve_ip_addr", 2023-08-11T12:40:18.599 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.599 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.599 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.599 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.599 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.600 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.600 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.600 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.600 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.600 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.601 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.601 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.601 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2023-08-11T12:40:18.601 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2023-08-11T12:40:18.601 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.602 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.602 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.602 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "::", 2023-08-11T12:40:18.602 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.602 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.603 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.603 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.603 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.603 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.603 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.604 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.604 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2023-08-11T12:40:18.604 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2023-08-11T12:40:18.604 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.604 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.605 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.605 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8080", 2023-08-11T12:40:18.605 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.605 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.605 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.606 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.606 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.606 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.606 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.606 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.607 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl": { 2023-08-11T12:40:18.607 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl", 2023-08-11T12:40:18.607 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.607 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.607 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.608 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.608 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.608 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.608 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.608 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.609 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.609 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.609 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.609 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.609 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl_server_port": { 2023-08-11T12:40:18.610 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl_server_port", 2023-08-11T12:40:18.610 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.610 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.610 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.610 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8443", 2023-08-11T12:40:18.611 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.611 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.611 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.611 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.611 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.612 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.612 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.612 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.612 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_behaviour": { 2023-08-11T12:40:18.612 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_behaviour", 2023-08-11T12:40:18.613 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.613 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.613 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.613 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "redirect", 2023-08-11T12:40:18.613 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.614 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.614 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.614 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.614 INFO:teuthology.orchestra.run.smithi008.stdout: "redirect" 2023-08-11T12:40:18.614 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.614 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.615 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.615 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.615 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.615 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.615 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_error_status_code": { 2023-08-11T12:40:18.616 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_error_status_code", 2023-08-11T12:40:18.616 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.616 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.616 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.616 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "500", 2023-08-11T12:40:18.617 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "400", 2023-08-11T12:40:18.617 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "599", 2023-08-11T12:40:18.617 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.617 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.617 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.618 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.618 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.618 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.618 INFO:teuthology.orchestra.run.smithi008.stdout: "url_prefix": { 2023-08-11T12:40:18.618 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "url_prefix", 2023-08-11T12:40:18.619 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.619 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.619 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.619 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.619 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.620 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.620 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.620 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.620 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.620 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.621 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.621 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.621 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.621 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.621 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:18.622 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "devicehealth", 2023-08-11T12:40:18.622 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:18.622 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:18.622 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:18.622 INFO:teuthology.orchestra.run.smithi008.stdout: "enable_monitoring": { 2023-08-11T12:40:18.623 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enable_monitoring", 2023-08-11T12:40:18.623 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.623 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.623 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.623 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.624 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.624 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.624 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.624 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "monitor device health metrics", 2023-08-11T12:40:18.624 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.625 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.625 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.625 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.625 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:18.625 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:18.626 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.626 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.626 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.626 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.626 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.627 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.627 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.627 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.627 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.628 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.628 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.628 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.628 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.628 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.629 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.629 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.629 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.629 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.629 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.629 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:18.630 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:18.630 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.630 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.630 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.630 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.631 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.631 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.631 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.631 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.631 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.632 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.632 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.632 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.632 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:18.633 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:18.633 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.633 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.633 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.633 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:18.634 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.634 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.634 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.634 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.634 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.635 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.635 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.635 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.635 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.636 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.636 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.636 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.636 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.636 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.637 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.637 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:18.637 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:18.637 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.637 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.638 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.638 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.638 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.638 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.638 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.639 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.639 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.639 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.639 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.639 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.640 INFO:teuthology.orchestra.run.smithi008.stdout: "mark_out_threshold": { 2023-08-11T12:40:18.640 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mark_out_threshold", 2023-08-11T12:40:18.640 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:18.640 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.640 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.641 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "2419200", 2023-08-11T12:40:18.641 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.641 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.641 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.641 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-08-11T12:40:18.642 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.642 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.642 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.642 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.642 INFO:teuthology.orchestra.run.smithi008.stdout: "pool_name": { 2023-08-11T12:40:18.643 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pool_name", 2023-08-11T12:40:18.643 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.643 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.643 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.643 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "device_health_metrics", 2023-08-11T12:40:18.644 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.644 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.644 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.644 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "name of pool in which to store device health metrics", 2023-08-11T12:40:18.644 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.645 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.645 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.645 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.645 INFO:teuthology.orchestra.run.smithi008.stdout: "retention_period": { 2023-08-11T12:40:18.645 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "retention_period", 2023-08-11T12:40:18.646 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:18.646 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.646 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.646 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15552000", 2023-08-11T12:40:18.646 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.647 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.647 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.647 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long to retain device health metrics", 2023-08-11T12:40:18.648 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.648 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.648 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.649 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.649 INFO:teuthology.orchestra.run.smithi008.stdout: "scrape_frequency": { 2023-08-11T12:40:18.649 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "scrape_frequency", 2023-08-11T12:40:18.649 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:18.649 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.650 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.650 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "86400", 2023-08-11T12:40:18.650 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.650 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.651 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.651 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to scrape device health metrics", 2023-08-11T12:40:18.651 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.651 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.651 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.652 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.652 INFO:teuthology.orchestra.run.smithi008.stdout: "self_heal": { 2023-08-11T12:40:18.652 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "self_heal", 2023-08-11T12:40:18.652 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.652 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.653 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.653 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.653 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.653 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.653 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.654 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-08-11T12:40:18.654 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.654 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.654 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.655 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.655 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-08-11T12:40:18.655 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-08-11T12:40:18.655 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:18.655 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.656 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.656 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-08-11T12:40:18.656 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.656 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.656 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.657 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to wake up and check device health", 2023-08-11T12:40:18.657 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.657 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.657 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.657 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.658 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_threshold": { 2023-08-11T12:40:18.658 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_threshold", 2023-08-11T12:40:18.658 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:18.658 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.658 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.659 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "7257600", 2023-08-11T12:40:18.659 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.659 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.659 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.660 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-08-11T12:40:18.660 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.660 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.660 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.660 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.661 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.661 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.661 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:18.661 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "diskprediction_local", 2023-08-11T12:40:18.661 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:18.662 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:18.662 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:18.662 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:18.662 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:18.663 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.663 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.663 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.663 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.663 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.664 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.664 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.664 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.664 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.664 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.665 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.665 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.665 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.665 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.665 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.666 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.666 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.666 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.666 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.666 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:18.667 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:18.667 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.667 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.667 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.667 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.668 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.668 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.668 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.668 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.668 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.669 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.669 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.669 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.669 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:18.669 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:18.670 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.670 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.670 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.670 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:18.670 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.670 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.671 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.671 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.671 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.671 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.671 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.672 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.672 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.672 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.672 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.673 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.673 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.673 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.673 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.673 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:18.674 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:18.674 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.674 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.674 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.674 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.674 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.675 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.675 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.675 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.675 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.675 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.676 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.676 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.676 INFO:teuthology.orchestra.run.smithi008.stdout: "predict_interval": { 2023-08-11T12:40:18.676 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "predict_interval", 2023-08-11T12:40:18.676 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.677 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.677 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.677 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "86400", 2023-08-11T12:40:18.677 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.677 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.678 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.678 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.678 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.678 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.678 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.679 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.679 INFO:teuthology.orchestra.run.smithi008.stdout: "predictor_model": { 2023-08-11T12:40:18.679 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "predictor_model", 2023-08-11T12:40:18.679 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.679 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.680 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.680 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "prophetstor", 2023-08-11T12:40:18.680 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.680 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.680 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.681 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.681 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.681 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.681 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.681 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.682 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-08-11T12:40:18.682 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-08-11T12:40:18.682 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.682 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.682 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.683 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-08-11T12:40:18.683 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.683 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.683 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.683 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.684 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.684 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.684 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.684 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.684 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.685 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.685 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:18.685 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "influx", 2023-08-11T12:40:18.685 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": false, 2023-08-11T12:40:18.685 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "influxdb python module not found", 2023-08-11T12:40:18.685 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:18.686 INFO:teuthology.orchestra.run.smithi008.stdout: "batch_size": { 2023-08-11T12:40:18.686 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "batch_size", 2023-08-11T12:40:18.686 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.686 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.687 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.687 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5000", 2023-08-11T12:40:18.687 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.687 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.687 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.688 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-08-11T12:40:18.688 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.688 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.688 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.688 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.689 INFO:teuthology.orchestra.run.smithi008.stdout: "database": { 2023-08-11T12:40:18.689 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "database", 2023-08-11T12:40:18.689 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.689 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.689 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.690 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "ceph", 2023-08-11T12:40:18.690 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.690 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.690 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.690 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-08-11T12:40:18.691 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.691 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.691 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.691 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.691 INFO:teuthology.orchestra.run.smithi008.stdout: "hostname": { 2023-08-11T12:40:18.692 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "hostname", 2023-08-11T12:40:18.692 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.692 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.692 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.693 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.693 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.693 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.693 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.693 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB server hostname", 2023-08-11T12:40:18.694 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.694 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.694 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.694 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.694 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-08-11T12:40:18.695 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-08-11T12:40:18.695 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:18.695 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.695 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.695 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "30", 2023-08-11T12:40:18.696 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "5", 2023-08-11T12:40:18.696 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.696 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.696 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-08-11T12:40:18.696 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.697 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.697 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.697 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.697 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:18.698 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:18.698 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.698 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.698 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.698 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.699 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.699 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.699 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.699 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.699 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.700 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.700 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.700 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.700 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.701 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.701 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.701 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.701 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.701 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.702 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.702 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:18.702 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:18.702 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.702 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.703 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.703 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.703 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.703 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.703 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.704 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.704 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.704 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.704 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.705 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.705 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:18.705 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:18.705 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.705 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.706 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.706 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:18.706 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.706 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.707 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.707 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.707 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.707 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.707 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.708 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.708 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.708 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.708 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.708 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.709 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.709 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.709 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.709 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:18.710 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:18.710 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.710 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.710 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.710 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.711 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.711 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.711 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.711 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.711 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.712 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.712 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.712 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.712 INFO:teuthology.orchestra.run.smithi008.stdout: "password": { 2023-08-11T12:40:18.712 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "password", 2023-08-11T12:40:18.713 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.713 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.713 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.713 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.713 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.714 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.714 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.714 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "password of InfluxDB server user", 2023-08-11T12:40:18.714 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.714 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.715 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.715 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.715 INFO:teuthology.orchestra.run.smithi008.stdout: "port": { 2023-08-11T12:40:18.715 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "port", 2023-08-11T12:40:18.715 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.716 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.716 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.716 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8086", 2023-08-11T12:40:18.716 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.716 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.717 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.717 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB server port", 2023-08-11T12:40:18.717 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.717 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.717 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.718 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.718 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl": { 2023-08-11T12:40:18.718 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl", 2023-08-11T12:40:18.718 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.718 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.718 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.719 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "false", 2023-08-11T12:40:18.719 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.719 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.719 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.719 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-08-11T12:40:18.720 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.720 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.720 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.720 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.720 INFO:teuthology.orchestra.run.smithi008.stdout: "threads": { 2023-08-11T12:40:18.721 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "threads", 2023-08-11T12:40:18.721 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.721 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.721 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.721 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-08-11T12:40:18.722 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-08-11T12:40:18.722 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "32", 2023-08-11T12:40:18.722 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.722 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-08-11T12:40:18.722 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.723 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.723 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.723 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.723 INFO:teuthology.orchestra.run.smithi008.stdout: "username": { 2023-08-11T12:40:18.723 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "username", 2023-08-11T12:40:18.724 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.724 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.724 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.724 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.724 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.725 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.725 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.725 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "username of InfluxDB server user", 2023-08-11T12:40:18.725 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.725 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.726 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.726 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.726 INFO:teuthology.orchestra.run.smithi008.stdout: "verify_ssl": { 2023-08-11T12:40:18.726 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "verify_ssl", 2023-08-11T12:40:18.726 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.727 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.727 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.727 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "true", 2023-08-11T12:40:18.727 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.727 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.728 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.728 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-08-11T12:40:18.728 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.728 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.728 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.729 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.729 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.729 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.729 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:18.729 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "insights", 2023-08-11T12:40:18.730 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:18.730 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:18.730 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:18.730 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:18.730 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:18.730 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.731 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.731 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.731 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.731 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.731 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.732 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.732 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.732 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.732 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.732 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.733 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.733 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.733 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.733 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.733 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.734 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.734 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.734 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.734 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:18.734 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:18.735 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.735 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.735 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.735 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.735 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.736 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.736 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.736 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.736 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.736 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.737 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.737 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.737 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:18.737 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:18.737 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.738 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.738 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.738 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:18.738 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.738 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.739 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.739 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.739 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.739 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.739 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.740 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.740 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.740 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.740 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.740 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.741 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.741 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.741 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.741 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:18.741 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:18.742 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.742 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.742 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.742 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.742 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.743 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.743 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.743 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.743 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.743 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.744 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.744 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.744 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.744 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.744 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:18.745 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "iostat", 2023-08-11T12:40:18.745 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:18.745 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:18.745 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:18.745 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:18.746 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:18.746 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.746 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.746 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.746 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.747 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.747 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.747 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.748 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.748 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.748 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.748 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.748 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.749 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.749 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.749 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.749 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.749 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.750 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.750 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.750 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:18.750 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:18.750 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.751 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.751 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.751 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.751 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.751 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.752 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.752 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.752 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.752 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.752 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.753 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.753 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:18.753 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:18.753 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.753 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.754 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.754 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:18.754 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.754 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.754 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.755 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.755 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.755 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.755 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.755 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.756 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.756 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.756 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.756 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.756 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.757 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.757 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.757 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:18.757 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:18.757 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "k8sevents", 2023-08-11T12:40:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_event_retention_days": { 2023-08-11T12:40:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ceph_event_retention_days", 2023-08-11T12:40:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "7", 2023-08-11T12:40:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.763 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.763 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Days to hold ceph event information within local cache", 2023-08-11T12:40:18.763 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.763 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: "config_check_secs": { 2023-08-11T12:40:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_check_secs", 2023-08-11T12:40:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-08-11T12:40:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "10", 2023-08-11T12:40:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-08-11T12:40:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.772 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.772 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.772 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.772 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.772 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.773 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.773 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.773 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.773 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.773 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.774 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.774 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:18.774 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:18.774 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.774 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.775 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.775 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:18.775 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.775 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.775 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.775 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.776 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.776 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.776 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.776 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.776 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.777 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.777 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.777 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.777 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.777 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.778 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.778 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:18.778 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:18.778 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.778 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.779 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.779 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.779 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.779 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.779 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.780 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.780 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.780 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.780 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.781 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.781 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.781 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.781 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:18.781 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "localpool", 2023-08-11T12:40:18.782 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:18.782 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:18.782 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:18.782 INFO:teuthology.orchestra.run.smithi008.stdout: "failure_domain": { 2023-08-11T12:40:18.782 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "failure_domain", 2023-08-11T12:40:18.783 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.783 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.783 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.783 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "host", 2023-08-11T12:40:18.783 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.784 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.784 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.784 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "failure domain for any created local pool", 2023-08-11T12:40:18.784 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-08-11T12:40:18.784 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.785 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.785 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.785 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:18.785 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:18.785 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.785 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.786 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.786 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.786 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.786 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.786 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.787 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.787 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.787 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.787 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.787 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.788 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.788 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.788 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.788 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.789 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.789 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.789 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.789 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:18.789 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:18.790 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.790 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.790 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.790 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.790 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.790 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.791 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.791 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.791 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.791 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.792 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.792 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.792 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:18.792 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:18.792 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: "min_size": { 2023-08-11T12:40:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "min_size", 2023-08-11T12:40:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default min_size for any created local pool", 2023-08-11T12:40:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-08-11T12:40:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: "num_rep": { 2023-08-11T12:40:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "num_rep", 2023-08-11T12:40:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3", 2023-08-11T12:40:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default replica count for any created local pool", 2023-08-11T12:40:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_num": { 2023-08-11T12:40:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pg_num", 2023-08-11T12:40:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "128", 2023-08-11T12:40:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.807 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.807 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default pg_num for any created local pool", 2023-08-11T12:40:18.807 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.807 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.807 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.808 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.808 INFO:teuthology.orchestra.run.smithi008.stdout: "prefix": { 2023-08-11T12:40:18.808 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prefix", 2023-08-11T12:40:18.808 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.809 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.809 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.809 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.809 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.809 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.810 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.810 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "name prefix for any created local pool", 2023-08-11T12:40:18.810 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.810 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.810 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.811 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.811 INFO:teuthology.orchestra.run.smithi008.stdout: "subtree": { 2023-08-11T12:40:18.811 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "subtree", 2023-08-11T12:40:18.811 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.812 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.812 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.812 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "rack", 2023-08-11T12:40:18.812 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.812 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.813 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.813 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "CRUSH level for which to create a local pool", 2023-08-11T12:40:18.813 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-08-11T12:40:18.813 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.813 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.814 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.814 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.814 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.814 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:18.814 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mds_autoscaler", 2023-08-11T12:40:18.815 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:18.815 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:18.815 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:18.815 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:18.815 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:18.816 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.816 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.816 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.816 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.816 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.817 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.817 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.817 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.817 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.817 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.818 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.818 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.818 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.818 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.818 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.819 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.819 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.819 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.820 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:18.820 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:18.820 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.820 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.820 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.821 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.821 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.821 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.821 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.822 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.822 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.822 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.822 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.822 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.823 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:18.823 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:18.823 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.823 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.823 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.824 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:18.824 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.824 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.824 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.824 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.824 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.825 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.825 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.825 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.825 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.825 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.826 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.826 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.826 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.826 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.826 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.827 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:18.827 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:18.827 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.827 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.827 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.828 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.828 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.828 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.828 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.828 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.829 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.829 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.829 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.829 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.829 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.830 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:18.830 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mirroring", 2023-08-11T12:40:18.830 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:18.830 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:18.831 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:18.831 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:18.831 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:18.831 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.831 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.832 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.832 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.832 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.832 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.832 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.833 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.833 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.833 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.833 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.833 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.833 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.834 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.834 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.834 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.834 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.834 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.835 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.835 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:18.835 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:18.835 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.835 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.836 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.836 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.836 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.836 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.837 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.837 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.837 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.837 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.837 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.838 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.838 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:18.838 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:18.838 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.838 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.839 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.839 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:18.839 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.839 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.839 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.840 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.840 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.840 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.840 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.840 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.841 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.841 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.841 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.841 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.841 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.842 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.842 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.842 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:18.842 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:18.842 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.843 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.843 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.843 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.843 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.843 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.844 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.844 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.844 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.844 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.844 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.845 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.845 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.845 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.845 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:18.845 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "nfs", 2023-08-11T12:40:18.846 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:18.846 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:18.846 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:18.846 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:18.846 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:18.847 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.847 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.847 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.847 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.847 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.847 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.848 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.848 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.848 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.848 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.848 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.849 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.849 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.849 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.849 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.849 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.850 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.850 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.850 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.850 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:18.850 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:18.851 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.851 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.851 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.851 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.851 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.852 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.852 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.852 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.852 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.852 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.853 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.853 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.853 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:18.853 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:18.853 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.854 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.854 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.854 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:18.854 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.854 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.855 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.855 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.855 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.855 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.855 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.855 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.856 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.856 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.856 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.856 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.856 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.857 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.857 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.857 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:18.857 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:18.857 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.858 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.858 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.858 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.858 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.858 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.859 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.859 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.859 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.859 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.859 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.860 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.860 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.860 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.860 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:18.860 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "orchestrator", 2023-08-11T12:40:18.861 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:18.861 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:18.861 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:18.861 INFO:teuthology.orchestra.run.smithi008.stdout: "fail_fs": { 2023-08-11T12:40:18.861 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "fail_fs", 2023-08-11T12:40:18.862 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.862 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.862 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.862 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.862 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.863 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.863 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.863 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-08-11T12:40:18.863 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.863 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.863 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.864 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.864 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:18.864 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:18.864 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.864 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.865 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.865 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.865 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.865 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.865 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.866 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.866 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.866 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.866 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.866 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.867 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.867 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.867 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.867 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.867 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.868 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.868 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.868 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:18.868 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:18.868 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.869 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.869 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.869 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.869 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.869 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.870 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.870 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.870 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.870 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.870 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.871 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:18.871 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:18.871 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.871 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.872 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.872 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:18.872 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.872 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.872 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.873 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.873 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.873 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.873 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.873 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.874 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.874 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.874 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.874 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.874 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.875 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.875 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:18.875 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:18.875 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.876 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.876 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.876 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.876 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.876 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.877 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.877 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.877 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.877 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.877 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.878 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator": { 2023-08-11T12:40:18.878 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "orchestrator", 2023-08-11T12:40:18.878 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.878 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.878 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.879 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.879 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.879 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.879 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.879 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm", 2023-08-11T12:40:18.880 INFO:teuthology.orchestra.run.smithi008.stdout: "rook", 2023-08-11T12:40:18.880 INFO:teuthology.orchestra.run.smithi008.stdout: "test_orchestrator" 2023-08-11T12:40:18.880 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.880 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Orchestrator backend", 2023-08-11T12:40:18.880 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.881 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.881 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.881 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.881 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.881 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.882 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:18.882 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "osd_perf_query", 2023-08-11T12:40:18.882 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:18.882 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:18.882 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:18.883 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:18.883 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:18.883 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.883 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.883 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.884 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.884 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.884 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.884 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.884 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.885 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.885 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.885 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.885 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.885 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.886 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.886 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.886 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.886 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.886 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.887 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.887 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:18.887 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:18.887 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.887 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.887 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.888 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.888 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.888 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.888 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.889 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.889 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.889 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.889 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.889 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.890 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:18.890 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:18.890 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.890 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.890 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.891 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:18.891 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.891 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.891 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.891 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.892 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.892 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.892 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.892 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.892 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.893 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.893 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.893 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.893 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.893 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.894 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.894 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:18.894 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:18.894 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.894 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.895 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.895 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.895 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.895 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.895 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.896 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.896 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.896 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.896 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.896 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.897 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.897 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.897 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:18.897 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "osd_support", 2023-08-11T12:40:18.897 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:18.898 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:18.898 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:18.898 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:18.898 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:18.898 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.899 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.899 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.899 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.899 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.900 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.900 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.900 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.900 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.900 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.901 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.901 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.901 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.901 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.901 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.902 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.902 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.902 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.902 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:18.903 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:18.903 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.903 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.903 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.903 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.904 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.904 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.904 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.904 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.904 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.905 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.905 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.905 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.905 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:18.905 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:18.906 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.906 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.906 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.906 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:18.906 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.907 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.907 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.907 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.907 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.907 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.908 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.908 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.908 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.908 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.909 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.909 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.909 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.909 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.909 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.910 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:18.910 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:18.910 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.910 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.910 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.911 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.911 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.911 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.911 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.911 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.912 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.912 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.912 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.912 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.912 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.913 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.913 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:18.913 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pg_autoscaler", 2023-08-11T12:40:18.913 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:18.913 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:18.914 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:18.914 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:18.914 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:18.914 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.914 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.915 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.915 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.915 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.915 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.916 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.916 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.916 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.916 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.916 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.917 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.917 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.917 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.917 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.917 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.918 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.918 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.918 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.918 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:18.918 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:18.919 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.919 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.919 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.919 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.919 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.920 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.920 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.920 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.920 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.920 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.921 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.921 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.921 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:18.921 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:18.922 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.922 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.922 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.922 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:18.922 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.923 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.923 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.923 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.923 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.923 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.923 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.924 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.924 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.924 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.924 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.925 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.925 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.925 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.925 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.925 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:18.926 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:18.926 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.926 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.926 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.926 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.927 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.927 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.927 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.927 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.927 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.928 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.928 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.928 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.928 INFO:teuthology.orchestra.run.smithi008.stdout: "noautoscale": { 2023-08-11T12:40:18.929 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "noautoscale", 2023-08-11T12:40:18.929 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.929 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.929 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.929 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.930 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.930 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.930 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.930 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "global autoscale flag", 2023-08-11T12:40:18.930 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-08-11T12:40:18.930 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.931 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.931 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.931 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-08-11T12:40:18.931 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-08-11T12:40:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-08-11T12:40:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: "threshold": { 2023-08-11T12:40:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "threshold", 2023-08-11T12:40:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-08-11T12:40:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3.0", 2023-08-11T12:40:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1.0", 2023-08-11T12:40:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "scaling threshold", 2023-08-11T12:40:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-08-11T12:40:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "progress", 2023-08-11T12:40:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_pg_recovery_event": { 2023-08-11T12:40:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_pg_recovery_event", 2023-08-11T12:40:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow the module to show pg recovery progress", 2023-08-11T12:40:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: "enabled": { 2023-08-11T12:40:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enabled", 2023-08-11T12:40:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.944 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.944 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.944 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.944 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.944 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:18.945 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:18.945 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.945 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.945 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.945 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.946 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.946 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.946 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.946 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.946 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.947 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.947 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.947 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.947 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.947 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.948 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.948 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.948 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.948 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.948 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.949 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:18.949 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:18.949 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.949 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.949 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.950 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.950 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.950 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.950 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.950 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.951 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.951 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.951 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.951 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.951 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:18.951 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:18.952 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.952 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.952 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.952 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:18.952 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.953 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.953 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.953 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.953 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.953 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.954 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.954 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.954 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.954 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.954 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.955 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.955 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.955 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.955 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.955 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:18.956 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:18.956 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.956 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.956 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.956 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.957 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.957 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.957 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.957 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.957 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.958 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.958 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.958 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.958 INFO:teuthology.orchestra.run.smithi008.stdout: "max_completed_events": { 2023-08-11T12:40:18.958 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_completed_events", 2023-08-11T12:40:18.959 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.959 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.959 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.959 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "50", 2023-08-11T12:40:18.959 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.960 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.960 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.960 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "number of past completed events to remember", 2023-08-11T12:40:18.960 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.960 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.961 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.961 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-08-11T12:40:18.961 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-08-11T12:40:18.961 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:18.962 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.962 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.962 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-08-11T12:40:18.962 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.962 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.962 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.963 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long the module is going to sleep", 2023-08-11T12:40:18.963 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.963 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.963 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.963 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.964 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:18.964 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.964 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:18.964 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prometheus", 2023-08-11T12:40:18.964 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:18.965 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:18.965 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:18.965 INFO:teuthology.orchestra.run.smithi008.stdout: "cache": { 2023-08-11T12:40:18.965 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cache", 2023-08-11T12:40:18.965 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.966 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.966 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.966 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.966 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.966 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.967 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.967 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.967 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.967 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.967 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.968 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.968 INFO:teuthology.orchestra.run.smithi008.stdout: "exclude_perf_counters": { 2023-08-11T12:40:18.968 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "exclude_perf_counters", 2023-08-11T12:40:18.968 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.968 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.969 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.969 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:18.969 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.969 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.969 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.970 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-08-11T12:40:18.970 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-08-11T12:40:18.970 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.970 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.970 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.971 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:18.971 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:18.971 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.971 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.971 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.972 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.972 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.972 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.972 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.972 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.973 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.973 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.973 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.973 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.973 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.974 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.974 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.974 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.974 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.974 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.975 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.975 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:18.975 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:18.975 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.975 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.976 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.976 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.976 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.976 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.977 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.977 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.977 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.977 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.977 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.978 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.978 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:18.978 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:18.978 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.978 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.979 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.979 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:18.979 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.979 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.979 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:18.980 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:18.980 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:18.980 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:18.980 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:18.980 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:18.981 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:18.981 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:18.981 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.981 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.981 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.982 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.982 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.982 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:18.982 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:18.982 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:18.983 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.983 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.983 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:18.983 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.983 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.984 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.984 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.984 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.984 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.985 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.985 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.985 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_stats_pools": { 2023-08-11T12:40:18.985 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_stats_pools", 2023-08-11T12:40:18.985 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.986 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.986 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.986 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:18.986 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.986 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.987 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.987 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.987 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.987 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.988 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.988 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.988 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_stats_pools_refresh_interval": { 2023-08-11T12:40:18.988 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-08-11T12:40:18.988 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.989 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.989 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.989 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "300", 2023-08-11T12:40:18.989 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.989 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.990 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.990 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.990 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.990 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.990 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.991 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.991 INFO:teuthology.orchestra.run.smithi008.stdout: "scrape_interval": { 2023-08-11T12:40:18.991 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "scrape_interval", 2023-08-11T12:40:18.991 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-08-11T12:40:18.992 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.992 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.992 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15.0", 2023-08-11T12:40:18.992 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.992 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.993 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.993 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:18.993 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.993 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.993 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.994 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.994 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2023-08-11T12:40:18.994 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2023-08-11T12:40:18.994 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:18.994 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.995 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:18.995 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "::", 2023-08-11T12:40:18.995 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.995 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.995 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.996 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-08-11T12:40:18.996 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.996 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.996 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.996 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.997 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2023-08-11T12:40:18.997 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2023-08-11T12:40:18.997 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:18.997 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:18.997 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:18.998 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "9283", 2023-08-11T12:40:18.998 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:18.998 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:18.998 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:18.998 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-08-11T12:40:18.999 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:18.999 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:18.999 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:18.999 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:18.999 INFO:teuthology.orchestra.run.smithi008.stdout: "stale_cache_strategy": { 2023-08-11T12:40:19.000 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "stale_cache_strategy", 2023-08-11T12:40:19.000 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.000 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.000 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.000 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "log", 2023-08-11T12:40:19.001 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.001 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.001 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.001 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.001 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.001 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.002 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.002 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.002 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_behaviour": { 2023-08-11T12:40:19.002 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_behaviour", 2023-08-11T12:40:19.002 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.003 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.003 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.003 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "default", 2023-08-11T12:40:19.003 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.004 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.004 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:19.004 INFO:teuthology.orchestra.run.smithi008.stdout: "default", 2023-08-11T12:40:19.004 INFO:teuthology.orchestra.run.smithi008.stdout: "error" 2023-08-11T12:40:19.004 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.005 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.005 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.005 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.005 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.005 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.006 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_error_status_code": { 2023-08-11T12:40:19.006 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_error_status_code", 2023-08-11T12:40:19.006 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:19.006 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.006 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.007 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "500", 2023-08-11T12:40:19.007 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "400", 2023-08-11T12:40:19.007 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "599", 2023-08-11T12:40:19.007 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.007 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.008 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.008 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.008 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.008 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.008 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.009 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.009 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:19.009 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_support", 2023-08-11T12:40:19.009 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:19.010 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:19.010 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:19.010 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:19.010 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:19.010 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.011 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.011 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.011 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.011 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.011 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.012 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:19.012 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:19.012 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:19.012 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:19.012 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:19.013 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:19.013 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:19.013 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.013 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.013 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.014 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.014 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.014 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.014 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:19.014 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:19.015 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.015 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.015 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.015 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.015 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.016 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.016 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.016 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.016 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.016 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.017 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.017 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.017 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:19.017 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:19.017 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.018 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.018 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.018 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:19.018 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.018 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.019 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:19.019 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:19.019 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:19.019 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:19.019 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:19.020 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:19.020 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:19.020 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.020 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.020 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.021 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.021 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.021 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.021 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:19.021 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:19.022 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.022 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.022 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.022 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.022 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.023 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.023 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.023 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.023 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.023 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.023 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.024 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.024 INFO:teuthology.orchestra.run.smithi008.stdout: "max_concurrent_snap_create": { 2023-08-11T12:40:19.024 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_concurrent_snap_create", 2023-08-11T12:40:19.024 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:19.024 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.025 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.025 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-08-11T12:40:19.025 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.025 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.025 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.026 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.026 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.026 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.026 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.026 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.027 INFO:teuthology.orchestra.run.smithi008.stdout: "mirror_snapshot_schedule": { 2023-08-11T12:40:19.027 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mirror_snapshot_schedule", 2023-08-11T12:40:19.027 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.027 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.027 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.028 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.028 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.028 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.028 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.028 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.029 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.029 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.029 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.029 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.029 INFO:teuthology.orchestra.run.smithi008.stdout: "trash_purge_schedule": { 2023-08-11T12:40:19.030 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "trash_purge_schedule", 2023-08-11T12:40:19.030 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.030 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.030 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.030 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.031 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.031 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.031 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.031 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.031 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.032 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.032 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.032 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.032 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.032 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.033 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:19.033 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "restful", 2023-08-11T12:40:19.033 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:19.033 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:19.033 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:19.034 INFO:teuthology.orchestra.run.smithi008.stdout: "enable_auth": { 2023-08-11T12:40:19.034 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enable_auth", 2023-08-11T12:40:19.034 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.034 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.034 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.035 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:19.035 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.035 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.035 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.035 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.035 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.036 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.036 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.036 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.036 INFO:teuthology.orchestra.run.smithi008.stdout: "key_file": { 2023-08-11T12:40:19.036 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "key_file", 2023-08-11T12:40:19.037 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.037 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.037 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.037 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.037 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.038 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.038 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.038 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.038 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.038 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.039 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.039 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.039 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:19.039 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:19.039 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.040 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.040 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.040 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.040 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.040 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.041 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:19.041 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:19.041 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:19.041 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:19.041 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:19.042 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:19.042 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:19.042 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.042 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.042 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.044 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.044 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.044 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.044 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.044 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.045 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.045 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.045 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.045 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.045 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.046 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.046 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:19.046 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:19.046 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.046 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.047 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.047 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:19.047 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.047 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.047 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:19.048 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:19.048 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:19.048 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:19.048 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:19.048 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:19.049 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:19.049 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.049 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.049 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.049 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.050 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.050 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.050 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:19.050 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:19.050 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.051 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.051 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.051 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.051 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.051 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.052 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.052 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.052 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.052 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.052 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.053 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.053 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2023-08-11T12:40:19.053 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2023-08-11T12:40:19.053 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.053 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.054 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.054 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.054 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.054 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.054 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.054 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.055 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.055 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.055 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.055 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.055 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2023-08-11T12:40:19.056 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2023-08-11T12:40:19.056 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.056 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.056 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.056 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.057 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.057 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.057 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.057 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.057 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.058 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.058 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.058 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.058 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.058 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.059 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:19.059 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rgw", 2023-08-11T12:40:19.059 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:19.059 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:19.059 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:19.060 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:19.060 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:19.060 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.060 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.061 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.061 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.061 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.061 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.061 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:19.062 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:19.062 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:19.062 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:19.062 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:19.062 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:19.063 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:19.063 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.063 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.063 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.063 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.064 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.064 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.064 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:19.064 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:19.064 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.065 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.065 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.065 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.065 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.065 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.066 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.066 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.066 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.066 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.067 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.067 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.067 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:19.067 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:19.067 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.068 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.068 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.068 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:19.068 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.069 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.069 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:19.069 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:19.069 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:19.069 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:19.070 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:19.070 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:19.070 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:19.070 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.070 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.071 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.071 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.071 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.071 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.071 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:19.071 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:19.072 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.072 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.072 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.072 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.073 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.073 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.073 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.073 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.073 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.074 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.074 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.074 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.074 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.074 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.074 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:19.075 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rook", 2023-08-11T12:40:19.075 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:19.075 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:19.075 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:19.075 INFO:teuthology.orchestra.run.smithi008.stdout: "drive_group_interval": { 2023-08-11T12:40:19.076 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "drive_group_interval", 2023-08-11T12:40:19.076 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-08-11T12:40:19.076 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.076 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.076 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "300.0", 2023-08-11T12:40:19.077 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.077 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.077 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.077 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-08-11T12:40:19.077 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.078 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.078 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.078 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.078 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:19.078 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:19.079 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.079 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.079 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.079 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.079 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.080 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.080 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:19.080 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:19.080 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:19.081 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:19.081 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:19.081 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:19.081 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:19.082 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.082 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.082 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.082 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.082 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.083 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.083 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:19.083 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:19.083 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.083 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.084 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.084 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.084 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.084 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.084 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.085 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.085 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.085 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.085 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.085 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.086 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:19.086 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:19.086 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.086 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.087 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.087 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:19.087 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.087 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.087 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:19.088 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:19.088 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:19.088 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:19.088 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:19.088 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:19.089 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:19.089 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.089 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.089 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.089 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.090 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.090 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.090 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:19.090 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:19.090 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.091 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.091 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.091 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.091 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.091 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.092 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.092 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.092 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.092 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.092 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: "storage_class": { 2023-08-11T12:40:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "storage_class", 2023-08-11T12:40:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.094 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.094 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.094 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "local", 2023-08-11T12:40:19.094 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.094 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-08-11T12:40:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.096 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.096 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.096 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.096 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:19.096 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "selftest", 2023-08-11T12:40:19.097 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:19.097 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:19.097 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:19.097 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:19.097 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:19.098 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.098 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.098 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.098 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.098 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.098 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.099 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:19.099 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:19.099 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:19.099 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:19.099 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:19.100 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:19.100 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:19.100 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.100 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.100 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.101 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.101 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.101 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.101 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:19.101 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:19.102 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.102 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.102 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.102 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.102 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.103 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.103 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.103 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.103 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.103 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.104 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.104 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.104 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:19.105 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:19.105 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.105 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.105 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.106 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:19.106 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.106 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.106 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:19.107 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:19.107 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:19.107 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:19.107 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:19.107 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:19.108 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:19.108 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.108 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.108 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.108 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.109 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.109 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.109 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:19.109 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:19.109 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.110 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.110 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.110 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.110 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.110 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.111 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.111 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.111 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.111 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.111 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.112 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.112 INFO:teuthology.orchestra.run.smithi008.stdout: "roption1": { 2023-08-11T12:40:19.112 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "roption1", 2023-08-11T12:40:19.112 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.112 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.113 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.113 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.113 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.113 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.113 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.114 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.114 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.114 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.114 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.114 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.115 INFO:teuthology.orchestra.run.smithi008.stdout: "roption2": { 2023-08-11T12:40:19.115 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "roption2", 2023-08-11T12:40:19.115 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.115 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.115 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.116 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "xyz", 2023-08-11T12:40:19.116 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.116 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.116 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.116 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption1": { 2023-08-11T12:40:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption1", 2023-08-11T12:40:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption2": { 2023-08-11T12:40:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption2", 2023-08-11T12:40:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.122 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.122 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.122 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.122 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.123 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.123 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.123 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.123 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.123 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption3": { 2023-08-11T12:40:19.124 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption3", 2023-08-11T12:40:19.124 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-08-11T12:40:19.124 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.124 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.124 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption4": { 2023-08-11T12:40:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption4", 2023-08-11T12:40:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.128 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.128 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.128 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.128 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.128 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.129 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.129 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.129 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption5": { 2023-08-11T12:40:19.129 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption5", 2023-08-11T12:40:19.130 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.130 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.130 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.130 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.130 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.131 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.131 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.131 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.131 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.131 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.132 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.132 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.132 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption6": { 2023-08-11T12:40:19.132 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption6", 2023-08-11T12:40:19.132 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.134 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.134 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.134 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.134 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.134 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.135 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.135 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption7": { 2023-08-11T12:40:19.135 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption7", 2023-08-11T12:40:19.135 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:19.135 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.136 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.136 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.136 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-08-11T12:40:19.136 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "42", 2023-08-11T12:40:19.136 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: "testkey": { 2023-08-11T12:40:19.138 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testkey", 2023-08-11T12:40:19.138 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.138 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.138 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.138 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.139 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.139 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.139 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.139 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.139 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.140 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.140 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.140 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.141 INFO:teuthology.orchestra.run.smithi008.stdout: "testlkey": { 2023-08-11T12:40:19.141 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testlkey", 2023-08-11T12:40:19.141 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.141 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.141 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.142 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.142 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.142 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.142 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.142 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.143 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.143 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.143 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.143 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.143 INFO:teuthology.orchestra.run.smithi008.stdout: "testnewline": { 2023-08-11T12:40:19.144 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testnewline", 2023-08-11T12:40:19.144 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.144 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.144 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.144 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.145 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.145 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.145 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.145 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.145 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.146 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.146 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.146 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.146 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.147 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.147 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:19.147 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snap_schedule", 2023-08-11T12:40:19.147 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:19.148 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:19.148 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:19.148 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_m_granularity": { 2023-08-11T12:40:19.148 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_m_granularity", 2023-08-11T12:40:19.148 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.150 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.150 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow minute scheduled snapshots", 2023-08-11T12:40:19.150 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.150 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.150 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.151 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.151 INFO:teuthology.orchestra.run.smithi008.stdout: "dump_on_update": { 2023-08-11T12:40:19.151 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "dump_on_update", 2023-08-11T12:40:19.151 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.151 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.153 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "dump database to debug log on update", 2023-08-11T12:40:19.153 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.153 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.153 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.153 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.154 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:19.154 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:19.154 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.154 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.154 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.155 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.155 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.155 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.155 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:19.155 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:19.156 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:19.156 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:19.156 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:19.156 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:19.157 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:19.157 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.157 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.157 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.157 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.158 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.158 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.158 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:19.158 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:19.158 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.161 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:19.161 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:19.161 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.161 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.162 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.162 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:19.162 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.162 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.162 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:19.163 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:19.163 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:19.163 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:19.163 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:19.163 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:19.164 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:19.164 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.164 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.164 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.164 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.165 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.165 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.165 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:19.165 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:19.165 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.166 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.166 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.166 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.166 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.167 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.167 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.168 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.168 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.168 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.168 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.169 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.169 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.169 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.169 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:19.169 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "stats", 2023-08-11T12:40:19.170 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:19.170 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:19.170 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:19.170 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:19.170 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.172 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.172 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:19.172 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:19.172 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:19.172 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.174 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.174 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.174 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.174 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.174 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.176 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.176 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.176 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.176 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.176 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:19.178 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.178 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.178 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.178 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:19.178 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.179 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.179 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:19.179 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:19.179 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:19.179 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:19.180 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:19.180 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:19.180 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:19.180 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.181 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.181 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.181 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.181 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.181 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.182 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:19.182 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:19.182 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.182 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.182 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.183 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.183 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.183 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.183 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.183 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.184 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.184 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.184 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.184 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.184 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.185 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.185 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:19.185 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "status", 2023-08-11T12:40:19.185 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:19.185 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:19.186 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:19.186 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:19.186 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:19.186 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.187 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.187 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.187 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.187 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.187 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.188 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:19.188 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:19.188 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:19.188 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:19.189 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:19.189 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:19.189 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:19.189 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.189 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.190 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.190 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.190 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.190 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.190 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:19.191 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:19.191 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.191 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.191 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.191 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.192 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.192 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.192 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.192 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.193 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.193 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.193 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.193 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.193 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:19.194 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:19.194 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.194 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.194 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.194 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:19.195 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.195 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.195 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:19.195 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:19.196 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:19.196 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:19.196 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:19.196 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:19.196 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:19.197 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.197 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.197 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.197 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.197 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.198 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.198 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:19.198 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:19.198 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.198 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.199 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.199 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.199 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.199 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.199 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.200 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.200 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.200 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.200 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.200 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.201 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.201 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.201 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:19.201 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "telegraf", 2023-08-11T12:40:19.201 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:19.202 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:19.202 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:19.202 INFO:teuthology.orchestra.run.smithi008.stdout: "address": { 2023-08-11T12:40:19.202 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "address", 2023-08-11T12:40:19.202 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.202 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.203 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.203 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-08-11T12:40:19.203 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.203 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.203 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.204 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.204 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.204 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.204 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.204 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.205 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-08-11T12:40:19.205 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-08-11T12:40:19.205 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:19.205 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.205 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.206 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15", 2023-08-11T12:40:19.206 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.206 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.206 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.206 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.207 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.207 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.207 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.207 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.207 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:19.208 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:19.208 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.208 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.208 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.208 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.209 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.209 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.209 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:19.209 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:19.209 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:19.210 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:19.210 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:19.210 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:19.210 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:19.210 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.211 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.211 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.211 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.211 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.211 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.212 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:19.212 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:19.212 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.212 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.213 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.213 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.213 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.213 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.213 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.214 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.214 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.214 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.214 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.214 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.215 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:19.215 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:19.215 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.215 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.215 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.216 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:19.216 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.216 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.216 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:19.216 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:19.217 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:19.217 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:19.217 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:19.217 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:19.217 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:19.218 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.218 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.218 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.218 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.218 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.219 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.219 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:19.219 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:19.219 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.219 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.220 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.220 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.220 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.220 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.220 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.221 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.221 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.221 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.221 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.221 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.222 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.222 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.222 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:19.222 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "telemetry", 2023-08-11T12:40:19.222 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:19.223 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:19.223 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:19.223 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_basic": { 2023-08-11T12:40:19.223 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_basic", 2023-08-11T12:40:19.223 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.224 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.224 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.224 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:19.224 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.224 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.225 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.225 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share basic cluster information (size, version)", 2023-08-11T12:40:19.225 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.225 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.225 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.226 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.226 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_crash": { 2023-08-11T12:40:19.226 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_crash", 2023-08-11T12:40:19.226 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.226 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.226 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.227 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:19.227 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.227 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.227 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.228 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-08-11T12:40:19.228 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.228 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.228 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.228 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.229 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_device": { 2023-08-11T12:40:19.229 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_device", 2023-08-11T12:40:19.229 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.229 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.230 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.230 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-08-11T12:40:19.230 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.230 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.230 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.231 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-08-11T12:40:19.231 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.231 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.231 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.231 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.232 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_ident": { 2023-08-11T12:40:19.232 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_ident", 2023-08-11T12:40:19.232 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.233 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.233 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.233 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.233 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.233 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.234 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.234 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-08-11T12:40:19.234 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.234 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.234 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.235 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.235 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_perf": { 2023-08-11T12:40:19.235 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_perf", 2023-08-11T12:40:19.235 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.236 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.236 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.236 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.236 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.236 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.237 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.237 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share various performance metrics of a cluster", 2023-08-11T12:40:19.237 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.237 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.237 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.238 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.238 INFO:teuthology.orchestra.run.smithi008.stdout: "contact": { 2023-08-11T12:40:19.238 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "contact", 2023-08-11T12:40:19.238 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.238 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.239 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.239 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.239 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.239 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.239 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.240 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.240 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.240 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.240 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.241 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.241 INFO:teuthology.orchestra.run.smithi008.stdout: "description": { 2023-08-11T12:40:19.241 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "description", 2023-08-11T12:40:19.241 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.241 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.242 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.242 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.242 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.242 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.242 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.243 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.243 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.243 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.243 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.243 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.244 INFO:teuthology.orchestra.run.smithi008.stdout: "device_url": { 2023-08-11T12:40:19.244 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_url", 2023-08-11T12:40:19.244 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.244 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.244 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.245 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-08-11T12:40:19.245 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.245 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.245 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.245 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.246 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.246 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.246 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.246 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.246 INFO:teuthology.orchestra.run.smithi008.stdout: "enabled": { 2023-08-11T12:40:19.247 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enabled", 2023-08-11T12:40:19.247 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.247 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.247 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.247 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.248 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.248 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.248 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.248 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.248 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.249 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.249 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.249 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.249 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-08-11T12:40:19.249 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-08-11T12:40:19.250 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:19.250 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.250 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.250 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "24", 2023-08-11T12:40:19.250 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "8", 2023-08-11T12:40:19.251 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.251 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.251 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.251 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.251 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.251 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.252 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.252 INFO:teuthology.orchestra.run.smithi008.stdout: "last_opt_revision": { 2023-08-11T12:40:19.252 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "last_opt_revision", 2023-08-11T12:40:19.252 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:19.253 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.253 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.253 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1", 2023-08-11T12:40:19.253 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.253 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.253 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.254 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.254 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.254 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.254 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.254 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.255 INFO:teuthology.orchestra.run.smithi008.stdout: "leaderboard": { 2023-08-11T12:40:19.255 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "leaderboard", 2023-08-11T12:40:19.255 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.255 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.255 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.256 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.256 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.256 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.256 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.256 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.257 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.257 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.257 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.257 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.257 INFO:teuthology.orchestra.run.smithi008.stdout: "leaderboard_description": { 2023-08-11T12:40:19.258 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "leaderboard_description", 2023-08-11T12:40:19.258 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.258 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.258 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.258 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.259 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.259 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.259 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.259 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.259 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.260 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.260 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.260 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.260 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:19.261 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:19.261 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.261 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.261 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.261 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.262 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.262 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.262 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:19.262 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:19.262 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:19.263 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:19.263 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:19.263 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:19.263 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:19.263 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.264 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.264 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.264 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.264 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.264 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.265 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:19.265 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:19.265 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.266 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.266 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.266 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.266 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.266 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.267 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.267 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.267 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.267 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.267 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.268 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.268 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:19.268 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:19.268 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.268 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.269 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.269 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:19.269 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.269 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.269 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:19.270 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:19.270 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:19.270 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:19.270 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:19.270 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:19.271 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:19.271 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.271 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.271 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.271 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.272 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.272 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.272 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:19.272 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:19.272 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.273 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.273 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.273 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.273 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.274 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.274 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.274 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.274 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.274 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.275 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.275 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.275 INFO:teuthology.orchestra.run.smithi008.stdout: "organization": { 2023-08-11T12:40:19.275 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "organization", 2023-08-11T12:40:19.275 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.276 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.276 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.276 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.276 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.276 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.277 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.277 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.277 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.277 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.277 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.278 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.278 INFO:teuthology.orchestra.run.smithi008.stdout: "proxy": { 2023-08-11T12:40:19.278 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "proxy", 2023-08-11T12:40:19.278 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.279 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.279 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.279 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.279 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.280 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.280 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.280 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.280 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.280 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.281 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.281 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.281 INFO:teuthology.orchestra.run.smithi008.stdout: "url": { 2023-08-11T12:40:19.281 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "url", 2023-08-11T12:40:19.282 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.282 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.282 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.282 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-08-11T12:40:19.282 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.283 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.283 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.283 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.283 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.283 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.284 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.284 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.284 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.284 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.284 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:19.285 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "test_orchestrator", 2023-08-11T12:40:19.285 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:19.285 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:19.285 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:19.286 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:19.286 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:19.286 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.286 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.286 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.287 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.287 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.287 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.287 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:19.287 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:19.288 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:19.288 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:19.288 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:19.288 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:19.288 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:19.289 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.289 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.289 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.289 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.289 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.290 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.290 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:19.290 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:19.290 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.290 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.291 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.291 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.291 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.291 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.291 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.292 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.292 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.292 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.292 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.293 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.293 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:19.293 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:19.293 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.293 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.294 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.294 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:19.294 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.294 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.295 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:19.295 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:19.295 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:19.295 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:19.295 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:19.296 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:19.296 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:19.296 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.296 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.296 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.297 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.297 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.297 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.297 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:19.297 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:19.298 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.298 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.298 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.298 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.298 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.299 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.299 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.299 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.299 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.299 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.300 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.300 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.300 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.300 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.300 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:19.301 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "volumes", 2023-08-11T12:40:19.301 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:19.301 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:19.301 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:19.301 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:19.302 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:19.302 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.302 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.302 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.302 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.303 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.303 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.303 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:19.303 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:19.303 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:19.304 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:19.304 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:19.304 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:19.304 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:19.304 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.305 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.305 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.305 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.305 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.305 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.306 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:19.306 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:19.306 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.306 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.306 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.306 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.307 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.307 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.307 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.307 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.307 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.308 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.308 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.308 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.308 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:19.308 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:19.309 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.309 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.309 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.309 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:19.309 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.310 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.310 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:19.310 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:19.310 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:19.310 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:19.311 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:19.311 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:19.311 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:19.311 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.311 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.312 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.312 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.312 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.312 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.312 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:19.313 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:19.313 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.313 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.313 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.313 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.314 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.314 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.314 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.314 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.314 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.315 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.315 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.315 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.315 INFO:teuthology.orchestra.run.smithi008.stdout: "max_concurrent_clones": { 2023-08-11T12:40:19.315 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_concurrent_clones", 2023-08-11T12:40:19.316 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:19.316 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.316 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.316 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "4", 2023-08-11T12:40:19.316 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.317 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.317 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.317 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Number of asynchronous cloner threads", 2023-08-11T12:40:19.317 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.317 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.318 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.318 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.318 INFO:teuthology.orchestra.run.smithi008.stdout: "snapshot_clone_delay": { 2023-08-11T12:40:19.318 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snapshot_clone_delay", 2023-08-11T12:40:19.318 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:19.319 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.319 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.319 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-08-11T12:40:19.319 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.319 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.320 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.320 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-08-11T12:40:19.320 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.320 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.320 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.321 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.321 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.321 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.321 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:19.321 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix", 2023-08-11T12:40:19.322 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-08-11T12:40:19.322 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-08-11T12:40:19.322 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-08-11T12:40:19.322 INFO:teuthology.orchestra.run.smithi008.stdout: "discovery_interval": { 2023-08-11T12:40:19.322 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "discovery_interval", 2023-08-11T12:40:19.323 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-08-11T12:40:19.323 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.323 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.323 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "100", 2023-08-11T12:40:19.323 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.324 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.324 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.324 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.324 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.325 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.325 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.325 INFO:teuthology.orchestra.run.smithi008.stdout: "identifier": { 2023-08-11T12:40:19.326 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "identifier", 2023-08-11T12:40:19.326 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.326 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.326 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.326 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.327 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.327 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.327 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.327 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.327 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.328 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.328 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.328 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-08-11T12:40:19.328 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-08-11T12:40:19.329 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-08-11T12:40:19.329 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.329 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.329 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-08-11T12:40:19.329 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.330 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.330 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.330 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.330 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.330 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.331 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.331 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-08-11T12:40:19.331 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-08-11T12:40:19.331 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.331 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.332 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.332 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.332 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.332 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.332 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:19.333 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:19.333 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:19.333 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:19.333 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:19.333 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:19.334 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:19.334 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.334 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.334 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.334 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.335 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.335 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-08-11T12:40:19.335 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-08-11T12:40:19.335 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.336 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.336 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.336 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.336 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.336 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.337 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.337 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.337 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.337 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.337 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.338 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-08-11T12:40:19.338 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-08-11T12:40:19.338 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.338 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.339 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.339 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-08-11T12:40:19.339 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.339 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.339 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-08-11T12:40:19.340 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-08-11T12:40:19.340 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-08-11T12:40:19.340 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-08-11T12:40:19.340 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-08-11T12:40:19.341 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-08-11T12:40:19.341 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-08-11T12:40:19.341 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.341 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.342 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.342 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.342 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.342 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-08-11T12:40:19.343 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-08-11T12:40:19.343 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-08-11T12:40:19.343 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.343 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-08-11T12:40:19.343 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-08-11T12:40:19.344 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.344 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.344 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.344 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.344 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.345 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.345 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.345 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_host": { 2023-08-11T12:40:19.345 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_host", 2023-08-11T12:40:19.346 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.346 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.346 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.346 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-08-11T12:40:19.348 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.348 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.348 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.349 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.349 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.349 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.349 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.350 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_port": { 2023-08-11T12:40:19.350 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_port", 2023-08-11T12:40:19.350 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-08-11T12:40:19.350 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.350 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.351 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10051", 2023-08-11T12:40:19.351 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.351 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.351 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.351 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.352 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.352 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.352 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.352 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_sender": { 2023-08-11T12:40:19.353 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_sender", 2023-08-11T12:40:19.353 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-08-11T12:40:19.353 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-08-11T12:40:19.353 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-08-11T12:40:19.353 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-08-11T12:40:19.353 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-08-11T12:40:19.354 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-08-11T12:40:19.354 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-08-11T12:40:19.354 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-08-11T12:40:19.354 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-08-11T12:40:19.354 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-08-11T12:40:19.355 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-08-11T12:40:19.355 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.355 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.355 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.355 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.356 INFO:teuthology.orchestra.run.smithi008.stdout: "services": { 2023-08-11T12:40:19.356 INFO:teuthology.orchestra.run.smithi008.stdout: "dashboard": "https://172.21.15.8:8443/" 2023-08-11T12:40:19.356 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.356 INFO:teuthology.orchestra.run.smithi008.stdout: "always_on_modules": { 2023-08-11T12:40:19.356 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus": [ 2023-08-11T12:40:19.357 INFO:teuthology.orchestra.run.smithi008.stdout: "balancer", 2023-08-11T12:40:19.357 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-08-11T12:40:19.357 INFO:teuthology.orchestra.run.smithi008.stdout: "devicehealth", 2023-08-11T12:40:19.357 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator", 2023-08-11T12:40:19.357 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_autoscaler", 2023-08-11T12:40:19.358 INFO:teuthology.orchestra.run.smithi008.stdout: "progress", 2023-08-11T12:40:19.358 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_support", 2023-08-11T12:40:19.358 INFO:teuthology.orchestra.run.smithi008.stdout: "status", 2023-08-11T12:40:19.358 INFO:teuthology.orchestra.run.smithi008.stdout: "telemetry", 2023-08-11T12:40:19.358 INFO:teuthology.orchestra.run.smithi008.stdout: "volumes" 2023-08-11T12:40:19.359 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.359 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific": [ 2023-08-11T12:40:19.359 INFO:teuthology.orchestra.run.smithi008.stdout: "balancer", 2023-08-11T12:40:19.359 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-08-11T12:40:19.359 INFO:teuthology.orchestra.run.smithi008.stdout: "devicehealth", 2023-08-11T12:40:19.360 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator", 2023-08-11T12:40:19.360 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_autoscaler", 2023-08-11T12:40:19.360 INFO:teuthology.orchestra.run.smithi008.stdout: "progress", 2023-08-11T12:40:19.360 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_support", 2023-08-11T12:40:19.360 INFO:teuthology.orchestra.run.smithi008.stdout: "status", 2023-08-11T12:40:19.361 INFO:teuthology.orchestra.run.smithi008.stdout: "telemetry", 2023-08-11T12:40:19.361 INFO:teuthology.orchestra.run.smithi008.stdout: "volumes" 2023-08-11T12:40:19.361 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.362 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy": [ 2023-08-11T12:40:19.362 INFO:teuthology.orchestra.run.smithi008.stdout: "balancer", 2023-08-11T12:40:19.362 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-08-11T12:40:19.362 INFO:teuthology.orchestra.run.smithi008.stdout: "devicehealth", 2023-08-11T12:40:19.362 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator", 2023-08-11T12:40:19.363 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_autoscaler", 2023-08-11T12:40:19.363 INFO:teuthology.orchestra.run.smithi008.stdout: "progress", 2023-08-11T12:40:19.363 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_support", 2023-08-11T12:40:19.363 INFO:teuthology.orchestra.run.smithi008.stdout: "status", 2023-08-11T12:40:19.363 INFO:teuthology.orchestra.run.smithi008.stdout: "telemetry", 2023-08-11T12:40:19.364 INFO:teuthology.orchestra.run.smithi008.stdout: "volumes" 2023-08-11T12:40:19.364 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-11T12:40:19.364 INFO:teuthology.orchestra.run.smithi008.stdout: "reef": [ 2023-08-11T12:40:19.364 INFO:teuthology.orchestra.run.smithi008.stdout: "balancer", 2023-08-11T12:40:19.365 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-08-11T12:40:19.365 INFO:teuthology.orchestra.run.smithi008.stdout: "devicehealth", 2023-08-11T12:40:19.365 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator", 2023-08-11T12:40:19.365 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_autoscaler", 2023-08-11T12:40:19.365 INFO:teuthology.orchestra.run.smithi008.stdout: "progress", 2023-08-11T12:40:19.366 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_support", 2023-08-11T12:40:19.366 INFO:teuthology.orchestra.run.smithi008.stdout: "status", 2023-08-11T12:40:19.366 INFO:teuthology.orchestra.run.smithi008.stdout: "telemetry", 2023-08-11T12:40:19.366 INFO:teuthology.orchestra.run.smithi008.stdout: "volumes" 2023-08-11T12:40:19.366 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-11T12:40:19.367 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.367 INFO:teuthology.orchestra.run.smithi008.stdout: "last_failure_osd_epoch": 90, 2023-08-11T12:40:19.367 INFO:teuthology.orchestra.run.smithi008.stdout: "active_clients": [ 2023-08-11T12:40:19.367 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:19.367 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "devicehealth", 2023-08-11T12:40:19.368 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2023-08-11T12:40:19.368 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:19.368 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2023-08-11T12:40:19.368 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:0", 2023-08-11T12:40:19.368 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 1500293049 2023-08-11T12:40:19.369 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.369 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-11T12:40:19.369 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.369 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:19.369 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "libcephsqlite", 2023-08-11T12:40:19.370 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2023-08-11T12:40:19.370 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:19.370 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2023-08-11T12:40:19.370 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:0", 2023-08-11T12:40:19.370 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 3138926615 2023-08-11T12:40:19.370 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.371 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-11T12:40:19.371 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.371 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:19.371 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_support", 2023-08-11T12:40:19.371 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2023-08-11T12:40:19.372 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:19.372 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2023-08-11T12:40:19.372 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:0", 2023-08-11T12:40:19.372 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 333795984 2023-08-11T12:40:19.373 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.373 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-11T12:40:19.373 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.373 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:19.373 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snap_schedule", 2023-08-11T12:40:19.374 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2023-08-11T12:40:19.374 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:19.374 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2023-08-11T12:40:19.374 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:0", 2023-08-11T12:40:19.374 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 1798013070 2023-08-11T12:40:19.375 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.375 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-11T12:40:19.375 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.375 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:19.375 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snap_schedule", 2023-08-11T12:40:19.376 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2023-08-11T12:40:19.376 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:19.376 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2023-08-11T12:40:19.376 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:0", 2023-08-11T12:40:19.376 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 3147875142 2023-08-11T12:40:19.377 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.377 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-11T12:40:19.377 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:19.377 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:19.377 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "volumes", 2023-08-11T12:40:19.378 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2023-08-11T12:40:19.378 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-11T12:40:19.378 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2023-08-11T12:40:19.378 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:0", 2023-08-11T12:40:19.378 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 1075280790 2023-08-11T12:40:19.379 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.379 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-11T12:40:19.379 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:19.379 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-11T12:40:19.379 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:40:19.381 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:16 smithi045 ceph-mon[130284]: pgmap v491: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:40:19.381 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:16 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/140529172' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:40:19.381 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:16 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/243879608' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-08-11T12:40:19.382 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:18 smithi045 ceph-mon[130284]: pgmap v493: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-08-11T12:40:19.382 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:16 smithi194 ceph-mon[130905]: pgmap v491: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:40:19.382 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:16 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/140529172' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:40:19.382 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:16 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/243879608' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-08-11T12:40:19.382 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:18 smithi194 ceph-mon[130905]: pgmap v493: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-08-11T12:40:19.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.752+0000 7f15b39ff700 1 -- 172.21.15.8:0/243879608 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f15980a00c0 msgr2=0x7f15980a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:19.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.752+0000 7f15b39ff700 1 --2- 172.21.15.8:0/243879608 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f15980a00c0 0x7f15980a2580 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f15a80116b0 tx=0x7f15a8009260 comp rx=0 tx=0).stop 2023-08-11T12:40:19.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.752+0000 7f15b39ff700 1 -- 172.21.15.8:0/243879608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15ac101300 msgr2=0x7f15ac19ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:19.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.752+0000 7f15b39ff700 1 --2- 172.21.15.8:0/243879608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15ac101300 0x7f15ac19ee40 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f159c00e9f0 tx=0x7f159c00ed00 comp rx=0 tx=0).stop 2023-08-11T12:40:19.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.753+0000 7f15b39ff700 1 -- 172.21.15.8:0/243879608 shutdown_connections 2023-08-11T12:40:19.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.753+0000 7f15b39ff700 1 --2- 172.21.15.8:0/243879608 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f15980a00c0 0x7f15980a2580 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:19.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.753+0000 7f15b39ff700 1 --2- 172.21.15.8:0/243879608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15ac106950 0x7f15ac198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:19.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.753+0000 7f15b39ff700 1 --2- 172.21.15.8:0/243879608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15ac100940 0x7f15ac19e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:19.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.753+0000 7f15b39ff700 1 --2- 172.21.15.8:0/243879608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15ac101300 0x7f15ac19ee40 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:19.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.753+0000 7f15b39ff700 1 -- 172.21.15.8:0/243879608 >> 172.21.15.8:0/243879608 conn(0x7f15ac0fc430 msgr2=0x7f15ac10be50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:19.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.753+0000 7f15b39ff700 1 -- 172.21.15.8:0/243879608 shutdown_connections 2023-08-11T12:40:19.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:15.753+0000 7f15b39ff700 1 -- 172.21.15.8:0/243879608 wait complete. 2023-08-11T12:40:19.395 DEBUG:tasks.check_counter:Getting stats from a 2023-08-11T12:40:19.395 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph daemon mds.a perf dump 2023-08-11T12:40:19.397 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:16 smithi008 ceph-mon[97158]: pgmap v491: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:40:19.397 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:16 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/140529172' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:40:19.397 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:16 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/243879608' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-08-11T12:40:19.397 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:18 smithi008 ceph-mon[97158]: pgmap v493: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-08-11T12:40:20.136 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:40:20.302 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:20 smithi008 ceph-mon[97158]: pgmap v494: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:40:20.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:20 smithi194 ceph-mon[130905]: pgmap v494: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:40:20.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:20 smithi045 ceph-mon[130284]: pgmap v494: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:40:21.857 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:40:21.858 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-0": { 2023-08-11T12:40:21.858 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 2206, 2023-08-11T12:40:21.858 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 2208, 2023-08-11T12:40:21.859 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 3553282, 2023-08-11T12:40:21.859 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 686067, 2023-08-11T12:40:21.859 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 6, 2023-08-11T12:40:21.859 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 2, 2023-08-11T12:40:21.859 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.276491303, 2023-08-11T12:40:21.860 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.094683288, 2023-08-11T12:40:21.860 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.075692553, 2023-08-11T12:40:21.860 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.073873678, 2023-08-11T12:40:21.860 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:21.860 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 2206, 2023-08-11T12:40:21.861 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.115914890, 2023-08-11T12:40:21.861 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000052545 2023-08-11T12:40:21.861 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.861 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:21.861 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.862 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.862 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.862 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.862 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 0, 2023-08-11T12:40:21.862 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 0 2023-08-11T12:40:21.863 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.863 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-1": { 2023-08-11T12:40:21.863 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 1306, 2023-08-11T12:40:21.863 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 1269, 2023-08-11T12:40:21.863 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 1882910, 2023-08-11T12:40:21.864 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 476985, 2023-08-11T12:40:21.864 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 5, 2023-08-11T12:40:21.864 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 3, 2023-08-11T12:40:21.864 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.194821946, 2023-08-11T12:40:21.865 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.064737744, 2023-08-11T12:40:21.865 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.073519270, 2023-08-11T12:40:21.865 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.052015770, 2023-08-11T12:40:21.865 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:21.865 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 1268, 2023-08-11T12:40:21.866 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.074752368, 2023-08-11T12:40:21.866 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000058952 2023-08-11T12:40:21.866 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.866 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:21.866 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.867 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.867 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.867 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 1649296, 2023-08-11T12:40:21.867 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 182400 2023-08-11T12:40:21.868 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.868 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-2": { 2023-08-11T12:40:21.868 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 8, 2023-08-11T12:40:21.868 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 230, 2023-08-11T12:40:21.868 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 3740, 2023-08-11T12:40:21.869 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 630247, 2023-08-11T12:40:21.869 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 8, 2023-08-11T12:40:21.869 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 4, 2023-08-11T12:40:21.869 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.026181902, 2023-08-11T12:40:21.869 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.016815567, 2023-08-11T12:40:21.870 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.004901416, 2023-08-11T12:40:21.870 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.000028645, 2023-08-11T12:40:21.870 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:21.870 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 228, 2023-08-11T12:40:21.870 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.022054468, 2023-08-11T12:40:21.871 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000096730 2023-08-11T12:40:21.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.871 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:21.871 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.871 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.872 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.872 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.872 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 3472, 2023-08-11T12:40:21.872 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 629936 2023-08-11T12:40:21.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.873 INFO:teuthology.orchestra.run.smithi008.stdout: "cct": { 2023-08-11T12:40:21.873 INFO:teuthology.orchestra.run.smithi008.stdout: "total_workers": 1, 2023-08-11T12:40:21.873 INFO:teuthology.orchestra.run.smithi008.stdout: "unhealthy_workers": 0 2023-08-11T12:40:21.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.874 INFO:teuthology.orchestra.run.smithi008.stdout: "finisher-MDSRank": { 2023-08-11T12:40:21.874 INFO:teuthology.orchestra.run.smithi008.stdout: "queue_len": 0, 2023-08-11T12:40:21.874 INFO:teuthology.orchestra.run.smithi008.stdout: "complete_latency": { 2023-08-11T12:40:21.874 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 4998, 2023-08-11T12:40:21.875 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.164830833, 2023-08-11T12:40:21.875 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000032979 2023-08-11T12:40:21.875 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:21.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.875 INFO:teuthology.orchestra.run.smithi008.stdout: "finisher-PurgeQueue": { 2023-08-11T12:40:21.875 INFO:teuthology.orchestra.run.smithi008.stdout: "queue_len": 0, 2023-08-11T12:40:21.876 INFO:teuthology.orchestra.run.smithi008.stdout: "complete_latency": { 2023-08-11T12:40:21.876 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.876 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.876 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.876 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:21.877 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.877 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-08-11T12:40:21.877 INFO:teuthology.orchestra.run.smithi008.stdout: "request": 0, 2023-08-11T12:40:21.877 INFO:teuthology.orchestra.run.smithi008.stdout: "reply": 0, 2023-08-11T12:40:21.877 INFO:teuthology.orchestra.run.smithi008.stdout: "reply_latency": { 2023-08-11T12:40:21.878 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.878 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.878 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.878 INFO:teuthology.orchestra.run.smithi008.stdout: "slow_reply": 0, 2023-08-11T12:40:21.879 INFO:teuthology.orchestra.run.smithi008.stdout: "forward": 0, 2023-08-11T12:40:21.879 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_fetch_complete": 0, 2023-08-11T12:40:21.879 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_fetch_keys": 0, 2023-08-11T12:40:21.879 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_commit": 0, 2023-08-11T12:40:21.879 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_split": 0, 2023-08-11T12:40:21.880 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_merge": 0, 2023-08-11T12:40:21.880 INFO:teuthology.orchestra.run.smithi008.stdout: "inodes": 658, 2023-08-11T12:40:21.880 INFO:teuthology.orchestra.run.smithi008.stdout: "inodes_top": 0, 2023-08-11T12:40:21.880 INFO:teuthology.orchestra.run.smithi008.stdout: "inodes_bottom": 0, 2023-08-11T12:40:21.880 INFO:teuthology.orchestra.run.smithi008.stdout: "inodes_pin_tail": 658, 2023-08-11T12:40:21.881 INFO:teuthology.orchestra.run.smithi008.stdout: "inodes_pinned": 658, 2023-08-11T12:40:21.881 INFO:teuthology.orchestra.run.smithi008.stdout: "inodes_expired": 10, 2023-08-11T12:40:21.881 INFO:teuthology.orchestra.run.smithi008.stdout: "inodes_with_caps": 0, 2023-08-11T12:40:21.881 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": 0, 2023-08-11T12:40:21.881 INFO:teuthology.orchestra.run.smithi008.stdout: "subtrees": 44, 2023-08-11T12:40:21.881 INFO:teuthology.orchestra.run.smithi008.stdout: "traverse": 0, 2023-08-11T12:40:21.882 INFO:teuthology.orchestra.run.smithi008.stdout: "traverse_hit": 0, 2023-08-11T12:40:21.882 INFO:teuthology.orchestra.run.smithi008.stdout: "traverse_forward": 0, 2023-08-11T12:40:21.882 INFO:teuthology.orchestra.run.smithi008.stdout: "traverse_discover": 0, 2023-08-11T12:40:21.882 INFO:teuthology.orchestra.run.smithi008.stdout: "traverse_dir_fetch": 0, 2023-08-11T12:40:21.882 INFO:teuthology.orchestra.run.smithi008.stdout: "traverse_remote_ino": 0, 2023-08-11T12:40:21.883 INFO:teuthology.orchestra.run.smithi008.stdout: "traverse_lock": 0, 2023-08-11T12:40:21.883 INFO:teuthology.orchestra.run.smithi008.stdout: "load_cent": 0, 2023-08-11T12:40:21.883 INFO:teuthology.orchestra.run.smithi008.stdout: "q": 0, 2023-08-11T12:40:21.883 INFO:teuthology.orchestra.run.smithi008.stdout: "exported": 0, 2023-08-11T12:40:21.883 INFO:teuthology.orchestra.run.smithi008.stdout: "exported_inodes": 0, 2023-08-11T12:40:21.884 INFO:teuthology.orchestra.run.smithi008.stdout: "imported": 0, 2023-08-11T12:40:21.884 INFO:teuthology.orchestra.run.smithi008.stdout: "imported_inodes": 0, 2023-08-11T12:40:21.884 INFO:teuthology.orchestra.run.smithi008.stdout: "openino_dir_fetch": 0, 2023-08-11T12:40:21.884 INFO:teuthology.orchestra.run.smithi008.stdout: "openino_backtrace_fetch": 0, 2023-08-11T12:40:21.885 INFO:teuthology.orchestra.run.smithi008.stdout: "openino_peer_discover": 0, 2023-08-11T12:40:21.885 INFO:teuthology.orchestra.run.smithi008.stdout: "root_rfiles": 0, 2023-08-11T12:40:21.885 INFO:teuthology.orchestra.run.smithi008.stdout: "root_rbytes": 0, 2023-08-11T12:40:21.885 INFO:teuthology.orchestra.run.smithi008.stdout: "root_rsnaps": 0, 2023-08-11T12:40:21.886 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_backtrace_fetch": 0, 2023-08-11T12:40:21.886 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_set_tag": 0, 2023-08-11T12:40:21.886 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_backtrace_repaired": 0, 2023-08-11T12:40:21.886 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_inotable_repaired": 0, 2023-08-11T12:40:21.886 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_dir_inodes": 0, 2023-08-11T12:40:21.887 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_dir_base_inodes": 0, 2023-08-11T12:40:21.887 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_dirfrag_rstats": 0, 2023-08-11T12:40:21.887 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_file_inodes": 0, 2023-08-11T12:40:21.888 INFO:teuthology.orchestra.run.smithi008.stdout: "handle_inode_file_caps": 0, 2023-08-11T12:40:21.888 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_cap_op_revoke": 0, 2023-08-11T12:40:21.889 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_cap_op_grant": 0, 2023-08-11T12:40:21.889 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_cap_op_trunc": 0, 2023-08-11T12:40:21.889 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-11T12:40:21.890 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-11T12:40:21.890 INFO:teuthology.orchestra.run.smithi008.stdout: "handle_client_caps": 0, 2023-08-11T12:40:21.891 INFO:teuthology.orchestra.run.smithi008.stdout: "handle_client_caps_dirty": 0, 2023-08-11T12:40:21.891 INFO:teuthology.orchestra.run.smithi008.stdout: "handle_client_cap_release": 0, 2023-08-11T12:40:21.892 INFO:teuthology.orchestra.run.smithi008.stdout: "process_request_cap_release": 0 2023-08-11T12:40:21.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.893 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_cache": { 2023-08-11T12:40:21.893 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_update": 0, 2023-08-11T12:40:21.893 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_update_receipt": 0, 2023-08-11T12:40:21.894 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_try_discover": 0, 2023-08-11T12:40:21.894 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_send_discover": 0, 2023-08-11T12:40:21.895 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_handle_discover": 0, 2023-08-11T12:40:21.895 INFO:teuthology.orchestra.run.smithi008.stdout: "num_strays": 0, 2023-08-11T12:40:21.896 INFO:teuthology.orchestra.run.smithi008.stdout: "num_strays_delayed": 0, 2023-08-11T12:40:21.896 INFO:teuthology.orchestra.run.smithi008.stdout: "num_strays_enqueuing": 0, 2023-08-11T12:40:21.896 INFO:teuthology.orchestra.run.smithi008.stdout: "strays_created": 0, 2023-08-11T12:40:21.897 INFO:teuthology.orchestra.run.smithi008.stdout: "strays_enqueued": 0, 2023-08-11T12:40:21.897 INFO:teuthology.orchestra.run.smithi008.stdout: "strays_reintegrated": 0, 2023-08-11T12:40:21.897 INFO:teuthology.orchestra.run.smithi008.stdout: "strays_migrated": 0, 2023-08-11T12:40:21.898 INFO:teuthology.orchestra.run.smithi008.stdout: "num_recovering_processing": 0, 2023-08-11T12:40:21.898 INFO:teuthology.orchestra.run.smithi008.stdout: "num_recovering_enqueued": 0, 2023-08-11T12:40:21.899 INFO:teuthology.orchestra.run.smithi008.stdout: "num_recovering_prioritized": 0, 2023-08-11T12:40:21.899 INFO:teuthology.orchestra.run.smithi008.stdout: "recovery_started": 0, 2023-08-11T12:40:21.899 INFO:teuthology.orchestra.run.smithi008.stdout: "recovery_completed": 0, 2023-08-11T12:40:21.900 INFO:teuthology.orchestra.run.smithi008.stdout: "ireq_enqueue_scrub": 0, 2023-08-11T12:40:21.900 INFO:teuthology.orchestra.run.smithi008.stdout: "ireq_exportdir": 0, 2023-08-11T12:40:21.900 INFO:teuthology.orchestra.run.smithi008.stdout: "ireq_flush": 0, 2023-08-11T12:40:21.900 INFO:teuthology.orchestra.run.smithi008.stdout: "ireq_fragmentdir": 0, 2023-08-11T12:40:21.901 INFO:teuthology.orchestra.run.smithi008.stdout: "ireq_fragstats": 0, 2023-08-11T12:40:21.901 INFO:teuthology.orchestra.run.smithi008.stdout: "ireq_inodestats": 0 2023-08-11T12:40:21.901 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.901 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_log": { 2023-08-11T12:40:21.901 INFO:teuthology.orchestra.run.smithi008.stdout: "evlrg": 0, 2023-08-11T12:40:21.902 INFO:teuthology.orchestra.run.smithi008.stdout: "evadd": 0, 2023-08-11T12:40:21.902 INFO:teuthology.orchestra.run.smithi008.stdout: "evex": 0, 2023-08-11T12:40:21.902 INFO:teuthology.orchestra.run.smithi008.stdout: "evtrm": 0, 2023-08-11T12:40:21.902 INFO:teuthology.orchestra.run.smithi008.stdout: "ev": 1676, 2023-08-11T12:40:21.902 INFO:teuthology.orchestra.run.smithi008.stdout: "evexg": 0, 2023-08-11T12:40:21.902 INFO:teuthology.orchestra.run.smithi008.stdout: "evexd": 0, 2023-08-11T12:40:21.903 INFO:teuthology.orchestra.run.smithi008.stdout: "segadd": 0, 2023-08-11T12:40:21.903 INFO:teuthology.orchestra.run.smithi008.stdout: "segex": 0, 2023-08-11T12:40:21.903 INFO:teuthology.orchestra.run.smithi008.stdout: "segtrm": 0, 2023-08-11T12:40:21.903 INFO:teuthology.orchestra.run.smithi008.stdout: "seg": 3, 2023-08-11T12:40:21.903 INFO:teuthology.orchestra.run.smithi008.stdout: "segmjr": 2, 2023-08-11T12:40:21.904 INFO:teuthology.orchestra.run.smithi008.stdout: "segexg": 0, 2023-08-11T12:40:21.904 INFO:teuthology.orchestra.run.smithi008.stdout: "segexd": 0, 2023-08-11T12:40:21.904 INFO:teuthology.orchestra.run.smithi008.stdout: "expos": 4194304, 2023-08-11T12:40:21.904 INFO:teuthology.orchestra.run.smithi008.stdout: "wrpos": 7091667, 2023-08-11T12:40:21.905 INFO:teuthology.orchestra.run.smithi008.stdout: "rdpos": 7091093, 2023-08-11T12:40:21.905 INFO:teuthology.orchestra.run.smithi008.stdout: "jlat": { 2023-08-11T12:40:21.905 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.905 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.905 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.906 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.906 INFO:teuthology.orchestra.run.smithi008.stdout: "replayed": 1676 2023-08-11T12:40:21.906 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.906 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_mem": { 2023-08-11T12:40:21.907 INFO:teuthology.orchestra.run.smithi008.stdout: "ino": 629, 2023-08-11T12:40:21.907 INFO:teuthology.orchestra.run.smithi008.stdout: "ino+": 1141, 2023-08-11T12:40:21.907 INFO:teuthology.orchestra.run.smithi008.stdout: "ino-": 512, 2023-08-11T12:40:21.907 INFO:teuthology.orchestra.run.smithi008.stdout: "dir": 48, 2023-08-11T12:40:21.907 INFO:teuthology.orchestra.run.smithi008.stdout: "dir+": 59, 2023-08-11T12:40:21.908 INFO:teuthology.orchestra.run.smithi008.stdout: "dir-": 11, 2023-08-11T12:40:21.908 INFO:teuthology.orchestra.run.smithi008.stdout: "dn": 658, 2023-08-11T12:40:21.908 INFO:teuthology.orchestra.run.smithi008.stdout: "dn+": 1181, 2023-08-11T12:40:21.908 INFO:teuthology.orchestra.run.smithi008.stdout: "dn-": 523, 2023-08-11T12:40:21.908 INFO:teuthology.orchestra.run.smithi008.stdout: "cap": 0, 2023-08-11T12:40:21.909 INFO:teuthology.orchestra.run.smithi008.stdout: "cap+": 0, 2023-08-11T12:40:21.909 INFO:teuthology.orchestra.run.smithi008.stdout: "cap-": 0, 2023-08-11T12:40:21.909 INFO:teuthology.orchestra.run.smithi008.stdout: "rss": 51360, 2023-08-11T12:40:21.909 INFO:teuthology.orchestra.run.smithi008.stdout: "heap": 207152 2023-08-11T12:40:21.910 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.910 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_server": { 2023-08-11T12:40:21.910 INFO:teuthology.orchestra.run.smithi008.stdout: "dispatch_client_request": 0, 2023-08-11T12:40:21.910 INFO:teuthology.orchestra.run.smithi008.stdout: "dispatch_server_request": 0, 2023-08-11T12:40:21.910 INFO:teuthology.orchestra.run.smithi008.stdout: "handle_client_request": 0, 2023-08-11T12:40:21.911 INFO:teuthology.orchestra.run.smithi008.stdout: "handle_client_session": 0, 2023-08-11T12:40:21.911 INFO:teuthology.orchestra.run.smithi008.stdout: "handle_peer_request": 0, 2023-08-11T12:40:21.911 INFO:teuthology.orchestra.run.smithi008.stdout: "req_create_latency": { 2023-08-11T12:40:21.911 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.911 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.912 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.912 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.912 INFO:teuthology.orchestra.run.smithi008.stdout: "req_getattr_latency": { 2023-08-11T12:40:21.912 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.912 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.913 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.913 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.913 INFO:teuthology.orchestra.run.smithi008.stdout: "req_getfilelock_latency": { 2023-08-11T12:40:21.913 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.913 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.914 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.914 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.914 INFO:teuthology.orchestra.run.smithi008.stdout: "req_link_latency": { 2023-08-11T12:40:21.914 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.914 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.915 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.915 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.915 INFO:teuthology.orchestra.run.smithi008.stdout: "req_lookup_latency": { 2023-08-11T12:40:21.915 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.915 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.915 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.916 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.916 INFO:teuthology.orchestra.run.smithi008.stdout: "req_lookuphash_latency": { 2023-08-11T12:40:21.916 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.917 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.917 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.917 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.917 INFO:teuthology.orchestra.run.smithi008.stdout: "req_lookupino_latency": { 2023-08-11T12:40:21.917 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.918 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.918 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.918 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.918 INFO:teuthology.orchestra.run.smithi008.stdout: "req_lookupname_latency": { 2023-08-11T12:40:21.918 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.919 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.919 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.919 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.919 INFO:teuthology.orchestra.run.smithi008.stdout: "req_lookupparent_latency": { 2023-08-11T12:40:21.919 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.919 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.920 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.920 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.920 INFO:teuthology.orchestra.run.smithi008.stdout: "req_lookupsnap_latency": { 2023-08-11T12:40:21.920 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.921 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.921 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.921 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.921 INFO:teuthology.orchestra.run.smithi008.stdout: "req_lssnap_latency": { 2023-08-11T12:40:21.921 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.922 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.922 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.922 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.922 INFO:teuthology.orchestra.run.smithi008.stdout: "req_mkdir_latency": { 2023-08-11T12:40:21.922 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.922 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.923 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.923 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.923 INFO:teuthology.orchestra.run.smithi008.stdout: "req_mknod_latency": { 2023-08-11T12:40:21.923 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.924 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.924 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.924 INFO:teuthology.orchestra.run.smithi008.stdout: "req_mksnap_latency": { 2023-08-11T12:40:21.925 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.925 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.925 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.925 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.925 INFO:teuthology.orchestra.run.smithi008.stdout: "req_open_latency": { 2023-08-11T12:40:21.925 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.926 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.926 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.926 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.926 INFO:teuthology.orchestra.run.smithi008.stdout: "req_readdir_latency": { 2023-08-11T12:40:21.927 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.927 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.927 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.927 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.928 INFO:teuthology.orchestra.run.smithi008.stdout: "req_rename_latency": { 2023-08-11T12:40:21.928 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.928 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.928 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.929 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.929 INFO:teuthology.orchestra.run.smithi008.stdout: "req_renamesnap_latency": { 2023-08-11T12:40:21.929 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.929 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.929 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.929 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.930 INFO:teuthology.orchestra.run.smithi008.stdout: "req_snapdiff_latency": { 2023-08-11T12:40:21.930 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.930 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.930 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.930 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.931 INFO:teuthology.orchestra.run.smithi008.stdout: "req_rmdir_latency": { 2023-08-11T12:40:21.931 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.931 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.931 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.931 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.932 INFO:teuthology.orchestra.run.smithi008.stdout: "req_rmsnap_latency": { 2023-08-11T12:40:21.932 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.932 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.932 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.932 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.933 INFO:teuthology.orchestra.run.smithi008.stdout: "req_rmxattr_latency": { 2023-08-11T12:40:21.933 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.933 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.933 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.933 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.934 INFO:teuthology.orchestra.run.smithi008.stdout: "req_setattr_latency": { 2023-08-11T12:40:21.934 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.934 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.934 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.934 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.935 INFO:teuthology.orchestra.run.smithi008.stdout: "req_setdirlayout_latency": { 2023-08-11T12:40:21.935 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.935 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.935 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.936 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.936 INFO:teuthology.orchestra.run.smithi008.stdout: "req_setfilelock_latency": { 2023-08-11T12:40:21.936 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.936 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.936 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.937 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.937 INFO:teuthology.orchestra.run.smithi008.stdout: "req_setlayout_latency": { 2023-08-11T12:40:21.937 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.937 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.938 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.938 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.938 INFO:teuthology.orchestra.run.smithi008.stdout: "req_setxattr_latency": { 2023-08-11T12:40:21.938 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.938 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.939 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.939 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.939 INFO:teuthology.orchestra.run.smithi008.stdout: "req_symlink_latency": { 2023-08-11T12:40:21.939 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.939 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.940 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.940 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.940 INFO:teuthology.orchestra.run.smithi008.stdout: "req_unlink_latency": { 2023-08-11T12:40:21.940 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.940 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.941 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.941 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.941 INFO:teuthology.orchestra.run.smithi008.stdout: "cap_revoke_eviction": 0, 2023-08-11T12:40:21.941 INFO:teuthology.orchestra.run.smithi008.stdout: "cap_acquisition_throttle": 0, 2023-08-11T12:40:21.941 INFO:teuthology.orchestra.run.smithi008.stdout: "req_getvxattr_latency": { 2023-08-11T12:40:21.942 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.942 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.942 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.942 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:21.942 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.943 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_sessions": { 2023-08-11T12:40:21.943 INFO:teuthology.orchestra.run.smithi008.stdout: "session_count": 1, 2023-08-11T12:40:21.943 INFO:teuthology.orchestra.run.smithi008.stdout: "session_add": 2, 2023-08-11T12:40:21.943 INFO:teuthology.orchestra.run.smithi008.stdout: "session_remove": 1, 2023-08-11T12:40:21.943 INFO:teuthology.orchestra.run.smithi008.stdout: "sessions_open": 2, 2023-08-11T12:40:21.944 INFO:teuthology.orchestra.run.smithi008.stdout: "sessions_stale": 0, 2023-08-11T12:40:21.944 INFO:teuthology.orchestra.run.smithi008.stdout: "total_load": 0, 2023-08-11T12:40:21.944 INFO:teuthology.orchestra.run.smithi008.stdout: "average_load": 0, 2023-08-11T12:40:21.944 INFO:teuthology.orchestra.run.smithi008.stdout: "avg_session_uptime": 4327 2023-08-11T12:40:21.944 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.945 INFO:teuthology.orchestra.run.smithi008.stdout: "mempool": { 2023-08-11T12:40:21.945 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_bytes": 0, 2023-08-11T12:40:21.945 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_items": 0, 2023-08-11T12:40:21.945 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_bytes": 0, 2023-08-11T12:40:21.945 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_items": 0, 2023-08-11T12:40:21.946 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_bytes": 0, 2023-08-11T12:40:21.946 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_items": 0, 2023-08-11T12:40:21.946 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-11T12:40:21.946 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_items": 0, 2023-08-11T12:40:21.946 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-11T12:40:21.947 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_items": 0, 2023-08-11T12:40:21.947 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_bytes": 0, 2023-08-11T12:40:21.947 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_items": 0, 2023-08-11T12:40:21.947 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-11T12:40:21.947 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_items": 0, 2023-08-11T12:40:21.948 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_bytes": 0, 2023-08-11T12:40:21.948 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_items": 0, 2023-08-11T12:40:21.948 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_bytes": 0, 2023-08-11T12:40:21.948 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_items": 0, 2023-08-11T12:40:21.949 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-11T12:40:21.949 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_items": 0, 2023-08-11T12:40:21.949 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-11T12:40:21.949 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_items": 0, 2023-08-11T12:40:21.950 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_bytes": 0, 2023-08-11T12:40:21.950 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_items": 0, 2023-08-11T12:40:21.950 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_bytes": 0, 2023-08-11T12:40:21.951 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_items": 0, 2023-08-11T12:40:21.951 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-11T12:40:21.952 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_items": 0, 2023-08-11T12:40:21.952 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_bytes": 0, 2023-08-11T12:40:21.952 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_items": 0, 2023-08-11T12:40:21.953 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_bytes": 0, 2023-08-11T12:40:21.953 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_items": 0, 2023-08-11T12:40:21.953 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_bytes": 0, 2023-08-11T12:40:21.953 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_items": 0, 2023-08-11T12:40:21.953 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_bytes": 0, 2023-08-11T12:40:21.954 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_items": 0, 2023-08-11T12:40:21.954 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_bytes": 214560, 2023-08-11T12:40:21.954 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_items": 712, 2023-08-11T12:40:21.954 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_bytes": 0, 2023-08-11T12:40:21.954 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_items": 0, 2023-08-11T12:40:21.955 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_bytes": 0, 2023-08-11T12:40:21.955 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_items": 0, 2023-08-11T12:40:21.955 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_bytes": 0, 2023-08-11T12:40:21.955 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_items": 0, 2023-08-11T12:40:21.955 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_bytes": 0, 2023-08-11T12:40:21.956 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_items": 0, 2023-08-11T12:40:21.956 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_bytes": 9320, 2023-08-11T12:40:21.956 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_items": 178, 2023-08-11T12:40:21.956 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_bytes": 0, 2023-08-11T12:40:21.956 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_items": 0, 2023-08-11T12:40:21.957 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_bytes": 0, 2023-08-11T12:40:21.957 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_items": 0, 2023-08-11T12:40:21.957 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_bytes": 1997884, 2023-08-11T12:40:21.957 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_items": 21419, 2023-08-11T12:40:21.957 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_bytes": 0, 2023-08-11T12:40:21.958 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_items": 0, 2023-08-11T12:40:21.958 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_bytes": 0, 2023-08-11T12:40:21.958 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_items": 0 2023-08-11T12:40:21.958 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.958 INFO:teuthology.orchestra.run.smithi008.stdout: "objecter": { 2023-08-11T12:40:21.959 INFO:teuthology.orchestra.run.smithi008.stdout: "op_active": 0, 2023-08-11T12:40:21.959 INFO:teuthology.orchestra.run.smithi008.stdout: "op_laggy": 0, 2023-08-11T12:40:21.959 INFO:teuthology.orchestra.run.smithi008.stdout: "op_send": 3154, 2023-08-11T12:40:21.959 INFO:teuthology.orchestra.run.smithi008.stdout: "op_send_bytes": 21, 2023-08-11T12:40:21.959 INFO:teuthology.orchestra.run.smithi008.stdout: "op_resend": 3, 2023-08-11T12:40:21.959 INFO:teuthology.orchestra.run.smithi008.stdout: "op_reply": 3154, 2023-08-11T12:40:21.960 INFO:teuthology.orchestra.run.smithi008.stdout: "op_latency": { 2023-08-11T12:40:21.960 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 3154, 2023-08-11T12:40:21.960 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 2.002979403, 2023-08-11T12:40:21.960 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000635060 2023-08-11T12:40:21.960 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.961 INFO:teuthology.orchestra.run.smithi008.stdout: "op_inflight": 0, 2023-08-11T12:40:21.961 INFO:teuthology.orchestra.run.smithi008.stdout: "oplen_avg": { 2023-08-11T12:40:21.961 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 3154, 2023-08-11T12:40:21.961 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 3155 2023-08-11T12:40:21.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.962 INFO:teuthology.orchestra.run.smithi008.stdout: "op": 3154, 2023-08-11T12:40:21.962 INFO:teuthology.orchestra.run.smithi008.stdout: "op_r": 3154, 2023-08-11T12:40:21.962 INFO:teuthology.orchestra.run.smithi008.stdout: "op_w": 0, 2023-08-11T12:40:21.962 INFO:teuthology.orchestra.run.smithi008.stdout: "op_rmw": 0, 2023-08-11T12:40:21.962 INFO:teuthology.orchestra.run.smithi008.stdout: "op_pg": 0, 2023-08-11T12:40:21.963 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_stat": 2012, 2023-08-11T12:40:21.963 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_create": 0, 2023-08-11T12:40:21.963 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_read": 1140, 2023-08-11T12:40:21.963 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_write": 0, 2023-08-11T12:40:21.963 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_writefull": 0, 2023-08-11T12:40:21.964 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_writesame": 0, 2023-08-11T12:40:21.964 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_append": 0, 2023-08-11T12:40:21.964 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_zero": 0, 2023-08-11T12:40:21.964 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_truncate": 0, 2023-08-11T12:40:21.964 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_delete": 0, 2023-08-11T12:40:21.965 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_mapext": 0, 2023-08-11T12:40:21.965 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_sparse_read": 0, 2023-08-11T12:40:21.965 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_clonerange": 0, 2023-08-11T12:40:21.965 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_getxattr": 1, 2023-08-11T12:40:21.965 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_setxattr": 0, 2023-08-11T12:40:21.965 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_cmpxattr": 0, 2023-08-11T12:40:21.966 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_rmxattr": 0, 2023-08-11T12:40:21.966 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_resetxattrs": 0, 2023-08-11T12:40:21.966 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_call": 0, 2023-08-11T12:40:21.966 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_watch": 0, 2023-08-11T12:40:21.966 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_notify": 0, 2023-08-11T12:40:21.967 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_src_cmpxattr": 0, 2023-08-11T12:40:21.967 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_pgls": 0, 2023-08-11T12:40:21.967 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_pgls_filter": 0, 2023-08-11T12:40:21.967 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_other": 0, 2023-08-11T12:40:21.967 INFO:teuthology.orchestra.run.smithi008.stdout: "linger_active": 0, 2023-08-11T12:40:21.968 INFO:teuthology.orchestra.run.smithi008.stdout: "linger_send": 0, 2023-08-11T12:40:21.968 INFO:teuthology.orchestra.run.smithi008.stdout: "linger_resend": 0, 2023-08-11T12:40:21.968 INFO:teuthology.orchestra.run.smithi008.stdout: "linger_ping": 0, 2023-08-11T12:40:21.968 INFO:teuthology.orchestra.run.smithi008.stdout: "poolop_active": 0, 2023-08-11T12:40:21.968 INFO:teuthology.orchestra.run.smithi008.stdout: "poolop_send": 0, 2023-08-11T12:40:21.969 INFO:teuthology.orchestra.run.smithi008.stdout: "poolop_resend": 0, 2023-08-11T12:40:21.969 INFO:teuthology.orchestra.run.smithi008.stdout: "poolstat_active": 0, 2023-08-11T12:40:21.969 INFO:teuthology.orchestra.run.smithi008.stdout: "poolstat_send": 0, 2023-08-11T12:40:21.969 INFO:teuthology.orchestra.run.smithi008.stdout: "poolstat_resend": 0, 2023-08-11T12:40:21.969 INFO:teuthology.orchestra.run.smithi008.stdout: "statfs_active": 0, 2023-08-11T12:40:21.970 INFO:teuthology.orchestra.run.smithi008.stdout: "statfs_send": 0, 2023-08-11T12:40:21.970 INFO:teuthology.orchestra.run.smithi008.stdout: "statfs_resend": 0, 2023-08-11T12:40:21.970 INFO:teuthology.orchestra.run.smithi008.stdout: "command_active": 0, 2023-08-11T12:40:21.970 INFO:teuthology.orchestra.run.smithi008.stdout: "command_send": 0, 2023-08-11T12:40:21.970 INFO:teuthology.orchestra.run.smithi008.stdout: "command_resend": 0, 2023-08-11T12:40:21.970 INFO:teuthology.orchestra.run.smithi008.stdout: "map_epoch": 110, 2023-08-11T12:40:21.971 INFO:teuthology.orchestra.run.smithi008.stdout: "map_full": 0, 2023-08-11T12:40:21.971 INFO:teuthology.orchestra.run.smithi008.stdout: "map_inc": 21, 2023-08-11T12:40:21.971 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_sessions": 5, 2023-08-11T12:40:21.971 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_session_open": 7, 2023-08-11T12:40:21.971 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_session_close": 2, 2023-08-11T12:40:21.972 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_laggy": 0, 2023-08-11T12:40:21.972 INFO:teuthology.orchestra.run.smithi008.stdout: "omap_wr": 0, 2023-08-11T12:40:21.972 INFO:teuthology.orchestra.run.smithi008.stdout: "omap_rd": 2, 2023-08-11T12:40:21.972 INFO:teuthology.orchestra.run.smithi008.stdout: "omap_del": 0 2023-08-11T12:40:21.972 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.973 INFO:teuthology.orchestra.run.smithi008.stdout: "oft": { 2023-08-11T12:40:21.973 INFO:teuthology.orchestra.run.smithi008.stdout: "omap_total_objs": 0, 2023-08-11T12:40:21.973 INFO:teuthology.orchestra.run.smithi008.stdout: "omap_total_kv_pairs": 0, 2023-08-11T12:40:21.973 INFO:teuthology.orchestra.run.smithi008.stdout: "omap_total_updates": 0, 2023-08-11T12:40:21.973 INFO:teuthology.orchestra.run.smithi008.stdout: "omap_total_removes": 0 2023-08-11T12:40:21.974 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.974 INFO:teuthology.orchestra.run.smithi008.stdout: "osd-slow-ops": { 2023-08-11T12:40:21.974 INFO:teuthology.orchestra.run.smithi008.stdout: "slow_ops_count": 0 2023-08-11T12:40:21.974 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.974 INFO:teuthology.orchestra.run.smithi008.stdout: "purge_queue": { 2023-08-11T12:40:21.975 INFO:teuthology.orchestra.run.smithi008.stdout: "pq_executing_ops": 0, 2023-08-11T12:40:21.975 INFO:teuthology.orchestra.run.smithi008.stdout: "pq_executing_ops_high_water": 0, 2023-08-11T12:40:21.975 INFO:teuthology.orchestra.run.smithi008.stdout: "pq_executing": 0, 2023-08-11T12:40:21.975 INFO:teuthology.orchestra.run.smithi008.stdout: "pq_executing_high_water": 0, 2023-08-11T12:40:21.975 INFO:teuthology.orchestra.run.smithi008.stdout: "pq_executed": 0, 2023-08-11T12:40:21.975 INFO:teuthology.orchestra.run.smithi008.stdout: "pq_item_in_journal": 0 2023-08-11T12:40:21.976 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.976 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-11T12:40:21.976 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2023-08-11T12:40:21.976 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 104857600, 2023-08-11T12:40:21.976 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2023-08-11T12:40:21.977 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 3516, 2023-08-11T12:40:21.977 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 5102237, 2023-08-11T12:40:21.977 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:21.977 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 3516, 2023-08-11T12:40:21.977 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 0, 2023-08-11T12:40:21.978 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 0, 2023-08-11T12:40:21.978 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 3516, 2023-08-11T12:40:21.978 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 5102237, 2023-08-11T12:40:21.978 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2023-08-11T12:40:21.978 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.979 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.979 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.979 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:21.979 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.979 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-objecter_bytes": { 2023-08-11T12:40:21.980 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2023-08-11T12:40:21.980 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 104857600, 2023-08-11T12:40:21.980 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2023-08-11T12:40:21.980 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 0, 2023-08-11T12:40:21.980 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 0, 2023-08-11T12:40:21.981 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:21.981 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:21.981 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 3154, 2023-08-11T12:40:21.981 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 2897368, 2023-08-11T12:40:21.981 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 3154, 2023-08-11T12:40:21.981 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 2897368, 2023-08-11T12:40:21.982 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2023-08-11T12:40:21.982 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.982 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.982 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.982 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:21.983 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.983 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-objecter_ops": { 2023-08-11T12:40:21.983 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2023-08-11T12:40:21.983 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 1024, 2023-08-11T12:40:21.983 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2023-08-11T12:40:21.984 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 0, 2023-08-11T12:40:21.984 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 0, 2023-08-11T12:40:21.984 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:21.984 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:21.984 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 3154, 2023-08-11T12:40:21.985 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 3154, 2023-08-11T12:40:21.985 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 3154, 2023-08-11T12:40:21.985 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 3154, 2023-08-11T12:40:21.985 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2023-08-11T12:40:21.985 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.986 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.986 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.986 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:21.986 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.986 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-write_buf_throttle": { 2023-08-11T12:40:21.987 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2023-08-11T12:40:21.987 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 3758096384, 2023-08-11T12:40:21.987 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2023-08-11T12:40:21.987 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 0, 2023-08-11T12:40:21.987 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 0, 2023-08-11T12:40:21.988 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:21.988 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:21.988 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 0, 2023-08-11T12:40:21.988 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 0, 2023-08-11T12:40:21.988 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 0, 2023-08-11T12:40:21.989 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 0, 2023-08-11T12:40:21.989 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2023-08-11T12:40:21.989 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.989 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.989 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.989 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:21.990 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:21.990 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-write_buf_throttle-0x5587861bc0a0": { 2023-08-11T12:40:21.990 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2023-08-11T12:40:21.990 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 3758096384, 2023-08-11T12:40:21.990 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2023-08-11T12:40:21.991 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 0, 2023-08-11T12:40:21.991 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 0, 2023-08-11T12:40:21.991 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:21.991 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:21.991 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 0, 2023-08-11T12:40:21.992 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 0, 2023-08-11T12:40:21.992 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 0, 2023-08-11T12:40:21.992 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 0, 2023-08-11T12:40:21.992 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2023-08-11T12:40:21.992 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:21.993 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:21.993 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:21.993 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:21.993 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:21.993 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:40:22.302 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:22 smithi008 ceph-mon[97158]: pgmap v495: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:40:22.334 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2023-08-11T12:40:22.335 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2023-08-11T12:40:22.335 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2023-08-11T12:40:22.335 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2023-08-11T12:40:22.335 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2023-08-11T12:40:22.336 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2023-08-11T12:40:22.336 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2023-08-11T12:40:22.336 DEBUG:tasks.check_counter:Getting stats from d 2023-08-11T12:40:22.337 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph daemon mds.d perf dump 2023-08-11T12:40:22.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:22 smithi194 ceph-mon[130905]: pgmap v495: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:40:22.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:22 smithi045 ceph-mon[130284]: pgmap v495: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-11T12:40:23.074 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:40:24.302 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:24 smithi008 ceph-mon[97158]: pgmap v496: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:40:24.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:24 smithi194 ceph-mon[130905]: pgmap v496: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:40:24.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:24 smithi045 ceph-mon[130284]: pgmap v496: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:40:24.993 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:40:24.993 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-0": { 2023-08-11T12:40:24.993 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 0, 2023-08-11T12:40:24.994 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 2, 2023-08-11T12:40:24.994 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 0, 2023-08-11T12:40:24.994 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 0, 2023-08-11T12:40:24.994 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 4, 2023-08-11T12:40:24.995 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 0, 2023-08-11T12:40:24.995 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.003785446, 2023-08-11T12:40:24.995 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.000000000, 2023-08-11T12:40:24.995 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.000706667, 2023-08-11T12:40:24.995 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-08-11T12:40:24.996 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:24.996 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:24.996 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:24.997 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:24.997 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:24.997 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:24.997 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:24.998 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:24.998 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:24.998 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:24.998 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 0, 2023-08-11T12:40:24.998 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 0 2023-08-11T12:40:24.999 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:24.999 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-1": { 2023-08-11T12:40:24.999 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 315, 2023-08-11T12:40:24.999 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 303, 2023-08-11T12:40:25.000 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 1440016, 2023-08-11T12:40:25.000 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 181440, 2023-08-11T12:40:25.000 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 2, 2023-08-11T12:40:25.000 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 1, 2023-08-11T12:40:25.000 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.067479138, 2023-08-11T12:40:25.001 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.027226091, 2023-08-11T12:40:25.001 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.039621738, 2023-08-11T12:40:25.001 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.007023567, 2023-08-11T12:40:25.001 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:25.002 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 303, 2023-08-11T12:40:25.002 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.025156647, 2023-08-11T12:40:25.002 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000083025 2023-08-11T12:40:25.002 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:25.003 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:25.003 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:25.003 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:25.003 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:25.003 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:25.004 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 1440016, 2023-08-11T12:40:25.004 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 181440 2023-08-11T12:40:25.004 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:25.004 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-2": { 2023-08-11T12:40:25.005 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 3, 2023-08-11T12:40:25.005 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 230, 2023-08-11T12:40:25.005 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 480, 2023-08-11T12:40:25.005 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 269344, 2023-08-11T12:40:25.006 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 6, 2023-08-11T12:40:25.006 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 3, 2023-08-11T12:40:25.006 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.027663098, 2023-08-11T12:40:25.006 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.019358873, 2023-08-11T12:40:25.006 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.003573451, 2023-08-11T12:40:25.007 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-08-11T12:40:25.007 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:25.007 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 227, 2023-08-11T12:40:25.007 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.025116349, 2023-08-11T12:40:25.008 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000110644 2023-08-11T12:40:25.008 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:25.008 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:25.008 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:25.008 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:25.009 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:25.009 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:25.009 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 480, 2023-08-11T12:40:25.009 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 269344 2023-08-11T12:40:25.010 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:25.010 INFO:teuthology.orchestra.run.smithi008.stdout: "cct": { 2023-08-11T12:40:25.010 INFO:teuthology.orchestra.run.smithi008.stdout: "total_workers": 0, 2023-08-11T12:40:25.010 INFO:teuthology.orchestra.run.smithi008.stdout: "unhealthy_workers": 0 2023-08-11T12:40:25.010 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:25.011 INFO:teuthology.orchestra.run.smithi008.stdout: "mempool": { 2023-08-11T12:40:25.011 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_bytes": 0, 2023-08-11T12:40:25.011 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_items": 0, 2023-08-11T12:40:25.011 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_bytes": 0, 2023-08-11T12:40:25.011 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_items": 0, 2023-08-11T12:40:25.012 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_bytes": 0, 2023-08-11T12:40:25.012 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_items": 0, 2023-08-11T12:40:25.012 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-11T12:40:25.012 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_items": 0, 2023-08-11T12:40:25.013 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-11T12:40:25.013 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_items": 0, 2023-08-11T12:40:25.013 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_bytes": 0, 2023-08-11T12:40:25.013 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_items": 0, 2023-08-11T12:40:25.013 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-11T12:40:25.014 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_items": 0, 2023-08-11T12:40:25.014 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_bytes": 0, 2023-08-11T12:40:25.014 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_items": 0, 2023-08-11T12:40:25.014 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_bytes": 0, 2023-08-11T12:40:25.014 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_items": 0, 2023-08-11T12:40:25.015 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-11T12:40:25.015 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_items": 0, 2023-08-11T12:40:25.015 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-11T12:40:25.015 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_items": 0, 2023-08-11T12:40:25.015 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_bytes": 0, 2023-08-11T12:40:25.016 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_items": 0, 2023-08-11T12:40:25.016 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_bytes": 0, 2023-08-11T12:40:25.016 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_items": 0, 2023-08-11T12:40:25.016 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-11T12:40:25.017 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_items": 0, 2023-08-11T12:40:25.017 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_bytes": 0, 2023-08-11T12:40:25.017 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_items": 0, 2023-08-11T12:40:25.017 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_bytes": 0, 2023-08-11T12:40:25.017 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_items": 0, 2023-08-11T12:40:25.018 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_bytes": 0, 2023-08-11T12:40:25.018 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_items": 0, 2023-08-11T12:40:25.018 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_bytes": 0, 2023-08-11T12:40:25.018 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_items": 0, 2023-08-11T12:40:25.018 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_bytes": 148714, 2023-08-11T12:40:25.019 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_items": 30, 2023-08-11T12:40:25.019 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_bytes": 0, 2023-08-11T12:40:25.019 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_items": 0, 2023-08-11T12:40:25.019 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_bytes": 0, 2023-08-11T12:40:25.019 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_items": 0, 2023-08-11T12:40:25.020 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_bytes": 0, 2023-08-11T12:40:25.020 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_items": 0, 2023-08-11T12:40:25.020 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_bytes": 0, 2023-08-11T12:40:25.020 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_items": 0, 2023-08-11T12:40:25.021 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_bytes": 0, 2023-08-11T12:40:25.021 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_items": 0, 2023-08-11T12:40:25.021 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_bytes": 0, 2023-08-11T12:40:25.021 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_items": 0, 2023-08-11T12:40:25.021 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_bytes": 0, 2023-08-11T12:40:25.022 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_items": 0, 2023-08-11T12:40:25.022 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_bytes": 928, 2023-08-11T12:40:25.022 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_items": 2, 2023-08-11T12:40:25.022 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_bytes": 0, 2023-08-11T12:40:25.022 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_items": 0, 2023-08-11T12:40:25.023 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_bytes": 0, 2023-08-11T12:40:25.023 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_items": 0 2023-08-11T12:40:25.023 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:25.023 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-11T12:40:25.023 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2023-08-11T12:40:25.024 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 104857600, 2023-08-11T12:40:25.024 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2023-08-11T12:40:25.024 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 314, 2023-08-11T12:40:25.024 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 1393147, 2023-08-11T12:40:25.025 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:25.025 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 314, 2023-08-11T12:40:25.025 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 0, 2023-08-11T12:40:25.025 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 0, 2023-08-11T12:40:25.025 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 314, 2023-08-11T12:40:25.026 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 1393147, 2023-08-11T12:40:25.026 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2023-08-11T12:40:25.026 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:25.026 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:25.026 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:25.027 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:25.027 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:25.027 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:40:25.470 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2023-08-11T12:40:25.470 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2023-08-11T12:40:25.471 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2023-08-11T12:40:25.471 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2023-08-11T12:40:25.471 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2023-08-11T12:40:25.471 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2023-08-11T12:40:25.472 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2023-08-11T12:40:25.472 DEBUG:tasks.check_counter:Getting stats from g 2023-08-11T12:40:25.472 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph daemon mds.g perf dump 2023-08-11T12:40:26.209 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:40:26.302 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:25 smithi008 ceph-mon[97158]: pgmap v497: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:40:26.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:25 smithi194 ceph-mon[130905]: pgmap v497: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:40:26.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:25 smithi045 ceph-mon[130284]: pgmap v497: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-11T12:40:27.975 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:40:27.976 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-0": { 2023-08-11T12:40:27.976 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 1075, 2023-08-11T12:40:27.976 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 1077, 2023-08-11T12:40:27.976 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 361145, 2023-08-11T12:40:27.976 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 334326, 2023-08-11T12:40:27.977 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 7, 2023-08-11T12:40:27.977 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 2, 2023-08-11T12:40:27.977 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.159019469, 2023-08-11T12:40:27.978 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.071489762, 2023-08-11T12:40:27.978 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.032114085, 2023-08-11T12:40:27.978 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.035116575, 2023-08-11T12:40:27.979 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:27.979 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 1075, 2023-08-11T12:40:27.979 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.082474370, 2023-08-11T12:40:27.979 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000076720 2023-08-11T12:40:27.979 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:27.980 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:27.980 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:27.980 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:27.980 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:27.980 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:27.981 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 0, 2023-08-11T12:40:27.981 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 0 2023-08-11T12:40:27.981 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:27.981 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-1": { 2023-08-11T12:40:27.981 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 2090, 2023-08-11T12:40:27.982 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 2315, 2023-08-11T12:40:27.982 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 2838434, 2023-08-11T12:40:27.982 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 1193553, 2023-08-11T12:40:27.982 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 7, 2023-08-11T12:40:27.982 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 5, 2023-08-11T12:40:27.983 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.219977126, 2023-08-11T12:40:27.983 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.073215955, 2023-08-11T12:40:27.983 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.061867055, 2023-08-11T12:40:27.983 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.066392404, 2023-08-11T12:40:27.983 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:27.984 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 2312, 2023-08-11T12:40:27.984 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.119792639, 2023-08-11T12:40:27.984 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000051813 2023-08-11T12:40:27.984 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:27.984 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:27.985 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:27.985 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:27.985 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:27.985 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:27.985 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 320, 2023-08-11T12:40:27.986 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 544128 2023-08-11T12:40:27.986 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:27.986 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-2": { 2023-08-11T12:40:27.986 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 368, 2023-08-11T12:40:27.986 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 329, 2023-08-11T12:40:27.987 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 1654180, 2023-08-11T12:40:27.987 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 185040, 2023-08-11T12:40:27.987 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 5, 2023-08-11T12:40:27.987 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 3, 2023-08-11T12:40:27.988 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.073997921, 2023-08-11T12:40:27.988 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.029676531, 2023-08-11T12:40:27.988 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.044843180, 2023-08-11T12:40:27.989 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.007013879, 2023-08-11T12:40:27.989 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:27.989 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 329, 2023-08-11T12:40:27.989 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.036628787, 2023-08-11T12:40:27.989 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000111333 2023-08-11T12:40:27.990 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:27.990 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:27.990 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:27.990 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:27.990 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:27.991 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:27.991 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 1652832, 2023-08-11T12:40:27.991 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 184096 2023-08-11T12:40:27.991 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:27.991 INFO:teuthology.orchestra.run.smithi008.stdout: "cct": { 2023-08-11T12:40:27.992 INFO:teuthology.orchestra.run.smithi008.stdout: "total_workers": 1, 2023-08-11T12:40:27.992 INFO:teuthology.orchestra.run.smithi008.stdout: "unhealthy_workers": 0 2023-08-11T12:40:27.992 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:27.992 INFO:teuthology.orchestra.run.smithi008.stdout: "finisher-MDSRank": { 2023-08-11T12:40:27.992 INFO:teuthology.orchestra.run.smithi008.stdout: "queue_len": 0, 2023-08-11T12:40:27.993 INFO:teuthology.orchestra.run.smithi008.stdout: "complete_latency": { 2023-08-11T12:40:27.993 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 5353, 2023-08-11T12:40:27.993 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.157464775, 2023-08-11T12:40:27.993 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000029416 2023-08-11T12:40:27.993 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:27.994 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:27.994 INFO:teuthology.orchestra.run.smithi008.stdout: "finisher-PurgeQueue": { 2023-08-11T12:40:27.994 INFO:teuthology.orchestra.run.smithi008.stdout: "queue_len": 0, 2023-08-11T12:40:27.994 INFO:teuthology.orchestra.run.smithi008.stdout: "complete_latency": { 2023-08-11T12:40:27.994 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:27.995 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:27.995 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:27.995 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:27.995 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:27.995 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-08-11T12:40:27.996 INFO:teuthology.orchestra.run.smithi008.stdout: "request": 0, 2023-08-11T12:40:27.996 INFO:teuthology.orchestra.run.smithi008.stdout: "reply": 0, 2023-08-11T12:40:27.996 INFO:teuthology.orchestra.run.smithi008.stdout: "reply_latency": { 2023-08-11T12:40:27.996 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:27.996 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:27.997 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:27.997 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:27.997 INFO:teuthology.orchestra.run.smithi008.stdout: "slow_reply": 0, 2023-08-11T12:40:27.997 INFO:teuthology.orchestra.run.smithi008.stdout: "forward": 0, 2023-08-11T12:40:27.997 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_fetch_complete": 0, 2023-08-11T12:40:27.998 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_fetch_keys": 0, 2023-08-11T12:40:27.998 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_commit": 0, 2023-08-11T12:40:27.998 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_split": 0, 2023-08-11T12:40:27.998 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_merge": 0, 2023-08-11T12:40:27.998 INFO:teuthology.orchestra.run.smithi008.stdout: "inodes": 801, 2023-08-11T12:40:27.999 INFO:teuthology.orchestra.run.smithi008.stdout: "inodes_top": 127, 2023-08-11T12:40:27.999 INFO:teuthology.orchestra.run.smithi008.stdout: "inodes_bottom": 575, 2023-08-11T12:40:27.999 INFO:teuthology.orchestra.run.smithi008.stdout: "inodes_pin_tail": 99, 2023-08-11T12:40:27.999 INFO:teuthology.orchestra.run.smithi008.stdout: "inodes_pinned": 619, 2023-08-11T12:40:27.999 INFO:teuthology.orchestra.run.smithi008.stdout: "inodes_expired": 40, 2023-08-11T12:40:28.000 INFO:teuthology.orchestra.run.smithi008.stdout: "inodes_with_caps": 0, 2023-08-11T12:40:28.000 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": 0, 2023-08-11T12:40:28.000 INFO:teuthology.orchestra.run.smithi008.stdout: "subtrees": 22, 2023-08-11T12:40:28.000 INFO:teuthology.orchestra.run.smithi008.stdout: "traverse": 0, 2023-08-11T12:40:28.000 INFO:teuthology.orchestra.run.smithi008.stdout: "traverse_hit": 0, 2023-08-11T12:40:28.001 INFO:teuthology.orchestra.run.smithi008.stdout: "traverse_forward": 0, 2023-08-11T12:40:28.001 INFO:teuthology.orchestra.run.smithi008.stdout: "traverse_discover": 0, 2023-08-11T12:40:28.001 INFO:teuthology.orchestra.run.smithi008.stdout: "traverse_dir_fetch": 0, 2023-08-11T12:40:28.001 INFO:teuthology.orchestra.run.smithi008.stdout: "traverse_remote_ino": 0, 2023-08-11T12:40:28.001 INFO:teuthology.orchestra.run.smithi008.stdout: "traverse_lock": 0, 2023-08-11T12:40:28.002 INFO:teuthology.orchestra.run.smithi008.stdout: "load_cent": 0, 2023-08-11T12:40:28.002 INFO:teuthology.orchestra.run.smithi008.stdout: "q": 0, 2023-08-11T12:40:28.002 INFO:teuthology.orchestra.run.smithi008.stdout: "exported": 0, 2023-08-11T12:40:28.002 INFO:teuthology.orchestra.run.smithi008.stdout: "exported_inodes": 0, 2023-08-11T12:40:28.002 INFO:teuthology.orchestra.run.smithi008.stdout: "imported": 0, 2023-08-11T12:40:28.003 INFO:teuthology.orchestra.run.smithi008.stdout: "imported_inodes": 0, 2023-08-11T12:40:28.003 INFO:teuthology.orchestra.run.smithi008.stdout: "openino_dir_fetch": 0, 2023-08-11T12:40:28.003 INFO:teuthology.orchestra.run.smithi008.stdout: "openino_backtrace_fetch": 0, 2023-08-11T12:40:28.003 INFO:teuthology.orchestra.run.smithi008.stdout: "openino_peer_discover": 0, 2023-08-11T12:40:28.003 INFO:teuthology.orchestra.run.smithi008.stdout: "root_rfiles": 0, 2023-08-11T12:40:28.004 INFO:teuthology.orchestra.run.smithi008.stdout: "root_rbytes": 0, 2023-08-11T12:40:28.004 INFO:teuthology.orchestra.run.smithi008.stdout: "root_rsnaps": 0, 2023-08-11T12:40:28.004 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_backtrace_fetch": 0, 2023-08-11T12:40:28.004 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_set_tag": 0, 2023-08-11T12:40:28.004 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_backtrace_repaired": 0, 2023-08-11T12:40:28.005 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_inotable_repaired": 0, 2023-08-11T12:40:28.005 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_dir_inodes": 0, 2023-08-11T12:40:28.005 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_dir_base_inodes": 0, 2023-08-11T12:40:28.005 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_dirfrag_rstats": 0, 2023-08-11T12:40:28.005 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_file_inodes": 0, 2023-08-11T12:40:28.006 INFO:teuthology.orchestra.run.smithi008.stdout: "handle_inode_file_caps": 0, 2023-08-11T12:40:28.006 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_cap_op_revoke": 0, 2023-08-11T12:40:28.006 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_cap_op_grant": 0, 2023-08-11T12:40:28.006 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_cap_op_trunc": 0, 2023-08-11T12:40:28.006 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-11T12:40:28.007 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-11T12:40:28.007 INFO:teuthology.orchestra.run.smithi008.stdout: "handle_client_caps": 0, 2023-08-11T12:40:28.007 INFO:teuthology.orchestra.run.smithi008.stdout: "handle_client_caps_dirty": 0, 2023-08-11T12:40:28.007 INFO:teuthology.orchestra.run.smithi008.stdout: "handle_client_cap_release": 0, 2023-08-11T12:40:28.007 INFO:teuthology.orchestra.run.smithi008.stdout: "process_request_cap_release": 0 2023-08-11T12:40:28.008 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.008 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_cache": { 2023-08-11T12:40:28.008 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_update": 0, 2023-08-11T12:40:28.008 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_update_receipt": 0, 2023-08-11T12:40:28.008 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_try_discover": 0, 2023-08-11T12:40:28.009 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_send_discover": 0, 2023-08-11T12:40:28.009 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_handle_discover": 0, 2023-08-11T12:40:28.009 INFO:teuthology.orchestra.run.smithi008.stdout: "num_strays": 0, 2023-08-11T12:40:28.009 INFO:teuthology.orchestra.run.smithi008.stdout: "num_strays_delayed": 0, 2023-08-11T12:40:28.009 INFO:teuthology.orchestra.run.smithi008.stdout: "num_strays_enqueuing": 0, 2023-08-11T12:40:28.010 INFO:teuthology.orchestra.run.smithi008.stdout: "strays_created": 0, 2023-08-11T12:40:28.010 INFO:teuthology.orchestra.run.smithi008.stdout: "strays_enqueued": 0, 2023-08-11T12:40:28.010 INFO:teuthology.orchestra.run.smithi008.stdout: "strays_reintegrated": 0, 2023-08-11T12:40:28.010 INFO:teuthology.orchestra.run.smithi008.stdout: "strays_migrated": 0, 2023-08-11T12:40:28.010 INFO:teuthology.orchestra.run.smithi008.stdout: "num_recovering_processing": 0, 2023-08-11T12:40:28.011 INFO:teuthology.orchestra.run.smithi008.stdout: "num_recovering_enqueued": 0, 2023-08-11T12:40:28.011 INFO:teuthology.orchestra.run.smithi008.stdout: "num_recovering_prioritized": 0, 2023-08-11T12:40:28.011 INFO:teuthology.orchestra.run.smithi008.stdout: "recovery_started": 0, 2023-08-11T12:40:28.011 INFO:teuthology.orchestra.run.smithi008.stdout: "recovery_completed": 0, 2023-08-11T12:40:28.011 INFO:teuthology.orchestra.run.smithi008.stdout: "ireq_enqueue_scrub": 0, 2023-08-11T12:40:28.012 INFO:teuthology.orchestra.run.smithi008.stdout: "ireq_exportdir": 0, 2023-08-11T12:40:28.012 INFO:teuthology.orchestra.run.smithi008.stdout: "ireq_flush": 0, 2023-08-11T12:40:28.012 INFO:teuthology.orchestra.run.smithi008.stdout: "ireq_fragmentdir": 0, 2023-08-11T12:40:28.012 INFO:teuthology.orchestra.run.smithi008.stdout: "ireq_fragstats": 0, 2023-08-11T12:40:28.012 INFO:teuthology.orchestra.run.smithi008.stdout: "ireq_inodestats": 0 2023-08-11T12:40:28.013 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.013 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_log": { 2023-08-11T12:40:28.013 INFO:teuthology.orchestra.run.smithi008.stdout: "evlrg": 0, 2023-08-11T12:40:28.013 INFO:teuthology.orchestra.run.smithi008.stdout: "evadd": 0, 2023-08-11T12:40:28.013 INFO:teuthology.orchestra.run.smithi008.stdout: "evex": 0, 2023-08-11T12:40:28.014 INFO:teuthology.orchestra.run.smithi008.stdout: "evtrm": 0, 2023-08-11T12:40:28.014 INFO:teuthology.orchestra.run.smithi008.stdout: "ev": 824, 2023-08-11T12:40:28.014 INFO:teuthology.orchestra.run.smithi008.stdout: "evexg": 0, 2023-08-11T12:40:28.014 INFO:teuthology.orchestra.run.smithi008.stdout: "evexd": 0, 2023-08-11T12:40:28.014 INFO:teuthology.orchestra.run.smithi008.stdout: "segadd": 0, 2023-08-11T12:40:28.015 INFO:teuthology.orchestra.run.smithi008.stdout: "segex": 0, 2023-08-11T12:40:28.015 INFO:teuthology.orchestra.run.smithi008.stdout: "segtrm": 0, 2023-08-11T12:40:28.015 INFO:teuthology.orchestra.run.smithi008.stdout: "seg": 2, 2023-08-11T12:40:28.015 INFO:teuthology.orchestra.run.smithi008.stdout: "segmjr": 2, 2023-08-11T12:40:28.015 INFO:teuthology.orchestra.run.smithi008.stdout: "segexg": 0, 2023-08-11T12:40:28.016 INFO:teuthology.orchestra.run.smithi008.stdout: "segexd": 0, 2023-08-11T12:40:28.016 INFO:teuthology.orchestra.run.smithi008.stdout: "expos": 4194304, 2023-08-11T12:40:28.016 INFO:teuthology.orchestra.run.smithi008.stdout: "wrpos": 6501522, 2023-08-11T12:40:28.016 INFO:teuthology.orchestra.run.smithi008.stdout: "rdpos": 6500948, 2023-08-11T12:40:28.016 INFO:teuthology.orchestra.run.smithi008.stdout: "jlat": { 2023-08-11T12:40:28.017 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.017 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.017 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.017 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.017 INFO:teuthology.orchestra.run.smithi008.stdout: "replayed": 824 2023-08-11T12:40:28.018 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.018 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_mem": { 2023-08-11T12:40:28.018 INFO:teuthology.orchestra.run.smithi008.stdout: "ino": 715, 2023-08-11T12:40:28.018 INFO:teuthology.orchestra.run.smithi008.stdout: "ino+": 1257, 2023-08-11T12:40:28.018 INFO:teuthology.orchestra.run.smithi008.stdout: "ino-": 542, 2023-08-11T12:40:28.019 INFO:teuthology.orchestra.run.smithi008.stdout: "dir": 26, 2023-08-11T12:40:28.019 INFO:teuthology.orchestra.run.smithi008.stdout: "dir+": 34, 2023-08-11T12:40:28.019 INFO:teuthology.orchestra.run.smithi008.stdout: "dir-": 8, 2023-08-11T12:40:28.019 INFO:teuthology.orchestra.run.smithi008.stdout: "dn": 801, 2023-08-11T12:40:28.019 INFO:teuthology.orchestra.run.smithi008.stdout: "dn+": 1374, 2023-08-11T12:40:28.020 INFO:teuthology.orchestra.run.smithi008.stdout: "dn-": 573, 2023-08-11T12:40:28.020 INFO:teuthology.orchestra.run.smithi008.stdout: "cap": 0, 2023-08-11T12:40:28.020 INFO:teuthology.orchestra.run.smithi008.stdout: "cap+": 0, 2023-08-11T12:40:28.020 INFO:teuthology.orchestra.run.smithi008.stdout: "cap-": 0, 2023-08-11T12:40:28.020 INFO:teuthology.orchestra.run.smithi008.stdout: "rss": 51276, 2023-08-11T12:40:28.021 INFO:teuthology.orchestra.run.smithi008.stdout: "heap": 207152 2023-08-11T12:40:28.021 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.021 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_server": { 2023-08-11T12:40:28.021 INFO:teuthology.orchestra.run.smithi008.stdout: "dispatch_client_request": 0, 2023-08-11T12:40:28.021 INFO:teuthology.orchestra.run.smithi008.stdout: "dispatch_server_request": 0, 2023-08-11T12:40:28.022 INFO:teuthology.orchestra.run.smithi008.stdout: "handle_client_request": 0, 2023-08-11T12:40:28.022 INFO:teuthology.orchestra.run.smithi008.stdout: "handle_client_session": 0, 2023-08-11T12:40:28.022 INFO:teuthology.orchestra.run.smithi008.stdout: "handle_peer_request": 0, 2023-08-11T12:40:28.022 INFO:teuthology.orchestra.run.smithi008.stdout: "req_create_latency": { 2023-08-11T12:40:28.022 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.023 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.023 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.023 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.023 INFO:teuthology.orchestra.run.smithi008.stdout: "req_getattr_latency": { 2023-08-11T12:40:28.023 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.024 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.024 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.024 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.024 INFO:teuthology.orchestra.run.smithi008.stdout: "req_getfilelock_latency": { 2023-08-11T12:40:28.024 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.025 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.025 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.025 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.025 INFO:teuthology.orchestra.run.smithi008.stdout: "req_link_latency": { 2023-08-11T12:40:28.025 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.026 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.026 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.026 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.026 INFO:teuthology.orchestra.run.smithi008.stdout: "req_lookup_latency": { 2023-08-11T12:40:28.026 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.027 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.027 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.027 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.027 INFO:teuthology.orchestra.run.smithi008.stdout: "req_lookuphash_latency": { 2023-08-11T12:40:28.027 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.028 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.028 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.028 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.028 INFO:teuthology.orchestra.run.smithi008.stdout: "req_lookupino_latency": { 2023-08-11T12:40:28.028 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.029 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.029 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.029 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.029 INFO:teuthology.orchestra.run.smithi008.stdout: "req_lookupname_latency": { 2023-08-11T12:40:28.029 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.030 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.030 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.030 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.030 INFO:teuthology.orchestra.run.smithi008.stdout: "req_lookupparent_latency": { 2023-08-11T12:40:28.030 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.031 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.031 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.031 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.031 INFO:teuthology.orchestra.run.smithi008.stdout: "req_lookupsnap_latency": { 2023-08-11T12:40:28.031 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.032 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.032 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.032 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.032 INFO:teuthology.orchestra.run.smithi008.stdout: "req_lssnap_latency": { 2023-08-11T12:40:28.032 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.033 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.033 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.033 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.033 INFO:teuthology.orchestra.run.smithi008.stdout: "req_mkdir_latency": { 2023-08-11T12:40:28.033 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.034 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.034 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.034 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.034 INFO:teuthology.orchestra.run.smithi008.stdout: "req_mknod_latency": { 2023-08-11T12:40:28.034 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.035 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.035 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.035 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.035 INFO:teuthology.orchestra.run.smithi008.stdout: "req_mksnap_latency": { 2023-08-11T12:40:28.035 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.036 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.036 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.036 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.036 INFO:teuthology.orchestra.run.smithi008.stdout: "req_open_latency": { 2023-08-11T12:40:28.036 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.037 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.037 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.037 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.037 INFO:teuthology.orchestra.run.smithi008.stdout: "req_readdir_latency": { 2023-08-11T12:40:28.037 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.038 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.038 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.038 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.038 INFO:teuthology.orchestra.run.smithi008.stdout: "req_rename_latency": { 2023-08-11T12:40:28.038 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.039 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.039 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.039 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.039 INFO:teuthology.orchestra.run.smithi008.stdout: "req_renamesnap_latency": { 2023-08-11T12:40:28.039 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.040 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.040 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.040 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.040 INFO:teuthology.orchestra.run.smithi008.stdout: "req_snapdiff_latency": { 2023-08-11T12:40:28.040 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.041 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.041 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.041 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.041 INFO:teuthology.orchestra.run.smithi008.stdout: "req_rmdir_latency": { 2023-08-11T12:40:28.041 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.042 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.042 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.042 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.042 INFO:teuthology.orchestra.run.smithi008.stdout: "req_rmsnap_latency": { 2023-08-11T12:40:28.042 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.043 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.043 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.043 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.043 INFO:teuthology.orchestra.run.smithi008.stdout: "req_rmxattr_latency": { 2023-08-11T12:40:28.043 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.044 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.044 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.044 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.044 INFO:teuthology.orchestra.run.smithi008.stdout: "req_setattr_latency": { 2023-08-11T12:40:28.044 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.045 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.045 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.045 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.045 INFO:teuthology.orchestra.run.smithi008.stdout: "req_setdirlayout_latency": { 2023-08-11T12:40:28.045 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.046 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.046 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.046 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.046 INFO:teuthology.orchestra.run.smithi008.stdout: "req_setfilelock_latency": { 2023-08-11T12:40:28.046 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.047 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.047 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.047 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.047 INFO:teuthology.orchestra.run.smithi008.stdout: "req_setlayout_latency": { 2023-08-11T12:40:28.047 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.048 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.048 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.048 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.048 INFO:teuthology.orchestra.run.smithi008.stdout: "req_setxattr_latency": { 2023-08-11T12:40:28.048 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.049 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.049 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.049 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.049 INFO:teuthology.orchestra.run.smithi008.stdout: "req_symlink_latency": { 2023-08-11T12:40:28.049 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.050 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.050 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.050 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.050 INFO:teuthology.orchestra.run.smithi008.stdout: "req_unlink_latency": { 2023-08-11T12:40:28.050 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.051 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.051 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.051 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.051 INFO:teuthology.orchestra.run.smithi008.stdout: "cap_revoke_eviction": 0, 2023-08-11T12:40:28.051 INFO:teuthology.orchestra.run.smithi008.stdout: "cap_acquisition_throttle": 0, 2023-08-11T12:40:28.052 INFO:teuthology.orchestra.run.smithi008.stdout: "req_getvxattr_latency": { 2023-08-11T12:40:28.052 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.052 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.052 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.052 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:28.053 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.053 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_sessions": { 2023-08-11T12:40:28.053 INFO:teuthology.orchestra.run.smithi008.stdout: "session_count": 2, 2023-08-11T12:40:28.053 INFO:teuthology.orchestra.run.smithi008.stdout: "session_add": 3, 2023-08-11T12:40:28.053 INFO:teuthology.orchestra.run.smithi008.stdout: "session_remove": 1, 2023-08-11T12:40:28.054 INFO:teuthology.orchestra.run.smithi008.stdout: "sessions_open": 3, 2023-08-11T12:40:28.054 INFO:teuthology.orchestra.run.smithi008.stdout: "sessions_stale": 0, 2023-08-11T12:40:28.054 INFO:teuthology.orchestra.run.smithi008.stdout: "total_load": 0, 2023-08-11T12:40:28.054 INFO:teuthology.orchestra.run.smithi008.stdout: "average_load": 0, 2023-08-11T12:40:28.054 INFO:teuthology.orchestra.run.smithi008.stdout: "avg_session_uptime": 3488 2023-08-11T12:40:28.055 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.055 INFO:teuthology.orchestra.run.smithi008.stdout: "mempool": { 2023-08-11T12:40:28.055 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_bytes": 0, 2023-08-11T12:40:28.055 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_items": 0, 2023-08-11T12:40:28.055 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_bytes": 0, 2023-08-11T12:40:28.056 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_items": 0, 2023-08-11T12:40:28.056 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_bytes": 0, 2023-08-11T12:40:28.056 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_items": 0, 2023-08-11T12:40:28.056 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-11T12:40:28.056 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_items": 0, 2023-08-11T12:40:28.057 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-11T12:40:28.057 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_items": 0, 2023-08-11T12:40:28.057 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_bytes": 0, 2023-08-11T12:40:28.057 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_items": 0, 2023-08-11T12:40:28.057 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-11T12:40:28.058 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_items": 0, 2023-08-11T12:40:28.058 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_bytes": 0, 2023-08-11T12:40:28.058 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_items": 0, 2023-08-11T12:40:28.058 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_bytes": 0, 2023-08-11T12:40:28.058 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_items": 0, 2023-08-11T12:40:28.059 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-11T12:40:28.059 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_items": 0, 2023-08-11T12:40:28.059 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-11T12:40:28.059 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_items": 0, 2023-08-11T12:40:28.059 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_bytes": 0, 2023-08-11T12:40:28.060 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_items": 0, 2023-08-11T12:40:28.060 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_bytes": 0, 2023-08-11T12:40:28.060 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_items": 0, 2023-08-11T12:40:28.060 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-11T12:40:28.061 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_items": 0, 2023-08-11T12:40:28.061 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_bytes": 0, 2023-08-11T12:40:28.061 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_items": 0, 2023-08-11T12:40:28.061 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_bytes": 0, 2023-08-11T12:40:28.061 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_items": 0, 2023-08-11T12:40:28.062 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_bytes": 0, 2023-08-11T12:40:28.062 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_items": 0, 2023-08-11T12:40:28.062 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_bytes": 0, 2023-08-11T12:40:28.062 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_items": 0, 2023-08-11T12:40:28.062 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_bytes": 227339, 2023-08-11T12:40:28.063 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_items": 843, 2023-08-11T12:40:28.063 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_bytes": 0, 2023-08-11T12:40:28.063 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_items": 0, 2023-08-11T12:40:28.063 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_bytes": 0, 2023-08-11T12:40:28.063 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_items": 0, 2023-08-11T12:40:28.064 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_bytes": 0, 2023-08-11T12:40:28.064 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_items": 0, 2023-08-11T12:40:28.064 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_bytes": 0, 2023-08-11T12:40:28.064 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_items": 0, 2023-08-11T12:40:28.064 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_bytes": 9320, 2023-08-11T12:40:28.065 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_items": 178, 2023-08-11T12:40:28.065 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_bytes": 0, 2023-08-11T12:40:28.065 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_items": 0, 2023-08-11T12:40:28.065 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_bytes": 0, 2023-08-11T12:40:28.065 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_items": 0, 2023-08-11T12:40:28.066 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_bytes": 2301441, 2023-08-11T12:40:28.066 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_items": 27927, 2023-08-11T12:40:28.066 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_bytes": 0, 2023-08-11T12:40:28.066 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_items": 0, 2023-08-11T12:40:28.066 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_bytes": 0, 2023-08-11T12:40:28.067 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_items": 0 2023-08-11T12:40:28.067 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.067 INFO:teuthology.orchestra.run.smithi008.stdout: "objecter": { 2023-08-11T12:40:28.067 INFO:teuthology.orchestra.run.smithi008.stdout: "op_active": 0, 2023-08-11T12:40:28.068 INFO:teuthology.orchestra.run.smithi008.stdout: "op_laggy": 0, 2023-08-11T12:40:28.068 INFO:teuthology.orchestra.run.smithi008.stdout: "op_send": 3166, 2023-08-11T12:40:28.068 INFO:teuthology.orchestra.run.smithi008.stdout: "op_send_bytes": 21, 2023-08-11T12:40:28.068 INFO:teuthology.orchestra.run.smithi008.stdout: "op_resend": 3, 2023-08-11T12:40:28.068 INFO:teuthology.orchestra.run.smithi008.stdout: "op_reply": 3166, 2023-08-11T12:40:28.069 INFO:teuthology.orchestra.run.smithi008.stdout: "op_latency": { 2023-08-11T12:40:28.069 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 3166, 2023-08-11T12:40:28.069 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 1.825981233, 2023-08-11T12:40:28.069 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000576747 2023-08-11T12:40:28.069 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.070 INFO:teuthology.orchestra.run.smithi008.stdout: "op_inflight": 0, 2023-08-11T12:40:28.070 INFO:teuthology.orchestra.run.smithi008.stdout: "oplen_avg": { 2023-08-11T12:40:28.070 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 3166, 2023-08-11T12:40:28.070 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 3167 2023-08-11T12:40:28.070 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.071 INFO:teuthology.orchestra.run.smithi008.stdout: "op": 3166, 2023-08-11T12:40:28.071 INFO:teuthology.orchestra.run.smithi008.stdout: "op_r": 3166, 2023-08-11T12:40:28.071 INFO:teuthology.orchestra.run.smithi008.stdout: "op_w": 0, 2023-08-11T12:40:28.071 INFO:teuthology.orchestra.run.smithi008.stdout: "op_rmw": 0, 2023-08-11T12:40:28.071 INFO:teuthology.orchestra.run.smithi008.stdout: "op_pg": 0, 2023-08-11T12:40:28.072 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_stat": 2024, 2023-08-11T12:40:28.072 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_create": 0, 2023-08-11T12:40:28.072 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_read": 1140, 2023-08-11T12:40:28.072 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_write": 0, 2023-08-11T12:40:28.072 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_writefull": 0, 2023-08-11T12:40:28.073 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_writesame": 0, 2023-08-11T12:40:28.073 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_append": 0, 2023-08-11T12:40:28.073 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_zero": 0, 2023-08-11T12:40:28.073 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_truncate": 0, 2023-08-11T12:40:28.073 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_delete": 0, 2023-08-11T12:40:28.074 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_mapext": 0, 2023-08-11T12:40:28.074 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_sparse_read": 0, 2023-08-11T12:40:28.074 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_clonerange": 0, 2023-08-11T12:40:28.074 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_getxattr": 1, 2023-08-11T12:40:28.074 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_setxattr": 0, 2023-08-11T12:40:28.075 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_cmpxattr": 0, 2023-08-11T12:40:28.075 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_rmxattr": 0, 2023-08-11T12:40:28.075 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_resetxattrs": 0, 2023-08-11T12:40:28.075 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_call": 0, 2023-08-11T12:40:28.075 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_watch": 0, 2023-08-11T12:40:28.076 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_notify": 0, 2023-08-11T12:40:28.076 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_src_cmpxattr": 0, 2023-08-11T12:40:28.076 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_pgls": 0, 2023-08-11T12:40:28.076 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_pgls_filter": 0, 2023-08-11T12:40:28.076 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_other": 0, 2023-08-11T12:40:28.077 INFO:teuthology.orchestra.run.smithi008.stdout: "linger_active": 0, 2023-08-11T12:40:28.077 INFO:teuthology.orchestra.run.smithi008.stdout: "linger_send": 0, 2023-08-11T12:40:28.077 INFO:teuthology.orchestra.run.smithi008.stdout: "linger_resend": 0, 2023-08-11T12:40:28.077 INFO:teuthology.orchestra.run.smithi008.stdout: "linger_ping": 0, 2023-08-11T12:40:28.077 INFO:teuthology.orchestra.run.smithi008.stdout: "poolop_active": 0, 2023-08-11T12:40:28.078 INFO:teuthology.orchestra.run.smithi008.stdout: "poolop_send": 0, 2023-08-11T12:40:28.078 INFO:teuthology.orchestra.run.smithi008.stdout: "poolop_resend": 0, 2023-08-11T12:40:28.078 INFO:teuthology.orchestra.run.smithi008.stdout: "poolstat_active": 0, 2023-08-11T12:40:28.078 INFO:teuthology.orchestra.run.smithi008.stdout: "poolstat_send": 0, 2023-08-11T12:40:28.078 INFO:teuthology.orchestra.run.smithi008.stdout: "poolstat_resend": 0, 2023-08-11T12:40:28.079 INFO:teuthology.orchestra.run.smithi008.stdout: "statfs_active": 0, 2023-08-11T12:40:28.079 INFO:teuthology.orchestra.run.smithi008.stdout: "statfs_send": 0, 2023-08-11T12:40:28.079 INFO:teuthology.orchestra.run.smithi008.stdout: "statfs_resend": 0, 2023-08-11T12:40:28.079 INFO:teuthology.orchestra.run.smithi008.stdout: "command_active": 0, 2023-08-11T12:40:28.079 INFO:teuthology.orchestra.run.smithi008.stdout: "command_send": 0, 2023-08-11T12:40:28.080 INFO:teuthology.orchestra.run.smithi008.stdout: "command_resend": 0, 2023-08-11T12:40:28.080 INFO:teuthology.orchestra.run.smithi008.stdout: "map_epoch": 110, 2023-08-11T12:40:28.080 INFO:teuthology.orchestra.run.smithi008.stdout: "map_full": 0, 2023-08-11T12:40:28.080 INFO:teuthology.orchestra.run.smithi008.stdout: "map_inc": 21, 2023-08-11T12:40:28.080 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_sessions": 6, 2023-08-11T12:40:28.081 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_session_open": 8, 2023-08-11T12:40:28.081 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_session_close": 2, 2023-08-11T12:40:28.081 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_laggy": 0, 2023-08-11T12:40:28.081 INFO:teuthology.orchestra.run.smithi008.stdout: "omap_wr": 0, 2023-08-11T12:40:28.081 INFO:teuthology.orchestra.run.smithi008.stdout: "omap_rd": 2, 2023-08-11T12:40:28.082 INFO:teuthology.orchestra.run.smithi008.stdout: "omap_del": 0 2023-08-11T12:40:28.082 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.082 INFO:teuthology.orchestra.run.smithi008.stdout: "oft": { 2023-08-11T12:40:28.082 INFO:teuthology.orchestra.run.smithi008.stdout: "omap_total_objs": 0, 2023-08-11T12:40:28.082 INFO:teuthology.orchestra.run.smithi008.stdout: "omap_total_kv_pairs": 0, 2023-08-11T12:40:28.083 INFO:teuthology.orchestra.run.smithi008.stdout: "omap_total_updates": 0, 2023-08-11T12:40:28.083 INFO:teuthology.orchestra.run.smithi008.stdout: "omap_total_removes": 0 2023-08-11T12:40:28.083 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.083 INFO:teuthology.orchestra.run.smithi008.stdout: "osd-slow-ops": { 2023-08-11T12:40:28.083 INFO:teuthology.orchestra.run.smithi008.stdout: "slow_ops_count": 0 2023-08-11T12:40:28.084 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.084 INFO:teuthology.orchestra.run.smithi008.stdout: "purge_queue": { 2023-08-11T12:40:28.084 INFO:teuthology.orchestra.run.smithi008.stdout: "pq_executing_ops": 0, 2023-08-11T12:40:28.084 INFO:teuthology.orchestra.run.smithi008.stdout: "pq_executing_ops_high_water": 0, 2023-08-11T12:40:28.084 INFO:teuthology.orchestra.run.smithi008.stdout: "pq_executing": 0, 2023-08-11T12:40:28.085 INFO:teuthology.orchestra.run.smithi008.stdout: "pq_executing_high_water": 0, 2023-08-11T12:40:28.085 INFO:teuthology.orchestra.run.smithi008.stdout: "pq_executed": 0, 2023-08-11T12:40:28.085 INFO:teuthology.orchestra.run.smithi008.stdout: "pq_item_in_journal": 0 2023-08-11T12:40:28.085 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.085 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-11T12:40:28.086 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2023-08-11T12:40:28.086 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 104857600, 2023-08-11T12:40:28.086 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2023-08-11T12:40:28.086 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 3529, 2023-08-11T12:40:28.086 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 4514833, 2023-08-11T12:40:28.087 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:28.087 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 3529, 2023-08-11T12:40:28.087 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 0, 2023-08-11T12:40:28.087 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 0, 2023-08-11T12:40:28.087 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 3529, 2023-08-11T12:40:28.088 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 4514833, 2023-08-11T12:40:28.088 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2023-08-11T12:40:28.088 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.088 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.089 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.089 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:28.089 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.089 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-objecter_bytes": { 2023-08-11T12:40:28.089 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2023-08-11T12:40:28.089 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 104857600, 2023-08-11T12:40:28.090 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2023-08-11T12:40:28.090 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 0, 2023-08-11T12:40:28.090 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 0, 2023-08-11T12:40:28.090 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:28.090 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:28.091 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 3166, 2023-08-11T12:40:28.091 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 2307223, 2023-08-11T12:40:28.091 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 3166, 2023-08-11T12:40:28.091 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 2307223, 2023-08-11T12:40:28.092 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2023-08-11T12:40:28.092 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.092 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.092 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.092 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:28.093 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.093 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-objecter_ops": { 2023-08-11T12:40:28.093 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2023-08-11T12:40:28.093 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 1024, 2023-08-11T12:40:28.093 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2023-08-11T12:40:28.094 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 0, 2023-08-11T12:40:28.094 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 0, 2023-08-11T12:40:28.094 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:28.094 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:28.094 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 3166, 2023-08-11T12:40:28.095 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 3166, 2023-08-11T12:40:28.095 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 3166, 2023-08-11T12:40:28.095 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 3166, 2023-08-11T12:40:28.095 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2023-08-11T12:40:28.095 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.096 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.096 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.096 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:28.096 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.096 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-write_buf_throttle": { 2023-08-11T12:40:28.097 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2023-08-11T12:40:28.097 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 3758096384, 2023-08-11T12:40:28.097 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2023-08-11T12:40:28.097 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 0, 2023-08-11T12:40:28.097 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 0, 2023-08-11T12:40:28.098 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:28.098 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:28.098 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 0, 2023-08-11T12:40:28.098 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 0, 2023-08-11T12:40:28.098 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 0, 2023-08-11T12:40:28.099 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 0, 2023-08-11T12:40:28.099 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2023-08-11T12:40:28.099 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.099 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.099 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.100 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:28.100 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:28.100 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-write_buf_throttle-0x562050c900a0": { 2023-08-11T12:40:28.100 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2023-08-11T12:40:28.100 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 3758096384, 2023-08-11T12:40:28.101 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2023-08-11T12:40:28.101 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 0, 2023-08-11T12:40:28.101 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 0, 2023-08-11T12:40:28.101 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:28.101 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:28.102 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 0, 2023-08-11T12:40:28.102 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 0, 2023-08-11T12:40:28.102 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 0, 2023-08-11T12:40:28.102 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 0, 2023-08-11T12:40:28.102 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2023-08-11T12:40:28.102 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:28.103 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:28.103 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:28.103 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:28.103 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:28.103 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:40:28.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:27 smithi008 ceph-mon[97158]: pgmap v498: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:40:28.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:27 smithi194 ceph-mon[130905]: pgmap v498: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:40:28.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:27 smithi045 ceph-mon[130284]: pgmap v498: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-08-11T12:40:28.510 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2023-08-11T12:40:28.510 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2023-08-11T12:40:28.511 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2023-08-11T12:40:28.511 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2023-08-11T12:40:28.511 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2023-08-11T12:40:28.511 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2023-08-11T12:40:28.512 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2023-08-11T12:40:28.512 DEBUG:tasks.check_counter:Getting stats from j 2023-08-11T12:40:28.512 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph daemon mds.j perf dump 2023-08-11T12:40:29.250 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.a/config 2023-08-11T12:40:30.302 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:30 smithi008 ceph-mon[97158]: pgmap v499: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:40:30.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:30 smithi194 ceph-mon[130905]: pgmap v499: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:40:30.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:30 smithi045 ceph-mon[130284]: pgmap v499: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-11T12:40:31.156 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-11T12:40:31.156 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-0": { 2023-08-11T12:40:31.156 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 314, 2023-08-11T12:40:31.157 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 304, 2023-08-11T12:40:31.157 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 1437840, 2023-08-11T12:40:31.158 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 182864, 2023-08-11T12:40:31.158 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 4, 2023-08-11T12:40:31.159 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 0, 2023-08-11T12:40:31.159 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.073245092, 2023-08-11T12:40:31.159 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.028747432, 2023-08-11T12:40:31.160 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.041230383, 2023-08-11T12:40:31.160 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.006933434, 2023-08-11T12:40:31.161 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:31.161 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 303, 2023-08-11T12:40:31.161 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.023126738, 2023-08-11T12:40:31.161 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000076325 2023-08-11T12:40:31.161 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:31.162 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:31.162 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:31.162 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:31.162 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:31.162 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:31.163 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 1437840, 2023-08-11T12:40:31.163 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 182864 2023-08-11T12:40:31.163 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:31.163 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-1": { 2023-08-11T12:40:31.163 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 3, 2023-08-11T12:40:31.164 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 232, 2023-08-11T12:40:31.164 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 480, 2023-08-11T12:40:31.164 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 269696, 2023-08-11T12:40:31.164 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 6, 2023-08-11T12:40:31.164 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 3, 2023-08-11T12:40:31.165 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.028075305, 2023-08-11T12:40:31.165 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.019626855, 2023-08-11T12:40:31.165 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.003579509, 2023-08-11T12:40:31.166 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-08-11T12:40:31.166 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:31.166 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 229, 2023-08-11T12:40:31.166 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.024662457, 2023-08-11T12:40:31.166 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000107696 2023-08-11T12:40:31.167 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:31.167 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:31.167 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:31.167 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:31.167 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:31.168 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:31.168 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 480, 2023-08-11T12:40:31.168 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 269696 2023-08-11T12:40:31.168 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:31.168 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-2": { 2023-08-11T12:40:31.169 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 4, 2023-08-11T12:40:31.169 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 4, 2023-08-11T12:40:31.169 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 2992, 2023-08-11T12:40:31.169 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 448, 2023-08-11T12:40:31.169 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 2, 2023-08-11T12:40:31.170 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 1, 2023-08-11T12:40:31.170 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.001342704, 2023-08-11T12:40:31.170 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.000070514, 2023-08-11T12:40:31.170 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.001254430, 2023-08-11T12:40:31.170 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-08-11T12:40:31.171 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:31.171 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 3, 2023-08-11T12:40:31.171 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.001143387, 2023-08-11T12:40:31.171 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000381129 2023-08-11T12:40:31.171 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:31.171 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:31.172 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:31.172 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:31.172 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:31.172 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:31.172 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-08-11T12:40:31.173 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 448 2023-08-11T12:40:31.173 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:31.173 INFO:teuthology.orchestra.run.smithi008.stdout: "cct": { 2023-08-11T12:40:31.173 INFO:teuthology.orchestra.run.smithi008.stdout: "total_workers": 0, 2023-08-11T12:40:31.173 INFO:teuthology.orchestra.run.smithi008.stdout: "unhealthy_workers": 0 2023-08-11T12:40:31.174 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:31.174 INFO:teuthology.orchestra.run.smithi008.stdout: "mempool": { 2023-08-11T12:40:31.174 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_bytes": 0, 2023-08-11T12:40:31.174 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_items": 0, 2023-08-11T12:40:31.174 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_bytes": 0, 2023-08-11T12:40:31.175 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_items": 0, 2023-08-11T12:40:31.175 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_bytes": 0, 2023-08-11T12:40:31.175 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_items": 0, 2023-08-11T12:40:31.175 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-11T12:40:31.176 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_items": 0, 2023-08-11T12:40:31.177 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-11T12:40:31.177 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_items": 0, 2023-08-11T12:40:31.177 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_bytes": 0, 2023-08-11T12:40:31.177 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_items": 0, 2023-08-11T12:40:31.177 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-11T12:40:31.178 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_items": 0, 2023-08-11T12:40:31.178 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_bytes": 0, 2023-08-11T12:40:31.178 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_items": 0, 2023-08-11T12:40:31.178 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_bytes": 0, 2023-08-11T12:40:31.178 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_items": 0, 2023-08-11T12:40:31.179 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-11T12:40:31.179 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_items": 0, 2023-08-11T12:40:31.179 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-11T12:40:31.179 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_items": 0, 2023-08-11T12:40:31.179 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_bytes": 0, 2023-08-11T12:40:31.180 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_items": 0, 2023-08-11T12:40:31.180 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_bytes": 0, 2023-08-11T12:40:31.180 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_items": 0, 2023-08-11T12:40:31.180 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-11T12:40:31.180 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_items": 0, 2023-08-11T12:40:31.181 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_bytes": 0, 2023-08-11T12:40:31.181 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_items": 0, 2023-08-11T12:40:31.181 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_bytes": 0, 2023-08-11T12:40:31.181 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_items": 0, 2023-08-11T12:40:31.181 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_bytes": 0, 2023-08-11T12:40:31.181 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_items": 0, 2023-08-11T12:40:31.182 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_bytes": 0, 2023-08-11T12:40:31.182 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_items": 0, 2023-08-11T12:40:31.182 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_bytes": 147930, 2023-08-11T12:40:31.182 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_items": 28, 2023-08-11T12:40:31.182 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_bytes": 0, 2023-08-11T12:40:31.183 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_items": 0, 2023-08-11T12:40:31.183 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_bytes": 0, 2023-08-11T12:40:31.183 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_items": 0, 2023-08-11T12:40:31.183 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_bytes": 0, 2023-08-11T12:40:31.183 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_items": 0, 2023-08-11T12:40:31.184 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_bytes": 0, 2023-08-11T12:40:31.184 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_items": 0, 2023-08-11T12:40:31.184 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_bytes": 0, 2023-08-11T12:40:31.184 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_items": 0, 2023-08-11T12:40:31.185 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_bytes": 0, 2023-08-11T12:40:31.185 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_items": 0, 2023-08-11T12:40:31.185 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_bytes": 0, 2023-08-11T12:40:31.185 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_items": 0, 2023-08-11T12:40:31.185 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_bytes": 928, 2023-08-11T12:40:31.186 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_items": 2, 2023-08-11T12:40:31.186 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_bytes": 0, 2023-08-11T12:40:31.186 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_items": 0, 2023-08-11T12:40:31.187 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_bytes": 0, 2023-08-11T12:40:31.187 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_items": 0 2023-08-11T12:40:31.187 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-11T12:40:31.187 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-11T12:40:31.187 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2023-08-11T12:40:31.188 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 104857600, 2023-08-11T12:40:31.188 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2023-08-11T12:40:31.188 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 317, 2023-08-11T12:40:31.188 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 1393537, 2023-08-11T12:40:31.189 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:31.189 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 317, 2023-08-11T12:40:31.189 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 0, 2023-08-11T12:40:31.189 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 0, 2023-08-11T12:40:31.189 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 317, 2023-08-11T12:40:31.189 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 1393537, 2023-08-11T12:40:31.190 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2023-08-11T12:40:31.190 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-08-11T12:40:31.190 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-08-11T12:40:31.190 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-08-11T12:40:31.190 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:31.191 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-11T12:40:31.191 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-11T12:40:31.748 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2023-08-11T12:40:31.748 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2023-08-11T12:40:31.748 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2023-08-11T12:40:31.749 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2023-08-11T12:40:31.749 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2023-08-11T12:40:31.749 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2023-08-11T12:40:31.749 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2023-08-11T12:40:31.750 DEBUG:tasks.check_counter:Getting stats from b 2023-08-11T12:40:31.750 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph daemon mds.b perf dump 2023-08-11T12:40:32.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:32 smithi045 ceph-mon[130284]: pgmap v500: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:32.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:32 smithi008 ceph-mon[97158]: pgmap v500: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:32.379 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.b/config 2023-08-11T12:40:32.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:32 smithi194 ceph-mon[130905]: pgmap v500: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:33.756 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-08-11T12:40:33.757 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-0": { 2023-08-11T12:40:33.757 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 5338173, 2023-08-11T12:40:33.757 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 5337764, 2023-08-11T12:40:33.758 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 845546136, 2023-08-11T12:40:33.758 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 875789142, 2023-08-11T12:40:33.758 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 23, 2023-08-11T12:40:33.758 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 5, 2023-08-11T12:40:33.759 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 218.520744543, 2023-08-11T12:40:33.759 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 91.775252543, 2023-08-11T12:40:33.759 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 153.561581610, 2023-08-11T12:40:33.759 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.561785720, 2023-08-11T12:40:33.759 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:33.760 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 5337763, 2023-08-11T12:40:33.760 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 55.818481950, 2023-08-11T12:40:33.760 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000010457 2023-08-11T12:40:33.760 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.761 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:33.761 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 10670179, 2023-08-11T12:40:33.761 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 1.152633975, 2023-08-11T12:40:33.761 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000108 2023-08-11T12:40:33.761 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.762 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 493024, 2023-08-11T12:40:33.762 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 155408 2023-08-11T12:40:33.762 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.763 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-1": { 2023-08-11T12:40:33.763 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 3393, 2023-08-11T12:40:33.763 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 3838, 2023-08-11T12:40:33.763 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 1366021, 2023-08-11T12:40:33.763 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 4332662, 2023-08-11T12:40:33.764 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 12, 2023-08-11T12:40:33.764 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 6, 2023-08-11T12:40:33.764 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.395657859, 2023-08-11T12:40:33.764 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.083190139, 2023-08-11T12:40:33.764 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.095767086, 2023-08-11T12:40:33.765 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.214742034, 2023-08-11T12:40:33.765 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:33.765 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 3837, 2023-08-11T12:40:33.765 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 3.586492833, 2023-08-11T12:40:33.765 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000934712 2023-08-11T12:40:33.766 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.766 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:33.766 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 3979, 2023-08-11T12:40:33.766 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000903069, 2023-08-11T12:40:33.766 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000226 2023-08-11T12:40:33.767 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.767 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 43216, 2023-08-11T12:40:33.767 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 570608 2023-08-11T12:40:33.767 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.767 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-2": { 2023-08-11T12:40:33.768 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 10091, 2023-08-11T12:40:33.768 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 13857, 2023-08-11T12:40:33.768 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 5291486, 2023-08-11T12:40:33.769 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 9356445, 2023-08-11T12:40:33.769 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 107, 2023-08-11T12:40:33.769 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 7, 2023-08-11T12:40:33.769 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.748526892, 2023-08-11T12:40:33.769 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.265992651, 2023-08-11T12:40:33.770 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.538951027, 2023-08-11T12:40:33.770 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.107307485, 2023-08-11T12:40:33.770 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:33.770 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 13854, 2023-08-11T12:40:33.770 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 1.253005231, 2023-08-11T12:40:33.770 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000090443 2023-08-11T12:40:33.771 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.771 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:33.771 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 18291, 2023-08-11T12:40:33.771 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.003544984, 2023-08-11T12:40:33.771 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000193 2023-08-11T12:40:33.772 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.772 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 3436720, 2023-08-11T12:40:33.772 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 4832016 2023-08-11T12:40:33.773 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.773 INFO:teuthology.orchestra.run.smithi045.stdout: "cct": { 2023-08-11T12:40:33.773 INFO:teuthology.orchestra.run.smithi045.stdout: "total_workers": 1, 2023-08-11T12:40:33.773 INFO:teuthology.orchestra.run.smithi045.stdout: "unhealthy_workers": 0 2023-08-11T12:40:33.774 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.774 INFO:teuthology.orchestra.run.smithi045.stdout: "finisher-MDSRank": { 2023-08-11T12:40:33.774 INFO:teuthology.orchestra.run.smithi045.stdout: "queue_len": 0, 2023-08-11T12:40:33.774 INFO:teuthology.orchestra.run.smithi045.stdout: "complete_latency": { 2023-08-11T12:40:33.774 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 2992, 2023-08-11T12:40:33.775 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 3.921119684, 2023-08-11T12:40:33.775 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.001310534 2023-08-11T12:40:33.775 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:33.775 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.775 INFO:teuthology.orchestra.run.smithi045.stdout: "finisher-PurgeQueue": { 2023-08-11T12:40:33.776 INFO:teuthology.orchestra.run.smithi045.stdout: "queue_len": 0, 2023-08-11T12:40:33.776 INFO:teuthology.orchestra.run.smithi045.stdout: "complete_latency": { 2023-08-11T12:40:33.776 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 112, 2023-08-11T12:40:33.776 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.017624540, 2023-08-11T12:40:33.776 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000157361 2023-08-11T12:40:33.777 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:33.777 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.777 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2023-08-11T12:40:33.777 INFO:teuthology.orchestra.run.smithi045.stdout: "request": 2222, 2023-08-11T12:40:33.777 INFO:teuthology.orchestra.run.smithi045.stdout: "reply": 2037, 2023-08-11T12:40:33.778 INFO:teuthology.orchestra.run.smithi045.stdout: "reply_latency": { 2023-08-11T12:40:33.778 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 2037, 2023-08-11T12:40:33.778 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 8.427910641, 2023-08-11T12:40:33.778 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.004137413 2023-08-11T12:40:33.778 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.779 INFO:teuthology.orchestra.run.smithi045.stdout: "slow_reply": 0, 2023-08-11T12:40:33.779 INFO:teuthology.orchestra.run.smithi045.stdout: "forward": 185, 2023-08-11T12:40:33.779 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_fetch_complete": 1, 2023-08-11T12:40:33.779 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_fetch_keys": 0, 2023-08-11T12:40:33.780 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_commit": 234, 2023-08-11T12:40:33.780 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_split": 8, 2023-08-11T12:40:33.780 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_merge": 0, 2023-08-11T12:40:33.780 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes": 700, 2023-08-11T12:40:33.780 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_top": 354, 2023-08-11T12:40:33.781 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_bottom": 327, 2023-08-11T12:40:33.781 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_pin_tail": 19, 2023-08-11T12:40:33.781 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_pinned": 78, 2023-08-11T12:40:33.781 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_expired": 1716, 2023-08-11T12:40:33.781 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_with_caps": 31, 2023-08-11T12:40:33.782 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": 32, 2023-08-11T12:40:33.782 INFO:teuthology.orchestra.run.smithi045.stdout: "subtrees": 117, 2023-08-11T12:40:33.782 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse": 3130, 2023-08-11T12:40:33.782 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_hit": 2247, 2023-08-11T12:40:33.782 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_forward": 167, 2023-08-11T12:40:33.783 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_discover": 11, 2023-08-11T12:40:33.783 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_dir_fetch": 0, 2023-08-11T12:40:33.783 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_remote_ino": 0, 2023-08-11T12:40:33.784 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_lock": 151, 2023-08-11T12:40:33.784 INFO:teuthology.orchestra.run.smithi045.stdout: "load_cent": 0, 2023-08-11T12:40:33.784 INFO:teuthology.orchestra.run.smithi045.stdout: "q": 0, 2023-08-11T12:40:33.784 INFO:teuthology.orchestra.run.smithi045.stdout: "exported": 68, 2023-08-11T12:40:33.785 INFO:teuthology.orchestra.run.smithi045.stdout: "exported_inodes": 1682, 2023-08-11T12:40:33.785 INFO:teuthology.orchestra.run.smithi045.stdout: "imported": 41, 2023-08-11T12:40:33.785 INFO:teuthology.orchestra.run.smithi045.stdout: "imported_inodes": 724, 2023-08-11T12:40:33.785 INFO:teuthology.orchestra.run.smithi045.stdout: "openino_dir_fetch": 0, 2023-08-11T12:40:33.785 INFO:teuthology.orchestra.run.smithi045.stdout: "openino_backtrace_fetch": 1264, 2023-08-11T12:40:33.786 INFO:teuthology.orchestra.run.smithi045.stdout: "openino_peer_discover": 0, 2023-08-11T12:40:33.786 INFO:teuthology.orchestra.run.smithi045.stdout: "root_rfiles": 1003, 2023-08-11T12:40:33.786 INFO:teuthology.orchestra.run.smithi045.stdout: "root_rbytes": 5502265756, 2023-08-11T12:40:33.786 INFO:teuthology.orchestra.run.smithi045.stdout: "root_rsnaps": 6, 2023-08-11T12:40:33.786 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_backtrace_fetch": 1264, 2023-08-11T12:40:33.787 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_set_tag": 0, 2023-08-11T12:40:33.788 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_backtrace_repaired": 0, 2023-08-11T12:40:33.788 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_inotable_repaired": 0, 2023-08-11T12:40:33.788 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_dir_inodes": 52, 2023-08-11T12:40:33.789 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_dir_base_inodes": 3, 2023-08-11T12:40:33.789 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_dirfrag_rstats": 49, 2023-08-11T12:40:33.790 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_file_inodes": 1212, 2023-08-11T12:40:33.790 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_inode_file_caps": 30, 2023-08-11T12:40:33.790 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_revoke": 994, 2023-08-11T12:40:33.791 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_grant": 2504, 2023-08-11T12:40:33.791 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_trunc": 0, 2023-08-11T12:40:33.792 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-11T12:40:33.792 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-11T12:40:33.792 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_caps": 2314, 2023-08-11T12:40:33.793 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_caps_dirty": 858, 2023-08-11T12:40:33.793 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_cap_release": 30, 2023-08-11T12:40:33.794 INFO:teuthology.orchestra.run.smithi045.stdout: "process_request_cap_release": 207 2023-08-11T12:40:33.794 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.794 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_cache": { 2023-08-11T12:40:33.795 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_update": 196, 2023-08-11T12:40:33.795 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_update_receipt": 0, 2023-08-11T12:40:33.795 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_try_discover": 0, 2023-08-11T12:40:33.795 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_send_discover": 11, 2023-08-11T12:40:33.796 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_handle_discover": 487, 2023-08-11T12:40:33.796 INFO:teuthology.orchestra.run.smithi045.stdout: "num_strays": 5, 2023-08-11T12:40:33.796 INFO:teuthology.orchestra.run.smithi045.stdout: "num_strays_delayed": 0, 2023-08-11T12:40:33.796 INFO:teuthology.orchestra.run.smithi045.stdout: "num_strays_enqueuing": 0, 2023-08-11T12:40:33.796 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_created": 46, 2023-08-11T12:40:33.797 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_enqueued": 29, 2023-08-11T12:40:33.797 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_reintegrated": 44, 2023-08-11T12:40:33.797 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_migrated": 5, 2023-08-11T12:40:33.797 INFO:teuthology.orchestra.run.smithi045.stdout: "num_recovering_processing": 0, 2023-08-11T12:40:33.797 INFO:teuthology.orchestra.run.smithi045.stdout: "num_recovering_enqueued": 0, 2023-08-11T12:40:33.798 INFO:teuthology.orchestra.run.smithi045.stdout: "num_recovering_prioritized": 0, 2023-08-11T12:40:33.798 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_started": 0, 2023-08-11T12:40:33.798 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_completed": 0, 2023-08-11T12:40:33.798 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_enqueue_scrub": 3, 2023-08-11T12:40:33.798 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_exportdir": 68, 2023-08-11T12:40:33.799 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_flush": 0, 2023-08-11T12:40:33.799 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_fragmentdir": 8, 2023-08-11T12:40:33.799 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_fragstats": 0, 2023-08-11T12:40:33.799 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_inodestats": 0 2023-08-11T12:40:33.799 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.800 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_log": { 2023-08-11T12:40:33.800 INFO:teuthology.orchestra.run.smithi045.stdout: "evlrg": 0, 2023-08-11T12:40:33.800 INFO:teuthology.orchestra.run.smithi045.stdout: "evadd": 4683, 2023-08-11T12:40:33.800 INFO:teuthology.orchestra.run.smithi045.stdout: "evex": 2542, 2023-08-11T12:40:33.800 INFO:teuthology.orchestra.run.smithi045.stdout: "evtrm": 2542, 2023-08-11T12:40:33.801 INFO:teuthology.orchestra.run.smithi045.stdout: "ev": 2141, 2023-08-11T12:40:33.801 INFO:teuthology.orchestra.run.smithi045.stdout: "evexg": 0, 2023-08-11T12:40:33.801 INFO:teuthology.orchestra.run.smithi045.stdout: "evexd": 51, 2023-08-11T12:40:33.801 INFO:teuthology.orchestra.run.smithi045.stdout: "segadd": 18, 2023-08-11T12:40:33.801 INFO:teuthology.orchestra.run.smithi045.stdout: "segex": 14, 2023-08-11T12:40:33.802 INFO:teuthology.orchestra.run.smithi045.stdout: "segtrm": 14, 2023-08-11T12:40:33.802 INFO:teuthology.orchestra.run.smithi045.stdout: "seg": 4, 2023-08-11T12:40:33.802 INFO:teuthology.orchestra.run.smithi045.stdout: "segmjr": 1, 2023-08-11T12:40:33.802 INFO:teuthology.orchestra.run.smithi045.stdout: "segexg": 0, 2023-08-11T12:40:33.803 INFO:teuthology.orchestra.run.smithi045.stdout: "segexd": 1, 2023-08-11T12:40:33.803 INFO:teuthology.orchestra.run.smithi045.stdout: "expos": 10865830, 2023-08-11T12:40:33.803 INFO:teuthology.orchestra.run.smithi045.stdout: "wrpos": 18717804, 2023-08-11T12:40:33.803 INFO:teuthology.orchestra.run.smithi045.stdout: "rdpos": 0, 2023-08-11T12:40:33.803 INFO:teuthology.orchestra.run.smithi045.stdout: "jlat": { 2023-08-11T12:40:33.804 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 1839, 2023-08-11T12:40:33.804 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 16.489491251, 2023-08-11T12:40:33.804 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.008966553 2023-08-11T12:40:33.804 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.805 INFO:teuthology.orchestra.run.smithi045.stdout: "replayed": 0 2023-08-11T12:40:33.805 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.805 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_mem": { 2023-08-11T12:40:33.805 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 691, 2023-08-11T12:40:33.805 INFO:teuthology.orchestra.run.smithi045.stdout: "ino+": 2382, 2023-08-11T12:40:33.806 INFO:teuthology.orchestra.run.smithi045.stdout: "ino-": 1691, 2023-08-11T12:40:33.806 INFO:teuthology.orchestra.run.smithi045.stdout: "dir": 184, 2023-08-11T12:40:33.806 INFO:teuthology.orchestra.run.smithi045.stdout: "dir+": 212, 2023-08-11T12:40:33.806 INFO:teuthology.orchestra.run.smithi045.stdout: "dir-": 28, 2023-08-11T12:40:33.806 INFO:teuthology.orchestra.run.smithi045.stdout: "dn": 701, 2023-08-11T12:40:33.806 INFO:teuthology.orchestra.run.smithi045.stdout: "dn+": 2793, 2023-08-11T12:40:33.807 INFO:teuthology.orchestra.run.smithi045.stdout: "dn-": 2092, 2023-08-11T12:40:33.807 INFO:teuthology.orchestra.run.smithi045.stdout: "cap": 32, 2023-08-11T12:40:33.807 INFO:teuthology.orchestra.run.smithi045.stdout: "cap+": 1533, 2023-08-11T12:40:33.807 INFO:teuthology.orchestra.run.smithi045.stdout: "cap-": 1501, 2023-08-11T12:40:33.807 INFO:teuthology.orchestra.run.smithi045.stdout: "rss": 71448, 2023-08-11T12:40:33.808 INFO:teuthology.orchestra.run.smithi045.stdout: "heap": 207152 2023-08-11T12:40:33.808 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.808 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_server": { 2023-08-11T12:40:33.808 INFO:teuthology.orchestra.run.smithi045.stdout: "dispatch_client_request": 2811, 2023-08-11T12:40:33.809 INFO:teuthology.orchestra.run.smithi045.stdout: "dispatch_server_request": 402, 2023-08-11T12:40:33.809 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_request": 2222, 2023-08-11T12:40:33.809 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_session": 349, 2023-08-11T12:40:33.809 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_peer_request": 526, 2023-08-11T12:40:33.809 INFO:teuthology.orchestra.run.smithi045.stdout: "req_create_latency": { 2023-08-11T12:40:33.810 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 997, 2023-08-11T12:40:33.810 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 4.386931964, 2023-08-11T12:40:33.810 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.004400132 2023-08-11T12:40:33.810 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.810 INFO:teuthology.orchestra.run.smithi045.stdout: "req_getattr_latency": { 2023-08-11T12:40:33.811 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 213, 2023-08-11T12:40:33.811 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.344969763, 2023-08-11T12:40:33.811 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.001619576 2023-08-11T12:40:33.811 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.811 INFO:teuthology.orchestra.run.smithi045.stdout: "req_getfilelock_latency": { 2023-08-11T12:40:33.812 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:33.812 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:33.812 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:33.812 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.812 INFO:teuthology.orchestra.run.smithi045.stdout: "req_link_latency": { 2023-08-11T12:40:33.813 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 11, 2023-08-11T12:40:33.813 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.131242381, 2023-08-11T12:40:33.813 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.011931125 2023-08-11T12:40:33.813 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.814 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookup_latency": { 2023-08-11T12:40:33.814 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 69, 2023-08-11T12:40:33.814 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.131090130, 2023-08-11T12:40:33.814 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.001899856 2023-08-11T12:40:33.814 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.815 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookuphash_latency": { 2023-08-11T12:40:33.815 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:33.815 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:33.815 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:33.815 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.816 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupino_latency": { 2023-08-11T12:40:33.816 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:33.816 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:33.816 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:33.816 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.817 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupname_latency": { 2023-08-11T12:40:33.817 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:33.817 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:33.817 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:33.817 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.818 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupparent_latency": { 2023-08-11T12:40:33.818 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:33.818 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:33.818 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:33.818 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.819 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupsnap_latency": { 2023-08-11T12:40:33.819 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:33.819 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:33.819 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:33.819 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.820 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lssnap_latency": { 2023-08-11T12:40:33.820 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 16, 2023-08-11T12:40:33.820 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.003689071, 2023-08-11T12:40:33.820 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000230566 2023-08-11T12:40:33.821 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.821 INFO:teuthology.orchestra.run.smithi045.stdout: "req_mkdir_latency": { 2023-08-11T12:40:33.821 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 28, 2023-08-11T12:40:33.821 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.085694442, 2023-08-11T12:40:33.821 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.003060515 2023-08-11T12:40:33.822 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.822 INFO:teuthology.orchestra.run.smithi045.stdout: "req_mknod_latency": { 2023-08-11T12:40:33.822 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:33.822 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:33.822 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:33.823 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.823 INFO:teuthology.orchestra.run.smithi045.stdout: "req_mksnap_latency": { 2023-08-11T12:40:33.823 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 16, 2023-08-11T12:40:33.823 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.770704855, 2023-08-11T12:40:33.824 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.048169053 2023-08-11T12:40:33.824 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.824 INFO:teuthology.orchestra.run.smithi045.stdout: "req_open_latency": { 2023-08-11T12:40:33.824 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 484, 2023-08-11T12:40:33.824 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.168191639, 2023-08-11T12:40:33.825 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000347503 2023-08-11T12:40:33.825 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.825 INFO:teuthology.orchestra.run.smithi045.stdout: "req_readdir_latency": { 2023-08-11T12:40:33.825 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 89, 2023-08-11T12:40:33.826 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.657439810, 2023-08-11T12:40:33.826 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.007386964 2023-08-11T12:40:33.826 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.826 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rename_latency": { 2023-08-11T12:40:33.826 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 63, 2023-08-11T12:40:33.827 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 1.496028391, 2023-08-11T12:40:33.827 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.023746482 2023-08-11T12:40:33.827 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.827 INFO:teuthology.orchestra.run.smithi045.stdout: "req_renamesnap_latency": { 2023-08-11T12:40:33.827 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:33.827 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:33.828 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:33.828 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.828 INFO:teuthology.orchestra.run.smithi045.stdout: "req_snapdiff_latency": { 2023-08-11T12:40:33.828 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:33.829 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:33.829 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:33.829 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.829 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rmdir_latency": { 2023-08-11T12:40:33.829 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:33.830 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:33.830 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:33.830 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.830 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rmsnap_latency": { 2023-08-11T12:40:33.830 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 10, 2023-08-11T12:40:33.830 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.053813158, 2023-08-11T12:40:33.831 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.005381315 2023-08-11T12:40:33.831 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.831 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rmxattr_latency": { 2023-08-11T12:40:33.831 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:33.831 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:33.832 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:33.832 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.832 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setattr_latency": { 2023-08-11T12:40:33.832 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 1, 2023-08-11T12:40:33.832 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000398077, 2023-08-11T12:40:33.833 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000398077 2023-08-11T12:40:33.833 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.833 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setdirlayout_latency": { 2023-08-11T12:40:33.833 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:33.833 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:33.834 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:33.834 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.834 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setfilelock_latency": { 2023-08-11T12:40:33.834 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:33.834 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:33.835 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:33.835 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.835 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setlayout_latency": { 2023-08-11T12:40:33.835 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:33.835 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:33.836 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:33.836 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.836 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setxattr_latency": { 2023-08-11T12:40:33.836 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 1, 2023-08-11T12:40:33.836 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.002813084, 2023-08-11T12:40:33.837 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.002813084 2023-08-11T12:40:33.837 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.837 INFO:teuthology.orchestra.run.smithi045.stdout: "req_symlink_latency": { 2023-08-11T12:40:33.837 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:33.837 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:33.838 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:33.838 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.838 INFO:teuthology.orchestra.run.smithi045.stdout: "req_unlink_latency": { 2023-08-11T12:40:33.838 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 39, 2023-08-11T12:40:33.838 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.194903876, 2023-08-11T12:40:33.839 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.004997535 2023-08-11T12:40:33.839 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.839 INFO:teuthology.orchestra.run.smithi045.stdout: "cap_revoke_eviction": 0, 2023-08-11T12:40:33.839 INFO:teuthology.orchestra.run.smithi045.stdout: "cap_acquisition_throttle": 0, 2023-08-11T12:40:33.839 INFO:teuthology.orchestra.run.smithi045.stdout: "req_getvxattr_latency": { 2023-08-11T12:40:33.840 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:33.840 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:33.840 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:33.840 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:33.840 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.841 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_sessions": { 2023-08-11T12:40:33.841 INFO:teuthology.orchestra.run.smithi045.stdout: "session_count": 2, 2023-08-11T12:40:33.841 INFO:teuthology.orchestra.run.smithi045.stdout: "session_add": 5, 2023-08-11T12:40:33.841 INFO:teuthology.orchestra.run.smithi045.stdout: "session_remove": 3, 2023-08-11T12:40:33.841 INFO:teuthology.orchestra.run.smithi045.stdout: "sessions_open": 2, 2023-08-11T12:40:33.842 INFO:teuthology.orchestra.run.smithi045.stdout: "sessions_stale": 0, 2023-08-11T12:40:33.842 INFO:teuthology.orchestra.run.smithi045.stdout: "total_load": 28, 2023-08-11T12:40:33.842 INFO:teuthology.orchestra.run.smithi045.stdout: "average_load": 14, 2023-08-11T12:40:33.842 INFO:teuthology.orchestra.run.smithi045.stdout: "avg_session_uptime": 943 2023-08-11T12:40:33.843 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.843 INFO:teuthology.orchestra.run.smithi045.stdout: "mempool": { 2023-08-11T12:40:33.843 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_bytes": 0, 2023-08-11T12:40:33.843 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_items": 0, 2023-08-11T12:40:33.843 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_bytes": 0, 2023-08-11T12:40:33.844 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_items": 0, 2023-08-11T12:40:33.844 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_bytes": 0, 2023-08-11T12:40:33.844 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_items": 0, 2023-08-11T12:40:33.844 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-11T12:40:33.844 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_items": 0, 2023-08-11T12:40:33.845 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-11T12:40:33.845 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_items": 0, 2023-08-11T12:40:33.845 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_bytes": 0, 2023-08-11T12:40:33.845 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_items": 0, 2023-08-11T12:40:33.845 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-11T12:40:33.846 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_items": 0, 2023-08-11T12:40:33.846 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_bytes": 0, 2023-08-11T12:40:33.846 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_items": 0, 2023-08-11T12:40:33.846 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_bytes": 0, 2023-08-11T12:40:33.846 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_items": 0, 2023-08-11T12:40:33.847 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-11T12:40:33.847 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_items": 0, 2023-08-11T12:40:33.847 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-11T12:40:33.847 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_items": 0, 2023-08-11T12:40:33.847 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_bytes": 0, 2023-08-11T12:40:33.848 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_items": 0, 2023-08-11T12:40:33.848 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_bytes": 0, 2023-08-11T12:40:33.848 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_items": 0, 2023-08-11T12:40:33.848 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-11T12:40:33.848 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_items": 0, 2023-08-11T12:40:33.849 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_bytes": 0, 2023-08-11T12:40:33.849 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_items": 0, 2023-08-11T12:40:33.849 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_bytes": 0, 2023-08-11T12:40:33.849 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_items": 0, 2023-08-11T12:40:33.849 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_bytes": 0, 2023-08-11T12:40:33.850 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_items": 0, 2023-08-11T12:40:33.850 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_bytes": 0, 2023-08-11T12:40:33.850 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_items": 0, 2023-08-11T12:40:33.850 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_bytes": 444185, 2023-08-11T12:40:33.850 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_items": 635, 2023-08-11T12:40:33.851 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_bytes": 528, 2023-08-11T12:40:33.851 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_items": 6, 2023-08-11T12:40:33.851 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_bytes": 0, 2023-08-11T12:40:33.851 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_items": 0, 2023-08-11T12:40:33.852 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_bytes": 0, 2023-08-11T12:40:33.852 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_items": 0, 2023-08-11T12:40:33.852 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_bytes": 0, 2023-08-11T12:40:33.852 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_items": 0, 2023-08-11T12:40:33.852 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_bytes": 9320, 2023-08-11T12:40:33.853 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_items": 178, 2023-08-11T12:40:33.853 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_bytes": 0, 2023-08-11T12:40:33.853 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_items": 0, 2023-08-11T12:40:33.853 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_bytes": 0, 2023-08-11T12:40:33.854 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_items": 0, 2023-08-11T12:40:33.854 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_bytes": 2424898, 2023-08-11T12:40:33.854 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_items": 24364, 2023-08-11T12:40:33.854 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_bytes": 0, 2023-08-11T12:40:33.855 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_items": 0, 2023-08-11T12:40:33.855 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_bytes": 0, 2023-08-11T12:40:33.855 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_items": 0 2023-08-11T12:40:33.855 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.855 INFO:teuthology.orchestra.run.smithi045.stdout: "objecter": { 2023-08-11T12:40:33.856 INFO:teuthology.orchestra.run.smithi045.stdout: "op_active": 0, 2023-08-11T12:40:33.856 INFO:teuthology.orchestra.run.smithi045.stdout: "op_laggy": 0, 2023-08-11T12:40:33.856 INFO:teuthology.orchestra.run.smithi045.stdout: "op_send": 5402, 2023-08-11T12:40:33.856 INFO:teuthology.orchestra.run.smithi045.stdout: "op_send_bytes": 16557399, 2023-08-11T12:40:33.856 INFO:teuthology.orchestra.run.smithi045.stdout: "op_resend": 37, 2023-08-11T12:40:33.857 INFO:teuthology.orchestra.run.smithi045.stdout: "op_reply": 5402, 2023-08-11T12:40:33.857 INFO:teuthology.orchestra.run.smithi045.stdout: "op_latency": { 2023-08-11T12:40:33.857 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 5402, 2023-08-11T12:40:33.857 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 136.610855228, 2023-08-11T12:40:33.857 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.025288940 2023-08-11T12:40:33.858 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.858 INFO:teuthology.orchestra.run.smithi045.stdout: "op_inflight": 0, 2023-08-11T12:40:33.858 INFO:teuthology.orchestra.run.smithi045.stdout: "oplen_avg": { 2023-08-11T12:40:33.858 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 5402, 2023-08-11T12:40:33.858 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 8529 2023-08-11T12:40:33.859 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.859 INFO:teuthology.orchestra.run.smithi045.stdout: "op": 5402, 2023-08-11T12:40:33.859 INFO:teuthology.orchestra.run.smithi045.stdout: "op_r": 1285, 2023-08-11T12:40:33.859 INFO:teuthology.orchestra.run.smithi045.stdout: "op_w": 4117, 2023-08-11T12:40:33.859 INFO:teuthology.orchestra.run.smithi045.stdout: "op_rmw": 0, 2023-08-11T12:40:33.860 INFO:teuthology.orchestra.run.smithi045.stdout: "op_pg": 0, 2023-08-11T12:40:33.860 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_stat": 130, 2023-08-11T12:40:33.860 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_create": 1808, 2023-08-11T12:40:33.860 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_read": 16, 2023-08-11T12:40:33.860 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_write": 1852, 2023-08-11T12:40:33.861 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_writefull": 87, 2023-08-11T12:40:33.861 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_writesame": 0, 2023-08-11T12:40:33.861 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_append": 0, 2023-08-11T12:40:33.861 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_zero": 0, 2023-08-11T12:40:33.862 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_truncate": 3, 2023-08-11T12:40:33.862 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_delete": 79, 2023-08-11T12:40:33.862 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_mapext": 0, 2023-08-11T12:40:33.862 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_sparse_read": 0, 2023-08-11T12:40:33.862 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_clonerange": 0, 2023-08-11T12:40:33.863 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_getxattr": 1267, 2023-08-11T12:40:33.863 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_setxattr": 2739, 2023-08-11T12:40:33.863 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_cmpxattr": 0, 2023-08-11T12:40:33.863 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_rmxattr": 0, 2023-08-11T12:40:33.863 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_resetxattrs": 0, 2023-08-11T12:40:33.864 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_call": 0, 2023-08-11T12:40:33.864 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_watch": 0, 2023-08-11T12:40:33.864 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_notify": 0, 2023-08-11T12:40:33.864 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_src_cmpxattr": 0, 2023-08-11T12:40:33.864 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_pgls": 0, 2023-08-11T12:40:33.865 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_pgls_filter": 0, 2023-08-11T12:40:33.865 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_other": 0, 2023-08-11T12:40:33.865 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_active": 0, 2023-08-11T12:40:33.865 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_send": 0, 2023-08-11T12:40:33.865 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_resend": 0, 2023-08-11T12:40:33.866 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_ping": 0, 2023-08-11T12:40:33.866 INFO:teuthology.orchestra.run.smithi045.stdout: "poolop_active": 0, 2023-08-11T12:40:33.866 INFO:teuthology.orchestra.run.smithi045.stdout: "poolop_send": 0, 2023-08-11T12:40:33.866 INFO:teuthology.orchestra.run.smithi045.stdout: "poolop_resend": 0, 2023-08-11T12:40:33.866 INFO:teuthology.orchestra.run.smithi045.stdout: "poolstat_active": 0, 2023-08-11T12:40:33.867 INFO:teuthology.orchestra.run.smithi045.stdout: "poolstat_send": 0, 2023-08-11T12:40:33.867 INFO:teuthology.orchestra.run.smithi045.stdout: "poolstat_resend": 0, 2023-08-11T12:40:33.867 INFO:teuthology.orchestra.run.smithi045.stdout: "statfs_active": 0, 2023-08-11T12:40:33.867 INFO:teuthology.orchestra.run.smithi045.stdout: "statfs_send": 0, 2023-08-11T12:40:33.867 INFO:teuthology.orchestra.run.smithi045.stdout: "statfs_resend": 0, 2023-08-11T12:40:33.868 INFO:teuthology.orchestra.run.smithi045.stdout: "command_active": 0, 2023-08-11T12:40:33.868 INFO:teuthology.orchestra.run.smithi045.stdout: "command_send": 0, 2023-08-11T12:40:33.868 INFO:teuthology.orchestra.run.smithi045.stdout: "command_resend": 0, 2023-08-11T12:40:33.868 INFO:teuthology.orchestra.run.smithi045.stdout: "map_epoch": 110, 2023-08-11T12:40:33.868 INFO:teuthology.orchestra.run.smithi045.stdout: "map_full": 0, 2023-08-11T12:40:33.869 INFO:teuthology.orchestra.run.smithi045.stdout: "map_inc": 28, 2023-08-11T12:40:33.869 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_sessions": 12, 2023-08-11T12:40:33.869 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_session_open": 12, 2023-08-11T12:40:33.869 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_session_close": 0, 2023-08-11T12:40:33.869 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_laggy": 0, 2023-08-11T12:40:33.870 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_wr": 491, 2023-08-11T12:40:33.870 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_rd": 3, 2023-08-11T12:40:33.870 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_del": 54 2023-08-11T12:40:33.870 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.870 INFO:teuthology.orchestra.run.smithi045.stdout: "oft": { 2023-08-11T12:40:33.871 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_objs": 1, 2023-08-11T12:40:33.871 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_kv_pairs": 0, 2023-08-11T12:40:33.871 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_updates": 0, 2023-08-11T12:40:33.871 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_removes": 0 2023-08-11T12:40:33.871 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.872 INFO:teuthology.orchestra.run.smithi045.stdout: "osd-slow-ops": { 2023-08-11T12:40:33.872 INFO:teuthology.orchestra.run.smithi045.stdout: "slow_ops_count": 4 2023-08-11T12:40:33.872 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.872 INFO:teuthology.orchestra.run.smithi045.stdout: "purge_queue": { 2023-08-11T12:40:33.872 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing_ops": 0, 2023-08-11T12:40:33.873 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing_ops_high_water": 10, 2023-08-11T12:40:33.873 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing": 0, 2023-08-11T12:40:33.873 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing_high_water": 5, 2023-08-11T12:40:33.873 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executed": 29, 2023-08-11T12:40:33.873 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_item_in_journal": 0 2023-08-11T12:40:33.874 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.874 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-11T12:40:33.874 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2023-08-11T12:40:33.874 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 104857600, 2023-08-11T12:40:33.875 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2023-08-11T12:40:33.875 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 5351655, 2023-08-11T12:40:33.875 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 370255783, 2023-08-11T12:40:33.875 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:33.875 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 5351655, 2023-08-11T12:40:33.876 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2023-08-11T12:40:33.876 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2023-08-11T12:40:33.876 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 5351655, 2023-08-11T12:40:33.876 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 370255783, 2023-08-11T12:40:33.876 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2023-08-11T12:40:33.877 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:33.877 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:33.877 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:33.877 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:33.877 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.877 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-objecter_bytes": { 2023-08-11T12:40:33.878 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2023-08-11T12:40:33.878 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 104857600, 2023-08-11T12:40:33.878 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2023-08-11T12:40:33.878 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 0, 2023-08-11T12:40:33.878 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 0, 2023-08-11T12:40:33.879 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:33.879 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:33.879 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 5402, 2023-08-11T12:40:33.879 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 16560567, 2023-08-11T12:40:33.879 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 5402, 2023-08-11T12:40:33.880 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 16560567, 2023-08-11T12:40:33.880 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2023-08-11T12:40:33.880 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:33.880 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:33.881 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:33.881 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:33.881 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.881 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-objecter_ops": { 2023-08-11T12:40:33.881 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2023-08-11T12:40:33.882 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 1024, 2023-08-11T12:40:33.882 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2023-08-11T12:40:33.882 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 0, 2023-08-11T12:40:33.882 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 0, 2023-08-11T12:40:33.882 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:33.883 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:33.883 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 5402, 2023-08-11T12:40:33.883 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 5402, 2023-08-11T12:40:33.883 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 5402, 2023-08-11T12:40:33.883 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 5402, 2023-08-11T12:40:33.884 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2023-08-11T12:40:33.884 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:33.884 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:33.884 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:33.884 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:33.885 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.885 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-write_buf_throttle": { 2023-08-11T12:40:33.885 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2023-08-11T12:40:33.885 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 3758096384, 2023-08-11T12:40:33.885 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2023-08-11T12:40:33.886 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 29, 2023-08-11T12:40:33.886 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 3209, 2023-08-11T12:40:33.886 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:33.886 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 29, 2023-08-11T12:40:33.886 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2023-08-11T12:40:33.887 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2023-08-11T12:40:33.887 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 13, 2023-08-11T12:40:33.887 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 3209, 2023-08-11T12:40:33.887 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2023-08-11T12:40:33.887 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:33.888 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:33.888 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:33.888 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:33.888 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:33.888 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-write_buf_throttle-0x5563a7478000": { 2023-08-11T12:40:33.889 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2023-08-11T12:40:33.889 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 3758096384, 2023-08-11T12:40:33.889 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2023-08-11T12:40:33.889 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 4683, 2023-08-11T12:40:33.889 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 14523500, 2023-08-11T12:40:33.890 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:33.890 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 4683, 2023-08-11T12:40:33.890 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2023-08-11T12:40:33.890 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2023-08-11T12:40:33.890 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 1839, 2023-08-11T12:40:33.891 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 14523500, 2023-08-11T12:40:33.891 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2023-08-11T12:40:33.891 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:33.891 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:33.891 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:33.892 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:33.892 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:33.892 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-08-11T12:40:34.145 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:34 smithi045 ceph-mon[130284]: pgmap v501: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:40:34.146 INFO:tasks.check_counter:Daemon mds.b mds.exported=68 2023-08-11T12:40:34.147 INFO:tasks.check_counter:Daemon mds.b mds.imported=41 2023-08-11T12:40:34.147 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=196 2023-08-11T12:40:34.147 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2023-08-11T12:40:34.148 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2023-08-11T12:40:34.148 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=16 2023-08-11T12:40:34.148 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=10 2023-08-11T12:40:34.149 DEBUG:tasks.check_counter:Getting stats from e 2023-08-11T12:40:34.149 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph daemon mds.e perf dump 2023-08-11T12:40:34.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:34 smithi008 ceph-mon[97158]: pgmap v501: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:40:34.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:34 smithi194 ceph-mon[130905]: pgmap v501: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:40:34.772 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.b/config 2023-08-11T12:40:36.221 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-08-11T12:40:36.222 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-0": { 2023-08-11T12:40:36.223 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 4903114, 2023-08-11T12:40:36.223 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 4902992, 2023-08-11T12:40:36.224 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 795607772, 2023-08-11T12:40:36.224 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 777603215, 2023-08-11T12:40:36.224 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 10, 2023-08-11T12:40:36.225 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 3, 2023-08-11T12:40:36.225 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 205.384328663, 2023-08-11T12:40:36.226 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 85.475550120, 2023-08-11T12:40:36.226 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 146.862624379, 2023-08-11T12:40:36.227 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.016312540, 2023-08-11T12:40:36.227 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:36.227 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 4902994, 2023-08-11T12:40:36.228 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 49.894312223, 2023-08-11T12:40:36.228 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000010176 2023-08-11T12:40:36.228 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.228 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:36.229 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 9804379, 2023-08-11T12:40:36.229 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 1.047666706, 2023-08-11T12:40:36.229 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000106 2023-08-11T12:40:36.229 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.229 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 0, 2023-08-11T12:40:36.230 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 0 2023-08-11T12:40:36.230 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.230 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-1": { 2023-08-11T12:40:36.230 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 1729, 2023-08-11T12:40:36.230 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 2937, 2023-08-11T12:40:36.231 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 744008, 2023-08-11T12:40:36.231 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 2286155, 2023-08-11T12:40:36.231 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 13, 2023-08-11T12:40:36.231 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 9, 2023-08-11T12:40:36.232 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.130166440, 2023-08-11T12:40:36.232 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.061895199, 2023-08-11T12:40:36.232 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.085098014, 2023-08-11T12:40:36.232 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.002029623, 2023-08-11T12:40:36.232 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:36.233 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 2932, 2023-08-11T12:40:36.233 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.372591003, 2023-08-11T12:40:36.233 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000127077 2023-08-11T12:40:36.233 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.233 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:36.234 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 3095, 2023-08-11T12:40:36.234 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000738649, 2023-08-11T12:40:36.234 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000238 2023-08-11T12:40:36.234 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.234 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 408784, 2023-08-11T12:40:36.235 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 1388464 2023-08-11T12:40:36.235 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.235 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-2": { 2023-08-11T12:40:36.236 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 680, 2023-08-11T12:40:36.236 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 851, 2023-08-11T12:40:36.236 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 1881743, 2023-08-11T12:40:36.236 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 968096, 2023-08-11T12:40:36.237 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 18, 2023-08-11T12:40:36.237 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 7, 2023-08-11T12:40:36.237 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.076710996, 2023-08-11T12:40:36.237 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.025438573, 2023-08-11T12:40:36.237 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.054515369, 2023-08-11T12:40:36.238 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.008128787, 2023-08-11T12:40:36.238 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:36.238 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 849, 2023-08-11T12:40:36.238 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.049781321, 2023-08-11T12:40:36.238 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000058635 2023-08-11T12:40:36.239 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.239 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:36.239 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 405, 2023-08-11T12:40:36.239 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000084079, 2023-08-11T12:40:36.239 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000207 2023-08-11T12:40:36.240 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.240 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 1678448, 2023-08-11T12:40:36.240 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 623552 2023-08-11T12:40:36.240 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.241 INFO:teuthology.orchestra.run.smithi045.stdout: "cct": { 2023-08-11T12:40:36.241 INFO:teuthology.orchestra.run.smithi045.stdout: "total_workers": 1, 2023-08-11T12:40:36.241 INFO:teuthology.orchestra.run.smithi045.stdout: "unhealthy_workers": 0 2023-08-11T12:40:36.241 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.241 INFO:teuthology.orchestra.run.smithi045.stdout: "finisher-MDSRank": { 2023-08-11T12:40:36.242 INFO:teuthology.orchestra.run.smithi045.stdout: "queue_len": 0, 2023-08-11T12:40:36.242 INFO:teuthology.orchestra.run.smithi045.stdout: "complete_latency": { 2023-08-11T12:40:36.242 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 811, 2023-08-11T12:40:36.242 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.683149001, 2023-08-11T12:40:36.242 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000842353 2023-08-11T12:40:36.243 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:36.243 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.243 INFO:teuthology.orchestra.run.smithi045.stdout: "finisher-PurgeQueue": { 2023-08-11T12:40:36.243 INFO:teuthology.orchestra.run.smithi045.stdout: "queue_len": 0, 2023-08-11T12:40:36.243 INFO:teuthology.orchestra.run.smithi045.stdout: "complete_latency": { 2023-08-11T12:40:36.244 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 22, 2023-08-11T12:40:36.244 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000665558, 2023-08-11T12:40:36.244 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000030252 2023-08-11T12:40:36.244 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:36.245 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.245 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2023-08-11T12:40:36.245 INFO:teuthology.orchestra.run.smithi045.stdout: "request": 178, 2023-08-11T12:40:36.245 INFO:teuthology.orchestra.run.smithi045.stdout: "reply": 126, 2023-08-11T12:40:36.245 INFO:teuthology.orchestra.run.smithi045.stdout: "reply_latency": { 2023-08-11T12:40:36.246 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 126, 2023-08-11T12:40:36.246 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 152.323157685, 2023-08-11T12:40:36.246 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 1.208913949 2023-08-11T12:40:36.246 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.246 INFO:teuthology.orchestra.run.smithi045.stdout: "slow_reply": 0, 2023-08-11T12:40:36.247 INFO:teuthology.orchestra.run.smithi045.stdout: "forward": 52, 2023-08-11T12:40:36.247 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_fetch_complete": 0, 2023-08-11T12:40:36.247 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_fetch_keys": 0, 2023-08-11T12:40:36.247 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_commit": 51, 2023-08-11T12:40:36.247 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_split": 5, 2023-08-11T12:40:36.248 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_merge": 0, 2023-08-11T12:40:36.248 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes": 692, 2023-08-11T12:40:36.248 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_top": 343, 2023-08-11T12:40:36.248 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_bottom": 349, 2023-08-11T12:40:36.249 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_pin_tail": 0, 2023-08-11T12:40:36.249 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_pinned": 117, 2023-08-11T12:40:36.249 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_expired": 523, 2023-08-11T12:40:36.249 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_with_caps": 5, 2023-08-11T12:40:36.249 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": 5, 2023-08-11T12:40:36.250 INFO:teuthology.orchestra.run.smithi045.stdout: "subtrees": 110, 2023-08-11T12:40:36.250 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse": 1817, 2023-08-11T12:40:36.250 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_hit": 1461, 2023-08-11T12:40:36.250 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_forward": 52, 2023-08-11T12:40:36.250 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_discover": 24, 2023-08-11T12:40:36.251 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_dir_fetch": 0, 2023-08-11T12:40:36.251 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_remote_ino": 0, 2023-08-11T12:40:36.251 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_lock": 239, 2023-08-11T12:40:36.251 INFO:teuthology.orchestra.run.smithi045.stdout: "load_cent": 0, 2023-08-11T12:40:36.252 INFO:teuthology.orchestra.run.smithi045.stdout: "q": 0, 2023-08-11T12:40:36.252 INFO:teuthology.orchestra.run.smithi045.stdout: "exported": 6, 2023-08-11T12:40:36.252 INFO:teuthology.orchestra.run.smithi045.stdout: "exported_inodes": 512, 2023-08-11T12:40:36.252 INFO:teuthology.orchestra.run.smithi045.stdout: "imported": 13, 2023-08-11T12:40:36.252 INFO:teuthology.orchestra.run.smithi045.stdout: "imported_inodes": 645, 2023-08-11T12:40:36.253 INFO:teuthology.orchestra.run.smithi045.stdout: "openino_dir_fetch": 0, 2023-08-11T12:40:36.253 INFO:teuthology.orchestra.run.smithi045.stdout: "openino_backtrace_fetch": 117, 2023-08-11T12:40:36.253 INFO:teuthology.orchestra.run.smithi045.stdout: "openino_peer_discover": 17, 2023-08-11T12:40:36.253 INFO:teuthology.orchestra.run.smithi045.stdout: "root_rfiles": 1003, 2023-08-11T12:40:36.253 INFO:teuthology.orchestra.run.smithi045.stdout: "root_rbytes": 5502265756, 2023-08-11T12:40:36.254 INFO:teuthology.orchestra.run.smithi045.stdout: "root_rsnaps": 4, 2023-08-11T12:40:36.254 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_backtrace_fetch": 117, 2023-08-11T12:40:36.254 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_set_tag": 0, 2023-08-11T12:40:36.254 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_backtrace_repaired": 0, 2023-08-11T12:40:36.255 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_inotable_repaired": 0, 2023-08-11T12:40:36.255 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_dir_inodes": 0, 2023-08-11T12:40:36.255 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_dir_base_inodes": 0, 2023-08-11T12:40:36.255 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_dirfrag_rstats": 0, 2023-08-11T12:40:36.255 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_file_inodes": 117, 2023-08-11T12:40:36.256 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_inode_file_caps": 6, 2023-08-11T12:40:36.256 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_revoke": 535, 2023-08-11T12:40:36.256 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_grant": 852, 2023-08-11T12:40:36.256 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_trunc": 0, 2023-08-11T12:40:36.256 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-11T12:40:36.257 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-11T12:40:36.257 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_caps": 853, 2023-08-11T12:40:36.257 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_caps_dirty": 56, 2023-08-11T12:40:36.258 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_cap_release": 12, 2023-08-11T12:40:36.258 INFO:teuthology.orchestra.run.smithi045.stdout: "process_request_cap_release": 38 2023-08-11T12:40:36.259 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.259 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_cache": { 2023-08-11T12:40:36.259 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_update": 32, 2023-08-11T12:40:36.260 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_update_receipt": 232, 2023-08-11T12:40:36.260 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_try_discover": 125, 2023-08-11T12:40:36.261 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_send_discover": 201, 2023-08-11T12:40:36.261 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_handle_discover": 38, 2023-08-11T12:40:36.262 INFO:teuthology.orchestra.run.smithi045.stdout: "num_strays": 4, 2023-08-11T12:40:36.262 INFO:teuthology.orchestra.run.smithi045.stdout: "num_strays_delayed": 0, 2023-08-11T12:40:36.263 INFO:teuthology.orchestra.run.smithi045.stdout: "num_strays_enqueuing": 0, 2023-08-11T12:40:36.263 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_created": 4, 2023-08-11T12:40:36.264 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_enqueued": 2, 2023-08-11T12:40:36.264 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_reintegrated": 35, 2023-08-11T12:40:36.265 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_migrated": 0, 2023-08-11T12:40:36.265 INFO:teuthology.orchestra.run.smithi045.stdout: "num_recovering_processing": 0, 2023-08-11T12:40:36.265 INFO:teuthology.orchestra.run.smithi045.stdout: "num_recovering_enqueued": 0, 2023-08-11T12:40:36.266 INFO:teuthology.orchestra.run.smithi045.stdout: "num_recovering_prioritized": 0, 2023-08-11T12:40:36.266 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_started": 0, 2023-08-11T12:40:36.266 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_completed": 0, 2023-08-11T12:40:36.267 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_enqueue_scrub": 0, 2023-08-11T12:40:36.267 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_exportdir": 6, 2023-08-11T12:40:36.268 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_flush": 0, 2023-08-11T12:40:36.268 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_fragmentdir": 5, 2023-08-11T12:40:36.269 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_fragstats": 0, 2023-08-11T12:40:36.269 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_inodestats": 0 2023-08-11T12:40:36.269 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.270 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_log": { 2023-08-11T12:40:36.270 INFO:teuthology.orchestra.run.smithi045.stdout: "evlrg": 0, 2023-08-11T12:40:36.270 INFO:teuthology.orchestra.run.smithi045.stdout: "evadd": 1676, 2023-08-11T12:40:36.271 INFO:teuthology.orchestra.run.smithi045.stdout: "evex": 0, 2023-08-11T12:40:36.271 INFO:teuthology.orchestra.run.smithi045.stdout: "evtrm": 0, 2023-08-11T12:40:36.271 INFO:teuthology.orchestra.run.smithi045.stdout: "ev": 1676, 2023-08-11T12:40:36.272 INFO:teuthology.orchestra.run.smithi045.stdout: "evexg": 0, 2023-08-11T12:40:36.272 INFO:teuthology.orchestra.run.smithi045.stdout: "evexd": 0, 2023-08-11T12:40:36.272 INFO:teuthology.orchestra.run.smithi045.stdout: "segadd": 3, 2023-08-11T12:40:36.273 INFO:teuthology.orchestra.run.smithi045.stdout: "segex": 0, 2023-08-11T12:40:36.273 INFO:teuthology.orchestra.run.smithi045.stdout: "segtrm": 0, 2023-08-11T12:40:36.273 INFO:teuthology.orchestra.run.smithi045.stdout: "seg": 3, 2023-08-11T12:40:36.274 INFO:teuthology.orchestra.run.smithi045.stdout: "segmjr": 2, 2023-08-11T12:40:36.274 INFO:teuthology.orchestra.run.smithi045.stdout: "segexg": 0, 2023-08-11T12:40:36.274 INFO:teuthology.orchestra.run.smithi045.stdout: "segexd": 0, 2023-08-11T12:40:36.275 INFO:teuthology.orchestra.run.smithi045.stdout: "expos": 4194304, 2023-08-11T12:40:36.275 INFO:teuthology.orchestra.run.smithi045.stdout: "wrpos": 7091667, 2023-08-11T12:40:36.276 INFO:teuthology.orchestra.run.smithi045.stdout: "rdpos": 0, 2023-08-11T12:40:36.276 INFO:teuthology.orchestra.run.smithi045.stdout: "jlat": { 2023-08-11T12:40:36.276 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 389, 2023-08-11T12:40:36.277 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 1.757412845, 2023-08-11T12:40:36.277 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.004517770 2023-08-11T12:40:36.277 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.278 INFO:teuthology.orchestra.run.smithi045.stdout: "replayed": 0 2023-08-11T12:40:36.278 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.278 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_mem": { 2023-08-11T12:40:36.279 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 659, 2023-08-11T12:40:36.279 INFO:teuthology.orchestra.run.smithi045.stdout: "ino+": 1173, 2023-08-11T12:40:36.280 INFO:teuthology.orchestra.run.smithi045.stdout: "ino-": 514, 2023-08-11T12:40:36.280 INFO:teuthology.orchestra.run.smithi045.stdout: "dir": 168, 2023-08-11T12:40:36.280 INFO:teuthology.orchestra.run.smithi045.stdout: "dir+": 250, 2023-08-11T12:40:36.281 INFO:teuthology.orchestra.run.smithi045.stdout: "dir-": 82, 2023-08-11T12:40:36.281 INFO:teuthology.orchestra.run.smithi045.stdout: "dn": 696, 2023-08-11T12:40:36.281 INFO:teuthology.orchestra.run.smithi045.stdout: "dn+": 1224, 2023-08-11T12:40:36.281 INFO:teuthology.orchestra.run.smithi045.stdout: "dn-": 528, 2023-08-11T12:40:36.282 INFO:teuthology.orchestra.run.smithi045.stdout: "cap": 5, 2023-08-11T12:40:36.282 INFO:teuthology.orchestra.run.smithi045.stdout: "cap+": 661, 2023-08-11T12:40:36.282 INFO:teuthology.orchestra.run.smithi045.stdout: "cap-": 656, 2023-08-11T12:40:36.283 INFO:teuthology.orchestra.run.smithi045.stdout: "rss": 63284, 2023-08-11T12:40:36.283 INFO:teuthology.orchestra.run.smithi045.stdout: "heap": 198960 2023-08-11T12:40:36.283 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.283 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_server": { 2023-08-11T12:40:36.284 INFO:teuthology.orchestra.run.smithi045.stdout: "dispatch_client_request": 1050, 2023-08-11T12:40:36.284 INFO:teuthology.orchestra.run.smithi045.stdout: "dispatch_server_request": 15, 2023-08-11T12:40:36.284 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_request": 178, 2023-08-11T12:40:36.284 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_session": 27, 2023-08-11T12:40:36.285 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_peer_request": 267, 2023-08-11T12:40:36.285 INFO:teuthology.orchestra.run.smithi045.stdout: "req_create_latency": { 2023-08-11T12:40:36.285 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 2, 2023-08-11T12:40:36.285 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.006589229, 2023-08-11T12:40:36.286 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.003294614 2023-08-11T12:40:36.286 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.286 INFO:teuthology.orchestra.run.smithi045.stdout: "req_getattr_latency": { 2023-08-11T12:40:36.286 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 2, 2023-08-11T12:40:36.286 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.002352243, 2023-08-11T12:40:36.287 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.001176121 2023-08-11T12:40:36.287 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.287 INFO:teuthology.orchestra.run.smithi045.stdout: "req_getfilelock_latency": { 2023-08-11T12:40:36.287 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:36.287 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:36.288 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:36.288 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.288 INFO:teuthology.orchestra.run.smithi045.stdout: "req_link_latency": { 2023-08-11T12:40:36.288 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 4, 2023-08-11T12:40:36.289 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.065789587, 2023-08-11T12:40:36.289 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.016447396 2023-08-11T12:40:36.289 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.289 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookup_latency": { 2023-08-11T12:40:36.289 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 37, 2023-08-11T12:40:36.290 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.019829771, 2023-08-11T12:40:36.290 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000535939 2023-08-11T12:40:36.290 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.290 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookuphash_latency": { 2023-08-11T12:40:36.291 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:36.291 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:36.291 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:36.291 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.291 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupino_latency": { 2023-08-11T12:40:36.292 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:36.292 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:36.292 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:36.292 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.293 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupname_latency": { 2023-08-11T12:40:36.293 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:36.293 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:36.293 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:36.293 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.294 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupparent_latency": { 2023-08-11T12:40:36.294 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:36.294 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:36.294 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:36.295 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.295 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupsnap_latency": { 2023-08-11T12:40:36.295 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:36.295 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:36.295 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:36.296 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.296 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lssnap_latency": { 2023-08-11T12:40:36.296 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:36.296 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:36.297 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:36.297 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.297 INFO:teuthology.orchestra.run.smithi045.stdout: "req_mkdir_latency": { 2023-08-11T12:40:36.297 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:36.297 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:36.298 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:36.298 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.298 INFO:teuthology.orchestra.run.smithi045.stdout: "req_mknod_latency": { 2023-08-11T12:40:36.298 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:36.298 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:36.299 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:36.299 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.299 INFO:teuthology.orchestra.run.smithi045.stdout: "req_mksnap_latency": { 2023-08-11T12:40:36.299 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:36.299 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:36.300 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:36.300 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.300 INFO:teuthology.orchestra.run.smithi045.stdout: "req_open_latency": { 2023-08-11T12:40:36.300 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 7, 2023-08-11T12:40:36.301 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.005832354, 2023-08-11T12:40:36.301 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000833193 2023-08-11T12:40:36.301 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.301 INFO:teuthology.orchestra.run.smithi045.stdout: "req_readdir_latency": { 2023-08-11T12:40:36.302 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 30, 2023-08-11T12:40:36.302 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 10.133303069, 2023-08-11T12:40:36.302 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.337776768 2023-08-11T12:40:36.302 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.302 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rename_latency": { 2023-08-11T12:40:36.303 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 40, 2023-08-11T12:40:36.303 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 142.067225898, 2023-08-11T12:40:36.303 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 3.551680647 2023-08-11T12:40:36.303 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.303 INFO:teuthology.orchestra.run.smithi045.stdout: "req_renamesnap_latency": { 2023-08-11T12:40:36.304 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:36.304 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:36.304 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:36.304 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.305 INFO:teuthology.orchestra.run.smithi045.stdout: "req_snapdiff_latency": { 2023-08-11T12:40:36.305 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:36.305 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:36.305 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:36.305 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.306 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rmdir_latency": { 2023-08-11T12:40:36.306 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:36.306 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:36.306 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:36.306 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.307 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rmsnap_latency": { 2023-08-11T12:40:36.307 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:36.307 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:36.307 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:36.307 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.308 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rmxattr_latency": { 2023-08-11T12:40:36.308 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:36.308 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:36.309 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:36.309 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.309 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setattr_latency": { 2023-08-11T12:40:36.310 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:36.310 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:36.311 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:36.311 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.311 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setdirlayout_latency": { 2023-08-11T12:40:36.312 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:36.312 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:36.313 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:36.313 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.314 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setfilelock_latency": { 2023-08-11T12:40:36.314 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:36.315 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:36.315 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:36.315 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.316 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setlayout_latency": { 2023-08-11T12:40:36.316 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:36.316 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:36.317 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:36.317 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.317 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setxattr_latency": { 2023-08-11T12:40:36.317 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:36.318 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:36.318 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:36.318 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.318 INFO:teuthology.orchestra.run.smithi045.stdout: "req_symlink_latency": { 2023-08-11T12:40:36.318 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:36.319 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:36.319 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:36.319 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.319 INFO:teuthology.orchestra.run.smithi045.stdout: "req_unlink_latency": { 2023-08-11T12:40:36.319 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 4, 2023-08-11T12:40:36.320 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.022235534, 2023-08-11T12:40:36.320 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.005558883 2023-08-11T12:40:36.320 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.320 INFO:teuthology.orchestra.run.smithi045.stdout: "cap_revoke_eviction": 0, 2023-08-11T12:40:36.321 INFO:teuthology.orchestra.run.smithi045.stdout: "cap_acquisition_throttle": 0, 2023-08-11T12:40:36.321 INFO:teuthology.orchestra.run.smithi045.stdout: "req_getvxattr_latency": { 2023-08-11T12:40:36.321 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:36.321 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:36.321 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:36.322 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:36.322 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.322 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_sessions": { 2023-08-11T12:40:36.323 INFO:teuthology.orchestra.run.smithi045.stdout: "session_count": 1, 2023-08-11T12:40:36.323 INFO:teuthology.orchestra.run.smithi045.stdout: "session_add": 2, 2023-08-11T12:40:36.323 INFO:teuthology.orchestra.run.smithi045.stdout: "session_remove": 1, 2023-08-11T12:40:36.323 INFO:teuthology.orchestra.run.smithi045.stdout: "sessions_open": 1, 2023-08-11T12:40:36.324 INFO:teuthology.orchestra.run.smithi045.stdout: "sessions_stale": 0, 2023-08-11T12:40:36.324 INFO:teuthology.orchestra.run.smithi045.stdout: "total_load": 66, 2023-08-11T12:40:36.324 INFO:teuthology.orchestra.run.smithi045.stdout: "average_load": 66, 2023-08-11T12:40:36.324 INFO:teuthology.orchestra.run.smithi045.stdout: "avg_session_uptime": 951 2023-08-11T12:40:36.325 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.325 INFO:teuthology.orchestra.run.smithi045.stdout: "mempool": { 2023-08-11T12:40:36.325 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_bytes": 0, 2023-08-11T12:40:36.326 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_items": 0, 2023-08-11T12:40:36.326 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_bytes": 0, 2023-08-11T12:40:36.327 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_items": 0, 2023-08-11T12:40:36.327 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_bytes": 0, 2023-08-11T12:40:36.327 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_items": 0, 2023-08-11T12:40:36.327 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-11T12:40:36.327 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_items": 0, 2023-08-11T12:40:36.328 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-11T12:40:36.328 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_items": 0, 2023-08-11T12:40:36.328 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_bytes": 0, 2023-08-11T12:40:36.328 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_items": 0, 2023-08-11T12:40:36.329 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-11T12:40:36.329 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_items": 0, 2023-08-11T12:40:36.329 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_bytes": 0, 2023-08-11T12:40:36.329 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_items": 0, 2023-08-11T12:40:36.329 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_bytes": 0, 2023-08-11T12:40:36.330 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_items": 0, 2023-08-11T12:40:36.330 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-11T12:40:36.330 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_items": 0, 2023-08-11T12:40:36.330 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-11T12:40:36.330 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_items": 0, 2023-08-11T12:40:36.331 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_bytes": 0, 2023-08-11T12:40:36.331 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_items": 0, 2023-08-11T12:40:36.331 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_bytes": 0, 2023-08-11T12:40:36.331 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_items": 0, 2023-08-11T12:40:36.331 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-11T12:40:36.332 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_items": 0, 2023-08-11T12:40:36.332 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_bytes": 0, 2023-08-11T12:40:36.332 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_items": 0, 2023-08-11T12:40:36.332 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_bytes": 0, 2023-08-11T12:40:36.333 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_items": 0, 2023-08-11T12:40:36.333 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_bytes": 0, 2023-08-11T12:40:36.333 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_items": 0, 2023-08-11T12:40:36.333 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_bytes": 0, 2023-08-11T12:40:36.333 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_items": 0, 2023-08-11T12:40:36.334 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_bytes": 441442, 2023-08-11T12:40:36.334 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_items": 399, 2023-08-11T12:40:36.334 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_bytes": 0, 2023-08-11T12:40:36.334 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_items": 0, 2023-08-11T12:40:36.335 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_bytes": 0, 2023-08-11T12:40:36.335 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_items": 0, 2023-08-11T12:40:36.335 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_bytes": 0, 2023-08-11T12:40:36.335 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_items": 0, 2023-08-11T12:40:36.335 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_bytes": 0, 2023-08-11T12:40:36.336 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_items": 0, 2023-08-11T12:40:36.336 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_bytes": 9320, 2023-08-11T12:40:36.336 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_items": 178, 2023-08-11T12:40:36.337 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_bytes": 0, 2023-08-11T12:40:36.337 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_items": 0, 2023-08-11T12:40:36.337 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_bytes": 0, 2023-08-11T12:40:36.337 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_items": 0, 2023-08-11T12:40:36.337 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_bytes": 2238679, 2023-08-11T12:40:36.338 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_items": 21131, 2023-08-11T12:40:36.338 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_bytes": 0, 2023-08-11T12:40:36.338 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_items": 0, 2023-08-11T12:40:36.338 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_bytes": 0, 2023-08-11T12:40:36.338 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_items": 0 2023-08-11T12:40:36.339 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.339 INFO:teuthology.orchestra.run.smithi045.stdout: "objecter": { 2023-08-11T12:40:36.339 INFO:teuthology.orchestra.run.smithi045.stdout: "op_active": 0, 2023-08-11T12:40:36.339 INFO:teuthology.orchestra.run.smithi045.stdout: "op_laggy": 0, 2023-08-11T12:40:36.340 INFO:teuthology.orchestra.run.smithi045.stdout: "op_send": 639, 2023-08-11T12:40:36.340 INFO:teuthology.orchestra.run.smithi045.stdout: "op_send_bytes": 3326690, 2023-08-11T12:40:36.340 INFO:teuthology.orchestra.run.smithi045.stdout: "op_resend": 33, 2023-08-11T12:40:36.340 INFO:teuthology.orchestra.run.smithi045.stdout: "op_reply": 639, 2023-08-11T12:40:36.340 INFO:teuthology.orchestra.run.smithi045.stdout: "op_latency": { 2023-08-11T12:40:36.341 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 639, 2023-08-11T12:40:36.341 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 1.840971096, 2023-08-11T12:40:36.341 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.002881018 2023-08-11T12:40:36.341 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.341 INFO:teuthology.orchestra.run.smithi045.stdout: "op_inflight": 0, 2023-08-11T12:40:36.342 INFO:teuthology.orchestra.run.smithi045.stdout: "oplen_avg": { 2023-08-11T12:40:36.342 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 639, 2023-08-11T12:40:36.342 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 729 2023-08-11T12:40:36.342 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.343 INFO:teuthology.orchestra.run.smithi045.stdout: "op": 639, 2023-08-11T12:40:36.343 INFO:teuthology.orchestra.run.smithi045.stdout: "op_r": 118, 2023-08-11T12:40:36.343 INFO:teuthology.orchestra.run.smithi045.stdout: "op_w": 521, 2023-08-11T12:40:36.343 INFO:teuthology.orchestra.run.smithi045.stdout: "op_rmw": 0, 2023-08-11T12:40:36.343 INFO:teuthology.orchestra.run.smithi045.stdout: "op_pg": 0, 2023-08-11T12:40:36.344 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_stat": 0, 2023-08-11T12:40:36.344 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_create": 10, 2023-08-11T12:40:36.344 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_read": 1, 2023-08-11T12:40:36.344 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_write": 390, 2023-08-11T12:40:36.344 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_writefull": 21, 2023-08-11T12:40:36.345 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_writesame": 0, 2023-08-11T12:40:36.345 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_append": 0, 2023-08-11T12:40:36.345 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_zero": 2, 2023-08-11T12:40:36.345 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_truncate": 0, 2023-08-11T12:40:36.345 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_delete": 23, 2023-08-11T12:40:36.346 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_mapext": 0, 2023-08-11T12:40:36.346 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_sparse_read": 0, 2023-08-11T12:40:36.346 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_clonerange": 0, 2023-08-11T12:40:36.347 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_getxattr": 117, 2023-08-11T12:40:36.347 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_setxattr": 20, 2023-08-11T12:40:36.347 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_cmpxattr": 0, 2023-08-11T12:40:36.347 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_rmxattr": 0, 2023-08-11T12:40:36.347 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_resetxattrs": 0, 2023-08-11T12:40:36.348 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_call": 0, 2023-08-11T12:40:36.348 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_watch": 0, 2023-08-11T12:40:36.348 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_notify": 0, 2023-08-11T12:40:36.348 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_src_cmpxattr": 0, 2023-08-11T12:40:36.349 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_pgls": 0, 2023-08-11T12:40:36.349 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_pgls_filter": 0, 2023-08-11T12:40:36.349 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_other": 0, 2023-08-11T12:40:36.349 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_active": 0, 2023-08-11T12:40:36.349 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_send": 0, 2023-08-11T12:40:36.350 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_resend": 0, 2023-08-11T12:40:36.350 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_ping": 0, 2023-08-11T12:40:36.350 INFO:teuthology.orchestra.run.smithi045.stdout: "poolop_active": 0, 2023-08-11T12:40:36.350 INFO:teuthology.orchestra.run.smithi045.stdout: "poolop_send": 0, 2023-08-11T12:40:36.351 INFO:teuthology.orchestra.run.smithi045.stdout: "poolop_resend": 0, 2023-08-11T12:40:36.351 INFO:teuthology.orchestra.run.smithi045.stdout: "poolstat_active": 0, 2023-08-11T12:40:36.351 INFO:teuthology.orchestra.run.smithi045.stdout: "poolstat_send": 0, 2023-08-11T12:40:36.352 INFO:teuthology.orchestra.run.smithi045.stdout: "poolstat_resend": 0, 2023-08-11T12:40:36.352 INFO:teuthology.orchestra.run.smithi045.stdout: "statfs_active": 0, 2023-08-11T12:40:36.352 INFO:teuthology.orchestra.run.smithi045.stdout: "statfs_send": 0, 2023-08-11T12:40:36.352 INFO:teuthology.orchestra.run.smithi045.stdout: "statfs_resend": 0, 2023-08-11T12:40:36.352 INFO:teuthology.orchestra.run.smithi045.stdout: "command_active": 0, 2023-08-11T12:40:36.353 INFO:teuthology.orchestra.run.smithi045.stdout: "command_send": 0, 2023-08-11T12:40:36.353 INFO:teuthology.orchestra.run.smithi045.stdout: "command_resend": 0, 2023-08-11T12:40:36.353 INFO:teuthology.orchestra.run.smithi045.stdout: "map_epoch": 110, 2023-08-11T12:40:36.353 INFO:teuthology.orchestra.run.smithi045.stdout: "map_full": 0, 2023-08-11T12:40:36.353 INFO:teuthology.orchestra.run.smithi045.stdout: "map_inc": 23, 2023-08-11T12:40:36.354 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_sessions": 12, 2023-08-11T12:40:36.354 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_session_open": 13, 2023-08-11T12:40:36.354 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_session_close": 1, 2023-08-11T12:40:36.354 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_laggy": 0, 2023-08-11T12:40:36.354 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_wr": 132, 2023-08-11T12:40:36.355 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_rd": 0, 2023-08-11T12:40:36.355 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_del": 13 2023-08-11T12:40:36.355 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.355 INFO:teuthology.orchestra.run.smithi045.stdout: "oft": { 2023-08-11T12:40:36.356 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_objs": 1, 2023-08-11T12:40:36.356 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_kv_pairs": 0, 2023-08-11T12:40:36.356 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_updates": 0, 2023-08-11T12:40:36.356 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_removes": 0 2023-08-11T12:40:36.356 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.357 INFO:teuthology.orchestra.run.smithi045.stdout: "osd-slow-ops": { 2023-08-11T12:40:36.357 INFO:teuthology.orchestra.run.smithi045.stdout: "slow_ops_count": 9 2023-08-11T12:40:36.357 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.357 INFO:teuthology.orchestra.run.smithi045.stdout: "purge_queue": { 2023-08-11T12:40:36.357 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing_ops": 0, 2023-08-11T12:40:36.358 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing_ops_high_water": 8, 2023-08-11T12:40:36.358 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing": 0, 2023-08-11T12:40:36.358 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing_high_water": 2, 2023-08-11T12:40:36.358 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executed": 2, 2023-08-11T12:40:36.359 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_item_in_journal": 0 2023-08-11T12:40:36.359 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.359 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-11T12:40:36.359 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2023-08-11T12:40:36.359 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 104857600, 2023-08-11T12:40:36.360 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2023-08-11T12:40:36.360 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 4905521, 2023-08-11T12:40:36.360 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 356669569, 2023-08-11T12:40:36.360 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:36.360 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 4905521, 2023-08-11T12:40:36.361 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2023-08-11T12:40:36.361 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2023-08-11T12:40:36.361 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 4905521, 2023-08-11T12:40:36.361 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 356669569, 2023-08-11T12:40:36.362 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2023-08-11T12:40:36.362 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:36.362 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:36.362 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:36.362 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:36.363 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.363 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-objecter_bytes": { 2023-08-11T12:40:36.363 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2023-08-11T12:40:36.363 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 104857600, 2023-08-11T12:40:36.363 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2023-08-11T12:40:36.364 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 0, 2023-08-11T12:40:36.364 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 0, 2023-08-11T12:40:36.364 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:36.364 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:36.365 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 639, 2023-08-11T12:40:36.365 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 3326924, 2023-08-11T12:40:36.365 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 639, 2023-08-11T12:40:36.365 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 3326924, 2023-08-11T12:40:36.366 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2023-08-11T12:40:36.366 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:36.366 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:36.366 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:36.366 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:36.367 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.367 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-objecter_ops": { 2023-08-11T12:40:36.367 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2023-08-11T12:40:36.367 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 1024, 2023-08-11T12:40:36.367 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2023-08-11T12:40:36.368 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 0, 2023-08-11T12:40:36.368 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 0, 2023-08-11T12:40:36.368 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:36.368 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:36.369 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 639, 2023-08-11T12:40:36.369 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 639, 2023-08-11T12:40:36.369 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 639, 2023-08-11T12:40:36.369 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 639, 2023-08-11T12:40:36.369 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2023-08-11T12:40:36.370 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:36.370 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:36.370 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:36.370 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:36.370 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.371 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-write_buf_throttle": { 2023-08-11T12:40:36.371 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2023-08-11T12:40:36.371 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 3758096384, 2023-08-11T12:40:36.371 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2023-08-11T12:40:36.371 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 2, 2023-08-11T12:40:36.372 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 234, 2023-08-11T12:40:36.372 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:36.372 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 2, 2023-08-11T12:40:36.373 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2023-08-11T12:40:36.373 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2023-08-11T12:40:36.373 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 1, 2023-08-11T12:40:36.373 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 234, 2023-08-11T12:40:36.373 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2023-08-11T12:40:36.374 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:36.374 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:36.374 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:36.374 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:36.374 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:36.375 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-write_buf_throttle-0x55752f2ae000": { 2023-08-11T12:40:36.375 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2023-08-11T12:40:36.375 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 3758096384, 2023-08-11T12:40:36.375 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2023-08-11T12:40:36.375 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 1676, 2023-08-11T12:40:36.376 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 2897363, 2023-08-11T12:40:36.376 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:36.376 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 1676, 2023-08-11T12:40:36.376 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2023-08-11T12:40:36.377 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2023-08-11T12:40:36.377 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 389, 2023-08-11T12:40:36.377 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 2897363, 2023-08-11T12:40:36.377 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2023-08-11T12:40:36.377 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:36.378 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:36.378 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:36.378 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:36.378 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:36.378 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-08-11T12:40:36.379 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:36 smithi008 ceph-mon[97158]: pgmap v502: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:36.380 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:36 smithi045 ceph-mon[130284]: pgmap v502: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:36.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:36 smithi194 ceph-mon[130905]: pgmap v502: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:36.735 INFO:tasks.check_counter:Daemon mds.e mds.exported=6 2023-08-11T12:40:36.735 INFO:tasks.check_counter:Daemon mds.e mds.imported=13 2023-08-11T12:40:36.736 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=32 2023-08-11T12:40:36.736 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=232 2023-08-11T12:40:36.736 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=4 2023-08-11T12:40:36.736 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2023-08-11T12:40:36.737 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2023-08-11T12:40:36.737 DEBUG:tasks.check_counter:Getting stats from h 2023-08-11T12:40:36.737 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph daemon mds.h perf dump 2023-08-11T12:40:37.327 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.b/config 2023-08-11T12:40:38.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:38 smithi008 ceph-mon[97158]: pgmap v503: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:38.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:38 smithi194 ceph-mon[130905]: pgmap v503: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:38.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:38 smithi045 ceph-mon[130284]: pgmap v503: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:40.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:40 smithi008 ceph-mon[97158]: pgmap v504: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:40:40.354 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:40 smithi045 ceph-mon[130284]: pgmap v504: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:40:40.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:40 smithi194 ceph-mon[130905]: pgmap v504: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:40:40.600 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-08-11T12:40:40.600 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-0": { 2023-08-11T12:40:40.600 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 2423, 2023-08-11T12:40:40.601 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 2379, 2023-08-11T12:40:40.601 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 6479262, 2023-08-11T12:40:40.601 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 823885, 2023-08-11T12:40:40.601 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 5, 2023-08-11T12:40:40.601 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 1, 2023-08-11T12:40:40.602 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.213270476, 2023-08-11T12:40:40.602 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.064993793, 2023-08-11T12:40:40.602 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.074060547, 2023-08-11T12:40:40.602 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.069322253, 2023-08-11T12:40:40.602 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:40.603 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 2378, 2023-08-11T12:40:40.603 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.060130410, 2023-08-11T12:40:40.603 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000025286 2023-08-11T12:40:40.603 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.604 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:40.604 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.604 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.604 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.604 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.605 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 1680304, 2023-08-11T12:40:40.605 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 187264 2023-08-11T12:40:40.605 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.605 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-1": { 2023-08-11T12:40:40.605 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 881, 2023-08-11T12:40:40.606 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 1107, 2023-08-11T12:40:40.606 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 2172478, 2023-08-11T12:40:40.606 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 821999, 2023-08-11T12:40:40.606 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 8, 2023-08-11T12:40:40.606 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 5, 2023-08-11T12:40:40.607 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.068049876, 2023-08-11T12:40:40.607 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.022904922, 2023-08-11T12:40:40.607 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.017670470, 2023-08-11T12:40:40.607 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.019969191, 2023-08-11T12:40:40.607 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:40.608 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 1105, 2023-08-11T12:40:40.608 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.035884201, 2023-08-11T12:40:40.608 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000032474 2023-08-11T12:40:40.608 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.608 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:40.609 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.609 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.609 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.609 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.609 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 3312, 2023-08-11T12:40:40.610 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 549808 2023-08-11T12:40:40.610 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.610 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-2": { 2023-08-11T12:40:40.610 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 527, 2023-08-11T12:40:40.610 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 529, 2023-08-11T12:40:40.611 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 8520916, 2023-08-11T12:40:40.611 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 163904, 2023-08-11T12:40:40.611 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 6, 2023-08-11T12:40:40.611 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 4, 2023-08-11T12:40:40.611 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.046280155, 2023-08-11T12:40:40.612 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.009219741, 2023-08-11T12:40:40.612 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.017756875, 2023-08-11T12:40:40.612 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.015783449, 2023-08-11T12:40:40.612 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:40.612 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 527, 2023-08-11T12:40:40.613 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.016268722, 2023-08-11T12:40:40.613 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000030870 2023-08-11T12:40:40.613 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.613 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:40.613 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.613 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.614 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.614 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.614 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 0, 2023-08-11T12:40:40.614 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 0 2023-08-11T12:40:40.614 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.615 INFO:teuthology.orchestra.run.smithi045.stdout: "cct": { 2023-08-11T12:40:40.615 INFO:teuthology.orchestra.run.smithi045.stdout: "total_workers": 1, 2023-08-11T12:40:40.615 INFO:teuthology.orchestra.run.smithi045.stdout: "unhealthy_workers": 0 2023-08-11T12:40:40.615 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.616 INFO:teuthology.orchestra.run.smithi045.stdout: "finisher-MDSRank": { 2023-08-11T12:40:40.616 INFO:teuthology.orchestra.run.smithi045.stdout: "queue_len": 0, 2023-08-11T12:40:40.616 INFO:teuthology.orchestra.run.smithi045.stdout: "complete_latency": { 2023-08-11T12:40:40.617 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 5786, 2023-08-11T12:40:40.617 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.170268068, 2023-08-11T12:40:40.617 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000029427 2023-08-11T12:40:40.617 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:40.617 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.618 INFO:teuthology.orchestra.run.smithi045.stdout: "finisher-PurgeQueue": { 2023-08-11T12:40:40.618 INFO:teuthology.orchestra.run.smithi045.stdout: "queue_len": 0, 2023-08-11T12:40:40.618 INFO:teuthology.orchestra.run.smithi045.stdout: "complete_latency": { 2023-08-11T12:40:40.618 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.618 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.619 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.619 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:40.619 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.619 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2023-08-11T12:40:40.619 INFO:teuthology.orchestra.run.smithi045.stdout: "request": 0, 2023-08-11T12:40:40.620 INFO:teuthology.orchestra.run.smithi045.stdout: "reply": 0, 2023-08-11T12:40:40.620 INFO:teuthology.orchestra.run.smithi045.stdout: "reply_latency": { 2023-08-11T12:40:40.620 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.620 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.620 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.621 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.621 INFO:teuthology.orchestra.run.smithi045.stdout: "slow_reply": 0, 2023-08-11T12:40:40.621 INFO:teuthology.orchestra.run.smithi045.stdout: "forward": 0, 2023-08-11T12:40:40.621 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_fetch_complete": 0, 2023-08-11T12:40:40.621 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_fetch_keys": 0, 2023-08-11T12:40:40.622 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_commit": 0, 2023-08-11T12:40:40.622 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_split": 0, 2023-08-11T12:40:40.622 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_merge": 0, 2023-08-11T12:40:40.622 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes": 692, 2023-08-11T12:40:40.622 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_top": 20, 2023-08-11T12:40:40.623 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_bottom": 206, 2023-08-11T12:40:40.623 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_pin_tail": 466, 2023-08-11T12:40:40.623 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_pinned": 663, 2023-08-11T12:40:40.623 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_expired": 26, 2023-08-11T12:40:40.623 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_with_caps": 0, 2023-08-11T12:40:40.624 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": 0, 2023-08-11T12:40:40.624 INFO:teuthology.orchestra.run.smithi045.stdout: "subtrees": 113, 2023-08-11T12:40:40.624 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse": 0, 2023-08-11T12:40:40.624 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_hit": 0, 2023-08-11T12:40:40.624 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_forward": 0, 2023-08-11T12:40:40.625 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_discover": 0, 2023-08-11T12:40:40.625 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_dir_fetch": 0, 2023-08-11T12:40:40.625 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_remote_ino": 0, 2023-08-11T12:40:40.625 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_lock": 0, 2023-08-11T12:40:40.626 INFO:teuthology.orchestra.run.smithi045.stdout: "load_cent": 0, 2023-08-11T12:40:40.626 INFO:teuthology.orchestra.run.smithi045.stdout: "q": 0, 2023-08-11T12:40:40.626 INFO:teuthology.orchestra.run.smithi045.stdout: "exported": 0, 2023-08-11T12:40:40.626 INFO:teuthology.orchestra.run.smithi045.stdout: "exported_inodes": 0, 2023-08-11T12:40:40.626 INFO:teuthology.orchestra.run.smithi045.stdout: "imported": 0, 2023-08-11T12:40:40.627 INFO:teuthology.orchestra.run.smithi045.stdout: "imported_inodes": 0, 2023-08-11T12:40:40.627 INFO:teuthology.orchestra.run.smithi045.stdout: "openino_dir_fetch": 0, 2023-08-11T12:40:40.627 INFO:teuthology.orchestra.run.smithi045.stdout: "openino_backtrace_fetch": 0, 2023-08-11T12:40:40.627 INFO:teuthology.orchestra.run.smithi045.stdout: "openino_peer_discover": 0, 2023-08-11T12:40:40.627 INFO:teuthology.orchestra.run.smithi045.stdout: "root_rfiles": 1003, 2023-08-11T12:40:40.628 INFO:teuthology.orchestra.run.smithi045.stdout: "root_rbytes": 5502265756, 2023-08-11T12:40:40.628 INFO:teuthology.orchestra.run.smithi045.stdout: "root_rsnaps": 6, 2023-08-11T12:40:40.628 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_backtrace_fetch": 0, 2023-08-11T12:40:40.628 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_set_tag": 0, 2023-08-11T12:40:40.628 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_backtrace_repaired": 0, 2023-08-11T12:40:40.629 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_inotable_repaired": 0, 2023-08-11T12:40:40.629 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_dir_inodes": 0, 2023-08-11T12:40:40.629 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_dir_base_inodes": 0, 2023-08-11T12:40:40.629 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_dirfrag_rstats": 0, 2023-08-11T12:40:40.629 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_file_inodes": 0, 2023-08-11T12:40:40.630 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_inode_file_caps": 0, 2023-08-11T12:40:40.630 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_revoke": 0, 2023-08-11T12:40:40.630 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_grant": 0, 2023-08-11T12:40:40.630 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_trunc": 0, 2023-08-11T12:40:40.630 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-11T12:40:40.631 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-11T12:40:40.631 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_caps": 0, 2023-08-11T12:40:40.631 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_caps_dirty": 0, 2023-08-11T12:40:40.631 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_cap_release": 0, 2023-08-11T12:40:40.631 INFO:teuthology.orchestra.run.smithi045.stdout: "process_request_cap_release": 0 2023-08-11T12:40:40.632 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.632 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_cache": { 2023-08-11T12:40:40.632 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_update": 0, 2023-08-11T12:40:40.632 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_update_receipt": 0, 2023-08-11T12:40:40.632 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_try_discover": 0, 2023-08-11T12:40:40.633 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_send_discover": 0, 2023-08-11T12:40:40.633 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_handle_discover": 0, 2023-08-11T12:40:40.633 INFO:teuthology.orchestra.run.smithi045.stdout: "num_strays": 0, 2023-08-11T12:40:40.633 INFO:teuthology.orchestra.run.smithi045.stdout: "num_strays_delayed": 0, 2023-08-11T12:40:40.633 INFO:teuthology.orchestra.run.smithi045.stdout: "num_strays_enqueuing": 0, 2023-08-11T12:40:40.634 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_created": 0, 2023-08-11T12:40:40.634 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_enqueued": 0, 2023-08-11T12:40:40.634 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_reintegrated": 0, 2023-08-11T12:40:40.634 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_migrated": 0, 2023-08-11T12:40:40.634 INFO:teuthology.orchestra.run.smithi045.stdout: "num_recovering_processing": 0, 2023-08-11T12:40:40.635 INFO:teuthology.orchestra.run.smithi045.stdout: "num_recovering_enqueued": 0, 2023-08-11T12:40:40.635 INFO:teuthology.orchestra.run.smithi045.stdout: "num_recovering_prioritized": 0, 2023-08-11T12:40:40.635 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_started": 0, 2023-08-11T12:40:40.635 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_completed": 0, 2023-08-11T12:40:40.635 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_enqueue_scrub": 0, 2023-08-11T12:40:40.636 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_exportdir": 0, 2023-08-11T12:40:40.636 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_flush": 0, 2023-08-11T12:40:40.636 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_fragmentdir": 0, 2023-08-11T12:40:40.636 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_fragstats": 0, 2023-08-11T12:40:40.636 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_inodestats": 0 2023-08-11T12:40:40.637 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.637 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_log": { 2023-08-11T12:40:40.637 INFO:teuthology.orchestra.run.smithi045.stdout: "evlrg": 0, 2023-08-11T12:40:40.637 INFO:teuthology.orchestra.run.smithi045.stdout: "evadd": 0, 2023-08-11T12:40:40.637 INFO:teuthology.orchestra.run.smithi045.stdout: "evex": 0, 2023-08-11T12:40:40.638 INFO:teuthology.orchestra.run.smithi045.stdout: "evtrm": 0, 2023-08-11T12:40:40.638 INFO:teuthology.orchestra.run.smithi045.stdout: "ev": 4683, 2023-08-11T12:40:40.638 INFO:teuthology.orchestra.run.smithi045.stdout: "evexg": 0, 2023-08-11T12:40:40.638 INFO:teuthology.orchestra.run.smithi045.stdout: "evexd": 0, 2023-08-11T12:40:40.638 INFO:teuthology.orchestra.run.smithi045.stdout: "segadd": 0, 2023-08-11T12:40:40.638 INFO:teuthology.orchestra.run.smithi045.stdout: "segex": 0, 2023-08-11T12:40:40.639 INFO:teuthology.orchestra.run.smithi045.stdout: "segtrm": 0, 2023-08-11T12:40:40.639 INFO:teuthology.orchestra.run.smithi045.stdout: "seg": 4, 2023-08-11T12:40:40.639 INFO:teuthology.orchestra.run.smithi045.stdout: "segmjr": 13, 2023-08-11T12:40:40.639 INFO:teuthology.orchestra.run.smithi045.stdout: "segexg": 0, 2023-08-11T12:40:40.639 INFO:teuthology.orchestra.run.smithi045.stdout: "segexd": 0, 2023-08-11T12:40:40.640 INFO:teuthology.orchestra.run.smithi045.stdout: "expos": 10865830, 2023-08-11T12:40:40.640 INFO:teuthology.orchestra.run.smithi045.stdout: "wrpos": 18717804, 2023-08-11T12:40:40.640 INFO:teuthology.orchestra.run.smithi045.stdout: "rdpos": 18717668, 2023-08-11T12:40:40.640 INFO:teuthology.orchestra.run.smithi045.stdout: "jlat": { 2023-08-11T12:40:40.640 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.641 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.641 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.641 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.641 INFO:teuthology.orchestra.run.smithi045.stdout: "replayed": 4683 2023-08-11T12:40:40.641 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.642 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_mem": { 2023-08-11T12:40:40.642 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 661, 2023-08-11T12:40:40.642 INFO:teuthology.orchestra.run.smithi045.stdout: "ino+": 2361, 2023-08-11T12:40:40.642 INFO:teuthology.orchestra.run.smithi045.stdout: "ino-": 1700, 2023-08-11T12:40:40.643 INFO:teuthology.orchestra.run.smithi045.stdout: "dir": 172, 2023-08-11T12:40:40.643 INFO:teuthology.orchestra.run.smithi045.stdout: "dir+": 201, 2023-08-11T12:40:40.643 INFO:teuthology.orchestra.run.smithi045.stdout: "dir-": 29, 2023-08-11T12:40:40.643 INFO:teuthology.orchestra.run.smithi045.stdout: "dn": 692, 2023-08-11T12:40:40.643 INFO:teuthology.orchestra.run.smithi045.stdout: "dn+": 2444, 2023-08-11T12:40:40.644 INFO:teuthology.orchestra.run.smithi045.stdout: "dn-": 1752, 2023-08-11T12:40:40.644 INFO:teuthology.orchestra.run.smithi045.stdout: "cap": 0, 2023-08-11T12:40:40.644 INFO:teuthology.orchestra.run.smithi045.stdout: "cap+": 0, 2023-08-11T12:40:40.644 INFO:teuthology.orchestra.run.smithi045.stdout: "cap-": 0, 2023-08-11T12:40:40.644 INFO:teuthology.orchestra.run.smithi045.stdout: "rss": 56976, 2023-08-11T12:40:40.645 INFO:teuthology.orchestra.run.smithi045.stdout: "heap": 207152 2023-08-11T12:40:40.645 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.645 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_server": { 2023-08-11T12:40:40.646 INFO:teuthology.orchestra.run.smithi045.stdout: "dispatch_client_request": 0, 2023-08-11T12:40:40.646 INFO:teuthology.orchestra.run.smithi045.stdout: "dispatch_server_request": 0, 2023-08-11T12:40:40.646 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_request": 0, 2023-08-11T12:40:40.646 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_session": 0, 2023-08-11T12:40:40.646 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_peer_request": 0, 2023-08-11T12:40:40.647 INFO:teuthology.orchestra.run.smithi045.stdout: "req_create_latency": { 2023-08-11T12:40:40.647 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.647 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.647 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.648 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.648 INFO:teuthology.orchestra.run.smithi045.stdout: "req_getattr_latency": { 2023-08-11T12:40:40.648 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.648 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.648 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.649 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.649 INFO:teuthology.orchestra.run.smithi045.stdout: "req_getfilelock_latency": { 2023-08-11T12:40:40.649 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.649 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.649 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.650 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.650 INFO:teuthology.orchestra.run.smithi045.stdout: "req_link_latency": { 2023-08-11T12:40:40.650 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.650 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.650 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.651 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.651 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookup_latency": { 2023-08-11T12:40:40.651 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.651 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.651 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.652 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.652 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookuphash_latency": { 2023-08-11T12:40:40.652 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.652 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.653 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.653 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.653 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupino_latency": { 2023-08-11T12:40:40.653 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.653 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.654 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.654 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.654 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupname_latency": { 2023-08-11T12:40:40.654 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.654 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.655 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.655 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.655 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupparent_latency": { 2023-08-11T12:40:40.656 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.656 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.656 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.656 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.657 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupsnap_latency": { 2023-08-11T12:40:40.657 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.657 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.657 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.657 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.658 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lssnap_latency": { 2023-08-11T12:40:40.658 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.658 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.658 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.658 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.659 INFO:teuthology.orchestra.run.smithi045.stdout: "req_mkdir_latency": { 2023-08-11T12:40:40.659 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.659 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.659 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.659 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.660 INFO:teuthology.orchestra.run.smithi045.stdout: "req_mknod_latency": { 2023-08-11T12:40:40.660 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.660 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.660 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.660 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.661 INFO:teuthology.orchestra.run.smithi045.stdout: "req_mksnap_latency": { 2023-08-11T12:40:40.661 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.661 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.661 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.661 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.662 INFO:teuthology.orchestra.run.smithi045.stdout: "req_open_latency": { 2023-08-11T12:40:40.662 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.662 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.662 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.662 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.663 INFO:teuthology.orchestra.run.smithi045.stdout: "req_readdir_latency": { 2023-08-11T12:40:40.663 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.663 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.663 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.664 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.664 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rename_latency": { 2023-08-11T12:40:40.664 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.664 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.664 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.665 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.665 INFO:teuthology.orchestra.run.smithi045.stdout: "req_renamesnap_latency": { 2023-08-11T12:40:40.665 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.665 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.665 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.666 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.666 INFO:teuthology.orchestra.run.smithi045.stdout: "req_snapdiff_latency": { 2023-08-11T12:40:40.666 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.666 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.666 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.667 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.667 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rmdir_latency": { 2023-08-11T12:40:40.667 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.667 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.668 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.668 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.668 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rmsnap_latency": { 2023-08-11T12:40:40.668 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.668 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.669 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.669 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.669 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rmxattr_latency": { 2023-08-11T12:40:40.669 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.670 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.670 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.670 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.670 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setattr_latency": { 2023-08-11T12:40:40.670 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.671 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.671 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.671 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.671 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setdirlayout_latency": { 2023-08-11T12:40:40.671 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.672 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.672 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.672 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.672 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setfilelock_latency": { 2023-08-11T12:40:40.673 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.673 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.673 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.673 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.673 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setlayout_latency": { 2023-08-11T12:40:40.674 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.674 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.674 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.674 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.674 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setxattr_latency": { 2023-08-11T12:40:40.674 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.675 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.675 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.675 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.675 INFO:teuthology.orchestra.run.smithi045.stdout: "req_symlink_latency": { 2023-08-11T12:40:40.675 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.676 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.676 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.676 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.676 INFO:teuthology.orchestra.run.smithi045.stdout: "req_unlink_latency": { 2023-08-11T12:40:40.677 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.677 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.677 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.677 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.677 INFO:teuthology.orchestra.run.smithi045.stdout: "cap_revoke_eviction": 0, 2023-08-11T12:40:40.678 INFO:teuthology.orchestra.run.smithi045.stdout: "cap_acquisition_throttle": 0, 2023-08-11T12:40:40.678 INFO:teuthology.orchestra.run.smithi045.stdout: "req_getvxattr_latency": { 2023-08-11T12:40:40.678 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.678 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.678 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.679 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:40.679 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.679 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_sessions": { 2023-08-11T12:40:40.679 INFO:teuthology.orchestra.run.smithi045.stdout: "session_count": 2, 2023-08-11T12:40:40.679 INFO:teuthology.orchestra.run.smithi045.stdout: "session_add": 5, 2023-08-11T12:40:40.680 INFO:teuthology.orchestra.run.smithi045.stdout: "session_remove": 3, 2023-08-11T12:40:40.680 INFO:teuthology.orchestra.run.smithi045.stdout: "sessions_open": 4, 2023-08-11T12:40:40.680 INFO:teuthology.orchestra.run.smithi045.stdout: "sessions_stale": 0, 2023-08-11T12:40:40.680 INFO:teuthology.orchestra.run.smithi045.stdout: "total_load": 0, 2023-08-11T12:40:40.680 INFO:teuthology.orchestra.run.smithi045.stdout: "average_load": 0, 2023-08-11T12:40:40.681 INFO:teuthology.orchestra.run.smithi045.stdout: "avg_session_uptime": 4845 2023-08-11T12:40:40.681 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.681 INFO:teuthology.orchestra.run.smithi045.stdout: "mempool": { 2023-08-11T12:40:40.681 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_bytes": 0, 2023-08-11T12:40:40.681 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_items": 0, 2023-08-11T12:40:40.682 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_bytes": 0, 2023-08-11T12:40:40.682 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_items": 0, 2023-08-11T12:40:40.682 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_bytes": 0, 2023-08-11T12:40:40.682 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_items": 0, 2023-08-11T12:40:40.682 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-11T12:40:40.683 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_items": 0, 2023-08-11T12:40:40.683 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-11T12:40:40.683 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_items": 0, 2023-08-11T12:40:40.683 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_bytes": 0, 2023-08-11T12:40:40.683 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_items": 0, 2023-08-11T12:40:40.684 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-11T12:40:40.684 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_items": 0, 2023-08-11T12:40:40.684 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_bytes": 0, 2023-08-11T12:40:40.684 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_items": 0, 2023-08-11T12:40:40.684 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_bytes": 0, 2023-08-11T12:40:40.685 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_items": 0, 2023-08-11T12:40:40.685 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-11T12:40:40.685 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_items": 0, 2023-08-11T12:40:40.685 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-11T12:40:40.686 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_items": 0, 2023-08-11T12:40:40.686 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_bytes": 0, 2023-08-11T12:40:40.686 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_items": 0, 2023-08-11T12:40:40.686 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_bytes": 0, 2023-08-11T12:40:40.686 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_items": 0, 2023-08-11T12:40:40.687 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-11T12:40:40.687 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_items": 0, 2023-08-11T12:40:40.687 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_bytes": 0, 2023-08-11T12:40:40.687 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_items": 0, 2023-08-11T12:40:40.687 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_bytes": 0, 2023-08-11T12:40:40.688 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_items": 0, 2023-08-11T12:40:40.688 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_bytes": 0, 2023-08-11T12:40:40.688 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_items": 0, 2023-08-11T12:40:40.688 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_bytes": 0, 2023-08-11T12:40:40.688 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_items": 0, 2023-08-11T12:40:40.689 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_bytes": 225366, 2023-08-11T12:40:40.689 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_items": 771, 2023-08-11T12:40:40.689 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_bytes": 0, 2023-08-11T12:40:40.689 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_items": 0, 2023-08-11T12:40:40.689 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_bytes": 0, 2023-08-11T12:40:40.690 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_items": 0, 2023-08-11T12:40:40.690 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_bytes": 0, 2023-08-11T12:40:40.690 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_items": 0, 2023-08-11T12:40:40.690 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_bytes": 0, 2023-08-11T12:40:40.690 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_items": 0, 2023-08-11T12:40:40.691 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_bytes": 9320, 2023-08-11T12:40:40.691 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_items": 178, 2023-08-11T12:40:40.691 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_bytes": 0, 2023-08-11T12:40:40.691 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_items": 0, 2023-08-11T12:40:40.691 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_bytes": 0, 2023-08-11T12:40:40.692 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_items": 0, 2023-08-11T12:40:40.692 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_bytes": 2289474, 2023-08-11T12:40:40.692 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_items": 20925, 2023-08-11T12:40:40.692 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_bytes": 0, 2023-08-11T12:40:40.692 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_items": 0, 2023-08-11T12:40:40.693 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_bytes": 0, 2023-08-11T12:40:40.693 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_items": 0 2023-08-11T12:40:40.693 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.693 INFO:teuthology.orchestra.run.smithi045.stdout: "objecter": { 2023-08-11T12:40:40.693 INFO:teuthology.orchestra.run.smithi045.stdout: "op_active": 0, 2023-08-11T12:40:40.694 INFO:teuthology.orchestra.run.smithi045.stdout: "op_laggy": 0, 2023-08-11T12:40:40.694 INFO:teuthology.orchestra.run.smithi045.stdout: "op_send": 3449, 2023-08-11T12:40:40.694 INFO:teuthology.orchestra.run.smithi045.stdout: "op_send_bytes": 26, 2023-08-11T12:40:40.694 INFO:teuthology.orchestra.run.smithi045.stdout: "op_resend": 4, 2023-08-11T12:40:40.694 INFO:teuthology.orchestra.run.smithi045.stdout: "op_reply": 3449, 2023-08-11T12:40:40.695 INFO:teuthology.orchestra.run.smithi045.stdout: "op_latency": { 2023-08-11T12:40:40.695 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 3449, 2023-08-11T12:40:40.695 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 1.730973430, 2023-08-11T12:40:40.695 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000501876 2023-08-11T12:40:40.695 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.696 INFO:teuthology.orchestra.run.smithi045.stdout: "op_inflight": 0, 2023-08-11T12:40:40.696 INFO:teuthology.orchestra.run.smithi045.stdout: "oplen_avg": { 2023-08-11T12:40:40.696 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 3449, 2023-08-11T12:40:40.696 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 3450 2023-08-11T12:40:40.696 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.697 INFO:teuthology.orchestra.run.smithi045.stdout: "op": 3449, 2023-08-11T12:40:40.697 INFO:teuthology.orchestra.run.smithi045.stdout: "op_r": 3449, 2023-08-11T12:40:40.697 INFO:teuthology.orchestra.run.smithi045.stdout: "op_w": 0, 2023-08-11T12:40:40.697 INFO:teuthology.orchestra.run.smithi045.stdout: "op_rmw": 0, 2023-08-11T12:40:40.697 INFO:teuthology.orchestra.run.smithi045.stdout: "op_pg": 0, 2023-08-11T12:40:40.698 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_stat": 2178, 2023-08-11T12:40:40.698 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_create": 0, 2023-08-11T12:40:40.698 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_read": 1268, 2023-08-11T12:40:40.698 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_write": 0, 2023-08-11T12:40:40.698 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_writefull": 0, 2023-08-11T12:40:40.699 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_writesame": 0, 2023-08-11T12:40:40.699 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_append": 0, 2023-08-11T12:40:40.699 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_zero": 0, 2023-08-11T12:40:40.699 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_truncate": 0, 2023-08-11T12:40:40.699 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_delete": 0, 2023-08-11T12:40:40.700 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_mapext": 0, 2023-08-11T12:40:40.700 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_sparse_read": 0, 2023-08-11T12:40:40.700 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_clonerange": 0, 2023-08-11T12:40:40.700 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_getxattr": 2, 2023-08-11T12:40:40.701 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_setxattr": 0, 2023-08-11T12:40:40.701 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_cmpxattr": 0, 2023-08-11T12:40:40.701 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_rmxattr": 0, 2023-08-11T12:40:40.701 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_resetxattrs": 0, 2023-08-11T12:40:40.701 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_call": 0, 2023-08-11T12:40:40.701 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_watch": 0, 2023-08-11T12:40:40.702 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_notify": 0, 2023-08-11T12:40:40.702 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_src_cmpxattr": 0, 2023-08-11T12:40:40.702 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_pgls": 0, 2023-08-11T12:40:40.702 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_pgls_filter": 0, 2023-08-11T12:40:40.702 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_other": 0, 2023-08-11T12:40:40.703 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_active": 0, 2023-08-11T12:40:40.703 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_send": 0, 2023-08-11T12:40:40.703 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_resend": 0, 2023-08-11T12:40:40.703 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_ping": 0, 2023-08-11T12:40:40.703 INFO:teuthology.orchestra.run.smithi045.stdout: "poolop_active": 0, 2023-08-11T12:40:40.704 INFO:teuthology.orchestra.run.smithi045.stdout: "poolop_send": 0, 2023-08-11T12:40:40.704 INFO:teuthology.orchestra.run.smithi045.stdout: "poolop_resend": 0, 2023-08-11T12:40:40.704 INFO:teuthology.orchestra.run.smithi045.stdout: "poolstat_active": 0, 2023-08-11T12:40:40.704 INFO:teuthology.orchestra.run.smithi045.stdout: "poolstat_send": 0, 2023-08-11T12:40:40.705 INFO:teuthology.orchestra.run.smithi045.stdout: "poolstat_resend": 0, 2023-08-11T12:40:40.705 INFO:teuthology.orchestra.run.smithi045.stdout: "statfs_active": 0, 2023-08-11T12:40:40.705 INFO:teuthology.orchestra.run.smithi045.stdout: "statfs_send": 0, 2023-08-11T12:40:40.705 INFO:teuthology.orchestra.run.smithi045.stdout: "statfs_resend": 0, 2023-08-11T12:40:40.705 INFO:teuthology.orchestra.run.smithi045.stdout: "command_active": 0, 2023-08-11T12:40:40.705 INFO:teuthology.orchestra.run.smithi045.stdout: "command_send": 0, 2023-08-11T12:40:40.706 INFO:teuthology.orchestra.run.smithi045.stdout: "command_resend": 0, 2023-08-11T12:40:40.706 INFO:teuthology.orchestra.run.smithi045.stdout: "map_epoch": 110, 2023-08-11T12:40:40.706 INFO:teuthology.orchestra.run.smithi045.stdout: "map_full": 0, 2023-08-11T12:40:40.706 INFO:teuthology.orchestra.run.smithi045.stdout: "map_inc": 23, 2023-08-11T12:40:40.706 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_sessions": 6, 2023-08-11T12:40:40.707 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_session_open": 8, 2023-08-11T12:40:40.707 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_session_close": 2, 2023-08-11T12:40:40.707 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_laggy": 0, 2023-08-11T12:40:40.707 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_wr": 0, 2023-08-11T12:40:40.707 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_rd": 2, 2023-08-11T12:40:40.708 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_del": 0 2023-08-11T12:40:40.708 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.708 INFO:teuthology.orchestra.run.smithi045.stdout: "oft": { 2023-08-11T12:40:40.708 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_objs": 0, 2023-08-11T12:40:40.709 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_kv_pairs": 0, 2023-08-11T12:40:40.709 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_updates": 0, 2023-08-11T12:40:40.709 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_removes": 0 2023-08-11T12:40:40.709 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.709 INFO:teuthology.orchestra.run.smithi045.stdout: "osd-slow-ops": { 2023-08-11T12:40:40.710 INFO:teuthology.orchestra.run.smithi045.stdout: "slow_ops_count": 0 2023-08-11T12:40:40.710 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.710 INFO:teuthology.orchestra.run.smithi045.stdout: "purge_queue": { 2023-08-11T12:40:40.710 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing_ops": 0, 2023-08-11T12:40:40.710 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing_ops_high_water": 0, 2023-08-11T12:40:40.711 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing": 0, 2023-08-11T12:40:40.711 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing_high_water": 0, 2023-08-11T12:40:40.711 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executed": 0, 2023-08-11T12:40:40.711 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_item_in_journal": 0 2023-08-11T12:40:40.711 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.712 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-11T12:40:40.712 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2023-08-11T12:40:40.712 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 104857600, 2023-08-11T12:40:40.712 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2023-08-11T12:40:40.712 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 3827, 2023-08-11T12:40:40.713 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 16806207, 2023-08-11T12:40:40.713 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:40.713 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 3827, 2023-08-11T12:40:40.713 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2023-08-11T12:40:40.713 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2023-08-11T12:40:40.714 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 3827, 2023-08-11T12:40:40.714 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 16806207, 2023-08-11T12:40:40.714 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2023-08-11T12:40:40.714 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.714 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.715 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.715 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:40.715 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.715 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-objecter_bytes": { 2023-08-11T12:40:40.715 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2023-08-11T12:40:40.716 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 104857600, 2023-08-11T12:40:40.716 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2023-08-11T12:40:40.716 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 0, 2023-08-11T12:40:40.716 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 0, 2023-08-11T12:40:40.716 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:40.717 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:40.717 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 3449, 2023-08-11T12:40:40.717 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 14523510, 2023-08-11T12:40:40.717 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 3449, 2023-08-11T12:40:40.717 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 14523510, 2023-08-11T12:40:40.718 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2023-08-11T12:40:40.718 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.718 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.718 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.718 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:40.719 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.719 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-objecter_ops": { 2023-08-11T12:40:40.719 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2023-08-11T12:40:40.719 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 1024, 2023-08-11T12:40:40.719 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2023-08-11T12:40:40.720 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 0, 2023-08-11T12:40:40.720 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 0, 2023-08-11T12:40:40.720 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:40.720 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:40.720 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 3449, 2023-08-11T12:40:40.721 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 3449, 2023-08-11T12:40:40.721 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 3449, 2023-08-11T12:40:40.721 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 3449, 2023-08-11T12:40:40.721 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2023-08-11T12:40:40.721 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.722 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.722 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.722 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:40.722 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.722 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-write_buf_throttle": { 2023-08-11T12:40:40.723 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2023-08-11T12:40:40.723 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 3758096384, 2023-08-11T12:40:40.723 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2023-08-11T12:40:40.723 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 0, 2023-08-11T12:40:40.723 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 0, 2023-08-11T12:40:40.724 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:40.724 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:40.724 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2023-08-11T12:40:40.724 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2023-08-11T12:40:40.725 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 0, 2023-08-11T12:40:40.725 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 0, 2023-08-11T12:40:40.725 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2023-08-11T12:40:40.725 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.725 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.726 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.726 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:40.726 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:40.726 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-write_buf_throttle-0x55d463f30000": { 2023-08-11T12:40:40.726 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2023-08-11T12:40:40.727 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 3758096384, 2023-08-11T12:40:40.727 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2023-08-11T12:40:40.727 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 0, 2023-08-11T12:40:40.727 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 0, 2023-08-11T12:40:40.727 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:40.727 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:40.728 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2023-08-11T12:40:40.728 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2023-08-11T12:40:40.728 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 0, 2023-08-11T12:40:40.728 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 0, 2023-08-11T12:40:40.729 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2023-08-11T12:40:40.729 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:40.729 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:40.729 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:40.729 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:40.730 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:40.730 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-08-11T12:40:41.101 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2023-08-11T12:40:41.101 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2023-08-11T12:40:41.102 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2023-08-11T12:40:41.102 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2023-08-11T12:40:41.102 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2023-08-11T12:40:41.103 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2023-08-11T12:40:41.103 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2023-08-11T12:40:41.103 DEBUG:tasks.check_counter:Getting stats from k 2023-08-11T12:40:41.103 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph daemon mds.k perf dump 2023-08-11T12:40:41.682 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.b/config 2023-08-11T12:40:42.204 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:42 smithi045 ceph-mon[130284]: pgmap v505: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:42.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:42 smithi008 ceph-mon[97158]: pgmap v505: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:42.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:42 smithi194 ceph-mon[130905]: pgmap v505: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:43.063 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-08-11T12:40:43.064 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-0": { 2023-08-11T12:40:43.064 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 446466, 2023-08-11T12:40:43.064 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 446314, 2023-08-11T12:40:43.065 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 73813757, 2023-08-11T12:40:43.065 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 74176355, 2023-08-11T12:40:43.066 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 13, 2023-08-11T12:40:43.066 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 6, 2023-08-11T12:40:43.066 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 22.596002446, 2023-08-11T12:40:43.066 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 9.265652758, 2023-08-11T12:40:43.066 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 16.320554835, 2023-08-11T12:40:43.067 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.017155394, 2023-08-11T12:40:43.067 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:43.067 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 446312, 2023-08-11T12:40:43.067 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 5.696233394, 2023-08-11T12:40:43.067 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000012762 2023-08-11T12:40:43.067 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.068 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:43.068 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 891606, 2023-08-11T12:40:43.068 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.127307002, 2023-08-11T12:40:43.068 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000142 2023-08-11T12:40:43.068 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.069 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 2192, 2023-08-11T12:40:43.069 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 9104 2023-08-11T12:40:43.069 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.069 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-1": { 2023-08-11T12:40:43.069 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 612, 2023-08-11T12:40:43.070 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 916, 2023-08-11T12:40:43.070 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 421200, 2023-08-11T12:40:43.070 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 929172, 2023-08-11T12:40:43.070 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 18, 2023-08-11T12:40:43.070 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 8, 2023-08-11T12:40:43.071 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.052059209, 2023-08-11T12:40:43.071 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.020991411, 2023-08-11T12:40:43.071 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.030253396, 2023-08-11T12:40:43.071 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.001983008, 2023-08-11T12:40:43.071 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:43.072 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 914, 2023-08-11T12:40:43.072 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.063211050, 2023-08-11T12:40:43.072 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000069158 2023-08-11T12:40:43.072 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.072 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:43.073 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 1034, 2023-08-11T12:40:43.073 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000211510, 2023-08-11T12:40:43.073 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000204 2023-08-11T12:40:43.073 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.073 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 4224, 2023-08-11T12:40:43.074 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 562160 2023-08-11T12:40:43.074 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.074 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-2": { 2023-08-11T12:40:43.074 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 2743, 2023-08-11T12:40:43.074 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 3898, 2023-08-11T12:40:43.075 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 2484059, 2023-08-11T12:40:43.075 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 1673814, 2023-08-11T12:40:43.075 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 8, 2023-08-11T12:40:43.075 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 7, 2023-08-11T12:40:43.076 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.215107751, 2023-08-11T12:40:43.076 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.083951403, 2023-08-11T12:40:43.076 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.149135695, 2023-08-11T12:40:43.076 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.010056955, 2023-08-11T12:40:43.077 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:43.077 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 3897, 2023-08-11T12:40:43.077 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.334206776, 2023-08-11T12:40:43.077 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000085760 2023-08-11T12:40:43.077 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.077 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:43.078 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 4823, 2023-08-11T12:40:43.078 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.001093557, 2023-08-11T12:40:43.078 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000226 2023-08-11T12:40:43.078 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.078 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 1859568, 2023-08-11T12:40:43.079 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 898768 2023-08-11T12:40:43.079 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.079 INFO:teuthology.orchestra.run.smithi045.stdout: "cct": { 2023-08-11T12:40:43.079 INFO:teuthology.orchestra.run.smithi045.stdout: "total_workers": 1, 2023-08-11T12:40:43.079 INFO:teuthology.orchestra.run.smithi045.stdout: "unhealthy_workers": 0 2023-08-11T12:40:43.080 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.080 INFO:teuthology.orchestra.run.smithi045.stdout: "finisher-MDSRank": { 2023-08-11T12:40:43.080 INFO:teuthology.orchestra.run.smithi045.stdout: "queue_len": 0, 2023-08-11T12:40:43.080 INFO:teuthology.orchestra.run.smithi045.stdout: "complete_latency": { 2023-08-11T12:40:43.080 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 833, 2023-08-11T12:40:43.081 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.439733849, 2023-08-11T12:40:43.081 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000527891 2023-08-11T12:40:43.081 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:43.081 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.081 INFO:teuthology.orchestra.run.smithi045.stdout: "finisher-PurgeQueue": { 2023-08-11T12:40:43.082 INFO:teuthology.orchestra.run.smithi045.stdout: "queue_len": 0, 2023-08-11T12:40:43.082 INFO:teuthology.orchestra.run.smithi045.stdout: "complete_latency": { 2023-08-11T12:40:43.082 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 2, 2023-08-11T12:40:43.082 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000021353, 2023-08-11T12:40:43.082 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000010676 2023-08-11T12:40:43.082 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:43.083 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.083 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2023-08-11T12:40:43.083 INFO:teuthology.orchestra.run.smithi045.stdout: "request": 285, 2023-08-11T12:40:43.083 INFO:teuthology.orchestra.run.smithi045.stdout: "reply": 269, 2023-08-11T12:40:43.083 INFO:teuthology.orchestra.run.smithi045.stdout: "reply_latency": { 2023-08-11T12:40:43.084 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 269, 2023-08-11T12:40:43.084 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 6.067343871, 2023-08-11T12:40:43.084 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.022555181 2023-08-11T12:40:43.084 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.084 INFO:teuthology.orchestra.run.smithi045.stdout: "slow_reply": 0, 2023-08-11T12:40:43.085 INFO:teuthology.orchestra.run.smithi045.stdout: "forward": 16, 2023-08-11T12:40:43.085 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_fetch_complete": 0, 2023-08-11T12:40:43.085 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_fetch_keys": 0, 2023-08-11T12:40:43.086 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_commit": 11, 2023-08-11T12:40:43.086 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_split": 0, 2023-08-11T12:40:43.086 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_merge": 0, 2023-08-11T12:40:43.086 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes": 847, 2023-08-11T12:40:43.086 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_top": 153, 2023-08-11T12:40:43.087 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_bottom": 694, 2023-08-11T12:40:43.087 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_pin_tail": 0, 2023-08-11T12:40:43.087 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_pinned": 630, 2023-08-11T12:40:43.087 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_expired": 550, 2023-08-11T12:40:43.087 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_with_caps": 2, 2023-08-11T12:40:43.088 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": 2, 2023-08-11T12:40:43.088 INFO:teuthology.orchestra.run.smithi045.stdout: "subtrees": 64, 2023-08-11T12:40:43.088 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse": 2522, 2023-08-11T12:40:43.088 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_hit": 1900, 2023-08-11T12:40:43.088 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_forward": 15, 2023-08-11T12:40:43.089 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_discover": 34, 2023-08-11T12:40:43.089 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_dir_fetch": 0, 2023-08-11T12:40:43.089 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_remote_ino": 0, 2023-08-11T12:40:43.089 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_lock": 463, 2023-08-11T12:40:43.089 INFO:teuthology.orchestra.run.smithi045.stdout: "load_cent": 0, 2023-08-11T12:40:43.090 INFO:teuthology.orchestra.run.smithi045.stdout: "q": 0, 2023-08-11T12:40:43.090 INFO:teuthology.orchestra.run.smithi045.stdout: "exported": 7, 2023-08-11T12:40:43.090 INFO:teuthology.orchestra.run.smithi045.stdout: "exported_inodes": 529, 2023-08-11T12:40:43.090 INFO:teuthology.orchestra.run.smithi045.stdout: "imported": 27, 2023-08-11T12:40:43.090 INFO:teuthology.orchestra.run.smithi045.stdout: "imported_inodes": 1020, 2023-08-11T12:40:43.091 INFO:teuthology.orchestra.run.smithi045.stdout: "openino_dir_fetch": 0, 2023-08-11T12:40:43.091 INFO:teuthology.orchestra.run.smithi045.stdout: "openino_backtrace_fetch": 187, 2023-08-11T12:40:43.091 INFO:teuthology.orchestra.run.smithi045.stdout: "openino_peer_discover": 0, 2023-08-11T12:40:43.091 INFO:teuthology.orchestra.run.smithi045.stdout: "root_rfiles": 1003, 2023-08-11T12:40:43.091 INFO:teuthology.orchestra.run.smithi045.stdout: "root_rbytes": 5502265756, 2023-08-11T12:40:43.091 INFO:teuthology.orchestra.run.smithi045.stdout: "root_rsnaps": 4, 2023-08-11T12:40:43.092 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_backtrace_fetch": 187, 2023-08-11T12:40:43.092 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_set_tag": 0, 2023-08-11T12:40:43.092 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_backtrace_repaired": 0, 2023-08-11T12:40:43.092 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_inotable_repaired": 0, 2023-08-11T12:40:43.093 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_dir_inodes": 0, 2023-08-11T12:40:43.093 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_dir_base_inodes": 0, 2023-08-11T12:40:43.093 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_dirfrag_rstats": 0, 2023-08-11T12:40:43.093 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_file_inodes": 187, 2023-08-11T12:40:43.093 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_inode_file_caps": 19, 2023-08-11T12:40:43.093 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_revoke": 90, 2023-08-11T12:40:43.094 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_grant": 201, 2023-08-11T12:40:43.094 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_trunc": 0, 2023-08-11T12:40:43.094 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-11T12:40:43.094 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-11T12:40:43.094 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_caps": 238, 2023-08-11T12:40:43.095 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_caps_dirty": 129, 2023-08-11T12:40:43.095 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_cap_release": 25, 2023-08-11T12:40:43.095 INFO:teuthology.orchestra.run.smithi045.stdout: "process_request_cap_release": 79 2023-08-11T12:40:43.095 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.095 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_cache": { 2023-08-11T12:40:43.096 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_update": 21, 2023-08-11T12:40:43.096 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_update_receipt": 187, 2023-08-11T12:40:43.096 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_try_discover": 102, 2023-08-11T12:40:43.096 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_send_discover": 158, 2023-08-11T12:40:43.096 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_handle_discover": 60, 2023-08-11T12:40:43.097 INFO:teuthology.orchestra.run.smithi045.stdout: "num_strays": 13, 2023-08-11T12:40:43.097 INFO:teuthology.orchestra.run.smithi045.stdout: "num_strays_delayed": 0, 2023-08-11T12:40:43.097 INFO:teuthology.orchestra.run.smithi045.stdout: "num_strays_enqueuing": 0, 2023-08-11T12:40:43.097 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_created": 31, 2023-08-11T12:40:43.097 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_enqueued": 0, 2023-08-11T12:40:43.098 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_reintegrated": 92, 2023-08-11T12:40:43.098 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_migrated": 9, 2023-08-11T12:40:43.098 INFO:teuthology.orchestra.run.smithi045.stdout: "num_recovering_processing": 0, 2023-08-11T12:40:43.098 INFO:teuthology.orchestra.run.smithi045.stdout: "num_recovering_enqueued": 0, 2023-08-11T12:40:43.098 INFO:teuthology.orchestra.run.smithi045.stdout: "num_recovering_prioritized": 0, 2023-08-11T12:40:43.099 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_started": 0, 2023-08-11T12:40:43.099 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_completed": 0, 2023-08-11T12:40:43.099 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_enqueue_scrub": 0, 2023-08-11T12:40:43.099 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_exportdir": 8, 2023-08-11T12:40:43.099 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_flush": 0, 2023-08-11T12:40:43.100 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_fragmentdir": 0, 2023-08-11T12:40:43.100 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_fragstats": 0, 2023-08-11T12:40:43.100 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_inodestats": 0 2023-08-11T12:40:43.100 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.100 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_log": { 2023-08-11T12:40:43.101 INFO:teuthology.orchestra.run.smithi045.stdout: "evlrg": 0, 2023-08-11T12:40:43.101 INFO:teuthology.orchestra.run.smithi045.stdout: "evadd": 824, 2023-08-11T12:40:43.101 INFO:teuthology.orchestra.run.smithi045.stdout: "evex": 0, 2023-08-11T12:40:43.101 INFO:teuthology.orchestra.run.smithi045.stdout: "evtrm": 0, 2023-08-11T12:40:43.101 INFO:teuthology.orchestra.run.smithi045.stdout: "ev": 824, 2023-08-11T12:40:43.102 INFO:teuthology.orchestra.run.smithi045.stdout: "evexg": 0, 2023-08-11T12:40:43.102 INFO:teuthology.orchestra.run.smithi045.stdout: "evexd": 0, 2023-08-11T12:40:43.102 INFO:teuthology.orchestra.run.smithi045.stdout: "segadd": 2, 2023-08-11T12:40:43.102 INFO:teuthology.orchestra.run.smithi045.stdout: "segex": 0, 2023-08-11T12:40:43.102 INFO:teuthology.orchestra.run.smithi045.stdout: "segtrm": 0, 2023-08-11T12:40:43.102 INFO:teuthology.orchestra.run.smithi045.stdout: "seg": 2, 2023-08-11T12:40:43.103 INFO:teuthology.orchestra.run.smithi045.stdout: "segmjr": 2, 2023-08-11T12:40:43.103 INFO:teuthology.orchestra.run.smithi045.stdout: "segexg": 0, 2023-08-11T12:40:43.103 INFO:teuthology.orchestra.run.smithi045.stdout: "segexd": 0, 2023-08-11T12:40:43.103 INFO:teuthology.orchestra.run.smithi045.stdout: "expos": 4194304, 2023-08-11T12:40:43.103 INFO:teuthology.orchestra.run.smithi045.stdout: "wrpos": 6501522, 2023-08-11T12:40:43.104 INFO:teuthology.orchestra.run.smithi045.stdout: "rdpos": 0, 2023-08-11T12:40:43.104 INFO:teuthology.orchestra.run.smithi045.stdout: "jlat": { 2023-08-11T12:40:43.104 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 355, 2023-08-11T12:40:43.104 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 1.027687787, 2023-08-11T12:40:43.104 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.002894895 2023-08-11T12:40:43.105 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.105 INFO:teuthology.orchestra.run.smithi045.stdout: "replayed": 0 2023-08-11T12:40:43.105 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.105 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_mem": { 2023-08-11T12:40:43.105 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 745, 2023-08-11T12:40:43.106 INFO:teuthology.orchestra.run.smithi045.stdout: "ino+": 1277, 2023-08-11T12:40:43.106 INFO:teuthology.orchestra.run.smithi045.stdout: "ino-": 532, 2023-08-11T12:40:43.106 INFO:teuthology.orchestra.run.smithi045.stdout: "dir": 123, 2023-08-11T12:40:43.106 INFO:teuthology.orchestra.run.smithi045.stdout: "dir+": 194, 2023-08-11T12:40:43.106 INFO:teuthology.orchestra.run.smithi045.stdout: "dir-": 71, 2023-08-11T12:40:43.107 INFO:teuthology.orchestra.run.smithi045.stdout: "dn": 848, 2023-08-11T12:40:43.107 INFO:teuthology.orchestra.run.smithi045.stdout: "dn+": 1426, 2023-08-11T12:40:43.107 INFO:teuthology.orchestra.run.smithi045.stdout: "dn-": 578, 2023-08-11T12:40:43.107 INFO:teuthology.orchestra.run.smithi045.stdout: "cap": 2, 2023-08-11T12:40:43.107 INFO:teuthology.orchestra.run.smithi045.stdout: "cap+": 553, 2023-08-11T12:40:43.107 INFO:teuthology.orchestra.run.smithi045.stdout: "cap-": 551, 2023-08-11T12:40:43.108 INFO:teuthology.orchestra.run.smithi045.stdout: "rss": 57244, 2023-08-11T12:40:43.108 INFO:teuthology.orchestra.run.smithi045.stdout: "heap": 198960 2023-08-11T12:40:43.108 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.108 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_server": { 2023-08-11T12:40:43.108 INFO:teuthology.orchestra.run.smithi045.stdout: "dispatch_client_request": 1593, 2023-08-11T12:40:43.109 INFO:teuthology.orchestra.run.smithi045.stdout: "dispatch_server_request": 602, 2023-08-11T12:40:43.109 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_request": 285, 2023-08-11T12:40:43.109 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_session": 74, 2023-08-11T12:40:43.109 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_peer_request": 751, 2023-08-11T12:40:43.109 INFO:teuthology.orchestra.run.smithi045.stdout: "req_create_latency": { 2023-08-11T12:40:43.110 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 8, 2023-08-11T12:40:43.110 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.068532902, 2023-08-11T12:40:43.110 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.008566612 2023-08-11T12:40:43.110 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.110 INFO:teuthology.orchestra.run.smithi045.stdout: "req_getattr_latency": { 2023-08-11T12:40:43.111 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 22, 2023-08-11T12:40:43.111 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.022342458, 2023-08-11T12:40:43.111 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.001015566 2023-08-11T12:40:43.111 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.111 INFO:teuthology.orchestra.run.smithi045.stdout: "req_getfilelock_latency": { 2023-08-11T12:40:43.112 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:43.112 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:43.112 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:43.112 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.112 INFO:teuthology.orchestra.run.smithi045.stdout: "req_link_latency": { 2023-08-11T12:40:43.113 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 17, 2023-08-11T12:40:43.113 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.110458029, 2023-08-11T12:40:43.113 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.006497531 2023-08-11T12:40:43.113 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.113 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookup_latency": { 2023-08-11T12:40:43.113 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 74, 2023-08-11T12:40:43.114 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.116111586, 2023-08-11T12:40:43.114 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.001569075 2023-08-11T12:40:43.114 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.114 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookuphash_latency": { 2023-08-11T12:40:43.114 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:43.115 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:43.115 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:43.115 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.115 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupino_latency": { 2023-08-11T12:40:43.115 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:43.116 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:43.116 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:43.116 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.116 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupname_latency": { 2023-08-11T12:40:43.116 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:43.117 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:43.117 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:43.117 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.117 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupparent_latency": { 2023-08-11T12:40:43.117 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:43.118 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:43.118 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:43.118 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.118 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupsnap_latency": { 2023-08-11T12:40:43.118 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:43.119 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:43.119 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:43.119 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.119 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lssnap_latency": { 2023-08-11T12:40:43.119 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:43.120 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:43.120 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:43.120 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.120 INFO:teuthology.orchestra.run.smithi045.stdout: "req_mkdir_latency": { 2023-08-11T12:40:43.120 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:43.121 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:43.121 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:43.121 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.121 INFO:teuthology.orchestra.run.smithi045.stdout: "req_mknod_latency": { 2023-08-11T12:40:43.121 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:43.122 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:43.122 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:43.122 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.122 INFO:teuthology.orchestra.run.smithi045.stdout: "req_mksnap_latency": { 2023-08-11T12:40:43.122 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:43.123 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:43.123 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:43.123 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.123 INFO:teuthology.orchestra.run.smithi045.stdout: "req_open_latency": { 2023-08-11T12:40:43.123 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 8, 2023-08-11T12:40:43.124 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.017420847, 2023-08-11T12:40:43.124 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.002177605 2023-08-11T12:40:43.124 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.124 INFO:teuthology.orchestra.run.smithi045.stdout: "req_readdir_latency": { 2023-08-11T12:40:43.124 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 10, 2023-08-11T12:40:43.125 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.008425057, 2023-08-11T12:40:43.125 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000842505 2023-08-11T12:40:43.125 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.125 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rename_latency": { 2023-08-11T12:40:43.125 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 99, 2023-08-11T12:40:43.126 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 5.520258592, 2023-08-11T12:40:43.126 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.055760187 2023-08-11T12:40:43.126 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.126 INFO:teuthology.orchestra.run.smithi045.stdout: "req_renamesnap_latency": { 2023-08-11T12:40:43.126 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:43.126 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:43.127 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:43.127 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.127 INFO:teuthology.orchestra.run.smithi045.stdout: "req_snapdiff_latency": { 2023-08-11T12:40:43.127 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:43.127 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:43.128 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:43.128 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.128 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rmdir_latency": { 2023-08-11T12:40:43.128 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:43.128 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:43.129 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:43.129 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.129 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rmsnap_latency": { 2023-08-11T12:40:43.129 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:43.129 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:43.130 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:43.130 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.130 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rmxattr_latency": { 2023-08-11T12:40:43.130 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:43.130 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:43.131 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:43.131 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.131 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setattr_latency": { 2023-08-11T12:40:43.131 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:43.131 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:43.132 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:43.132 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.132 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setdirlayout_latency": { 2023-08-11T12:40:43.132 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:43.132 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:43.133 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:43.133 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.133 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setfilelock_latency": { 2023-08-11T12:40:43.133 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:43.133 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:43.134 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:43.134 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.134 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setlayout_latency": { 2023-08-11T12:40:43.134 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:43.135 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:43.135 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:43.135 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.135 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setxattr_latency": { 2023-08-11T12:40:43.135 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:43.136 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:43.136 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:43.136 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.136 INFO:teuthology.orchestra.run.smithi045.stdout: "req_symlink_latency": { 2023-08-11T12:40:43.136 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:43.137 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:43.137 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:43.137 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.137 INFO:teuthology.orchestra.run.smithi045.stdout: "req_unlink_latency": { 2023-08-11T12:40:43.137 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 31, 2023-08-11T12:40:43.138 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.203794400, 2023-08-11T12:40:43.138 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.006574012 2023-08-11T12:40:43.138 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.138 INFO:teuthology.orchestra.run.smithi045.stdout: "cap_revoke_eviction": 0, 2023-08-11T12:40:43.138 INFO:teuthology.orchestra.run.smithi045.stdout: "cap_acquisition_throttle": 0, 2023-08-11T12:40:43.139 INFO:teuthology.orchestra.run.smithi045.stdout: "req_getvxattr_latency": { 2023-08-11T12:40:43.139 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:43.139 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:43.139 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:43.139 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:43.140 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.140 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_sessions": { 2023-08-11T12:40:43.140 INFO:teuthology.orchestra.run.smithi045.stdout: "session_count": 2, 2023-08-11T12:40:43.140 INFO:teuthology.orchestra.run.smithi045.stdout: "session_add": 3, 2023-08-11T12:40:43.140 INFO:teuthology.orchestra.run.smithi045.stdout: "session_remove": 1, 2023-08-11T12:40:43.140 INFO:teuthology.orchestra.run.smithi045.stdout: "sessions_open": 2, 2023-08-11T12:40:43.141 INFO:teuthology.orchestra.run.smithi045.stdout: "sessions_stale": 0, 2023-08-11T12:40:43.141 INFO:teuthology.orchestra.run.smithi045.stdout: "total_load": 120, 2023-08-11T12:40:43.141 INFO:teuthology.orchestra.run.smithi045.stdout: "average_load": 60, 2023-08-11T12:40:43.141 INFO:teuthology.orchestra.run.smithi045.stdout: "avg_session_uptime": 944 2023-08-11T12:40:43.141 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.142 INFO:teuthology.orchestra.run.smithi045.stdout: "mempool": { 2023-08-11T12:40:43.142 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_bytes": 0, 2023-08-11T12:40:43.142 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_items": 0, 2023-08-11T12:40:43.142 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_bytes": 0, 2023-08-11T12:40:43.142 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_items": 0, 2023-08-11T12:40:43.143 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_bytes": 0, 2023-08-11T12:40:43.143 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_items": 0, 2023-08-11T12:40:43.143 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-11T12:40:43.143 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_items": 0, 2023-08-11T12:40:43.143 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-11T12:40:43.144 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_items": 0, 2023-08-11T12:40:43.144 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_bytes": 0, 2023-08-11T12:40:43.144 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_items": 0, 2023-08-11T12:40:43.144 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-11T12:40:43.144 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_items": 0, 2023-08-11T12:40:43.145 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_bytes": 0, 2023-08-11T12:40:43.145 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_items": 0, 2023-08-11T12:40:43.145 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_bytes": 0, 2023-08-11T12:40:43.145 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_items": 0, 2023-08-11T12:40:43.145 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-11T12:40:43.146 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_items": 0, 2023-08-11T12:40:43.146 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-11T12:40:43.146 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_items": 0, 2023-08-11T12:40:43.146 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_bytes": 0, 2023-08-11T12:40:43.146 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_items": 0, 2023-08-11T12:40:43.147 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_bytes": 0, 2023-08-11T12:40:43.147 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_items": 0, 2023-08-11T12:40:43.147 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-11T12:40:43.147 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_items": 0, 2023-08-11T12:40:43.147 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_bytes": 0, 2023-08-11T12:40:43.148 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_items": 0, 2023-08-11T12:40:43.148 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_bytes": 0, 2023-08-11T12:40:43.148 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_items": 0, 2023-08-11T12:40:43.148 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_bytes": 0, 2023-08-11T12:40:43.148 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_items": 0, 2023-08-11T12:40:43.149 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_bytes": 0, 2023-08-11T12:40:43.149 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_items": 0, 2023-08-11T12:40:43.149 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_bytes": 661895, 2023-08-11T12:40:43.149 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_items": 966, 2023-08-11T12:40:43.149 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_bytes": 0, 2023-08-11T12:40:43.150 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_items": 0, 2023-08-11T12:40:43.150 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_bytes": 0, 2023-08-11T12:40:43.150 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_items": 0, 2023-08-11T12:40:43.150 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_bytes": 0, 2023-08-11T12:40:43.150 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_items": 0, 2023-08-11T12:40:43.150 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_bytes": 0, 2023-08-11T12:40:43.151 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_items": 0, 2023-08-11T12:40:43.151 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_bytes": 9320, 2023-08-11T12:40:43.151 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_items": 178, 2023-08-11T12:40:43.151 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_bytes": 0, 2023-08-11T12:40:43.151 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_items": 0, 2023-08-11T12:40:43.152 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_bytes": 0, 2023-08-11T12:40:43.152 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_items": 0, 2023-08-11T12:40:43.152 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_bytes": 2586303, 2023-08-11T12:40:43.152 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_items": 33413, 2023-08-11T12:40:43.152 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_bytes": 0, 2023-08-11T12:40:43.153 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_items": 0, 2023-08-11T12:40:43.153 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_bytes": 0, 2023-08-11T12:40:43.153 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_items": 0 2023-08-11T12:40:43.153 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.153 INFO:teuthology.orchestra.run.smithi045.stdout: "objecter": { 2023-08-11T12:40:43.154 INFO:teuthology.orchestra.run.smithi045.stdout: "op_active": 0, 2023-08-11T12:40:43.154 INFO:teuthology.orchestra.run.smithi045.stdout: "op_laggy": 0, 2023-08-11T12:40:43.154 INFO:teuthology.orchestra.run.smithi045.stdout: "op_send": 613, 2023-08-11T12:40:43.154 INFO:teuthology.orchestra.run.smithi045.stdout: "op_send_bytes": 2348585, 2023-08-11T12:40:43.154 INFO:teuthology.orchestra.run.smithi045.stdout: "op_resend": 30, 2023-08-11T12:40:43.155 INFO:teuthology.orchestra.run.smithi045.stdout: "op_reply": 613, 2023-08-11T12:40:43.155 INFO:teuthology.orchestra.run.smithi045.stdout: "op_latency": { 2023-08-11T12:40:43.155 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 613, 2023-08-11T12:40:43.155 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 1.397978061, 2023-08-11T12:40:43.155 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.002280551 2023-08-11T12:40:43.156 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.156 INFO:teuthology.orchestra.run.smithi045.stdout: "op_inflight": 0, 2023-08-11T12:40:43.156 INFO:teuthology.orchestra.run.smithi045.stdout: "oplen_avg": { 2023-08-11T12:40:43.156 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 613, 2023-08-11T12:40:43.156 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 669 2023-08-11T12:40:43.157 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.157 INFO:teuthology.orchestra.run.smithi045.stdout: "op": 613, 2023-08-11T12:40:43.157 INFO:teuthology.orchestra.run.smithi045.stdout: "op_r": 187, 2023-08-11T12:40:43.157 INFO:teuthology.orchestra.run.smithi045.stdout: "op_w": 426, 2023-08-11T12:40:43.157 INFO:teuthology.orchestra.run.smithi045.stdout: "op_rmw": 0, 2023-08-11T12:40:43.157 INFO:teuthology.orchestra.run.smithi045.stdout: "op_pg": 0, 2023-08-11T12:40:43.158 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_stat": 0, 2023-08-11T12:40:43.158 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_create": 10, 2023-08-11T12:40:43.158 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_read": 0, 2023-08-11T12:40:43.158 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_write": 355, 2023-08-11T12:40:43.158 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_writefull": 19, 2023-08-11T12:40:43.159 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_writesame": 0, 2023-08-11T12:40:43.159 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_append": 0, 2023-08-11T12:40:43.159 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_zero": 0, 2023-08-11T12:40:43.159 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_truncate": 0, 2023-08-11T12:40:43.159 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_delete": 6, 2023-08-11T12:40:43.160 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_mapext": 0, 2023-08-11T12:40:43.160 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_sparse_read": 0, 2023-08-11T12:40:43.160 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_clonerange": 0, 2023-08-11T12:40:43.160 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_getxattr": 187, 2023-08-11T12:40:43.160 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_setxattr": 20, 2023-08-11T12:40:43.161 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_cmpxattr": 0, 2023-08-11T12:40:43.161 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_rmxattr": 0, 2023-08-11T12:40:43.161 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_resetxattrs": 0, 2023-08-11T12:40:43.161 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_call": 0, 2023-08-11T12:40:43.161 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_watch": 0, 2023-08-11T12:40:43.162 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_notify": 0, 2023-08-11T12:40:43.162 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_src_cmpxattr": 0, 2023-08-11T12:40:43.162 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_pgls": 0, 2023-08-11T12:40:43.162 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_pgls_filter": 0, 2023-08-11T12:40:43.162 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_other": 0, 2023-08-11T12:40:43.162 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_active": 0, 2023-08-11T12:40:43.163 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_send": 0, 2023-08-11T12:40:43.163 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_resend": 0, 2023-08-11T12:40:43.163 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_ping": 0, 2023-08-11T12:40:43.163 INFO:teuthology.orchestra.run.smithi045.stdout: "poolop_active": 0, 2023-08-11T12:40:43.163 INFO:teuthology.orchestra.run.smithi045.stdout: "poolop_send": 0, 2023-08-11T12:40:43.164 INFO:teuthology.orchestra.run.smithi045.stdout: "poolop_resend": 0, 2023-08-11T12:40:43.164 INFO:teuthology.orchestra.run.smithi045.stdout: "poolstat_active": 0, 2023-08-11T12:40:43.164 INFO:teuthology.orchestra.run.smithi045.stdout: "poolstat_send": 0, 2023-08-11T12:40:43.164 INFO:teuthology.orchestra.run.smithi045.stdout: "poolstat_resend": 0, 2023-08-11T12:40:43.164 INFO:teuthology.orchestra.run.smithi045.stdout: "statfs_active": 0, 2023-08-11T12:40:43.165 INFO:teuthology.orchestra.run.smithi045.stdout: "statfs_send": 0, 2023-08-11T12:40:43.165 INFO:teuthology.orchestra.run.smithi045.stdout: "statfs_resend": 0, 2023-08-11T12:40:43.165 INFO:teuthology.orchestra.run.smithi045.stdout: "command_active": 0, 2023-08-11T12:40:43.165 INFO:teuthology.orchestra.run.smithi045.stdout: "command_send": 0, 2023-08-11T12:40:43.165 INFO:teuthology.orchestra.run.smithi045.stdout: "command_resend": 0, 2023-08-11T12:40:43.166 INFO:teuthology.orchestra.run.smithi045.stdout: "map_epoch": 110, 2023-08-11T12:40:43.166 INFO:teuthology.orchestra.run.smithi045.stdout: "map_full": 0, 2023-08-11T12:40:43.166 INFO:teuthology.orchestra.run.smithi045.stdout: "map_inc": 22, 2023-08-11T12:40:43.166 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_sessions": 12, 2023-08-11T12:40:43.166 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_session_open": 12, 2023-08-11T12:40:43.166 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_session_close": 0, 2023-08-11T12:40:43.167 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_laggy": 0, 2023-08-11T12:40:43.167 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_wr": 56, 2023-08-11T12:40:43.167 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_rd": 0, 2023-08-11T12:40:43.167 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_del": 16 2023-08-11T12:40:43.167 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.168 INFO:teuthology.orchestra.run.smithi045.stdout: "oft": { 2023-08-11T12:40:43.168 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_objs": 1, 2023-08-11T12:40:43.168 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_kv_pairs": 0, 2023-08-11T12:40:43.168 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_updates": 0, 2023-08-11T12:40:43.168 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_removes": 0 2023-08-11T12:40:43.169 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.169 INFO:teuthology.orchestra.run.smithi045.stdout: "osd-slow-ops": { 2023-08-11T12:40:43.169 INFO:teuthology.orchestra.run.smithi045.stdout: "slow_ops_count": 4 2023-08-11T12:40:43.169 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.169 INFO:teuthology.orchestra.run.smithi045.stdout: "purge_queue": { 2023-08-11T12:40:43.170 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing_ops": 0, 2023-08-11T12:40:43.170 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing_ops_high_water": 0, 2023-08-11T12:40:43.170 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing": 0, 2023-08-11T12:40:43.170 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing_high_water": 0, 2023-08-11T12:40:43.170 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executed": 0, 2023-08-11T12:40:43.171 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_item_in_journal": 0 2023-08-11T12:40:43.171 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.171 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-11T12:40:43.171 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2023-08-11T12:40:43.171 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 104857600, 2023-08-11T12:40:43.172 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2023-08-11T12:40:43.172 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 449817, 2023-08-11T12:40:43.172 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 36188510, 2023-08-11T12:40:43.172 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:43.172 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 449817, 2023-08-11T12:40:43.173 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2023-08-11T12:40:43.173 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2023-08-11T12:40:43.173 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 449817, 2023-08-11T12:40:43.173 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 36188510, 2023-08-11T12:40:43.173 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2023-08-11T12:40:43.173 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:43.174 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:43.174 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:43.174 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:43.174 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.174 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-objecter_bytes": { 2023-08-11T12:40:43.175 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2023-08-11T12:40:43.175 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 104857600, 2023-08-11T12:40:43.175 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2023-08-11T12:40:43.175 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 0, 2023-08-11T12:40:43.175 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 0, 2023-08-11T12:40:43.176 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:43.176 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:43.176 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 613, 2023-08-11T12:40:43.176 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 2348585, 2023-08-11T12:40:43.176 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 613, 2023-08-11T12:40:43.177 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 2348585, 2023-08-11T12:40:43.177 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2023-08-11T12:40:43.177 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:43.177 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:43.177 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:43.178 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:43.178 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.178 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-objecter_ops": { 2023-08-11T12:40:43.178 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2023-08-11T12:40:43.178 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 1024, 2023-08-11T12:40:43.179 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2023-08-11T12:40:43.179 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 0, 2023-08-11T12:40:43.179 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 0, 2023-08-11T12:40:43.179 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:43.179 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:43.180 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 613, 2023-08-11T12:40:43.180 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 613, 2023-08-11T12:40:43.180 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 613, 2023-08-11T12:40:43.180 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 613, 2023-08-11T12:40:43.180 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2023-08-11T12:40:43.180 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:43.181 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:43.181 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:43.181 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:43.181 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.181 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-write_buf_throttle": { 2023-08-11T12:40:43.182 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2023-08-11T12:40:43.182 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 3758096384, 2023-08-11T12:40:43.182 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2023-08-11T12:40:43.182 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 0, 2023-08-11T12:40:43.182 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 0, 2023-08-11T12:40:43.183 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:43.183 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:43.183 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2023-08-11T12:40:43.183 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2023-08-11T12:40:43.183 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 0, 2023-08-11T12:40:43.184 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 0, 2023-08-11T12:40:43.184 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2023-08-11T12:40:43.184 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:43.185 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:43.185 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:43.185 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:43.185 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-08-11T12:40:43.186 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-write_buf_throttle-0x55a0f4270000": { 2023-08-11T12:40:43.186 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2023-08-11T12:40:43.186 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 3758096384, 2023-08-11T12:40:43.186 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2023-08-11T12:40:43.187 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 824, 2023-08-11T12:40:43.187 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 2307218, 2023-08-11T12:40:43.187 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:43.187 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 824, 2023-08-11T12:40:43.187 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2023-08-11T12:40:43.188 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2023-08-11T12:40:43.188 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 355, 2023-08-11T12:40:43.188 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 2307218, 2023-08-11T12:40:43.188 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2023-08-11T12:40:43.188 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2023-08-11T12:40:43.189 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2023-08-11T12:40:43.189 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2023-08-11T12:40:43.189 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:43.189 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-08-11T12:40:43.189 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-08-11T12:40:43.456 INFO:tasks.check_counter:Daemon mds.k mds.exported=7 2023-08-11T12:40:43.457 INFO:tasks.check_counter:Daemon mds.k mds.imported=27 2023-08-11T12:40:43.457 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=21 2023-08-11T12:40:43.457 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=187 2023-08-11T12:40:43.457 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=4 2023-08-11T12:40:43.458 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2023-08-11T12:40:43.458 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2023-08-11T12:40:43.458 DEBUG:tasks.check_counter:Getting stats from c 2023-08-11T12:40:43.459 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph daemon mds.c perf dump 2023-08-11T12:40:44.039 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.c/config 2023-08-11T12:40:44.301 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:44 smithi194 ceph-mon[130905]: pgmap v506: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:40:44.302 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:44 smithi008 ceph-mon[97158]: pgmap v506: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:40:44.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:44 smithi045 ceph-mon[130284]: pgmap v506: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:40:45.292 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2023-08-11T12:40:45.293 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-0": { 2023-08-11T12:40:45.293 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 1471, 2023-08-11T12:40:45.294 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 1427, 2023-08-11T12:40:45.294 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 2048272, 2023-08-11T12:40:45.294 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 528586, 2023-08-11T12:40:45.294 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 5, 2023-08-11T12:40:45.294 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 1, 2023-08-11T12:40:45.295 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.195330635, 2023-08-11T12:40:45.295 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.058178652, 2023-08-11T12:40:45.295 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.070035403, 2023-08-11T12:40:45.295 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.058196340, 2023-08-11T12:40:45.295 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:45.296 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 1426, 2023-08-11T12:40:45.296 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.082217059, 2023-08-11T12:40:45.296 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000057655 2023-08-11T12:40:45.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.296 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:45.297 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.297 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.297 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.297 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 1680688, 2023-08-11T12:40:45.298 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 188352 2023-08-11T12:40:45.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.298 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-1": { 2023-08-11T12:40:45.298 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 4, 2023-08-11T12:40:45.299 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 234, 2023-08-11T12:40:45.299 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 876, 2023-08-11T12:40:45.299 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 551964, 2023-08-11T12:40:45.299 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 6, 2023-08-11T12:40:45.299 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 4, 2023-08-11T12:40:45.300 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.013044342, 2023-08-11T12:40:45.300 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.008536890, 2023-08-11T12:40:45.300 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.001879829, 2023-08-11T12:40:45.300 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.000084656, 2023-08-11T12:40:45.301 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:45.301 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 231, 2023-08-11T12:40:45.301 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.020735022, 2023-08-11T12:40:45.301 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000089762 2023-08-11T12:40:45.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.302 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:45.302 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.302 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.302 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.303 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 320, 2023-08-11T12:40:45.303 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 551280 2023-08-11T12:40:45.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.303 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-2": { 2023-08-11T12:40:45.303 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 2176, 2023-08-11T12:40:45.304 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 2176, 2023-08-11T12:40:45.304 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 4140865, 2023-08-11T12:40:45.304 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 675947, 2023-08-11T12:40:45.304 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 5, 2023-08-11T12:40:45.304 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 3, 2023-08-11T12:40:45.305 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.158723904, 2023-08-11T12:40:45.305 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.048304945, 2023-08-11T12:40:45.305 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.038815196, 2023-08-11T12:40:45.305 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.060141611, 2023-08-11T12:40:45.305 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:45.306 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 2175, 2023-08-11T12:40:45.306 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.076154368, 2023-08-11T12:40:45.306 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000035013 2023-08-11T12:40:45.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.306 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:45.307 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.307 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.307 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.307 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-08-11T12:40:45.308 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 448 2023-08-11T12:40:45.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.308 INFO:teuthology.orchestra.run.smithi194.stdout: "cct": { 2023-08-11T12:40:45.308 INFO:teuthology.orchestra.run.smithi194.stdout: "total_workers": 1, 2023-08-11T12:40:45.308 INFO:teuthology.orchestra.run.smithi194.stdout: "unhealthy_workers": 0 2023-08-11T12:40:45.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.309 INFO:teuthology.orchestra.run.smithi194.stdout: "finisher-MDSRank": { 2023-08-11T12:40:45.309 INFO:teuthology.orchestra.run.smithi194.stdout: "queue_len": 0, 2023-08-11T12:40:45.309 INFO:teuthology.orchestra.run.smithi194.stdout: "complete_latency": { 2023-08-11T12:40:45.309 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 5537, 2023-08-11T12:40:45.310 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.161068743, 2023-08-11T12:40:45.310 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000029089 2023-08-11T12:40:45.310 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:45.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.310 INFO:teuthology.orchestra.run.smithi194.stdout: "finisher-PurgeQueue": { 2023-08-11T12:40:45.311 INFO:teuthology.orchestra.run.smithi194.stdout: "queue_len": 0, 2023-08-11T12:40:45.311 INFO:teuthology.orchestra.run.smithi194.stdout: "complete_latency": { 2023-08-11T12:40:45.311 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.311 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.311 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.312 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:45.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.312 INFO:teuthology.orchestra.run.smithi194.stdout: "mds": { 2023-08-11T12:40:45.312 INFO:teuthology.orchestra.run.smithi194.stdout: "request": 0, 2023-08-11T12:40:45.313 INFO:teuthology.orchestra.run.smithi194.stdout: "reply": 0, 2023-08-11T12:40:45.313 INFO:teuthology.orchestra.run.smithi194.stdout: "reply_latency": { 2023-08-11T12:40:45.313 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.314 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.314 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.314 INFO:teuthology.orchestra.run.smithi194.stdout: "slow_reply": 0, 2023-08-11T12:40:45.315 INFO:teuthology.orchestra.run.smithi194.stdout: "forward": 0, 2023-08-11T12:40:45.315 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_fetch_complete": 0, 2023-08-11T12:40:45.315 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_fetch_keys": 0, 2023-08-11T12:40:45.315 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_commit": 0, 2023-08-11T12:40:45.315 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_split": 0, 2023-08-11T12:40:45.316 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_merge": 0, 2023-08-11T12:40:45.316 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes": 591, 2023-08-11T12:40:45.316 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_top": 53, 2023-08-11T12:40:45.316 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_bottom": 535, 2023-08-11T12:40:45.316 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_pin_tail": 3, 2023-08-11T12:40:45.317 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_pinned": 514, 2023-08-11T12:40:45.317 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_expired": 0, 2023-08-11T12:40:45.317 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_with_caps": 0, 2023-08-11T12:40:45.317 INFO:teuthology.orchestra.run.smithi194.stdout: "caps": 0, 2023-08-11T12:40:45.317 INFO:teuthology.orchestra.run.smithi194.stdout: "subtrees": 15, 2023-08-11T12:40:45.318 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse": 0, 2023-08-11T12:40:45.318 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_hit": 0, 2023-08-11T12:40:45.318 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_forward": 0, 2023-08-11T12:40:45.318 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_discover": 0, 2023-08-11T12:40:45.318 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_dir_fetch": 0, 2023-08-11T12:40:45.318 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_remote_ino": 0, 2023-08-11T12:40:45.319 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_lock": 0, 2023-08-11T12:40:45.319 INFO:teuthology.orchestra.run.smithi194.stdout: "load_cent": 0, 2023-08-11T12:40:45.319 INFO:teuthology.orchestra.run.smithi194.stdout: "q": 0, 2023-08-11T12:40:45.319 INFO:teuthology.orchestra.run.smithi194.stdout: "exported": 0, 2023-08-11T12:40:45.319 INFO:teuthology.orchestra.run.smithi194.stdout: "exported_inodes": 0, 2023-08-11T12:40:45.320 INFO:teuthology.orchestra.run.smithi194.stdout: "imported": 0, 2023-08-11T12:40:45.320 INFO:teuthology.orchestra.run.smithi194.stdout: "imported_inodes": 0, 2023-08-11T12:40:45.320 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_dir_fetch": 0, 2023-08-11T12:40:45.320 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_backtrace_fetch": 0, 2023-08-11T12:40:45.321 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_peer_discover": 0, 2023-08-11T12:40:45.321 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rfiles": 0, 2023-08-11T12:40:45.321 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rbytes": 0, 2023-08-11T12:40:45.321 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rsnaps": 0, 2023-08-11T12:40:45.321 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_backtrace_fetch": 0, 2023-08-11T12:40:45.322 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_set_tag": 0, 2023-08-11T12:40:45.322 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_backtrace_repaired": 0, 2023-08-11T12:40:45.322 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_inotable_repaired": 0, 2023-08-11T12:40:45.322 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dir_inodes": 0, 2023-08-11T12:40:45.322 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dir_base_inodes": 0, 2023-08-11T12:40:45.322 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dirfrag_rstats": 0, 2023-08-11T12:40:45.323 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_file_inodes": 0, 2023-08-11T12:40:45.323 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_inode_file_caps": 0, 2023-08-11T12:40:45.323 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_revoke": 0, 2023-08-11T12:40:45.323 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_grant": 0, 2023-08-11T12:40:45.323 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_trunc": 0, 2023-08-11T12:40:45.324 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-11T12:40:45.324 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-11T12:40:45.324 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_caps": 0, 2023-08-11T12:40:45.324 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_caps_dirty": 0, 2023-08-11T12:40:45.324 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_cap_release": 0, 2023-08-11T12:40:45.325 INFO:teuthology.orchestra.run.smithi194.stdout: "process_request_cap_release": 0 2023-08-11T12:40:45.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.325 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_cache": { 2023-08-11T12:40:45.325 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_update": 0, 2023-08-11T12:40:45.325 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_update_receipt": 0, 2023-08-11T12:40:45.326 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_try_discover": 0, 2023-08-11T12:40:45.326 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_send_discover": 0, 2023-08-11T12:40:45.326 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_handle_discover": 0, 2023-08-11T12:40:45.326 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays": 0, 2023-08-11T12:40:45.326 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays_delayed": 0, 2023-08-11T12:40:45.327 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays_enqueuing": 0, 2023-08-11T12:40:45.327 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_created": 0, 2023-08-11T12:40:45.327 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_enqueued": 0, 2023-08-11T12:40:45.327 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_reintegrated": 0, 2023-08-11T12:40:45.327 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_migrated": 0, 2023-08-11T12:40:45.328 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_processing": 0, 2023-08-11T12:40:45.328 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_enqueued": 0, 2023-08-11T12:40:45.328 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_prioritized": 0, 2023-08-11T12:40:45.328 INFO:teuthology.orchestra.run.smithi194.stdout: "recovery_started": 0, 2023-08-11T12:40:45.328 INFO:teuthology.orchestra.run.smithi194.stdout: "recovery_completed": 0, 2023-08-11T12:40:45.329 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_enqueue_scrub": 0, 2023-08-11T12:40:45.329 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_exportdir": 0, 2023-08-11T12:40:45.329 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_flush": 0, 2023-08-11T12:40:45.329 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_fragmentdir": 0, 2023-08-11T12:40:45.329 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_fragstats": 0, 2023-08-11T12:40:45.330 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_inodestats": 0 2023-08-11T12:40:45.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.330 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_log": { 2023-08-11T12:40:45.330 INFO:teuthology.orchestra.run.smithi194.stdout: "evlrg": 0, 2023-08-11T12:40:45.331 INFO:teuthology.orchestra.run.smithi194.stdout: "evadd": 0, 2023-08-11T12:40:45.331 INFO:teuthology.orchestra.run.smithi194.stdout: "evex": 0, 2023-08-11T12:40:45.331 INFO:teuthology.orchestra.run.smithi194.stdout: "evtrm": 0, 2023-08-11T12:40:45.331 INFO:teuthology.orchestra.run.smithi194.stdout: "ev": 1664, 2023-08-11T12:40:45.332 INFO:teuthology.orchestra.run.smithi194.stdout: "evexg": 0, 2023-08-11T12:40:45.332 INFO:teuthology.orchestra.run.smithi194.stdout: "evexd": 0, 2023-08-11T12:40:45.332 INFO:teuthology.orchestra.run.smithi194.stdout: "segadd": 0, 2023-08-11T12:40:45.332 INFO:teuthology.orchestra.run.smithi194.stdout: "segex": 0, 2023-08-11T12:40:45.332 INFO:teuthology.orchestra.run.smithi194.stdout: "segtrm": 0, 2023-08-11T12:40:45.333 INFO:teuthology.orchestra.run.smithi194.stdout: "seg": 3, 2023-08-11T12:40:45.333 INFO:teuthology.orchestra.run.smithi194.stdout: "segmjr": 2, 2023-08-11T12:40:45.333 INFO:teuthology.orchestra.run.smithi194.stdout: "segexg": 0, 2023-08-11T12:40:45.333 INFO:teuthology.orchestra.run.smithi194.stdout: "segexd": 0, 2023-08-11T12:40:45.333 INFO:teuthology.orchestra.run.smithi194.stdout: "expos": 4194304, 2023-08-11T12:40:45.334 INFO:teuthology.orchestra.run.smithi194.stdout: "wrpos": 7779716, 2023-08-11T12:40:45.334 INFO:teuthology.orchestra.run.smithi194.stdout: "rdpos": 7779142, 2023-08-11T12:40:45.334 INFO:teuthology.orchestra.run.smithi194.stdout: "jlat": { 2023-08-11T12:40:45.334 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.334 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.335 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.335 INFO:teuthology.orchestra.run.smithi194.stdout: "replayed": 1664 2023-08-11T12:40:45.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.335 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_mem": { 2023-08-11T12:40:45.336 INFO:teuthology.orchestra.run.smithi194.stdout: "ino": 372, 2023-08-11T12:40:45.336 INFO:teuthology.orchestra.run.smithi194.stdout: "ino+": 600, 2023-08-11T12:40:45.336 INFO:teuthology.orchestra.run.smithi194.stdout: "ino-": 228, 2023-08-11T12:40:45.336 INFO:teuthology.orchestra.run.smithi194.stdout: "dir": 21, 2023-08-11T12:40:45.336 INFO:teuthology.orchestra.run.smithi194.stdout: "dir+": 58, 2023-08-11T12:40:45.337 INFO:teuthology.orchestra.run.smithi194.stdout: "dir-": 37, 2023-08-11T12:40:45.337 INFO:teuthology.orchestra.run.smithi194.stdout: "dn": 591, 2023-08-11T12:40:45.337 INFO:teuthology.orchestra.run.smithi194.stdout: "dn+": 949, 2023-08-11T12:40:45.337 INFO:teuthology.orchestra.run.smithi194.stdout: "dn-": 358, 2023-08-11T12:40:45.337 INFO:teuthology.orchestra.run.smithi194.stdout: "cap": 0, 2023-08-11T12:40:45.338 INFO:teuthology.orchestra.run.smithi194.stdout: "cap+": 0, 2023-08-11T12:40:45.338 INFO:teuthology.orchestra.run.smithi194.stdout: "cap-": 0, 2023-08-11T12:40:45.338 INFO:teuthology.orchestra.run.smithi194.stdout: "rss": 48436, 2023-08-11T12:40:45.338 INFO:teuthology.orchestra.run.smithi194.stdout: "heap": 207152 2023-08-11T12:40:45.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.339 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_server": { 2023-08-11T12:40:45.339 INFO:teuthology.orchestra.run.smithi194.stdout: "dispatch_client_request": 0, 2023-08-11T12:40:45.339 INFO:teuthology.orchestra.run.smithi194.stdout: "dispatch_server_request": 0, 2023-08-11T12:40:45.339 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_request": 0, 2023-08-11T12:40:45.339 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_session": 0, 2023-08-11T12:40:45.340 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_peer_request": 0, 2023-08-11T12:40:45.340 INFO:teuthology.orchestra.run.smithi194.stdout: "req_create_latency": { 2023-08-11T12:40:45.341 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.341 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.341 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.342 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getattr_latency": { 2023-08-11T12:40:45.342 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.342 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.342 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.343 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getfilelock_latency": { 2023-08-11T12:40:45.343 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.343 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.343 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.344 INFO:teuthology.orchestra.run.smithi194.stdout: "req_link_latency": { 2023-08-11T12:40:45.344 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.344 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.344 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.345 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookup_latency": { 2023-08-11T12:40:45.345 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.345 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.345 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.346 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookuphash_latency": { 2023-08-11T12:40:45.346 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.346 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.346 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.347 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupino_latency": { 2023-08-11T12:40:45.347 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.347 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.347 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.348 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupname_latency": { 2023-08-11T12:40:45.348 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.348 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.348 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.349 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupparent_latency": { 2023-08-11T12:40:45.349 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.349 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.349 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.350 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupsnap_latency": { 2023-08-11T12:40:45.350 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.350 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.350 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.351 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lssnap_latency": { 2023-08-11T12:40:45.351 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.351 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.352 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.352 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mkdir_latency": { 2023-08-11T12:40:45.352 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.353 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.353 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.353 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mknod_latency": { 2023-08-11T12:40:45.353 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.354 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.354 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.354 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mksnap_latency": { 2023-08-11T12:40:45.354 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.355 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.355 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.355 INFO:teuthology.orchestra.run.smithi194.stdout: "req_open_latency": { 2023-08-11T12:40:45.355 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.356 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.356 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.356 INFO:teuthology.orchestra.run.smithi194.stdout: "req_readdir_latency": { 2023-08-11T12:40:45.356 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.357 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.357 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.357 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rename_latency": { 2023-08-11T12:40:45.357 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.358 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.358 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.358 INFO:teuthology.orchestra.run.smithi194.stdout: "req_renamesnap_latency": { 2023-08-11T12:40:45.358 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.359 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.359 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.359 INFO:teuthology.orchestra.run.smithi194.stdout: "req_snapdiff_latency": { 2023-08-11T12:40:45.359 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.360 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.360 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.360 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmdir_latency": { 2023-08-11T12:40:45.360 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.361 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.361 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.362 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmsnap_latency": { 2023-08-11T12:40:45.362 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.362 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.362 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.363 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmxattr_latency": { 2023-08-11T12:40:45.363 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.363 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.363 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.364 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setattr_latency": { 2023-08-11T12:40:45.364 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.364 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.364 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.365 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setdirlayout_latency": { 2023-08-11T12:40:45.365 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.365 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.365 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.366 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setfilelock_latency": { 2023-08-11T12:40:45.366 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.366 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.366 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.367 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setlayout_latency": { 2023-08-11T12:40:45.367 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.367 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.367 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.368 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setxattr_latency": { 2023-08-11T12:40:45.368 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.368 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.368 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.369 INFO:teuthology.orchestra.run.smithi194.stdout: "req_symlink_latency": { 2023-08-11T12:40:45.369 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.369 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.369 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.370 INFO:teuthology.orchestra.run.smithi194.stdout: "req_unlink_latency": { 2023-08-11T12:40:45.370 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.370 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.370 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.371 INFO:teuthology.orchestra.run.smithi194.stdout: "cap_revoke_eviction": 0, 2023-08-11T12:40:45.371 INFO:teuthology.orchestra.run.smithi194.stdout: "cap_acquisition_throttle": 0, 2023-08-11T12:40:45.372 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getvxattr_latency": { 2023-08-11T12:40:45.372 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.372 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.372 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.372 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:45.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.373 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_sessions": { 2023-08-11T12:40:45.373 INFO:teuthology.orchestra.run.smithi194.stdout: "session_count": 2, 2023-08-11T12:40:45.373 INFO:teuthology.orchestra.run.smithi194.stdout: "session_add": 2, 2023-08-11T12:40:45.373 INFO:teuthology.orchestra.run.smithi194.stdout: "session_remove": 0, 2023-08-11T12:40:45.374 INFO:teuthology.orchestra.run.smithi194.stdout: "sessions_open": 2, 2023-08-11T12:40:45.374 INFO:teuthology.orchestra.run.smithi194.stdout: "sessions_stale": 0, 2023-08-11T12:40:45.375 INFO:teuthology.orchestra.run.smithi194.stdout: "total_load": 0, 2023-08-11T12:40:45.376 INFO:teuthology.orchestra.run.smithi194.stdout: "average_load": 0, 2023-08-11T12:40:45.376 INFO:teuthology.orchestra.run.smithi194.stdout: "avg_session_uptime": 2911 2023-08-11T12:40:45.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.376 INFO:teuthology.orchestra.run.smithi194.stdout: "mempool": { 2023-08-11T12:40:45.376 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_bytes": 0, 2023-08-11T12:40:45.377 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_items": 0, 2023-08-11T12:40:45.377 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_bytes": 0, 2023-08-11T12:40:45.377 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_items": 0, 2023-08-11T12:40:45.377 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_bytes": 0, 2023-08-11T12:40:45.377 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_items": 0, 2023-08-11T12:40:45.378 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-11T12:40:45.378 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_items": 0, 2023-08-11T12:40:45.378 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-11T12:40:45.378 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_items": 0, 2023-08-11T12:40:45.378 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_bytes": 0, 2023-08-11T12:40:45.379 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_items": 0, 2023-08-11T12:40:45.379 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-11T12:40:45.379 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_items": 0, 2023-08-11T12:40:45.379 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_bytes": 0, 2023-08-11T12:40:45.379 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_items": 0, 2023-08-11T12:40:45.380 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_bytes": 0, 2023-08-11T12:40:45.380 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_items": 0, 2023-08-11T12:40:45.380 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-11T12:40:45.380 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_items": 0, 2023-08-11T12:40:45.380 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-11T12:40:45.381 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_items": 0, 2023-08-11T12:40:45.381 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_bytes": 0, 2023-08-11T12:40:45.381 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_items": 0, 2023-08-11T12:40:45.381 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_bytes": 0, 2023-08-11T12:40:45.382 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_items": 0, 2023-08-11T12:40:45.382 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-11T12:40:45.382 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_items": 0, 2023-08-11T12:40:45.383 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_bytes": 0, 2023-08-11T12:40:45.383 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_items": 0, 2023-08-11T12:40:45.383 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_bytes": 0, 2023-08-11T12:40:45.383 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_items": 0, 2023-08-11T12:40:45.383 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_bytes": 0, 2023-08-11T12:40:45.384 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_items": 0, 2023-08-11T12:40:45.384 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_bytes": 0, 2023-08-11T12:40:45.384 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_items": 0, 2023-08-11T12:40:45.384 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_bytes": 198383, 2023-08-11T12:40:45.384 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_items": 489, 2023-08-11T12:40:45.385 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_bytes": 0, 2023-08-11T12:40:45.385 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_items": 0, 2023-08-11T12:40:45.385 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_bytes": 0, 2023-08-11T12:40:45.385 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_items": 0, 2023-08-11T12:40:45.385 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_bytes": 0, 2023-08-11T12:40:45.386 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_items": 0, 2023-08-11T12:40:45.386 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_bytes": 0, 2023-08-11T12:40:45.386 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_items": 0, 2023-08-11T12:40:45.386 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_bytes": 9320, 2023-08-11T12:40:45.386 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_items": 178, 2023-08-11T12:40:45.387 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_bytes": 0, 2023-08-11T12:40:45.387 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_items": 0, 2023-08-11T12:40:45.387 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_bytes": 0, 2023-08-11T12:40:45.387 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_items": 0, 2023-08-11T12:40:45.387 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_bytes": 1368053, 2023-08-11T12:40:45.388 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_items": 19555, 2023-08-11T12:40:45.388 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_bytes": 0, 2023-08-11T12:40:45.388 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_items": 0, 2023-08-11T12:40:45.388 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_bytes": 0, 2023-08-11T12:40:45.388 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_items": 0 2023-08-11T12:40:45.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.389 INFO:teuthology.orchestra.run.smithi194.stdout: "objecter": { 2023-08-11T12:40:45.389 INFO:teuthology.orchestra.run.smithi194.stdout: "op_active": 0, 2023-08-11T12:40:45.389 INFO:teuthology.orchestra.run.smithi194.stdout: "op_laggy": 0, 2023-08-11T12:40:45.389 INFO:teuthology.orchestra.run.smithi194.stdout: "op_send": 3268, 2023-08-11T12:40:45.389 INFO:teuthology.orchestra.run.smithi194.stdout: "op_send_bytes": 21, 2023-08-11T12:40:45.390 INFO:teuthology.orchestra.run.smithi194.stdout: "op_resend": 3, 2023-08-11T12:40:45.390 INFO:teuthology.orchestra.run.smithi194.stdout: "op_reply": 3268, 2023-08-11T12:40:45.390 INFO:teuthology.orchestra.run.smithi194.stdout: "op_latency": { 2023-08-11T12:40:45.390 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 3268, 2023-08-11T12:40:45.390 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 1.629966766, 2023-08-11T12:40:45.391 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000498765 2023-08-11T12:40:45.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.391 INFO:teuthology.orchestra.run.smithi194.stdout: "op_inflight": 0, 2023-08-11T12:40:45.391 INFO:teuthology.orchestra.run.smithi194.stdout: "oplen_avg": { 2023-08-11T12:40:45.391 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 3268, 2023-08-11T12:40:45.392 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 3269 2023-08-11T12:40:45.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.393 INFO:teuthology.orchestra.run.smithi194.stdout: "op": 3268, 2023-08-11T12:40:45.393 INFO:teuthology.orchestra.run.smithi194.stdout: "op_r": 3268, 2023-08-11T12:40:45.393 INFO:teuthology.orchestra.run.smithi194.stdout: "op_w": 0, 2023-08-11T12:40:45.393 INFO:teuthology.orchestra.run.smithi194.stdout: "op_rmw": 0, 2023-08-11T12:40:45.394 INFO:teuthology.orchestra.run.smithi194.stdout: "op_pg": 0, 2023-08-11T12:40:45.394 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_stat": 2082, 2023-08-11T12:40:45.394 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_create": 0, 2023-08-11T12:40:45.394 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_read": 1184, 2023-08-11T12:40:45.394 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_write": 0, 2023-08-11T12:40:45.395 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_writefull": 0, 2023-08-11T12:40:45.395 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_writesame": 0, 2023-08-11T12:40:45.395 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_append": 0, 2023-08-11T12:40:45.395 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_zero": 0, 2023-08-11T12:40:45.395 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_truncate": 0, 2023-08-11T12:40:45.396 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_delete": 0, 2023-08-11T12:40:45.396 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_mapext": 0, 2023-08-11T12:40:45.396 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_sparse_read": 0, 2023-08-11T12:40:45.396 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_clonerange": 0, 2023-08-11T12:40:45.396 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_getxattr": 1, 2023-08-11T12:40:45.397 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_setxattr": 0, 2023-08-11T12:40:45.397 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_cmpxattr": 0, 2023-08-11T12:40:45.397 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_rmxattr": 0, 2023-08-11T12:40:45.398 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_resetxattrs": 0, 2023-08-11T12:40:45.398 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_call": 0, 2023-08-11T12:40:45.398 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_watch": 0, 2023-08-11T12:40:45.398 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_notify": 0, 2023-08-11T12:40:45.398 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_src_cmpxattr": 0, 2023-08-11T12:40:45.398 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_pgls": 0, 2023-08-11T12:40:45.399 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_pgls_filter": 0, 2023-08-11T12:40:45.399 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_other": 0, 2023-08-11T12:40:45.399 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_active": 0, 2023-08-11T12:40:45.399 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_send": 0, 2023-08-11T12:40:45.399 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_resend": 0, 2023-08-11T12:40:45.400 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_ping": 0, 2023-08-11T12:40:45.400 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_active": 0, 2023-08-11T12:40:45.400 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_send": 0, 2023-08-11T12:40:45.400 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_resend": 0, 2023-08-11T12:40:45.400 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_active": 0, 2023-08-11T12:40:45.401 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_send": 0, 2023-08-11T12:40:45.401 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_resend": 0, 2023-08-11T12:40:45.401 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_active": 0, 2023-08-11T12:40:45.401 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_send": 0, 2023-08-11T12:40:45.401 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_resend": 0, 2023-08-11T12:40:45.402 INFO:teuthology.orchestra.run.smithi194.stdout: "command_active": 0, 2023-08-11T12:40:45.402 INFO:teuthology.orchestra.run.smithi194.stdout: "command_send": 0, 2023-08-11T12:40:45.402 INFO:teuthology.orchestra.run.smithi194.stdout: "command_resend": 0, 2023-08-11T12:40:45.402 INFO:teuthology.orchestra.run.smithi194.stdout: "map_epoch": 110, 2023-08-11T12:40:45.402 INFO:teuthology.orchestra.run.smithi194.stdout: "map_full": 0, 2023-08-11T12:40:45.403 INFO:teuthology.orchestra.run.smithi194.stdout: "map_inc": 23, 2023-08-11T12:40:45.403 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_sessions": 4, 2023-08-11T12:40:45.403 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_session_open": 5, 2023-08-11T12:40:45.403 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_session_close": 1, 2023-08-11T12:40:45.403 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_laggy": 0, 2023-08-11T12:40:45.404 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_wr": 0, 2023-08-11T12:40:45.404 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_rd": 2, 2023-08-11T12:40:45.404 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_del": 0 2023-08-11T12:40:45.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.404 INFO:teuthology.orchestra.run.smithi194.stdout: "oft": { 2023-08-11T12:40:45.405 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_objs": 0, 2023-08-11T12:40:45.405 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_kv_pairs": 0, 2023-08-11T12:40:45.405 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_updates": 0, 2023-08-11T12:40:45.405 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_removes": 0 2023-08-11T12:40:45.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.406 INFO:teuthology.orchestra.run.smithi194.stdout: "osd-slow-ops": { 2023-08-11T12:40:45.406 INFO:teuthology.orchestra.run.smithi194.stdout: "slow_ops_count": 0 2023-08-11T12:40:45.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.406 INFO:teuthology.orchestra.run.smithi194.stdout: "purge_queue": { 2023-08-11T12:40:45.406 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_ops": 0, 2023-08-11T12:40:45.407 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_ops_high_water": 0, 2023-08-11T12:40:45.407 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing": 0, 2023-08-11T12:40:45.407 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_high_water": 0, 2023-08-11T12:40:45.407 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executed": 0, 2023-08-11T12:40:45.407 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_item_in_journal": 0 2023-08-11T12:40:45.408 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.408 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-11T12:40:45.408 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2023-08-11T12:40:45.408 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2023-08-11T12:40:45.408 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2023-08-11T12:40:45.409 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 3647, 2023-08-11T12:40:45.409 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 5839706, 2023-08-11T12:40:45.409 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:45.409 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 3647, 2023-08-11T12:40:45.409 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2023-08-11T12:40:45.410 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2023-08-11T12:40:45.410 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 3647, 2023-08-11T12:40:45.410 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 5839706, 2023-08-11T12:40:45.410 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2023-08-11T12:40:45.410 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.411 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.411 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.411 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:45.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.411 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-objecter_bytes": { 2023-08-11T12:40:45.412 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2023-08-11T12:40:45.412 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2023-08-11T12:40:45.412 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2023-08-11T12:40:45.412 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2023-08-11T12:40:45.412 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2023-08-11T12:40:45.413 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:45.413 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:45.413 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 3268, 2023-08-11T12:40:45.413 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 3585417, 2023-08-11T12:40:45.413 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 3268, 2023-08-11T12:40:45.414 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 3585417, 2023-08-11T12:40:45.414 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2023-08-11T12:40:45.414 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.414 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.414 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.415 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:45.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.415 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-objecter_ops": { 2023-08-11T12:40:45.415 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2023-08-11T12:40:45.415 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 1024, 2023-08-11T12:40:45.416 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2023-08-11T12:40:45.416 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2023-08-11T12:40:45.416 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2023-08-11T12:40:45.416 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:45.416 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:45.417 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 3268, 2023-08-11T12:40:45.417 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 3268, 2023-08-11T12:40:45.417 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 3268, 2023-08-11T12:40:45.417 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 3268, 2023-08-11T12:40:45.417 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2023-08-11T12:40:45.418 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.418 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.418 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.418 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:45.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.419 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-write_buf_throttle": { 2023-08-11T12:40:45.419 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2023-08-11T12:40:45.419 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 3758096384, 2023-08-11T12:40:45.419 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2023-08-11T12:40:45.419 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2023-08-11T12:40:45.420 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2023-08-11T12:40:45.420 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:45.420 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:45.420 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2023-08-11T12:40:45.420 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2023-08-11T12:40:45.421 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 0, 2023-08-11T12:40:45.421 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 0, 2023-08-11T12:40:45.421 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2023-08-11T12:40:45.421 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.421 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.422 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.422 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:45.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:45.422 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-write_buf_throttle-0x55e4d4c2e000": { 2023-08-11T12:40:45.422 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2023-08-11T12:40:45.423 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 3758096384, 2023-08-11T12:40:45.423 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2023-08-11T12:40:45.423 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2023-08-11T12:40:45.423 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2023-08-11T12:40:45.423 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:45.424 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:45.424 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2023-08-11T12:40:45.424 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2023-08-11T12:40:45.424 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 0, 2023-08-11T12:40:45.424 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 0, 2023-08-11T12:40:45.425 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2023-08-11T12:40:45.425 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:45.425 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:45.425 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:45.425 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:45.425 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:45.426 INFO:teuthology.orchestra.run.smithi194.stdout:} 2023-08-11T12:40:45.694 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2023-08-11T12:40:45.695 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2023-08-11T12:40:45.695 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2023-08-11T12:40:45.695 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2023-08-11T12:40:45.696 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=0 2023-08-11T12:40:45.696 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2023-08-11T12:40:45.696 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2023-08-11T12:40:45.696 DEBUG:tasks.check_counter:Getting stats from f 2023-08-11T12:40:45.697 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph daemon mds.f perf dump 2023-08-11T12:40:46.250 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.c/config 2023-08-11T12:40:46.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:46 smithi008 ceph-mon[97158]: pgmap v507: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:46.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:46 smithi194 ceph-mon[130905]: pgmap v507: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:46.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:46 smithi045 ceph-mon[130284]: pgmap v507: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:47.386 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2023-08-11T12:40:47.387 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-0": { 2023-08-11T12:40:47.387 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 1287, 2023-08-11T12:40:47.387 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 1330, 2023-08-11T12:40:47.387 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 2047326, 2023-08-11T12:40:47.387 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 2724033, 2023-08-11T12:40:47.388 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 18, 2023-08-11T12:40:47.388 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 4, 2023-08-11T12:40:47.388 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.130372033, 2023-08-11T12:40:47.388 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.047815417, 2023-08-11T12:40:47.389 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.068928887, 2023-08-11T12:40:47.389 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.020250536, 2023-08-11T12:40:47.389 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:47.389 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 1330, 2023-08-11T12:40:47.389 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.075590403, 2023-08-11T12:40:47.390 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000056834 2023-08-11T12:40:47.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.390 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:47.390 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 774, 2023-08-11T12:40:47.390 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000158740, 2023-08-11T12:40:47.391 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000205 2023-08-11T12:40:47.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.391 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 1690528, 2023-08-11T12:40:47.391 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 215664 2023-08-11T12:40:47.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.392 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-1": { 2023-08-11T12:40:47.392 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 380, 2023-08-11T12:40:47.392 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 601, 2023-08-11T12:40:47.392 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 232899, 2023-08-11T12:40:47.393 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 1016427, 2023-08-11T12:40:47.393 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 14, 2023-08-11T12:40:47.393 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 8, 2023-08-11T12:40:47.393 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.039716941, 2023-08-11T12:40:47.393 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.018132925, 2023-08-11T12:40:47.393 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.017836300, 2023-08-11T12:40:47.394 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.003647564, 2023-08-11T12:40:47.394 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:47.394 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 598, 2023-08-11T12:40:47.394 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.050221989, 2023-08-11T12:40:47.394 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000083983 2023-08-11T12:40:47.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.395 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:47.395 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 421, 2023-08-11T12:40:47.395 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000092386, 2023-08-11T12:40:47.395 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000219 2023-08-11T12:40:47.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.396 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 1920, 2023-08-11T12:40:47.396 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 564416 2023-08-11T12:40:47.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.396 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-2": { 2023-08-11T12:40:47.397 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 3931, 2023-08-11T12:40:47.397 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 4393, 2023-08-11T12:40:47.397 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 1910778, 2023-08-11T12:40:47.397 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 2501989, 2023-08-11T12:40:47.397 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 10, 2023-08-11T12:40:47.398 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 6, 2023-08-11T12:40:47.398 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.264363616, 2023-08-11T12:40:47.398 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.105468765, 2023-08-11T12:40:47.398 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.181374883, 2023-08-11T12:40:47.398 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.010890388, 2023-08-11T12:40:47.399 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:47.399 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 4391, 2023-08-11T12:40:47.399 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.161112791, 2023-08-11T12:40:47.399 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000036691 2023-08-11T12:40:47.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.400 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:47.400 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 6870, 2023-08-11T12:40:47.400 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.001203201, 2023-08-11T12:40:47.400 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000175 2023-08-11T12:40:47.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.401 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 420448, 2023-08-11T12:40:47.401 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 1052512 2023-08-11T12:40:47.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.401 INFO:teuthology.orchestra.run.smithi194.stdout: "cct": { 2023-08-11T12:40:47.401 INFO:teuthology.orchestra.run.smithi194.stdout: "total_workers": 1, 2023-08-11T12:40:47.402 INFO:teuthology.orchestra.run.smithi194.stdout: "unhealthy_workers": 0 2023-08-11T12:40:47.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.402 INFO:teuthology.orchestra.run.smithi194.stdout: "finisher-MDSRank": { 2023-08-11T12:40:47.402 INFO:teuthology.orchestra.run.smithi194.stdout: "queue_len": 0, 2023-08-11T12:40:47.402 INFO:teuthology.orchestra.run.smithi194.stdout: "complete_latency": { 2023-08-11T12:40:47.403 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 733, 2023-08-11T12:40:47.403 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.384688629, 2023-08-11T12:40:47.403 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000524813 2023-08-11T12:40:47.404 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:47.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.404 INFO:teuthology.orchestra.run.smithi194.stdout: "finisher-PurgeQueue": { 2023-08-11T12:40:47.404 INFO:teuthology.orchestra.run.smithi194.stdout: "queue_len": 0, 2023-08-11T12:40:47.405 INFO:teuthology.orchestra.run.smithi194.stdout: "complete_latency": { 2023-08-11T12:40:47.405 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 114, 2023-08-11T12:40:47.405 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.004059134, 2023-08-11T12:40:47.405 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000035606 2023-08-11T12:40:47.405 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:47.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.406 INFO:teuthology.orchestra.run.smithi194.stdout: "mds": { 2023-08-11T12:40:47.406 INFO:teuthology.orchestra.run.smithi194.stdout: "request": 231, 2023-08-11T12:40:47.406 INFO:teuthology.orchestra.run.smithi194.stdout: "reply": 171, 2023-08-11T12:40:47.406 INFO:teuthology.orchestra.run.smithi194.stdout: "reply_latency": { 2023-08-11T12:40:47.406 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 171, 2023-08-11T12:40:47.407 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 48.451921070, 2023-08-11T12:40:47.407 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.283344567 2023-08-11T12:40:47.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.407 INFO:teuthology.orchestra.run.smithi194.stdout: "slow_reply": 0, 2023-08-11T12:40:47.408 INFO:teuthology.orchestra.run.smithi194.stdout: "forward": 60, 2023-08-11T12:40:47.408 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_fetch_complete": 0, 2023-08-11T12:40:47.409 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_fetch_keys": 0, 2023-08-11T12:40:47.409 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_commit": 51, 2023-08-11T12:40:47.409 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_split": 5, 2023-08-11T12:40:47.409 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_merge": 0, 2023-08-11T12:40:47.410 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes": 640, 2023-08-11T12:40:47.410 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_top": 297, 2023-08-11T12:40:47.411 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_bottom": 328, 2023-08-11T12:40:47.411 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_pin_tail": 15, 2023-08-11T12:40:47.411 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_pinned": 217, 2023-08-11T12:40:47.412 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_expired": 199, 2023-08-11T12:40:47.412 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_with_caps": 20, 2023-08-11T12:40:47.413 INFO:teuthology.orchestra.run.smithi194.stdout: "caps": 20, 2023-08-11T12:40:47.413 INFO:teuthology.orchestra.run.smithi194.stdout: "subtrees": 90, 2023-08-11T12:40:47.414 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse": 894, 2023-08-11T12:40:47.414 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_hit": 672, 2023-08-11T12:40:47.414 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_forward": 58, 2023-08-11T12:40:47.415 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_discover": 36, 2023-08-11T12:40:47.416 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_dir_fetch": 0, 2023-08-11T12:40:47.416 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_remote_ino": 1, 2023-08-11T12:40:47.416 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_lock": 79, 2023-08-11T12:40:47.417 INFO:teuthology.orchestra.run.smithi194.stdout: "load_cent": 0, 2023-08-11T12:40:47.418 INFO:teuthology.orchestra.run.smithi194.stdout: "q": 0, 2023-08-11T12:40:47.418 INFO:teuthology.orchestra.run.smithi194.stdout: "exported": 21, 2023-08-11T12:40:47.418 INFO:teuthology.orchestra.run.smithi194.stdout: "exported_inodes": 172, 2023-08-11T12:40:47.419 INFO:teuthology.orchestra.run.smithi194.stdout: "imported": 22, 2023-08-11T12:40:47.419 INFO:teuthology.orchestra.run.smithi194.stdout: "imported_inodes": 354, 2023-08-11T12:40:47.420 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_dir_fetch": 0, 2023-08-11T12:40:47.420 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_backtrace_fetch": 169, 2023-08-11T12:40:47.421 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_peer_discover": 5, 2023-08-11T12:40:47.421 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rfiles": 1003, 2023-08-11T12:40:47.421 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rbytes": 5502265756, 2023-08-11T12:40:47.422 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rsnaps": 4, 2023-08-11T12:40:47.422 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_backtrace_fetch": 169, 2023-08-11T12:40:47.422 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_set_tag": 0, 2023-08-11T12:40:47.423 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_backtrace_repaired": 0, 2023-08-11T12:40:47.423 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_inotable_repaired": 0, 2023-08-11T12:40:47.424 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dir_inodes": 0, 2023-08-11T12:40:47.424 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dir_base_inodes": 0, 2023-08-11T12:40:47.425 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dirfrag_rstats": 0, 2023-08-11T12:40:47.425 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_file_inodes": 169, 2023-08-11T12:40:47.425 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_inode_file_caps": 1, 2023-08-11T12:40:47.426 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_revoke": 491, 2023-08-11T12:40:47.426 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_grant": 796, 2023-08-11T12:40:47.427 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_trunc": 0, 2023-08-11T12:40:47.427 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_flushsnap_ack": 4, 2023-08-11T12:40:47.427 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-11T12:40:47.428 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_caps": 813, 2023-08-11T12:40:47.428 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_caps_dirty": 72, 2023-08-11T12:40:47.428 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_cap_release": 26, 2023-08-11T12:40:47.429 INFO:teuthology.orchestra.run.smithi194.stdout: "process_request_cap_release": 99 2023-08-11T12:40:47.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.430 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_cache": { 2023-08-11T12:40:47.430 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_update": 54, 2023-08-11T12:40:47.430 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_update_receipt": 198, 2023-08-11T12:40:47.431 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_try_discover": 107, 2023-08-11T12:40:47.431 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_send_discover": 170, 2023-08-11T12:40:47.431 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_handle_discover": 60, 2023-08-11T12:40:47.431 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays": 1, 2023-08-11T12:40:47.432 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays_delayed": 0, 2023-08-11T12:40:47.432 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays_enqueuing": 0, 2023-08-11T12:40:47.432 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_created": 19, 2023-08-11T12:40:47.432 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_enqueued": 18, 2023-08-11T12:40:47.432 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_reintegrated": 12, 2023-08-11T12:40:47.433 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_migrated": 0, 2023-08-11T12:40:47.433 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_processing": 0, 2023-08-11T12:40:47.433 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_enqueued": 0, 2023-08-11T12:40:47.433 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_prioritized": 0, 2023-08-11T12:40:47.434 INFO:teuthology.orchestra.run.smithi194.stdout: "recovery_started": 0, 2023-08-11T12:40:47.434 INFO:teuthology.orchestra.run.smithi194.stdout: "recovery_completed": 0, 2023-08-11T12:40:47.434 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_enqueue_scrub": 0, 2023-08-11T12:40:47.435 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_exportdir": 22, 2023-08-11T12:40:47.435 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_flush": 0, 2023-08-11T12:40:47.435 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_fragmentdir": 5, 2023-08-11T12:40:47.435 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_fragstats": 0, 2023-08-11T12:40:47.435 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_inodestats": 0 2023-08-11T12:40:47.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.436 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_log": { 2023-08-11T12:40:47.436 INFO:teuthology.orchestra.run.smithi194.stdout: "evlrg": 0, 2023-08-11T12:40:47.437 INFO:teuthology.orchestra.run.smithi194.stdout: "evadd": 1572, 2023-08-11T12:40:47.437 INFO:teuthology.orchestra.run.smithi194.stdout: "evex": 0, 2023-08-11T12:40:47.437 INFO:teuthology.orchestra.run.smithi194.stdout: "evtrm": 0, 2023-08-11T12:40:47.438 INFO:teuthology.orchestra.run.smithi194.stdout: "ev": 1572, 2023-08-11T12:40:47.438 INFO:teuthology.orchestra.run.smithi194.stdout: "evexg": 0, 2023-08-11T12:40:47.439 INFO:teuthology.orchestra.run.smithi194.stdout: "evexd": 0, 2023-08-11T12:40:47.439 INFO:teuthology.orchestra.run.smithi194.stdout: "segadd": 3, 2023-08-11T12:40:47.439 INFO:teuthology.orchestra.run.smithi194.stdout: "segex": 0, 2023-08-11T12:40:47.440 INFO:teuthology.orchestra.run.smithi194.stdout: "segtrm": 0, 2023-08-11T12:40:47.440 INFO:teuthology.orchestra.run.smithi194.stdout: "seg": 3, 2023-08-11T12:40:47.441 INFO:teuthology.orchestra.run.smithi194.stdout: "segmjr": 2, 2023-08-11T12:40:47.441 INFO:teuthology.orchestra.run.smithi194.stdout: "segexg": 0, 2023-08-11T12:40:47.441 INFO:teuthology.orchestra.run.smithi194.stdout: "segexd": 0, 2023-08-11T12:40:47.442 INFO:teuthology.orchestra.run.smithi194.stdout: "expos": 4194304, 2023-08-11T12:40:47.442 INFO:teuthology.orchestra.run.smithi194.stdout: "wrpos": 6756537, 2023-08-11T12:40:47.442 INFO:teuthology.orchestra.run.smithi194.stdout: "rdpos": 0, 2023-08-11T12:40:47.443 INFO:teuthology.orchestra.run.smithi194.stdout: "jlat": { 2023-08-11T12:40:47.443 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 402, 2023-08-11T12:40:47.444 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 10.845087687, 2023-08-11T12:40:47.444 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.026977830 2023-08-11T12:40:47.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.444 INFO:teuthology.orchestra.run.smithi194.stdout: "replayed": 0 2023-08-11T12:40:47.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.445 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_mem": { 2023-08-11T12:40:47.445 INFO:teuthology.orchestra.run.smithi194.stdout: "ino": 642, 2023-08-11T12:40:47.445 INFO:teuthology.orchestra.run.smithi194.stdout: "ino+": 823, 2023-08-11T12:40:47.445 INFO:teuthology.orchestra.run.smithi194.stdout: "ino-": 181, 2023-08-11T12:40:47.446 INFO:teuthology.orchestra.run.smithi194.stdout: "dir": 152, 2023-08-11T12:40:47.446 INFO:teuthology.orchestra.run.smithi194.stdout: "dir+": 235, 2023-08-11T12:40:47.446 INFO:teuthology.orchestra.run.smithi194.stdout: "dir-": 83, 2023-08-11T12:40:47.446 INFO:teuthology.orchestra.run.smithi194.stdout: "dn": 642, 2023-08-11T12:40:47.446 INFO:teuthology.orchestra.run.smithi194.stdout: "dn+": 861, 2023-08-11T12:40:47.447 INFO:teuthology.orchestra.run.smithi194.stdout: "dn-": 219, 2023-08-11T12:40:47.447 INFO:teuthology.orchestra.run.smithi194.stdout: "cap": 20, 2023-08-11T12:40:47.447 INFO:teuthology.orchestra.run.smithi194.stdout: "cap+": 454, 2023-08-11T12:40:47.447 INFO:teuthology.orchestra.run.smithi194.stdout: "cap-": 434, 2023-08-11T12:40:47.447 INFO:teuthology.orchestra.run.smithi194.stdout: "rss": 58800, 2023-08-11T12:40:47.447 INFO:teuthology.orchestra.run.smithi194.stdout: "heap": 198960 2023-08-11T12:40:47.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.448 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_server": { 2023-08-11T12:40:47.448 INFO:teuthology.orchestra.run.smithi194.stdout: "dispatch_client_request": 531, 2023-08-11T12:40:47.448 INFO:teuthology.orchestra.run.smithi194.stdout: "dispatch_server_request": 8, 2023-08-11T12:40:47.449 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_request": 231, 2023-08-11T12:40:47.449 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_session": 55, 2023-08-11T12:40:47.449 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_peer_request": 138, 2023-08-11T12:40:47.449 INFO:teuthology.orchestra.run.smithi194.stdout: "req_create_latency": { 2023-08-11T12:40:47.450 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 17, 2023-08-11T12:40:47.450 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.028719901, 2023-08-11T12:40:47.450 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.001689405 2023-08-11T12:40:47.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.450 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getattr_latency": { 2023-08-11T12:40:47.451 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 5, 2023-08-11T12:40:47.451 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000923273, 2023-08-11T12:40:47.451 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000184654 2023-08-11T12:40:47.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.452 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getfilelock_latency": { 2023-08-11T12:40:47.453 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:47.453 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:47.453 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:47.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.454 INFO:teuthology.orchestra.run.smithi194.stdout: "req_link_latency": { 2023-08-11T12:40:47.454 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 7, 2023-08-11T12:40:47.454 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.112348019, 2023-08-11T12:40:47.454 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.016049717 2023-08-11T12:40:47.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.455 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookup_latency": { 2023-08-11T12:40:47.455 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 73, 2023-08-11T12:40:47.455 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.059857614, 2023-08-11T12:40:47.455 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000819967 2023-08-11T12:40:47.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.456 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookuphash_latency": { 2023-08-11T12:40:47.456 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:47.456 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:47.457 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:47.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.457 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupino_latency": { 2023-08-11T12:40:47.457 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:47.457 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:47.458 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:47.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.458 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupname_latency": { 2023-08-11T12:40:47.458 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:47.458 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:47.459 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:47.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.459 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupparent_latency": { 2023-08-11T12:40:47.459 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:47.459 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:47.460 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:47.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.460 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupsnap_latency": { 2023-08-11T12:40:47.460 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:47.460 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:47.461 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:47.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.461 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lssnap_latency": { 2023-08-11T12:40:47.461 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:47.461 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:47.461 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:47.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.462 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mkdir_latency": { 2023-08-11T12:40:47.462 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:47.462 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:47.463 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:47.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.463 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mknod_latency": { 2023-08-11T12:40:47.463 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:47.463 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:47.463 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:47.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.464 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mksnap_latency": { 2023-08-11T12:40:47.464 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:47.464 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:47.465 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:47.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.465 INFO:teuthology.orchestra.run.smithi194.stdout: "req_open_latency": { 2023-08-11T12:40:47.465 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 11, 2023-08-11T12:40:47.465 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.003569212, 2023-08-11T12:40:47.466 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000324473 2023-08-11T12:40:47.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.466 INFO:teuthology.orchestra.run.smithi194.stdout: "req_readdir_latency": { 2023-08-11T12:40:47.466 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 23, 2023-08-11T12:40:47.466 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.036645414, 2023-08-11T12:40:47.466 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.001593278 2023-08-11T12:40:47.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.467 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rename_latency": { 2023-08-11T12:40:47.467 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 29, 2023-08-11T12:40:47.467 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 48.193671723, 2023-08-11T12:40:47.467 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 1.661850749 2023-08-11T12:40:47.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.468 INFO:teuthology.orchestra.run.smithi194.stdout: "req_renamesnap_latency": { 2023-08-11T12:40:47.468 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:47.468 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:47.468 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:47.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.469 INFO:teuthology.orchestra.run.smithi194.stdout: "req_snapdiff_latency": { 2023-08-11T12:40:47.469 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:47.469 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:47.470 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:47.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.470 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmdir_latency": { 2023-08-11T12:40:47.470 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:47.470 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmsnap_latency": { 2023-08-11T12:40:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmxattr_latency": { 2023-08-11T12:40:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setattr_latency": { 2023-08-11T12:40:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setdirlayout_latency": { 2023-08-11T12:40:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setfilelock_latency": { 2023-08-11T12:40:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setlayout_latency": { 2023-08-11T12:40:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setxattr_latency": { 2023-08-11T12:40:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: "req_symlink_latency": { 2023-08-11T12:40:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: "req_unlink_latency": { 2023-08-11T12:40:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 6, 2023-08-11T12:40:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.016185914, 2023-08-11T12:40:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.002697652 2023-08-11T12:40:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: "cap_revoke_eviction": 0, 2023-08-11T12:40:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: "cap_acquisition_throttle": 0, 2023-08-11T12:40:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getvxattr_latency": { 2023-08-11T12:40:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:47.482 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:47.482 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:47.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.483 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_sessions": { 2023-08-11T12:40:47.484 INFO:teuthology.orchestra.run.smithi194.stdout: "session_count": 2, 2023-08-11T12:40:47.484 INFO:teuthology.orchestra.run.smithi194.stdout: "session_add": 4, 2023-08-11T12:40:47.484 INFO:teuthology.orchestra.run.smithi194.stdout: "session_remove": 2, 2023-08-11T12:40:47.485 INFO:teuthology.orchestra.run.smithi194.stdout: "sessions_open": 2, 2023-08-11T12:40:47.485 INFO:teuthology.orchestra.run.smithi194.stdout: "sessions_stale": 0, 2023-08-11T12:40:47.486 INFO:teuthology.orchestra.run.smithi194.stdout: "total_load": 102, 2023-08-11T12:40:47.486 INFO:teuthology.orchestra.run.smithi194.stdout: "average_load": 51, 2023-08-11T12:40:47.487 INFO:teuthology.orchestra.run.smithi194.stdout: "avg_session_uptime": 955 2023-08-11T12:40:47.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: "mempool": { 2023-08-11T12:40:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_bytes": 0, 2023-08-11T12:40:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_items": 0, 2023-08-11T12:40:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_bytes": 0, 2023-08-11T12:40:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_items": 0, 2023-08-11T12:40:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_bytes": 0, 2023-08-11T12:40:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_items": 0, 2023-08-11T12:40:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-11T12:40:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_items": 0, 2023-08-11T12:40:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-11T12:40:47.492 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_items": 0, 2023-08-11T12:40:47.492 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_bytes": 0, 2023-08-11T12:40:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_items": 0, 2023-08-11T12:40:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-11T12:40:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_items": 0, 2023-08-11T12:40:47.494 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_bytes": 0, 2023-08-11T12:40:47.494 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_items": 0, 2023-08-11T12:40:47.495 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_bytes": 0, 2023-08-11T12:40:47.495 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_items": 0, 2023-08-11T12:40:47.496 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-11T12:40:47.496 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_items": 0, 2023-08-11T12:40:47.496 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-11T12:40:47.497 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_items": 0, 2023-08-11T12:40:47.497 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_bytes": 0, 2023-08-11T12:40:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_items": 0, 2023-08-11T12:40:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_bytes": 0, 2023-08-11T12:40:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_items": 0, 2023-08-11T12:40:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-11T12:40:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_items": 0, 2023-08-11T12:40:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_bytes": 0, 2023-08-11T12:40:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_items": 0, 2023-08-11T12:40:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_bytes": 0, 2023-08-11T12:40:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_items": 0, 2023-08-11T12:40:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_bytes": 0, 2023-08-11T12:40:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_items": 0, 2023-08-11T12:40:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_bytes": 0, 2023-08-11T12:40:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_items": 0, 2023-08-11T12:40:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_bytes": 387821, 2023-08-11T12:40:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_items": 447, 2023-08-11T12:40:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_bytes": 0, 2023-08-11T12:40:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_items": 0, 2023-08-11T12:40:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_bytes": 0, 2023-08-11T12:40:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_items": 0, 2023-08-11T12:40:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_bytes": 0, 2023-08-11T12:40:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_items": 0, 2023-08-11T12:40:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_bytes": 0, 2023-08-11T12:40:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_items": 0, 2023-08-11T12:40:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_bytes": 9320, 2023-08-11T12:40:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_items": 178, 2023-08-11T12:40:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_bytes": 0, 2023-08-11T12:40:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_items": 0, 2023-08-11T12:40:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_bytes": 0, 2023-08-11T12:40:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_items": 0, 2023-08-11T12:40:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_bytes": 2139853, 2023-08-11T12:40:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_items": 18766, 2023-08-11T12:40:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_bytes": 0, 2023-08-11T12:40:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_items": 0, 2023-08-11T12:40:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_bytes": 0, 2023-08-11T12:40:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_items": 0 2023-08-11T12:40:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: "objecter": { 2023-08-11T12:40:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: "op_active": 0, 2023-08-11T12:40:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: "op_laggy": 0, 2023-08-11T12:40:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: "op_send": 777, 2023-08-11T12:40:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: "op_send_bytes": 2991548, 2023-08-11T12:40:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: "op_resend": 33, 2023-08-11T12:40:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: "op_reply": 777, 2023-08-11T12:40:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: "op_latency": { 2023-08-11T12:40:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 777, 2023-08-11T12:40:47.507 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 11.056774794, 2023-08-11T12:40:47.507 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.014230083 2023-08-11T12:40:47.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.507 INFO:teuthology.orchestra.run.smithi194.stdout: "op_inflight": 0, 2023-08-11T12:40:47.507 INFO:teuthology.orchestra.run.smithi194.stdout: "oplen_avg": { 2023-08-11T12:40:47.507 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 777, 2023-08-11T12:40:47.508 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 880 2023-08-11T12:40:47.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.508 INFO:teuthology.orchestra.run.smithi194.stdout: "op": 777, 2023-08-11T12:40:47.508 INFO:teuthology.orchestra.run.smithi194.stdout: "op_r": 184, 2023-08-11T12:40:47.508 INFO:teuthology.orchestra.run.smithi194.stdout: "op_w": 593, 2023-08-11T12:40:47.509 INFO:teuthology.orchestra.run.smithi194.stdout: "op_rmw": 0, 2023-08-11T12:40:47.509 INFO:teuthology.orchestra.run.smithi194.stdout: "op_pg": 0, 2023-08-11T12:40:47.509 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_stat": 0, 2023-08-11T12:40:47.509 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_create": 10, 2023-08-11T12:40:47.509 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_read": 15, 2023-08-11T12:40:47.510 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_write": 417, 2023-08-11T12:40:47.510 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_writefull": 33, 2023-08-11T12:40:47.510 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_writesame": 0, 2023-08-11T12:40:47.510 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_append": 0, 2023-08-11T12:40:47.510 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_zero": 0, 2023-08-11T12:40:47.511 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_truncate": 0, 2023-08-11T12:40:47.511 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_delete": 53, 2023-08-11T12:40:47.511 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_mapext": 0, 2023-08-11T12:40:47.511 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_sparse_read": 0, 2023-08-11T12:40:47.511 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_clonerange": 0, 2023-08-11T12:40:47.512 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_getxattr": 169, 2023-08-11T12:40:47.512 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_setxattr": 20, 2023-08-11T12:40:47.512 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_cmpxattr": 0, 2023-08-11T12:40:47.512 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_rmxattr": 0, 2023-08-11T12:40:47.512 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_resetxattrs": 0, 2023-08-11T12:40:47.513 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_call": 0, 2023-08-11T12:40:47.513 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_watch": 0, 2023-08-11T12:40:47.513 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_notify": 0, 2023-08-11T12:40:47.513 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_src_cmpxattr": 0, 2023-08-11T12:40:47.513 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_pgls": 0, 2023-08-11T12:40:47.514 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_pgls_filter": 0, 2023-08-11T12:40:47.514 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_other": 0, 2023-08-11T12:40:47.514 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_active": 0, 2023-08-11T12:40:47.514 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_send": 0, 2023-08-11T12:40:47.514 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_resend": 0, 2023-08-11T12:40:47.515 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_ping": 0, 2023-08-11T12:40:47.515 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_active": 0, 2023-08-11T12:40:47.515 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_send": 0, 2023-08-11T12:40:47.515 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_resend": 0, 2023-08-11T12:40:47.515 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_active": 0, 2023-08-11T12:40:47.515 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_send": 0, 2023-08-11T12:40:47.516 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_resend": 0, 2023-08-11T12:40:47.516 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_active": 0, 2023-08-11T12:40:47.516 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_send": 0, 2023-08-11T12:40:47.517 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_resend": 0, 2023-08-11T12:40:47.517 INFO:teuthology.orchestra.run.smithi194.stdout: "command_active": 0, 2023-08-11T12:40:47.517 INFO:teuthology.orchestra.run.smithi194.stdout: "command_send": 0, 2023-08-11T12:40:47.517 INFO:teuthology.orchestra.run.smithi194.stdout: "command_resend": 0, 2023-08-11T12:40:47.517 INFO:teuthology.orchestra.run.smithi194.stdout: "map_epoch": 110, 2023-08-11T12:40:47.518 INFO:teuthology.orchestra.run.smithi194.stdout: "map_full": 0, 2023-08-11T12:40:47.518 INFO:teuthology.orchestra.run.smithi194.stdout: "map_inc": 23, 2023-08-11T12:40:47.518 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_sessions": 12, 2023-08-11T12:40:47.518 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_session_open": 12, 2023-08-11T12:40:47.518 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_session_close": 0, 2023-08-11T12:40:47.518 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_laggy": 0, 2023-08-11T12:40:47.519 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_wr": 140, 2023-08-11T12:40:47.519 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_rd": 0, 2023-08-11T12:40:47.519 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_del": 23 2023-08-11T12:40:47.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.519 INFO:teuthology.orchestra.run.smithi194.stdout: "oft": { 2023-08-11T12:40:47.520 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_objs": 1, 2023-08-11T12:40:47.520 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_kv_pairs": 0, 2023-08-11T12:40:47.520 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_updates": 0, 2023-08-11T12:40:47.520 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_removes": 0 2023-08-11T12:40:47.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.521 INFO:teuthology.orchestra.run.smithi194.stdout: "osd-slow-ops": { 2023-08-11T12:40:47.521 INFO:teuthology.orchestra.run.smithi194.stdout: "slow_ops_count": 1 2023-08-11T12:40:47.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.521 INFO:teuthology.orchestra.run.smithi194.stdout: "purge_queue": { 2023-08-11T12:40:47.521 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_ops": 0, 2023-08-11T12:40:47.522 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_ops_high_water": 6, 2023-08-11T12:40:47.522 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing": 0, 2023-08-11T12:40:47.522 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_high_water": 3, 2023-08-11T12:40:47.522 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executed": 18, 2023-08-11T12:40:47.522 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_item_in_journal": 0 2023-08-11T12:40:47.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.523 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-11T12:40:47.523 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2023-08-11T12:40:47.523 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2023-08-11T12:40:47.523 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2023-08-11T12:40:47.524 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 5594, 2023-08-11T12:40:47.524 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 3616308, 2023-08-11T12:40:47.524 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:47.524 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 5594, 2023-08-11T12:40:47.524 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2023-08-11T12:40:47.524 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2023-08-11T12:40:47.525 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 5594, 2023-08-11T12:40:47.525 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 3616308, 2023-08-11T12:40:47.525 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2023-08-11T12:40:47.525 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:47.525 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:47.526 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:47.526 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:47.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.526 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-objecter_bytes": { 2023-08-11T12:40:47.526 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2023-08-11T12:40:47.527 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2023-08-11T12:40:47.527 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2023-08-11T12:40:47.527 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2023-08-11T12:40:47.527 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2023-08-11T12:40:47.527 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:47.528 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:47.528 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 777, 2023-08-11T12:40:47.528 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 2993622, 2023-08-11T12:40:47.528 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 777, 2023-08-11T12:40:47.528 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 2993622, 2023-08-11T12:40:47.529 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2023-08-11T12:40:47.529 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:47.529 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:47.529 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:47.529 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:47.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.530 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-objecter_ops": { 2023-08-11T12:40:47.530 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2023-08-11T12:40:47.530 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 1024, 2023-08-11T12:40:47.530 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2023-08-11T12:40:47.531 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2023-08-11T12:40:47.531 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2023-08-11T12:40:47.531 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:47.531 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:47.531 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 777, 2023-08-11T12:40:47.532 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 777, 2023-08-11T12:40:47.532 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 777, 2023-08-11T12:40:47.532 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 777, 2023-08-11T12:40:47.532 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2023-08-11T12:40:47.532 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:47.532 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:47.533 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:47.533 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:47.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.533 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-write_buf_throttle": { 2023-08-11T12:40:47.534 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2023-08-11T12:40:47.534 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 3758096384, 2023-08-11T12:40:47.534 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2023-08-11T12:40:47.534 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 18, 2023-08-11T12:40:47.534 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 2074, 2023-08-11T12:40:47.534 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:47.535 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 18, 2023-08-11T12:40:47.535 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2023-08-11T12:40:47.535 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2023-08-11T12:40:47.535 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 15, 2023-08-11T12:40:47.535 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 2074, 2023-08-11T12:40:47.536 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2023-08-11T12:40:47.536 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:47.536 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:47.536 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:47.536 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:47.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:47.537 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-write_buf_throttle-0x564a64b80000": { 2023-08-11T12:40:47.537 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2023-08-11T12:40:47.537 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 3758096384, 2023-08-11T12:40:47.537 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2023-08-11T12:40:47.538 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 1572, 2023-08-11T12:40:47.538 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 2562233, 2023-08-11T12:40:47.538 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:47.538 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 1572, 2023-08-11T12:40:47.538 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2023-08-11T12:40:47.539 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2023-08-11T12:40:47.539 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 402, 2023-08-11T12:40:47.539 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 2562233, 2023-08-11T12:40:47.539 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2023-08-11T12:40:47.539 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:47.540 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:47.540 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:47.540 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:47.540 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:47.540 INFO:teuthology.orchestra.run.smithi194.stdout:} 2023-08-11T12:40:47.791 INFO:tasks.check_counter:Daemon mds.f mds.exported=21 2023-08-11T12:40:47.792 INFO:tasks.check_counter:Daemon mds.f mds.imported=22 2023-08-11T12:40:47.792 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=54 2023-08-11T12:40:47.792 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=198 2023-08-11T12:40:47.792 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=4 2023-08-11T12:40:47.793 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2023-08-11T12:40:47.793 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2023-08-11T12:40:47.793 DEBUG:tasks.check_counter:Getting stats from i 2023-08-11T12:40:47.794 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph daemon mds.i perf dump 2023-08-11T12:40:48.143 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:48 smithi194 ceph-mon[130905]: pgmap v508: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:48.302 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:48 smithi008 ceph-mon[97158]: pgmap v508: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:48.347 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.c/config 2023-08-11T12:40:48.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:48 smithi045 ceph-mon[130284]: pgmap v508: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:49.540 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2023-08-11T12:40:49.540 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-0": { 2023-08-11T12:40:49.540 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 3685, 2023-08-11T12:40:49.541 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 3275, 2023-08-11T12:40:49.541 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 1269042, 2023-08-11T12:40:49.541 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 4835197, 2023-08-11T12:40:49.541 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 14, 2023-08-11T12:40:49.541 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 6, 2023-08-11T12:40:49.542 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.198330632, 2023-08-11T12:40:49.542 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.077159035, 2023-08-11T12:40:49.542 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.108025937, 2023-08-11T12:40:49.542 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.028607064, 2023-08-11T12:40:49.542 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:49.543 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 3271, 2023-08-11T12:40:49.543 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.099904595, 2023-08-11T12:40:49.543 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000030542 2023-08-11T12:40:49.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.543 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 4301, 2023-08-11T12:40:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000581651, 2023-08-11T12:40:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000135 2023-08-11T12:40:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 0, 2023-08-11T12:40:49.545 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 0 2023-08-11T12:40:49.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.545 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-1": { 2023-08-11T12:40:49.545 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 7037, 2023-08-11T12:40:49.545 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 7549, 2023-08-11T12:40:49.546 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 2888230, 2023-08-11T12:40:49.546 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 4021794, 2023-08-11T12:40:49.546 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 16, 2023-08-11T12:40:49.546 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 5, 2023-08-11T12:40:49.546 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.532068014, 2023-08-11T12:40:49.547 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.187284382, 2023-08-11T12:40:49.547 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.318861101, 2023-08-11T12:40:49.547 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.076947187, 2023-08-11T12:40:49.547 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:49.547 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 7549, 2023-08-11T12:40:49.548 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.198696485, 2023-08-11T12:40:49.548 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000026320 2023-08-11T12:40:49.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.548 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:49.548 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 12778, 2023-08-11T12:40:49.549 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.002033583, 2023-08-11T12:40:49.549 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000159 2023-08-11T12:40:49.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.549 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 1354624, 2023-08-11T12:40:49.549 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 2551184 2023-08-11T12:40:49.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.550 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-2": { 2023-08-11T12:40:49.550 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 1119, 2023-08-11T12:40:49.550 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 982, 2023-08-11T12:40:49.550 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 2077519, 2023-08-11T12:40:49.551 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 635924, 2023-08-11T12:40:49.551 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 10, 2023-08-11T12:40:49.551 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 7, 2023-08-11T12:40:49.551 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.103386090, 2023-08-11T12:40:49.551 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.035660839, 2023-08-11T12:40:49.552 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.064504909, 2023-08-11T12:40:49.552 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.014123576, 2023-08-11T12:40:49.552 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:49.552 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 981, 2023-08-11T12:40:49.552 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.046321465, 2023-08-11T12:40:49.553 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000047218 2023-08-11T12:40:49.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.553 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:49.553 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 824, 2023-08-11T12:40:49.553 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000175877, 2023-08-11T12:40:49.553 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000213 2023-08-11T12:40:49.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.554 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 1689392, 2023-08-11T12:40:49.554 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 205168 2023-08-11T12:40:49.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.554 INFO:teuthology.orchestra.run.smithi194.stdout: "cct": { 2023-08-11T12:40:49.555 INFO:teuthology.orchestra.run.smithi194.stdout: "total_workers": 1, 2023-08-11T12:40:49.555 INFO:teuthology.orchestra.run.smithi194.stdout: "unhealthy_workers": 0 2023-08-11T12:40:49.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.555 INFO:teuthology.orchestra.run.smithi194.stdout: "finisher-MDSRank": { 2023-08-11T12:40:49.555 INFO:teuthology.orchestra.run.smithi194.stdout: "queue_len": 0, 2023-08-11T12:40:49.556 INFO:teuthology.orchestra.run.smithi194.stdout: "complete_latency": { 2023-08-11T12:40:49.556 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 2325, 2023-08-11T12:40:49.556 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 1.017661371, 2023-08-11T12:40:49.556 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000437703 2023-08-11T12:40:49.556 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:49.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.557 INFO:teuthology.orchestra.run.smithi194.stdout: "finisher-PurgeQueue": { 2023-08-11T12:40:49.557 INFO:teuthology.orchestra.run.smithi194.stdout: "queue_len": 0, 2023-08-11T12:40:49.557 INFO:teuthology.orchestra.run.smithi194.stdout: "complete_latency": { 2023-08-11T12:40:49.557 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 119, 2023-08-11T12:40:49.558 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.005890388, 2023-08-11T12:40:49.558 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000049499 2023-08-11T12:40:49.558 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:49.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.558 INFO:teuthology.orchestra.run.smithi194.stdout: "mds": { 2023-08-11T12:40:49.558 INFO:teuthology.orchestra.run.smithi194.stdout: "request": 1867, 2023-08-11T12:40:49.559 INFO:teuthology.orchestra.run.smithi194.stdout: "reply": 1822, 2023-08-11T12:40:49.559 INFO:teuthology.orchestra.run.smithi194.stdout: "reply_latency": { 2023-08-11T12:40:49.559 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 1822, 2023-08-11T12:40:49.559 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 13.802930737, 2023-08-11T12:40:49.559 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.007575702 2023-08-11T12:40:49.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.560 INFO:teuthology.orchestra.run.smithi194.stdout: "slow_reply": 0, 2023-08-11T12:40:49.560 INFO:teuthology.orchestra.run.smithi194.stdout: "forward": 45, 2023-08-11T12:40:49.560 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_fetch_complete": 7, 2023-08-11T12:40:49.560 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_fetch_keys": 0, 2023-08-11T12:40:49.561 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_commit": 27, 2023-08-11T12:40:49.561 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_split": 2, 2023-08-11T12:40:49.561 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_merge": 0, 2023-08-11T12:40:49.561 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes": 597, 2023-08-11T12:40:49.561 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_top": 77, 2023-08-11T12:40:49.562 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_bottom": 367, 2023-08-11T12:40:49.562 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_pin_tail": 153, 2023-08-11T12:40:49.562 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_pinned": 486, 2023-08-11T12:40:49.562 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_expired": 433, 2023-08-11T12:40:49.562 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_with_caps": 8, 2023-08-11T12:40:49.563 INFO:teuthology.orchestra.run.smithi194.stdout: "caps": 8, 2023-08-11T12:40:49.563 INFO:teuthology.orchestra.run.smithi194.stdout: "subtrees": 28, 2023-08-11T12:40:49.563 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse": 8182, 2023-08-11T12:40:49.563 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_hit": 5884, 2023-08-11T12:40:49.563 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_forward": 33, 2023-08-11T12:40:49.564 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_discover": 61, 2023-08-11T12:40:49.564 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_dir_fetch": 1, 2023-08-11T12:40:49.564 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_remote_ino": 0, 2023-08-11T12:40:49.564 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_lock": 1579, 2023-08-11T12:40:49.564 INFO:teuthology.orchestra.run.smithi194.stdout: "load_cent": 0, 2023-08-11T12:40:49.565 INFO:teuthology.orchestra.run.smithi194.stdout: "q": 0, 2023-08-11T12:40:49.565 INFO:teuthology.orchestra.run.smithi194.stdout: "exported": 30, 2023-08-11T12:40:49.565 INFO:teuthology.orchestra.run.smithi194.stdout: "exported_inodes": 304, 2023-08-11T12:40:49.565 INFO:teuthology.orchestra.run.smithi194.stdout: "imported": 29, 2023-08-11T12:40:49.565 INFO:teuthology.orchestra.run.smithi194.stdout: "imported_inodes": 456, 2023-08-11T12:40:49.565 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_dir_fetch": 0, 2023-08-11T12:40:49.566 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_backtrace_fetch": 231, 2023-08-11T12:40:49.566 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_peer_discover": 0, 2023-08-11T12:40:49.566 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rfiles": 1003, 2023-08-11T12:40:49.566 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rbytes": 5502265756, 2023-08-11T12:40:49.566 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rsnaps": 4, 2023-08-11T12:40:49.567 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_backtrace_fetch": 231, 2023-08-11T12:40:49.567 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_set_tag": 0, 2023-08-11T12:40:49.567 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_backtrace_repaired": 0, 2023-08-11T12:40:49.567 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_inotable_repaired": 0, 2023-08-11T12:40:49.567 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dir_inodes": 6, 2023-08-11T12:40:49.568 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dir_base_inodes": 0, 2023-08-11T12:40:49.568 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dirfrag_rstats": 6, 2023-08-11T12:40:49.568 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_file_inodes": 225, 2023-08-11T12:40:49.568 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_inode_file_caps": 2, 2023-08-11T12:40:49.568 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_revoke": 124, 2023-08-11T12:40:49.569 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_grant": 544, 2023-08-11T12:40:49.569 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_trunc": 0, 2023-08-11T12:40:49.569 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_flushsnap_ack": 2, 2023-08-11T12:40:49.569 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-11T12:40:49.569 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_caps": 734, 2023-08-11T12:40:49.570 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_caps_dirty": 570, 2023-08-11T12:40:49.570 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_cap_release": 32, 2023-08-11T12:40:49.570 INFO:teuthology.orchestra.run.smithi194.stdout: "process_request_cap_release": 863 2023-08-11T12:40:49.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.570 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_cache": { 2023-08-11T12:40:49.571 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_update": 71, 2023-08-11T12:40:49.571 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_update_receipt": 205, 2023-08-11T12:40:49.571 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_try_discover": 114, 2023-08-11T12:40:49.571 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_send_discover": 195, 2023-08-11T12:40:49.571 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_handle_discover": 90, 2023-08-11T12:40:49.572 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays": 11, 2023-08-11T12:40:49.572 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays_delayed": 0, 2023-08-11T12:40:49.572 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays_enqueuing": 0, 2023-08-11T12:40:49.572 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_created": 200, 2023-08-11T12:40:49.572 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_enqueued": 12, 2023-08-11T12:40:49.573 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_reintegrated": 728, 2023-08-11T12:40:49.573 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_migrated": 7, 2023-08-11T12:40:49.573 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_processing": 0, 2023-08-11T12:40:49.573 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_enqueued": 0, 2023-08-11T12:40:49.573 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_prioritized": 0, 2023-08-11T12:40:49.574 INFO:teuthology.orchestra.run.smithi194.stdout: "recovery_started": 0, 2023-08-11T12:40:49.574 INFO:teuthology.orchestra.run.smithi194.stdout: "recovery_completed": 0, 2023-08-11T12:40:49.574 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_enqueue_scrub": 0, 2023-08-11T12:40:49.574 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_exportdir": 31, 2023-08-11T12:40:49.574 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_flush": 0, 2023-08-11T12:40:49.575 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_fragmentdir": 2, 2023-08-11T12:40:49.575 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_fragstats": 0, 2023-08-11T12:40:49.575 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_inodestats": 0 2023-08-11T12:40:49.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.575 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_log": { 2023-08-11T12:40:49.576 INFO:teuthology.orchestra.run.smithi194.stdout: "evlrg": 0, 2023-08-11T12:40:49.576 INFO:teuthology.orchestra.run.smithi194.stdout: "evadd": 1664, 2023-08-11T12:40:49.576 INFO:teuthology.orchestra.run.smithi194.stdout: "evex": 0, 2023-08-11T12:40:49.576 INFO:teuthology.orchestra.run.smithi194.stdout: "evtrm": 0, 2023-08-11T12:40:49.576 INFO:teuthology.orchestra.run.smithi194.stdout: "ev": 1664, 2023-08-11T12:40:49.577 INFO:teuthology.orchestra.run.smithi194.stdout: "evexg": 0, 2023-08-11T12:40:49.577 INFO:teuthology.orchestra.run.smithi194.stdout: "evexd": 0, 2023-08-11T12:40:49.577 INFO:teuthology.orchestra.run.smithi194.stdout: "segadd": 3, 2023-08-11T12:40:49.577 INFO:teuthology.orchestra.run.smithi194.stdout: "segex": 0, 2023-08-11T12:40:49.577 INFO:teuthology.orchestra.run.smithi194.stdout: "segtrm": 0, 2023-08-11T12:40:49.577 INFO:teuthology.orchestra.run.smithi194.stdout: "seg": 3, 2023-08-11T12:40:49.578 INFO:teuthology.orchestra.run.smithi194.stdout: "segmjr": 2, 2023-08-11T12:40:49.578 INFO:teuthology.orchestra.run.smithi194.stdout: "segexg": 0, 2023-08-11T12:40:49.578 INFO:teuthology.orchestra.run.smithi194.stdout: "segexd": 0, 2023-08-11T12:40:49.578 INFO:teuthology.orchestra.run.smithi194.stdout: "expos": 4194304, 2023-08-11T12:40:49.578 INFO:teuthology.orchestra.run.smithi194.stdout: "wrpos": 7779716, 2023-08-11T12:40:49.579 INFO:teuthology.orchestra.run.smithi194.stdout: "rdpos": 0, 2023-08-11T12:40:49.579 INFO:teuthology.orchestra.run.smithi194.stdout: "jlat": { 2023-08-11T12:40:49.579 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 1072, 2023-08-11T12:40:49.579 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 2.194420810, 2023-08-11T12:40:49.579 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.002047034 2023-08-11T12:40:49.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.580 INFO:teuthology.orchestra.run.smithi194.stdout: "replayed": 0 2023-08-11T12:40:49.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.580 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_mem": { 2023-08-11T12:40:49.580 INFO:teuthology.orchestra.run.smithi194.stdout: "ino": 431, 2023-08-11T12:40:49.581 INFO:teuthology.orchestra.run.smithi194.stdout: "ino+": 632, 2023-08-11T12:40:49.581 INFO:teuthology.orchestra.run.smithi194.stdout: "ino-": 201, 2023-08-11T12:40:49.581 INFO:teuthology.orchestra.run.smithi194.stdout: "dir": 88, 2023-08-11T12:40:49.581 INFO:teuthology.orchestra.run.smithi194.stdout: "dir+": 191, 2023-08-11T12:40:49.581 INFO:teuthology.orchestra.run.smithi194.stdout: "dir-": 103, 2023-08-11T12:40:49.582 INFO:teuthology.orchestra.run.smithi194.stdout: "dn": 613, 2023-08-11T12:40:49.582 INFO:teuthology.orchestra.run.smithi194.stdout: "dn+": 1078, 2023-08-11T12:40:49.582 INFO:teuthology.orchestra.run.smithi194.stdout: "dn-": 465, 2023-08-11T12:40:49.582 INFO:teuthology.orchestra.run.smithi194.stdout: "cap": 8, 2023-08-11T12:40:49.582 INFO:teuthology.orchestra.run.smithi194.stdout: "cap+": 345, 2023-08-11T12:40:49.583 INFO:teuthology.orchestra.run.smithi194.stdout: "cap-": 337, 2023-08-11T12:40:49.583 INFO:teuthology.orchestra.run.smithi194.stdout: "rss": 60008, 2023-08-11T12:40:49.583 INFO:teuthology.orchestra.run.smithi194.stdout: "heap": 198960 2023-08-11T12:40:49.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.583 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_server": { 2023-08-11T12:40:49.584 INFO:teuthology.orchestra.run.smithi194.stdout: "dispatch_client_request": 5153, 2023-08-11T12:40:49.584 INFO:teuthology.orchestra.run.smithi194.stdout: "dispatch_server_request": 367, 2023-08-11T12:40:49.584 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_request": 1867, 2023-08-11T12:40:49.584 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_session": 416, 2023-08-11T12:40:49.584 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_peer_request": 649, 2023-08-11T12:40:49.585 INFO:teuthology.orchestra.run.smithi194.stdout: "req_create_latency": { 2023-08-11T12:40:49.585 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 65, 2023-08-11T12:40:49.585 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.075940970, 2023-08-11T12:40:49.585 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.001168322 2023-08-11T12:40:49.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.588 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getattr_latency": { 2023-08-11T12:40:49.589 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 21, 2023-08-11T12:40:49.589 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.010856744, 2023-08-11T12:40:49.589 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000516987 2023-08-11T12:40:49.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.589 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getfilelock_latency": { 2023-08-11T12:40:49.590 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:49.590 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:49.590 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:49.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.590 INFO:teuthology.orchestra.run.smithi194.stdout: "req_link_latency": { 2023-08-11T12:40:49.591 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 200, 2023-08-11T12:40:49.591 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.619367756, 2023-08-11T12:40:49.591 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.003096838 2023-08-11T12:40:49.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.591 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookup_latency": { 2023-08-11T12:40:49.592 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 442, 2023-08-11T12:40:49.592 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.426462009, 2023-08-11T12:40:49.592 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000964846 2023-08-11T12:40:49.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.592 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookuphash_latency": { 2023-08-11T12:40:49.593 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:49.593 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:49.593 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:49.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.593 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupino_latency": { 2023-08-11T12:40:49.594 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:49.594 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:49.594 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:49.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.594 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupname_latency": { 2023-08-11T12:40:49.595 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:49.595 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:49.595 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:49.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.595 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupparent_latency": { 2023-08-11T12:40:49.596 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:49.596 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:49.596 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:49.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.596 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupsnap_latency": { 2023-08-11T12:40:49.597 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:49.597 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:49.597 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:49.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.597 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lssnap_latency": { 2023-08-11T12:40:49.598 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:49.598 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:49.598 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:49.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.598 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mkdir_latency": { 2023-08-11T12:40:49.599 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:49.599 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:49.599 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:49.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.599 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mknod_latency": { 2023-08-11T12:40:49.599 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:49.600 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:49.600 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:49.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.600 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mksnap_latency": { 2023-08-11T12:40:49.600 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:49.601 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:49.601 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:49.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.601 INFO:teuthology.orchestra.run.smithi194.stdout: "req_open_latency": { 2023-08-11T12:40:49.601 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 138, 2023-08-11T12:40:49.602 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.418732886, 2023-08-11T12:40:49.602 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.003034296 2023-08-11T12:40:49.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.602 INFO:teuthology.orchestra.run.smithi194.stdout: "req_readdir_latency": { 2023-08-11T12:40:49.602 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 22, 2023-08-11T12:40:49.603 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 5.006365504, 2023-08-11T12:40:49.603 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.227562068 2023-08-11T12:40:49.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.603 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rename_latency": { 2023-08-11T12:40:49.603 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 734, 2023-08-11T12:40:49.604 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 6.863229341, 2023-08-11T12:40:49.604 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.009350448 2023-08-11T12:40:49.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.604 INFO:teuthology.orchestra.run.smithi194.stdout: "req_renamesnap_latency": { 2023-08-11T12:40:49.604 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:49.605 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:49.605 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:49.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.605 INFO:teuthology.orchestra.run.smithi194.stdout: "req_snapdiff_latency": { 2023-08-11T12:40:49.605 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:49.606 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:49.606 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:49.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.606 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmdir_latency": { 2023-08-11T12:40:49.606 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:49.607 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:49.607 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:49.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.607 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmsnap_latency": { 2023-08-11T12:40:49.607 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:49.608 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:49.608 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:49.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.608 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmxattr_latency": { 2023-08-11T12:40:49.608 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:49.609 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:49.609 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:49.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.609 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setattr_latency": { 2023-08-11T12:40:49.609 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:49.610 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:49.610 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:49.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.610 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setdirlayout_latency": { 2023-08-11T12:40:49.610 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:49.611 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:49.611 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:49.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.611 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setfilelock_latency": { 2023-08-11T12:40:49.611 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:49.612 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:49.612 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:49.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.612 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setlayout_latency": { 2023-08-11T12:40:49.612 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:49.613 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:49.613 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:49.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.613 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setxattr_latency": { 2023-08-11T12:40:49.613 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:49.613 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:49.614 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:49.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.614 INFO:teuthology.orchestra.run.smithi194.stdout: "req_symlink_latency": { 2023-08-11T12:40:49.614 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:49.614 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:49.615 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:49.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.615 INFO:teuthology.orchestra.run.smithi194.stdout: "req_unlink_latency": { 2023-08-11T12:40:49.615 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 200, 2023-08-11T12:40:49.615 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.381975527, 2023-08-11T12:40:49.616 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.001909877 2023-08-11T12:40:49.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.616 INFO:teuthology.orchestra.run.smithi194.stdout: "cap_revoke_eviction": 0, 2023-08-11T12:40:49.616 INFO:teuthology.orchestra.run.smithi194.stdout: "cap_acquisition_throttle": 0, 2023-08-11T12:40:49.616 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getvxattr_latency": { 2023-08-11T12:40:49.617 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:49.617 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:49.617 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:49.617 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:49.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.618 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_sessions": { 2023-08-11T12:40:49.618 INFO:teuthology.orchestra.run.smithi194.stdout: "session_count": 2, 2023-08-11T12:40:49.618 INFO:teuthology.orchestra.run.smithi194.stdout: "session_add": 2, 2023-08-11T12:40:49.618 INFO:teuthology.orchestra.run.smithi194.stdout: "session_remove": 0, 2023-08-11T12:40:49.618 INFO:teuthology.orchestra.run.smithi194.stdout: "sessions_open": 2, 2023-08-11T12:40:49.619 INFO:teuthology.orchestra.run.smithi194.stdout: "sessions_stale": 0, 2023-08-11T12:40:49.619 INFO:teuthology.orchestra.run.smithi194.stdout: "total_load": 402, 2023-08-11T12:40:49.619 INFO:teuthology.orchestra.run.smithi194.stdout: "average_load": 201, 2023-08-11T12:40:49.619 INFO:teuthology.orchestra.run.smithi194.stdout: "avg_session_uptime": 971 2023-08-11T12:40:49.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.620 INFO:teuthology.orchestra.run.smithi194.stdout: "mempool": { 2023-08-11T12:40:49.620 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_bytes": 0, 2023-08-11T12:40:49.620 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_items": 0, 2023-08-11T12:40:49.620 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_bytes": 0, 2023-08-11T12:40:49.620 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_items": 0, 2023-08-11T12:40:49.621 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_bytes": 0, 2023-08-11T12:40:49.621 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_items": 0, 2023-08-11T12:40:49.621 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-11T12:40:49.621 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_items": 0, 2023-08-11T12:40:49.621 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-11T12:40:49.622 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_items": 0, 2023-08-11T12:40:49.622 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_bytes": 0, 2023-08-11T12:40:49.622 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_items": 0, 2023-08-11T12:40:49.622 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-11T12:40:49.622 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_items": 0, 2023-08-11T12:40:49.622 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_bytes": 0, 2023-08-11T12:40:49.623 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_items": 0, 2023-08-11T12:40:49.623 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_bytes": 0, 2023-08-11T12:40:49.623 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_items": 0, 2023-08-11T12:40:49.623 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-11T12:40:49.623 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_items": 0, 2023-08-11T12:40:49.624 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-11T12:40:49.624 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_items": 0, 2023-08-11T12:40:49.624 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_bytes": 0, 2023-08-11T12:40:49.624 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_items": 0, 2023-08-11T12:40:49.624 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_bytes": 0, 2023-08-11T12:40:49.625 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_items": 0, 2023-08-11T12:40:49.625 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-11T12:40:49.625 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_items": 0, 2023-08-11T12:40:49.625 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_bytes": 0, 2023-08-11T12:40:49.625 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_items": 0, 2023-08-11T12:40:49.626 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_bytes": 0, 2023-08-11T12:40:49.626 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_items": 0, 2023-08-11T12:40:49.626 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_bytes": 0, 2023-08-11T12:40:49.626 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_items": 0, 2023-08-11T12:40:49.626 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_bytes": 0, 2023-08-11T12:40:49.627 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_items": 0, 2023-08-11T12:40:49.627 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_bytes": 834193, 2023-08-11T12:40:49.627 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_items": 702, 2023-08-11T12:40:49.627 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_bytes": 0, 2023-08-11T12:40:49.627 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_items": 0, 2023-08-11T12:40:49.628 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_bytes": 0, 2023-08-11T12:40:49.628 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_items": 0, 2023-08-11T12:40:49.628 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_bytes": 0, 2023-08-11T12:40:49.628 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_items": 0, 2023-08-11T12:40:49.628 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_bytes": 0, 2023-08-11T12:40:49.629 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_items": 0, 2023-08-11T12:40:49.629 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_bytes": 9320, 2023-08-11T12:40:49.629 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_items": 178, 2023-08-11T12:40:49.629 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_bytes": 0, 2023-08-11T12:40:49.629 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_items": 0, 2023-08-11T12:40:49.630 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_bytes": 0, 2023-08-11T12:40:49.630 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_items": 0, 2023-08-11T12:40:49.630 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_bytes": 1704652, 2023-08-11T12:40:49.630 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_items": 28642, 2023-08-11T12:40:49.630 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_bytes": 0, 2023-08-11T12:40:49.631 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_items": 0, 2023-08-11T12:40:49.631 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_bytes": 0, 2023-08-11T12:40:49.631 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_items": 0 2023-08-11T12:40:49.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.631 INFO:teuthology.orchestra.run.smithi194.stdout: "objecter": { 2023-08-11T12:40:49.632 INFO:teuthology.orchestra.run.smithi194.stdout: "op_active": 0, 2023-08-11T12:40:49.632 INFO:teuthology.orchestra.run.smithi194.stdout: "op_laggy": 0, 2023-08-11T12:40:49.632 INFO:teuthology.orchestra.run.smithi194.stdout: "op_send": 1502, 2023-08-11T12:40:49.632 INFO:teuthology.orchestra.run.smithi194.stdout: "op_send_bytes": 3778186, 2023-08-11T12:40:49.632 INFO:teuthology.orchestra.run.smithi194.stdout: "op_resend": 27, 2023-08-11T12:40:49.633 INFO:teuthology.orchestra.run.smithi194.stdout: "op_reply": 1502, 2023-08-11T12:40:49.633 INFO:teuthology.orchestra.run.smithi194.stdout: "op_latency": { 2023-08-11T12:40:49.633 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 1502, 2023-08-11T12:40:49.633 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 3.021938490, 2023-08-11T12:40:49.633 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.002011943 2023-08-11T12:40:49.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.634 INFO:teuthology.orchestra.run.smithi194.stdout: "op_inflight": 0, 2023-08-11T12:40:49.634 INFO:teuthology.orchestra.run.smithi194.stdout: "oplen_avg": { 2023-08-11T12:40:49.634 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 1502, 2023-08-11T12:40:49.634 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 1598 2023-08-11T12:40:49.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.635 INFO:teuthology.orchestra.run.smithi194.stdout: "op": 1502, 2023-08-11T12:40:49.635 INFO:teuthology.orchestra.run.smithi194.stdout: "op_r": 254, 2023-08-11T12:40:49.635 INFO:teuthology.orchestra.run.smithi194.stdout: "op_w": 1248, 2023-08-11T12:40:49.635 INFO:teuthology.orchestra.run.smithi194.stdout: "op_rmw": 0, 2023-08-11T12:40:49.635 INFO:teuthology.orchestra.run.smithi194.stdout: "op_pg": 0, 2023-08-11T12:40:49.636 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_stat": 0, 2023-08-11T12:40:49.636 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_create": 10, 2023-08-11T12:40:49.636 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_read": 12, 2023-08-11T12:40:49.636 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_write": 1084, 2023-08-11T12:40:49.636 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_writefull": 28, 2023-08-11T12:40:49.637 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_writesame": 0, 2023-08-11T12:40:49.637 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_append": 0, 2023-08-11T12:40:49.637 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_zero": 7, 2023-08-11T12:40:49.637 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_truncate": 2, 2023-08-11T12:40:49.637 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_delete": 55, 2023-08-11T12:40:49.638 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_mapext": 0, 2023-08-11T12:40:49.638 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_sparse_read": 0, 2023-08-11T12:40:49.638 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_clonerange": 0, 2023-08-11T12:40:49.638 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_getxattr": 231, 2023-08-11T12:40:49.638 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_setxattr": 20, 2023-08-11T12:40:49.639 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_cmpxattr": 0, 2023-08-11T12:40:49.639 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_rmxattr": 0, 2023-08-11T12:40:49.639 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_resetxattrs": 0, 2023-08-11T12:40:49.639 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_call": 0, 2023-08-11T12:40:49.639 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_watch": 0, 2023-08-11T12:40:49.640 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_notify": 0, 2023-08-11T12:40:49.640 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_src_cmpxattr": 0, 2023-08-11T12:40:49.640 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_pgls": 0, 2023-08-11T12:40:49.640 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_pgls_filter": 0, 2023-08-11T12:40:49.640 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_other": 0, 2023-08-11T12:40:49.641 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_active": 0, 2023-08-11T12:40:49.641 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_send": 0, 2023-08-11T12:40:49.641 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_resend": 0, 2023-08-11T12:40:49.641 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_ping": 0, 2023-08-11T12:40:49.641 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_active": 0, 2023-08-11T12:40:49.641 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_send": 0, 2023-08-11T12:40:49.642 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_resend": 0, 2023-08-11T12:40:49.642 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_active": 0, 2023-08-11T12:40:49.642 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_send": 0, 2023-08-11T12:40:49.642 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_resend": 0, 2023-08-11T12:40:49.642 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_active": 0, 2023-08-11T12:40:49.643 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_send": 0, 2023-08-11T12:40:49.643 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_resend": 0, 2023-08-11T12:40:49.643 INFO:teuthology.orchestra.run.smithi194.stdout: "command_active": 0, 2023-08-11T12:40:49.643 INFO:teuthology.orchestra.run.smithi194.stdout: "command_send": 0, 2023-08-11T12:40:49.643 INFO:teuthology.orchestra.run.smithi194.stdout: "command_resend": 0, 2023-08-11T12:40:49.644 INFO:teuthology.orchestra.run.smithi194.stdout: "map_epoch": 110, 2023-08-11T12:40:49.644 INFO:teuthology.orchestra.run.smithi194.stdout: "map_full": 0, 2023-08-11T12:40:49.644 INFO:teuthology.orchestra.run.smithi194.stdout: "map_inc": 23, 2023-08-11T12:40:49.644 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_sessions": 12, 2023-08-11T12:40:49.644 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_session_open": 12, 2023-08-11T12:40:49.645 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_session_close": 0, 2023-08-11T12:40:49.645 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_laggy": 0, 2023-08-11T12:40:49.645 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_wr": 106, 2023-08-11T12:40:49.645 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_rd": 18, 2023-08-11T12:40:49.645 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_del": 25 2023-08-11T12:40:49.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.646 INFO:teuthology.orchestra.run.smithi194.stdout: "oft": { 2023-08-11T12:40:49.646 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_objs": 1, 2023-08-11T12:40:49.646 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_kv_pairs": 0, 2023-08-11T12:40:49.646 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_updates": 0, 2023-08-11T12:40:49.647 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_removes": 0 2023-08-11T12:40:49.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.647 INFO:teuthology.orchestra.run.smithi194.stdout: "osd-slow-ops": { 2023-08-11T12:40:49.647 INFO:teuthology.orchestra.run.smithi194.stdout: "slow_ops_count": 0 2023-08-11T12:40:49.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.647 INFO:teuthology.orchestra.run.smithi194.stdout: "purge_queue": { 2023-08-11T12:40:49.648 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_ops": 0, 2023-08-11T12:40:49.648 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_ops_high_water": 10, 2023-08-11T12:40:49.648 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing": 0, 2023-08-11T12:40:49.648 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_high_water": 2, 2023-08-11T12:40:49.648 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executed": 12, 2023-08-11T12:40:49.649 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_item_in_journal": 0 2023-08-11T12:40:49.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.649 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-11T12:40:49.649 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2023-08-11T12:40:49.649 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2023-08-11T12:40:49.650 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2023-08-11T12:40:49.650 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 11837, 2023-08-11T12:40:49.650 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 4984741, 2023-08-11T12:40:49.650 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:49.650 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 11837, 2023-08-11T12:40:49.651 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2023-08-11T12:40:49.651 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2023-08-11T12:40:49.651 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 11837, 2023-08-11T12:40:49.651 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 4984741, 2023-08-11T12:40:49.651 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2023-08-11T12:40:49.652 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:49.652 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:49.652 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:49.652 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:49.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.653 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-objecter_bytes": { 2023-08-11T12:40:49.653 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2023-08-11T12:40:49.653 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2023-08-11T12:40:49.653 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2023-08-11T12:40:49.653 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2023-08-11T12:40:49.654 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2023-08-11T12:40:49.654 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:49.654 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:49.654 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 1502, 2023-08-11T12:40:49.654 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 3779234, 2023-08-11T12:40:49.655 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 1502, 2023-08-11T12:40:49.655 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 3779234, 2023-08-11T12:40:49.655 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2023-08-11T12:40:49.655 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:49.655 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:49.656 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:49.656 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:49.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.656 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-objecter_ops": { 2023-08-11T12:40:49.656 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2023-08-11T12:40:49.657 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 1024, 2023-08-11T12:40:49.657 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2023-08-11T12:40:49.657 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2023-08-11T12:40:49.657 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2023-08-11T12:40:49.657 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:49.658 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:49.658 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 1502, 2023-08-11T12:40:49.658 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 1502, 2023-08-11T12:40:49.658 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 1502, 2023-08-11T12:40:49.658 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 1502, 2023-08-11T12:40:49.659 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2023-08-11T12:40:49.659 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:49.659 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:49.659 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:49.659 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:49.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.660 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-write_buf_throttle": { 2023-08-11T12:40:49.660 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2023-08-11T12:40:49.660 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 3758096384, 2023-08-11T12:40:49.660 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2023-08-11T12:40:49.661 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 12, 2023-08-11T12:40:49.661 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 1340, 2023-08-11T12:40:49.661 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:49.661 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 12, 2023-08-11T12:40:49.661 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2023-08-11T12:40:49.662 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2023-08-11T12:40:49.662 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 12, 2023-08-11T12:40:49.662 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 1340, 2023-08-11T12:40:49.662 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2023-08-11T12:40:49.662 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:49.663 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:49.663 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:49.663 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:49.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:49.663 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-write_buf_throttle-0x55f0f9dc2000": { 2023-08-11T12:40:49.664 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2023-08-11T12:40:49.664 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 3758096384, 2023-08-11T12:40:49.664 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2023-08-11T12:40:49.664 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 1664, 2023-08-11T12:40:49.664 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 3585412, 2023-08-11T12:40:49.665 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:49.665 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 1664, 2023-08-11T12:40:49.665 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2023-08-11T12:40:49.665 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2023-08-11T12:40:49.665 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 1072, 2023-08-11T12:40:49.665 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 3585412, 2023-08-11T12:40:49.666 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2023-08-11T12:40:49.666 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:49.666 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:49.666 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:49.666 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:49.667 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:49.667 INFO:teuthology.orchestra.run.smithi194.stdout:} 2023-08-11T12:40:50.000 INFO:tasks.check_counter:Daemon mds.i mds.exported=30 2023-08-11T12:40:50.001 INFO:tasks.check_counter:Daemon mds.i mds.imported=29 2023-08-11T12:40:50.001 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=71 2023-08-11T12:40:50.001 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=205 2023-08-11T12:40:50.002 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=4 2023-08-11T12:40:50.002 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2023-08-11T12:40:50.002 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2023-08-11T12:40:50.002 DEBUG:tasks.check_counter:Getting stats from l 2023-08-11T12:40:50.003 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:92684807f016ce045ac66e37fdde6f8c47857bcc shell --fsid 815f94ae-3840-11ee-9b37-001a4aab830c -- ceph daemon mds.l perf dump 2023-08-11T12:40:50.302 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:50 smithi008 ceph-mon[97158]: pgmap v509: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:40:50.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:50 smithi194 ceph-mon[130905]: pgmap v509: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:40:50.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:50 smithi045 ceph-mon[130284]: pgmap v509: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:40:50.557 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/mon.c/config 2023-08-11T12:40:51.677 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2023-08-11T12:40:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-0": { 2023-08-11T12:40:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 374, 2023-08-11T12:40:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 337, 2023-08-11T12:40:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 1653938, 2023-08-11T12:40:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 191437, 2023-08-11T12:40:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 6, 2023-08-11T12:40:51.679 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 1, 2023-08-11T12:40:51.679 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.065095286, 2023-08-11T12:40:51.679 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.021442029, 2023-08-11T12:40:51.679 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.039912189, 2023-08-11T12:40:51.679 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.009665799, 2023-08-11T12:40:51.679 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 336, 2023-08-11T12:40:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.018573709, 2023-08-11T12:40:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000055278 2023-08-11T12:40:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 1653104, 2023-08-11T12:40:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 191120 2023-08-11T12:40:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-1": { 2023-08-11T12:40:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 981, 2023-08-11T12:40:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 1213, 2023-08-11T12:40:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 243184, 2023-08-11T12:40:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 857230, 2023-08-11T12:40:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 7, 2023-08-11T12:40:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 5, 2023-08-11T12:40:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.114103880, 2023-08-11T12:40:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.033835265, 2023-08-11T12:40:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.025693702, 2023-08-11T12:40:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.042736313, 2023-08-11T12:40:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 1211, 2023-08-11T12:40:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.055151242, 2023-08-11T12:40:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000045541 2023-08-11T12:40:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 3312, 2023-08-11T12:40:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 554000 2023-08-11T12:40:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-2": { 2023-08-11T12:40:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 2260, 2023-08-11T12:40:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 2262, 2023-08-11T12:40:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 3234574, 2023-08-11T12:40:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 702918, 2023-08-11T12:40:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 4, 2023-08-11T12:40:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 3, 2023-08-11T12:40:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.244198217, 2023-08-11T12:40:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.069182263, 2023-08-11T12:40:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.063557584, 2023-08-11T12:40:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.088254916, 2023-08-11T12:40:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2023-08-11T12:40:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 2260, 2023-08-11T12:40:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.093866779, 2023-08-11T12:40:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000041533 2023-08-11T12:40:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2023-08-11T12:40:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 0, 2023-08-11T12:40:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 0 2023-08-11T12:40:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: "cct": { 2023-08-11T12:40:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: "total_workers": 1, 2023-08-11T12:40:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: "unhealthy_workers": 0 2023-08-11T12:40:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: "finisher-MDSRank": { 2023-08-11T12:40:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: "queue_len": 0, 2023-08-11T12:40:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: "complete_latency": { 2023-08-11T12:40:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 5361, 2023-08-11T12:40:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.179494269, 2023-08-11T12:40:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000033481 2023-08-11T12:40:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "finisher-PurgeQueue": { 2023-08-11T12:40:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "queue_len": 0, 2023-08-11T12:40:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: "complete_latency": { 2023-08-11T12:40:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: "mds": { 2023-08-11T12:40:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: "request": 0, 2023-08-11T12:40:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: "reply": 0, 2023-08-11T12:40:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: "reply_latency": { 2023-08-11T12:40:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: "slow_reply": 0, 2023-08-11T12:40:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: "forward": 0, 2023-08-11T12:40:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_fetch_complete": 0, 2023-08-11T12:40:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_fetch_keys": 0, 2023-08-11T12:40:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_commit": 0, 2023-08-11T12:40:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_split": 0, 2023-08-11T12:40:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_merge": 0, 2023-08-11T12:40:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes": 640, 2023-08-11T12:40:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_top": 3, 2023-08-11T12:40:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_bottom": 540, 2023-08-11T12:40:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_pin_tail": 97, 2023-08-11T12:40:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_pinned": 635, 2023-08-11T12:40:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_expired": 0, 2023-08-11T12:40:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_with_caps": 0, 2023-08-11T12:40:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "caps": 0, 2023-08-11T12:40:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "subtrees": 38, 2023-08-11T12:40:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse": 0, 2023-08-11T12:40:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_hit": 0, 2023-08-11T12:40:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_forward": 0, 2023-08-11T12:40:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_discover": 0, 2023-08-11T12:40:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_dir_fetch": 0, 2023-08-11T12:40:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_remote_ino": 0, 2023-08-11T12:40:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_lock": 0, 2023-08-11T12:40:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "load_cent": 0, 2023-08-11T12:40:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "q": 0, 2023-08-11T12:40:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "exported": 0, 2023-08-11T12:40:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "exported_inodes": 0, 2023-08-11T12:40:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "imported": 0, 2023-08-11T12:40:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "imported_inodes": 0, 2023-08-11T12:40:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_dir_fetch": 0, 2023-08-11T12:40:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_backtrace_fetch": 0, 2023-08-11T12:40:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_peer_discover": 0, 2023-08-11T12:40:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rfiles": 0, 2023-08-11T12:40:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rbytes": 0, 2023-08-11T12:40:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rsnaps": 0, 2023-08-11T12:40:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_backtrace_fetch": 0, 2023-08-11T12:40:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_set_tag": 0, 2023-08-11T12:40:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_backtrace_repaired": 0, 2023-08-11T12:40:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_inotable_repaired": 0, 2023-08-11T12:40:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dir_inodes": 0, 2023-08-11T12:40:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dir_base_inodes": 0, 2023-08-11T12:40:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dirfrag_rstats": 0, 2023-08-11T12:40:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_file_inodes": 0, 2023-08-11T12:40:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_inode_file_caps": 0, 2023-08-11T12:40:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_revoke": 0, 2023-08-11T12:40:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_grant": 0, 2023-08-11T12:40:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_trunc": 0, 2023-08-11T12:40:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-11T12:40:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-11T12:40:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_caps": 0, 2023-08-11T12:40:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_caps_dirty": 0, 2023-08-11T12:40:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_cap_release": 0, 2023-08-11T12:40:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: "process_request_cap_release": 0 2023-08-11T12:40:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_cache": { 2023-08-11T12:40:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_update": 0, 2023-08-11T12:40:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_update_receipt": 0, 2023-08-11T12:40:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_try_discover": 0, 2023-08-11T12:40:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_send_discover": 0, 2023-08-11T12:40:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_handle_discover": 0, 2023-08-11T12:40:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays": 0, 2023-08-11T12:40:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays_delayed": 0, 2023-08-11T12:40:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays_enqueuing": 0, 2023-08-11T12:40:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_created": 0, 2023-08-11T12:40:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_enqueued": 0, 2023-08-11T12:40:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_reintegrated": 0, 2023-08-11T12:40:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_migrated": 0, 2023-08-11T12:40:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_processing": 0, 2023-08-11T12:40:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_enqueued": 0, 2023-08-11T12:40:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_prioritized": 0, 2023-08-11T12:40:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: "recovery_started": 0, 2023-08-11T12:40:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: "recovery_completed": 0, 2023-08-11T12:40:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_enqueue_scrub": 0, 2023-08-11T12:40:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_exportdir": 0, 2023-08-11T12:40:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_flush": 0, 2023-08-11T12:40:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_fragmentdir": 0, 2023-08-11T12:40:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_fragstats": 0, 2023-08-11T12:40:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_inodestats": 0 2023-08-11T12:40:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_log": { 2023-08-11T12:40:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: "evlrg": 0, 2023-08-11T12:40:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: "evadd": 0, 2023-08-11T12:40:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: "evex": 0, 2023-08-11T12:40:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: "evtrm": 0, 2023-08-11T12:40:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: "ev": 1572, 2023-08-11T12:40:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: "evexg": 0, 2023-08-11T12:40:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: "evexd": 0, 2023-08-11T12:40:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: "segadd": 0, 2023-08-11T12:40:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: "segex": 0, 2023-08-11T12:40:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: "segtrm": 0, 2023-08-11T12:40:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: "seg": 3, 2023-08-11T12:40:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: "segmjr": 2, 2023-08-11T12:40:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: "segexg": 0, 2023-08-11T12:40:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: "segexd": 0, 2023-08-11T12:40:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: "expos": 4194304, 2023-08-11T12:40:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: "wrpos": 6756537, 2023-08-11T12:40:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: "rdpos": 6755963, 2023-08-11T12:40:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: "jlat": { 2023-08-11T12:40:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: "replayed": 1572 2023-08-11T12:40:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_mem": { 2023-08-11T12:40:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: "ino": 623, 2023-08-11T12:40:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: "ino+": 797, 2023-08-11T12:40:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: "ino-": 174, 2023-08-11T12:40:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: "dir": 46, 2023-08-11T12:40:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: "dir+": 72, 2023-08-11T12:40:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: "dir-": 26, 2023-08-11T12:40:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: "dn": 640, 2023-08-11T12:40:51.722 INFO:teuthology.orchestra.run.smithi194.stdout: "dn+": 826, 2023-08-11T12:40:51.722 INFO:teuthology.orchestra.run.smithi194.stdout: "dn-": 186, 2023-08-11T12:40:51.722 INFO:teuthology.orchestra.run.smithi194.stdout: "cap": 0, 2023-08-11T12:40:51.722 INFO:teuthology.orchestra.run.smithi194.stdout: "cap+": 0, 2023-08-11T12:40:51.722 INFO:teuthology.orchestra.run.smithi194.stdout: "cap-": 0, 2023-08-11T12:40:51.723 INFO:teuthology.orchestra.run.smithi194.stdout: "rss": 50728, 2023-08-11T12:40:51.723 INFO:teuthology.orchestra.run.smithi194.stdout: "heap": 207152 2023-08-11T12:40:51.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.723 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_server": { 2023-08-11T12:40:51.723 INFO:teuthology.orchestra.run.smithi194.stdout: "dispatch_client_request": 0, 2023-08-11T12:40:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: "dispatch_server_request": 0, 2023-08-11T12:40:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_request": 0, 2023-08-11T12:40:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_session": 0, 2023-08-11T12:40:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_peer_request": 0, 2023-08-11T12:40:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: "req_create_latency": { 2023-08-11T12:40:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getattr_latency": { 2023-08-11T12:40:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getfilelock_latency": { 2023-08-11T12:40:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: "req_link_latency": { 2023-08-11T12:40:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookup_latency": { 2023-08-11T12:40:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookuphash_latency": { 2023-08-11T12:40:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupino_latency": { 2023-08-11T12:40:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupname_latency": { 2023-08-11T12:40:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupparent_latency": { 2023-08-11T12:40:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupsnap_latency": { 2023-08-11T12:40:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lssnap_latency": { 2023-08-11T12:40:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mkdir_latency": { 2023-08-11T12:40:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mknod_latency": { 2023-08-11T12:40:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mksnap_latency": { 2023-08-11T12:40:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: "req_open_latency": { 2023-08-11T12:40:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: "req_readdir_latency": { 2023-08-11T12:40:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rename_latency": { 2023-08-11T12:40:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: "req_renamesnap_latency": { 2023-08-11T12:40:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: "req_snapdiff_latency": { 2023-08-11T12:40:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmdir_latency": { 2023-08-11T12:40:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmsnap_latency": { 2023-08-11T12:40:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmxattr_latency": { 2023-08-11T12:40:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setattr_latency": { 2023-08-11T12:40:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setdirlayout_latency": { 2023-08-11T12:40:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setfilelock_latency": { 2023-08-11T12:40:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setlayout_latency": { 2023-08-11T12:40:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.750 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setxattr_latency": { 2023-08-11T12:40:51.750 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.750 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.750 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.751 INFO:teuthology.orchestra.run.smithi194.stdout: "req_symlink_latency": { 2023-08-11T12:40:51.751 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.751 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.751 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.752 INFO:teuthology.orchestra.run.smithi194.stdout: "req_unlink_latency": { 2023-08-11T12:40:51.752 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.752 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.752 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.753 INFO:teuthology.orchestra.run.smithi194.stdout: "cap_revoke_eviction": 0, 2023-08-11T12:40:51.753 INFO:teuthology.orchestra.run.smithi194.stdout: "cap_acquisition_throttle": 0, 2023-08-11T12:40:51.753 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getvxattr_latency": { 2023-08-11T12:40:51.753 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.753 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.754 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.754 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:51.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.754 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_sessions": { 2023-08-11T12:40:51.754 INFO:teuthology.orchestra.run.smithi194.stdout: "session_count": 2, 2023-08-11T12:40:51.754 INFO:teuthology.orchestra.run.smithi194.stdout: "session_add": 4, 2023-08-11T12:40:51.755 INFO:teuthology.orchestra.run.smithi194.stdout: "session_remove": 2, 2023-08-11T12:40:51.755 INFO:teuthology.orchestra.run.smithi194.stdout: "sessions_open": 4, 2023-08-11T12:40:51.755 INFO:teuthology.orchestra.run.smithi194.stdout: "sessions_stale": 0, 2023-08-11T12:40:51.755 INFO:teuthology.orchestra.run.smithi194.stdout: "total_load": 0, 2023-08-11T12:40:51.755 INFO:teuthology.orchestra.run.smithi194.stdout: "average_load": 0, 2023-08-11T12:40:51.756 INFO:teuthology.orchestra.run.smithi194.stdout: "avg_session_uptime": 4860 2023-08-11T12:40:51.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.756 INFO:teuthology.orchestra.run.smithi194.stdout: "mempool": { 2023-08-11T12:40:51.756 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_bytes": 0, 2023-08-11T12:40:51.756 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_items": 0, 2023-08-11T12:40:51.757 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_bytes": 0, 2023-08-11T12:40:51.757 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_items": 0, 2023-08-11T12:40:51.757 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_bytes": 0, 2023-08-11T12:40:51.757 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_items": 0, 2023-08-11T12:40:51.757 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-11T12:40:51.758 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_items": 0, 2023-08-11T12:40:51.758 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-11T12:40:51.758 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_items": 0, 2023-08-11T12:40:51.758 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_bytes": 0, 2023-08-11T12:40:51.758 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_items": 0, 2023-08-11T12:40:51.759 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-11T12:40:51.759 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_items": 0, 2023-08-11T12:40:51.759 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_bytes": 0, 2023-08-11T12:40:51.759 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_items": 0, 2023-08-11T12:40:51.759 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_bytes": 0, 2023-08-11T12:40:51.760 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_items": 0, 2023-08-11T12:40:51.760 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-11T12:40:51.760 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_items": 0, 2023-08-11T12:40:51.760 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-11T12:40:51.760 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_items": 0, 2023-08-11T12:40:51.761 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_bytes": 0, 2023-08-11T12:40:51.761 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_items": 0, 2023-08-11T12:40:51.761 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_bytes": 0, 2023-08-11T12:40:51.761 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_items": 0, 2023-08-11T12:40:51.761 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-11T12:40:51.761 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_items": 0, 2023-08-11T12:40:51.762 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_bytes": 0, 2023-08-11T12:40:51.762 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_items": 0, 2023-08-11T12:40:51.762 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_bytes": 0, 2023-08-11T12:40:51.762 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_items": 0, 2023-08-11T12:40:51.762 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_bytes": 0, 2023-08-11T12:40:51.763 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_items": 0, 2023-08-11T12:40:51.763 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_bytes": 0, 2023-08-11T12:40:51.763 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_items": 0, 2023-08-11T12:40:51.763 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_bytes": 214217, 2023-08-11T12:40:51.763 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_items": 684, 2023-08-11T12:40:51.764 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_bytes": 0, 2023-08-11T12:40:51.764 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_items": 0, 2023-08-11T12:40:51.764 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_bytes": 0, 2023-08-11T12:40:51.764 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_items": 0, 2023-08-11T12:40:51.764 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_bytes": 0, 2023-08-11T12:40:51.765 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_items": 0, 2023-08-11T12:40:51.765 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_bytes": 0, 2023-08-11T12:40:51.765 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_items": 0, 2023-08-11T12:40:51.765 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_bytes": 9320, 2023-08-11T12:40:51.765 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_items": 178, 2023-08-11T12:40:51.766 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_bytes": 0, 2023-08-11T12:40:51.766 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_items": 0, 2023-08-11T12:40:51.766 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_bytes": 0, 2023-08-11T12:40:51.766 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_items": 0, 2023-08-11T12:40:51.766 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_bytes": 1943112, 2023-08-11T12:40:51.767 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_items": 17946, 2023-08-11T12:40:51.767 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_bytes": 0, 2023-08-11T12:40:51.767 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_items": 0, 2023-08-11T12:40:51.767 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_bytes": 0, 2023-08-11T12:40:51.767 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_items": 0 2023-08-11T12:40:51.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.768 INFO:teuthology.orchestra.run.smithi194.stdout: "objecter": { 2023-08-11T12:40:51.768 INFO:teuthology.orchestra.run.smithi194.stdout: "op_active": 0, 2023-08-11T12:40:51.768 INFO:teuthology.orchestra.run.smithi194.stdout: "op_laggy": 0, 2023-08-11T12:40:51.768 INFO:teuthology.orchestra.run.smithi194.stdout: "op_send": 3236, 2023-08-11T12:40:51.769 INFO:teuthology.orchestra.run.smithi194.stdout: "op_send_bytes": 21, 2023-08-11T12:40:51.769 INFO:teuthology.orchestra.run.smithi194.stdout: "op_resend": 3, 2023-08-11T12:40:51.769 INFO:teuthology.orchestra.run.smithi194.stdout: "op_reply": 3236, 2023-08-11T12:40:51.769 INFO:teuthology.orchestra.run.smithi194.stdout: "op_latency": { 2023-08-11T12:40:51.769 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 3236, 2023-08-11T12:40:51.769 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 1.922960800, 2023-08-11T12:40:51.770 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000594240 2023-08-11T12:40:51.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.770 INFO:teuthology.orchestra.run.smithi194.stdout: "op_inflight": 0, 2023-08-11T12:40:51.770 INFO:teuthology.orchestra.run.smithi194.stdout: "oplen_avg": { 2023-08-11T12:40:51.770 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 3236, 2023-08-11T12:40:51.771 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 3237 2023-08-11T12:40:51.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.771 INFO:teuthology.orchestra.run.smithi194.stdout: "op": 3236, 2023-08-11T12:40:51.771 INFO:teuthology.orchestra.run.smithi194.stdout: "op_r": 3236, 2023-08-11T12:40:51.771 INFO:teuthology.orchestra.run.smithi194.stdout: "op_w": 0, 2023-08-11T12:40:51.772 INFO:teuthology.orchestra.run.smithi194.stdout: "op_rmw": 0, 2023-08-11T12:40:51.772 INFO:teuthology.orchestra.run.smithi194.stdout: "op_pg": 0, 2023-08-11T12:40:51.772 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_stat": 2070, 2023-08-11T12:40:51.772 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_create": 0, 2023-08-11T12:40:51.772 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_read": 1164, 2023-08-11T12:40:51.773 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_write": 0, 2023-08-11T12:40:51.773 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_writefull": 0, 2023-08-11T12:40:51.773 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_writesame": 0, 2023-08-11T12:40:51.773 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_append": 0, 2023-08-11T12:40:51.773 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_zero": 0, 2023-08-11T12:40:51.774 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_truncate": 0, 2023-08-11T12:40:51.774 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_delete": 0, 2023-08-11T12:40:51.774 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_mapext": 0, 2023-08-11T12:40:51.774 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_sparse_read": 0, 2023-08-11T12:40:51.774 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_clonerange": 0, 2023-08-11T12:40:51.775 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_getxattr": 1, 2023-08-11T12:40:51.775 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_setxattr": 0, 2023-08-11T12:40:51.775 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_cmpxattr": 0, 2023-08-11T12:40:51.775 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_rmxattr": 0, 2023-08-11T12:40:51.775 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_resetxattrs": 0, 2023-08-11T12:40:51.775 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_call": 0, 2023-08-11T12:40:51.776 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_watch": 0, 2023-08-11T12:40:51.776 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_notify": 0, 2023-08-11T12:40:51.776 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_src_cmpxattr": 0, 2023-08-11T12:40:51.776 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_pgls": 0, 2023-08-11T12:40:51.776 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_pgls_filter": 0, 2023-08-11T12:40:51.777 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_other": 0, 2023-08-11T12:40:51.777 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_active": 0, 2023-08-11T12:40:51.777 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_send": 0, 2023-08-11T12:40:51.777 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_resend": 0, 2023-08-11T12:40:51.777 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_ping": 0, 2023-08-11T12:40:51.778 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_active": 0, 2023-08-11T12:40:51.778 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_send": 0, 2023-08-11T12:40:51.778 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_resend": 0, 2023-08-11T12:40:51.778 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_active": 0, 2023-08-11T12:40:51.778 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_send": 0, 2023-08-11T12:40:51.779 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_resend": 0, 2023-08-11T12:40:51.779 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_active": 0, 2023-08-11T12:40:51.779 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_send": 0, 2023-08-11T12:40:51.779 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_resend": 0, 2023-08-11T12:40:51.779 INFO:teuthology.orchestra.run.smithi194.stdout: "command_active": 0, 2023-08-11T12:40:51.780 INFO:teuthology.orchestra.run.smithi194.stdout: "command_send": 0, 2023-08-11T12:40:51.780 INFO:teuthology.orchestra.run.smithi194.stdout: "command_resend": 0, 2023-08-11T12:40:51.780 INFO:teuthology.orchestra.run.smithi194.stdout: "map_epoch": 110, 2023-08-11T12:40:51.780 INFO:teuthology.orchestra.run.smithi194.stdout: "map_full": 0, 2023-08-11T12:40:51.780 INFO:teuthology.orchestra.run.smithi194.stdout: "map_inc": 21, 2023-08-11T12:40:51.781 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_sessions": 5, 2023-08-11T12:40:51.781 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_session_open": 6, 2023-08-11T12:40:51.781 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_session_close": 1, 2023-08-11T12:40:51.781 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_laggy": 0, 2023-08-11T12:40:51.781 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_wr": 0, 2023-08-11T12:40:51.782 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_rd": 2, 2023-08-11T12:40:51.782 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_del": 0 2023-08-11T12:40:51.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.782 INFO:teuthology.orchestra.run.smithi194.stdout: "oft": { 2023-08-11T12:40:51.782 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_objs": 0, 2023-08-11T12:40:51.782 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_kv_pairs": 0, 2023-08-11T12:40:51.783 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_updates": 0, 2023-08-11T12:40:51.783 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_removes": 0 2023-08-11T12:40:51.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.783 INFO:teuthology.orchestra.run.smithi194.stdout: "osd-slow-ops": { 2023-08-11T12:40:51.783 INFO:teuthology.orchestra.run.smithi194.stdout: "slow_ops_count": 0 2023-08-11T12:40:51.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.784 INFO:teuthology.orchestra.run.smithi194.stdout: "purge_queue": { 2023-08-11T12:40:51.784 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_ops": 0, 2023-08-11T12:40:51.784 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_ops_high_water": 0, 2023-08-11T12:40:51.784 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing": 0, 2023-08-11T12:40:51.785 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_high_water": 0, 2023-08-11T12:40:51.785 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executed": 0, 2023-08-11T12:40:51.785 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_item_in_journal": 0 2023-08-11T12:40:51.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.785 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-11T12:40:51.786 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2023-08-11T12:40:51.786 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2023-08-11T12:40:51.786 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2023-08-11T12:40:51.786 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 3611, 2023-08-11T12:40:51.786 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 4784766, 2023-08-11T12:40:51.787 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:51.787 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 3611, 2023-08-11T12:40:51.787 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2023-08-11T12:40:51.787 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2023-08-11T12:40:51.787 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 3611, 2023-08-11T12:40:51.787 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 4784766, 2023-08-11T12:40:51.788 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2023-08-11T12:40:51.788 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.788 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.788 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.788 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:51.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.789 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-objecter_bytes": { 2023-08-11T12:40:51.789 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2023-08-11T12:40:51.789 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2023-08-11T12:40:51.789 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2023-08-11T12:40:51.790 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2023-08-11T12:40:51.790 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2023-08-11T12:40:51.790 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:51.790 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:51.790 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 3236, 2023-08-11T12:40:51.791 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 2562238, 2023-08-11T12:40:51.791 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 3236, 2023-08-11T12:40:51.791 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 2562238, 2023-08-11T12:40:51.791 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2023-08-11T12:40:51.791 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.792 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.792 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.792 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:51.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.792 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-objecter_ops": { 2023-08-11T12:40:51.793 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2023-08-11T12:40:51.793 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 1024, 2023-08-11T12:40:51.793 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2023-08-11T12:40:51.793 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2023-08-11T12:40:51.793 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2023-08-11T12:40:51.794 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:51.794 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:51.794 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 3236, 2023-08-11T12:40:51.794 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 3236, 2023-08-11T12:40:51.794 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 3236, 2023-08-11T12:40:51.795 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 3236, 2023-08-11T12:40:51.795 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2023-08-11T12:40:51.795 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.795 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.795 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.795 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:51.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.796 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-write_buf_throttle": { 2023-08-11T12:40:51.796 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2023-08-11T12:40:51.796 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 3758096384, 2023-08-11T12:40:51.796 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2023-08-11T12:40:51.797 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2023-08-11T12:40:51.797 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2023-08-11T12:40:51.797 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:51.797 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:51.797 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2023-08-11T12:40:51.798 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2023-08-11T12:40:51.798 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 0, 2023-08-11T12:40:51.798 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 0, 2023-08-11T12:40:51.798 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2023-08-11T12:40:51.798 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.799 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.799 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.799 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:51.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-08-11T12:40:51.799 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-write_buf_throttle-0x55a8b9cd8000": { 2023-08-11T12:40:51.800 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2023-08-11T12:40:51.800 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 3758096384, 2023-08-11T12:40:51.800 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2023-08-11T12:40:51.800 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2023-08-11T12:40:51.800 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2023-08-11T12:40:51.800 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2023-08-11T12:40:51.801 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2023-08-11T12:40:51.801 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2023-08-11T12:40:51.801 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2023-08-11T12:40:51.801 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 0, 2023-08-11T12:40:51.801 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 0, 2023-08-11T12:40:51.802 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2023-08-11T12:40:51.802 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2023-08-11T12:40:51.802 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2023-08-11T12:40:51.802 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2023-08-11T12:40:51.802 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:51.803 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-08-11T12:40:51.803 INFO:teuthology.orchestra.run.smithi194.stdout:} 2023-08-11T12:40:52.104 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2023-08-11T12:40:52.105 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2023-08-11T12:40:52.105 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2023-08-11T12:40:52.106 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2023-08-11T12:40:52.106 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2023-08-11T12:40:52.106 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2023-08-11T12:40:52.107 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2023-08-11T12:40:52.107 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-08-11T12:40:52.118 INFO:tasks.kclient:Unmounting kernel clients... 2023-08-11T12:40:52.119 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-11T12:40:52.119 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-11T12:40:52.170 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-11T12:40:52.171 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-11T12:40:52.217 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-11T12:40:52.302 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:52 smithi008 ceph-mon[97158]: pgmap v510: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:52.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:52 smithi194 ceph-mon[130905]: pgmap v510: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:52.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:52 smithi045 ceph-mon[130284]: pgmap v510: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:52.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.466+0000 7fb522dff700 1 -- 172.21.15.8:0/3029678146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb51c100940 msgr2=0x7fb51c100dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:52.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.466+0000 7fb522dff700 1 --2- 172.21.15.8:0/3029678146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb51c100940 0x7fb51c100dc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb508009990 tx=0x7fb508009ca0 comp rx=0 tx=0).stop 2023-08-11T12:40:52.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.466+0000 7fb522dff700 1 -- 172.21.15.8:0/3029678146 shutdown_connections 2023-08-11T12:40:52.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.466+0000 7fb522dff700 1 --2- 172.21.15.8:0/3029678146 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb51c106950 0x7fb51c106d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:52.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.466+0000 7fb522dff700 1 --2- 172.21.15.8:0/3029678146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb51c101300 0x7fb51c10d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:52.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.466+0000 7fb522dff700 1 --2- 172.21.15.8:0/3029678146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb51c100940 0x7fb51c100dc0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:52.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.466+0000 7fb522dff700 1 -- 172.21.15.8:0/3029678146 >> 172.21.15.8:0/3029678146 conn(0x7fb51c0fc430 msgr2=0x7fb51c0fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:52.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.466+0000 7fb522dff700 1 -- 172.21.15.8:0/3029678146 shutdown_connections 2023-08-11T12:40:52.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.466+0000 7fb522dff700 1 -- 172.21.15.8:0/3029678146 wait complete. 2023-08-11T12:40:52.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.467+0000 7fb522dff700 1 Processor -- start 2023-08-11T12:40:52.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.467+0000 7fb522dff700 1 -- start start 2023-08-11T12:40:52.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.467+0000 7fb522dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb51c100940 0x7fb51c19c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:52.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.468+0000 7fb522dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb51c101300 0x7fb51c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:52.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.468+0000 7fb522dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb51c106950 0x7fb51c196890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:52.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.468+0000 7fb522dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51c196f00 con 0x7fb51c101300 2023-08-11T12:40:52.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.468+0000 7fb522dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51c197070 con 0x7fb51c100940 2023-08-11T12:40:52.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.468+0000 7fb522dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51c197230 con 0x7fb51c106950 2023-08-11T12:40:52.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.468+0000 7fb51bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb51c101300 0x7fb51c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:52.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.468+0000 7fb520b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb51c100940 0x7fb51c19c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:52.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.468+0000 7fb520b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb51c100940 0x7fb51c19c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:44570/0 (socket says 172.21.15.8:44570) 2023-08-11T12:40:52.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.468+0000 7fb520b9b700 1 -- 172.21.15.8:0/213734105 learned_addr learned my addr 172.21.15.8:0/213734105 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:40:52.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.468+0000 7fb52139c700 1 --2- 172.21.15.8:0/213734105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb51c106950 0x7fb51c196890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:52.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.468+0000 7fb520b9b700 1 -- 172.21.15.8:0/213734105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb51c106950 msgr2=0x7fb51c196890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:52.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.468+0000 7fb520b9b700 1 --2- 172.21.15.8:0/213734105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb51c106950 0x7fb51c196890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:52.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.468+0000 7fb520b9b700 1 -- 172.21.15.8:0/213734105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb51c101300 msgr2=0x7fb51c19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:52.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.468+0000 7fb520b9b700 1 --2- 172.21.15.8:0/213734105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb51c101300 0x7fb51c19cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:52.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.468+0000 7fb520b9b700 1 -- 172.21.15.8:0/213734105 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb514009c40 con 0x7fb51c100940 2023-08-11T12:40:52.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.468+0000 7fb51bfff700 1 --2- 172.21.15.8:0/213734105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb51c101300 0x7fb51c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:40:52.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.468+0000 7fb520b9b700 1 --2- 172.21.15.8:0/213734105 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb51c100940 0x7fb51c19c820 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb51000e9a0 tx=0x7fb51000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:52.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.469+0000 7fb519ffb700 1 -- 172.21.15.8:0/213734105 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb510009790 con 0x7fb51c100940 2023-08-11T12:40:52.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.469+0000 7fb522dff700 1 -- 172.21.15.8:0/213734105 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5080095f0 con 0x7fb51c100940 2023-08-11T12:40:52.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.469+0000 7fb519ffb700 1 -- 172.21.15.8:0/213734105 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb51000ce80 con 0x7fb51c100940 2023-08-11T12:40:52.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.469+0000 7fb519ffb700 1 -- 172.21.15.8:0/213734105 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb510018680 con 0x7fb51c100940 2023-08-11T12:40:52.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.469+0000 7fb522dff700 1 -- 172.21.15.8:0/213734105 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb51c1a3630 con 0x7fb51c100940 2023-08-11T12:40:52.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.470+0000 7fb522dff700 1 -- 172.21.15.8:0/213734105 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb51c0677a0 con 0x7fb51c100940 2023-08-11T12:40:52.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.472+0000 7fb519ffb700 1 -- 172.21.15.8:0/213734105 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7fb510010430 con 0x7fb51c100940 2023-08-11T12:40:52.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.473+0000 7fb519ffb700 1 --2- 172.21.15.8:0/213734105 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb50c0a00c0 0x7fb50c0a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:52.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.474+0000 7fb519ffb700 1 -- 172.21.15.8:0/213734105 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 9366+0+0 (secure 0 0 0) 0x7fb510014070 con 0x7fb51c100940 2023-08-11T12:40:52.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.474+0000 7fb51bfff700 1 --2- 172.21.15.8:0/213734105 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb50c0a00c0 0x7fb50c0a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:52.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.474+0000 7fb51bfff700 1 --2- 172.21.15.8:0/213734105 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb50c0a00c0 0x7fb50c0a2580 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb51c105d70 tx=0x7fb508005fd0 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:52.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.478+0000 7fb519ffb700 1 -- 172.21.15.8:0/213734105 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fb510095570 con 0x7fb51c100940 2023-08-11T12:40:52.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.691+0000 7fb522dff700 1 -- 172.21.15.8:0/213734105 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb51c1109c0 con 0x7fb51c100940 2023-08-11T12:40:52.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.693+0000 7fb519ffb700 1 -- 172.21.15.8:0/213734105 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+24907 (secure 0 0 0) 0x7fb510098b90 con 0x7fb51c100940 2023-08-11T12:40:52.696 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:40:52.697 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":110,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","created":"2023-08-11T12:14:28.341113+0000","modified":"2023-08-11T12:40:14.988942+0000","last_up_change":"2023-08-11T12:21:14.913735+0000","last_in_change":"2023-08-11T12:20:57.476558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-11T12:17:49.040758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-11T12:22:01.383296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-11T12:22:02.816329+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":27,"snap_epoch":109,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-11T12:22:06.369375+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":27,"snap_epoch":109,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f903e393-7894-42d6-8b11-737ceef1f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6803","nonce":664104961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6805","nonce":664104961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6809","nonce":664104961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6807","nonce":664104961}]},"public_addr":"172.21.15.8:6803/664104961","cluster_addr":"172.21.15.8:6805/664104961","heartbeat_back_addr":"172.21.15.8:6809/664104961","heartbeat_front_addr":"172.21.15.8:6807/664104961","state":["exists","up"]},{"osd":1,"uuid":"1e988e5c-e78c-46d5-80a5-dff7ac38cbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6801","nonce":4187350703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6803","nonce":4187350703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6807","nonce":4187350703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6805","nonce":4187350703}]},"public_addr":"172.21.15.45:6801/4187350703","cluster_addr":"172.21.15.45:6803/4187350703","heartbeat_back_addr":"172.21.15.45:6807/4187350703","heartbeat_front_addr":"172.21.15.45:6805/4187350703","state":["exists","up"]},{"osd":2,"uuid":"1835217c-a93c-4181-b8b8-cc410bab1a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6801","nonce":2547818140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6803","nonce":2547818140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6807","nonce":2547818140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6805","nonce":2547818140}]},"public_addr":"172.21.15.194:6801/2547818140","cluster_addr":"172.21.15.194:6803/2547818140","heartbeat_back_addr":"172.21.15.194:6807/2547818140","heartbeat_front_addr":"172.21.15.194:6805/2547818140","state":["exists","up"]},{"osd":3,"uuid":"b55ae61a-731c-4312-a998-661122b84788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6811","nonce":187418883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6813","nonce":187418883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6817","nonce":187418883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6815","nonce":187418883}]},"public_addr":"172.21.15.8:6811/187418883","cluster_addr":"172.21.15.8:6813/187418883","heartbeat_back_addr":"172.21.15.8:6817/187418883","heartbeat_front_addr":"172.21.15.8:6815/187418883","state":["exists","up"]},{"osd":4,"uuid":"2c28acbb-e807-4559-8aa2-a35ca84b5d43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6809","nonce":3099704571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6811","nonce":3099704571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6815","nonce":3099704571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6813","nonce":3099704571}]},"public_addr":"172.21.15.45:6809/3099704571","cluster_addr":"172.21.15.45:6811/3099704571","heartbeat_back_addr":"172.21.15.45:6815/3099704571","heartbeat_front_addr":"172.21.15.45:6813/3099704571","state":["exists","up"]},{"osd":5,"uuid":"37032289-8016-4730-9b69-f7985e058ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6809","nonce":263803874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6811","nonce":263803874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6815","nonce":263803874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6813","nonce":263803874}]},"public_addr":"172.21.15.194:6809/263803874","cluster_addr":"172.21.15.194:6811/263803874","heartbeat_back_addr":"172.21.15.194:6815/263803874","heartbeat_front_addr":"172.21.15.194:6813/263803874","state":["exists","up"]},{"osd":6,"uuid":"32d2dab9-6944-40d1-ada9-4f941821b063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6819","nonce":1802966829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6821","nonce":1802966829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6825","nonce":1802966829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6823","nonce":1802966829}]},"public_addr":"172.21.15.8:6819/1802966829","cluster_addr":"172.21.15.8:6821/1802966829","heartbeat_back_addr":"172.21.15.8:6825/1802966829","heartbeat_front_addr":"172.21.15.8:6823/1802966829","state":["exists","up"]},{"osd":7,"uuid":"086aff58-1554-49fe-92ff-5166b115aeef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6817","nonce":3715737148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6819","nonce":3715737148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6823","nonce":3715737148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6821","nonce":3715737148}]},"public_addr":"172.21.15.45:6817/3715737148","cluster_addr":"172.21.15.45:6819/3715737148","heartbeat_back_addr":"172.21.15.45:6823/3715737148","heartbeat_front_addr":"172.21.15.45:6821/3715737148","state":["exists","up"]},{"osd":8,"uuid":"7fff5e95-2453-4ea6-a5c1-3bba6a1f6400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6817","nonce":57497127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6819","nonce":57497127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6823","nonce":57497127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6821","nonce":57497127}]},"public_addr":"172.21.15.194:6817/57497127","cluster_addr":"172.21.15.194:6819/57497127","heartbeat_back_addr":"172.21.15.194:6823/57497127","heartbeat_front_addr":"172.21.15.194:6821/57497127","state":["exists","up"]},{"osd":9,"uuid":"31ab0121-4c92-42ec-9f19-e672062e8814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6827","nonce":434661930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6829","nonce":434661930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6833","nonce":434661930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6831","nonce":434661930}]},"public_addr":"172.21.15.8:6827/434661930","cluster_addr":"172.21.15.8:6829/434661930","heartbeat_back_addr":"172.21.15.8:6833/434661930","heartbeat_front_addr":"172.21.15.8:6831/434661930","state":["exists","up"]},{"osd":10,"uuid":"62c632e4-94f6-4630-9d94-8d28fccacf45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6825","nonce":3281212184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6827","nonce":3281212184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6831","nonce":3281212184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6829","nonce":3281212184}]},"public_addr":"172.21.15.45:6825/3281212184","cluster_addr":"172.21.15.45:6827/3281212184","heartbeat_back_addr":"172.21.15.45:6831/3281212184","heartbeat_front_addr":"172.21.15.45:6829/3281212184","state":["exists","up"]},{"osd":11,"uuid":"8ca4a80d-cd75-4230-b46d-aef6fdc03e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6825","nonce":1637875895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6827","nonce":1637875895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6831","nonce":1637875895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6829","nonce":1637875895}]},"public_addr":"172.21.15.194:6825/1637875895","cluster_addr":"172.21.15.194:6827/1637875895","heartbeat_back_addr":"172.21.15.194:6831/1637875895","heartbeat_front_addr":"172.21.15.194:6829/1637875895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:04.255616+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:26.243863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:46.630365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:12.926291+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:35.747049+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:55.793767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:21.685725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:43.703215+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:04.043674+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:30.320026+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:52.751974+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:21:13.230024+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6801/2041276411":"2023-08-12T12:24:35.743200+0000","172.21.15.8:0/3461107704":"2023-08-12T12:24:35.743200+0000","172.21.15.8:0/340114165":"2023-08-12T12:24:35.743200+0000","172.21.15.8:0/2764282698":"2023-08-12T12:24:35.743200+0000","172.21.15.8:0/2000592056":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2102228072":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2132227156":"2023-08-12T12:24:35.743200+0000","172.21.15.8:6800/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:6800/2041276411":"2023-08-12T12:24:35.743200+0000","172.21.15.8:0/2374527928":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2928221278":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2744750874":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/3681755887":"2023-08-12T12:15:02.528403+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":14,"length":1},{"begin":27,"length":1}]},{"pool":4,"snaps":[{"begin":14,"length":1},{"begin":27,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-11T12:40:52.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.696+0000 7fb522dff700 1 -- 172.21.15.8:0/213734105 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb50c0a00c0 msgr2=0x7fb50c0a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:52.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.696+0000 7fb522dff700 1 --2- 172.21.15.8:0/213734105 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb50c0a00c0 0x7fb50c0a2580 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb51c105d70 tx=0x7fb508005fd0 comp rx=0 tx=0).stop 2023-08-11T12:40:52.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.696+0000 7fb522dff700 1 -- 172.21.15.8:0/213734105 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb51c100940 msgr2=0x7fb51c19c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:52.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.696+0000 7fb522dff700 1 --2- 172.21.15.8:0/213734105 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb51c100940 0x7fb51c19c820 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb51000e9a0 tx=0x7fb51000ecb0 comp rx=0 tx=0).stop 2023-08-11T12:40:52.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.696+0000 7fb522dff700 1 -- 172.21.15.8:0/213734105 shutdown_connections 2023-08-11T12:40:52.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.696+0000 7fb522dff700 1 --2- 172.21.15.8:0/213734105 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb50c0a00c0 0x7fb50c0a2580 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:52.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.696+0000 7fb522dff700 1 --2- 172.21.15.8:0/213734105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb51c106950 0x7fb51c196890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:52.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.696+0000 7fb522dff700 1 --2- 172.21.15.8:0/213734105 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb51c100940 0x7fb51c19c820 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:52.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.696+0000 7fb522dff700 1 --2- 172.21.15.8:0/213734105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb51c101300 0x7fb51c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:52.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.696+0000 7fb522dff700 1 -- 172.21.15.8:0/213734105 >> 172.21.15.8:0/213734105 conn(0x7fb51c0fc430 msgr2=0x7fb51c0fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:52.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.696+0000 7fb522dff700 1 -- 172.21.15.8:0/213734105 shutdown_connections 2023-08-11T12:40:52.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.696+0000 7fb522dff700 1 -- 172.21.15.8:0/213734105 wait complete. 2023-08-11T12:40:52.717 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-11T12:17:49.040758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-11T12:22:01.383296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-11T12:22:02.816329+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 27, 'snap_epoch': 109, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-11T12:22:06.369375+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 27, 'snap_epoch': 109, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-11T12:40:52.718 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-11T12:40:52.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.962+0000 7f292b1ff700 1 -- 172.21.15.8:0/2514582324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2924106970 msgr2=0x7f2924106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:52.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.962+0000 7f292b1ff700 1 --2- 172.21.15.8:0/2514582324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2924106970 0x7f2924106d50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f29180098f0 tx=0x7f2918009c00 comp rx=0 tx=0).stop 2023-08-11T12:40:52.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.962+0000 7f292b1ff700 1 -- 172.21.15.8:0/2514582324 shutdown_connections 2023-08-11T12:40:52.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.962+0000 7f292b1ff700 1 --2- 172.21.15.8:0/2514582324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2924101320 0x7f292410d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:52.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.962+0000 7f292b1ff700 1 --2- 172.21.15.8:0/2514582324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2924106970 0x7f2924106d50 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:52.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.962+0000 7f292b1ff700 1 --2- 172.21.15.8:0/2514582324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2924100960 0x7f2924100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:52.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.962+0000 7f292b1ff700 1 -- 172.21.15.8:0/2514582324 >> 172.21.15.8:0/2514582324 conn(0x7f29240fc490 msgr2=0x7f29240fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:52.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.962+0000 7f292b1ff700 1 -- 172.21.15.8:0/2514582324 shutdown_connections 2023-08-11T12:40:52.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.962+0000 7f292b1ff700 1 -- 172.21.15.8:0/2514582324 wait complete. 2023-08-11T12:40:52.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.963+0000 7f292b1ff700 1 Processor -- start 2023-08-11T12:40:52.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.963+0000 7f292b1ff700 1 -- start start 2023-08-11T12:40:52.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.963+0000 7f292b1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2924100960 0x7f2924072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:52.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.963+0000 7f292b1ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2924101320 0x7f2924073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:52.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.964+0000 7f292b1ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2924106970 0x7f29241a4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:52.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.964+0000 7f292b1ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2924073990 con 0x7f2924101320 2023-08-11T12:40:52.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.964+0000 7f292b1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29241a51c0 con 0x7f2924100960 2023-08-11T12:40:52.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.964+0000 7f292b1ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29241a5300 con 0x7f2924106970 2023-08-11T12:40:52.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.964+0000 7f2928f9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2924100960 0x7f2924072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:52.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.964+0000 7f2923fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2924101320 0x7f2924073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:52.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.964+0000 7f2928f9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2924100960 0x7f2924072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:44582/0 (socket says 172.21.15.8:44582) 2023-08-11T12:40:52.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.964+0000 7f2928f9b700 1 -- 172.21.15.8:0/2453527169 learned_addr learned my addr 172.21.15.8:0/2453527169 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:40:52.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.964+0000 7f292979c700 1 --2- 172.21.15.8:0/2453527169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2924106970 0x7f29241a4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:52.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.964+0000 7f2928f9b700 1 -- 172.21.15.8:0/2453527169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2924106970 msgr2=0x7f29241a4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:52.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.964+0000 7f2928f9b700 1 --2- 172.21.15.8:0/2453527169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2924106970 0x7f29241a4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:52.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.964+0000 7f2928f9b700 1 -- 172.21.15.8:0/2453527169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2924101320 msgr2=0x7f2924073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:52.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.964+0000 7f2928f9b700 1 --2- 172.21.15.8:0/2453527169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2924101320 0x7f2924073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:52.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.964+0000 7f2928f9b700 1 -- 172.21.15.8:0/2453527169 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2918009520 con 0x7f2924100960 2023-08-11T12:40:52.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.964+0000 7f2928f9b700 1 --2- 172.21.15.8:0/2453527169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2924100960 0x7f2924072c20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2918009810 tx=0x7f291800fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:52.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.965+0000 7f2921ffb700 1 -- 172.21.15.8:0/2453527169 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291801c070 con 0x7f2924100960 2023-08-11T12:40:52.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.965+0000 7f2921ffb700 1 -- 172.21.15.8:0/2453527169 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f291800bbd0 con 0x7f2924100960 2023-08-11T12:40:52.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.965+0000 7f2921ffb700 1 -- 172.21.15.8:0/2453527169 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2918004930 con 0x7f2924100960 2023-08-11T12:40:52.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.965+0000 7f292b1ff700 1 -- 172.21.15.8:0/2453527169 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29241a5500 con 0x7f2924100960 2023-08-11T12:40:52.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.965+0000 7f292b1ff700 1 -- 172.21.15.8:0/2453527169 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29241a59e0 con 0x7f2924100960 2023-08-11T12:40:52.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.966+0000 7f292b1ff700 1 -- 172.21.15.8:0/2453527169 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29240677a0 con 0x7f2924100960 2023-08-11T12:40:52.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.968+0000 7f2921ffb700 1 -- 172.21.15.8:0/2453527169 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f2918020070 con 0x7f2924100960 2023-08-11T12:40:52.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.969+0000 7f2921ffb700 1 --2- 172.21.15.8:0/2453527169 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f29140a0140 0x7f29140a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:52.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.969+0000 7f2921ffb700 1 -- 172.21.15.8:0/2453527169 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 9366+0+0 (secure 0 0 0) 0x7f29180cc670 con 0x7f2924100960 2023-08-11T12:40:52.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.969+0000 7f2923fff700 1 --2- 172.21.15.8:0/2453527169 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f29140a0140 0x7f29140a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:52.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.970+0000 7f2923fff700 1 --2- 172.21.15.8:0/2453527169 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f29140a0140 0x7f29140a2600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2924074410 tx=0x7f2910009310 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:52.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:52.971+0000 7f2921ffb700 1 -- 172.21.15.8:0/2453527169 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f2918095e30 con 0x7f2924100960 2023-08-11T12:40:53.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.187+0000 7f292b1ff700 1 -- 172.21.15.8:0/2453527169 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f29241108f0 con 0x7f2924100960 2023-08-11T12:40:53.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.187+0000 7f2921ffb700 1 -- 172.21.15.8:0/2453527169 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2918099450 con 0x7f2924100960 2023-08-11T12:40:53.190 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-08-11T12:40:53.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.190+0000 7f292b1ff700 1 -- 172.21.15.8:0/2453527169 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f29140a0140 msgr2=0x7f29140a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:53.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.190+0000 7f292b1ff700 1 --2- 172.21.15.8:0/2453527169 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f29140a0140 0x7f29140a2600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2924074410 tx=0x7f2910009310 comp rx=0 tx=0).stop 2023-08-11T12:40:53.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.190+0000 7f292b1ff700 1 -- 172.21.15.8:0/2453527169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2924100960 msgr2=0x7f2924072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:53.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.190+0000 7f292b1ff700 1 --2- 172.21.15.8:0/2453527169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2924100960 0x7f2924072c20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2918009810 tx=0x7f291800fa00 comp rx=0 tx=0).stop 2023-08-11T12:40:53.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.190+0000 7f292b1ff700 1 -- 172.21.15.8:0/2453527169 shutdown_connections 2023-08-11T12:40:53.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.190+0000 7f292b1ff700 1 --2- 172.21.15.8:0/2453527169 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f29140a0140 0x7f29140a2600 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:53.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.190+0000 7f292b1ff700 1 --2- 172.21.15.8:0/2453527169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2924106970 0x7f29241a4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:53.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.190+0000 7f292b1ff700 1 --2- 172.21.15.8:0/2453527169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2924100960 0x7f2924072c20 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:53.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.190+0000 7f292b1ff700 1 --2- 172.21.15.8:0/2453527169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2924101320 0x7f2924073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:53.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.190+0000 7f292b1ff700 1 -- 172.21.15.8:0/2453527169 >> 172.21.15.8:0/2453527169 conn(0x7f29240fc490 msgr2=0x7f29240fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:53.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.190+0000 7f292b1ff700 1 -- 172.21.15.8:0/2453527169 shutdown_connections 2023-08-11T12:40:53.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.190+0000 7f292b1ff700 1 -- 172.21.15.8:0/2453527169 wait complete. 2023-08-11T12:40:53.211 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-11T12:40:53.302 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:53 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/213734105' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:40:53.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:53 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/213734105' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:40:53.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:53 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/213734105' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:40:53.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.417+0000 7fd75ebff700 1 -- 172.21.15.8:0/3196339779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd758106970 msgr2=0x7fd758106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:53.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.417+0000 7fd75ebff700 1 --2- 172.21.15.8:0/3196339779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd758106970 0x7fd758106d50 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd74c009990 tx=0x7fd74c009ca0 comp rx=0 tx=0).stop 2023-08-11T12:40:53.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.417+0000 7fd75ebff700 1 -- 172.21.15.8:0/3196339779 shutdown_connections 2023-08-11T12:40:53.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.417+0000 7fd75ebff700 1 --2- 172.21.15.8:0/3196339779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd758101320 0x7fd75810d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:53.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.417+0000 7fd75ebff700 1 --2- 172.21.15.8:0/3196339779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd758106970 0x7fd758106d50 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:53.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.417+0000 7fd75ebff700 1 --2- 172.21.15.8:0/3196339779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd758100960 0x7fd758100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:53.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.417+0000 7fd75ebff700 1 -- 172.21.15.8:0/3196339779 >> 172.21.15.8:0/3196339779 conn(0x7fd7580fc490 msgr2=0x7fd7580fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:53.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.417+0000 7fd75ebff700 1 -- 172.21.15.8:0/3196339779 shutdown_connections 2023-08-11T12:40:53.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.417+0000 7fd75ebff700 1 -- 172.21.15.8:0/3196339779 wait complete. 2023-08-11T12:40:53.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.418+0000 7fd75ebff700 1 Processor -- start 2023-08-11T12:40:53.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.418+0000 7fd75ebff700 1 -- start start 2023-08-11T12:40:53.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.419+0000 7fd75ebff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd758100960 0x7fd75819e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:53.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.419+0000 7fd75ebff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd758101320 0x7fd75819eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:53.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.419+0000 7fd75ebff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd758106970 0x7fd758198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:53.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.419+0000 7fd75ebff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd758199080 con 0x7fd758101320 2023-08-11T12:40:53.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.419+0000 7fd75ebff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7581991f0 con 0x7fd758106970 2023-08-11T12:40:53.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.419+0000 7fd75ebff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7581993b0 con 0x7fd758100960 2023-08-11T12:40:53.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.419+0000 7fd757fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd758101320 0x7fd75819eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:53.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.419+0000 7fd75d19c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd758106970 0x7fd758198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:53.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.419+0000 7fd757fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd758101320 0x7fd75819eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41210/0 (socket says 172.21.15.8:41210) 2023-08-11T12:40:53.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.419+0000 7fd757fff700 1 -- 172.21.15.8:0/1926174596 learned_addr learned my addr 172.21.15.8:0/1926174596 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:40:53.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.419+0000 7fd75c99b700 1 --2- 172.21.15.8:0/1926174596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd758100960 0x7fd75819e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:53.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.419+0000 7fd757fff700 1 -- 172.21.15.8:0/1926174596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd758100960 msgr2=0x7fd75819e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:53.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.419+0000 7fd757fff700 1 --2- 172.21.15.8:0/1926174596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd758100960 0x7fd75819e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:53.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.419+0000 7fd757fff700 1 -- 172.21.15.8:0/1926174596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd758106970 msgr2=0x7fd758198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:53.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.419+0000 7fd757fff700 1 --2- 172.21.15.8:0/1926174596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd758106970 0x7fd758198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:53.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.419+0000 7fd757fff700 1 -- 172.21.15.8:0/1926174596 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd750009c40 con 0x7fd758101320 2023-08-11T12:40:53.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.419+0000 7fd75d19c700 1 --2- 172.21.15.8:0/1926174596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd758106970 0x7fd758198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:40:53.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.420+0000 7fd757fff700 1 --2- 172.21.15.8:0/1926174596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd758101320 0x7fd75819eee0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd74400e9a0 tx=0x7fd74400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:53.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.420+0000 7fd755ffb700 1 -- 172.21.15.8:0/1926174596 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd744009790 con 0x7fd758101320 2023-08-11T12:40:53.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.420+0000 7fd755ffb700 1 -- 172.21.15.8:0/1926174596 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd74400ce80 con 0x7fd758101320 2023-08-11T12:40:53.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.420+0000 7fd755ffb700 1 -- 172.21.15.8:0/1926174596 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd744018680 con 0x7fd758101320 2023-08-11T12:40:53.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.420+0000 7fd75ebff700 1 -- 172.21.15.8:0/1926174596 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd74c0095f0 con 0x7fd758101320 2023-08-11T12:40:53.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.420+0000 7fd75ebff700 1 -- 172.21.15.8:0/1926174596 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7581a57b0 con 0x7fd758101320 2023-08-11T12:40:53.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.421+0000 7fd75ebff700 1 -- 172.21.15.8:0/1926174596 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7580677a0 con 0x7fd758101320 2023-08-11T12:40:53.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.423+0000 7fd755ffb700 1 -- 172.21.15.8:0/1926174596 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7fd744010430 con 0x7fd758101320 2023-08-11T12:40:53.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.424+0000 7fd755ffb700 1 --2- 172.21.15.8:0/1926174596 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fd7480a0140 0x7fd7480a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:53.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.425+0000 7fd755ffb700 1 -- 172.21.15.8:0/1926174596 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 9366+0+0 (secure 0 0 0) 0x7fd744014070 con 0x7fd758101320 2023-08-11T12:40:53.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.425+0000 7fd75c99b700 1 --2- 172.21.15.8:0/1926174596 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fd7480a0140 0x7fd7480a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:53.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.425+0000 7fd75c99b700 1 --2- 172.21.15.8:0/1926174596 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fd7480a0140 0x7fd7480a2600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd74c00b2e0 tx=0x7fd74c005960 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:53.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.429+0000 7fd755ffb700 1 -- 172.21.15.8:0/1926174596 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fd7440951e0 con 0x7fd758101320 2023-08-11T12:40:53.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.640+0000 7fd75ebff700 1 -- 172.21.15.8:0/1926174596 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd7581109e0 con 0x7fd758101320 2023-08-11T12:40:53.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.640+0000 7fd755ffb700 1 -- 172.21.15.8:0/1926174596 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v110) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd744098800 con 0x7fd758101320 2023-08-11T12:40:53.643 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-08-11T12:40:53.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.643+0000 7fd75ebff700 1 -- 172.21.15.8:0/1926174596 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fd7480a0140 msgr2=0x7fd7480a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:53.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.643+0000 7fd75ebff700 1 --2- 172.21.15.8:0/1926174596 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fd7480a0140 0x7fd7480a2600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd74c00b2e0 tx=0x7fd74c005960 comp rx=0 tx=0).stop 2023-08-11T12:40:53.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.643+0000 7fd75ebff700 1 -- 172.21.15.8:0/1926174596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd758101320 msgr2=0x7fd75819eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:53.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.643+0000 7fd75ebff700 1 --2- 172.21.15.8:0/1926174596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd758101320 0x7fd75819eee0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd74400e9a0 tx=0x7fd74400ecb0 comp rx=0 tx=0).stop 2023-08-11T12:40:53.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.643+0000 7fd75ebff700 1 -- 172.21.15.8:0/1926174596 shutdown_connections 2023-08-11T12:40:53.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.643+0000 7fd75ebff700 1 --2- 172.21.15.8:0/1926174596 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fd7480a0140 0x7fd7480a2600 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:53.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.643+0000 7fd75ebff700 1 --2- 172.21.15.8:0/1926174596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd758100960 0x7fd75819e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:53.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.643+0000 7fd75ebff700 1 --2- 172.21.15.8:0/1926174596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd758106970 0x7fd758198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:53.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.643+0000 7fd75ebff700 1 --2- 172.21.15.8:0/1926174596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd758101320 0x7fd75819eee0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:53.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.643+0000 7fd75ebff700 1 -- 172.21.15.8:0/1926174596 >> 172.21.15.8:0/1926174596 conn(0x7fd7580fc490 msgr2=0x7fd75810bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:53.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.643+0000 7fd75ebff700 1 -- 172.21.15.8:0/1926174596 shutdown_connections 2023-08-11T12:40:53.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.643+0000 7fd75ebff700 1 -- 172.21.15.8:0/1926174596 wait complete. 2023-08-11T12:40:53.664 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-11T12:40:53.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.870+0000 7f07fffff700 1 -- 172.21.15.8:0/433740701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07f8101320 msgr2=0x7f07f810d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:53.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.870+0000 7f07fffff700 1 --2- 172.21.15.8:0/433740701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07f8101320 0x7f07f810d830 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f07f0009f90 tx=0x7f07f000b330 comp rx=0 tx=0).stop 2023-08-11T12:40:53.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.871+0000 7f07fffff700 1 -- 172.21.15.8:0/433740701 shutdown_connections 2023-08-11T12:40:53.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.871+0000 7f07fffff700 1 --2- 172.21.15.8:0/433740701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07f8101320 0x7f07f810d830 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:53.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.871+0000 7f07fffff700 1 --2- 172.21.15.8:0/433740701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07f8106970 0x7f07f8106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:53.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.871+0000 7f07fffff700 1 --2- 172.21.15.8:0/433740701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07f8100960 0x7f07f8100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:53.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.871+0000 7f07fffff700 1 -- 172.21.15.8:0/433740701 >> 172.21.15.8:0/433740701 conn(0x7f07f80fc490 msgr2=0x7f07f80fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:53.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.871+0000 7f07fffff700 1 -- 172.21.15.8:0/433740701 shutdown_connections 2023-08-11T12:40:53.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.871+0000 7f07fffff700 1 -- 172.21.15.8:0/433740701 wait complete. 2023-08-11T12:40:53.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.872+0000 7f07fffff700 1 Processor -- start 2023-08-11T12:40:53.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.872+0000 7f07fffff700 1 -- start start 2023-08-11T12:40:53.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.872+0000 7f07fffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07f8100960 0x7f07f819e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:53.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.872+0000 7f07fffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07f8101320 0x7f07f819eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:53.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.872+0000 7f07fffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07f8106970 0x7f07f81989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:53.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.872+0000 7f07fffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f8199060 con 0x7f07f8101320 2023-08-11T12:40:53.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.872+0000 7f07fffff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f81991d0 con 0x7f07f8106970 2023-08-11T12:40:53.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.872+0000 7f07fffff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f8199390 con 0x7f07f8100960 2023-08-11T12:40:53.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.872+0000 7f07fd59a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07f8101320 0x7f07f819eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:53.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.873+0000 7f07fdd9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07f8100960 0x7f07f819e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:53.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.873+0000 7f07fe59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07f8106970 0x7f07f81989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:53.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.873+0000 7f07fd59a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07f8101320 0x7f07f819eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41242/0 (socket says 172.21.15.8:41242) 2023-08-11T12:40:53.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.873+0000 7f07fd59a700 1 -- 172.21.15.8:0/1753519253 learned_addr learned my addr 172.21.15.8:0/1753519253 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:40:53.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.873+0000 7f07fd59a700 1 -- 172.21.15.8:0/1753519253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07f8100960 msgr2=0x7f07f819e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:53.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.873+0000 7f07fd59a700 1 --2- 172.21.15.8:0/1753519253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07f8100960 0x7f07f819e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:53.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.873+0000 7f07fd59a700 1 -- 172.21.15.8:0/1753519253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07f8106970 msgr2=0x7f07f81989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:53.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.873+0000 7f07fd59a700 1 --2- 172.21.15.8:0/1753519253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07f8106970 0x7f07f81989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:53.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.873+0000 7f07fd59a700 1 -- 172.21.15.8:0/1753519253 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f40095f0 con 0x7f07f8101320 2023-08-11T12:40:53.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.873+0000 7f07fdd9b700 1 --2- 172.21.15.8:0/1753519253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07f8100960 0x7f07f819e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:40:53.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.873+0000 7f07fd59a700 1 --2- 172.21.15.8:0/1753519253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07f8101320 0x7f07f819eec0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f07e800e9a0 tx=0x7f07e800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:53.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.873+0000 7f07eeffd700 1 -- 172.21.15.8:0/1753519253 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e8009790 con 0x7f07f8101320 2023-08-11T12:40:53.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.873+0000 7f07fffff700 1 -- 172.21.15.8:0/1753519253 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f0009c40 con 0x7f07f8101320 2023-08-11T12:40:53.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.873+0000 7f07eeffd700 1 -- 172.21.15.8:0/1753519253 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f07e8010430 con 0x7f07f8101320 2023-08-11T12:40:53.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.873+0000 7f07eeffd700 1 -- 172.21.15.8:0/1753519253 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e8018680 con 0x7f07f8101320 2023-08-11T12:40:53.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.874+0000 7f07fffff700 1 -- 172.21.15.8:0/1753519253 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f81a5790 con 0x7f07f8101320 2023-08-11T12:40:53.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.875+0000 7f07fffff700 1 -- 172.21.15.8:0/1753519253 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f80677a0 con 0x7f07f8101320 2023-08-11T12:40:53.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.876+0000 7f07eeffd700 1 -- 172.21.15.8:0/1753519253 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f07e80105a0 con 0x7f07f8101320 2023-08-11T12:40:53.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.878+0000 7f07eeffd700 1 --2- 172.21.15.8:0/1753519253 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f07e40a00c0 0x7f07e40a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:53.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.878+0000 7f07eeffd700 1 -- 172.21.15.8:0/1753519253 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 9366+0+0 (secure 0 0 0) 0x7f07e8014070 con 0x7f07f8101320 2023-08-11T12:40:53.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.878+0000 7f07fdd9b700 1 --2- 172.21.15.8:0/1753519253 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f07e40a00c0 0x7f07e40a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:53.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.879+0000 7f07fdd9b700 1 --2- 172.21.15.8:0/1753519253 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f07e40a00c0 0x7f07e40a2580 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f07f4005fd0 tx=0x7f07f4009310 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:53.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:53.882+0000 7f07eeffd700 1 -- 172.21.15.8:0/1753519253 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f07e8051c30 con 0x7f07f8101320 2023-08-11T12:40:54.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.093+0000 7f07fffff700 1 -- 172.21.15.8:0/1753519253 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f07f8110a10 con 0x7f07f8101320 2023-08-11T12:40:54.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.093+0000 7f07eeffd700 1 -- 172.21.15.8:0/1753519253 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v110) v1 ==== 100+0+11 (secure 0 0 0) 0x7f07e8095260 con 0x7f07f8101320 2023-08-11T12:40:54.096 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-08-11T12:40:54.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.095+0000 7f07fffff700 1 -- 172.21.15.8:0/1753519253 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f07e40a00c0 msgr2=0x7f07e40a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:54.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.095+0000 7f07fffff700 1 --2- 172.21.15.8:0/1753519253 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f07e40a00c0 0x7f07e40a2580 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f07f4005fd0 tx=0x7f07f4009310 comp rx=0 tx=0).stop 2023-08-11T12:40:54.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.095+0000 7f07fffff700 1 -- 172.21.15.8:0/1753519253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07f8101320 msgr2=0x7f07f819eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:54.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.095+0000 7f07fffff700 1 --2- 172.21.15.8:0/1753519253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07f8101320 0x7f07f819eec0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f07e800e9a0 tx=0x7f07e800ecb0 comp rx=0 tx=0).stop 2023-08-11T12:40:54.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.095+0000 7f07fffff700 1 -- 172.21.15.8:0/1753519253 shutdown_connections 2023-08-11T12:40:54.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.095+0000 7f07fffff700 1 --2- 172.21.15.8:0/1753519253 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f07e40a00c0 0x7f07e40a2580 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:54.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.096+0000 7f07fffff700 1 --2- 172.21.15.8:0/1753519253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07f8100960 0x7f07f819e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:54.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.096+0000 7f07fffff700 1 --2- 172.21.15.8:0/1753519253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07f8106970 0x7f07f81989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:54.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.096+0000 7f07fffff700 1 --2- 172.21.15.8:0/1753519253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07f8101320 0x7f07f819eec0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:54.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.096+0000 7f07fffff700 1 -- 172.21.15.8:0/1753519253 >> 172.21.15.8:0/1753519253 conn(0x7f07f80fc490 msgr2=0x7f07f810beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:54.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.096+0000 7f07fffff700 1 -- 172.21.15.8:0/1753519253 shutdown_connections 2023-08-11T12:40:54.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.096+0000 7f07fffff700 1 -- 172.21.15.8:0/1753519253 wait complete. 2023-08-11T12:40:54.117 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-11T12:40:54.302 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:54 smithi008 ceph-mon[97158]: pgmap v511: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:40:54.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:54 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2453527169' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:40:54.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:54 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1926174596' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:40:54.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.324+0000 7f0b9c7ff700 1 -- 172.21.15.8:0/814696470 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b94106970 msgr2=0x7f0b94106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:54.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.324+0000 7f0b9c7ff700 1 --2- 172.21.15.8:0/814696470 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b94106970 0x7f0b94106d50 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0b90009990 tx=0x7f0b90009ca0 comp rx=0 tx=0).stop 2023-08-11T12:40:54.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.324+0000 7f0b9c7ff700 1 -- 172.21.15.8:0/814696470 shutdown_connections 2023-08-11T12:40:54.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.324+0000 7f0b9c7ff700 1 --2- 172.21.15.8:0/814696470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b94101320 0x7f0b9410d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:54.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.324+0000 7f0b9c7ff700 1 --2- 172.21.15.8:0/814696470 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b94106970 0x7f0b94106d50 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:54.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.324+0000 7f0b9c7ff700 1 --2- 172.21.15.8:0/814696470 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b94100960 0x7f0b94100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:54.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.324+0000 7f0b9c7ff700 1 -- 172.21.15.8:0/814696470 >> 172.21.15.8:0/814696470 conn(0x7f0b940fc490 msgr2=0x7f0b940fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:54.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.324+0000 7f0b9c7ff700 1 -- 172.21.15.8:0/814696470 shutdown_connections 2023-08-11T12:40:54.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.324+0000 7f0b9c7ff700 1 -- 172.21.15.8:0/814696470 wait complete. 2023-08-11T12:40:54.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.325+0000 7f0b9c7ff700 1 Processor -- start 2023-08-11T12:40:54.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.325+0000 7f0b9c7ff700 1 -- start start 2023-08-11T12:40:54.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.326+0000 7f0b9c7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b94100960 0x7f0b94072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:54.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.326+0000 7f0b9c7ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b94101320 0x7f0b94073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:54.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.326+0000 7f0b9c7ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b94106970 0x7f0b941a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:54.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.326+0000 7f0b9c7ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b94073990 con 0x7f0b94106970 2023-08-11T12:40:54.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.326+0000 7f0b9c7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b941a5180 con 0x7f0b94100960 2023-08-11T12:40:54.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.326+0000 7f0b9c7ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b941a52c0 con 0x7f0b94101320 2023-08-11T12:40:54.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.326+0000 7f0b9a59b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b94100960 0x7f0b94072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:54.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.326+0000 7f0b9a59b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b94100960 0x7f0b94072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:44612/0 (socket says 172.21.15.8:44612) 2023-08-11T12:40:54.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.326+0000 7f0b9a59b700 1 -- 172.21.15.8:0/4187380299 learned_addr learned my addr 172.21.15.8:0/4187380299 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:40:54.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.326+0000 7f0b9ad9c700 1 --2- 172.21.15.8:0/4187380299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b94106970 0x7f0b941a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:54.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.326+0000 7f0b99d9a700 1 --2- 172.21.15.8:0/4187380299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b94101320 0x7f0b94073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:54.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.326+0000 7f0b9a59b700 1 -- 172.21.15.8:0/4187380299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b94101320 msgr2=0x7f0b94073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:54.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.326+0000 7f0b9a59b700 1 --2- 172.21.15.8:0/4187380299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b94101320 0x7f0b94073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:54.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.326+0000 7f0b9a59b700 1 -- 172.21.15.8:0/4187380299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b94106970 msgr2=0x7f0b941a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:54.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.326+0000 7f0b9a59b700 1 --2- 172.21.15.8:0/4187380299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b94106970 0x7f0b941a4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:54.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.326+0000 7f0b9a59b700 1 -- 172.21.15.8:0/4187380299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8c009c40 con 0x7f0b94100960 2023-08-11T12:40:54.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.326+0000 7f0b9ad9c700 1 --2- 172.21.15.8:0/4187380299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b94106970 0x7f0b941a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:40:54.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.327+0000 7f0b9a59b700 1 --2- 172.21.15.8:0/4187380299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b94100960 0x7f0b94072c20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0b90005910 tx=0x7f0b90005720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:54.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.327+0000 7f0b8b7fe700 1 -- 172.21.15.8:0/4187380299 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9001d070 con 0x7f0b94100960 2023-08-11T12:40:54.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.327+0000 7f0b9c7ff700 1 -- 172.21.15.8:0/4187380299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b900095f0 con 0x7f0b94100960 2023-08-11T12:40:54.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.327+0000 7f0b8b7fe700 1 -- 172.21.15.8:0/4187380299 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b90022470 con 0x7f0b94100960 2023-08-11T12:40:54.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.327+0000 7f0b8b7fe700 1 -- 172.21.15.8:0/4187380299 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b90017650 con 0x7f0b94100960 2023-08-11T12:40:54.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.327+0000 7f0b9c7ff700 1 -- 172.21.15.8:0/4187380299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b941a5860 con 0x7f0b94100960 2023-08-11T12:40:54.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.328+0000 7f0b9c7ff700 1 -- 172.21.15.8:0/4187380299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b940677a0 con 0x7f0b94100960 2023-08-11T12:40:54.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.330+0000 7f0b8b7fe700 1 -- 172.21.15.8:0/4187380299 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f0b900225e0 con 0x7f0b94100960 2023-08-11T12:40:54.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.331+0000 7f0b8b7fe700 1 --2- 172.21.15.8:0/4187380299 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f0b800a00c0 0x7f0b800a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:54.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.331+0000 7f0b8b7fe700 1 -- 172.21.15.8:0/4187380299 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 9366+0+0 (secure 0 0 0) 0x7f0b900cd3e0 con 0x7f0b94100960 2023-08-11T12:40:54.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.332+0000 7f0b99d9a700 1 --2- 172.21.15.8:0/4187380299 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f0b800a00c0 0x7f0b800a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:54.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.332+0000 7f0b99d9a700 1 --2- 172.21.15.8:0/4187380299 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f0b800a00c0 0x7f0b800a2580 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0b94074410 tx=0x7f0b84009260 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:54.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.333+0000 7f0b8b7fe700 1 -- 172.21.15.8:0/4187380299 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f0b90096b10 con 0x7f0b94100960 2023-08-11T12:40:54.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:54 smithi194 ceph-mon[130905]: pgmap v511: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:40:54.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:54 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2453527169' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:40:54.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:54 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1926174596' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:40:54.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:54 smithi045 ceph-mon[130284]: pgmap v511: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-11T12:40:54.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:54 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2453527169' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-11T12:40:54.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:54 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1926174596' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-11T12:40:54.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.544+0000 7f0b9c7ff700 1 -- 172.21.15.8:0/4187380299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0b94074150 con 0x7f0b94100960 2023-08-11T12:40:54.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.545+0000 7f0b8b7fe700 1 -- 172.21.15.8:0/4187380299 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v110) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0b9009a130 con 0x7f0b94100960 2023-08-11T12:40:54.548 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-08-11T12:40:54.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.547+0000 7f0b9c7ff700 1 -- 172.21.15.8:0/4187380299 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f0b800a00c0 msgr2=0x7f0b800a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:54.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.547+0000 7f0b9c7ff700 1 --2- 172.21.15.8:0/4187380299 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f0b800a00c0 0x7f0b800a2580 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0b94074410 tx=0x7f0b84009260 comp rx=0 tx=0).stop 2023-08-11T12:40:54.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.547+0000 7f0b9c7ff700 1 -- 172.21.15.8:0/4187380299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b94100960 msgr2=0x7f0b94072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:54.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.547+0000 7f0b9c7ff700 1 --2- 172.21.15.8:0/4187380299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b94100960 0x7f0b94072c20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0b90005910 tx=0x7f0b90005720 comp rx=0 tx=0).stop 2023-08-11T12:40:54.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.547+0000 7f0b9c7ff700 1 -- 172.21.15.8:0/4187380299 shutdown_connections 2023-08-11T12:40:54.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.547+0000 7f0b9c7ff700 1 --2- 172.21.15.8:0/4187380299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b94106970 0x7f0b941a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:54.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.547+0000 7f0b9c7ff700 1 --2- 172.21.15.8:0/4187380299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b94100960 0x7f0b94072c20 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:54.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.547+0000 7f0b9c7ff700 1 --2- 172.21.15.8:0/4187380299 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f0b800a00c0 0x7f0b800a2580 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:54.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.547+0000 7f0b9c7ff700 1 --2- 172.21.15.8:0/4187380299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b94101320 0x7f0b94073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:54.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.547+0000 7f0b9c7ff700 1 -- 172.21.15.8:0/4187380299 >> 172.21.15.8:0/4187380299 conn(0x7f0b940fc490 msgr2=0x7f0b94104470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:54.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.547+0000 7f0b9c7ff700 1 -- 172.21.15.8:0/4187380299 shutdown_connections 2023-08-11T12:40:54.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.547+0000 7f0b9c7ff700 1 -- 172.21.15.8:0/4187380299 wait complete. 2023-08-11T12:40:54.569 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-11T12:40:54.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.773+0000 7f20cd1ff700 1 -- 172.21.15.8:0/3315829414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20c8106970 msgr2=0x7f20c8106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:54.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.773+0000 7f20cd1ff700 1 --2- 172.21.15.8:0/3315829414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20c8106970 0x7f20c8106d50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f20b8009990 tx=0x7f20b8009ca0 comp rx=0 tx=0).stop 2023-08-11T12:40:54.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.774+0000 7f20cd1ff700 1 -- 172.21.15.8:0/3315829414 shutdown_connections 2023-08-11T12:40:54.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.774+0000 7f20cd1ff700 1 --2- 172.21.15.8:0/3315829414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20c8101320 0x7f20c810d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:54.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.774+0000 7f20cd1ff700 1 --2- 172.21.15.8:0/3315829414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20c8106970 0x7f20c8106d50 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:54.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.774+0000 7f20cd1ff700 1 --2- 172.21.15.8:0/3315829414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20c8100960 0x7f20c8100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:54.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.774+0000 7f20cd1ff700 1 -- 172.21.15.8:0/3315829414 >> 172.21.15.8:0/3315829414 conn(0x7f20c80fc490 msgr2=0x7f20c80fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:54.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.774+0000 7f20cd1ff700 1 -- 172.21.15.8:0/3315829414 shutdown_connections 2023-08-11T12:40:54.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.774+0000 7f20cd1ff700 1 -- 172.21.15.8:0/3315829414 wait complete. 2023-08-11T12:40:54.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.775+0000 7f20cd1ff700 1 Processor -- start 2023-08-11T12:40:54.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.775+0000 7f20cd1ff700 1 -- start start 2023-08-11T12:40:54.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.775+0000 7f20cd1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20c8100960 0x7f20c8072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:54.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.775+0000 7f20cd1ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20c8101320 0x7f20c8073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:54.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.775+0000 7f20cd1ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20c8106970 0x7f20c81a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:54.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.775+0000 7f20cd1ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c8073990 con 0x7f20c8101320 2023-08-11T12:40:54.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.775+0000 7f20cd1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c81a5170 con 0x7f20c8100960 2023-08-11T12:40:54.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.775+0000 7f20cd1ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c81a52b0 con 0x7f20c8106970 2023-08-11T12:40:54.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.775+0000 7f20c6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20c8100960 0x7f20c8072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:54.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.775+0000 7f20c6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20c8100960 0x7f20c8072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:44620/0 (socket says 172.21.15.8:44620) 2023-08-11T12:40:54.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.775+0000 7f20c6d9d700 1 -- 172.21.15.8:0/901945203 learned_addr learned my addr 172.21.15.8:0/901945203 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:40:54.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.775+0000 7f20c659c700 1 --2- 172.21.15.8:0/901945203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20c8101320 0x7f20c8073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:54.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.776+0000 7f20c759e700 1 --2- 172.21.15.8:0/901945203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20c8106970 0x7f20c81a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:54.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.776+0000 7f20c6d9d700 1 -- 172.21.15.8:0/901945203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20c8106970 msgr2=0x7f20c81a4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:54.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.776+0000 7f20c6d9d700 1 --2- 172.21.15.8:0/901945203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20c8106970 0x7f20c81a4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:54.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.776+0000 7f20c6d9d700 1 -- 172.21.15.8:0/901945203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20c8101320 msgr2=0x7f20c8073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:54.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.776+0000 7f20c6d9d700 1 --2- 172.21.15.8:0/901945203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20c8101320 0x7f20c8073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:54.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.776+0000 7f20c6d9d700 1 -- 172.21.15.8:0/901945203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c0009c40 con 0x7f20c8100960 2023-08-11T12:40:54.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.776+0000 7f20c659c700 1 --2- 172.21.15.8:0/901945203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20c8101320 0x7f20c8073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:40:54.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.776+0000 7f20c6d9d700 1 --2- 172.21.15.8:0/901945203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20c8100960 0x7f20c8072c20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f20b8005910 tx=0x7f20b8005720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:54.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.776+0000 7f20affff700 1 -- 172.21.15.8:0/901945203 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b801d070 con 0x7f20c8100960 2023-08-11T12:40:54.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.776+0000 7f20cd1ff700 1 -- 172.21.15.8:0/901945203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b80095f0 con 0x7f20c8100960 2023-08-11T12:40:54.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.776+0000 7f20affff700 1 -- 172.21.15.8:0/901945203 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f20b8022470 con 0x7f20c8100960 2023-08-11T12:40:54.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.776+0000 7f20affff700 1 -- 172.21.15.8:0/901945203 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b8017650 con 0x7f20c8100960 2023-08-11T12:40:54.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.776+0000 7f20cd1ff700 1 -- 172.21.15.8:0/901945203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c81a5850 con 0x7f20c8100960 2023-08-11T12:40:54.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.777+0000 7f20cd1ff700 1 -- 172.21.15.8:0/901945203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20c80677a0 con 0x7f20c8100960 2023-08-11T12:40:54.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.780+0000 7f20affff700 1 -- 172.21.15.8:0/901945203 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f20b80225e0 con 0x7f20c8100960 2023-08-11T12:40:54.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.781+0000 7f20affff700 1 --2- 172.21.15.8:0/901945203 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f20b00a00c0 0x7f20b00a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:54.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.781+0000 7f20affff700 1 -- 172.21.15.8:0/901945203 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 9366+0+0 (secure 0 0 0) 0x7f20b80cd3e0 con 0x7f20c8100960 2023-08-11T12:40:54.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.781+0000 7f20c659c700 1 --2- 172.21.15.8:0/901945203 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f20b00a00c0 0x7f20b00a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:54.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.782+0000 7f20c659c700 1 --2- 172.21.15.8:0/901945203 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f20b00a00c0 0x7f20b00a2580 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f20c8074410 tx=0x7f20bc009260 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:54.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:54.783+0000 7f20affff700 1 -- 172.21.15.8:0/901945203 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f20b8096b10 con 0x7f20c8100960 2023-08-11T12:40:55.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:55.010+0000 7f20cd1ff700 1 -- 172.21.15.8:0/901945203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f20c8074150 con 0x7f20c8100960 2023-08-11T12:40:55.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:55.011+0000 7f20affff700 1 -- 172.21.15.8:0/901945203 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v110) v1 ==== 81+0+929 (secure 0 0 0) 0x7f20b809a130 con 0x7f20c8100960 2023-08-11T12:40:55.014 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6801/2041276411 2023-08-12T12:24:35.743200+0000 2023-08-11T12:40:55.015 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/3461107704 2023-08-12T12:24:35.743200+0000 2023-08-11T12:40:55.015 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/340114165 2023-08-12T12:24:35.743200+0000 2023-08-11T12:40:55.015 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2764282698 2023-08-12T12:24:35.743200+0000 2023-08-11T12:40:55.016 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2000592056 2023-08-12T12:15:30.423754+0000 2023-08-11T12:40:55.016 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2102228072 2023-08-12T12:15:30.423754+0000 2023-08-11T12:40:55.016 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6801/2832004641 2023-08-12T12:15:30.423754+0000 2023-08-11T12:40:55.017 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6800/2832004641 2023-08-12T12:15:30.423754+0000 2023-08-11T12:40:55.017 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2132227156 2023-08-12T12:24:35.743200+0000 2023-08-11T12:40:55.017 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6800/2108474030 2023-08-12T12:15:02.528403+0000 2023-08-11T12:40:55.018 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6800/2041276411 2023-08-12T12:24:35.743200+0000 2023-08-11T12:40:55.018 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2374527928 2023-08-12T12:15:02.528403+0000 2023-08-11T12:40:55.019 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2928221278 2023-08-12T12:15:02.528403+0000 2023-08-11T12:40:55.019 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2744750874 2023-08-12T12:15:30.423754+0000 2023-08-11T12:40:55.019 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6801/2108474030 2023-08-12T12:15:02.528403+0000 2023-08-11T12:40:55.020 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/3681755887 2023-08-12T12:15:02.528403+0000 2023-08-11T12:40:55.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:55.013+0000 7f20cd1ff700 1 -- 172.21.15.8:0/901945203 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f20b00a00c0 msgr2=0x7f20b00a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:55.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:55.013+0000 7f20cd1ff700 1 --2- 172.21.15.8:0/901945203 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f20b00a00c0 0x7f20b00a2580 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f20c8074410 tx=0x7f20bc009260 comp rx=0 tx=0).stop 2023-08-11T12:40:55.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:55.013+0000 7f20cd1ff700 1 -- 172.21.15.8:0/901945203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20c8100960 msgr2=0x7f20c8072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:55.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:55.013+0000 7f20cd1ff700 1 --2- 172.21.15.8:0/901945203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20c8100960 0x7f20c8072c20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f20b8005910 tx=0x7f20b8005720 comp rx=0 tx=0).stop 2023-08-11T12:40:55.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:55.013+0000 7f20cd1ff700 1 -- 172.21.15.8:0/901945203 shutdown_connections 2023-08-11T12:40:55.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:55.013+0000 7f20cd1ff700 1 --2- 172.21.15.8:0/901945203 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f20b00a00c0 0x7f20b00a2580 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:55.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:55.013+0000 7f20cd1ff700 1 --2- 172.21.15.8:0/901945203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20c8106970 0x7f20c81a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:55.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:55.013+0000 7f20cd1ff700 1 --2- 172.21.15.8:0/901945203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20c8100960 0x7f20c8072c20 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:55.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:55.013+0000 7f20cd1ff700 1 --2- 172.21.15.8:0/901945203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20c8101320 0x7f20c8073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:55.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:55.013+0000 7f20cd1ff700 1 -- 172.21.15.8:0/901945203 >> 172.21.15.8:0/901945203 conn(0x7f20c80fc490 msgr2=0x7f20c80fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:55.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:55.013+0000 7f20cd1ff700 1 -- 172.21.15.8:0/901945203 shutdown_connections 2023-08-11T12:40:55.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:55.014+0000 7f20cd1ff700 1 -- 172.21.15.8:0/901945203 wait complete. 2023-08-11T12:40:55.025 INFO:teuthology.orchestra.run.smithi008.stderr:listed 16 entries 2023-08-11T12:40:55.035 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-11T12:40:55.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:40:55.036 DEBUG:teuthology.orchestra.run.smithi008:> sudo umount /tmp/cephfs 2023-08-11T12:40:55.185 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi008.front.sepia.ceph.com 2023-08-11T12:40:55.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:40:55.186 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2023-08-11T12:40:55.311 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:55 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1753519253' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:40:55.311 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:55 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/4187380299' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:40:55.311 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:55 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/901945203' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-08-11T12:40:55.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:40:55.342 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-08-11T12:40:55.388 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-ns--tmp-cephfs (id: 0) 2023-08-11T12:40:55.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:40:55.390 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns delete ceph-ns--tmp-cephfs 2023-08-11T12:40:55.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:55 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1753519253' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:40:55.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:55 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/4187380299' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:40:55.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:55 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/901945203' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-08-11T12:40:55.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:55 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1753519253' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-11T12:40:55.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:55 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/4187380299' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-11T12:40:55.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:55 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/901945203' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-08-11T12:40:55.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:40:55.503 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link delete ceph-brx 2023-08-11T12:40:55.612 INFO:tasks.kclient:Unmounting kernel clients... 2023-08-11T12:40:55.613 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-11T12:40:55.613 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-11T12:40:55.661 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348696k,nr_inodes=4087174,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=39,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/0ec044cbb737235bb043e91df1485fa751eb1873e3edc68ebf5ee46a23102518/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/GBMFCIYQWZFPSSIGKAURULIOK6:/var/lib/containers/storage/overlay/l/3NYAS23JPXCBCY6CC256KKHZGJ,upperdir=/var/lib/containers/storage/overlay/0ec044cbb737235bb043e91df1485fa751eb1873e3edc68ebf5ee46a23102518/diff,workdir=/var/lib/containers/storage/overlay/0ec044cbb737235bb043e91df1485fa751eb1873e3edc68ebf5ee46a23102518/work,redirect_dir=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/87fc406cbcc46f4d8291617422885a266be515e1a7093226db33f2fb583d8268/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/GBMFCIYQWZFPSSIGKAURULIOK6:/var/lib/containers/storage/overlay/l/3NYAS23JPXCBCY6CC256KKHZGJ,upperdir=/var/lib/containers/storage/overlay/87fc406cbcc46f4d8291617422885a266be515e1a7093226db33f2fb583d8268/diff,workdir=/var/lib/containers/storage/overlay/87fc406cbcc46f4d8291617422885a266be515e1a7093226db33f2fb583d8268/work,redirect_dir=on,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,relatime 0 0 overlay /var/lib/containers/storage/overlay/85a6cd2332ac98eef9b7328a4b6cdf44102943ac1eb3ae7869a165157355b6e2/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/GBMFCIYQWZFPSSIGKAURULIOK6:/var/lib/containers/storage/overlay/l/3NYAS23JPXCBCY6CC256KKHZGJ,upperdir=/var/lib/containers/storage/overlay/85a6cd2332ac98eef9b7328a4b6cdf44102943ac1eb3ae7869a165157355b6e2/diff,workdir=/var/lib/containers/storage/overlay/85a6cd2332ac98eef9b7328a4b6cdf44102943ac1eb3ae7869a165157355b6e2/work,redirect_dir=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/51a9867555f14b4399d418b5e13c5e142e437ce415e4f6812eb7e77a39cef141/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/GBMFCIYQWZFPSSIGKAURULIOK6:/var/lib/containers/storage/overlay/l/3NYAS23JPXCBCY6CC256KKHZGJ,upperdir=/var/lib/containers/storage/overlay/51a9867555f14b4399d418b5e13c5e142e437ce415e4f6812eb7e77a39cef141/diff,workdir=/var/lib/containers/storage/overlay/51a9867555f14b4399d418b5e13c5e142e437ce415e4f6812eb7e77a39cef141/work,redirect_dir=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/6a5308a425ba121812fc1696af78b29c6e930089e04e03b47a7be10c8d050e60/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/GBMFCIYQWZFPSSIGKAURULIOK6:/var/lib/containers/storage/overlay/l/3NYAS23JPXCBCY6CC256KKHZGJ,upperdir=/var/lib/containers/storage/overlay/6a5308a425ba121812fc1696af78b29c6e930089e04e03b47a7be10c8d050e60/diff,workdir=/var/lib/containers/storage/overlay/6a5308a425ba121812fc1696af78b29c6e930089e04e03b47a7be10c8d050e60/work,redirect_dir=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/6cd3fb733298cffd82842a7c1578d5d406cc86f0ce5fd962be3b949311a7ff2b/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/GBMFCIYQWZFPSSIGKAURULIOK6:/var/lib/containers/storage/overlay/l/3NYAS23JPXCBCY6CC256KKHZGJ,upperdir=/var/lib/containers/storage/overlay/6cd3fb733298cffd82842a7c1578d5d406cc86f0ce5fd962be3b949311a7ff2b/diff,workdir=/var/lib/containers/storage/overlay/6cd3fb733298cffd82842a7c1578d5d406cc86f0ce5fd962be3b949311a7ff2b/work,redirect_dir=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/203a5632c23998372ec11e3d0afa10cf86f5432fd50664d5a220f58b5d98337f/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/GBMFCIYQWZFPSSIGKAURULIOK6:/var/lib/containers/storage/overlay/l/3NYAS23JPXCBCY6CC256KKHZGJ,upperdir=/var/lib/containers/storage/overlay/203a5632c23998372ec11e3d0afa10cf86f5432fd50664d5a220f58b5d98337f/diff,workdir=/var/lib/containers/storage/overlay/203a5632c23998372ec11e3d0afa10cf86f5432fd50664d5a220f58b5d98337f/work,redirect_dir=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/dcc8d89cd8675545a251d4d1af37bc7875785cd900b7e13b311085ba2eaf486d/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/GBMFCIYQWZFPSSIGKAURULIOK6:/var/lib/containers/storage/overlay/l/3NYAS23JPXCBCY6CC256KKHZGJ,upperdir=/var/lib/containers/storage/overlay/dcc8d89cd8675545a251d4d1af37bc7875785cd900b7e13b311085ba2eaf486d/diff,workdir=/var/lib/containers/storage/overlay/dcc8d89cd8675545a251d4d1af37bc7875785cd900b7e13b311085ba2eaf486d/work,redirect_dir=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/9a603916881bfcca4080bd14cea9141ad7a63bed06ea565ca5005d2fd0a48ce2/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/GBMFCIYQWZFPSSIGKAURULIOK6:/var/lib/containers/storage/overlay/l/3NYAS23JPXCBCY6CC256KKHZGJ,upperdir=/var/lib/containers/storage/overlay/9a603916881bfcca4080bd14cea9141ad7a63bed06ea565ca5005d2fd0a48ce2/diff,workdir=/var/lib/containers/storage/overlay/9a603916881bfcca4080bd14cea9141ad7a63bed06ea565ca5005d2fd0a48ce2/work,redirect_dir=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/68e5c9f635e4d817e3dafa81c31867840f1c47aaaa88c5762658f4dcff8ba786/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/GBMFCIYQWZFPSSIGKAURULIOK6:/var/lib/containers/storage/overlay/l/3NYAS23JPXCBCY6CC256KKHZGJ,upperdir=/var/lib/containers/storage/overlay/68e5c9f635e4d817e3dafa81c31867840f1c47aaaa88c5762658f4dcff8ba786/diff,workdir=/var/lib/containers/storage/overlay/68e5c9f635e4d817e3dafa81c31867840f1c47aaaa88c5762658f4dcff8ba786/work,redirect_dir=on,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 2023-08-11T12:40:55.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:40:55.662 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-08-11T12:40:55.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-11T12:40:55.746 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link delete ceph-brx 2023-08-11T12:40:55.862 INFO:teuthology.orchestra.run.smithi008.stderr:Cannot find device "ceph-brx" 2023-08-11T12:40:55.864 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-11T12:40:55.865 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-08-11T12:40:55.885 INFO:tasks.cephadm:Teardown begin 2023-08-11T12:40:55.885 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-11T12:40:55.886 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-11T12:40:56.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.094+0000 7fdc2ffff700 1 -- 172.21.15.8:0/4060998143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc28106950 msgr2=0x7fdc28106d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:56.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.094+0000 7fdc2ffff700 1 --2- 172.21.15.8:0/4060998143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc28106950 0x7fdc28106d30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdc24009990 tx=0x7fdc24009ca0 comp rx=0 tx=0).stop 2023-08-11T12:40:56.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.094+0000 7fdc2ffff700 1 -- 172.21.15.8:0/4060998143 shutdown_connections 2023-08-11T12:40:56.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.094+0000 7fdc2ffff700 1 --2- 172.21.15.8:0/4060998143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc28101300 0x7fdc2810d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:56.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.094+0000 7fdc2ffff700 1 --2- 172.21.15.8:0/4060998143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc28106950 0x7fdc28106d30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:56.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.094+0000 7fdc2ffff700 1 --2- 172.21.15.8:0/4060998143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc28100940 0x7fdc28100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:56.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.094+0000 7fdc2ffff700 1 -- 172.21.15.8:0/4060998143 >> 172.21.15.8:0/4060998143 conn(0x7fdc280fc430 msgr2=0x7fdc280fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:56.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.094+0000 7fdc2ffff700 1 -- 172.21.15.8:0/4060998143 shutdown_connections 2023-08-11T12:40:56.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.094+0000 7fdc2ffff700 1 -- 172.21.15.8:0/4060998143 wait complete. 2023-08-11T12:40:56.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.095+0000 7fdc2ffff700 1 Processor -- start 2023-08-11T12:40:56.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.095+0000 7fdc2ffff700 1 -- start start 2023-08-11T12:40:56.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.096+0000 7fdc2ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc28100940 0x7fdc28072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:56.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.096+0000 7fdc2ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc28101300 0x7fdc28073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:56.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.096+0000 7fdc2ffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc28106950 0x7fdc281a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:56.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.096+0000 7fdc2ffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc28073990 con 0x7fdc28100940 2023-08-11T12:40:56.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.096+0000 7fdc2ffff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc281a5150 con 0x7fdc28101300 2023-08-11T12:40:56.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.096+0000 7fdc2ffff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc281a5290 con 0x7fdc28106950 2023-08-11T12:40:56.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.096+0000 7fdc2d59a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc28101300 0x7fdc28073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:56.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.096+0000 7fdc2dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc28100940 0x7fdc28072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:56.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.096+0000 7fdc2d59a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc28101300 0x7fdc28073160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:44638/0 (socket says 172.21.15.8:44638) 2023-08-11T12:40:56.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.096+0000 7fdc2d59a700 1 -- 172.21.15.8:0/494144677 learned_addr learned my addr 172.21.15.8:0/494144677 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:40:56.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.096+0000 7fdc2e59c700 1 --2- 172.21.15.8:0/494144677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc28106950 0x7fdc281a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:56.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.096+0000 7fdc2d59a700 1 -- 172.21.15.8:0/494144677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc28106950 msgr2=0x7fdc281a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:56.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.096+0000 7fdc2d59a700 1 --2- 172.21.15.8:0/494144677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc28106950 0x7fdc281a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:56.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.096+0000 7fdc2d59a700 1 -- 172.21.15.8:0/494144677 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc28100940 msgr2=0x7fdc28072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:56.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.096+0000 7fdc2d59a700 1 --2- 172.21.15.8:0/494144677 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc28100940 0x7fdc28072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:56.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.097+0000 7fdc2d59a700 1 -- 172.21.15.8:0/494144677 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc240095f0 con 0x7fdc28101300 2023-08-11T12:40:56.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.097+0000 7fdc2d59a700 1 --2- 172.21.15.8:0/494144677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc28101300 0x7fdc28073160 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fdc1800e9a0 tx=0x7fdc1800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:56.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.097+0000 7fdc1effd700 1 -- 172.21.15.8:0/494144677 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18009790 con 0x7fdc28101300 2023-08-11T12:40:56.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.097+0000 7fdc1effd700 1 -- 172.21.15.8:0/494144677 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc18010430 con 0x7fdc28101300 2023-08-11T12:40:56.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.097+0000 7fdc2ffff700 1 -- 172.21.15.8:0/494144677 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc281a54f0 con 0x7fdc28101300 2023-08-11T12:40:56.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.097+0000 7fdc1effd700 1 -- 172.21.15.8:0/494144677 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18018680 con 0x7fdc28101300 2023-08-11T12:40:56.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.097+0000 7fdc2ffff700 1 -- 172.21.15.8:0/494144677 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc281a59d0 con 0x7fdc28101300 2023-08-11T12:40:56.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.098+0000 7fdc2ffff700 1 -- 172.21.15.8:0/494144677 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc280677a0 con 0x7fdc28101300 2023-08-11T12:40:56.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.100+0000 7fdc1effd700 1 -- 172.21.15.8:0/494144677 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7fdc180105a0 con 0x7fdc28101300 2023-08-11T12:40:56.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.102+0000 7fdc1effd700 1 --2- 172.21.15.8:0/494144677 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fdc140a00c0 0x7fdc140a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:56.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.102+0000 7fdc1effd700 1 -- 172.21.15.8:0/494144677 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 9366+0+0 (secure 0 0 0) 0x7fdc18014070 con 0x7fdc28101300 2023-08-11T12:40:56.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.102+0000 7fdc2dd9b700 1 --2- 172.21.15.8:0/494144677 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fdc140a00c0 0x7fdc140a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:56.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.103+0000 7fdc2dd9b700 1 --2- 172.21.15.8:0/494144677 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fdc140a00c0 0x7fdc140a2580 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400b2e0 tx=0x7fdc24005fd0 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:56.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.104+0000 7fdc1effd700 1 -- 172.21.15.8:0/494144677 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fdc18095340 con 0x7fdc28101300 2023-08-11T12:40:56.302 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:56 smithi008 ceph-mon[97158]: pgmap v512: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:56.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.360+0000 7fdc2ffff700 1 -- 172.21.15.8:0/494144677 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc28074150 con 0x7fdc28101300 2023-08-11T12:40:56.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.361+0000 7fdc1effd700 1 -- 172.21.15.8:0/494144677 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+11351 (secure 0 0 0) 0x7fdc18098960 con 0x7fdc28101300 2023-08-11T12:40:56.364 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:40:56.364 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":54,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14469,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2854286216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2854286216},{"type":"v1","addr":"172.21.15.8:6835","nonce":2854286216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/805368621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":805368621},{"type":"v1","addr":"172.21.15.8:6837","nonce":805368621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":54,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-11T12:22:03.398475+0000","modified":"2023-08-11T12:30:40.813864+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24575,"mds_1":24550,"mds_2":24517,"mds_3":24500,"mds_4":24464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14526":{"gid":14526,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/2990530720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":2990530720},{"type":"v1","addr":"172.21.15.8:6839","nonce":2990530720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14538":{"gid":14538,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6841/3589272762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":3589272762},{"type":"v1","addr":"172.21.15.8:6841","nonce":3589272762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6833/2043443402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2043443402},{"type":"v1","addr":"172.21.15.194:6833","nonce":2043443402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24464":{"gid":24464,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.45:6833/1208864615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1208864615},{"type":"v1","addr":"172.21.15.45:6833","nonce":1208864615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24500":{"gid":24500,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.45:6835/1776075470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1776075470},{"type":"v1","addr":"172.21.15.45:6835","nonce":1776075470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24517":{"gid":24517,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.194:6835/2457430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2457430285},{"type":"v1","addr":"172.21.15.194:6835","nonce":2457430285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24529":{"gid":24529,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/3072808560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":3072808560},{"type":"v1","addr":"172.21.15.194:6837","nonce":3072808560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/641549061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":641549061},{"type":"v1","addr":"172.21.15.45:6837","nonce":641549061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.194:6839/2174476491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":2174476491},{"type":"v1","addr":"172.21.15.194:6839","nonce":2174476491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6839/119684732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":119684732},{"type":"v1","addr":"172.21.15.45:6839","nonce":119684732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-11T12:40:56.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.364+0000 7fdc2ffff700 1 -- 172.21.15.8:0/494144677 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fdc140a00c0 msgr2=0x7fdc140a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:56.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.364+0000 7fdc2ffff700 1 --2- 172.21.15.8:0/494144677 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fdc140a00c0 0x7fdc140a2580 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400b2e0 tx=0x7fdc24005fd0 comp rx=0 tx=0).stop 2023-08-11T12:40:56.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.364+0000 7fdc2ffff700 1 -- 172.21.15.8:0/494144677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc28101300 msgr2=0x7fdc28073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:56.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.364+0000 7fdc2ffff700 1 --2- 172.21.15.8:0/494144677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc28101300 0x7fdc28073160 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fdc1800e9a0 tx=0x7fdc1800ecb0 comp rx=0 tx=0).stop 2023-08-11T12:40:56.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.364+0000 7fdc2ffff700 1 -- 172.21.15.8:0/494144677 shutdown_connections 2023-08-11T12:40:56.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.364+0000 7fdc2ffff700 1 --2- 172.21.15.8:0/494144677 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fdc140a00c0 0x7fdc140a2580 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:56.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.364+0000 7fdc2ffff700 1 --2- 172.21.15.8:0/494144677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc28106950 0x7fdc281a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:56.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.364+0000 7fdc2ffff700 1 --2- 172.21.15.8:0/494144677 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc28100940 0x7fdc28072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:56.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.364+0000 7fdc2ffff700 1 --2- 172.21.15.8:0/494144677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc28101300 0x7fdc28073160 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:56.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.364+0000 7fdc2ffff700 1 -- 172.21.15.8:0/494144677 >> 172.21.15.8:0/494144677 conn(0x7fdc280fc430 msgr2=0x7fdc280fcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:56.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.364+0000 7fdc2ffff700 1 -- 172.21.15.8:0/494144677 shutdown_connections 2023-08-11T12:40:56.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.364+0000 7fdc2ffff700 1 -- 172.21.15.8:0/494144677 wait complete. 2023-08-11T12:40:56.369 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 54 2023-08-11T12:40:56.385 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-11T12:40:56.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:56 smithi194 ceph-mon[130905]: pgmap v512: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:56.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:56 smithi045 ceph-mon[130284]: pgmap v512: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:56.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.587+0000 7f66859ff700 1 -- 172.21.15.8:0/2493770593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6680106950 msgr2=0x7f6680106d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:56.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.587+0000 7f66859ff700 1 --2- 172.21.15.8:0/2493770593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6680106950 0x7f6680106d30 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6670009990 tx=0x7f6670009ca0 comp rx=0 tx=0).stop 2023-08-11T12:40:56.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.587+0000 7f66859ff700 1 -- 172.21.15.8:0/2493770593 shutdown_connections 2023-08-11T12:40:56.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.587+0000 7f66859ff700 1 --2- 172.21.15.8:0/2493770593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6680101300 0x7f668010d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:56.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.587+0000 7f66859ff700 1 --2- 172.21.15.8:0/2493770593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6680106950 0x7f6680106d30 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:56.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.587+0000 7f66859ff700 1 --2- 172.21.15.8:0/2493770593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6680100940 0x7f6680100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:56.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.587+0000 7f66859ff700 1 -- 172.21.15.8:0/2493770593 >> 172.21.15.8:0/2493770593 conn(0x7f66800fc430 msgr2=0x7f66800fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:56.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.587+0000 7f66859ff700 1 -- 172.21.15.8:0/2493770593 shutdown_connections 2023-08-11T12:40:56.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.587+0000 7f66859ff700 1 -- 172.21.15.8:0/2493770593 wait complete. 2023-08-11T12:40:56.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.588+0000 7f66859ff700 1 Processor -- start 2023-08-11T12:40:56.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.588+0000 7f66859ff700 1 -- start start 2023-08-11T12:40:56.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.588+0000 7f66859ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6680100940 0x7f668019ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:56.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.588+0000 7f66859ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6680101300 0x7f668019ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:56.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.588+0000 7f66859ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6680106950 0x7f6680198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:56.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.588+0000 7f66859ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6680199100 con 0x7f6680101300 2023-08-11T12:40:56.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.588+0000 7f66859ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6680199270 con 0x7f6680106950 2023-08-11T12:40:56.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.588+0000 7f66859ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6680199430 con 0x7f6680100940 2023-08-11T12:40:56.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.589+0000 7f667f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6680106950 0x7f6680198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:56.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.589+0000 7f667e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6680101300 0x7f668019ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:56.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.589+0000 7f667effd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6680100940 0x7f668019ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:56.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.589+0000 7f667f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6680106950 0x7f6680198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:44658/0 (socket says 172.21.15.8:44658) 2023-08-11T12:40:56.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.589+0000 7f667f7fe700 1 -- 172.21.15.8:0/2672854043 learned_addr learned my addr 172.21.15.8:0/2672854043 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:40:56.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.589+0000 7f667e7fc700 1 -- 172.21.15.8:0/2672854043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6680100940 msgr2=0x7f668019ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:56.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.589+0000 7f667e7fc700 1 --2- 172.21.15.8:0/2672854043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6680100940 0x7f668019ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:56.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.589+0000 7f667e7fc700 1 -- 172.21.15.8:0/2672854043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6680106950 msgr2=0x7f6680198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:56.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.589+0000 7f667e7fc700 1 --2- 172.21.15.8:0/2672854043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6680106950 0x7f6680198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:56.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.589+0000 7f667e7fc700 1 -- 172.21.15.8:0/2672854043 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66700095f0 con 0x7f6680101300 2023-08-11T12:40:56.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.589+0000 7f667e7fc700 1 --2- 172.21.15.8:0/2672854043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6680101300 0x7f668019ef60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f667400e9f0 tx=0x7f667400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:56.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.590+0000 7f66849fd700 1 -- 172.21.15.8:0/2672854043 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667400c9c0 con 0x7f6680101300 2023-08-11T12:40:56.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.590+0000 7f66859ff700 1 -- 172.21.15.8:0/2672854043 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6680199710 con 0x7f6680101300 2023-08-11T12:40:56.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.590+0000 7f66849fd700 1 -- 172.21.15.8:0/2672854043 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6674010430 con 0x7f6680101300 2023-08-11T12:40:56.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.590+0000 7f66849fd700 1 -- 172.21.15.8:0/2672854043 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6674018680 con 0x7f6680101300 2023-08-11T12:40:56.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.590+0000 7f66859ff700 1 -- 172.21.15.8:0/2672854043 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66801a5a10 con 0x7f6680101300 2023-08-11T12:40:56.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.591+0000 7f66859ff700 1 -- 172.21.15.8:0/2672854043 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66800677a0 con 0x7f6680101300 2023-08-11T12:40:56.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.593+0000 7f66849fd700 1 -- 172.21.15.8:0/2672854043 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f6674010860 con 0x7f6680101300 2023-08-11T12:40:56.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.595+0000 7f66849fd700 1 --2- 172.21.15.8:0/2672854043 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f66680a00c0 0x7f66680a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:56.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.595+0000 7f66849fd700 1 -- 172.21.15.8:0/2672854043 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 9366+0+0 (secure 0 0 0) 0x7f6674014070 con 0x7f6680101300 2023-08-11T12:40:56.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.595+0000 7f667effd700 1 --2- 172.21.15.8:0/2672854043 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f66680a00c0 0x7f66680a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:56.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.596+0000 7f667effd700 1 --2- 172.21.15.8:0/2672854043 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f66680a00c0 0x7f66680a2580 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f667000b2e0 tx=0x7f6670005fd0 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:56.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.599+0000 7f66849fd700 1 -- 172.21.15.8:0/2672854043 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f6674051c30 con 0x7f6680101300 2023-08-11T12:40:56.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.856+0000 7f66859ff700 1 -- 172.21.15.8:0/2672854043 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66801109a0 con 0x7f6680101300 2023-08-11T12:40:56.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.856+0000 7f66849fd700 1 -- 172.21.15.8:0/2672854043 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+11351 (secure 0 0 0) 0x7f66740951c0 con 0x7f6680101300 2023-08-11T12:40:56.860 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:40:56.860 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":54,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14469,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2854286216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2854286216},{"type":"v1","addr":"172.21.15.8:6835","nonce":2854286216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/805368621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":805368621},{"type":"v1","addr":"172.21.15.8:6837","nonce":805368621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":54,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-11T12:22:03.398475+0000","modified":"2023-08-11T12:30:40.813864+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24575,"mds_1":24550,"mds_2":24517,"mds_3":24500,"mds_4":24464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14526":{"gid":14526,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/2990530720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":2990530720},{"type":"v1","addr":"172.21.15.8:6839","nonce":2990530720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14538":{"gid":14538,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6841/3589272762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":3589272762},{"type":"v1","addr":"172.21.15.8:6841","nonce":3589272762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6833/2043443402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2043443402},{"type":"v1","addr":"172.21.15.194:6833","nonce":2043443402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24464":{"gid":24464,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.45:6833/1208864615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1208864615},{"type":"v1","addr":"172.21.15.45:6833","nonce":1208864615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24500":{"gid":24500,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.45:6835/1776075470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1776075470},{"type":"v1","addr":"172.21.15.45:6835","nonce":1776075470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24517":{"gid":24517,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.194:6835/2457430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2457430285},{"type":"v1","addr":"172.21.15.194:6835","nonce":2457430285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24529":{"gid":24529,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/3072808560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":3072808560},{"type":"v1","addr":"172.21.15.194:6837","nonce":3072808560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/641549061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":641549061},{"type":"v1","addr":"172.21.15.45:6837","nonce":641549061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.194:6839/2174476491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":2174476491},{"type":"v1","addr":"172.21.15.194:6839","nonce":2174476491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6839/119684732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":119684732},{"type":"v1","addr":"172.21.15.45:6839","nonce":119684732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-11T12:40:56.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.859+0000 7f66859ff700 1 -- 172.21.15.8:0/2672854043 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f66680a00c0 msgr2=0x7f66680a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:56.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.859+0000 7f66859ff700 1 --2- 172.21.15.8:0/2672854043 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f66680a00c0 0x7f66680a2580 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f667000b2e0 tx=0x7f6670005fd0 comp rx=0 tx=0).stop 2023-08-11T12:40:56.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.859+0000 7f66859ff700 1 -- 172.21.15.8:0/2672854043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6680101300 msgr2=0x7f668019ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:56.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.859+0000 7f66859ff700 1 --2- 172.21.15.8:0/2672854043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6680101300 0x7f668019ef60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f667400e9f0 tx=0x7f667400ed00 comp rx=0 tx=0).stop 2023-08-11T12:40:56.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.859+0000 7f66859ff700 1 -- 172.21.15.8:0/2672854043 shutdown_connections 2023-08-11T12:40:56.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.859+0000 7f66859ff700 1 --2- 172.21.15.8:0/2672854043 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f66680a00c0 0x7f66680a2580 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:56.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.859+0000 7f66859ff700 1 --2- 172.21.15.8:0/2672854043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6680100940 0x7f668019ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:56.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.859+0000 7f66859ff700 1 --2- 172.21.15.8:0/2672854043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6680106950 0x7f6680198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:56.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.859+0000 7f66859ff700 1 --2- 172.21.15.8:0/2672854043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6680101300 0x7f668019ef60 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:56.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.859+0000 7f66859ff700 1 -- 172.21.15.8:0/2672854043 >> 172.21.15.8:0/2672854043 conn(0x7f66800fc430 msgr2=0x7f668010bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:56.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.859+0000 7f66859ff700 1 -- 172.21.15.8:0/2672854043 shutdown_connections 2023-08-11T12:40:56.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:56.859+0000 7f66859ff700 1 -- 172.21.15.8:0/2672854043 wait complete. 2023-08-11T12:40:56.864 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 54 2023-08-11T12:40:56.880 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-11T12:40:57.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.085+0000 7fe2f07ff700 1 -- 172.21.15.8:0/1257176783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2e8100940 msgr2=0x7fe2e8100dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:57.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.085+0000 7fe2f07ff700 1 --2- 172.21.15.8:0/1257176783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2e8100940 0x7fe2e8100dc0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80098f0 tx=0x7fe2d8009c00 comp rx=0 tx=0).stop 2023-08-11T12:40:57.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.085+0000 7fe2f07ff700 1 -- 172.21.15.8:0/1257176783 shutdown_connections 2023-08-11T12:40:57.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.085+0000 7fe2f07ff700 1 --2- 172.21.15.8:0/1257176783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2e8106950 0x7fe2e8106d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:57.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.085+0000 7fe2f07ff700 1 --2- 172.21.15.8:0/1257176783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e8101300 0x7fe2e810d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:57.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.085+0000 7fe2f07ff700 1 --2- 172.21.15.8:0/1257176783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2e8100940 0x7fe2e8100dc0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:57.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.085+0000 7fe2f07ff700 1 -- 172.21.15.8:0/1257176783 >> 172.21.15.8:0/1257176783 conn(0x7fe2e80fc430 msgr2=0x7fe2e80fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:57.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.085+0000 7fe2f07ff700 1 -- 172.21.15.8:0/1257176783 shutdown_connections 2023-08-11T12:40:57.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.085+0000 7fe2f07ff700 1 -- 172.21.15.8:0/1257176783 wait complete. 2023-08-11T12:40:57.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.086+0000 7fe2f07ff700 1 Processor -- start 2023-08-11T12:40:57.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.086+0000 7fe2f07ff700 1 -- start start 2023-08-11T12:40:57.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.086+0000 7fe2f07ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e8100940 0x7fe2e8072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:57.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.086+0000 7fe2f07ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2e8101300 0x7fe2e8073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:57.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.086+0000 7fe2f07ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2e8106950 0x7fe2e81a4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:57.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.086+0000 7fe2f07ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e8073990 con 0x7fe2e8106950 2023-08-11T12:40:57.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.086+0000 7fe2f07ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e81a51d0 con 0x7fe2e8100940 2023-08-11T12:40:57.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.086+0000 7fe2f07ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e81a5310 con 0x7fe2e8101300 2023-08-11T12:40:57.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.087+0000 7fe2ee59b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e8100940 0x7fe2e8072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:57.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.087+0000 7fe2ee59b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e8100940 0x7fe2e8072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:44678/0 (socket says 172.21.15.8:44678) 2023-08-11T12:40:57.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.087+0000 7fe2ee59b700 1 -- 172.21.15.8:0/4097429735 learned_addr learned my addr 172.21.15.8:0/4097429735 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:40:57.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.087+0000 7fe2edd9a700 1 --2- 172.21.15.8:0/4097429735 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2e8101300 0x7fe2e8073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:57.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.087+0000 7fe2eed9c700 1 --2- 172.21.15.8:0/4097429735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2e8106950 0x7fe2e81a4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:57.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.087+0000 7fe2ee59b700 1 -- 172.21.15.8:0/4097429735 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2e8101300 msgr2=0x7fe2e8073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:57.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.087+0000 7fe2ee59b700 1 --2- 172.21.15.8:0/4097429735 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2e8101300 0x7fe2e8073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:57.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.087+0000 7fe2ee59b700 1 -- 172.21.15.8:0/4097429735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2e8106950 msgr2=0x7fe2e81a4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:57.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.087+0000 7fe2ee59b700 1 --2- 172.21.15.8:0/4097429735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2e8106950 0x7fe2e81a4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:57.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.087+0000 7fe2ee59b700 1 -- 172.21.15.8:0/4097429735 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e0009d00 con 0x7fe2e8100940 2023-08-11T12:40:57.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.087+0000 7fe2ee59b700 1 --2- 172.21.15.8:0/4097429735 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e8100940 0x7fe2e8072c20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe2e400e9a0 tx=0x7fe2e400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:57.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.087+0000 7fe2df7fe700 1 -- 172.21.15.8:0/4097429735 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4009790 con 0x7fe2e8100940 2023-08-11T12:40:57.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.088+0000 7fe2df7fe700 1 -- 172.21.15.8:0/4097429735 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe2e4010430 con 0x7fe2e8100940 2023-08-11T12:40:57.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.088+0000 7fe2f07ff700 1 -- 172.21.15.8:0/4097429735 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d8009520 con 0x7fe2e8100940 2023-08-11T12:40:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.088+0000 7fe2df7fe700 1 -- 172.21.15.8:0/4097429735 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4018680 con 0x7fe2e8100940 2023-08-11T12:40:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.088+0000 7fe2f07ff700 1 -- 172.21.15.8:0/4097429735 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e81a58c0 con 0x7fe2e8100940 2023-08-11T12:40:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.089+0000 7fe2f07ff700 1 -- 172.21.15.8:0/4097429735 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e80677a0 con 0x7fe2e8100940 2023-08-11T12:40:57.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.091+0000 7fe2df7fe700 1 -- 172.21.15.8:0/4097429735 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7fe2e40105a0 con 0x7fe2e8100940 2023-08-11T12:40:57.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.092+0000 7fe2df7fe700 1 --2- 172.21.15.8:0/4097429735 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe2d40a00c0 0x7fe2d40a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:57.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.092+0000 7fe2df7fe700 1 -- 172.21.15.8:0/4097429735 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 9366+0+0 (secure 0 0 0) 0x7fe2e4014070 con 0x7fe2e8100940 2023-08-11T12:40:57.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.093+0000 7fe2edd9a700 1 --2- 172.21.15.8:0/4097429735 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe2d40a00c0 0x7fe2d40a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:57.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.093+0000 7fe2edd9a700 1 --2- 172.21.15.8:0/4097429735 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe2d40a00c0 0x7fe2d40a2580 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8005e90 tx=0x7fe2d8019040 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:57.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.098+0000 7fe2df7fe700 1 -- 172.21.15.8:0/4097429735 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fe2e4095410 con 0x7fe2e8100940 2023-08-11T12:40:57.302 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:57 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/494144677' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:40:57.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:57 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2672854043' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:40:57.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.307+0000 7fe2f07ff700 1 -- 172.21.15.8:0/4097429735 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2e81109c0 con 0x7fe2e8100940 2023-08-11T12:40:57.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.309+0000 7fe2df7fe700 1 -- 172.21.15.8:0/4097429735 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+24907 (secure 0 0 0) 0x7fe2e4026090 con 0x7fe2e8100940 2023-08-11T12:40:57.312 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-11T12:40:57.312 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":110,"fsid":"815f94ae-3840-11ee-9b37-001a4aab830c","created":"2023-08-11T12:14:28.341113+0000","modified":"2023-08-11T12:40:14.988942+0000","last_up_change":"2023-08-11T12:21:14.913735+0000","last_in_change":"2023-08-11T12:20:57.476558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-11T12:17:49.040758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-11T12:22:01.383296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-11T12:22:02.816329+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":27,"snap_epoch":109,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-11T12:22:06.369375+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":27,"snap_epoch":109,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f903e393-7894-42d6-8b11-737ceef1f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6803","nonce":664104961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6805","nonce":664104961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6809","nonce":664104961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":664104961},{"type":"v1","addr":"172.21.15.8:6807","nonce":664104961}]},"public_addr":"172.21.15.8:6803/664104961","cluster_addr":"172.21.15.8:6805/664104961","heartbeat_back_addr":"172.21.15.8:6809/664104961","heartbeat_front_addr":"172.21.15.8:6807/664104961","state":["exists","up"]},{"osd":1,"uuid":"1e988e5c-e78c-46d5-80a5-dff7ac38cbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6801","nonce":4187350703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6803","nonce":4187350703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6807","nonce":4187350703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":4187350703},{"type":"v1","addr":"172.21.15.45:6805","nonce":4187350703}]},"public_addr":"172.21.15.45:6801/4187350703","cluster_addr":"172.21.15.45:6803/4187350703","heartbeat_back_addr":"172.21.15.45:6807/4187350703","heartbeat_front_addr":"172.21.15.45:6805/4187350703","state":["exists","up"]},{"osd":2,"uuid":"1835217c-a93c-4181-b8b8-cc410bab1a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6801","nonce":2547818140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6803","nonce":2547818140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6807","nonce":2547818140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2547818140},{"type":"v1","addr":"172.21.15.194:6805","nonce":2547818140}]},"public_addr":"172.21.15.194:6801/2547818140","cluster_addr":"172.21.15.194:6803/2547818140","heartbeat_back_addr":"172.21.15.194:6807/2547818140","heartbeat_front_addr":"172.21.15.194:6805/2547818140","state":["exists","up"]},{"osd":3,"uuid":"b55ae61a-731c-4312-a998-661122b84788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6811","nonce":187418883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6813","nonce":187418883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6817","nonce":187418883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":187418883},{"type":"v1","addr":"172.21.15.8:6815","nonce":187418883}]},"public_addr":"172.21.15.8:6811/187418883","cluster_addr":"172.21.15.8:6813/187418883","heartbeat_back_addr":"172.21.15.8:6817/187418883","heartbeat_front_addr":"172.21.15.8:6815/187418883","state":["exists","up"]},{"osd":4,"uuid":"2c28acbb-e807-4559-8aa2-a35ca84b5d43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6809","nonce":3099704571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6811","nonce":3099704571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6815","nonce":3099704571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3099704571},{"type":"v1","addr":"172.21.15.45:6813","nonce":3099704571}]},"public_addr":"172.21.15.45:6809/3099704571","cluster_addr":"172.21.15.45:6811/3099704571","heartbeat_back_addr":"172.21.15.45:6815/3099704571","heartbeat_front_addr":"172.21.15.45:6813/3099704571","state":["exists","up"]},{"osd":5,"uuid":"37032289-8016-4730-9b69-f7985e058ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6809","nonce":263803874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6811","nonce":263803874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6815","nonce":263803874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":263803874},{"type":"v1","addr":"172.21.15.194:6813","nonce":263803874}]},"public_addr":"172.21.15.194:6809/263803874","cluster_addr":"172.21.15.194:6811/263803874","heartbeat_back_addr":"172.21.15.194:6815/263803874","heartbeat_front_addr":"172.21.15.194:6813/263803874","state":["exists","up"]},{"osd":6,"uuid":"32d2dab9-6944-40d1-ada9-4f941821b063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6819","nonce":1802966829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6821","nonce":1802966829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6825","nonce":1802966829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1802966829},{"type":"v1","addr":"172.21.15.8:6823","nonce":1802966829}]},"public_addr":"172.21.15.8:6819/1802966829","cluster_addr":"172.21.15.8:6821/1802966829","heartbeat_back_addr":"172.21.15.8:6825/1802966829","heartbeat_front_addr":"172.21.15.8:6823/1802966829","state":["exists","up"]},{"osd":7,"uuid":"086aff58-1554-49fe-92ff-5166b115aeef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6817","nonce":3715737148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6819","nonce":3715737148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6823","nonce":3715737148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3715737148},{"type":"v1","addr":"172.21.15.45:6821","nonce":3715737148}]},"public_addr":"172.21.15.45:6817/3715737148","cluster_addr":"172.21.15.45:6819/3715737148","heartbeat_back_addr":"172.21.15.45:6823/3715737148","heartbeat_front_addr":"172.21.15.45:6821/3715737148","state":["exists","up"]},{"osd":8,"uuid":"7fff5e95-2453-4ea6-a5c1-3bba6a1f6400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6817","nonce":57497127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6819","nonce":57497127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6823","nonce":57497127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":57497127},{"type":"v1","addr":"172.21.15.194:6821","nonce":57497127}]},"public_addr":"172.21.15.194:6817/57497127","cluster_addr":"172.21.15.194:6819/57497127","heartbeat_back_addr":"172.21.15.194:6823/57497127","heartbeat_front_addr":"172.21.15.194:6821/57497127","state":["exists","up"]},{"osd":9,"uuid":"31ab0121-4c92-42ec-9f19-e672062e8814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6827","nonce":434661930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6829","nonce":434661930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6833","nonce":434661930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":434661930},{"type":"v1","addr":"172.21.15.8:6831","nonce":434661930}]},"public_addr":"172.21.15.8:6827/434661930","cluster_addr":"172.21.15.8:6829/434661930","heartbeat_back_addr":"172.21.15.8:6833/434661930","heartbeat_front_addr":"172.21.15.8:6831/434661930","state":["exists","up"]},{"osd":10,"uuid":"62c632e4-94f6-4630-9d94-8d28fccacf45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6825","nonce":3281212184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6827","nonce":3281212184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6831","nonce":3281212184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3281212184},{"type":"v1","addr":"172.21.15.45:6829","nonce":3281212184}]},"public_addr":"172.21.15.45:6825/3281212184","cluster_addr":"172.21.15.45:6827/3281212184","heartbeat_back_addr":"172.21.15.45:6831/3281212184","heartbeat_front_addr":"172.21.15.45:6829/3281212184","state":["exists","up"]},{"osd":11,"uuid":"8ca4a80d-cd75-4230-b46d-aef6fdc03e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6825","nonce":1637875895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6827","nonce":1637875895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6831","nonce":1637875895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1637875895},{"type":"v1","addr":"172.21.15.194:6829","nonce":1637875895}]},"public_addr":"172.21.15.194:6825/1637875895","cluster_addr":"172.21.15.194:6827/1637875895","heartbeat_back_addr":"172.21.15.194:6831/1637875895","heartbeat_front_addr":"172.21.15.194:6829/1637875895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:04.255616+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:26.243863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:17:46.630365+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:12.926291+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:35.747049+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:18:55.793767+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:21.685725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:19:43.703215+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:04.043674+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:30.320026+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:20:52.751974+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-11T12:21:13.230024+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6801/2041276411":"2023-08-12T12:24:35.743200+0000","172.21.15.8:0/3461107704":"2023-08-12T12:24:35.743200+0000","172.21.15.8:0/340114165":"2023-08-12T12:24:35.743200+0000","172.21.15.8:0/2764282698":"2023-08-12T12:24:35.743200+0000","172.21.15.8:0/2000592056":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2102228072":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6800/2832004641":"2023-08-12T12:15:30.423754+0000","172.21.15.8:0/2132227156":"2023-08-12T12:24:35.743200+0000","172.21.15.8:6800/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:6800/2041276411":"2023-08-12T12:24:35.743200+0000","172.21.15.8:0/2374527928":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2928221278":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/2744750874":"2023-08-12T12:15:30.423754+0000","172.21.15.8:6801/2108474030":"2023-08-12T12:15:02.528403+0000","172.21.15.8:0/3681755887":"2023-08-12T12:15:02.528403+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":14,"length":1},{"begin":27,"length":1}]},{"pool":4,"snaps":[{"begin":14,"length":1},{"begin":27,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-11T12:40:57.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.312+0000 7fe2f07ff700 1 -- 172.21.15.8:0/4097429735 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe2d40a00c0 msgr2=0x7fe2d40a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:57.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.312+0000 7fe2f07ff700 1 --2- 172.21.15.8:0/4097429735 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe2d40a00c0 0x7fe2d40a2580 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8005e90 tx=0x7fe2d8019040 comp rx=0 tx=0).stop 2023-08-11T12:40:57.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.312+0000 7fe2f07ff700 1 -- 172.21.15.8:0/4097429735 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e8100940 msgr2=0x7fe2e8072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:57.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.312+0000 7fe2f07ff700 1 --2- 172.21.15.8:0/4097429735 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e8100940 0x7fe2e8072c20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe2e400e9a0 tx=0x7fe2e400ecb0 comp rx=0 tx=0).stop 2023-08-11T12:40:57.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.312+0000 7fe2f07ff700 1 -- 172.21.15.8:0/4097429735 shutdown_connections 2023-08-11T12:40:57.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.312+0000 7fe2f07ff700 1 --2- 172.21.15.8:0/4097429735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2e8106950 0x7fe2e81a4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:57.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.312+0000 7fe2f07ff700 1 --2- 172.21.15.8:0/4097429735 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e8100940 0x7fe2e8072c20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:57.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.312+0000 7fe2f07ff700 1 --2- 172.21.15.8:0/4097429735 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fe2d40a00c0 0x7fe2d40a2580 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:57.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.312+0000 7fe2f07ff700 1 --2- 172.21.15.8:0/4097429735 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2e8101300 0x7fe2e8073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:57.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.312+0000 7fe2f07ff700 1 -- 172.21.15.8:0/4097429735 >> 172.21.15.8:0/4097429735 conn(0x7fe2e80fc430 msgr2=0x7fe2e80fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:57.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.312+0000 7fe2f07ff700 1 -- 172.21.15.8:0/4097429735 shutdown_connections 2023-08-11T12:40:57.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.312+0000 7fe2f07ff700 1 -- 172.21.15.8:0/4097429735 wait complete. 2023-08-11T12:40:57.334 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-11T12:40:57.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:57 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/494144677' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:40:57.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:57 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2672854043' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:40:57.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:57 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/494144677' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:40:57.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:57 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2672854043' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-11T12:40:57.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.537+0000 7f668b5ff700 1 -- 172.21.15.8:0/3600992359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6684100960 msgr2=0x7f6684100de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:57.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.537+0000 7f668b5ff700 1 --2- 172.21.15.8:0/3600992359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6684100960 0x7f6684100de0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6674009990 tx=0x7f6674009ca0 comp rx=0 tx=0).stop 2023-08-11T12:40:57.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.537+0000 7f668b5ff700 1 -- 172.21.15.8:0/3600992359 shutdown_connections 2023-08-11T12:40:57.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.537+0000 7f668b5ff700 1 --2- 172.21.15.8:0/3600992359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6684101320 0x7f668410d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:57.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.537+0000 7f668b5ff700 1 --2- 172.21.15.8:0/3600992359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6684106970 0x7f6684106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:57.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.537+0000 7f668b5ff700 1 --2- 172.21.15.8:0/3600992359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6684100960 0x7f6684100de0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:57.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.537+0000 7f668b5ff700 1 -- 172.21.15.8:0/3600992359 >> 172.21.15.8:0/3600992359 conn(0x7f66840fc490 msgr2=0x7f66840fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:57.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.537+0000 7f668b5ff700 1 -- 172.21.15.8:0/3600992359 shutdown_connections 2023-08-11T12:40:57.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.537+0000 7f668b5ff700 1 -- 172.21.15.8:0/3600992359 wait complete. 2023-08-11T12:40:57.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.538+0000 7f668b5ff700 1 Processor -- start 2023-08-11T12:40:57.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.538+0000 7f668b5ff700 1 -- start start 2023-08-11T12:40:57.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.538+0000 7f668b5ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6684100960 0x7f668419e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:57.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.538+0000 7f668b5ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6684101320 0x7f668419eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:57.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.538+0000 7f668b5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6684106970 0x7f6684198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:57.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.538+0000 7f668b5ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66841990c0 con 0x7f6684100960 2023-08-11T12:40:57.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.538+0000 7f668b5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6684199230 con 0x7f6684106970 2023-08-11T12:40:57.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.538+0000 7f668b5ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66841993f0 con 0x7f6684101320 2023-08-11T12:40:57.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.539+0000 7f668939b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6684100960 0x7f668419e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:57.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.539+0000 7f6689b9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6684106970 0x7f6684198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:57.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.539+0000 7f668939b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6684100960 0x7f668419e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41336/0 (socket says 172.21.15.8:41336) 2023-08-11T12:40:57.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.539+0000 7f6688b9a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6684101320 0x7f668419eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:57.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.539+0000 7f668939b700 1 -- 172.21.15.8:0/2829072701 learned_addr learned my addr 172.21.15.8:0/2829072701 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:40:57.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.539+0000 7f668939b700 1 -- 172.21.15.8:0/2829072701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6684101320 msgr2=0x7f668419eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:57.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.539+0000 7f668939b700 1 --2- 172.21.15.8:0/2829072701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6684101320 0x7f668419eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:57.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.539+0000 7f668939b700 1 -- 172.21.15.8:0/2829072701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6684106970 msgr2=0x7f6684198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:57.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.539+0000 7f668939b700 1 --2- 172.21.15.8:0/2829072701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6684106970 0x7f6684198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:57.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.539+0000 7f668939b700 1 -- 172.21.15.8:0/2829072701 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66740095f0 con 0x7f6684100960 2023-08-11T12:40:57.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.539+0000 7f6689b9c700 1 --2- 172.21.15.8:0/2829072701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6684106970 0x7f6684198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:40:57.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.539+0000 7f668939b700 1 --2- 172.21.15.8:0/2829072701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6684100960 0x7f668419e990 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f668000e9a0 tx=0x7f668000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:57.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.540+0000 7f667a7fc700 1 -- 172.21.15.8:0/2829072701 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6680009790 con 0x7f6684100960 2023-08-11T12:40:57.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.540+0000 7f668b5ff700 1 -- 172.21.15.8:0/2829072701 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66841996d0 con 0x7f6684100960 2023-08-11T12:40:57.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.540+0000 7f667a7fc700 1 -- 172.21.15.8:0/2829072701 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6680010430 con 0x7f6684100960 2023-08-11T12:40:57.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.540+0000 7f667a7fc700 1 -- 172.21.15.8:0/2829072701 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6680018680 con 0x7f6684100960 2023-08-11T12:40:57.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.540+0000 7f668b5ff700 1 -- 172.21.15.8:0/2829072701 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66841a5980 con 0x7f6684100960 2023-08-11T12:40:57.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.541+0000 7f668b5ff700 1 -- 172.21.15.8:0/2829072701 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66840677a0 con 0x7f6684100960 2023-08-11T12:40:57.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.543+0000 7f667a7fc700 1 -- 172.21.15.8:0/2829072701 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f66800105a0 con 0x7f6684100960 2023-08-11T12:40:57.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.544+0000 7f667a7fc700 1 --2- 172.21.15.8:0/2829072701 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f66700a0140 0x7f66700a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:57.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.544+0000 7f667a7fc700 1 -- 172.21.15.8:0/2829072701 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 9366+0+0 (secure 0 0 0) 0x7f6680014070 con 0x7f6684100960 2023-08-11T12:40:57.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.544+0000 7f6688b9a700 1 --2- 172.21.15.8:0/2829072701 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f66700a0140 0x7f66700a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:57.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.545+0000 7f6688b9a700 1 --2- 172.21.15.8:0/2829072701 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f66700a0140 0x7f66700a2600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f667400b2e0 tx=0x7f6674005960 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:57.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.548+0000 7f667a7fc700 1 -- 172.21.15.8:0/2829072701 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f6680051c30 con 0x7f6684100960 2023-08-11T12:40:57.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.803+0000 7f668b5ff700 1 -- 172.21.15.8:0/2829072701 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6684110970 con 0x7f6684100960 2023-08-11T12:40:57.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.809+0000 7f667a7fc700 1 -- 172.21.15.8:0/2829072701 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v55) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6680095120 con 0x7f6684100960 2023-08-11T12:40:57.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.813+0000 7f668b5ff700 1 -- 172.21.15.8:0/2829072701 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f66700a0140 msgr2=0x7f66700a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:57.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.813+0000 7f668b5ff700 1 --2- 172.21.15.8:0/2829072701 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f66700a0140 0x7f66700a2600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f667400b2e0 tx=0x7f6674005960 comp rx=0 tx=0).stop 2023-08-11T12:40:57.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.813+0000 7f668b5ff700 1 -- 172.21.15.8:0/2829072701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6684100960 msgr2=0x7f668419e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:57.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.813+0000 7f668b5ff700 1 --2- 172.21.15.8:0/2829072701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6684100960 0x7f668419e990 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f668000e9a0 tx=0x7f668000ecb0 comp rx=0 tx=0).stop 2023-08-11T12:40:57.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.813+0000 7f668b5ff700 1 -- 172.21.15.8:0/2829072701 shutdown_connections 2023-08-11T12:40:57.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.813+0000 7f668b5ff700 1 --2- 172.21.15.8:0/2829072701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6684106970 0x7f6684198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:57.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.813+0000 7f668b5ff700 1 --2- 172.21.15.8:0/2829072701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6684100960 0x7f668419e990 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:57.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.813+0000 7f668b5ff700 1 --2- 172.21.15.8:0/2829072701 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f66700a0140 0x7f66700a2600 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:57.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.813+0000 7f668b5ff700 1 --2- 172.21.15.8:0/2829072701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6684101320 0x7f668419eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:57.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.813+0000 7f668b5ff700 1 -- 172.21.15.8:0/2829072701 >> 172.21.15.8:0/2829072701 conn(0x7f66840fc490 msgr2=0x7f66840fcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:57.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.813+0000 7f668b5ff700 1 -- 172.21.15.8:0/2829072701 shutdown_connections 2023-08-11T12:40:57.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:57.813+0000 7f668b5ff700 1 -- 172.21.15.8:0/2829072701 wait complete. 2023-08-11T12:40:57.818 INFO:teuthology.orchestra.run.smithi008.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-11T12:40:57.845 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-11T12:40:58.058 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:57 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mon-a[97134]: 2023-08-11T12:40:57.804+0000 7f0e49409700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-11T12:40:58.059 INFO:journalctl@ceph.mds.g.smithi008.stdout:Aug 11 12:40:57 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-g[131311]: ignoring --setuser ceph since I am not root 2023-08-11T12:40:58.060 INFO:journalctl@ceph.mds.g.smithi008.stdout:Aug 11 12:40:57 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-g[131311]: ignoring --setgroup ceph since I am not root 2023-08-11T12:40:58.060 INFO:journalctl@ceph.mds.g.smithi008.stdout:Aug 11 12:40:57 smithi008 ceph-mds[131335]: -- 172.21.15.8:0/4138340161 <== mon.2 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561783ebf1e0 con 0x561783e94c00 2023-08-11T12:40:58.061 INFO:journalctl@ceph.mds.g.smithi008.stdout:Aug 11 12:40:57 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-g[131311]: starting mds.g at 2023-08-11T12:40:58.061 INFO:journalctl@ceph.mds.a.smithi008.stdout:Aug 11 12:40:57 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-a[131700]: ignoring --setuser ceph since I am not root 2023-08-11T12:40:58.062 INFO:journalctl@ceph.mds.a.smithi008.stdout:Aug 11 12:40:57 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-a[131700]: ignoring --setgroup ceph since I am not root 2023-08-11T12:40:58.062 INFO:journalctl@ceph.mds.a.smithi008.stdout:Aug 11 12:40:57 smithi008 ceph-mds[131724]: -- 172.21.15.8:0/1446853160 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5653b72c71e0 con 0x5653b729c800 2023-08-11T12:40:58.063 INFO:journalctl@ceph.mds.a.smithi008.stdout:Aug 11 12:40:57 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-a[131700]: starting mds.a at 2023-08-11T12:40:58.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.063+0000 7fb2327ff700 1 -- 172.21.15.8:0/2330814806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb22c1024e0 msgr2=0x7fb22c10a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:58.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.063+0000 7fb2327ff700 1 --2- 172.21.15.8:0/2330814806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb22c1024e0 0x7fb22c10a9c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb220009990 tx=0x7fb220009ca0 comp rx=0 tx=0).stop 2023-08-11T12:40:58.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.063+0000 7fb2327ff700 1 -- 172.21.15.8:0/2330814806 shutdown_connections 2023-08-11T12:40:58.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.063+0000 7fb2327ff700 1 --2- 172.21.15.8:0/2330814806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb22c10af90 0x7fb22c10d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:58.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.063+0000 7fb2327ff700 1 --2- 172.21.15.8:0/2330814806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb22c101bc0 0x7fb22c101fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:58.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.063+0000 7fb2327ff700 1 --2- 172.21.15.8:0/2330814806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb22c1024e0 0x7fb22c10a9c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:58.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.063+0000 7fb2327ff700 1 -- 172.21.15.8:0/2330814806 >> 172.21.15.8:0/2330814806 conn(0x7fb22c076a30 msgr2=0x7fb22c076e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:58.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.063+0000 7fb2327ff700 1 -- 172.21.15.8:0/2330814806 shutdown_connections 2023-08-11T12:40:58.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.063+0000 7fb2327ff700 1 -- 172.21.15.8:0/2330814806 wait complete. 2023-08-11T12:40:58.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.065+0000 7fb2327ff700 1 Processor -- start 2023-08-11T12:40:58.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.065+0000 7fb2327ff700 1 -- start start 2023-08-11T12:40:58.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.066+0000 7fb2327ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb22c101bc0 0x7fb22c19c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:58.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.066+0000 7fb2327ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb22c1024e0 0x7fb22c19cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:58.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.066+0000 7fb2327ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb22c10af90 0x7fb22c196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:58.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.066+0000 7fb2327ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c196f80 con 0x7fb22c101bc0 2023-08-11T12:40:58.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.066+0000 7fb2327ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c1970f0 con 0x7fb22c10af90 2023-08-11T12:40:58.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.066+0000 7fb2327ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c1972b0 con 0x7fb22c1024e0 2023-08-11T12:40:58.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.066+0000 7fb22bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb22c101bc0 0x7fb22c19c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:58.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.066+0000 7fb22b7fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb22c1024e0 0x7fb22c19cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:58.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.066+0000 7fb22bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb22c101bc0 0x7fb22c19c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51238/0 (socket says 172.21.15.8:51238) 2023-08-11T12:40:58.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.066+0000 7fb22bfff700 1 -- 172.21.15.8:0/1951054714 learned_addr learned my addr 172.21.15.8:0/1951054714 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:40:58.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.066+0000 7fb230d9c700 1 --2- 172.21.15.8:0/1951054714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb22c10af90 0x7fb22c196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:58.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.066+0000 7fb22bfff700 1 -- 172.21.15.8:0/1951054714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb22c1024e0 msgr2=0x7fb22c19cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:58.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.066+0000 7fb22bfff700 1 --2- 172.21.15.8:0/1951054714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb22c1024e0 0x7fb22c19cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:58.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.066+0000 7fb22bfff700 1 -- 172.21.15.8:0/1951054714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb22c10af90 msgr2=0x7fb22c196910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:58.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.066+0000 7fb22bfff700 1 --2- 172.21.15.8:0/1951054714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb22c10af90 0x7fb22c196910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:58.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.066+0000 7fb22bfff700 1 -- 172.21.15.8:0/1951054714 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2200095f0 con 0x7fb22c101bc0 2023-08-11T12:40:58.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.067+0000 7fb22bfff700 1 --2- 172.21.15.8:0/1951054714 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb22c101bc0 0x7fb22c19c8a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb21c00e9a0 tx=0x7fb21c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:58.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.067+0000 7fb2297fa700 1 -- 172.21.15.8:0/1951054714 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c009790 con 0x7fb22c101bc0 2023-08-11T12:40:58.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.067+0000 7fb2327ff700 1 -- 172.21.15.8:0/1951054714 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb22c197590 con 0x7fb22c101bc0 2023-08-11T12:40:58.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.067+0000 7fb2297fa700 1 -- 172.21.15.8:0/1951054714 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb21c010430 con 0x7fb22c101bc0 2023-08-11T12:40:58.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.067+0000 7fb2297fa700 1 -- 172.21.15.8:0/1951054714 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c018680 con 0x7fb22c101bc0 2023-08-11T12:40:58.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.067+0000 7fb2327ff700 1 -- 172.21.15.8:0/1951054714 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22c1a3890 con 0x7fb22c101bc0 2023-08-11T12:40:58.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.068+0000 7fb2327ff700 1 -- 172.21.15.8:0/1951054714 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb22c0677a0 con 0x7fb22c101bc0 2023-08-11T12:40:58.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.070+0000 7fb2297fa700 1 -- 172.21.15.8:0/1951054714 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7fb21c0105a0 con 0x7fb22c101bc0 2023-08-11T12:40:58.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.071+0000 7fb2297fa700 1 --2- 172.21.15.8:0/1951054714 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb2140a0140 0x7fb2140a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:58.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.072+0000 7fb2297fa700 1 -- 172.21.15.8:0/1951054714 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 9708+0+0 (secure 0 0 0) 0x7fb21c014070 con 0x7fb22c101bc0 2023-08-11T12:40:58.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.072+0000 7fb22b7fe700 1 --2- 172.21.15.8:0/1951054714 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb2140a0140 0x7fb2140a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:58.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.072+0000 7fb22b7fe700 1 --2- 172.21.15.8:0/1951054714 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb2140a0140 0x7fb2140a2600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb22c0ff530 tx=0x7fb220005fd0 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:58.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.075+0000 7fb2297fa700 1 -- 172.21.15.8:0/1951054714 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fb21c051c30 con 0x7fb22c101bc0 2023-08-11T12:40:58.143 INFO:journalctl@ceph.mds.c.smithi194.stdout:Aug 11 12:40:57 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-c[156475]: ignoring --setuser ceph since I am not root 2023-08-11T12:40:58.143 INFO:journalctl@ceph.mds.c.smithi194.stdout:Aug 11 12:40:57 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-c[156475]: ignoring --setgroup ceph since I am not root 2023-08-11T12:40:58.144 INFO:journalctl@ceph.mds.c.smithi194.stdout:Aug 11 12:40:57 smithi194 ceph-mds[156499]: -- 172.21.15.194:0/46547284 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564ce6d231e0 con 0x564ce6cf8800 2023-08-11T12:40:58.144 INFO:journalctl@ceph.mds.c.smithi194.stdout:Aug 11 12:40:57 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-c[156475]: starting mds.c at 2023-08-11T12:40:58.145 INFO:journalctl@ceph.mds.i.smithi194.stdout:Aug 11 12:40:57 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-i[156816]: ignoring --setuser ceph since I am not root 2023-08-11T12:40:58.145 INFO:journalctl@ceph.mds.i.smithi194.stdout:Aug 11 12:40:57 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-i[156816]: ignoring --setgroup ceph since I am not root 2023-08-11T12:40:58.145 INFO:journalctl@ceph.mds.i.smithi194.stdout:Aug 11 12:40:57 smithi194 ceph-mds[156840]: -- 172.21.15.194:0/2052226764 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f0fd2431e0 con 0x55f0fd219000 2023-08-11T12:40:58.145 INFO:journalctl@ceph.mds.i.smithi194.stdout:Aug 11 12:40:57 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-i[156816]: starting mds.i at 2023-08-11T12:40:58.146 INFO:journalctl@ceph.mds.l.smithi194.stdout:Aug 11 12:40:57 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-l[155795]: ignoring --setuser ceph since I am not root 2023-08-11T12:40:58.146 INFO:journalctl@ceph.mds.l.smithi194.stdout:Aug 11 12:40:57 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-l[155795]: ignoring --setgroup ceph since I am not root 2023-08-11T12:40:58.146 INFO:journalctl@ceph.mds.l.smithi194.stdout:Aug 11 12:40:57 smithi194 ceph-mds[155820]: -- 172.21.15.194:0/1599363713 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c007ccf1e0 con 0x55c007ca5000 2023-08-11T12:40:58.146 INFO:journalctl@ceph.mds.l.smithi194.stdout:Aug 11 12:40:57 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-l[155795]: starting mds.l at 2023-08-11T12:40:58.147 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:58 smithi194 ceph-mon[130905]: pgmap v513: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:58.147 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:58 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/4097429735' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:40:58.147 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:58 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2829072701' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-08-11T12:40:58.148 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:58 smithi194 ceph-mon[130905]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-08-11T12:40:58.148 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:58 smithi194 ceph-mon[130905]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-11T12:40:58.148 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:58 smithi194 ceph-mon[130905]: osdmap e111: 12 total, 12 up, 12 in 2023-08-11T12:40:58.148 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:58 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/2829072701' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-08-11T12:40:58.148 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:58 smithi194 ceph-mon[130905]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-08-11T12:40:58.149 INFO:journalctl@ceph.mds.f.smithi194.stdout:Aug 11 12:40:57 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-f[156134]: ignoring --setuser ceph since I am not root 2023-08-11T12:40:58.149 INFO:journalctl@ceph.mds.f.smithi194.stdout:Aug 11 12:40:57 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-f[156134]: ignoring --setgroup ceph since I am not root 2023-08-11T12:40:58.149 INFO:journalctl@ceph.mds.f.smithi194.stdout:Aug 11 12:40:57 smithi194 ceph-mds[156158]: -- 172.21.15.194:0/1415852178 <== mon.2 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560b1cba11e0 con 0x560b1cb76c00 2023-08-11T12:40:58.149 INFO:journalctl@ceph.mds.f.smithi194.stdout:Aug 11 12:40:57 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-f[156134]: starting mds.f at 2023-08-11T12:40:58.150 INFO:journalctl@ceph.mds.b.smithi045.stdout:Aug 11 12:40:57 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-b[155632]: ignoring --setuser ceph since I am not root 2023-08-11T12:40:58.150 INFO:journalctl@ceph.mds.b.smithi045.stdout:Aug 11 12:40:57 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-b[155632]: ignoring --setgroup ceph since I am not root 2023-08-11T12:40:58.151 INFO:journalctl@ceph.mds.b.smithi045.stdout:Aug 11 12:40:57 smithi045 ceph-mds[155656]: -- 172.21.15.45:0/2042499301 <== mon.2 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56097969f1e0 con 0x560979674800 2023-08-11T12:40:58.151 INFO:journalctl@ceph.mds.b.smithi045.stdout:Aug 11 12:40:57 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-b[155632]: starting mds.b at 2023-08-11T12:40:58.151 INFO:journalctl@ceph.mds.e.smithi045.stdout:Aug 11 12:40:57 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-e[154951]: ignoring --setuser ceph since I am not root 2023-08-11T12:40:58.151 INFO:journalctl@ceph.mds.e.smithi045.stdout:Aug 11 12:40:57 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-e[154951]: ignoring --setgroup ceph since I am not root 2023-08-11T12:40:58.152 INFO:journalctl@ceph.mds.e.smithi045.stdout:Aug 11 12:40:57 smithi045 ceph-mds[154975]: -- 172.21.15.45:0/3855090737 <== mon.2 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55771bb271e0 con 0x55771bafd000 2023-08-11T12:40:58.152 INFO:journalctl@ceph.mds.e.smithi045.stdout:Aug 11 12:40:57 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-e[154951]: starting mds.e at 2023-08-11T12:40:58.152 INFO:journalctl@ceph.mds.h.smithi045.stdout:Aug 11 12:40:57 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-h[155288]: ignoring --setuser ceph since I am not root 2023-08-11T12:40:58.153 INFO:journalctl@ceph.mds.h.smithi045.stdout:Aug 11 12:40:57 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-h[155288]: ignoring --setgroup ceph since I am not root 2023-08-11T12:40:58.153 INFO:journalctl@ceph.mds.h.smithi045.stdout:Aug 11 12:40:57 smithi045 ceph-mds[155313]: -- 172.21.15.45:0/318572198 <== mon.2 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5617f12771e0 con 0x5617f124d000 2023-08-11T12:40:58.153 INFO:journalctl@ceph.mds.h.smithi045.stdout:Aug 11 12:40:57 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-h[155288]: starting mds.h at 2023-08-11T12:40:58.153 INFO:journalctl@ceph.mds.k.smithi045.stdout:Aug 11 12:40:57 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-k[154610]: ignoring --setuser ceph since I am not root 2023-08-11T12:40:58.154 INFO:journalctl@ceph.mds.k.smithi045.stdout:Aug 11 12:40:57 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-k[154610]: ignoring --setgroup ceph since I am not root 2023-08-11T12:40:58.154 INFO:journalctl@ceph.mds.k.smithi045.stdout:Aug 11 12:40:57 smithi045 ceph-mds[154634]: -- 172.21.15.45:0/1212389132 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56364a8d91e0 con 0x56364a8aec00 2023-08-11T12:40:58.154 INFO:journalctl@ceph.mds.k.smithi045.stdout:Aug 11 12:40:57 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-k[154610]: starting mds.k at 2023-08-11T12:40:58.155 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:58 smithi045 ceph-mon[130284]: pgmap v513: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:58.155 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:58 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/4097429735' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:40:58.155 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:58 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2829072701' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-08-11T12:40:58.155 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:58 smithi045 ceph-mon[130284]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-08-11T12:40:58.155 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:58 smithi045 ceph-mon[130284]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-11T12:40:58.156 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:58 smithi045 ceph-mon[130284]: osdmap e111: 12 total, 12 up, 12 in 2023-08-11T12:40:58.156 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:58 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/2829072701' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-08-11T12:40:58.156 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:58 smithi045 ceph-mon[130284]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-08-11T12:40:58.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.331+0000 7fb2327ff700 1 -- 172.21.15.8:0/1951054714 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb22c1108b0 con 0x7fb22c101bc0 2023-08-11T12:40:58.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:58 smithi008 ceph-mon[97158]: pgmap v513: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-11T12:40:58.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:58 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/4097429735' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-11T12:40:58.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:58 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2829072701' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-08-11T12:40:58.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:58 smithi008 ceph-mon[97158]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-08-11T12:40:58.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:58 smithi008 ceph-mon[97158]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-11T12:40:58.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:58 smithi008 ceph-mon[97158]: osdmap e111: 12 total, 12 up, 12 in 2023-08-11T12:40:58.554 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:58 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/2829072701' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-08-11T12:40:58.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:58 smithi008 ceph-mon[97158]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-08-11T12:40:58.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.811+0000 7fb2297fa700 1 -- 172.21.15.8:0/1951054714 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v56) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb21c0951e0 con 0x7fb22c101bc0 2023-08-11T12:40:58.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.815+0000 7fb2327ff700 1 -- 172.21.15.8:0/1951054714 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb2140a0140 msgr2=0x7fb2140a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:58.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.816+0000 7fb2327ff700 1 --2- 172.21.15.8:0/1951054714 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb2140a0140 0x7fb2140a2600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb22c0ff530 tx=0x7fb220005fd0 comp rx=0 tx=0).stop 2023-08-11T12:40:58.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.816+0000 7fb2327ff700 1 -- 172.21.15.8:0/1951054714 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb22c101bc0 msgr2=0x7fb22c19c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:58.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.816+0000 7fb2327ff700 1 --2- 172.21.15.8:0/1951054714 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb22c101bc0 0x7fb22c19c8a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb21c00e9a0 tx=0x7fb21c00ecb0 comp rx=0 tx=0).stop 2023-08-11T12:40:58.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.816+0000 7fb2327ff700 1 -- 172.21.15.8:0/1951054714 shutdown_connections 2023-08-11T12:40:58.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.816+0000 7fb2327ff700 1 --2- 172.21.15.8:0/1951054714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb22c10af90 0x7fb22c196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:58.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.816+0000 7fb2327ff700 1 --2- 172.21.15.8:0/1951054714 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb22c101bc0 0x7fb22c19c8a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:58.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.816+0000 7fb2327ff700 1 --2- 172.21.15.8:0/1951054714 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fb2140a0140 0x7fb2140a2600 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:58.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.816+0000 7fb2327ff700 1 --2- 172.21.15.8:0/1951054714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb22c1024e0 0x7fb22c19cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:58.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.816+0000 7fb2327ff700 1 -- 172.21.15.8:0/1951054714 >> 172.21.15.8:0/1951054714 conn(0x7fb22c076a30 msgr2=0x7fb22c0fc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:58.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.817+0000 7fb2327ff700 1 -- 172.21.15.8:0/1951054714 shutdown_connections 2023-08-11T12:40:58.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:58.817+0000 7fb2327ff700 1 -- 172.21.15.8:0/1951054714 wait complete. 2023-08-11T12:40:58.842 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-11T12:40:59.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.055+0000 7ff102dff700 1 -- 172.21.15.8:0/4100765266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0fc10d1a0 msgr2=0x7ff0fc10f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:59.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.055+0000 7ff102dff700 1 --2- 172.21.15.8:0/4100765266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0fc10d1a0 0x7ff0fc10f610 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4009f90 tx=0x7ff0f400b330 comp rx=0 tx=0).stop 2023-08-11T12:40:59.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.056+0000 7ff102dff700 1 -- 172.21.15.8:0/4100765266 shutdown_connections 2023-08-11T12:40:59.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.056+0000 7ff102dff700 1 --2- 172.21.15.8:0/4100765266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0fc072d50 0x7ff0fc073130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:59.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.056+0000 7ff102dff700 1 --2- 172.21.15.8:0/4100765266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0fc10d1a0 0x7ff0fc10f610 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:59.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.056+0000 7ff102dff700 1 --2- 172.21.15.8:0/4100765266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0fc073670 0x7ff0fc10cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:59.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.056+0000 7ff102dff700 1 -- 172.21.15.8:0/4100765266 >> 172.21.15.8:0/4100765266 conn(0x7ff0fc0fc490 msgr2=0x7ff0fc0fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:40:59.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.056+0000 7ff102dff700 1 -- 172.21.15.8:0/4100765266 shutdown_connections 2023-08-11T12:40:59.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.056+0000 7ff102dff700 1 -- 172.21.15.8:0/4100765266 wait complete. 2023-08-11T12:40:59.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.057+0000 7ff102dff700 1 Processor -- start 2023-08-11T12:40:59.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.057+0000 7ff102dff700 1 -- start start 2023-08-11T12:40:59.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.058+0000 7ff102dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0fc072d50 0x7ff0fc198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:59.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.058+0000 7ff102dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0fc073670 0x7ff0fc199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:59.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.058+0000 7ff102dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0fc10d1a0 0x7ff0fc19d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:59.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.058+0000 7ff102dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc19dd30 con 0x7ff0fc073670 2023-08-11T12:40:59.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.058+0000 7ff102dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc19dea0 con 0x7ff0fc072d50 2023-08-11T12:40:59.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.058+0000 7ff102dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc19e060 con 0x7ff0fc10d1a0 2023-08-11T12:40:59.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.058+0000 7ff0fbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0fc073670 0x7ff0fc199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:59.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.058+0000 7ff100b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0fc072d50 0x7ff0fc198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:59.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.058+0000 7ff100b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0fc072d50 0x7ff0fc198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.8:33202/0 (socket says 172.21.15.8:33202) 2023-08-11T12:40:59.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.058+0000 7ff100b9b700 1 -- 172.21.15.8:0/3710961926 learned_addr learned my addr 172.21.15.8:0/3710961926 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:40:59.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.058+0000 7ff0fbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0fc073670 0x7ff0fc199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51258/0 (socket says 172.21.15.8:51258) 2023-08-11T12:40:59.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.058+0000 7ff10139c700 1 --2- 172.21.15.8:0/3710961926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0fc10d1a0 0x7ff0fc19d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:59.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.059+0000 7ff100b9b700 1 -- 172.21.15.8:0/3710961926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0fc10d1a0 msgr2=0x7ff0fc19d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:59.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.059+0000 7ff100b9b700 1 --2- 172.21.15.8:0/3710961926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0fc10d1a0 0x7ff0fc19d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:59.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.059+0000 7ff100b9b700 1 -- 172.21.15.8:0/3710961926 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0fc073670 msgr2=0x7ff0fc199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:40:59.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.059+0000 7ff100b9b700 1 --2- 172.21.15.8:0/3710961926 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0fc073670 0x7ff0fc199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:40:59.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.059+0000 7ff100b9b700 1 -- 172.21.15.8:0/3710961926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f00095f0 con 0x7ff0fc072d50 2023-08-11T12:40:59.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.059+0000 7ff0fbfff700 1 --2- 172.21.15.8:0/3710961926 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0fc073670 0x7ff0fc199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:40:59.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.059+0000 7ff100b9b700 1 --2- 172.21.15.8:0/3710961926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0fc072d50 0x7ff0fc198d50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000ec10 tx=0x7ff0f000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:59.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.060+0000 7ff0f9ffb700 1 -- 172.21.15.8:0/3710961926 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f000cc90 con 0x7ff0fc072d50 2023-08-11T12:40:59.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.060+0000 7ff0f9ffb700 1 -- 172.21.15.8:0/3710961926 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff0f00044e0 con 0x7ff0fc072d50 2023-08-11T12:40:59.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.060+0000 7ff102dff700 1 -- 172.21.15.8:0/3710961926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f4009c40 con 0x7ff0fc072d50 2023-08-11T12:40:59.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.060+0000 7ff0f9ffb700 1 -- 172.21.15.8:0/3710961926 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0010430 con 0x7ff0fc072d50 2023-08-11T12:40:59.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.060+0000 7ff102dff700 1 -- 172.21.15.8:0/3710961926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0fc19e530 con 0x7ff0fc072d50 2023-08-11T12:40:59.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.061+0000 7ff102dff700 1 -- 172.21.15.8:0/3710961926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0fc107ac0 con 0x7ff0fc072d50 2023-08-11T12:40:59.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.064+0000 7ff0f9ffb700 1 -- 172.21.15.8:0/3710961926 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7ff0f0004020 con 0x7ff0fc072d50 2023-08-11T12:40:59.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.066+0000 7ff0f9ffb700 1 --2- 172.21.15.8:0/3710961926 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff0ec0a0140 0x7ff0ec0a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:40:59.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.066+0000 7ff0f9ffb700 1 -- 172.21.15.8:0/3710961926 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 9708+0+0 (secure 0 0 0) 0x7ff0f0014070 con 0x7ff0fc072d50 2023-08-11T12:40:59.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.066+0000 7ff0fbfff700 1 --2- 172.21.15.8:0/3710961926 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff0ec0a0140 0x7ff0ec0a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:40:59.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.067+0000 7ff0fbfff700 1 --2- 172.21.15.8:0/3710961926 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff0ec0a0140 0x7ff0ec0a2600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc19a360 tx=0x7ff0e8009260 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:40:59.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.071+0000 7ff0f9ffb700 1 -- 172.21.15.8:0/3710961926 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7ff0f0095590 con 0x7ff0fc072d50 2023-08-11T12:40:59.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:40:59.281+0000 7ff102dff700 1 -- 172.21.15.8:0/3710961926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff0fc0677a0 con 0x7ff0fc072d50 2023-08-11T12:40:59.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:59 smithi008 ceph-mon[97158]: pgmap v515: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2023-08-11T12:40:59.303 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:59 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1951054714' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-08-11T12:40:59.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:59 smithi008 ceph-mon[97158]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-08-11T12:40:59.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:59 smithi008 ceph-mon[97158]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-08-11T12:40:59.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:59 smithi008 ceph-mon[97158]: Cluster is now healthy 2023-08-11T12:40:59.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:59 smithi008 ceph-mon[97158]: mds.? [v2:172.21.15.194:6832/2913600821,v1:172.21.15.194:6834/2913600821] up:boot 2023-08-11T12:40:59.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:59 smithi008 ceph-mon[97158]: mds.? [v2:172.21.15.45:6834/713582941,v1:172.21.15.45:6835/713582941] up:boot 2023-08-11T12:40:59.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:59 smithi008 ceph-mon[97158]: mds.? [v2:172.21.15.45:6836/3246398332,v1:172.21.15.45:6837/3246398332] up:boot 2023-08-11T12:40:59.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:59 smithi008 ceph-mon[97158]: mds.? [v2:172.21.15.45:6832/3100538408,v1:172.21.15.45:6833/3100538408] up:boot 2023-08-11T12:40:59.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:59 smithi008 ceph-mon[97158]: mds.? [v2:172.21.15.45:6838/1941377857,v1:172.21.15.45:6839/1941377857] up:boot 2023-08-11T12:40:59.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:59 smithi008 ceph-mon[97158]: mds.? [v2:172.21.15.194:6833/4018830047,v1:172.21.15.194:6835/4018830047] up:boot 2023-08-11T12:40:59.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:59 smithi008 ceph-mon[97158]: mds.? [v2:172.21.15.194:6836/1922879601,v1:172.21.15.194:6838/1922879601] up:boot 2023-08-11T12:40:59.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:59 smithi008 ceph-mon[97158]: mds.? [v2:172.21.15.194:6837/4178249852,v1:172.21.15.194:6839/4178249852] up:boot 2023-08-11T12:40:59.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:59 smithi008 ceph-mon[97158]: mds.? [v2:172.21.15.8:6838/2831308873,v1:172.21.15.8:6839/2831308873] up:boot 2023-08-11T12:40:59.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:59 smithi008 ceph-mon[97158]: mds.? [v2:172.21.15.8:6840/1150033191,v1:172.21.15.8:6841/1150033191] up:boot 2023-08-11T12:40:59.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:59 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/1951054714' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-08-11T12:40:59.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:59 smithi008 ceph-mon[97158]: fsmap 12 up:standby 2023-08-11T12:40:59.307 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:59 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-08-11T12:40:59.307 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:59 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-08-11T12:40:59.307 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:59 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-08-11T12:40:59.307 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:59 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-08-11T12:40:59.307 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:59 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-08-11T12:40:59.308 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:59 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-08-11T12:40:59.308 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:59 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-08-11T12:40:59.308 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:59 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-08-11T12:40:59.308 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:59 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-08-11T12:40:59.308 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:40:59 smithi008 ceph-mon[97158]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-08-11T12:40:59.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:59 smithi194 ceph-mon[130905]: pgmap v515: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2023-08-11T12:40:59.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:59 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1951054714' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-08-11T12:40:59.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:59 smithi194 ceph-mon[130905]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-08-11T12:40:59.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:59 smithi194 ceph-mon[130905]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-08-11T12:40:59.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:59 smithi194 ceph-mon[130905]: Cluster is now healthy 2023-08-11T12:40:59.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:59 smithi194 ceph-mon[130905]: mds.? [v2:172.21.15.194:6832/2913600821,v1:172.21.15.194:6834/2913600821] up:boot 2023-08-11T12:40:59.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:59 smithi194 ceph-mon[130905]: mds.? [v2:172.21.15.45:6834/713582941,v1:172.21.15.45:6835/713582941] up:boot 2023-08-11T12:40:59.395 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:59 smithi194 ceph-mon[130905]: mds.? [v2:172.21.15.45:6836/3246398332,v1:172.21.15.45:6837/3246398332] up:boot 2023-08-11T12:40:59.395 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:59 smithi194 ceph-mon[130905]: mds.? [v2:172.21.15.45:6832/3100538408,v1:172.21.15.45:6833/3100538408] up:boot 2023-08-11T12:40:59.395 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:59 smithi194 ceph-mon[130905]: mds.? [v2:172.21.15.45:6838/1941377857,v1:172.21.15.45:6839/1941377857] up:boot 2023-08-11T12:40:59.395 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:59 smithi194 ceph-mon[130905]: mds.? [v2:172.21.15.194:6833/4018830047,v1:172.21.15.194:6835/4018830047] up:boot 2023-08-11T12:40:59.395 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:59 smithi194 ceph-mon[130905]: mds.? [v2:172.21.15.194:6836/1922879601,v1:172.21.15.194:6838/1922879601] up:boot 2023-08-11T12:40:59.396 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:59 smithi194 ceph-mon[130905]: mds.? [v2:172.21.15.194:6837/4178249852,v1:172.21.15.194:6839/4178249852] up:boot 2023-08-11T12:40:59.396 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:59 smithi194 ceph-mon[130905]: mds.? [v2:172.21.15.8:6838/2831308873,v1:172.21.15.8:6839/2831308873] up:boot 2023-08-11T12:40:59.396 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:59 smithi194 ceph-mon[130905]: mds.? [v2:172.21.15.8:6840/1150033191,v1:172.21.15.8:6841/1150033191] up:boot 2023-08-11T12:40:59.396 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:59 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/1951054714' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-08-11T12:40:59.396 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:59 smithi194 ceph-mon[130905]: fsmap 12 up:standby 2023-08-11T12:40:59.397 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:59 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-08-11T12:40:59.397 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:59 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-08-11T12:40:59.397 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:59 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-08-11T12:40:59.397 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:59 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-08-11T12:40:59.397 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:59 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-08-11T12:40:59.398 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:59 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-08-11T12:40:59.398 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:59 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-08-11T12:40:59.398 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:59 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-08-11T12:40:59.398 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:59 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-08-11T12:40:59.398 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:40:59 smithi194 ceph-mon[130905]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-08-11T12:40:59.399 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:59 smithi045 ceph-mon[130284]: pgmap v515: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2023-08-11T12:40:59.399 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:59 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1951054714' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-08-11T12:40:59.399 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:59 smithi045 ceph-mon[130284]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-08-11T12:40:59.400 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:59 smithi045 ceph-mon[130284]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-08-11T12:40:59.400 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:59 smithi045 ceph-mon[130284]: Cluster is now healthy 2023-08-11T12:40:59.400 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:59 smithi045 ceph-mon[130284]: mds.? [v2:172.21.15.194:6832/2913600821,v1:172.21.15.194:6834/2913600821] up:boot 2023-08-11T12:40:59.400 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:59 smithi045 ceph-mon[130284]: mds.? [v2:172.21.15.45:6834/713582941,v1:172.21.15.45:6835/713582941] up:boot 2023-08-11T12:40:59.400 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:59 smithi045 ceph-mon[130284]: mds.? [v2:172.21.15.45:6836/3246398332,v1:172.21.15.45:6837/3246398332] up:boot 2023-08-11T12:40:59.401 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:59 smithi045 ceph-mon[130284]: mds.? [v2:172.21.15.45:6832/3100538408,v1:172.21.15.45:6833/3100538408] up:boot 2023-08-11T12:40:59.401 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:59 smithi045 ceph-mon[130284]: mds.? [v2:172.21.15.45:6838/1941377857,v1:172.21.15.45:6839/1941377857] up:boot 2023-08-11T12:40:59.401 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:59 smithi045 ceph-mon[130284]: mds.? [v2:172.21.15.194:6833/4018830047,v1:172.21.15.194:6835/4018830047] up:boot 2023-08-11T12:40:59.401 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:59 smithi045 ceph-mon[130284]: mds.? [v2:172.21.15.194:6836/1922879601,v1:172.21.15.194:6838/1922879601] up:boot 2023-08-11T12:40:59.401 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:59 smithi045 ceph-mon[130284]: mds.? [v2:172.21.15.194:6837/4178249852,v1:172.21.15.194:6839/4178249852] up:boot 2023-08-11T12:40:59.402 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:59 smithi045 ceph-mon[130284]: mds.? [v2:172.21.15.8:6838/2831308873,v1:172.21.15.8:6839/2831308873] up:boot 2023-08-11T12:40:59.402 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:59 smithi045 ceph-mon[130284]: mds.? [v2:172.21.15.8:6840/1150033191,v1:172.21.15.8:6841/1150033191] up:boot 2023-08-11T12:40:59.402 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:59 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/1951054714' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-08-11T12:40:59.402 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:59 smithi045 ceph-mon[130284]: fsmap 12 up:standby 2023-08-11T12:40:59.402 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:59 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-08-11T12:40:59.403 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:59 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-08-11T12:40:59.403 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:59 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-08-11T12:40:59.403 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:59 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-08-11T12:40:59.403 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:59 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-08-11T12:40:59.403 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:59 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-08-11T12:40:59.404 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:59 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-08-11T12:40:59.404 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:59 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-08-11T12:40:59.404 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:59 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-08-11T12:40:59.404 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:40:59 smithi045 ceph-mon[130284]: from='mgr.25601 172.21.15.8:0/1828862280' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-08-11T12:41:00.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.071+0000 7ff0f9ffb700 1 -- 172.21.15.8:0/3710961926 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v112) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff0f0093e60 con 0x7ff0fc072d50 2023-08-11T12:41:00.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.076+0000 7ff102dff700 1 -- 172.21.15.8:0/3710961926 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff0ec0a0140 msgr2=0x7ff0ec0a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:41:00.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.076+0000 7ff102dff700 1 --2- 172.21.15.8:0/3710961926 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff0ec0a0140 0x7ff0ec0a2600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc19a360 tx=0x7ff0e8009260 comp rx=0 tx=0).stop 2023-08-11T12:41:00.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.076+0000 7ff102dff700 1 -- 172.21.15.8:0/3710961926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0fc072d50 msgr2=0x7ff0fc198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:41:00.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.076+0000 7ff102dff700 1 --2- 172.21.15.8:0/3710961926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0fc072d50 0x7ff0fc198d50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000ec10 tx=0x7ff0f000ef20 comp rx=0 tx=0).stop 2023-08-11T12:41:00.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.076+0000 7ff102dff700 1 -- 172.21.15.8:0/3710961926 shutdown_connections 2023-08-11T12:41:00.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.076+0000 7ff102dff700 1 --2- 172.21.15.8:0/3710961926 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7ff0ec0a0140 0x7ff0ec0a2600 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:41:00.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.076+0000 7ff102dff700 1 --2- 172.21.15.8:0/3710961926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0fc10d1a0 0x7ff0fc19d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:41:00.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.076+0000 7ff102dff700 1 --2- 172.21.15.8:0/3710961926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0fc072d50 0x7ff0fc198d50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:41:00.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.076+0000 7ff102dff700 1 --2- 172.21.15.8:0/3710961926 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0fc073670 0x7ff0fc199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:41:00.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.076+0000 7ff102dff700 1 -- 172.21.15.8:0/3710961926 >> 172.21.15.8:0/3710961926 conn(0x7ff0fc0fc490 msgr2=0x7ff0fc104c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:41:00.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.077+0000 7ff102dff700 1 -- 172.21.15.8:0/3710961926 shutdown_connections 2023-08-11T12:41:00.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.077+0000 7ff102dff700 1 -- 172.21.15.8:0/3710961926 wait complete. 2023-08-11T12:41:00.082 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_metadata' removed 2023-08-11T12:41:00.103 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-11T12:41:00.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.318+0000 7fd76bbff700 1 -- 172.21.15.8:0/3220073673 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd764100960 msgr2=0x7fd764100de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:41:00.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.318+0000 7fd76bbff700 1 --2- 172.21.15.8:0/3220073673 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd764100960 0x7fd764100de0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd7540098f0 tx=0x7fd754009c00 comp rx=0 tx=0).stop 2023-08-11T12:41:00.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.318+0000 7fd76bbff700 1 -- 172.21.15.8:0/3220073673 shutdown_connections 2023-08-11T12:41:00.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.318+0000 7fd76bbff700 1 --2- 172.21.15.8:0/3220073673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd764106970 0x7fd764106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:41:00.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.318+0000 7fd76bbff700 1 --2- 172.21.15.8:0/3220073673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd764101320 0x7fd76410d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:41:00.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.318+0000 7fd76bbff700 1 --2- 172.21.15.8:0/3220073673 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd764100960 0x7fd764100de0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:41:00.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.318+0000 7fd76bbff700 1 -- 172.21.15.8:0/3220073673 >> 172.21.15.8:0/3220073673 conn(0x7fd7640fc490 msgr2=0x7fd7640fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:41:00.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.318+0000 7fd76bbff700 1 -- 172.21.15.8:0/3220073673 shutdown_connections 2023-08-11T12:41:00.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.318+0000 7fd76bbff700 1 -- 172.21.15.8:0/3220073673 wait complete. 2023-08-11T12:41:00.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.319+0000 7fd76bbff700 1 Processor -- start 2023-08-11T12:41:00.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.320+0000 7fd76bbff700 1 -- start start 2023-08-11T12:41:00.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.320+0000 7fd76bbff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd764100960 0x7fd764072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:41:00.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.320+0000 7fd76bbff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd764101320 0x7fd764073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:41:00.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.320+0000 7fd76bbff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd764106970 0x7fd7640736a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:41:00.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.320+0000 7fd76bbff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7641a4f80 con 0x7fd764106970 2023-08-11T12:41:00.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.320+0000 7fd76bbff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7641a50f0 con 0x7fd764100960 2023-08-11T12:41:00.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.320+0000 7fd76bbff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7641a52b0 con 0x7fd764101320 2023-08-11T12:41:00.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.321+0000 7fd76919a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd764101320 0x7fd764073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:41:00.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.321+0000 7fd76999b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd764100960 0x7fd764072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:41:00.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.321+0000 7fd76a19c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd764106970 0x7fd7640736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:41:00.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.321+0000 7fd76919a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd764101320 0x7fd764073160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:50486/0 (socket says 172.21.15.8:50486) 2023-08-11T12:41:00.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.321+0000 7fd76919a700 1 -- 172.21.15.8:0/3961740614 learned_addr learned my addr 172.21.15.8:0/3961740614 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:41:00.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.321+0000 7fd76919a700 1 -- 172.21.15.8:0/3961740614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd764100960 msgr2=0x7fd764072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:41:00.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.321+0000 7fd76919a700 1 --2- 172.21.15.8:0/3961740614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd764100960 0x7fd764072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:41:00.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.321+0000 7fd76919a700 1 -- 172.21.15.8:0/3961740614 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd764106970 msgr2=0x7fd7640736a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:41:00.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.321+0000 7fd76919a700 1 --2- 172.21.15.8:0/3961740614 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd764106970 0x7fd7640736a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:41:00.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.321+0000 7fd76919a700 1 -- 172.21.15.8:0/3961740614 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd754009520 con 0x7fd764101320 2023-08-11T12:41:00.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.321+0000 7fd76919a700 1 --2- 172.21.15.8:0/3961740614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd764101320 0x7fd764073160 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd754009810 tx=0x7fd75400fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:41:00.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.322+0000 7fd75affd700 1 -- 172.21.15.8:0/3961740614 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75401c070 con 0x7fd764101320 2023-08-11T12:41:00.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.322+0000 7fd76bbff700 1 -- 172.21.15.8:0/3961740614 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7641a5530 con 0x7fd764101320 2023-08-11T12:41:00.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.322+0000 7fd75affd700 1 -- 172.21.15.8:0/3961740614 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd75400bbd0 con 0x7fd764101320 2023-08-11T12:41:00.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.322+0000 7fd75affd700 1 -- 172.21.15.8:0/3961740614 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd754004930 con 0x7fd764101320 2023-08-11T12:41:00.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.322+0000 7fd76bbff700 1 -- 172.21.15.8:0/3961740614 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7641a5a60 con 0x7fd764101320 2023-08-11T12:41:00.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.323+0000 7fd76bbff700 1 -- 172.21.15.8:0/3961740614 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7640677a0 con 0x7fd764101320 2023-08-11T12:41:00.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.325+0000 7fd75affd700 1 -- 172.21.15.8:0/3961740614 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7fd754020070 con 0x7fd764101320 2023-08-11T12:41:00.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.327+0000 7fd75affd700 1 --2- 172.21.15.8:0/3961740614 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fd7500a00c0 0x7fd7500a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:41:00.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.327+0000 7fd75affd700 1 -- 172.21.15.8:0/3961740614 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 9212+0+0 (secure 0 0 0) 0x7fd7540cc9a0 con 0x7fd764101320 2023-08-11T12:41:00.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.327+0000 7fd76999b700 1 --2- 172.21.15.8:0/3961740614 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fd7500a00c0 0x7fd7500a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:41:00.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.328+0000 7fd76999b700 1 --2- 172.21.15.8:0/3961740614 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fd7500a00c0 0x7fd7500a2580 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd760005fd0 tx=0x7fd760009310 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:41:00.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.329+0000 7fd75affd700 1 -- 172.21.15.8:0/3961740614 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7fd754096170 con 0x7fd764101320 2023-08-11T12:41:00.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:41:00 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3710961926' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-08-11T12:41:00.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:41:00 smithi194 ceph-mon[130905]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-08-11T12:41:00.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:41:00 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3710961926' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-08-11T12:41:00.395 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:41:00 smithi045 ceph-mon[130284]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-08-11T12:41:00.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:00.538+0000 7fd76bbff700 1 -- 172.21.15.8:0/3961740614 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd7641108f0 con 0x7fd764101320 2023-08-11T12:41:00.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:41:00 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3710961926' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-08-11T12:41:00.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:41:00 smithi008 ceph-mon[97158]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-08-11T12:41:00.553 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:41:00 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:41:00.250+0000 7fecad688700 -1 client.15600: SimpleRADOSStriper: lock: snap_db_v0.db: lock failed: (2) No such file or directory 2023-08-11T12:41:00.554 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:41:00 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:41:00.251+0000 7fecad688700 -1 client.15600: SimpleRADOSStriper: lock: snap_db_v0.db: lock failed: (2) No such file or directory 2023-08-11T12:41:01.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.079+0000 7fd75affd700 1 -- 172.21.15.8:0/3961740614 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v113) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd754099790 con 0x7fd764101320 2023-08-11T12:41:01.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.083+0000 7fd76bbff700 1 -- 172.21.15.8:0/3961740614 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fd7500a00c0 msgr2=0x7fd7500a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:41:01.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.083+0000 7fd76bbff700 1 --2- 172.21.15.8:0/3961740614 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fd7500a00c0 0x7fd7500a2580 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd760005fd0 tx=0x7fd760009310 comp rx=0 tx=0).stop 2023-08-11T12:41:01.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.083+0000 7fd76bbff700 1 -- 172.21.15.8:0/3961740614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd764101320 msgr2=0x7fd764073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:41:01.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.083+0000 7fd76bbff700 1 --2- 172.21.15.8:0/3961740614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd764101320 0x7fd764073160 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd754009810 tx=0x7fd75400fa00 comp rx=0 tx=0).stop 2023-08-11T12:41:01.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.084+0000 7fd76bbff700 1 -- 172.21.15.8:0/3961740614 shutdown_connections 2023-08-11T12:41:01.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.084+0000 7fd76bbff700 1 --2- 172.21.15.8:0/3961740614 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd764106970 0x7fd7640736a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:41:01.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.084+0000 7fd76bbff700 1 --2- 172.21.15.8:0/3961740614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd764100960 0x7fd764072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:41:01.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.084+0000 7fd76bbff700 1 --2- 172.21.15.8:0/3961740614 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7fd7500a00c0 0x7fd7500a2580 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:41:01.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.084+0000 7fd76bbff700 1 --2- 172.21.15.8:0/3961740614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd764101320 0x7fd764073160 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:41:01.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.084+0000 7fd76bbff700 1 -- 172.21.15.8:0/3961740614 >> 172.21.15.8:0/3961740614 conn(0x7fd7640fc490 msgr2=0x7fd7640fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:41:01.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.084+0000 7fd76bbff700 1 -- 172.21.15.8:0/3961740614 shutdown_connections 2023-08-11T12:41:01.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.084+0000 7fd76bbff700 1 -- 172.21.15.8:0/3961740614 wait complete. 2023-08-11T12:41:01.089 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data' removed 2023-08-11T12:41:01.111 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-08-11T12:41:01.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.322+0000 7f5a8bfff700 1 -- 172.21.15.8:0/3876519856 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5a840735e0 msgr2=0x7f5a84111430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:41:01.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.323+0000 7f5a8bfff700 1 --2- 172.21.15.8:0/3876519856 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5a840735e0 0x7f5a84111430 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009990 tx=0x7f5a74009ca0 comp rx=0 tx=0).stop 2023-08-11T12:41:01.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.323+0000 7f5a8bfff700 1 -- 172.21.15.8:0/3876519856 shutdown_connections 2023-08-11T12:41:01.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.323+0000 7f5a8bfff700 1 --2- 172.21.15.8:0/3876519856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a84072cc0 0x7f5a840730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:41:01.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.323+0000 7f5a8bfff700 1 --2- 172.21.15.8:0/3876519856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a84111970 0x7f5a84113d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:41:01.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.323+0000 7f5a8bfff700 1 --2- 172.21.15.8:0/3876519856 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5a840735e0 0x7f5a84111430 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:41:01.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.323+0000 7f5a8bfff700 1 -- 172.21.15.8:0/3876519856 >> 172.21.15.8:0/3876519856 conn(0x7f5a840fc490 msgr2=0x7f5a840fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:41:01.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.323+0000 7f5a8bfff700 1 -- 172.21.15.8:0/3876519856 shutdown_connections 2023-08-11T12:41:01.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.323+0000 7f5a8bfff700 1 -- 172.21.15.8:0/3876519856 wait complete. 2023-08-11T12:41:01.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.324+0000 7f5a8bfff700 1 Processor -- start 2023-08-11T12:41:01.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.324+0000 7f5a8bfff700 1 -- start start 2023-08-11T12:41:01.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.324+0000 7f5a8bfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a84072cc0 0x7f5a8419d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:41:01.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.324+0000 7f5a8bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a840735e0 0x7f5a8419d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:41:01.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.324+0000 7f5a8bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5a84111970 0x7f5a841a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:41:01.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.324+0000 7f5a8bfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a841a2050 con 0x7f5a84111970 2023-08-11T12:41:01.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.324+0000 7f5a8bfff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a841a21c0 con 0x7f5a840735e0 2023-08-11T12:41:01.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.324+0000 7f5a8bfff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a841a2380 con 0x7f5a84072cc0 2023-08-11T12:41:01.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.325+0000 7f5a89d9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a84072cc0 0x7f5a8419d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:41:01.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.325+0000 7f5a89d9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a84072cc0 0x7f5a8419d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.8:50504/0 (socket says 172.21.15.8:50504) 2023-08-11T12:41:01.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.325+0000 7f5a89d9b700 1 -- 172.21.15.8:0/3122965170 learned_addr learned my addr 172.21.15.8:0/3122965170 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-08-11T12:41:01.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.325+0000 7f5a8959a700 1 --2- 172.21.15.8:0/3122965170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a840735e0 0x7f5a8419d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:41:01.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.325+0000 7f5a8a59c700 1 --2- 172.21.15.8:0/3122965170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5a84111970 0x7f5a841a1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:41:01.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.325+0000 7f5a8959a700 1 -- 172.21.15.8:0/3122965170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a84072cc0 msgr2=0x7f5a8419d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:41:01.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.325+0000 7f5a8959a700 1 --2- 172.21.15.8:0/3122965170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a84072cc0 0x7f5a8419d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:41:01.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.325+0000 7f5a8959a700 1 -- 172.21.15.8:0/3122965170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5a84111970 msgr2=0x7f5a841a1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:41:01.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.325+0000 7f5a8959a700 1 --2- 172.21.15.8:0/3122965170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5a84111970 0x7f5a841a1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:41:01.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.325+0000 7f5a8959a700 1 -- 172.21.15.8:0/3122965170 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a740095f0 con 0x7f5a840735e0 2023-08-11T12:41:01.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.325+0000 7f5a89d9b700 1 --2- 172.21.15.8:0/3122965170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a84072cc0 0x7f5a8419d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:41:01.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.325+0000 7f5a8a59c700 1 --2- 172.21.15.8:0/3122965170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5a84111970 0x7f5a841a1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-11T12:41:01.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.325+0000 7f5a8959a700 1 --2- 172.21.15.8:0/3122965170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a840735e0 0x7f5a8419d5b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5a740059d0 tx=0x7f5a74005720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:41:01.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.326+0000 7f5a7affd700 1 -- 172.21.15.8:0/3122965170 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7401d070 con 0x7f5a840735e0 2023-08-11T12:41:01.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.326+0000 7f5a8bfff700 1 -- 172.21.15.8:0/3122965170 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a841a2600 con 0x7f5a840735e0 2023-08-11T12:41:01.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.326+0000 7f5a7affd700 1 -- 172.21.15.8:0/3122965170 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5a74022470 con 0x7f5a840735e0 2023-08-11T12:41:01.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.326+0000 7f5a7affd700 1 -- 172.21.15.8:0/3122965170 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a74017650 con 0x7f5a840735e0 2023-08-11T12:41:01.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.326+0000 7f5a8bfff700 1 -- 172.21.15.8:0/3122965170 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a841a9ea0 con 0x7f5a840735e0 2023-08-11T12:41:01.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.327+0000 7f5a8bfff700 1 -- 172.21.15.8:0/3122965170 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a84103e90 con 0x7f5a840735e0 2023-08-11T12:41:01.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.329+0000 7f5a7affd700 1 -- 172.21.15.8:0/3122965170 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) v1 ==== 134801+0+0 (secure 0 0 0) 0x7f5a74022890 con 0x7f5a840735e0 2023-08-11T12:41:01.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.330+0000 7f5a7affd700 1 --2- 172.21.15.8:0/3122965170 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f5a700a00c0 0x7f5a700a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-11T12:41:01.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.330+0000 7f5a7affd700 1 -- 172.21.15.8:0/3122965170 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8682+0+0 (secure 0 0 0) 0x7f5a740cd0e0 con 0x7f5a840735e0 2023-08-11T12:41:01.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.330+0000 7f5a89d9b700 1 --2- 172.21.15.8:0/3122965170 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f5a700a00c0 0x7f5a700a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-11T12:41:01.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.331+0000 7f5a89d9b700 1 --2- 172.21.15.8:0/3122965170 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f5a700a00c0 0x7f5a700a2580 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5a80011550 tx=0x7f5a80009260 comp rx=0 tx=0).ready entity=mgr.25601 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-11T12:41:01.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.332+0000 7f5a7affd700 1 -- 172.21.15.8:0/3122965170 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179220 (secure 0 0 0) 0x7f5a74096ac0 con 0x7f5a840735e0 2023-08-11T12:41:01.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:41:01 smithi194 ceph-mon[130905]: pgmap v516: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2023-08-11T12:41:01.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:41:01 smithi194 ceph-mon[130905]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-08-11T12:41:01.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:41:01 smithi194 ceph-mon[130905]: osdmap e112: 12 total, 12 up, 12 in 2023-08-11T12:41:01.395 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:41:01 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3961740614' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-08-11T12:41:01.395 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:41:01 smithi194 ceph-mon[130905]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-08-11T12:41:01.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:41:01 smithi045 ceph-mon[130284]: pgmap v516: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2023-08-11T12:41:01.396 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:41:01 smithi045 ceph-mon[130284]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-08-11T12:41:01.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:41:01 smithi045 ceph-mon[130284]: osdmap e112: 12 total, 12 up, 12 in 2023-08-11T12:41:01.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:41:01 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3961740614' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-08-11T12:41:01.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:41:01 smithi045 ceph-mon[130284]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-08-11T12:41:01.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:01.547+0000 7f5a8bfff700 1 -- 172.21.15.8:0/3122965170 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5a8419e460 con 0x7f5a840735e0 2023-08-11T12:41:01.552 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:41:01 smithi008 ceph-mon[97158]: pgmap v516: 129 pgs: 129 active+clean; 5.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2023-08-11T12:41:01.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:41:01 smithi008 ceph-mon[97158]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-08-11T12:41:01.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:41:01 smithi008 ceph-mon[97158]: osdmap e112: 12 total, 12 up, 12 in 2023-08-11T12:41:01.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:41:01 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3961740614' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-08-11T12:41:01.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:41:01 smithi008 ceph-mon[97158]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-08-11T12:41:02.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:02.090+0000 7f5a7affd700 1 -- 172.21.15.8:0/3122965170 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v114) v1 ==== 178+0+0 (secure 0 0 0) 0x7f5a7409a0e0 con 0x7f5a840735e0 2023-08-11T12:41:02.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:02.094+0000 7f5a8bfff700 1 -- 172.21.15.8:0/3122965170 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f5a700a00c0 msgr2=0x7f5a700a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:41:02.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:02.094+0000 7f5a8bfff700 1 --2- 172.21.15.8:0/3122965170 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f5a700a00c0 0x7f5a700a2580 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5a80011550 tx=0x7f5a80009260 comp rx=0 tx=0).stop 2023-08-11T12:41:02.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:02.094+0000 7f5a8bfff700 1 -- 172.21.15.8:0/3122965170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a840735e0 msgr2=0x7f5a8419d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-11T12:41:02.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:02.094+0000 7f5a8bfff700 1 --2- 172.21.15.8:0/3122965170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a840735e0 0x7f5a8419d5b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5a740059d0 tx=0x7f5a74005720 comp rx=0 tx=0).stop 2023-08-11T12:41:02.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:02.094+0000 7f5a8bfff700 1 -- 172.21.15.8:0/3122965170 shutdown_connections 2023-08-11T12:41:02.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:02.094+0000 7f5a8bfff700 1 --2- 172.21.15.8:0/3122965170 >> [v2:172.21.15.8:6800/3843802949,v1:172.21.15.8:6801/3843802949] conn(0x7f5a700a00c0 0x7f5a700a2580 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:41:02.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:02.094+0000 7f5a8bfff700 1 --2- 172.21.15.8:0/3122965170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a84072cc0 0x7f5a8419d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:41:02.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:02.094+0000 7f5a8bfff700 1 --2- 172.21.15.8:0/3122965170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5a84111970 0x7f5a841a1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:41:02.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:02.094+0000 7f5a8bfff700 1 --2- 172.21.15.8:0/3122965170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a840735e0 0x7f5a8419d5b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-11T12:41:02.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:02.094+0000 7f5a8bfff700 1 -- 172.21.15.8:0/3122965170 >> 172.21.15.8:0/3122965170 conn(0x7f5a840fc490 msgr2=0x7f5a840fd100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-11T12:41:02.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:02.094+0000 7f5a8bfff700 1 -- 172.21.15.8:0/3122965170 shutdown_connections 2023-08-11T12:41:02.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-11T12:41:02.094+0000 7f5a8bfff700 1 -- 172.21.15.8:0/3122965170 wait complete. 2023-08-11T12:41:02.100 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data_ec' removed 2023-08-11T12:41:02.122 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-08-11T12:41:02.203 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-08-11T12:41:02.236 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-08-11T12:41:02.268 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-08-11T12:41:02.269 DEBUG:teuthology.orchestra.run.smithi008:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-08-11T12:41:02.312 DEBUG:teuthology.orchestra.run.smithi045:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-08-11T12:41:02.330 DEBUG:teuthology.orchestra.run.smithi194:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-08-11T12:41:02.347 INFO:tasks.cephadm:Stopping all daemons... 2023-08-11T12:41:02.348 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-08-11T12:41:02.349 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mon.a 2023-08-11T12:41:02.392 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:41:02 smithi194 ceph-mon[130905]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2023-08-11T12:41:02.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:41:02 smithi194 ceph-mon[130905]: osdmap e113: 12 total, 12 up, 12 in 2023-08-11T12:41:02.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:41:02 smithi194 ceph-mon[130905]: from='client.? 172.21.15.8:0/3122965170' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2023-08-11T12:41:02.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:41:02 smithi194 ceph-mon[130905]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2023-08-11T12:41:02.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:41:02 smithi045 ceph-mon[130284]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2023-08-11T12:41:02.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:41:02 smithi045 ceph-mon[130284]: osdmap e113: 12 total, 12 up, 12 in 2023-08-11T12:41:02.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:41:02 smithi045 ceph-mon[130284]: from='client.? 172.21.15.8:0/3122965170' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2023-08-11T12:41:02.397 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:41:02 smithi045 ceph-mon[130284]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2023-08-11T12:41:02.452 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:41:02 smithi008 ceph-mon[97158]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2023-08-11T12:41:02.453 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:41:02 smithi008 ceph-mon[97158]: osdmap e113: 12 total, 12 up, 12 in 2023-08-11T12:41:02.453 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:41:02 smithi008 ceph-mon[97158]: from='client.? 172.21.15.8:0/3122965170' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2023-08-11T12:41:02.453 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:41:02 smithi008 ceph-mon[97158]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2023-08-11T12:41:02.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:41:02 smithi008 systemd[1]: Stopping Ceph mon.a for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:41:03.269 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:41:02 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mon-a[97134]: 2023-08-11T12:41:02.968+0000 7f0e4ec14700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:41:03.269 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:41:02 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mon-a[97134]: 2023-08-11T12:41:02.968+0000 7f0e4ec14700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2023-08-11T12:41:03.973 INFO:journalctl@ceph.mon.a.smithi008.stdout:Aug 11 12:41:03 smithi008 bash[160049]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mon-a 2023-08-11T12:41:04.004 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mon.a.service' 2023-08-11T12:41:04.102 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:41:04.103 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-08-11T12:41:04.103 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2023-08-11T12:41:04.104 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mon.b 2023-08-11T12:41:04.394 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:41:04 smithi045 systemd[1]: Stopping Ceph mon.b for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:41:04.764 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:41:04 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mon-b[130260]: 2023-08-11T12:41:04.499+0000 7faed7c75700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:41:04.765 INFO:journalctl@ceph.mon.b.smithi045.stdout:Aug 11 12:41:04 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mon-b[130260]: 2023-08-11T12:41:04.499+0000 7faed7c75700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2023-08-11T12:41:05.242 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mon.b.service' 2023-08-11T12:41:05.291 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:41:05.292 INFO:tasks.cephadm.mon.c:Stopped mon.b 2023-08-11T12:41:05.292 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2023-08-11T12:41:05.293 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mon.c 2023-08-11T12:41:05.642 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:41:05 smithi194 systemd[1]: Stopping Ceph mon.c for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:41:05.936 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:41:05 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mon-c[130866]: 2023-08-11T12:41:05.652+0000 7fdf9215b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:41:05.937 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:41:05 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mon-c[130866]: 2023-08-11T12:41:05.652+0000 7fdf9215b700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2023-08-11T12:41:06.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Aug 11 12:41:05 smithi194 bash[163713]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mon-c 2023-08-11T12:41:06.205 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mon.c.service' 2023-08-11T12:41:06.261 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:41:06.262 INFO:tasks.cephadm.mon.c:Stopped mon.c 2023-08-11T12:41:06.262 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2023-08-11T12:41:06.262 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mgr.x 2023-08-11T12:41:06.797 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:41:06 smithi008 systemd[1]: Stopping Ceph mgr.x for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:41:07.053 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:41:06 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:41:06.793+0000 7fed61387700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:41:07.053 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:41:06 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x[97403]: 2023-08-11T12:41:06.793+0000 7fed61387700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-08-11T12:41:07.553 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Aug 11 12:41:07 smithi008 bash[160190]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-x 2023-08-11T12:41:07.587 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mgr.x.service' 2023-08-11T12:41:07.676 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:41:07.677 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2023-08-11T12:41:07.677 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2023-08-11T12:41:07.677 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mgr.y 2023-08-11T12:41:08.107 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:41:07 smithi045 systemd[1]: Stopping Ceph mgr.y for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:41:08.394 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:41:08 smithi045 bash[162915]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-y 2023-08-11T12:41:08.395 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Aug 11 12:41:08 smithi045 systemd[1]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mgr.y.service: Main process exited, code=exited, status=143/n/a 2023-08-11T12:41:08.484 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mgr.y.service' 2023-08-11T12:41:08.521 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:41:08.522 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2023-08-11T12:41:08.522 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2023-08-11T12:41:08.523 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mgr.z 2023-08-11T12:41:08.893 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:41:08 smithi194 systemd[1]: Stopping Ceph mgr.z for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:41:10.621 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:41:10 smithi194 bash[163852]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mgr-z 2023-08-11T12:41:10.622 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:41:10 smithi194 systemd[1]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mgr.z.service: Main process exited, code=exited, status=143/n/a 2023-08-11T12:41:10.624 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mgr.z.service' 2023-08-11T12:41:10.642 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:41:10 smithi194 systemd[1]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mgr.z.service: Failed with result 'exit-code'. 2023-08-11T12:41:10.643 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Aug 11 12:41:10 smithi194 systemd[1]: Stopped Ceph mgr.z for 815f94ae-3840-11ee-9b37-001a4aab830c. 2023-08-11T12:41:10.661 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:41:10.662 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2023-08-11T12:41:10.662 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-08-11T12:41:10.663 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.0 2023-08-11T12:41:11.053 INFO:journalctl@ceph.osd.0.smithi008.stdout:Aug 11 12:41:10 smithi008 systemd[1]: Stopping Ceph osd.0 for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:41:11.552 INFO:journalctl@ceph.osd.0.smithi008.stdout:Aug 11 12:41:11 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-0[110043]: 2023-08-11T12:41:11.227+0000 7f7cf0661700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:41:11.553 INFO:journalctl@ceph.osd.0.smithi008.stdout:Aug 11 12:41:11 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-0[110043]: 2023-08-11T12:41:11.227+0000 7f7cf0661700 -1 osd.0 114 *** Got signal Terminated *** 2023-08-11T12:41:11.553 INFO:journalctl@ceph.osd.0.smithi008.stdout:Aug 11 12:41:11 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-0[110043]: 2023-08-11T12:41:11.227+0000 7f7cf0661700 -1 osd.0 114 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-11T12:41:17.303 INFO:journalctl@ceph.osd.0.smithi008.stdout:Aug 11 12:41:17 smithi008 bash[160335]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-0 2023-08-11T12:41:19.802 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.0.service' 2023-08-11T12:41:19.899 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:41:19.900 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-08-11T12:41:19.901 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-08-11T12:41:19.901 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.1 2023-08-11T12:41:20.258 INFO:journalctl@ceph.osd.1.smithi045.stdout:Aug 11 12:41:19 smithi045 systemd[1]: Stopping Ceph osd.1 for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:41:20.645 INFO:journalctl@ceph.osd.1.smithi045.stdout:Aug 11 12:41:20 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-1[135362]: 2023-08-11T12:41:20.255+0000 7fa30c997700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:41:20.645 INFO:journalctl@ceph.osd.1.smithi045.stdout:Aug 11 12:41:20 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-1[135362]: 2023-08-11T12:41:20.255+0000 7fa30c997700 -1 osd.1 114 *** Got signal Terminated *** 2023-08-11T12:41:20.645 INFO:journalctl@ceph.osd.1.smithi045.stdout:Aug 11 12:41:20 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-1[135362]: 2023-08-11T12:41:20.255+0000 7fa30c997700 -1 osd.1 114 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-11T12:41:25.942 INFO:journalctl@ceph.osd.1.smithi045.stdout:Aug 11 12:41:25 smithi045 bash[163058]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-1 2023-08-11T12:41:27.617 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.1.service' 2023-08-11T12:41:27.659 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:41:27.660 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-08-11T12:41:27.660 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-08-11T12:41:27.662 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.2 2023-08-11T12:41:28.027 INFO:journalctl@ceph.osd.2.smithi194.stdout:Aug 11 12:41:27 smithi194 systemd[1]: Stopping Ceph osd.2 for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:41:28.392 INFO:journalctl@ceph.osd.2.smithi194.stdout:Aug 11 12:41:28 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-2[136715]: 2023-08-11T12:41:28.024+0000 7ffbd104c700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:41:28.393 INFO:journalctl@ceph.osd.2.smithi194.stdout:Aug 11 12:41:28 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-2[136715]: 2023-08-11T12:41:28.024+0000 7ffbd104c700 -1 osd.2 114 *** Got signal Terminated *** 2023-08-11T12:41:28.393 INFO:journalctl@ceph.osd.2.smithi194.stdout:Aug 11 12:41:28 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-2[136715]: 2023-08-11T12:41:28.024+0000 7ffbd104c700 -1 osd.2 114 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-11T12:41:33.892 INFO:journalctl@ceph.osd.2.smithi194.stdout:Aug 11 12:41:33 smithi194 bash[164008]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-2 2023-08-11T12:41:35.069 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.2.service' 2023-08-11T12:41:35.111 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:41:35.112 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-08-11T12:41:35.112 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-08-11T12:41:35.113 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.3 2023-08-11T12:41:35.552 INFO:journalctl@ceph.osd.3.smithi008.stdout:Aug 11 12:41:35 smithi008 systemd[1]: Stopping Ceph osd.3 for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:41:36.053 INFO:journalctl@ceph.osd.3.smithi008.stdout:Aug 11 12:41:35 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-3[115429]: 2023-08-11T12:41:35.632+0000 7fb066ca3700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:41:36.053 INFO:journalctl@ceph.osd.3.smithi008.stdout:Aug 11 12:41:35 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-3[115429]: 2023-08-11T12:41:35.632+0000 7fb066ca3700 -1 osd.3 114 *** Got signal Terminated *** 2023-08-11T12:41:36.053 INFO:journalctl@ceph.osd.3.smithi008.stdout:Aug 11 12:41:35 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-3[115429]: 2023-08-11T12:41:35.632+0000 7fb066ca3700 -1 osd.3 114 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-11T12:41:37.892 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:37 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:37.531+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:41:38.810 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:38 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:38.549+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:41:39.142 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:38 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:38.809+0000 7f665656a700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:15.904304+0000 front 2023-08-11T12:41:15.904198+0000 (oldest deadline 2023-08-11T12:41:38.204240+0000) 2023-08-11T12:41:39.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:38 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:38.803+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:41:39.851 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:39 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:39.517+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:41:40.143 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:39 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:39.850+0000 7f665656a700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:15.904304+0000 front 2023-08-11T12:41:15.904198+0000 (oldest deadline 2023-08-11T12:41:38.204240+0000) 2023-08-11T12:41:40.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:39 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:39.844+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:41:40.848 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:40 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:40.496+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:41:40.894 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:40 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:40.561+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:41:41.142 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:40 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:40.847+0000 7f665656a700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:15.904304+0000 front 2023-08-11T12:41:15.904198+0000 (oldest deadline 2023-08-11T12:41:38.204240+0000) 2023-08-11T12:41:41.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:40 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:40.887+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:41:41.802 INFO:journalctl@ceph.osd.3.smithi008.stdout:Aug 11 12:41:41 smithi008 bash[160614]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-3 2023-08-11T12:41:41.819 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:41 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:41.464+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:41:41.894 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:41 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:41.568+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:41:42.142 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:41 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:41.817+0000 7f665656a700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:15.904304+0000 front 2023-08-11T12:41:15.904198+0000 (oldest deadline 2023-08-11T12:41:38.204240+0000) 2023-08-11T12:41:42.302 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:41 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:41.851+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:41:42.792 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:42 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:42.417+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:41:42.894 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:42 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:42.611+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:41:43.142 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:42 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:42.791+0000 7f665656a700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:15.904304+0000 front 2023-08-11T12:41:15.904198+0000 (oldest deadline 2023-08-11T12:41:38.204240+0000) 2023-08-11T12:41:43.164 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:42 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:42.868+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:41:43.487 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.3.service' 2023-08-11T12:41:43.580 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:41:43.580 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-08-11T12:41:43.581 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-08-11T12:41:43.581 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.4 2023-08-11T12:41:43.788 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:43 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:43.397+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:41:43.895 INFO:journalctl@ceph.osd.4.smithi045.stdout:Aug 11 12:41:43 smithi045 systemd[1]: Stopping Ceph osd.4 for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:41:43.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:43 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:43.597+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:41:44.143 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:43 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:43.787+0000 7f665656a700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:15.904304+0000 front 2023-08-11T12:41:15.904198+0000 (oldest deadline 2023-08-11T12:41:38.204240+0000) 2023-08-11T12:41:44.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:43 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:43.887+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:41:44.395 INFO:journalctl@ceph.osd.4.smithi045.stdout:Aug 11 12:41:43 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-4[140874]: 2023-08-11T12:41:43.943+0000 7fe00a75b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:41:44.395 INFO:journalctl@ceph.osd.4.smithi045.stdout:Aug 11 12:41:43 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-4[140874]: 2023-08-11T12:41:43.943+0000 7fe00a75b700 -1 osd.4 114 *** Got signal Terminated *** 2023-08-11T12:41:44.396 INFO:journalctl@ceph.osd.4.smithi045.stdout:Aug 11 12:41:43 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-4[140874]: 2023-08-11T12:41:43.943+0000 7fe00a75b700 -1 osd.4 114 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-11T12:41:44.642 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:44 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:44.380+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:41:44.894 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:44 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:44.619+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:41:45.142 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:44 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:44.784+0000 7f665656a700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:15.904304+0000 front 2023-08-11T12:41:15.904198+0000 (oldest deadline 2023-08-11T12:41:38.204240+0000) 2023-08-11T12:41:45.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:44 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:44.920+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:41:45.790 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:45 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:45.399+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:41:45.894 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:45 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:45.629+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:41:46.142 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:45 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:45.789+0000 7f665656a700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:15.904304+0000 front 2023-08-11T12:41:15.904198+0000 (oldest deadline 2023-08-11T12:41:38.204240+0000) 2023-08-11T12:41:46.302 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:45 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:45.914+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:41:46.743 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:46 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:46.448+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:41:46.894 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:46 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:46.588+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:41:47.142 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:46 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:46.741+0000 7f665656a700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:15.904304+0000 front 2023-08-11T12:41:15.904198+0000 (oldest deadline 2023-08-11T12:41:38.204240+0000) 2023-08-11T12:41:47.143 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:41:46 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:41:46.976+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:41:47.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:46 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:46.931+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:41:47.756 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:47 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:47.488+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:41:47.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:47 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:47.557+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:41:47.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:47 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:47.557+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:41:48.142 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:47 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:47.754+0000 7f665656a700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:15.904304+0000 front 2023-08-11T12:41:15.904198+0000 (oldest deadline 2023-08-11T12:41:38.204240+0000) 2023-08-11T12:41:48.143 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:41:47 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:41:47.963+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:41:48.302 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:47 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:47.904+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:41:48.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:47 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:47.904+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:41:48.394 INFO:journalctl@ceph.osd.4.smithi045.stdout:Aug 11 12:41:47 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-4[140874]: 2023-08-11T12:41:47.982+0000 7fe002d49700 -1 osd.4 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:25.100173+0000 front 2023-08-11T12:41:25.100208+0000 (oldest deadline 2023-08-11T12:41:47.900843+0000) 2023-08-11T12:41:48.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:41:47 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:41:47.966+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:21.985094+0000 front 2023-08-11T12:41:21.985044+0000 (oldest deadline 2023-08-11T12:41:47.885275+0000) 2023-08-11T12:41:48.803 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:41:48 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:41:48.539+0000 7f20de38a700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:25.105429+0000 front 2023-08-11T12:41:25.105462+0000 (oldest deadline 2023-08-11T12:41:48.005361+0000) 2023-08-11T12:41:48.892 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:48 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:48.538+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:41:48.893 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:48 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:48.709+0000 7f665656a700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:15.904304+0000 front 2023-08-11T12:41:15.904198+0000 (oldest deadline 2023-08-11T12:41:38.204240+0000) 2023-08-11T12:41:48.893 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:48 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:48.709+0000 7f665656a700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.905662+0000 front 2023-08-11T12:41:22.905746+0000 (oldest deadline 2023-08-11T12:41:48.205722+0000) 2023-08-11T12:41:48.894 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:48 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:48.576+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:41:48.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:48 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:48.576+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:41:49.302 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:48 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:48.887+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:41:49.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:48 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:48.887+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:41:49.392 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:41:48 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:41:48.942+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:41:49.394 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:41:48 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:41:48.927+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:21.985094+0000 front 2023-08-11T12:41:21.985044+0000 (oldest deadline 2023-08-11T12:41:47.885275+0000) 2023-08-11T12:41:49.802 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:41:49 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:41:49.527+0000 7f20de38a700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:25.105429+0000 front 2023-08-11T12:41:25.105462+0000 (oldest deadline 2023-08-11T12:41:48.005361+0000) 2023-08-11T12:41:49.892 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:49 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:49.683+0000 7f665656a700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:15.904304+0000 front 2023-08-11T12:41:15.904198+0000 (oldest deadline 2023-08-11T12:41:38.204240+0000) 2023-08-11T12:41:49.893 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:49 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:49.683+0000 7f665656a700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.905662+0000 front 2023-08-11T12:41:22.905746+0000 (oldest deadline 2023-08-11T12:41:48.205722+0000) 2023-08-11T12:41:49.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:49 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:49.527+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:41:49.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:49 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:49.527+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:41:49.894 INFO:journalctl@ceph.osd.4.smithi045.stdout:Aug 11 12:41:49 smithi045 bash[163331]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-4 2023-08-11T12:41:49.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:49 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:49.578+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:41:49.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:49 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:49.579+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:41:50.302 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:49 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:49.871+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:41:50.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:49 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:49.871+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:41:50.392 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:41:49 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:41:49.916+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:41:50.394 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:41:49 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:41:49.927+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:21.985094+0000 front 2023-08-11T12:41:21.985044+0000 (oldest deadline 2023-08-11T12:41:47.885275+0000) 2023-08-11T12:41:50.803 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:41:50 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:41:50.489+0000 7f20de38a700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:25.105429+0000 front 2023-08-11T12:41:25.105462+0000 (oldest deadline 2023-08-11T12:41:48.005361+0000) 2023-08-11T12:41:50.849 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:50 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:50.538+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:41:50.850 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:50 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:50.538+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:41:50.893 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:50 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:50.705+0000 7f665656a700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:15.904304+0000 front 2023-08-11T12:41:15.904198+0000 (oldest deadline 2023-08-11T12:41:38.204240+0000) 2023-08-11T12:41:50.893 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:50 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:50.705+0000 7f665656a700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.905662+0000 front 2023-08-11T12:41:22.905746+0000 (oldest deadline 2023-08-11T12:41:48.205722+0000) 2023-08-11T12:41:50.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:50 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:50.568+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:41:50.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:50 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:50.568+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:41:51.145 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:41:50 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:41:50.919+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:21.985094+0000 front 2023-08-11T12:41:21.985044+0000 (oldest deadline 2023-08-11T12:41:47.885275+0000) 2023-08-11T12:41:51.167 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.4.service' 2023-08-11T12:41:51.209 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:41:51.209 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-08-11T12:41:51.210 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-08-11T12:41:51.210 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.5 2023-08-11T12:41:51.239 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:41:50 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:41:50.934+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:41:51.302 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:50 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:50.884+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:41:51.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:50 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:50.884+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:41:51.530 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:51 smithi194 systemd[1]: Stopping Ceph osd.5 for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:41:51.802 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:41:51 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:41:51.446+0000 7f20de38a700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:25.105429+0000 front 2023-08-11T12:41:25.105462+0000 (oldest deadline 2023-08-11T12:41:48.005361+0000) 2023-08-11T12:41:51.892 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:51 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:51.527+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:41:51.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:51 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:51.527+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:41:51.893 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:51 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:51.556+0000 7f665c779700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:41:51.894 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:51 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:51.556+0000 7f665c779700 -1 osd.5 114 *** Got signal Terminated *** 2023-08-11T12:41:51.894 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:51 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:51.556+0000 7f665c779700 -1 osd.5 114 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-11T12:41:51.894 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:51 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:51.661+0000 7f665656a700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:15.904304+0000 front 2023-08-11T12:41:15.904198+0000 (oldest deadline 2023-08-11T12:41:38.204240+0000) 2023-08-11T12:41:51.895 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:51 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:51.661+0000 7f665656a700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.905662+0000 front 2023-08-11T12:41:22.905746+0000 (oldest deadline 2023-08-11T12:41:48.205722+0000) 2023-08-11T12:41:51.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:51 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:51.553+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:41:51.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:51 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:51.553+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:41:52.302 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:51 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:51.858+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:41:52.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:51 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:51.858+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:41:52.392 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:41:51 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:41:51.907+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:41:52.394 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:41:51 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:41:51.903+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:21.985094+0000 front 2023-08-11T12:41:21.985044+0000 (oldest deadline 2023-08-11T12:41:47.885275+0000) 2023-08-11T12:41:52.802 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:41:52 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:41:52.476+0000 7f20de38a700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:25.105429+0000 front 2023-08-11T12:41:25.105462+0000 (oldest deadline 2023-08-11T12:41:48.005361+0000) 2023-08-11T12:41:52.867 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:52 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:52.525+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:41:52.868 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:52 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:52.525+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:41:52.892 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:52 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:52.679+0000 7f665656a700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:15.904304+0000 front 2023-08-11T12:41:15.904198+0000 (oldest deadline 2023-08-11T12:41:38.204240+0000) 2023-08-11T12:41:52.893 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:52 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:52.679+0000 7f665656a700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.905662+0000 front 2023-08-11T12:41:22.905746+0000 (oldest deadline 2023-08-11T12:41:48.205722+0000) 2023-08-11T12:41:52.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:52 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:52.550+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:41:52.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:52 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:52.550+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:41:53.144 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:41:52 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:41:52.866+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:21.985094+0000 front 2023-08-11T12:41:21.985044+0000 (oldest deadline 2023-08-11T12:41:47.885275+0000) 2023-08-11T12:41:53.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:52 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:52.836+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:41:53.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:52 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:52.836+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:41:53.393 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:41:52 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:41:52.896+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:41:53.802 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:41:53 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:41:53.490+0000 7f20de38a700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:25.105429+0000 front 2023-08-11T12:41:25.105462+0000 (oldest deadline 2023-08-11T12:41:48.005361+0000) 2023-08-11T12:41:53.851 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:53 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:53.718+0000 7f665656a700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:15.904304+0000 front 2023-08-11T12:41:15.904198+0000 (oldest deadline 2023-08-11T12:41:38.204240+0000) 2023-08-11T12:41:53.852 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:53 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:53.718+0000 7f665656a700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.905662+0000 front 2023-08-11T12:41:22.905746+0000 (oldest deadline 2023-08-11T12:41:48.205722+0000) 2023-08-11T12:41:53.852 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:53 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:53.566+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:41:53.852 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:53 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:53.566+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:41:53.882 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:53 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:53.514+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:41:53.883 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:53 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:53.514+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:41:54.142 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:41:53 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:41:53.849+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:41:54.144 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:41:53 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:41:53.880+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:21.985094+0000 front 2023-08-11T12:41:21.985044+0000 (oldest deadline 2023-08-11T12:41:47.885275+0000) 2023-08-11T12:41:54.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:53 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:53.848+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:41:54.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:53 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:53.848+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:41:54.803 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:41:54 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:41:54.492+0000 7f20de38a700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:25.105429+0000 front 2023-08-11T12:41:25.105462+0000 (oldest deadline 2023-08-11T12:41:48.005361+0000) 2023-08-11T12:41:54.892 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:41:54 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:41:54.839+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:41:54.893 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:54 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:54.738+0000 7f665656a700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:15.904304+0000 front 2023-08-11T12:41:15.904198+0000 (oldest deadline 2023-08-11T12:41:38.204240+0000) 2023-08-11T12:41:54.894 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:54 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:54.738+0000 7f665656a700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.905662+0000 front 2023-08-11T12:41:22.905746+0000 (oldest deadline 2023-08-11T12:41:48.205722+0000) 2023-08-11T12:41:54.894 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:54 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:54.738+0000 7f665656a700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:28.706803+0000 front 2023-08-11T12:41:28.706826+0000 (oldest deadline 2023-08-11T12:41:54.606965+0000) 2023-08-11T12:41:54.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:54 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:54.598+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:41:54.895 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:54 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:54.598+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:41:54.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:54 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:54.551+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:41:54.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:54 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:54.551+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:41:54.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:54 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:54.551+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:41:55.302 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:54 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:54.887+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:41:55.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:54 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:54.887+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:41:55.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:54 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:54.887+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:41:55.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:41:54 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:41:54.920+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:21.985094+0000 front 2023-08-11T12:41:21.985044+0000 (oldest deadline 2023-08-11T12:41:47.885275+0000) 2023-08-11T12:41:55.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:41:54 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:41:54.920+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:32.586511+0000 front 2023-08-11T12:41:32.586438+0000 (oldest deadline 2023-08-11T12:41:54.286599+0000) 2023-08-11T12:41:55.802 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:41:55 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:41:55.518+0000 7f20de38a700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:25.105429+0000 front 2023-08-11T12:41:25.105462+0000 (oldest deadline 2023-08-11T12:41:48.005361+0000) 2023-08-11T12:41:55.892 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:55 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:55.736+0000 7f665656a700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:15.904304+0000 front 2023-08-11T12:41:15.904198+0000 (oldest deadline 2023-08-11T12:41:38.204240+0000) 2023-08-11T12:41:55.893 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:55 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:55.736+0000 7f665656a700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.905662+0000 front 2023-08-11T12:41:22.905746+0000 (oldest deadline 2023-08-11T12:41:48.205722+0000) 2023-08-11T12:41:55.893 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:55 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5[142059]: 2023-08-11T12:41:55.736+0000 7f665656a700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:28.706803+0000 front 2023-08-11T12:41:28.706826+0000 (oldest deadline 2023-08-11T12:41:54.606965+0000) 2023-08-11T12:41:55.894 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:41:55 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:41:55.847+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:41:55.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:55 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:55.615+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:41:55.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:55 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:55.615+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:41:55.895 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:55 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:55.615+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:41:55.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:55 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:55.557+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:41:55.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:55 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:55.557+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:41:55.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:55 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:55.557+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:41:56.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:55 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:55.861+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:41:56.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:55 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:55.861+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:41:56.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:55 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:55.861+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:41:56.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:41:55 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:41:55.939+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:21.985094+0000 front 2023-08-11T12:41:21.985044+0000 (oldest deadline 2023-08-11T12:41:47.885275+0000) 2023-08-11T12:41:56.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:41:55 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:41:55.939+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:32.586511+0000 front 2023-08-11T12:41:32.586438+0000 (oldest deadline 2023-08-11T12:41:54.286599+0000) 2023-08-11T12:41:56.802 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:41:56 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:41:56.529+0000 7f20de38a700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:25.105429+0000 front 2023-08-11T12:41:25.105462+0000 (oldest deadline 2023-08-11T12:41:48.005361+0000) 2023-08-11T12:41:56.803 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:41:56 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:41:56.529+0000 7f20de38a700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.207010+0000 front 2023-08-11T12:41:30.206875+0000 (oldest deadline 2023-08-11T12:41:56.106787+0000) 2023-08-11T12:41:56.894 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:56 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:56.567+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:41:56.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:56 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:56.567+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:41:56.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:56 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:56.567+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:41:57.142 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:41:56 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:41:56.886+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:41:57.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:56 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:56.664+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:41:57.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:56 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:56.664+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:41:57.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:56 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:56.664+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:41:57.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:56 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:56.812+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:41:57.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:56 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:56.812+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:41:57.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:56 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:56.812+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:41:57.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:41:56 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:41:56.972+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:21.985094+0000 front 2023-08-11T12:41:21.985044+0000 (oldest deadline 2023-08-11T12:41:47.885275+0000) 2023-08-11T12:41:57.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:41:56 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:41:56.972+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:32.586511+0000 front 2023-08-11T12:41:32.586438+0000 (oldest deadline 2023-08-11T12:41:54.286599+0000) 2023-08-11T12:41:57.642 INFO:journalctl@ceph.osd.5.smithi194.stdout:Aug 11 12:41:57 smithi194 bash[164271]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-5 2023-08-11T12:41:57.803 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:41:57 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:41:57.516+0000 7f20de38a700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:25.105429+0000 front 2023-08-11T12:41:25.105462+0000 (oldest deadline 2023-08-11T12:41:48.005361+0000) 2023-08-11T12:41:57.803 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:41:57 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:41:57.516+0000 7f20de38a700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.207010+0000 front 2023-08-11T12:41:30.206875+0000 (oldest deadline 2023-08-11T12:41:56.106787+0000) 2023-08-11T12:41:57.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:57 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:57.611+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:41:57.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:57 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:57.611+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:41:57.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:57 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:57.611+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:41:58.142 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:41:57 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:41:57.930+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:41:58.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:57 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:57.696+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:41:58.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:57 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:57.696+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:41:58.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:57 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:57.696+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:41:58.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:57 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:57.803+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:41:58.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:57 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:57.803+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:41:58.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:57 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:57.803+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:41:58.394 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:41:57 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:41:57.959+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:21.985094+0000 front 2023-08-11T12:41:21.985044+0000 (oldest deadline 2023-08-11T12:41:47.885275+0000) 2023-08-11T12:41:58.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:41:57 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:41:57.959+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:32.586511+0000 front 2023-08-11T12:41:32.586438+0000 (oldest deadline 2023-08-11T12:41:54.286599+0000) 2023-08-11T12:41:58.513 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.5.service' 2023-08-11T12:41:58.593 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:41:58.594 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-08-11T12:41:58.595 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-08-11T12:41:58.596 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.6 2023-08-11T12:41:58.803 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:58 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:58.769+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:41:58.804 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:58 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:58.769+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:41:58.804 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:58 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:58.769+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:41:58.805 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:41:58 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:41:58.550+0000 7f20de38a700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:25.105429+0000 front 2023-08-11T12:41:25.105462+0000 (oldest deadline 2023-08-11T12:41:48.005361+0000) 2023-08-11T12:41:58.805 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:41:58 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:41:58.550+0000 7f20de38a700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.207010+0000 front 2023-08-11T12:41:30.206875+0000 (oldest deadline 2023-08-11T12:41:56.106787+0000) 2023-08-11T12:41:58.805 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:41:58 smithi008 systemd[1]: Stopping Ceph osd.6 for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:41:58.892 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:58 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:58.680+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:41:58.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:58 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:58.680+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:41:58.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:58 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:58.680+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:41:58.894 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:58 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:58.564+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:41:58.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:58 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:58.564+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:41:58.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:58 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:58.564+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:41:59.392 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:41:58 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:41:58.965+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:41:59.393 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:41:58 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:41:58.965+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.608567+0000 front 2023-08-11T12:41:30.608601+0000 (oldest deadline 2023-08-11T12:41:58.809419+0000) 2023-08-11T12:41:59.394 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:41:58 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:41:58.988+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:21.985094+0000 front 2023-08-11T12:41:21.985044+0000 (oldest deadline 2023-08-11T12:41:47.885275+0000) 2023-08-11T12:41:59.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:41:58 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:41:58.988+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:32.586511+0000 front 2023-08-11T12:41:32.586438+0000 (oldest deadline 2023-08-11T12:41:54.286599+0000) 2023-08-11T12:41:59.512 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:41:59 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:41:59.129+0000 7f20e1d94700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:41:59.513 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:41:59 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:41:59.129+0000 7f20e1d94700 -1 osd.6 114 *** Got signal Terminated *** 2023-08-11T12:41:59.513 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:41:59 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:41:59.129+0000 7f20e1d94700 -1 osd.6 114 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-11T12:41:59.513 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:41:59 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:41:59.511+0000 7f20de38a700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:25.105429+0000 front 2023-08-11T12:41:25.105462+0000 (oldest deadline 2023-08-11T12:41:48.005361+0000) 2023-08-11T12:41:59.513 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:41:59 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:41:59.511+0000 7f20de38a700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.207010+0000 front 2023-08-11T12:41:30.206875+0000 (oldest deadline 2023-08-11T12:41:56.106787+0000) 2023-08-11T12:41:59.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:59 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:59.563+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:41:59.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:59 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:59.563+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:41:59.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:41:59 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:41:59.563+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:00.142 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:41:59 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:41:59.918+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:42:00.143 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:41:59 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:41:59.918+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.608567+0000 front 2023-08-11T12:41:30.608601+0000 (oldest deadline 2023-08-11T12:41:58.809419+0000) 2023-08-11T12:42:00.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:59 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:59.676+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:00.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:59 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:59.676+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:00.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:41:59 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:41:59.676+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:00.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:59 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:59.808+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:00.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:59 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:59.808+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:00.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:41:59 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:41:59.808+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:00.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:00 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:00.036+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:21.985094+0000 front 2023-08-11T12:41:21.985044+0000 (oldest deadline 2023-08-11T12:41:47.885275+0000) 2023-08-11T12:42:00.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:00 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:00.036+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:32.586511+0000 front 2023-08-11T12:41:32.586438+0000 (oldest deadline 2023-08-11T12:41:54.286599+0000) 2023-08-11T12:42:00.803 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:00 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:00.767+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:00.803 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:00 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:00.767+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:00.804 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:00 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:00.767+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:00.804 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:42:00 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:42:00.540+0000 7f20de38a700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:25.105429+0000 front 2023-08-11T12:41:25.105462+0000 (oldest deadline 2023-08-11T12:41:48.005361+0000) 2023-08-11T12:42:00.805 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:42:00 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:42:00.540+0000 7f20de38a700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.207010+0000 front 2023-08-11T12:41:30.206875+0000 (oldest deadline 2023-08-11T12:41:56.106787+0000) 2023-08-11T12:42:00.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:00 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:00.586+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:00.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:00 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:00.586+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:00.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:00 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:00.586+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:01.142 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:00 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:00.899+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:42:01.143 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:00 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:00.899+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.608567+0000 front 2023-08-11T12:41:30.608601+0000 (oldest deadline 2023-08-11T12:41:58.809419+0000) 2023-08-11T12:42:01.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:00 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:00.692+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:01.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:00 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:00.692+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:01.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:00 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:00.692+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:01.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:01 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:01.014+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:21.985094+0000 front 2023-08-11T12:41:21.985044+0000 (oldest deadline 2023-08-11T12:41:47.885275+0000) 2023-08-11T12:42:01.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:01 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:01.014+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:32.586511+0000 front 2023-08-11T12:41:32.586438+0000 (oldest deadline 2023-08-11T12:41:54.286599+0000) 2023-08-11T12:42:01.773 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:42:01 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:42:01.505+0000 7f20de38a700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:25.105429+0000 front 2023-08-11T12:41:25.105462+0000 (oldest deadline 2023-08-11T12:41:48.005361+0000) 2023-08-11T12:42:01.774 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:42:01 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:42:01.505+0000 7f20de38a700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.207010+0000 front 2023-08-11T12:41:30.206875+0000 (oldest deadline 2023-08-11T12:41:56.106787+0000) 2023-08-11T12:42:01.774 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:42:01 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:42:01.505+0000 7f20de38a700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:36.107308+0000 front 2023-08-11T12:41:36.107208+0000 (oldest deadline 2023-08-11T12:42:01.407264+0000) 2023-08-11T12:42:01.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:01 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:01.566+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:01.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:01 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:01.566+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:01.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:01 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:01.566+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:02.052 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:01 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:01.772+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:02.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:01 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:01.772+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:02.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:01 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:01.772+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:02.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:01 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:01.772+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:39.229386+0000 front 2023-08-11T12:41:39.229355+0000 (oldest deadline 2023-08-11T12:42:01.529404+0000) 2023-08-11T12:42:02.143 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:01 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:01.860+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:42:02.143 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:01 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:01.860+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.608567+0000 front 2023-08-11T12:41:30.608601+0000 (oldest deadline 2023-08-11T12:41:58.809419+0000) 2023-08-11T12:42:02.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:01 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:01.671+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:02.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:01 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:01.671+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:02.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:01 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:01.671+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:02.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:02 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:02.040+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:21.985094+0000 front 2023-08-11T12:41:21.985044+0000 (oldest deadline 2023-08-11T12:41:47.885275+0000) 2023-08-11T12:42:02.396 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:02 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:02.040+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:32.586511+0000 front 2023-08-11T12:41:32.586438+0000 (oldest deadline 2023-08-11T12:41:54.286599+0000) 2023-08-11T12:42:02.805 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:42:02 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:42:02.479+0000 7f20de38a700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:25.105429+0000 front 2023-08-11T12:41:25.105462+0000 (oldest deadline 2023-08-11T12:41:48.005361+0000) 2023-08-11T12:42:02.806 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:42:02 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:42:02.479+0000 7f20de38a700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.207010+0000 front 2023-08-11T12:41:30.206875+0000 (oldest deadline 2023-08-11T12:41:56.106787+0000) 2023-08-11T12:42:02.806 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:42:02 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:42:02.479+0000 7f20de38a700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:36.107308+0000 front 2023-08-11T12:41:36.107208+0000 (oldest deadline 2023-08-11T12:42:01.407264+0000) 2023-08-11T12:42:02.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:02 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:02.546+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:02.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:02 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:02.546+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:02.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:02 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:02.546+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:03.142 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:02 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:02.861+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:42:03.143 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:02 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:02.861+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.608567+0000 front 2023-08-11T12:41:30.608601+0000 (oldest deadline 2023-08-11T12:41:58.809419+0000) 2023-08-11T12:42:03.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:02 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:02.641+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:03.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:02 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:02.641+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:03.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:02 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:02.641+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:03.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:02 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:02.806+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:03.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:02 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:02.806+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:03.304 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:02 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:02.806+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:03.304 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:02 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:02.806+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:39.229386+0000 front 2023-08-11T12:41:39.229355+0000 (oldest deadline 2023-08-11T12:42:01.529404+0000) 2023-08-11T12:42:03.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:02 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:02.995+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:21.985094+0000 front 2023-08-11T12:41:21.985044+0000 (oldest deadline 2023-08-11T12:41:47.885275+0000) 2023-08-11T12:42:03.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:02 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:02.995+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:32.586511+0000 front 2023-08-11T12:41:32.586438+0000 (oldest deadline 2023-08-11T12:41:54.286599+0000) 2023-08-11T12:42:03.777 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:42:03 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:42:03.465+0000 7f20de38a700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:25.105429+0000 front 2023-08-11T12:41:25.105462+0000 (oldest deadline 2023-08-11T12:41:48.005361+0000) 2023-08-11T12:42:03.778 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:42:03 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:42:03.465+0000 7f20de38a700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.207010+0000 front 2023-08-11T12:41:30.206875+0000 (oldest deadline 2023-08-11T12:41:56.106787+0000) 2023-08-11T12:42:03.778 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:42:03 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6[120856]: 2023-08-11T12:42:03.465+0000 7f20de38a700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:36.107308+0000 front 2023-08-11T12:41:36.107208+0000 (oldest deadline 2023-08-11T12:42:01.407264+0000) 2023-08-11T12:42:03.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:03 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:03.531+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:03.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:03 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:03.531+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:03.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:03 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:03.531+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:04.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:03 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:03.776+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:04.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:03 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:03.776+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:04.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:03 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:03.776+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:04.055 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:03 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:03.776+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:39.229386+0000 front 2023-08-11T12:41:39.229355+0000 (oldest deadline 2023-08-11T12:42:01.529404+0000) 2023-08-11T12:42:04.142 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:03 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:03.900+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:42:04.143 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:03 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:03.900+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.608567+0000 front 2023-08-11T12:41:30.608601+0000 (oldest deadline 2023-08-11T12:41:58.809419+0000) 2023-08-11T12:42:04.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:03 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:03.660+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:04.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:03 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:03.660+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:04.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:03 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:03.660+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:04.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:03 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:03.971+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:21.985094+0000 front 2023-08-11T12:41:21.985044+0000 (oldest deadline 2023-08-11T12:41:47.885275+0000) 2023-08-11T12:42:04.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:03 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:03.971+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:32.586511+0000 front 2023-08-11T12:41:32.586438+0000 (oldest deadline 2023-08-11T12:41:54.286599+0000) 2023-08-11T12:42:04.396 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:03 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:03.971+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:38.888706+0000 front 2023-08-11T12:41:38.888633+0000 (oldest deadline 2023-08-11T12:42:03.588447+0000) 2023-08-11T12:42:04.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:04 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:04.569+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:04.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:04 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:04.569+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:04.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:04 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:04.569+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:04.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:04 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:04.569+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:05.053 INFO:journalctl@ceph.osd.6.smithi008.stdout:Aug 11 12:42:04 smithi008 bash[160897]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-6 2023-08-11T12:42:05.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:04 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:04.762+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:05.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:04 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:04.762+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:05.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:04 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:04.762+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:05.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:04 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:04.762+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:39.229386+0000 front 2023-08-11T12:41:39.229355+0000 (oldest deadline 2023-08-11T12:42:01.529404+0000) 2023-08-11T12:42:05.142 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:04 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:04.695+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:05.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:04 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:04.695+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:05.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:04 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:04.695+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:05.143 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:04 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:04.890+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:42:05.144 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:04 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:04.890+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.608567+0000 front 2023-08-11T12:41:30.608601+0000 (oldest deadline 2023-08-11T12:41:58.809419+0000) 2023-08-11T12:42:05.144 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:04 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:04.890+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:38.809908+0000 front 2023-08-11T12:41:38.809929+0000 (oldest deadline 2023-08-11T12:42:04.709950+0000) 2023-08-11T12:42:05.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:04 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:04.959+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:21.985094+0000 front 2023-08-11T12:41:21.985044+0000 (oldest deadline 2023-08-11T12:41:47.885275+0000) 2023-08-11T12:42:05.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:04 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:04.959+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:32.586511+0000 front 2023-08-11T12:41:32.586438+0000 (oldest deadline 2023-08-11T12:41:54.286599+0000) 2023-08-11T12:42:05.396 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:04 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:04.959+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:38.888706+0000 front 2023-08-11T12:41:38.888633+0000 (oldest deadline 2023-08-11T12:42:03.588447+0000) 2023-08-11T12:42:05.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:05 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:05.521+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:05.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:05 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:05.521+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:05.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:05 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:05.521+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:05.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:05 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:05.521+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:06.052 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:05 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:05.791+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:06.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:05 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:05.791+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:06.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:05 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:05.791+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:06.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:05 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:05.791+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:39.229386+0000 front 2023-08-11T12:41:39.229355+0000 (oldest deadline 2023-08-11T12:42:01.529404+0000) 2023-08-11T12:42:06.143 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:05 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:05.865+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:42:06.143 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:05 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:05.865+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.608567+0000 front 2023-08-11T12:41:30.608601+0000 (oldest deadline 2023-08-11T12:41:58.809419+0000) 2023-08-11T12:42:06.143 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:05 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:05.865+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:38.809908+0000 front 2023-08-11T12:41:38.809929+0000 (oldest deadline 2023-08-11T12:42:04.709950+0000) 2023-08-11T12:42:06.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:05 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:05.703+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:06.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:05 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:05.703+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:06.145 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:05 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:05.703+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:06.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:05 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:05.925+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:21.985094+0000 front 2023-08-11T12:41:21.985044+0000 (oldest deadline 2023-08-11T12:41:47.885275+0000) 2023-08-11T12:42:06.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:05 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:05.925+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:32.586511+0000 front 2023-08-11T12:41:32.586438+0000 (oldest deadline 2023-08-11T12:41:54.286599+0000) 2023-08-11T12:42:06.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:05 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:05.925+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:38.888706+0000 front 2023-08-11T12:41:38.888633+0000 (oldest deadline 2023-08-11T12:42:03.588447+0000) 2023-08-11T12:42:06.797 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.6.service' 2023-08-11T12:42:06.889 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:42:06.889 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-08-11T12:42:06.890 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-08-11T12:42:06.890 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.7 2023-08-11T12:42:06.894 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:06 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:06.494+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:06.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:06 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:06.494+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:06.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:06 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:06.494+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:06.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:06 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:06.494+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:06.915 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:06 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:06.657+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:06.916 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:06 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:06.657+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:06.916 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:06 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:06.657+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:07.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:06 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:06.775+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:07.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:06 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:06.775+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:07.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:06 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:06.775+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:07.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:06 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:06.775+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:39.229386+0000 front 2023-08-11T12:41:39.229355+0000 (oldest deadline 2023-08-11T12:42:01.529404+0000) 2023-08-11T12:42:07.249 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:06 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:06.908+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:21.985094+0000 front 2023-08-11T12:41:21.985044+0000 (oldest deadline 2023-08-11T12:41:47.885275+0000) 2023-08-11T12:42:07.249 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:06 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:06.908+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:32.586511+0000 front 2023-08-11T12:41:32.586438+0000 (oldest deadline 2023-08-11T12:41:54.286599+0000) 2023-08-11T12:42:07.249 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:06 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:06.908+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:38.888706+0000 front 2023-08-11T12:41:38.888633+0000 (oldest deadline 2023-08-11T12:42:03.588447+0000) 2023-08-11T12:42:07.250 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:06 smithi045 systemd[1]: Stopping Ceph osd.7 for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:42:07.393 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:06 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:06.914+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:42:07.393 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:06 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:06.914+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.608567+0000 front 2023-08-11T12:41:30.608601+0000 (oldest deadline 2023-08-11T12:41:58.809419+0000) 2023-08-11T12:42:07.393 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:06 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:06.914+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:38.809908+0000 front 2023-08-11T12:41:38.809929+0000 (oldest deadline 2023-08-11T12:42:04.709950+0000) 2023-08-11T12:42:07.645 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:07 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:07.246+0000 7f5fb540b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:42:07.645 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:07 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:07.246+0000 7f5fb540b700 -1 osd.7 114 *** Got signal Terminated *** 2023-08-11T12:42:07.645 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:07 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:07.246+0000 7f5fb540b700 -1 osd.7 114 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-11T12:42:07.646 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:07 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:07.487+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:07.646 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:07 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:07.487+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:07.646 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:07 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:07.487+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:07.646 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:07 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:07.487+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:08.142 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:07 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:07.678+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:08.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:07 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:07.678+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:08.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:07 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:07.678+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:08.143 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:07 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:07.885+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:42:08.144 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:07 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:07.885+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.608567+0000 front 2023-08-11T12:41:30.608601+0000 (oldest deadline 2023-08-11T12:41:58.809419+0000) 2023-08-11T12:42:08.144 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:07 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:07.885+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:38.809908+0000 front 2023-08-11T12:41:38.809929+0000 (oldest deadline 2023-08-11T12:42:04.709950+0000) 2023-08-11T12:42:08.302 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:07 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:07.813+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:08.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:07 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:07.813+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:08.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:07 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:07.813+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:08.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:07 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:07.813+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:39.229386+0000 front 2023-08-11T12:41:39.229355+0000 (oldest deadline 2023-08-11T12:42:01.529404+0000) 2023-08-11T12:42:08.396 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:07 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:07.926+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:21.985094+0000 front 2023-08-11T12:41:21.985044+0000 (oldest deadline 2023-08-11T12:41:47.885275+0000) 2023-08-11T12:42:08.396 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:07 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:07.926+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:32.586511+0000 front 2023-08-11T12:41:32.586438+0000 (oldest deadline 2023-08-11T12:41:54.286599+0000) 2023-08-11T12:42:08.397 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:07 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:07.926+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:38.888706+0000 front 2023-08-11T12:41:38.888633+0000 (oldest deadline 2023-08-11T12:42:03.588447+0000) 2023-08-11T12:42:08.894 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:08 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:08.475+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:08.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:08 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:08.475+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:08.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:08 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:08.475+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:08.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:08 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:08.475+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:09.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:08 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:08.688+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:09.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:08 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:08.688+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:09.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:08 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:08.688+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:09.144 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:08 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:08.847+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:42:09.145 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:08 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:08.847+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.608567+0000 front 2023-08-11T12:41:30.608601+0000 (oldest deadline 2023-08-11T12:41:58.809419+0000) 2023-08-11T12:42:09.145 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:08 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:08.847+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:38.809908+0000 front 2023-08-11T12:41:38.809929+0000 (oldest deadline 2023-08-11T12:42:04.709950+0000) 2023-08-11T12:42:09.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:08 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:08.828+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:09.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:08 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:08.828+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:09.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:08 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:08.828+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:09.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:08 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:08.828+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:39.229386+0000 front 2023-08-11T12:41:39.229355+0000 (oldest deadline 2023-08-11T12:42:01.529404+0000) 2023-08-11T12:42:09.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:08 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:08.904+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:21.985094+0000 front 2023-08-11T12:41:21.985044+0000 (oldest deadline 2023-08-11T12:41:47.885275+0000) 2023-08-11T12:42:09.396 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:08 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:08.904+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:32.586511+0000 front 2023-08-11T12:41:32.586438+0000 (oldest deadline 2023-08-11T12:41:54.286599+0000) 2023-08-11T12:42:09.396 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:08 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:08.904+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:38.888706+0000 front 2023-08-11T12:41:38.888633+0000 (oldest deadline 2023-08-11T12:42:03.588447+0000) 2023-08-11T12:42:09.894 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:09 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:09.479+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:09.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:09 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:09.479+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:09.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:09 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:09.479+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:09.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:09 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:09.479+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:10.142 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:09 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:09.652+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:10.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:09 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:09.652+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:10.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:09 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:09.652+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:10.144 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:09 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:09.819+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:42:10.144 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:09 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:09.819+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.608567+0000 front 2023-08-11T12:41:30.608601+0000 (oldest deadline 2023-08-11T12:41:58.809419+0000) 2023-08-11T12:42:10.144 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:09 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:09.819+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:38.809908+0000 front 2023-08-11T12:41:38.809929+0000 (oldest deadline 2023-08-11T12:42:04.709950+0000) 2023-08-11T12:42:10.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:09 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:09.852+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:10.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:09 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:09.852+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:10.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:09 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:09.852+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:10.304 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:09 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:09.852+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:39.229386+0000 front 2023-08-11T12:41:39.229355+0000 (oldest deadline 2023-08-11T12:42:01.529404+0000) 2023-08-11T12:42:10.394 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:09 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:09.941+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:21.985094+0000 front 2023-08-11T12:41:21.985044+0000 (oldest deadline 2023-08-11T12:41:47.885275+0000) 2023-08-11T12:42:10.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:09 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:09.941+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:32.586511+0000 front 2023-08-11T12:41:32.586438+0000 (oldest deadline 2023-08-11T12:41:54.286599+0000) 2023-08-11T12:42:10.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:09 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:09.941+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:38.888706+0000 front 2023-08-11T12:41:38.888633+0000 (oldest deadline 2023-08-11T12:42:03.588447+0000) 2023-08-11T12:42:10.892 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:10 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:10.624+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:10.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:10 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:10.624+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:10.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:10 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:10.624+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:10.893 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:10 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:10.797+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:42:10.894 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:10 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:10.797+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.608567+0000 front 2023-08-11T12:41:30.608601+0000 (oldest deadline 2023-08-11T12:41:58.809419+0000) 2023-08-11T12:42:10.894 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:10 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:10.797+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:38.809908+0000 front 2023-08-11T12:41:38.809929+0000 (oldest deadline 2023-08-11T12:42:04.709950+0000) 2023-08-11T12:42:10.894 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:10 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:10.441+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:10.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:10 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:10.441+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:10.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:10 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:10.441+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:10.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:10 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:10.441+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:11.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:10 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:10.810+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:11.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:10 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:10.810+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:11.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:10 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:10.810+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:11.304 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:10 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:10.810+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:39.229386+0000 front 2023-08-11T12:41:39.229355+0000 (oldest deadline 2023-08-11T12:42:01.529404+0000) 2023-08-11T12:42:11.394 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:10 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:10.894+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:21.985094+0000 front 2023-08-11T12:41:21.985044+0000 (oldest deadline 2023-08-11T12:41:47.885275+0000) 2023-08-11T12:42:11.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:10 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:10.894+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:32.586511+0000 front 2023-08-11T12:41:32.586438+0000 (oldest deadline 2023-08-11T12:41:54.286599+0000) 2023-08-11T12:42:11.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:10 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:10.894+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:38.888706+0000 front 2023-08-11T12:41:38.888633+0000 (oldest deadline 2023-08-11T12:42:03.588447+0000) 2023-08-11T12:42:11.892 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:11 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:11.575+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:11.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:11 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:11.575+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:11.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:11 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:11.575+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:11.894 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:11 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:11.793+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:42:11.894 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:11 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:11.793+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.608567+0000 front 2023-08-11T12:41:30.608601+0000 (oldest deadline 2023-08-11T12:41:58.809419+0000) 2023-08-11T12:42:11.895 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:11 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:11.793+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:38.809908+0000 front 2023-08-11T12:41:38.809929+0000 (oldest deadline 2023-08-11T12:42:04.709950+0000) 2023-08-11T12:42:11.895 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:11 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:11.793+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.211316+0000 front 2023-08-11T12:41:48.211048+0000 (oldest deadline 2023-08-11T12:42:11.710992+0000) 2023-08-11T12:42:11.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:11 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:11.457+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:11.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:11 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:11.457+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:11.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:11 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:11.457+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:11.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:11 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:11.457+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:12.302 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:11 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:11.837+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:12.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:11 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:11.837+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:12.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:11 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:11.837+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:12.304 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:11 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:11.837+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:39.229386+0000 front 2023-08-11T12:41:39.229355+0000 (oldest deadline 2023-08-11T12:42:01.529404+0000) 2023-08-11T12:42:12.394 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:11 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:11.908+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:21.985094+0000 front 2023-08-11T12:41:21.985044+0000 (oldest deadline 2023-08-11T12:41:47.885275+0000) 2023-08-11T12:42:12.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:11 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:11.908+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:32.586511+0000 front 2023-08-11T12:41:32.586438+0000 (oldest deadline 2023-08-11T12:41:54.286599+0000) 2023-08-11T12:42:12.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:11 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7[146349]: 2023-08-11T12:42:11.908+0000 7f5fae9fb700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:38.888706+0000 front 2023-08-11T12:41:38.888633+0000 (oldest deadline 2023-08-11T12:42:03.588447+0000) 2023-08-11T12:42:12.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:12 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:12.604+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:12.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:12 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:12.604+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:12.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:12 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:12.604+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:12.894 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:12 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:12.788+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:42:12.895 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:12 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:12.788+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.608567+0000 front 2023-08-11T12:41:30.608601+0000 (oldest deadline 2023-08-11T12:41:58.809419+0000) 2023-08-11T12:42:12.895 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:12 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:12.788+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:38.809908+0000 front 2023-08-11T12:41:38.809929+0000 (oldest deadline 2023-08-11T12:42:04.709950+0000) 2023-08-11T12:42:12.895 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:12 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:12.788+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.211316+0000 front 2023-08-11T12:41:48.211048+0000 (oldest deadline 2023-08-11T12:42:11.710992+0000) 2023-08-11T12:42:12.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:12 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:12.482+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:12.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:12 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:12.483+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:12.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:12 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:12.483+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:12.897 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:12 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:12.483+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:13.302 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:12 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:12.814+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:13.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:12 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:12.814+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:13.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:12 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:12.814+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:13.303 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:12 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:12.814+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:39.229386+0000 front 2023-08-11T12:41:39.229355+0000 (oldest deadline 2023-08-11T12:42:01.529404+0000) 2023-08-11T12:42:13.304 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:12 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:12.814+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.831856+0000 front 2023-08-11T12:41:47.831798+0000 (oldest deadline 2023-08-11T12:42:12.532006+0000) 2023-08-11T12:42:13.395 INFO:journalctl@ceph.osd.7.smithi045.stdout:Aug 11 12:42:13 smithi045 bash[163597]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-7 2023-08-11T12:42:13.816 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:13 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:13.559+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:13.816 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:13 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:13.559+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:13.816 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:13 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:13.559+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:13.817 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:13 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:13.559+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:13.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:13 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:13.460+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:13.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:13 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:13.460+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:13.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:13 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:13.460+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:13.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:13 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:13.460+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:14.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:13 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:13.794+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:14.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:13 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:13.794+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:14.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:13 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:13.794+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:14.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:13 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:13.794+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:39.229386+0000 front 2023-08-11T12:41:39.229355+0000 (oldest deadline 2023-08-11T12:42:01.529404+0000) 2023-08-11T12:42:14.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:13 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:13.794+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.831856+0000 front 2023-08-11T12:41:47.831798+0000 (oldest deadline 2023-08-11T12:42:12.532006+0000) 2023-08-11T12:42:14.142 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:13 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:13.814+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:42:14.143 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:13 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:13.814+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.608567+0000 front 2023-08-11T12:41:30.608601+0000 (oldest deadline 2023-08-11T12:41:58.809419+0000) 2023-08-11T12:42:14.143 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:13 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:13.814+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:38.809908+0000 front 2023-08-11T12:41:38.809929+0000 (oldest deadline 2023-08-11T12:42:04.709950+0000) 2023-08-11T12:42:14.144 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:13 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:13.814+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.211316+0000 front 2023-08-11T12:41:48.211048+0000 (oldest deadline 2023-08-11T12:42:11.710992+0000) 2023-08-11T12:42:14.518 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.7.service' 2023-08-11T12:42:14.601 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:42:14.602 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-08-11T12:42:14.603 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2023-08-11T12:42:14.603 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.8 2023-08-11T12:42:14.823 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:14 smithi194 systemd[1]: Stopping Ceph osd.8 for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:42:14.824 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:14 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:14.566+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:14.824 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:14 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:14.566+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:14.825 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:14 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:14.566+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:14.825 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:14 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:14.566+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:14.894 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:14 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:14.453+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:14.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:14 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:14.453+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:14.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:14 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:14.453+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:14.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:14 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:14.453+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:14.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:14 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:14.453+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.780536+0000 front 2023-08-11T12:41:47.780575+0000 (oldest deadline 2023-08-11T12:42:13.680683+0000) 2023-08-11T12:42:15.052 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:14 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:14.776+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:15.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:14 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:14.776+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:15.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:14 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:14.776+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:15.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:14 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:14.776+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:39.229386+0000 front 2023-08-11T12:41:39.229355+0000 (oldest deadline 2023-08-11T12:42:01.529404+0000) 2023-08-11T12:42:15.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:14 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:14.776+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.831856+0000 front 2023-08-11T12:41:47.831798+0000 (oldest deadline 2023-08-11T12:42:12.532006+0000) 2023-08-11T12:42:15.143 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:14 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:14.821+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:42:15.143 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:14 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:14.821+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.608567+0000 front 2023-08-11T12:41:30.608601+0000 (oldest deadline 2023-08-11T12:41:58.809419+0000) 2023-08-11T12:42:15.143 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:14 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:14.821+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:38.809908+0000 front 2023-08-11T12:41:38.809929+0000 (oldest deadline 2023-08-11T12:42:04.709950+0000) 2023-08-11T12:42:15.144 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:14 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:14.821+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.211316+0000 front 2023-08-11T12:41:48.211048+0000 (oldest deadline 2023-08-11T12:42:11.710992+0000) 2023-08-11T12:42:15.144 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:14 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:14.949+0000 7f015f91f700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:42:15.144 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:14 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:14.949+0000 7f015f91f700 -1 osd.8 114 *** Got signal Terminated *** 2023-08-11T12:42:15.144 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:14 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:14.949+0000 7f015f91f700 -1 osd.8 114 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-11T12:42:15.801 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:15 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:15.532+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:15.802 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:15 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:15.532+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:15.802 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:15 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:15.532+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:15.802 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:15 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:15.532+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:15.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:15 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:15.447+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:15.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:15 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:15.447+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:15.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:15 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:15.447+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:15.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:15 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:15.447+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:15.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:15 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:15.447+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.780536+0000 front 2023-08-11T12:41:47.780575+0000 (oldest deadline 2023-08-11T12:42:13.680683+0000) 2023-08-11T12:42:16.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:15 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:15.758+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:16.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:15 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:15.758+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:16.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:15 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:15.758+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:16.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:15 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:15.758+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:39.229386+0000 front 2023-08-11T12:41:39.229355+0000 (oldest deadline 2023-08-11T12:42:01.529404+0000) 2023-08-11T12:42:16.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:15 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:15.758+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.831856+0000 front 2023-08-11T12:41:47.831798+0000 (oldest deadline 2023-08-11T12:42:12.532006+0000) 2023-08-11T12:42:16.142 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:15 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:15.800+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:42:16.143 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:15 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:15.800+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.608567+0000 front 2023-08-11T12:41:30.608601+0000 (oldest deadline 2023-08-11T12:41:58.809419+0000) 2023-08-11T12:42:16.143 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:15 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:15.800+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:38.809908+0000 front 2023-08-11T12:41:38.809929+0000 (oldest deadline 2023-08-11T12:42:04.709950+0000) 2023-08-11T12:42:16.143 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:15 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:15.800+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.211316+0000 front 2023-08-11T12:41:48.211048+0000 (oldest deadline 2023-08-11T12:42:11.710992+0000) 2023-08-11T12:42:16.892 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:16 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:16.755+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:42:16.893 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:16 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:16.755+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.608567+0000 front 2023-08-11T12:41:30.608601+0000 (oldest deadline 2023-08-11T12:41:58.809419+0000) 2023-08-11T12:42:16.893 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:16 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:16.755+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:38.809908+0000 front 2023-08-11T12:41:38.809929+0000 (oldest deadline 2023-08-11T12:42:04.709950+0000) 2023-08-11T12:42:16.893 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:16 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:16.755+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.211316+0000 front 2023-08-11T12:41:48.211048+0000 (oldest deadline 2023-08-11T12:42:11.710992+0000) 2023-08-11T12:42:16.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:16 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:16.506+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:16.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:16 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:16.506+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:16.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:16 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:16.506+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:16.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:16 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:16.506+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:16.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:16 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:16.417+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:16.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:16 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:16.417+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:16.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:16 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:16.417+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:16.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:16 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:16.417+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:16.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:16 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:16.417+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.780536+0000 front 2023-08-11T12:41:47.780575+0000 (oldest deadline 2023-08-11T12:42:13.680683+0000) 2023-08-11T12:42:17.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:16 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:16.733+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:17.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:16 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:16.733+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:17.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:16 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:16.733+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:17.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:16 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:16.733+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:39.229386+0000 front 2023-08-11T12:41:39.229355+0000 (oldest deadline 2023-08-11T12:42:01.529404+0000) 2023-08-11T12:42:17.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:16 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:16.733+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.831856+0000 front 2023-08-11T12:41:47.831798+0000 (oldest deadline 2023-08-11T12:42:12.532006+0000) 2023-08-11T12:42:17.645 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:17 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:17.376+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:17.646 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:17 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:17.376+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:17.646 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:17 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:17.376+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:17.646 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:17 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:17.376+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:17.646 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:17 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:17.376+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.780536+0000 front 2023-08-11T12:41:47.780575+0000 (oldest deadline 2023-08-11T12:42:13.680683+0000) 2023-08-11T12:42:17.795 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:17 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:17.543+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:17.796 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:17 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:17.543+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:17.796 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:17 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:17.543+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:17.796 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:17 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:17.543+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:18.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:17 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:17.779+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:18.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:17 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:17.779+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:18.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:17 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:17.779+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:18.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:17 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:17.779+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:39.229386+0000 front 2023-08-11T12:41:39.229355+0000 (oldest deadline 2023-08-11T12:42:01.529404+0000) 2023-08-11T12:42:18.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:17 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:17.779+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.831856+0000 front 2023-08-11T12:41:47.831798+0000 (oldest deadline 2023-08-11T12:42:12.532006+0000) 2023-08-11T12:42:18.142 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:17 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:17.794+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:42:18.143 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:17 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:17.794+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.608567+0000 front 2023-08-11T12:41:30.608601+0000 (oldest deadline 2023-08-11T12:41:58.809419+0000) 2023-08-11T12:42:18.143 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:17 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:17.794+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:38.809908+0000 front 2023-08-11T12:41:38.809929+0000 (oldest deadline 2023-08-11T12:42:04.709950+0000) 2023-08-11T12:42:18.144 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:17 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:17.794+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.211316+0000 front 2023-08-11T12:41:48.211048+0000 (oldest deadline 2023-08-11T12:42:11.710992+0000) 2023-08-11T12:42:18.645 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:18 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:18.372+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:18.645 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:18 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:18.372+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:18.646 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:18 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:18.372+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:18.646 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:18 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:18.372+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:18.647 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:18 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:18.372+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.780536+0000 front 2023-08-11T12:41:47.780575+0000 (oldest deadline 2023-08-11T12:42:13.680683+0000) 2023-08-11T12:42:18.892 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:18 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:18.815+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:42:18.893 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:18 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:18.815+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.608567+0000 front 2023-08-11T12:41:30.608601+0000 (oldest deadline 2023-08-11T12:41:58.809419+0000) 2023-08-11T12:42:18.893 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:18 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:18.815+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:38.809908+0000 front 2023-08-11T12:41:38.809929+0000 (oldest deadline 2023-08-11T12:42:04.709950+0000) 2023-08-11T12:42:18.893 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:18 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:18.815+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.211316+0000 front 2023-08-11T12:41:48.211048+0000 (oldest deadline 2023-08-11T12:42:11.710992+0000) 2023-08-11T12:42:18.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:18 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:18.586+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:18.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:18 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:18.586+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:18.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:18 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:18.586+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:18.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:18 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:18.586+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:19.052 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:18 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:18.754+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:19.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:18 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:18.754+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:19.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:18 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:18.754+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:19.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:18 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:18.754+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:39.229386+0000 front 2023-08-11T12:41:39.229355+0000 (oldest deadline 2023-08-11T12:42:01.529404+0000) 2023-08-11T12:42:19.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:18 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:18.754+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.831856+0000 front 2023-08-11T12:41:47.831798+0000 (oldest deadline 2023-08-11T12:42:12.532006+0000) 2023-08-11T12:42:19.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:18 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:18.754+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:52.532847+0000 front 2023-08-11T12:41:52.532830+0000 (oldest deadline 2023-08-11T12:42:18.432622+0000) 2023-08-11T12:42:19.645 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:19 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:19.389+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:19.645 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:19 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:19.389+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:19.645 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:19 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:19.389+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:19.645 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:19 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:19.389+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:19.646 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:19 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:19.389+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.780536+0000 front 2023-08-11T12:41:47.780575+0000 (oldest deadline 2023-08-11T12:42:13.680683+0000) 2023-08-11T12:42:19.646 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:19 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:19.389+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:53.681262+0000 front 2023-08-11T12:41:53.681406+0000 (oldest deadline 2023-08-11T12:42:18.981156+0000) 2023-08-11T12:42:19.892 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:19 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:19.847+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.406533+0000 front 2023-08-11T12:41:24.406655+0000 (oldest deadline 2023-08-11T12:41:46.106547+0000) 2023-08-11T12:42:19.893 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:19 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:19.847+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.608567+0000 front 2023-08-11T12:41:30.608601+0000 (oldest deadline 2023-08-11T12:41:58.809419+0000) 2023-08-11T12:42:19.893 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:19 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:19.847+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:38.809908+0000 front 2023-08-11T12:41:38.809929+0000 (oldest deadline 2023-08-11T12:42:04.709950+0000) 2023-08-11T12:42:19.893 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:19 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8[147451]: 2023-08-11T12:42:19.847+0000 7f0159f11700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.211316+0000 front 2023-08-11T12:41:48.211048+0000 (oldest deadline 2023-08-11T12:42:11.710992+0000) 2023-08-11T12:42:19.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:19 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:19.620+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:19.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:19 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:19.620+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:19.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:19 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:19.620+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:19.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:19 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:19.620+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:20.052 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:19 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:19.726+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:20.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:19 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:19.726+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:20.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:19 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:19.726+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:20.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:19 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:19.726+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:39.229386+0000 front 2023-08-11T12:41:39.229355+0000 (oldest deadline 2023-08-11T12:42:01.529404+0000) 2023-08-11T12:42:20.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:19 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:19.726+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.831856+0000 front 2023-08-11T12:41:47.831798+0000 (oldest deadline 2023-08-11T12:42:12.532006+0000) 2023-08-11T12:42:20.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:19 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:19.726+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:52.532847+0000 front 2023-08-11T12:41:52.532830+0000 (oldest deadline 2023-08-11T12:42:18.432622+0000) 2023-08-11T12:42:20.893 INFO:journalctl@ceph.osd.8.smithi194.stdout:Aug 11 12:42:20 smithi194 bash[164531]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-8 2023-08-11T12:42:20.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:20 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:20.601+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:20.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:20 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:20.602+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:20.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:20 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:20.602+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:20.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:20 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:20.602+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:20.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:20 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:20.428+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:20.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:20 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:20.428+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:20.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:20 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:20.428+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:20.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:20 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:20.428+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:20.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:20 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:20.428+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.780536+0000 front 2023-08-11T12:41:47.780575+0000 (oldest deadline 2023-08-11T12:42:13.680683+0000) 2023-08-11T12:42:20.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:20 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:20.428+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:53.681262+0000 front 2023-08-11T12:41:53.681406+0000 (oldest deadline 2023-08-11T12:42:18.981156+0000) 2023-08-11T12:42:21.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:20 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:20.678+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:21.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:20 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:20.678+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:21.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:20 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:20.678+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:21.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:20 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:20.678+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:39.229386+0000 front 2023-08-11T12:41:39.229355+0000 (oldest deadline 2023-08-11T12:42:01.529404+0000) 2023-08-11T12:42:21.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:20 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:20.678+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.831856+0000 front 2023-08-11T12:41:47.831798+0000 (oldest deadline 2023-08-11T12:42:12.532006+0000) 2023-08-11T12:42:21.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:20 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:20.678+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:52.532847+0000 front 2023-08-11T12:41:52.532830+0000 (oldest deadline 2023-08-11T12:42:18.432622+0000) 2023-08-11T12:42:21.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:21 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:21.626+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:21.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:21 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:21.626+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:21.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:21 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:21.626+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:21.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:21 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:21.626+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:21.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:21 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:21.435+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:21.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:21 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:21.435+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:21.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:21 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:21.435+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:21.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:21 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:21.435+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:21.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:21 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:21.435+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.780536+0000 front 2023-08-11T12:41:47.780575+0000 (oldest deadline 2023-08-11T12:42:13.680683+0000) 2023-08-11T12:42:21.897 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:21 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:21.435+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:53.681262+0000 front 2023-08-11T12:41:53.681406+0000 (oldest deadline 2023-08-11T12:42:18.981156+0000) 2023-08-11T12:42:22.008 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.8.service' 2023-08-11T12:42:22.049 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:42:22.050 INFO:tasks.cephadm.osd.8:Stopped osd.8 2023-08-11T12:42:22.050 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2023-08-11T12:42:22.051 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.9 2023-08-11T12:42:22.056 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:21 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:21.647+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:22.056 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:21 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:21.647+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:22.056 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:21 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:21.647+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:22.057 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:21 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:21.647+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:39.229386+0000 front 2023-08-11T12:41:39.229355+0000 (oldest deadline 2023-08-11T12:42:01.529404+0000) 2023-08-11T12:42:22.057 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:21 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:21.647+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.831856+0000 front 2023-08-11T12:41:47.831798+0000 (oldest deadline 2023-08-11T12:42:12.532006+0000) 2023-08-11T12:42:22.057 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:21 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:21.647+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:52.532847+0000 front 2023-08-11T12:41:52.532830+0000 (oldest deadline 2023-08-11T12:42:18.432622+0000) 2023-08-11T12:42:22.553 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:22 smithi008 systemd[1]: Stopping Ceph osd.9 for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:42:22.894 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:22 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:22.433+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:22.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:22 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:22.433+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:22.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:22 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:22.433+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:22.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:22 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:22.433+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:22.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:22 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:22.433+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.780536+0000 front 2023-08-11T12:41:47.780575+0000 (oldest deadline 2023-08-11T12:42:13.680683+0000) 2023-08-11T12:42:22.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:22 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:22.433+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:53.681262+0000 front 2023-08-11T12:41:53.681406+0000 (oldest deadline 2023-08-11T12:42:18.981156+0000) 2023-08-11T12:42:23.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:22 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:22.603+0000 7f59848c2700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:42:23.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:22 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:22.603+0000 7f59848c2700 -1 osd.9 114 *** Got signal Terminated *** 2023-08-11T12:42:23.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:22 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:22.603+0000 7f59848c2700 -1 osd.9 114 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-11T12:42:23.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:22 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:22.654+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:23.055 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:22 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:22.654+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:23.055 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:22 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:22.654+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:23.056 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:22 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:22.654+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:39.229386+0000 front 2023-08-11T12:41:39.229355+0000 (oldest deadline 2023-08-11T12:42:01.529404+0000) 2023-08-11T12:42:23.056 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:22 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:22.654+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.831856+0000 front 2023-08-11T12:41:47.831798+0000 (oldest deadline 2023-08-11T12:42:12.532006+0000) 2023-08-11T12:42:23.056 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:22 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:22.654+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:52.532847+0000 front 2023-08-11T12:41:52.532830+0000 (oldest deadline 2023-08-11T12:42:18.432622+0000) 2023-08-11T12:42:23.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:22 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:22.660+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:23.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:22 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:22.660+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:23.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:22 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:22.660+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:23.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:22 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:22.660+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:23.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:22 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:22.660+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:56.213623+0000 front 2023-08-11T12:41:56.213582+0000 (oldest deadline 2023-08-11T12:42:22.113656+0000) 2023-08-11T12:42:23.892 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:23 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:23.633+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:23.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:23 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:23.633+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:23.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:23 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:23.633+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:23.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:23 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:23.633+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:23.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:23 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:23.633+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:56.213623+0000 front 2023-08-11T12:41:56.213582+0000 (oldest deadline 2023-08-11T12:42:22.113656+0000) 2023-08-11T12:42:23.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:23 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:23.476+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:23.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:23 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:23.476+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:23.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:23 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:23.476+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:23.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:23 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:23.476+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:23.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:23 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:23.476+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.780536+0000 front 2023-08-11T12:41:47.780575+0000 (oldest deadline 2023-08-11T12:42:13.680683+0000) 2023-08-11T12:42:23.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:23 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:23.476+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:53.681262+0000 front 2023-08-11T12:41:53.681406+0000 (oldest deadline 2023-08-11T12:42:18.981156+0000) 2023-08-11T12:42:24.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:23 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:23.625+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:24.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:23 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:23.625+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:24.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:23 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:23.625+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:24.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:23 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:23.625+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:39.229386+0000 front 2023-08-11T12:41:39.229355+0000 (oldest deadline 2023-08-11T12:42:01.529404+0000) 2023-08-11T12:42:24.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:23 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:23.625+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.831856+0000 front 2023-08-11T12:41:47.831798+0000 (oldest deadline 2023-08-11T12:42:12.532006+0000) 2023-08-11T12:42:24.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:23 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:23.625+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:52.532847+0000 front 2023-08-11T12:41:52.532830+0000 (oldest deadline 2023-08-11T12:42:18.432622+0000) 2023-08-11T12:42:24.892 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:24 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:24.623+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:24.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:24 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:24.623+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:24.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:24 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:24.623+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:24.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:24 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:24.623+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:24.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:24 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:24.623+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:56.213623+0000 front 2023-08-11T12:41:56.213582+0000 (oldest deadline 2023-08-11T12:42:22.113656+0000) 2023-08-11T12:42:24.894 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:24 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:24.444+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:24.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:24 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:24.444+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:24.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:24 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:24.444+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:24.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:24 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:24.444+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:24.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:24 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:24.444+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.780536+0000 front 2023-08-11T12:41:47.780575+0000 (oldest deadline 2023-08-11T12:42:13.680683+0000) 2023-08-11T12:42:24.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:24 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:24.444+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:53.681262+0000 front 2023-08-11T12:41:53.681406+0000 (oldest deadline 2023-08-11T12:42:18.981156+0000) 2023-08-11T12:42:25.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:24 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:24.596+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:25.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:24 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:24.596+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:25.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:24 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:24.596+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:25.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:24 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:24.596+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:39.229386+0000 front 2023-08-11T12:41:39.229355+0000 (oldest deadline 2023-08-11T12:42:01.529404+0000) 2023-08-11T12:42:25.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:24 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:24.596+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.831856+0000 front 2023-08-11T12:41:47.831798+0000 (oldest deadline 2023-08-11T12:42:12.532006+0000) 2023-08-11T12:42:25.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:24 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:24.596+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:52.532847+0000 front 2023-08-11T12:41:52.532830+0000 (oldest deadline 2023-08-11T12:42:18.432622+0000) 2023-08-11T12:42:25.894 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:25 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:25.455+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:25.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:25 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:25.455+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:25.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:25 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:25.455+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:25.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:25 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:25.455+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:25.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:25 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:25.455+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.780536+0000 front 2023-08-11T12:41:47.780575+0000 (oldest deadline 2023-08-11T12:42:13.680683+0000) 2023-08-11T12:42:25.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:25 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:25.455+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:53.681262+0000 front 2023-08-11T12:41:53.681406+0000 (oldest deadline 2023-08-11T12:42:18.981156+0000) 2023-08-11T12:42:26.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:25 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:25.551+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:26.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:25 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:25.551+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:26.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:25 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:25.551+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:26.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:25 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:25.551+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:39.229386+0000 front 2023-08-11T12:41:39.229355+0000 (oldest deadline 2023-08-11T12:42:01.529404+0000) 2023-08-11T12:42:26.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:25 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:25.551+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.831856+0000 front 2023-08-11T12:41:47.831798+0000 (oldest deadline 2023-08-11T12:42:12.532006+0000) 2023-08-11T12:42:26.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:25 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:25.551+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:52.532847+0000 front 2023-08-11T12:41:52.532830+0000 (oldest deadline 2023-08-11T12:42:18.432622+0000) 2023-08-11T12:42:26.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:25 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:25.665+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:26.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:25 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:25.665+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:26.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:25 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:25.665+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:26.145 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:25 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:25.665+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:26.145 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:25 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:25.665+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:56.213623+0000 front 2023-08-11T12:41:56.213582+0000 (oldest deadline 2023-08-11T12:42:22.113656+0000) 2023-08-11T12:42:26.802 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:26 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:26.537+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:26.803 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:26 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:26.537+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:26.803 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:26 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:26.537+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:26.803 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:26 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:26.537+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:39.229386+0000 front 2023-08-11T12:41:39.229355+0000 (oldest deadline 2023-08-11T12:42:01.529404+0000) 2023-08-11T12:42:26.804 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:26 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:26.537+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.831856+0000 front 2023-08-11T12:41:47.831798+0000 (oldest deadline 2023-08-11T12:42:12.532006+0000) 2023-08-11T12:42:26.804 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:26 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:26.537+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:52.532847+0000 front 2023-08-11T12:41:52.532830+0000 (oldest deadline 2023-08-11T12:42:18.432622+0000) 2023-08-11T12:42:26.892 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:26 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:26.625+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:26.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:26 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:26.625+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:26.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:26 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:26.625+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:26.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:26 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:26.625+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:26.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:26 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:26.625+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:56.213623+0000 front 2023-08-11T12:41:56.213582+0000 (oldest deadline 2023-08-11T12:42:22.113656+0000) 2023-08-11T12:42:26.894 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:26 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:26.435+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:26.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:26 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:26.435+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:26.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:26 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:26.435+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:26.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:26 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:26.435+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:26.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:26 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:26.435+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.780536+0000 front 2023-08-11T12:41:47.780575+0000 (oldest deadline 2023-08-11T12:42:13.680683+0000) 2023-08-11T12:42:26.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:26 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:26.435+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:53.681262+0000 front 2023-08-11T12:41:53.681406+0000 (oldest deadline 2023-08-11T12:42:18.981156+0000) 2023-08-11T12:42:27.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:27 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:27.636+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:27.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:27 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:27.636+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:27.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:27 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:27.636+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:27.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:27 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:27.636+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:27.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:27 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:27.636+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:56.213623+0000 front 2023-08-11T12:41:56.213582+0000 (oldest deadline 2023-08-11T12:42:22.113656+0000) 2023-08-11T12:42:27.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:27 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:27.636+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-08-11T12:42:02.114248+0000 front 2023-08-11T12:42:02.114292+0000 (oldest deadline 2023-08-11T12:42:27.314670+0000) 2023-08-11T12:42:27.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:27 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:27.485+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:27.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:27 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:27.485+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:27.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:27 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:27.485+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:27.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:27 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:27.485+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:27.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:27 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:27.485+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.780536+0000 front 2023-08-11T12:41:47.780575+0000 (oldest deadline 2023-08-11T12:42:13.680683+0000) 2023-08-11T12:42:27.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:27 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:27.485+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:53.681262+0000 front 2023-08-11T12:41:53.681406+0000 (oldest deadline 2023-08-11T12:42:18.981156+0000) 2023-08-11T12:42:28.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:27 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:27.560+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:11.922758+0000 front 2023-08-11T12:41:11.923077+0000 (oldest deadline 2023-08-11T12:41:37.822786+0000) 2023-08-11T12:42:28.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:27 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:27.560+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.325855+0000 front 2023-08-11T12:41:22.325827+0000 (oldest deadline 2023-08-11T12:41:47.625944+0000) 2023-08-11T12:42:28.053 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:27 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:27.560+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.927487+0000 front 2023-08-11T12:41:29.927439+0000 (oldest deadline 2023-08-11T12:41:54.027370+0000) 2023-08-11T12:42:28.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:27 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:27.560+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:39.229386+0000 front 2023-08-11T12:41:39.229355+0000 (oldest deadline 2023-08-11T12:42:01.529404+0000) 2023-08-11T12:42:28.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:27 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:27.560+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.831856+0000 front 2023-08-11T12:41:47.831798+0000 (oldest deadline 2023-08-11T12:42:12.532006+0000) 2023-08-11T12:42:28.054 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:27 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9[126293]: 2023-08-11T12:42:27.560+0000 7f59806b7700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:52.532847+0000 front 2023-08-11T12:41:52.532830+0000 (oldest deadline 2023-08-11T12:42:18.432622+0000) 2023-08-11T12:42:28.553 INFO:journalctl@ceph.osd.9.smithi008.stdout:Aug 11 12:42:28 smithi008 bash[161170]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-9 2023-08-11T12:42:28.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:28 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:28.613+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:28.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:28 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:28.613+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:28.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:28 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:28.613+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:28.895 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:28 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:28.613+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:28.895 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:28 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:28.613+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:56.213623+0000 front 2023-08-11T12:41:56.213582+0000 (oldest deadline 2023-08-11T12:42:22.113656+0000) 2023-08-11T12:42:28.896 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:28 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:28.613+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-08-11T12:42:02.114248+0000 front 2023-08-11T12:42:02.114292+0000 (oldest deadline 2023-08-11T12:42:27.314670+0000) 2023-08-11T12:42:28.897 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:28 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:28.506+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:28.897 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:28 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:28.506+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:28.897 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:28 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:28.506+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:28.898 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:28 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:28.506+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:28.898 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:28 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:28.506+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.780536+0000 front 2023-08-11T12:41:47.780575+0000 (oldest deadline 2023-08-11T12:42:13.680683+0000) 2023-08-11T12:42:28.899 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:28 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:28.506+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:53.681262+0000 front 2023-08-11T12:41:53.681406+0000 (oldest deadline 2023-08-11T12:42:18.981156+0000) 2023-08-11T12:42:29.894 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:29 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:29.504+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:29.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:29 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:29.504+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:29.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:29 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:29.504+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:29.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:29 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:29.504+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:29.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:29 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:29.504+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.780536+0000 front 2023-08-11T12:41:47.780575+0000 (oldest deadline 2023-08-11T12:42:13.680683+0000) 2023-08-11T12:42:29.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:29 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:29.504+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:53.681262+0000 front 2023-08-11T12:41:53.681406+0000 (oldest deadline 2023-08-11T12:42:18.981156+0000) 2023-08-11T12:42:29.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:29 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:29.504+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-08-11T12:41:58.981746+0000 front 2023-08-11T12:41:58.981799+0000 (oldest deadline 2023-08-11T12:42:28.982220+0000) 2023-08-11T12:42:30.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:29 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:29.646+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:30.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:29 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:29.646+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:30.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:29 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:29.646+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:30.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:29 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:29.646+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:30.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:29 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:29.646+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:56.213623+0000 front 2023-08-11T12:41:56.213582+0000 (oldest deadline 2023-08-11T12:42:22.113656+0000) 2023-08-11T12:42:30.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:29 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:29.646+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-08-11T12:42:02.114248+0000 front 2023-08-11T12:42:02.114292+0000 (oldest deadline 2023-08-11T12:42:27.314670+0000) 2023-08-11T12:42:30.207 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.9.service' 2023-08-11T12:42:30.298 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:42:30.299 INFO:tasks.cephadm.osd.9:Stopped osd.9 2023-08-11T12:42:30.300 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2023-08-11T12:42:30.301 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.10 2023-08-11T12:42:30.645 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:30 smithi045 systemd[1]: Stopping Ceph osd.10 for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:42:30.645 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:30 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:30.459+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:30.646 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:30 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:30.459+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:30.646 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:30 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:30.459+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:30.646 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:30 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:30.459+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:30.646 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:30 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:30.459+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.780536+0000 front 2023-08-11T12:41:47.780575+0000 (oldest deadline 2023-08-11T12:42:13.680683+0000) 2023-08-11T12:42:30.647 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:30 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:30.459+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:53.681262+0000 front 2023-08-11T12:41:53.681406+0000 (oldest deadline 2023-08-11T12:42:18.981156+0000) 2023-08-11T12:42:30.647 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:30 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:30.459+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-08-11T12:41:58.981746+0000 front 2023-08-11T12:41:58.981799+0000 (oldest deadline 2023-08-11T12:42:28.982220+0000) 2023-08-11T12:42:30.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:30 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:30.605+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:30.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:30 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:30.605+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:30.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:30 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:30.605+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:30.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:30 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:30.605+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:30.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:30 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:30.605+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:56.213623+0000 front 2023-08-11T12:41:56.213582+0000 (oldest deadline 2023-08-11T12:42:22.113656+0000) 2023-08-11T12:42:30.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:30 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:30.605+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-08-11T12:42:02.114248+0000 front 2023-08-11T12:42:02.114292+0000 (oldest deadline 2023-08-11T12:42:27.314670+0000) 2023-08-11T12:42:31.144 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:30 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:30.652+0000 7f2fed325700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:42:31.145 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:30 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:30.652+0000 7f2fed325700 -1 osd.10 114 *** Got signal Terminated *** 2023-08-11T12:42:31.145 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:30 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:30.652+0000 7f2fed325700 -1 osd.10 114 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-11T12:42:31.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:31 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:31.444+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:31.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:31 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:31.444+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:31.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:31 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:31.444+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:31.897 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:31 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:31.444+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:31.897 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:31 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:31.444+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.780536+0000 front 2023-08-11T12:41:47.780575+0000 (oldest deadline 2023-08-11T12:42:13.680683+0000) 2023-08-11T12:42:31.897 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:31 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:31.444+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:53.681262+0000 front 2023-08-11T12:41:53.681406+0000 (oldest deadline 2023-08-11T12:42:18.981156+0000) 2023-08-11T12:42:31.898 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:31 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:31.444+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-08-11T12:41:58.981746+0000 front 2023-08-11T12:41:58.981799+0000 (oldest deadline 2023-08-11T12:42:28.982220+0000) 2023-08-11T12:42:32.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:31 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:31.653+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:32.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:31 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:31.653+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:32.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:31 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:31.653+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:32.145 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:31 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:31.653+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:32.145 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:31 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:31.653+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:56.213623+0000 front 2023-08-11T12:41:56.213582+0000 (oldest deadline 2023-08-11T12:42:22.113656+0000) 2023-08-11T12:42:32.146 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:31 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:31.653+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-08-11T12:42:02.114248+0000 front 2023-08-11T12:42:02.114292+0000 (oldest deadline 2023-08-11T12:42:27.314670+0000) 2023-08-11T12:42:32.892 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:32 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:32.607+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:32.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:32 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:32.607+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:32.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:32 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:32.607+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:32.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:32 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:32.607+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:32.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:32 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:32.607+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:56.213623+0000 front 2023-08-11T12:41:56.213582+0000 (oldest deadline 2023-08-11T12:42:22.113656+0000) 2023-08-11T12:42:32.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:32 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:32.607+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-08-11T12:42:02.114248+0000 front 2023-08-11T12:42:02.114292+0000 (oldest deadline 2023-08-11T12:42:27.314670+0000) 2023-08-11T12:42:32.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:32 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:32.466+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:32.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:32 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:32.466+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:32.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:32 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:32.466+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:32.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:32 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:32.466+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:32.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:32 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:32.466+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.780536+0000 front 2023-08-11T12:41:47.780575+0000 (oldest deadline 2023-08-11T12:42:13.680683+0000) 2023-08-11T12:42:32.897 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:32 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:32.466+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:53.681262+0000 front 2023-08-11T12:41:53.681406+0000 (oldest deadline 2023-08-11T12:42:18.981156+0000) 2023-08-11T12:42:32.897 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:32 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:32.466+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-08-11T12:41:58.981746+0000 front 2023-08-11T12:41:58.981799+0000 (oldest deadline 2023-08-11T12:42:28.982220+0000) 2023-08-11T12:42:33.892 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:33 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:33.590+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:33.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:33 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:33.590+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:33.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:33 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:33.590+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:33.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:33 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:33.590+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:33.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:33 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:33.590+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:56.213623+0000 front 2023-08-11T12:41:56.213582+0000 (oldest deadline 2023-08-11T12:42:22.113656+0000) 2023-08-11T12:42:33.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:33 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:33.590+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-08-11T12:42:02.114248+0000 front 2023-08-11T12:42:02.114292+0000 (oldest deadline 2023-08-11T12:42:27.314670+0000) 2023-08-11T12:42:33.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:33 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:33.505+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:33.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:33 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:33.505+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:33.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:33 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:33.505+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:33.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:33 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:33.505+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:33.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:33 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:33.505+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.780536+0000 front 2023-08-11T12:41:47.780575+0000 (oldest deadline 2023-08-11T12:42:13.680683+0000) 2023-08-11T12:42:33.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:33 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:33.505+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:53.681262+0000 front 2023-08-11T12:41:53.681406+0000 (oldest deadline 2023-08-11T12:42:18.981156+0000) 2023-08-11T12:42:33.897 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:33 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:33.505+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-08-11T12:41:58.981746+0000 front 2023-08-11T12:41:58.981799+0000 (oldest deadline 2023-08-11T12:42:28.982220+0000) 2023-08-11T12:42:34.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:34 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:34.613+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:34.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:34 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:34.613+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:34.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:34 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:34.613+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:34.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:34 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:34.613+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:34.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:34 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:34.613+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:56.213623+0000 front 2023-08-11T12:41:56.213582+0000 (oldest deadline 2023-08-11T12:42:22.113656+0000) 2023-08-11T12:42:34.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:34 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:34.613+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-08-11T12:42:02.114248+0000 front 2023-08-11T12:42:02.114292+0000 (oldest deadline 2023-08-11T12:42:27.314670+0000) 2023-08-11T12:42:34.894 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:34 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:34.547+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:34.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:34 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:34.547+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:34.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:34 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:34.547+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:34.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:34 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:34.547+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:34.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:34 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:34.547+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.780536+0000 front 2023-08-11T12:41:47.780575+0000 (oldest deadline 2023-08-11T12:42:13.680683+0000) 2023-08-11T12:42:34.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:34 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:34.547+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:53.681262+0000 front 2023-08-11T12:41:53.681406+0000 (oldest deadline 2023-08-11T12:42:18.981156+0000) 2023-08-11T12:42:34.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:34 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:34.547+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-08-11T12:41:58.981746+0000 front 2023-08-11T12:41:58.981799+0000 (oldest deadline 2023-08-11T12:42:28.982220+0000) 2023-08-11T12:42:35.892 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:35 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:35.611+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:35.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:35 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:35.611+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:35.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:35 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:35.611+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:35.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:35 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:35.611+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:35.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:35 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:35.611+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:56.213623+0000 front 2023-08-11T12:41:56.213582+0000 (oldest deadline 2023-08-11T12:42:22.113656+0000) 2023-08-11T12:42:35.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:35 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:35.611+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-08-11T12:42:02.114248+0000 front 2023-08-11T12:42:02.114292+0000 (oldest deadline 2023-08-11T12:42:27.314670+0000) 2023-08-11T12:42:35.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:35 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:35.611+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6820 osd.7 since back 2023-08-11T12:42:10.816103+0000 front 2023-08-11T12:42:10.816121+0000 (oldest deadline 2023-08-11T12:42:34.915840+0000) 2023-08-11T12:42:35.894 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:35 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:35.543+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:14.575552+0000 front 2023-08-11T12:41:14.575595+0000 (oldest deadline 2023-08-11T12:41:39.875340+0000) 2023-08-11T12:42:35.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:35 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:35.543+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:22.776421+0000 front 2023-08-11T12:41:22.776379+0000 (oldest deadline 2023-08-11T12:41:47.476530+0000) 2023-08-11T12:42:35.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:35 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:35.543+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:30.977554+0000 front 2023-08-11T12:41:30.977501+0000 (oldest deadline 2023-08-11T12:41:54.477539+0000) 2023-08-11T12:42:35.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:35 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:35.543+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-08-11T12:41:40.279163+0000 front 2023-08-11T12:41:40.279347+0000 (oldest deadline 2023-08-11T12:42:03.779179+0000) 2023-08-11T12:42:35.895 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:35 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:35.543+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:47.780536+0000 front 2023-08-11T12:41:47.780575+0000 (oldest deadline 2023-08-11T12:42:13.680683+0000) 2023-08-11T12:42:35.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:35 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:35.543+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:53.681262+0000 front 2023-08-11T12:41:53.681406+0000 (oldest deadline 2023-08-11T12:42:18.981156+0000) 2023-08-11T12:42:35.896 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:35 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10[151789]: 2023-08-11T12:42:35.543+0000 7f2fe7917700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-08-11T12:41:58.981746+0000 front 2023-08-11T12:41:58.981799+0000 (oldest deadline 2023-08-11T12:42:28.982220+0000) 2023-08-11T12:42:36.647 INFO:journalctl@ceph.osd.10.smithi045.stdout:Aug 11 12:42:36 smithi045 bash[163878]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-10 2023-08-11T12:42:36.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:36 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:36.566+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:36.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:36 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:36.566+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:36.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:36 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:36.566+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:36.895 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:36 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:36.566+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:36.896 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:36 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:36.566+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:56.213623+0000 front 2023-08-11T12:41:56.213582+0000 (oldest deadline 2023-08-11T12:42:22.113656+0000) 2023-08-11T12:42:36.896 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:36 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:36.566+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-08-11T12:42:02.114248+0000 front 2023-08-11T12:42:02.114292+0000 (oldest deadline 2023-08-11T12:42:27.314670+0000) 2023-08-11T12:42:36.896 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:36 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:36.566+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6820 osd.7 since back 2023-08-11T12:42:10.816103+0000 front 2023-08-11T12:42:10.816121+0000 (oldest deadline 2023-08-11T12:42:34.915840+0000) 2023-08-11T12:42:37.641 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.10.service' 2023-08-11T12:42:37.683 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:42:37.683 INFO:tasks.cephadm.osd.10:Stopped osd.10 2023-08-11T12:42:37.684 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2023-08-11T12:42:37.684 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.11 2023-08-11T12:42:37.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:37 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:37.605+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:37.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:37 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:37.605+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:37.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:37 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:37.605+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:37.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:37 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:37.605+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:37.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:37 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:37.605+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:56.213623+0000 front 2023-08-11T12:41:56.213582+0000 (oldest deadline 2023-08-11T12:42:22.113656+0000) 2023-08-11T12:42:37.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:37 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:37.605+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-08-11T12:42:02.114248+0000 front 2023-08-11T12:42:02.114292+0000 (oldest deadline 2023-08-11T12:42:27.314670+0000) 2023-08-11T12:42:37.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:37 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:37.605+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6820 osd.7 since back 2023-08-11T12:42:10.816103+0000 front 2023-08-11T12:42:10.816121+0000 (oldest deadline 2023-08-11T12:42:34.915840+0000) 2023-08-11T12:42:37.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:37 smithi194 systemd[1]: Stopping Ceph osd.11 for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:42:38.393 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:38 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:38.037+0000 7ff0deec7700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:42:38.394 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:38 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:38.037+0000 7ff0deec7700 -1 osd.11 114 *** Got signal Terminated *** 2023-08-11T12:42:38.395 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:38 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:38.037+0000 7ff0deec7700 -1 osd.11 114 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-11T12:42:39.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:38 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:38.645+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:39.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:38 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:38.645+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:39.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:38 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:38.645+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:39.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:38 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:38.645+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:39.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:38 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:38.645+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:56.213623+0000 front 2023-08-11T12:41:56.213582+0000 (oldest deadline 2023-08-11T12:42:22.113656+0000) 2023-08-11T12:42:39.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:38 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:38.645+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-08-11T12:42:02.114248+0000 front 2023-08-11T12:42:02.114292+0000 (oldest deadline 2023-08-11T12:42:27.314670+0000) 2023-08-11T12:42:39.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:38 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:38.645+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6820 osd.7 since back 2023-08-11T12:42:10.816103+0000 front 2023-08-11T12:42:10.816121+0000 (oldest deadline 2023-08-11T12:42:34.915840+0000) 2023-08-11T12:42:39.892 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:39 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:39.606+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:39.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:39 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:39.606+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:39.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:39 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:39.606+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:39.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:39 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:39.606+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:39.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:39 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:39.606+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:56.213623+0000 front 2023-08-11T12:41:56.213582+0000 (oldest deadline 2023-08-11T12:42:22.113656+0000) 2023-08-11T12:42:39.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:39 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:39.606+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-08-11T12:42:02.114248+0000 front 2023-08-11T12:42:02.114292+0000 (oldest deadline 2023-08-11T12:42:27.314670+0000) 2023-08-11T12:42:39.895 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:39 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:39.606+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6820 osd.7 since back 2023-08-11T12:42:10.816103+0000 front 2023-08-11T12:42:10.816121+0000 (oldest deadline 2023-08-11T12:42:34.915840+0000) 2023-08-11T12:42:41.142 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:40 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:40.644+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:41.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:40 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:40.644+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:41.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:40 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:40.644+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:41.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:40 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:40.644+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:41.143 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:40 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:40.644+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:56.213623+0000 front 2023-08-11T12:41:56.213582+0000 (oldest deadline 2023-08-11T12:42:22.113656+0000) 2023-08-11T12:42:41.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:40 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:40.644+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-08-11T12:42:02.114248+0000 front 2023-08-11T12:42:02.114292+0000 (oldest deadline 2023-08-11T12:42:27.314670+0000) 2023-08-11T12:42:41.144 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:40 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:40.644+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6820 osd.7 since back 2023-08-11T12:42:10.816103+0000 front 2023-08-11T12:42:10.816121+0000 (oldest deadline 2023-08-11T12:42:34.915840+0000) 2023-08-11T12:42:41.892 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:41 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:41.599+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:41.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:41 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:41.599+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:41.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:41 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:41.599+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:41.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:41 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:41.599+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:41.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:41 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:41.599+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:56.213623+0000 front 2023-08-11T12:41:56.213582+0000 (oldest deadline 2023-08-11T12:42:22.113656+0000) 2023-08-11T12:42:41.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:41 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:41.599+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-08-11T12:42:02.114248+0000 front 2023-08-11T12:42:02.114292+0000 (oldest deadline 2023-08-11T12:42:27.314670+0000) 2023-08-11T12:42:41.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:41 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:41.599+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6820 osd.7 since back 2023-08-11T12:42:10.816103+0000 front 2023-08-11T12:42:10.816121+0000 (oldest deadline 2023-08-11T12:42:34.915840+0000) 2023-08-11T12:42:42.892 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:42 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:42.553+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-08-11T12:41:16.006961+0000 front 2023-08-11T12:41:16.006925+0000 (oldest deadline 2023-08-11T12:41:37.106904+0000) 2023-08-11T12:42:42.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:42 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:42.553+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2023-08-11T12:41:24.108933+0000 front 2023-08-11T12:41:24.108856+0000 (oldest deadline 2023-08-11T12:41:48.808949+0000) 2023-08-11T12:42:42.893 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:42 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:42.553+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2023-08-11T12:41:29.309748+0000 front 2023-08-11T12:41:29.309874+0000 (oldest deadline 2023-08-11T12:41:54.609851+0000) 2023-08-11T12:42:42.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:42 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:42.553+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2023-08-11T12:41:48.712134+0000 front 2023-08-11T12:41:48.712044+0000 (oldest deadline 2023-08-11T12:42:13.312601+0000) 2023-08-11T12:42:42.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:42 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:42.553+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2023-08-11T12:41:56.213623+0000 front 2023-08-11T12:41:56.213582+0000 (oldest deadline 2023-08-11T12:42:22.113656+0000) 2023-08-11T12:42:42.894 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:42 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:42.553+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-08-11T12:42:02.114248+0000 front 2023-08-11T12:42:02.114292+0000 (oldest deadline 2023-08-11T12:42:27.314670+0000) 2023-08-11T12:42:42.895 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:42 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:42.553+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.45:6820 osd.7 since back 2023-08-11T12:42:10.816103+0000 front 2023-08-11T12:42:10.816121+0000 (oldest deadline 2023-08-11T12:42:34.915840+0000) 2023-08-11T12:42:42.895 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:42 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11[152903]: 2023-08-11T12:42:42.553+0000 7ff0d8cb8700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.194:6820 osd.8 since back 2023-08-11T12:42:18.416711+0000 front 2023-08-11T12:42:18.416749+0000 (oldest deadline 2023-08-11T12:42:42.417463+0000) 2023-08-11T12:42:44.142 INFO:journalctl@ceph.osd.11.smithi194.stdout:Aug 11 12:42:43 smithi194 bash[164801]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-osd-11 2023-08-11T12:42:45.151 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@osd.11.service' 2023-08-11T12:42:45.191 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:42:45.192 INFO:tasks.cephadm.osd.11:Stopped osd.11 2023-08-11T12:42:45.193 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2023-08-11T12:42:45.194 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.a 2023-08-11T12:42:45.553 INFO:journalctl@ceph.mds.a.smithi008.stdout:Aug 11 12:42:45 smithi008 systemd[1]: Stopping Ceph mds.a for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:42:46.052 INFO:journalctl@ceph.mds.a.smithi008.stdout:Aug 11 12:42:45 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-a[131700]: 2023-08-11T12:42:45.764+0000 7f5a284ff700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:42:46.053 INFO:journalctl@ceph.mds.a.smithi008.stdout:Aug 11 12:42:45 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-a[131700]: 2023-08-11T12:42:45.764+0000 7f5a284ff700 -1 mds.a *** got signal Terminated *** 2023-08-11T12:42:50.304 INFO:journalctl@ceph.mds.a.smithi008.stdout:Aug 11 12:42:50 smithi008 bash[161450]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-a 2023-08-11T12:42:50.466 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.a.service' 2023-08-11T12:42:50.553 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:42:50.553 INFO:tasks.cephadm.mds.a:Stopped mds.a 2023-08-11T12:42:50.554 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2023-08-11T12:42:50.554 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.d 2023-08-11T12:42:50.806 INFO:journalctl@ceph.mds.d.smithi008.stdout:Aug 11 12:42:50 smithi008 systemd[1]: Stopping Ceph mds.d for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:42:51.553 INFO:journalctl@ceph.mds.d.smithi008.stdout:Aug 11 12:42:51 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-d[130692]: 2023-08-11T12:42:51.072+0000 7f4c7f628700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:42:51.553 INFO:journalctl@ceph.mds.d.smithi008.stdout:Aug 11 12:42:51 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-d[130692]: 2023-08-11T12:42:51.072+0000 7f4c7f628700 -1 mds.d *** got signal Terminated *** 2023-08-11T12:42:54.303 INFO:journalctl@ceph.mds.d.smithi008.stdout:Aug 11 12:42:53 smithi008 bash[161594]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-d 2023-08-11T12:42:54.419 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.d.service' 2023-08-11T12:42:54.505 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:42:54.506 INFO:tasks.cephadm.mds.d:Stopped mds.d 2023-08-11T12:42:54.506 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2023-08-11T12:42:54.507 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.g 2023-08-11T12:42:54.802 INFO:journalctl@ceph.mds.g.smithi008.stdout:Aug 11 12:42:54 smithi008 systemd[1]: Stopping Ceph mds.g for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:42:55.302 INFO:journalctl@ceph.mds.g.smithi008.stdout:Aug 11 12:42:55 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-g[131311]: 2023-08-11T12:42:55.029+0000 7fb656ec7700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:42:55.303 INFO:journalctl@ceph.mds.g.smithi008.stdout:Aug 11 12:42:55 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-g[131311]: 2023-08-11T12:42:55.029+0000 7fb656ec7700 -1 mds.g *** got signal Terminated *** 2023-08-11T12:42:58.556 INFO:journalctl@ceph.mds.g.smithi008.stdout:Aug 11 12:42:58 smithi008 bash[161738]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-g 2023-08-11T12:42:58.785 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.g.service' 2023-08-11T12:42:58.871 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:42:58.872 INFO:tasks.cephadm.mds.g:Stopped mds.g 2023-08-11T12:42:58.872 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2023-08-11T12:42:58.873 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.j 2023-08-11T12:42:59.052 INFO:journalctl@ceph.mds.j.smithi008.stdout:Aug 11 12:42:58 smithi008 systemd[1]: Stopping Ceph mds.j for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:42:59.803 INFO:journalctl@ceph.mds.j.smithi008.stdout:Aug 11 12:42:59 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-j[130300]: 2023-08-11T12:42:59.411+0000 7fc51b07c700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:42:59.803 INFO:journalctl@ceph.mds.j.smithi008.stdout:Aug 11 12:42:59 smithi008 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-j[130300]: 2023-08-11T12:42:59.411+0000 7fc51b07c700 -1 mds.j *** got signal Terminated *** 2023-08-11T12:43:03.053 INFO:journalctl@ceph.mds.j.smithi008.stdout:Aug 11 12:43:02 smithi008 bash[161883]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-j 2023-08-11T12:43:03.378 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.j.service' 2023-08-11T12:43:03.442 INFO:journalctl@ceph.mds.j.smithi008.stdout:Aug 11 12:43:03 smithi008 systemd[1]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.j.service: Succeeded. 2023-08-11T12:43:03.442 INFO:journalctl@ceph.mds.j.smithi008.stdout:Aug 11 12:43:03 smithi008 systemd[1]: Stopped Ceph mds.j for 815f94ae-3840-11ee-9b37-001a4aab830c. 2023-08-11T12:43:03.462 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:43:03.462 INFO:tasks.cephadm.mds.j:Stopped mds.j 2023-08-11T12:43:03.463 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2023-08-11T12:43:03.463 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.b 2023-08-11T12:43:03.824 INFO:journalctl@ceph.mds.b.smithi045.stdout:Aug 11 12:43:03 smithi045 systemd[1]: Stopping Ceph mds.b for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:43:04.144 INFO:journalctl@ceph.mds.b.smithi045.stdout:Aug 11 12:43:03 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-b[155632]: 2023-08-11T12:43:03.822+0000 7fb764283700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:43:04.145 INFO:journalctl@ceph.mds.b.smithi045.stdout:Aug 11 12:43:03 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-b[155632]: 2023-08-11T12:43:03.822+0000 7fb764283700 -1 mds.b *** got signal Terminated *** 2023-08-11T12:43:06.191 INFO:journalctl@ceph.mds.b.smithi045.stdout:Aug 11 12:43:06 smithi045 bash[164151]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-b 2023-08-11T12:43:06.384 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.b.service' 2023-08-11T12:43:06.425 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:43:06.427 INFO:tasks.cephadm.mds.b:Stopped mds.b 2023-08-11T12:43:06.428 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2023-08-11T12:43:06.429 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.e 2023-08-11T12:43:06.644 INFO:journalctl@ceph.mds.e.smithi045.stdout:Aug 11 12:43:06 smithi045 systemd[1]: Stopping Ceph mds.e for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:43:07.144 INFO:journalctl@ceph.mds.e.smithi045.stdout:Aug 11 12:43:06 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-e[154951]: 2023-08-11T12:43:06.812+0000 7fa88b4ac700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:43:07.145 INFO:journalctl@ceph.mds.e.smithi045.stdout:Aug 11 12:43:06 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-e[154951]: 2023-08-11T12:43:06.812+0000 7fa88b4ac700 -1 mds.e *** got signal Terminated *** 2023-08-11T12:43:10.394 INFO:journalctl@ceph.mds.e.smithi045.stdout:Aug 11 12:43:10 smithi045 bash[164288]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-e 2023-08-11T12:43:10.471 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.e.service' 2023-08-11T12:43:10.507 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:43:10.507 INFO:tasks.cephadm.mds.e:Stopped mds.e 2023-08-11T12:43:10.508 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2023-08-11T12:43:10.508 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.h 2023-08-11T12:43:10.881 INFO:journalctl@ceph.mds.h.smithi045.stdout:Aug 11 12:43:10 smithi045 systemd[1]: Stopping Ceph mds.h for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:43:11.144 INFO:journalctl@ceph.mds.h.smithi045.stdout:Aug 11 12:43:10 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-h[155288]: 2023-08-11T12:43:10.879+0000 7f1df0ff3700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:43:11.145 INFO:journalctl@ceph.mds.h.smithi045.stdout:Aug 11 12:43:10 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-h[155288]: 2023-08-11T12:43:10.879+0000 7f1df0ff3700 -1 mds.h *** got signal Terminated *** 2023-08-11T12:43:14.395 INFO:journalctl@ceph.mds.h.smithi045.stdout:Aug 11 12:43:14 smithi045 bash[164433]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-h 2023-08-11T12:43:14.593 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.h.service' 2023-08-11T12:43:14.629 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:43:14.630 INFO:tasks.cephadm.mds.h:Stopped mds.h 2023-08-11T12:43:14.630 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2023-08-11T12:43:14.630 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.k 2023-08-11T12:43:14.895 INFO:journalctl@ceph.mds.k.smithi045.stdout:Aug 11 12:43:14 smithi045 systemd[1]: Stopping Ceph mds.k for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:43:15.395 INFO:journalctl@ceph.mds.k.smithi045.stdout:Aug 11 12:43:15 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-k[154610]: 2023-08-11T12:43:15.002+0000 7f22aac76700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:43:15.395 INFO:journalctl@ceph.mds.k.smithi045.stdout:Aug 11 12:43:15 smithi045 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-k[154610]: 2023-08-11T12:43:15.002+0000 7f22aac76700 -1 mds.k *** got signal Terminated *** 2023-08-11T12:43:18.177 INFO:journalctl@ceph.mds.k.smithi045.stdout:Aug 11 12:43:18 smithi045 bash[164587]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-k 2023-08-11T12:43:18.384 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.k.service' 2023-08-11T12:43:18.420 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:43:18.420 INFO:tasks.cephadm.mds.k:Stopped mds.k 2023-08-11T12:43:18.421 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2023-08-11T12:43:18.421 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.c 2023-08-11T12:43:18.766 INFO:journalctl@ceph.mds.c.smithi194.stdout:Aug 11 12:43:18 smithi194 systemd[1]: Stopping Ceph mds.c for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:43:19.142 INFO:journalctl@ceph.mds.c.smithi194.stdout:Aug 11 12:43:18 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-c[156475]: 2023-08-11T12:43:18.764+0000 7fa0ba7d2700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:43:19.143 INFO:journalctl@ceph.mds.c.smithi194.stdout:Aug 11 12:43:18 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-c[156475]: 2023-08-11T12:43:18.764+0000 7fa0ba7d2700 -1 mds.c *** got signal Terminated *** 2023-08-11T12:43:22.325 INFO:journalctl@ceph.mds.c.smithi194.stdout:Aug 11 12:43:22 smithi194 bash[165069]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-c 2023-08-11T12:43:22.332 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.c.service' 2023-08-11T12:43:22.367 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:43:22.368 INFO:tasks.cephadm.mds.c:Stopped mds.c 2023-08-11T12:43:22.368 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2023-08-11T12:43:22.369 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.f 2023-08-11T12:43:22.642 INFO:journalctl@ceph.mds.f.smithi194.stdout:Aug 11 12:43:22 smithi194 systemd[1]: Stopping Ceph mds.f for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:43:23.142 INFO:journalctl@ceph.mds.f.smithi194.stdout:Aug 11 12:43:22 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-f[156134]: 2023-08-11T12:43:22.728+0000 7ff7f9925700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:43:23.143 INFO:journalctl@ceph.mds.f.smithi194.stdout:Aug 11 12:43:22 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-f[156134]: 2023-08-11T12:43:22.728+0000 7ff7f9925700 -1 mds.f *** got signal Terminated *** 2023-08-11T12:43:26.213 INFO:journalctl@ceph.mds.f.smithi194.stdout:Aug 11 12:43:26 smithi194 bash[165208]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-f 2023-08-11T12:43:26.401 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.f.service' 2023-08-11T12:43:26.438 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:43:26.439 INFO:tasks.cephadm.mds.f:Stopped mds.f 2023-08-11T12:43:26.439 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2023-08-11T12:43:26.440 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.i 2023-08-11T12:43:26.822 INFO:journalctl@ceph.mds.i.smithi194.stdout:Aug 11 12:43:26 smithi194 systemd[1]: Stopping Ceph mds.i for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:43:27.142 INFO:journalctl@ceph.mds.i.smithi194.stdout:Aug 11 12:43:26 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-i[156816]: 2023-08-11T12:43:26.820+0000 7f59c3cdb700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:43:27.143 INFO:journalctl@ceph.mds.i.smithi194.stdout:Aug 11 12:43:26 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-i[156816]: 2023-08-11T12:43:26.820+0000 7f59c3cdb700 -1 mds.i *** got signal Terminated *** 2023-08-11T12:43:30.542 INFO:journalctl@ceph.mds.i.smithi194.stdout:Aug 11 12:43:30 smithi194 bash[165359]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-i 2023-08-11T12:43:30.546 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.i.service' 2023-08-11T12:43:30.580 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:43:30.581 INFO:tasks.cephadm.mds.i:Stopped mds.i 2023-08-11T12:43:30.581 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2023-08-11T12:43:30.582 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.l 2023-08-11T12:43:30.892 INFO:journalctl@ceph.mds.l.smithi194.stdout:Aug 11 12:43:30 smithi194 systemd[1]: Stopping Ceph mds.l for 815f94ae-3840-11ee-9b37-001a4aab830c... 2023-08-11T12:43:31.393 INFO:journalctl@ceph.mds.l.smithi194.stdout:Aug 11 12:43:30 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-l[155795]: 2023-08-11T12:43:30.952+0000 7f99bbfa8700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-11T12:43:31.394 INFO:journalctl@ceph.mds.l.smithi194.stdout:Aug 11 12:43:30 smithi194 ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-l[155795]: 2023-08-11T12:43:30.952+0000 7f99bbfa8700 -1 mds.l *** got signal Terminated *** 2023-08-11T12:43:34.315 INFO:journalctl@ceph.mds.l.smithi194.stdout:Aug 11 12:43:34 smithi194 bash[165503]: ceph-815f94ae-3840-11ee-9b37-001a4aab830c-mds-l 2023-08-11T12:43:34.321 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-815f94ae-3840-11ee-9b37-001a4aab830c@mds.l.service' 2023-08-11T12:43:34.354 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-11T12:43:34.355 INFO:tasks.cephadm.mds.l:Stopped mds.l 2023-08-11T12:43:34.356 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 815f94ae-3840-11ee-9b37-001a4aab830c --force --keep-logs 2023-08-11T12:43:34.754 INFO:teuthology.orchestra.run.smithi008.stdout:Deleting cluster with fsid: 815f94ae-3840-11ee-9b37-001a4aab830c 2023-08-11T12:43:38.169 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 815f94ae-3840-11ee-9b37-001a4aab830c --force --keep-logs 2023-08-11T12:43:38.485 INFO:teuthology.orchestra.run.smithi045.stdout:Deleting cluster with fsid: 815f94ae-3840-11ee-9b37-001a4aab830c 2023-08-11T12:43:40.151 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 815f94ae-3840-11ee-9b37-001a4aab830c --force --keep-logs 2023-08-11T12:43:40.453 INFO:teuthology.orchestra.run.smithi194.stdout:Deleting cluster with fsid: 815f94ae-3840-11ee-9b37-001a4aab830c 2023-08-11T12:43:42.025 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-08-11T12:43:42.107 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-08-11T12:43:42.144 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-08-11T12:43:42.173 INFO:tasks.cephadm:Archiving crash dumps... 2023-08-11T12:43:42.180 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/crash to /home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365718/remote/smithi008/crash 2023-08-11T12:43:42.181 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/crash -- . 2023-08-11T12:43:42.263 INFO:teuthology.orchestra.run.smithi008.stderr:tar: /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/crash: Cannot open: No such file or directory 2023-08-11T12:43:42.264 INFO:teuthology.orchestra.run.smithi008.stderr:tar: Error is not recoverable: exiting now 2023-08-11T12:43:42.267 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/crash to /home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365718/remote/smithi045/crash 2023-08-11T12:43:42.268 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/crash -- . 2023-08-11T12:43:42.320 INFO:teuthology.orchestra.run.smithi045.stderr:tar: /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/crash: Cannot open: No such file or directory 2023-08-11T12:43:42.320 INFO:teuthology.orchestra.run.smithi045.stderr:tar: Error is not recoverable: exiting now 2023-08-11T12:43:42.323 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/crash to /home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365718/remote/smithi194/crash 2023-08-11T12:43:42.324 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/crash -- . 2023-08-11T12:43:42.357 INFO:teuthology.orchestra.run.smithi194.stderr:tar: /var/lib/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/crash: Cannot open: No such file or directory 2023-08-11T12:43:42.358 INFO:teuthology.orchestra.run.smithi194.stderr:tar: Error is not recoverable: exiting now 2023-08-11T12:43:42.359 INFO:tasks.cephadm:Checking cluster log for badness... 2023-08-11T12:43:42.359 DEBUG:teuthology.orchestra.run.smithi008:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2023-08-11T12:43:42.439 INFO:teuthology.orchestra.run.smithi008.stderr:grep: /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph.log: No such file or directory 2023-08-11T12:43:42.443 INFO:tasks.cephadm:Compressing logs... 2023-08-11T12:43:42.444 DEBUG:teuthology.orchestra.run.smithi008:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-08-11T12:43:42.449 DEBUG:teuthology.orchestra.run.smithi045:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-08-11T12:43:42.451 DEBUG:teuthology.orchestra.run.smithi194:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-08-11T12:43:42.478 INFO:teuthology.orchestra.run.smithi194.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-08-11T12:43:42.479 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-08-11T12:43:42.479 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.5.log 2023-08-11T12:43:42.480 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.2.log 2023-08-11T12:43:42.480 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.11.log 2023-08-11T12:43:42.481 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.5.log: /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mgr.z.log 2023-08-11T12:43:42.481 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.8.log 2023-08-11T12:43:42.481 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mgr.z.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2023-08-11T12:43:42.482 INFO:teuthology.orchestra.run.smithi045.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-08-11T12:43:42.482 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-08-11T12:43:42.483 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.f.log 2023-08-11T12:43:42.483 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.c.log 2023-08-11T12:43:42.484 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.10.log 2023-08-11T12:43:42.484 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.h.log /var/log/ceph/cephadm.log: 2023-08-11T12:43:42.485 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.e.log 2023-08-11T12:43:42.486 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.4.log 2023-08-11T12:43:42.486 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.e.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2023-08-11T12:43:42.487 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.1.log 2023-08-11T12:43:42.487 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.k.log 2023-08-11T12:43:42.488 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-volume.log 2023-08-11T12:43:42.488 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.f.log: /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.c.log: 92.2% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mgr.z.log.gz 2023-08-11T12:43:42.489 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.i.log 2023-08-11T12:43:42.491 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mon.c.log 2023-08-11T12:43:42.492 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.k.log: /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-volume.log: 91.2% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-volume.log.gz 2023-08-11T12:43:42.493 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.7.log 2023-08-11T12:43:42.497 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mon.b.log 2023-08-11T12:43:42.503 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-volume.log 2023-08-11T12:43:42.505 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.b.log 2023-08-11T12:43:42.513 INFO:teuthology.orchestra.run.smithi008.stderr:find: ‘/var/log/rbd-target-api’: No such file or directorygzip 2023-08-11T12:43:42.514 INFO:teuthology.orchestra.run.smithi008.stderr:-5 --verbose -- /var/log/ceph/cephadm.log 2023-08-11T12:43:42.515 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2023-08-11T12:43:42.515 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.0.log 2023-08-11T12:43:42.517 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.g.log 2023-08-11T12:43:42.518 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.a.log 2023-08-11T12:43:42.518 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.g.log: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2023-08-11T12:43:42.519 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.6.log 2023-08-11T12:43:42.520 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.3.log 2023-08-11T12:43:42.520 INFO:teuthology.orchestra.run.smithi008.stderr: 93.2% -- replaced with /var/log/ceph/cephadm.log.gz/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.6.log: 2023-08-11T12:43:42.521 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.d.log 2023-08-11T12:43:42.523 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mgr.x.log 2023-08-11T12:43:42.526 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.d.log: /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.9.log 2023-08-11T12:43:42.530 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-volume.log: 91.2% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-volume.log.gz 2023-08-11T12:43:42.530 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.l.log 2023-08-11T12:43:42.537 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.9.log: 94.4% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.d.log.gz 2023-08-11T12:43:42.537 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-volume.log 2023-08-11T12:43:42.538 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mgr.y.log 2023-08-11T12:43:42.548 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.j.log 2023-08-11T12:43:42.548 INFO:teuthology.orchestra.run.smithi008.stderr: 91.3% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-volume.log.gz 2023-08-11T12:43:42.559 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.j.log: 94.6% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.j.log.gz 2023-08-11T12:43:42.559 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mon.a.log 2023-08-11T12:43:42.574 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mgr.y.log: 92.2% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mgr.y.log.gz 2023-08-11T12:43:42.674 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.l.log: 94.4% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.c.log.gz 2023-08-11T12:43:42.675 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mon.a.log: 93.9% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.g.log.gz 2023-08-11T12:43:42.696 INFO:teuthology.orchestra.run.smithi008.stderr: 94.4% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.a.log.gz 2023-08-11T12:43:42.767 INFO:teuthology.orchestra.run.smithi194.stderr: 94.2% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.l.log.gz 2023-08-11T12:43:42.888 INFO:teuthology.orchestra.run.smithi045.stderr: 94.7% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.h.log.gz 2023-08-11T12:43:42.932 INFO:teuthology.orchestra.run.smithi008.stderr: 89.8% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mgr.x.log.gz 2023-08-11T12:43:43.184 INFO:teuthology.orchestra.run.smithi194.stderr: 91.8% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mon.c.log.gz 2023-08-11T12:43:43.239 INFO:teuthology.orchestra.run.smithi045.stderr: 91.9% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mon.b.log.gz 2023-08-11T12:43:43.393 INFO:teuthology.orchestra.run.smithi194.stderr: 93.9% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.f.log.gz 2023-08-11T12:43:43.686 INFO:teuthology.orchestra.run.smithi008.stderr: 90.5% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mon.a.log.gz 2023-08-11T12:43:44.324 INFO:teuthology.orchestra.run.smithi194.stderr: 94.0% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.i.log.gz 2023-08-11T12:43:46.770 INFO:teuthology.orchestra.run.smithi008.stderr: 92.5% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.0.log.gz 2023-08-11T12:43:47.533 INFO:teuthology.orchestra.run.smithi194.stderr: 92.4% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.11.log.gz 2023-08-11T12:43:47.547 INFO:teuthology.orchestra.run.smithi194.stderr: 92.3% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.8.log.gz 2023-08-11T12:43:47.861 INFO:teuthology.orchestra.run.smithi045.stderr: 92.4% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.1.log.gz 2023-08-11T12:43:47.871 INFO:teuthology.orchestra.run.smithi045.stderr: 92.3% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.7.log.gz 2023-08-11T12:43:48.171 INFO:teuthology.orchestra.run.smithi045.stderr: 97.3% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.k.log.gz 2023-08-11T12:43:49.202 INFO:teuthology.orchestra.run.smithi008.stderr: 92.4% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.6.log.gz 2023-08-11T12:43:49.287 INFO:teuthology.orchestra.run.smithi008.stderr: 92.6% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.9.log.gz 2023-08-11T12:43:49.317 INFO:teuthology.orchestra.run.smithi194.stderr: 92.1% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.2.log.gz 2023-08-11T12:43:49.542 INFO:teuthology.orchestra.run.smithi045.stderr: 92.1% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.10.log.gz 2023-08-11T12:43:50.611 INFO:teuthology.orchestra.run.smithi008.stderr: 92.3% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.3.log.gz 2023-08-11T12:43:50.614 INFO:teuthology.orchestra.run.smithi008.stderr: 2023-08-11T12:43:50.614 INFO:teuthology.orchestra.run.smithi008.stderr:real 0m8.130s 2023-08-11T12:43:50.615 INFO:teuthology.orchestra.run.smithi008.stderr:user 0m25.565s 2023-08-11T12:43:50.615 INFO:teuthology.orchestra.run.smithi008.stderr:sys 0m2.203s 2023-08-11T12:43:52.369 INFO:teuthology.orchestra.run.smithi194.stderr: 92.0% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.5.log.gz 2023-08-11T12:43:52.370 INFO:teuthology.orchestra.run.smithi194.stderr: 2023-08-11T12:43:52.371 INFO:teuthology.orchestra.run.smithi194.stderr:real 0m9.903s 2023-08-11T12:43:52.371 INFO:teuthology.orchestra.run.smithi194.stderr:user 0m29.539s 2023-08-11T12:43:52.371 INFO:teuthology.orchestra.run.smithi194.stderr:sys 0m1.008s 2023-08-11T12:43:54.965 INFO:teuthology.orchestra.run.smithi045.stderr: 92.0% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-osd.4.log.gz 2023-08-11T12:44:20.651 INFO:teuthology.orchestra.run.smithi045.stderr: 97.9% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.e.log.gz 2023-08-11T12:45:18.045 INFO:teuthology.orchestra.run.smithi045.stderr: 98.3% -- replaced with /var/log/ceph/815f94ae-3840-11ee-9b37-001a4aab830c/ceph-mds.b.log.gz 2023-08-11T12:45:18.047 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-08-11T12:45:18.047 INFO:teuthology.orchestra.run.smithi045.stderr:real 1m35.578s 2023-08-11T12:45:18.047 INFO:teuthology.orchestra.run.smithi045.stderr:user 2m43.973s 2023-08-11T12:45:18.048 INFO:teuthology.orchestra.run.smithi045.stderr:sys 0m6.217s 2023-08-11T12:45:18.048 INFO:tasks.cephadm:Archiving logs... 2023-08-11T12:45:18.049 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365718/remote/smithi008/log 2023-08-11T12:45:18.050 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-11T12:45:21.477 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365718/remote/smithi045/log 2023-08-11T12:45:21.478 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-11T12:45:30.755 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365718/remote/smithi194/log 2023-08-11T12:45:30.756 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-11T12:45:34.444 INFO:tasks.cephadm:Removing cluster... 2023-08-11T12:45:34.444 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 815f94ae-3840-11ee-9b37-001a4aab830c --force 2023-08-11T12:45:34.840 INFO:teuthology.orchestra.run.smithi008.stdout:Deleting cluster with fsid: 815f94ae-3840-11ee-9b37-001a4aab830c 2023-08-11T12:45:35.661 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 815f94ae-3840-11ee-9b37-001a4aab830c --force 2023-08-11T12:45:35.986 INFO:teuthology.orchestra.run.smithi045.stdout:Deleting cluster with fsid: 815f94ae-3840-11ee-9b37-001a4aab830c 2023-08-11T12:45:36.555 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 815f94ae-3840-11ee-9b37-001a4aab830c --force 2023-08-11T12:45:36.856 INFO:teuthology.orchestra.run.smithi194.stdout:Deleting cluster with fsid: 815f94ae-3840-11ee-9b37-001a4aab830c 2023-08-11T12:45:37.345 INFO:tasks.cephadm:Removing cephadm ... 2023-08-11T12:45:37.345 DEBUG:teuthology.orchestra.run.smithi008:> rm -rf /home/ubuntu/cephtest/cephadm 2023-08-11T12:45:37.394 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf /home/ubuntu/cephtest/cephadm 2023-08-11T12:45:37.416 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf /home/ubuntu/cephtest/cephadm 2023-08-11T12:45:37.434 INFO:tasks.cephadm:Teardown complete 2023-08-11T12:45:37.434 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-08-11T12:45:37.456 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-08-11T12:45:37.456 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-11T12:45:37.461 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-11T12:45:37.464 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-11T12:45:37.602 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-08-11T12:45:37.616 INFO:teuthology.task.clock:Checking final clock skew... 2023-08-11T12:45:37.617 DEBUG:teuthology.orchestra.run.smithi008:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-11T12:45:37.622 DEBUG:teuthology.orchestra.run.smithi045:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-11T12:45:37.625 DEBUG:teuthology.orchestra.run.smithi194:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-11T12:45:37.641 INFO:teuthology.orchestra.run.smithi194.stderr:bash: ntpq: command not found 2023-08-11T12:45:37.642 INFO:teuthology.orchestra.run.smithi045.stderr:bash: ntpq: command not found 2023-08-11T12:45:37.645 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-11T12:45:37.645 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2023-08-11T12:45:37.646 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 117 +784us[ +784us] +/- 97ms 2023-08-11T12:45:37.646 INFO:teuthology.orchestra.run.smithi194.stdout:^* hv02.front.sepia.ceph.com 3 7 377 117 -860us[ -896us] +/- 50ms 2023-08-11T12:45:37.647 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 47 +624us[ +624us] +/- 86ms 2023-08-11T12:45:37.647 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-08-11T12:45:37.649 INFO:teuthology.orchestra.run.smithi045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-11T12:45:37.649 INFO:teuthology.orchestra.run.smithi045.stdout:=============================================================================== 2023-08-11T12:45:37.650 INFO:teuthology.orchestra.run.smithi045.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 51 +863us[ +863us] +/- 98ms 2023-08-11T12:45:37.650 INFO:teuthology.orchestra.run.smithi045.stdout:^* hv02.front.sepia.ceph.com 3 6 377 55 -836us[ -835us] +/- 51ms 2023-08-11T12:45:37.651 INFO:teuthology.orchestra.run.smithi045.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 +655us[ +655us] +/- 86ms 2023-08-11T12:45:37.651 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-08-11T12:45:37.660 INFO:teuthology.orchestra.run.smithi008.stderr:bash: ntpq: command not found 2023-08-11T12:45:37.668 INFO:teuthology.orchestra.run.smithi008.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-11T12:45:37.668 INFO:teuthology.orchestra.run.smithi008.stdout:=============================================================================== 2023-08-11T12:45:37.668 INFO:teuthology.orchestra.run.smithi008.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 52 +822us[ +822us] +/- 98ms 2023-08-11T12:45:37.669 INFO:teuthology.orchestra.run.smithi008.stdout:^* hv02.front.sepia.ceph.com 3 6 377 53 -838us[ -844us] +/- 51ms 2023-08-11T12:45:37.669 INFO:teuthology.orchestra.run.smithi008.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 +643us[ +643us] +/- 86ms 2023-08-11T12:45:37.669 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-08-11T12:45:37.670 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-08-11T12:45:37.684 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-08-11T12:45:37.685 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-08-11T12:45:37.698 DEBUG:teuthology.orchestra.run.smithi008:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-08-11T12:45:37.896 DEBUG:teuthology.orchestra.run.smithi045:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-08-11T12:45:38.002 DEBUG:teuthology.orchestra.run.smithi194:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-08-11T12:45:38.096 DEBUG:teuthology.orchestra.run.smithi008:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-11T12:45:38.174 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-11T12:45:38.175 DEBUG:teuthology.orchestra.run.smithi045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-11T12:45:38.211 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-11T12:45:38.213 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-11T12:45:38.245 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-11T12:45:38.246 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-08-11T12:45:38.264 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-08-11T12:45:38.280 INFO:teuthology.task.internal:Duration was 2924.522400 seconds 2023-08-11T12:45:38.280 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-08-11T12:45:38.295 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-08-11T12:45:38.297 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-11T12:45:38.302 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-11T12:45:38.304 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-11T12:45:38.351 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-11T12:45:38.354 INFO:teuthology.orchestra.run.smithi045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-11T12:45:38.420 INFO:teuthology.orchestra.run.smithi008.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-11T12:45:38.657 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-08-11T12:45:38.658 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi008.front.sepia.ceph.com 2023-08-11T12:45:38.658 DEBUG:teuthology.orchestra.run.smithi008:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-11T12:45:38.719 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi045.front.sepia.ceph.com 2023-08-11T12:45:38.719 DEBUG:teuthology.orchestra.run.smithi045:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-11T12:45:38.745 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi194.front.sepia.ceph.com 2023-08-11T12:45:38.746 DEBUG:teuthology.orchestra.run.smithi194:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-11T12:45:38.767 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-08-11T12:45:38.767 DEBUG:teuthology.orchestra.run.smithi008:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-11T12:45:38.772 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-11T12:45:38.788 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-11T12:45:38.987 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-08-11T12:45:38.987 DEBUG:teuthology.orchestra.run.smithi008:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-11T12:45:38.992 DEBUG:teuthology.orchestra.run.smithi045:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-11T12:45:38.994 DEBUG:teuthology.orchestra.run.smithi194:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-11T12:45:39.161 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-08-11T12:45:39.173 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-08-11T12:45:39.174 DEBUG:teuthology.orchestra.run.smithi008:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-11T12:45:39.244 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-11T12:45:39.272 DEBUG:teuthology.orchestra.run.smithi194:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-11T12:45:39.299 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-08-11T12:45:39.315 DEBUG:teuthology.orchestra.run.smithi008:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-11T12:45:39.320 DEBUG:teuthology.orchestra.run.smithi045:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-11T12:45:39.322 DEBUG:teuthology.orchestra.run.smithi194:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-11T12:45:39.347 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = core 2023-08-11T12:45:39.365 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = core 2023-08-11T12:45:39.384 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern = core 2023-08-11T12:45:39.421 DEBUG:teuthology.orchestra.run.smithi008:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-11T12:45:39.462 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-11T12:45:39.463 DEBUG:teuthology.orchestra.run.smithi045:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-11T12:45:39.480 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-11T12:45:39.481 DEBUG:teuthology.orchestra.run.smithi194:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-11T12:45:39.496 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-11T12:45:39.497 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-08-11T12:45:39.511 INFO:teuthology.task.internal:Transferring archived files... 2023-08-11T12:45:39.512 DEBUG:teuthology.misc:Transferring archived files from smithi008:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365718/remote/smithi008 2023-08-11T12:45:39.513 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-11T12:45:39.595 DEBUG:teuthology.misc:Transferring archived files from smithi045:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365718/remote/smithi045 2023-08-11T12:45:39.596 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-11T12:45:39.640 DEBUG:teuthology.misc:Transferring archived files from smithi194:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365718/remote/smithi194 2023-08-11T12:45:39.640 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-11T12:45:39.678 INFO:teuthology.task.internal:Removing archive directory... 2023-08-11T12:45:39.679 DEBUG:teuthology.orchestra.run.smithi008:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-11T12:45:39.687 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-11T12:45:39.689 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-11T12:45:39.728 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-08-11T12:45:39.743 INFO:teuthology.task.internal:Not uploading archives. 2023-08-11T12:45:39.744 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-08-11T12:45:39.758 INFO:teuthology.task.internal:Tidying up after the test... 2023-08-11T12:45:39.758 DEBUG:teuthology.orchestra.run.smithi008:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-11T12:45:39.767 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-11T12:45:39.770 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-11T12:45:39.784 INFO:teuthology.orchestra.run.smithi045.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 11 12:45 /home/ubuntu/cephtest 2023-08-11T12:45:39.786 INFO:teuthology.orchestra.run.smithi194.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 11 12:45 /home/ubuntu/cephtest 2023-08-11T12:45:39.806 INFO:teuthology.orchestra.run.smithi008.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 11 12:45 /home/ubuntu/cephtest 2023-08-11T12:45:39.809 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-08-11T12:45:39.824 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-08-11T12:45:39.854 INFO:teuthology.nuke:Checking targets against current locks 2023-08-11T12:45:39.882 DEBUG:teuthology.nuke:shortname: smithi008 2023-08-11T12:45:39.883 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-11T12:45:39.906 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365718', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-11 11:48:13.013822', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-11T12:45:39.910 DEBUG:teuthology.nuke:shortname: smithi045 2023-08-11T12:45:39.910 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-11T12:45:39.930 DEBUG:teuthology.nuke:shortname: smithi194 2023-08-11T12:45:39.931 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-11T12:45:39.937 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365718', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-11 11:48:13.017444', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-11T12:45:39.966 INFO:teuthology.orchestra.console.smithi008:Power off 2023-08-11T12:45:39.968 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-11T12:45:39.983 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365718', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-11 11:48:13.015521', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-11T12:45:39.993 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off 2023-08-11T12:45:39.994 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T12:45:40.018 INFO:teuthology.orchestra.console.smithi045:Power off 2023-08-11T12:45:40.019 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-11T12:45:40.038 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2023-08-11T12:45:40.043 DEBUG:teuthology.orchestra.console.smithi045:power off output: Chassis Power Control: Down/Off 2023-08-11T12:45:40.044 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T12:45:40.069 INFO:teuthology.orchestra.console.smithi194:Power off 2023-08-11T12:45:40.070 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-11T12:45:40.082 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-08-11T12:45:40.095 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2023-08-11T12:45:40.095 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T12:45:40.118 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2023-08-11T12:45:44.039 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T12:45:44.084 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T12:45:44.120 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T12:45:44.152 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2023-08-11T12:45:44.197 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-08-11T12:45:44.234 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2023-08-11T12:45:48.156 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T12:45:48.199 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T12:45:48.236 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T12:45:48.267 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2023-08-11T12:45:48.311 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2023-08-11T12:45:48.350 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-08-11T12:45:48.369 INFO:teuthology.orchestra.console.smithi008:Power off completed 2023-08-11T12:45:48.412 INFO:teuthology.orchestra.console.smithi045:Power off completed 2023-08-11T12:45:48.451 INFO:teuthology.orchestra.console.smithi194:Power off completed 2023-08-11T12:45:48.559 INFO:teuthology.run:Summary data: client.0-kernel-sha1: a7fb1265323db972dd333f71b9a53e9479f62e37 description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/postgres}} duration: 2924.5224001407623 failure_reason: 'Command failed on smithi008 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -c ''sudo -u postgres -- pgbench -s 500 -i''"' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=131e6996218e42dbadd9f9c0b2bcd491 status: fail success: false 2023-08-11T12:45:48.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:45:48.641 INFO:teuthology.run:FAIL